==>(B Building on smoochum(B ==>(B Checking for remote environment...(B ==>(B Syncing package to remote host...(B sending incremental file list created directory packages/seaweedfs ./ .SRCINFO 430B 100% 0B/s 0:00:00 430B 100% 0B/s 0:00:00 (xfr#1, to-chk=7/9) .nvchecker.toml 91B 100% 91.0KB/s 0:00:00 91B 100% 91.0KB/s 0:00:00 (xfr#2, to-chk=6/9) LICENSE 646B 100% 646KB/s 0:00:00 646B 100% 646KB/s 0:00:00 (xfr#3, to-chk=5/9) PKGBUILD 1,486B 100% 1.49MB/s 0:00:00 1,486B 100% 1.49MB/s 0:00:00 (xfr#4, to-chk=4/9) REUSE.toml 375B 100% 375KB/s 0:00:00 375B 100% 375KB/s 0:00:00 (xfr#5, to-chk=3/9) seaweedfs-4.54-1.log 855B 100% 855KB/s 0:00:00 855B 100% 855KB/s 0:00:00 (xfr#6, to-chk=2/9) LICENSES/ LICENSES/0BSD.txt -> ../LICENSE sent 2,528 bytes received 185 bytes 1,808.67 bytes/sec total size is 3,245 speedup is 1.20 ==>(B Applying RISC-V patches...(B sending incremental file list ./ riscv64.patch 582B 100% 0B/s 0:00:00 582B 100% 0B/s 0:00:00 (xfr#1, to-chk=0/2) sent 456 bytes received 38 bytes 329.33 bytes/sec total size is 582 speedup is 1.18 patching file PKGBUILD ==>(B Patching arch to riscv64...(B ==>(B Running pkgctl build --arch riscv64 on remote host...(B ==> WARNING:(B invalid architecture: riscv64(B ==>(B Updating pacman database cache(B [?25l:: Synchronizing package databases... core downloading... extra downloading... multilib downloading... [?25h==>(B Building seaweedfs(B  ->(B repo: extra(B  ->(B arch: riscv64(B  ->(B worker: felix-8(B ==>(B Building seaweedfs for [extra] (riscv64)(B ]3008;start=5bc457e1bb254421b8de9a13282eae22;user=felix;hostname=smoochum.felixc.at;machineid=77eccab17314487ca80710578b50c923;bootid=abe36af9c93d490fa218c75a14ed2c6b;pid=2222372;pidfdid=39964108;comm=sudo;targetuser=root;type=session\Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. ]3008;start=71ad4c71ff6a4cdb8f057d101e7ba449;user=root;hostname=smoochum.felixc.at;machineid=77eccab17314487ca80710578b50c923;bootid=abe36af9c93d490fa218c75a14ed2c6b;pid=2222510;pidfdid=39964246;comm=systemd-nspawn;container=arch-nspawn-2222510;type=container\]11;?\]2;🔵 Container arch-nspawn-2222510 on smoochum.felixc.at\[?25l:: Synchronizing package databases... core downloading... extra downloading... :: Starting full system upgrade... there is nothing to do [?25h[!p]104\[?7h]3008;end=71ad4c71ff6a4cdb8f057d101e7ba449\==>(B Building in chroot for [extra] (riscv64)...(B ==>(B Synchronizing chroot copy [/var/lib/archbuild/extra-riscv64/root] -> [felix-8]...(Bdone(B ]3008;start=91fe7ad4beaf4226bbaa000b99236f3b;user=root;hostname=smoochum.felixc.at;machineid=77eccab17314487ca80710578b50c923;bootid=abe36af9c93d490fa218c75a14ed2c6b;pid=2224656;pidfdid=39966392;comm=sudo;targetuser=felix;type=session\==>(B Making package: seaweedfs 4.54-1 (Tue Nov 17 07:17:29 2026)(B ==>(B Retrieving sources...(B  ->(B Downloading seaweedfs-4.54.tar.gz...(B % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 100 966.6k 0 966.6k 0 0 483.7k 0 00:01 963.9k 100 6.52M 0 6.52M 0 0 2.16M 0 00:03 3.23M 100 13.10M 0 13.10M 0 0 3.26M 0 00:04 4.34M 100 21.59M 0 21.59M 0 0 4.29M 0 00:05 5.36M 100 30.18M 0 30.18M 0 0 5.01M 0 00:06 6.00M 100 35.01M 0 35.01M 0 0 4.97M 0 00:07 6.75M 100 42.29M 0 42.29M 0 0 5.25M 0 00:08 7.10M 100 53.75M 0 53.75M 0 0 5.93M 0 00:09 8.06M 100 64.50M 0 64.50M 0 0 6.40M 0 00:10 8.50M 100 72.17M 0 72.17M 0 0 6.52M 0 00:11 8.32M 100 79.25M 0 79.25M 0 0 6.64M 0 00:11 8.32M 100 79.25M 0 79.25M 0 0 6.64M 0 00:11 8.32M 100 79.25M 0 79.25M 0 0 6.64M 0 00:11 8.32M ==>(B Validating source files with sha256sums...(B seaweedfs-4.54.tar.gz ... Passed ]3008;end=91fe7ad4beaf4226bbaa000b99236f3b\Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. ]3008;start=ce48ffb52c834acb82a91267425e4ec1;user=root;hostname=smoochum.felixc.at;machineid=77eccab17314487ca80710578b50c923;bootid=abe36af9c93d490fa218c75a14ed2c6b;pid=2227166;pidfdid=39968902;comm=systemd-nspawn;container=makechrootpkg-seaweedfs.build.2222444;type=container\]11;?\]2;🔵 Container makechrootpkg-seaweedfs.build.2222444 on smoochum.felixc.at\]3008;start=0c0f3de5c47e45578c7c086935ee7516;user=root;hostname=makechrootpkg-seaweedfs.build.2222444;machineid=c7dd088d07b14b1a9064811f96268186;bootid=6f81d66545c34edba4adca32bbf85a62;pid=34;pidfdid=39969410;comm=sudo;targetuser=builduser;type=session\==>(B Making package: seaweedfs 4.54-1 (Tue Nov 17 07:18:28 2026)(B ==>(B Checking runtime dependencies...(B ==>(B Installing missing dependencies...(B ]3008;start=dd08dbb6f1304539a7ab5ad3d76a26fa;user=builduser;hostname=makechrootpkg-seaweedfs.build.2222444;machineid=c7dd088d07b14b1a9064811f96268186;bootid=6f81d66545c34edba4adca32bbf85a62;pid=3207;pidfdid=39974283;comm=sudo;targetuser=root;type=session\[?25lresolving dependencies... looking for conflicting packages... Package (1) New Version Net Change Download Size extra/mailcap 2.1.54-3 0.11 MiB 0.03 MiB Total Download Size: 0.03 MiB Total Installed Size: 0.11 MiB :: Proceed with installation? [Y/n] :: Retrieving packages... mailcap-2.1.54-3-any downloading... checking keyring... checking package integrity... loading package files... checking for file conflicts... :: Processing package changes... installing mailcap... :: Running post-transaction hooks... (1/1) Arming ConditionNeedsUpdate... [?25h]3008;end=dd08dbb6f1304539a7ab5ad3d76a26fa\==>(B Checking buildtime dependencies...(B ==>(B Installing missing dependencies...(B ]3008;start=631e66533bb5446e9009d940e75db3d2;user=builduser;hostname=makechrootpkg-seaweedfs.build.2222444;machineid=c7dd088d07b14b1a9064811f96268186;bootid=6f81d66545c34edba4adca32bbf85a62;pid=3311;pidfdid=39974615;comm=sudo;targetuser=root;type=session\[?25lresolving dependencies... looking for conflicting packages... Package (1) New Version Net Change extra/go 2:1.27.4-1 217.18 MiB Total Installed Size: 217.18 MiB :: Proceed with installation? [Y/n] checking keyring... checking package integrity... loading package files... checking for file conflicts... :: Processing package changes... installing go... :: Running post-transaction hooks... (1/1) Arming ConditionNeedsUpdate... [?25h]3008;end=631e66533bb5446e9009d940e75db3d2\==>(B Retrieving sources...(B  ->(B Found seaweedfs-4.54.tar.gz(B ==> WARNING:(B Skipping all source file integrity checks.(B ==>(B Extracting sources...(B  ->(B Extracting seaweedfs-4.54.tar.gz with bsdtar(B ==>(B Starting prepare()...(B ==>(B Starting build()...(B ==>(B Starting check()...(B ? github.com/seaweedfs/seaweedfs/weed [no test files] === RUN TestStaticGzMirror --- PASS: TestStaticGzMirror (0.50s) === RUN TestStaticHandlerGzip --- PASS: TestStaticHandlerGzip (0.24s) === RUN TestStaticHandlerIdentity --- PASS: TestStaticHandlerIdentity (0.06s) === RUN TestStaticHandlerNotModified --- PASS: TestStaticHandlerNotModified (0.00s) === RUN TestStaticHandlerVariantETags --- PASS: TestStaticHandlerVariantETags (0.01s) === RUN TestStaticHandlerNotFound --- PASS: TestStaticHandlerNotFound (0.01s) === RUN TestAcceptsGzip --- PASS: TestAcceptsGzip (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/admin 1.113s === RUN TestApplyDefaults_WithEmbeddedStruct --- PASS: TestApplyDefaults_WithEmbeddedStruct (0.01s) === RUN TestApplyDefaults_PartiallySet --- PASS: TestApplyDefaults_PartiallySet (0.00s) === RUN TestApplyDefaults_NonPointer --- PASS: TestApplyDefaults_NonPointer (0.00s) === RUN TestApplyDefaults_NonStruct --- PASS: TestApplyDefaults_NonStruct (0.00s) === RUN TestApplyDefaults_EmptySchema --- PASS: TestApplyDefaults_EmptySchema (0.00s) === RUN TestApplyDefaults_MissingSchemaField --- PASS: TestApplyDefaults_MissingSchemaField (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/admin/config 0.226s === RUN TestRaftMasterHttpAddress === RUN TestRaftMasterHttpAddress/goraft_names_members_by_full_address === RUN TestRaftMasterHttpAddress/hashicorp_names_members_by_http_address === RUN TestRaftMasterHttpAddress/default_ports === RUN TestRaftMasterHttpAddress/ipv6 === RUN TestRaftMasterHttpAddress/id_that_is_not_an_address === RUN TestRaftMasterHttpAddress/id_without_a_valid_port --- PASS: TestRaftMasterHttpAddress (0.01s) --- PASS: TestRaftMasterHttpAddress/goraft_names_members_by_full_address (0.00s) --- PASS: TestRaftMasterHttpAddress/hashicorp_names_members_by_http_address (0.00s) --- PASS: TestRaftMasterHttpAddress/default_ports (0.00s) --- PASS: TestRaftMasterHttpAddress/ipv6 (0.00s) --- PASS: TestRaftMasterHttpAddress/id_that_is_not_an_address (0.00s) --- PASS: TestRaftMasterHttpAddress/id_without_a_valid_port (0.00s) === RUN TestAdminLockManagerStatusWhileWaiting === RUN TestAdminLockManagerStatusWhileWaiting/plugin_scheduler_vacuum_detection === RUN TestAdminLockManagerStatusWhileWaiting/plugin_scheduler_vacuum_job_vacuum-1 --- PASS: TestAdminLockManagerStatusWhileWaiting (0.01s) --- PASS: TestAdminLockManagerStatusWhileWaiting/plugin_scheduler_vacuum_detection (0.01s) --- PASS: TestAdminLockManagerStatusWhileWaiting/plugin_scheduler_vacuum_job_vacuum-1 (0.00s) === RUN TestAdminLockManagerRefCountsOverlappingHolds === PAUSE TestAdminLockManagerRefCountsOverlappingHolds === RUN TestAdminLockManagerYieldsBeforeReacquire === PAUSE TestAdminLockManagerYieldsBeforeReacquire === RUN TestAdminLockManagerFairnessWindowForcesFullRelease === PAUSE TestAdminLockManagerFairnessWindowForcesFullRelease === RUN TestAdminLockManagerAcquireWaitsForReleaseInFlight === PAUSE TestAdminLockManagerAcquireWaitsForReleaseInFlight === RUN TestAdminLockManagerZeroFairnessWindowKeepsJoining === PAUSE TestAdminLockManagerZeroFairnessWindowKeepsJoining === RUN TestAdminLockManagerSetFairnessWindowWakesWaiters === PAUSE TestAdminLockManagerSetFairnessWindowWakesWaiters === RUN TestListClusterNodesRequestIncludesFilerGroup --- PASS: TestListClusterNodesRequestIncludesFilerGroup (0.00s) === RUN TestListClusterNodesRequestKeepsDefaultFilerGroupEmpty --- PASS: TestListClusterNodesRequestKeepsDefaultFilerGroupEmpty (0.00s) === RUN TestVectorDiscoveryUsesRegistrationGroup --- PASS: TestVectorDiscoveryUsesRegistrationGroup (0.00s) === RUN TestCleanMaintenanceScript === RUN TestCleanMaintenanceScript/empty === RUN TestCleanMaintenanceScript/only_lock_unlock === RUN TestCleanMaintenanceScript/strips_lock_and_unlock === RUN TestCleanMaintenanceScript/case_insensitive_lock === RUN TestCleanMaintenanceScript/preserves_comments_removal === RUN TestCleanMaintenanceScript/no_lock_unlock_present === RUN TestCleanMaintenanceScript/windows_line_endings === RUN TestCleanMaintenanceScript/lock_with_inline_comment === RUN TestCleanMaintenanceScript/command_with_inline_comment_preserved === RUN TestCleanMaintenanceScript/only_inline_comment_after_stripping === RUN TestCleanMaintenanceScript/typical_master_default --- PASS: TestCleanMaintenanceScript (0.01s) --- PASS: TestCleanMaintenanceScript/empty (0.00s) --- PASS: TestCleanMaintenanceScript/only_lock_unlock (0.00s) --- PASS: TestCleanMaintenanceScript/strips_lock_and_unlock (0.00s) --- PASS: TestCleanMaintenanceScript/case_insensitive_lock (0.00s) --- PASS: TestCleanMaintenanceScript/preserves_comments_removal (0.00s) --- PASS: TestCleanMaintenanceScript/no_lock_unlock_present (0.00s) --- PASS: TestCleanMaintenanceScript/windows_line_endings (0.00s) --- PASS: TestCleanMaintenanceScript/lock_with_inline_comment (0.00s) --- PASS: TestCleanMaintenanceScript/command_with_inline_comment_preserved (0.00s) --- PASS: TestCleanMaintenanceScript/only_inline_comment_after_stripping (0.00s) --- PASS: TestCleanMaintenanceScript/typical_master_default (0.00s) === RUN TestValidateBucketLifecycleRules_Valid --- PASS: TestValidateBucketLifecycleRules_Valid (0.00s) === RUN TestValidateBucketLifecycleRules_Empty --- PASS: TestValidateBucketLifecycleRules_Empty (0.00s) === RUN TestValidateBucketLifecycleRules_TooManyRules --- PASS: TestValidateBucketLifecycleRules_TooManyRules (0.00s) === RUN TestValidateBucketLifecycleRules_DuplicateIDs --- PASS: TestValidateBucketLifecycleRules_DuplicateIDs (0.00s) === RUN TestValidateBucketLifecycleRules_IDTooLong --- PASS: TestValidateBucketLifecycleRules_IDTooLong (0.00s) === RUN TestValidateBucketLifecycleRules_InvalidStatus --- PASS: TestValidateBucketLifecycleRules_InvalidStatus (0.00s) === RUN TestValidateBucketLifecycleRules_ExpirationDaysAndDateMutuallyExclusive --- PASS: TestValidateBucketLifecycleRules_ExpirationDaysAndDateMutuallyExclusive (0.00s) === RUN TestValidateBucketLifecycleRules_DeleteMarkerWithExpirationDaysRejected --- PASS: TestValidateBucketLifecycleRules_DeleteMarkerWithExpirationDaysRejected (0.00s) === RUN TestValidateBucketLifecycleRules_DeleteMarkerWithExpirationDateRejected --- PASS: TestValidateBucketLifecycleRules_DeleteMarkerWithExpirationDateRejected (0.00s) === RUN TestValidateBucketLifecycleRules_DeleteMarkerAlone --- PASS: TestValidateBucketLifecycleRules_DeleteMarkerAlone (0.00s) === RUN TestValidateBucketLifecycleRules_InvalidExpirationDate --- PASS: TestValidateBucketLifecycleRules_InvalidExpirationDate (0.00s) === RUN TestValidateBucketLifecycleRules_NegativeExpirationDays --- PASS: TestValidateBucketLifecycleRules_NegativeExpirationDays (0.00s) === RUN TestValidateBucketLifecycleRules_StandaloneNewerNoncurrentVersions --- PASS: TestValidateBucketLifecycleRules_StandaloneNewerNoncurrentVersions (0.00s) === RUN TestValidateBucketLifecycleRules_NegativeAbortMultipartDays --- PASS: TestValidateBucketLifecycleRules_NegativeAbortMultipartDays (0.00s) === RUN TestValidateBucketLifecycleRules_SizeGreaterThanNotLessThanSizeLessThan --- PASS: TestValidateBucketLifecycleRules_SizeGreaterThanNotLessThanSizeLessThan (0.00s) === RUN TestValidateBucketLifecycleRules_NegativeSizeBounds --- PASS: TestValidateBucketLifecycleRules_NegativeSizeBounds (0.00s) === RUN TestValidateBucketLifecycleRules_EmptyTagKey --- PASS: TestValidateBucketLifecycleRules_EmptyTagKey (0.00s) === RUN TestValidateBucketLifecycleRules_EmptyTagValue --- PASS: TestValidateBucketLifecycleRules_EmptyTagValue (0.00s) === RUN TestValidateBucketLifecycleRules_NoAction --- PASS: TestValidateBucketLifecycleRules_NoAction (0.00s) === RUN TestFromBucketLifecycleRule_MapsAllFields --- PASS: TestFromBucketLifecycleRule_MapsAllFields (0.00s) === RUN TestFromBucketLifecycleRule_EmptyExpirationDate --- PASS: TestFromBucketLifecycleRule_EmptyExpirationDate (0.00s) === RUN TestFromBucketLifecycleRule_InvalidExpirationDate --- PASS: TestFromBucketLifecycleRule_InvalidExpirationDate (0.00s) === RUN TestBucketLifecycleMutation_SetsXML --- PASS: TestBucketLifecycleMutation_SetsXML (0.00s) === RUN TestBucketLifecycleMutation_ClearsBothKeys --- PASS: TestBucketLifecycleMutation_ClearsBothKeys (0.00s) === RUN TestBucketLifecycleMutation_TouchesOnlyLifecycleKeys --- PASS: TestBucketLifecycleMutation_TouchesOnlyLifecycleKeys (0.00s) === RUN TestSetBucketLifecycle_RejectsOversizedConfiguration --- PASS: TestSetBucketLifecycle_RejectsOversizedConfiguration (0.11s) === RUN TestBucketLifecycleErrorStatus --- PASS: TestBucketLifecycleErrorStatus (0.00s) === RUN TestBucketPolicyMutation_SetsPolicy --- PASS: TestBucketPolicyMutation_SetsPolicy (0.00s) === RUN TestBucketPolicyMutation_ClearsKey --- PASS: TestBucketPolicyMutation_ClearsKey (0.00s) === RUN TestBucketPolicyMutation_TouchesOnlyPolicyKey --- PASS: TestBucketPolicyMutation_TouchesOnlyPolicyKey (0.00s) === RUN TestExtractPolicyStatementCountFromEntry === RUN TestExtractPolicyStatementCountFromEntry/no_extended_attrs === RUN TestExtractPolicyStatementCountFromEntry/absent_key === RUN TestExtractPolicyStatementCountFromEntry/one_statement === RUN TestExtractPolicyStatementCountFromEntry/three_statements === RUN TestExtractPolicyStatementCountFromEntry/garbage_bytes --- PASS: TestExtractPolicyStatementCountFromEntry (0.03s) --- PASS: TestExtractPolicyStatementCountFromEntry/no_extended_attrs (0.00s) --- PASS: TestExtractPolicyStatementCountFromEntry/absent_key (0.00s) --- PASS: TestExtractPolicyStatementCountFromEntry/one_statement (0.02s) --- PASS: TestExtractPolicyStatementCountFromEntry/three_statements (0.00s) --- PASS: TestExtractPolicyStatementCountFromEntry/garbage_bytes (0.00s) === RUN TestBucketPolicyErrorStatus --- PASS: TestBucketPolicyErrorStatus (0.00s) === RUN TestSetBucketPolicy_RejectsOversized --- PASS: TestSetBucketPolicy_RejectsOversized (0.01s) === RUN TestSetBucketPolicy_RejectsForeignResource --- PASS: TestSetBucketPolicy_RejectsForeignResource (0.00s) === RUN TestSetBucketPolicy_RejectsMissingPrincipal --- PASS: TestSetBucketPolicy_RejectsMissingPrincipal (0.00s) === RUN TestCollectCollectionStatsECUnevenShards --- PASS: TestCollectCollectionStatsECUnevenShards (0.00s) === RUN TestCollectCollectionStatsECEmptyCollection --- PASS: TestCollectCollectionStatsECEmptyCollection (0.00s) === RUN TestCollectCollectionStatsECFileAndDeleteCountAggregation --- PASS: TestCollectCollectionStatsECFileAndDeleteCountAggregation (0.00s) === RUN TestCollectCollectionStatsECDeleteCountAboveFileCount --- PASS: TestCollectCollectionStatsECDeleteCountAboveFileCount (0.00s) === RUN TestCollectCollectionStatsECFileCountMaxDedupe --- PASS: TestCollectCollectionStatsECFileCountMaxDedupe (0.00s) === RUN TestTotalCollectionFileCount --- PASS: TestTotalCollectionFileCount (0.00s) === RUN TestTotalCollectionFileCountUnderReplicated --- PASS: TestTotalCollectionFileCountUnderReplicated (0.00s) === RUN TestApplyMaintenanceConfigFromToml I1117 09:26:18.194491 config_toml.go:142 Applied [maintenance.vacuum] settings from admin.toml I1117 09:26:18.215612 config_toml.go:154 Applied [maintenance.erasure_coding] settings from admin.toml --- PASS: TestApplyMaintenanceConfigFromToml (0.08s) === RUN TestApplyMaintenanceConfigFromTomlEnabledToggle I1117 09:26:18.230169 config_toml.go:136 Applied [maintenance] settings from admin.toml (enabled: false) I1117 09:26:18.241103 config_toml.go:136 Applied [maintenance] settings from admin.toml (enabled: true) --- PASS: TestApplyMaintenanceConfigFromTomlEnabledToggle (0.02s) === RUN TestApplyMaintenanceConfigFromTomlNoKeys --- PASS: TestApplyMaintenanceConfigFromTomlNoKeys (0.00s) === RUN TestApplyMaintenanceConfigFromTomlRequiresDataDir --- PASS: TestApplyMaintenanceConfigFromTomlRequiresDataDir (0.00s) === RUN TestApplyPluginConfigFromTomlUpdatesExistingConfig I1117 09:26:18.289476 config_toml.go:199 Applied [maintenance.vacuum] settings from admin.toml to plugin config --- PASS: TestApplyPluginConfigFromTomlUpdatesExistingConfig (0.04s) === RUN TestApplyPluginConfigFromTomlClampsRetryValues I1117 09:26:18.300121 config_toml.go:199 Applied [maintenance.vacuum] settings from admin.toml to plugin config --- PASS: TestApplyPluginConfigFromTomlClampsRetryValues (0.00s) === RUN TestApplyPluginConfigFromTomlLeavesMissingConfigToBootstrap --- PASS: TestApplyPluginConfigFromTomlLeavesMissingConfigToBootstrap (0.00s) === RUN TestApplyPluginTomlDefaultsOverlaysBootstrapConfig I1117 09:26:18.308138 config_toml.go:210 Applied [maintenance.vacuum] settings from admin.toml to plugin defaults --- PASS: TestApplyPluginTomlDefaultsOverlaysBootstrapConfig (0.01s) === RUN TestApplyPluginConfigFromTomlErasureCodingKeyPlacement I1117 09:26:18.315121 config_toml.go:199 Applied [maintenance.erasure_coding] settings from admin.toml to plugin config --- PASS: TestApplyPluginConfigFromTomlErasureCodingKeyPlacement (0.01s) === RUN TestApplyMaintenanceConfigFromTomlMaxShardTransfers I1117 09:26:18.323025 config_toml.go:154 Applied [maintenance.erasure_coding] settings from admin.toml I1117 09:26:18.326808 config_toml.go:154 Applied [maintenance.erasure_coding] settings from admin.toml I1117 09:26:18.330167 config_toml.go:154 Applied [maintenance.erasure_coding] settings from admin.toml I1117 09:26:18.333424 config_toml.go:154 Applied [maintenance.erasure_coding] settings from admin.toml --- PASS: TestApplyMaintenanceConfigFromTomlMaxShardTransfers (0.02s) === RUN TestApplyPluginConfigFromTomlMaxShardTransfers I1117 09:26:18.338196 config_toml.go:199 Applied [maintenance.erasure_coding] settings from admin.toml to plugin config I1117 09:26:18.340468 config_toml.go:199 Applied [maintenance.erasure_coding] settings from admin.toml to plugin config --- PASS: TestApplyPluginConfigFromTomlMaxShardTransfers (0.01s) === RUN TestApplyPluginConfigFromTomlS3Lifecycle I1117 09:26:18.344573 config_toml.go:199 Applied [maintenance.s3_lifecycle] settings from admin.toml to plugin config --- PASS: TestApplyPluginConfigFromTomlS3Lifecycle (0.00s) === RUN TestGenerateBreadcrumbs === RUN TestGenerateBreadcrumbs/root_path === RUN TestGenerateBreadcrumbs/simple_path === RUN TestGenerateBreadcrumbs/nested_path === RUN TestGenerateBreadcrumbs/bucket_path === RUN TestGenerateBreadcrumbs/bucket_nested_path === RUN TestGenerateBreadcrumbs/path_with_trailing_slash --- PASS: TestGenerateBreadcrumbs (0.00s) --- PASS: TestGenerateBreadcrumbs/root_path (0.00s) --- PASS: TestGenerateBreadcrumbs/simple_path (0.00s) --- PASS: TestGenerateBreadcrumbs/nested_path (0.00s) --- PASS: TestGenerateBreadcrumbs/bucket_path (0.00s) --- PASS: TestGenerateBreadcrumbs/bucket_nested_path (0.00s) --- PASS: TestGenerateBreadcrumbs/path_with_trailing_slash (0.00s) === RUN TestS3ObjectURL === RUN TestS3ObjectURL/simple_object === RUN TestS3ObjectURL/space_hash_and_question_mark_in_key === RUN TestS3ObjectURL/non-ascii_key === RUN TestS3ObjectURL/percent_in_key === RUN TestS3ObjectURL/trailing_slash_on_endpoint === RUN TestS3ObjectURL/not_a_bucket_path === RUN TestS3ObjectURL/empty_endpoint --- PASS: TestS3ObjectURL (0.00s) --- PASS: TestS3ObjectURL/simple_object (0.00s) --- PASS: TestS3ObjectURL/space_hash_and_question_mark_in_key (0.00s) --- PASS: TestS3ObjectURL/non-ascii_key (0.00s) --- PASS: TestS3ObjectURL/percent_in_key (0.00s) --- PASS: TestS3ObjectURL/trailing_slash_on_endpoint (0.00s) --- PASS: TestS3ObjectURL/not_a_bucket_path (0.00s) --- PASS: TestS3ObjectURL/empty_endpoint (0.00s) === RUN TestNormalizeS3PublicEndpoint W1117 09:26:18.359282 admin_server.go:1608 ignoring s3.public_endpoint: expecting an http:// or https:// URL with a host and no credentials, query, or fragment W1117 09:26:18.366290 admin_server.go:1608 ignoring s3.public_endpoint: expecting an http:// or https:// URL with a host and no credentials, query, or fragment W1117 09:26:18.366565 admin_server.go:1608 ignoring s3.public_endpoint: expecting an http:// or https:// URL with a host and no credentials, query, or fragment W1117 09:26:18.366723 admin_server.go:1608 ignoring s3.public_endpoint: expecting an http:// or https:// URL with a host and no credentials, query, or fragment W1117 09:26:18.366899 admin_server.go:1608 ignoring s3.public_endpoint: expecting an http:// or https:// URL with a host and no credentials, query, or fragment W1117 09:26:18.367144 admin_server.go:1608 ignoring s3.public_endpoint: expecting an http:// or https:// URL with a host and no credentials, query, or fragment W1117 09:26:18.367271 admin_server.go:1608 ignoring s3.public_endpoint: expecting an http:// or https:// URL with a host and no credentials, query, or fragment W1117 09:26:18.367702 admin_server.go:1608 ignoring s3.public_endpoint: expecting an http:// or https:// URL with a host and no credentials, query, or fragment --- PASS: TestNormalizeS3PublicEndpoint (0.01s) === RUN TestPathHandlingWithForwardSlashes === RUN TestPathHandlingWithForwardSlashes/root === RUN TestPathHandlingWithForwardSlashes/single_level === RUN TestPathHandlingWithForwardSlashes/multiple_levels === RUN TestPathHandlingWithForwardSlashes/bucket_path --- PASS: TestPathHandlingWithForwardSlashes (0.00s) --- PASS: TestPathHandlingWithForwardSlashes/root (0.00s) --- PASS: TestPathHandlingWithForwardSlashes/single_level (0.00s) --- PASS: TestPathHandlingWithForwardSlashes/multiple_levels (0.00s) --- PASS: TestPathHandlingWithForwardSlashes/bucket_path (0.00s) === RUN TestParentPathCalculationLogic === RUN TestParentPathCalculationLogic/root_path === RUN TestParentPathCalculationLogic/single_level === RUN TestParentPathCalculationLogic/two_levels === RUN TestParentPathCalculationLogic/deep_nesting === RUN TestParentPathCalculationLogic/bucket_root === RUN TestParentPathCalculationLogic/bucket_directory --- PASS: TestParentPathCalculationLogic (0.00s) --- PASS: TestParentPathCalculationLogic/root_path (0.00s) --- PASS: TestParentPathCalculationLogic/single_level (0.00s) --- PASS: TestParentPathCalculationLogic/two_levels (0.00s) --- PASS: TestParentPathCalculationLogic/deep_nesting (0.00s) --- PASS: TestParentPathCalculationLogic/bucket_root (0.00s) --- PASS: TestParentPathCalculationLogic/bucket_directory (0.00s) === RUN TestFileExtensionHandlingLogic === RUN TestFileExtensionHandlingLogic/file.txt === RUN TestFileExtensionHandlingLogic/file.log === RUN TestFileExtensionHandlingLogic/archive.tar.gz === RUN TestFileExtensionHandlingLogic/image.jpg === RUN TestFileExtensionHandlingLogic/document.pdf === RUN TestFileExtensionHandlingLogic/data.json === RUN TestFileExtensionHandlingLogic/noextension === RUN TestFileExtensionHandlingLogic/.hidden === RUN TestFileExtensionHandlingLogic/file.TXT === RUN TestFileExtensionHandlingLogic/file.JPG --- PASS: TestFileExtensionHandlingLogic (0.01s) --- PASS: TestFileExtensionHandlingLogic/file.txt (0.00s) --- PASS: TestFileExtensionHandlingLogic/file.log (0.00s) --- PASS: TestFileExtensionHandlingLogic/archive.tar.gz (0.00s) --- PASS: TestFileExtensionHandlingLogic/image.jpg (0.00s) --- PASS: TestFileExtensionHandlingLogic/document.pdf (0.00s) --- PASS: TestFileExtensionHandlingLogic/data.json (0.00s) --- PASS: TestFileExtensionHandlingLogic/noextension (0.00s) --- PASS: TestFileExtensionHandlingLogic/.hidden (0.00s) --- PASS: TestFileExtensionHandlingLogic/file.TXT (0.00s) --- PASS: TestFileExtensionHandlingLogic/file.JPG (0.00s) === RUN TestBucketPathDetectionLogic === RUN TestBucketPathDetectionLogic/root_is_not_a_bucket_path === RUN TestBucketPathDetectionLogic/buckets_root === RUN TestBucketPathDetectionLogic/single_bucket === RUN TestBucketPathDetectionLogic/bucket_with_nested_path === RUN TestBucketPathDetectionLogic/non-bucket_path --- PASS: TestBucketPathDetectionLogic (0.00s) --- PASS: TestBucketPathDetectionLogic/root_is_not_a_bucket_path (0.00s) --- PASS: TestBucketPathDetectionLogic/buckets_root (0.00s) --- PASS: TestBucketPathDetectionLogic/single_bucket (0.00s) --- PASS: TestBucketPathDetectionLogic/bucket_with_nested_path (0.00s) --- PASS: TestBucketPathDetectionLogic/non-bucket_path (0.00s) === RUN TestPathJoinHandlesEdgeCases === RUN TestPathJoinHandlesEdgeCases/root_directory === RUN TestPathJoinHandlesEdgeCases/simple_directory === RUN TestPathJoinHandlesEdgeCases/nested_directory === RUN TestPathJoinHandlesEdgeCases/handles_trailing_slash === RUN TestPathJoinHandlesEdgeCases/handles_empty_name --- PASS: TestPathJoinHandlesEdgeCases (0.00s) --- PASS: TestPathJoinHandlesEdgeCases/root_directory (0.00s) --- PASS: TestPathJoinHandlesEdgeCases/simple_directory (0.00s) --- PASS: TestPathJoinHandlesEdgeCases/nested_directory (0.00s) --- PASS: TestPathJoinHandlesEdgeCases/handles_trailing_slash (0.00s) --- PASS: TestPathJoinHandlesEdgeCases/handles_empty_name (0.00s) === RUN TestWindowsPathNormalizationBehavior === RUN TestWindowsPathNormalizationBehavior/backslash_separator === RUN TestWindowsPathNormalizationBehavior/mixed_separators === RUN TestWindowsPathNormalizationBehavior/already_normalized === RUN TestWindowsPathNormalizationBehavior/simple_backslash_path === RUN TestWindowsPathNormalizationBehavior/deep_nested_path --- PASS: TestWindowsPathNormalizationBehavior (0.00s) --- PASS: TestWindowsPathNormalizationBehavior/backslash_separator (0.00s) --- PASS: TestWindowsPathNormalizationBehavior/mixed_separators (0.00s) --- PASS: TestWindowsPathNormalizationBehavior/already_normalized (0.00s) --- PASS: TestWindowsPathNormalizationBehavior/simple_backslash_path (0.00s) --- PASS: TestWindowsPathNormalizationBehavior/deep_nested_path (0.00s) === RUN TestBreadcrumbPathFormatting === RUN TestBreadcrumbPathFormatting/breadcrumbs_for_/ === RUN TestBreadcrumbPathFormatting/breadcrumbs_for_/folder === RUN TestBreadcrumbPathFormatting/breadcrumbs_for_/folder/subfolder === RUN TestBreadcrumbPathFormatting/breadcrumbs_for_/buckets/mybucket === RUN TestBreadcrumbPathFormatting/breadcrumbs_for_/buckets/mybucket/data --- PASS: TestBreadcrumbPathFormatting (0.00s) --- PASS: TestBreadcrumbPathFormatting/breadcrumbs_for_/ (0.00s) --- PASS: TestBreadcrumbPathFormatting/breadcrumbs_for_/folder (0.00s) --- PASS: TestBreadcrumbPathFormatting/breadcrumbs_for_/folder/subfolder (0.00s) --- PASS: TestBreadcrumbPathFormatting/breadcrumbs_for_/buckets/mybucket (0.00s) --- PASS: TestBreadcrumbPathFormatting/breadcrumbs_for_/buckets/mybucket/data (0.00s) === RUN TestDirectoryNavigation === RUN TestDirectoryNavigation/navigate_from_root === RUN TestDirectoryNavigation/navigate_from_single_folder === RUN TestDirectoryNavigation/navigate_from_nested_folder === RUN TestDirectoryNavigation/navigate_bucket_contents --- PASS: TestDirectoryNavigation (0.00s) --- PASS: TestDirectoryNavigation/navigate_from_root (0.00s) --- PASS: TestDirectoryNavigation/navigate_from_single_folder (0.00s) --- PASS: TestDirectoryNavigation/navigate_from_nested_folder (0.00s) --- PASS: TestDirectoryNavigation/navigate_bucket_contents (0.00s) === RUN TestResolveEntryMimePrefersStoredMime --- PASS: TestResolveEntryMimePrefersStoredMime (0.00s) === RUN TestResolveEntryMimePrefersStoredMimeMalformedParameter --- PASS: TestResolveEntryMimePrefersStoredMimeMalformedParameter (0.00s) === RUN TestResolveEntryMimeFallsBackToFilename --- PASS: TestResolveEntryMimeFallsBackToFilename (0.00s) === RUN TestResolveEntryMimeReturnsDirectoryMime --- PASS: TestResolveEntryMimeReturnsDirectoryMime (0.00s) === RUN TestResolveEntryMimeWhitespaceMimeFallsBackToFilename --- PASS: TestResolveEntryMimeWhitespaceMimeFallsBackToFilename (0.00s) === RUN TestIcebergLocationToFilerPath --- PASS: TestIcebergLocationToFilerPath (0.00s) === RUN TestFormatParquetRow --- PASS: TestFormatParquetRow (0.12s) === RUN TestTruncateCell --- PASS: TestTruncateCell (0.00s) === RUN TestLoadMaintenanceConfigHonoursPersistedTaskConfigs --- PASS: TestLoadMaintenanceConfigHonoursPersistedTaskConfigs (0.01s) === RUN TestDisabledTaskIsNotScannedAfterStartup --- PASS: TestDisabledTaskIsNotScannedAfterStartup (0.01s) === RUN TestLoadMaintenanceConfigKeepsPersistedEnabledFalse --- PASS: TestLoadMaintenanceConfigKeepsPersistedEnabledFalse (0.00s) === RUN TestLoadMaintenanceConfigTreatsLegacyAbsentEnabledAsOn --- PASS: TestLoadMaintenanceConfigTreatsLegacyAbsentEnabledAsOn (0.00s) === RUN TestPolicyMirrorsWhatTheDetectorsReport --- PASS: TestPolicyMirrorsWhatTheDetectorsReport (0.01s) === RUN TestCancelledTaskFilesDoNotAccumulate I1117 09:26:18.566344 maintenance_queue.go:237 Task queued: ec_vol_0_cycle_0 (erasure_coding) volume 1 on server1, priority 0, reason: I1117 09:26:18.570335 maintenance_queue.go:237 Task queued: ec_vol_1_cycle_1 (erasure_coding) volume 2 on server1, priority 0, reason: I1117 09:26:18.571119 maintenance_queue.go:237 Task queued: ec_vol_2_cycle_2 (erasure_coding) volume 3 on server1, priority 0, reason: --- PASS: TestCancelledTaskFilesDoNotAccumulate (0.02s) === RUN TestManuallyCancelledTaskFileIsRemoved I1117 09:26:18.575017 maintenance_queue.go:237 Task queued: manual_1 (vacuum) volume 7 on server1, priority 0, reason: --- PASS: TestManuallyCancelledTaskFileIsRemoved (0.00s) === RUN TestCleanupCompletedTasksBoundsCancelledFiles --- PASS: TestCleanupCompletedTasksBoundsCancelledFiles (0.01s) === RUN TestShortVersion --- PASS: TestShortVersion (0.00s) === RUN TestBuildClusterVersionSummary === RUN TestBuildClusterVersionSummary/uniform_across_types === RUN TestBuildClusterVersionSummary/mixed_volume_server_versions === RUN TestBuildClusterVersionSummary/unreported_versions_count_as_unknown === RUN TestBuildClusterVersionSummary/unknown_mixed_with_real_versions_is_not_uniform === RUN TestBuildClusterVersionSummary/no_nodes_is_not_uniform --- PASS: TestBuildClusterVersionSummary (0.01s) --- PASS: TestBuildClusterVersionSummary/uniform_across_types (0.00s) --- PASS: TestBuildClusterVersionSummary/mixed_volume_server_versions (0.00s) --- PASS: TestBuildClusterVersionSummary/unreported_versions_count_as_unknown (0.00s) --- PASS: TestBuildClusterVersionSummary/unknown_mixed_with_real_versions_is_not_uniform (0.00s) --- PASS: TestBuildClusterVersionSummary/no_nodes_is_not_uniform (0.00s) === RUN TestExpirePluginJobAPI === RUN TestExpirePluginJobAPI/empty_job_id === RUN TestExpirePluginJobAPI/invalid_json === RUN TestExpirePluginJobAPI/job_not_found === RUN TestExpirePluginJobAPI/successful_expire === RUN TestExpirePluginJobAPI/non-active_job --- PASS: TestExpirePluginJobAPI (0.03s) --- PASS: TestExpirePluginJobAPI/empty_job_id (0.01s) --- PASS: TestExpirePluginJobAPI/invalid_json (0.00s) --- PASS: TestExpirePluginJobAPI/job_not_found (0.00s) --- PASS: TestExpirePluginJobAPI/successful_expire (0.01s) --- PASS: TestExpirePluginJobAPI/non-active_job (0.00s) === RUN TestApplyDescriptorDefaultsToPersistedConfigBackfillsAdminDefaults === PAUSE TestApplyDescriptorDefaultsToPersistedConfigBackfillsAdminDefaults === RUN TestApplyDescriptorDefaultsToPersistedConfigReplacesBlankAdminScript === PAUSE TestApplyDescriptorDefaultsToPersistedConfigReplacesBlankAdminScript === RUN TestFilterTrackedJobsByLane === PAUSE TestFilterTrackedJobsByLane === RUN TestFilterActivitiesByLane === PAUSE TestFilterActivitiesByLane === RUN TestPluginJobsAndActivitiesAPILimitAfterLaneFilter --- PASS: TestPluginJobsAndActivitiesAPILimitAfterLaneFilter (0.07s) === RUN TestIsPolicyAttached I1117 09:26:18.716304 config_loader.go:73 Using explicit credential store: memory --- PASS: TestIsPolicyAttached (0.01s) === RUN TestDeletePolicyRejectsWhenAttachedToUser I1117 09:26:18.725568 config_loader.go:73 Using explicit credential store: memory --- PASS: TestDeletePolicyRejectsWhenAttachedToUser (0.00s) === RUN TestDeletePolicyRejectsWhenAttachedToGroup I1117 09:26:18.730639 config_loader.go:73 Using explicit credential store: memory --- PASS: TestDeletePolicyRejectsWhenAttachedToGroup (0.00s) === RUN TestDeletePolicySucceedsWhenNotAttached I1117 09:26:18.732281 config_loader.go:73 Using explicit credential store: memory --- PASS: TestDeletePolicySucceedsWhenNotAttached (0.00s) === RUN TestPrincipalRoleArn --- PASS: TestPrincipalRoleArn (0.00s) === RUN TestIsReadOnlyRole --- PASS: TestIsReadOnlyRole (0.00s) === RUN TestObjectStoreUserRedactSecretKey --- PASS: TestObjectStoreUserRedactSecretKey (0.00s) === RUN TestUserDetailsRedactSecretKeys --- PASS: TestUserDetailsRedactSecretKeys (0.00s) === RUN TestUserDetailsRedactSecretKeys_Empty --- PASS: TestUserDetailsRedactSecretKeys_Empty (0.00s) === RUN TestS3VectorsBucketsListsOnlyVectorBuckets --- PASS: TestS3VectorsBucketsListsOnlyVectorBuckets (0.44s) === RUN TestS3VectorsBucketShowsIndexesAndPolicy I1117 09:26:19.230808 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=admin, actions=[] --- PASS: TestS3VectorsBucketShowsIndexesAndPolicy (0.29s) === RUN TestS3VectorsDeleteIndexThenBucket I1117 09:26:19.502394 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=admin, actions=[] --- PASS: TestS3VectorsDeleteIndexThenBucket (0.30s) === RUN TestS3VectorsBucketsStopAtTheListLimit --- PASS: TestS3VectorsBucketsStopAtTheListLimit (26.61s) === RUN TestS3VectorsManagementOperations --- PASS: TestS3VectorsManagementOperations (0.23s) === RUN TestS3VectorsEncryptedCreationRequiresKey --- PASS: TestS3VectorsEncryptedCreationRequiresKey (0.04s) === RUN TestS3VectorsReadOnlyOperations --- PASS: TestS3VectorsReadOnlyOperations (0.08s) === RUN TestLoadTaskPolicyDefaultsMatchTaskDefaults === RUN TestLoadTaskPolicyDefaultsMatchTaskDefaults/vacuum === RUN TestLoadTaskPolicyDefaultsMatchTaskDefaults/erasure_coding === RUN TestLoadTaskPolicyDefaultsMatchTaskDefaults/balance === RUN TestLoadTaskPolicyDefaultsMatchTaskDefaults/ec_balance --- PASS: TestLoadTaskPolicyDefaultsMatchTaskDefaults (0.01s) --- PASS: TestLoadTaskPolicyDefaultsMatchTaskDefaults/vacuum (0.00s) --- PASS: TestLoadTaskPolicyDefaultsMatchTaskDefaults/erasure_coding (0.00s) --- PASS: TestLoadTaskPolicyDefaultsMatchTaskDefaults/balance (0.00s) --- PASS: TestLoadTaskPolicyDefaultsMatchTaskDefaults/ec_balance (0.00s) === RUN TestLoadTaskConfigDefaultsMatchTaskDefaults --- PASS: TestLoadTaskConfigDefaultsMatchTaskDefaults (0.00s) === RUN TestEcBalanceTaskPolicyRoundTrip --- PASS: TestEcBalanceTaskPolicyRoundTrip (0.00s) === RUN TestBuildPolicyKeepsTaskSpecificFields --- PASS: TestBuildPolicyKeepsTaskSpecificFields (0.00s) === RUN TestCollectTierStats --- PASS: TestCollectTierStats (0.00s) === RUN TestCollectTierStatsEmpty --- PASS: TestCollectTierStatsEmpty (0.00s) === RUN TestGetObjectStoreUserDetailsIncludesInlinePolicies I1117 09:26:46.756884 config_loader.go:73 Using explicit credential store: memory --- PASS: TestGetObjectStoreUserDetailsIncludesInlinePolicies (0.00s) === RUN TestFilerAddressFunctionInterface user_management_test.go:46: FilerEtcStore correctly implements SetFilerAddressFunc interface --- PASS: TestFilerAddressFunctionInterface (0.01s) === RUN TestGenerateAccessKey --- PASS: TestGenerateAccessKey (0.00s) === RUN TestGenerateSecretKey --- PASS: TestGenerateSecretKey (0.00s) === RUN TestGenerateAccountId --- PASS: TestGenerateAccountId (0.00s) === RUN TestVacuumMonitorStateTransitions === PAUSE TestVacuumMonitorStateTransitions === RUN TestSyncVacuumState === PAUSE TestSyncVacuumState === RUN TestVectorEncryptionChecksRemoteGateway --- PASS: TestVectorEncryptionChecksRemoteGateway (0.03s) === RUN TestVectorNodeStatus === RUN TestVectorNodeStatus/Ready === RUN TestVectorNodeStatus/Not_ready === RUN TestVectorNodeStatus/Registered_(health_unavailable) === RUN TestVectorNodeStatus/Unknown_service --- PASS: TestVectorNodeStatus (0.07s) --- PASS: TestVectorNodeStatus/Ready (0.02s) --- PASS: TestVectorNodeStatus/Not_ready (0.02s) --- PASS: TestVectorNodeStatus/Registered_(health_unavailable) (0.01s) --- PASS: TestVectorNodeStatus/Unknown_service (0.01s) === RUN TestBuildExportVolumeDerivedFields --- PASS: TestBuildExportVolumeDerivedFields (0.00s) === RUN TestBuildExportDiskFilterAndTotals --- PASS: TestBuildExportDiskFilterAndTotals (0.00s) === RUN TestBuildExportDiskPrunesWhenNoMatch --- PASS: TestBuildExportDiskPrunesWhenNoMatch (0.00s) === RUN TestFindDuplicateVolumeIdsForExport --- PASS: TestFindDuplicateVolumeIdsForExport (0.00s) === RUN TestSetVolumeReadOnly === RUN TestSetVolumeReadOnly/persist_read-only === RUN TestSetVolumeReadOnly/restore_read-write === RUN TestSetVolumeReadOnly/propagate_volume_server_error === RUN TestSetVolumeReadOnly/reject_unknown_volume === RUN TestSetVolumeReadOnly/reject_unknown_server --- PASS: TestSetVolumeReadOnly (0.78s) --- PASS: TestSetVolumeReadOnly/persist_read-only (0.14s) --- PASS: TestSetVolumeReadOnly/restore_read-write (0.18s) --- PASS: TestSetVolumeReadOnly/propagate_volume_server_error (0.20s) --- PASS: TestSetVolumeReadOnly/reject_unknown_volume (0.12s) --- PASS: TestSetVolumeReadOnly/reject_unknown_server (0.14s) === RUN TestVolumeReplicaAddress --- PASS: TestVolumeReplicaAddress (0.00s) === RUN TestGetClusterVolumeServersDiskAccounting === RUN TestGetClusterVolumeServersDiskAccounting/compressed_filesystem_reports_statfs_usage === RUN TestGetClusterVolumeServersDiskAccounting/plain_filesystem_reports_statfs_usage === RUN TestGetClusterVolumeServersDiskAccounting/ec_shards_are_not_added_on_top_of_statfs_usage === RUN TestGetClusterVolumeServersDiskAccounting/without_statfs_numbers_falls_back_to_logical_size --- PASS: TestGetClusterVolumeServersDiskAccounting (0.43s) --- PASS: TestGetClusterVolumeServersDiskAccounting/compressed_filesystem_reports_statfs_usage (0.12s) --- PASS: TestGetClusterVolumeServersDiskAccounting/plain_filesystem_reports_statfs_usage (0.05s) --- PASS: TestGetClusterVolumeServersDiskAccounting/ec_shards_are_not_added_on_top_of_statfs_usage (0.11s) --- PASS: TestGetClusterVolumeServersDiskAccounting/without_statfs_numbers_falls_back_to_logical_size (0.15s) === RUN TestClusterTopologyDiskTotals --- PASS: TestClusterTopologyDiskTotals (0.13s) === RUN TestMergeWorkerFleetTotals === RUN TestMergeWorkerFleetTotals/no_workers_at_all === RUN TestMergeWorkerFleetTotals/legacy_workers_only,_unchanged_accounting === RUN TestMergeWorkerFleetTotals/plugin_workers_only_are_counted === RUN TestMergeWorkerFleetTotals/distinct_workers_in_both_registries_are_summed === RUN TestMergeWorkerFleetTotals/same_worker_ID_in_both_registries_counts_once === RUN TestMergeWorkerFleetTotals/plugin_worker_without_a_heartbeat_still_counts_as_connected === RUN TestMergeWorkerFleetTotals/nil_session_is_skipped --- PASS: TestMergeWorkerFleetTotals (0.01s) --- PASS: TestMergeWorkerFleetTotals/no_workers_at_all (0.00s) --- PASS: TestMergeWorkerFleetTotals/legacy_workers_only,_unchanged_accounting (0.00s) --- PASS: TestMergeWorkerFleetTotals/plugin_workers_only_are_counted (0.00s) --- PASS: TestMergeWorkerFleetTotals/distinct_workers_in_both_registries_are_summed (0.00s) --- PASS: TestMergeWorkerFleetTotals/same_worker_ID_in_both_registries_counts_once (0.00s) --- PASS: TestMergeWorkerFleetTotals/plugin_worker_without_a_heartbeat_still_counts_as_connected (0.00s) --- PASS: TestMergeWorkerFleetTotals/nil_session_is_skipped (0.00s) === RUN TestWorkerFleetTotalsWithoutMaintenanceManager --- PASS: TestWorkerFleetTotalsWithoutMaintenanceManager (0.00s) === RUN TestSendToWorkerDropsOnCancelledContext --- PASS: TestSendToWorkerDropsOnCancelledContext (0.00s) === RUN TestHeartbeatDuringUnregisterDoesNotPanic --- PASS: TestHeartbeatDuringUnregisterDoesNotPanic (0.07s) === CONT TestAdminLockManagerRefCountsOverlappingHolds === CONT TestAdminLockManagerAcquireWaitsForReleaseInFlight === CONT TestVacuumMonitorStateTransitions === CONT TestAdminLockManagerYieldsBeforeReacquire === CONT TestSyncVacuumState === CONT TestAdminLockManagerSetFairnessWindowWakesWaiters === CONT TestAdminLockManagerFairnessWindowForcesFullRelease === CONT TestFilterActivitiesByLane === CONT TestApplyDescriptorDefaultsToPersistedConfigBackfillsAdminDefaults === CONT TestApplyDescriptorDefaultsToPersistedConfigReplacesBlankAdminScript === RUN TestSyncVacuumState/worker_connects_triggers_disable === CONT TestFilterTrackedJobsByLane --- PASS: TestFilterActivitiesByLane (0.00s) === CONT TestAdminLockManagerZeroFairnessWindowKeepsJoining --- PASS: TestFilterTrackedJobsByLane (0.00s) --- PASS: TestApplyDescriptorDefaultsToPersistedConfigBackfillsAdminDefaults (0.01s) I1117 09:26:48.306171 admin_server.go:392 Vacuum plugin worker connected, disabling master automatic vacuum --- PASS: TestAdminLockManagerRefCountsOverlappingHolds (0.01s) === RUN TestSyncVacuumState/worker_disconnects_triggers_enable I1117 09:26:48.307884 admin_server.go:401 Vacuum plugin worker disconnected, re-enabling master automatic vacuum --- PASS: TestAdminLockManagerZeroFairnessWindowKeepsJoining (0.01s) === RUN TestSyncVacuumState/disable_is_re-sent_every_tick_while_the_worker_stays_connected --- PASS: TestApplyDescriptorDefaultsToPersistedConfigReplacesBlankAdminScript (0.00s) I1117 09:26:48.309636 admin_server.go:392 Vacuum plugin worker connected, disabling master automatic vacuum === RUN TestSyncVacuumState/enable_is_re-sent_every_tick_while_no_worker_is_connected --- PASS: TestAdminLockManagerSetFairnessWindowWakesWaiters (0.01s) === RUN TestSyncVacuumState/failed_call_keeps_the_previous_state_and_reports_failure I1117 09:26:48.311785 admin_server.go:392 Vacuum plugin worker connected, disabling master automatic vacuum W1117 09:26:48.311971 admin_server.go:395 Failed to disable vacuum on master: master unavailable W1117 09:26:48.312182 admin_server.go:395 Failed to disable vacuum on master: master unavailable I1117 09:26:48.312374 admin_server.go:401 Vacuum plugin worker disconnected, re-enabling master automatic vacuum W1117 09:26:48.312547 admin_server.go:404 Failed to enable vacuum on master: master unavailable --- PASS: TestSyncVacuumState (0.01s) --- PASS: TestSyncVacuumState/worker_connects_triggers_disable (0.00s) --- PASS: TestSyncVacuumState/worker_disconnects_triggers_enable (0.00s) --- PASS: TestSyncVacuumState/disable_is_re-sent_every_tick_while_the_worker_stays_connected (0.00s) --- PASS: TestSyncVacuumState/enable_is_re-sent_every_tick_while_no_worker_is_connected (0.00s) --- PASS: TestSyncVacuumState/failed_call_keeps_the_previous_state_and_reports_failure (0.00s) --- PASS: TestVacuumMonitorStateTransitions (0.02s) --- PASS: TestAdminLockManagerFairnessWindowForcesFullRelease (0.03s) --- PASS: TestAdminLockManagerYieldsBeforeReacquire (0.10s) --- PASS: TestAdminLockManagerAcquireWaitsForReleaseInFlight (0.11s) PASS ok github.com/seaweedfs/seaweedfs/weed/admin/dash 33.574s === RUN TestSetupRoutes_RegistersPluginSchedulerStatesAPI_NoAuth --- PASS: TestSetupRoutes_RegistersPluginSchedulerStatesAPI_NoAuth (0.13s) === RUN TestSetupRoutes_RegistersPluginSchedulerStatesAPI_WithAuth --- PASS: TestSetupRoutes_RegistersPluginSchedulerStatesAPI_WithAuth (0.10s) === RUN TestSetupRoutes_RegistersBucketLifecycleAPI_NoAuth --- PASS: TestSetupRoutes_RegistersBucketLifecycleAPI_NoAuth (0.09s) === RUN TestSetupRoutes_RegistersBucketLifecycleAPI_WithAuth --- PASS: TestSetupRoutes_RegistersBucketLifecycleAPI_WithAuth (0.09s) === RUN TestSetupRoutes_RegistersBucketPolicyAPI_NoAuth --- PASS: TestSetupRoutes_RegistersBucketPolicyAPI_NoAuth (0.12s) === RUN TestSetupRoutes_RegistersBucketPolicyAPI_WithAuth --- PASS: TestSetupRoutes_RegistersBucketPolicyAPI_WithAuth (0.09s) === RUN TestSetupRoutes_RegistersPolicyAPI_NoAuth --- PASS: TestSetupRoutes_RegistersPolicyAPI_NoAuth (0.09s) === RUN TestSetupRoutes_RegistersPolicyAPI_WithAuth --- PASS: TestSetupRoutes_RegistersPolicyAPI_WithAuth (0.09s) === RUN TestSetupRoutes_RegistersPrincipalsAPI_NoAuth --- PASS: TestSetupRoutes_RegistersPrincipalsAPI_NoAuth (0.08s) === RUN TestSetupRoutes_RegistersFilesListFoldersAPI_NoAuth --- PASS: TestSetupRoutes_RegistersFilesListFoldersAPI_NoAuth (0.11s) === RUN TestSetupRoutes_RegistersPluginPages_NoAuth --- PASS: TestSetupRoutes_RegistersPluginPages_NoAuth (0.09s) === RUN TestSetupRoutes_RegistersPluginPages_WithAuth --- PASS: TestSetupRoutes_RegistersPluginPages_WithAuth (0.09s) === RUN TestSetVolumeReadOnlyInvalidRequests === RUN TestSetVolumeReadOnlyInvalidRequests/missing_volume === RUN TestSetVolumeReadOnlyInvalidRequests/negative_volume === RUN TestSetVolumeReadOnlyInvalidRequests/overflow_volume === RUN TestSetVolumeReadOnlyInvalidRequests/invalid_volume === RUN TestSetVolumeReadOnlyInvalidRequests/missing_server === RUN TestSetVolumeReadOnlyInvalidRequests/missing_mode === RUN TestSetVolumeReadOnlyInvalidRequests/null_mode === RUN TestSetVolumeReadOnlyInvalidRequests/string_mode === RUN TestSetVolumeReadOnlyInvalidRequests/malformed_JSON === RUN TestSetVolumeReadOnlyInvalidRequests/trailing_JSON --- PASS: TestSetVolumeReadOnlyInvalidRequests (0.04s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/missing_volume (0.01s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/negative_volume (0.00s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/overflow_volume (0.00s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/invalid_volume (0.00s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/missing_server (0.00s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/missing_mode (0.01s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/null_mode (0.00s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/string_mode (0.00s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/malformed_JSON (0.00s) --- PASS: TestSetVolumeReadOnlyInvalidRequests/trailing_JSON (0.00s) === RUN TestSetVolumeReadOnlyRoutePermissions === RUN TestSetVolumeReadOnlyRoutePermissions/read-only_user === RUN TestSetVolumeReadOnlyRoutePermissions/admin === RUN TestSetVolumeReadOnlyRoutePermissions/no_authentication --- PASS: TestSetVolumeReadOnlyRoutePermissions (0.22s) --- PASS: TestSetVolumeReadOnlyRoutePermissions/read-only_user (0.06s) --- PASS: TestSetVolumeReadOnlyRoutePermissions/admin (0.06s) --- PASS: TestSetVolumeReadOnlyRoutePermissions/no_authentication (0.09s) === RUN TestValidateAndCleanFilePath_AllowsControlChars --- PASS: TestValidateAndCleanFilePath_AllowsControlChars (0.00s) === RUN TestValidateAndCleanFilePath_RejectsEmpty --- PASS: TestValidateAndCleanFilePath_RejectsEmpty (0.00s) === RUN TestValidateAndCleanFilePath_RejectsParentComponents --- PASS: TestValidateAndCleanFilePath_RejectsParentComponents (0.00s) === RUN TestCleanReadPath_DeniesEtcForReadOnly --- PASS: TestCleanReadPath_DeniesEtcForReadOnly (0.00s) === RUN TestCleanReadPath_AllowsEtcForAdminAndNorRole --- PASS: TestCleanReadPath_AllowsEtcForAdminAndNorRole (0.00s) === RUN TestCleanReadPath_AllowsReadOnlyOutsideEtc --- PASS: TestCleanReadPath_AllowsReadOnlyOutsideEtc (0.00s) === RUN TestExportExcludedPrefixes_ReadOnlyDropsEtc --- PASS: TestExportExcludedPrefixes_ReadOnlyDropsEtc (0.00s) === RUN TestListFolders_RejectsPathOutsideBuckets --- PASS: TestListFolders_RejectsPathOutsideBuckets (0.00s) === RUN TestUploadFile_RejectsOversizedUpload --- PASS: TestUploadFile_RejectsOversizedUpload (0.63s) === RUN TestUploadFile_RemovesSpooledParts --- PASS: TestUploadFile_RemovesSpooledParts (6.68s) === RUN TestIsRelativeUploadPath --- PASS: TestIsRelativeUploadPath (0.00s) === RUN TestUploadFile_FolderRelativePaths --- PASS: TestUploadFile_FolderRelativePaths (0.02s) === RUN TestValidatePolicy === RUN TestValidatePolicy/valid_document_with_Resource === RUN TestValidatePolicy/valid_document_with_NotResource_only === RUN TestValidatePolicy/missing_version === RUN TestValidatePolicy/no_statements === RUN TestValidatePolicy/invalid_effect === RUN TestValidatePolicy/missing_action === RUN TestValidatePolicy/neither_Resource_nor_NotResource === RUN TestValidatePolicy/both_Resource_and_NotResource === RUN TestValidatePolicy/empty_Resource_alongside_non-empty_NotResource_is_still_a_conflict === RUN TestValidatePolicy/both_Principal_and_NotPrincipal --- PASS: TestValidatePolicy (0.04s) --- PASS: TestValidatePolicy/valid_document_with_Resource (0.01s) --- PASS: TestValidatePolicy/valid_document_with_NotResource_only (0.00s) --- PASS: TestValidatePolicy/missing_version (0.00s) --- PASS: TestValidatePolicy/no_statements (0.00s) --- PASS: TestValidatePolicy/invalid_effect (0.00s) --- PASS: TestValidatePolicy/missing_action (0.00s) --- PASS: TestValidatePolicy/neither_Resource_nor_NotResource (0.00s) --- PASS: TestValidatePolicy/both_Resource_and_NotResource (0.00s) --- PASS: TestValidatePolicy/empty_Resource_alongside_non-empty_NotResource_is_still_a_conflict (0.00s) --- PASS: TestValidatePolicy/both_Principal_and_NotPrincipal (0.00s) === RUN TestValidatePolicy_NotResourceOnlyDecodes --- PASS: TestValidatePolicy_NotResourceOnlyDecodes (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/admin/handlers 11.894s ? github.com/seaweedfs/seaweedfs/weed/admin/internal/httputil [no test files] === RUN TestMaintenanceManager_ErrorHandling E1117 09:28:26.305513 maintenance_manager.go:408 Maintenance scan failed: dial tcp [::1]:19333: connect: connection refused (will retry with backoff) E1117 09:28:26.342900 maintenance_manager.go:410 Maintenance scan still failing after 2 attempts: dial tcp [::1]:19333: connect: connection refused (backoff: 2s) E1117 09:28:26.344779 maintenance_manager.go:410 Maintenance scan still failing after 3 attempts: dial tcp [::1]:19333: connect: connection refused (backoff: 4s) E1117 09:28:26.345049 maintenance_manager.go:410 Maintenance scan still failing after 6 attempts: dial tcp [::1]:19333: connect: connection refused (backoff: 32s) E1117 09:28:26.345204 maintenance_manager.go:410 Maintenance scan still failing after 9 attempts: dial tcp [::1]:19333: connect: connection refused (backoff: 4m16s) E1117 09:28:26.345424 maintenance_manager.go:410 Maintenance scan still failing after 10 attempts: dial tcp [::1]:19333: connect: connection refused (backoff: 5m0s) --- PASS: TestMaintenanceManager_ErrorHandling (0.05s) === RUN TestIsConnectionError --- PASS: TestIsConnectionError (0.00s) === RUN TestMaintenanceManager_GetErrorState E1117 09:28:26.356441 maintenance_manager.go:414 Maintenance scan failed: test error E1117 09:28:26.356860 maintenance_manager.go:414 Maintenance scan failed: test error --- PASS: TestMaintenanceManager_GetErrorState (0.00s) === RUN TestMaintenanceManager_LogThrottling E1117 09:28:26.358252 maintenance_manager.go:414 Maintenance scan failed: test error E1117 09:28:26.358433 maintenance_manager.go:414 Maintenance scan failed: test error E1117 09:28:26.358562 maintenance_manager.go:414 Maintenance scan failed: test error E1117 09:28:26.358683 maintenance_manager.go:414 Maintenance scan failed: test error E1117 09:28:26.358794 maintenance_manager.go:414 Maintenance scan failed: test error E1117 09:28:26.358899 maintenance_manager.go:414 Maintenance scan failed: test error E1117 09:28:26.359026 maintenance_manager.go:414 Maintenance scan failed: test error --- PASS: TestMaintenanceManager_LogThrottling (0.00s) === RUN TestBuildPolicyFromTaskConfigsUsesPersistence --- PASS: TestBuildPolicyFromTaskConfigsUsesPersistence (0.00s) === RUN TestBuildPolicyFromTaskConfigsWithoutPersistence --- PASS: TestBuildPolicyFromTaskConfigsWithoutPersistence (0.00s) === RUN TestNewMaintenanceManagerUsesPersistenceForPolicyFallback --- PASS: TestNewMaintenanceManagerUsesPersistenceForPolicyFallback (0.00s) === RUN TestPolicyReachesRegisteredDetectors --- PASS: TestPolicyReachesRegisteredDetectors (0.01s) === RUN TestPolicyMaxConcurrentReachesSchedulers --- PASS: TestPolicyMaxConcurrentReachesSchedulers (0.00s) === RUN TestPolicyWithoutEntryLeavesTaskAlone --- PASS: TestPolicyWithoutEntryLeavesTaskAlone (0.00s) === RUN TestBuildPolicyCoversEveryRegisteredTask --- PASS: TestBuildPolicyCoversEveryRegisteredTask (0.00s) === RUN TestBuildPolicyIncludesEcBalance --- PASS: TestBuildPolicyIncludesEcBalance (0.00s) === RUN TestPolicyHelpersTolerateNilPolicy --- PASS: TestPolicyHelpersTolerateNilPolicy (0.00s) === RUN TestCanScheduleTaskNow_FallbackLogic --- PASS: TestCanScheduleTaskNow_FallbackLogic (0.00s) === RUN TestCanScheduleTaskNow_FallbackWithRunningTasks --- PASS: TestCanScheduleTaskNow_FallbackWithRunningTasks (0.00s) === RUN TestCanScheduleTaskNow_DifferentTaskTypes --- PASS: TestCanScheduleTaskNow_DifferentTaskTypes (0.00s) === RUN TestCanScheduleTaskNow_WithIntegration --- PASS: TestCanScheduleTaskNow_WithIntegration (0.00s) === RUN TestGetRunningTaskCount --- PASS: TestGetRunningTaskCount (0.00s) === RUN TestCanExecuteTaskType --- PASS: TestCanExecuteTaskType (0.00s) === RUN TestGetMaxConcurrentForTaskType_DefaultBehavior --- PASS: TestGetMaxConcurrentForTaskType_DefaultBehavior (0.00s) === RUN TestCanScheduleTaskNow_NilTask --- PASS: TestCanScheduleTaskNow_NilTask (0.00s) === RUN TestCanScheduleTaskNow_EmptyTaskType --- PASS: TestCanScheduleTaskNow_EmptyTaskType (0.00s) === RUN TestCanScheduleTaskNow_WithPolicy --- PASS: TestCanScheduleTaskNow_WithPolicy (0.00s) === RUN TestMaintenanceQueue_TaskIDPreservation I1117 09:28:26.401695 maintenance_queue.go:237 Task queued: ec_task_123 (erasure_coding) volume 100 on server1, priority 1, reason: I1117 09:28:26.402513 maintenance_queue.go:237 Task queued: manual_id_456 (vacuum) volume 0 on , priority 0, reason: --- PASS: TestMaintenanceQueue_TaskIDPreservation (0.00s) === RUN TestMaintenanceQueue_ActiveTopologySync I1117 09:28:26.409630 maintenance_queue.go:237 Task queued: sync_test_123 (balance) volume 100 on server1, priority 0, reason: I1117 09:28:26.414506 maintenance_queue.go:544 Task assigned: sync_test_123 (balance) → worker worker1 (volume 100, server server1) I1117 09:28:26.418610 maintenance_queue.go:651 Task completed: sync_test_123 (balance) worker worker1, duration 5.288383ms, volume 100 --- PASS: TestMaintenanceQueue_ActiveTopologySync (0.02s) === RUN TestMaintenanceQueue_StaleWorkerCapacityRelease I1117 09:28:26.422075 maintenance_queue.go:237 Task queued: stale_test_123 (balance) volume 100 on server1, priority 0, reason: I1117 09:28:26.425316 maintenance_queue.go:544 Task assigned: stale_test_123 (balance) → worker worker1 (volume 100, server server1) W1117 09:28:26.426890 maintenance_queue.go:1026 Removed stale maintenance worker worker1 --- PASS: TestMaintenanceQueue_StaleWorkerCapacityRelease (0.01s) === RUN TestMaintenanceManager_CancelTaskCapacityRelease I1117 09:28:26.429296 maintenance_queue.go:237 Task queued: cancel_test_123 (balance) volume 100 on server1, priority 0, reason: --- PASS: TestMaintenanceManager_CancelTaskCapacityRelease (0.00s) === RUN TestMaintenanceQueue_LoadRequeuesInFlightTasks I1117 09:28:26.432171 maintenance_queue.go:96 Task queue initialized: re-queued 2 in-flight task(s) from persistence; scanner will re-detect the rest --- PASS: TestMaintenanceQueue_LoadRequeuesInFlightTasks (0.00s) === RUN TestMaintenanceQueue_RetryCapacitySync I1117 09:28:26.435202 maintenance_queue.go:237 Task queued: retry_test_123 (balance) volume 100 on server1, priority 0, reason: I1117 09:28:26.436120 maintenance_queue.go:544 Task assigned: retry_test_123 (balance) → worker worker1 (volume 100, server server1) W1117 09:28:26.438612 maintenance_queue.go:624 Task failed, scheduling retry: retry_test_123 (balance) attempt 1/3, worker worker1, duration 953.255µs, error: simulated failure --- PASS: TestMaintenanceQueue_RetryCapacitySync (0.01s) === RUN TestMaintenanceQueue_AssignTaskRollback I1117 09:28:26.441675 maintenance_queue.go:237 Task queued: rollback_test_123 (balance) volume 100 on server1, priority 0, reason: W1117 09:28:26.442307 maintenance_queue.go:511 Failed to update ActiveTopology for task assignment rollback_test_123: pending task rollback_test_123 not found. Rolling back assignment. --- PASS: TestMaintenanceQueue_AssignTaskRollback (0.00s) === RUN TestGetNextTask_SkipsVolumeConflictsAcrossTypes I1117 09:28:26.444305 maintenance_queue.go:237 Task queued: t1 (balance) volume 100 on server1, priority 2, reason: I1117 09:28:26.444859 maintenance_queue.go:237 Task queued: t3 (vacuum) volume 200 on server1, priority 1, reason: I1117 09:28:26.445626 maintenance_queue.go:544 Task assigned: t1 (balance) → worker worker1 (volume 100, server server1) I1117 09:28:26.446165 maintenance_queue.go:544 Task assigned: t3 (vacuum) → worker worker2 (volume 200, server server1) --- PASS: TestGetNextTask_SkipsVolumeConflictsAcrossTypes (0.00s) === RUN TestAddTask_OnePendingTaskPerVolume I1117 09:28:26.447307 maintenance_queue.go:237 Task queued: t1 (balance) volume 100 on server1, priority 0, reason: --- PASS: TestAddTask_OnePendingTaskPerVolume (0.00s) === RUN TestAddTask_RejectsWhenVolumeHasRunningTask I1117 09:28:26.448583 maintenance_queue.go:237 Task queued: t1 (balance) volume 100 on server1, priority 0, reason: --- PASS: TestAddTask_RejectsWhenVolumeHasRunningTask (0.00s) === RUN TestScanLoopRestoresIntervalAfterBackoff I1117 09:28:29.453066 maintenance_manager.go:331 Starting maintenance scan... E1117 09:28:29.466378 maintenance_integration.go:282 Failed to scan for ec_balance tasks: topology info not available I1117 09:28:29.466917 maintenance_manager.go:372 Maintenance scan completed: no maintenance tasks needed I1117 09:28:30.454432 maintenance_manager.go:331 Starting maintenance scan... E1117 09:28:30.454864 maintenance_integration.go:282 Failed to scan for ec_balance tasks: topology info not available I1117 09:28:30.455519 maintenance_manager.go:372 Maintenance scan completed: no maintenance tasks needed I1117 09:28:33.457067 maintenance_manager.go:331 Starting maintenance scan... E1117 09:28:33.457594 maintenance_integration.go:282 Failed to scan for ec_balance tasks: topology info not available I1117 09:28:33.458473 maintenance_manager.go:372 Maintenance scan completed: no maintenance tasks needed I1117 09:28:35.986420 maintenance_manager.go:191 Maintenance manager stopped --- PASS: TestScanLoopRestoresIntervalAfterBackoff (9.54s) === RUN TestScanLoopEntersBackoffOnError --- PASS: TestScanLoopEntersBackoffOnError (0.00s) === RUN TestStopIsIdempotent I1117 09:28:35.989936 maintenance_manager.go:191 Maintenance manager stopped --- PASS: TestStopIsIdempotent (0.00s) === RUN TestPendingOperations_ConflictDetection --- PASS: TestPendingOperations_ConflictDetection (0.00s) === RUN TestPendingOperations_CapacityProjection --- PASS: TestPendingOperations_CapacityProjection (0.01s) === RUN TestPendingOperations_VolumeFiltering --- PASS: TestPendingOperations_VolumeFiltering (0.00s) === RUN TestPendingOperations_OperationLifecycle --- PASS: TestPendingOperations_OperationLifecycle (0.00s) === RUN TestPendingOperations_StaleCleanup W1117 09:28:36.003420 pending_operations.go:265 Removed stale pending operation: volume 301, task task-stale, age 24h0m0.000460128s --- PASS: TestPendingOperations_StaleCleanup (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/admin/maintenance 11.481s === RUN TestDecorateClusterContext_NonS3LifecycleIsPassThrough --- PASS: TestDecorateClusterContext_NonS3LifecycleIsPassThrough (0.00s) === RUN TestDecorateClusterContext_RpsZeroSkipsAllocation --- PASS: TestDecorateClusterContext_RpsZeroSkipsAllocation (0.00s) === RUN TestDecorateClusterContext_NoExecutorsSkipsAllocation --- PASS: TestDecorateClusterContext_NoExecutorsSkipsAllocation (0.00s) === RUN TestDecorateClusterContext_SingletonJobGetsFullBudget --- PASS: TestDecorateClusterContext_SingletonJobGetsFullBudget (0.00s) === RUN TestDecorateClusterContext_SharedEvenlyWhenParallelLimited --- PASS: TestDecorateClusterContext_SharedEvenlyWhenParallelLimited (0.00s) === RUN TestDecorateClusterContext_MaxJobsExceedsExecutors --- PASS: TestDecorateClusterContext_MaxJobsExceedsExecutors (0.00s) === RUN TestDecorateClusterContext_BurstSharedWhenParallel --- PASS: TestDecorateClusterContext_BurstSharedWhenParallel (0.00s) === RUN TestDecorateClusterContext_BurstZeroOmitsKey --- PASS: TestDecorateClusterContext_BurstZeroOmitsKey (0.00s) === RUN TestDecorateClusterContext_BurstFloorIsOneWhenDividesBelowOne --- PASS: TestDecorateClusterContext_BurstFloorIsOneWhenDividesBelowOne (0.00s) === RUN TestDecorateClusterContext_DoesNotMutateInput --- PASS: TestDecorateClusterContext_DoesNotMutateInput (0.00s) === RUN TestDecorateClusterContext_NilInputPassesThrough --- PASS: TestDecorateClusterContext_NilInputPassesThrough (0.00s) === RUN TestConfigStoreRefreshRepairsCorruptDescriptor --- PASS: TestConfigStoreRefreshRepairsCorruptDescriptor (0.07s) === RUN TestConfigStoreDoesNotDowngradeDescriptors --- PASS: TestConfigStoreDoesNotDowngradeDescriptors (0.01s) === RUN TestConfigStoreDescriptorRoundTrip === PAUSE TestConfigStoreDescriptorRoundTrip === RUN TestConfigStoreRunHistoryRetention === PAUSE TestConfigStoreRunHistoryRetention === RUN TestConfigStoreListJobTypes === PAUSE TestConfigStoreListJobTypes === RUN TestConfigStoreMonitorStateRoundTrip === PAUSE TestConfigStoreMonitorStateRoundTrip === RUN TestConfigStoreSaveJobTypeConfigIfNotExists === PAUSE TestConfigStoreSaveJobTypeConfigIfNotExists === RUN TestConfigStoreJobDetailRoundTrip === PAUSE TestConfigStoreJobDetailRoundTrip === RUN TestConfigStoreDeleteJobDetail === PAUSE TestConfigStoreDeleteJobDetail === RUN TestObservationAttributesAreFlattened --- PASS: TestObservationAttributesAreFlattened (0.02s) === RUN TestObservationIsReplacedByALaterOne --- PASS: TestObservationIsReplacedByALaterOne (0.03s) === RUN TestObservationAttributeStringHandlesAbsence --- PASS: TestObservationAttributeStringHandlesAbsence (0.00s) === RUN TestObservationLookupIsScopedToFormat --- PASS: TestObservationLookupIsScopedToFormat (0.00s) === RUN TestExecutionFailsWhenWorkerRestartsWithoutJob === PAUSE TestExecutionFailsWhenWorkerRestartsWithoutJob === RUN TestExecutionKeptWhenWorkerReconnectsWithJob === PAUSE TestExecutionKeptWhenWorkerReconnectsWithJob === RUN TestExecutionKeptWhenReconnectedWorkerListsPaddedJobID === PAUSE TestExecutionKeptWhenReconnectedWorkerListsPaddedJobID === RUN TestExecutionKeptWhileDispatchSessionHasNotListedJob === PAUSE TestExecutionKeptWhileDispatchSessionHasNotListedJob === RUN TestExecutionKeptWhenHeartbeatDoesNotItemize === PAUSE TestExecutionKeptWhenHeartbeatDoesNotItemize === RUN TestExecutionKeptWhenReplacementStreamListsJobBetweenOmissions === PAUSE TestExecutionKeptWhenReplacementStreamListsJobBetweenOmissions === RUN TestExecutionNotTrackedWhenWorkerNotConnected === PAUSE TestExecutionNotTrackedWhenWorkerNotConnected === RUN TestExecutionFailedWhenSendToSessionFails === PAUSE TestExecutionFailedWhenSendToSessionFails === RUN TestExecutionFailedWhenSendFailsAfterShutdownUnregisters === PAUSE TestExecutionFailedWhenSendFailsAfterShutdownUnregisters === RUN TestExecutionNotOrphanedAfterDispatcherTookCompletion === PAUSE TestExecutionNotOrphanedAfterDispatcherTookCompletion === RUN TestRunDetectionSendsCancelOnContextDone === PAUSE TestRunDetectionSendsCancelOnContextDone === RUN TestExecuteJobSendsCancelOnContextDone === PAUSE TestExecuteJobSendsCancelOnContextDone === RUN TestAdminScriptExecutionBlocksOtherDetection --- PASS: TestAdminScriptExecutionBlocksOtherDetection (0.14s) === RUN TestAdminScriptExecutionBlocksOtherExecution --- PASS: TestAdminScriptExecutionBlocksOtherExecution (0.13s) === RUN TestEnsureJobTypeConfigFromDescriptorBootstrapsDefaults === PAUSE TestEnsureJobTypeConfigFromDescriptorBootstrapsDefaults === RUN TestEnsureJobTypeConfigFromDescriptorDoesNotOverwriteExisting === PAUSE TestEnsureJobTypeConfigFromDescriptorDoesNotOverwriteExisting === RUN TestRunDetectionFailsWhenDetectorDisconnects I1117 09:28:26.707119 plugin.go:1611 Plugin worker disconnected: worker-a W1117 09:28:26.709650 plugin.go:706 Plugin detection detect-1794907706705785003-0e312023c667e85f for vacuum failed: detection worker worker-a disconnected --- PASS: TestRunDetectionFailsWhenDetectorDisconnects (0.03s) === RUN TestRunDetectionFailsWhenDetectorReconnectsWithNewSession W1117 09:28:26.737116 plugin.go:706 Plugin detection detect-1794907706734591293-f58859145155cb56 for vacuum failed: detection worker worker-a disconnected --- PASS: TestRunDetectionFailsWhenDetectorReconnectsWithNewSession (0.01s) === RUN TestRunDetectionSurvivesOtherWorkerDisconnect I1117 09:28:26.748551 plugin.go:1611 Plugin worker disconnected: worker-b --- PASS: TestRunDetectionSurvivesOtherWorkerDisconnect (0.31s) === RUN TestRunDetectionFailsWhenDetectorHeartbeatGoesStale W1117 09:28:27.118018 plugin.go:706 Plugin detection detect-1794907707055748291-08dcab6c41abac1a for vacuum failed: detection worker worker-a disconnected: heartbeat stale --- PASS: TestRunDetectionFailsWhenDetectorHeartbeatGoesStale (0.07s) === RUN TestScheduledDetectionFailsFastOnWorkerDisconnect I1117 09:28:27.126028 plugin.go:1611 Plugin worker disconnected: worker-a W1117 09:28:27.126182 plugin.go:706 Plugin detection detect-1794907707125361398-fa7345a5bcfd2a54 for vacuum failed: detection worker worker-a disconnected --- PASS: TestScheduledDetectionFailsFastOnWorkerDisconnect (0.01s) === RUN TestScheduledDetectionRetriesOnAnotherWorkerAfterDisconnect I1117 09:28:27.136795 plugin.go:1611 Plugin worker disconnected: worker-a W1117 09:28:27.136948 plugin.go:706 Plugin detection detect-1794907707136384191-36d09fb4ec62e3fe for vacuum failed: detection worker worker-a disconnected --- PASS: TestScheduledDetectionRetriesOnAnotherWorkerAfterDisconnect (0.01s) === RUN TestRegisterSessionKeepsRegistryOnLiveStream --- PASS: TestRegisterSessionKeepsRegistryOnLiveStream (0.01s) === RUN TestScheduledDetectionRetryAvoidsClosedDetectorStream W1117 09:28:27.155382 plugin.go:706 Plugin detection detect-1794907707154809202-7f0fe2648f4ee871 for vacuum failed: detection worker worker-a disconnected --- PASS: TestScheduledDetectionRetryAvoidsClosedDetectorStream (0.01s) === RUN TestAwaitDetectionOutcomePrefersBufferedCompletionOverClosedStream I1117 09:28:27.161941 plugin.go:1611 Plugin worker disconnected: worker-a --- PASS: TestAwaitDetectionOutcomePrefersBufferedCompletionOverClosedStream (0.01s) === RUN TestRunDetectionKeepsCompletionDeliveredBeforeDisconnect I1117 09:28:27.178554 plugin.go:1611 Plugin worker disconnected: worker-a --- PASS: TestRunDetectionKeepsCompletionDeliveredBeforeDisconnect (0.01s) === RUN TestLateDetectionCompletionDoesNotReachNextDetection I1117 09:28:27.183196 plugin.go:1611 Plugin worker disconnected: worker-a W1117 09:28:27.183554 plugin.go:706 Plugin detection detect-1794907707182776804-20c73110d60ca57f for vacuum failed: detection worker worker-a disconnected --- PASS: TestLateDetectionCompletionDoesNotReachNextDetection (0.31s) === RUN TestScheduledDetectionDistinguishesSkipFromEmptyScan === RUN TestScheduledDetectionDistinguishesSkipFromEmptyScan/#00 === RUN TestScheduledDetectionDistinguishesSkipFromEmptyScan/Cooldown_after_successful_job_(10h0m0s) --- PASS: TestScheduledDetectionDistinguishesSkipFromEmptyScan (0.01s) --- PASS: TestScheduledDetectionDistinguishesSkipFromEmptyScan/#00 (0.00s) --- PASS: TestScheduledDetectionDistinguishesSkipFromEmptyScan/Cooldown_after_successful_job_(10h0m0s) (0.00s) === RUN TestManualDetectionSkipDoesNotChangeScheduledStatus --- PASS: TestManualDetectionSkipDoesNotChangeScheduledStatus (0.00s) === RUN TestPrefetchRefreshesSavedDescriptorFromReconnectingWorker --- PASS: TestPrefetchRefreshesSavedDescriptorFromReconnectingWorker (0.01s) === RUN TestRunDetectionIncludesLatestSuccessfulRun --- PASS: TestRunDetectionIncludesLatestSuccessfulRun (0.00s) === RUN TestRunDetectionOmitsLastSuccessfulRunWhenNoSuccessHistory --- PASS: TestRunDetectionOmitsLastSuccessfulRunWhenNoSuccessHistory (0.00s) === RUN TestRunDetectionWithReportCapturesDetectionActivities --- PASS: TestRunDetectionWithReportCapturesDetectionActivities (0.00s) === RUN TestRunDetectionAdminScriptUsesLastCompletedRun --- PASS: TestRunDetectionAdminScriptUsesLastCompletedRun (0.00s) === RUN TestPluginLoadsPersistedMonitorStateOnStart === PAUSE TestPluginLoadsPersistedMonitorStateOnStart === RUN TestPluginPersistsMonitorStateAfterJobUpdates === PAUSE TestPluginPersistsMonitorStateAfterJobUpdates === RUN TestTrackExecutionQueuedMarksPendingState === PAUSE TestTrackExecutionQueuedMarksPendingState === RUN TestHandleJobProgressUpdateCarriesWorkerIDInActivities === PAUSE TestHandleJobProgressUpdateCarriesWorkerIDInActivities === RUN TestHandleJobProgressUpdateWithoutJobIDTracksDetectionActivities === PAUSE TestHandleJobProgressUpdateWithoutJobIDTracksDetectionActivities === RUN TestHandleJobCompletedCarriesWorkerIDInActivitiesAndRunHistory === PAUSE TestHandleJobCompletedCarriesWorkerIDInActivitiesAndRunHistory === RUN TestTrackExecutionStartStoresJobPayloadDetails === PAUSE TestTrackExecutionStartStoresJobPayloadDetails === RUN TestTrackExecutionStartStoresErasureCodingExecutionPlan === PAUSE TestTrackExecutionStartStoresErasureCodingExecutionPlan === RUN TestBuildJobDetailIncludesActivitiesAndRunRecord === PAUSE TestBuildJobDetailIncludesActivitiesAndRunRecord === RUN TestBuildJobDetailKeepsFailedJobResult === PAUSE TestBuildJobDetailKeepsFailedJobResult === RUN TestRetryWithoutResultDropsFailedAttemptSummary === PAUSE TestRetryWithoutResultDropsFailedAttemptSummary === RUN TestBuildJobDetailLoadsFromDiskWhenMemoryCleared === PAUSE TestBuildJobDetailLoadsFromDiskWhenMemoryCleared === RUN TestExpireJobCancelsTheJobOnItsWorker === PAUSE TestExpireJobCancelsTheJobOnItsWorker === RUN TestExpireStaleJobsCancelsTheJobOnItsWorker === PAUSE TestExpireStaleJobsCancelsTheJobOnItsWorker === RUN TestExpireStaleJobsKeepsAJobThatReportsProgress === PAUSE TestExpireStaleJobsKeepsAJobThatReportsProgress === RUN TestExpireJobResendsAnUndeliveredCancelOnHeartbeat === PAUSE TestExpireJobResendsAnUndeliveredCancelOnHeartbeat === RUN TestUndeliveredCancelNamesTheExpiredAttempt === PAUSE TestUndeliveredCancelNamesTheExpiredAttempt === RUN TestUndeliveredCancelByJobIDSkipsAnActiveJob === PAUSE TestUndeliveredCancelByJobIDSkipsAnActiveJob === RUN TestExpiredAttemptIgnoresItsLateReports === PAUSE TestExpiredAttemptIgnoresItsLateReports === RUN TestLoadSchedulerPolicyUsesAdminConfig === PAUSE TestLoadSchedulerPolicyUsesAdminConfig === RUN TestLoadSchedulerPolicyUsesDescriptorDefaultsWhenConfigMissing === PAUSE TestLoadSchedulerPolicyUsesDescriptorDefaultsWhenConfigMissing === RUN TestReserveScheduledExecutorRespectsPerWorkerLimit === PAUSE TestReserveScheduledExecutorRespectsPerWorkerLimit === RUN TestFilterScheduledProposalsDedupe === PAUSE TestFilterScheduledProposalsDedupe === RUN TestBuildScheduledJobSpecDoesNotReuseProposalID === PAUSE TestBuildScheduledJobSpecDoesNotReuseProposalID === RUN TestFilterProposalsWithActiveJobs === PAUSE TestFilterProposalsWithActiveJobs === RUN TestReserveScheduledExecutorTimesOutWhenNoExecutor === PAUSE TestReserveScheduledExecutorTimesOutWhenNoExecutor === RUN TestReserveScheduledExecutorWaitsForWorkerCapacity === PAUSE TestReserveScheduledExecutorWaitsForWorkerCapacity === RUN TestShouldSkipDetectionForWaitingJobs === PAUSE TestShouldSkipDetectionForWaitingJobs === RUN TestWaitingBacklogThresholdHonorsMaxResultsCap === PAUSE TestWaitingBacklogThresholdHonorsMaxResultsCap === RUN TestListSchedulerStatesIncludesPolicyAndState === PAUSE TestListSchedulerStatesIncludesPolicyAndState === RUN TestListSchedulerStatesShowsDisabledWhenNoPolicy === PAUSE TestListSchedulerStatesShowsDisabledWhenNoPolicy === RUN TestPickDetectorPrefersLeasedWorker === PAUSE TestPickDetectorPrefersLeasedWorker === RUN TestPickDetectorReassignsWhenLeaseIsStale === PAUSE TestPickDetectorReassignsWhenLeaseIsStale === RUN TestRunLaneSchedulerIterationLockBehavior === PAUSE TestRunLaneSchedulerIterationLockBehavior === RUN TestDispatchScheduledProposalsLocksPerJob === PAUSE TestDispatchScheduledProposalsLocksPerJob === RUN TestScheduledAttemptContextDrainGrace === PAUSE TestScheduledAttemptContextDrainGrace === RUN TestScheduledEstimatedRuntime === PAUSE TestScheduledEstimatedRuntime === RUN TestDispatchScheduledProposalsDrainsStartedJobOnWindowClose === PAUSE TestDispatchScheduledProposalsDrainsStartedJobOnWindowClose === RUN TestPruneSchedulerState_DefaultLaneKeepsForeignLanesAndPrunesOwnStale --- PASS: TestPruneSchedulerState_DefaultLaneKeepsForeignLanesAndPrunesOwnStale (0.00s) === RUN TestPruneSchedulerState_LifecycleLaneLeavesDefaultLane --- PASS: TestPruneSchedulerState_LifecycleLaneLeavesDefaultLane (0.00s) === RUN TestPruneDetectorLeases_IsLaneScoped --- PASS: TestPruneDetectorLeases_IsLaneScoped (0.00s) === RUN TestLaneStatus_LifecycleNextDetectionSurvivesDefaultLanePrune --- PASS: TestLaneStatus_LifecycleNextDetectionSurvivesDefaultLanePrune (0.00s) === RUN TestReserveWaterfillsPreferredHosts === PAUSE TestReserveWaterfillsPreferredHosts === RUN TestExecutorCapacityCountsOnlyTheJobTypeBeingDispatched === PAUSE TestExecutorCapacityCountsOnlyTheJobTypeBeingDispatched === RUN TestExecutorCapacityHonorsWorkerSlotTotalAcrossJobTypes === PAUSE TestExecutorCapacityHonorsWorkerSlotTotalAcrossJobTypes === RUN TestExecutorCapacityDoesNotDoubleCountReservedJobsEchoedByHeartbeat === PAUSE TestExecutorCapacityDoesNotDoubleCountReservedJobsEchoedByHeartbeat === RUN TestDispatchGivesUpWhenCapacityIsHeldByForeignWork === PAUSE TestDispatchGivesUpWhenCapacityIsHeldByForeignWork === RUN TestDispatchWaitsForItsOwnLaneToReleaseCapacity === PAUSE TestDispatchWaitsForItsOwnLaneToReleaseCapacity === RUN TestDispatchGivesUpWhenNoExecutorReturnsWithinGrace === PAUSE TestDispatchGivesUpWhenNoExecutorReturnsWithinGrace === RUN TestDispatchWaitsForTheEchoOfItsOwnCompletedJob === PAUSE TestDispatchWaitsForTheEchoOfItsOwnCompletedJob === RUN TestExecutorCapacityCountsUnitemizedSlots === PAUSE TestExecutorCapacityCountsUnitemizedSlots === RUN TestDispatchGivesUpPinnedJobsWhoseHomeIsHeldByForeignWork === PAUSE TestDispatchGivesUpPinnedJobsWhoseHomeIsHeldByForeignWork === RUN TestExecutorCapacityCountsARedispatchedJobOnce === PAUSE TestExecutorCapacityCountsARedispatchedJobOnce === RUN TestExecutorCapacityStopsCreditingACompletedJobAfterTheNextHeartbeat === PAUSE TestExecutorCapacityStopsCreditingACompletedJobAfterTheNextHeartbeat === RUN TestExecutorCapacityKeepsSlotsCountedBeforeAReservation === PAUSE TestExecutorCapacityKeepsSlotsCountedBeforeAReservation === RUN TestExecutorCapacityKeepsSlotsCountedBeforeACompletedJob === PAUSE TestExecutorCapacityKeepsSlotsCountedBeforeACompletedJob === RUN TestCapacityReasonNamesUnitemizedSlots === PAUSE TestCapacityReasonNamesUnitemizedSlots === RUN TestRequestObjectPreviewReturnsTheWorkersRows === PAUSE TestRequestObjectPreviewReturnsTheWorkersRows === RUN TestRequestObjectPreviewSurfacesTheWorkersError === PAUSE TestRequestObjectPreviewSurfacesTheWorkersError === RUN TestRequestObjectPreviewNeedsAnObservation === PAUSE TestRequestObjectPreviewNeedsAnObservation === RUN TestRequestObjectPreviewNeedsAConnectedWorker === PAUSE TestRequestObjectPreviewNeedsAConnectedWorker === RUN TestObjectPreviewResponseRacesShutdown === PAUSE TestObjectPreviewResponseRacesShutdown === RUN TestCloneWorkerHeartbeatFiltersNilAndIsolatesState === PAUSE TestCloneWorkerHeartbeatFiltersNilAndIsolatesState === RUN TestCloneWorkerHeartbeatPreservesEmptyCollections === PAUSE TestCloneWorkerHeartbeatPreservesEmptyCollections === RUN TestRegistryPickDetectorPrefersMoreFreeSlots === PAUSE TestRegistryPickDetectorPrefersMoreFreeSlots === RUN TestRegistryPickExecutorAllowsSameWorker === PAUSE TestRegistryPickExecutorAllowsSameWorker === RUN TestRegistryDetectableJobTypes === PAUSE TestRegistryDetectableJobTypes === RUN TestRegistryJobTypes === PAUSE TestRegistryJobTypes === RUN TestRegistryListExecutorsSortedBySlots === PAUSE TestRegistryListExecutorsSortedBySlots === RUN TestRegistryPickExecutorRoundRobinForTopTie === PAUSE TestRegistryPickExecutorRoundRobinForTopTie === RUN TestRegistryListExecutorsRoundRobinForTopTie === PAUSE TestRegistryListExecutorsRoundRobinForTopTie === RUN TestRegistrySkipsStaleWorkersForSelectionAndListing === PAUSE TestRegistrySkipsStaleWorkersForSelectionAndListing === RUN TestRegistryReturnsNoDetectorWhenAllWorkersStale === PAUSE TestRegistryReturnsNoDetectorWhenAllWorkersStale === RUN TestRegistryHasCapableWorkerWithDetectCapability === PAUSE TestRegistryHasCapableWorkerWithDetectCapability === RUN TestRegistryHasCapableWorkerWithExecuteCapability === PAUSE TestRegistryHasCapableWorkerWithExecuteCapability === RUN TestRegistryHasCapableWorkerReturnsFalseWhenNoWorkers === PAUSE TestRegistryHasCapableWorkerReturnsFalseWhenNoWorkers === RUN TestRegistryHasCapableWorkerSkipsStaleWorkers === PAUSE TestRegistryHasCapableWorkerSkipsStaleWorkers === RUN TestRegistryHasCapableWorkerIgnoresNilCapability === PAUSE TestRegistryHasCapableWorkerIgnoresNilCapability === RUN TestListExecutorsPrefersMatchingReplicaHost === PAUSE TestListExecutorsPrefersMatchingReplicaHost === RUN TestJobReplicaHostsFromSourcesAndReplicaServers === PAUSE TestJobReplicaHostsFromSourcesAndReplicaServers === RUN TestJobTypeLaneMapCoversKnownTypes --- PASS: TestJobTypeLaneMapCoversKnownTypes (0.00s) === RUN TestJobTypeLaneFallsBackToDefault --- PASS: TestJobTypeLaneFallsBackToDefault (0.00s) === RUN TestAllLanesHaveIdleSleep --- PASS: TestAllLanesHaveIdleSleep (0.00s) === RUN TestLaneRequiresLock === RUN TestLaneRequiresLock/Default === RUN TestLaneRequiresLock/Iceberg === RUN TestLaneRequiresLock/Lifecycle === RUN TestLaneRequiresLock/Unknown --- PASS: TestLaneRequiresLock (0.00s) --- PASS: TestLaneRequiresLock/Default (0.00s) --- PASS: TestLaneRequiresLock/Iceberg (0.00s) --- PASS: TestLaneRequiresLock/Lifecycle (0.00s) --- PASS: TestLaneRequiresLock/Unknown (0.00s) === RUN TestKnownJobTypesInMap --- PASS: TestKnownJobTypesInMap (0.00s) === RUN TestSchedulerCooldownUsesSavedPolicyAndHistory --- PASS: TestSchedulerCooldownUsesSavedPolicyAndHistory (0.03s) === RUN TestGetSchedulerStatusIncludesInProcessJobs --- PASS: TestGetSchedulerStatusIncludesInProcessJobs (0.00s) === RUN TestGetSchedulerStatusIncludesLastDetectionCount --- PASS: TestGetSchedulerStatusIncludesLastDetectionCount (0.00s) === RUN TestGetLaneSchedulerStatusShowsActiveConcurrentLaneWork --- PASS: TestGetLaneSchedulerStatusShowsActiveConcurrentLaneWork (0.00s) === RUN TestAssignJobsWaterfillsPreferredWorkers === PAUSE TestAssignJobsWaterfillsPreferredWorkers === RUN TestAssignAndTakeDoesNotStarveOtherHomes === PAUSE TestAssignAndTakeDoesNotStarveOtherHomes === RUN TestTakeStealsOnlyWhenHomeQueueReachesK === PAUSE TestTakeStealsOnlyWhenHomeQueueReachesK === RUN TestTakeStealsImmediatelyWhenPinDisabled === PAUSE TestTakeStealsImmediatelyWhenPinDisabled === RUN TestTakeStealsOrphanedHomeWithoutK === PAUSE TestTakeStealsOrphanedHomeWithoutK === RUN TestTakeKeepsOrphanWhenHomeReconnectsDuringGrace === PAUSE TestTakeKeepsOrphanWhenHomeReconnectsDuringGrace === RUN TestTakeStealsOrphanImmediatelyWhenGraceDisabled === PAUSE TestTakeStealsOrphanImmediatelyWhenGraceDisabled === RUN TestBindQueuedJobWorkerKeepsPendingState === PAUSE TestBindQueuedJobWorkerKeepsPendingState === RUN TestHomelessAllRemoteWorkersUseFIFOWithoutPinOrGrace === PAUSE TestHomelessAllRemoteWorkersUseFIFOWithoutPinOrGrace === RUN TestMixedReplicaLocalJobsStayHomeBeforeHomeless === PAUSE TestMixedReplicaLocalJobsStayHomeBeforeHomeless === RUN TestIdleHomeWorkerTakesHomelessAfterEmptyHomeQueue === PAUSE TestIdleHomeWorkerTakesHomelessAfterEmptyHomeQueue === RUN TestHomelessWorkerTakesFIFOBeforeStealableHome === PAUSE TestHomelessWorkerTakesFIFOBeforeStealableHome === RUN TestHomeWorkerStealsBeforeHomelessAfterOwnQueueEmpty === PAUSE TestHomeWorkerStealsBeforeHomelessAfterOwnQueueEmpty === CONT TestIdleHomeWorkerTakesHomelessAfterEmptyHomeQueue === CONT TestConfigStoreDescriptorRoundTrip === CONT TestRegistryPickExecutorRoundRobinForTopTie === CONT TestBuildJobDetailLoadsFromDiskWhenMemoryCleared === CONT TestLoadSchedulerPolicyUsesAdminConfig === CONT TestHomeWorkerStealsBeforeHomelessAfterOwnQueueEmpty === CONT TestExecutionFailedWhenSendToSessionFails === CONT TestConfigStoreMonitorStateRoundTrip === CONT TestShouldSkipDetectionForWaitingJobs === CONT TestExecutionNotTrackedWhenWorkerNotConnected === CONT TestExecutionKeptWhileDispatchSessionHasNotListedJob === CONT TestHomelessWorkerTakesFIFOBeforeStealableHome === CONT TestBuildScheduledJobSpecDoesNotReuseProposalID === CONT TestConfigStoreDeleteJobDetail === CONT TestFilterProposalsWithActiveJobs === CONT TestRequestObjectPreviewNeedsAnObservation === CONT TestConfigStoreJobDetailRoundTrip === CONT TestExecutionFailsWhenWorkerRestartsWithoutJob --- PASS: TestLoadSchedulerPolicyUsesAdminConfig (0.01s) === CONT TestExecutorCapacityCountsOnlyTheJobTypeBeingDispatched === CONT TestRequestObjectPreviewSurfacesTheWorkersError === CONT TestRegistryDetectableJobTypes === CONT TestRegistryPickExecutorAllowsSameWorker === CONT TestCloneWorkerHeartbeatPreservesEmptyCollections === CONT TestCloneWorkerHeartbeatFiltersNilAndIsolatesState === CONT TestObjectPreviewResponseRacesShutdown === CONT TestRequestObjectPreviewNeedsAConnectedWorker === CONT TestRequestObjectPreviewReturnsTheWorkersRows === CONT TestCapacityReasonNamesUnitemizedSlots === CONT TestConfigStoreListJobTypes === CONT TestRegistryJobTypes === CONT TestExecutionKeptWhenReconnectedWorkerListsPaddedJobID === CONT TestDispatchGivesUpWhenCapacityIsHeldByForeignWork --- PASS: TestRequestObjectPreviewNeedsAnObservation (0.05s) --- PASS: TestBuildScheduledJobSpecDoesNotReuseProposalID (0.04s) === CONT TestDispatchGivesUpPinnedJobsWhoseHomeIsHeldByForeignWork --- PASS: TestRegistryPickExecutorAllowsSameWorker (0.01s) === CONT TestPickDetectorPrefersLeasedWorker === CONT TestExecutorCapacityKeepsSlotsCountedBeforeACompletedJob === RUN TestCloneWorkerHeartbeatPreservesEmptyCollections/nil === CONT TestExecutorCapacityCountsARedispatchedJobOnce --- PASS: TestExecutionNotTrackedWhenWorkerNotConnected (0.05s) --- PASS: TestRegistryPickExecutorRoundRobinForTopTie (0.08s) === CONT TestExecutorCapacityCountsUnitemizedSlots --- PASS: TestRegistryDetectableJobTypes (0.05s) === CONT TestDispatchWaitsForTheEchoOfItsOwnCompletedJob --- PASS: TestRegistryJobTypes (0.03s) === CONT TestDispatchGivesUpWhenNoExecutorReturnsWithinGrace === CONT TestExecutorCapacityStopsCreditingACompletedJobAfterTheNextHeartbeat --- PASS: TestConfigStoreListJobTypes (0.04s) === CONT TestFilterScheduledProposalsDedupe === RUN TestDispatchWaitsForTheEchoOfItsOwnCompletedJob/itemized=true --- PASS: TestRequestObjectPreviewNeedsAConnectedWorker (0.05s) === CONT TestAssignJobsWaterfillsPreferredWorkers === PAUSE TestDispatchWaitsForTheEchoOfItsOwnCompletedJob/itemized=true === RUN TestDispatchWaitsForTheEchoOfItsOwnCompletedJob/itemized=false === CONT TestScheduledAttemptContextDrainGrace --- PASS: TestIdleHomeWorkerTakesHomelessAfterEmptyHomeQueue (0.11s) === CONT TestMixedReplicaLocalJobsStayHomeBeforeHomeless === RUN TestCloneWorkerHeartbeatPreservesEmptyCollections/empty --- PASS: TestFilterProposalsWithActiveJobs (0.10s) === PAUSE TestDispatchWaitsForTheEchoOfItsOwnCompletedJob/itemized=false --- PASS: TestExecutionFailedWhenSendToSessionFails (0.12s) === CONT TestHomelessAllRemoteWorkersUseFIFOWithoutPinOrGrace --- PASS: TestShouldSkipDetectionForWaitingJobs (0.12s) === CONT TestReserveWaterfillsPreferredHosts === CONT TestBindQueuedJobWorkerKeepsPendingState --- PASS: TestFilterScheduledProposalsDedupe (0.02s) === CONT TestDispatchScheduledProposalsDrainsStartedJobOnWindowClose --- PASS: TestPickDetectorPrefersLeasedWorker (0.07s) === CONT TestTakeStealsOrphanImmediatelyWhenGraceDisabled --- PASS: TestRequestObjectPreviewReturnsTheWorkersRows (0.07s) === CONT TestRegistryListExecutorsSortedBySlots --- PASS: TestExecutorCapacityKeepsSlotsCountedBeforeACompletedJob (0.07s) === CONT TestTakeKeepsOrphanWhenHomeReconnectsDuringGrace === RUN TestCloneWorkerHeartbeatPreservesEmptyCollections/all_nil_work --- PASS: TestRequestObjectPreviewSurfacesTheWorkersError (0.09s) === CONT TestScheduledEstimatedRuntime --- PASS: TestExecutorCapacityCountsUnitemizedSlots (0.06s) === CONT TestExecutionNotOrphanedAfterDispatcherTookCompletion --- PASS: TestScheduledAttemptContextDrainGrace (0.03s) === CONT TestTakeStealsImmediatelyWhenPinDisabled --- PASS: TestCloneWorkerHeartbeatPreservesEmptyCollections (0.09s) --- PASS: TestCloneWorkerHeartbeatPreservesEmptyCollections/nil (0.01s) --- PASS: TestCloneWorkerHeartbeatPreservesEmptyCollections/empty (0.02s) --- PASS: TestCloneWorkerHeartbeatPreservesEmptyCollections/all_nil_work (0.01s) === CONT TestRetryWithoutResultDropsFailedAttemptSummary --- PASS: TestScheduledEstimatedRuntime (0.01s) === CONT TestTakeStealsOrphanedHomeWithoutK --- PASS: TestExecutorCapacityStopsCreditingACompletedJobAfterTheNextHeartbeat (0.05s) === CONT TestBuildJobDetailKeepsFailedJobResult --- PASS: TestRegistryListExecutorsSortedBySlots (0.02s) === CONT TestRunLaneSchedulerIterationLockBehavior === RUN TestRunLaneSchedulerIterationLockBehavior/Default --- PASS: TestHomelessWorkerTakesFIFOBeforeStealableHome (0.15s) === CONT TestBuildJobDetailIncludesActivitiesAndRunRecord === PAUSE TestRunLaneSchedulerIterationLockBehavior/Default === CONT TestTrackExecutionStartStoresErasureCodingExecutionPlan --- PASS: TestConfigStoreDescriptorRoundTrip (0.15s) === CONT TestDispatchScheduledProposalsLocksPerJob --- PASS: TestTakeStealsOrphanImmediatelyWhenGraceDisabled (0.04s) === CONT TestListExecutorsPrefersMatchingReplicaHost === CONT TestTrackExecutionStartStoresJobPayloadDetails === CONT TestHandleJobCompletedCarriesWorkerIDInActivitiesAndRunHistory === CONT TestJobReplicaHostsFromSourcesAndReplicaServers === CONT TestHandleJobProgressUpdateWithoutJobIDTracksDetectionActivities === RUN TestRunLaneSchedulerIterationLockBehavior/Iceberg === CONT TestRegistryHasCapableWorkerReturnsFalseWhenNoWorkers === RUN TestDispatchScheduledProposalsLocksPerJob/DefaultLaneLocksEachJob --- PASS: TestExecutorCapacityCountsARedispatchedJobOnce (0.08s) --- PASS: TestHomeWorkerStealsBeforeHomelessAfterOwnQueueEmpty (0.16s) --- PASS: TestRegistryHasCapableWorkerReturnsFalseWhenNoWorkers (0.01s) --- PASS: TestCloneWorkerHeartbeatFiltersNilAndIsolatesState (0.12s) === CONT TestHandleJobProgressUpdateCarriesWorkerIDInActivities --- PASS: TestBindQueuedJobWorkerKeepsPendingState (0.04s) --- PASS: TestExecutionNotOrphanedAfterDispatcherTookCompletion (0.02s) --- PASS: TestTakeKeepsOrphanWhenHomeReconnectsDuringGrace (0.04s) === PAUSE TestRunLaneSchedulerIterationLockBehavior/Iceberg --- PASS: TestExecutionKeptWhileDispatchSessionHasNotListedJob (0.20s) === CONT TestRegistryHasCapableWorkerIgnoresNilCapability --- PASS: TestCapacityReasonNamesUnitemizedSlots (0.14s) === CONT TestTrackExecutionQueuedMarksPendingState --- PASS: TestExecutorCapacityCountsOnlyTheJobTypeBeingDispatched (0.19s) === CONT TestRegistryHasCapableWorkerSkipsStaleWorkers --- PASS: TestMixedReplicaLocalJobsStayHomeBeforeHomeless (0.09s) === CONT TestPluginPersistsMonitorStateAfterJobUpdates === PAUSE TestDispatchScheduledProposalsLocksPerJob/DefaultLaneLocksEachJob === RUN TestRunLaneSchedulerIterationLockBehavior/Lifecycle === PAUSE TestRunLaneSchedulerIterationLockBehavior/Lifecycle W1117 09:28:27.835399 orphaned_execution.go:86 Plugin failing ec_vacuum request exec-1794907707673213684-bac8b64182237542: worker worker-a re-registered without job job-lost-in-restart === RUN TestDispatchScheduledProposalsLocksPerJob/LifecycleLaneNeedsNoLock === PAUSE TestDispatchScheduledProposalsLocksPerJob/LifecycleLaneNeedsNoLock === CONT TestPluginLoadsPersistedMonitorStateOnStart === CONT TestLoadSchedulerPolicyUsesDescriptorDefaultsWhenConfigMissing === CONT TestEnsureJobTypeConfigFromDescriptorDoesNotOverwriteExisting --- PASS: TestJobReplicaHostsFromSourcesAndReplicaServers (0.03s) === CONT TestEnsureJobTypeConfigFromDescriptorBootstrapsDefaults === CONT TestTakeStealsOnlyWhenHomeQueueReachesK === CONT TestExecuteJobSendsCancelOnContextDone === CONT TestRegistryReturnsNoDetectorWhenAllWorkersStale --- PASS: TestRegistryHasCapableWorkerIgnoresNilCapability (0.02s) --- PASS: TestRegistryHasCapableWorkerSkipsStaleWorkers (0.02s) --- PASS: TestListExecutorsPrefersMatchingReplicaHost (0.04s) --- PASS: TestTakeStealsImmediatelyWhenPinDisabled (0.08s) --- PASS: TestHomelessAllRemoteWorkersUseFIFOWithoutPinOrGrace (0.10s) === CONT TestDispatchWaitsForItsOwnLaneToReleaseCapacity === CONT TestRunDetectionSendsCancelOnContextDone --- PASS: TestTakeStealsOrphanedHomeWithoutK (0.08s) --- PASS: TestAssignJobsWaterfillsPreferredWorkers (0.12s) === CONT TestRegistryHasCapableWorkerWithExecuteCapability --- PASS: TestHandleJobProgressUpdateWithoutJobIDTracksDetectionActivities (0.04s) === CONT TestListSchedulerStatesIncludesPolicyAndState --- PASS: TestTrackExecutionQueuedMarksPendingState (0.03s) === CONT TestAssignAndTakeDoesNotStarveOtherHomes --- PASS: TestReserveWaterfillsPreferredHosts (0.12s) === CONT TestRegistryHasCapableWorkerWithDetectCapability === CONT TestListSchedulerStatesShowsDisabledWhenNoPolicy --- PASS: TestRegistryReturnsNoDetectorWhenAllWorkersStale (0.01s) === CONT TestExecutorCapacityHonorsWorkerSlotTotalAcrossJobTypes --- PASS: TestHandleJobProgressUpdateCarriesWorkerIDInActivities (0.04s) --- PASS: TestHandleJobCompletedCarriesWorkerIDInActivitiesAndRunHistory (0.05s) === CONT TestWaitingBacklogThresholdHonorsMaxResultsCap --- PASS: TestWaitingBacklogThresholdHonorsMaxResultsCap (0.00s) === CONT TestRegistryListExecutorsRoundRobinForTopTie --- PASS: TestDispatchScheduledProposalsDrainsStartedJobOnWindowClose (0.13s) === CONT TestReserveScheduledExecutorTimesOutWhenNoExecutor --- PASS: TestExecutionFailsWhenWorkerRestartsWithoutJob (0.24s) === CONT TestExpireJobResendsAnUndeliveredCancelOnHeartbeat --- PASS: TestRegistryHasCapableWorkerWithExecuteCapability (0.02s) === CONT TestPickDetectorReassignsWhenLeaseIsStale --- PASS: TestDispatchGivesUpWhenNoExecutorReturnsWithinGrace (0.16s) === CONT TestReserveScheduledExecutorWaitsForWorkerCapacity --- PASS: TestLoadSchedulerPolicyUsesDescriptorDefaultsWhenConfigMissing (0.03s) === CONT TestExpiredAttemptIgnoresItsLateReports --- PASS: TestRegistryHasCapableWorkerWithDetectCapability (0.02s) === CONT TestRegistrySkipsStaleWorkersForSelectionAndListing --- PASS: TestTakeStealsOnlyWhenHomeQueueReachesK (0.04s) === CONT TestUndeliveredCancelNamesTheExpiredAttempt --- PASS: TestReserveScheduledExecutorTimesOutWhenNoExecutor (0.01s) --- PASS: TestExecutorCapacityHonorsWorkerSlotTotalAcrossJobTypes (0.02s) === CONT TestUndeliveredCancelByJobIDSkipsAnActiveJob === CONT TestExpireStaleJobsKeepsAJobThatReportsProgress --- PASS: TestRunDetectionSendsCancelOnContextDone (0.04s) === CONT TestExecutionKeptWhenWorkerReconnectsWithJob --- PASS: TestListSchedulerStatesShowsDisabledWhenNoPolicy (0.03s) === CONT TestConfigStoreSaveJobTypeConfigIfNotExists === RUN TestConfigStoreSaveJobTypeConfigIfNotExists/in-memory --- PASS: TestExecutionKeptWhenReconnectedWorkerListsPaddedJobID (0.22s) === CONT TestExpireStaleJobsCancelsTheJobOnItsWorker === CONT TestExpireJobCancelsTheJobOnItsWorker === PAUSE TestConfigStoreSaveJobTypeConfigIfNotExists/in-memory === RUN TestConfigStoreSaveJobTypeConfigIfNotExists/on-disk === PAUSE TestConfigStoreSaveJobTypeConfigIfNotExists/on-disk === CONT TestExecutionFailedWhenSendFailsAfterShutdownUnregisters --- PASS: TestDispatchGivesUpWhenCapacityIsHeldByForeignWork (0.20s) === CONT TestExecutionKeptWhenHeartbeatDoesNotItemize --- PASS: TestEnsureJobTypeConfigFromDescriptorDoesNotOverwriteExisting (0.04s) --- PASS: TestListSchedulerStatesIncludesPolicyAndState (0.04s) === CONT TestConfigStoreRunHistoryRetention --- PASS: TestPickDetectorReassignsWhenLeaseIsStale (0.03s) === CONT TestExecutorCapacityDoesNotDoubleCountReservedJobsEchoedByHeartbeat --- PASS: TestEnsureJobTypeConfigFromDescriptorBootstrapsDefaults (0.06s) === CONT TestExecutionKeptWhenReplacementStreamListsJobBetweenOmissions --- PASS: TestRegistryListExecutorsRoundRobinForTopTie (0.04s) === CONT TestRegistryPickDetectorPrefersMoreFreeSlots --- PASS: TestExpireJobCancelsTheJobOnItsWorker (0.02s) === CONT TestExecutorCapacityKeepsSlotsCountedBeforeAReservation --- PASS: TestRegistrySkipsStaleWorkersForSelectionAndListing (0.03s) === CONT TestReserveScheduledExecutorRespectsPerWorkerLimit --- PASS: TestAssignAndTakeDoesNotStarveOtherHomes (0.06s) === CONT TestDispatchWaitsForTheEchoOfItsOwnCompletedJob/itemized=true === RUN TestExecutionKeptWhenReplacementStreamListsJobBetweenOmissions/itemized --- PASS: TestExpiredAttemptIgnoresItsLateReports (0.05s) === CONT TestDispatchWaitsForTheEchoOfItsOwnCompletedJob/itemized=false --- PASS: TestExpireStaleJobsKeepsAJobThatReportsProgress (0.04s) === CONT TestRunLaneSchedulerIterationLockBehavior/Default --- PASS: TestRegistryPickDetectorPrefersMoreFreeSlots (0.02s) === CONT TestRunLaneSchedulerIterationLockBehavior/Lifecycle --- PASS: TestExecuteJobSendsCancelOnContextDone (0.09s) === CONT TestRunLaneSchedulerIterationLockBehavior/Iceberg --- PASS: TestReserveScheduledExecutorRespectsPerWorkerLimit (0.02s) === CONT TestDispatchScheduledProposalsLocksPerJob/DefaultLaneLocksEachJob --- PASS: TestReserveScheduledExecutorWaitsForWorkerCapacity (0.06s) === CONT TestDispatchScheduledProposalsLocksPerJob/LifecycleLaneNeedsNoLock --- PASS: TestDispatchGivesUpPinnedJobsWhoseHomeIsHeldByForeignWork (0.26s) === CONT TestConfigStoreSaveJobTypeConfigIfNotExists/in-memory --- PASS: TestExecutorCapacityDoesNotDoubleCountReservedJobsEchoedByHeartbeat (0.04s) === CONT TestConfigStoreSaveJobTypeConfigIfNotExists/on-disk --- PASS: TestExecutionFailedWhenSendFailsAfterShutdownUnregisters (0.05s) --- PASS: TestExpireStaleJobsCancelsTheJobOnItsWorker (0.05s) --- PASS: TestExecutorCapacityKeepsSlotsCountedBeforeAReservation (0.03s) --- PASS: TestDispatchWaitsForItsOwnLaneToReleaseCapacity (0.10s) --- PASS: TestConfigStoreDeleteJobDetail (0.32s) --- PASS: TestConfigStoreJobDetailRoundTrip (0.33s) --- PASS: TestBuildJobDetailLoadsFromDiskWhenMemoryCleared (0.34s) --- PASS: TestTrackExecutionStartStoresJobPayloadDetails (0.17s) --- PASS: TestConfigStoreMonitorStateRoundTrip (0.35s) --- PASS: TestObjectPreviewResponseRacesShutdown (0.30s) --- PASS: TestRunLaneSchedulerIterationLockBehavior (0.06s) --- PASS: TestRunLaneSchedulerIterationLockBehavior/Iceberg (0.05s) --- PASS: TestRunLaneSchedulerIterationLockBehavior/Default (0.05s) --- PASS: TestRunLaneSchedulerIterationLockBehavior/Lifecycle (0.05s) --- PASS: TestPluginPersistsMonitorStateAfterJobUpdates (0.17s) --- PASS: TestPluginLoadsPersistedMonitorStateOnStart (0.15s) --- PASS: TestDispatchScheduledProposalsLocksPerJob (0.05s) --- PASS: TestDispatchScheduledProposalsLocksPerJob/LifecycleLaneNeedsNoLock (0.05s) --- PASS: TestDispatchScheduledProposalsLocksPerJob/DefaultLaneLocksEachJob (0.06s) --- PASS: TestBuildJobDetailIncludesActivitiesAndRunRecord (0.23s) --- PASS: TestRetryWithoutResultDropsFailedAttemptSummary (0.23s) --- PASS: TestBuildJobDetailKeepsFailedJobResult (0.23s) --- PASS: TestConfigStoreSaveJobTypeConfigIfNotExists (0.01s) --- PASS: TestConfigStoreSaveJobTypeConfigIfNotExists/in-memory (0.02s) --- PASS: TestConfigStoreSaveJobTypeConfigIfNotExists/on-disk (0.07s) --- PASS: TestExecutionKeptWhenWorkerReconnectsWithJob (0.12s) --- PASS: TestExecutionKeptWhenHeartbeatDoesNotItemize (0.12s) --- PASS: TestDispatchWaitsForTheEchoOfItsOwnCompletedJob (0.03s) --- PASS: TestDispatchWaitsForTheEchoOfItsOwnCompletedJob/itemized=false (0.10s) --- PASS: TestDispatchWaitsForTheEchoOfItsOwnCompletedJob/itemized=true (0.11s) --- PASS: TestUndeliveredCancelByJobIDSkipsAnActiveJob (0.15s) --- PASS: TestExpireJobResendsAnUndeliveredCancelOnHeartbeat (0.16s) === RUN TestExecutionKeptWhenReplacementStreamListsJobBetweenOmissions/partly_itemized --- PASS: TestTrackExecutionStartStoresErasureCodingExecutionPlan (0.27s) --- PASS: TestUndeliveredCancelNamesTheExpiredAttempt (0.17s) --- PASS: TestConfigStoreRunHistoryRetention (0.19s) --- PASS: TestExecutionKeptWhenReplacementStreamListsJobBetweenOmissions (0.24s) --- PASS: TestExecutionKeptWhenReplacementStreamListsJobBetweenOmissions/itemized (0.12s) --- PASS: TestExecutionKeptWhenReplacementStreamListsJobBetweenOmissions/partly_itemized (0.10s) PASS ok github.com/seaweedfs/seaweedfs/weed/admin/plugin 3.626s === RUN TestActiveTopologyBasicOperations --- PASS: TestActiveTopologyBasicOperations (0.00s) === RUN TestActiveTopologyUpdate --- PASS: TestActiveTopologyUpdate (0.01s) === RUN TestTaskLifecycle --- PASS: TestTaskLifecycle (0.01s) === RUN TestTaskDetectionScenarios === RUN TestTaskDetectionScenarios/Empty_cluster_-_no_tasks_needed === RUN TestTaskDetectionScenarios/Unbalanced_cluster_-_balance_task_needed === RUN TestTaskDetectionScenarios/High_garbage_ratio_-_vacuum_task_needed === RUN TestTaskDetectionScenarios/Large_volumes_-_EC_task_needed === RUN TestTaskDetectionScenarios/Recent_tasks_-_no_immediate_re-detection --- PASS: TestTaskDetectionScenarios (0.01s) --- PASS: TestTaskDetectionScenarios/Empty_cluster_-_no_tasks_needed (0.00s) --- PASS: TestTaskDetectionScenarios/Unbalanced_cluster_-_balance_task_needed (0.00s) --- PASS: TestTaskDetectionScenarios/High_garbage_ratio_-_vacuum_task_needed (0.00s) --- PASS: TestTaskDetectionScenarios/Large_volumes_-_EC_task_needed (0.00s) --- PASS: TestTaskDetectionScenarios/Recent_tasks_-_no_immediate_re-detection (0.00s) === RUN TestTargetSelectionScenarios === RUN TestTargetSelectionScenarios/Balance_task_-_find_least_loaded_disk === RUN TestTargetSelectionScenarios/EC_task_-_find_multiple_available_disks === RUN TestTargetSelectionScenarios/Vacuum_task_-_cross-type_tasks_do_not_block_per_disk --- PASS: TestTargetSelectionScenarios (0.03s) --- PASS: TestTargetSelectionScenarios/Balance_task_-_find_least_loaded_disk (0.00s) --- PASS: TestTargetSelectionScenarios/EC_task_-_find_multiple_available_disks (0.00s) --- PASS: TestTargetSelectionScenarios/Vacuum_task_-_cross-type_tasks_do_not_block_per_disk (0.00s) === RUN TestDiskLoadCalculation --- PASS: TestDiskLoadCalculation (0.00s) === RUN TestCrossTypeTasksDoNotBlockPerDisk --- PASS: TestCrossTypeTasksDoNotBlockPerDisk (0.00s) === RUN TestECPlanningNotBlockedByUnrelatedBalance --- PASS: TestECPlanningNotBlockedByUnrelatedBalance (0.00s) === RUN TestECPlannerSeesEachPhysicalDisk --- PASS: TestECPlannerSeesEachPhysicalDisk (0.01s) === RUN TestVolumeIndexResolvesPhysicalDiskZero --- PASS: TestVolumeIndexResolvesPhysicalDiskZero (0.00s) === RUN TestECShardIndexResolvesPhysicalDiskZero --- PASS: TestECShardIndexResolvesPhysicalDiskZero (0.00s) === RUN TestPublicInterfaces --- PASS: TestPublicInterfaces (0.00s) === RUN TestDestinationPlanning === RUN TestDestinationPlanning/GetAvailableDisks_functionality === RUN TestDestinationPlanning/Topology_provides_planning_information --- PASS: TestDestinationPlanning (0.00s) --- PASS: TestDestinationPlanning/GetAvailableDisks_functionality (0.00s) --- PASS: TestDestinationPlanning/Topology_provides_planning_information (0.00s) === RUN TestGetDisksWithEffectiveCapacityNotCappedAtTenByLoad === PAUSE TestGetDisksWithEffectiveCapacityNotCappedAtTenByLoad === RUN TestCountTopologyResources_multiDiskPerNode --- PASS: TestCountTopologyResources_multiDiskPerNode (0.00s) === RUN TestUpdateTopologyIgnoresEmptyDiskTypeEntries --- PASS: TestUpdateTopologyIgnoresEmptyDiskTypeEntries (0.03s) === RUN TestUpdateTopologyKeepsVolumesBehindEmptyDiskTypeEntries --- PASS: TestUpdateTopologyKeepsVolumesBehindEmptyDiskTypeEntries (0.01s) === RUN TestUpdateTopologyIgnoresEmptyDiskTypeEntriesAtAnyDiskId --- PASS: TestUpdateTopologyIgnoresEmptyDiskTypeEntriesAtAnyDiskId (0.01s) === RUN TestStorageSlotChangeArithmetic --- PASS: TestStorageSlotChangeArithmetic (0.00s) === RUN TestStorageSlotChange --- PASS: TestStorageSlotChange (0.00s) === RUN TestStorageSlotChangeCapacityCalculation --- PASS: TestStorageSlotChangeCapacityCalculation (0.00s) === RUN TestGetDisksWithEffectiveCapacity_UnknownEmptyDiskFallback --- PASS: TestGetDisksWithEffectiveCapacity_UnknownEmptyDiskFallback (0.00s) === RUN TestECMultipleTargets storage_slot_test.go:512: EC operation distributed 14 shards across 3 targets storage_slot_test.go:513: Capacity impacts: EC source reserves with zero impact, Targets minimal (shards < 10) --- PASS: TestECMultipleTargets (0.01s) === RUN TestCapacityReservationCycle storage_slot_test.go:611: Capacity lifecycle with StorageSlotChange: Pending -> Assigned -> Released -> Applied storage_slot_test.go:612: Source: 10 -> 11 -> 11 -> 10 -> 11 (freed by pending balance, then applied) storage_slot_test.go:613: Target: 10 -> 9 -> 9 -> 10 -> 9 (reserved by pending, then applied) --- PASS: TestCapacityReservationCycle (0.00s) === RUN TestReplicatedVolumeECOperations storage_slot_test.go:766: Replicated volume EC operation: 3 source replicas, 14 EC shards distributed across 3 destinations storage_slot_test.go:768: Each source replica reserves with zero capacity impact, destinations receive EC shards --- PASS: TestReplicatedVolumeECOperations (0.01s) === RUN TestECWithOldShardCleanup storage_slot_test.go:919: EC operation with cleanup: 2 volume replicas + 2 old EC shard locations → 14 new EC shards storage_slot_test.go:921: Volume sources have zero impact, old EC shard sources free capacity, new destinations consume shard slots --- PASS: TestECWithOldShardCleanup (0.00s) === RUN TestDetailedCapacityCalculations storage_slot_test.go:997: Detailed capacity calculation: VolumeSlots=80, ShardSlots=-5 storage_slot_test.go:999: Capacity impact: VolumeSlots=0, ShardSlots=5 storage_slot_test.go:1001: Simple capacity (backward compatible): 80 --- PASS: TestDetailedCapacityCalculations (0.00s) === RUN TestStorageSlotChangeConversions storage_slot_test.go:1052: Conversion tests passed: 10 shards = 1 volume slot storage_slot_test.go:1053: Mixed capacity (2 volumes + 15 shards) = 3 equivalent volume slots storage_slot_test.go:1055: Available capacity (10 volumes) = 100 total shard slots storage_slot_test.go:1057: NOTE: This test adapts automatically to erasure_coding.DataShardsCount = 10 --- PASS: TestStorageSlotChangeConversions (0.00s) === CONT TestGetDisksWithEffectiveCapacityNotCappedAtTenByLoad --- PASS: TestGetDisksWithEffectiveCapacityNotCappedAtTenByLoad (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/admin/topology 1.634s === RUN TestAdminDashboardShowsDiskUsage --- PASS: TestAdminDashboardShowsDiskUsage (0.02s) === RUN TestS3BucketModalsEscapeDynamicHTMLText --- PASS: TestS3BucketModalsEscapeDynamicHTMLText (0.02s) === RUN TestCalculatePercent64PetabyteScale --- PASS: TestCalculatePercent64PetabyteScale (0.00s) === RUN TestClusterHealthSummary --- PASS: TestClusterHealthSummary (0.00s) === RUN TestAdminDashboardListsVectorServers --- PASS: TestAdminDashboardListsVectorServers (0.02s) === RUN TestClusterVectorServers --- PASS: TestClusterVectorServers (0.01s) === RUN TestFileBrowserPathURLEscapesQueryPath --- PASS: TestFileBrowserPathURLEscapesQueryPath (0.00s) === RUN TestFileBrowserPageURLEscapesCursor --- PASS: TestFileBrowserPageURLEscapesCursor (0.00s) === RUN TestPolicyActionSuggestions_NotEmpty --- PASS: TestPolicyActionSuggestions_NotEmpty (0.00s) === RUN TestPolicyActionSuggestions_NoDuplicates --- PASS: TestPolicyActionSuggestions_NoDuplicates (0.00s) === RUN TestPolicyActionSuggestions_AllPrefixed --- PASS: TestPolicyActionSuggestions_AllPrefixed (0.00s) === RUN TestPolicyActionSuggestions_NoEmptyStrings --- PASS: TestPolicyActionSuggestions_NoEmptyStrings (0.00s) === RUN TestVectorPolicySuggestions --- PASS: TestVectorPolicySuggestions (0.00s) === RUN TestS3VectorsBucketsRendersBuckets --- PASS: TestS3VectorsBucketsRendersBuckets (0.01s) === RUN TestS3VectorsBucketDetailsRendersIndexesAndPolicy --- PASS: TestS3VectorsBucketDetailsRendersIndexesAndPolicy (0.02s) === RUN TestJSONDepthSkipsStrings --- PASS: TestJSONDepthSkipsStrings (0.00s) === RUN TestS3TablesBucketsLinksVectorBuckets --- PASS: TestS3TablesBucketsLinksVectorBuckets (0.01s) === RUN TestVectorOperationalStates --- PASS: TestVectorOperationalStates (0.00s) === RUN TestVolumeDetailsAccessControls --- PASS: TestVolumeDetailsAccessControls (0.11s) PASS ok github.com/seaweedfs/seaweedfs/weed/admin/view/app 3.229s ? github.com/seaweedfs/seaweedfs/weed/admin/view/components [no test files] ? github.com/seaweedfs/seaweedfs/weed/admin/view/layout [no test files] === RUN TestConcurrentAddRemoveNodes --- PASS: TestConcurrentAddRemoveNodes (0.02s) === RUN TestListClusterNodeUpdates --- PASS: TestListClusterNodeUpdates (0.00s) === RUN TestIsKnownNode --- PASS: TestIsKnownNode (0.00s) === RUN TestLockClientHostMatchesFilerRing --- PASS: TestLockClientHostMatchesFilerRing (0.05s) === RUN TestLockClientHostFallsBackToSeed --- PASS: TestLockClientHostFallsBackToSeed (0.00s) === RUN TestLockClientSetRingVersionGuard --- PASS: TestLockClientSetRingVersionGuard (0.00s) === RUN TestLockClientPrimaryForKey --- PASS: TestLockClientPrimaryForKey (0.00s) === RUN TestLockClientPriorOwnerForKey --- PASS: TestLockClientPriorOwnerForKey (0.01s) === RUN TestLockClientPriorOwnerForKeyExpires --- PASS: TestLockClientPriorOwnerForKeyExpires (0.06s) === RUN TestLockClientResetRing --- PASS: TestLockClientResetRing (0.00s) === RUN TestNewShortLivedLockFailsFastOnNoLockServer W1117 09:28:27.460963 lock_client.go:186 create lock test-key: no lock server found --- PASS: TestNewShortLivedLockFailsFastOnNoLockServer (1.19s) === RUN TestNewShortLivedLockWaitsOutContention --- PASS: TestNewShortLivedLockWaitsOutContention (0.61s) === RUN TestNewBlockingLongLivedLockWithinGivesUpOnContention W1117 09:28:29.576666 lock_client.go:186 create lock test-key: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:38013: connect: connection refused" --- PASS: TestNewBlockingLongLivedLockWithinGivesUpOnContention (2.03s) === RUN TestNewShortLivedLockFailsFastOnUnreachableFiler W1117 09:28:31.141987 lock_client.go:186 create lock test-key: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:40639: connect: connection refused" --- PASS: TestNewShortLivedLockFailsFastOnUnreachableFiler (1.01s) === RUN TestNewShortLivedLockFallsBackToSeedOnHangingPrimary I1117 09:28:32.204230 lock_client.go:345 LOCK: no response within 200ms for key=test-key filer=127.0.0.1:2, falling back to seed filer=127.0.0.1:1 --- PASS: TestNewShortLivedLockFallsBackToSeedOnHangingPrimary (1.07s) === RUN TestNewShortLivedLockBoundsSeedRedirectCycle I1117 09:28:33.245514 lock_client.go:345 LOCK: no response within 200ms for key=test-key filer=127.0.0.1:2, falling back to seed filer=127.0.0.1:1 W1117 09:28:34.254467 lock_client.go:186 create lock test-key: forward failed --- PASS: TestNewShortLivedLockBoundsSeedRedirectCycle (2.04s) === RUN TestNewShortLivedLockBoundsCleanRedirectCycle I1117 09:28:35.269750 lock_client.go:345 LOCK: no response within 200ms for key=test-key filer=127.0.0.1:2, falling back to seed filer=127.0.0.1:1 W1117 09:28:36.275032 lock_client.go:186 create lock test-key: lock test-key: no lock server granted within 200ms --- PASS: TestNewShortLivedLockBoundsCleanRedirectCycle (2.02s) === RUN TestDoLockKeepsRenewTokenOnError --- PASS: TestDoLockKeepsRenewTokenOnError (0.02s) === RUN TestDoLockClearsRenewTokenOnRejection --- PASS: TestDoLockClearsRenewTokenOnRejection (0.01s) === RUN TestDoLockKeepsRenewTokenOnCleanRedirect --- PASS: TestDoLockKeepsRenewTokenOnCleanRedirect (0.01s) === RUN TestLiveLockGenerationIsAligned --- PASS: TestLiveLockGenerationIsAligned (0.00s) === RUN TestLockRingManager_BatchesRapidChanges I1117 09:28:36.422639 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907716421724493: [filer1:8888 filer2:8888 filer3:8888] --- PASS: TestLockRingManager_BatchesRapidChanges (0.20s) === RUN TestLockRingManager_DropAndJoinBatched I1117 09:28:36.526817 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907716526034917: [filer1:8888 filer2:8888 filer3:8888] I1117 09:28:36.628355 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907716627886965: [filer1:8888 filer2:8888 filer4:8888] --- PASS: TestLockRingManager_DropAndJoinBatched (0.20s) === RUN TestLockRingManager_VersionIncrements I1117 09:28:36.780304 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907716779927637: [filer1:8888] I1117 09:28:36.881181 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907716880824990: [filer1:8888 filer2:8888] --- PASS: TestLockRingManager_VersionIncrements (0.20s) === RUN TestLockRingManager_FlushPending I1117 09:28:36.933291 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907716932706419: [filer2:8888 filer1:8888] --- PASS: TestLockRingManager_FlushPending (0.00s) === RUN TestLockRingManager_MultipleGroups I1117 09:28:36.985184 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group2" version 1794907716984781633: [filer2:8888] I1117 09:28:36.985329 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group1" version 1794907716985079085: [filer1:8888] --- PASS: TestLockRingManager_MultipleGroups (0.10s) === RUN TestLockRingManager_GetServers --- PASS: TestLockRingManager_GetServers (0.00s) === RUN TestLockRingManager_NoBroadcastWithoutFn I1117 09:28:37.056676 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717056345339: [filer1:8888] --- PASS: TestLockRingManager_NoBroadcastWithoutFn (0.05s) === RUN TestLockRingManager_EmptyRingNotBroadcast I1117 09:28:37.098037 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717097730792: [filer1:8888] --- PASS: TestLockRingManager_EmptyRingNotBroadcast (0.12s) === RUN TestLockRingManager_PeriodicRebroadcast I1117 09:28:37.240352 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717240033367: [filer1:8888] I1117 09:28:37.301169 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717300739026: [filer1:8888] I1117 09:28:37.361561 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717361280080: [filer1:8888] --- PASS: TestLockRingManager_PeriodicRebroadcast (0.20s) === RUN TestLockRingManager_RebroadcastDefersToPendingStabilization I1117 09:28:37.422515 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717421940960: [filer1:8888] I1117 09:28:37.423527 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717423182078: [filer1:8888] I1117 09:28:37.483414 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717483110357: [filer1:8888] I1117 09:28:37.526288 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717525935102: [filer2:8888] I1117 09:28:37.544581 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717544277155: [filer1:8888] I1117 09:28:37.556741 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717556528576: [filer2:8888] I1117 09:28:37.590335 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717589958295: [filer2:8888] I1117 09:28:37.605271 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717604946985: [filer1:8888] I1117 09:28:37.621748 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717621286890: [filer2:8888] I1117 09:28:37.652169 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717651797075: [filer2:8888] I1117 09:28:37.666513 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717666201370: [filer1:8888] I1117 09:28:37.682805 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717682539685: [filer2:8888] --- PASS: TestLockRingManager_RebroadcastDefersToPendingStabilization (0.26s) === RUN TestLockRingManager_GetLastUpdateReturnsBroadcastState I1117 09:28:37.687730 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "default" version 1794907717687201903: [filer1:8888 filer2:8888] --- PASS: TestLockRingManager_GetLastUpdateReturnsBroadcastState (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/cluster 13.166s === RUN TestDLM_PrimaryCrash_BackupPromotes --- PASS: TestDLM_PrimaryCrash_BackupPromotes (0.06s) === RUN TestDLM_BackupCrash_PrimaryContinues --- PASS: TestDLM_BackupCrash_PrimaryContinues (0.03s) === RUN TestDLM_BothPrimaryAndBackupCrash --- PASS: TestDLM_BothPrimaryAndBackupCrash (0.04s) === RUN TestDLM_RollingRestart distributed_lock_manager_test.go:337: Locks survived rolling restart: 2 / 5 --- PASS: TestDLM_RollingRestart (0.21s) === RUN TestDLM_GenerationIncrementsOnNewAcquisition --- PASS: TestDLM_GenerationIncrementsOnNewAcquisition (3.04s) === RUN TestDLM_ReplicationFailure_PrimaryStillWorks --- PASS: TestDLM_ReplicationFailure_PrimaryStillWorks (0.03s) === RUN TestDLM_UnlockReplicatesToBackup --- PASS: TestDLM_UnlockReplicatesToBackup (0.04s) === RUN TestDLM_TopologyChange_LockSurvivesServerAddition --- PASS: TestDLM_TopologyChange_LockSurvivesServerAddition (0.05s) === RUN TestDLM_ConsistentHashing_MinimalDisruption distributed_lock_manager_test.go:477: Lock distribution before: map[filer1:8888:7 filer2:8888:22 filer3:8888:21] --- PASS: TestDLM_ConsistentHashing_MinimalDisruption (0.55s) === RUN TestDLM_NodeDropAndJoin_OwnershipDisruption distributed_lock_manager_test.go:593: Locks disrupted from departed filer3: 44 / 100 distributed_lock_manager_test.go:594: Locks disrupted from surviving filer1/filer2: 14 / 100 distributed_lock_manager_test.go:595: Locks now on new filer4: 24 / 100 --- PASS: TestDLM_NodeDropAndJoin_OwnershipDisruption (1.13s) === RUN TestDLM_RenewalDuringTransferWindow distributed_lock_manager_test.go:671: Key transfer-window-lock-0: primary changed from filer3:8888 to filer4:8888, but renewal on old primary succeeded --- PASS: TestDLM_RenewalDuringTransferWindow (0.06s) === RUN TestDLM_ReplayedRenewalExtendsBackupExpiry --- PASS: TestDLM_ReplayedRenewalExtendsBackupExpiry (0.03s) === RUN TestDLM_BackupPromotionKeepsLostRenewalRecovery --- PASS: TestDLM_BackupPromotionKeepsLostRenewalRecovery (0.03s) === RUN TestDLM_StaleReplicationRejected --- PASS: TestDLM_StaleReplicationRejected (0.00s) === RUN TestHashRing_BasicOperations --- PASS: TestHashRing_BasicOperations (0.01s) === RUN TestHashRing_DuplicateAddRemove --- PASS: TestHashRing_DuplicateAddRemove (0.00s) === RUN TestHashRing_SetServers --- PASS: TestHashRing_SetServers (0.00s) === RUN TestHashRing_ConsistencyOnRemoval hash_ring_test.go:101: Keys that moved: 380 / 1000 --- PASS: TestHashRing_ConsistencyOnRemoval (0.04s) === RUN TestHashRing_BackupIsSuccessor --- PASS: TestHashRing_BackupIsSuccessor (1.08s) === RUN TestHashRing_Distribution hash_ring_test.go:150: Server filer1:8888: 677 keys (32.3% deviation) hash_ring_test.go:150: Server filer3:8888: 1250 keys (25.0% deviation) hash_ring_test.go:150: Server filer2:8888: 1073 keys (7.3% deviation) --- PASS: TestHashRing_Distribution (0.04s) === RUN TestHashRing_GetPrimary --- PASS: TestHashRing_GetPrimary (0.00s) === RUN TestHashRing_OrderIndependent --- PASS: TestHashRing_OrderIndependent (0.12s) === RUN TestLockManager_GetLockOwnerIgnoresExpiredLock --- PASS: TestLockManager_GetLockOwnerIgnoresExpiredLock (0.00s) === RUN TestLockManager_InsertLockRejectsStaleTransfer --- PASS: TestLockManager_InsertLockRejectsStaleTransfer (0.00s) === RUN TestLockManager_InsertLockAdvancesGenerationCounter --- PASS: TestLockManager_InsertLockAdvancesGenerationCounter (0.00s) === RUN TestLockManager_InsertBackupLockRejectsOlderGeneration --- PASS: TestLockManager_InsertBackupLockRejectsOlderGeneration (0.00s) === RUN TestLockManager_InsertBackupLockKeepsPrimaryRole --- PASS: TestLockManager_InsertBackupLockKeepsPrimaryRole (0.00s) === RUN TestLockManager_RemoveBackupLockRejectsOlderGeneration --- PASS: TestLockManager_RemoveBackupLockRejectsOlderGeneration (0.00s) === RUN TestLockManager_LostRenewalResponseReplaysToken --- PASS: TestLockManager_LostRenewalResponseReplaysToken (0.00s) === RUN TestLockManager_LostRenewalReplayAdvancesSeq --- PASS: TestLockManager_LostRenewalReplayAdvancesSeq (0.00s) === RUN TestLockManager_InsertBackupLockKeepsPrevToken --- PASS: TestLockManager_InsertBackupLockKeepsPrevToken (0.00s) === RUN TestLockRing_PriorOwner --- PASS: TestLockRing_PriorOwner (5.01s) === RUN TestLockRing_PriorOwnerExpires --- PASS: TestLockRing_PriorOwnerExpires (0.06s) === RUN TestLockRing_WriteOwner --- PASS: TestLockRing_WriteOwner (5.01s) === RUN TestLockRing_SetSnapshot --- PASS: TestLockRing_SetSnapshot (0.22s) === RUN TestLockRing_SnapshotCompaction --- PASS: TestLockRing_SnapshotCompaction (0.24s) === RUN TestLockRing_VersionRejectsStale I1117 09:28:43.168706 lock_ring.go:54 LockRing: rejecting stale update v2 (current v3) --- PASS: TestLockRing_VersionRejectsStale (0.03s) === RUN TestLockRing_SetSnapshotUnchangedOnlyBumpsVersion --- PASS: TestLockRing_SetSnapshotUnchangedOnlyBumpsVersion (0.00s) === RUN TestLockRing_Reset --- PASS: TestLockRing_Reset (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/cluster/lock_manager 18.677s ? github.com/seaweedfs/seaweedfs/weed/cluster/maintenance [no test files] === RUN TestBackupOffset_HistoricalFallbackThenIndependence --- PASS: TestBackupOffset_HistoricalFallbackThenIndependence (0.23s) === RUN TestBackupOffset_DistinctDestinationsDoNotShare --- PASS: TestBackupOffset_DistinctDestinationsDoNotShare (0.03s) === RUN TestFilerBackup_OffsetReadFailureFailsAttempt I1117 09:36:58.021328 filer_replication.go:129 Configure sink to local I1117 09:36:58.061801 filer_replication.go:129 Configure sink to local I1117 09:36:58.075516 filer_backup.go:166 starting from 1970-01-01 00:00:00 +0000 UTC (no prior checkpoint) I1117 09:36:58.093151 s3_sse_s3.go:566 SSE-S3 KeyManager: No KEK configured. SSE-S3 encryption is disabled. Set s3.sse.kek or s3.sse.key in security.toml to enable it. I1117 09:36:58.094754 sse_init.go:50 KMS initialized for replication W1117 09:36:58.134485 filer_backup.go:299 persist backup offset: rpc error: code = Unimplemented desc = method KvPut not implemented --- PASS: TestFilerBackup_OffsetReadFailureFailsAttempt (0.13s) === RUN TestIsIgnorable404_WrappedErrNotFound --- PASS: TestIsIgnorable404_WrappedErrNotFound (0.05s) === RUN TestIsIgnorable404_BrokenUnwrapChain --- PASS: TestIsIgnorable404_BrokenUnwrapChain (0.01s) === RUN TestIsIgnorable404_NonIgnorableError --- PASS: TestIsIgnorable404_NonIgnorableError (0.02s) === RUN TestIsIgnorable404_TransientLookupNotSwallowed === RUN TestIsIgnorable404_TransientLookupNotSwallowed/lookup_file_id_race === RUN TestIsIgnorable404_TransientLookupNotSwallowed/volume_id_not_found_race --- PASS: TestIsIgnorable404_TransientLookupNotSwallowed (0.01s) --- PASS: TestIsIgnorable404_TransientLookupNotSwallowed/lookup_file_id_race (0.00s) --- PASS: TestIsIgnorable404_TransientLookupNotSwallowed/volume_id_not_found_race (0.00s) === RUN TestErrorClassifiersNilSafe --- PASS: TestErrorClassifiersNilSafe (0.00s) === RUN TestIsSourceLookupError_NonLookupErrors === RUN TestIsSourceLookupError_NonLookupErrors/genuine_S3_404 === RUN TestIsSourceLookupError_NonLookupErrors/network_error === RUN TestIsSourceLookupError_NonLookupErrors/plain_not_found_without_volume_id --- PASS: TestIsSourceLookupError_NonLookupErrors (0.00s) --- PASS: TestIsSourceLookupError_NonLookupErrors/genuine_S3_404 (0.00s) --- PASS: TestIsSourceLookupError_NonLookupErrors/network_error (0.00s) --- PASS: TestIsSourceLookupError_NonLookupErrors/plain_not_found_without_volume_id (0.00s) === RUN TestEventSupersessionProbe_PathDerivation === RUN TestEventSupersessionProbe_PathDerivation/legacy_event_without_NewParentPath === RUN TestEventSupersessionProbe_PathDerivation/rename_event_with_NewParentPath --- PASS: TestEventSupersessionProbe_PathDerivation (0.00s) --- PASS: TestEventSupersessionProbe_PathDerivation/legacy_event_without_NewParentPath (0.00s) --- PASS: TestEventSupersessionProbe_PathDerivation/rename_event_with_NewParentPath (0.00s) === RUN TestEventSourceSuperseded_Guards --- PASS: TestEventSourceSuperseded_Guards (0.00s) === RUN TestInitialSnapshotTargetKey --- PASS: TestInitialSnapshotTargetKey (0.00s) === RUN TestBackupCheckpointIds_DistinctDestinations --- PASS: TestBackupCheckpointIds_DistinctDestinations (0.00s) === RUN TestBackupCheckpointIds_DistinctSourcePaths --- PASS: TestBackupCheckpointIds_DistinctSourcePaths (0.00s) === RUN TestBackupCheckpointIds_LegacyFormulaUnchanged --- PASS: TestBackupCheckpointIds_LegacyFormulaUnchanged (0.00s) === RUN TestBackupCheckpointIds_NoAliasing --- PASS: TestBackupCheckpointIds_NoAliasing (0.00s) === RUN TestBackupCheckpointIds_FlattenModeDistinct --- PASS: TestBackupCheckpointIds_FlattenModeDistinct (0.00s) === RUN TestBackupCheckpointIds_Stable --- PASS: TestBackupCheckpointIds_Stable (0.00s) === RUN TestFlattenDropsVersionFileEvents --- PASS: TestFlattenDropsVersionFileEvents (0.00s) === RUN TestFlattenPassesThroughNormalEvents --- PASS: TestFlattenPassesThroughNormalEvents (0.00s) === RUN TestFlattenUploadsLatestVersion --- PASS: TestFlattenUploadsLatestVersion (0.00s) === RUN TestFlattenDeletesOnLatestDeleteMarker --- PASS: TestFlattenDeletesOnLatestDeleteMarker (0.01s) === RUN TestFlattenDeleteHonorsDoDeleteFiles --- PASS: TestFlattenDeleteHonorsDoDeleteFiles (0.00s) === RUN TestFlattenDeleteOnClearedPointerAndRemovedDir --- PASS: TestFlattenDeleteOnClearedPointerAndRemovedDir (0.00s) === RUN TestFlattenFreshVersionsDirIsSkipped --- PASS: TestFlattenFreshVersionsDirIsSkipped (0.00s) === RUN TestFlattenNullVersionIsLatest --- PASS: TestFlattenNullVersionIsLatest (0.00s) === RUN TestFlattenNullVersionDeletedRescansNewestVersion --- PASS: TestFlattenNullVersionDeletedRescansNewestVersion (0.01s) === RUN TestFlattenNullVersionDeletedNewestIsDeleteMarker --- PASS: TestFlattenNullVersionDeletedNewestIsDeleteMarker (0.01s) === RUN TestFlattenNullVersionDeletedNoVersionsLeftDeletes --- PASS: TestFlattenNullVersionDeletedNoVersionsLeftDeletes (0.00s) === RUN TestFlattenNullVersionDeletedScansPastOnePage --- PASS: TestFlattenNullVersionDeletedScansPastOnePage (0.07s) === RUN TestFlattenVersionFileEventRefreshesCurrentVersion --- PASS: TestFlattenVersionFileEventRefreshesCurrentVersion (0.00s) === RUN TestFlattenExcludedObjectNameIsNotCopiedOrDeleted --- PASS: TestFlattenExcludedObjectNameIsNotCopiedOrDeleted (0.00s) === RUN TestFlattenRegularPathFollowsVersionsPointer --- PASS: TestFlattenRegularPathFollowsVersionsPointer (0.00s) === RUN TestFlattenRenameLeavesDeleteForGenericPath --- PASS: TestFlattenRenameLeavesDeleteForGenericPath (0.00s) === RUN TestFlattenRenameLeavesCreateForGenericPath --- PASS: TestFlattenRenameLeavesCreateForGenericPath (0.00s) === RUN TestFlattenRenameBothSidesVersioned --- PASS: TestFlattenRenameBothSidesVersioned (0.00s) === RUN TestFlattenDeleteMarkerVersionEntry --- PASS: TestFlattenDeleteMarkerVersionEntry (0.00s) === RUN TestUploadFileInChunksStoresChunksInOffsetOrder uploading f.bin in 3 chunks ... uploaded f.bin-2 [65536,131072) uploaded f.bin-3 [131072,196608) uploaded f.bin-1 [0,65536) copied /tmp/TestUploadFileInChunksStoresChunksInOffsetOrder2114988589/001/f.bin => http://127.0.0.1:1/dir/f.bin --- PASS: TestUploadFileInChunksStoresChunksInOffsetOrder (0.41s) === RUN TestCopyMetadataStreamsFromAnUnfinishedWalk I1117 09:36:58.795062 filer_meta_backup.go:174 traversing metadata tree... I1117 09:36:58.798788 filer_meta_backup.go:201 an earlier metadata walk started at 2026-11-17 09:36:58.794326354 +0000 UTC did not finish; streaming from then I1117 09:36:58.799579 filer_meta_backup.go:174 traversing metadata tree... I1117 09:36:58.799922 filer_meta_backup.go:201 an earlier metadata walk started at 2026-11-17 09:36:58.794326354 +0000 UTC did not finish; streaming from then I1117 09:36:58.800098 filer_meta_backup.go:174 traversing metadata tree... I1117 09:36:58.800460 filer_meta_backup.go:187 metadata copied up to 2026-11-17 09:36:58.794326354 +0000 UTC I1117 09:36:58.800810 filer_meta_backup.go:174 traversing metadata tree... I1117 09:36:58.800966 filer_meta_backup.go:187 metadata copied up to 2026-11-17 09:36:58.800729087 +0000 UTC m=+10.729161309 --- PASS: TestCopyMetadataStreamsFromAnUnfinishedWalk (0.01s) === RUN TestCopyMetadataIgnoresAWalkStartTheStreamPassed I1117 09:36:58.802536 filer_meta_backup.go:201 an earlier metadata walk started at 2026-11-17 08:36:58.802090511 +0000 UTC did not finish; streaming from then I1117 09:36:58.803173 filer_meta_backup.go:174 traversing metadata tree... I1117 09:36:58.803356 filer_meta_backup.go:187 metadata copied up to 2026-11-17 09:36:58.803083816 +0000 UTC m=+10.731516058 --- PASS: TestCopyMetadataIgnoresAWalkStartTheStreamPassed (0.00s) === RUN TestCopyMetadataResumesOnlyItsOwnWalk I1117 09:36:58.804393 filer_meta_backup.go:174 traversing metadata tree... I1117 09:36:58.805174 filer_meta_backup.go:201 an earlier metadata walk started at 2026-11-17 09:36:58.804158808 +0000 UTC did not finish; streaming from then I1117 09:36:58.805667 filer_meta_backup.go:174 traversing metadata tree... I1117 09:36:58.806018 filer_meta_backup.go:187 metadata copied up to 2026-11-17 09:36:58.804158808 +0000 UTC I1117 09:36:58.806402 filer_meta_backup.go:174 traversing metadata tree... I1117 09:36:58.806612 filer_meta_backup.go:187 metadata copied up to 2026-11-17 09:36:58.806327551 +0000 UTC m=+10.734759743 --- PASS: TestCopyMetadataResumesOnlyItsOwnWalk (0.00s) === RUN TestLogicalPathResolvesVersionedLayout === RUN TestLogicalPathResolvesVersionedLayout/version_file_reports_the_object_key === RUN TestLogicalPathResolvesVersionedLayout/versions_directory_reports_the_object_key === RUN TestLogicalPathResolvesVersionedLayout/unversioned_object_is_unchanged === RUN TestLogicalPathResolvesVersionedLayout/v__prefix_outside_a_versions_directory_is_a_normal_name --- PASS: TestLogicalPathResolvesVersionedLayout (0.00s) --- PASS: TestLogicalPathResolvesVersionedLayout/version_file_reports_the_object_key (0.00s) --- PASS: TestLogicalPathResolvesVersionedLayout/versions_directory_reports_the_object_key (0.00s) --- PASS: TestLogicalPathResolvesVersionedLayout/unversioned_object_is_unchanged (0.00s) --- PASS: TestLogicalPathResolvesVersionedLayout/v__prefix_outside_a_versions_directory_is_a_normal_name (0.00s) === RUN TestLogicalPathRawKeepsStoredPath --- PASS: TestLogicalPathRawKeepsStoredPath (0.00s) === RUN TestToScanEventClassifiesOperations === RUN TestToScanEventClassifiesOperations/create === RUN TestToScanEventClassifiesOperations/delete === RUN TestToScanEventClassifiesOperations/update_in_place === RUN TestToScanEventClassifiesOperations/rename --- PASS: TestToScanEventClassifiesOperations (0.00s) --- PASS: TestToScanEventClassifiesOperations/create (0.00s) --- PASS: TestToScanEventClassifiesOperations/delete (0.00s) --- PASS: TestToScanEventClassifiesOperations/update_in_place (0.00s) --- PASS: TestToScanEventClassifiesOperations/rename (0.00s) === RUN TestDescribeEntryMarksDeleteMarkers --- PASS: TestDescribeEntryMarksDeleteMarkers (0.00s) === RUN TestParseScanTimeHonoursTimezone --- PASS: TestParseScanTimeHonoursTimezone (0.01s) === RUN TestGatewayDroppedLocalCopyIsNotUploaded --- PASS: TestGatewayDroppedLocalCopyIsNotUploaded (0.02s) === RUN TestGatewayUncachedRewriteWaitsForTheSupersessionLookup --- PASS: TestGatewayUncachedRewriteWaitsForTheSupersessionLookup (0.01s) === RUN TestGatewayRemoteOnlyRenameCopiesTheObject I1117 09:36:58.865242 filer_remote_gateway_buckets.go:595 copy gatewaytest-rename/gold/dir/old.txt -> gatewaytest-rename/gold/dir/new.txt --- PASS: TestGatewayRemoteOnlyRenameCopiesTheObject (0.02s) === RUN TestGatewayRemoteOnlyRenameAlreadyComplete I1117 09:36:58.873071 filer_remote_gateway_buckets.go:565 gatewaytest-rename-complete/gold/dir/new.txt already holds the renamed content --- PASS: TestGatewayRemoteOnlyRenameAlreadyComplete (0.01s) === RUN TestGatewayRenameReleasesPendingSource I1117 09:36:58.879584 filer_remote_gateway_buckets.go:659 delete gatewaytest-release/gold/dir/orig.txt, the source of a pending rename --- PASS: TestGatewayRenameReleasesPendingSource (0.00s) === RUN TestGatewayRenameKeepsHeldPendingSource I1117 09:36:58.882158 filer_remote_gateway_buckets.go:651 keep /buckets/gold/dir/orig.txt: a remote-only entry holds the pending rename's source --- PASS: TestGatewayRenameKeepsHeldPendingSource (0.00s) === RUN TestGatewayRemoteOnlyRenameSourceOutOfCoverage I1117 09:36:58.884803 filer_remote_gateway_buckets.go:565 gatewaytest-outsrc/gold/dir/new.txt already holds the renamed content --- PASS: TestGatewayRemoteOnlyRenameSourceOutOfCoverage (0.00s) === RUN TestGatewayRenameOutKeepsRemoteOnlyObject I1117 09:36:58.888506 filer_remote_gateway_buckets.go:485 keep gatewaytest-out/gold/dir/old.txt: the renamed entry's only content --- PASS: TestGatewayRenameOutKeepsRemoteOnlyObject (0.00s) === RUN TestGatewayMetadataOnlyDeleteKeepsTheRemoteObject I1117 09:36:58.901023 filer_remote_gateway_buckets.go:352 delete gatewaytest/b/dir/obj.bin --- PASS: TestGatewayMetadataOnlyDeleteKeepsTheRemoteObject (0.01s) === RUN TestGatewayUnmountedBucketDeleteIsSkipped I1117 09:36:58.903755 filer_remote_gateway_buckets.go:168 remote bucket unmounted-bucket is not mounted, skipping delete --- PASS: TestGatewayUnmountedBucketDeleteIsSkipped (0.00s) === RUN TestGatewayCreatesABucketAfterTheMappingFileIsDeleted I1117 09:36:58.907247 filer_remote_gateway_buckets.go:151 create bucket fresh --- PASS: TestGatewayCreatesABucketAfterTheMappingFileIsDeleted (0.01s) === RUN TestGatewayDeleteOfAnAbsentObjectSucceeds I1117 09:36:58.913034 filer_remote_gateway_buckets.go:352 delete gatewaytest-absent-delete/gold/dir/obj.bin --- PASS: TestGatewayDeleteOfAnAbsentObjectSucceeds (0.00s) === RUN TestGatewayKeepsTheDefaultStorageAcrossMappingChanges === RUN TestGatewayKeepsTheDefaultStorageAcrossMappingChanges/mapping_updated I1117 09:36:58.916702 filer_remote_gateway_buckets.go:97 gatewaytest-default-storage is set as the primary remote storage I1117 09:36:58.917561 filer_remote_gateway_buckets.go:151 create bucket fresh === RUN TestGatewayKeepsTheDefaultStorageAcrossMappingChanges/mapping_deleted I1117 09:36:58.919771 filer_remote_gateway_buckets.go:97 gatewaytest-default-storage is set as the primary remote storage I1117 09:36:58.920489 filer_remote_gateway_buckets.go:151 create bucket fresh --- PASS: TestGatewayKeepsTheDefaultStorageAcrossMappingChanges (0.01s) --- PASS: TestGatewayKeepsTheDefaultStorageAcrossMappingChanges/mapping_updated (0.00s) --- PASS: TestGatewayKeepsTheDefaultStorageAcrossMappingChanges/mapping_deleted (0.00s) === RUN TestGatewayKeptDeleteMarkerRetry I1117 09:36:58.926458 filer_remote_sync_dir.go:1801 delete (marker) gatewaytest-kept-marker/gold/dir/held.bin W1117 09:36:58.928400 filer_remote_gateway_buckets.go:691 /buckets/unmounted is not mounted --- PASS: TestGatewayKeptDeleteMarkerRetry (0.01s) === RUN TestGatewayLockReleaseLooksUpTheKeptMarker === RUN TestGatewayLockReleaseLooksUpTheKeptMarker/hold_released === RUN TestGatewayLockReleaseLooksUpTheKeptMarker/held_version_deleted === RUN TestGatewayLockReleaseLooksUpTheKeptMarker/unlocked_version_updated === RUN TestGatewayLockReleaseLooksUpTheKeptMarker/unlocked_version_deleted --- PASS: TestGatewayLockReleaseLooksUpTheKeptMarker (0.01s) --- PASS: TestGatewayLockReleaseLooksUpTheKeptMarker/hold_released (0.00s) --- PASS: TestGatewayLockReleaseLooksUpTheKeptMarker/held_version_deleted (0.00s) --- PASS: TestGatewayLockReleaseLooksUpTheKeptMarker/unlocked_version_updated (0.00s) --- PASS: TestGatewayLockReleaseLooksUpTheKeptMarker/unlocked_version_deleted (0.00s) === RUN TestAllMountsFollowsEachMountOnceUnderItsOwnClient I1117 09:36:58.945017 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:36:58.945018 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/b to remote storage I1117 09:36:58.945120 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/c to remote storage I1117 09:36:59.005289 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/d to remote storage --- PASS: TestAllMountsFollowsEachMountOnceUnderItsOwnClient (0.07s) === RUN TestAllMountsWriteBackEndsAtTheUnmountNotBefore I1117 09:36:59.010605 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage --- PASS: TestAllMountsWriteBackEndsAtTheUnmountNotBefore (0.18s) === RUN TestAllMountsRestartsAnEndedWriteBackWhileMounted I1117 09:36:59.187551 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:36:59.258577 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage --- PASS: TestAllMountsRestartsAnEndedWriteBackWhileMounted (0.08s) === RUN TestAllMountsGuards I1117 09:36:59.263323 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage E1117 09:36:59.263899 filer_remote_sync_all.go:295 synchronize /buckets/a: stream reset E1117 09:37:00.269964 filer_remote_sync_all.go:295 synchronize /buckets/a: stream reset I1117 09:37:02.343456 filer_remote_sync_all.go:243 filer.remote.sync -allMounts: /buckets/c has no saved offset after 2m0s; starting from its creation I1117 09:37:02.344671 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/c to remote storage --- PASS: TestAllMountsGuards (3.09s) === RUN TestAllMountsRetiresAFailedFollowWhoseMountIsGone I1117 09:37:02.352227 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage E1117 09:37:02.352502 filer_remote_sync_all.go:295 synchronize /buckets/a: stream reset E1117 09:37:03.353855 filer_remote_sync_all.go:295 synchronize /buckets/a: /buckets/a is not mounted I1117 09:37:03.442822 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage --- PASS: TestAllMountsRetiresAFailedFollowWhoseMountIsGone (1.09s) === RUN TestNothingIsAdmittedAfterAnUnmount I1117 09:37:03.571120 filer_remote_sync_dir.go:279 /buckets/a unmounted at 3: its write-back stops I1117 09:37:03.581889 filer_remote_sync_dir.go:279 /buckets/a unmounted at 2: its write-back stops --- PASS: TestNothingIsAdmittedAfterAnUnmount (0.14s) === RUN TestNothingIsAdmittedAfterAMove I1117 09:37:03.592176 filer_remote_sync_dir.go:277 /buckets/a moved name:"r" bucket:"zone" path:"/a" => name:"r" bucket:"zone2" path:"/a" at 2: its write-back stops --- PASS: TestNothingIsAdmittedAfterAMove (0.01s) === RUN TestAPanickingJobIsAnError E1117 09:37:03.607811 filer_remote_sync_dir.go:562 /buckets/a: job at 7 panicked: assignment to entry in nil map goroutine 472 [running]: runtime/debug.Stack() /usr/lib/go/src/runtime/debug/stack.go:26 +0x56 github.com/seaweedfs/seaweedfs/weed/command.recoverJob.func1.1() /build/seaweedfs/src/seaweedfs-4.54/weed/command/filer_remote_sync_dir.go:562 +0x40 panic({0x78bff00?, 0x8070180?}) /usr/lib/go/src/runtime/panic.go:859 +0xf6 github.com/seaweedfs/seaweedfs/weed/command.TestAPanickingJobIsAnError.func1(0x85a5e?) /build/seaweedfs/src/seaweedfs-4.54/weed/command/filer_remote_sync_all_test.go:416 +0x32 github.com/seaweedfs/seaweedfs/weed/command.recoverJob.func1(0x12917e?) /build/seaweedfs/src/seaweedfs-4.54/weed/command/filer_remote_sync_dir.go:566 +0x5a github.com/seaweedfs/seaweedfs/weed/command.TestAPanickingJobIsAnError(0x4a609cbee488) /build/seaweedfs/src/seaweedfs-4.54/weed/command/filer_remote_sync_all_test.go:419 +0x1ae testing.tRunner(0x4a609cbee488, 0x80611a8) /usr/lib/go/src/testing/testing.go:2195 +0xba created by testing.(*T).Run in goroutine 1 /usr/lib/go/src/testing/testing.go:2260 +0x36c --- PASS: TestAPanickingJobIsAnError (0.01s) === RUN TestAFollowNeverMovesAnOffsetSomeoneElseWrote I1117 09:37:03.610154 filer_remote_sync_dir.go:374 /buckets/a: its sync offset was moved to 900 by someone else; this write-back no longer saves it --- PASS: TestAFollowNeverMovesAnOffsetSomeoneElseWrote (0.00s) === RUN TestAResumePositionStaysWithItsMount I1117 09:37:03.611441 filer_remote_sync_dir.go:327 /buckets/a: mounted at name:"r" bucket:"zone" path:"/b" now, not name:"r" bucket:"zone" path:"/a" where it stopped: not resuming from 50 I1117 09:37:03.612428 filer_remote_sync_dir.go:327 /buckets/a: mounted at name:"r" bucket:"zone" path:"/b" now, not name:"r" bucket:"zone" path:"/a" where it stopped: not resuming from 50 I1117 09:37:03.613148 filer_remote_sync_dir.go:327 /buckets/a/x: mounted at name:"r" bucket:"zone" path:"/a/a/x" now, not name:"r" bucket:"zone" path:"/a/x" where it stopped: not resuming from 50 I1117 09:37:03.613602 filer_remote_sync_dir.go:330 /buckets/a: its sync offset was moved to 900 by someone else since it stopped: starting there, not at 50 I1117 09:37:03.614066 filer_remote_sync_dir.go:1565 resume from 1970-01-01 00:00:00.0000009 +0000 UTC I1117 09:37:03.616397 filer_remote_sync_dir.go:1525 resuming previous attempt at 1970-01-01 00:00:00.00000005 +0000 UTC --- PASS: TestAResumePositionStaysWithItsMount (0.01s) === RUN TestAGuardsOwnWriteThatFailedIsNotAMove I1117 09:37:03.617487 filer_remote_sync_dir.go:374 /buckets/a: its sync offset was moved to 900 by someone else; this write-back no longer saves it --- PASS: TestAGuardsOwnWriteThatFailedIsNotAMove (0.00s) === RUN TestAllMountsWarnsAboutAWriteBackThatKeepsEndingAtAnUnmount I1117 09:37:03.621768 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.626935 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.628356 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.629647 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.630856 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.632576 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.633866 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.635281 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.637255 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.638532 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.641363 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.642732 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.644341 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.645823 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.647203 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.648837 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.650070 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.651411 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.652695 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.653928 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.655595 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.656870 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage I1117 09:37:03.658134 filer_remote_sync_all.go:273 filer.remote.sync -allMounts: synchronize /buckets/a to remote storage --- PASS: TestAllMountsWarnsAboutAWriteBackThatKeepsEndingAtAnUnmount (0.04s) === RUN TestVersionedFilePathRewrittenForRemote --- PASS: TestVersionedFilePathRewrittenForRemote (0.00s) === RUN TestVersionsDirectoryFilteredByHasData --- PASS: TestVersionsDirectoryFilteredByHasData (0.00s) === RUN TestIsVersionedPath === RUN TestIsVersionedPath/version_file_in_.versions_dir === RUN TestIsVersionedPath/regular_file === RUN TestIsVersionedPath/.versions_directory_entry === RUN TestIsVersionedPath/non-version_file_in_.versions_dir === RUN TestIsVersionedPath/file_in_user_dir_ending_with_.versions_but_no_v__prefix === RUN TestIsVersionedPath/regular_directory === RUN TestIsVersionedPath/file_named_like_.versions_dir === RUN TestIsVersionedPath/.versions_dir_outside_/buckets/ === RUN TestIsVersionedPath/v__file_outside_/buckets/ --- PASS: TestIsVersionedPath (0.03s) --- PASS: TestIsVersionedPath/version_file_in_.versions_dir (0.00s) --- PASS: TestIsVersionedPath/regular_file (0.00s) --- PASS: TestIsVersionedPath/.versions_directory_entry (0.00s) --- PASS: TestIsVersionedPath/non-version_file_in_.versions_dir (0.00s) --- PASS: TestIsVersionedPath/file_in_user_dir_ending_with_.versions_but_no_v__prefix (0.00s) --- PASS: TestIsVersionedPath/regular_directory (0.00s) --- PASS: TestIsVersionedPath/file_named_like_.versions_dir (0.00s) --- PASS: TestIsVersionedPath/.versions_dir_outside_/buckets/ (0.00s) --- PASS: TestIsVersionedPath/v__file_outside_/buckets/ (0.00s) === RUN TestDeleteMarkerDetectedBeforeHasDataFilter --- PASS: TestDeleteMarkerDetectedBeforeHasDataFilter (0.00s) === RUN TestRewriteVersionedSourcePath === RUN TestRewriteVersionedSourcePath/version_file_in_.versions_dir === RUN TestRewriteVersionedSourcePath/regular_file === RUN TestRewriteVersionedSourcePath/version_file_at_bucket_root === RUN TestRewriteVersionedSourcePath/non-bucket_path_not_rewritten === RUN TestRewriteVersionedSourcePath/non-bucket_mount_not_rewritten === RUN TestRewriteVersionedSourcePath/non-version_file_in_.versions_dir === RUN TestRewriteVersionedSourcePath/dir_not_ending_in_.versions --- PASS: TestRewriteVersionedSourcePath (0.00s) --- PASS: TestRewriteVersionedSourcePath/version_file_in_.versions_dir (0.00s) --- PASS: TestRewriteVersionedSourcePath/regular_file (0.00s) --- PASS: TestRewriteVersionedSourcePath/version_file_at_bucket_root (0.00s) --- PASS: TestRewriteVersionedSourcePath/non-bucket_path_not_rewritten (0.00s) --- PASS: TestRewriteVersionedSourcePath/non-bucket_mount_not_rewritten (0.00s) --- PASS: TestRewriteVersionedSourcePath/non-version_file_in_.versions_dir (0.00s) --- PASS: TestRewriteVersionedSourcePath/dir_not_ending_in_.versions (0.00s) === RUN TestIsMetadataOnlyUpdate === RUN TestIsMetadataOnlyUpdate/same_chunks === RUN TestIsMetadataOnlyUpdate/same_chunks,_no_RemoteEntry === RUN TestIsMetadataOnlyUpdate/rewritten_chunks === RUN TestIsMetadataOnlyUpdate/first_write_into_an_empty_entry === RUN TestIsMetadataOnlyUpdate/rename === RUN TestIsMetadataOnlyUpdate/move_to_another_directory --- PASS: TestIsMetadataOnlyUpdate (0.01s) --- PASS: TestIsMetadataOnlyUpdate/same_chunks (0.00s) --- PASS: TestIsMetadataOnlyUpdate/same_chunks,_no_RemoteEntry (0.00s) --- PASS: TestIsMetadataOnlyUpdate/rewritten_chunks (0.00s) --- PASS: TestIsMetadataOnlyUpdate/first_write_into_an_empty_entry (0.00s) --- PASS: TestIsMetadataOnlyUpdate/rename (0.00s) --- PASS: TestIsMetadataOnlyUpdate/move_to_another_directory (0.00s) === RUN TestLiveRemoteEntry === RUN TestLiveRemoteEntry/event_carries_the_RemoteEntry,_no_lookup === RUN TestLiveRemoteEntry/never_replicated === RUN TestLiveRemoteEntry/stamped_after_the_event_was_logged === RUN TestLiveRemoteEntry/deleted_since --- PASS: TestLiveRemoteEntry (0.01s) --- PASS: TestLiveRemoteEntry/event_carries_the_RemoteEntry,_no_lookup (0.00s) --- PASS: TestLiveRemoteEntry/never_replicated (0.00s) --- PASS: TestLiveRemoteEntry/stamped_after_the_event_was_logged (0.00s) --- PASS: TestLiveRemoteEntry/deleted_since (0.00s) === RUN TestFilerLookupsOnTheSyncPathCarryADeadline --- PASS: TestFilerLookupsOnTheSyncPathCarryADeadline (0.21s) === RUN TestRetriedWriteFileStopsWhenTheLookupAfterAFailureIsUnanswered I1117 09:37:03.936041 filer_remote_sync_dir.go:1479 create b2/tier/lease.json E1117 09:37:03.989121 filer_remote_sync_dir.go:1488 write to name:"b2" bucket:"tier" path:"/lease.json": /buckets/ingest/lease.json supersession lookup unanswered: LookupEntry1: context deadline exceeded (after: RequestError: send request failed caused by: Put "https://s3.example.com/tier/x": 503 Service Unavailable) --- PASS: TestRetriedWriteFileStopsWhenTheLookupAfterAFailureIsUnanswered (0.06s) === RUN TestResolveLastSyncOffsetKeepsTheSavedOffsetWhenTheLookupFails I1117 09:37:03.990864 filer_remote_sync_dir.go:1547 get mounted directory /buckets/x: context deadline exceeded; resume from the saved offset 2026-11-04 17:57:10.123 +0000 UTC I1117 09:37:03.991656 filer_remote_sync_dir.go:1565 resume from 2026-11-04 17:57:10.123 +0000 UTC I1117 09:37:03.991927 filer_remote_sync_dir.go:1565 resume from 2026-11-04 17:57:10.123 +0000 UTC --- PASS: TestResolveLastSyncOffsetKeepsTheSavedOffsetWhenTheLookupFails (0.00s) === RUN TestResolveLastSyncOffsetReturnsTheErrorToTheRetryLoop --- PASS: TestResolveLastSyncOffsetReturnsTheErrorToTheRetryLoop (0.01s) === RUN TestSaveResumeOffsetKeepsTheStartForTheRetry E1117 09:37:04.190629 filer_remote_sync_dir.go:250 save the sync offset of /buckets/x: rpc error: code = Unimplemented desc = method KvPut not implemented I1117 09:37:04.192498 filer_remote_sync_dir.go:1497 resuming previous attempt at 2026-11-17 08:37:04.02038545 +0000 UTC --- PASS: TestSaveResumeOffsetKeepsTheStartForTheRetry (0.20s) === RUN TestRemoteUploadReaderSharesOneChunkCache --- PASS: TestRemoteUploadReaderSharesOneChunkCache (0.37s) === RUN TestIsSuperseded === RUN TestIsSuperseded/deleted_since === RUN TestIsSuperseded/rewritten_since === RUN TestIsSuperseded/recreated_with_identical_content === RUN TestIsSuperseded/recreated_with_other_content === RUN TestIsSuperseded/truncated_since === RUN TestIsSuperseded/still_as_described === RUN TestIsSuperseded/still_as_described,_since_replicated === RUN TestIsSuperseded/appended_since === RUN TestIsSuperseded/filer_lookup_failed === RUN TestIsSuperseded/written_since:_the_event_described_an_entry_without_data === RUN TestIsSuperseded/mid-write_snapshot_with_a_hole,_filled_in_since === RUN TestIsSuperseded/inline_content_rewritten_since --- PASS: TestIsSuperseded (0.02s) --- PASS: TestIsSuperseded/deleted_since (0.00s) --- PASS: TestIsSuperseded/rewritten_since (0.00s) --- PASS: TestIsSuperseded/recreated_with_identical_content (0.00s) --- PASS: TestIsSuperseded/recreated_with_other_content (0.00s) --- PASS: TestIsSuperseded/truncated_since (0.00s) --- PASS: TestIsSuperseded/still_as_described (0.00s) --- PASS: TestIsSuperseded/still_as_described,_since_replicated (0.00s) --- PASS: TestIsSuperseded/appended_since (0.00s) --- PASS: TestIsSuperseded/filer_lookup_failed (0.00s) --- PASS: TestIsSuperseded/written_since:_the_event_described_an_entry_without_data (0.00s) --- PASS: TestIsSuperseded/mid-write_snapshot_with_a_hole,_filled_in_since (0.00s) --- PASS: TestIsSuperseded/inline_content_rewritten_since (0.00s) === RUN TestRetriedWriteFileZeroFillsHoles === RUN TestRetriedWriteFileZeroFillsHoles/gap_between_chunks I1117 09:37:04.599690 filer_remote_sync_dir.go:1479 create b2/tier/sparse.dat === RUN TestRetriedWriteFileZeroFillsHoles/gap_inside_a_manifest_chunk I1117 09:37:04.725149 filer_remote_sync_dir.go:1479 create b2/tier/sparse.dat === RUN TestRetriedWriteFileZeroFillsHoles/holed_entry_with_no_declared_size I1117 09:37:04.730021 filer_remote_sync_dir.go:1479 create b2/tier/sparse.dat === RUN TestRetriedWriteFileZeroFillsHoles/chunkless_entry_uploads_zeros_to_its_declared_size I1117 09:37:04.736474 filer_remote_sync_dir.go:1479 create b2/tier/truncated.dat --- PASS: TestRetriedWriteFileZeroFillsHoles (0.14s) --- PASS: TestRetriedWriteFileZeroFillsHoles/gap_between_chunks (0.10s) --- PASS: TestRetriedWriteFileZeroFillsHoles/gap_inside_a_manifest_chunk (0.03s) --- PASS: TestRetriedWriteFileZeroFillsHoles/holed_entry_with_no_declared_size (0.01s) --- PASS: TestRetriedWriteFileZeroFillsHoles/chunkless_entry_uploads_zeros_to_its_declared_size (0.00s) === RUN TestRetriedWriteFileStopsWhenSuperseded === RUN TestRetriedWriteFileStopsWhenSuperseded/superseded_before_the_first_attempt,_no_write === RUN TestRetriedWriteFileStopsWhenSuperseded/superseded_during_the_attempt,_one_write I1117 09:37:04.741723 filer_remote_sync_dir.go:1479 create b2/tier/tmpjt9req69__Alan_Doe_Resume-1.pdf === RUN TestRetriedWriteFileStopsWhenSuperseded/mid-write_snapshot_filled_in_during_the_attempt,_one_write I1117 09:37:04.744143 filer_remote_sync_dir.go:1479 create b2/tier/tmpjt9req69__Alan_Doe_Resume-1.pdf === RUN TestRetriedWriteFileStopsWhenSuperseded/mid-write_snapshot_still_held_uploads_its_hole_as_zeros I1117 09:37:04.746449 filer_remote_sync_dir.go:1479 create b2/tier/tmpjt9req69__Alan_Doe_Resume-1.pdf === RUN TestRetriedWriteFileStopsWhenSuperseded/still_as_described,_transient_failure_keeps_retrying I1117 09:37:04.769268 filer_remote_sync_dir.go:1479 create b2/tier/tmpjt9req69__Alan_Doe_Resume-1.pdf I1117 09:37:04.770718 retry.go:181 retry writeFile: err: RequestError: send request failed caused by: Put "https://s3.example.com/tier/x": http://volume:8444/3,01?readDeleted=true: 404 Not Found: not found I1117 09:37:05.771798 filer_remote_sync_dir.go:1479 create b2/tier/tmpjt9req69__Alan_Doe_Resume-1.pdf I1117 09:37:05.772463 retry.go:181 retry writeFile: err: RequestError: send request failed caused by: Put "https://s3.example.com/tier/x": http://volume:8444/3,01?readDeleted=true: 404 Not Found: not found E1117 09:37:07.273176 filer_remote_sync_dir.go:1488 write to name:"b2" bucket:"tier" path:"/tmpjt9req69__Alan_Doe_Resume-1.pdf": RequestError: send request failed caused by: Put "https://s3.example.com/tier/x": http://volume:8444/3,01?readDeleted=true: 404 Not Found: not found === RUN TestRetriedWriteFileStopsWhenSuperseded/still_as_described,_permanent_failure_not_retried I1117 09:37:07.276120 filer_remote_sync_dir.go:1479 create b2/tier/tmpjt9req69__Alan_Doe_Resume-1.pdf E1117 09:37:07.276606 filer_remote_sync_dir.go:1488 write to name:"b2" bucket:"tier" path:"/tmpjt9req69__Alan_Doe_Resume-1.pdf": AccessDenied: Access Denied --- PASS: TestRetriedWriteFileStopsWhenSuperseded (2.54s) --- PASS: TestRetriedWriteFileStopsWhenSuperseded/superseded_before_the_first_attempt,_no_write (0.00s) --- PASS: TestRetriedWriteFileStopsWhenSuperseded/superseded_during_the_attempt,_one_write (0.00s) --- PASS: TestRetriedWriteFileStopsWhenSuperseded/mid-write_snapshot_filled_in_during_the_attempt,_one_write (0.00s) --- PASS: TestRetriedWriteFileStopsWhenSuperseded/mid-write_snapshot_still_held_uploads_its_hole_as_zeros (0.02s) --- PASS: TestRetriedWriteFileStopsWhenSuperseded/still_as_described,_transient_failure_keeps_retrying (2.51s) --- PASS: TestRetriedWriteFileStopsWhenSuperseded/still_as_described,_permanent_failure_not_retried (0.00s) === RUN TestRenameWithInheritedRemoteEntryWritesNewKey I1117 09:37:07.280311 filer_remote_sync_dir.go:967 delete b2/bucket/b/src/probe.bin I1117 09:37:07.281151 filer_remote_sync_dir.go:1479 create b2/bucket/b/dst/probe.bin --- PASS: TestRenameWithInheritedRemoteEntryWritesNewKey (0.00s) === RUN TestRenameRemoteOnlyEntrySkipsEmptyUpload I1117 09:37:07.283684 filer_remote_sync_dir.go:967 delete b2/bucket/b/src/video.mp4 E1117 09:37:07.284455 filer_remote_sync_dir.go:979 skipping b2/bucket/b/dst/video.mp4: /buckets/b/dst/video.mp4 superseded or incomplete since the event was logged --- PASS: TestRenameRemoteOnlyEntrySkipsEmptyUpload (0.00s) === RUN TestRenameDeleteOldKeyFailureReturnsError I1117 09:37:07.286067 filer_remote_sync_dir.go:967 delete b2/bucket/b/src/probe.bin --- PASS: TestRenameDeleteOldKeyFailureReturnsError (0.00s) === RUN TestRenameDeleteOldKeyNotFoundStillWrites I1117 09:37:07.287416 filer_remote_sync_dir.go:967 delete gcs/bucket/b/src/probe.bin I1117 09:37:07.287885 filer_remote_sync_dir.go:1479 create gcs/bucket/b/dst/probe.bin --- PASS: TestRenameDeleteOldKeyNotFoundStillWrites (0.00s) === RUN TestIfEntryEqualCarriesTheEventEntry --- PASS: TestIfEntryEqualCarriesTheEventEntry (0.00s) === RUN TestRemoteWriteEntryLeavesEventEntryUntouched --- PASS: TestRemoteWriteEntryLeavesEventEntryUntouched (0.00s) === RUN TestIsFailedPrecondition --- PASS: TestIsFailedPrecondition (0.00s) === RUN TestDeleteEventAbsentRemoteObjectIsSuccess === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/absent_object I1117 09:37:07.296208 filer_remote_sync_dir.go:787 delete gcs/bucket/b/vol/state.db.tmp === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/metadata-only_delete_keeps_the_remote_object === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/a_remote-only_entry_that_took_the_path_keeps_the_object I1117 09:37:07.310123 filer_remote_sync_dir.go:775 keep gcs/bucket/b/vol/state.db.tmp: a remote-only entry has taken its path since === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/a_replaced_object_is_kept I1117 09:37:07.311502 filer_remote_sync_dir.go:787 delete gcs/bucket/b/vol/state.db.tmp I1117 09:37:07.311906 filer_remote_sync_dir.go:844 keep gcs/bucket/b/vol/state.db.tmp: the object changed since the delete === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/a_changed_object_with_no_entry_at_the_path_yet_is_kept I1117 09:37:07.313379 filer_remote_sync_dir.go:787 delete gcs/bucket/b/vol/state.db.tmp I1117 09:37:07.313698 filer_remote_sync_dir.go:844 keep gcs/bucket/b/vol/state.db.tmp: the object changed since the delete === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/an_unchanged_object_still_goes I1117 09:37:07.315676 filer_remote_sync_dir.go:787 delete gcs/bucket/b/vol/state.db.tmp === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/a_copy_that_landed_before_its_entry_is_kept I1117 09:37:07.317150 filer_remote_sync_dir.go:787 delete gcs/bucket/b/vol/state.db.tmp I1117 09:37:07.317412 filer_remote_sync_dir.go:844 keep gcs/bucket/b/vol/state.db.tmp: the object changed since the delete === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/an_unverifiable_object_is_kept I1117 09:37:07.318787 filer_remote_sync_dir.go:787 delete gcs/bucket/b/vol/state.db.tmp I1117 09:37:07.319039 filer_remote_sync_dir.go:844 keep gcs/bucket/b/vol/state.db.tmp: the object changed since the delete === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/an_entry_with_local_data_at_the_path_does_not_stop_the_delete I1117 09:37:07.320342 filer_remote_sync_dir.go:787 delete gcs/bucket/b/vol/state.db.tmp === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/other_failure_still_fails I1117 09:37:07.321560 filer_remote_sync_dir.go:787 delete gcs/bucket/b/vol/state.db.tmp === RUN TestDeleteEventAbsentRemoteObjectIsSuccess/delete_marker,_absent_object I1117 09:37:07.323682 filer_remote_sync_dir.go:1801 delete (marker) gcs/bucket/b/vol/state.db --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess (0.03s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/absent_object (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/metadata-only_delete_keeps_the_remote_object (0.01s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/a_remote-only_entry_that_took_the_path_keeps_the_object (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/a_replaced_object_is_kept (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/a_changed_object_with_no_entry_at_the_path_yet_is_kept (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/an_unchanged_object_still_goes (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/a_copy_that_landed_before_its_entry_is_kept (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/an_unverifiable_object_is_kept (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/an_entry_with_local_data_at_the_path_does_not_stop_the_delete (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/other_failure_still_fails (0.00s) --- PASS: TestDeleteEventAbsentRemoteObjectIsSuccess/delete_marker,_absent_object (0.00s) === RUN TestUpdateLocalEntryLeavesTheEventEntryAlone --- PASS: TestUpdateLocalEntryLeavesTheEventEntryAlone (0.00s) === RUN TestUpdateLocalEntrySkipsDeletedEntry === RUN TestUpdateLocalEntrySkipsDeletedEntry/plain_not_found_from_the_filer E1117 09:37:07.328181 filer_remote_sync_dir.go:1700 skipping stamp of /buckets/b/vol/state.db: deleted since the event was logged: not found /buckets/b/vol/state.db: filer: no entry is found in filer store === RUN TestUpdateLocalEntrySkipsDeletedEntry/not_found_over_grpc E1117 09:37:07.329484 filer_remote_sync_dir.go:1700 skipping stamp of /buckets/b/vol/state.db: deleted since the event was logged: rpc error: code = Unknown desc = not found /buckets/b/vol/state.db: filer: no entry is found in filer store === RUN TestUpdateLocalEntrySkipsDeletedEntry/typed_not_found_from_the_filer E1117 09:37:07.330895 filer_remote_sync_dir.go:1700 skipping stamp of /buckets/b/vol/state.db: deleted since the event was logged: rpc error: code = NotFound desc = not found /buckets/b/vol/state.db: filer: no entry is found in filer store === RUN TestUpdateLocalEntrySkipsDeletedEntry/the_sentinel_inside_the_path_is_not_a_missing_entry === RUN TestUpdateLocalEntrySkipsDeletedEntry/other_failure_still_fails --- PASS: TestUpdateLocalEntrySkipsDeletedEntry (0.01s) --- PASS: TestUpdateLocalEntrySkipsDeletedEntry/plain_not_found_from_the_filer (0.00s) --- PASS: TestUpdateLocalEntrySkipsDeletedEntry/not_found_over_grpc (0.00s) --- PASS: TestUpdateLocalEntrySkipsDeletedEntry/typed_not_found_from_the_filer (0.00s) --- PASS: TestUpdateLocalEntrySkipsDeletedEntry/the_sentinel_inside_the_path_is_not_a_missing_entry (0.00s) --- PASS: TestUpdateLocalEntrySkipsDeletedEntry/other_failure_still_fails (0.00s) === RUN TestSupersededRenameUploadsCurrentEntry === RUN TestSupersededRenameUploadsCurrentEntry/rewrite_already_synced:_upload_once_here I1117 09:37:07.335817 filer_remote_sync_dir.go:967 delete gcs/bucket/b/dir/a.txt E1117 09:37:07.336415 filer_remote_sync_dir.go:979 skipping gcs/bucket/b/dir/b.txt: /buckets/b/dir/b.txt superseded or incomplete since the event was logged I1117 09:37:07.336824 filer_remote_sync_dir.go:1181 uploading the current gcs/bucket/b/dir/b.txt in place of the superseded rename I1117 09:37:07.337650 filer_remote_sync_dir.go:1479 create gcs/bucket/b/dir/b.txt === RUN TestSupersededRenameUploadsCurrentEntry/rewrite_newer_than_the_stamp:_its_own_event_uploads,_not_this_one I1117 09:37:07.339510 filer_remote_sync_dir.go:967 delete gcs/bucket/b/dir/a.txt E1117 09:37:07.340028 filer_remote_sync_dir.go:979 skipping gcs/bucket/b/dir/b.txt: /buckets/b/dir/b.txt superseded or incomplete since the event was logged I1117 09:37:07.340368 filer_remote_sync_dir.go:1178 leaving gcs/bucket/b/dir/b.txt to the rewrite that superseded the rename === RUN TestSupersededRenameUploadsCurrentEntry/deleted_meanwhile:_nothing_to_upload I1117 09:37:07.341564 filer_remote_sync_dir.go:967 delete gcs/bucket/b/dir/a.txt E1117 09:37:07.342114 filer_remote_sync_dir.go:979 skipping gcs/bucket/b/dir/b.txt: /buckets/b/dir/b.txt superseded or incomplete since the event was logged === RUN TestSupersededRenameUploadsCurrentEntry/uncached_meanwhile,_old_object_present:_copied_to_the_destination,_stamped,_old_key_deleted I1117 09:37:07.344210 filer_remote_sync_dir.go:1101 copy gcs/bucket/b/dir/a.txt -> gcs/bucket/b/dir/b.txt === RUN TestSupersededRenameUploadsCurrentEntry/uncached_after_an_earlier_run_completed_the_rename:_destination_present,_old_key_deleted,_nothing_written I1117 09:37:07.346915 filer_remote_sync_dir.go:1076 gcs/bucket/b/dir/b.txt already holds the renamed content === RUN TestSupersededRenameUploadsCurrentEntry/uncached_and_neither_object_exists:_the_event_fails_and_holds_the_offset === RUN TestSupersededRenameUploadsCurrentEntry/destination_holds_an_object_of_another_size:_replaced_from_the_old_key I1117 09:37:07.349760 filer_remote_sync_dir.go:1085 gcs/bucket/b/dir/b.txt holds an object the entry does not describe (size 14, want 7); replacing it from gcs/bucket/b/dir/a.txt I1117 09:37:07.349984 filer_remote_sync_dir.go:1101 copy gcs/bucket/b/dir/a.txt -> gcs/bucket/b/dir/b.txt === RUN TestSupersededRenameUploadsCurrentEntry/snapshot_remote-only_but_rewritten_since:_the_rewrite's_own_event_uploads I1117 09:37:07.352237 filer_remote_sync_dir.go:967 delete gcs/bucket/b/dir/a.txt E1117 09:37:07.352926 filer_remote_sync_dir.go:979 skipping gcs/bucket/b/dir/b.txt: /buckets/b/dir/b.txt superseded or incomplete since the event was logged I1117 09:37:07.353210 filer_remote_sync_dir.go:1178 leaving gcs/bucket/b/dir/b.txt to the rewrite that superseded the rename === RUN TestSupersededRenameUploadsCurrentEntry/snapshot_already_remote-only:_completed_the_same_way I1117 09:37:07.354843 filer_remote_sync_dir.go:1101 copy gcs/bucket/b/dir/a.txt -> gcs/bucket/b/dir/b.txt === RUN TestSupersededRenameUploadsCurrentEntry/uncached_after_the_old_key_was_deleted:_the_event_fails_and_holds_the_offset === RUN TestSupersededRenameUploadsCurrentEntry/uncached_with_the_destination_already_synced:_complete_without_a_write I1117 09:37:07.357710 filer_remote_sync_dir.go:1076 gcs/bucket/b/dir/b.txt already holds the renamed content --- PASS: TestSupersededRenameUploadsCurrentEntry (0.02s) --- PASS: TestSupersededRenameUploadsCurrentEntry/rewrite_already_synced:_upload_once_here (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/rewrite_newer_than_the_stamp:_its_own_event_uploads,_not_this_one (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/deleted_meanwhile:_nothing_to_upload (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/uncached_meanwhile,_old_object_present:_copied_to_the_destination,_stamped,_old_key_deleted (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/uncached_after_an_earlier_run_completed_the_rename:_destination_present,_old_key_deleted,_nothing_written (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/uncached_and_neither_object_exists:_the_event_fails_and_holds_the_offset (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/destination_holds_an_object_of_another_size:_replaced_from_the_old_key (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/snapshot_remote-only_but_rewritten_since:_the_rewrite's_own_event_uploads (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/snapshot_already_remote-only:_completed_the_same_way (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/uncached_after_the_old_key_was_deleted:_the_event_fails_and_holds_the_offset (0.00s) --- PASS: TestSupersededRenameUploadsCurrentEntry/uncached_with_the_destination_already_synced:_complete_without_a_write (0.00s) === RUN TestCompleteRemoteOnlyRenameClearsThePendingSourceFirst === RUN TestCompleteRemoteOnlyRenameClearsThePendingSourceFirst/stamped,_then_the_source_goes I1117 09:37:07.359889 filer_remote_sync_dir.go:1076 b2/bucket/b/dst/a.jpg already holds the renamed content === RUN TestCompleteRemoteOnlyRenameClearsThePendingSourceFirst/a_marker_still_in_place_keeps_the_source I1117 09:37:07.365188 filer_remote_sync_dir.go:1076 b2/bucket/b/dst/a.jpg already holds the renamed content E1117 09:37:07.365695 filer_remote_sync_dir.go:1696 skipping stale stamp of /buckets/b/dst/a.jpg: rpc error: code = FailedPrecondition desc = entry changed --- PASS: TestCompleteRemoteOnlyRenameClearsThePendingSourceFirst (0.01s) --- PASS: TestCompleteRemoteOnlyRenameClearsThePendingSourceFirst/stamped,_then_the_source_goes (0.00s) --- PASS: TestCompleteRemoteOnlyRenameClearsThePendingSourceFirst/a_marker_still_in_place_keeps_the_source (0.00s) === RUN TestRenameOfAPendingEntryFollowsItsSource === RUN TestRenameOfAPendingEntryFollowsItsSource/the_first_rename_leaves_the_source_to_the_entry_that_moved_on I1117 09:37:07.368647 filer_remote_sync_dir.go:964 keep b2/bucket/b/a.jpg: the pending rename moved on === RUN TestRenameOfAPendingEntryFollowsItsSource/the_second_rename_copies_from_the_marker's_source I1117 09:37:07.370048 filer_remote_sync_dir.go:1085 b2/bucket/b/c.jpg holds an object the entry does not describe (size 5, want 6); replacing it from b2/bucket/b/a.jpg I1117 09:37:07.370253 filer_remote_sync_dir.go:1101 copy b2/bucket/b/a.jpg -> b2/bucket/b/c.jpg --- PASS: TestRenameOfAPendingEntryFollowsItsSource (0.00s) --- PASS: TestRenameOfAPendingEntryFollowsItsSource/the_first_rename_leaves_the_source_to_the_entry_that_moved_on (0.00s) --- PASS: TestRenameOfAPendingEntryFollowsItsSource/the_second_rename_copies_from_the_marker's_source (0.00s) === RUN TestPendingRenameSourceIsReleasedOnlyWhileUnchanged === RUN TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/deleting_the_pending_entry_releases_its_source I1117 09:37:07.374189 filer_remote_sync_dir.go:811 delete b2/bucket/b/a.jpg, the source of a pending rename I1117 09:37:07.374632 filer_remote_sync_dir.go:787 delete b2/bucket/b/b.jpg === RUN TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_source_replaced_since_is_kept I1117 09:37:07.376709 filer_remote_sync_dir.go:811 delete b2/bucket/b/a.jpg, the source of a pending rename I1117 09:37:07.376899 filer_remote_sync_dir.go:844 keep b2/bucket/b/a.jpg: the object changed since the delete I1117 09:37:07.377141 filer_remote_sync_dir.go:787 delete b2/bucket/b/b.jpg === RUN TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_destination_cached_since_releases_the_source_too I1117 09:37:07.379125 filer_remote_sync_dir.go:967 delete b2/bucket/b/b.jpg I1117 09:37:07.379394 filer_remote_sync_dir.go:1479 create b2/bucket/b/c.jpg I1117 09:37:07.380014 filer_remote_sync_dir.go:811 delete b2/bucket/b/a.jpg, the source of a pending rename === RUN TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_cached_entry_still_reading_the_source_keeps_it_until_its_upload_lands === RUN TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_cached_entry_still_reading_the_source_keeps_it_until_its_upload_lands/stamp_does_not_land I1117 09:37:07.382845 filer_remote_sync_dir.go:967 delete b2/bucket/b/b.jpg I1117 09:37:07.383163 filer_remote_sync_dir.go:1479 create b2/bucket/b/c.jpg === RUN TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_cached_entry_still_reading_the_source_keeps_it_until_its_upload_lands/upload_fails I1117 09:37:07.387678 filer_remote_sync_dir.go:967 delete b2/bucket/b/b.jpg I1117 09:37:07.388082 filer_remote_sync_dir.go:1479 create b2/bucket/b/c.jpg E1117 09:37:07.388683 filer_remote_sync_dir.go:1488 write to name:"b2" bucket:"bucket" path:"/b/c.jpg": upload failed === RUN TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_later_rename_the_filer_copied_releases_the_source I1117 09:37:07.390867 filer_remote_sync_dir.go:1076 b2/bucket/b/c.jpg already holds the renamed content I1117 09:37:07.391323 filer_remote_sync_dir.go:844 keep b2/bucket/b/b.jpg: the object changed since the delete I1117 09:37:07.391705 filer_remote_sync_dir.go:811 delete b2/bucket/b/a.jpg, the source of a pending rename --- PASS: TestPendingRenameSourceIsReleasedOnlyWhileUnchanged (0.02s) --- PASS: TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/deleting_the_pending_entry_releases_its_source (0.00s) --- PASS: TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_source_replaced_since_is_kept (0.00s) --- PASS: TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_destination_cached_since_releases_the_source_too (0.00s) --- PASS: TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_cached_entry_still_reading_the_source_keeps_it_until_its_upload_lands (0.01s) --- PASS: TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_cached_entry_still_reading_the_source_keeps_it_until_its_upload_lands/stamp_does_not_land (0.00s) --- PASS: TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_cached_entry_still_reading_the_source_keeps_it_until_its_upload_lands/upload_fails (0.00s) --- PASS: TestPendingRenameSourceIsReleasedOnlyWhileUnchanged/a_later_rename_the_filer_copied_releases_the_source (0.00s) === RUN TestShouldSendToRemote === RUN TestShouldSendToRemote/no_RemoteEntry === RUN TestShouldSendToRemote/remote_older === RUN TestShouldSendToRemote/remote_newer === RUN TestShouldSendToRemote/same_second,_no_sync_stamp === RUN TestShouldSendToRemote/same_second,_synced_at_the_second === RUN TestShouldSendToRemote/same_second,_synced_after === RUN TestShouldSendToRemote/same_second,_rewritten_after_the_sync === RUN TestShouldSendToRemote/same_second,_rewrite_synced --- PASS: TestShouldSendToRemote (0.00s) --- PASS: TestShouldSendToRemote/no_RemoteEntry (0.00s) --- PASS: TestShouldSendToRemote/remote_older (0.00s) --- PASS: TestShouldSendToRemote/remote_newer (0.00s) --- PASS: TestShouldSendToRemote/same_second,_no_sync_stamp (0.00s) --- PASS: TestShouldSendToRemote/same_second,_synced_at_the_second (0.00s) --- PASS: TestShouldSendToRemote/same_second,_synced_after (0.00s) --- PASS: TestShouldSendToRemote/same_second,_rewritten_after_the_sync (0.00s) --- PASS: TestShouldSendToRemote/same_second,_rewrite_synced (0.00s) === RUN TestMetadataOnlyUpdateRestampsSyncTs --- PASS: TestMetadataOnlyUpdateRestampsSyncTs (0.00s) === RUN TestDroppedLocalCopyIsNotUploaded === RUN TestDroppedLocalCopyIsNotUploaded/remote.uncache === RUN TestDroppedLocalCopyIsNotUploaded/eviction_under_storage_pressure === RUN TestDroppedLocalCopyIsNotUploaded/remote.meta.sync_pulls_a_newer_version === RUN TestDroppedLocalCopyIsNotUploaded/a_metadata_edit_of_a_remote-only_entry_still_reaches_the_remote --- PASS: TestDroppedLocalCopyIsNotUploaded (0.01s) --- PASS: TestDroppedLocalCopyIsNotUploaded/remote.uncache (0.00s) --- PASS: TestDroppedLocalCopyIsNotUploaded/eviction_under_storage_pressure (0.00s) --- PASS: TestDroppedLocalCopyIsNotUploaded/remote.meta.sync_pulls_a_newer_version (0.00s) --- PASS: TestDroppedLocalCopyIsNotUploaded/a_metadata_edit_of_a_remote-only_entry_still_reaches_the_remote (0.00s) === RUN TestSameSecondRewriteIsStillUploaded === RUN TestSameSecondRewriteIsStillUploaded/synced_entry,_stamp_cleared_by_the_filer I1117 09:37:07.414413 filer_remote_sync_dir.go:1479 create s3/gold/sales/_delta_log/00000000000000000007.json === RUN TestSameSecondRewriteIsStillUploaded/synced_entry,_stamp_older_than_the_rewrite I1117 09:37:07.416719 filer_remote_sync_dir.go:1479 create s3/gold/sales/_delta_log/00000000000000000007.json === RUN TestSameSecondRewriteIsStillUploaded/uncached_entry I1117 09:37:07.418468 filer_remote_sync_dir.go:1479 create s3/gold/sales/_delta_log/00000000000000000007.json --- PASS: TestSameSecondRewriteIsStillUploaded (0.01s) --- PASS: TestSameSecondRewriteIsStillUploaded/synced_entry,_stamp_cleared_by_the_filer (0.00s) --- PASS: TestSameSecondRewriteIsStillUploaded/synced_entry,_stamp_older_than_the_rewrite (0.00s) --- PASS: TestSameSecondRewriteIsStillUploaded/uncached_entry (0.00s) === RUN TestTruncateToZeroIsUploaded === RUN TestTruncateToZeroIsUploaded/in_a_later_second I1117 09:37:07.421637 filer_remote_sync_dir.go:1479 create s3/gold/sales/_delta_log/00000000000000000007.json === RUN TestTruncateToZeroIsUploaded/in_the_remote_mtime's_second I1117 09:37:07.423393 filer_remote_sync_dir.go:1479 create s3/gold/sales/_delta_log/00000000000000000007.json --- PASS: TestTruncateToZeroIsUploaded (0.00s) --- PASS: TestTruncateToZeroIsUploaded/in_a_later_second (0.00s) --- PASS: TestTruncateToZeroIsUploaded/in_the_remote_mtime's_second (0.00s) === RUN TestCompleteRemoteOnlyRenameKeepsAReusedOldKey I1117 09:37:07.424914 filer_remote_sync_dir.go:1076 b2/bucket/b/b.jpg already holds the renamed content I1117 09:37:07.425200 filer_remote_sync_dir.go:844 keep b2/bucket/b/a.jpg: the object changed since the delete --- PASS: TestCompleteRemoteOnlyRenameKeepsAReusedOldKey (0.00s) === RUN TestCompleteRemoteOnlyRenameRetryUsesTheSourceStamp I1117 09:37:07.426267 filer_remote_sync_dir.go:1076 b2/bucket/b/b.jpg already holds the renamed content --- PASS: TestCompleteRemoteOnlyRenameRetryUsesTheSourceStamp (0.00s) === RUN TestMetadataUpdateRestampsTheUpdatedObject --- PASS: TestMetadataUpdateRestampsTheUpdatedObject (0.00s) === RUN TestMetadataUpdateKeepsTheStoredStampOnNilResult --- PASS: TestMetadataUpdateKeepsTheStoredStampOnNilResult (0.00s) === RUN TestTouchedEntryIsStampedOnce === RUN TestTouchedEntryIsStampedOnce/touched === RUN TestTouchedEntryIsStampedOnce/touched_into_the_future --- PASS: TestTouchedEntryIsStampedOnce (0.01s) --- PASS: TestTouchedEntryIsStampedOnce/touched (0.00s) --- PASS: TestTouchedEntryIsStampedOnce/touched_into_the_future (0.00s) === RUN TestReshapeCrossMountRename === RUN TestReshapeCrossMountRename/into_the_mount_from_a_shorter_path_is_a_create_of_the_new_entry I1117 09:37:07.442638 filer_remote_sync_dir.go:611 rename into mount /buckets/mount: /plain/in.txt -> /buckets/mount/lock/in.txt, creating === RUN TestReshapeCrossMountRename/into_the_mount_from_a_longer_path_outside_it_is_a_create,_not_a_key_in_the_wrong_tree I1117 09:37:07.443822 filer_remote_sync_dir.go:611 rename into mount /buckets/mount: /buckets/other/deeper/tree/x.txt -> /buckets/mount/x.txt, creating === RUN TestReshapeCrossMountRename/out_of_the_mount_is_a_delete_of_the_old_entry I1117 09:37:07.444869 filer_remote_sync_dir.go:623 rename out of mount /buckets/mount: /buckets/mount/lock/out.txt -> /plain/out.txt, deleting === RUN TestReshapeCrossMountRename/out_of_the_mount_keeps_the_object_of_a_remote-only_entry I1117 09:37:07.446126 filer_remote_sync_dir.go:620 rename out of mount /buckets/mount: /buckets/mount/lock/out.txt -> /plain/out.txt, keeping the remote-only object === RUN TestReshapeCrossMountRename/both_paths_inside_is_the_update_itself === RUN TestReshapeCrossMountRename/an_update_of_the_/etc/remote_directory_entry_itself_is_not_the_mount's_event === RUN TestReshapeCrossMountRename/neither_path_inside_is_not_the_mount's_event === RUN TestReshapeCrossMountRename/a_trailing_slash_on_the_mount_flag_changes_nothing I1117 09:37:07.449067 filer_remote_sync_dir.go:611 rename into mount /buckets/mount/: /plain/in.txt -> /buckets/mount/in.txt, creating --- PASS: TestReshapeCrossMountRename (0.01s) --- PASS: TestReshapeCrossMountRename/into_the_mount_from_a_shorter_path_is_a_create_of_the_new_entry (0.00s) --- PASS: TestReshapeCrossMountRename/into_the_mount_from_a_longer_path_outside_it_is_a_create,_not_a_key_in_the_wrong_tree (0.00s) --- PASS: TestReshapeCrossMountRename/out_of_the_mount_is_a_delete_of_the_old_entry (0.00s) --- PASS: TestReshapeCrossMountRename/out_of_the_mount_keeps_the_object_of_a_remote-only_entry (0.00s) --- PASS: TestReshapeCrossMountRename/both_paths_inside_is_the_update_itself (0.00s) --- PASS: TestReshapeCrossMountRename/an_update_of_the_/etc/remote_directory_entry_itself_is_not_the_mount's_event (0.00s) --- PASS: TestReshapeCrossMountRename/neither_path_inside_is_not_the_mount's_event (0.00s) --- PASS: TestReshapeCrossMountRename/a_trailing_slash_on_the_mount_flag_changes_nothing (0.00s) === RUN TestRenameIntoMountUploadsDespiteTheOldStamp I1117 09:37:07.450223 filer_remote_sync_dir.go:611 rename into mount /buckets/mount: /plain/back.txt -> /buckets/mount/lock/back.txt, creating I1117 09:37:07.451288 filer_remote_sync_dir.go:1479 create b2/bucket/lock/back.txt --- PASS: TestRenameIntoMountUploadsDespiteTheOldStamp (0.00s) === RUN TestRenameIntoMountWritesAnEmptyFile === RUN TestRenameIntoMountWritesAnEmptyFile/an_empty_entry_writes_a_zero-byte_object I1117 09:37:07.453439 filer_remote_sync_dir.go:611 rename into mount /buckets/mount: /plain/empty.txt -> /buckets/mount/lock/empty.txt, creating I1117 09:37:07.454116 filer_remote_sync_dir.go:1479 create b2/bucket/lock/empty.txt === RUN TestRenameIntoMountWritesAnEmptyFile/a_remote-only_entry_still_skips I1117 09:37:07.456164 filer_remote_sync_dir.go:611 rename into mount /buckets/mount: /plain/empty.txt -> /buckets/mount/lock/empty.txt, creating === RUN TestRenameIntoMountWritesAnEmptyFile/a_truncated_stamped_entry_writes_a_zero-byte_object I1117 09:37:07.457384 filer_remote_sync_dir.go:611 rename into mount /buckets/mount: /plain/empty.txt -> /buckets/mount/lock/empty.txt, creating I1117 09:37:07.457984 filer_remote_sync_dir.go:1479 create b2/bucket/lock/empty.txt === RUN TestRenameIntoMountWritesAnEmptyFile/a_plain_empty_create_still_writes_nothing I1117 09:37:07.459286 filer_remote_sync_dir.go:611 rename into mount /buckets/mount: /plain/empty.txt -> /buckets/mount/lock/empty.txt, creating --- PASS: TestRenameIntoMountWritesAnEmptyFile (0.01s) --- PASS: TestRenameIntoMountWritesAnEmptyFile/an_empty_entry_writes_a_zero-byte_object (0.00s) --- PASS: TestRenameIntoMountWritesAnEmptyFile/a_remote-only_entry_still_skips (0.00s) --- PASS: TestRenameIntoMountWritesAnEmptyFile/a_truncated_stamped_entry_writes_a_zero-byte_object (0.00s) --- PASS: TestRenameIntoMountWritesAnEmptyFile/a_plain_empty_create_still_writes_nothing (0.00s) === RUN TestSupersededRenameInRecoversTheCurrentEntry === RUN TestSupersededRenameInRecoversTheCurrentEntry/uncached_meanwhile:_the_source_object_is_copied_and_the_entry_stamped E1117 09:37:07.462784 filer_remote_sync_dir.go:706 skipping b2/bucket/mnt/lock/a.txt: /buckets/mount/lock/a.txt superseded or incomplete since the event was logged I1117 09:37:07.464528 filer_remote_sync_dir.go:1284 copy b2/bucket/plain-remote/a.txt -> b2/bucket/mnt/lock/a.txt === RUN TestSupersededRenameInRecoversTheCurrentEntry/the_destination_already_holds_it:_only_a_stamp E1117 09:37:07.466488 filer_remote_sync_dir.go:706 skipping b2/bucket/mnt/lock/a.txt: /buckets/mount/lock/a.txt superseded or incomplete since the event was logged I1117 09:37:07.467286 filer_remote_sync_dir.go:1265 b2/bucket/mnt/lock/a.txt already holds the renamed content === RUN TestSupersededRenameInRecoversTheCurrentEntry/no_object_on_either_side:_the_event_fails E1117 09:37:07.469295 filer_remote_sync_dir.go:706 skipping b2/bucket/mnt/lock/a.txt: /buckets/mount/lock/a.txt superseded or incomplete since the event was logged === RUN TestSupersededRenameInRecoversTheCurrentEntry/a_pending_marker_under_the_mount_names_the_source E1117 09:37:07.471606 filer_remote_sync_dir.go:706 skipping b2/bucket/mnt/lock/a.txt: /buckets/mount/lock/a.txt superseded or incomplete since the event was logged I1117 09:37:07.472017 filer_remote_sync_dir.go:1284 copy b2/bucket/mnt/lock/old.txt -> b2/bucket/mnt/lock/a.txt === RUN TestSupersededRenameInRecoversTheCurrentEntry/rewritten_since:_the_superseding_event_uploads E1117 09:37:07.474040 filer_remote_sync_dir.go:706 skipping b2/bucket/mnt/lock/a.txt: /buckets/mount/lock/a.txt superseded or incomplete since the event was logged I1117 09:37:07.474422 filer_remote_sync_dir.go:1225 leaving b2/bucket/mnt/lock/a.txt to the event that superseded the rename --- PASS: TestSupersededRenameInRecoversTheCurrentEntry (0.01s) --- PASS: TestSupersededRenameInRecoversTheCurrentEntry/uncached_meanwhile:_the_source_object_is_copied_and_the_entry_stamped (0.00s) --- PASS: TestSupersededRenameInRecoversTheCurrentEntry/the_destination_already_holds_it:_only_a_stamp (0.00s) --- PASS: TestSupersededRenameInRecoversTheCurrentEntry/no_object_on_either_side:_the_event_fails (0.00s) --- PASS: TestSupersededRenameInRecoversTheCurrentEntry/a_pending_marker_under_the_mount_names_the_source (0.00s) --- PASS: TestSupersededRenameInRecoversTheCurrentEntry/rewritten_since:_the_superseding_event_uploads (0.00s) === RUN TestIsSystemPath === RUN TestIsSystemPath//buckets/.system === RUN TestIsSystemPath//buckets/.system/owners === RUN TestIsSystemPath//buckets/.system/owners/alice === RUN TestIsSystemPath//buckets/.system/owners/alice/mybucket === RUN TestIsSystemPath///.system === RUN TestIsSystemPath//.system/config === RUN TestIsSystemPath//custom-mount/.system === RUN TestIsSystemPath//custom-mount/.system/owners/alice === RUN TestIsSystemPath//buckets/mybucket/file.txt === RUN TestIsSystemPath//buckets/mybucket/.system === RUN TestIsSystemPath//buckets/mybucket/.system/data === RUN TestIsSystemPath//buckets/.system-other === RUN TestIsSystemPath//buckets/.system-other/sub --- PASS: TestIsSystemPath (0.01s) --- PASS: TestIsSystemPath//buckets/.system (0.00s) --- PASS: TestIsSystemPath//buckets/.system/owners (0.00s) --- PASS: TestIsSystemPath//buckets/.system/owners/alice (0.00s) --- PASS: TestIsSystemPath//buckets/.system/owners/alice/mybucket (0.00s) --- PASS: TestIsSystemPath///.system (0.00s) --- PASS: TestIsSystemPath//.system/config (0.00s) --- PASS: TestIsSystemPath//custom-mount/.system (0.00s) --- PASS: TestIsSystemPath//custom-mount/.system/owners/alice (0.00s) --- PASS: TestIsSystemPath//buckets/mybucket/file.txt (0.00s) --- PASS: TestIsSystemPath//buckets/mybucket/.system (0.00s) --- PASS: TestIsSystemPath//buckets/mybucket/.system/data (0.00s) --- PASS: TestIsSystemPath//buckets/.system-other (0.00s) --- PASS: TestIsSystemPath//buckets/.system-other/sub (0.00s) === RUN TestRemoteSyncSkipsSystemFolder --- PASS: TestRemoteSyncSkipsSystemFolder (0.00s) === RUN TestSyncDeleteMarkerKeepsALockedVersion === RUN TestSyncDeleteMarkerKeepsALockedVersion/legal_hold I1117 09:37:07.489175 filer_remote_sync_dir.go:1798 keep azure/b/held.bin: a version under the delete marker is locked === RUN TestSyncDeleteMarkerKeepsALockedVersion/retention I1117 09:37:07.492415 filer_remote_sync_dir.go:1798 keep azure/b/held.bin: a version under the delete marker is locked === RUN TestSyncDeleteMarkerKeepsALockedVersion/released_hold I1117 09:37:07.493686 filer_remote_sync_dir.go:1801 delete (marker) azure/b/held.bin === RUN TestSyncDeleteMarkerKeepsALockedVersion/expired_retention I1117 09:37:07.495186 filer_remote_sync_dir.go:1801 delete (marker) azure/b/held.bin === RUN TestSyncDeleteMarkerKeepsALockedVersion/listing_failure --- PASS: TestSyncDeleteMarkerKeepsALockedVersion (0.01s) --- PASS: TestSyncDeleteMarkerKeepsALockedVersion/legal_hold (0.00s) --- PASS: TestSyncDeleteMarkerKeepsALockedVersion/retention (0.00s) --- PASS: TestSyncDeleteMarkerKeepsALockedVersion/released_hold (0.00s) --- PASS: TestSyncDeleteMarkerKeepsALockedVersion/expired_retention (0.00s) --- PASS: TestSyncDeleteMarkerKeepsALockedVersion/listing_failure (0.00s) === RUN TestKeptDeleteMarkerRetriesWhenTheLockIsReleased === RUN TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/hold_released I1117 09:37:07.503511 filer_remote_sync_dir.go:1801 delete (marker) azure/b/held.bin === RUN TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/expired_version_deleted I1117 09:37:07.505648 filer_remote_sync_dir.go:1801 delete (marker) azure/b/held.bin === RUN TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/another_version_still_held I1117 09:37:07.507185 filer_remote_sync_dir.go:1798 keep azure/b/held.bin: a version under the delete marker is locked === RUN TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/marker_already_synced === RUN TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/a_newer_version_is_latest === RUN TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/unlocked_version_updated --- PASS: TestKeptDeleteMarkerRetriesWhenTheLockIsReleased (0.01s) --- PASS: TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/hold_released (0.00s) --- PASS: TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/expired_version_deleted (0.00s) --- PASS: TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/another_version_still_held (0.00s) --- PASS: TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/marker_already_synced (0.00s) --- PASS: TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/a_newer_version_is_latest (0.00s) --- PASS: TestKeptDeleteMarkerRetriesWhenTheLockIsReleased/unlocked_version_updated (0.00s) === RUN TestMountTableEnds === RUN TestMountTableEnds/another_mount_added === RUN TestMountTableEnds/unmounted === RUN TestMountTableEnds/mounted_elsewhere === RUN TestMountTableEnds/table_deleted === RUN TestMountTableEnds/mounted_on_another_remote === RUN TestMountTableEnds/remounted_here_from_another_remote === RUN TestMountTableEnds/replayed_version_from_before_the_mount === RUN TestMountTableEnds/replayed_creation_of_the_table === RUN TestMountTableEnds/replayed_deletion_of_the_table === RUN TestMountTableEnds/the_mount_itself === RUN TestMountTableEnds/replayed_mount_elsewhere === RUN TestMountTableEnds/replayed_unmount_from_elsewhere:_its_purge_follows === RUN TestMountTableEnds/remounted_here_from_elsewhere === RUN TestMountTableEnds/table_renamed_away === RUN TestMountTableEnds/table_moved_out_of_the_directory === RUN TestMountTableEnds/a_table-named_file_in_a_subdirectory === RUN TestMountTableEnds/remote_conf_updated === RUN TestMountTableEnds/file_under_the_mount === RUN TestMountTableEnds/unreadable_table W1117 09:37:07.527820 remote_storage.go:244 unmarshal existing mappings: proto: cannot parse invalid wire-format data === RUN TestMountTableEnds/a_replaced_version_it_cannot_read_counts_as_covering W1117 09:37:07.529902 remote_storage.go:244 unmarshal existing mappings: proto: cannot parse invalid wire-format data --- PASS: TestMountTableEnds (0.02s) --- PASS: TestMountTableEnds/another_mount_added (0.00s) --- PASS: TestMountTableEnds/unmounted (0.00s) --- PASS: TestMountTableEnds/mounted_elsewhere (0.00s) --- PASS: TestMountTableEnds/table_deleted (0.00s) --- PASS: TestMountTableEnds/mounted_on_another_remote (0.00s) --- PASS: TestMountTableEnds/remounted_here_from_another_remote (0.00s) --- PASS: TestMountTableEnds/replayed_version_from_before_the_mount (0.00s) --- PASS: TestMountTableEnds/replayed_creation_of_the_table (0.00s) --- PASS: TestMountTableEnds/replayed_deletion_of_the_table (0.00s) --- PASS: TestMountTableEnds/the_mount_itself (0.00s) --- PASS: TestMountTableEnds/replayed_mount_elsewhere (0.00s) --- PASS: TestMountTableEnds/replayed_unmount_from_elsewhere:_its_purge_follows (0.00s) --- PASS: TestMountTableEnds/remounted_here_from_elsewhere (0.00s) --- PASS: TestMountTableEnds/table_renamed_away (0.00s) --- PASS: TestMountTableEnds/table_moved_out_of_the_directory (0.00s) --- PASS: TestMountTableEnds/a_table-named_file_in_a_subdirectory (0.00s) --- PASS: TestMountTableEnds/remote_conf_updated (0.00s) --- PASS: TestMountTableEnds/file_under_the_mount (0.00s) --- PASS: TestMountTableEnds/unreadable_table (0.00s) --- PASS: TestMountTableEnds/a_replaced_version_it_cannot_read_counts_as_covering (0.00s) === RUN TestMountTableEndsBelowAMount === RUN TestMountTableEndsBelowAMount/another_mount_added === RUN TestMountTableEndsBelowAMount/the_parent_unmounted === RUN TestMountTableEndsBelowAMount/the_directory_mounted_itself === RUN TestMountTableEndsBelowAMount/replayed_nested_unmount_from_before === RUN TestMountTableEndsBelowAMount/replayed_version_from_before_the_mount === RUN TestMountTableEndsBelowAMount/replayed_unmount_of_an_earlier_parent_mount --- PASS: TestMountTableEndsBelowAMount (0.01s) --- PASS: TestMountTableEndsBelowAMount/another_mount_added (0.00s) --- PASS: TestMountTableEndsBelowAMount/the_parent_unmounted (0.00s) --- PASS: TestMountTableEndsBelowAMount/the_directory_mounted_itself (0.00s) --- PASS: TestMountTableEndsBelowAMount/replayed_nested_unmount_from_before (0.00s) --- PASS: TestMountTableEndsBelowAMount/replayed_version_from_before_the_mount (0.00s) --- PASS: TestMountTableEndsBelowAMount/replayed_unmount_of_an_earlier_parent_mount (0.00s) === RUN TestDirRemoteLocationBelowAMount === RUN TestDirRemoteLocationBelowAMount/the_mount_itself === RUN TestDirRemoteLocationBelowAMount/the_mount_with_a_trailing_slash === RUN TestDirRemoteLocationBelowAMount/a_directory_below_the_mount === RUN TestDirRemoteLocationBelowAMount/a_directory_below_a_mount_at_a_remote_prefix --- PASS: TestDirRemoteLocationBelowAMount (0.00s) --- PASS: TestDirRemoteLocationBelowAMount/the_mount_itself (0.00s) --- PASS: TestDirRemoteLocationBelowAMount/the_mount_with_a_trailing_slash (0.00s) --- PASS: TestDirRemoteLocationBelowAMount/a_directory_below_the_mount (0.00s) --- PASS: TestDirRemoteLocationBelowAMount/a_directory_below_a_mount_at_a_remote_prefix (0.00s) === RUN TestStartAfterMountOffset === RUN TestStartAfterMountOffset/below_the_mount,_unmounted_since I1117 09:37:07.542379 filer_remote_sync_dir.go:225 resume /buckets/b/sub from the offset of its mount /buckets/b: 1970-01-01 00:03:20.000000007 +0000 UTC === RUN TestStartAfterMountOffset/below_the_mount,_mount_offset_older === RUN TestStartAfterMountOffset/below_the_mount,_no_mount_offset === RUN TestStartAfterMountOffset/the_mount_itself === RUN TestStartAfterMountOffset/the_mount_with_a_trailing_slash === RUN TestStartAfterMountOffset/a_-timeAgo_replay === RUN TestStartAfterMountOffset/a_retry_in_this_process --- PASS: TestStartAfterMountOffset (0.00s) --- PASS: TestStartAfterMountOffset/below_the_mount,_unmounted_since (0.00s) --- PASS: TestStartAfterMountOffset/below_the_mount,_mount_offset_older (0.00s) --- PASS: TestStartAfterMountOffset/below_the_mount,_no_mount_offset (0.00s) --- PASS: TestStartAfterMountOffset/the_mount_itself (0.00s) --- PASS: TestStartAfterMountOffset/the_mount_with_a_trailing_slash (0.00s) --- PASS: TestStartAfterMountOffset/a_-timeAgo_replay (0.00s) --- PASS: TestStartAfterMountOffset/a_retry_in_this_process (0.00s) === RUN TestAdmitUntilMountEndsDrainsBeforeTheExit === RUN TestAdmitUntilMountEndsDrainsBeforeTheExit/unmount I1117 09:37:07.549832 filer_remote_sync_dir.go:279 /buckets/b unmounted at 2: its write-back stops === RUN TestAdmitUntilMountEndsDrainsBeforeTheExit/move I1117 09:37:07.653384 filer_remote_sync_dir.go:277 /buckets/b moved name:"r" bucket:"b" path:"/" => name:"r" bucket:"other" path:"/" at 2: its write-back stops --- PASS: TestAdmitUntilMountEndsDrainsBeforeTheExit (0.21s) --- PASS: TestAdmitUntilMountEndsDrainsBeforeTheExit/unmount (0.10s) --- PASS: TestAdmitUntilMountEndsDrainsBeforeTheExit/move (0.10s) === RUN TestFilerShutdownJoinsServeDuringParallelDrain --- PASS: TestFilerShutdownJoinsServeDuringParallelDrain (0.02s) === RUN TestFilerShutdownWaitsForHTTPAfterGrpcStops --- PASS: TestFilerShutdownWaitsForHTTPAfterGrpcStops (0.14s) === RUN TestFilerShutdownLeavesLockRingBeforeDraining --- PASS: TestFilerShutdownLeavesLockRingBeforeDraining (0.10s) === RUN TestFilerShutdownStopsSubscriptionsBeforeGrpc --- PASS: TestFilerShutdownStopsSubscriptionsBeforeGrpc (0.00s) === RUN TestPathAncestors --- PASS: TestPathAncestors (0.00s) === RUN TestFileVsFileConflict --- PASS: TestFileVsFileConflict (0.00s) === RUN TestFileUnderActiveDirConflict --- PASS: TestFileUnderActiveDirConflict (0.00s) === RUN TestDirWithActiveFileUnder --- PASS: TestDirWithActiveFileUnder (0.00s) === RUN TestDirVsDirConflict --- PASS: TestDirVsDirConflict (0.00s) === RUN TestRenameConflict --- PASS: TestRenameConflict (0.00s) === RUN TestActiveRenameConflict --- PASS: TestActiveRenameConflict (0.00s) === RUN TestRootDirConflict --- PASS: TestRootDirConflict (0.00s) === RUN TestIndexCleanup --- PASS: TestIndexCleanup (0.00s) === RUN TestWatermarkWithHeap --- PASS: TestWatermarkWithHeap (0.00s) === RUN TestNonBarrierDirUpdateDoesNotBlockDescendants === RUN TestNonBarrierDirUpdateDoesNotBlockDescendants/attribute_update_on_/dir1_does_not_block_file_under_it === RUN TestNonBarrierDirUpdateDoesNotBlockDescendants/barrier_dir_create_at_the_same_path_still_blocks_descendants === RUN TestNonBarrierDirUpdateDoesNotBlockDescendants/barrier_dir_delete_still_waits_for_in-flight_descendants === RUN TestNonBarrierDirUpdateDoesNotBlockDescendants/non-barrier_dir_update_still_keeps_ancestor_barrier_waiting --- PASS: TestNonBarrierDirUpdateDoesNotBlockDescendants (0.00s) --- PASS: TestNonBarrierDirUpdateDoesNotBlockDescendants/attribute_update_on_/dir1_does_not_block_file_under_it (0.00s) --- PASS: TestNonBarrierDirUpdateDoesNotBlockDescendants/barrier_dir_create_at_the_same_path_still_blocks_descendants (0.00s) --- PASS: TestNonBarrierDirUpdateDoesNotBlockDescendants/barrier_dir_delete_still_waits_for_in-flight_descendants (0.00s) --- PASS: TestNonBarrierDirUpdateDoesNotBlockDescendants/non-barrier_dir_update_still_keeps_ancestor_barrier_waiting (0.00s) === RUN TestSamePathBarrierSerialization === RUN TestSamePathBarrierSerialization/barrier_dir_at_p_blocks_same-path_file === RUN TestSamePathBarrierSerialization/barrier_dir_at_p_blocks_another_same-path_barrier_dir === RUN TestSamePathBarrierSerialization/barrier_dir_at_p_blocks_non-barrier_update_at_same_path === RUN TestSamePathBarrierSerialization/file_at_p_blocks_same-path_barrier_dir === RUN TestSamePathBarrierSerialization/non-barrier_update_at_p_blocks_incoming_barrier_dir_at_same_path === RUN TestSamePathBarrierSerialization/non-barrier_update_at_p_does_NOT_block_same-path_non-barrier_update --- PASS: TestSamePathBarrierSerialization (0.01s) --- PASS: TestSamePathBarrierSerialization/barrier_dir_at_p_blocks_same-path_file (0.00s) --- PASS: TestSamePathBarrierSerialization/barrier_dir_at_p_blocks_another_same-path_barrier_dir (0.00s) --- PASS: TestSamePathBarrierSerialization/barrier_dir_at_p_blocks_non-barrier_update_at_same_path (0.00s) --- PASS: TestSamePathBarrierSerialization/file_at_p_blocks_same-path_barrier_dir (0.00s) --- PASS: TestSamePathBarrierSerialization/non-barrier_update_at_p_blocks_incoming_barrier_dir_at_same_path (0.00s) --- PASS: TestSamePathBarrierSerialization/non-barrier_update_at_p_does_NOT_block_same-path_non-barrier_update (0.00s) === RUN TestConcurrentJobsUpToLimit --- PASS: TestConcurrentJobsUpToLimit (0.20s) === RUN TestFailedJobHoldsWatermark E1117 09:37:08.256360 filer_sync_jobs.go:501 process /dir/b.txt -> ts_ns=200: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000002 +0000 UTC so this event is replayed on restart --- PASS: TestFailedJobHoldsWatermark (0.01s) === RUN TestFailedJobHoldsWatermarkAtOldestFailure E1117 09:37:08.259957 filer_sync_jobs.go:501 process /dir/f200.txt -> ts_ns=200: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000002 +0000 UTC so this event is replayed on restart E1117 09:37:08.260535 filer_sync_jobs.go:503 process /dir/f400.txt -> ts_ns=400: AccessDenied: Access Denied --- PASS: TestFailedJobHoldsWatermarkAtOldestFailure (0.00s) === RUN TestSyncStreamMetrics E1117 09:37:08.266501 filer_sync_jobs.go:501 process /dir1/b.txt -> ts_ns=2: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.000000002 +0000 UTC so this event is replayed on restart --- PASS: TestSyncStreamMetrics (0.01s) === RUN TestFailedJobReplaySuccessClearsPin E1117 09:37:08.272693 filer_sync_jobs.go:501 process /dir/b.txt -> ts_ns=200: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000002 +0000 UTC so this event is replayed on restart --- PASS: TestFailedJobReplaySuccessClearsPin (0.00s) === RUN TestFilteredMarkerAdvancesWatermark === RUN TestFilteredMarkerAdvancesWatermark/idle === RUN TestFilteredMarkerAdvancesWatermark/behind_in-flight_job === RUN TestFilteredMarkerAdvancesWatermark/behind_a_failure E1117 09:37:08.280795 filer_sync_jobs.go:501 process /dir/f.txt -> ts_ns=100: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000001 +0000 UTC so this event is replayed on restart --- PASS: TestFilteredMarkerAdvancesWatermark (0.01s) --- PASS: TestFilteredMarkerAdvancesWatermark/idle (0.00s) --- PASS: TestFilteredMarkerAdvancesWatermark/behind_in-flight_job (0.00s) --- PASS: TestFilteredMarkerAdvancesWatermark/behind_a_failure (0.00s) === RUN TestFailedLedgerCapsAndStaysPinned E1117 09:37:08.284817 filer_sync_jobs.go:501 process /dir/f6.txt -> ts_ns=600: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000006 +0000 UTC so this event is replayed on restart E1117 09:37:08.286327 filer_sync_jobs.go:501 process /dir/f5.txt -> ts_ns=500: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000005 +0000 UTC so this event is replayed on restart E1117 09:37:08.286670 filer_sync_jobs.go:503 process /dir/f10.txt -> ts_ns=1000: AccessDenied: Access Denied E1117 09:37:08.286920 filer_sync_jobs.go:501 process /dir/f4.txt -> ts_ns=400: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000004 +0000 UTC so this event is replayed on restart W1117 09:37:08.287359 filer_sync_jobs.go:496 process /dir/f3.txt -> ts_ns=300: AccessDenied: Access Denied; over 4 unresolved failures, pinning sync offset at 1970-01-01 00:00:00.0000003 +0000 UTC until restart E1117 09:37:08.287735 filer_sync_jobs.go:488 process /dir/f1.txt -> ts_ns=100: AccessDenied: Access Denied E1117 09:37:08.288006 filer_sync_jobs.go:488 process /dir/f2.txt -> ts_ns=200: AccessDenied: Access Denied E1117 09:37:08.288233 filer_sync_jobs.go:488 process /dir/f8.txt -> ts_ns=800: AccessDenied: Access Denied E1117 09:37:08.288452 filer_sync_jobs.go:488 process /dir/f7.txt -> ts_ns=700: AccessDenied: Access Denied E1117 09:37:08.288709 filer_sync_jobs.go:488 process /dir/f9.txt -> ts_ns=900: AccessDenied: Access Denied --- PASS: TestFailedLedgerCapsAndStaysPinned (0.01s) === RUN TestFailedLedgerDistinguishesEventsAtSameTs E1117 09:37:08.292330 filer_sync_jobs.go:501 process /dir/bad.txt -> ts_ns=200: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000002 +0000 UTC so this event is replayed on restart --- PASS: TestFailedLedgerDistinguishesEventsAtSameTs (0.01s) === RUN TestFailedJobSignalsResubscribe E1117 09:37:08.297506 filer_sync_jobs.go:501 process /dir/a.txt -> ts_ns=100: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000001 +0000 UTC so this event is replayed on restart --- PASS: TestFailedJobSignalsResubscribe (0.00s) === RUN TestResubscribeWaitsForInFlightJobs E1117 09:37:08.299988 filer_sync_jobs.go:501 process /dir/a.txt -> ts_ns=100: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000001 +0000 UTC so this event is replayed on restart --- PASS: TestResubscribeWaitsForInFlightJobs (0.05s) === RUN TestResubscribeWaitsForSameTsSibling E1117 09:37:08.355010 filer_sync_jobs.go:501 process /dir/bad.txt -> ts_ns=200: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000002 +0000 UTC so this event is replayed on restart --- PASS: TestResubscribeWaitsForSameTsSibling (0.05s) === RUN TestResumeStaysBehindClearedPin E1117 09:37:08.409523 filer_sync_jobs.go:501 process /dir/bad.txt -> ts_ns=200: AccessDenied: Access Denied; holding sync offset at 1970-01-01 00:00:00.0000002 +0000 UTC so this event is replayed on restart --- PASS: TestResumeStaysBehindClearedPin (0.00s) === RUN TestResumeStaysBelowNewestSeen --- PASS: TestResumeStaysBelowNewestSeen (0.01s) === RUN TestWatermarkAfterOutOfOrderCompletion --- PASS: TestWatermarkAfterOutOfOrderCompletion (0.00s) === RUN TestDoneTimestampsStayBoundedBehindSlowJob --- PASS: TestDoneTimestampsStayBoundedBehindSlowJob (0.43s) === RUN TestCompactedDoneTimestampsKeepProgressBetweenRunningJobs --- PASS: TestCompactedDoneTimestampsKeepProgressBetweenRunningJobs (0.03s) === RUN TestCompactDoneTsKeepsNewestPerGap --- PASS: TestCompactDoneTsKeepsNewestPerGap (0.00s) === RUN TestGetSignaturePrefixByPath_KeyForms --- PASS: TestGetSignaturePrefixByPath_KeyForms (0.00s) === RUN TestGetSignaturePrefixByPath_NoAliasing --- PASS: TestGetSignaturePrefixByPath_NoAliasing (0.00s) === RUN TestGetSignaturePrefixByPath_DistinctTargets --- PASS: TestGetSignaturePrefixByPath_DistinctTargets (0.00s) === RUN TestSyncOffset_HistoricalFallbackThenIndependence --- PASS: TestSyncOffset_HistoricalFallbackThenIndependence (0.05s) === RUN TestSyncOffset_StaleWriteDropped --- PASS: TestSyncOffset_StaleWriteDropped (0.02s) === RUN TestDestKeyPreservesColonForNonLocalSink === RUN TestDestKeyPreservesColonForNonLocalSink/non-incremental === RUN TestDestKeyPreservesColonForNonLocalSink/incremental --- PASS: TestDestKeyPreservesColonForNonLocalSink (0.00s) --- PASS: TestDestKeyPreservesColonForNonLocalSink/non-incremental (0.00s) --- PASS: TestDestKeyPreservesColonForNonLocalSink/incremental (0.00s) === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/equal === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/descendant === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/sibling_prefix === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/root === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/empty --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries (0.00s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/equal (0.00s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/descendant (0.00s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/sibling_prefix (0.00s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/root (0.00s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/empty (0.00s) === RUN TestMatchesExcludePathUsesDirectoryBoundaries --- PASS: TestMatchesExcludePathUsesDirectoryBoundaries (0.00s) === RUN TestGenProcessFunctionRenameCreatesThenDeletes --- PASS: TestGenProcessFunctionRenameCreatesThenDeletes (0.00s) === RUN TestGenProcessFunctionRenameUsesMoveEntryWhenSupported --- PASS: TestGenProcessFunctionRenameUsesMoveEntryWhenSupported (0.00s) === RUN TestGenProcessFunctionRenameMoverKeepsOldWhenDeletesDisabled --- PASS: TestGenProcessFunctionRenameMoverKeepsOldWhenDeletesDisabled (0.00s) === RUN TestGenProcessFunctionInPlaceUpdateUsesUpdateEntry --- PASS: TestGenProcessFunctionInPlaceUpdateUsesUpdateEntry (0.00s) === RUN TestGenProcessFunctionInPlaceUpdateFallbackDeletesBeforeCreate --- PASS: TestGenProcessFunctionInPlaceUpdateFallbackDeletesBeforeCreate (0.00s) === RUN TestGenProcessFunctionRenameCreateOnlyWhenDeletesDisabled --- PASS: TestGenProcessFunctionRenameCreateOnlyWhenDeletesDisabled (0.00s) === RUN TestGenProcessFunctionRenameToSiblingPrefixBecomesDelete --- PASS: TestGenProcessFunctionRenameToSiblingPrefixBecomesDelete (0.00s) === RUN TestGenProcessFunctionRenameFromExcludedDirBecomesCreate --- PASS: TestGenProcessFunctionRenameFromExcludedDirBecomesCreate (0.00s) === RUN TestGenProcessFunctionLocalSinkStaysInsideTarget W1117 09:37:08.994294 local_sink.go:53 local sink: skip /tmp/TestGenProcessFunctionLocalSinkStaysInsideTarget4085138418/001/escape/marker.txt outside /tmp/TestGenProcessFunctionLocalSinkStaysInsideTarget4085138418/001/backup --- PASS: TestGenProcessFunctionLocalSinkStaysInsideTarget (0.02s) === RUN TestGenProcessFunctionLocalSinkKeepsPathTheSourceRecreated --- PASS: TestGenProcessFunctionLocalSinkKeepsPathTheSourceRecreated (0.08s) === RUN TestStreamDeliveryBottleneck filer_sync_subscription_test.go:131: 1 stream: 2000 events 406ms 4924 events/sec filer_sync_subscription_test.go:136: 10 streams: 2000 events 50ms 39632 events/sec filer_sync_subscription_test.go:140: Speedup: 8.0x (10 parallel streams vs 1 stream) --- PASS: TestStreamDeliveryBottleneck (0.49s) === RUN TestConcurrencyIneffectiveOnStreamBottleneck filer_sync_subscription_test.go:174: concurrency= 32: 1000 events 193ms 5192 events/sec filer_sync_subscription_test.go:174: concurrency=128: 1000 events 195ms 5128 events/sec filer_sync_subscription_test.go:174: concurrency=512: 1000 events 195ms 5140 events/sec filer_sync_subscription_test.go:180: concurrency 512 vs 32: 0.99x (expected ~1.0x when stream-limited) --- PASS: TestConcurrencyIneffectiveOnStreamBottleneck (0.60s) === RUN TestLogBufferSubscriptionThroughput === RUN TestLogBufferSubscriptionThroughput/single_subscriber_root filer_sync_subscription_test.go:259: 1 subscriber (/): 2000 events 2.414s 828 events/sec === RUN TestLogBufferSubscriptionThroughput/parallel_subscribers_per_dir filer_sync_subscription_test.go:315: 10 subscribers: 2000 events 223ms 8966 events/sec === NAME TestLogBufferSubscriptionThroughput filer_sync_subscription_test.go:325: LogBuffer speedup: 10.8x (10 parallel subscribers vs 1) --- PASS: TestLogBufferSubscriptionThroughput (2.96s) --- PASS: TestLogBufferSubscriptionThroughput/single_subscriber_root (2.42s) --- PASS: TestLogBufferSubscriptionThroughput/parallel_subscribers_per_dir (0.22s) === RUN TestVerifySyncMissingFile [MISSING] /root/file.txt (size=100, etag=d41d8cd98f00b204e9800998ecf8427e-0) --- PASS: TestVerifySyncMissingFile (0.01s) === RUN TestVerifySyncOnlyInB === RUN TestVerifySyncOnlyInB/bidirectional [ONLY_IN_B] /root/extra.txt === RUN TestVerifySyncOnlyInB/active-passive_ignores_onlyInB --- PASS: TestVerifySyncOnlyInB (0.00s) --- PASS: TestVerifySyncOnlyInB/bidirectional (0.00s) --- PASS: TestVerifySyncOnlyInB/active-passive_ignores_onlyInB (0.00s) === RUN TestVerifySyncSizeMismatch [SIZE_MISMATCH] /root/data.bin (a=1024, b=512, mtime equal [chunk-level issue]) --- PASS: TestVerifySyncSizeMismatch (0.00s) === RUN TestVerifySyncConcurrencyBound --- PASS: TestVerifySyncConcurrencyBound (0.03s) === RUN TestVerifySyncETagMismatch [ETAG_MISMATCH] /root/data.bin (a=112233, b=445566, mtime equal [chunk-level issue]) --- PASS: TestVerifySyncETagMismatch (0.00s) === RUN TestVerifySyncChunkReorder --- PASS: TestVerifySyncChunkReorder (0.00s) === RUN TestVerifySyncGenuineChunkDivergence [ETAG_MISMATCH] /root/model.bin (a=bc86f2b2489529a978fb72f5c7924a06-3, b=835086ae0fedc4b8173fed690601b0d0-3, mtime equal [chunk-level issue]) --- PASS: TestVerifySyncGenuineChunkDivergence (0.00s) === RUN TestVerifySyncChunkCountDiffStaysEtagMismatch [ETAG_MISMATCH] /root/data.bin (a=4054c6f7787ecb7b323323155b0c0583-3, b=be6996cb706f34d65b9fee8745325abf-2, mtime equal [chunk-level issue]) --- PASS: TestVerifySyncChunkCountDiffStaysEtagMismatch (0.00s) === RUN TestVerifySyncDuplicateOffsetStaysEtagMismatch [ETAG_MISMATCH] /root/data.bin (a=cb662da895d59679c42914df7a97a8f8-2, b=5ea5b42ba5a8f329a95a02fbb277546d-2, mtime equal [chunk-level issue]) --- PASS: TestVerifySyncDuplicateOffsetStaysEtagMismatch (0.00s) === RUN TestVerifySyncManifestChunkStaysEtagMismatch [ETAG_MISMATCH] /root/data.bin (a=0a5ffa6ef1e4da9211ba94feda315660-2, b=278c4fdf68ec7ad5e134331f06ea61f4-2, mtime equal [chunk-level issue]) --- PASS: TestVerifySyncManifestChunkStaysEtagMismatch (0.00s) === RUN TestVerifySyncEmptyChunkETagStaysEtagMismatch [ETAG_MISMATCH] /root/data.bin (a=2abb7e6461a0bdb2a4a2a2d16bbd4ae2-3, b=a356dbadc2bbb35f128fb27178f8a89b-3, mtime equal [chunk-level issue]) --- PASS: TestVerifySyncEmptyChunkETagStaysEtagMismatch (0.00s) === RUN TestVerifySyncChunkReorderJSONEmittedByDefault --- PASS: TestVerifySyncChunkReorderJSONEmittedByDefault (0.02s) === RUN TestVerifySyncCutoffTime === RUN TestVerifySyncCutoffTime/A-only_recent_file_is_skipped,_not_reported_missing === RUN TestVerifySyncCutoffTime/A-only_old_file_is_reported_missing [MISSING] /old.txt (size=10, etag=d41d8cd98f00b204e9800998ecf8427e-0) === RUN TestVerifySyncCutoffTime/B-only_recent_file_is_skipped,_not_reported_as_ONLY_IN_B === RUN TestVerifySyncCutoffTime/B-only_old_file_is_reported_as_ONLY_IN_B [ONLY_IN_B] /old.txt --- PASS: TestVerifySyncCutoffTime (0.01s) --- PASS: TestVerifySyncCutoffTime/A-only_recent_file_is_skipped,_not_reported_missing (0.00s) --- PASS: TestVerifySyncCutoffTime/A-only_old_file_is_reported_missing (0.00s) --- PASS: TestVerifySyncCutoffTime/B-only_recent_file_is_skipped,_not_reported_as_ONLY_IN_B (0.00s) --- PASS: TestVerifySyncCutoffTime/B-only_old_file_is_reported_as_ONLY_IN_B (0.00s) === RUN TestVerifySyncCutoffMatchedFileBSideRecent --- PASS: TestVerifySyncCutoffMatchedFileBSideRecent (0.00s) === RUN TestVerifySyncMissingDirRecursesEvenWithRecentMtime [MISSING] /subdir/ (directory) [MISSING] /subdir/old.txt (size=10, etag=d41d8cd98f00b204e9800998ecf8427e-0) --- PASS: TestVerifySyncMissingDirRecursesEvenWithRecentMtime (0.00s) === RUN TestVerifySyncRootPath --- PASS: TestVerifySyncRootPath (0.00s) === RUN TestVerifySyncNoDeadlockDeepTree --- PASS: TestVerifySyncNoDeadlockDeepTree (0.23s) === RUN TestVerifySyncByteOrderSkew --- PASS: TestVerifySyncByteOrderSkew (0.00s) === RUN TestVerifySyncSourcesListConcurrently --- PASS: TestVerifySyncSourcesListConcurrently (0.00s) === RUN TestVerifySyncListErrorNoBogusDiffs --- PASS: TestVerifySyncListErrorNoBogusDiffs (0.00s) === RUN TestFixEcxFromShards I1117 09:37:13.528276 ec_encoder.go:225 encodeDatFile /tmp/TestFixEcxFromShards998396616/001/7.dat size:3000 with EC context 10+4 (total: 14) I1117 09:37:14.799469 fix.go:469 volume 7: no .dat size in .vif; reconstructing padded .dat (10485760 bytes) from 10 data shards I1117 09:37:14.800133 fix.go:497 volume 7: no .vif or .ecsum records the shard block layout; trying both I1117 09:37:14.841814 fix.go:553 volume 7: legacy layout indexes 10 needles over 3000 bytes; keeping it I1117 09:37:14.842434 fix.go:555 volume 7: wrote /tmp/TestFixEcxFromShards998396616/001/7.ecx from 10 data shards I1117 09:37:14.865661 fix.go:586 volume 7: wrote /tmp/TestFixEcxFromShards998396616/001/7.vif (version 3, datFileSize 3000, ec 10+4) --- PASS: TestFixEcxFromShards (1.42s) === RUN TestFixEcxFromShardsWithVif I1117 09:37:14.891075 ec_encoder.go:225 encodeDatFile /tmp/TestFixEcxFromShardsWithVif2477598619/001/9.dat size:3000 with EC context 10+4 (total: 14) I1117 09:37:15.619807 fix.go:555 volume 9: wrote /tmp/TestFixEcxFromShardsWithVif2477598619/001/9.ecx from 10 data shards --- PASS: TestFixEcxFromShardsWithVif (0.74s) === RUN TestFixEcxFromShardsMissingShards I1117 09:37:15.641245 ec_encoder.go:225 encodeDatFile /tmp/TestFixEcxFromShardsMissingShards873526701/001/11.dat size:3000 with EC context 10+4 (total: 14) I1117 09:37:16.368919 fix.go:446 volume 11: 11/14 shards present; reconstructing missing shards (10+4 (total: 14)) before index rebuild I1117 09:37:16.372737 ec_encoder.go:359 rebuilding /tmp/TestFixEcxFromShardsMissingShards873526701/001/11: 11 shards present, 3 missing [2 5 11], config 10+4 (total: 14) I1117 09:37:16.453095 fix.go:469 volume 11: no .dat size in .vif; reconstructing padded .dat (10485760 bytes) from 10 data shards I1117 09:37:16.453672 fix.go:497 volume 11: no .vif or .ecsum records the shard block layout; trying both I1117 09:37:16.508071 fix.go:553 volume 11: legacy layout indexes 10 needles over 3000 bytes; keeping it I1117 09:37:16.508615 fix.go:555 volume 11: wrote /tmp/TestFixEcxFromShardsMissingShards873526701/001/11.ecx from 10 data shards I1117 09:37:16.510373 fix.go:586 volume 11: wrote /tmp/TestFixEcxFromShardsMissingShards873526701/001/11.vif (version 3, datFileSize 3000, ec 10+4) --- PASS: TestFixEcxFromShardsMissingShards (0.89s) === RUN TestFixEcxFromShardsUniformLayout === RUN TestFixEcxFromShardsUniformLayout/from-sidecar I1117 09:37:20.195510 ec_encoder.go:225 encodeDatFile /tmp/TestFixEcxFromShardsUniformLayoutfrom-sidecar2414735696/001/13.dat size:27263624 with EC context 10+4 (total: 14) I1117 09:37:21.665073 fix.go:469 volume 13: no .dat size in .vif; reconstructing padded .dat (31457280 bytes) from 10 data shards I1117 09:37:21.701775 fix.go:555 volume 13: wrote /tmp/TestFixEcxFromShardsUniformLayoutfrom-sidecar2414735696/001/13.ecx from 10 data shards I1117 09:37:21.703801 fix.go:586 volume 13: wrote /tmp/TestFixEcxFromShardsUniformLayoutfrom-sidecar2414735696/001/13.vif (version 3, datFileSize 27263624, ec 10+4) === RUN TestFixEcxFromShardsUniformLayout/dual-scan I1117 09:37:25.988411 ec_encoder.go:225 encodeDatFile /tmp/TestFixEcxFromShardsUniformLayoutdual-scan1267716964/001/13.dat size:27263624 with EC context 10+4 (total: 14) I1117 09:37:27.868407 fix.go:469 volume 13: no .dat size in .vif; reconstructing padded .dat (31457280 bytes) from 10 data shards I1117 09:37:27.868948 fix.go:497 volume 13: no .vif or .ecsum records the shard block layout; trying both I1117 09:37:27.961948 fix.go:553 volume 13: uniform layout indexes 11 needles over 27263624 bytes; keeping it I1117 09:37:27.962490 fix.go:555 volume 13: wrote /tmp/TestFixEcxFromShardsUniformLayoutdual-scan1267716964/001/13.ecx from 10 data shards I1117 09:37:27.964190 fix.go:586 volume 13: wrote /tmp/TestFixEcxFromShardsUniformLayoutdual-scan1267716964/001/13.vif (version 3, datFileSize 27263624, ec 10+4) --- PASS: TestFixEcxFromShardsUniformLayout (11.46s) --- PASS: TestFixEcxFromShardsUniformLayout/from-sidecar (5.20s) --- PASS: TestFixEcxFromShardsUniformLayout/dual-scan (6.26s) === RUN TestSaveToIdxWritesOffsetOrder --- PASS: TestSaveToIdxWritesOffsetOrder (0.03s) === RUN TestRunFuseDoesNotSkipOptionAfterConcurrentWriters --- PASS: TestRunFuseDoesNotSkipOptionAfterConcurrentWriters (0.00s) === RUN TestRunFuseSetsVolumeName --- PASS: TestRunFuseSetsVolumeName (0.00s) === RUN TestDefaultVolumeSizeLimitAlignsWithErasureCodingRows --- PASS: TestDefaultVolumeSizeLimitAlignsWithErasureCodingRows (0.00s) === RUN TestPeerIndexIgnoresGrpcPort --- PASS: TestPeerIndexIgnoresGrpcPort (0.00s) === RUN TestCheckPeersAddsSelfWhenGrpcPortMismatches I1117 09:37:28.019290 master.go:517 current: 127.0.0.1:9000 peers:127.0.0.1:9002,127.0.0.1:9003 --- PASS: TestCheckPeersAddsSelfWhenGrpcPortMismatches (0.00s) === RUN TestCheckPeersCanonicalizesSelfEntry I1117 09:37:28.022051 master.go:517 current: 127.0.0.1:9000 peers:127.0.0.1:9000,127.0.0.1:9002,127.0.0.1:9003 --- PASS: TestCheckPeersCanonicalizesSelfEntry (0.00s) === RUN TestCheckPeersDeduplicatesAliasPeers I1117 09:37:28.023171 master.go:517 current: 127.0.0.1:9000 peers:127.0.0.1:9002,127.0.0.1:9002.19002,127.0.0.1:9003 --- PASS: TestCheckPeersDeduplicatesAliasPeers (0.00s) === RUN TestMetadataEventDirectoryMembershipUsesDirectoryBoundaries --- PASS: TestMetadataEventDirectoryMembershipUsesDirectoryBoundaries (0.00s) === RUN TestMetadataEventUpdatesAndRemovesDirectory === RUN TestMetadataEventUpdatesAndRemovesDirectory/nil_response === RUN TestMetadataEventUpdatesAndRemovesDirectory/create_event === RUN TestMetadataEventUpdatesAndRemovesDirectory/rename_out === RUN TestMetadataEventUpdatesAndRemovesDirectory/rename_into === RUN TestMetadataEventUpdatesAndRemovesDirectory/rename_within === RUN TestMetadataEventUpdatesAndRemovesDirectory/delete --- PASS: TestMetadataEventUpdatesAndRemovesDirectory (0.00s) --- PASS: TestMetadataEventUpdatesAndRemovesDirectory/nil_response (0.00s) --- PASS: TestMetadataEventUpdatesAndRemovesDirectory/create_event (0.00s) --- PASS: TestMetadataEventUpdatesAndRemovesDirectory/rename_out (0.00s) --- PASS: TestMetadataEventUpdatesAndRemovesDirectory/rename_into (0.00s) --- PASS: TestMetadataEventUpdatesAndRemovesDirectory/rename_within (0.00s) --- PASS: TestMetadataEventUpdatesAndRemovesDirectory/delete (0.00s) === RUN TestApplyMiniAdminCredentialFallbackFromEnv --- PASS: TestApplyMiniAdminCredentialFallbackFromEnv (0.03s) === RUN TestMiniAdminBindIP === RUN TestMiniAdminBindIP/unauthenticated_wildcard_binds_to_loopback === RUN TestMiniAdminBindIP/unauthenticated_IPv6_wildcard_binds_to_loopback === RUN TestMiniAdminBindIP/existing_loopback_bind_is_preserved === RUN TestMiniAdminBindIP/password_permits_requested_bind === RUN TestMiniAdminBindIP/mTLS_permits_requested_bind === RUN TestMiniAdminBindIP/explicit_insecure_opt-out_permits_requested_bind --- PASS: TestMiniAdminBindIP (0.01s) --- PASS: TestMiniAdminBindIP/unauthenticated_wildcard_binds_to_loopback (0.00s) --- PASS: TestMiniAdminBindIP/unauthenticated_IPv6_wildcard_binds_to_loopback (0.00s) --- PASS: TestMiniAdminBindIP/existing_loopback_bind_is_preserved (0.00s) --- PASS: TestMiniAdminBindIP/password_permits_requested_bind (0.00s) --- PASS: TestMiniAdminBindIP/mTLS_permits_requested_bind (0.00s) --- PASS: TestMiniAdminBindIP/explicit_insecure_opt-out_permits_requested_bind (0.00s) === RUN TestMiniAdminWorkerBindDefaultsToLoopback --- PASS: TestMiniAdminWorkerBindDefaultsToLoopback (0.00s) === RUN TestListenMiniAdminWorkerUsesRequestedAddress --- PASS: TestListenMiniAdminWorkerUsesRequestedAddress (0.00s) === RUN TestMiniAdminWorkerAddressUsesFinalGrpcPort === RUN TestMiniAdminWorkerAddressUsesFinalGrpcPort/IPv4 === RUN TestMiniAdminWorkerAddressUsesFinalGrpcPort/IPv6 === RUN TestMiniAdminWorkerAddressUsesFinalGrpcPort/IPv4_wildcard_dials_loopback === RUN TestMiniAdminWorkerAddressUsesFinalGrpcPort/IPv6_wildcard_dials_loopback --- PASS: TestMiniAdminWorkerAddressUsesFinalGrpcPort (0.00s) --- PASS: TestMiniAdminWorkerAddressUsesFinalGrpcPort/IPv4 (0.00s) --- PASS: TestMiniAdminWorkerAddressUsesFinalGrpcPort/IPv6 (0.00s) --- PASS: TestMiniAdminWorkerAddressUsesFinalGrpcPort/IPv4_wildcard_dials_loopback (0.00s) --- PASS: TestMiniAdminWorkerAddressUsesFinalGrpcPort/IPv6_wildcard_dials_loopback (0.00s) === RUN TestMiniAdminWorkerDialIP === RUN TestMiniAdminWorkerDialIP/0.0.0.0 === RUN TestMiniAdminWorkerDialIP/:: === RUN TestMiniAdminWorkerDialIP/[::] === RUN TestMiniAdminWorkerDialIP/192.0.2.10 === RUN TestMiniAdminWorkerDialIP/2001:db8::10 === RUN TestMiniAdminWorkerDialIP/worker.internal --- PASS: TestMiniAdminWorkerDialIP (0.00s) --- PASS: TestMiniAdminWorkerDialIP/0.0.0.0 (0.00s) --- PASS: TestMiniAdminWorkerDialIP/:: (0.00s) --- PASS: TestMiniAdminWorkerDialIP/[::] (0.00s) --- PASS: TestMiniAdminWorkerDialIP/192.0.2.10 (0.00s) --- PASS: TestMiniAdminWorkerDialIP/2001:db8::10 (0.00s) --- PASS: TestMiniAdminWorkerDialIP/worker.internal (0.00s) === RUN TestMiniAdminAdvertisedIP === RUN TestMiniAdminAdvertisedIP/selected_loopback === RUN TestMiniAdminAdvertisedIP/IPv4_wildcard === RUN TestMiniAdminAdvertisedIP/IPv6_wildcard --- PASS: TestMiniAdminAdvertisedIP (0.00s) --- PASS: TestMiniAdminAdvertisedIP/selected_loopback (0.00s) --- PASS: TestMiniAdminAdvertisedIP/IPv4_wildcard (0.00s) --- PASS: TestMiniAdminAdvertisedIP/IPv6_wildcard (0.00s) === RUN TestDefaultAdminGrpcPortBelowEphemeralFloor --- PASS: TestDefaultAdminGrpcPortBelowEphemeralFloor (0.00s) === RUN TestParseBucketList === RUN TestParseBucketList/empty === RUN TestParseBucketList/single === RUN TestParseBucketList/multi === RUN TestParseBucketList/trims_whitespace === RUN TestParseBucketList/drops_empty_entries === RUN TestParseBucketList/dedupes_preserving_order === RUN TestParseBucketList/only_commas --- PASS: TestParseBucketList (0.01s) --- PASS: TestParseBucketList/empty (0.00s) --- PASS: TestParseBucketList/single (0.00s) --- PASS: TestParseBucketList/multi (0.00s) --- PASS: TestParseBucketList/trims_whitespace (0.00s) --- PASS: TestParseBucketList/drops_empty_entries (0.00s) --- PASS: TestParseBucketList/dedupes_preserving_order (0.00s) --- PASS: TestParseBucketList/only_commas (0.00s) === RUN TestParseTableBucketList === RUN TestParseTableBucketList/empty === RUN TestParseTableBucketList/defaults_to_iceberg === RUN TestParseTableBucketList/explicit_format === RUN TestParseTableBucketList/format_is_case_insensitive === RUN TestParseTableBucketList/mixed_formats === RUN TestParseTableBucketList/trims_whitespace === RUN TestParseTableBucketList/drops_unsupported_format W1117 09:37:28.117107 mini.go:2623 not creating table bucket vectors: unsupported format "DELTA" === RUN TestParseTableBucketList/empty_format_is_the_default === RUN TestParseTableBucketList/dedupes_by_name === RUN TestParseTableBucketList/drops_empty_entries --- PASS: TestParseTableBucketList (0.01s) --- PASS: TestParseTableBucketList/empty (0.00s) --- PASS: TestParseTableBucketList/defaults_to_iceberg (0.00s) --- PASS: TestParseTableBucketList/explicit_format (0.00s) --- PASS: TestParseTableBucketList/format_is_case_insensitive (0.00s) --- PASS: TestParseTableBucketList/mixed_formats (0.00s) --- PASS: TestParseTableBucketList/trims_whitespace (0.00s) --- PASS: TestParseTableBucketList/drops_unsupported_format (0.00s) --- PASS: TestParseTableBucketList/empty_format_is_the_default (0.00s) --- PASS: TestParseTableBucketList/dedupes_by_name (0.00s) --- PASS: TestParseTableBucketList/drops_empty_entries (0.00s) === RUN TestMiniServesTableFormat --- PASS: TestMiniServesTableFormat (0.00s) === RUN TestIcebergRoutingNames === RUN TestIcebergRoutingNames/none === RUN TestIcebergRoutingNames/iceberg_only === RUN TestIcebergRoutingNames/lance_is_not_routable === RUN TestIcebergRoutingNames/lance_first === RUN TestIcebergRoutingNames/order_preserved --- PASS: TestIcebergRoutingNames (0.00s) --- PASS: TestIcebergRoutingNames/none (0.00s) --- PASS: TestIcebergRoutingNames/iceberg_only (0.00s) --- PASS: TestIcebergRoutingNames/lance_is_not_routable (0.00s) --- PASS: TestIcebergRoutingNames/lance_first (0.00s) --- PASS: TestIcebergRoutingNames/order_preserved (0.00s) === RUN TestIcebergRoutingNamesFromEnvSpec --- PASS: TestIcebergRoutingNamesFromEnvSpec (0.00s) === RUN TestMiniDefaultPluginJobTypes --- PASS: TestMiniDefaultPluginJobTypes (0.00s) === RUN TestMiniVectorRejectsExplicitListenerConflict --- PASS: TestMiniVectorRejectsExplicitListenerConflict (0.00s) === RUN Test_volumeName === RUN Test_volumeName/an_override_outranks_the_mounted_path_and_the_mount_point === RUN Test_volumeName/an_override_still_gets_commas_replaced === RUN Test_volumeName/a_drive_letter_leaves_only_the_filer_to_fall_back_on === RUN Test_volumeName/empty_path_falls_back_to_the_filer === RUN Test_volumeName/several_filers_stay_parseable_as_one_option === RUN Test_volumeName/a_whole-tree_mount_takes_the_name_of_its_network_share === RUN Test_volumeName/a_whole-tree_mount_takes_the_name_of_its_directory === RUN Test_volumeName/the_mounted_path_outranks_the_mount_point === RUN Test_volumeName/a_relative_mount_point_is_not_a_name === RUN Test_volumeName/mounted_directory_names_the_disk === RUN Test_volumeName/trailing_slash_is_not_a_name === RUN Test_volumeName/spaces_are_kept,_commas_are_not --- PASS: Test_volumeName (0.01s) --- PASS: Test_volumeName/an_override_outranks_the_mounted_path_and_the_mount_point (0.00s) --- PASS: Test_volumeName/an_override_still_gets_commas_replaced (0.00s) --- PASS: Test_volumeName/a_drive_letter_leaves_only_the_filer_to_fall_back_on (0.00s) --- PASS: Test_volumeName/empty_path_falls_back_to_the_filer (0.00s) --- PASS: Test_volumeName/several_filers_stay_parseable_as_one_option (0.00s) --- PASS: Test_volumeName/a_whole-tree_mount_takes_the_name_of_its_network_share (0.00s) --- PASS: Test_volumeName/a_whole-tree_mount_takes_the_name_of_its_directory (0.00s) --- PASS: Test_volumeName/the_mounted_path_outranks_the_mount_point (0.00s) --- PASS: Test_volumeName/a_relative_mount_point_is_not_a_name (0.00s) --- PASS: Test_volumeName/mounted_directory_names_the_disk (0.00s) --- PASS: Test_volumeName/trailing_slash_is_not_a_name (0.00s) --- PASS: Test_volumeName/spaces_are_kept,_commas_are_not (0.00s) === RUN Test_ensureBucketAllowEmptyFolders === RUN Test_ensureBucketAllowEmptyFolders/no_policy_allows_empty_folders === RUN Test_ensureBucketAllowEmptyFolders/explicit_true_is_kept === RUN Test_ensureBucketAllowEmptyFolders/explicit_false_is_kept === RUN Test_ensureBucketAllowEmptyFolders/subdirectory_mount_leaves_the_bucket_alone === RUN Test_ensureBucketAllowEmptyFolders/a_concurrent_false_wins_over_the_mount_default --- PASS: Test_ensureBucketAllowEmptyFolders (0.01s) --- PASS: Test_ensureBucketAllowEmptyFolders/no_policy_allows_empty_folders (0.00s) --- PASS: Test_ensureBucketAllowEmptyFolders/explicit_true_is_kept (0.00s) --- PASS: Test_ensureBucketAllowEmptyFolders/explicit_false_is_kept (0.00s) --- PASS: Test_ensureBucketAllowEmptyFolders/subdirectory_mount_leaves_the_bucket_alone (0.00s) --- PASS: Test_ensureBucketAllowEmptyFolders/a_concurrent_false_wins_over_the_mount_default (0.00s) === RUN Test_mountSocketCleanup --- PASS: Test_mountSocketCleanup (0.01s) === RUN Test_ensureMountRootDirectory === RUN Test_ensureMountRootDirectory/an_existing_bucket_root_survives_the_mount_start === RUN Test_ensureMountRootDirectory/a_missing_root_is_created_exclusively === RUN Test_ensureMountRootDirectory/a_file_at_the_root_path_is_refused === RUN Test_ensureMountRootDirectory/a_root_created_meanwhile_is_kept,_text-only_errors_false I1117 09:37:28.163574 filer_client.go:306 mkdir directory:"/buckets" entry:{name:"b1" is_directory:true attributes:{mtime:1794908248 file_mode:2147484159 uid:1000 gid:1000 crtime:1794908248}} o_excl:true: CreateEntry /buckets/b1: entry already exists === RUN Test_ensureMountRootDirectory/a_root_created_meanwhile_is_kept,_text-only_errors_true I1117 09:37:28.172243 filer_client.go:306 mkdir directory:"/buckets" entry:{name:"b1" is_directory:true attributes:{mtime:1794908248 file_mode:2147484159 uid:1000 gid:1000 crtime:1794908248}} o_excl:true: CreateEntry: EEXIST: entry already exists === RUN Test_ensureMountRootDirectory/a_file_created_meanwhile_is_refused I1117 09:37:28.176035 filer_client.go:306 mkdir directory:"/buckets" entry:{name:"b1" is_directory:true attributes:{mtime:1794908248 file_mode:2147484159 uid:1000 gid:1000 crtime:1794908248}} o_excl:true: CreateEntry /buckets/b1: entry already exists === RUN Test_ensureMountRootDirectory/the_filer_root_is_never_created --- PASS: Test_ensureMountRootDirectory (0.02s) --- PASS: Test_ensureMountRootDirectory/an_existing_bucket_root_survives_the_mount_start (0.00s) --- PASS: Test_ensureMountRootDirectory/a_missing_root_is_created_exclusively (0.00s) --- PASS: Test_ensureMountRootDirectory/a_file_at_the_root_path_is_refused (0.00s) --- PASS: Test_ensureMountRootDirectory/a_root_created_meanwhile_is_kept,_text-only_errors_false (0.01s) --- PASS: Test_ensureMountRootDirectory/a_root_created_meanwhile_is_kept,_text-only_errors_true (0.00s) --- PASS: Test_ensureMountRootDirectory/a_file_created_meanwhile_is_refused (0.00s) --- PASS: Test_ensureMountRootDirectory/the_filer_root_is_never_created (0.00s) === RUN TestConfigureMountMemory --- PASS: TestConfigureMountMemory (0.00s) === RUN TestConfigureMountMemoryRuntimeLimit --- PASS: TestConfigureMountMemoryRuntimeLimit (0.00s) === RUN Test_bucketPathForMountRoot === RUN Test_bucketPathForMountRoot/bucket_root_mount === RUN Test_bucketPathForMountRoot/bucket_root_with_trailing_slash === RUN Test_bucketPathForMountRoot/subdirectory_mount === RUN Test_bucketPathForMountRoot/non-bucket_mount --- PASS: Test_bucketPathForMountRoot (0.00s) --- PASS: Test_bucketPathForMountRoot/bucket_root_mount (0.00s) --- PASS: Test_bucketPathForMountRoot/bucket_root_with_trailing_slash (0.00s) --- PASS: Test_bucketPathForMountRoot/subdirectory_mount (0.00s) --- PASS: Test_bucketPathForMountRoot/non-bucket_mount (0.00s) === RUN TestBuildPluginWorkerHandlerExplicitTypes --- PASS: TestBuildPluginWorkerHandlerExplicitTypes (0.00s) === RUN TestBuildPluginWorkerHandlerAliases --- PASS: TestBuildPluginWorkerHandlerAliases (0.00s) === RUN TestBuildPluginWorkerHandlerUnknown --- PASS: TestBuildPluginWorkerHandlerUnknown (0.00s) === RUN TestBuildPluginWorkerHandlers --- PASS: TestBuildPluginWorkerHandlers (0.00s) === RUN TestBuildPluginWorkerHandlersCategories --- PASS: TestBuildPluginWorkerHandlersCategories (0.00s) === RUN TestPluginWorkerDefaultJobTypes --- PASS: TestPluginWorkerDefaultJobTypes (0.00s) === RUN TestResolvePluginWorkerID I1117 09:37:28.196513 worker.go:148 Generated new worker ID: w-makech-f6ae I1117 09:37:28.196963 worker.go:155 Saved worker ID to /tmp/TestResolvePluginWorkerID1943935031/001/worker.id I1117 09:37:28.197543 worker.go:110 Loaded existing worker ID from /tmp/TestResolvePluginWorkerID1943935031/001/worker.id: w-makech-f6ae --- PASS: TestResolvePluginWorkerID (0.00s) === RUN TestParsePluginWorkerAdminAddress --- PASS: TestParsePluginWorkerAdminAddress (0.00s) === RUN TestResolvePluginWorkerAdminServerUsesStatusGrpcPort --- PASS: TestResolvePluginWorkerAdminServerUsesStatusGrpcPort (0.02s) === RUN TestResolvePluginWorkerAdminServerKeepsDefaultGrpcOffset --- PASS: TestResolvePluginWorkerAdminServerKeepsDefaultGrpcOffset (0.01s) === RUN TestAuxListenerBindFailureIsNonFatal E1117 09:37:28.290583 s3.go:665 Iceberg REST Catalog listener on 127.0.0.1:42375 error: listen tcp 127.0.0.1:42375: bind: address already in use E1117 09:37:28.322845 s3.go:714 Lance Namespace listener on 127.0.0.1:46325 error: listen tcp 127.0.0.1:46325: bind: address already in use --- PASS: TestAuxListenerBindFailureIsNonFatal (0.10s) === RUN TestCredentialRoleIsSetForBothCatalogs --- PASS: TestCredentialRoleIsSetForBothCatalogs (0.00s) === RUN TestDeriveS3AdvertisedEndpoint === RUN TestDeriveS3AdvertisedEndpoint/wildcard_bind_IP_with_no_externalUrl_does_not_advertise_an_endpoint === RUN TestDeriveS3AdvertisedEndpoint/empty_bind_IP_with_no_externalUrl_does_not_advertise_an_endpoint === RUN TestDeriveS3AdvertisedEndpoint/explicit_bind_IP_is_kept === RUN TestDeriveS3AdvertisedEndpoint/IPv6_literals_are_bracketed === RUN TestDeriveS3AdvertisedEndpoint/TLS_key_+_https_port_switches_scheme_and_port === RUN TestDeriveS3AdvertisedEndpoint/TLS-only_(no_separate_https_port)_still_uses_https_on_the_HTTP_port === RUN TestDeriveS3AdvertisedEndpoint/externalUrl_wins_and_trailing_slash_is_stripped --- PASS: TestDeriveS3AdvertisedEndpoint (0.01s) --- PASS: TestDeriveS3AdvertisedEndpoint/wildcard_bind_IP_with_no_externalUrl_does_not_advertise_an_endpoint (0.00s) --- PASS: TestDeriveS3AdvertisedEndpoint/empty_bind_IP_with_no_externalUrl_does_not_advertise_an_endpoint (0.00s) --- PASS: TestDeriveS3AdvertisedEndpoint/explicit_bind_IP_is_kept (0.00s) --- PASS: TestDeriveS3AdvertisedEndpoint/IPv6_literals_are_bracketed (0.00s) --- PASS: TestDeriveS3AdvertisedEndpoint/TLS_key_+_https_port_switches_scheme_and_port (0.00s) --- PASS: TestDeriveS3AdvertisedEndpoint/TLS-only_(no_separate_https_port)_still_uses_https_on_the_HTTP_port (0.00s) --- PASS: TestDeriveS3AdvertisedEndpoint/externalUrl_wins_and_trailing_slash_is_stripped (0.00s) === RUN TestS3ShutdownDrainsActiveRequestBeforeServeReturns --- PASS: TestS3ShutdownDrainsActiveRequestBeforeServeReturns (0.14s) === RUN TestReadingTomlConfiguration database is map[connection_max:5000 enabled:true ports:[8001 8001 8002] server:192.168.1.1] servers is map[alpha:map[dc:eqdc10 ip:10.0.0.1] beta:map[dc:eqdc10 ip:10.0.0.2]] alpha ip is 10.0.0.1 --- PASS: TestReadingTomlConfiguration (0.02s) === RUN TestServerFilerDisableHttpFlag --- PASS: TestServerFilerDisableHttpFlag (0.00s) === RUN TestServerGatewayDataCenterFlags --- PASS: TestServerGatewayDataCenterFlags (0.00s) === RUN TestIdleTimeoutSeconds --- PASS: TestIdleTimeoutSeconds (0.00s) === RUN TestGracefulStopGrpcWaitsForInFlightRPC I1117 09:37:28.514981 shutdown.go:15 Gracefully stopping gRPC server I1117 09:37:28.622944 shutdown.go:23 gRPC server stopped gracefully --- PASS: TestGracefulStopGrpcWaitsForInFlightRPC (0.13s) === RUN TestGracefulStopGrpcForcesStopAfterTimeout I1117 09:37:28.637766 shutdown.go:15 Gracefully stopping gRPC server I1117 09:37:28.689188 shutdown.go:25 gRPC server graceful stop timed out after 50ms, forcing stop --- PASS: TestGracefulStopGrpcForcesStopAfterTimeout (0.07s) === RUN TestXYZ I1117 09:37:28.694300 volume_test.go:12 Last-Modified Mon, 08 Jul 2013 08:53:16 GMT --- PASS: TestXYZ (0.00s) === RUN TestWorkerDefaultJobTypes --- PASS: TestWorkerDefaultJobTypes (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/command 40.892s ? github.com/seaweedfs/seaweedfs/weed/command/scaffold [no test files] === RUN TestSaveConfigurationFiltersStaticIdentitySnapshot === PAUSE TestSaveConfigurationFiltersStaticIdentitySnapshot === RUN TestCredentialStoreInterface --- PASS: TestCredentialStoreInterface (0.00s) === RUN TestCredentialManagerCreation --- PASS: TestCredentialManagerCreation (0.00s) === RUN TestCredentialInterface --- PASS: TestCredentialInterface (0.04s) === RUN TestCredentialManagerIntegration --- PASS: TestCredentialManagerIntegration (0.02s) === RUN TestErrorTypes --- PASS: TestErrorTypes (0.00s) === RUN TestGetAvailableStores credential_test.go:317: Available stores: [memory filer_etc] (count: 2) --- PASS: TestGetAvailableStores (0.01s) === RUN TestWithS3InternalAdminAuth_NoKey_NoOp --- PASS: TestWithS3InternalAdminAuth_NoKey_NoOp (0.00s) === RUN TestWithS3InternalAdminAuth_WithKey_AttachesBearer --- PASS: TestWithS3InternalAdminAuth_WithKey_AttachesBearer (0.12s) === RUN TestWithS3InternalAdminAuth_ZeroExpiry_ZeroTTL --- PASS: TestWithS3InternalAdminAuth_ZeroExpiry_ZeroTTL (0.00s) === RUN TestWithS3InternalAdminAuth_ReplacesInheritedToken --- PASS: TestWithS3InternalAdminAuth_ReplacesInheritedToken (0.00s) === RUN TestValidateServiceAccountId === RUN TestValidateServiceAccountId/simple === RUN TestValidateServiceAccountId/uppercase_parent === RUN TestValidateServiceAccountId/hyphenated_uuid_suffix === RUN TestValidateServiceAccountId/with_hyphen === RUN TestValidateServiceAccountId/with_underscore === RUN TestValidateServiceAccountId/email-style === RUN TestValidateServiceAccountId/with_dot === RUN TestValidateServiceAccountId/with_plus === RUN TestValidateServiceAccountId/with_equals === RUN TestValidateServiceAccountId/with_comma === RUN TestValidateServiceAccountId/empty === RUN TestValidateServiceAccountId/missing_prefix === RUN TestValidateServiceAccountId/wrong_prefix === RUN TestValidateServiceAccountId/uppercase_uuid === RUN TestValidateServiceAccountId/missing_uuid === RUN TestValidateServiceAccountId/missing_user === RUN TestValidateServiceAccountId/colon_in_user --- PASS: TestValidateServiceAccountId (0.02s) --- PASS: TestValidateServiceAccountId/simple (0.00s) --- PASS: TestValidateServiceAccountId/uppercase_parent (0.00s) --- PASS: TestValidateServiceAccountId/hyphenated_uuid_suffix (0.00s) --- PASS: TestValidateServiceAccountId/with_hyphen (0.00s) --- PASS: TestValidateServiceAccountId/with_underscore (0.00s) --- PASS: TestValidateServiceAccountId/email-style (0.00s) --- PASS: TestValidateServiceAccountId/with_dot (0.00s) --- PASS: TestValidateServiceAccountId/with_plus (0.00s) --- PASS: TestValidateServiceAccountId/with_equals (0.00s) --- PASS: TestValidateServiceAccountId/with_comma (0.00s) --- PASS: TestValidateServiceAccountId/empty (0.00s) --- PASS: TestValidateServiceAccountId/missing_prefix (0.00s) --- PASS: TestValidateServiceAccountId/wrong_prefix (0.00s) --- PASS: TestValidateServiceAccountId/uppercase_uuid (0.00s) --- PASS: TestValidateServiceAccountId/missing_uuid (0.00s) --- PASS: TestValidateServiceAccountId/missing_user (0.00s) --- PASS: TestValidateServiceAccountId/colon_in_user (0.00s) === RUN TestSaveConfigurationDelegatesWithoutMaster --- PASS: TestSaveConfigurationDelegatesWithoutMaster (0.01s) === RUN TestSaveConfigurationDiffSnapshotTakenBeforeWrite --- PASS: TestSaveConfigurationDiffSnapshotTakenBeforeWrite (0.01s) === CONT TestSaveConfigurationFiltersStaticIdentitySnapshot --- PASS: TestSaveConfigurationFiltersStaticIdentitySnapshot (0.08s) PASS ok github.com/seaweedfs/seaweedfs/weed/credential 2.662s === RUN TestLoadConfigurationFailsOnEmptyIdentityFile --- PASS: TestLoadConfigurationFailsOnEmptyIdentityFile (0.55s) === RUN TestLoadConfigurationFailsOnMalformedIdentityFile --- PASS: TestLoadConfigurationFailsOnMalformedIdentityFile (0.08s) === RUN TestLoadManagedPoliciesFailsOnEmptyPolicyFile --- PASS: TestLoadManagedPoliciesFailsOnEmptyPolicyFile (0.08s) === RUN TestLoadConfigurationIgnoresNonJsonAuxiliaryFiles --- PASS: TestLoadConfigurationIgnoresNonJsonAuxiliaryFiles (0.10s) === RUN TestLoadConfigurationFailsOnEmptyIdentityName --- PASS: TestLoadConfigurationFailsOnEmptyIdentityName (0.05s) === RUN TestLoadConfigurationFailsOnEmptyGroupName --- PASS: TestLoadConfigurationFailsOnEmptyGroupName (0.07s) === RUN TestLoadConfigurationFailsOnEmptyServiceAccountId --- PASS: TestLoadConfigurationFailsOnEmptyServiceAccountId (0.06s) === RUN TestLoadConfigurationSucceedsOnValidFiles --- PASS: TestLoadConfigurationSucceedsOnValidFiles (0.06s) === RUN TestMigrationKeepsChangesMadeAfterTheLoad === RUN TestMigrationKeepsChangesMadeAfterTheLoad/rewritten_identity_file I1117 09:36:51.119515 filer_etc_identity.go:185 Migrating IAM configuration to multi-file layout... === RUN TestMigrationKeepsChangesMadeAfterTheLoad/removed_identity_file I1117 09:36:51.244720 filer_etc_identity.go:185 Migrating IAM configuration to multi-file layout... === RUN TestMigrationKeepsChangesMadeAfterTheLoad/removed_identity_file_also_in_the_legacy_file I1117 09:36:51.348880 filer_etc_identity.go:185 Migrating IAM configuration to multi-file layout... === RUN TestMigrationKeepsChangesMadeAfterTheLoad/rewritten_legacy_file I1117 09:36:51.428063 filer_etc_identity.go:177 identity.json changed during the IAM load, migrating it at the next load I1117 09:36:51.451157 filer_etc_identity.go:185 Migrating IAM configuration to multi-file layout... --- PASS: TestMigrationKeepsChangesMadeAfterTheLoad (0.59s) --- PASS: TestMigrationKeepsChangesMadeAfterTheLoad/rewritten_identity_file (0.20s) --- PASS: TestMigrationKeepsChangesMadeAfterTheLoad/removed_identity_file (0.10s) --- PASS: TestMigrationKeepsChangesMadeAfterTheLoad/removed_identity_file_also_in_the_legacy_file (0.08s) --- PASS: TestMigrationKeepsChangesMadeAfterTheLoad/rewritten_legacy_file (0.20s) === RUN TestFilerEtcStoreListPolicyNamesIncludesLegacyPolicies --- PASS: TestFilerEtcStoreListPolicyNamesIncludesLegacyPolicies (0.13s) === RUN TestFilerEtcStoreListPolicyNamesSkipsNonJsonAuxiliary --- PASS: TestFilerEtcStoreListPolicyNamesSkipsNonJsonAuxiliary (0.07s) === RUN TestFilerEtcStoreDeletePolicyRemovesLegacyManagedCopy --- PASS: TestFilerEtcStoreDeletePolicyRemovesLegacyManagedCopy (0.15s) === RUN TestFilerEtcStoreDeletePolicySerializesLegacyUpdates --- PASS: TestFilerEtcStoreDeletePolicySerializesLegacyUpdates (0.46s) === RUN TestFilerEtcStoreLoadManagedPoliciesRespectsReadContext --- PASS: TestFilerEtcStoreLoadManagedPoliciesRespectsReadContext (0.07s) PASS ok github.com/seaweedfs/seaweedfs/weed/credential/filer_etc 4.647s === RUN TestIamGrpcStore_AdminBearerToken === RUN TestIamGrpcStore_AdminBearerToken/matching_key_succeeds === RUN TestIamGrpcStore_AdminBearerToken/wrong_key_unauthenticated === RUN TestIamGrpcStore_AdminBearerToken/no_key_unauthenticated --- PASS: TestIamGrpcStore_AdminBearerToken (0.45s) --- PASS: TestIamGrpcStore_AdminBearerToken/matching_key_succeeds (0.34s) --- PASS: TestIamGrpcStore_AdminBearerToken/wrong_key_unauthenticated (0.04s) --- PASS: TestIamGrpcStore_AdminBearerToken/no_key_unauthenticated (0.02s) === RUN TestIamGrpcStore_DeleteAccessKeyNotFound --- PASS: TestIamGrpcStore_DeleteAccessKeyNotFound (0.09s) PASS ok github.com/seaweedfs/seaweedfs/weed/credential/grpc 4.888s === RUN TestMemoryStore --- PASS: TestMemoryStore (0.03s) === RUN TestMemoryStoreConcurrency --- PASS: TestMemoryStoreConcurrency (0.01s) === RUN TestMemoryStoreReset --- PASS: TestMemoryStoreReset (0.01s) === RUN TestMemoryStoreConfigurationSaveLoad --- PASS: TestMemoryStoreConfigurationSaveLoad (0.01s) === RUN TestMemoryStoreServiceAccountByAccessKey --- PASS: TestMemoryStoreServiceAccountByAccessKey (0.00s) === RUN TestMemoryStoreUpdateUserRename --- PASS: TestMemoryStoreUpdateUserRename (0.00s) === RUN TestMemoryStoreUpdateUserRenameCollision --- PASS: TestMemoryStoreUpdateUserRenameCollision (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/credential/memory 2.350s ? github.com/seaweedfs/seaweedfs/weed/credential/postgres [no test files] === RUN TestInlinePolicyOperations --- PASS: TestInlinePolicyOperations (0.01s) === RUN TestMemoryRenameUserMovesIdentityAndPolicies --- PASS: TestMemoryRenameUserMovesIdentityAndPolicies (0.02s) === RUN TestStoreRegistration integration_test.go:40: Available stores: [memory postgres filer_etc] --- PASS: TestStoreRegistration (0.01s) === RUN TestMemoryStoreIntegration --- PASS: TestMemoryStoreIntegration (0.01s) === RUN TestPolicyManagement --- PASS: TestPolicyManagement (0.00s) === RUN TestPolicyManagementWithFilerEtc policy_test.go:140: Filer connection required for filer_etc store testing --- SKIP: TestPolicyManagementWithFilerEtc (0.00s) === RUN TestPolicyManagementWithPostgres policy_test.go:146: PostgreSQL connection required for postgres store testing --- SKIP: TestPolicyManagementWithPostgres (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/credential/test 2.225s === RUN TestEcBalanceMigratesCrossDiskTypeShards dn1 moves ec shard 1.0 to dn2 dn1 moves ec shard 1.1 to dn3 dn1 moves ec shard 1.2 to dn2 dn1 moves ec shard 1.3 to dn3 dn1 moves ec shard 1.4 to dn2 dn1 moves ec shard 1.5 to dn3 dn1 moves ec shard 1.10 to dn2 dn1 moves ec shard 1.11 to dn3 dn1 moves ec shard 1.12 to dn2 --- PASS: TestEcBalanceMigratesCrossDiskTypeShards (0.04s) === RUN TestEcBalanceReplanAfterNoSpaceLeft 127.0.0.1:1.40277 moves ec shard 1.0 to 127.0.0.1:1.36985 copy 1.[0] 127.0.0.1:1 => 127.0.0.1:1 ec.balance: [127.0.0.1:1.36985] reported no space left; re-collecting topology and re-planning without them as targets 127.0.0.1:1.40277 moves ec shard 1.0 to 127.0.0.1:1.44197 copy 1.[0] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[0] on 127.0.0.1:1 unmount 1.[0] from 127.0.0.1:1 delete 1.[0] from 127.0.0.1:1 127.0.0.1:1.40277 moves ec shard 1.1 to 127.0.0.1:1.44197 copy 1.[1] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[1] on 127.0.0.1:1 unmount 1.[1] from 127.0.0.1:1 delete 1.[1] from 127.0.0.1:1 127.0.0.1:1.40277 moves ec shard 1.2 to 127.0.0.1:1.44197 copy 1.[2] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[2] on 127.0.0.1:1 unmount 1.[2] from 127.0.0.1:1 delete 1.[2] from 127.0.0.1:1 127.0.0.1:1.40277 moves ec shard 1.3 to 127.0.0.1:1.44197 copy 1.[3] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[3] on 127.0.0.1:1 unmount 1.[3] from 127.0.0.1:1 delete 1.[3] from 127.0.0.1:1 127.0.0.1:1.40277 moves ec shard 1.10 to 127.0.0.1:1.44197 copy 1.[10] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[10] on 127.0.0.1:1 unmount 1.[10] from 127.0.0.1:1 delete 1.[10] from 127.0.0.1:1 127.0.0.1:1.40277 moves ec shard 1.11 to 127.0.0.1:1.44197 copy 1.[11] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[11] on 127.0.0.1:1 unmount 1.[11] from 127.0.0.1:1 delete 1.[11] from 127.0.0.1:1 --- PASS: TestEcBalanceReplanAfterNoSpaceLeft (0.93s) === RUN TestEcBalanceReplanAfterNoSpaceLeftStaleSnapshot 127.0.0.1:1.45313 moves ec shard 1.0 to 127.0.0.1:1.35367 copy 1.[0] 127.0.0.1:1 => 127.0.0.1:1 ec.balance: [127.0.0.1:1.35367] reported no space left; re-collecting topology and re-planning without them as targets 127.0.0.1:1.45313 moves ec shard 1.0 to 127.0.0.1:1.40573 copy 1.[0] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[0] on 127.0.0.1:1 unmount 1.[0] from 127.0.0.1:1 delete 1.[0] from 127.0.0.1:1 127.0.0.1:1.45313 moves ec shard 1.1 to 127.0.0.1:1.40573 copy 1.[1] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[1] on 127.0.0.1:1 unmount 1.[1] from 127.0.0.1:1 delete 1.[1] from 127.0.0.1:1 127.0.0.1:1.45313 moves ec shard 1.2 to 127.0.0.1:1.40573 copy 1.[2] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[2] on 127.0.0.1:1 unmount 1.[2] from 127.0.0.1:1 delete 1.[2] from 127.0.0.1:1 127.0.0.1:1.45313 moves ec shard 1.3 to 127.0.0.1:1.40573 copy 1.[3] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[3] on 127.0.0.1:1 unmount 1.[3] from 127.0.0.1:1 delete 1.[3] from 127.0.0.1:1 127.0.0.1:1.45313 moves ec shard 1.10 to 127.0.0.1:1.40573 copy 1.[10] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[10] on 127.0.0.1:1 unmount 1.[10] from 127.0.0.1:1 delete 1.[10] from 127.0.0.1:1 127.0.0.1:1.45313 moves ec shard 1.11 to 127.0.0.1:1.40573 copy 1.[11] 127.0.0.1:1 => 127.0.0.1:1 mount 1.[11] on 127.0.0.1:1 unmount 1.[11] from 127.0.0.1:1 delete 1.[11] from 127.0.0.1:1 --- PASS: TestEcBalanceReplanAfterNoSpaceLeftStaleSnapshot (0.33s) === RUN TestEcBalanceNoReceivingTargetFails 127.0.0.1:1.41195 moves ec shard 1.0 to 127.0.0.1:1.46813 copy 1.[0] 127.0.0.1:1 => 127.0.0.1:1 ec.balance: [127.0.0.1:1.46813] reported no space left; re-collecting topology and re-planning without them as targets --- PASS: TestEcBalanceNoReceivingTargetFails (0.06s) === RUN TestApplyCompletedMovesReplaysDiskState --- PASS: TestApplyCompletedMovesReplaysDiskState (0.00s) === RUN TestRunMovesSpreadsConcurrentCopiesOverTargets --- PASS: TestRunMovesSpreadsConcurrentCopiesOverTargets (0.16s) === RUN TestRunMovesKeepsPlanOrderWithoutParallelism --- PASS: TestRunMovesKeepsPlanOrderWithoutParallelism (0.29s) === RUN TestRunMovesKeepsOrderOfMovesOfOneShard --- PASS: TestRunMovesKeepsOrderOfMovesOfOneShard (0.01s) === RUN TestRunMovesStopsOnlyTheFailedVolume --- PASS: TestRunMovesStopsOnlyTheFailedVolume (0.00s) === RUN TestRunMovesLetsAMoveIntoANodeWaitForTheMoveLeavingIt --- PASS: TestRunMovesLetsAMoveIntoANodeWaitForTheMoveLeavingIt (0.01s) === RUN TestRunMovesJoinsTheErrorsOfEveryFailedVolume --- PASS: TestRunMovesJoinsTheErrorsOfEveryFailedVolume (0.00s) === RUN TestEcCheckReplication --- PASS: TestEcCheckReplication (0.02s) === RUN TestEcCheckReplicationNoVolumes === RUN TestEcCheckReplicationNoVolumes/unfiltered === RUN TestEcCheckReplicationNoVolumes/filtered_no_match --- PASS: TestEcCheckReplicationNoVolumes (0.01s) --- PASS: TestEcCheckReplicationNoVolumes/unfiltered (0.00s) --- PASS: TestEcCheckReplicationNoVolumes/filtered_no_match (0.00s) === RUN TestEcCheckReplicationUnexpectedShard --- PASS: TestEcCheckReplicationUnexpectedShard (0.00s) === RUN TestEcCheckReplicationMixedAnomalies --- PASS: TestEcCheckReplicationMixedAnomalies (0.00s) === RUN TestPickBestDiskOnNodeSelectsPhysicalDiskZero --- PASS: TestPickBestDiskOnNodeSelectsPhysicalDiskZero (0.00s) === RUN TestCommandEcBalanceSmall dn1 moves ec shard 1.0 to dn2 dn1 moves ec shard 1.1 to dn2 dn1 moves ec shard 1.2 to dn2 dn1 moves ec shard 1.3 to dn2 dn1 moves ec shard 1.4 to dn2 dn1 moves ec shard 1.10 to dn2 dn1 moves ec shard 1.11 to dn2 dn2 moves ec shard 2.0 to dn1 dn2 moves ec shard 2.1 to dn1 dn2 moves ec shard 2.2 to dn1 dn2 moves ec shard 2.3 to dn1 dn2 moves ec shard 2.4 to dn1 dn2 moves ec shard 2.10 to dn1 dn2 moves ec shard 2.11 to dn1 --- PASS: TestCommandEcBalanceSmall (0.01s) === RUN TestCommandEcBalanceNothingToMove dn1 moves ec shard 1.0 to dn2 dn1 moves ec shard 1.1 to dn2 dn2 moves ec shard 1.10 to dn1 dn2 moves ec shard 1.11 to dn1 dn2 moves ec shard 2.0 to dn1 dn2 moves ec shard 2.1 to dn1 dn1 moves ec shard 2.10 to dn2 dn1 moves ec shard 2.11 to dn2 --- PASS: TestCommandEcBalanceNothingToMove (0.01s) === RUN TestCommandEcBalanceAddNewServers dn1 moves ec shard 1.0 to dn3 dn1 moves ec shard 1.1 to dn4 dn1 moves ec shard 1.2 to dn3 dn1 moves ec shard 1.3 to dn4 dn2 moves ec shard 1.10 to dn3 dn2 moves ec shard 1.11 to dn4 dn2 moves ec shard 1.12 to dn1 dn2 moves ec shard 2.0 to dn3 dn2 moves ec shard 2.1 to dn4 dn2 moves ec shard 2.2 to dn3 dn2 moves ec shard 2.3 to dn4 dn1 moves ec shard 2.10 to dn3 dn1 moves ec shard 2.11 to dn4 dn1 moves ec shard 2.12 to dn2 dn1 moves ec shard 1.4 to dn3 dn2 moves ec shard 1.7 to dn4 --- PASS: TestCommandEcBalanceAddNewServers (0.01s) === RUN TestCommandEcBalanceAddNewRacks dn1 moves ec shard 1.0 to dn3 dn1 moves ec shard 1.1 to dn4 dn1 moves ec shard 1.2 to dn3 dn1 moves ec shard 1.3 to dn4 dn1 moves ec shard 1.4 to dn3 dn2 moves ec shard 1.10 to dn4 dn2 moves ec shard 1.11 to dn3 dn2 moves ec shard 2.0 to dn4 dn2 moves ec shard 2.1 to dn3 dn2 moves ec shard 2.2 to dn4 dn2 moves ec shard 2.3 to dn3 dn2 moves ec shard 2.4 to dn4 dn1 moves ec shard 2.10 to dn3 dn1 moves ec shard 2.11 to dn4 dn2 moves ec shard 1.12 to dn1 dn1 moves ec shard 2.12 to dn2 --- PASS: TestCommandEcBalanceAddNewRacks (0.01s) === RUN TestCommandEcBalanceVolumeEvenButRackUneven dn_shared moves ec shard 1.0 to dn3 --- PASS: TestCommandEcBalanceVolumeEvenButRackUneven (0.02s) === RUN TestCommandEcBalanceEvenDataAndParityDistribution dn1 moves ec shard 1.0 to dn2 dn1 moves ec shard 1.1 to dn3 dn1 moves ec shard 1.2 to dn4 dn1 moves ec shard 1.3 to dn5 dn1 moves ec shard 1.4 to dn6 dn1 moves ec shard 1.5 to dn2 dn1 moves ec shard 1.6 to dn3 dn1 moves ec shard 1.7 to dn4 dn1 moves ec shard 1.10 to dn5 dn1 moves ec shard 1.11 to dn6 dn1 moves ec shard 1.12 to dn2 ec_common_test.go:239: Distribution after balancing: ec_common_test.go:240: Data shards per rack: map[rack1:2 rack2:2 rack3:2 rack4:2 rack5:1 rack6:1] (max allowed: 2) ec_common_test.go:241: Parity shards per rack: map[rack1:1 rack2:1 rack5:1 rack6:1] (max allowed: 1) --- PASS: TestCommandEcBalanceEvenDataAndParityDistribution (0.02s) === RUN TestCommandEcBalanceMultipleVolumesEvenDistribution dn1 moves ec shard 1.0 to dn3 dn1 moves ec shard 1.1 to dn4 dn1 moves ec shard 1.2 to dn5 dn1 moves ec shard 1.3 to dn6 dn1 moves ec shard 1.4 to dn2 dn1 moves ec shard 1.5 to dn3 dn1 moves ec shard 1.6 to dn4 dn1 moves ec shard 1.7 to dn5 dn1 moves ec shard 1.10 to dn6 dn1 moves ec shard 1.11 to dn3 dn1 moves ec shard 1.12 to dn4 dn2 moves ec shard 2.0 to dn5 dn2 moves ec shard 2.1 to dn6 dn2 moves ec shard 2.2 to dn1 dn2 moves ec shard 2.3 to dn3 dn2 moves ec shard 2.4 to dn4 dn2 moves ec shard 2.5 to dn5 dn2 moves ec shard 2.6 to dn6 dn2 moves ec shard 2.7 to dn1 dn2 moves ec shard 2.10 to dn3 dn2 moves ec shard 2.11 to dn4 dn2 moves ec shard 2.12 to dn5 ec_common_test.go:303: Volume 1 - Data: map[rack1:2 rack2:1 rack3:2 rack4:2 rack5:2 rack6:1], Parity: map[rack1:1 rack3:1 rack4:1 rack6:1] ec_common_test.go:303: Volume 2 - Data: map[rack1:2 rack2:2 rack3:1 rack4:1 rack5:2 rack6:2], Parity: map[rack2:1 rack3:1 rack4:1 rack5:1] --- PASS: TestCommandEcBalanceMultipleVolumesEvenDistribution (0.02s) === RUN TestCommandEcBalanceAllNodesShareAllVolumes dn1 moves ec shard 1.0 to dn4 dn1 moves ec shard 1.1 to dn3 dn2 moves ec shard 1.5 to dn4 dn2 moves ec shard 1.6 to dn3 dn3 moves ec shard 1.10 to dn1 dn3 moves ec shard 1.11 to dn2 dn1 moves ec shard 2.0 to dn4 dn1 moves ec shard 2.1 to dn3 dn2 moves ec shard 2.5 to dn4 dn2 moves ec shard 2.6 to dn3 dn3 moves ec shard 2.10 to dn1 dn3 moves ec shard 2.11 to dn2 dn1 moves ec shard 1.2 to dn3 dn2 moves ec shard 1.7 to dn4 ec_common_test.go:351: node dn1: 7 shards ec_common_test.go:351: node dn2: 7 shards ec_common_test.go:351: node dn3: 7 shards ec_common_test.go:351: node dn4: 7 shards --- PASS: TestCommandEcBalanceAllNodesShareAllVolumes (0.01s) === RUN TestCommandEcBalanceIssue8793Topology ec_common_test.go:417: BEFORE node 192.168.0.12:8332 (max 80): 36 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8333 (max 80): 36 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8334 (max 80): 36 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8335 (max 80): 36 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8336 (max 80): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8337 (max 80): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8338 (max 80): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8339 (max 80): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8340 (max 80): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8341 (max 33): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8342 (max 33): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.12:8343 (max 33): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.25:8350 (max 33): 22 shards ec_common_test.go:417: BEFORE node 192.168.0.25:8351 (max 33): 22 shards 192.168.0.12:8332 moves ec shard 23.0 to 192.168.0.12:8336 192.168.0.12:8332 moves ec shard 23.1 to 192.168.0.12:8337 192.168.0.12:8332 moves ec shard 23.2 to 192.168.0.12:8338 192.168.0.12:8332 moves ec shard 23.3 to 192.168.0.12:8339 192.168.0.12:8332 moves ec shard 23.4 to 192.168.0.12:8340 192.168.0.12:8332 moves ec shard 23.5 to 192.168.0.12:8333 192.168.0.12:8332 moves ec shard 23.6 to 192.168.0.12:8334 192.168.0.12:8332 moves ec shard 23.7 to 192.168.0.12:8335 192.168.0.12:8332 moves ec shard 23.8 to 192.168.0.12:8341 192.168.0.12:8332 moves ec shard 23.10 to 192.168.0.12:8342 192.168.0.12:8332 moves ec shard 23.11 to 192.168.0.12:8343 192.168.0.12:8332 moves ec shard 23.12 to 192.168.0.25:8350 192.168.0.12:8333 moves ec shard 24.0 to 192.168.0.12:8336 192.168.0.12:8333 moves ec shard 24.1 to 192.168.0.12:8337 192.168.0.12:8333 moves ec shard 24.2 to 192.168.0.12:8338 192.168.0.12:8333 moves ec shard 24.3 to 192.168.0.12:8339 192.168.0.12:8333 moves ec shard 24.4 to 192.168.0.12:8340 192.168.0.12:8333 moves ec shard 24.5 to 192.168.0.12:8332 192.168.0.12:8333 moves ec shard 24.6 to 192.168.0.12:8334 192.168.0.12:8333 moves ec shard 24.7 to 192.168.0.12:8335 192.168.0.12:8333 moves ec shard 24.8 to 192.168.0.25:8351 192.168.0.12:8333 moves ec shard 24.10 to 192.168.0.12:8341 192.168.0.12:8333 moves ec shard 24.11 to 192.168.0.12:8342 192.168.0.12:8333 moves ec shard 24.12 to 192.168.0.12:8343 192.168.0.12:8334 moves ec shard 25.0 to 192.168.0.12:8336 192.168.0.12:8334 moves ec shard 25.1 to 192.168.0.12:8337 192.168.0.12:8334 moves ec shard 25.2 to 192.168.0.12:8338 192.168.0.12:8334 moves ec shard 25.3 to 192.168.0.12:8339 192.168.0.12:8334 moves ec shard 25.4 to 192.168.0.12:8340 192.168.0.12:8334 moves ec shard 25.5 to 192.168.0.12:8332 192.168.0.12:8334 moves ec shard 25.6 to 192.168.0.12:8333 192.168.0.12:8334 moves ec shard 25.7 to 192.168.0.12:8335 192.168.0.12:8334 moves ec shard 25.8 to 192.168.0.25:8350 192.168.0.12:8334 moves ec shard 25.10 to 192.168.0.25:8351 192.168.0.12:8334 moves ec shard 25.11 to 192.168.0.12:8341 192.168.0.12:8334 moves ec shard 25.12 to 192.168.0.12:8342 192.168.0.12:8335 moves ec shard 26.0 to 192.168.0.12:8336 192.168.0.12:8335 moves ec shard 26.1 to 192.168.0.12:8337 192.168.0.12:8335 moves ec shard 26.2 to 192.168.0.12:8338 192.168.0.12:8335 moves ec shard 26.3 to 192.168.0.12:8339 192.168.0.12:8335 moves ec shard 26.4 to 192.168.0.12:8340 192.168.0.12:8335 moves ec shard 26.5 to 192.168.0.12:8332 192.168.0.12:8335 moves ec shard 26.6 to 192.168.0.12:8333 192.168.0.12:8335 moves ec shard 26.7 to 192.168.0.12:8334 192.168.0.12:8335 moves ec shard 26.8 to 192.168.0.12:8343 192.168.0.12:8335 moves ec shard 26.10 to 192.168.0.25:8350 192.168.0.12:8335 moves ec shard 26.11 to 192.168.0.25:8351 192.168.0.12:8335 moves ec shard 26.12 to 192.168.0.12:8341 192.168.0.25:8350 moves ec shard 1.12 to 192.168.0.12:8336 192.168.0.12:8341 moves ec shard 1.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 1.9 to 192.168.0.12:8337 192.168.0.25:8351 moves ec shard 1.13 to 192.168.0.12:8338 192.168.0.25:8350 moves ec shard 2.12 to 192.168.0.12:8339 192.168.0.12:8341 moves ec shard 2.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 2.9 to 192.168.0.12:8340 192.168.0.12:8342 moves ec shard 1.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 1.10 to 192.168.0.12:8332 192.168.0.12:8343 moves ec shard 1.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 1.11 to 192.168.0.12:8333 192.168.0.25:8351 moves ec shard 2.13 to 192.168.0.12:8334 192.168.0.25:8350 moves ec shard 3.12 to 192.168.0.12:8335 192.168.0.12:8341 moves ec shard 3.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 3.9 to 192.168.0.12:8336 192.168.0.12:8342 moves ec shard 2.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 2.10 to 192.168.0.12:8337 192.168.0.12:8343 moves ec shard 2.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 2.11 to 192.168.0.12:8338 192.168.0.25:8351 moves ec shard 3.13 to 192.168.0.12:8339 192.168.0.25:8350 moves ec shard 4.12 to 192.168.0.12:8340 192.168.0.12:8341 moves ec shard 4.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 4.9 to 192.168.0.12:8332 192.168.0.12:8342 moves ec shard 3.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 3.10 to 192.168.0.12:8333 192.168.0.12:8343 moves ec shard 3.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 3.11 to 192.168.0.12:8334 192.168.0.25:8351 moves ec shard 4.13 to 192.168.0.12:8335 192.168.0.25:8350 moves ec shard 5.12 to 192.168.0.12:8336 192.168.0.12:8341 moves ec shard 5.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 5.9 to 192.168.0.12:8337 192.168.0.12:8342 moves ec shard 4.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 4.10 to 192.168.0.12:8338 192.168.0.12:8343 moves ec shard 4.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 4.11 to 192.168.0.12:8339 192.168.0.25:8351 moves ec shard 5.13 to 192.168.0.12:8340 192.168.0.25:8350 moves ec shard 6.12 to 192.168.0.12:8332 192.168.0.12:8341 moves ec shard 6.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 6.9 to 192.168.0.12:8333 192.168.0.12:8342 moves ec shard 5.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 5.10 to 192.168.0.12:8334 192.168.0.12:8343 moves ec shard 5.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 5.11 to 192.168.0.12:8335 192.168.0.25:8351 moves ec shard 6.13 to 192.168.0.12:8336 192.168.0.25:8350 moves ec shard 7.12 to 192.168.0.12:8337 192.168.0.12:8341 moves ec shard 7.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 7.9 to 192.168.0.12:8338 192.168.0.12:8342 moves ec shard 6.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 6.10 to 192.168.0.12:8339 192.168.0.12:8343 moves ec shard 6.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 6.11 to 192.168.0.12:8340 192.168.0.25:8351 moves ec shard 7.13 to 192.168.0.12:8332 192.168.0.25:8350 moves ec shard 8.12 to 192.168.0.12:8333 192.168.0.12:8341 moves ec shard 8.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 8.9 to 192.168.0.12:8334 192.168.0.12:8342 moves ec shard 7.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 7.10 to 192.168.0.12:8335 192.168.0.12:8343 moves ec shard 7.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 7.11 to 192.168.0.12:8336 192.168.0.25:8351 moves ec shard 8.13 to 192.168.0.12:8337 192.168.0.25:8350 moves ec shard 9.12 to 192.168.0.12:8338 192.168.0.12:8341 moves ec shard 9.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 9.9 to 192.168.0.12:8339 192.168.0.12:8342 moves ec shard 8.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 8.10 to 192.168.0.12:8340 192.168.0.12:8343 moves ec shard 8.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 8.11 to 192.168.0.12:8332 192.168.0.25:8351 moves ec shard 9.13 to 192.168.0.12:8333 192.168.0.25:8350 moves ec shard 10.12 to 192.168.0.12:8334 192.168.0.12:8341 moves ec shard 10.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 10.9 to 192.168.0.12:8335 192.168.0.12:8342 moves ec shard 9.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 9.10 to 192.168.0.12:8336 192.168.0.12:8343 moves ec shard 9.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 9.11 to 192.168.0.12:8337 192.168.0.25:8351 moves ec shard 10.13 to 192.168.0.12:8338 192.168.0.25:8350 moves ec shard 11.12 to 192.168.0.12:8339 192.168.0.12:8341 moves ec shard 11.9 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 11.9 to 192.168.0.12:8340 192.168.0.12:8342 moves ec shard 10.10 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 10.10 to 192.168.0.12:8332 192.168.0.12:8343 moves ec shard 10.11 to 192.168.0.25:8350 192.168.0.25:8350 moves ec shard 10.11 to 192.168.0.12:8333 192.168.0.25:8351 moves ec shard 11.13 to 192.168.0.12:8334 ec_common_test.go:454: AFTER node 192.168.0.12:8332: 33/80 shards (41% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8333: 33/80 shards (41% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8334: 33/80 shards (41% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8335: 32/80 shards (40% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8336: 32/80 shards (40% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8337: 32/80 shards (40% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8338: 32/80 shards (40% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8339: 32/80 shards (40% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8340: 32/80 shards (40% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8341: 15/33 shards (45% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8342: 15/33 shards (45% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.12:8343: 15/33 shards (45% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.25:8350: 14/33 shards (42% full, overall 41%) ec_common_test.go:454: AFTER node 192.168.0.25:8351: 14/33 shards (42% full, overall 41%) --- PASS: TestCommandEcBalanceIssue8793Topology (1.89s) === RUN TestCommandEcBalanceVolumeIdsFilter balancing ec volume(s) [1] planned 11 ec shard move(s) and 0 ec shard deletion(s) dn1 moves ec shard 1.0 to dn4 dn1 moves ec shard 1.1 to dn5 dn1 moves ec shard 1.2 to dn6 dn1 moves ec shard 1.3 to dn3 dn1 moves ec shard 1.4 to dn2 dn1 moves ec shard 1.5 to dn4 dn1 moves ec shard 1.6 to dn5 dn1 moves ec shard 1.7 to dn6 dn1 moves ec shard 1.10 to dn3 dn1 moves ec shard 1.11 to dn4 dn1 moves ec shard 1.12 to dn5 --- PASS: TestCommandEcBalanceVolumeIdsFilter (0.01s) === RUN TestCommandEcBalanceVolumeIdsNotFound --- PASS: TestCommandEcBalanceVolumeIdsNotFound (0.00s) === RUN TestMissingDataShard === RUN TestMissingDataShard/complete_set_on_one_holder_decodes,_so_nothing_is_finished === RUN TestMissingDataShard/complete_set_spread_across_holders_is_still_complete === RUN TestMissingDataShard/parity_gone_is_not_the_deletion_phase:_the_volume_still_decodes === RUN TestMissingDataShard/a_data_shard_gone_is_a_decode_that_was_interrupted_mid-cleanup === RUN TestMissingDataShard/the_first_gap_is_reported,_not_the_last === RUN TestMissingDataShard/no_holders_at_all_leaves_every_data_shard_missing --- PASS: TestMissingDataShard (0.01s) --- PASS: TestMissingDataShard/complete_set_on_one_holder_decodes,_so_nothing_is_finished (0.00s) --- PASS: TestMissingDataShard/complete_set_spread_across_holders_is_still_complete (0.00s) --- PASS: TestMissingDataShard/parity_gone_is_not_the_deletion_phase:_the_volume_still_decodes (0.00s) --- PASS: TestMissingDataShard/a_data_shard_gone_is_a_decode_that_was_interrupted_mid-cleanup (0.00s) --- PASS: TestMissingDataShard/the_first_gap_is_reported,_not_the_last (0.00s) --- PASS: TestMissingDataShard/no_holders_at_all_leaves_every_data_shard_missing (0.00s) === RUN TestFindEcVolumeCollection === RUN TestFindEcVolumeCollection/nil_topology === RUN TestFindEcVolumeCollection/ec_volume_with_named_collection === RUN TestFindEcVolumeCollection/ec_volume_with_empty_collection === RUN TestFindEcVolumeCollection/regular_volume_record_is_not_an_ec_volume === RUN TestFindEcVolumeCollection/not_found --- PASS: TestFindEcVolumeCollection (0.01s) --- PASS: TestFindEcVolumeCollection/nil_topology (0.00s) --- PASS: TestFindEcVolumeCollection/ec_volume_with_named_collection (0.00s) --- PASS: TestFindEcVolumeCollection/ec_volume_with_empty_collection (0.00s) --- PASS: TestFindEcVolumeCollection/regular_volume_record_is_not_an_ec_volume (0.00s) --- PASS: TestFindEcVolumeCollection/not_found (0.00s) === RUN TestAssertEncodableRegularVolumes === RUN TestAssertEncodableRegularVolumes/regular_volume === RUN TestAssertEncodableRegularVolumes/already_EC === RUN TestAssertEncodableRegularVolumes/regular_plus_stale_orphan_shards === RUN TestAssertEncodableRegularVolumes/unknown_id --- PASS: TestAssertEncodableRegularVolumes (0.01s) --- PASS: TestAssertEncodableRegularVolumes/regular_volume (0.00s) --- PASS: TestAssertEncodableRegularVolumes/already_EC (0.00s) --- PASS: TestAssertEncodableRegularVolumes/regular_plus_stale_orphan_shards (0.00s) --- PASS: TestAssertEncodableRegularVolumes/unknown_id (0.00s) === RUN TestPrepareDataToRecover_DryRunRecoverableNoSideEffects --- PASS: TestPrepareDataToRecover_DryRunRecoverableNoSideEffects (0.00s) === RUN TestPrepareDataToRecover_UnionsLocalShardsAcrossDisks --- PASS: TestPrepareDataToRecover_UnionsLocalShardsAcrossDisks (0.00s) === RUN TestCountLocalShards_UnionsAcrossDisks --- PASS: TestCountLocalShards_UnionsAcrossDisks (0.00s) === RUN TestPrepareDataToRecover_SelfSourceNotCopied --- PASS: TestPrepareDataToRecover_SelfSourceNotCopied (0.00s) === RUN TestPrepareDataToRecover_ApplyCopyFailureDoesNotCountAsRecoverable --- PASS: TestPrepareDataToRecover_ApplyCopyFailureDoesNotCountAsRecoverable (0.03s) === RUN TestRequireUniformShardSizes === RUN TestRequireUniformShardSizes/one_holder,_all_shards_the_same_length === RUN TestRequireUniformShardSizes/spread_across_holders,_still_one_length === RUN TestRequireUniformShardSizes/a_truncated_shard_is_named_with_its_holder === RUN TestRequireUniformShardSizes/two_copies_of_one_shard_that_disagree_are_still_a_disagreement === RUN TestRequireUniformShardSizes/unreported_sizes_are_skipped,_not_read_as_a_disagreement === RUN TestRequireUniformShardSizes/nothing_reported_at_all_verifies_vacuously === RUN TestRequireUniformShardSizes/no_holders_is_not_a_size_problem === RUN TestRequireUniformShardSizes/a_nil_inventory_is_skipped_rather_than_panicking --- PASS: TestRequireUniformShardSizes (0.02s) --- PASS: TestRequireUniformShardSizes/one_holder,_all_shards_the_same_length (0.00s) --- PASS: TestRequireUniformShardSizes/spread_across_holders,_still_one_length (0.00s) --- PASS: TestRequireUniformShardSizes/a_truncated_shard_is_named_with_its_holder (0.00s) --- PASS: TestRequireUniformShardSizes/two_copies_of_one_shard_that_disagree_are_still_a_disagreement (0.00s) --- PASS: TestRequireUniformShardSizes/unreported_sizes_are_skipped,_not_read_as_a_disagreement (0.00s) --- PASS: TestRequireUniformShardSizes/nothing_reported_at_all_verifies_vacuously (0.00s) --- PASS: TestRequireUniformShardSizes/no_holders_is_not_a_size_problem (0.00s) --- PASS: TestRequireUniformShardSizes/a_nil_inventory_is_skipped_rather_than_panicking (0.00s) === RUN TestShardSizeCheckIgnoresOlderEncodeGenerations --- PASS: TestShardSizeCheckIgnoresOlderEncodeGenerations (0.00s) === RUN TestShardSizeCheckStillCatchesShortShardInNewestGeneration --- PASS: TestShardSizeCheckStillCatchesShortShardInNewestGeneration (0.00s) === RUN TestShardSizeCheckHandlesUnstampedGenerations --- PASS: TestShardSizeCheckHandlesUnstampedGenerations (0.01s) === RUN TestSelectVolumeIdsFromTopology skip volume 1 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 2 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 3 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 4 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 5 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 6 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 7 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 8 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 9 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) I1117 09:36:53.929902 ec_encode.go:1074 replica test 10 on seaweedfs-volume-0.seaweedfs-volume.sea:8080 has no free disk skip replica of volume 10 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: insufficient free disk space (free volumes: 1, required: 2) I1117 09:36:53.976677 ec_encode.go:1074 replica test 11 on seaweedfs-volume-0.seaweedfs-volume.sea:8080 has no free disk skip replica of volume 11 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: insufficient free disk space (free volumes: 1, required: 2) I1117 09:36:53.988656 ec_encode.go:1074 replica test 12 on seaweedfs-volume-0.seaweedfs-volume.sea:8080 has no free disk skip replica of volume 12 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: insufficient free disk space (free volumes: 1, required: 2) skip volume 13 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 544.0 MB, threshold: 950.0 MB, 54.4% full) skip volume 14 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 456.0 MB, threshold: 950.0 MB, 45.6% full) skip volume 1 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 2 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 3 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 4 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 5 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 6 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 7 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 8 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 9 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) I1117 09:36:53.996295 ec_encode.go:1074 replica test 10 on seaweedfs-volume-1.seaweedfs-volume.sea:8080 has no free disk skip replica of volume 10 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: insufficient free disk space (free volumes: 1, required: 2) I1117 09:36:53.997423 ec_encode.go:1074 replica test 11 on seaweedfs-volume-1.seaweedfs-volume.sea:8080 has no free disk skip replica of volume 11 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: insufficient free disk space (free volumes: 1, required: 2) I1117 09:36:53.997919 ec_encode.go:1074 replica test 12 on seaweedfs-volume-1.seaweedfs-volume.sea:8080 has no free disk skip replica of volume 12 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: insufficient free disk space (free volumes: 1, required: 2) skip volume 13 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 544.0 MB, threshold: 950.0 MB, 54.4% full) skip volume 14 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 456.0 MB, threshold: 950.0 MB, 45.6% full) Volume selection summary: Total volumes examined: 28 Selected for encoding: 0 Collections matched: [ encrypt-data test] Reasons for exclusion: Too small (< 95.0% full): 22 Insufficient free disk space: 3 skip volume 1 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 2 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 3 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 4 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 5 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 6 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 7 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 8 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 9 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) selected volume 10 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: size 1000.0 MB (100.0% full), last modified 5025 seconds ago, free volumes: 2 selected volume 11 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: size 1000.0 MB (100.0% full), last modified 4966 seconds ago, free volumes: 2 selected volume 12 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: size 1000.0 MB (100.0% full), last modified 4933 seconds ago, free volumes: 2 skip volume 13 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 544.0 MB, threshold: 950.0 MB, 54.4% full) skip volume 14 on seaweedfs-volume-0.seaweedfs-volume.sea:8080: too small (size: 456.0 MB, threshold: 950.0 MB, 45.6% full) skip volume 1 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 2 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 3 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 4 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 5 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 6 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.1 MB, threshold: 950.0 MB, 0.0% full) skip volume 7 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 8 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) skip volume 9 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 0.0 MB, threshold: 950.0 MB, 0.0% full) selected volume 10 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: size 1000.0 MB (100.0% full), last modified 5025 seconds ago, free volumes: 2 selected volume 11 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: size 1000.0 MB (100.0% full), last modified 4966 seconds ago, free volumes: 2 selected volume 12 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: size 1000.0 MB (100.0% full), last modified 4934 seconds ago, free volumes: 2 skip volume 13 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 544.0 MB, threshold: 950.0 MB, 54.4% full) skip volume 14 on seaweedfs-volume-1.seaweedfs-volume.sea:8080: too small (size: 456.0 MB, threshold: 950.0 MB, 45.6% full) Volume selection summary: Total volumes examined: 28 Selected for encoding: 3 Collections matched: [ encrypt-data test] Reasons for exclusion: Too small (< 95.0% full): 22 --- PASS: TestSelectVolumeIdsFromTopology (0.09s) === RUN TestEcEncodeNodeCountCheck --- PASS: TestEcEncodeNodeCountCheck (0.00s) === RUN TestChunkVolumeIds --- PASS: TestChunkVolumeIds (0.00s) === RUN TestCollectEcShardBitsByNode --- PASS: TestCollectEcShardBitsByNode (0.00s) === RUN TestCollectEcShardBitsByNode_MixedGenerations --- PASS: TestCollectEcShardBitsByNode_MixedGenerations (0.00s) === RUN TestEcShardsClumpedOnOneNode --- PASS: TestEcShardsClumpedOnOneNode (0.01s) === RUN TestEcShardCountIgnoresDiskTypeOfTheShards --- PASS: TestEcShardCountIgnoresDiskTypeOfTheShards (0.00s) === RUN TestEcShardSummaryNamesTheShardIds --- PASS: TestEcShardSummaryNamesTheShardIds (0.00s) === RUN TestCollectSourceFreeVolumeCountsRefundsClearedShards --- PASS: TestCollectSourceFreeVolumeCountsRefundsClearedShards (0.00s) === RUN TestEcShardPlacementViolations --- PASS: TestEcShardPlacementViolations (0.01s) === RUN TestVerifyEcShardsBeforeDeletePlacement I1117 09:36:54.063508 ec_encode.go:921 EC shard verification ok for volume 1: 14/14 shards present across 14 nodes I1117 09:36:54.065562 ec_encode.go:929 EC shard verification incomplete (attempt 1/2), waiting for shard locations to propagate: [] [] [volume 1: 14 shards on node n1:8080, over the requested 1 per node] --- PASS: TestVerifyEcShardsBeforeDeletePlacement (0.01s) === RUN TestCountFreeShardSlotsPhysicalDiskGate --- PASS: TestCountFreeShardSlotsPhysicalDiskGate (0.00s) === RUN TestParseVolumeIdsFlag --- PASS: TestParseVolumeIdsFlag (0.00s) === RUN TestECLifecycleModelExhaustive ec_lifecycle_model_test.go:519: explored 6923 schedules reaching 17 distinct quiescent states, all recoverable --- PASS: TestECLifecycleModelExhaustive (0.43s) === RUN TestRunEcShardMovesStopsOnFirstError --- PASS: TestRunEcShardMovesStopsOnFirstError (0.00s) === RUN TestRunEcShardMovesGoesOnAfterFailure --- PASS: TestRunEcShardMovesGoesOnAfterFailure (0.00s) === RUN TestRunEcShardMovesInParallel --- PASS: TestRunEcShardMovesInParallel (0.01s) === RUN TestRunEcShardMovesStopsWhenLockIsLost --- PASS: TestRunEcShardMovesStopsWhenLockIsLost (0.00s) === RUN TestRunEcShardMovesKeepsShardsOnTheTargetOutOfFailedMoves --- PASS: TestRunEcShardMovesKeepsShardsOnTheTargetOutOfFailedMoves (0.00s) === RUN TestECRebalanceWithLimitedSlots ec_rebalance_slots_test.go:38: Topology summary: ec_rebalance_slots_test.go:39: Number of EC nodes: 6 ec_rebalance_slots_test.go:40: Total free EC slots: 432 ec_rebalance_slots_test.go:50: Node 127.0.0.1:8080 (rack rack0): 28 shards, 52 free slots ec_rebalance_slots_test.go:50: Node 127.0.0.1:8081 (rack rack1): 28 shards, 52 free slots ec_rebalance_slots_test.go:50: Node 127.0.0.1:8082 (rack rack2): 14 shards, 76 free slots ec_rebalance_slots_test.go:50: Node 127.0.0.1:8083 (rack rack3): 28 shards, 52 free slots ec_rebalance_slots_test.go:50: Node 127.0.0.1:8084 (rack rack4): 0 shards, 100 free slots ec_rebalance_slots_test.go:50: Node 127.0.0.1:8085 (rack rack5): 0 shards, 100 free slots ec_rebalance_slots_test.go:63: Total EC shards: 98 ec_rebalance_slots_test.go:105: totalFreeEcSlots = 432, rebalance should be possible --- PASS: TestECRebalanceWithLimitedSlots (0.01s) === RUN TestECRebalanceZeroFreeSlots ec_rebalance_slots_test.go:120: Zero free slots scenario: ec_rebalance_slots_test.go:128: Node 127.0.0.1:8080: 28 shards, 0 free slots, volumeCount=10, max=10 ec_rebalance_slots_test.go:128: Node 127.0.0.1:8081: 28 shards, 0 free slots, volumeCount=10, max=10 ec_rebalance_slots_test.go:128: Node 127.0.0.1:8082: 14 shards, 0 free slots, volumeCount=10, max=10 ec_rebalance_slots_test.go:128: Node 127.0.0.1:8083: 28 shards, 0 free slots, volumeCount=10, max=10 ec_rebalance_slots_test.go:133: Total free slots: 0 ec_rebalance_slots_test.go:136: ec_rebalance_slots_test.go:137: SCENARIO REPRODUCED: totalFreeEcSlots = 0 ec_rebalance_slots_test.go:138: This would trigger: 'no free ec shard slots. only 0 left' --- PASS: TestECRebalanceZeroFreeSlots (0.01s) === RUN TestRebuildChecksumReplacesCorruptShardOfCompleteVolume rebuildEcVolumes for 1 collection(s) rebuildEcVolumes for "c1" rebuildOneEcVolume c1 1 mount 1.[3] on 127.0.0.1:1 delete 1.[0 1 2 4 5 6 7 8] from 127.0.0.1:1 --- PASS: TestRebuildChecksumReplacesCorruptShardOfCompleteVolume (0.14s) === RUN TestRebuildChecksumRegeneratesCorruptShardOnRebuilder rebuildEcVolumes for 1 collection(s) rebuildEcVolumes for "c1" rebuildOneEcVolume c1 1 mount 1.[11] on 127.0.0.1:1 delete 1.[0 1 2 3 4 5 6 7 8] from 127.0.0.1:1 --- PASS: TestRebuildChecksumRegeneratesCorruptShardOnRebuilder (0.08s) === RUN TestRebuildChecksumRemovesCorruptDuplicate rebuildEcVolumes for 1 collection(s) rebuildEcVolumes for "c1" --- PASS: TestRebuildChecksumRemovesCorruptDuplicate (0.04s) === RUN TestRebuildChecksumDryRun rebuildEcVolumes for 1 collection(s) rebuildEcVolumes for "c1" rebuildOneEcVolume c1 1 --- PASS: TestRebuildChecksumDryRun (0.03s) === RUN TestRebuildWithoutChecksumSkipsCompleteVolume rebuildEcVolumes for 1 collection(s) rebuildEcVolumes for "c1" --- PASS: TestRebuildWithoutChecksumSkipsCompleteVolume (0.02s) === RUN TestRebuildChecksumReportsDuplicateRemovalFailures === RUN TestRebuildChecksumReportsDuplicateRemovalFailures/unmount_fails rebuildEcVolumes for 1 collection(s) rebuildEcVolumes for "c1" === RUN TestRebuildChecksumReportsDuplicateRemovalFailures/lock_lost rebuildEcVolumes for 1 collection(s) rebuildEcVolumes for "c1" --- PASS: TestRebuildChecksumReportsDuplicateRemovalFailures (0.07s) --- PASS: TestRebuildChecksumReportsDuplicateRemovalFailures/unmount_fails (0.04s) --- PASS: TestRebuildChecksumReportsDuplicateRemovalFailures/lock_lost (0.03s) === RUN TestRebuildChecksumScrubFailureFailsRun rebuildEcVolumes for 1 collection(s) rebuildEcVolumes for "c1" rebuildOneEcVolume c1 1 mount 1.[3] on 127.0.0.1:1 delete 1.[0 1 2 4 5 6 7 8] from 127.0.0.1:1 --- PASS: TestRebuildChecksumScrubFailureFailsRun (0.07s) === RUN TestEcShardMapRegister --- PASS: TestEcShardMapRegister (0.00s) === RUN TestEcShardMapShardCount === RUN TestEcShardMapShardCount/all_shards === RUN TestEcShardMapShardCount/data_shards_only === RUN TestEcShardMapShardCount/parity_shards_only === RUN TestEcShardMapShardCount/missing_some_shards === RUN TestEcShardMapShardCount/single_shard === RUN TestEcShardMapShardCount/no_shards --- PASS: TestEcShardMapShardCount (0.01s) --- PASS: TestEcShardMapShardCount/all_shards (0.00s) --- PASS: TestEcShardMapShardCount/data_shards_only (0.00s) --- PASS: TestEcShardMapShardCount/parity_shards_only (0.00s) --- PASS: TestEcShardMapShardCount/missing_some_shards (0.00s) --- PASS: TestEcShardMapShardCount/single_shard (0.00s) --- PASS: TestEcShardMapShardCount/no_shards (0.00s) === RUN TestRebuildEcVolumesInsufficientShards rebuildEcVolumes for "c1" --- PASS: TestRebuildEcVolumesInsufficientShards (0.00s) === RUN TestRebuildEcVolumesCompleteVolume rebuildEcVolumes for "c1" --- PASS: TestRebuildEcVolumesCompleteVolume (0.00s) === RUN TestRebuildEcVolumesInsufficientSpace rebuildEcVolumes for "c1" --- PASS: TestRebuildEcVolumesInsufficientSpace (0.00s) === RUN TestMultipleNodesWithShards --- PASS: TestMultipleNodesWithShards (0.00s) === RUN TestDuplicateShards --- PASS: TestDuplicateShards (0.00s) === RUN TestPrepareDataToRecoverTargetShardCount --- PASS: TestPrepareDataToRecoverTargetShardCount (0.00s) === RUN TestRebuilderVolumeIdMatches === RUN TestRebuilderVolumeIdMatches/no_target_volume_IDs_(nil) === RUN TestRebuilderVolumeIdMatches/no_target_volume_IDs === RUN TestRebuilderVolumeIdMatches/volume_ID_matches === RUN TestRebuilderVolumeIdMatches/volume_ID_mismatch --- PASS: TestRebuilderVolumeIdMatches (0.00s) --- PASS: TestRebuilderVolumeIdMatches/no_target_volume_IDs_(nil) (0.00s) --- PASS: TestRebuilderVolumeIdMatches/no_target_volume_IDs (0.00s) --- PASS: TestRebuilderVolumeIdMatches/volume_ID_matches (0.00s) --- PASS: TestRebuilderVolumeIdMatches/volume_ID_mismatch (0.00s) === RUN TestEcShardsFromString === RUN TestEcShardsFromString/single_id === RUN TestEcShardsFromString/list_of_ids === RUN TestEcShardsFromString/qualified_keeps_host:port === RUN TestEcShardsFromString/mixed_bare_and_qualified === RUN TestEcShardsFromString/colon_without_node_marker_is_not_a_shard_ID === RUN TestEcShardsFromString/shard_id_within_MaxShardCount === RUN TestEcShardsFromString/shard_id_at_MaxShardCount_is_rejected === RUN TestEcShardsFromString/negative_shard_id === RUN TestEcShardsFromString/out-of-range_shard_id_does_not_wrap === RUN TestEcShardsFromString/non-numeric_shard_id === RUN TestEcShardsFromString/empty_element --- PASS: TestEcShardsFromString (0.01s) --- PASS: TestEcShardsFromString/single_id (0.00s) --- PASS: TestEcShardsFromString/list_of_ids (0.00s) --- PASS: TestEcShardsFromString/qualified_keeps_host:port (0.00s) --- PASS: TestEcShardsFromString/mixed_bare_and_qualified (0.00s) --- PASS: TestEcShardsFromString/colon_without_node_marker_is_not_a_shard_ID (0.00s) --- PASS: TestEcShardsFromString/shard_id_within_MaxShardCount (0.00s) --- PASS: TestEcShardsFromString/shard_id_at_MaxShardCount_is_rejected (0.00s) --- PASS: TestEcShardsFromString/negative_shard_id (0.00s) --- PASS: TestEcShardsFromString/out-of-range_shard_id_does_not_wrap (0.00s) --- PASS: TestEcShardsFromString/non-numeric_shard_id (0.00s) --- PASS: TestEcShardsFromString/empty_element (0.00s) === RUN TestEcShardStringRoundTrips --- PASS: TestEcShardStringRoundTrips (0.00s) === RUN TestUnmountResolvesShardDuplicatedOnOneNode --- PASS: TestUnmountResolvesShardDuplicatedOnOneNode (0.00s) === RUN TestUnmountStillRejectsShardOnTwoNodes --- PASS: TestUnmountStillRejectsShardOnTwoNodes (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/ec 7.245s === RUN TestEntryCodec_AtimeRoundTrip --- PASS: TestEntryCodec_AtimeRoundTrip (0.00s) === RUN TestEntryCodec_AtimeZeroFallsBackToMtime --- PASS: TestEntryCodec_AtimeZeroFallsBackToMtime (0.00s) === RUN TestEntryCodec_AtimeSubSecondEpochPreserved --- PASS: TestEntryCodec_AtimeSubSecondEpochPreserved (0.00s) === RUN TestDecodeAttributesOnlyMatchesFullDecode === RUN TestDecodeAttributesOnlyMatchesFullDecode/no_chunks === RUN TestDecodeAttributesOnlyMatchesFullDecode/directory === RUN TestDecodeAttributesOnlyMatchesFullDecode/one_chunk === RUN TestDecodeAttributesOnlyMatchesFullDecode/zero_FileSize,_size_comes_from_chunks === RUN TestDecodeAttributesOnlyMatchesFullDecode/chunks_out_of_order === RUN TestDecodeAttributesOnlyMatchesFullDecode/stored_FileSize_larger_than_chunks === RUN TestDecodeAttributesOnlyMatchesFullDecode/symlink === RUN TestDecodeAttributesOnlyMatchesFullDecode/hard_link === RUN TestDecodeAttributesOnlyMatchesFullDecode/inline_content === RUN TestDecodeAttributesOnlyMatchesFullDecode/extended_attributes === RUN TestDecodeAttributesOnlyMatchesFullDecode/remote_entry === RUN TestDecodeAttributesOnlyMatchesFullDecode/quota_and_worm --- PASS: TestDecodeAttributesOnlyMatchesFullDecode (0.34s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/no_chunks (0.24s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/directory (0.00s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/one_chunk (0.02s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/zero_FileSize,_size_comes_from_chunks (0.01s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/chunks_out_of_order (0.00s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/stored_FileSize_larger_than_chunks (0.00s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/symlink (0.00s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/hard_link (0.01s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/inline_content (0.01s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/extended_attributes (0.01s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/remote_entry (0.01s) --- PASS: TestDecodeAttributesOnlyMatchesFullDecode/quota_and_worm (0.00s) === RUN TestDecodeAttributesOnlyRandomEntries --- PASS: TestDecodeAttributesOnlyRandomEntries (2.30s) === RUN TestDecodeAttributesOnlyRejectsGarbage --- PASS: TestDecodeAttributesOnlyRejectsGarbage (0.00s) === RUN TestProtoEntryWithoutChunksKeepsSize --- PASS: TestProtoEntryWithoutChunksKeepsSize (0.00s) === RUN TestChunkValidationCoversEveryField --- PASS: TestChunkValidationCoversEveryField (0.00s) === RUN TestDecodeAttributesOnlyRejectsWhatFullDecodeRejects === RUN TestDecodeAttributesOnlyRejectsWhatFullDecodeRejects/corrupt_nested_fid === RUN TestDecodeAttributesOnlyRejectsWhatFullDecodeRejects/invalid_utf8_in_file_id === RUN TestDecodeAttributesOnlyRejectsWhatFullDecodeRejects/truncated_chunk --- PASS: TestDecodeAttributesOnlyRejectsWhatFullDecodeRejects (0.01s) --- PASS: TestDecodeAttributesOnlyRejectsWhatFullDecodeRejects/corrupt_nested_fid (0.00s) --- PASS: TestDecodeAttributesOnlyRejectsWhatFullDecodeRejects/invalid_utf8_in_file_id (0.00s) --- PASS: TestDecodeAttributesOnlyRejectsWhatFullDecodeRejects/truncated_chunk (0.00s) === RUN TestDecodeAttributesOnlyManifestChunk --- PASS: TestDecodeAttributesOnlyManifestChunk (0.00s) === RUN TestDecodeAttributesOnlyFieldBeforeChunks --- PASS: TestDecodeAttributesOnlyFieldBeforeChunks (0.00s) === RUN TestApplyS3ExpiryMetadata === RUN TestApplyS3ExpiryMetadata/s3_entry_with_ttl === RUN TestApplyS3ExpiryMetadata/no_ttl === RUN TestApplyS3ExpiryMetadata/not_an_s3_entry === RUN TestApplyS3ExpiryMetadata/versioned_entry_keeps_crtime_expiry --- PASS: TestApplyS3ExpiryMetadata (0.01s) --- PASS: TestApplyS3ExpiryMetadata/s3_entry_with_ttl (0.00s) --- PASS: TestApplyS3ExpiryMetadata/no_ttl (0.00s) --- PASS: TestApplyS3ExpiryMetadata/not_an_s3_entry (0.00s) --- PASS: TestApplyS3ExpiryMetadata/versioned_entry_keeps_crtime_expiry (0.00s) === RUN TestChunkGroup_ReadDataAt_ErrorHandling === RUN TestChunkGroup_ReadDataAt_ErrorHandling/should_return_immediately_on_error === RUN TestChunkGroup_ReadDataAt_ErrorHandling/should_handle_EOF_correctly === RUN TestChunkGroup_ReadDataAt_ErrorHandling/should_return_EOF_when_offset_exceeds_file_size === RUN TestChunkGroup_ReadDataAt_ErrorHandling/should_demonstrate_the_GitHub_issue_fix_-_errors_should_not_be_masked === RUN TestChunkGroup_ReadDataAt_ErrorHandling/Context_Cancellation filechunk_group_test.go:147: Operation completed before context cancellation was checked - this is expected for empty ChunkGroup === RUN TestChunkGroup_ReadDataAt_ErrorHandling/Context_Cancellation_with_Timeout --- PASS: TestChunkGroup_ReadDataAt_ErrorHandling (0.02s) --- PASS: TestChunkGroup_ReadDataAt_ErrorHandling/should_return_immediately_on_error (0.00s) --- PASS: TestChunkGroup_ReadDataAt_ErrorHandling/should_handle_EOF_correctly (0.00s) --- PASS: TestChunkGroup_ReadDataAt_ErrorHandling/should_return_EOF_when_offset_exceeds_file_size (0.00s) --- PASS: TestChunkGroup_ReadDataAt_ErrorHandling/should_demonstrate_the_GitHub_issue_fix_-_errors_should_not_be_masked (0.00s) --- PASS: TestChunkGroup_ReadDataAt_ErrorHandling/Context_Cancellation (0.00s) --- PASS: TestChunkGroup_ReadDataAt_ErrorHandling/Context_Cancellation_with_Timeout (0.00s) === RUN TestChunkGroup_SearchChunks_Cancellation === RUN TestChunkGroup_SearchChunks_Cancellation/Context_Cancellation_in_SearchChunks filechunk_group_test.go:209: SearchChunks completed with cancelled context - context threading verified === RUN TestChunkGroup_SearchChunks_Cancellation/Context_with_Timeout_in_SearchChunks --- PASS: TestChunkGroup_SearchChunks_Cancellation (0.01s) --- PASS: TestChunkGroup_SearchChunks_Cancellation/Context_Cancellation_in_SearchChunks (0.00s) --- PASS: TestChunkGroup_SearchChunks_Cancellation/Context_with_Timeout_in_SearchChunks (0.00s) === RUN TestChunkGroup_SearchChunks === RUN TestChunkGroup_SearchChunks/SEEK_DATA_starts_at_the_first_data_range_after_a_hole === RUN TestChunkGroup_SearchChunks/SEEK_DATA_preserves_an_offset_inside_a_data_range === RUN TestChunkGroup_SearchChunks/SEEK_DATA_crosses_a_hole_between_data_ranges === RUN TestChunkGroup_SearchChunks/SEEK_DATA_returns_no_match_after_the_final_data_range === RUN TestChunkGroup_SearchChunks/SEEK_HOLE_starts_at_the_sparse_prefix === RUN TestChunkGroup_SearchChunks/SEEK_HOLE_finds_the_transition_after_data === RUN TestChunkGroup_SearchChunks/SEEK_HOLE_preserves_an_offset_inside_a_hole === RUN TestChunkGroup_SearchChunks/SEEK_HOLE_returns_the_implicit_trailing_hole === RUN TestChunkGroup_SearchChunks/SEEK_DATA_at_EOF_has_no_match === RUN TestChunkGroup_SearchChunks/SEEK_HOLE_at_EOF_returns_EOF === RUN TestChunkGroup_SearchChunks/empty_file_has_neither_data_nor_a_non-EOF_hole === RUN TestChunkGroup_SearchChunks/empty_file_reports_EOF_for_SEEK_HOLE === RUN TestChunkGroup_SearchChunks/SEEK_DATA_crosses_a_section_boundary === RUN TestChunkGroup_SearchChunks/SEEK_DATA_finds_data_after_a_section_boundary_hole === RUN TestChunkGroup_SearchChunks/SEEK_HOLE_finds_a_hole_at_a_section_boundary === RUN TestChunkGroup_SearchChunks/SEEK_HOLE_finds_a_missing_section === RUN TestChunkGroup_SearchChunks/SEEK_DATA_finds_data_in_the_final_section_at_MaxInt64_file_size === RUN TestChunkGroup_SearchChunks/SEEK_HOLE_finds_the_final_section_hole_at_MaxInt64_file_size --- PASS: TestChunkGroup_SearchChunks (0.05s) --- PASS: TestChunkGroup_SearchChunks/SEEK_DATA_starts_at_the_first_data_range_after_a_hole (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_DATA_preserves_an_offset_inside_a_data_range (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_DATA_crosses_a_hole_between_data_ranges (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_DATA_returns_no_match_after_the_final_data_range (0.01s) --- PASS: TestChunkGroup_SearchChunks/SEEK_HOLE_starts_at_the_sparse_prefix (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_HOLE_finds_the_transition_after_data (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_HOLE_preserves_an_offset_inside_a_hole (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_HOLE_returns_the_implicit_trailing_hole (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_DATA_at_EOF_has_no_match (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_HOLE_at_EOF_returns_EOF (0.00s) --- PASS: TestChunkGroup_SearchChunks/empty_file_has_neither_data_nor_a_non-EOF_hole (0.00s) --- PASS: TestChunkGroup_SearchChunks/empty_file_reports_EOF_for_SEEK_HOLE (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_DATA_crosses_a_section_boundary (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_DATA_finds_data_after_a_section_boundary_hole (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_HOLE_finds_a_hole_at_a_section_boundary (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_HOLE_finds_a_missing_section (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_DATA_finds_data_in_the_final_section_at_MaxInt64_file_size (0.00s) --- PASS: TestChunkGroup_SearchChunks/SEEK_HOLE_finds_the_final_section_hole_at_MaxInt64_file_size (0.00s) === RUN TestChunkGroup_ReadDataAt_ManifestResolveFailure E1117 09:36:52.857003 filechunk_manifest.go:384 operation LookupFileId 1,1679011dc64abd40 failed, err: lookup failed --- PASS: TestChunkGroup_ReadDataAt_ManifestResolveFailure (0.07s) === RUN TestChunkGroupManifestResolutionCachesRepeatedOpens --- PASS: TestChunkGroupManifestResolutionCachesRepeatedOpens (0.21s) === RUN TestChunkGroupManifestResolutionDoesNotCacheFailedReads I1117 09:36:53.207873 filechunk_manifest.go:470 read http://127.0.0.1:38117/cache-failed-read failed, err: http://127.0.0.1:38117/cache-failed-read?readDeleted=true: 404 Not Found: not found --- PASS: TestChunkGroupManifestResolutionDoesNotCacheFailedReads (0.10s) === RUN TestChunkGroupManifestResolutionConcurrentWarmOpensReuseFetch --- PASS: TestChunkGroupManifestResolutionConcurrentWarmOpensReuseFetch (0.03s) === RUN TestChunkGroupManifestResolutionCoalescesColdMisses --- PASS: TestChunkGroupManifestResolutionCoalescesColdMisses (0.09s) === RUN TestResolveOneChunkManifestDoesNotUseMountCache --- PASS: TestResolveOneChunkManifestDoesNotUseMountCache (0.04s) === RUN TestChunkGroupManifestResolutionDoesNotCacheMalformedManifest --- PASS: TestChunkGroupManifestResolutionDoesNotCacheMalformedManifest (0.04s) === RUN TestChunkManifestCacheSeparatesReadParameters --- PASS: TestChunkManifestCacheSeparatesReadParameters (0.00s) === RUN TestChunkManifestCacheCopiesData --- PASS: TestChunkManifestCacheCopiesData (0.00s) === RUN TestChunkManifestCacheEvictsLeastRecentlyUsedAndOversizedEntries --- PASS: TestChunkManifestCacheEvictsLeastRecentlyUsedAndOversizedEntries (0.00s) === RUN TestResolveOneChunkManifestHonorsCanceledContextOnCacheHit --- PASS: TestResolveOneChunkManifestHonorsCanceledContextOnCacheHit (0.00s) === RUN TestResolveOneChunkManifestCanceledWaiterReturnsDuringCoalescedMiss --- PASS: TestResolveOneChunkManifestCanceledWaiterReturnsDuringCoalescedMiss (0.13s) === RUN TestResolveChunkManifestParallelReadsAreBounded --- PASS: TestResolveChunkManifestParallelReadsAreBounded (0.21s) === RUN TestResolveChunkManifestPreservesInputOrderWhenReadsCompleteOutOfOrder --- PASS: TestResolveChunkManifestPreservesInputOrderWhenReadsCompleteOutOfOrder (0.10s) === RUN TestResolveChunkManifestNestedManifestsKeepDepthFirstOrder --- PASS: TestResolveChunkManifestNestedManifestsKeepDepthFirstOrder (0.10s) === RUN TestResolveChunkManifestFiltersBeforeReadingAndRecursively --- PASS: TestResolveChunkManifestFiltersBeforeReadingAndRecursively (0.01s) === RUN TestResolveChunkManifestPropagatesReadAndFormatErrorsInInputOrder E1117 09:36:54.096295 filechunk_manifest.go:384 operation LookupFileId lookup-error failed, err: lookup failed --- PASS: TestResolveChunkManifestPropagatesReadAndFormatErrorsInInputOrder (0.07s) === RUN TestResolveChunkManifestCancellationStopsAllReads --- PASS: TestResolveChunkManifestCancellationStopsAllReads (0.02s) === RUN TestResolveChunkManifestFastFailureCancelsSlowSibling === RUN TestResolveChunkManifestFastFailureCancelsSlowSibling/fast_then_slow_returns_quickly I1117 09:36:54.136492 filechunk_manifest.go:470 read http://127.0.0.1:35817/slow failed, err: Get "http://127.0.0.1:35817/slow?readDeleted=true": context canceled === RUN TestResolveChunkManifestFastFailureCancelsSlowSibling/slow_then_fast_keeps_real_error I1117 09:36:54.153753 filechunk_manifest.go:470 read http://127.0.0.1:44497/slow failed, err: Get "http://127.0.0.1:44497/slow?readDeleted=true": context canceled --- PASS: TestResolveChunkManifestFastFailureCancelsSlowSibling (0.04s) --- PASS: TestResolveChunkManifestFastFailureCancelsSlowSibling/fast_then_slow_returns_quickly (0.02s) --- PASS: TestResolveChunkManifestFastFailureCancelsSlowSibling/slow_then_fast_keeps_real_error (0.01s) === RUN TestResolveChunkManifestFastFailureCancelsEncryptedSibling I1117 09:36:54.174196 filechunk_manifest.go:470 read http://127.0.0.1:39689/slow failed, err: fetch http://127.0.0.1:39689/slow?readDeleted=true: Get "http://127.0.0.1:39689/slow?readDeleted=true": context canceled --- PASS: TestResolveChunkManifestFastFailureCancelsEncryptedSibling (0.02s) === RUN TestResolveChunkManifestKeepsRealErrorAfterInternalCancellation E1117 09:36:54.180462 filechunk_manifest.go:384 operation LookupFileId late failed, err: late lookup failed E1117 09:36:54.180861 filechunk_manifest.go:384 operation LookupFileId early failed, err: early lookup failed --- PASS: TestResolveChunkManifestKeepsRealErrorAfterInternalCancellation (0.00s) === RUN TestResolveChunkManifestReturnsLaterFailureWithoutRecursingEarlierChildren --- PASS: TestResolveChunkManifestReturnsLaterFailureWithoutRecursingEarlierChildren (0.07s) === RUN TestResolveChunkManifestExcludesOutOfRangeChildrenOnLaterFailure --- PASS: TestResolveChunkManifestExcludesOutOfRangeChildrenOnLaterFailure (0.06s) === RUN TestResolveChunkManifestQueuesJobsBeyondWorkerCount E1117 09:36:54.316343 filechunk_manifest.go:384 operation LookupFileId fail failed, err: prompt lookup failure --- PASS: TestResolveChunkManifestQueuesJobsBeyondWorkerCount (0.00s) === RUN TestMaybeManifestizeFolds --- PASS: TestMaybeManifestizeFolds (0.30s) === RUN TestMaybeManifestizeBelowThreshold --- PASS: TestMaybeManifestizeBelowThreshold (0.11s) === RUN TestMaybeManifestizeRollsBackPartialFold --- PASS: TestMaybeManifestizeRollsBackPartialFold (0.55s) === RUN TestMaybeManifestizeKeepsExistingManifestsOnFailure --- PASS: TestMaybeManifestizeKeepsExistingManifestsOnFailure (0.55s) === RUN TestMaybeManifestizeRollbackWithoutDeleter I1117 09:36:56.410263 filechunk_manifest.go:541 manifestize failed, 1 manifest blobs left unreferenced: save 2 failed --- PASS: TestMaybeManifestizeRollbackWithoutDeleter (0.58s) === RUN TestMaybeManifestizeRollsBackSmallFold --- PASS: TestMaybeManifestizeRollsBackSmallFold (0.59s) === RUN TestDoMaybeManifestize test 0 test 1 test 2 test 3 --- PASS: TestDoMaybeManifestize (0.00s) === RUN TestManifestRoundTripPreservesChunks --- PASS: TestManifestRoundTripPreservesChunks (0.00s) === RUN TestMaybeManifestizePreservesSSEMetadata === RUN TestMaybeManifestizePreservesSSEMetadata/SSE_C === RUN TestMaybeManifestizePreservesSSEMetadata/SSE_KMS === RUN TestMaybeManifestizePreservesSSEMetadata/SSE_S3 --- PASS: TestMaybeManifestizePreservesSSEMetadata (2.11s) --- PASS: TestMaybeManifestizePreservesSSEMetadata/SSE_C (0.71s) --- PASS: TestMaybeManifestizePreservesSSEMetadata/SSE_KMS (0.68s) --- PASS: TestMaybeManifestizePreservesSSEMetadata/SSE_S3 (0.72s) === RUN TestCompactResolvedOverlappingManifests --- PASS: TestCompactResolvedOverlappingManifests (0.00s) === RUN TestDoMinusChunksWithResolvedManifests --- PASS: TestDoMinusChunksWithResolvedManifests (0.00s) === RUN TestManifestizeSmallBatchWithRemainder --- PASS: TestManifestizeSmallBatchWithRemainder (0.00s) === RUN TestCompactMultipleOverlappingManifestGenerations --- PASS: TestCompactMultipleOverlappingManifestGenerations (0.00s) === RUN TestManifestBloatDetection filechunk_manifest_test.go:547: n=1 manifests: totalStored=20000 fileSize=10000 ratio=2.0x expectMerge=false filechunk_manifest_test.go:547: n=2 manifests: totalStored=30000 fileSize=10000 ratio=3.0x expectMerge=true filechunk_manifest_test.go:547: n=3 manifests: totalStored=40000 fileSize=10000 ratio=4.0x expectMerge=true filechunk_manifest_test.go:547: n=4 manifests: totalStored=50000 fileSize=10000 ratio=5.0x expectMerge=true filechunk_manifest_test.go:547: n=5 manifests: totalStored=60000 fileSize=10000 ratio=6.0x expectMerge=true filechunk_manifest_test.go:547: n=6 manifests: totalStored=70000 fileSize=10000 ratio=7.0x expectMerge=true filechunk_manifest_test.go:547: n=7 manifests: totalStored=80000 fileSize=10000 ratio=8.0x expectMerge=true filechunk_manifest_test.go:547: n=8 manifests: totalStored=90000 fileSize=10000 ratio=9.0x expectMerge=true filechunk_manifest_test.go:547: n=9 manifests: totalStored=100000 fileSize=10000 ratio=10.0x expectMerge=true filechunk_manifest_test.go:547: n=10 manifests: totalStored=110000 fileSize=10000 ratio=11.0x expectMerge=true --- PASS: TestManifestBloatDetection (0.00s) === RUN TestFetchWholeChunkRetriesFreshLocations I1117 09:36:59.149663 filechunk_manifest.go:470 read http://127.0.0.1:43365/5,stale failed, err: unexpected EOF I1117 09:36:59.149963 stream.go:157 read chunk 5,stale failed, invalidating cache and retrying: unexpected EOF I1117 09:36:59.150430 stream.go:174 retrying read chunk 5,stale with 1 new locations --- PASS: TestFetchWholeChunkRetriesFreshLocations (0.02s) === RUN TestFetchWholeChunkRefreshesLocationsAfterPartialFailure I1117 09:36:59.172586 filechunk_manifest.go:470 read http://127.0.0.1:39715/5,abc failed, err: Get "http://127.0.0.1:39715/5,abc?readDeleted=true": dial tcp 127.0.0.1:39715: connect: connection refused --- PASS: TestFetchWholeChunkRefreshesLocationsAfterPartialFailure (0.02s) === RUN TestFetchWholeChunkWithoutInvalidator I1117 09:36:59.185019 filechunk_manifest.go:470 read http://127.0.0.1:35555/5,abc failed, err: http://127.0.0.1:35555/5,abc?readDeleted=true: 500 Internal Server Error --- PASS: TestFetchWholeChunkWithoutInvalidator (0.01s) === RUN TestFetchWholeChunkUnchangedLocations I1117 09:36:59.191334 filechunk_manifest.go:470 read http://127.0.0.1:34147/5,abc failed, err: http://127.0.0.1:34147/5,abc?readDeleted=true: 500 Internal Server Error I1117 09:36:59.191550 stream.go:157 read chunk 5,abc failed, invalidating cache and retrying: http://127.0.0.1:34147/5,abc?readDeleted=true: 500 Internal Server Error I1117 09:36:59.191883 stream.go:170 re-lookup returned same locations for chunk 5,abc, skipping retry --- PASS: TestFetchWholeChunkUnchangedLocations (0.01s) === RUN TestFetchWholeChunkCancelledKeepsLocations --- PASS: TestFetchWholeChunkCancelledKeepsLocations (0.00s) === RUN TestFetchWholeChunkUsesProvidedFilerJwt --- PASS: TestFetchWholeChunkUsesProvidedFilerJwt (0.01s) === RUN TestRetriedStreamFetchChunkDataReportsWriteError --- PASS: TestRetriedStreamFetchChunkDataReportsWriteError (0.01s) === RUN TestMaybeManifestizeBoundsSmallAppends --- PASS: TestMaybeManifestizeBoundsSmallAppends (1.12s) === RUN TestMaybeManifestizeLeavesLargeChunksToManifestBatch --- PASS: TestMaybeManifestizeLeavesLargeChunksToManifestBatch (0.03s) === RUN TestMaybeManifestizeKeepsOrderBelowSmallBatch --- PASS: TestMaybeManifestizeKeepsOrderBelowSmallBatch (0.02s) === RUN Test_removeGarbageChunks --- PASS: Test_removeGarbageChunks (0.00s) === RUN TestDoMinusChunks 2026/11/17 09:37:00 first deleted chunks: [file_id:"1" size:3 modified_ts_ns:100 source_file_id:"11" file_id:"2" offset:3 size:3 modified_ts_ns:200 file_id:"3" offset:6 size:3 modified_ts_ns:300 source_file_id:"33"] 2026/11/17 09:37:00 clusterA synced empty chunks event result: [] --- PASS: TestDoMinusChunks (0.01s) === RUN TestCompactFileChunksRealCase I1117 09:37:00.402391 filechunks2_test.go:87 before chunk 2,512f31f2c0700a [ 0, 25) I1117 09:37:00.402686 filechunks2_test.go:87 before chunk 6,512f2c2e24e9e8 [ 868352, 917585) I1117 09:37:00.402831 filechunks2_test.go:87 before chunk 7,514468dd5954ca [ 884736, 901120) I1117 09:37:00.402967 filechunks2_test.go:87 before chunk 5,5144463173fe77 [ 917504, 2297856) I1117 09:37:00.403096 filechunks2_test.go:87 before chunk 4,51444c7ab54e2d [ 2301952, 2367488) I1117 09:37:00.403203 filechunks2_test.go:87 before chunk 4,514450e643ad22 [ 2371584, 2420736) I1117 09:37:00.403310 filechunks2_test.go:87 before chunk 6,514456a5e9e4d7 [ 2449408, 2490368) I1117 09:37:00.403426 filechunks2_test.go:87 before chunk 3,51444f8d53eebe [ 2494464, 2555904) I1117 09:37:00.403548 filechunks2_test.go:87 before chunk 4,5144578b097c7e [ 2560000, 2596864) I1117 09:37:00.403668 filechunks2_test.go:87 before chunk 3,51445500b6b4ac [ 2637824, 2678784) I1117 09:37:00.403786 filechunks2_test.go:87 before chunk 1,51446285e52a61 [ 2695168, 2715648) I1117 09:37:00.404594 filechunks2_test.go:87 compacted chunk 2,512f31f2c0700a [ 0, 25) I1117 09:37:00.404721 filechunks2_test.go:87 compacted chunk 6,512f2c2e24e9e8 [ 868352, 917585) I1117 09:37:00.404824 filechunks2_test.go:87 compacted chunk 7,514468dd5954ca [ 884736, 901120) I1117 09:37:00.404922 filechunks2_test.go:87 compacted chunk 5,5144463173fe77 [ 917504, 2297856) I1117 09:37:00.405021 filechunks2_test.go:87 compacted chunk 4,51444c7ab54e2d [ 2301952, 2367488) I1117 09:37:00.405120 filechunks2_test.go:87 compacted chunk 4,514450e643ad22 [ 2371584, 2420736) I1117 09:37:00.405218 filechunks2_test.go:87 compacted chunk 6,514456a5e9e4d7 [ 2449408, 2490368) I1117 09:37:00.405316 filechunks2_test.go:87 compacted chunk 3,51444f8d53eebe [ 2494464, 2555904) I1117 09:37:00.405415 filechunks2_test.go:87 compacted chunk 4,5144578b097c7e [ 2560000, 2596864) I1117 09:37:00.405520 filechunks2_test.go:87 compacted chunk 3,51445500b6b4ac [ 2637824, 2678784) I1117 09:37:00.405619 filechunks2_test.go:87 compacted chunk 1,51446285e52a61 [ 2695168, 2715648) --- PASS: TestCompactFileChunksRealCase (0.00s) === RUN TestCompactFileChunksCancelledContext --- PASS: TestCompactFileChunksCancelledContext (0.00s) === RUN TestViewFromChunksCancelledContext --- PASS: TestViewFromChunksCancelledContext (0.00s) === RUN TestChunkStreamReaderCancelledContext --- PASS: TestChunkStreamReaderCancelledContext (0.00s) === RUN TestReadResolvedChunks resolved to 4 visible intervales [0,50) a 1 [50,150) b 2 [175,275) e 5 [275,300) d 4 --- PASS: TestReadResolvedChunks (0.00s) === RUN TestReadResolvedChunks2 resolved to 2 visible intervales [200,225) e 5 [225,250) c 3 --- PASS: TestReadResolvedChunks2 (0.00s) === RUN TestRandomizedReadResolvedChunks --- PASS: TestRandomizedReadResolvedChunks (0.11s) === RUN TestSequentialReadResolvedChunks visibles 13--- PASS: TestSequentialReadResolvedChunks (0.00s) === RUN TestActualReadResolvedChunks [0,2097152) 5,e7b96fef48 1634447487595823000 [2097152,4194304) 5,e5562640b9 1634447487595826000 [4194304,6291456) 5,df033e0fe4 1634447487595827000 [6291456,8388608) 7,eb08148a9b 1634447487595827000 [8388608,10485760) 7,e0f92d1604 1634447487595828000 [10485760,12582912) 7,e33cb63262 1634447487595828000 [12582912,14680064) 5,ea98e40e93 1634447487595829000 [14680064,16777216) 5,e165661172 1634447487595829000 [16777216,18874368) 3,e692097486 1634447487595830000 [18874368,20971520) 3,e28e2e3cbd 1634447487595830000 [20971520,23068672) 3,e443974d4e 1634447487595830000 [23068672,25165824) 2,e815bed597 1634447487595831000 [25165824,27140560) 5,e94715199e 1634447487595832000 --- PASS: TestActualReadResolvedChunks (0.00s) === RUN TestActualReadResolvedChunks2 [0,184320) 1,e7b96fef48 1 [184320,188416) 2,33562640b9 4 [188416,2285568) 4,df033e0fe4 3 --- PASS: TestActualReadResolvedChunks2 (0.00s) === RUN TestChunkViewStringOmitsCipherKey --- PASS: TestChunkViewStringOmitsCipherKey (0.00s) === RUN TestCompactFileChunks --- PASS: TestCompactFileChunks (0.00s) === RUN TestCompactFileChunks2 --- PASS: TestCompactFileChunks2 (0.00s) === RUN TestRandomFileChunksCompact --- PASS: TestRandomFileChunksCompact (0.01s) === RUN TestIntervalMerging 2026/11/17 09:37:00 ++++++++++ merged test case 0 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 0, interval start=0, stop=100, fileId=abc 2026/11/17 09:37:00 test case 0, interval start=100, stop=200, fileId=asdf 2026/11/17 09:37:00 test case 0, interval start=200, stop=300, fileId=fsad 2026/11/17 09:37:00 ++++++++++ merged test case 1 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 1, interval start=0, stop=200, fileId=asdf 2026/11/17 09:37:00 ++++++++++ merged test case 2 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 2, interval start=0, stop=70, fileId=b 2026/11/17 09:37:00 test case 2, interval start=70, stop=100, fileId=a 2026/11/17 09:37:00 ++++++++++ merged test case 3 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 3, interval start=0, stop=50, fileId=asdf 2026/11/17 09:37:00 test case 3, interval start=50, stop=300, fileId=xxxx 2026/11/17 09:37:00 ++++++++++ merged test case 4 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 4, interval start=0, stop=200, fileId=asdf 2026/11/17 09:37:00 test case 4, interval start=250, stop=500, fileId=xxxx 2026/11/17 09:37:00 ++++++++++ merged test case 5 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 5, interval start=0, stop=200, fileId=d 2026/11/17 09:37:00 test case 5, interval start=200, stop=220, fileId=c 2026/11/17 09:37:00 ++++++++++ merged test case 6 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 6, interval start=0, stop=100, fileId=xyz 2026/11/17 09:37:00 ++++++++++ merged test case 7 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 7, interval start=0, stop=2097152, fileId=3,029565bf3092 2026/11/17 09:37:00 test case 7, interval start=2097152, stop=5242880, fileId=6,029632f47ae2 2026/11/17 09:37:00 test case 7, interval start=5242880, stop=8388608, fileId=2,029734c5aa10 2026/11/17 09:37:00 test case 7, interval start=8388608, stop=11534336, fileId=5,02982f80de50 2026/11/17 09:37:00 test case 7, interval start=11534336, stop=14376529, fileId=7,0299ad723803 2026/11/17 09:37:00 ++++++++++ merged test case 8 ++++++++++++++++++++ 2026/11/17 09:37:00 test case 8, interval start=0, stop=77824, fileId=4,0b3df938e301 2026/11/17 09:37:00 test case 8, interval start=77824, stop=208896, fileId=4,0b3f0c7202f0 2026/11/17 09:37:00 test case 8, interval start=208896, stop=339968, fileId=2,0b4031a72689 2026/11/17 09:37:00 test case 8, interval start=339968, stop=471040, fileId=3,0b416a557362 2026/11/17 09:37:00 test case 8, interval start=471040, stop=472225, fileId=6,0b3e0650019c --- PASS: TestIntervalMerging (0.01s) === RUN TestChunksReading 2026/11/17 09:37:00 ++++++++++ read test case 0 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 0, chunk 0, offset=0, size=100, fileId=abc 2026/11/17 09:37:00 read case 0, chunk 1, offset=0, size=100, fileId=asdf 2026/11/17 09:37:00 read case 0, chunk 2, offset=0, size=50, fileId=fsad 2026/11/17 09:37:00 ++++++++++ read test case 1 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 1, chunk 0, offset=50, size=100, fileId=asdf 2026/11/17 09:37:00 ++++++++++ read test case 2 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 2, chunk 0, offset=20, size=30, fileId=b 2026/11/17 09:37:00 read case 2, chunk 1, offset=57, size=10, fileId=a 2026/11/17 09:37:00 ++++++++++ read test case 3 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 3, chunk 0, offset=0, size=50, fileId=asdf 2026/11/17 09:37:00 read case 3, chunk 1, offset=0, size=150, fileId=xxxx 2026/11/17 09:37:00 ++++++++++ read test case 4 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 4, chunk 0, offset=0, size=200, fileId=asdf 2026/11/17 09:37:00 read case 4, chunk 1, offset=0, size=150, fileId=xxxx 2026/11/17 09:37:00 ++++++++++ read test case 5 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 5, chunk 0, offset=0, size=200, fileId=c 2026/11/17 09:37:00 read case 5, chunk 1, offset=130, size=20, fileId=b 2026/11/17 09:37:00 ++++++++++ read test case 6 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 6, chunk 0, offset=0, size=100, fileId=xyz 2026/11/17 09:37:00 ++++++++++ read test case 7 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 7, chunk 0, offset=0, size=100, fileId=abc 2026/11/17 09:37:00 read case 7, chunk 1, offset=0, size=100, fileId=asdf 2026/11/17 09:37:00 ++++++++++ read test case 8 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 8, chunk 0, offset=0, size=90, fileId=abc 2026/11/17 09:37:00 read case 8, chunk 1, offset=0, size=100, fileId=asdf 2026/11/17 09:37:00 read case 8, chunk 2, offset=0, size=110, fileId=fsad 2026/11/17 09:37:00 ++++++++++ read test case 9 ++++++++++++++++++++ 2026/11/17 09:37:00 read case 9, chunk 0, offset=0, size=43175936, fileId=2,111fc2cbfac1 2026/11/17 09:37:00 read case 9, chunk 1, offset=0, size=9805824, fileId=2,112a36ea7f85 2026/11/17 09:37:00 read case 9, chunk 2, offset=0, size=19582976, fileId=4,112d5f31c5e7 2026/11/17 09:37:00 read case 9, chunk 3, offset=0, size=60690432, fileId=1,113245f0cdb6 2026/11/17 09:37:00 read case 9, chunk 4, offset=0, size=4014080, fileId=3,1141a70733b5 2026/11/17 09:37:00 read case 9, chunk 5, offset=0, size=16309588, fileId=1,114201d5bbdb --- PASS: TestChunksReading (0.01s) === RUN TestViewFromVisibleIntervals --- PASS: TestViewFromVisibleIntervals (0.00s) === RUN TestViewFromVisibleIntervals2 --- PASS: TestViewFromVisibleIntervals2 (0.00s) === RUN TestViewFromVisibleIntervals3 --- PASS: TestViewFromVisibleIntervals3 (0.00s) === RUN TestCompactFileChunks3 --- PASS: TestCompactFileChunks3 (0.00s) === RUN TestSeparateGarbageChunksNilVisibles --- PASS: TestSeparateGarbageChunksNilVisibles (0.00s) === RUN TestViewFromVisibleIntervalsNilVisibles --- PASS: TestViewFromVisibleIntervalsNilVisibles (0.00s) === RUN TestViewFromChunksPropagatesError --- PASS: TestViewFromChunksPropagatesError (0.00s) === RUN TestFilerConf --- PASS: TestFilerConf (0.02s) === RUN TestWormInheritance --- PASS: TestWormInheritance (0.00s) === RUN TestWormLegacyFalseIsNotAnOverride --- PASS: TestWormLegacyFalseIsNotAnOverride (0.02s) === RUN TestFsyncInheritance --- PASS: TestFsyncInheritance (0.00s) === RUN TestFsyncLegacyFalseIsNotAnOverride --- PASS: TestFsyncLegacyFalseIsNotAnOverride (0.01s) === RUN TestWormSurvivesRoundTrip --- PASS: TestWormSurvivesRoundTrip (0.01s) === RUN TestFsyncSurvivesRoundTrip --- PASS: TestFsyncSurvivesRoundTrip (0.00s) === RUN TestClonePathConf --- PASS: TestClonePathConf (0.00s) === RUN TestClonePathConfNil --- PASS: TestClonePathConfNil (0.00s) === RUN TestApplyBucketQuotaReadOnly --- PASS: TestApplyBucketQuotaReadOnly (0.00s) === RUN TestClearReadOnly --- PASS: TestClearReadOnly (0.00s) === RUN TestClearBucketLifecycleDayTTLs_NoFilerConf --- PASS: TestClearBucketLifecycleDayTTLs_NoFilerConf (0.00s) === RUN TestClearBucketLifecycleDayTTLs_NoMatchingRule --- PASS: TestClearBucketLifecycleDayTTLs_NoMatchingRule (0.00s) === RUN TestClearBucketLifecycleDayTTLs_RemovesDayTTLUnderBucket I1117 09:37:00.648755 filer_conf.go:468 lifecycle migration: dropping legacy day-TTL rule /buckets/mybucket/ ttl=7d --- PASS: TestClearBucketLifecycleDayTTLs_RemovesDayTTLUnderBucket (0.01s) === RUN TestClearBucketLifecycleDayTTLs_KeepsNonDayTTL --- PASS: TestClearBucketLifecycleDayTTLs_KeepsNonDayTTL (0.01s) === RUN TestClearBucketLifecycleDayTTLs_KeepsOperatorSettingsAndClearsOnlyTheTTL I1117 09:37:00.670672 filer_conf.go:471 lifecycle migration: clearing legacy day-TTL 30d on operator rule /buckets/mybucket/logs/ --- PASS: TestClearBucketLifecycleDayTTLs_KeepsOperatorSettingsAndClearsOnlyTheTTL (0.00s) === RUN TestClearBucketLifecycleDayTTLs_KeepsWormSettings I1117 09:37:00.675378 filer_conf.go:471 lifecycle migration: clearing legacy day-TTL 7d on operator rule /buckets/mybucket/locked/ --- PASS: TestClearBucketLifecycleDayTTLs_KeepsWormSettings (0.00s) === RUN TestClearBucketLifecycleDayTTLs_KeepsOtherBucketsAndCollections I1117 09:37:00.683445 filer_conf.go:468 lifecycle migration: dropping legacy day-TTL rule /buckets/mybucket/ ttl=7d --- PASS: TestClearBucketLifecycleDayTTLs_KeepsOtherBucketsAndCollections (0.01s) === RUN TestSaveFilerConfConditionally_RejectsUpdateModifiedConcurrently --- PASS: TestSaveFilerConfConditionally_RejectsUpdateModifiedConcurrently (0.00s) === RUN TestSaveFilerConfConditionally_ExactContentCheckRejectsConcurrentModification --- PASS: TestSaveFilerConfConditionally_ExactContentCheckRejectsConcurrentModification (0.01s) === RUN TestSaveFilerConfConditionally_RejectsCreateWhenCreatedConcurrently --- PASS: TestSaveFilerConfConditionally_RejectsCreateWhenCreatedConcurrently (0.00s) === RUN TestDeleteEntryMetaAndDataDeletesCollectionWhenTheRequestIsCancelledMidDelete I1117 09:37:01.022489 metrics.go:1258 delete bucket metrics, bucket-a: 0 --- PASS: TestDeleteEntryMetaAndDataDeletesCollectionWhenTheRequestIsCancelledMidDelete (0.34s) === RUN TestDeleteBucketKeepsSharedCollection I1117 09:37:01.172825 metrics.go:1258 delete bucket metrics, a: 0 --- PASS: TestDeleteBucketKeepsSharedCollection (0.13s) === RUN TestDeleteBucketNamedAfterSharedCollection I1117 09:37:01.394522 metrics.go:1258 delete bucket metrics, shared: 0 --- PASS: TestDeleteBucketNamedAfterSharedCollection (0.22s) === RUN TestDeleteBucketKeepsCollectionUsedByNonBucketPath I1117 09:37:01.701889 metrics.go:1258 delete bucket metrics, a: 0 --- PASS: TestDeleteBucketKeepsCollectionUsedByNonBucketPath (0.31s) === RUN TestDeleteBucketKeepsCollectionFromBroadRule I1117 09:37:01.745262 metrics.go:1258 delete bucket metrics, a: 0 --- PASS: TestDeleteBucketKeepsCollectionFromBroadRule (0.04s) === RUN TestDeleteBucketKeepsDefaultCollection I1117 09:37:01.925781 metrics.go:1258 delete bucket metrics, a: 0 --- PASS: TestDeleteBucketKeepsDefaultCollection (0.18s) === RUN TestDeleteBucketKeepsCollectionFromNestedSiblingRule I1117 09:37:02.159055 metrics.go:1258 delete bucket metrics, a: 0 --- PASS: TestDeleteBucketKeepsCollectionFromNestedSiblingRule (0.23s) === RUN TestDeleteBucketUnderFilerGroup I1117 09:37:02.390892 metrics.go:1258 delete bucket metrics, photos: 0 --- PASS: TestDeleteBucketUnderFilerGroup (0.23s) === RUN TestDeleteBucketDeletesResolvedCollection I1117 09:37:02.614805 metrics.go:1258 delete bucket metrics, only: 0 --- PASS: TestDeleteBucketDeletesResolvedCollection (0.22s) === RUN TestNonEmptyFolderClassification --- PASS: TestNonEmptyFolderClassification (0.00s) === RUN TestKeepRemoteObjectMarkerOnlyLivesOnDeleteEvents --- PASS: TestKeepRemoteObjectMarkerOnlyLivesOnDeleteEvents (0.12s) === RUN TestDeleteFolderFreesLastHardLinkChunks --- PASS: TestDeleteFolderFreesLastHardLinkChunks (0.04s) === RUN TestDeleteFolderKeepsSharedHardLinkChunks --- PASS: TestDeleteFolderKeepsSharedHardLinkChunks (0.11s) === RUN TestDeleteEntryMetaAndData_IfNotModifiedAfterSubsecond --- PASS: TestDeleteEntryMetaAndData_IfNotModifiedAfterSubsecond (0.11s) === RUN TestDeletionLedgerSnapshotAndRecover I1117 09:37:03.018781 filer_deletion_persist.go:740 recovered 2 pending deletions from ledger, applying in 0s I1117 09:37:03.020034 filer_deletion_persist.go:755 re-queued 2 recovered pending deletions --- PASS: TestDeletionLedgerSnapshotAndRecover (0.02s) === RUN TestDeletionLedgerRetryKeepsEntry --- PASS: TestDeletionLedgerRetryKeepsEntry (0.00s) === RUN TestDeletionLedgerDisabled --- PASS: TestDeletionLedgerDisabled (0.00s) === RUN TestDeletionLedgerScopedPerFiler I1117 09:37:03.040573 filer_deletion_persist.go:740 recovered 1 pending deletions from ledger, applying in 30s --- PASS: TestDeletionLedgerScopedPerFiler (0.00s) === RUN TestDeletionLedgerChunked I1117 09:37:03.151572 filer_deletion_persist.go:740 recovered 4000 pending deletions from ledger, applying in 30s --- PASS: TestDeletionLedgerChunked (0.13s) === RUN TestDeletionLedgerReadFailureBlocksPersistence W1117 09:37:03.177056 filer_deletion_persist.go:707 failed to read persisted deletion ledger; persistence disabled until it reads: kv read down W1117 09:37:03.177504 filer_deletion_persist.go:707 failed to read persisted deletion ledger; persistence disabled until it reads: kv read down --- PASS: TestDeletionLedgerReadFailureBlocksPersistence (0.00s) === RUN TestDeletionLedgerRecoveryKeepsIdsPending I1117 09:37:03.179736 filer_deletion_persist.go:740 recovered 2 pending deletions from ledger, applying in 1h0m0s --- PASS: TestDeletionLedgerRecoveryKeepsIdsPending (0.00s) === RUN TestDeletionLedgerZeroValueFiler --- PASS: TestDeletionLedgerZeroValueFiler (0.00s) === RUN TestDeletionLedgerMissingPartBlocks W1117 09:37:03.183130 filer_deletion_persist.go:707 failed to read persisted deletion ledger; persistence disabled until it reads: deletion ledger part 1 of filer.deleteQueue.ledger.v1 unreadable: kv: not found W1117 09:37:03.183724 filer_deletion_persist.go:707 failed to read persisted deletion ledger; persistence disabled until it reads: deletion ledger part 1 of filer.deleteQueue.ledger.v1 unreadable: kv: not found --- PASS: TestDeletionLedgerMissingPartBlocks (0.00s) === RUN TestDeletionLedgerAddressChangeClaim I1117 09:37:03.187706 filer_deletion_persist.go:740 recovered 2 pending deletions from ledger, applying in 30s --- PASS: TestDeletionLedgerAddressChangeClaim (0.01s) === RUN TestDeletionLedgerGenerationPublish --- PASS: TestDeletionLedgerGenerationPublish (0.09s) === RUN TestDeletionLedgerStalePartsRetried --- PASS: TestDeletionLedgerStalePartsRetried (0.10s) === RUN TestDeletionLedgerLegacyMigrationDurable I1117 09:37:03.384760 filer_deletion_persist.go:740 recovered 2 pending deletions from ledger, applying in 30s --- PASS: TestDeletionLedgerLegacyMigrationDurable (0.01s) === RUN TestDeletionLedgerUnreadableForeignBlocks W1117 09:37:03.387398 filer_deletion_persist.go:707 failed to read persisted deletion ledger; persistence disabled until it reads: deletion ledger filer.deleteQueue.ledger.v1.filer-old:8888 unreadable: deletion ledger part 0 of filer.deleteQueue.ledger.v1.filer-old:8888 unreadable: kv: not found --- PASS: TestDeletionLedgerUnreadableForeignBlocks (0.00s) === RUN TestDeletionLedgerClaimKeepsChangedSource I1117 09:37:03.390242 filer_deletion_persist.go:629 deletion ledger filer.deleteQueue.ledger.v1.filer-old:8888 changed while claiming; leaving it for its owner I1117 09:37:03.392623 filer_deletion_persist.go:740 recovered 3 pending deletions from ledger, applying in 30s --- PASS: TestDeletionLedgerClaimKeepsChangedSource (0.00s) === RUN TestForgetDeletionEpochSkipsNewer --- PASS: TestForgetDeletionEpochSkipsNewer (0.00s) === RUN TestDeletionRetryQueue_AddAndRetrieve --- PASS: TestDeletionRetryQueue_AddAndRetrieve (0.00s) === RUN TestDeletionRetryQueue_ExponentialBackoff filer_deletion_test.go:80: Exponential backoff delays: [5m0.000101428s 10m0.000017039s 20m0.00000211s 40m0.00000201s 1h20m0.000002s] --- PASS: TestDeletionRetryQueue_ExponentialBackoff (0.00s) === RUN TestDeletionRetryQueue_OverflowProtection --- PASS: TestDeletionRetryQueue_OverflowProtection (0.00s) === RUN TestDeletionRetryQueue_MaxAttemptsReached W1117 09:37:03.400149 filer_deletion.go:258 max retry attempts (10) reached for file1, last error: final error --- PASS: TestDeletionRetryQueue_MaxAttemptsReached (0.00s) === RUN TestCalculateBackoff --- PASS: TestCalculateBackoff (0.00s) === RUN TestIsRetryableError --- PASS: TestIsRetryableError (0.00s) === RUN TestDeletionRetryQueue_HeapOrdering --- PASS: TestDeletionRetryQueue_HeapOrdering (0.00s) === RUN TestDeletionRetryQueue_DuplicateFileIds --- PASS: TestDeletionRetryQueue_DuplicateFileIds (0.00s) === RUN TestDeletionRetryQueue_InFlightKeepsEpoch --- PASS: TestDeletionRetryQueue_InFlightKeepsEpoch (0.00s) === RUN TestEnsureEntryInodeMatchesFuseDerivation --- PASS: TestEnsureEntryInodeMatchesFuseDerivation (0.00s) === RUN TestEnsureEntryInodeSharesAcrossHardLinks --- PASS: TestEnsureEntryInodeSharesAcrossHardLinks (0.00s) === RUN TestEnsureEntryInodeFitsSignedLong --- PASS: TestEnsureEntryInodeFitsSignedLong (0.12s) === RUN TestEnsureEntryInodeHardLinkFitsSignedLong --- PASS: TestEnsureEntryInodeHardLinkFitsSignedLong (0.16s) === RUN TestCreateEntryAssignsInodeWhenMissing I1117 09:37:03.719824 filer_deletion.go:317 deletion processor shutting down I1117 09:37:03.720123 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:03.734949 filer_notify.go:375 metadata log write failed /topics/.system/log/2026-11-17/09-37.23ac156f: AssignVolume: context canceled I1117 09:37:03.735773 filer_notify.go:384 metadata log flush abandoned during shutdown, 266 bytes left for /topics/.system/log/2026-11-17/09-37.23ac156f: context canceled W1117 09:37:03.736047 log_buffer.go:828 log buffer local: shutdown flush dropped 266 bytes --- PASS: TestCreateEntryAssignsInodeWhenMissing (0.05s) === RUN TestCreateEntryAssignsInodesToAutoCreatedParents I1117 09:37:03.830999 filer_deletion.go:317 deletion processor shutting down I1117 09:37:03.831151 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:03.833304 filer_notify.go:375 metadata log write failed /topics/.system/log/2026-11-17/09-37.198095a8: AssignVolume: context canceled I1117 09:37:03.833621 filer_notify.go:384 metadata log flush abandoned during shutdown, 388 bytes left for /topics/.system/log/2026-11-17/09-37.198095a8: context canceled W1117 09:37:03.833791 log_buffer.go:828 log buffer local: shutdown flush dropped 388 bytes --- PASS: TestCreateEntryAssignsInodesToAutoCreatedParents (0.10s) === RUN TestCreateEntryOExclPreservesExistingEntry --- PASS: TestCreateEntryOExclPreservesExistingEntry (0.09s) I1117 09:37:03.920229 filer_deletion.go:317 deletion processor shutting down === RUN TestCreateEntryOExclFailsOnLookupError I1117 09:37:03.920453 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:04.013364 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:04.013987 filer_deletion.go:317 deletion processor shutting down --- PASS: TestCreateEntryOExclFailsOnLookupError (0.09s) === RUN TestUpdateEntryPreservesExistingInode I1117 09:37:04.092885 filer_deletion.go:317 deletion processor shutting down --- PASS: TestUpdateEntryPreservesExistingInode (0.08s) I1117 09:37:04.092944 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue === RUN TestUpdateEntryBackfillsMissingLegacyInode I1117 09:37:04.193194 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestUpdateEntryBackfillsMissingLegacyInode (0.10s) I1117 09:37:04.193505 filer_deletion.go:317 deletion processor shutting down === RUN TestCreateEntryFailsWhenLookupErrors I1117 09:37:04.300612 filer_deletion.go:317 deletion processor shutting down --- PASS: TestCreateEntryFailsWhenLookupErrors (0.11s) I1117 09:37:04.300634 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue === RUN TestMaybeLazyFetchFromRemote_HitsRemoteAndPersists --- PASS: TestMaybeLazyFetchFromRemote_HitsRemoteAndPersists (0.14s) === RUN TestMaybeLazyFetchFromRemote_PersistsParentDirectories --- PASS: TestMaybeLazyFetchFromRemote_PersistsParentDirectories (0.13s) === RUN TestMaybeLazyFetchFromRemote_ParentLookupStopsAtStoreError E1117 09:37:04.690981 filer.go:582 create parent directories of /buckets/mybucket/a/b/file.bin: store unavailable W1117 09:37:04.691761 filer_lazy_remote.go:139 maybeLazyFetchFromRemote: failed to persist filer entry for /buckets/mybucket/a/b/file.bin: store unavailable --- PASS: TestMaybeLazyFetchFromRemote_ParentLookupStopsAtStoreError (0.12s) === RUN TestMaybeLazyFetchFromRemote_PromotesRemoteObjectAtParentKey --- PASS: TestMaybeLazyFetchFromRemote_PromotesRemoteObjectAtParentKey (0.06s) === RUN TestMaybeLazyFetchFromRemote_StatsEachParentOnce --- PASS: TestMaybeLazyFetchFromRemote_StatsEachParentOnce (0.11s) === RUN TestMaybeLazyListFromRemote_PersistsParentDirectories --- PASS: TestMaybeLazyListFromRemote_PersistsParentDirectories (0.07s) === RUN TestDeleteEntryMetaAndData_EmptyFolderUnderMountKeepsRemotePrefix --- PASS: TestDeleteEntryMetaAndData_EmptyFolderUnderMountKeepsRemotePrefix (0.08s) === RUN TestDeleteEmptyParentDirectories_UnderMountKeepsRemotePrefix --- PASS: TestDeleteEmptyParentDirectories_UnderMountKeepsRemotePrefix (0.10s) === RUN TestIsUnderRemoteMount --- PASS: TestIsUnderRemoteMount (0.06s) === RUN TestMaybeLazyFetchFromRemote_NotUnderMount --- PASS: TestMaybeLazyFetchFromRemote_NotUnderMount (0.08s) === RUN TestMaybeLazyFetchFromRemote_RemoteObjectNotFound --- PASS: TestMaybeLazyFetchFromRemote_RemoteObjectNotFound (0.10s) === RUN TestMaybeLazyFetchFromRemote_CreateEntryFailureReturnsInMemoryEntry E1117 09:37:05.442978 filer.go:567 insert entry /buckets/mybucket/failfile.txt: simulated store failure W1117 09:37:05.443754 filer_lazy_remote.go:139 maybeLazyFetchFromRemote: failed to persist filer entry for /buckets/mybucket/failfile.txt: insert entry /buckets/mybucket/failfile.txt: simulated store failure --- PASS: TestMaybeLazyFetchFromRemote_CreateEntryFailureReturnsInMemoryEntry (0.08s) === RUN TestMaybeLazyFetchFromRemote_LongestPrefixMount --- PASS: TestMaybeLazyFetchFromRemote_LongestPrefixMount (0.09s) === RUN TestMaybeLazyFetchFromRemote_ContextGuardPreventsRecursion --- PASS: TestMaybeLazyFetchFromRemote_ContextGuardPreventsRecursion (0.10s) === RUN TestCreateEntry_SkipsTheLazyFetchInsideAStoreTransaction --- PASS: TestCreateEntry_SkipsTheLazyFetchInsideAStoreTransaction (0.11s) === RUN TestMaybeLazyFetchFromRemote_GuardedClientRejectsEndpoint --- PASS: TestMaybeLazyFetchFromRemote_GuardedClientRejectsEndpoint (0.11s) === RUN TestMaybeLazyListFromRemote_GuardedClientRejectsEndpoint --- PASS: TestMaybeLazyListFromRemote_GuardedClientRejectsEndpoint (0.11s) === RUN TestDeleteEntryMetaAndData_GuardedClientRejectsRemoteBackedFile --- PASS: TestDeleteEntryMetaAndData_GuardedClientRejectsRemoteBackedFile (0.11s) === RUN TestDeleteEntryMetaAndData_GuardedClientAllowsLocalOnlyFile --- PASS: TestDeleteEntryMetaAndData_GuardedClientAllowsLocalOnlyFile (0.10s) === RUN TestFindEntry_LazyFetchOnMiss --- PASS: TestFindEntry_LazyFetchOnMiss (0.11s) === RUN TestDeleteEntryMetaAndData_RemoteOnlyFileDeletesRemoteAndMetadata --- PASS: TestDeleteEntryMetaAndData_RemoteOnlyFileDeletesRemoteAndMetadata (0.06s) === RUN TestDeleteEntryMetaAndData_IsFromOtherClusterSkipsRemoteDelete --- PASS: TestDeleteEntryMetaAndData_IsFromOtherClusterSkipsRemoteDelete (0.11s) === RUN TestDeleteEntryMetaAndData_UnmountedDirectorySkipsRemoteDelete --- PASS: TestDeleteEntryMetaAndData_UnmountedDirectorySkipsRemoteDelete (0.05s) === RUN TestDeleteEntryMetaAndData_RemoteOnlyFileNotUnderMountSkipsRemoteDelete --- PASS: TestDeleteEntryMetaAndData_RemoteOnlyFileNotUnderMountSkipsRemoteDelete (0.10s) === RUN TestDeleteEntryMetaAndData_RemoteMountWithoutClientResolutionKeepsMetadata --- PASS: TestDeleteEntryMetaAndData_RemoteMountWithoutClientResolutionKeepsMetadata (0.10s) === RUN TestDeleteEntryMetaAndData_LocalDeleteFailurePreservesMetadata --- PASS: TestDeleteEntryMetaAndData_LocalDeleteFailurePreservesMetadata (0.07s) === RUN TestDeleteEntryMetaAndData_RemoteDeleteNotFoundStillDeletesMetadata --- PASS: TestDeleteEntryMetaAndData_RemoteDeleteNotFoundStillDeletesMetadata (0.08s) === RUN TestDeleteEntryMetaAndData_RemoteDeleteErrorKeepsMetadata --- PASS: TestDeleteEntryMetaAndData_RemoteDeleteErrorKeepsMetadata (0.11s) === RUN TestDeleteEntryMetaAndData_DirectoryUnderMountDeletesRemoteDirectory --- PASS: TestDeleteEntryMetaAndData_DirectoryUnderMountDeletesRemoteDirectory (0.10s) === RUN TestDeleteEntryMetaAndData_RecursiveFolderDeleteRemotesChildren --- PASS: TestDeleteEntryMetaAndData_RecursiveFolderDeleteRemotesChildren (0.11s) === RUN TestMaybeLazyListFromRemote_PopulatesStoreFromRemote --- PASS: TestMaybeLazyListFromRemote_PopulatesStoreFromRemote (0.11s) === RUN TestMaybeLazyListFromRemote_DisabledWhenTTLZero --- PASS: TestMaybeLazyListFromRemote_DisabledWhenTTLZero (0.11s) === RUN TestMaybeLazyListFromRemote_TTLCachePreventsSecondCall --- PASS: TestMaybeLazyListFromRemote_TTLCachePreventsSecondCall (0.10s) === RUN TestMaybeLazyListFromRemote_NotUnderMount --- PASS: TestMaybeLazyListFromRemote_NotUnderMount (0.08s) === RUN TestMaybeLazyListFromRemote_SkipsLocalOnlyEntries --- PASS: TestMaybeLazyListFromRemote_SkipsLocalOnlyEntries (0.08s) === RUN TestMaybeLazyListFromRemote_MergesExistingRemoteEntry --- PASS: TestMaybeLazyListFromRemote_MergesExistingRemoteEntry (0.11s) === RUN TestMaybeLazyListFromRemote_ContextGuardPreventsRecursion --- PASS: TestMaybeLazyListFromRemote_ContextGuardPreventsRecursion (0.10s) === RUN TestMetaLogPieceUploadsCompressed --- PASS: TestMetaLogPieceUploadsCompressed (1.02s) === RUN TestMetaLogPieceUploadsIncompressibleAsIs --- PASS: TestMetaLogPieceUploadsIncompressibleAsIs (0.09s) === RUN TestCommitAppendedChunkReleasesChunkWhenCommitFails E1117 09:37:09.118153 filer.go:567 insert entry /topics/.system/log/2026-11-05/10-00.00000001: store unavailable --- PASS: TestCommitAppendedChunkReleasesChunkWhenCommitFails (0.11s) === RUN TestCommitAppendedChunkReleasesChunkWhenLookupFails --- PASS: TestCommitAppendedChunkReleasesChunkWhenLookupFails (0.06s) === RUN TestCommitAppendedChunkKeepsChunkTheFailedCreateStored E1117 09:37:09.227948 filer.go:582 create parent directories of /topics/.system/log/2026-11-05/10-00.00000001: store unavailable I1117 09:37:09.230114 filer_notify_append.go:65 append to /topics/.system/log/2026-11-05/10-00.00000001 landed despite: store unavailable --- PASS: TestCommitAppendedChunkKeepsChunkTheFailedCreateStored (0.05s) === RUN TestCommitAppendedChunkAppendsAfterExistingChunks --- PASS: TestCommitAppendedChunkAppendsAfterExistingChunks (0.01s) === RUN TestResolveMetadataLogAssignDiskTypeUsesPathRule --- PASS: TestResolveMetadataLogAssignDiskTypeUsesPathRule (0.00s) === RUN TestResolveMetadataLogAssignDiskTypeFallsBackToFilerDefault --- PASS: TestResolveMetadataLogAssignDiskTypeFallsBackToFilerDefault (0.00s) === RUN TestResolveMetadataLogAssignDiskTypeNilFilerConf --- PASS: TestResolveMetadataLogAssignDiskTypeNilFilerConf (0.00s) === RUN TestMetaLogInflightFloor --- PASS: TestMetaLogInflightFloor (0.00s) === RUN TestLocalFlushedThroughTsNsBoundsInflight --- PASS: TestLocalFlushedThroughTsNsBoundsInflight (0.00s) === RUN TestLocalDeliveredThroughTsNsBoundsInflight --- PASS: TestLocalDeliveredThroughTsNsBoundsInflight (0.01s) === RUN TestClaimFencesFutureStamps --- PASS: TestClaimFencesFutureStamps (0.05s) === RUN TestMetaLogInflightStampMonotonic --- PASS: TestMetaLogInflightStampMonotonic (0.00s) === RUN TestPersistedLogScanStartCoversSpanningWindow --- PASS: TestPersistedLogScanStartCoversSpanningWindow (0.00s) === RUN TestPersistedLogScanStartCrossesMidnight --- PASS: TestPersistedLogScanStartCrossesMidnight (0.00s) === RUN TestSpanningLogFileIsNotSkipped --- PASS: TestSpanningLogFileIsNotSkipped (0.00s) === RUN TestClampLogRefsCursorNeverRewinds --- PASS: TestClampLogRefsCursorNeverRewinds (0.00s) === RUN TestPersistedLogScanStartTsNsMinuteAligned --- PASS: TestPersistedLogScanStartTsNsMinuteAligned (0.00s) === RUN TestLastShippedLogEntryTsNs === RUN TestLastShippedLogEntryTsNs/a_fully_readable_file_answers_with_its_tail,_complete === RUN TestLastShippedLogEntryTsNs/the_prefix_ends_at_the_first_missing_chunk === RUN TestLastShippedLogEntryTsNs/nothing_readable_is_a_clean_no-answer === RUN TestLastShippedLogEntryTsNs/an_entirely_missing_last_file_falls_back_to_earlier_files === RUN TestLastShippedLogEntryTsNs/a_cached_chunk_on_a_dead_volume_ends_the_prefix === RUN TestLastShippedLogEntryTsNs/a_dead_needle_behind_a_warm_cache_is_the_accepted_residual === RUN TestLastShippedLogEntryTsNs/spanning_records_stream_the_shipped_list --- PASS: TestLastShippedLogEntryTsNs (0.01s) --- PASS: TestLastShippedLogEntryTsNs/a_fully_readable_file_answers_with_its_tail,_complete (0.00s) --- PASS: TestLastShippedLogEntryTsNs/the_prefix_ends_at_the_first_missing_chunk (0.00s) --- PASS: TestLastShippedLogEntryTsNs/nothing_readable_is_a_clean_no-answer (0.00s) --- PASS: TestLastShippedLogEntryTsNs/an_entirely_missing_last_file_falls_back_to_earlier_files (0.00s) --- PASS: TestLastShippedLogEntryTsNs/a_cached_chunk_on_a_dead_volume_ends_the_prefix (0.00s) --- PASS: TestLastShippedLogEntryTsNs/a_dead_needle_behind_a_warm_cache_is_the_accepted_residual (0.00s) --- PASS: TestLastShippedLogEntryTsNs/spanning_records_stream_the_shipped_list (0.00s) === RUN TestNotifyRenameTargetWakesDestinationSubscribers --- PASS: TestNotifyRenameTargetWakesDestinationSubscribers (0.10s) === RUN TestProtoMarshal x to: 234,2423423422ú¥ê ç¾ï* 2342342354223234,2342342342"6ÅÀðפ 0€’¸Øþÿÿÿ: text/jsonP�€’¸Øþÿÿÿ˜Çä†Í --- PASS: TestProtoMarshal (0.00s) === RUN TestNextLogPiece === RUN TestNextLogPiece/fits_in_one_piece === RUN TestNextLogPiece/many_small_records === RUN TestNextLogPiece/one_record_far_over_the_limit === RUN TestNextLogPiece/oversized_record_between_small_ones === RUN TestNextLogPiece/record_exactly_at_the_limit --- PASS: TestNextLogPiece (0.01s) --- PASS: TestNextLogPiece/fits_in_one_piece (0.00s) --- PASS: TestNextLogPiece/many_small_records (0.00s) --- PASS: TestNextLogPiece/one_record_far_over_the_limit (0.00s) --- PASS: TestNextLogPiece/oversized_record_between_small_ones (0.00s) --- PASS: TestNextLogPiece/record_exactly_at_the_limit (0.00s) === RUN TestNextLogPieceKeepsRecordBoundaries --- PASS: TestNextLogPieceKeepsRecordBoundaries (0.00s) === RUN TestNextLogPieceTruncatedTail --- PASS: TestNextLogPieceTruncatedTail (0.00s) === RUN TestVolumeFileSizeLimit === RUN TestVolumeFileSizeLimit/volume_server_size_rejection === RUN TestVolumeFileSizeLimit/default_limit === RUN TestVolumeFileSizeLimit/unrelated_failure === RUN TestVolumeFileSizeLimit/no_byte_count --- PASS: TestVolumeFileSizeLimit (0.00s) --- PASS: TestVolumeFileSizeLimit/volume_server_size_rejection (0.00s) --- PASS: TestVolumeFileSizeLimit/default_limit (0.00s) --- PASS: TestVolumeFileSizeLimit/unrelated_failure (0.00s) --- PASS: TestVolumeFileSizeLimit/no_byte_count (0.00s) === RUN TestNextLogPieceHonorsLoweredLimit I1117 09:37:10.245051 filer_deletion.go:410 failed to delete 1/1 files (1 retryable, 0 permanent): 7,0abc: no deletion result from volume server (will retry) I1117 09:37:10.301533 filer_deletion.go:410 failed to delete 1/1 files (1 retryable, 0 permanent): 7,0abc: no deletion result from volume server (will retry) --- PASS: TestNextLogPieceHonorsLoweredLimit (1.97s) === RUN TestOnBucketEventsRenameIntoBucketsRootCreatesBucket --- PASS: TestOnBucketEventsRenameIntoBucketsRootCreatesBucket (0.00s) === RUN TestPromoteToPrefixObject I1117 09:37:11.520191 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:11.520330 filer_deletion.go:317 deletion processor shutting down I1117 09:37:11.525265 filer_notify.go:375 metadata log write failed /topics/.system/log/2026-11-17/09-37.139fa724: AssignVolume: context canceled I1117 09:37:11.525709 filer_notify.go:384 metadata log flush abandoned during shutdown, 1090 bytes left for /topics/.system/log/2026-11-17/09-37.139fa724: context canceled W1117 09:37:11.525886 log_buffer.go:828 log buffer local: shutdown flush dropped 1090 bytes --- PASS: TestPromoteToPrefixObject (0.10s) === RUN TestPrefixObjectKeepsDirectoryAttributes I1117 09:37:11.611334 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:11.611401 filer_deletion.go:317 deletion processor shutting down I1117 09:37:11.612890 filer_notify.go:375 metadata log write failed /topics/.system/log/2026-11-17/09-37.602a1587: AssignVolume: context canceled I1117 09:37:11.613145 filer_notify.go:384 metadata log flush abandoned during shutdown, 342 bytes left for /topics/.system/log/2026-11-17/09-37.602a1587: context canceled W1117 09:37:11.613318 log_buffer.go:828 log buffer local: shutdown flush dropped 342 bytes --- PASS: TestPrefixObjectKeepsDirectoryAttributes (0.09s) === RUN TestExpiredDirectoryIsNotDeletedOnRead --- PASS: TestExpiredDirectoryIsNotDeletedOnRead (0.08s) I1117 09:37:11.697523 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:11.697566 filer_deletion.go:317 deletion processor shutting down === RUN TestExpiredFileIsDeletedOnRead --- PASS: TestExpiredFileIsDeletedOnRead (0.09s) I1117 09:37:11.785673 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:11.785723 filer_deletion.go:317 deletion processor shutting down === RUN TestListDirectoryEntriesContextCanceled --- PASS: TestListDirectoryEntriesContextCanceled (0.10s) I1117 09:37:11.883837 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue === RUN TestIsEvictableRemoteEntry I1117 09:37:11.883875 filer_deletion.go:317 deletion processor shutting down --- PASS: TestIsEvictableRemoteEntry (0.00s) === RUN TestListEvictableRemoteEntries --- PASS: TestListEvictableRemoteEntries (0.10s) === RUN TestUpdateEntryInvalidatesStaleSyncStamp === RUN TestUpdateEntryInvalidatesStaleSyncStamp/local_chunk_change_clears_stamp === RUN TestUpdateEntryInvalidatesStaleSyncStamp/metadata-only_update_keeps_stamp === RUN TestUpdateEntryInvalidatesStaleSyncStamp/fresh_sync_stamp_survives_chunk_change === RUN TestUpdateEntryInvalidatesStaleSyncStamp/replicated_update_keeps_authoritative_stamp --- PASS: TestUpdateEntryInvalidatesStaleSyncStamp (0.40s) --- PASS: TestUpdateEntryInvalidatesStaleSyncStamp/local_chunk_change_clears_stamp (0.09s) --- PASS: TestUpdateEntryInvalidatesStaleSyncStamp/metadata-only_update_keeps_stamp (0.09s) --- PASS: TestUpdateEntryInvalidatesStaleSyncStamp/fresh_sync_stamp_survives_chunk_change (0.10s) --- PASS: TestUpdateEntryInvalidatesStaleSyncStamp/replicated_update_keeps_authoritative_stamp (0.10s) === RUN TestRemoteDeletionTombstones_BlocksAndReleases --- PASS: TestRemoteDeletionTombstones_BlocksAndReleases (0.00s) === RUN TestRemoteDeletionTombstones_AncestorSubsumesAndCovers --- PASS: TestRemoteDeletionTombstones_AncestorSubsumesAndCovers (0.00s) === RUN TestRemoteDeletionTombstones_PendingIgnoresOffset --- PASS: TestRemoteDeletionTombstones_PendingIgnoresOffset (0.10s) === RUN TestRemoteDeletionTombstones_OffsetMustPassDeliveryPosition --- PASS: TestRemoteDeletionTombstones_OffsetMustPassDeliveryPosition (0.06s) === RUN TestRemoteDeletionTombstones_RaisedLocalTombstoneIsPendingAgain --- PASS: TestRemoteDeletionTombstones_RaisedLocalTombstoneIsPendingAgain (0.00s) === RUN TestMaybeLazyFetchFromRemote_FullTableKeepsTheFetchOff I1117 09:37:12.641528 filer_remote_tombstone.go:212 remote deletion tombstones full (2), lazy remote fetch off until the table has room and the unrecorded deletes age out; first skipped /buckets/mybucket/dir/c.txt --- PASS: TestMaybeLazyFetchFromRemote_FullTableKeepsTheFetchOff (0.11s) === RUN TestMaybeLazyFetchFromRemote_FullTableDrainsOnReads I1117 09:37:12.654117 filer_remote_tombstone.go:212 remote deletion tombstones full (3), lazy remote fetch off until the table has room and the unrecorded deletes age out; first skipped /buckets/mybucket/dir/c.txt --- PASS: TestMaybeLazyFetchFromRemote_FullTableDrainsOnReads (0.01s) === RUN TestMaybeLazyFetchFromRemote_SkipsTombstonedPath --- PASS: TestMaybeLazyFetchFromRemote_SkipsTombstonedPath (0.00s) === RUN TestMaybeLazyFetchFromRemote_NewerRemoteMtimeStillBlocked --- PASS: TestMaybeLazyFetchFromRemote_NewerRemoteMtimeStillBlocked (0.01s) === RUN TestMaybeLazyFetchFromRemote_SyncOffsetReleasesTombstone --- PASS: TestMaybeLazyFetchFromRemote_SyncOffsetReleasesTombstone (0.01s) === RUN TestDeleteEntryMetaAndData_TombstonesPath --- PASS: TestDeleteEntryMetaAndData_TombstonesPath (0.10s) === RUN TestOnMetadataChangeEvent_MetadataOnlyDeleteSkipsTombstone --- PASS: TestOnMetadataChangeEvent_MetadataOnlyDeleteSkipsTombstone (0.09s) === RUN TestOnMetadataChangeEvent_PeerDeleteTombstones --- PASS: TestOnMetadataChangeEvent_PeerDeleteTombstones (0.09s) === RUN TestOnMetadataChangeEvent_PeerDirDeleteTombstonesSubtree --- PASS: TestOnMetadataChangeEvent_PeerDirDeleteTombstonesSubtree (0.09s) === RUN TestMaybeLazyListFromRemote_SkipsTombstonedChild --- PASS: TestMaybeLazyListFromRemote_SkipsTombstonedChild (0.10s) === RUN TestMaybeLazyListFromRemote_RecreatedDirStillHidesChildren --- PASS: TestMaybeLazyListFromRemote_RecreatedDirStillHidesChildren (0.10s) === RUN TestRemoteDeletionRebuildStartTsNs_UsesOldestMountOffset W1117 09:37:13.371572 filer_remote_tombstone.go:545 read remote sync offset for /buckets/other: kv: not found --- PASS: TestRemoteDeletionRebuildStartTsNs_UsesOldestMountOffset (0.10s) === RUN TestRebuildRemoteDeletionTombstones_EmptyLogReleasesGate W1117 09:37:13.476549 filer_remote_tombstone.go:545 read remote sync offset for /buckets/mybucket: kv: not found --- PASS: TestRebuildRemoteDeletionTombstones_EmptyLogReleasesGate (0.11s) === RUN TestMaybeLazyFetchFromRemote_WaitsForRebuild --- PASS: TestMaybeLazyFetchFromRemote_WaitsForRebuild (0.15s) === RUN TestDetectBucket === RUN TestDetectBucket/object_in_bucket === RUN TestDetectBucket/bucket_root === RUN TestDetectBucket/not_under_buckets_path === RUN TestDetectBucket/buckets_path_itself === RUN TestDetectBucket/custom_buckets_path === RUN TestDetectBucket/nested_object --- PASS: TestDetectBucket (0.00s) --- PASS: TestDetectBucket/object_in_bucket (0.00s) --- PASS: TestDetectBucket/bucket_root (0.00s) --- PASS: TestDetectBucket/not_under_buckets_path (0.00s) --- PASS: TestDetectBucket/buckets_path_itself (0.00s) --- PASS: TestDetectBucket/custom_buckets_path (0.00s) --- PASS: TestDetectBucket/nested_object (0.00s) === RUN TestCanRenameIntoItself === RUN TestCanRenameIntoItself/into_itself === RUN TestCanRenameIntoItself/into_a_child === RUN TestCanRenameIntoItself/into_a_deeper_descendant === RUN TestCanRenameIntoItself/into_a_child_with_a_trailing_slash === RUN TestCanRenameIntoItself/old_name_with_a_trailing_slash_into_a_child === RUN TestCanRenameIntoItself/into_a_sibling_sharing_the_name_prefix === RUN TestCanRenameIntoItself/into_a_descendant_of_that_sibling === RUN TestCanRenameIntoItself/into_the_parent === RUN TestCanRenameIntoItself/into_an_unrelated_directory I1117 09:37:13.739371 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestCanRenameIntoItself (0.10s) --- PASS: TestCanRenameIntoItself/into_itself (0.00s) --- PASS: TestCanRenameIntoItself/into_a_child (0.00s) --- PASS: TestCanRenameIntoItself/into_a_deeper_descendant (0.00s) --- PASS: TestCanRenameIntoItself/into_a_child_with_a_trailing_slash (0.00s) --- PASS: TestCanRenameIntoItself/old_name_with_a_trailing_slash_into_a_child (0.00s) --- PASS: TestCanRenameIntoItself/into_a_sibling_sharing_the_name_prefix (0.00s) --- PASS: TestCanRenameIntoItself/into_a_descendant_of_that_sibling (0.00s) --- PASS: TestCanRenameIntoItself/into_the_parent (0.00s) --- PASS: TestCanRenameIntoItself/into_an_unrelated_directory (0.00s) I1117 09:37:13.739554 filer_deletion.go:317 deletion processor shutting down === RUN TestShutdownKeepsStoreOpenUntilMetadataIsFlushed --- PASS: TestShutdownKeepsStoreOpenUntilMetadataIsFlushed (0.10s) === RUN TestShutdownBoundsBlockedMetadataFlush W0101 00:00:15.000000 log_buffer.go:828 log buffer blocked flush: shutdown flush dropped 46 bytes --- PASS: TestShutdownBoundsBlockedMetadataFlush (0.05s) === RUN TestFilerStoreWrapperMimeNormalization === RUN TestFilerStoreWrapperMimeNormalization/files_strip_octet-stream/insert === RUN TestFilerStoreWrapperMimeNormalization/files_strip_octet-stream/update === RUN TestFilerStoreWrapperMimeNormalization/directories_keep_octet-stream/insert === RUN TestFilerStoreWrapperMimeNormalization/directories_keep_octet-stream/update --- PASS: TestFilerStoreWrapperMimeNormalization (0.01s) --- PASS: TestFilerStoreWrapperMimeNormalization/files_strip_octet-stream/insert (0.00s) --- PASS: TestFilerStoreWrapperMimeNormalization/files_strip_octet-stream/update (0.00s) --- PASS: TestFilerStoreWrapperMimeNormalization/directories_keep_octet-stream/insert (0.00s) --- PASS: TestFilerStoreWrapperMimeNormalization/directories_keep_octet-stream/update (0.00s) === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/InsertEntry/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/InsertEntry/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/InsertEntryKnownAbsent/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/InsertEntryKnownAbsent/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/UpdateEntry/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/UpdateEntry/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteEntry/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteEntry/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteOneEntry/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteOneEntry/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteFolderChildren/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteFolderChildren/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/BeginTransaction/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/BeginTransaction/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/CommitTransaction/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/CommitTransaction/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/KvPut/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/KvPut/deadline_exceeded === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/KvDelete/cancelled === RUN TestFilerStoreWrapperWriteOpsRejectCancelledContext/KvDelete/deadline_exceeded --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext (0.02s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/InsertEntry/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/InsertEntry/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/InsertEntryKnownAbsent/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/InsertEntryKnownAbsent/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/UpdateEntry/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/UpdateEntry/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteEntry/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteEntry/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteOneEntry/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteOneEntry/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteFolderChildren/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/DeleteFolderChildren/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/BeginTransaction/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/BeginTransaction/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/CommitTransaction/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/CommitTransaction/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/KvPut/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/KvPut/deadline_exceeded (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/KvDelete/cancelled (0.00s) --- PASS: TestFilerStoreWrapperWriteOpsRejectCancelledContext/KvDelete/deadline_exceeded (0.00s) === RUN TestFilerStoreWrapperWriteOpsSucceedWithActiveContext --- PASS: TestFilerStoreWrapperWriteOpsSucceedWithActiveContext (0.00s) === RUN TestFilerStoreWrapperReadOpsSucceedWithCancelledContext --- PASS: TestFilerStoreWrapperReadOpsSucceedWithCancelledContext (0.00s) === RUN TestFilerStoreWrapperRollbackSucceedsWithCancelledContext --- PASS: TestFilerStoreWrapperRollbackSucceedsWithCancelledContext (0.00s) === RUN TestPrefixFilterEntriesCursorStaysAtLastDelivered --- PASS: TestPrefixFilterEntriesCursorStaysAtLastDelivered (0.00s) === RUN TestIntervalList_Overlay [0,25) 6 6 [25,50) 1 1 [50,150) 2 2 [175,210) 5 5 [210,225) 3 3 [225,250) 4 4 [0,25) 6 6 [25,50) 1 1 [50,150) 7 7 [175,210) 5 5 [210,225) 3 3 [225,250) 4 4 --- PASS: TestIntervalList_Overlay (0.00s) === RUN TestIntervalList_Overlay2 [0,50) 2 2 [50,100) 1 1 --- PASS: TestIntervalList_Overlay2 (0.00s) === RUN TestIntervalList_Overlay3 [0,60) 2 2 [60,100) 1 1 --- PASS: TestIntervalList_Overlay3 (0.00s) === RUN TestIntervalList_Overlay4 [0,100) 2 2 --- PASS: TestIntervalList_Overlay4 (0.00s) === RUN TestIntervalList_Overlay5 [0,110) 2 2 --- PASS: TestIntervalList_Overlay5 (0.00s) === RUN TestIntervalList_Overlay6 [50,110) 2 2 --- PASS: TestIntervalList_Overlay6 (0.00s) === RUN TestIntervalList_Overlay7 [50,90) 2 2 [90,100) 1 1 --- PASS: TestIntervalList_Overlay7 (0.00s) === RUN TestIntervalList_Overlay8 [50,60) 1 1 [60,90) 2 2 [90,100) 1 1 --- PASS: TestIntervalList_Overlay8 (0.00s) === RUN TestIntervalList_Overlay9 [50,60) 1 1 [60,100) 2 2 --- PASS: TestIntervalList_Overlay9 (0.00s) === RUN TestIntervalList_Overlay10 [50,60) 1 1 [60,110) 2 2 --- PASS: TestIntervalList_Overlay10 (0.00s) === RUN TestIntervalList_Overlay11 [0,90) 5 5 [90,100) 1 1 [100,110) 2 2 --- PASS: TestIntervalList_Overlay11 (0.00s) === RUN TestIntervalList_insertInterval1 [50,150) 2 2 [200,250) 3 3 --- PASS: TestIntervalList_insertInterval1 (0.00s) === RUN TestIntervalList_insertInterval2 [0,25) 3 3 [50,150) 2 2 --- PASS: TestIntervalList_insertInterval2 (0.00s) === RUN TestIntervalList_insertInterval3 [0,75) 3 3 [75,150) 2 2 [200,250) 4 4 --- PASS: TestIntervalList_insertInterval3 (0.00s) === RUN TestIntervalList_insertInterval4 [0,200) 3 3 [200,250) 4 4 --- PASS: TestIntervalList_insertInterval4 (0.00s) === RUN TestIntervalList_insertInterval5 [0,225) 5 5 [225,250) 4 4 --- PASS: TestIntervalList_insertInterval5 (0.00s) === RUN TestIntervalList_insertInterval6 [0,50) 1 1 [50,150) 2 2 [150,200) 1 1 [200,250) 4 4 [250,275) 1 1 --- PASS: TestIntervalList_insertInterval6 (0.00s) === RUN TestIntervalList_insertInterval7 [50,150) 2 2 [150,200) 1 1 [200,250) 4 4 [250,275) 1 1 --- PASS: TestIntervalList_insertInterval7 (0.00s) === RUN TestIntervalList_insertInterval8 [50,75) 2 2 [75,200) 3 3 [200,250) 4 4 [250,275) 3 3 --- PASS: TestIntervalList_insertInterval8 (0.00s) === RUN TestIntervalList_insertInterval9 [50,150) 3 3 [200,250) 4 4 --- PASS: TestIntervalList_insertInterval9 (0.00s) === RUN TestIntervalList_insertInterval10 [50,100) 2 2 [100,200) 5 5 [200,300) 4 4 --- PASS: TestIntervalList_insertInterval10 (0.00s) === RUN TestIntervalList_insertInterval11 [0,64) 1 1 [64,68) 2 2 [68,72) 4 4 [72,136) 3 3 --- PASS: TestIntervalList_insertInterval11 (0.00s) === RUN TestIntervalList_insertIntervalStruct [0,64) 1 {1 0 0} [64,68) 4 {4 0 0} [68,72) 2 {2 0 0} [72,136) 3 {3 0 0} --- PASS: TestIntervalList_insertIntervalStruct (0.00s) === RUN TestReplicateMetadataChangeRetriesTransientFailure I1117 09:37:13.961027 meta_aggregator.go:790 retry replicate metadata change from peer-transient:1: i/o timeout talking to store --- PASS: TestReplicateMetadataChangeRetriesTransientFailure (1.01s) === RUN TestReplicateMetadataChangeGivesUpLoudlyOnPermanentFailure E1117 09:37:14.967260 meta_aggregator.go:803 giving up replicating metadata change from peer-permanent:1 for /buckets/poison-bucket (ts=1794908234966489259): entry checksum mismatch --- PASS: TestReplicateMetadataChangeGivesUpLoudlyOnPermanentFailure (0.00s) === RUN TestReplaySkipsEventOlderThanLocalEntry --- PASS: TestReplaySkipsEventOlderThanLocalEntry (0.00s) === RUN TestReplayAppliesEventNewerThanLocalEntry --- PASS: TestReplayAppliesEventNewerThanLocalEntry (0.00s) === RUN TestReplayOrdersByMutationStampNotStreamPosition --- PASS: TestReplayOrdersByMutationStampNotStreamPosition (0.00s) === RUN TestReplaySkipsDeleteOlderThanLocalEntry --- PASS: TestReplaySkipsDeleteOlderThanLocalEntry (0.00s) === RUN TestReplayAppliesNewerDelete --- PASS: TestReplayAppliesNewerDelete (0.00s) === RUN TestReplayMoveChecksEachPathSeparately --- PASS: TestReplayMoveChecksEachPathSeparately (0.00s) === RUN TestReplayAppliesWhenCommitRecordIsOlderThanFutureMtime --- PASS: TestReplayAppliesWhenCommitRecordIsOlderThanFutureMtime (0.00s) === RUN TestReplayPropagatesLookupError --- PASS: TestReplayPropagatesLookupError (0.00s) === RUN TestReplaySerializesWithEntryLock --- PASS: TestReplaySerializesWithEntryLock (0.05s) === RUN TestReplicateMetadataChangeAbortsOnStop --- PASS: TestReplicateMetadataChangeAbortsOnStop (0.00s) === RUN TestReplaySerializesWithAncestorLock --- PASS: TestReplaySerializesWithAncestorLock (0.05s) === RUN TestBootstrapAppliesPeerCommitNewerThanLocal --- PASS: TestBootstrapAppliesPeerCommitNewerThanLocal (0.00s) === RUN TestBootstrapAppliedCommitBlocksStaleReplay --- PASS: TestBootstrapAppliedCommitBlocksStaleReplay (0.00s) === RUN TestBootstrapUpdatesExistingByCommitTime --- PASS: TestBootstrapUpdatesExistingByCommitTime (0.00s) === RUN TestBootstrapCopiesMissingEntryWithoutCommitTime --- PASS: TestBootstrapCopiesMissingEntryWithoutCommitTime (0.00s) === RUN TestCommitTsNsFromEntry --- PASS: TestCommitTsNsFromEntry (0.00s) === RUN TestReplayDirectoryDeleteSweepsLocalChildren --- PASS: TestReplayDirectoryDeleteSweepsLocalChildren (0.00s) === RUN TestReplaySweepFailsOnChildLockContention --- PASS: TestReplaySweepFailsOnChildLockContention (0.00s) === RUN TestReplayFileDeleteKeepsSiblingEntries --- PASS: TestReplayFileDeleteKeepsSiblingEntries (0.00s) === RUN TestReplayDirectoryDeleteKeepsNewerChildren --- PASS: TestReplayDirectoryDeleteKeepsNewerChildren (0.00s) === RUN TestReplayKeptDirectoryDeleteAllowsStaleCreates --- PASS: TestReplayKeptDirectoryDeleteAllowsStaleCreates (0.00s) === RUN TestReplayDirectoryDeleteFreesOrphanedHardLinkChunks --- PASS: TestReplayDirectoryDeleteFreesOrphanedHardLinkChunks (0.00s) === RUN TestReplayDirectoryDeleteKeepsSharedHardLinkChunks --- PASS: TestReplayDirectoryDeleteKeepsSharedHardLinkChunks (0.00s) === RUN TestReplayDirectoryDeleteSweepsRemoteObjects --- PASS: TestReplayDirectoryDeleteSweepsRemoteObjects (0.10s) === RUN TestReplayDirectoryDeleteKeepRemoteObjects --- PASS: TestReplayDirectoryDeleteKeepRemoteObjects (0.10s) === RUN TestReplayDirectoryDeleteKeepsReplacedRemoteObject I1117 09:37:15.421446 filer_lazy_remote.go:333 keep replacestore/mybucket/d/f.txt: the remote object changed since the delete --- PASS: TestReplayDirectoryDeleteKeepsReplacedRemoteObject (0.10s) === RUN TestReplayDirectoryDeleteUsesConditionalRemoteDelete --- PASS: TestReplayDirectoryDeleteUsesConditionalRemoteDelete (0.11s) === RUN TestReplayDirectoryDeleteKeepsChangedRemoteObject I1117 09:37:15.629307 filer_lazy_remote.go:321 keep condkeepstore/mybucket/d/f.txt: the remote object changed since the delete --- PASS: TestReplayDirectoryDeleteKeepsChangedRemoteObject (0.09s) === RUN TestReplayDirectoryDeleteFailsOnRemoteDeleteError --- PASS: TestReplayDirectoryDeleteFailsOnRemoteDeleteError (0.10s) === RUN TestReplayDirectoryDeleteReleasesPendingRenameSource --- PASS: TestReplayDirectoryDeleteReleasesPendingRenameSource (0.10s) === RUN TestReplayDirectoryDeleteKeepsPendingRenameSourceOwnedByRemoteOnly I1117 09:37:15.930306 filer_lazy_remote.go:300 keep remote source /buckets/mybucket/other/src.txt of pending rename of /buckets/mybucket/d/dst.txt: a remote-only entry holds its path --- PASS: TestReplayDirectoryDeleteKeepsPendingRenameSourceOwnedByRemoteOnly (0.10s) === RUN TestReplaySweepKeepsRemoteOnlyOwnerOfPath I1117 09:37:16.023257 meta_replay.go:308 keep /buckets/mybucket/d/f.txt: a remote-only entry has taken the path since the listing --- PASS: TestReplaySweepKeepsRemoteOnlyOwnerOfPath (0.09s) === RUN TestReplayDirUpdateDoesNotSuppressChildren --- PASS: TestReplayDirUpdateDoesNotSuppressChildren (0.00s) === RUN TestOnPeerUpdateRepeatedAdd I1117 09:37:16.119065 meta_aggregator.go:465 loopSubscribeToOneFiler read 127.0.0.1:1 start from 2026-11-17 09:37:16.11708466 +0000 UTC 1794908236117084660 I1117 09:37:16.122446 meta_aggregator.go:471 stop subscribing peer 127.0.0.1:1 meta change --- PASS: TestOnPeerUpdateRepeatedAdd (0.10s) === RUN TestMetaAggregatorShutdownStopsPeerLoops --- PASS: TestMetaAggregatorShutdownStopsPeerLoops (0.10s) === RUN TestPeerResumeStartFromSurvivesRemoval --- PASS: TestPeerResumeStartFromSurvivesRemoval (0.09s) === RUN TestOnPeerUpdateAfterShutdownRejected --- PASS: TestOnPeerUpdateAfterShutdownRejected (0.09s) === RUN TestPeerWatermarkBookkeeping --- PASS: TestPeerWatermarkBookkeeping (0.00s) === RUN TestPeerWatermarkRemovalGrace --- PASS: TestPeerWatermarkRemovalGrace (0.00s) === RUN TestPeerFlushWatermarkBookkeeping --- PASS: TestPeerFlushWatermarkBookkeeping (0.00s) === RUN TestWatermarkAdvancedChansAreScoped --- PASS: TestWatermarkAdvancedChansAreScoped (0.00s) === RUN TestMetaLogCollectionResolution === RUN TestMetaLogCollectionResolution/no_override:_filer_default_wins_(today's_behaviour) === RUN TestMetaLogCollectionResolution/no_override_anywhere:_still_empty_(default_collection) === RUN TestMetaLogCollectionResolution/override_wins_over_filer_default === RUN TestMetaLogCollectionResolution/override_wins_over_matched_rule === RUN TestMetaLogCollectionResolution/no_override_but_rule_set:_rule_used_(unchanged_fallback_chain) --- PASS: TestMetaLogCollectionResolution (0.00s) --- PASS: TestMetaLogCollectionResolution/no_override:_filer_default_wins_(today's_behaviour) (0.00s) --- PASS: TestMetaLogCollectionResolution/no_override_anywhere:_still_empty_(default_collection) (0.00s) --- PASS: TestMetaLogCollectionResolution/override_wins_over_filer_default (0.00s) --- PASS: TestMetaLogCollectionResolution/override_wins_over_matched_rule (0.00s) --- PASS: TestMetaLogCollectionResolution/no_override_but_rule_set:_rule_used_(unchanged_fallback_chain) (0.00s) === RUN TestMetaLogReplicationResolution --- PASS: TestMetaLogReplicationResolution (0.00s) === RUN TestViperReadsMetaLogOverrides I1117 09:37:16.518331 filer.go:178 system metadata logs will be stored in collection "filer-meta" I1117 09:37:16.519353 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:37:16.519353 filer_deletion.go:317 deletion processor shutting down --- PASS: TestViperReadsMetaLogOverrides (0.10s) === RUN TestBucketCollectionKeepsMetaLogTargetCollection I1117 09:37:16.700737 metrics.go:1258 delete bucket metrics, a: 0 --- PASS: TestBucketCollectionKeepsMetaLogTargetCollection (0.18s) === RUN TestPathCommitStampedOnEntry --- PASS: TestPathCommitStampedOnEntry (0.00s) === RUN TestEventTsNsEqualsEntryCommitTs --- PASS: TestEventTsNsEqualsEntryCommitTs (0.09s) === RUN TestEventWithoutPreStampStillEmits --- PASS: TestEventWithoutPreStampStillEmits (0.09s) === RUN TestNotifyUpdateEventRecordsRequestMetadataEvent --- PASS: TestNotifyUpdateEventRecordsRequestMetadataEvent (0.10s) === RUN TestNotifyUpdateEventReloadsLocalFilerConfiguration I1117 09:37:17.083555 filer_on_meta_event.go:102 processing /etc/seaweedfs ts_ns=1794908237083041869 --- PASS: TestNotifyUpdateEventReloadsLocalFilerConfiguration (0.09s) === RUN TestMountPeerRegistry_RegisterAndList --- PASS: TestMountPeerRegistry_RegisterAndList (0.00s) === RUN TestMountPeerRegistry_RenewExtendsExpiry --- PASS: TestMountPeerRegistry_RenewExtendsExpiry (0.00s) === RUN TestMountPeerRegistry_ExpirationDropsEntry --- PASS: TestMountPeerRegistry_ExpirationDropsEntry (0.00s) === RUN TestMountPeerRegistry_SweepCountsEvictions --- PASS: TestMountPeerRegistry_SweepCountsEvictions (0.00s) === RUN TestMountPeerRegistry_NegativeTTLFallsBackToDefault --- PASS: TestMountPeerRegistry_NegativeTTLFallsBackToDefault (0.00s) === RUN TestMountPeerRegistry_EmptyList --- PASS: TestMountPeerRegistry_EmptyList (0.00s) === RUN TestMountPeerRegistry_EmptyPeerAddrRejected --- PASS: TestMountPeerRegistry_EmptyPeerAddrRejected (0.00s) === RUN TestMountPeerRegistry_TTLCapped --- PASS: TestMountPeerRegistry_TTLCapped (0.00s) === RUN TestMountPeerRegistry_CapacityLimit --- PASS: TestMountPeerRegistry_CapacityLimit (0.19s) === RUN TestPersistedLogCacheHitMiss --- PASS: TestPersistedLogCacheHitMiss (0.00s) === RUN TestPersistedLogCacheNotCachedWhenUncacheable --- PASS: TestPersistedLogCacheNotCachedWhenUncacheable (0.00s) === RUN TestPersistedLogCacheSingleFlight --- PASS: TestPersistedLogCacheSingleFlight (0.01s) === RUN TestPersistedLogCacheEviction --- PASS: TestPersistedLogCacheEviction (0.00s) === RUN TestDecodeLogRecords --- PASS: TestDecodeLogRecords (0.00s) === RUN TestDecodeLogRecordsIncomplete --- PASS: TestDecodeLogRecordsIncomplete (0.00s) === RUN TestLogFileIteratorChunkedFiltering --- PASS: TestLogFileIteratorChunkedFiltering (0.00s) === RUN TestLogFileIteratorSkipsColdChunks --- PASS: TestLogFileIteratorSkipsColdChunks (0.00s) === RUN TestLogFileIteratorSharesDecodedChunks --- PASS: TestLogFileIteratorSharesDecodedChunks (0.02s) === RUN TestLogFileIteratorStreamsWhenRecordsSpanChunks --- PASS: TestLogFileIteratorStreamsWhenRecordsSpanChunks (0.00s) === RUN TestLogFileIteratorStreamFallbackResumesAfterYielded --- PASS: TestLogFileIteratorStreamFallbackResumesAfterYielded (0.00s) === RUN TestLogFileIteratorLoadErrorPropagates --- PASS: TestLogFileIteratorLoadErrorPropagates (0.00s) === RUN TestPersistedLogCacheIdleEviction --- PASS: TestPersistedLogCacheIdleEviction (0.00s) === RUN TestDecodeLogRecordsRejectsImplausibleRecords --- PASS: TestDecodeLogRecordsRejectsImplausibleRecords (0.00s) === RUN TestPersistedLogCacheLoadLargerThanBudget --- PASS: TestPersistedLogCacheLoadLargerThanBudget (0.00s) === RUN TestMergeRemoteContentEncoding --- PASS: TestMergeRemoteContentEncoding (0.00s) === RUN TestSaveInsideFilerSkipsIdenticalContent --- PASS: TestSaveInsideFilerSkipsIdenticalContent (0.00s) === RUN TestSaveInsideFilerStampsMd5OnLegacyEntry --- PASS: TestSaveInsideFilerStampsMd5OnLegacyEntry (0.00s) === RUN TestChunkReadAtSequentialPrefetchStaysWithinWindow --- PASS: TestChunkReadAtSequentialPrefetchStaysWithinWindow (0.04s) === RUN TestChunkReadAtConcurrentStreamsShareChunks --- PASS: TestChunkReadAtConcurrentStreamsShareChunks (0.01s) === RUN TestChunkStreamReleasesPreviousChunkOnCacheHit --- PASS: TestChunkStreamReleasesPreviousChunkOnCacheHit (0.00s) === RUN TestChunkStreamDropsLeftChunkAfterInFlightRead --- PASS: TestChunkStreamDropsLeftChunkAfterInFlightRead (0.00s) === RUN TestChunkStreamConcurrentReadsOnOneReader --- PASS: TestChunkStreamConcurrentReadsOnOneReader (0.01s) === RUN TestChunkReadAtClippedViewsFetchOnlyCoveredParts --- PASS: TestChunkReadAtClippedViewsFetchOnlyCoveredParts (0.01s) === RUN TestChunkReadAtRangeInsideOneChunkStaysRangeFetch --- PASS: TestChunkReadAtRangeInsideOneChunkStaysRangeFetch (0.00s) === RUN TestChunkReadAtOversizedCompressedChunkFallsBackToRange --- PASS: TestChunkReadAtOversizedCompressedChunkFallsBackToRange (0.00s) === RUN TestChunkReadAtPinnedChunkSurvivesEviction --- PASS: TestChunkReadAtPinnedChunkSurvivesEviction (0.00s) === RUN TestChunkReadAtPinnedEvictionFallsBackWhenAllPinned --- PASS: TestChunkReadAtPinnedEvictionFallsBackWhenAllPinned (0.00s) === RUN TestReaderAt --- PASS: TestReaderAt (0.00s) === RUN TestReaderAt0 --- PASS: TestReaderAt0 (0.00s) === RUN TestReaderAt1 --- PASS: TestReaderAt1 (0.00s) === RUN TestReaderAtGappedChunksDoNotLeak --- PASS: TestReaderAtGappedChunksDoNotLeak (0.00s) === RUN TestReaderAtSparseFileDoesNotLeak --- PASS: TestReaderAtSparseFileDoesNotLeak (0.00s) === RUN TestReaderAtParallelFailureReturnsContiguousPrefix --- PASS: TestReaderAtParallelFailureReturnsContiguousPrefix (0.00s) === RUN TestChunkGroupReaderCacheMemory --- PASS: TestChunkGroupReaderCacheMemory (0.01s) === RUN TestReaderCacheBudgetInFlight === RUN TestReaderCacheBudgetInFlight/prefetch=false === RUN TestReaderCacheBudgetInFlight/prefetch=true --- PASS: TestReaderCacheBudgetInFlight (0.11s) --- PASS: TestReaderCacheBudgetInFlight/prefetch=false (0.05s) --- PASS: TestReaderCacheBudgetInFlight/prefetch=true (0.05s) === RUN TestReaderCacheBudgetOversizedChunk --- PASS: TestReaderCacheBudgetOversizedChunk (0.00s) === RUN TestReaderCacheEvictionDoesNotHoldCacheLock --- PASS: TestReaderCacheEvictionDoesNotHoldCacheLock (0.00s) === RUN TestReaderCacheFailedPrefetchReleasesBudget === RUN TestReaderCacheFailedPrefetchReleasesBudget/lookupFailure=false === RUN TestReaderCacheFailedPrefetchReleasesBudget/lookupFailure=true --- PASS: TestReaderCacheFailedPrefetchReleasesBudget (0.01s) --- PASS: TestReaderCacheFailedPrefetchReleasesBudget/lookupFailure=false (0.00s) --- PASS: TestReaderCacheFailedPrefetchReleasesBudget/lookupFailure=true (0.00s) === RUN TestReaderCacheUnboundedWithoutBudget --- PASS: TestReaderCacheUnboundedWithoutBudget (0.08s) === RUN TestReaderCacheDropsConsumedChunks --- PASS: TestReaderCacheDropsConsumedChunks (0.00s) === RUN TestReaderCachePrefetchBufferDroppedAfterRead --- PASS: TestReaderCachePrefetchBufferDroppedAfterRead (0.00s) === RUN TestReaderCacheConsumedBufferSurvivesAttachedReader --- PASS: TestReaderCacheConsumedBufferSurvivesAttachedReader (0.00s) === RUN TestReaderCacheConsumedChunkReleasesBudget --- PASS: TestReaderCacheConsumedChunkReleasesBudget (0.00s) === RUN TestReaderCacheReReadAfterEviction --- PASS: TestReaderCacheReReadAfterEviction (0.00s) === RUN TestReaderCacheBudgetWaitStopsWithItsLastStream --- PASS: TestReaderCacheBudgetWaitStopsWithItsLastStream (0.05s) === RUN TestReaderCacheRetryAfterCacheInvalidation I1117 09:37:17.712390 stream.go:157 read chunk 425141,ef8914e9bdbbe8cb6838191f failed, invalidating cache and retrying: 404 Not Found: not found I1117 09:37:17.712921 stream.go:174 retrying read chunk 425141,ef8914e9bdbbe8cb6838191f with 1 new locations --- PASS: TestReaderCacheRetryAfterCacheInvalidation (0.00s) === RUN TestReaderCacheRefreshesLocationsAfterPartialFailure I1117 09:37:17.726785 http_global_client_util.go:766 read http://127.0.0.1:33703/3,abc failed, err: Get "http://127.0.0.1:33703/3,abc?readDeleted=true": dial tcp 127.0.0.1:33703: connect: connection refused --- PASS: TestReaderCacheRefreshesLocationsAfterPartialFailure (0.02s) === RUN TestReaderCacheRemovesFailedDownloader --- PASS: TestReaderCacheRemovesFailedDownloader (0.00s) === RUN TestReaderCacheContextCancellation --- PASS: TestReaderCacheContextCancellation (0.00s) === RUN TestReaderCacheFallbackToChunkCache --- PASS: TestReaderCacheFallbackToChunkCache (0.00s) === RUN TestReaderCacheMultipleReadersWaitForSameChunk --- PASS: TestReaderCacheMultipleReadersWaitForSameChunk (0.00s) === RUN TestReaderCachePartialRead === RUN TestReaderCachePartialRead/read_from_start === RUN TestReaderCachePartialRead/read_from_middle === RUN TestReaderCachePartialRead/read_to_end === RUN TestReaderCachePartialRead/read_single_byte --- PASS: TestReaderCachePartialRead (0.00s) --- PASS: TestReaderCachePartialRead/read_from_start (0.00s) --- PASS: TestReaderCachePartialRead/read_from_middle (0.00s) --- PASS: TestReaderCachePartialRead/read_to_end (0.00s) --- PASS: TestReaderCachePartialRead/read_single_byte (0.00s) === RUN TestReaderCacheCleanup --- PASS: TestReaderCacheCleanup (0.00s) === RUN TestSingleChunkCacherDoneSignal --- PASS: TestSingleChunkCacherDoneSignal (0.00s) === RUN TestSingleChunkCacherLookupError --- PASS: TestSingleChunkCacherLookupError (0.00s) === RUN TestSingleChunkCacherContextCancellationDuringLookup --- PASS: TestSingleChunkCacherContextCancellationDuringLookup (0.00s) === RUN TestSingleChunkCacherMultipleReadersWaitForDownload --- PASS: TestSingleChunkCacherMultipleReadersWaitForDownload (0.00s) === RUN TestReaderCacheDownloaderDedup --- PASS: TestReaderCacheDownloaderDedup (0.00s) === RUN TestSingleChunkCacherOneReaderCancelsOthersContinue --- PASS: TestSingleChunkCacherOneReaderCancelsOthersContinue (0.00s) === RUN TestReaderCacheBookkeepingOffCacheLock --- PASS: TestReaderCacheBookkeepingOffCacheLock (0.00s) === RUN TestAbandonedChunkDownloadStopsWithItsLastStream --- PASS: TestAbandonedChunkDownloadStopsWithItsLastStream (0.00s) === RUN TestAbandonedChunkDownloadKeepsRunningForOtherStream --- PASS: TestAbandonedChunkDownloadKeepsRunningForOtherStream (0.00s) === RUN TestAbandonedChunkDownloadKeepsRunningForWaitingReader --- PASS: TestAbandonedChunkDownloadKeepsRunningForWaitingReader (0.00s) === RUN TestAbandonedChunkDownloadIsNotCached --- PASS: TestAbandonedChunkDownloadIsNotCached (0.00s) === RUN TestAbandonedChunkDownloadKeepsItsRelookupAlive I1117 09:37:17.763733 stream.go:157 read chunk 3077,02c3475d67aaf564 failed, invalidating cache and retrying: connection reset by peer I1117 09:37:17.766150 stream.go:170 re-lookup returned same locations for chunk 3077,02c3475d67aaf564, skipping retry --- PASS: TestAbandonedChunkDownloadKeepsItsRelookupAlive (0.00s) === RUN TestReaderCacheDestroyCancelsUnreadPrefetch --- PASS: TestReaderCacheDestroyCancelsUnreadPrefetch (0.00s) === RUN TestReaderCacheDestroyCancelsDownloadAfterItsLastStream --- PASS: TestReaderCacheDestroyCancelsDownloadAfterItsLastStream (0.05s) === RUN TestReaderPatternSequentialAndHysteresis --- PASS: TestReaderPatternSequentialAndHysteresis (0.00s) === RUN TestReaderPatternFarFirstReadIsRandom --- PASS: TestReaderPatternFarFirstReadIsRandom (0.00s) === RUN TestReaderPatternToleranceAbsorbsReorder --- PASS: TestReaderPatternToleranceAbsorbsReorder (0.00s) === RUN TestReaderPatternRandomRecoveryNeedsHysteresis --- PASS: TestReaderPatternRandomRecoveryNeedsHysteresis (0.00s) === RUN TestReaderPatternFrontierNeverRegresses --- PASS: TestReaderPatternFrontierNeverRegresses (0.00s) === RUN TestReaderPatternToleranceBoundary --- PASS: TestReaderPatternToleranceBoundary (0.00s) === RUN TestReaderPatternRecoversFromRandom --- PASS: TestReaderPatternRecoversFromRandom (0.00s) === RUN TestReaderPatternRangedReadStaysRandom --- PASS: TestReaderPatternRangedReadStaysRandom (0.00s) === RUN TestFindMountedRemoteMapping === RUN TestFindMountedRemoteMapping//buckets/b === RUN TestFindMountedRemoteMapping//buckets/b/other === RUN TestFindMountedRemoteMapping//buckets/b/sub === RUN TestFindMountedRemoteMapping//buckets/b/sub/deep === RUN TestFindMountedRemoteMapping//buckets/foo/x === RUN TestFindMountedRemoteMapping//buckets/foobar === RUN TestFindMountedRemoteMapping//buckets/other --- PASS: TestFindMountedRemoteMapping (0.01s) --- PASS: TestFindMountedRemoteMapping//buckets/b (0.00s) --- PASS: TestFindMountedRemoteMapping//buckets/b/other (0.00s) --- PASS: TestFindMountedRemoteMapping//buckets/b/sub (0.00s) --- PASS: TestFindMountedRemoteMapping//buckets/b/sub/deep (0.00s) --- PASS: TestFindMountedRemoteMapping//buckets/foo/x (0.00s) --- PASS: TestFindMountedRemoteMapping//buckets/foobar (0.00s) --- PASS: TestFindMountedRemoteMapping//buckets/other (0.00s) === RUN TestFilerRemoteStorage_FindRemoteStorageClient --- PASS: TestFilerRemoteStorage_FindRemoteStorageClient (0.00s) === RUN TestFilerRemoteStorage_FindMountDirectory_LongestPrefixWins --- PASS: TestFilerRemoteStorage_FindMountDirectory_LongestPrefixWins (0.00s) === RUN TestLoadRemoteStorageConfigurationsAndMapping_RejectsBlockedEndpoint W1117 09:37:17.841474 remote_storage.go:123 reject remote storage conf /etc/remote/evil.conf: reject remote endpoint: loopback --- PASS: TestLoadRemoteStorageConfigurationsAndMapping_RejectsBlockedEndpoint (0.01s) === RUN TestLoadRemoteStorageConfigurationsAndMapping_DropsClientsOfRemovedRemotes --- PASS: TestLoadRemoteStorageConfigurationsAndMapping_DropsClientsOfRemovedRemotes (0.01s) === RUN TestS3Conf --- PASS: TestS3Conf (0.02s) === RUN TestCheckDuplicateAccessKey --- PASS: TestCheckDuplicateAccessKey (0.00s) === RUN TestChunkStreamReaderReadAtReusesFetchedChunks --- PASS: TestChunkStreamReaderReadAtReusesFetchedChunks (0.01s) === RUN TestChunkStreamReaderFromFilerAsksMasterOnCacheMiss --- PASS: TestChunkStreamReaderFromFilerAsksMasterOnCacheMiss (0.08s) === RUN TestChunkReadJwt === RUN TestChunkReadJwt/through_a_filer === RUN TestChunkReadJwt/straight_to_a_volume_server --- PASS: TestChunkReadJwt (0.03s) --- PASS: TestChunkReadJwt/through_a_filer (0.02s) --- PASS: TestChunkReadJwt/straight_to_a_volume_server (0.01s) === RUN TestPrepareStreamContent_ManifestResolveFailure E1117 09:37:18.006639 filechunk_manifest.go:384 operation LookupFileId 1,1879011dc64abd40 failed, err: fileId 1,1879011dc64abd40 not found E1117 09:37:18.007679 filechunk_manifest.go:384 operation LookupFileId 1,1879011dc64abd40 failed, err: fileId 1,1879011dc64abd40 not found --- PASS: TestPrepareStreamContent_ManifestResolveFailure (0.00s) === RUN TestPrefetchInOrderDelivery --- PASS: TestPrefetchInOrderDelivery (0.02s) === RUN TestPrefetchSingleChunk --- PASS: TestPrefetchSingleChunk (0.01s) === RUN TestPrefetchFallbackToSequential --- PASS: TestPrefetchFallbackToSequential (0.01s) === RUN TestPrefetchContextCancellation I1117 09:37:18.105881 filechunk_manifest.go:470 read http://127.0.0.1:32889/1,3 failed, err: Get "http://127.0.0.1:32889/1,3?readDeleted=true": context deadline exceeded I1117 09:37:18.105946 filechunk_manifest.go:470 read http://127.0.0.1:32889/1,2 failed, err: Get "http://127.0.0.1:32889/1,2?readDeleted=true": context deadline exceeded I1117 09:37:18.106164 filechunk_manifest.go:470 read http://127.0.0.1:32889/1,0 failed, err: Get "http://127.0.0.1:32889/1,0?readDeleted=true": context deadline exceeded I1117 09:37:18.106264 filechunk_manifest.go:470 read http://127.0.0.1:32889/1,1 failed, err: Get "http://127.0.0.1:32889/1,1?readDeleted=true": context deadline exceeded --- PASS: TestPrefetchContextCancellation (0.11s) === RUN TestPrefetchRangeRequest --- PASS: TestPrefetchRangeRequest (0.01s) === RUN TestPrefetchLargePrefetchCount --- PASS: TestPrefetchLargePrefetchCount (0.01s) === RUN TestPrefetchConcurrentDownloads --- PASS: TestPrefetchConcurrentDownloads (0.02s) === RUN TestChunkStreamReaderSourceError --- PASS: TestChunkStreamReaderSourceError (0.01s) === RUN TestChunkStreamReaderSourceErrorOnLookup --- PASS: TestChunkStreamReaderSourceErrorOnLookup (0.00s) === RUN TestReaderSourceErrorInlineEntry --- PASS: TestReaderSourceErrorInlineEntry (0.00s) === RUN TestIsSameDataLeavesChunkOrderAlone --- PASS: TestIsSameDataLeavesChunkOrderAlone (0.00s) === RUN TestCancelledFetchKeepsCachedLocations I1117 09:37:18.265547 http_global_client_util.go:766 read http://127.0.0.1:45815/4,12c8f6c18f failed, err: Get "http://127.0.0.1:45815/4,12c8f6c18f?readDeleted=true": context canceled I1117 09:37:18.266250 http_global_client_util.go:775 retry reading in 1s --- PASS: TestCancelledFetchKeepsCachedLocations (0.05s) === RUN TestSanitizeZipMemberName --- PASS: TestSanitizeZipMemberName (0.00s) === RUN TestSpoolZipReaderMemory --- PASS: TestSpoolZipReaderMemory (0.00s) === RUN TestSpoolZipReaderTempFile --- PASS: TestSpoolZipReaderTempFile (0.00s) === RUN TestSpoolZipReaderLimit --- PASS: TestSpoolZipReaderLimit (0.00s) === RUN TestCheckZipLimits --- PASS: TestCheckZipLimits (0.17s) === RUN TestSpoolZipReaderRoundTrip --- PASS: TestSpoolZipReaderRoundTrip (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer 30.636s === RUN TestBucketTableFor --- PASS: TestBucketTableFor (0.00s) === RUN TestIsMissingTableError --- PASS: TestIsMissingTableError (0.00s) === RUN TestGetTxOrDBInternalSystemFolder --- PASS: TestGetTxOrDBInternalSystemFolder (0.00s) === RUN TestGetTxOrDBRealBucket --- PASS: TestGetTxOrDBRealBucket (0.00s) === RUN TestLikePattern --- PASS: TestLikePattern (0.00s) === RUN TestSplitPoolForKv --- PASS: TestSplitPoolForKv (0.00s) === RUN TestBucketHooksSkipInvalidBucketNames --- PASS: TestBucketHooksSkipInvalidBucketNames (0.02s) === RUN TestListDirectoryEntriesReportsRowIterationError --- PASS: TestListDirectoryEntriesReportsRowIterationError (0.17s) === RUN TestListDirectoryEntriesStoppedByCallbackWithCanceledContext --- PASS: TestListDirectoryEntriesStoppedByCallbackWithCanceledContext (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/abstract_sql 3.186s === RUN TestListDirectoryPrefixedEntriesAqlInjection arangodb_store_test.go:80: arangodb tests are disabled. Start an arangodb server and set RUN_ARANGODB_TESTS=1 to enable, ARANGODB_ADDR defaults to http://127.0.0.1:8529. --- SKIP: TestListDirectoryPrefixedEntriesAqlInjection (0.01s) === RUN TestListDirectoryPrefixedEntriesPrefixNotEvaluated arangodb_store_test.go:105: arangodb tests are disabled. Start an arangodb server and set RUN_ARANGODB_TESTS=1 to enable, ARANGODB_ADDR defaults to http://127.0.0.1:8529. --- SKIP: TestListDirectoryPrefixedEntriesPrefixNotEvaluated (0.00s) === RUN TestListDirectoryPrefixedEntriesQuotedNames arangodb_store_test.go:122: arangodb tests are disabled. Start an arangodb server and set RUN_ARANGODB_TESTS=1 to enable, ARANGODB_ADDR defaults to http://127.0.0.1:8529. --- SKIP: TestListDirectoryPrefixedEntriesQuotedNames (0.00s) === RUN TestDeleteFolderChildrenAqlInjection arangodb_store_test.go:142: arangodb tests are disabled. Start an arangodb server and set RUN_ARANGODB_TESTS=1 to enable, ARANGODB_ADDR defaults to http://127.0.0.1:8529. --- SKIP: TestDeleteFolderChildrenAqlInjection (0.00s) === RUN TestDeleteFolderChildrenRemovesSubtree arangodb_store_test.go:160: arangodb tests are disabled. Start an arangodb server and set RUN_ARANGODB_TESTS=1 to enable, ARANGODB_ADDR defaults to http://127.0.0.1:8529. --- SKIP: TestDeleteFolderChildrenRemovesSubtree (0.00s) === RUN TestListDirectoryEntriesQuotedStartFileName arangodb_store_test.go:178: arangodb tests are disabled. Start an arangodb server and set RUN_ARANGODB_TESTS=1 to enable, ARANGODB_ADDR defaults to http://127.0.0.1:8529. --- SKIP: TestListDirectoryEntriesQuotedStartFileName (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/arangodb 2.240s ? github.com/seaweedfs/seaweedfs/weed/filer/cassandra [no test files] ? github.com/seaweedfs/seaweedfs/weed/filer/cassandra2 [no test files] ? github.com/seaweedfs/seaweedfs/weed/filer/elastic/v7 [no test files] === RUN TestCleanupQueue_Add --- PASS: TestCleanupQueue_Add (0.00s) === RUN TestCleanupQueue_Add_OutOfOrder --- PASS: TestCleanupQueue_Add_OutOfOrder (0.00s) === RUN TestCleanupQueue_Add_DuplicateWithOlderTime --- PASS: TestCleanupQueue_Add_DuplicateWithOlderTime (0.00s) === RUN TestCleanupQueue_Remove --- PASS: TestCleanupQueue_Remove (0.00s) === RUN TestCleanupQueue_Pop --- PASS: TestCleanupQueue_Pop (0.00s) === RUN TestCleanupQueue_Peek --- PASS: TestCleanupQueue_Peek (0.00s) === RUN TestCleanupQueue_Contains --- PASS: TestCleanupQueue_Contains (0.00s) === RUN TestCleanupQueue_ShouldProcess_MaxSize --- PASS: TestCleanupQueue_ShouldProcess_MaxSize (0.00s) === RUN TestCleanupQueue_ShouldProcess_MaxAge --- PASS: TestCleanupQueue_ShouldProcess_MaxAge (0.00s) === RUN TestCleanupQueue_Clear --- PASS: TestCleanupQueue_Clear (0.00s) === RUN TestCleanupQueue_OldestAge --- PASS: TestCleanupQueue_OldestAge (0.00s) === RUN TestCleanupQueue_TimeOrder --- PASS: TestCleanupQueue_TimeOrder (0.00s) === RUN TestCleanupQueue_DuplicateWithNewerTime --- PASS: TestCleanupQueue_DuplicateWithNewerTime (0.00s) === RUN TestCleanupQueue_Concurrent --- PASS: TestCleanupQueue_Concurrent (0.01s) === RUN Test_isUnderPath === RUN Test_isUnderPath/child_under_parent === RUN Test_isUnderPath/child_is_parent === RUN Test_isUnderPath/child_not_under_parent === RUN Test_isUnderPath/empty_parent === RUN Test_isUnderPath/root_parent === RUN Test_isUnderPath/parent_with_trailing_slash === RUN Test_isUnderPath/similar_prefix_but_not_under === RUN Test_isUnderPath/deeply_nested --- PASS: Test_isUnderPath (0.01s) --- PASS: Test_isUnderPath/child_under_parent (0.00s) --- PASS: Test_isUnderPath/child_is_parent (0.00s) --- PASS: Test_isUnderPath/child_not_under_parent (0.00s) --- PASS: Test_isUnderPath/empty_parent (0.00s) --- PASS: Test_isUnderPath/root_parent (0.00s) --- PASS: Test_isUnderPath/parent_with_trailing_slash (0.00s) --- PASS: Test_isUnderPath/similar_prefix_but_not_under (0.00s) --- PASS: Test_isUnderPath/deeply_nested (0.00s) === RUN Test_isUnderBucketPath === RUN Test_isUnderBucketPath/bucket_path_itself === RUN Test_isUnderBucketPath/bucket_directory === RUN Test_isUnderBucketPath/folder_in_bucket === RUN Test_isUnderBucketPath/nested_folder === RUN Test_isUnderBucketPath/outside_buckets === RUN Test_isUnderBucketPath/empty_bucket_path --- PASS: Test_isUnderBucketPath (0.01s) --- PASS: Test_isUnderBucketPath/bucket_path_itself (0.00s) --- PASS: Test_isUnderBucketPath/bucket_directory (0.00s) --- PASS: Test_isUnderBucketPath/folder_in_bucket (0.00s) --- PASS: Test_isUnderBucketPath/nested_folder (0.00s) --- PASS: Test_isUnderBucketPath/outside_buckets (0.00s) --- PASS: Test_isUnderBucketPath/empty_bucket_path (0.00s) === RUN Test_isMultipartUploadsPath === RUN Test_isMultipartUploadsPath/staging_root === RUN Test_isMultipartUploadsPath/upload_marker_dir === RUN Test_isMultipartUploadsPath/nested_under_staging === RUN Test_isMultipartUploadsPath/normal_folder === RUN Test_isMultipartUploadsPath/registry_own_uploads_dir === RUN Test_isMultipartUploadsPath/bucket_itself === RUN Test_isMultipartUploadsPath/outside_buckets === RUN Test_isMultipartUploadsPath/empty_bucket_path --- PASS: Test_isMultipartUploadsPath (0.02s) --- PASS: Test_isMultipartUploadsPath/staging_root (0.00s) --- PASS: Test_isMultipartUploadsPath/upload_marker_dir (0.00s) --- PASS: Test_isMultipartUploadsPath/nested_under_staging (0.00s) --- PASS: Test_isMultipartUploadsPath/normal_folder (0.00s) --- PASS: Test_isMultipartUploadsPath/registry_own_uploads_dir (0.00s) --- PASS: Test_isMultipartUploadsPath/bucket_itself (0.00s) --- PASS: Test_isMultipartUploadsPath/outside_buckets (0.00s) --- PASS: Test_isMultipartUploadsPath/empty_bucket_path (0.00s) === RUN TestEmptyFolderCleaner_OnDeleteEvent_skipsMultipartUploads --- PASS: TestEmptyFolderCleaner_OnDeleteEvent_skipsMultipartUploads (0.02s) === RUN TestEmptyFolderCleaner_executeCleanup_skipsMultipartUploads I1117 09:36:50.158146 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/folder (triggered by file.txt) --- PASS: TestEmptyFolderCleaner_executeCleanup_skipsMultipartUploads (0.04s) === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_create_event_for_the_deleted_folder_puts_it_back I1117 09:36:50.192811 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/folder (triggered by file.txt) === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_create_event_elsewhere_is_ignored I1117 09:36:50.206031 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/folder (triggered by file.txt) === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/an_entry_that_went_away_again_is_not_restored I1117 09:36:50.209311 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/folder (triggered by file.txt) === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/observation_expires I1117 09:36:50.216670 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/folder (triggered by file.txt) === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_failed_restore_is_retried I1117 09:36:50.219047 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/folder (triggered by file.txt) === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_folder_whose_restore_keeps_failing_stops_being_observed I1117 09:36:50.223354 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/folder (triggered by file.txt) === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/an_ancestor_taken_by_the_cascade_is_restored_with_its_own_attributes I1117 09:36:50.226380 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/data/abc (triggered by file.txt) I1117 09:36:50.226955 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/data (triggered by file.txt) I1117 09:36:50.227332 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/data (triggered by abc) === RUN TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_delete_that_reports_failure_is_still_observed I1117 09:36:50.328695 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/folder (triggered by file.txt) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete (0.14s) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_create_event_for_the_deleted_folder_puts_it_back (0.01s) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_create_event_elsewhere_is_ignored (0.00s) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/an_entry_that_went_away_again_is_not_restored (0.00s) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/observation_expires (0.00s) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_failed_restore_is_retried (0.00s) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_folder_whose_restore_keeps_failing_stops_being_observed (0.00s) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/an_ancestor_taken_by_the_cascade_is_restored_with_its_own_attributes (0.08s) --- PASS: TestEmptyFolderCleaner_restoreFoldersWrittenDuringDelete/a_delete_that_reports_failure_is_still_observed (0.00s) === RUN Test_autoRemoveEmptyFoldersEnabled === RUN Test_autoRemoveEmptyFoldersEnabled/no_attrs_defaults_enabled === RUN Test_autoRemoveEmptyFoldersEnabled/missing_key_defaults_enabled === RUN Test_autoRemoveEmptyFoldersEnabled/allow-empty_disables_cleanup === RUN Test_autoRemoveEmptyFoldersEnabled/explicit_false_keeps_cleanup_enabled --- PASS: Test_autoRemoveEmptyFoldersEnabled (0.03s) --- PASS: Test_autoRemoveEmptyFoldersEnabled/no_attrs_defaults_enabled (0.00s) --- PASS: Test_autoRemoveEmptyFoldersEnabled/missing_key_defaults_enabled (0.00s) --- PASS: Test_autoRemoveEmptyFoldersEnabled/allow-empty_disables_cleanup (0.00s) --- PASS: Test_autoRemoveEmptyFoldersEnabled/explicit_false_keeps_cleanup_enabled (0.00s) === RUN TestEmptyFolderCleaner_ownsFolder --- PASS: TestEmptyFolderCleaner_ownsFolder (0.01s) === RUN TestEmptyFolderCleaner_ownsFolder_singleServer --- PASS: TestEmptyFolderCleaner_ownsFolder_singleServer (0.01s) === RUN TestEmptyFolderCleaner_ownsFolder_emptyRing --- PASS: TestEmptyFolderCleaner_ownsFolder_emptyRing (0.00s) === RUN TestEmptyFolderCleaner_OnCreateEvent_cancelsCleanup --- PASS: TestEmptyFolderCleaner_OnCreateEvent_cancelsCleanup (0.00s) === RUN TestEmptyFolderCleaner_OnDeleteEvent_deduplication --- PASS: TestEmptyFolderCleaner_OnDeleteEvent_deduplication (0.00s) === RUN TestEmptyFolderCleaner_OnDeleteEvent_multipleFolders --- PASS: TestEmptyFolderCleaner_OnDeleteEvent_multipleFolders (0.00s) === RUN TestEmptyFolderCleaner_OnDeleteEvent_notOwner --- PASS: TestEmptyFolderCleaner_OnDeleteEvent_notOwner (0.00s) === RUN TestEmptyFolderCleaner_OnDeleteEvent_disabled --- PASS: TestEmptyFolderCleaner_OnDeleteEvent_disabled (0.00s) === RUN TestEmptyFolderCleaner_OnDeleteEvent_directoryDeletion --- PASS: TestEmptyFolderCleaner_OnDeleteEvent_directoryDeletion (0.00s) === RUN TestEmptyFolderCleaner_cachedCounts --- PASS: TestEmptyFolderCleaner_cachedCounts (0.01s) === RUN TestEmptyFolderCleaner_Stop --- PASS: TestEmptyFolderCleaner_Stop (0.00s) === RUN TestEmptyFolderCleaner_cacheEviction --- PASS: TestEmptyFolderCleaner_cacheEviction (0.00s) === RUN TestEmptyFolderCleaner_cacheEviction_skipsEntriesInQueue --- PASS: TestEmptyFolderCleaner_cacheEviction_skipsEntriesInQueue (0.00s) === RUN TestEmptyFolderCleaner_queueFIFOOrder --- PASS: TestEmptyFolderCleaner_queueFIFOOrder (0.00s) === RUN TestEmptyFolderCleaner_processCleanupQueue_onlyProcessesAgedItems I1117 09:36:50.454517 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/test/folder1 (triggered by i1) I1117 09:36:50.455467 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/test/folder2 (triggered by i2) --- PASS: TestEmptyFolderCleaner_processCleanupQueue_onlyProcessesAgedItems (0.01s) === RUN TestEmptyFolderCleaner_executeCleanup_bucketPolicyDisabledSkips --- PASS: TestEmptyFolderCleaner_executeCleanup_bucketPolicyDisabledSkips (0.01s) === RUN TestEmptyFolderCleaner_InvalidateBucketPolicy --- PASS: TestEmptyFolderCleaner_InvalidateBucketPolicy (0.00s) === RUN TestEmptyFolderCleaner_getBucketCleanupPolicy_concurrentUpdate --- PASS: TestEmptyFolderCleaner_getBucketCleanupPolicy_concurrentUpdate (0.00s) === RUN TestEmptyFolderCleaner_getBucketCleanupPolicy_evictionKeepsInflightRead --- PASS: TestEmptyFolderCleaner_getBucketCleanupPolicy_evictionKeepsInflightRead (0.00s) === RUN TestEmptyFolderCleaner_executeCleanup_policyFailureRequeues --- PASS: TestEmptyFolderCleaner_executeCleanup_policyFailureRequeues (0.01s) === RUN TestEmptyFolderCleaner_executeCleanup_directoryMarker === RUN TestEmptyFolderCleaner_executeCleanup_directoryMarker/skips_explicit_directory_marker === RUN TestEmptyFolderCleaner_executeCleanup_directoryMarker/deletes_implicit_empty_folder I1117 09:36:50.492903 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/test/folder (triggered by triggered_item) --- PASS: TestEmptyFolderCleaner_executeCleanup_directoryMarker (0.02s) --- PASS: TestEmptyFolderCleaner_executeCleanup_directoryMarker/skips_explicit_directory_marker (0.00s) --- PASS: TestEmptyFolderCleaner_executeCleanup_directoryMarker/deletes_implicit_empty_folder (0.01s) === RUN TestEmptyFolderCleaner_OnCreateEvent_cancelsCleanupForRecreatedDirectory --- PASS: TestEmptyFolderCleaner_OnCreateEvent_cancelsCleanupForRecreatedDirectory (0.01s) === RUN TestEmptyFolderCleaner_executeCleanup_skipsCatalogEntry I1117 09:36:50.528526 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/warehouse/pedsnet/person/metadata (triggered by v2.metadata.json) --- PASS: TestEmptyFolderCleaner_executeCleanup_skipsCatalogEntry (0.02s) === RUN TestEmptyFolderCleaner_restoreIfWrittenTo === RUN TestEmptyFolderCleaner_restoreIfWrittenTo/an_entry_that_landed_during_the_delete_is_restored_without_waiting_for_its_event I1117 09:36:50.555235 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/a/b (triggered by obj) === RUN TestEmptyFolderCleaner_restoreIfWrittenTo/a_folder_still_empty_after_the_delete_is_not_restored_and_the_parent_is_cascaded I1117 09:36:50.559832 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/a/b (triggered by obj) I1117 09:36:50.560827 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/a (triggered by obj) === RUN TestEmptyFolderCleaner_restoreIfWrittenTo/a_restore_that_fails_is_left_marked_for_the_deferred_pass I1117 09:36:50.562967 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/a/b (triggered by obj) I1117 09:36:50.568903 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/a (triggered by obj) === RUN TestEmptyFolderCleaner_restoreIfWrittenTo/a_re-check_that_fails_leaves_the_folder_to_the_event_path I1117 09:36:50.572348 empty_folder_cleaner.go:621 EmptyFolderCleaner: deleting empty folder /buckets/mybucket/a/b (triggered by obj) --- PASS: TestEmptyFolderCleaner_restoreIfWrittenTo (0.03s) --- PASS: TestEmptyFolderCleaner_restoreIfWrittenTo/an_entry_that_landed_during_the_delete_is_restored_without_waiting_for_its_event (0.00s) --- PASS: TestEmptyFolderCleaner_restoreIfWrittenTo/a_folder_still_empty_after_the_delete_is_not_restored_and_the_parent_is_cascaded (0.00s) --- PASS: TestEmptyFolderCleaner_restoreIfWrittenTo/a_restore_that_fails_is_left_marked_for_the_deferred_pass (0.01s) --- PASS: TestEmptyFolderCleaner_restoreIfWrittenTo/a_re-check_that_fails_leaves_the_folder_to_the_event_path (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/empty_folder_cleanup 2.728s === RUN TestScanEntriesSeesFileMovedDuringScan --- PASS: TestScanEntriesSeesFileMovedDuringScan (0.07s) === RUN TestScanEntriesFromRoot --- PASS: TestScanEntriesFromRoot (0.02s) === RUN TestScanEntriesReadsHardLinkAtScanRevision --- PASS: TestScanEntriesReadsHardLinkAtScanRevision (0.01s) === RUN TestScanEntriesFailsWhenRevisionCompacted --- PASS: TestScanEntriesFailsWhenRevisionCompacted (0.01s) === RUN TestScanEntriesRejectsSanitizedPathOfAnotherEntry === RUN TestScanEntriesRejectsSanitizedPathOfAnotherEntry/free === RUN TestScanEntriesRejectsSanitizedPathOfAnotherEntry/stored_entry === RUN TestScanEntriesRejectsSanitizedPathOfAnotherEntry/two_invalid_directories === RUN TestScanEntriesRejectsSanitizedPathOfAnotherEntry/created_after_the_scan_revision --- PASS: TestScanEntriesRejectsSanitizedPathOfAnotherEntry (0.04s) --- PASS: TestScanEntriesRejectsSanitizedPathOfAnotherEntry/free (0.01s) --- PASS: TestScanEntriesRejectsSanitizedPathOfAnotherEntry/stored_entry (0.00s) --- PASS: TestScanEntriesRejectsSanitizedPathOfAnotherEntry/two_invalid_directories (0.00s) --- PASS: TestScanEntriesRejectsSanitizedPathOfAnotherEntry/created_after_the_scan_revision (0.00s) === RUN TestStore --- PASS: TestStore (0.00s) === RUN TestWithTimeout --- PASS: TestWithTimeout (0.00s) === RUN TestWritesHaveNoRequestDeadline --- PASS: TestWritesHaveNoRequestDeadline (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/etcd 3.190s === RUN TestFDBValueSizeLimitConstant --- PASS: TestFDBValueSizeLimitConstant (0.00s) === RUN TestErrIfValueTooLarge --- PASS: TestErrIfValueTooLarge (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/foundationdb 0.344s ? github.com/seaweedfs/seaweedfs/weed/filer/hbase [no test files] === RUN TestCreateAndFind I1117 09:36:50.333023 leveldb_store.go:48 filer store dir: /tmp/TestCreateAndFind1614291040/001 I1117 09:36:50.360221 file_util.go:29 Folder /tmp/TestCreateAndFind1614291040/001 Permission: -rwxr-xr-x I1117 09:36:50.525666 filer.go:435 create filer.store.id to 523830275 --- PASS: TestCreateAndFind (0.62s) === RUN TestEmptyRoot I1117 09:36:50.741921 leveldb_store.go:48 filer store dir: /tmp/TestEmptyRoot1427408829/001 I1117 09:36:50.742374 file_util.go:29 Folder /tmp/TestEmptyRoot1427408829/001 Permission: -rwxr-xr-x I1117 09:36:50.762531 filer.go:435 create filer.store.id to -1487013801 --- PASS: TestEmptyRoot (0.05s) === RUN TestListDirectoryPrefixedEntries_StartBelowPrefix I1117 09:36:50.777920 leveldb_store.go:48 filer store dir: /tmp/TestListDirectoryPrefixedEntries_StartBelowPrefix4033472057/001 I1117 09:36:50.778259 file_util.go:29 Folder /tmp/TestListDirectoryPrefixedEntries_StartBelowPrefix4033472057/001 Permission: -rwxr-xr-x --- PASS: TestListDirectoryPrefixedEntries_StartBelowPrefix (0.10s) === RUN TestUnavailableDatabaseFailsListAndDelete I1117 09:36:50.883234 leveldb_store.go:48 filer store dir: /tmp/TestUnavailableDatabaseFailsListAndDelete346952339/001 I1117 09:36:50.884042 file_util.go:29 Folder /tmp/TestUnavailableDatabaseFailsListAndDelete346952339/001 Permission: -rwxr-xr-x --- PASS: TestUnavailableDatabaseFailsListAndDelete (0.03s) === RUN TestCreateEntryRecordsObjectSize I1117 09:36:50.918115 leveldb_store.go:48 filer store dir: /tmp/TestCreateEntryRecordsObjectSize449939823/001 I1117 09:36:50.918525 file_util.go:29 Folder /tmp/TestCreateEntryRecordsObjectSize449939823/001 Permission: -rwxr-xr-x I1117 09:36:50.929666 filer.go:435 create filer.store.id to -1982906387 I1117 09:36:50.958666 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:36:50.959699 filer_deletion.go:317 deletion processor shutting down --- PASS: TestCreateEntryRecordsObjectSize (0.07s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/leveldb 3.135s === RUN TestNonRecursiveFolderDeleteKeepsRacingChild I1117 09:36:50.225392 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestNonRecursiveFolderDeleteKeepsRacingChild4066072920/001 I1117 09:36:50.285109 file_util.go:29 Folder /tmp/TestNonRecursiveFolderDeleteKeepsRacingChild4066072920/001 Permission: -rwxr-xr-x I1117 09:36:50.557463 filer.go:435 create filer.store.id to 1401329862 --- PASS: TestNonRecursiveFolderDeleteKeepsRacingChild (0.69s) === RUN TestEnsureDirectoryEntryRestoresRacingParent I1117 09:36:50.706904 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestEnsureDirectoryEntryRestoresRacingParent1590123200/001 I1117 09:36:50.708271 file_util.go:29 Folder /tmp/TestEnsureDirectoryEntryRestoresRacingParent1590123200/001 Permission: -rwxr-xr-x I1117 09:36:50.832743 filer.go:435 create filer.store.id to -567633381 --- PASS: TestEnsureDirectoryEntryRestoresRacingParent (0.17s) === RUN TestEnsureDirectoryEntryRestoresExactAttributes I1117 09:36:50.876749 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestEnsureDirectoryEntryRestoresExactAttributes119026101/001 I1117 09:36:50.877774 file_util.go:29 Folder /tmp/TestEnsureDirectoryEntryRestoresExactAttributes119026101/001 Permission: -rwxr-xr-x I1117 09:36:50.919409 filer.go:435 create filer.store.id to 1269907596 --- PASS: TestEnsureDirectoryEntryRestoresExactAttributes (0.07s) === RUN TestCreateEntryCreatesParentAfterTheEntry I1117 09:36:50.944582 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestCreateEntryCreatesParentAfterTheEntry502729122/001 I1117 09:36:50.945012 file_util.go:29 Folder /tmp/TestCreateEntryCreatesParentAfterTheEntry502729122/001 Permission: -rwxr-xr-x I1117 09:36:51.069495 filer.go:435 create filer.store.id to -433117107 --- PASS: TestCreateEntryCreatesParentAfterTheEntry (0.17s) === RUN TestCreateEntryKeepsTheEntryWhenTheParentCannotBeCreated I1117 09:36:51.163440 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestCreateEntryKeepsTheEntryWhenTheParentCannotBeCreated3495193927/001 I1117 09:36:51.163966 file_util.go:29 Folder /tmp/TestCreateEntryKeepsTheEntryWhenTheParentCannotBeCreated3495193927/001 Permission: -rwxr-xr-x I1117 09:36:51.194652 filer.go:435 create filer.store.id to 453572700 E1117 09:36:51.200288 filer.go:582 create parent directories of /buckets/Not_A_Valid_Bucket/obj: invalid bucket name Not_A_Valid_Bucket: bucket name can only contain lowercase letters, numbers, dots, and hyphens --- PASS: TestCreateEntryKeepsTheEntryWhenTheParentCannotBeCreated (0.10s) === RUN TestCreateEntryDoesNotAnnounceAnEntryWhoseParentFailed I1117 09:36:51.229351 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestCreateEntryDoesNotAnnounceAnEntryWhoseParentFailed4076566756/001 I1117 09:36:51.229726 file_util.go:29 Folder /tmp/TestCreateEntryDoesNotAnnounceAnEntryWhoseParentFailed4076566756/001 Permission: -rwxr-xr-x I1117 09:36:51.260024 filer.go:435 create filer.store.id to -699558807 E1117 09:36:51.264441 filer.go:582 create parent directories of /buckets/Not_A_Valid_Bucket/obj: invalid bucket name Not_A_Valid_Bucket: bucket name can only contain lowercase letters, numbers, dots, and hyphens --- PASS: TestCreateEntryDoesNotAnnounceAnEntryWhoseParentFailed (0.05s) === RUN TestEnsureDirectoryEntryNarrowsAWiderRestore I1117 09:36:51.286430 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestEnsureDirectoryEntryNarrowsAWiderRestore1169888703/001 I1117 09:36:51.286990 file_util.go:29 Folder /tmp/TestEnsureDirectoryEntryNarrowsAWiderRestore1169888703/001 Permission: -rwxr-xr-x I1117 09:36:51.314273 filer.go:435 create filer.store.id to 681558101 --- PASS: TestEnsureDirectoryEntryNarrowsAWiderRestore (0.06s) === RUN TestEnsureDirectoryEntryKeepsATightenedDirectory I1117 09:36:51.350854 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestEnsureDirectoryEntryKeepsATightenedDirectory1766077365/001 I1117 09:36:51.351430 file_util.go:29 Folder /tmp/TestEnsureDirectoryEntryKeepsATightenedDirectory1766077365/001 Permission: -rwxr-xr-x I1117 09:36:51.426624 filer.go:435 create filer.store.id to 559193672 --- PASS: TestEnsureDirectoryEntryKeepsATightenedDirectory (0.11s) === RUN TestEnsureDirectoryEntryIntersectsMixedModes I1117 09:36:51.461230 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestEnsureDirectoryEntryIntersectsMixedModes2787112551/001 I1117 09:36:51.461607 file_util.go:29 Folder /tmp/TestEnsureDirectoryEntryIntersectsMixedModes2787112551/001 Permission: -rwxr-xr-x I1117 09:36:51.489730 filer.go:435 create filer.store.id to -1127979430 --- PASS: TestEnsureDirectoryEntryIntersectsMixedModes (0.05s) === RUN TestCreateAndFind I1117 09:36:51.509832 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestCreateAndFind2074897630/001 I1117 09:36:51.510458 file_util.go:29 Folder /tmp/TestCreateAndFind2074897630/001 Permission: -rwxr-xr-x I1117 09:36:51.560062 filer.go:435 create filer.store.id to 1658793775 --- PASS: TestCreateAndFind (0.09s) === RUN TestInitializeOptions I1117 09:36:51.598026 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestInitializeOptions2082439110/001 I1117 09:36:51.598446 file_util.go:29 Folder /tmp/TestInitializeOptions2082439110/001 Permission: -rwxr-xr-x --- PASS: TestInitializeOptions (0.15s) === RUN TestInitializeDefaultOptions I1117 09:36:51.750302 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestInitializeDefaultOptions2921549203/001 I1117 09:36:51.753024 file_util.go:29 Folder /tmp/TestInitializeDefaultOptions2921549203/001 Permission: -rwxr-xr-x --- PASS: TestInitializeDefaultOptions (0.10s) === RUN TestInitializeRejectsOversizedOption --- PASS: TestInitializeRejectsOversizedOption (0.00s) === RUN TestListDirectoryPrefixedEntries_StartBelowPrefix I1117 09:36:51.858420 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestListDirectoryPrefixedEntries_StartBelowPrefix3740341637/001 I1117 09:36:51.858717 file_util.go:29 Folder /tmp/TestListDirectoryPrefixedEntries_StartBelowPrefix3740341637/001 Permission: -rwxr-xr-x --- PASS: TestListDirectoryPrefixedEntries_StartBelowPrefix (0.17s) === RUN TestEmptyRoot I1117 09:36:52.151900 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestEmptyRoot2463275259/001 I1117 09:36:52.152364 file_util.go:29 Folder /tmp/TestEmptyRoot2463275259/001 Permission: -rwxr-xr-x I1117 09:36:52.263075 filer.go:435 create filer.store.id to -928610191 --- PASS: TestEmptyRoot (0.24s) === RUN TestUnavailableDatabaseFailsListAndDelete I1117 09:36:52.269953 leveldb2_store.go:94 filer store leveldb2 dir: /tmp/TestUnavailableDatabaseFailsListAndDelete3283943424/001 I1117 09:36:52.270520 file_util.go:29 Folder /tmp/TestUnavailableDatabaseFailsListAndDelete3283943424/001 Permission: -rwxr-xr-x --- PASS: TestUnavailableDatabaseFailsListAndDelete (0.12s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/leveldb2 4.540s === RUN TestCreateAndFind I1117 09:36:50.329408 leveldb3_store.go:108 filer store leveldb3 dir: /tmp/TestCreateAndFind2843332783/001 I1117 09:36:50.357053 file_util.go:29 Folder /tmp/TestCreateAndFind2843332783/001 Permission: -rwxr-xr-x I1117 09:36:50.565630 filer.go:435 create filer.store.id to 1762109931 --- PASS: TestCreateAndFind (0.64s) === RUN TestInitializeOptions I1117 09:36:50.744675 leveldb3_store.go:108 filer store leveldb3 dir: /tmp/TestInitializeOptions3046805894/001 I1117 09:36:50.745364 file_util.go:29 Folder /tmp/TestInitializeOptions3046805894/001 Permission: -rwxr-xr-x --- PASS: TestInitializeOptions (0.03s) === RUN TestInitializeDefaultOptions I1117 09:36:50.779633 leveldb3_store.go:108 filer store leveldb3 dir: /tmp/TestInitializeDefaultOptions412458754/001 I1117 09:36:50.781016 file_util.go:29 Folder /tmp/TestInitializeDefaultOptions412458754/001 Permission: -rwxr-xr-x --- PASS: TestInitializeDefaultOptions (0.04s) === RUN TestInitializeRejectsOversizedOption --- PASS: TestInitializeRejectsOversizedOption (0.00s) === RUN TestEmptyRoot I1117 09:36:50.986788 leveldb3_store.go:108 filer store leveldb3 dir: /tmp/TestEmptyRoot4086774478/001 I1117 09:36:50.987365 file_util.go:29 Folder /tmp/TestEmptyRoot4086774478/001 Permission: -rwxr-xr-x I1117 09:36:51.071757 filer.go:435 create filer.store.id to 1700334922 --- PASS: TestEmptyRoot (0.27s) === RUN TestListDirectoryPrefixedEntries_StartBelowPrefix I1117 09:36:51.095718 leveldb3_store.go:108 filer store leveldb3 dir: /tmp/TestListDirectoryPrefixedEntries_StartBelowPrefix3634228813/001 I1117 09:36:51.096018 file_util.go:29 Folder /tmp/TestListDirectoryPrefixedEntries_StartBelowPrefix3634228813/001 Permission: -rwxr-xr-x --- PASS: TestListDirectoryPrefixedEntries_StartBelowPrefix (0.04s) === RUN TestBucketEventsStayInsideStoreDir I1117 09:36:51.131908 leveldb3_store.go:108 filer store leveldb3 dir: /tmp/TestBucketEventsStayInsideStoreDir4211350389/001/store I1117 09:36:51.132344 file_util.go:29 Folder /tmp/TestBucketEventsStayInsideStoreDir4211350389/001/store Permission: -rwxr-xr-x --- PASS: TestBucketEventsStayInsideStoreDir (0.19s) === RUN TestUnavailableDatabaseFailsListAndDelete I1117 09:36:51.325768 leveldb3_store.go:108 filer store leveldb3 dir: /tmp/TestUnavailableDatabaseFailsListAndDelete2631601169/001 I1117 09:36:51.326162 file_util.go:29 Folder /tmp/TestUnavailableDatabaseFailsListAndDelete2631601169/001 Permission: -rwxr-xr-x --- PASS: TestUnavailableDatabaseFailsListAndDelete (0.07s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/leveldb3 3.531s === RUN TestWriteRecoversOnceStorageRecovers W1117 09:36:48.552861 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device W1117 09:36:48.636577 leveldb_handle.go:205 leveldb : reopening after a storage write error --- PASS: TestWriteRecoversOnceStorageRecovers (0.51s) === RUN TestStalledProbeKeepsReadsAvailable W1117 09:36:48.913534 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device --- PASS: TestStalledProbeKeepsReadsAvailable (0.07s) === RUN TestWritesDoNotQueueBehindAStalledProbe W1117 09:36:49.010418 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device --- PASS: TestWritesDoNotQueueBehindAStalledProbe (0.09s) === RUN TestReopenWaitsForOpenIterator W1117 09:36:49.063205 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device W1117 09:36:49.117640 leveldb_handle.go:197 leveldb : calls still running after 50ms, not reopening W1117 09:36:49.120359 leveldb_handle.go:205 leveldb : reopening after a storage write error --- PASS: TestReopenWaitsForOpenIterator (0.19s) === RUN TestNestedReadWaitsOutTheDrain W1117 09:36:49.218106 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device W1117 09:36:49.721508 leveldb_handle.go:197 leveldb : calls still running after 500ms, not reopening --- PASS: TestNestedReadWaitsOutTheDrain (0.52s) === RUN TestReopenIsNotStarvedByOverlappingReaders W1117 09:36:49.751801 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device W1117 09:36:49.765850 leveldb_handle.go:205 leveldb : reopening after a storage write error --- PASS: TestReopenIsNotStarvedByOverlappingReaders (0.13s) === RUN TestCloseIsNotUndoneByReopen W1117 09:36:49.870150 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device --- PASS: TestCloseIsNotUndoneByReopen (0.02s) === RUN TestReopenKeepsFileDatabase W1117 09:36:49.949408 leveldb_handle.go:205 leveldb /tmp/TestReopenKeepsFileDatabase2603207671/001: reopening after a storage write error --- PASS: TestReopenKeepsFileDatabase (0.27s) === RUN TestReopenAttemptsAreRateLimited W1117 09:36:50.164237 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device W1117 09:36:50.165708 leveldb_handle.go:205 leveldb : reopening after a storage write error --- PASS: TestReopenAttemptsAreRateLimited (0.11s) === RUN TestFailedReopenReportsErrorsUntilOpen W1117 09:36:50.291578 leveldb_handle.go:193 leveldb : storage still failing, not reopening: no space left on device W1117 09:36:50.302015 leveldb_handle.go:205 leveldb : reopening after a storage write error E1117 09:36:50.324744 leveldb_handle.go:211 leveldb : reopen: no space left on device W1117 09:36:50.329327 leveldb_handle.go:205 leveldb : reopening after a storage write error E1117 09:36:50.370102 leveldb_handle.go:211 leveldb : reopen: no space left on device W1117 09:36:50.371803 leveldb_handle.go:205 leveldb : reopening after a storage write error E1117 09:36:50.388244 leveldb_handle.go:211 leveldb : reopen: no space left on device W1117 09:36:50.390298 leveldb_handle.go:205 leveldb : reopening after a storage write error --- PASS: TestFailedReopenReportsErrorsUntilOpen (0.21s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/leveldb_handle 2.639s ? github.com/seaweedfs/seaweedfs/weed/filer/mongodb [no test files] === RUN TestDefaultUpsertQueryUsesOnDuplicateKey --- PASS: TestDefaultUpsertQueryUsesOnDuplicateKey (0.00s) === RUN TestDefaultCreateTableQueryRendersValidSql --- PASS: TestDefaultCreateTableQueryRendersValidSql (0.00s) === RUN TestEmptyUpsertTemplateFallsBackToPlainInsert --- PASS: TestEmptyUpsertTemplateFallsBackToPlainInsert (0.00s) === RUN TestListSqlDefaultOrderingFollowsColumn --- PASS: TestListSqlDefaultOrderingFollowsColumn (0.00s) === RUN TestListSqlBinaryOrderingOnNonBinaryColumn --- PASS: TestListSqlBinaryOrderingOnNonBinaryColumn (0.00s) === RUN TestListSqlEscapesLikeWildcards --- PASS: TestListSqlEscapesLikeWildcards (0.00s) === RUN TestIsBinaryCollation --- PASS: TestIsBinaryCollation (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/mysql 2.286s ? github.com/seaweedfs/seaweedfs/weed/filer/mysql2 [no test files] === RUN TestManagerGrantAndConflict --- PASS: TestManagerGrantAndConflict (0.01s) === RUN TestManagerUnlockCleansEmptyKeyAndIndex --- PASS: TestManagerUnlockCleansEmptyKeyAndIndex (0.00s) === RUN TestManagerPartialUnlockKeepsIndex --- PASS: TestManagerPartialUnlockKeepsIndex (0.00s) === RUN TestManagerGetLk --- PASS: TestManagerGetLk (0.00s) === RUN TestManagerReleasePosixOwnerKeepsFlockAndIndex --- PASS: TestManagerReleasePosixOwnerKeepsFlockAndIndex (0.01s) === RUN TestManagerReleaseSessionReapsAcrossKeys --- PASS: TestManagerReleaseSessionReapsAcrossKeys (0.00s) === RUN TestManagerReapsOnlyStaleLeasedSessions --- PASS: TestManagerReapsOnlyStaleLeasedSessions (0.00s) === RUN TestManagerConcurrentFlockMutualExclusion --- PASS: TestManagerConcurrentFlockMutualExclusion (2.00s) === RUN TestNonOverlappingLocksFromDifferentOwners --- PASS: TestNonOverlappingLocksFromDifferentOwners (0.00s) === RUN TestOverlappingReadLocksFromDifferentOwners --- PASS: TestOverlappingReadLocksFromDifferentOwners (0.00s) === RUN TestOverlappingWriteReadConflict --- PASS: TestOverlappingWriteReadConflict (0.00s) === RUN TestOverlappingWriteWriteConflict --- PASS: TestOverlappingWriteWriteConflict (0.00s) === RUN TestSameOwnerUpgradeReadToWrite --- PASS: TestSameOwnerUpgradeReadToWrite (0.00s) === RUN TestSameOwnerDowngradeWriteToRead --- PASS: TestSameOwnerDowngradeWriteToRead (0.00s) === RUN TestLockCoalescing --- PASS: TestLockCoalescing (0.00s) === RUN TestLockSplitting --- PASS: TestLockSplitting (0.00s) === RUN TestConflictReportsHolder --- PASS: TestConflictReportsHolder (0.00s) === RUN TestConflictNoneForSharedReads --- PASS: TestConflictNoneForSharedReads (0.00s) === RUN TestConflictSameOwnerNone --- PASS: TestConflictSameOwnerNone (0.00s) === RUN TestReleaseOwner --- PASS: TestReleaseOwner (0.00s) === RUN TestFlockAndFcntlDoNotConflict --- PASS: TestFlockAndFcntlDoNotConflict (0.00s) === RUN TestReleasePosixOwnerKeepsFlock --- PASS: TestReleasePosixOwnerKeepsFlock (0.00s) === RUN TestReleaseFlockOwnerKeepsPosix --- PASS: TestReleaseFlockOwnerKeepsPosix (0.00s) === RUN TestHasPosixIgnoresMissingOwnerAndFlock --- PASS: TestHasPosixIgnoresMissingOwnerAndFlock (0.00s) === RUN TestWholeFileLock --- PASS: TestWholeFileLock (0.00s) === RUN TestReleaseNoExistingLocks --- PASS: TestReleaseNoExistingLocks (0.00s) === RUN TestSameOwnerReplaceDifferentType --- PASS: TestSameOwnerReplaceDifferentType (0.00s) === RUN TestNonAdjacentRangesNotCoalesced --- PASS: TestNonAdjacentRangesNotCoalesced (0.00s) === RUN TestAdjacencyNoOverflowAtMaxUint64 --- PASS: TestAdjacencyNoOverflowAtMaxUint64 (0.00s) === RUN TestTwoSessionsSameOwnerDoNotAlias --- PASS: TestTwoSessionsSameOwnerDoNotAlias (0.00s) === RUN TestReleaseSessionReapsOnlyThatSession --- PASS: TestReleaseSessionReapsOnlyThatSession (0.00s) === RUN TestEmptyAfterReleasingAll --- PASS: TestEmptyAfterReleasingAll (0.00s) === RUN TestReassertRebuildsOnFreshOwner --- PASS: TestReassertRebuildsOnFreshOwner (0.00s) === RUN TestReassertIdempotent --- PASS: TestReassertIdempotent (0.00s) === RUN TestReassertReportsConflict --- PASS: TestReassertReportsConflict (0.01s) === RUN TestReassertRenewsLease --- PASS: TestReassertRenewsLease (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/posixlock 2.463s === RUN TestConfigureListOrderingSkipsCockroachDB --- PASS: TestConfigureListOrderingSkipsCockroachDB (0.02s) === RUN TestConfigureListOrderingForcesBinaryOnLocalePostgres W1117 09:36:50.170729 postgres_collation.go:29 postgres: filemeta.name collation "en_US.UTF-8" is not byte-ordered, so S3 list order is not byte-lexicographic and clients that merge sorted listings may report spurious diffs. Falling back to a slower COLLATE "C" sort; declare the name column COLLATE "C" (or use a C/C.UTF-8 database collation) for correct, indexed ordering. --- PASS: TestConfigureListOrderingForcesBinaryOnLocalePostgres (0.13s) === RUN TestDefaultUpsertQueryIsConflictSafe --- PASS: TestDefaultUpsertQueryIsConflictSafe (0.00s) === RUN TestDefaultCreateTableQueryRendersValidSql --- PASS: TestDefaultCreateTableQueryRendersValidSql (0.00s) === RUN TestEmptyUpsertTemplateFallsBackToPlainInsert --- PASS: TestEmptyUpsertTemplateFallsBackToPlainInsert (0.00s) === RUN TestListSqlDefaultOrderingFollowsColumn --- PASS: TestListSqlDefaultOrderingFollowsColumn (0.00s) === RUN TestListSqlBinaryOrderingOnNonBinaryColumn --- PASS: TestListSqlBinaryOrderingOnNonBinaryColumn (0.00s) === RUN TestListSqlEscapesLikeWildcards --- PASS: TestListSqlEscapesLikeWildcards (0.00s) === RUN TestIsByteOrderedCollation --- PASS: TestIsByteOrderedCollation (0.00s) === RUN TestResolveCreateTableQuery --- PASS: TestResolveCreateTableQuery (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/postgres 2.362s ? github.com/seaweedfs/seaweedfs/weed/filer/postgres2 [no test files] === RUN TestListDirectoryEntriesRemovesOrphanedIndexMembers universal_redis_store_test.go:93: redis tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestListDirectoryEntriesRemovesOrphanedIndexMembers (0.01s) === RUN TestRemoveOrphanedDirectoryListMemberKeepsRecreatedEntry universal_redis_store_test.go:112: redis tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestRemoveOrphanedDirectoryListMemberKeepsRecreatedEntry (0.00s) === RUN TestRemoveOrphanedDirectoryListMemberKeepsDirectoryWithChildren universal_redis_store_test.go:128: redis tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestRemoveOrphanedDirectoryListMemberKeepsDirectoryWithChildren (0.00s) === RUN TestDeleteFolderChildrenRemovesTheListing universal_redis_store_test.go:158: redis tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestDeleteFolderChildrenRemovesTheListing (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/redis 2.377s === RUN TestListDirectoryEntriesRemovesOrphanedIndexMembers === RUN TestListDirectoryEntriesRemovesOrphanedIndexMembers/keyPrefix= universal_redis_store_test.go:93: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. === RUN TestListDirectoryEntriesRemovesOrphanedIndexMembers/keyPrefix=sw: universal_redis_store_test.go:93: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- PASS: TestListDirectoryEntriesRemovesOrphanedIndexMembers (0.02s) --- SKIP: TestListDirectoryEntriesRemovesOrphanedIndexMembers/keyPrefix= (0.01s) --- SKIP: TestListDirectoryEntriesRemovesOrphanedIndexMembers/keyPrefix=sw: (0.00s) === RUN TestRemoveOrphanedDirectoryListMemberKeepsRecreatedEntry === RUN TestRemoveOrphanedDirectoryListMemberKeepsRecreatedEntry/keyPrefix= universal_redis_store_test.go:116: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. === RUN TestRemoveOrphanedDirectoryListMemberKeepsRecreatedEntry/keyPrefix=sw: universal_redis_store_test.go:116: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- PASS: TestRemoveOrphanedDirectoryListMemberKeepsRecreatedEntry (0.01s) --- SKIP: TestRemoveOrphanedDirectoryListMemberKeepsRecreatedEntry/keyPrefix= (0.00s) --- SKIP: TestRemoveOrphanedDirectoryListMemberKeepsRecreatedEntry/keyPrefix=sw: (0.00s) === RUN TestRemoveOrphanedDirectoryListMemberKeepsDirectoryWithChildren === RUN TestRemoveOrphanedDirectoryListMemberKeepsDirectoryWithChildren/keyPrefix= universal_redis_store_test.go:137: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. === RUN TestRemoveOrphanedDirectoryListMemberKeepsDirectoryWithChildren/keyPrefix=sw: universal_redis_store_test.go:137: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- PASS: TestRemoveOrphanedDirectoryListMemberKeepsDirectoryWithChildren (0.01s) --- SKIP: TestRemoveOrphanedDirectoryListMemberKeepsDirectoryWithChildren/keyPrefix= (0.00s) --- SKIP: TestRemoveOrphanedDirectoryListMemberKeepsDirectoryWithChildren/keyPrefix=sw: (0.00s) === RUN TestRemoveOrphanedDirectoryListMemberSkipsSuperLargeDirectory universal_redis_store_test.go:169: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestRemoveOrphanedDirectoryListMemberSkipsSuperLargeDirectory (0.00s) === RUN TestListDirectoryEntriesRemovesIndexMembersExpiredByRedis universal_redis_store_test.go:193: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestListDirectoryEntriesRemovesIndexMembersExpiredByRedis (0.00s) === RUN TestListDirectoryEntriesDeletesLogicallyExpiredEntries === RUN TestListDirectoryEntriesDeletesLogicallyExpiredEntries/keyPrefix= universal_redis_store_test.go:239: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. === RUN TestListDirectoryEntriesDeletesLogicallyExpiredEntries/keyPrefix=sw: universal_redis_store_test.go:239: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- PASS: TestListDirectoryEntriesDeletesLogicallyExpiredEntries (0.00s) --- SKIP: TestListDirectoryEntriesDeletesLogicallyExpiredEntries/keyPrefix= (0.00s) --- SKIP: TestListDirectoryEntriesDeletesLogicallyExpiredEntries/keyPrefix=sw: (0.00s) === RUN TestListDirectoryEntriesSkipsMissingAndExpiredMembersInOrder === RUN TestListDirectoryEntriesSkipsMissingAndExpiredMembersInOrder/keyPrefix= universal_redis_store_test.go:262: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. === RUN TestListDirectoryEntriesSkipsMissingAndExpiredMembersInOrder/keyPrefix=sw: universal_redis_store_test.go:262: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- PASS: TestListDirectoryEntriesSkipsMissingAndExpiredMembersInOrder (0.00s) --- SKIP: TestListDirectoryEntriesSkipsMissingAndExpiredMembersInOrder/keyPrefix= (0.00s) --- SKIP: TestListDirectoryEntriesSkipsMissingAndExpiredMembersInOrder/keyPrefix=sw: (0.00s) === RUN TestListDirectoryEntriesAcrossFetchBatches universal_redis_store_test.go:285: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestListDirectoryEntriesAcrossFetchBatches (0.00s) === RUN TestListDirectoryEntriesStopsAtUnreadableMember universal_redis_store_test.go:319: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestListDirectoryEntriesStopsAtUnreadableMember (0.01s) === RUN TestDeleteExpiredEntryKeepsRecreatedValue universal_redis_store_test.go:349: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestDeleteExpiredEntryKeepsRecreatedValue (0.01s) === RUN TestDeleteIfUnchangedScriptOnlyDeletesSameBytes universal_redis_store_test.go:368: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestDeleteIfUnchangedScriptOnlyDeletesSameBytes (0.00s) === RUN TestDeleteEntryKeepsChildListing universal_redis_store_test.go:393: redis2 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestDeleteEntryKeepsChildListing (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/redis2 2.387s === RUN TestDeleteEntryKeepsChildListing universal_redis_store_test.go:70: redis3 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestDeleteEntryKeepsChildListing (0.01s) === RUN TestRemovingTheLastChildDropsTheListing universal_redis_store_test.go:107: redis3 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestRemovingTheLastChildDropsTheListing (0.00s) === RUN TestKeyPrefixScopesAllKeys universal_redis_store_test.go:136: redis3 tests are disabled. Start a redis-server and set RUN_REDIS_TESTS=1 to enable, REDIS_ADDR defaults to 127.0.0.1:6379. --- SKIP: TestKeyPrefixScopesAllKeys (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/redis3 2.166s === RUN TestUnsetKeepsGoRedisDefaults --- PASS: TestUnsetKeepsGoRedisDefaults (0.01s) === RUN TestRead --- PASS: TestRead (0.00s) === RUN TestNegativeDurationIsIgnored --- PASS: TestNegativeDurationIsIgnored (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/redis_conf 0.941s === RUN TestDisabled --- PASS: TestDisabled (0.00s) === RUN TestEnabledWithoutCertificates --- PASS: TestEnabledWithoutCertificates (0.00s) === RUN TestMutualTls --- PASS: TestMutualTls (0.18s) === RUN TestUnreadableCaCertificate --- PASS: TestUnreadableCaCertificate (0.00s) === RUN TestCaCertificateWithoutPem --- PASS: TestCaCertificateWithoutPem (0.00s) === RUN TestClientCertificateWithoutKey --- PASS: TestClientCertificateWithoutKey (0.06s) PASS ok github.com/seaweedfs/seaweedfs/weed/filer/redis_tls 1.115s ? github.com/seaweedfs/seaweedfs/weed/filer/sqlite [no test files] ? github.com/seaweedfs/seaweedfs/weed/filer/store_test [no test files] ? github.com/seaweedfs/seaweedfs/weed/filer/tarantool [no test files] ? github.com/seaweedfs/seaweedfs/weed/filer/tikv [no test files] ? github.com/seaweedfs/seaweedfs/weed/filer/ydb [no test files] ? github.com/seaweedfs/seaweedfs/weed/filer_client [no test files] === RUN TestCompressRotated_Toggle --- PASS: TestCompressRotated_Toggle (0.00s) === RUN TestCompressFile --- PASS: TestCompressFile (0.06s) === RUN TestCompressFile_AlreadyGz --- PASS: TestCompressFile_AlreadyGz (0.01s) === RUN TestCompressFile_NonExistent --- PASS: TestCompressFile_NonExistent (0.00s) === RUN TestCompressFile_EmptyFile --- PASS: TestCompressFile_EmptyFile (0.00s) === RUN TestCompressFile_LargeContent --- PASS: TestCompressFile_LargeContent (0.36s) === RUN TestJSONMode_Toggle --- PASS: TestJSONMode_Toggle (0.00s) === RUN TestJSONMode_Output {"ts":"2026-03-19T15:30:00Z","level":"INFO","file":"glog_json_test.go","line":39,"msg":"hello json"} --- PASS: TestJSONMode_Output (0.03s) === RUN TestJSONMode_AllLevels {"ts":"2026-11-17T09:36:48.937297977Z","level":"INFO","file":"glog_json_test.go","line":78,"msg":"info msg"} {"ts":"2026-11-17T09:36:48.937848253Z","level":"WARNING","file":"glog_json_test.go","line":79,"msg":"warn msg"} {"ts":"2026-11-17T09:36:48.938303091Z","level":"ERROR","file":"glog_json_test.go","line":80,"msg":"error msg"} --- PASS: TestJSONMode_AllLevels (0.00s) === RUN TestJSONMode_Infof {"ts":"2026-11-17T09:36:48.942320106Z","level":"INFO","file":"glog_json_test.go","line":106,"msg":"count=42 name=test"} --- PASS: TestJSONMode_Infof (0.00s) === RUN TestJSONEscapeString --- PASS: TestJSONEscapeString (0.00s) === RUN TestItoa --- PASS: TestItoa (0.00s) === RUN TestJSONMode_TextFallback I1117 09:36:48.950125 glog_json_test.go:167 text mode --- PASS: TestJSONMode_TextFallback (0.01s) === RUN TestShortHostname --- PASS: TestShortHostname (0.00s) === RUN TestInfo I1117 09:36:48.962333 glog_test.go:92 test --- PASS: TestInfo (0.00s) === RUN TestInfoDepth I1117 09:36:48.965677 glog_test.go:109 depth-test0 I1117 09:36:48.965858 glog_test.go:110 depth-test1 --- PASS: TestInfoDepth (0.00s) === RUN TestCopyStandardLogToPanic --- PASS: TestCopyStandardLogToPanic (0.00s) === RUN TestStandardLog I1117 09:36:48.974984 glog_test.go:163 test --- PASS: TestStandardLog (0.00s) === RUN TestHeader I0102 15:04:05.067890 glog_test.go:181 test --- PASS: TestHeader (0.01s) === RUN TestError E1117 09:36:48.984695 glog_test.go:202 test --- PASS: TestError (0.00s) === RUN TestWarning W1117 09:36:48.987271 glog_test.go:224 test --- PASS: TestWarning (0.00s) === RUN TestV I1117 09:36:48.989464 glog_test.go:243 test --- PASS: TestV (0.00s) === RUN TestVmoduleOn I1117 09:36:48.994104 glog_test.go:267 test --- PASS: TestVmoduleOn (0.00s) === RUN TestVmoduleOff --- PASS: TestVmoduleOff (0.00s) === RUN TestVmoduleGlob --- PASS: TestVmoduleGlob (0.00s) === RUN TestRollover I1117 09:36:49.004135 glog_test.go:337 x I1117 09:36:49.018156 glog_test.go:351 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx I1117 09:36:50.027983 glog_test.go:364 x --- PASS: TestRollover (1.03s) === RUN TestTimeBasedRollover I1117 09:36:50.034550 glog_test.go:393 x I1117 10:06:50.028247 glog_test.go:407 still within interval I1117 10:37:50.028247 glog_test.go:417 past interval --- PASS: TestTimeBasedRollover (0.01s) === RUN TestLogBacktraceAt I1117 09:36:50.044342 glog_test.go:448 we want a stack trace here goroutine 47 [running]: github.com/seaweedfs/seaweedfs/weed/glog.stacks(0x0) /build/seaweedfs/src/seaweedfs-4.54/weed/glog/glog.go:832 +0x82 github.com/seaweedfs/seaweedfs/weed/glog.(*loggingT).output(0x4ed900, 0x0, 0x2d86964a22a0, {0x27e04d?, 0x1?}, 0x0?, 0x0) /build/seaweedfs/src/seaweedfs-4.54/weed/glog/glog.go:730 +0xb4 github.com/seaweedfs/seaweedfs/weed/glog.(*loggingT).printDepth(0x4ed900, 0x0, 0x1, {0x2d869646be48, 0x1, 0x1}) /build/seaweedfs/src/seaweedfs-4.54/weed/glog/glog.go:667 +0xc0 github.com/seaweedfs/seaweedfs/weed/glog.(*loggingT).print(...) /build/seaweedfs/src/seaweedfs-4.54/weed/glog/glog.go:654 github.com/seaweedfs/seaweedfs/weed/glog.Info(...) /build/seaweedfs/src/seaweedfs-4.54/weed/glog/glog.go:1149 github.com/seaweedfs/seaweedfs/weed/glog.TestLogBacktraceAt(0x2d869658b688) /build/seaweedfs/src/seaweedfs-4.54/weed/glog/glog_test.go:448 +0x35e testing.tRunner(0x2d869658b688, 0x490148) /usr/lib/go/src/testing/testing.go:2195 +0xba created by testing.(*T).Run in goroutine 1 /usr/lib/go/src/testing/testing.go:2260 +0x36c --- PASS: TestLogBacktraceAt (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/glog 2.068s === RUN TestRedactSensitiveFormValues --- PASS: TestRedactSensitiveFormValues (0.01s) === RUN TestListUsersResponseXMLOrdering --- PASS: TestListUsersResponseXMLOrdering (0.02s) === RUN TestErrorResponseXMLUsesTopLevelRequestId --- PASS: TestErrorResponseXMLUsesTopLevelRequestId (0.00s) === RUN TestValidateCallerSuppliedAccessKeyId === RUN TestValidateCallerSuppliedAccessKeyId/empty === RUN TestValidateCallerSuppliedAccessKeyId/three_chars === RUN TestValidateCallerSuppliedAccessKeyId/four_chars_ok === RUN TestValidateCallerSuppliedAccessKeyId/mixed_case_alnum === RUN TestValidateCallerSuppliedAccessKeyId/128_chars_ok === RUN TestValidateCallerSuppliedAccessKeyId/129_chars_too_long === RUN TestValidateCallerSuppliedAccessKeyId/slash_rejected === RUN TestValidateCallerSuppliedAccessKeyId/equals_rejected === RUN TestValidateCallerSuppliedAccessKeyId/dash_rejected === RUN TestValidateCallerSuppliedAccessKeyId/underscore_rejected === RUN TestValidateCallerSuppliedAccessKeyId/unicode_rejected --- PASS: TestValidateCallerSuppliedAccessKeyId (0.03s) --- PASS: TestValidateCallerSuppliedAccessKeyId/empty (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/three_chars (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/four_chars_ok (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/mixed_case_alnum (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/128_chars_ok (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/129_chars_too_long (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/slash_rejected (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/equals_rejected (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/dash_rejected (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/underscore_rejected (0.00s) --- PASS: TestValidateCallerSuppliedAccessKeyId/unicode_rejected (0.00s) === RUN TestValidateCallerSuppliedSecretAccessKey === RUN TestValidateCallerSuppliedSecretAccessKey/empty === RUN TestValidateCallerSuppliedSecretAccessKey/seven_chars === RUN TestValidateCallerSuppliedSecretAccessKey/eight_chars_ok === RUN TestValidateCallerSuppliedSecretAccessKey/128_chars_ok === RUN TestValidateCallerSuppliedSecretAccessKey/129_chars_too_long === RUN TestValidateCallerSuppliedSecretAccessKey/non-alnum_allowed_in_secret --- PASS: TestValidateCallerSuppliedSecretAccessKey (0.01s) --- PASS: TestValidateCallerSuppliedSecretAccessKey/empty (0.00s) --- PASS: TestValidateCallerSuppliedSecretAccessKey/seven_chars (0.00s) --- PASS: TestValidateCallerSuppliedSecretAccessKey/eight_chars_ok (0.00s) --- PASS: TestValidateCallerSuppliedSecretAccessKey/128_chars_ok (0.00s) --- PASS: TestValidateCallerSuppliedSecretAccessKey/129_chars_too_long (0.00s) --- PASS: TestValidateCallerSuppliedSecretAccessKey/non-alnum_allowed_in_secret (0.00s) === RUN TestFindAccessKeyOwner === RUN TestFindAccessKeyOwner/matches_user === RUN TestFindAccessKeyOwner/matches_service_account === RUN TestFindAccessKeyOwner/no_match === RUN TestFindAccessKeyOwner/empty_key === RUN TestFindAccessKeyOwner/nil_config --- PASS: TestFindAccessKeyOwner (0.00s) --- PASS: TestFindAccessKeyOwner/matches_user (0.00s) --- PASS: TestFindAccessKeyOwner/matches_service_account (0.00s) --- PASS: TestFindAccessKeyOwner/no_match (0.00s) --- PASS: TestFindAccessKeyOwner/empty_key (0.00s) --- PASS: TestFindAccessKeyOwner/nil_config (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/iam 2.081s === RUN TestGetProviderByIssuerAndAccount === RUN TestGetProviderByIssuerAndAccount/matching_account_returns_scoped_record === RUN TestGetProviderByIssuerAndAccount/unknown_account_is_rejected === RUN TestGetProviderByIssuerAndAccount/global_provider_satisfies_any_account === RUN TestGetProviderByIssuerAndAccount/empty_caller_account_accepts_any_record --- PASS: TestGetProviderByIssuerAndAccount (0.05s) --- PASS: TestGetProviderByIssuerAndAccount/matching_account_returns_scoped_record (0.01s) --- PASS: TestGetProviderByIssuerAndAccount/unknown_account_is_rejected (0.00s) --- PASS: TestGetProviderByIssuerAndAccount/global_provider_satisfies_any_account (0.00s) --- PASS: TestGetProviderByIssuerAndAccount/empty_caller_account_accepts_any_record (0.00s) === RUN TestPolicyVariableSubstitution --- PASS: TestPolicyVariableSubstitution (0.16s) === RUN TestConditionWithNumericComparison === RUN TestConditionWithNumericComparison/duration_within_limit === RUN TestConditionWithNumericComparison/duration_at_limit === RUN TestConditionWithNumericComparison/duration_exceeding_limit --- PASS: TestConditionWithNumericComparison (0.08s) --- PASS: TestConditionWithNumericComparison/duration_within_limit (0.02s) --- PASS: TestConditionWithNumericComparison/duration_at_limit (0.01s) --- PASS: TestConditionWithNumericComparison/duration_exceeding_limit (0.00s) === RUN TestMultipleConditionOperators === RUN TestMultipleConditionOperators/all_conditions_match === RUN TestMultipleConditionOperators/aud_mismatch === RUN TestMultipleConditionOperators/sub_pattern_mismatch --- PASS: TestMultipleConditionOperators (0.03s) --- PASS: TestMultipleConditionOperators/all_conditions_match (0.00s) --- PASS: TestMultipleConditionOperators/aud_mismatch (0.00s) --- PASS: TestMultipleConditionOperators/sub_pattern_mismatch (0.00s) === RUN TestFullOIDCWorkflow === RUN TestFullOIDCWorkflow/successful_role_assumption_with_policy_validation === RUN TestFullOIDCWorkflow/role_assumption_denied_by_trust_policy === RUN TestFullOIDCWorkflow/invalid_token_rejected --- PASS: TestFullOIDCWorkflow (0.05s) --- PASS: TestFullOIDCWorkflow/successful_role_assumption_with_policy_validation (0.03s) --- PASS: TestFullOIDCWorkflow/role_assumption_denied_by_trust_policy (0.00s) --- PASS: TestFullOIDCWorkflow/invalid_token_rejected (0.00s) === RUN TestFullLDAPWorkflow === RUN TestFullLDAPWorkflow/successful_LDAP_role_assumption === RUN TestFullLDAPWorkflow/invalid_LDAP_credentials --- PASS: TestFullLDAPWorkflow (0.03s) --- PASS: TestFullLDAPWorkflow/successful_LDAP_role_assumption (0.02s) --- PASS: TestFullLDAPWorkflow/invalid_LDAP_credentials (0.00s) === RUN TestPolicyEnforcement === RUN TestPolicyEnforcement/allow_read_access === RUN TestPolicyEnforcement/allow_list_bucket === RUN TestPolicyEnforcement/deny_write_access === RUN TestPolicyEnforcement/deny_delete_access === RUN TestPolicyEnforcement/deny_filer_access --- PASS: TestPolicyEnforcement (0.07s) --- PASS: TestPolicyEnforcement/allow_read_access (0.01s) --- PASS: TestPolicyEnforcement/allow_list_bucket (0.01s) --- PASS: TestPolicyEnforcement/deny_write_access (0.01s) --- PASS: TestPolicyEnforcement/deny_delete_access (0.01s) --- PASS: TestPolicyEnforcement/deny_filer_access (0.01s) === RUN TestSessionPolicyBoundary --- PASS: TestSessionPolicyBoundary (0.03s) === RUN TestAssumeRoleWithWebIdentitySessionPolicy --- PASS: TestAssumeRoleWithWebIdentitySessionPolicy (0.03s) === RUN TestAssumeRoleWithCredentialsSessionPolicy --- PASS: TestAssumeRoleWithCredentialsSessionPolicy (0.03s) === RUN TestSessionExpiration --- PASS: TestSessionExpiration (0.04s) === RUN TestSessionOutlivesShortLivedToken === RUN TestSessionOutlivesShortLivedToken/default_duration_ignores_token_exp === RUN TestSessionOutlivesShortLivedToken/explicit_DurationSeconds_ignores_token_exp --- PASS: TestSessionOutlivesShortLivedToken (0.03s) --- PASS: TestSessionOutlivesShortLivedToken/default_duration_ignores_token_exp (0.01s) --- PASS: TestSessionOutlivesShortLivedToken/explicit_DurationSeconds_ignores_token_exp (0.01s) === RUN TestTrustPolicyValidation === RUN TestTrustPolicyValidation/OIDC_user_allowed_by_trust_policy === RUN TestTrustPolicyValidation/LDAP_user_allowed_by_different_role === RUN TestTrustPolicyValidation/Wrong_provider_for_role --- PASS: TestTrustPolicyValidation (0.02s) --- PASS: TestTrustPolicyValidation/OIDC_user_allowed_by_trust_policy (0.00s) --- PASS: TestTrustPolicyValidation/LDAP_user_allowed_by_different_role (0.00s) --- PASS: TestTrustPolicyValidation/Wrong_provider_for_role (0.00s) === RUN TestTrustPolicyWildcardPrincipal === RUN TestTrustPolicyWildcardPrincipal/Wildcard_federated_principal_allows_any_provider === RUN TestTrustPolicyWildcardPrincipal/Wildcard_in_array_allows_any_provider === RUN TestTrustPolicyWildcardPrincipal/Plain_wildcard_allows_any_provider_(regression) === RUN TestTrustPolicyWildcardPrincipal/Non-wildcard_federated_principal_requires_matching_provider === RUN TestTrustPolicyWildcardPrincipal/Interface_array_principal_works_correctly --- PASS: TestTrustPolicyWildcardPrincipal (0.06s) --- PASS: TestTrustPolicyWildcardPrincipal/Wildcard_federated_principal_allows_any_provider (0.01s) --- PASS: TestTrustPolicyWildcardPrincipal/Wildcard_in_array_allows_any_provider (0.01s) --- PASS: TestTrustPolicyWildcardPrincipal/Plain_wildcard_allows_any_provider_(regression) (0.01s) --- PASS: TestTrustPolicyWildcardPrincipal/Non-wildcard_federated_principal_requires_matching_provider (0.00s) --- PASS: TestTrustPolicyWildcardPrincipal/Interface_array_principal_works_correctly (0.01s) === RUN TestOIDCClaimsTrustPolicy --- PASS: TestOIDCClaimsTrustPolicy (0.02s) === RUN TestIsActionAllowed_RegisteredUserWithoutPoliciesIsDenied --- PASS: TestIsActionAllowed_RegisteredUserWithoutPoliciesIsDenied (0.00s) === RUN TestIsActionAllowed_RegisteredRoleWithoutPoliciesIsDenied --- PASS: TestIsActionAllowed_RegisteredRoleWithoutPoliciesIsDenied (0.00s) === RUN TestIsActionAllowed_RegisteredUserWithNonMatchingPolicyIsDenied --- PASS: TestIsActionAllowed_RegisteredUserWithNonMatchingPolicyIsDenied (0.00s) === RUN TestOIDCAuditLifecycleEventsAreEmitted --- PASS: TestOIDCAuditLifecycleEventsAreEmitted (0.03s) === RUN TestOIDCAuditDefaultsToGlogSink I1117 09:36:51.456739 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam::111122223333:oidc-provider/idp.example","url":"https://idp.example","occurredAt":"2026-11-17T09:36:51.453585599Z"} --- PASS: TestOIDCAuditDefaultsToGlogSink (0.03s) === RUN TestStaticConfigSeedsProviderStore --- PASS: TestStaticConfigSeedsProviderStore (0.01s) === RUN TestStaticConfigMirrorsThumbprintsAndAdvancedFields --- PASS: TestStaticConfigMirrorsThumbprintsAndAdvancedFields (0.01s) === RUN TestStoreNotConfiguredReturnsClearError --- PASS: TestStoreNotConfiguredReturnsClearError (0.00s) === RUN TestPersistentStoreNeverHoldsConfigFileProviders --- PASS: TestPersistentStoreNeverHoldsConfigFileProviders (0.01s) === RUN TestServersSharingAStoreKeepEachOthersProviders I1117 09:36:51.525536 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam:::oidc-provider/api.example","url":"https://api.example","occurredAt":"2026-11-17T09:36:51.524751446Z"} --- PASS: TestServersSharingAStoreKeepEachOthersProviders (0.02s) === RUN TestRemovingAProviderFromTheConfigFileRevokesIt --- PASS: TestRemovingAProviderFromTheConfigFileRevokesIt (0.00s) === RUN TestConfigFileProvidersCannotBeChangedThroughTheAPI --- PASS: TestConfigFileProvidersCannotBeChangedThroughTheAPI (0.00s) === RUN TestStartupLoadsStoredProvidersIntoSTS I1117 09:36:51.551698 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam:::oidc-provider/api.example","url":"https://api.example","occurredAt":"2026-11-17T09:36:51.551387472Z"} --- PASS: TestStartupLoadsStoredProvidersIntoSTS (0.01s) === RUN TestInMemoryStoreStillHoldsConfigFileProviders --- PASS: TestInMemoryStoreStillHoldsConfigFileProviders (0.00s) === RUN TestStartupLoadRetriesUntilTheStoreIsReadable W1117 09:36:51.563446 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: filer unavailable; retrying in the background I1117 09:36:51.576601 iam_manager.go:880 loaded OIDC providers from the store after retrying --- PASS: TestStartupLoadRetriesUntilTheStoreIsReadable (0.03s) === RUN TestStoredProviderTakesPrecedenceOverTheConfigFileOne I1117 09:36:51.590717 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam:::oidc-provider/static.example","url":"https://static.example","occurredAt":"2026-11-17T09:36:51.590399637Z"} I1117 09:36:51.594355 oidc_provider_audit.go:66 oidc-audit: {"type":"AddClientID","arn":"arn:aws:iam:::oidc-provider/static.example","url":"https://static.example","detail":{"clientId":"more"},"occurredAt":"2026-11-17T09:36:51.593845627Z"} I1117 09:36:51.596071 oidc_provider_audit.go:66 oidc-audit: {"type":"Delete","arn":"arn:aws:iam:::oidc-provider/static.example","occurredAt":"2026-11-17T09:36:51.595690289Z"} --- PASS: TestStoredProviderTakesPrecedenceOverTheConfigFileOne (0.01s) === RUN TestSetOIDCProviderStoreInstallsLikeStartup --- PASS: TestSetOIDCProviderStoreInstallsLikeStartup (0.01s) === RUN TestConfigFileProvidersReportNoCreationTime --- PASS: TestConfigFileProvidersReportNoCreationTime (0.00s) === RUN TestInstallingAnotherStoreStopsThePreviousRetry W1117 09:36:51.612659 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: filer unavailable; retrying in the background --- PASS: TestInstallingAnotherStoreStopsThePreviousRetry (0.05s) === RUN TestAnOlderRefreshCannotRestoreADeletedProvider I1117 09:36:51.668245 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam:::oidc-provider/api.example","url":"https://api.example","occurredAt":"2026-11-17T09:36:51.667710274Z"} I1117 09:36:51.887024 oidc_provider_audit.go:66 oidc-audit: {"type":"Delete","arn":"arn:aws:iam:::oidc-provider/api.example","occurredAt":"2026-11-17T09:36:51.886639123Z"} --- PASS: TestAnOlderRefreshCannotRestoreADeletedProvider (0.24s) === RUN TestAFailedRefreshIsRetriedUntilTheStoreAnswers I1117 09:36:51.933889 iam_manager.go:880 loaded OIDC providers from the store after retrying --- PASS: TestAFailedRefreshIsRetriedUntilTheStoreAnswers (0.04s) === RUN TestFailedRefreshesShareOneRetry I1117 09:36:51.970627 iam_manager.go:880 loaded OIDC providers from the store after retrying I1117 09:36:51.976997 iam_manager.go:880 loaded OIDC providers from the store after retrying --- PASS: TestFailedRefreshesShareOneRetry (0.02s) === RUN TestAFailedRefreshOfASupersededStoreStartsNoRetry --- PASS: TestAFailedRefreshOfASupersededStoreStartsNoRetry (0.00s) === RUN TestASupersededSnapshotIsNotApplied I1117 09:36:51.985024 iam_manager.go:880 loaded OIDC providers from the store after retrying --- PASS: TestASupersededSnapshotIsNotApplied (0.02s) === RUN TestAFailureDuringARetryIsNotDropped W1117 09:36:52.004575 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: filer unavailable; retrying in the background I1117 09:36:52.007801 iam_manager.go:880 loaded OIDC providers from the store after retrying I1117 09:36:52.011257 iam_manager.go:880 loaded OIDC providers from the store after retrying --- PASS: TestAFailureDuringARetryIsNotDropped (0.01s) === RUN TestAnUnrelatedRefreshKeepsAProvidersRuntimeState I1117 09:36:52.019299 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam:::oidc-provider/api.example","url":"https://api.example","occurredAt":"2026-11-17T09:36:52.018925249Z"} I1117 09:36:52.021569 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam:::oidc-provider/static.example","url":"https://static.example","occurredAt":"2026-11-17T09:36:52.021256188Z"} --- PASS: TestAnUnrelatedRefreshKeepsAProvidersRuntimeState (0.01s) === RUN TestAChangedRecordRebuildsItsProvider I1117 09:36:52.026649 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam:::oidc-provider/api.example","url":"https://api.example","occurredAt":"2026-11-17T09:36:52.026322066Z"} I1117 09:36:52.029010 oidc_provider_audit.go:66 oidc-audit: {"type":"UpdateThumbprints","arn":"arn:aws:iam:::oidc-provider/api.example","url":"https://api.example","detail":{"count":"1"},"occurredAt":"2026-11-17T09:36:52.028630916Z"} --- PASS: TestAChangedRecordRebuildsItsProvider (0.01s) === RUN TestMemoryStoreCRUD --- PASS: TestMemoryStoreCRUD (0.00s) === RUN TestMemoryStoreGetByIssuerNormalizesHost --- PASS: TestMemoryStoreGetByIssuerNormalizesHost (0.00s) === RUN TestMemoryStoreGetByIssuerMissing --- PASS: TestMemoryStoreGetByIssuerMissing (0.00s) === RUN TestDeriveOIDCProviderARN === RUN TestDeriveOIDCProviderARN/google === RUN TestDeriveOIDCProviderARN/EKS_with_path === RUN TestDeriveOIDCProviderARN/uppercase_host_normalized === RUN TestDeriveOIDCProviderARN/trailing_slash_trimmed === RUN TestDeriveOIDCProviderARN/empty_account_allowed --- PASS: TestDeriveOIDCProviderARN (0.01s) --- PASS: TestDeriveOIDCProviderARN/google (0.00s) --- PASS: TestDeriveOIDCProviderARN/EKS_with_path (0.00s) --- PASS: TestDeriveOIDCProviderARN/uppercase_host_normalized (0.00s) --- PASS: TestDeriveOIDCProviderARN/trailing_slash_trimmed (0.00s) --- PASS: TestDeriveOIDCProviderARN/empty_account_allowed (0.00s) === RUN TestDeriveOIDCProviderARNRejectsBadInput --- PASS: TestDeriveOIDCProviderARNRejectsBadInput (0.00s) === RUN TestStoreRejectsEmptyARN --- PASS: TestStoreRejectsEmptyARN (0.00s) === RUN TestStoreRejectsNil --- PASS: TestStoreRejectsNil (0.00s) === RUN TestNormalizeIssuerRejectsEmpty --- PASS: TestNormalizeIssuerRejectsEmpty (0.00s) === RUN TestNormalizeIssuerHandlesNonURL --- PASS: TestNormalizeIssuerHandlesNonURL (0.00s) === RUN TestSessionIsBoundToTheRoleNotItsName --- PASS: TestSessionIsBoundToTheRoleNotItsName (0.05s) === RUN TestASessionCarryingItsPoliciesIsStillBoundToItsRole --- PASS: TestASessionCarryingItsPoliciesIsStillBoundToItsRole (0.04s) === RUN TestStaticRoleIDIsStableAndRuntimeIDsAreUnique --- PASS: TestStaticRoleIDIsStableAndRuntimeIDsAreUnique (0.02s) === RUN TestAuthorizationEvaluatesTheRoleTheBindingCheckSaw --- PASS: TestAuthorizationEvaluatesTheRoleTheBindingCheckSaw (0.02s) === RUN TestCapDurationByRole === RUN TestCapDurationByRole/no_cap,_no_request_->_nil_keeps_service_default === RUN TestCapDurationByRole/no_cap,_with_request === RUN TestCapDurationByRole/cap_below_default,_no_request_->_cap === RUN TestCapDurationByRole/cap_above_default,_no_request_->_nil === RUN TestCapDurationByRole/request_below_cap_->_request === RUN TestCapDurationByRole/request_equal_cap_->_request === RUN TestCapDurationByRole/request_above_cap_->_cap === RUN TestCapDurationByRole/default_above_service_max_->_service_cap_materialized === RUN TestCapDurationByRole/role_bound_above_service_max_->_service_cap_still_applies === RUN TestCapDurationByRole/role_bound_below_service_floor_->_tightest_issuable --- PASS: TestCapDurationByRole (0.02s) --- PASS: TestCapDurationByRole/no_cap,_no_request_->_nil_keeps_service_default (0.00s) --- PASS: TestCapDurationByRole/no_cap,_with_request (0.00s) --- PASS: TestCapDurationByRole/cap_below_default,_no_request_->_cap (0.00s) --- PASS: TestCapDurationByRole/cap_above_default,_no_request_->_nil (0.00s) --- PASS: TestCapDurationByRole/request_below_cap_->_request (0.00s) --- PASS: TestCapDurationByRole/request_equal_cap_->_request (0.00s) --- PASS: TestCapDurationByRole/request_above_cap_->_cap (0.00s) --- PASS: TestCapDurationByRole/default_above_service_max_->_service_cap_materialized (0.00s) --- PASS: TestCapDurationByRole/role_bound_above_service_max_->_service_cap_still_applies (0.00s) --- PASS: TestCapDurationByRole/role_bound_below_service_floor_->_tightest_issuable (0.00s) === RUN TestFilerRoleUpdateIsNotLostToAConcurrentChange --- PASS: TestFilerRoleUpdateIsNotLostToAConcurrentChange (0.59s) === RUN TestFilerRoleUpdateDoesNotReviveADeletedRole --- PASS: TestFilerRoleUpdateDoesNotReviveADeletedRole (0.15s) === RUN TestFilerRoleCreateRefusesARoleCreatedConcurrently --- PASS: TestFilerRoleCreateRefusesARoleCreatedConcurrently (0.11s) === RUN TestFilerRoleUpdateCanDeleteTheRole --- PASS: TestFilerRoleUpdateCanDeleteTheRole (0.11s) === RUN TestFilerRoleDeleteIsDecidedAgainstTheRoleItRemoves --- PASS: TestFilerRoleDeleteIsDecidedAgainstTheRoleItRemoves (0.08s) === RUN TestFilerRoleListingPagesPastTheFirstThousand --- PASS: TestFilerRoleListingPagesPastTheFirstThousand (0.47s) === RUN TestFilerRoleListingFailsOnABrokenStream --- PASS: TestFilerRoleListingFailsOnABrokenStream (0.07s) === RUN TestMemoryRoleStoreWrapsErrRoleNotFound --- PASS: TestMemoryRoleStoreWrapsErrRoleNotFound (0.00s) === RUN TestPersistentRoleStoreNeverHoldsConfigFileRoles --- PASS: TestPersistentRoleStoreNeverHoldsConfigFileRoles (0.00s) === RUN TestServersSharingARoleStoreKeepEachOthersRoles --- PASS: TestServersSharingARoleStoreKeepEachOthersRoles (0.00s) === RUN TestRemovingARoleFromTheConfigFileRemovesIt --- PASS: TestRemovingARoleFromTheConfigFileRemovesIt (0.00s) === RUN TestConfigFileRolesCannotBeReplacedOrDeletedThroughTheStore --- PASS: TestConfigFileRolesCannotBeReplacedOrDeletedThroughTheStore (0.00s) === RUN TestInMemoryRoleStoreStillHoldsConfigFileRoles --- PASS: TestInMemoryRoleStoreStillHoldsConfigFileRoles (0.00s) === RUN TestRoleCacheInvalidationReachesTheStoreBeneathTheOverlay --- PASS: TestRoleCacheInvalidationReachesTheStoreBeneathTheOverlay (0.00s) === RUN TestRoleCopiesKeepSource --- PASS: TestRoleCopiesKeepSource (0.00s) === RUN TestConfigFileRolesReportNoCreationTime === RUN TestConfigFileRolesReportNoCreationTime/in-memory === RUN TestConfigFileRolesReportNoCreationTime/persistent --- PASS: TestConfigFileRolesReportNoCreationTime (0.00s) --- PASS: TestConfigFileRolesReportNoCreationTime/in-memory (0.00s) --- PASS: TestConfigFileRolesReportNoCreationTime/persistent (0.00s) === RUN TestStoredRoleTakesPrecedenceOverTheConfigFileOne --- PASS: TestStoredRoleTakesPrecedenceOverTheConfigFileOne (0.00s) === RUN TestSetRoleStoreInstallsLikeStartup --- PASS: TestSetRoleStoreInstallsLikeStartup (0.00s) === RUN TestRoleStoreDirectoryIsTheConfiguredBasePath --- PASS: TestRoleStoreDirectoryIsTheConfiguredBasePath (0.00s) === RUN TestMemoryRoleStore --- PASS: TestMemoryRoleStore (0.01s) === RUN TestRoleStoreConfiguration --- PASS: TestRoleStoreConfiguration (0.00s) === RUN TestDistributedIAMManagerWithRoleStore --- PASS: TestDistributedIAMManagerWithRoleStore (0.00s) === RUN TestMemoryRevocationStoreCRUD --- PASS: TestMemoryRevocationStoreCRUD (0.00s) === RUN TestMemoryRevocationStoreRejectsBadInput --- PASS: TestMemoryRevocationStoreRejectsBadInput (0.00s) === RUN TestMemoryRevocationStorePurge --- PASS: TestMemoryRevocationStorePurge (0.00s) === RUN TestIAMManagerRevocationDefaultIsNoop --- PASS: TestIAMManagerRevocationDefaultIsNoop (0.00s) === RUN TestIAMManagerRevocationFlow --- PASS: TestIAMManagerRevocationFlow (0.00s) === RUN TestAssumedRoleUsernameIsTheSessionUser --- PASS: TestAssumedRoleUsernameIsTheSessionUser (0.03s) === RUN TestTrustPolicyAWSUserPrincipal === RUN TestTrustPolicyAWSUserPrincipal/matching_user_principal_should_be_allowed === RUN TestTrustPolicyAWSUserPrincipal/non-matching_user_principal_should_be_denied --- PASS: TestTrustPolicyAWSUserPrincipal (0.01s) --- PASS: TestTrustPolicyAWSUserPrincipal/matching_user_principal_should_be_allowed (0.00s) --- PASS: TestTrustPolicyAWSUserPrincipal/non-matching_user_principal_should_be_denied (0.00s) === RUN TestTrustPolicyAWSWildcardPrincipal --- PASS: TestTrustPolicyAWSWildcardPrincipal (0.01s) === RUN TestTrustPolicyAWSUserArrayPrincipal === RUN TestTrustPolicyAWSUserArrayPrincipal/first_listed_user_is_allowed === RUN TestTrustPolicyAWSUserArrayPrincipal/second_listed_user_is_allowed === RUN TestTrustPolicyAWSUserArrayPrincipal/unlisted_user_is_denied --- PASS: TestTrustPolicyAWSUserArrayPrincipal (0.01s) --- PASS: TestTrustPolicyAWSUserArrayPrincipal/first_listed_user_is_allowed (0.00s) --- PASS: TestTrustPolicyAWSUserArrayPrincipal/second_listed_user_is_allowed (0.00s) --- PASS: TestTrustPolicyAWSUserArrayPrincipal/unlisted_user_is_denied (0.00s) === RUN TestTrustPolicyPlainStringPrincipal --- PASS: TestTrustPolicyPlainStringPrincipal (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/iam/integration 5.973s ? github.com/seaweedfs/seaweedfs/weed/iam/ldap [no test files] === RUN TestDiscoveryHappyPath --- PASS: TestDiscoveryHappyPath (0.34s) === RUN TestDiscoveryFallback404 --- PASS: TestDiscoveryFallback404 (0.07s) === RUN TestDiscoveryDisabledByExplicitJWKSUri --- PASS: TestDiscoveryDisabledByExplicitJWKSUri (0.01s) === RUN TestDiscoveryRejectsIssuerMismatch --- PASS: TestDiscoveryRejectsIssuerMismatch (0.04s) === RUN TestDiscoveryRejectsMissingIssuer --- PASS: TestDiscoveryRejectsMissingIssuer (0.02s) === RUN TestAnHTTPSIssuersDiscoveredKeysMustBeHTTPS W1117 09:36:49.472341 oidc_provider.go:385 OIDC provider "https-keys" is configured to skip TLS verification. This is insecure and should not be used in production. --- PASS: TestAnHTTPSIssuersDiscoveredKeysMustBeHTTPS (0.56s) === RUN TestAnHTTPSKeyFetchIsNotRedirectedToHTTP W1117 09:36:50.023999 oidc_provider.go:385 OIDC provider "https-keys" is configured to skip TLS verification. This is insecure and should not be used in production. --- PASS: TestAnHTTPSKeyFetchIsNotRedirectedToHTTP (0.27s) === RUN TestOIDCProviderInitialization === RUN TestOIDCProviderInitialization/valid_config === RUN TestOIDCProviderInitialization/missing_issuer === RUN TestOIDCProviderInitialization/missing_client_id === RUN TestOIDCProviderInitialization/invalid_issuer_url --- PASS: TestOIDCProviderInitialization (0.02s) --- PASS: TestOIDCProviderInitialization/valid_config (0.00s) --- PASS: TestOIDCProviderInitialization/missing_issuer (0.00s) --- PASS: TestOIDCProviderInitialization/missing_client_id (0.00s) --- PASS: TestOIDCProviderInitialization/invalid_issuer_url (0.00s) === RUN TestOIDCProviderJWTValidation === RUN TestOIDCProviderJWTValidation/valid_token === RUN TestOIDCProviderJWTValidation/valid_token_with_array_audience === RUN TestOIDCProviderJWTValidation/expired_token === RUN TestOIDCProviderJWTValidation/missing_exp === RUN TestOIDCProviderJWTValidation/invalid_signature --- PASS: TestOIDCProviderJWTValidation (8.47s) --- PASS: TestOIDCProviderJWTValidation/valid_token (0.14s) --- PASS: TestOIDCProviderJWTValidation/valid_token_with_array_audience (0.11s) --- PASS: TestOIDCProviderJWTValidation/expired_token (0.10s) --- PASS: TestOIDCProviderJWTValidation/missing_exp (0.11s) --- PASS: TestOIDCProviderJWTValidation/invalid_signature (4.41s) === RUN TestOIDCProviderJWTValidationECDSA === RUN TestOIDCProviderJWTValidationECDSA/valid_token === RUN TestOIDCProviderJWTValidationECDSA/expired_token === RUN TestOIDCProviderJWTValidationECDSA/invalid_signature === RUN TestOIDCProviderJWTValidationECDSA/invalid_issuer === RUN TestOIDCProviderJWTValidationECDSA/invalid_audience --- PASS: TestOIDCProviderJWTValidationECDSA (0.13s) --- PASS: TestOIDCProviderJWTValidationECDSA/valid_token (0.04s) --- PASS: TestOIDCProviderJWTValidationECDSA/expired_token (0.02s) --- PASS: TestOIDCProviderJWTValidationECDSA/invalid_signature (0.02s) --- PASS: TestOIDCProviderJWTValidationECDSA/invalid_issuer (0.01s) --- PASS: TestOIDCProviderJWTValidationECDSA/invalid_audience (0.02s) === RUN TestOIDCProviderAuthentication === RUN TestOIDCProviderAuthentication/successful_authentication === RUN TestOIDCProviderAuthentication/successful_authentication_with_additional_attributes === RUN TestOIDCProviderAuthentication/authentication_with_invalid_token --- PASS: TestOIDCProviderAuthentication (2.87s) --- PASS: TestOIDCProviderAuthentication/successful_authentication (0.10s) --- PASS: TestOIDCProviderAuthentication/successful_authentication_with_additional_attributes (0.11s) --- PASS: TestOIDCProviderAuthentication/authentication_with_invalid_token (0.00s) === RUN TestOIDCProviderUserInfo === RUN TestOIDCProviderUserInfo/get_user_info_with_access_token === RUN TestOIDCProviderUserInfo/get_admin_user_info === RUN TestOIDCProviderUserInfo/get_user_info_without_token === RUN TestOIDCProviderUserInfo/get_user_info_with_invalid_token === RUN TestOIDCProviderUserInfo/get_user_info_with_custom_claims_mapping === RUN TestOIDCProviderUserInfo/get_user_info_with_empty_id --- PASS: TestOIDCProviderUserInfo (0.03s) --- PASS: TestOIDCProviderUserInfo/get_user_info_with_access_token (0.01s) --- PASS: TestOIDCProviderUserInfo/get_admin_user_info (0.01s) --- PASS: TestOIDCProviderUserInfo/get_user_info_without_token (0.00s) --- PASS: TestOIDCProviderUserInfo/get_user_info_with_invalid_token (0.00s) --- PASS: TestOIDCProviderUserInfo/get_user_info_with_custom_claims_mapping (0.01s) --- PASS: TestOIDCProviderUserInfo/get_user_info_with_empty_id (0.00s) === RUN TestExtractClaimPoliciesString --- PASS: TestExtractClaimPoliciesString (0.00s) === RUN TestExtractClaimPoliciesCommaSeparated --- PASS: TestExtractClaimPoliciesCommaSeparated (0.00s) === RUN TestExtractClaimPoliciesArray --- PASS: TestExtractClaimPoliciesArray (0.00s) === RUN TestExtractClaimPoliciesMissing --- PASS: TestExtractClaimPoliciesMissing (0.00s) === RUN TestExtractClaimPoliciesEmptyClaimName --- PASS: TestExtractClaimPoliciesEmptyClaimName (0.00s) === RUN TestExtractClaimPoliciesUnsupportedShape --- PASS: TestExtractClaimPoliciesUnsupportedShape (0.00s) === RUN TestExtractPrincipalTagsObjectShape --- PASS: TestExtractPrincipalTagsObjectShape (0.00s) === RUN TestExtractPrincipalTagsArrayValueTakesFirst --- PASS: TestExtractPrincipalTagsArrayValueTakesFirst (0.00s) === RUN TestExtractPrincipalTagsAbsent --- PASS: TestExtractPrincipalTagsAbsent (0.00s) === RUN TestExtractPrincipalTagsWrongShape --- PASS: TestExtractPrincipalTagsWrongShape (0.00s) === RUN TestFilterPrincipalTagsAllowlist === RUN TestFilterPrincipalTagsAllowlist/empty_allowlist_denies_all === RUN TestFilterPrincipalTagsAllowlist/partial_allowlist === RUN TestFilterPrincipalTagsAllowlist/allowlist_with_no_matches === RUN TestFilterPrincipalTagsAllowlist/case-insensitive_on_key --- PASS: TestFilterPrincipalTagsAllowlist (0.00s) --- PASS: TestFilterPrincipalTagsAllowlist/empty_allowlist_denies_all (0.00s) --- PASS: TestFilterPrincipalTagsAllowlist/partial_allowlist (0.00s) --- PASS: TestFilterPrincipalTagsAllowlist/allowlist_with_no_matches (0.00s) --- PASS: TestFilterPrincipalTagsAllowlist/case-insensitive_on_key (0.00s) === RUN TestThumbprintMatchAccepted W1117 09:37:01.831275 oidc_provider.go:385 OIDC provider "thumbprint-test" is configured to skip TLS verification. This is insecure and should not be used in production. --- PASS: TestThumbprintMatchAccepted (0.17s) === RUN TestThumbprintMismatchRejected W1117 09:37:02.004331 oidc_provider.go:385 OIDC provider "thumbprint-test" is configured to skip TLS verification. This is insecure and should not be used in production. 2026/11/17 09:37:02 http: TLS handshake error from 127.0.0.1:35568: remote error: tls: bad certificate 2026/11/17 09:37:02 http: TLS handshake error from 127.0.0.1:35570: remote error: tls: bad certificate --- PASS: TestThumbprintMismatchRejected (0.27s) === RUN TestThumbprintAllowlistAcceptsMixedCase W1117 09:37:02.258967 oidc_provider.go:385 OIDC provider "thumbprint-test" is configured to skip TLS verification. This is insecure and should not be used in production. --- PASS: TestThumbprintAllowlistAcceptsMixedCase (0.13s) === RUN TestThumbprintEmptyAllowlistSkipsCheck W1117 09:37:02.396361 oidc_provider.go:385 OIDC provider "thumbprint-test" is configured to skip TLS verification. This is insecure and should not be used in production. --- PASS: TestThumbprintEmptyAllowlistSkipsCheck (0.13s) === RUN TestThumbprintSkipVerifyHonoured W1117 09:37:02.527001 oidc_provider.go:385 OIDC provider "skip" is configured to skip TLS verification. This is insecure and should not be used in production. --- PASS: TestThumbprintSkipVerifyHonoured (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/iam/oidc 14.523s === RUN TestAWSIAMMatch === RUN TestAWSIAMMatch/case_insensitive_exact_match === RUN TestAWSIAMMatch/case_insensitive_wildcard_match === RUN TestAWSIAMMatch/AWS_username_variable_expansion === RUN TestAWSIAMMatch/SAML_username_variable_expansion === RUN TestAWSIAMMatch/OIDC_subject_variable_expansion === RUN TestAWSIAMMatch/case_insensitive_with_variable === RUN TestAWSIAMMatch/universal_wildcard === RUN TestAWSIAMMatch/question_mark_wildcard === RUN TestAWSIAMMatch/no_match_different_pattern === RUN TestAWSIAMMatch/variable_not_expanded_due_to_missing_context --- PASS: TestAWSIAMMatch (0.12s) --- PASS: TestAWSIAMMatch/case_insensitive_exact_match (0.01s) --- PASS: TestAWSIAMMatch/case_insensitive_wildcard_match (0.00s) --- PASS: TestAWSIAMMatch/AWS_username_variable_expansion (0.01s) --- PASS: TestAWSIAMMatch/SAML_username_variable_expansion (0.01s) --- PASS: TestAWSIAMMatch/OIDC_subject_variable_expansion (0.00s) --- PASS: TestAWSIAMMatch/case_insensitive_with_variable (0.00s) --- PASS: TestAWSIAMMatch/universal_wildcard (0.00s) --- PASS: TestAWSIAMMatch/question_mark_wildcard (0.00s) --- PASS: TestAWSIAMMatch/no_match_different_pattern (0.00s) --- PASS: TestAWSIAMMatch/variable_not_expanded_due_to_missing_context (0.00s) === RUN TestMatchesActionsMultipartExpansion === RUN TestMatchesActionsMultipartExpansion/PutObject_directly_matches_PutObject === RUN TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_CreateMultipartUpload === RUN TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_UploadPart === RUN TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_CompleteMultipartUpload === RUN TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_AbortMultipartUpload === RUN TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_ListMultipartUploadParts === RUN TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_ListBucketMultipartUploads === RUN TestMatchesActionsMultipartExpansion/PutObject_does_not_allow_GetObject === RUN TestMatchesActionsMultipartExpansion/GetObject_does_not_allow_CreateMultipartUpload === RUN TestMatchesActionsMultipartExpansion/wildcard_s3:Put*_implicitly_allows_multipart_via_PutObject_match === RUN TestMatchesActionsMultipartExpansion/case-insensitive_multipart_action_lookup --- PASS: TestMatchesActionsMultipartExpansion (0.05s) --- PASS: TestMatchesActionsMultipartExpansion/PutObject_directly_matches_PutObject (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_CreateMultipartUpload (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_UploadPart (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_CompleteMultipartUpload (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_AbortMultipartUpload (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_ListMultipartUploadParts (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/PutObject_implicitly_allows_ListBucketMultipartUploads (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/PutObject_does_not_allow_GetObject (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/GetObject_does_not_allow_CreateMultipartUpload (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/wildcard_s3:Put*_implicitly_allows_multipart_via_PutObject_match (0.00s) --- PASS: TestMatchesActionsMultipartExpansion/case-insensitive_multipart_action_lookup (0.00s) === RUN TestExpandPolicyVariables === RUN TestExpandPolicyVariables/expand_aws_username === RUN TestExpandPolicyVariables/expand_multiple_variables === RUN TestExpandPolicyVariables/no_variables_to_expand === RUN TestExpandPolicyVariables/nil_context === RUN TestExpandPolicyVariables/missing_variable_in_context --- PASS: TestExpandPolicyVariables (0.01s) --- PASS: TestExpandPolicyVariables/expand_aws_username (0.00s) --- PASS: TestExpandPolicyVariables/expand_multiple_variables (0.00s) --- PASS: TestExpandPolicyVariables/no_variables_to_expand (0.00s) --- PASS: TestExpandPolicyVariables/nil_context (0.00s) --- PASS: TestExpandPolicyVariables/missing_variable_in_context (0.00s) === RUN TestAWSWildcardMatch === RUN TestAWSWildcardMatch/case_insensitive_asterisk === RUN TestAWSWildcardMatch/case_insensitive_question_mark === RUN TestAWSWildcardMatch/mixed_wildcards === RUN TestAWSWildcardMatch/no_match --- PASS: TestAWSWildcardMatch (0.01s) --- PASS: TestAWSWildcardMatch/case_insensitive_asterisk (0.00s) --- PASS: TestAWSWildcardMatch/case_insensitive_question_mark (0.00s) --- PASS: TestAWSWildcardMatch/mixed_wildcards (0.00s) --- PASS: TestAWSWildcardMatch/no_match (0.00s) === RUN TestStringifyClaimValue === RUN TestStringifyClaimValue/string === RUN TestStringifyClaimValue/bool_true === RUN TestStringifyClaimValue/bool_false === RUN TestStringifyClaimValue/float64_integer === RUN TestStringifyClaimValue/float64_fraction === RUN TestStringifyClaimValue/float32 === RUN TestStringifyClaimValue/int === RUN TestStringifyClaimValue/int8 === RUN TestStringifyClaimValue/int16 === RUN TestStringifyClaimValue/int32 === RUN TestStringifyClaimValue/int64 === RUN TestStringifyClaimValue/uint === RUN TestStringifyClaimValue/uint8 === RUN TestStringifyClaimValue/uint16 === RUN TestStringifyClaimValue/uint32 === RUN TestStringifyClaimValue/uint64 === RUN TestStringifyClaimValue/json.Number_int === RUN TestStringifyClaimValue/json.Number_float === RUN TestStringifyClaimValue/nil === RUN TestStringifyClaimValue/slice_unsupported === RUN TestStringifyClaimValue/map_unsupported --- PASS: TestStringifyClaimValue (0.04s) --- PASS: TestStringifyClaimValue/string (0.00s) --- PASS: TestStringifyClaimValue/bool_true (0.00s) --- PASS: TestStringifyClaimValue/bool_false (0.00s) --- PASS: TestStringifyClaimValue/float64_integer (0.00s) --- PASS: TestStringifyClaimValue/float64_fraction (0.00s) --- PASS: TestStringifyClaimValue/float32 (0.00s) --- PASS: TestStringifyClaimValue/int (0.00s) --- PASS: TestStringifyClaimValue/int8 (0.00s) --- PASS: TestStringifyClaimValue/int16 (0.00s) --- PASS: TestStringifyClaimValue/int32 (0.00s) --- PASS: TestStringifyClaimValue/int64 (0.00s) --- PASS: TestStringifyClaimValue/uint (0.00s) --- PASS: TestStringifyClaimValue/uint8 (0.00s) --- PASS: TestStringifyClaimValue/uint16 (0.00s) --- PASS: TestStringifyClaimValue/uint32 (0.00s) --- PASS: TestStringifyClaimValue/uint64 (0.00s) --- PASS: TestStringifyClaimValue/json.Number_int (0.00s) --- PASS: TestStringifyClaimValue/json.Number_float (0.00s) --- PASS: TestStringifyClaimValue/nil (0.00s) --- PASS: TestStringifyClaimValue/slice_unsupported (0.00s) --- PASS: TestStringifyClaimValue/map_unsupported (0.00s) === RUN TestExpandPolicyVariablesDynamicJWTClaims === RUN TestExpandPolicyVariablesDynamicJWTClaims/dynamic_jwt_claim_substituted_in_resource_arn === RUN TestExpandPolicyVariablesDynamicJWTClaims/multiple_dynamic_jwt_claims_in_one_pattern === RUN TestExpandPolicyVariablesDynamicJWTClaims/dynamic_numeric_jwt_claim_is_stringified === RUN TestExpandPolicyVariablesDynamicJWTClaims/dynamic_saml_claim_substituted === RUN TestExpandPolicyVariablesDynamicJWTClaims/dynamic_oidc_claim_substituted === RUN TestExpandPolicyVariablesDynamicJWTClaims/missing_jwt_claim_leaves_placeholder_intact === RUN TestExpandPolicyVariablesDynamicJWTClaims/non-identity_prefix_is_not_substituted --- PASS: TestExpandPolicyVariablesDynamicJWTClaims (0.02s) --- PASS: TestExpandPolicyVariablesDynamicJWTClaims/dynamic_jwt_claim_substituted_in_resource_arn (0.00s) --- PASS: TestExpandPolicyVariablesDynamicJWTClaims/multiple_dynamic_jwt_claims_in_one_pattern (0.00s) --- PASS: TestExpandPolicyVariablesDynamicJWTClaims/dynamic_numeric_jwt_claim_is_stringified (0.00s) --- PASS: TestExpandPolicyVariablesDynamicJWTClaims/dynamic_saml_claim_substituted (0.00s) --- PASS: TestExpandPolicyVariablesDynamicJWTClaims/dynamic_oidc_claim_substituted (0.00s) --- PASS: TestExpandPolicyVariablesDynamicJWTClaims/missing_jwt_claim_leaves_placeholder_intact (0.00s) --- PASS: TestExpandPolicyVariablesDynamicJWTClaims/non-identity_prefix_is_not_substituted (0.00s) === RUN TestGitLabProjectUploadPolicy === RUN TestGitLabProjectUploadPolicy/user_writes_into_own_project_folder_-_allowed === RUN TestGitLabProjectUploadPolicy/user_tries_to_write_into_another_project_-_falls_through_to_default_Deny === RUN TestGitLabProjectUploadPolicy/different_user_writes_into_their_own_project_-_allowed === RUN TestGitLabProjectUploadPolicy/user_tries_to_GetObject_-_only_PutObject_allowed,_default_Deny === RUN TestGitLabProjectUploadPolicy/missing_project_path_claim_-_placeholder_prevents_match,_default_Deny --- PASS: TestGitLabProjectUploadPolicy (0.02s) --- PASS: TestGitLabProjectUploadPolicy/user_writes_into_own_project_folder_-_allowed (0.00s) --- PASS: TestGitLabProjectUploadPolicy/user_tries_to_write_into_another_project_-_falls_through_to_default_Deny (0.00s) --- PASS: TestGitLabProjectUploadPolicy/different_user_writes_into_their_own_project_-_allowed (0.00s) --- PASS: TestGitLabProjectUploadPolicy/user_tries_to_GetObject_-_only_PutObject_allowed,_default_Deny (0.00s) --- PASS: TestGitLabProjectUploadPolicy/missing_project_path_claim_-_placeholder_prevents_match,_default_Deny (0.00s) === RUN TestDistributedPolicyEngine === RUN TestDistributedPolicyEngine/policy_storage_consistency === RUN TestDistributedPolicyEngine/evaluation_consistency === RUN TestDistributedPolicyEngine/deny_precedence_consistency === RUN TestDistributedPolicyEngine/default_effect_consistency --- PASS: TestDistributedPolicyEngine (0.02s) --- PASS: TestDistributedPolicyEngine/policy_storage_consistency (0.00s) --- PASS: TestDistributedPolicyEngine/evaluation_consistency (0.01s) --- PASS: TestDistributedPolicyEngine/deny_precedence_consistency (0.00s) --- PASS: TestDistributedPolicyEngine/default_effect_consistency (0.00s) === RUN TestPolicyEngineConfigurationConsistency === RUN TestPolicyEngineConfigurationConsistency/consistent_default_effects_required === RUN TestPolicyEngineConfigurationConsistency/invalid_configuration_handling === RUN TestPolicyEngineConfigurationConsistency/invalid_configuration_handling/invalid_config_0 === RUN TestPolicyEngineConfigurationConsistency/invalid_configuration_handling/invalid_config_1 --- PASS: TestPolicyEngineConfigurationConsistency (0.01s) --- PASS: TestPolicyEngineConfigurationConsistency/consistent_default_effects_required (0.00s) --- PASS: TestPolicyEngineConfigurationConsistency/invalid_configuration_handling (0.00s) --- PASS: TestPolicyEngineConfigurationConsistency/invalid_configuration_handling/invalid_config_0 (0.00s) --- PASS: TestPolicyEngineConfigurationConsistency/invalid_configuration_handling/invalid_config_1 (0.00s) === RUN TestPolicyStoreDistributed === RUN TestPolicyStoreDistributed/memory_store_isolation === RUN TestPolicyStoreDistributed/policy_loading_error_handling --- PASS: TestPolicyStoreDistributed (0.01s) --- PASS: TestPolicyStoreDistributed/memory_store_isolation (0.00s) --- PASS: TestPolicyStoreDistributed/policy_loading_error_handling (0.00s) === RUN TestFilerPolicyStoreConfiguration === RUN TestFilerPolicyStoreConfiguration/filer_store_creation === RUN TestFilerPolicyStoreConfiguration/filer_store_custom_path === RUN TestFilerPolicyStoreConfiguration/filer_store_missing_address --- PASS: TestFilerPolicyStoreConfiguration (0.01s) --- PASS: TestFilerPolicyStoreConfiguration/filer_store_creation (0.00s) --- PASS: TestFilerPolicyStoreConfiguration/filer_store_custom_path (0.00s) --- PASS: TestFilerPolicyStoreConfiguration/filer_store_missing_address (0.00s) === RUN TestPolicyEvaluationPerformance policy_engine_distributed_test.go:384: Average policy evaluation time: 502.4µs --- PASS: TestPolicyEvaluationPerformance (0.07s) === RUN TestFilerPolicyStoreGetPolicyPrefersCanonicalFiles --- PASS: TestFilerPolicyStoreGetPolicyPrefersCanonicalFiles (0.33s) === RUN TestFilerPolicyStoreListPoliciesIncludesCanonicalAndLegacyFiles --- PASS: TestFilerPolicyStoreListPoliciesIncludesCanonicalAndLegacyFiles (0.09s) === RUN TestFilerPolicyStoreDeletePolicyRemovesCanonicalAndLegacyFiles --- PASS: TestFilerPolicyStoreDeletePolicyRemovesCanonicalAndLegacyFiles (0.11s) === RUN TestFilerPolicyStoreStorePolicyWritesCanonicalFileAndRemovesLegacyTwin --- PASS: TestFilerPolicyStoreStorePolicyWritesCanonicalFileAndRemovesLegacyTwin (0.11s) === RUN TestFilerPolicyStoreStorePolicyUpdatesExistingCanonicalFile --- PASS: TestFilerPolicyStoreStorePolicyUpdatesExistingCanonicalFile (0.12s) === RUN TestCopyPolicyDocumentClonesConditionState --- PASS: TestCopyPolicyDocumentClonesConditionState (0.00s) === RUN TestIsAlreadyExistsPolicyStoreErrorUsesStatusCode --- PASS: TestIsAlreadyExistsPolicyStoreErrorUsesStatusCode (0.00s) === RUN TestPolicyVariableMatchingInActionsAndResources === RUN TestPolicyVariableMatchingInActionsAndResources/policy_variable_in_action_matches === RUN TestPolicyVariableMatchingInActionsAndResources/policy_variable_in_resource_matches === RUN TestPolicyVariableMatchingInActionsAndResources/saml_username_variable_in_resource === RUN TestPolicyVariableMatchingInActionsAndResources/policy_variable_no_match_wrong_user === RUN TestPolicyVariableMatchingInActionsAndResources/missing_policy_variable_context --- PASS: TestPolicyVariableMatchingInActionsAndResources (0.06s) --- PASS: TestPolicyVariableMatchingInActionsAndResources/policy_variable_in_action_matches (0.00s) --- PASS: TestPolicyVariableMatchingInActionsAndResources/policy_variable_in_resource_matches (0.00s) --- PASS: TestPolicyVariableMatchingInActionsAndResources/saml_username_variable_in_resource (0.00s) --- PASS: TestPolicyVariableMatchingInActionsAndResources/policy_variable_no_match_wrong_user (0.00s) --- PASS: TestPolicyVariableMatchingInActionsAndResources/missing_policy_variable_context (0.00s) === RUN TestActionResourceConsistencyWithStringConditions --- PASS: TestActionResourceConsistencyWithStringConditions (0.02s) === RUN TestEvaluateTrustPolicyIsImplicitDenyWhateverTheDefaultEffect === RUN TestEvaluateTrustPolicyIsImplicitDenyWhateverTheDefaultEffect/defaultEffect=Allow === RUN TestEvaluateTrustPolicyIsImplicitDenyWhateverTheDefaultEffect/defaultEffect=Deny --- PASS: TestEvaluateTrustPolicyIsImplicitDenyWhateverTheDefaultEffect (0.05s) --- PASS: TestEvaluateTrustPolicyIsImplicitDenyWhateverTheDefaultEffect/defaultEffect=Allow (0.01s) --- PASS: TestEvaluateTrustPolicyIsImplicitDenyWhateverTheDefaultEffect/defaultEffect=Deny (0.00s) === RUN TestEvaluateTrustPolicyExplicitDenyWins --- PASS: TestEvaluateTrustPolicyExplicitDenyWins (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/iam/policy 4.164s ? github.com/seaweedfs/seaweedfs/weed/iam/providers [no test files] === RUN TestIsClaimBasedPolicyRoleArn === RUN TestIsClaimBasedPolicyRoleArn/empty_matches === RUN TestIsClaimBasedPolicyRoleArn/sentinel_matches === RUN TestIsClaimBasedPolicyRoleArn/concrete_role_does_not === RUN TestIsClaimBasedPolicyRoleArn/random_ARN_does_not --- PASS: TestIsClaimBasedPolicyRoleArn (0.03s) --- PASS: TestIsClaimBasedPolicyRoleArn/empty_matches (0.00s) --- PASS: TestIsClaimBasedPolicyRoleArn/sentinel_matches (0.00s) --- PASS: TestIsClaimBasedPolicyRoleArn/concrete_role_does_not (0.00s) --- PASS: TestIsClaimBasedPolicyRoleArn/random_ARN_does_not (0.00s) === RUN TestTemporaryCredentialPrefix --- PASS: TestTemporaryCredentialPrefix (0.01s) === RUN TestTemporaryCredentialFormat --- PASS: TestTemporaryCredentialFormat (0.01s) === RUN TestAssumeRoleForPrincipalValidatesDuration --- PASS: TestAssumeRoleForPrincipalValidatesDuration (0.01s) === RUN TestLookupOIDCProviderForAccountPrefersAccountMatch --- PASS: TestLookupOIDCProviderForAccountPrefersAccountMatch (0.00s) === RUN TestLookupOIDCProviderForAccountFallsBackToGlobal --- PASS: TestLookupOIDCProviderForAccountFallsBackToGlobal (0.00s) === RUN TestLookupOIDCProviderForAccountSkipsAccountSpecificWhenAccountUnknown --- PASS: TestLookupOIDCProviderForAccountSkipsAccountSpecificWhenAccountUnknown (0.00s) === RUN TestLookupOIDCProviderForAccountFallsBackToStatic --- PASS: TestLookupOIDCProviderForAccountFallsBackToStatic (0.00s) === RUN TestComputeParentUserStability --- PASS: TestComputeParentUserStability (0.00s) === RUN TestComputeParentUserDistinguishesIssuer --- PASS: TestComputeParentUserDistinguishesIssuer (0.00s) === RUN TestComputeParentUserDistinguishesSubject --- PASS: TestComputeParentUserDistinguishesSubject (0.00s) === RUN TestComputeParentUserEmptySub --- PASS: TestComputeParentUserEmptySub (0.00s) === RUN TestComputeParentUserEmptyIss --- PASS: TestComputeParentUserEmptyIss (0.00s) === RUN TestComputeParentUserEncoding --- PASS: TestComputeParentUserEncoding (0.00s) === RUN TestIsParentUserID --- PASS: TestIsParentUserID (0.00s) === RUN TestSessionClaimsRoundTripParentUser --- PASS: TestSessionClaimsRoundTripParentUser (0.00s) === RUN TestResolveIdentityClaimPrefersPreferredUsername --- PASS: TestResolveIdentityClaimPrefersPreferredUsername (0.00s) === RUN TestResolveIdentityClaimFallsBackThroughPriority --- PASS: TestResolveIdentityClaimFallsBackThroughPriority (0.00s) === RUN TestResolveIdentityClaimEmpty --- PASS: TestResolveIdentityClaimEmpty (0.00s) === RUN TestResolveIdentityClaimSkipsNonString --- PASS: TestResolveIdentityClaimSkipsNonString (0.00s) === RUN TestResolveIdentityClaimTrimsWhitespace --- PASS: TestResolveIdentityClaimTrimsWhitespace (0.00s) === RUN TestResolveIdentityClaimSkipsWhitespaceOnly --- PASS: TestResolveIdentityClaimSkipsWhitespaceOnly (0.00s) === RUN TestSTSSessionClaimsToSessionInfo --- PASS: TestSTSSessionClaimsToSessionInfo (0.00s) === RUN TestSTSSessionClaimsToSessionInfoCredentialGeneration --- PASS: TestSTSSessionClaimsToSessionInfoCredentialGeneration (0.00s) === RUN TestSTSSessionClaimsToSessionInfoPreservesAllFields --- PASS: TestSTSSessionClaimsToSessionInfoPreservesAllFields (0.00s) === RUN TestSTSSessionClaimsToSessionInfoEmptyFields --- PASS: TestSTSSessionClaimsToSessionInfoEmptyFields (0.00s) === RUN TestSTSSessionClaimsToSessionInfoCredentialExpiration === RUN TestSTSSessionClaimsToSessionInfoCredentialExpiration/future_expiration === RUN TestSTSSessionClaimsToSessionInfoCredentialExpiration/past_expiration === RUN TestSTSSessionClaimsToSessionInfoCredentialExpiration/near_future_expiration --- PASS: TestSTSSessionClaimsToSessionInfoCredentialExpiration (0.01s) --- PASS: TestSTSSessionClaimsToSessionInfoCredentialExpiration/future_expiration (0.00s) --- PASS: TestSTSSessionClaimsToSessionInfoCredentialExpiration/past_expiration (0.00s) --- PASS: TestSTSSessionClaimsToSessionInfoCredentialExpiration/near_future_expiration (0.00s) === RUN TestSessionInfoIntegration --- PASS: TestSessionInfoIntegration (0.00s) === RUN TestSecretAccessKeyDeterminism --- PASS: TestSecretAccessKeyDeterminism (0.02s) === RUN TestSessionCarriesItsSourceAccessKey --- PASS: TestSessionCarriesItsSourceAccessKey (0.16s) === RUN TestValidateSessionDurationSeconds_RespectsConfiguredMaxSessionLength --- PASS: TestValidateSessionDurationSeconds_RespectsConfiguredMaxSessionLength (0.00s) === RUN TestValidateSessionDurationSeconds_RejectsAboveConfiguredMaxSessionLength --- PASS: TestValidateSessionDurationSeconds_RejectsAboveConfiguredMaxSessionLength (0.00s) === RUN TestValidateSessionDurationSeconds_FallsBackToDefaultWhenUnset --- PASS: TestValidateSessionDurationSeconds_FallsBackToDefaultWhenUnset (0.00s) === RUN TestValidateSessionDurationSeconds_EnforcesMinimum --- PASS: TestValidateSessionDurationSeconds_EnforcesMinimum (0.00s) === RUN TestValidateSessionDurationSeconds_NilReturnsNil --- PASS: TestValidateSessionDurationSeconds_NilReturnsNil (0.00s) === RUN TestValidateSessionDurationSeconds_SubMinimumMaxSessionLengthKeepsCapping --- PASS: TestValidateSessionDurationSeconds_SubMinimumMaxSessionLengthKeepsCapping (0.00s) === RUN TestCalculateSessionDuration === RUN TestCalculateSessionDuration/default_from_config === RUN TestCalculateSessionDuration/explicit_request === RUN TestCalculateSessionDuration/capped_at_MaxSessionLength --- PASS: TestCalculateSessionDuration (0.01s) --- PASS: TestCalculateSessionDuration/default_from_config (0.00s) --- PASS: TestCalculateSessionDuration/explicit_request (0.00s) --- PASS: TestCalculateSessionDuration/capped_at_MaxSessionLength (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/iam/sts 2.411s ? github.com/seaweedfs/seaweedfs/weed/iam/util [no test files] === RUN TestExtractRoleNameFromArn === RUN TestExtractRoleNameFromArn/legacy_format_simple_role_name === RUN TestExtractRoleNameFromArn/legacy_format_custom_role_name === RUN TestExtractRoleNameFromArn/legacy_format_with_path === RUN TestExtractRoleNameFromArn/legacy_format_with_nested_path === RUN TestExtractRoleNameFromArn/standard_format_simple_role_name === RUN TestExtractRoleNameFromArn/standard_format_custom_role_name === RUN TestExtractRoleNameFromArn/standard_format_with_path === RUN TestExtractRoleNameFromArn/standard_format_with_nested_path === RUN TestExtractRoleNameFromArn/invalid_arn_missing_prefix === RUN TestExtractRoleNameFromArn/invalid_arn_incomplete === RUN TestExtractRoleNameFromArn/invalid_arn_no_role_marker === RUN TestExtractRoleNameFromArn/invalid_arn_wrong_service === RUN TestExtractRoleNameFromArn/empty_string === RUN TestExtractRoleNameFromArn/role_marker_no_name === RUN TestExtractRoleNameFromArn/standard_format_role_marker_no_name --- PASS: TestExtractRoleNameFromArn (0.06s) --- PASS: TestExtractRoleNameFromArn/legacy_format_simple_role_name (0.00s) --- PASS: TestExtractRoleNameFromArn/legacy_format_custom_role_name (0.00s) --- PASS: TestExtractRoleNameFromArn/legacy_format_with_path (0.00s) --- PASS: TestExtractRoleNameFromArn/legacy_format_with_nested_path (0.00s) --- PASS: TestExtractRoleNameFromArn/standard_format_simple_role_name (0.00s) --- PASS: TestExtractRoleNameFromArn/standard_format_custom_role_name (0.00s) --- PASS: TestExtractRoleNameFromArn/standard_format_with_path (0.00s) --- PASS: TestExtractRoleNameFromArn/standard_format_with_nested_path (0.00s) --- PASS: TestExtractRoleNameFromArn/invalid_arn_missing_prefix (0.00s) --- PASS: TestExtractRoleNameFromArn/invalid_arn_incomplete (0.00s) --- PASS: TestExtractRoleNameFromArn/invalid_arn_no_role_marker (0.00s) --- PASS: TestExtractRoleNameFromArn/invalid_arn_wrong_service (0.00s) --- PASS: TestExtractRoleNameFromArn/empty_string (0.00s) --- PASS: TestExtractRoleNameFromArn/role_marker_no_name (0.00s) --- PASS: TestExtractRoleNameFromArn/standard_format_role_marker_no_name (0.00s) === RUN TestExtractRoleNameFromPrincipal === RUN TestExtractRoleNameFromPrincipal/sts_assumed_role_legacy === RUN TestExtractRoleNameFromPrincipal/sts_assumed_role_legacy_no_session === RUN TestExtractRoleNameFromPrincipal/sts_assumed_role_standard === RUN TestExtractRoleNameFromPrincipal/sts_assumed_role_standard_no_session === RUN TestExtractRoleNameFromPrincipal/iam_role_legacy === RUN TestExtractRoleNameFromPrincipal/iam_role_legacy_with_path === RUN TestExtractRoleNameFromPrincipal/iam_role_standard === RUN TestExtractRoleNameFromPrincipal/iam_role_standard_with_path === RUN TestExtractRoleNameFromPrincipal/invalid_principal === RUN TestExtractRoleNameFromPrincipal/empty_string --- PASS: TestExtractRoleNameFromPrincipal (0.01s) --- PASS: TestExtractRoleNameFromPrincipal/sts_assumed_role_legacy (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/sts_assumed_role_legacy_no_session (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/sts_assumed_role_standard (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/sts_assumed_role_standard_no_session (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/iam_role_legacy (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/iam_role_legacy_with_path (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/iam_role_standard (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/iam_role_standard_with_path (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/invalid_principal (0.00s) --- PASS: TestExtractRoleNameFromPrincipal/empty_string (0.00s) === RUN TestParseRoleARN === RUN TestParseRoleARN/legacy_format_simple_role === RUN TestParseRoleARN/legacy_format_with_path === RUN TestParseRoleARN/standard_format_simple_role === RUN TestParseRoleARN/standard_format_with_path === RUN TestParseRoleARN/invalid_arn_missing_prefix === RUN TestParseRoleARN/invalid_arn_no_role_marker === RUN TestParseRoleARN/invalid_arn_empty_role_name === RUN TestParseRoleARN/invalid_arn_empty_role_name_standard_format --- PASS: TestParseRoleARN (0.01s) --- PASS: TestParseRoleARN/legacy_format_simple_role (0.00s) --- PASS: TestParseRoleARN/legacy_format_with_path (0.00s) --- PASS: TestParseRoleARN/standard_format_simple_role (0.00s) --- PASS: TestParseRoleARN/standard_format_with_path (0.00s) --- PASS: TestParseRoleARN/invalid_arn_missing_prefix (0.00s) --- PASS: TestParseRoleARN/invalid_arn_no_role_marker (0.00s) --- PASS: TestParseRoleARN/invalid_arn_empty_role_name (0.00s) --- PASS: TestParseRoleARN/invalid_arn_empty_role_name_standard_format (0.00s) === RUN TestParsePrincipalARN === RUN TestParsePrincipalARN/sts_assumed_role_legacy === RUN TestParsePrincipalARN/sts_assumed_role_standard === RUN TestParsePrincipalARN/sts_assumed_role_no_session === RUN TestParsePrincipalARN/iam_role_legacy === RUN TestParsePrincipalARN/iam_role_standard === RUN TestParsePrincipalARN/iam_role_with_path === RUN TestParsePrincipalARN/invalid_principal === RUN TestParsePrincipalARN/invalid_sts_empty_role_name === RUN TestParsePrincipalARN/invalid_sts_empty_role_name_standard_format --- PASS: TestParsePrincipalARN (0.01s) --- PASS: TestParsePrincipalARN/sts_assumed_role_legacy (0.00s) --- PASS: TestParsePrincipalARN/sts_assumed_role_standard (0.00s) --- PASS: TestParsePrincipalARN/sts_assumed_role_no_session (0.00s) --- PASS: TestParsePrincipalARN/iam_role_legacy (0.00s) --- PASS: TestParsePrincipalARN/iam_role_standard (0.00s) --- PASS: TestParsePrincipalARN/iam_role_with_path (0.00s) --- PASS: TestParsePrincipalARN/invalid_principal (0.00s) --- PASS: TestParsePrincipalARN/invalid_sts_empty_role_name (0.00s) --- PASS: TestParsePrincipalARN/invalid_sts_empty_role_name_standard_format (0.00s) === RUN TestSecurityMaliciousUserARNs === RUN TestSecurityMaliciousUserARNs/user_ARN_with_role/_in_path === RUN TestSecurityMaliciousUserARNs/policy_ARN_with_role/_in_name === RUN TestSecurityMaliciousUserARNs/group_ARN_with_role/_in_name === RUN TestSecurityMaliciousUserARNs/legacy_user_ARN_with_role/_in_path --- PASS: TestSecurityMaliciousUserARNs (0.00s) --- PASS: TestSecurityMaliciousUserARNs/user_ARN_with_role/_in_path (0.00s) --- PASS: TestSecurityMaliciousUserARNs/policy_ARN_with_role/_in_name (0.00s) --- PASS: TestSecurityMaliciousUserARNs/group_ARN_with_role/_in_name (0.00s) --- PASS: TestSecurityMaliciousUserARNs/legacy_user_ARN_with_role/_in_path (0.00s) === RUN TestSecurityMaliciousSTSUserARNs === RUN TestSecurityMaliciousSTSUserARNs/STS_user_with_assumed-role_in_path === RUN TestSecurityMaliciousSTSUserARNs/legacy_STS_user_with_assumed-role_in_path --- PASS: TestSecurityMaliciousSTSUserARNs (0.00s) --- PASS: TestSecurityMaliciousSTSUserARNs/STS_user_with_assumed-role_in_path (0.00s) --- PASS: TestSecurityMaliciousSTSUserARNs/legacy_STS_user_with_assumed-role_in_path (0.00s) === RUN TestEdgeCaseMultipleRoleMarkers === RUN TestEdgeCaseMultipleRoleMarkers/legacy_format_role_in_path === RUN TestEdgeCaseMultipleRoleMarkers/standard_format_role_in_path === RUN TestEdgeCaseMultipleRoleMarkers/multiple_role_markers_in_path === RUN TestEdgeCaseMultipleRoleMarkers/sts_assumed_role_with_role_in_path --- PASS: TestEdgeCaseMultipleRoleMarkers (0.01s) --- PASS: TestEdgeCaseMultipleRoleMarkers/legacy_format_role_in_path (0.00s) --- PASS: TestEdgeCaseMultipleRoleMarkers/standard_format_role_in_path (0.00s) --- PASS: TestEdgeCaseMultipleRoleMarkers/multiple_role_markers_in_path (0.00s) --- PASS: TestEdgeCaseMultipleRoleMarkers/sts_assumed_role_with_role_in_path (0.00s) === RUN TestEdgeCaseConsecutiveSlashes === RUN TestEdgeCaseConsecutiveSlashes/consecutive_slashes_immediately_after_role === RUN TestEdgeCaseConsecutiveSlashes/consecutive_slashes_in_path === RUN TestEdgeCaseConsecutiveSlashes/multiple_consecutive_slashes --- PASS: TestEdgeCaseConsecutiveSlashes (0.01s) --- PASS: TestEdgeCaseConsecutiveSlashes/consecutive_slashes_immediately_after_role (0.00s) --- PASS: TestEdgeCaseConsecutiveSlashes/consecutive_slashes_in_path (0.00s) --- PASS: TestEdgeCaseConsecutiveSlashes/multiple_consecutive_slashes (0.00s) === RUN TestEdgeCaseSpecialCharactersInRoleName === RUN TestEdgeCaseSpecialCharactersInRoleName/role_name_with_hyphens === RUN TestEdgeCaseSpecialCharactersInRoleName/role_name_with_underscores === RUN TestEdgeCaseSpecialCharactersInRoleName/role_name_with_dots === RUN TestEdgeCaseSpecialCharactersInRoleName/role_name_with_at_sign === RUN TestEdgeCaseSpecialCharactersInRoleName/role_name_with_plus_and_equals === RUN TestEdgeCaseSpecialCharactersInRoleName/role_name_with_commas === RUN TestEdgeCaseSpecialCharactersInRoleName/role_name_with_mixed_special_chars === RUN TestEdgeCaseSpecialCharactersInRoleName/path_with_special_characters --- PASS: TestEdgeCaseSpecialCharactersInRoleName (0.01s) --- PASS: TestEdgeCaseSpecialCharactersInRoleName/role_name_with_hyphens (0.00s) --- PASS: TestEdgeCaseSpecialCharactersInRoleName/role_name_with_underscores (0.00s) --- PASS: TestEdgeCaseSpecialCharactersInRoleName/role_name_with_dots (0.00s) --- PASS: TestEdgeCaseSpecialCharactersInRoleName/role_name_with_at_sign (0.00s) --- PASS: TestEdgeCaseSpecialCharactersInRoleName/role_name_with_plus_and_equals (0.00s) --- PASS: TestEdgeCaseSpecialCharactersInRoleName/role_name_with_commas (0.00s) --- PASS: TestEdgeCaseSpecialCharactersInRoleName/role_name_with_mixed_special_chars (0.00s) --- PASS: TestEdgeCaseSpecialCharactersInRoleName/path_with_special_characters (0.00s) === RUN TestEdgeCaseExtremelyLongRoleName === RUN TestEdgeCaseExtremelyLongRoleName/role_name_at_max_length === RUN TestEdgeCaseExtremelyLongRoleName/role_with_long_path_components --- PASS: TestEdgeCaseExtremelyLongRoleName (0.00s) --- PASS: TestEdgeCaseExtremelyLongRoleName/role_name_at_max_length (0.00s) --- PASS: TestEdgeCaseExtremelyLongRoleName/role_with_long_path_components (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/iam/utils 0.431s === RUN TestIamManagementDeniedForDataPlanePolicy === RUN TestIamManagementDeniedForDataPlanePolicy/CreateUser E1117 09:36:53.954827 s3api_embedded_iam.go:363 IAM Response Access Denied. === RUN TestIamManagementDeniedForDataPlanePolicy/CreateAccessKey E1117 09:36:54.053561 s3api_embedded_iam.go:363 IAM Response Access Denied. === RUN TestIamManagementDeniedForDataPlanePolicy/PutUserPolicy E1117 09:36:54.096809 s3api_embedded_iam.go:363 IAM Response Access Denied. === RUN TestIamManagementDeniedForDataPlanePolicy/AttachUserPolicy E1117 09:36:54.129900 s3api_embedded_iam.go:363 IAM Response Access Denied. --- PASS: TestIamManagementDeniedForDataPlanePolicy (0.58s) --- PASS: TestIamManagementDeniedForDataPlanePolicy/CreateUser (0.18s) --- PASS: TestIamManagementDeniedForDataPlanePolicy/CreateAccessKey (0.05s) --- PASS: TestIamManagementDeniedForDataPlanePolicy/PutUserPolicy (0.03s) --- PASS: TestIamManagementDeniedForDataPlanePolicy/AttachUserPolicy (0.03s) === RUN TestIamManagementDeniedWithS3QueryParameter === RUN TestIamManagementDeniedWithS3QueryParameter/delete E1117 09:36:54.213178 s3api_embedded_iam.go:363 IAM Response Access Denied. === RUN TestIamManagementDeniedWithS3QueryParameter/acl E1117 09:36:54.228436 s3api_embedded_iam.go:363 IAM Response Access Denied. === RUN TestIamManagementDeniedWithS3QueryParameter/tagging E1117 09:36:54.248581 s3api_embedded_iam.go:363 IAM Response Access Denied. === RUN TestIamManagementDeniedWithS3QueryParameter/policy E1117 09:36:54.263853 s3api_embedded_iam.go:363 IAM Response Access Denied. --- PASS: TestIamManagementDeniedWithS3QueryParameter (0.11s) --- PASS: TestIamManagementDeniedWithS3QueryParameter/delete (0.03s) --- PASS: TestIamManagementDeniedWithS3QueryParameter/acl (0.01s) --- PASS: TestIamManagementDeniedWithS3QueryParameter/tagging (0.02s) --- PASS: TestIamManagementDeniedWithS3QueryParameter/policy (0.01s) === RUN TestIamSelfServiceAllowedForDataPlanePolicy --- PASS: TestIamSelfServiceAllowedForDataPlanePolicy (0.05s) === RUN TestIamManagementAllowedForAdmin --- PASS: TestIamManagementAllowedForAdmin (0.03s) === RUN TestImplicitUserNameUsesVerifiedIdentity === RUN TestImplicitUserNameUsesVerifiedIdentity/ListAccessKeys iamapi_authz_test.go:180: 200 AKIAIOSFODNN7EXAMPLEActivepower_userfalse18E8CB82DA06FD695F0B2A48 === RUN TestImplicitUserNameUsesVerifiedIdentity/CreateAccessKey iamapi_authz_test.go:180: 200 RRC3E9VA54AHVWZVSTOSSOsV4KNJhutIdPGRsyz8vz5DwXuQ48t7VW8xWwbw5nNActivepower_user18E8CB82DBEB08EFE2492497 === RUN TestImplicitUserNameUsesVerifiedIdentity/GetUser iamapi_authz_test.go:180: 200 arn:aws:iam::000000000000:user/power_user/power_user18E8CB82DD4C7D56DE08DA51 === RUN TestImplicitUserNameUsesVerifiedIdentity/ListUserPolicies E1117 09:36:54.441482 s3api_embedded_iam.go:363 IAM Response Access Denied. iamapi_authz_test.go:190: 403 AccessDeniedAccess Denied.Sender18E8CB82DE13011BFF6B8990 === RUN TestImplicitUserNameUsesVerifiedIdentity/UpdateAccessKey E1117 09:36:54.451786 iamapi_handlers.go:30 Response the access key with id AKIATESTFAKEADMIN0001 for user power_user cannot be found iamapi_authz_test.go:198: 404 NoSuchEntitythe access key with id AKIATESTFAKEADMIN0001 for user power_user cannot be foundSender18E8CB82DE999AAFFE94B2AB === RUN TestImplicitUserNameUsesVerifiedIdentity/DeleteAccessKey iamapi_authz_test.go:204: 200 18E8CB82DF3E0F1D3B51F25F --- PASS: TestImplicitUserNameUsesVerifiedIdentity (0.14s) --- PASS: TestImplicitUserNameUsesVerifiedIdentity/ListAccessKeys (0.04s) --- PASS: TestImplicitUserNameUsesVerifiedIdentity/CreateAccessKey (0.02s) --- PASS: TestImplicitUserNameUsesVerifiedIdentity/GetUser (0.01s) --- PASS: TestImplicitUserNameUsesVerifiedIdentity/ListUserPolicies (0.01s) --- PASS: TestImplicitUserNameUsesVerifiedIdentity/UpdateAccessKey (0.01s) --- PASS: TestImplicitUserNameUsesVerifiedIdentity/DeleteAccessKey (0.01s) === RUN TestGetActionsUserPath --- PASS: TestGetActionsUserPath (0.00s) === RUN TestGetActionsWildcardPath --- PASS: TestGetActionsWildcardPath (0.00s) === RUN TestGetActionsInvalidAction --- PASS: TestGetActionsInvalidAction (0.00s) === RUN TestPutGetUserPolicyPreservesStatements --- PASS: TestPutGetUserPolicyPreservesStatements (0.01s) === RUN TestPutGetUserPolicyIssue9008 --- PASS: TestPutGetUserPolicyIssue9008 (0.01s) === RUN TestMultipleInlinePoliciesAggregateActions --- PASS: TestMultipleInlinePoliciesAggregateActions (0.00s) === RUN TestGetPolicy --- PASS: TestGetPolicy (0.00s) === RUN TestDeletePolicy --- PASS: TestDeletePolicy (0.00s) === RUN TestListPolicies --- PASS: TestListPolicies (0.00s) === RUN TestAttachUserPolicy --- PASS: TestAttachUserPolicy (0.00s) === RUN TestManagedPolicyActionsPreservedAcrossInlineMutations --- PASS: TestManagedPolicyActionsPreservedAcrossInlineMutations (0.01s) === RUN TestDetachUserPolicy --- PASS: TestDetachUserPolicy (0.00s) === RUN TestListAttachedUserPolicies --- PASS: TestListAttachedUserPolicies (0.00s) === RUN TestUserArnIsValid --- PASS: TestUserArnIsValid (0.00s) === RUN TestCreateAccessKeyWithCallerSuppliedKeys --- PASS: TestCreateAccessKeyWithCallerSuppliedKeys (0.00s) === RUN TestCreateAccessKeyRandomGeneration --- PASS: TestCreateAccessKeyRandomGeneration (0.00s) === RUN TestCreateAccessKeyRejectsWeakKeys --- PASS: TestCreateAccessKeyRejectsWeakKeys (0.00s) === RUN TestCreateAccessKeyRejectsCollision === RUN TestCreateAccessKeyRejectsCollision/identity_credential === RUN TestCreateAccessKeyRejectsCollision/service_account_credential --- PASS: TestCreateAccessKeyRejectsCollision (0.00s) --- PASS: TestCreateAccessKeyRejectsCollision/identity_credential (0.00s) --- PASS: TestCreateAccessKeyRejectsCollision/service_account_credential (0.00s) === RUN TestCreateAccessKeyBoundary --- PASS: TestCreateAccessKeyBoundary (0.00s) === RUN TestCreateAccessKeyRejectsPartialSupply --- PASS: TestCreateAccessKeyRejectsPartialSupply (0.00s) === RUN TestPutPoliciesCreatesInCredentialStore --- PASS: TestPutPoliciesCreatesInCredentialStore (0.01s) === RUN TestGetPoliciesReadsFromCredentialStore --- PASS: TestGetPoliciesReadsFromCredentialStore (0.00s) === RUN TestPutPoliciesDeletesRemovedFromCredentialStore --- PASS: TestPutPoliciesDeletesRemovedFromCredentialStore (0.00s) === RUN TestPutPoliciesUpdatesChangedInCredentialStore --- PASS: TestPutPoliciesUpdatesChangedInCredentialStore (0.00s) === RUN TestPutPoliciesRoutesUserInlineThroughCredentialStore --- PASS: TestPutPoliciesRoutesUserInlineThroughCredentialStore (0.00s) === RUN TestPutPoliciesDeletesRemovedUserInline --- PASS: TestPutPoliciesDeletesRemovedUserInline (0.00s) === RUN TestPutPoliciesRoutesGroupInlineThroughCredentialStore --- PASS: TestPutPoliciesRoutesGroupInlineThroughCredentialStore (0.00s) === RUN TestPutPoliciesDeletesRemovedGroupInline --- PASS: TestPutPoliciesDeletesRemovedGroupInline (0.00s) === RUN TestPutPoliciesIsAuthoritativeWhenStoreIsNotFilerEtc --- PASS: TestPutPoliciesIsAuthoritativeWhenStoreIsNotFilerEtc (0.00s) === RUN TestGetPoliciesReadsInlineAndGroupInlineFromCredentialStore --- PASS: TestGetPoliciesReadsInlineAndGroupInlineFromCredentialStore (0.00s) === RUN TestIamApiCreateAccessKeyTargeted --- PASS: TestIamApiCreateAccessKeyTargeted (0.04s) === RUN TestIamApiCreateAccessKeyUnknownUserFallsBack --- PASS: TestIamApiCreateAccessKeyUnknownUserFallsBack (0.02s) === RUN TestIamApiDeleteAccessKeyTargeted --- PASS: TestIamApiDeleteAccessKeyTargeted (0.02s) === RUN TestIamApiUpdateAccessKeyTargeted --- PASS: TestIamApiUpdateAccessKeyTargeted (0.02s) === RUN TestIamApiPutUserPolicyTargeted --- PASS: TestIamApiPutUserPolicyTargeted (0.01s) === RUN TestIamApiDeleteUserPolicyTargeted --- PASS: TestIamApiDeleteUserPolicyTargeted (0.02s) === RUN TestIamApiUpdateUserRenameTargeted --- PASS: TestIamApiUpdateUserRenameTargeted (0.02s) === RUN TestIamApiDeleteUserTargeted --- PASS: TestIamApiDeleteUserTargeted (0.01s) === RUN TestCreateUser --- PASS: TestCreateUser (0.01s) === RUN TestListUsers --- PASS: TestListUsers (0.01s) === RUN TestListUsersRequestIdMatchesResponseHeader --- PASS: TestListUsersRequestIdMatchesResponseHeader (0.01s) === RUN TestListAccessKeys --- PASS: TestListAccessKeys (0.00s) === RUN TestUpdateAccessKey --- PASS: TestUpdateAccessKey (0.02s) === RUN TestGetUser --- PASS: TestGetUser (0.01s) === RUN TestCreatePolicy --- PASS: TestCreatePolicy (0.02s) === RUN TestCreatePolicyVersion --- PASS: TestCreatePolicyVersion (0.04s) === RUN TestCreatePolicyVersionMissingPolicy E1117 09:36:54.890446 iamapi_handlers.go:30 Response policy does-not-exist not found --- PASS: TestCreatePolicyVersionMissingPolicy (0.01s) === RUN TestCreatePolicyVersionRequiresSetAsDefault E1117 09:36:54.906392 iamapi_handlers.go:30 Response SetAsDefault must be true: SeaweedFS stores a single managed policy version --- PASS: TestCreatePolicyVersionRequiresSetAsDefault (0.02s) === RUN TestPutUserPolicy --- PASS: TestPutUserPolicy (0.01s) === RUN TestPutUserPolicyError E1117 09:36:54.938223 iamapi_management_handlers.go:1566 PutUserPolicy: the user with name InvalidUser cannot be found E1117 09:36:54.938714 iamapi_handlers.go:30 Response the user with name InvalidUser cannot be found --- PASS: TestPutUserPolicyError (0.02s) === RUN TestGetUserPolicy --- PASS: TestGetUserPolicy (0.01s) === RUN TestUpdateUser --- PASS: TestUpdateUser (0.01s) === RUN TestDeleteUser E1117 09:36:54.962816 iamapi_handlers.go:30 Response cannot delete user Test-New: user has 1 access key(s). Delete access keys first --- PASS: TestDeleteUser (0.02s) === RUN TestHandleImplicitUsername --- PASS: TestHandleImplicitUsername (0.00s) === RUN TestCreateUserDoesNotSaveAllUsers --- PASS: TestCreateUserDoesNotSaveAllUsers (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/iamapi 5.461s === RUN TestCropping --- PASS: TestCropping (5.38s) === RUN TestXYZ --- PASS: TestXYZ (31.53s) === RUN TestResizing --- PASS: TestResizing (1.17s) PASS ok github.com/seaweedfs/seaweedfs/weed/images 38.956s === RUN TestCacheRechecksAccess --- PASS: TestCacheRechecksAccess (0.49s) === RUN TestRepresentationHeaders --- PASS: TestRepresentationHeaders (0.28s) === RUN TestChangedSource --- PASS: TestChangedSource (0.11s) === RUN TestSourceChangesDuringEncoding --- PASS: TestSourceChangesDuringEncoding (0.06s) === RUN TestRejectUnsafeRequests --- PASS: TestRejectUnsafeRequests (0.02s) === RUN TestLimitsAndBackendFailures === RUN TestLimitsAndBackendFailures/oversized_source === RUN TestLimitsAndBackendFailures/oversized_result === RUN TestLimitsAndBackendFailures/empty_result === RUN TestLimitsAndBackendFailures/incorrect_media_type === RUN TestLimitsAndBackendFailures/encoder_failure === RUN TestLimitsAndBackendFailures/source_denied === RUN TestLimitsAndBackendFailures/source_missing === RUN TestLimitsAndBackendFailures/source_failure === RUN TestLimitsAndBackendFailures/redirect --- PASS: TestLimitsAndBackendFailures (0.25s) --- PASS: TestLimitsAndBackendFailures/oversized_source (0.03s) --- PASS: TestLimitsAndBackendFailures/oversized_result (0.05s) --- PASS: TestLimitsAndBackendFailures/empty_result (0.04s) --- PASS: TestLimitsAndBackendFailures/incorrect_media_type (0.03s) --- PASS: TestLimitsAndBackendFailures/encoder_failure (0.03s) --- PASS: TestLimitsAndBackendFailures/source_denied (0.01s) --- PASS: TestLimitsAndBackendFailures/source_missing (0.03s) --- PASS: TestLimitsAndBackendFailures/source_failure (0.02s) --- PASS: TestLimitsAndBackendFailures/redirect (0.02s) === RUN TestConcurrentMisses --- PASS: TestConcurrentMisses (0.26s) === RUN TestConcurrencyAndCancellation --- PASS: TestConcurrencyAndCancellation (0.03s) === RUN TestOriginalRead --- PASS: TestOriginalRead (0.11s) === RUN TestBrowserCookiesAreNotForwarded --- PASS: TestBrowserCookiesAreNotForwarded (0.04s) === RUN TestNoETagDisablesCache --- PASS: TestNoETagDisablesCache (0.04s) === RUN TestFixedSourceAndSigning --- PASS: TestFixedSourceAndSigning (0.01s) === RUN TestRealHTTPHead --- PASS: TestRealHTTPHead (0.04s) === RUN TestCancelledLeaderDoesNotFailWaiter --- PASS: TestCancelledLeaderDoesNotFailWaiter (0.04s) === RUN TestCancelledWorkRemainsBounded --- PASS: TestCancelledWorkRemainsBounded (0.06s) === RUN TestAbandonedWorkTimesOut --- PASS: TestAbandonedWorkTimesOut (0.10s) === RUN TestSameSecondOverwriteDoesNotReturn304 --- PASS: TestSameSecondOverwriteDoesNotReturn304 (0.07s) === RUN TestOriginalRangeLimitsAndErrors --- PASS: TestOriginalRangeLimitsAndErrors (0.04s) === RUN TestOriginalRangeRequiresCompleteLength === RUN TestOriginalRangeRequiresCompleteLength/#00 === RUN TestOriginalRangeRequiresCompleteLength/bytes_0-0/* === RUN TestOriginalRangeRequiresCompleteLength/bytes_0-0/no-number === RUN TestOriginalRangeRequiresCompleteLength/items_0-0/100 === RUN TestOriginalRangeRequiresCompleteLength/bytes_0-0/0 --- PASS: TestOriginalRangeRequiresCompleteLength (0.13s) --- PASS: TestOriginalRangeRequiresCompleteLength/#00 (0.03s) --- PASS: TestOriginalRangeRequiresCompleteLength/bytes_0-0/* (0.03s) --- PASS: TestOriginalRangeRequiresCompleteLength/bytes_0-0/no-number (0.02s) --- PASS: TestOriginalRangeRequiresCompleteLength/items_0-0/100 (0.03s) --- PASS: TestOriginalRangeRequiresCompleteLength/bytes_0-0/0 (0.02s) === RUN TestRejectNormalizedTraversal --- PASS: TestRejectNormalizedTraversal (0.06s) === RUN TestWriteBudgetStartsAfterProcessing --- PASS: TestWriteBudgetStartsAfterProcessing (0.04s) === RUN TestSlowMetadataDoesNotConsumeEncodingWait --- PASS: TestSlowMetadataDoesNotConsumeEncodingWait (0.45s) === RUN TestOriginalContentEncoding --- PASS: TestOriginalContentEncoding (0.10s) === RUN TestRepeatedSlashesPreserveBucketPrefix --- PASS: TestRepeatedSlashesPreserveBucketPrefix (0.11s) === RUN TestOriginalMediaType --- PASS: TestOriginalMediaType (0.20s) === RUN TestWriteBudgetsForOriginalAndErrors === RUN TestWriteBudgetsForOriginalAndErrors/original === RUN TestWriteBudgetsForOriginalAndErrors/head === RUN TestWriteBudgetsForOriginalAndErrors/conditional === RUN TestWriteBudgetsForOriginalAndErrors/range === RUN TestWriteBudgetsForOriginalAndErrors/invalid-range === RUN TestWriteBudgetsForOriginalAndErrors/unsupported-method --- PASS: TestWriteBudgetsForOriginalAndErrors (0.05s) --- PASS: TestWriteBudgetsForOriginalAndErrors/original (0.01s) --- PASS: TestWriteBudgetsForOriginalAndErrors/head (0.01s) --- PASS: TestWriteBudgetsForOriginalAndErrors/conditional (0.01s) --- PASS: TestWriteBudgetsForOriginalAndErrors/range (0.01s) --- PASS: TestWriteBudgetsForOriginalAndErrors/invalid-range (0.01s) --- PASS: TestWriteBudgetsForOriginalAndErrors/unsupported-method (0.00s) === RUN TestOriginalConditionalMediaType --- PASS: TestOriginalConditionalMediaType (0.05s) === RUN TestProcessedErrorsDisableCaching --- PASS: TestProcessedErrorsDisableCaching (0.02s) === RUN TestOptionsCoverage --- PASS: TestOptionsCoverage (0.00s) === RUN TestByteLimitedCache --- PASS: TestByteLimitedCache (0.05s) === RUN TestConfigurationRejectsUnsafeBackends --- PASS: TestConfigurationRejectsUnsafeBackends (0.00s) === RUN TestOutputBounds --- PASS: TestOutputBounds (0.00s) === RUN TestProcessorRootURL --- PASS: TestProcessorRootURL (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/images/gateway 3.820s === RUN TestCachedProviderDecryptHitsProviderOnce --- PASS: TestCachedProviderDecryptHitsProviderOnce (0.01s) === RUN TestCachedProviderContextSensitivity --- PASS: TestCachedProviderContextSensitivity (0.01s) === RUN TestCachedProviderTTLExpiry --- PASS: TestCachedProviderTTLExpiry (0.04s) === RUN TestCachedProviderMaxEntries --- PASS: TestCachedProviderMaxEntries (0.00s) === RUN TestCachedProviderClearsOverwrittenPlaintext --- PASS: TestCachedProviderClearsOverwrittenPlaintext (0.00s) === RUN TestCachedProviderNoWriteAfterClose --- PASS: TestCachedProviderNoWriteAfterClose (0.00s) === RUN TestAddKMSProviderWiresCache --- PASS: TestAddKMSProviderWiresCache (0.00s) === RUN TestCiphertextEnvelope_CreateAndParse --- PASS: TestCiphertextEnvelope_CreateAndParse (0.04s) === RUN TestCiphertextEnvelope_InvalidFormat --- PASS: TestCiphertextEnvelope_InvalidFormat (0.01s) === RUN TestCiphertextEnvelope_ValidationErrors === RUN TestCiphertextEnvelope_ValidationErrors/Valid === RUN TestCiphertextEnvelope_ValidationErrors/Empty_provider === RUN TestCiphertextEnvelope_ValidationErrors/Empty_keyID === RUN TestCiphertextEnvelope_ValidationErrors/Empty_ciphertext --- PASS: TestCiphertextEnvelope_ValidationErrors (0.03s) --- PASS: TestCiphertextEnvelope_ValidationErrors/Valid (0.00s) --- PASS: TestCiphertextEnvelope_ValidationErrors/Empty_provider (0.00s) --- PASS: TestCiphertextEnvelope_ValidationErrors/Empty_keyID (0.00s) --- PASS: TestCiphertextEnvelope_ValidationErrors/Empty_ciphertext (0.00s) === RUN TestCiphertextEnvelope_MultipleProviders === RUN TestCiphertextEnvelope_MultipleProviders/openbao === RUN TestCiphertextEnvelope_MultipleProviders/gcp === RUN TestCiphertextEnvelope_MultipleProviders/azure === RUN TestCiphertextEnvelope_MultipleProviders/aws --- PASS: TestCiphertextEnvelope_MultipleProviders (0.01s) --- PASS: TestCiphertextEnvelope_MultipleProviders/openbao (0.00s) --- PASS: TestCiphertextEnvelope_MultipleProviders/gcp (0.00s) --- PASS: TestCiphertextEnvelope_MultipleProviders/azure (0.01s) --- PASS: TestCiphertextEnvelope_MultipleProviders/aws (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/kms 1.084s ? github.com/seaweedfs/seaweedfs/weed/kms/aws [no test files] ? github.com/seaweedfs/seaweedfs/weed/kms/gcp [no test files] ? github.com/seaweedfs/seaweedfs/weed/kms/local [no test files] ? github.com/seaweedfs/seaweedfs/weed/kms/openbao [no test files] === RUN TestAttributeExplicitCollidingIds === RUN TestAttributeExplicitCollidingIds/uid I1117 09:36:52.413578 leveldb_store.go:48 filer store dir: /tmp/TestAttributeExplicitCollidingIdsuid1379403395/001/meta I1117 09:36:52.434458 file_util.go:29 Folder /tmp/TestAttributeExplicitCollidingIdsuid1379403395/001/meta Permission: -rwxr-xr-x I1117 09:36:52.667839 leveldb_store.go:48 filer store dir: /tmp/TestAttributeExplicitCollidingIdsuid1379403395/002/mapped I1117 09:36:52.670746 file_util.go:29 Folder /tmp/TestAttributeExplicitCollidingIdsuid1379403395/002/mapped Permission: -rwxr-xr-x === RUN TestAttributeExplicitCollidingIds/gid I1117 09:36:53.322637 leveldb_store.go:48 filer store dir: /tmp/TestAttributeExplicitCollidingIdsgid2049705689/001/meta I1117 09:36:53.323458 file_util.go:29 Folder /tmp/TestAttributeExplicitCollidingIdsgid2049705689/001/meta Permission: -rwxr-xr-x I1117 09:36:53.405833 leveldb_store.go:48 filer store dir: /tmp/TestAttributeExplicitCollidingIdsgid2049705689/002/mapped I1117 09:36:53.406260 file_util.go:29 Folder /tmp/TestAttributeExplicitCollidingIdsgid2049705689/002/mapped Permission: -rwxr-xr-x === RUN TestAttributeExplicitCollidingIds/both I1117 09:36:53.605784 leveldb_store.go:48 filer store dir: /tmp/TestAttributeExplicitCollidingIdsboth644342902/001/meta I1117 09:36:53.606395 file_util.go:29 Folder /tmp/TestAttributeExplicitCollidingIdsboth644342902/001/meta Permission: -rwxr-xr-x I1117 09:36:53.743228 leveldb_store.go:48 filer store dir: /tmp/TestAttributeExplicitCollidingIdsboth644342902/002/mapped I1117 09:36:53.743611 file_util.go:29 Folder /tmp/TestAttributeExplicitCollidingIdsboth644342902/002/mapped Permission: -rwxr-xr-x === RUN TestAttributeExplicitCollidingIds/untouched I1117 09:36:53.926568 leveldb_store.go:48 filer store dir: /tmp/TestAttributeExplicitCollidingIdsuntouched2089538692/001/meta I1117 09:36:53.926898 file_util.go:29 Folder /tmp/TestAttributeExplicitCollidingIdsuntouched2089538692/001/meta Permission: -rwxr-xr-x I1117 09:36:54.010435 leveldb_store.go:48 filer store dir: /tmp/TestAttributeExplicitCollidingIdsuntouched2089538692/002/mapped I1117 09:36:54.010833 file_util.go:29 Folder /tmp/TestAttributeExplicitCollidingIdsuntouched2089538692/002/mapped Permission: -rwxr-xr-x --- PASS: TestAttributeExplicitCollidingIds (1.75s) --- PASS: TestAttributeExplicitCollidingIds/uid (0.91s) --- PASS: TestAttributeExplicitCollidingIds/gid (0.28s) --- PASS: TestAttributeExplicitCollidingIds/both (0.32s) --- PASS: TestAttributeExplicitCollidingIds/untouched (0.22s) === RUN TestAttributeSetAttrReadLockOrder --- PASS: TestAttributeSetAttrReadLockOrder (2.53s) === RUN TestAttributeSnapshotReadLockOrder I1117 09:36:56.688181 leveldb_store.go:48 filer store dir: /tmp/TestAttributeSnapshotReadLockOrder3187976591/001/meta I1117 09:36:56.688502 file_util.go:29 Folder /tmp/TestAttributeSnapshotReadLockOrder3187976591/001/meta Permission: -rwxr-xr-x --- PASS: TestAttributeSnapshotReadLockOrder (0.13s) === RUN TestAttributeTruncateRetainLockOrder --- PASS: TestAttributeTruncateRetainLockOrder (2.21s) === RUN TestContentFlushPreservesPeerChunks === RUN TestContentFlushPreservesPeerChunks/single-writer I1117 09:36:59.031894 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushPreservesPeerChunkssingle-writer2981962965/001/meta I1117 09:36:59.032148 file_util.go:29 Folder /tmp/TestContentFlushPreservesPeerChunkssingle-writer2981962965/001/meta Permission: -rwxr-xr-x === RUN TestContentFlushPreservesPeerChunks/peer-append I1117 09:36:59.160993 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushPreservesPeerChunkspeer-append4154503561/001/meta I1117 09:36:59.161282 file_util.go:29 Folder /tmp/TestContentFlushPreservesPeerChunkspeer-append4154503561/001/meta Permission: -rwxr-xr-x === RUN TestContentFlushPreservesPeerChunks/replaced I1117 09:36:59.249457 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushPreservesPeerChunksreplaced2160245748/001/meta I1117 09:36:59.249731 file_util.go:29 Folder /tmp/TestContentFlushPreservesPeerChunksreplaced2160245748/001/meta Permission: -rwxr-xr-x E1117 09:36:59.320291 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:36:59.336656 weedfs_file_sync.go:237 /dir/file fh 1 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed === RUN TestContentFlushPreservesPeerChunks/deleted I1117 09:36:59.346628 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushPreservesPeerChunksdeleted350039234/001/meta I1117 09:36:59.346881 file_util.go:29 Folder /tmp/TestContentFlushPreservesPeerChunksdeleted350039234/001/meta Permission: -rwxr-xr-x E1117 09:36:59.411605 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:36:59.412552 weedfs_file_sync.go:237 /dir/file fh 1 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed === RUN TestContentFlushPreservesPeerChunks/deferred-create I1117 09:36:59.416855 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushPreservesPeerChunksdeferred-create1517719855/001/meta I1117 09:36:59.417043 file_util.go:29 Folder /tmp/TestContentFlushPreservesPeerChunksdeferred-create1517719855/001/meta Permission: -rwxr-xr-x === RUN TestContentFlushPreservesPeerChunks/deferred-create-race I1117 09:36:59.488639 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushPreservesPeerChunksdeferred-create-race3852948305/001/meta I1117 09:36:59.488852 file_util.go:29 Folder /tmp/TestContentFlushPreservesPeerChunksdeferred-create-race3852948305/001/meta Permission: -rwxr-xr-x E1117 09:36:59.543823 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:36:59.544404 weedfs_file_sync.go:237 /dir/file fh 1 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed --- PASS: TestContentFlushPreservesPeerChunks (0.52s) --- PASS: TestContentFlushPreservesPeerChunks/single-writer (0.13s) --- PASS: TestContentFlushPreservesPeerChunks/peer-append (0.09s) --- PASS: TestContentFlushPreservesPeerChunks/replaced (0.10s) --- PASS: TestContentFlushPreservesPeerChunks/deleted (0.07s) --- PASS: TestContentFlushPreservesPeerChunks/deferred-create (0.07s) --- PASS: TestContentFlushPreservesPeerChunks/deferred-create-race (0.06s) === RUN TestContentFlushRepeatsOnOneHandle I1117 09:36:59.549641 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushRepeatsOnOneHandle3657975158/001/meta I1117 09:36:59.549848 file_util.go:29 Folder /tmp/TestContentFlushRepeatsOnOneHandle3657975158/001/meta Permission: -rwxr-xr-x --- PASS: TestContentFlushRepeatsOnOneHandle (0.08s) === RUN TestContentFlushRefusalWithStalledLookup I1117 09:36:59.632800 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushRefusalWithStalledLookup2688642386/001/meta I1117 09:36:59.633013 file_util.go:29 Folder /tmp/TestContentFlushRefusalWithStalledLookup2688642386/001/meta Permission: -rwxr-xr-x E1117 09:36:59.895381 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:36:59.896039 weedfs_file_sync.go:237 /dir/file fh 1 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed --- PASS: TestContentFlushRefusalWithStalledLookup (0.27s) === RUN TestPeriodicMetadataFlushPreservesPeerChunks I1117 09:36:59.902022 leveldb_store.go:48 filer store dir: /tmp/TestPeriodicMetadataFlushPreservesPeerChunks3756075192/001/meta I1117 09:36:59.902214 file_util.go:29 Folder /tmp/TestPeriodicMetadataFlushPreservesPeerChunks3756075192/001/meta Permission: -rwxr-xr-x --- PASS: TestPeriodicMetadataFlushPreservesPeerChunks (0.09s) === RUN TestContentFlushMergeThenRepeat I1117 09:36:59.991443 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushMergeThenRepeat552644542/001/meta I1117 09:36:59.991650 file_util.go:29 Folder /tmp/TestContentFlushMergeThenRepeat552644542/001/meta Permission: -rwxr-xr-x --- PASS: TestContentFlushMergeThenRepeat (0.10s) === RUN TestMergeContentEntry --- PASS: TestMergeContentEntry (0.01s) === RUN TestContentFlushRepublishesUnchangedEntry === RUN TestContentFlushRepublishesUnchangedEntry/renamed I1117 09:37:00.114564 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushRepublishesUnchangedEntryrenamed4061770580/001/meta I1117 09:37:00.114832 file_util.go:29 Folder /tmp/TestContentFlushRepublishesUnchangedEntryrenamed4061770580/001/meta Permission: -rwxr-xr-x === RUN TestContentFlushRepublishesUnchangedEntry/colliding-uid I1117 09:37:00.196458 leveldb_store.go:48 filer store dir: /tmp/TestContentFlushRepublishesUnchangedEntrycolliding-uid1132102960/001/meta I1117 09:37:00.196703 file_util.go:29 Folder /tmp/TestContentFlushRepublishesUnchangedEntrycolliding-uid1132102960/001/meta Permission: -rwxr-xr-x --- PASS: TestContentFlushRepublishesUnchangedEntry (0.17s) --- PASS: TestContentFlushRepublishesUnchangedEntry/renamed (0.08s) --- PASS: TestContentFlushRepublishesUnchangedEntry/colliding-uid (0.08s) === RUN TestRebaseEntryKeepsMergedSize I1117 09:37:00.281682 leveldb_store.go:48 filer store dir: /tmp/TestRebaseEntryKeepsMergedSize3391429313/001/meta I1117 09:37:00.281918 file_util.go:29 Folder /tmp/TestRebaseEntryKeepsMergedSize3391429313/001/meta Permission: -rwxr-xr-x --- PASS: TestRebaseEntryKeepsMergedSize (0.06s) === RUN TestRebaseEntryRetriesUnresolvedChunkView I1117 09:37:00.341143 leveldb_store.go:48 filer store dir: /tmp/TestRebaseEntryRetriesUnresolvedChunkView472694328/001/meta I1117 09:37:00.341380 file_util.go:29 Folder /tmp/TestRebaseEntryRetriesUnresolvedChunkView472694328/001/meta Permission: -rwxr-xr-x E1117 09:37:00.394081 filechunk_manifest.go:384 operation LookupFileId 1,0200000001 failed, err: volume lookup down W1117 09:37:00.394728 filehandle.go:221 rebase /dir/file: resolve chunks: fail to read manifest 1,0200000001: volume lookup down --- PASS: TestRebaseEntryRetriesUnresolvedChunkView (0.06s) === RUN TestContentAsyncSuccessReleasesHandle I1117 09:37:00.400298 leveldb_store.go:48 filer store dir: /tmp/TestContentAsyncSuccessReleasesHandle1907536227/001/meta I1117 09:37:00.400542 file_util.go:29 Folder /tmp/TestContentAsyncSuccessReleasesHandle1907536227/001/meta Permission: -rwxr-xr-x --- PASS: TestContentAsyncSuccessReleasesHandle (0.08s) === RUN TestContentAsyncConflictKeepsRecoveryRecord I1117 09:37:00.479818 leveldb_store.go:48 filer store dir: /tmp/TestContentAsyncConflictKeepsRecoveryRecord1617731044/001/meta I1117 09:37:00.480038 file_util.go:29 Folder /tmp/TestContentAsyncConflictKeepsRecoveryRecord1617731044/001/meta Permission: -rwxr-xr-x E1117 09:37:00.546494 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:00.547201 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 2/4) after 1s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.556345 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:00.556795 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 3/4) after 2s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.565298 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:00.565702 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 4/4) after 4s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.578806 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.579586 weedfs_async_flush.go:161 completeAsyncFlush /dir/file: metadata flush failed after 4 attempts: fh flush create /dir/file: CreateEntry /dir/file: precondition failed - chunks are uploaded but NOT referenced in filer metadata; they will appear as orphans in volume.fsck E1117 09:37:00.607292 weedfs_async_flush.go:113 completeAsyncFlush /dir/file: publication failed: fh flush create /dir/file: CreateEntry /dir/file: precondition failed; recovery request retained at /tmp/TestContentAsyncConflictKeepsRecoveryRecord1617731044/002/failed-metadata-1000/pending-3500598177.tmp.json (no automatic replay) --- PASS: TestContentAsyncConflictKeepsRecoveryRecord (0.15s) === RUN TestContentRecoveryUsesFailedRequestNotLaterHandle I1117 09:37:00.625698 leveldb_store.go:48 filer store dir: /tmp/TestContentRecoveryUsesFailedRequestNotLaterHandle3372190634/001/meta I1117 09:37:00.625936 file_util.go:29 Folder /tmp/TestContentRecoveryUsesFailedRequestNotLaterHandle3372190634/001/meta Permission: -rwxr-xr-x E1117 09:37:00.697362 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed --- PASS: TestContentRecoveryUsesFailedRequestNotLaterHandle (0.08s) === RUN TestContentAsyncRetentionWriteFailureKeepsDrainPending I1117 09:37:00.710512 leveldb_store.go:48 filer store dir: /tmp/TestContentAsyncRetentionWriteFailureKeepsDrainPending1088861151/001/meta I1117 09:37:00.710778 file_util.go:29 Folder /tmp/TestContentAsyncRetentionWriteFailureKeepsDrainPending1088861151/001/meta Permission: -rwxr-xr-x E1117 09:37:00.777373 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:00.777965 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 2/4) after 1s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.786586 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:00.786999 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 3/4) after 2s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.795031 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:00.795529 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 4/4) after 4s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.803851 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.804368 weedfs_async_flush.go:161 completeAsyncFlush /dir/file: metadata flush failed after 4 attempts: fh flush create /dir/file: CreateEntry /dir/file: precondition failed - chunks are uploaded but NOT referenced in filer metadata; they will appear as orphans in volume.fsck E1117 09:37:00.805236 weedfs_async_flush.go:116 completeAsyncFlush /dir/file: retaining pending references in memory: mkdir /tmp/TestContentAsyncRetentionWriteFailureKeepsDrainPending1088861151/002/cache: not a directory; publication failure: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:00.808184 weedfs_async_flush.go:113 completeAsyncFlush /dir/file: publication failed: fh flush create /dir/file: CreateEntry /dir/file: precondition failed; recovery request retained at /tmp/TestContentAsyncRetentionWriteFailureKeepsDrainPending1088861151/002/cache/failed-metadata-1000/pending-800983920.tmp.json (no automatic replay) --- PASS: TestContentAsyncRetentionWriteFailureKeepsDrainPending (0.10s) === RUN TestContentRecoverySkipsAnotherUsersDirectory I1117 09:37:00.814042 leveldb_store.go:48 filer store dir: /tmp/TestContentRecoverySkipsAnotherUsersDirectory2148357114/001/meta I1117 09:37:00.814303 file_util.go:29 Folder /tmp/TestContentRecoverySkipsAnotherUsersDirectory2148357114/001/meta Permission: -rwxr-xr-x E1117 09:37:00.887625 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed --- PASS: TestContentRecoverySkipsAnotherUsersDirectory (0.08s) === RUN TestMasterCommittedEOFAppendHasNoGap === RUN TestMasterCommittedEOFAppendHasNoGap/append I1117 09:37:00.897255 leveldb_store.go:48 filer store dir: /tmp/TestMasterCommittedEOFAppendHasNoGapappend1995751501/001/meta I1117 09:37:00.897474 file_util.go:29 Folder /tmp/TestMasterCommittedEOFAppendHasNoGapappend1995751501/001/meta Permission: -rwxr-xr-x E1117 09:37:00.963015 weedfs_file_sync.go:369 fh flush create /dir/file: append offset 512 exceeds committed EOF 256: precondition failed E1117 09:37:00.964511 weedfs_file_sync.go:237 /dir/file fh 3618611670488738897 flush: fh flush create /dir/file: append offset 512 exceeds committed EOF 256: precondition failed === RUN TestMasterCommittedEOFAppendHasNoGap/intentional-sparse-pwrite I1117 09:37:00.971292 leveldb_store.go:48 filer store dir: /tmp/TestMasterCommittedEOFAppendHasNoGapintentional-sparse-pwrite3130230053/001/meta I1117 09:37:00.971541 file_util.go:29 Folder /tmp/TestMasterCommittedEOFAppendHasNoGapintentional-sparse-pwrite3130230053/001/meta Permission: -rwxr-xr-x --- PASS: TestMasterCommittedEOFAppendHasNoGap (0.17s) --- PASS: TestMasterCommittedEOFAppendHasNoGap/append (0.07s) --- PASS: TestMasterCommittedEOFAppendHasNoGap/intentional-sparse-pwrite (0.10s) === RUN TestMasterConflictThenAppendCannotPublishGap === RUN TestMasterConflictThenAppendCannotPublishGap/normal I1117 09:37:01.071118 leveldb_store.go:48 filer store dir: /tmp/TestMasterConflictThenAppendCannotPublishGapnormal663446428/001/meta I1117 09:37:01.071362 file_util.go:29 Folder /tmp/TestMasterConflictThenAppendCannotPublishGapnormal663446428/001/meta Permission: -rwxr-xr-x E1117 09:37:01.142933 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.143839 weedfs_file_sync.go:237 /dir/file fh 13954404631290630922 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.158966 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.159639 weedfs_file_sync.go:237 /dir/file fh 13954404631290630922 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:01.160034 weedfs_file_io.go:166 release fh 13954404631290630922 inode 42: fallback flush failed: 5=input/output error E1117 09:37:01.170088 weedfs_file_sync.go:369 fh flush create /dir/file: append offset 512 exceeds committed EOF 256: precondition failed E1117 09:37:01.170839 weedfs_file_sync.go:237 /dir/file fh 12640271446074423942 flush: fh flush create /dir/file: append offset 512 exceeds committed EOF 256: precondition failed === RUN TestMasterConflictThenAppendCannotPublishGap/writeback I1117 09:37:01.176771 leveldb_store.go:48 filer store dir: /tmp/TestMasterConflictThenAppendCannotPublishGapwriteback887613574/001/meta I1117 09:37:01.176972 file_util.go:29 Folder /tmp/TestMasterConflictThenAppendCannotPublishGapwriteback887613574/001/meta Permission: -rwxr-xr-x E1117 09:37:01.254723 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.255604 weedfs_file_sync.go:237 /dir/file fh 1685081658199973752 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.257597 weedfs_file_sync.go:369 fh flush create /dir/file: writeback inode awaits Forget after content refusal: precondition failed E1117 09:37:01.258141 weedfs_file_sync.go:237 /dir/file fh 1685081658199973752 flush: fh flush create /dir/file: writeback inode awaits Forget after content refusal: precondition failed W1117 09:37:01.258375 weedfs_file_io.go:166 release fh 1685081658199973752 inode 42: fallback flush failed: 5=input/output error E1117 09:37:01.264334 weedfs_file_sync.go:369 fh flush create /dir/file: writeback inode awaits Forget after content refusal: precondition failed E1117 09:37:01.264898 weedfs_file_sync.go:237 /dir/file fh 5306082967140358620 flush: fh flush create /dir/file: writeback inode awaits Forget after content refusal: precondition failed === RUN TestMasterConflictThenAppendCannotPublishGap/writeback-coalesced I1117 09:37:01.269890 leveldb_store.go:48 filer store dir: /tmp/TestMasterConflictThenAppendCannotPublishGapwriteback-coalesced1927464880/001/meta I1117 09:37:01.270128 file_util.go:29 Folder /tmp/TestMasterConflictThenAppendCannotPublishGapwriteback-coalesced1927464880/001/meta Permission: -rwxr-xr-x E1117 09:37:01.340127 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.340998 weedfs_file_sync.go:237 /dir/file fh 1890014861144380099 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.343029 weedfs_file_sync.go:369 fh flush create /dir/file: writeback inode awaits Forget after content refusal: precondition failed E1117 09:37:01.343708 weedfs_file_sync.go:237 /dir/file fh 1890014861144380099 flush: fh flush create /dir/file: writeback inode awaits Forget after content refusal: precondition failed W1117 09:37:01.344042 weedfs_file_io.go:166 release fh 1890014861144380099 inode 42: fallback flush failed: 5=input/output error E1117 09:37:01.352533 weedfs_file_sync.go:369 fh flush create /dir/file: writeback inode awaits Forget after content refusal: precondition failed E1117 09:37:01.353250 weedfs_file_sync.go:237 /dir/file fh 5445172661491495713 flush: fh flush create /dir/file: writeback inode awaits Forget after content refusal: precondition failed --- PASS: TestMasterConflictThenAppendCannotPublishGap (0.29s) --- PASS: TestMasterConflictThenAppendCannotPublishGap/normal (0.11s) --- PASS: TestMasterConflictThenAppendCannotPublishGap/writeback (0.09s) --- PASS: TestMasterConflictThenAppendCannotPublishGap/writeback-coalesced (0.09s) === RUN TestContentGapPeerMerge === RUN TestContentGapPeerMerge/peer-append I1117 09:37:01.362453 leveldb_store.go:48 filer store dir: /tmp/TestContentGapPeerMergepeer-append2231519939/001/meta I1117 09:37:01.362704 file_util.go:29 Folder /tmp/TestContentGapPeerMergepeer-append2231519939/001/meta Permission: -rwxr-xr-x content_gap_merge_test.go:69: scenario=peer-append status=OK size=768 rejected=1 gap[256,512)-zero=false === RUN TestContentGapPeerMerge/peer-replaced-file I1117 09:37:01.458696 leveldb_store.go:48 filer store dir: /tmp/TestContentGapPeerMergepeer-replaced-file3942929510/001/meta I1117 09:37:01.458967 file_util.go:29 Folder /tmp/TestContentGapPeerMergepeer-replaced-file3942929510/001/meta Permission: -rwxr-xr-x E1117 09:37:01.525514 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.526334 weedfs_file_sync.go:237 /dir/file fh 1 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed content_gap_merge_test.go:69: scenario=peer-replaced-file status=5=input/output error size=256 rejected=1 gap[256,512)-zero=false === RUN TestContentGapPeerMerge/peer-truncate I1117 09:37:01.535156 leveldb_store.go:48 filer store dir: /tmp/TestContentGapPeerMergepeer-truncate4064830662/001/meta I1117 09:37:01.535356 file_util.go:29 Folder /tmp/TestContentGapPeerMergepeer-truncate4064830662/001/meta Permission: -rwxr-xr-x E1117 09:37:01.606180 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:01.606997 weedfs_file_sync.go:237 /dir/file fh 1 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed content_gap_merge_test.go:69: scenario=peer-truncate status=5=input/output error size=256 rejected=1 gap[256,512)-zero=false --- PASS: TestContentGapPeerMerge (0.25s) --- PASS: TestContentGapPeerMerge/peer-append (0.10s) --- PASS: TestContentGapPeerMerge/peer-replaced-file (0.08s) --- PASS: TestContentGapPeerMerge/peer-truncate (0.08s) === RUN TestContentGapPeriodicPeerMerge === RUN TestContentGapPeriodicPeerMerge/peer-append I1117 09:37:01.615976 leveldb_store.go:48 filer store dir: /tmp/TestContentGapPeriodicPeerMergepeer-append3589755012/001/meta I1117 09:37:01.616222 file_util.go:29 Folder /tmp/TestContentGapPeriodicPeerMergepeer-append3589755012/001/meta Permission: -rwxr-xr-x content_gap_merge_test.go:69: scenario=peer-append status=OK size=768 rejected=1 gap[256,512)-zero=false === RUN TestContentGapPeriodicPeerMerge/peer-replaced-file I1117 09:37:01.700643 leveldb_store.go:48 filer store dir: /tmp/TestContentGapPeriodicPeerMergepeer-replaced-file2227437305/001/meta I1117 09:37:01.700882 file_util.go:29 Folder /tmp/TestContentGapPeriodicPeerMergepeer-replaced-file2227437305/001/meta Permission: -rwxr-xr-x content_gap_merge_test.go:61: periodic error: CreateEntry /dir/file: precondition failed content_gap_merge_test.go:69: scenario=peer-replaced-file status=5=input/output error size=256 rejected=1 gap[256,512)-zero=false === RUN TestContentGapPeriodicPeerMerge/peer-truncate I1117 09:37:01.787794 leveldb_store.go:48 filer store dir: /tmp/TestContentGapPeriodicPeerMergepeer-truncate921731319/001/meta I1117 09:37:01.787999 file_util.go:29 Folder /tmp/TestContentGapPeriodicPeerMergepeer-truncate921731319/001/meta Permission: -rwxr-xr-x content_gap_merge_test.go:61: periodic error: CreateEntry /dir/file: precondition failed content_gap_merge_test.go:69: scenario=peer-truncate status=5=input/output error size=256 rejected=1 gap[256,512)-zero=false --- PASS: TestContentGapPeriodicPeerMerge (0.25s) --- PASS: TestContentGapPeriodicPeerMerge/peer-append (0.08s) --- PASS: TestContentGapPeriodicPeerMerge/peer-replaced-file (0.09s) --- PASS: TestContentGapPeriodicPeerMerge/peer-truncate (0.08s) === RUN TestAppendAfterRefusedFlushHasNoHole I1117 09:37:01.862810 leveldb_store.go:48 filer store dir: /tmp/TestAppendAfterRefusedFlushHasNoHole1400661317/001/meta I1117 09:37:01.863053 file_util.go:29 Folder /tmp/TestAppendAfterRefusedFlushHasNoHole1400661317/001/meta Permission: -rwxr-xr-x content_gap_test.go:94: first fsync=OK --- PASS: TestAppendAfterRefusedFlushHasNoHole (0.11s) === RUN TestG6AppendFsyncAfterPeerAttribute === RUN TestG6AppendFsyncAfterPeerAttribute/none I1117 09:37:01.972352 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributenone3588690358/001/meta I1117 09:37:01.972629 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributenone3588690358/001/meta Permission: -rwxr-xr-x I1117 09:37:02.019845 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributenone3588690358/002/meta I1117 09:37:02.020073 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributenone3588690358/002/meta Permission: -rwxr-xr-x === RUN TestG6AppendFsyncAfterPeerAttribute/chmod I1117 09:37:02.103034 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributechmod3248089384/001/meta I1117 09:37:02.103257 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributechmod3248089384/001/meta Permission: -rwxr-xr-x I1117 09:37:02.146778 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributechmod3248089384/002/meta I1117 09:37:02.146994 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributechmod3248089384/002/meta Permission: -rwxr-xr-x === RUN TestG6AppendFsyncAfterPeerAttribute/chown I1117 09:37:02.205885 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributechown3045513945/001/meta I1117 09:37:02.206117 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributechown3045513945/001/meta Permission: -rwxr-xr-x I1117 09:37:02.221688 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributechown3045513945/002/meta I1117 09:37:02.222432 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributechown3045513945/002/meta Permission: -rwxr-xr-x === RUN TestG6AppendFsyncAfterPeerAttribute/utimes I1117 09:37:02.327630 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributeutimes3147458606/001/meta I1117 09:37:02.327866 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributeutimes3147458606/001/meta Permission: -rwxr-xr-x I1117 09:37:02.384394 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributeutimes3147458606/002/meta I1117 09:37:02.384668 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributeutimes3147458606/002/meta Permission: -rwxr-xr-x === RUN TestG6AppendFsyncAfterPeerAttribute/setxattr I1117 09:37:02.478819 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributesetxattr3977141151/001/meta I1117 09:37:02.479026 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributesetxattr3977141151/001/meta Permission: -rwxr-xr-x I1117 09:37:02.515336 leveldb_store.go:48 filer store dir: /tmp/TestG6AppendFsyncAfterPeerAttributesetxattr3977141151/002/meta I1117 09:37:02.515655 file_util.go:29 Folder /tmp/TestG6AppendFsyncAfterPeerAttributesetxattr3977141151/002/meta Permission: -rwxr-xr-x --- PASS: TestG6AppendFsyncAfterPeerAttribute (0.64s) --- PASS: TestG6AppendFsyncAfterPeerAttribute/none (0.13s) --- PASS: TestG6AppendFsyncAfterPeerAttribute/chmod (0.10s) --- PASS: TestG6AppendFsyncAfterPeerAttribute/chown (0.12s) --- PASS: TestG6AppendFsyncAfterPeerAttribute/utimes (0.15s) --- PASS: TestG6AppendFsyncAfterPeerAttribute/setxattr (0.14s) === RUN TestAppendCompatibleCommittedPrefix I1117 09:37:02.616837 leveldb_store.go:48 filer store dir: /tmp/TestAppendCompatibleCommittedPrefix2506382300/001/meta I1117 09:37:02.617083 file_util.go:29 Folder /tmp/TestAppendCompatibleCommittedPrefix2506382300/001/meta Permission: -rwxr-xr-x --- PASS: TestAppendCompatibleCommittedPrefix (0.09s) === RUN TestAsyncRefusalAfterForgetDoesNotPoisonRelookup I1117 09:37:02.705720 leveldb_store.go:48 filer store dir: /tmp/TestAsyncRefusalAfterForgetDoesNotPoisonRelookup1152270791/001/meta I1117 09:37:02.705928 file_util.go:29 Folder /tmp/TestAsyncRefusalAfterForgetDoesNotPoisonRelookup1152270791/001/meta Permission: -rwxr-xr-x E1117 09:37:02.799971 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:02.800664 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 2/4) after 1s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:03.833159 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:03.833824 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 3/4) after 2s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:05.865784 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:05.866384 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 4/4) after 4s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:09.898096 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:09.898820 weedfs_async_flush.go:161 completeAsyncFlush /dir/file: metadata flush failed after 4 attempts: fh flush create /dir/file: CreateEntry /dir/file: precondition failed - chunks are uploaded but NOT referenced in filer metadata; they will appear as orphans in volume.fsck E1117 09:37:09.902845 weedfs_async_flush.go:113 completeAsyncFlush /dir/file: publication failed: fh flush create /dir/file: CreateEntry /dir/file: precondition failed; recovery request retained at /tmp/TestAsyncRefusalAfterForgetDoesNotPoisonRelookup1152270791/002/failed-metadata-1000/pending-2545716122.tmp.json (no automatic replay) --- PASS: TestAsyncRefusalAfterForgetDoesNotPoisonRelookup (7.22s) === RUN TestAsyncPublicationBlockedBeforeCaptureDoesNotPoisonRelookup I1117 09:37:09.921019 leveldb_store.go:48 filer store dir: /tmp/TestAsyncPublicationBlockedBeforeCaptureDoesNotPoisonRelookup3226371283/001/meta I1117 09:37:09.921252 file_util.go:29 Folder /tmp/TestAsyncPublicationBlockedBeforeCaptureDoesNotPoisonRelookup3226371283/001/meta Permission: -rwxr-xr-x content_gap_test.go:364: flush arrived and is blocked at publication before opening gate E1117 09:37:10.056821 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:10.057717 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 2/4) after 1s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:11.091217 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:11.091867 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 3/4) after 2s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:13.127555 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed W1117 09:37:13.128365 weedfs_async_flush.go:154 completeAsyncFlush /dir/file: retrying metadata flush (attempt 4/4) after 4s: fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:17.157313 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:37:17.158001 weedfs_async_flush.go:161 completeAsyncFlush /dir/file: metadata flush failed after 4 attempts: fh flush create /dir/file: CreateEntry /dir/file: precondition failed - chunks are uploaded but NOT referenced in filer metadata; they will appear as orphans in volume.fsck E1117 09:37:17.160785 weedfs_async_flush.go:113 completeAsyncFlush /dir/file: publication failed: fh flush create /dir/file: CreateEntry /dir/file: precondition failed; recovery request retained at /tmp/TestAsyncPublicationBlockedBeforeCaptureDoesNotPoisonRelookup3226371283/002/failed-metadata-1000/pending-352761837.tmp.json (no automatic replay) --- PASS: TestAsyncPublicationBlockedBeforeCaptureDoesNotPoisonRelookup (7.25s) === RUN TestAppendAfterPendingPositionalExtensionPublishes I1117 09:37:17.176818 leveldb_store.go:48 filer store dir: /tmp/TestAppendAfterPendingPositionalExtensionPublishes694991612/001/meta I1117 09:37:17.177033 file_util.go:29 Folder /tmp/TestAppendAfterPendingPositionalExtensionPublishes694991612/001/meta Permission: -rwxr-xr-x --- PASS: TestAppendAfterPendingPositionalExtensionPublishes (0.07s) === RUN TestPositionalSparseWriteStillPublishes I1117 09:37:17.244607 leveldb_store.go:48 filer store dir: /tmp/TestPositionalSparseWriteStillPublishes2772732970/001/meta I1117 09:37:17.244812 file_util.go:29 Folder /tmp/TestPositionalSparseWriteStillPublishes2772732970/001/meta Permission: -rwxr-xr-x --- PASS: TestPositionalSparseWriteStillPublishes (0.06s) === RUN TestSparseWriteAfterAppendFlagClearedPublishes I1117 09:37:17.308276 leveldb_store.go:48 filer store dir: /tmp/TestSparseWriteAfterAppendFlagClearedPublishes1575105976/001/meta I1117 09:37:17.308509 file_util.go:29 Folder /tmp/TestSparseWriteAfterAppendFlagClearedPublishes1575105976/001/meta Permission: -rwxr-xr-x --- PASS: TestSparseWriteAfterAppendFlagClearedPublishes (0.07s) === RUN TestTruncatingOpenDiscardsRefusedAppend I1117 09:37:17.378815 leveldb_store.go:48 filer store dir: /tmp/TestTruncatingOpenDiscardsRefusedAppend2303040826/001/meta I1117 09:37:17.379033 file_util.go:29 Folder /tmp/TestTruncatingOpenDiscardsRefusedAppend2303040826/001/meta Permission: -rwxr-xr-x E1117 09:37:17.435739 weedfs_file_sync.go:369 fh flush create /dir/file: append offset 512 exceeds committed EOF 256: precondition failed E1117 09:37:17.436500 weedfs_file_sync.go:237 /dir/file fh 12686914158759940680 flush: fh flush create /dir/file: append offset 512 exceeds committed EOF 256: precondition failed --- PASS: TestTruncatingOpenDiscardsRefusedAppend (0.10s) === RUN TestEagerCreateWriteKeepsFilerDefaults I1117 09:37:17.474447 leveldb_store.go:48 filer store dir: /tmp/TestEagerCreateWriteKeepsFilerDefaults1461142920/001/meta I1117 09:37:17.474651 file_util.go:29 Folder /tmp/TestEagerCreateWriteKeepsFilerDefaults1461142920/001/meta Permission: -rwxr-xr-x --- PASS: TestEagerCreateWriteKeepsFilerDefaults (0.13s) === RUN TestLostAnswerToOwnShrinkingFlushIsNotAConflict I1117 09:37:17.602617 leveldb_store.go:48 filer store dir: /tmp/TestLostAnswerToOwnShrinkingFlushIsNotAConflict2207293026/001/meta I1117 09:37:17.602871 file_util.go:29 Folder /tmp/TestLostAnswerToOwnShrinkingFlushIsNotAConflict2207293026/001/meta Permission: -rwxr-xr-x I1117 09:37:17.698979 retry.go:132 retry filer grpc: err: CreateEntry: rpc error: code = Unavailable desc = answer lost after commit --- PASS: TestLostAnswerToOwnShrinkingFlushIsNotAConflict (1.13s) === RUN TestChunkedDirtyPagesFailWritesAfterUploadError --- PASS: TestChunkedDirtyPagesFailWritesAfterUploadError (0.00s) === RUN TestChunkedDirtyPagesWritebackRetriesTransientUploadError E1117 09:37:18.779846 upload_content.go:696 unmarshal http://127.0.0.1:37221: W1117 09:37:18.781012 upload_content.go:377 uploading 0 to http://127.0.0.1:37221: unmarshal http://127.0.0.1:37221: unexpected end of JSON input === RUN TestChunkedDirtyPagesWritebackRetriesTransientUploadError/volume_refused I1117 09:37:18.789848 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesWritebackRetriesTransientUploadErrorvolume1170730506/001/meta I1117 09:37:18.790054 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesWritebackRetriesTransientUploadErrorvolume1170730506/001/meta Permission: -rwxr-xr-x W1117 09:37:18.833863 dirty_pages_chunked.go:135 /dir/f writeback upload [0,5) failed, keeping the data and retrying: upload data: dial tcp: connection refused === RUN TestChunkedDirtyPagesWritebackRetriesTransientUploadError/filer_proxy_500 I1117 09:37:19.840480 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesWritebackRetriesTransientUploadErrorfiler_853398239/001/meta I1117 09:37:19.840697 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesWritebackRetriesTransientUploadErrorfiler_853398239/001/meta Permission: -rwxr-xr-x W1117 09:37:19.894087 dirty_pages_chunked.go:135 /dir/f writeback upload [0,5) failed, keeping the data and retrying: upload data: unmarshal http://127.0.0.1:37221: unexpected end of JSON input === RUN TestChunkedDirtyPagesWritebackRetriesTransientUploadError/assign_timed_out I1117 09:37:20.900417 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesWritebackRetriesTransientUploadErrorassign624099949/001/meta I1117 09:37:20.900697 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesWritebackRetriesTransientUploadErrorassign624099949/001/meta Permission: -rwxr-xr-x W1117 09:37:20.949215 dirty_pages_chunked.go:135 /dir/f writeback upload [0,5) failed, keeping the data and retrying: upload data: filerGrpcAddress assign volume: rpc error: code = Unavailable desc = filer 127.0.0.1:18888: call timed out I1117 09:37:20.949650 retry.go:202 retry writeback upload /dir/f: err: upload data: filerGrpcAddress assign volume: rpc error: code = Unavailable desc = filer 127.0.0.1:18888: call timed out --- PASS: TestChunkedDirtyPagesWritebackRetriesTransientUploadError (3.23s) --- PASS: TestChunkedDirtyPagesWritebackRetriesTransientUploadError/volume_refused (1.05s) --- PASS: TestChunkedDirtyPagesWritebackRetriesTransientUploadError/filer_proxy_500 (1.06s) --- PASS: TestChunkedDirtyPagesWritebackRetriesTransientUploadError/assign_timed_out (1.06s) === RUN TestChunkedDirtyPagesUploadErrorWithoutRetry === RUN TestChunkedDirtyPagesUploadErrorWithoutRetry/sync_mode_reports_the_outage_to_close I1117 09:37:21.959021 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrysync_mode_reports_t615860844/001/meta I1117 09:37:21.959275 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrysync_mode_reports_t615860844/001/meta Permission: -rwxr-xr-x I1117 09:37:22.023068 dirty_pages_chunked.go:139 /dir/f saveToStorage [0,5): upload data: dial tcp: connection refused === RUN TestChunkedDirtyPagesUploadErrorWithoutRetry/writeback_permanent_error I1117 09:37:22.028310 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrywriteback_permanent878269612/001/meta I1117 09:37:22.028563 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrywriteback_permanent878269612/001/meta Permission: -rwxr-xr-x I1117 09:37:22.080554 dirty_pages_chunked.go:139 /dir/f saveToStorage [0,5): upload data: assign volume failure: no writable volumes === RUN TestChunkedDirtyPagesUploadErrorWithoutRetry/writeback_read-only_path I1117 09:37:22.087075 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrywriteback_read-only3679631985/001/meta I1117 09:37:22.087360 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrywriteback_read-only3679631985/001/meta Permission: -rwxr-xr-x I1117 09:37:22.158305 dirty_pages_chunked.go:139 /dir/f saveToStorage [0,5): upload data: assign volume failure path:"/unavailable/f": assign volume: read only: /unavailable === RUN TestChunkedDirtyPagesUploadErrorWithoutRetry/writeback_pages_discarded_mid-upload I1117 09:37:22.162094 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrywriteback_pages_dis4072124770/001/meta I1117 09:37:22.162321 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrywriteback_pages_dis4072124770/001/meta Permission: -rwxr-xr-x I1117 09:37:22.207180 dirty_pages_chunked.go:139 /dir/f saveToStorage [0,5): upload data: dial tcp: connection refused === RUN TestChunkedDirtyPagesUploadErrorWithoutRetry/writeback_pages_discarded_during_the_retry_wait I1117 09:37:22.211390 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrywriteback_pages_dis1046989750/001/meta I1117 09:37:22.211625 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesUploadErrorWithoutRetrywriteback_pages_dis1046989750/001/meta Permission: -rwxr-xr-x W1117 09:37:22.260868 dirty_pages_chunked.go:135 /dir/f writeback upload [0,5) failed, keeping the data and retrying: upload data: dial tcp: connection refused I1117 09:37:23.262386 dirty_pages_chunked.go:139 /dir/f saveToStorage [0,5): dirty pages discarded --- PASS: TestChunkedDirtyPagesUploadErrorWithoutRetry (1.31s) --- PASS: TestChunkedDirtyPagesUploadErrorWithoutRetry/sync_mode_reports_the_outage_to_close (0.07s) --- PASS: TestChunkedDirtyPagesUploadErrorWithoutRetry/writeback_permanent_error (0.06s) --- PASS: TestChunkedDirtyPagesUploadErrorWithoutRetry/writeback_read-only_path (0.07s) --- PASS: TestChunkedDirtyPagesUploadErrorWithoutRetry/writeback_pages_discarded_mid-upload (0.05s) --- PASS: TestChunkedDirtyPagesUploadErrorWithoutRetry/writeback_pages_discarded_during_the_retry_wait (1.06s) === RUN TestChunkedDirtyPagesDiscardedUploadNotAttached I1117 09:37:23.267669 leveldb_store.go:48 filer store dir: /tmp/TestChunkedDirtyPagesDiscardedUploadNotAttached718325634/001/meta I1117 09:37:23.267884 file_util.go:29 Folder /tmp/TestChunkedDirtyPagesDiscardedUploadNotAttached718325634/001/meta Permission: -rwxr-xr-x --- PASS: TestChunkedDirtyPagesDiscardedUploadNotAttached (0.05s) === RUN TestGrpcErrorToFuseStatusUnwrapsCanceledThroughFmtErrorf --- PASS: TestGrpcErrorToFuseStatusUnwrapsCanceledThroughFmtErrorf (0.00s) === RUN TestGrpcErrorToFuseStatusDropsCanceledThroughPercentV --- PASS: TestGrpcErrorToFuseStatusDropsCanceledThroughPercentV (0.00s) === RUN TestWriteErrorToFuseStatus === RUN TestWriteErrorToFuseStatus/assign_shed_during_growth === RUN TestWriteErrorToFuseStatus/no_free_volumes_left === RUN TestWriteErrorToFuseStatus/unrelated_upload_failure --- PASS: TestWriteErrorToFuseStatus (0.00s) --- PASS: TestWriteErrorToFuseStatus/assign_shed_during_growth (0.00s) --- PASS: TestWriteErrorToFuseStatus/no_free_volumes_left (0.00s) --- PASS: TestWriteErrorToFuseStatus/unrelated_upload_failure (0.00s) === RUN TestIsRetryableFilerError === RUN TestIsRetryableFilerError/nil === RUN TestIsRetryableFilerError/canceled === RUN TestIsRetryableFilerError/unavailable === RUN TestIsRetryableFilerError/deadline_exceeded === RUN TestIsRetryableFilerError/resource_exhausted === RUN TestIsRetryableFilerError/internal === RUN TestIsRetryableFilerError/not_found === RUN TestIsRetryableFilerError/already_exists === RUN TestIsRetryableFilerError/invalid_argument === RUN TestIsRetryableFilerError/permission_denied === RUN TestIsRetryableFilerError/unauthenticated === RUN TestIsRetryableFilerError/failed_precondition === RUN TestIsRetryableFilerError/create_condition_failed === RUN TestIsRetryableFilerError/plain_error_retries === RUN TestIsRetryableFilerError/wrapped_canceled_still_retries === RUN TestIsRetryableFilerError/wrapped_not_found_still_skipped --- PASS: TestIsRetryableFilerError (0.01s) --- PASS: TestIsRetryableFilerError/nil (0.00s) --- PASS: TestIsRetryableFilerError/canceled (0.00s) --- PASS: TestIsRetryableFilerError/unavailable (0.00s) --- PASS: TestIsRetryableFilerError/deadline_exceeded (0.00s) --- PASS: TestIsRetryableFilerError/resource_exhausted (0.00s) --- PASS: TestIsRetryableFilerError/internal (0.00s) --- PASS: TestIsRetryableFilerError/not_found (0.00s) --- PASS: TestIsRetryableFilerError/already_exists (0.00s) --- PASS: TestIsRetryableFilerError/invalid_argument (0.00s) --- PASS: TestIsRetryableFilerError/permission_denied (0.00s) --- PASS: TestIsRetryableFilerError/unauthenticated (0.00s) --- PASS: TestIsRetryableFilerError/failed_precondition (0.00s) --- PASS: TestIsRetryableFilerError/create_condition_failed (0.00s) --- PASS: TestIsRetryableFilerError/plain_error_retries (0.00s) --- PASS: TestIsRetryableFilerError/wrapped_canceled_still_retries (0.00s) --- PASS: TestIsRetryableFilerError/wrapped_not_found_still_skipped (0.00s) === RUN TestRetryMetadataFlushIfShortCircuitsOnPermanentError --- PASS: TestRetryMetadataFlushIfShortCircuitsOnPermanentError (0.00s) === RUN TestRetryMetadataFlushIfRetriesTransientErrors --- PASS: TestRetryMetadataFlushIfRetriesTransientErrors (0.00s) === RUN TestAcquireFileHandleRefusesDrainingHandle --- PASS: TestAcquireFileHandleRefusesDrainingHandle (0.00s) === RUN TestReadUncachedRemoteEntryDoesNotDeadlock I1117 09:37:23.343351 leveldb_store.go:48 filer store dir: /tmp/TestReadUncachedRemoteEntryDoesNotDeadlock2679136654/001/meta I1117 09:37:23.343618 file_util.go:29 Folder /tmp/TestReadUncachedRemoteEntryDoesNotDeadlock2679136654/001/meta Permission: -rwxr-xr-x --- PASS: TestReadUncachedRemoteEntryDoesNotDeadlock (0.09s) === RUN TestFileHandleFullPathFallsBackAfterForget --- PASS: TestFileHandleFullPathFallsBackAfterForget (0.00s) === RUN TestFileHandleFullPathUsesSavedRenamePathAfterForget --- PASS: TestFileHandleFullPathUsesSavedRenamePathAfterForget (0.00s) === RUN TestIsFilerConfUpdateEventMatchesRenameTarget --- PASS: TestIsFilerConfUpdateEventMatchesRenameTarget (0.00s) === RUN TestFlushRacingWriteKeepsHandleDirty I1117 09:37:23.432498 leveldb_store.go:48 filer store dir: /tmp/TestFlushRacingWriteKeepsHandleDirty1036744433/001/meta I1117 09:37:23.432702 file_util.go:29 Folder /tmp/TestFlushRacingWriteKeepsHandleDirty1036744433/001/meta Permission: -rwxr-xr-x --- PASS: TestFlushRacingWriteKeepsHandleDirty (0.09s) === RUN TestDirStateIndexesStayInStep --- PASS: TestDirStateIndexesStayInStep (0.00s) === RUN TestForgetDoesNotDropAReusedDirPath --- PASS: TestForgetDoesNotDropAReusedDirPath (0.00s) === RUN TestInodeEntryStaysInSizeClass --- PASS: TestInodeEntryStaysInSizeClass (0.00s) === RUN TestInodeEntry_removeOnePath === RUN TestInodeEntry_removeOnePath/actual_case === RUN TestInodeEntry_removeOnePath/empty === RUN TestInodeEntry_removeOnePath/single === RUN TestInodeEntry_removeOnePath/first === RUN TestInodeEntry_removeOnePath/middle === RUN TestInodeEntry_removeOnePath/last === RUN TestInodeEntry_removeOnePath/not_found --- PASS: TestInodeEntry_removeOnePath (0.01s) --- PASS: TestInodeEntry_removeOnePath/actual_case (0.00s) --- PASS: TestInodeEntry_removeOnePath/empty (0.00s) --- PASS: TestInodeEntry_removeOnePath/single (0.00s) --- PASS: TestInodeEntry_removeOnePath/first (0.00s) --- PASS: TestInodeEntry_removeOnePath/middle (0.00s) --- PASS: TestInodeEntry_removeOnePath/last (0.00s) --- PASS: TestInodeEntry_removeOnePath/not_found (0.00s) === RUN TestOnlyDirectoriesGetDirState W1117 09:37:23.534532 inode_to_path.go:341 MarkChildrenCached not a tracked directory: /data/file.txt --- PASS: TestOnlyDirectoriesGetDirState (0.00s) === RUN TestMarkChildrenCachedClearsReadThroughMode --- PASS: TestMarkChildrenCachedClearsReadThroughMode (0.00s) === RUN TestForgetOnReleaseRunsUnderLock --- PASS: TestForgetOnReleaseRunsUnderLock (0.00s) === RUN TestMovePathWithNoSourceLeavesTheTarget --- PASS: TestMovePathWithNoSourceLeavesTheTarget (0.00s) === RUN TestLookupRecordsHardLinkNames --- PASS: TestLookupRecordsHardLinkNames (0.00s) === RUN TestRetryMetadataFlushEventuallySucceeds --- PASS: TestRetryMetadataFlushEventuallySucceeds (0.00s) === RUN TestRetryMetadataFlushReturnsLastError --- PASS: TestRetryMetadataFlushReturnsLastError (0.00s) === RUN TestRetryMetadataFlushStopsOnCancel --- PASS: TestRetryMetadataFlushStopsOnCancel (0.00s) === RUN TestRetryMetadataFlushUntilOutlastsOutage --- PASS: TestRetryMetadataFlushUntilOutlastsOutage (0.00s) === RUN TestRetryMetadataFlushUntilStopsOnRejectedError --- PASS: TestRetryMetadataFlushUntilStopsOnRejectedError (0.00s) === RUN TestRetryMetadataFlushUntilStopsOnCancel --- PASS: TestRetryMetadataFlushUntilStopsOnCancel (0.00s) === RUN TestWriterPatternSequentialAndHysteresis --- PASS: TestWriterPatternSequentialAndHysteresis (0.00s) === RUN TestWriterPatternFarFirstWriteIsRandom --- PASS: TestWriterPatternFarFirstWriteIsRandom (0.00s) === RUN TestWriterPatternToleranceAbsorbsReorder --- PASS: TestWriterPatternToleranceAbsorbsReorder (0.00s) === RUN TestWriterPatternRandomRecoveryNeedsHysteresis --- PASS: TestWriterPatternRandomRecoveryNeedsHysteresis (0.00s) === RUN TestWriterPatternFrontierNeverRegresses --- PASS: TestWriterPatternFrontierNeverRegresses (0.00s) === RUN TestWriterPatternToleranceBoundary --- PASS: TestWriterPatternToleranceBoundary (0.00s) === RUN TestWriterPatternRecoversToSequential --- PASS: TestWriterPatternRecoversToSequential (0.00s) === RUN TestResolvePeerAdvertiseAddr === RUN TestResolvePeerAdvertiseAddr/explicit_advertise_wins === RUN TestResolvePeerAdvertiseAddr/bind_host_used_verbatim === RUN TestResolvePeerAdvertiseAddr/wildcard_ipv4_bind === RUN TestResolvePeerAdvertiseAddr/empty_host_bind === RUN TestResolvePeerAdvertiseAddr/ipv6_wildcard === RUN TestResolvePeerAdvertiseAddr/unparseable_listen_errors --- PASS: TestResolvePeerAdvertiseAddr (0.02s) --- PASS: TestResolvePeerAdvertiseAddr/explicit_advertise_wins (0.00s) --- PASS: TestResolvePeerAdvertiseAddr/bind_host_used_verbatim (0.00s) --- PASS: TestResolvePeerAdvertiseAddr/wildcard_ipv4_bind (0.01s) --- PASS: TestResolvePeerAdvertiseAddr/empty_host_bind (0.00s) --- PASS: TestResolvePeerAdvertiseAddr/ipv6_wildcard (0.00s) --- PASS: TestResolvePeerAdvertiseAddr/unparseable_listen_errors (0.00s) === RUN TestIsWildcardHost --- PASS: TestIsWildcardHost (0.00s) === RUN TestPeerAnnouncer_FlushGroupsByOwner --- PASS: TestPeerAnnouncer_FlushGroupsByOwner (0.00s) === RUN TestPeerAnnouncer_SkipOwnerEqualsSelf --- PASS: TestPeerAnnouncer_SkipOwnerEqualsSelf (0.00s) === RUN TestPeerAnnouncer_RequeueOnRejection --- PASS: TestPeerAnnouncer_RequeueOnRejection (0.00s) === RUN TestPeerAnnouncer_TTLRenewal --- PASS: TestPeerAnnouncer_TTLRenewal (0.00s) === RUN TestPeerAnnouncer_ReAnnouncesOnOwnerChange --- PASS: TestPeerAnnouncer_ReAnnouncesOnOwnerChange (0.00s) === RUN TestPeerAnnouncer_DropsEvictedFids --- PASS: TestPeerAnnouncer_DropsEvictedFids (0.00s) === RUN TestPeerAnnouncer_StopWaitsForFlush --- PASS: TestPeerAnnouncer_StopWaitsForFlush (0.00s) === RUN TestPeerAnnouncer_SelfOwnedWritesToLocalDir --- PASS: TestPeerAnnouncer_SelfOwnedWritesToLocalDir (0.00s) === RUN TestPeerAnnouncer_DialerErrorRequeues --- PASS: TestPeerAnnouncer_DialerErrorRequeues (0.00s) === RUN TestPeerDirectory_AnnounceAndLookup --- PASS: TestPeerDirectory_AnnounceAndLookup (0.00s) === RUN TestPeerDirectory_OwnerRejection --- PASS: TestPeerDirectory_OwnerRejection (0.00s) === RUN TestPeerDirectory_MultipleHolders --- PASS: TestPeerDirectory_MultipleHolders (0.00s) === RUN TestPeerDirectory_RenewExtendsExpiry --- PASS: TestPeerDirectory_RenewExtendsExpiry (0.00s) === RUN TestPeerDirectory_TTLExpiry --- PASS: TestPeerDirectory_TTLExpiry (0.00s) === RUN TestPeerDirectory_Sweep --- PASS: TestPeerDirectory_Sweep (0.00s) === RUN TestPeerDirectory_LookupOrdersByRecency --- PASS: TestPeerDirectory_LookupOrdersByRecency (0.00s) === RUN TestPeerDirectory_LookupOrderAfterRenewal --- PASS: TestPeerDirectory_LookupOrderAfterRenewal (0.00s) === RUN TestPeerDirectory_StatsCountersIncrement --- PASS: TestPeerDirectory_StatsCountersIncrement (0.00s) === RUN TestPeerDirectory_LookupCapsHolderList --- PASS: TestPeerDirectory_LookupCapsHolderList (0.00s) === RUN TestFetchChunkFromPeer_Hit I1117 09:37:23.611762 peer_grpc.go:88 peer-grpc listening on 127.0.0.1:40081 --- PASS: TestFetchChunkFromPeer_Hit (0.03s) === RUN TestFetchChunkFromPeer_Base64Etag I1117 09:37:23.636986 peer_grpc.go:88 peer-grpc listening on 127.0.0.1:41709 --- PASS: TestFetchChunkFromPeer_Base64Etag (0.01s) === RUN TestFetchChunkFromPeer_EtagMismatch I1117 09:37:23.650866 peer_grpc.go:88 peer-grpc listening on 127.0.0.1:44527 --- PASS: TestFetchChunkFromPeer_EtagMismatch (0.03s) === RUN TestFetchChunkFromPeer_NotFound I1117 09:37:23.684309 peer_grpc.go:88 peer-grpc listening on 127.0.0.1:38793 --- PASS: TestFetchChunkFromPeer_NotFound (0.01s) === RUN TestSortHoldersByLocality --- PASS: TestSortHoldersByLocality (0.00s) === RUN TestSortHoldersByLocality_NoSelfLabels --- PASS: TestSortHoldersByLocality_NoSelfLabels (0.00s) === RUN TestFetchChunkFromPeer_MultiFrameChunkAssembledCorrectly I1117 09:37:23.748429 peer_grpc.go:88 peer-grpc listening on 127.0.0.1:43169 --- PASS: TestFetchChunkFromPeer_MultiFrameChunkAssembledCorrectly (0.43s) === RUN TestPeerGrpcServer_AnnounceAndLookup --- PASS: TestPeerGrpcServer_AnnounceAndLookup (0.03s) === RUN TestPeerGrpcServer_OwnerMismatch --- PASS: TestPeerGrpcServer_OwnerMismatch (0.02s) === RUN TestPeerGrpcServer_FetchChunk_StreamsHit --- PASS: TestPeerGrpcServer_FetchChunk_StreamsHit (0.53s) === RUN TestPeerGrpcServer_FetchChunk_NotFound --- PASS: TestPeerGrpcServer_FetchChunk_NotFound (0.04s) === RUN TestOwnerFor_EmptySeeds --- PASS: TestOwnerFor_EmptySeeds (0.00s) === RUN TestOwnerFor_Deterministic --- PASS: TestOwnerFor_Deterministic (0.00s) === RUN TestOwnerFor_DistributesEvenly --- PASS: TestOwnerFor_DistributesEvenly (0.16s) === RUN TestOwnerFor_MinimalShuffleOnSeedChange --- PASS: TestOwnerFor_MinimalShuffleOnSeedChange (0.20s) === RUN TestOwnerFor_TieBreakerDeterministic --- PASS: TestOwnerFor_TieBreakerDeterministic (0.00s) === RUN TestPeerRegistrar_StartPopulatesSeedsFromFiler --- PASS: TestPeerRegistrar_StartPopulatesSeedsFromFiler (0.01s) === RUN TestPeerRegistrar_HeartbeatTTLMatchesConfig --- PASS: TestPeerRegistrar_HeartbeatTTLMatchesConfig (0.00s) === RUN TestPeerRegistrar_StopIsIdempotent --- PASS: TestPeerRegistrar_StopIsIdempotent (0.00s) === RUN TestPeerRegistrar_RegisterBroadcastsToAllFilers --- PASS: TestPeerRegistrar_RegisterBroadcastsToAllFilers (0.00s) === RUN TestPeerRegistrar_ListMergesAcrossFilers --- PASS: TestPeerRegistrar_ListMergesAcrossFilers (0.00s) === RUN TestPeerRegistrar_ListMergeKeepsNewestLastSeen --- PASS: TestPeerRegistrar_ListMergeKeepsNewestLastSeen (0.00s) === RUN TestNonOverlappingLocksFromDifferentOwners --- PASS: TestNonOverlappingLocksFromDifferentOwners (0.00s) === RUN TestOverlappingReadLocksFromDifferentOwners --- PASS: TestOverlappingReadLocksFromDifferentOwners (0.00s) === RUN TestOverlappingWriteReadConflict --- PASS: TestOverlappingWriteReadConflict (0.00s) === RUN TestOverlappingWriteWriteConflict --- PASS: TestOverlappingWriteWriteConflict (0.00s) === RUN TestSameOwnerUpgradeReadToWrite --- PASS: TestSameOwnerUpgradeReadToWrite (0.00s) === RUN TestSameOwnerDowngradeWriteToRead --- PASS: TestSameOwnerDowngradeWriteToRead (0.00s) === RUN TestLockCoalescing --- PASS: TestLockCoalescing (0.00s) === RUN TestLockSplitting --- PASS: TestLockSplitting (0.00s) === RUN TestGetLkConflict --- PASS: TestGetLkConflict (0.00s) === RUN TestGetLkNoConflict --- PASS: TestGetLkNoConflict (0.00s) === RUN TestGetLkSameOwnerNoConflict --- PASS: TestGetLkSameOwnerNoConflict (0.00s) === RUN TestReleaseOwner --- PASS: TestReleaseOwner (0.00s) === RUN TestDifferentLockKindsDoNotConflict --- PASS: TestDifferentLockKindsDoNotConflict (0.00s) === RUN TestReleasePosixOwnerReleasesPosixLocksAndWakesWaiters --- PASS: TestReleasePosixOwnerReleasesPosixLocksAndWakesWaiters (0.05s) === RUN TestReleasePosixOwnerDoesNotReleaseFlockLocks --- PASS: TestReleasePosixOwnerDoesNotReleaseFlockLocks (0.00s) === RUN TestHasPosixOwnerIgnoresMissingOwnerAndFlock --- PASS: TestHasPosixOwnerIgnoresMissingOwnerAndFlock (0.00s) === RUN TestWakeEligibleWaitersKeepsInodeUntilWakeRefReleased --- PASS: TestWakeEligibleWaitersKeepsInodeUntilWakeRefReleased (0.00s) === RUN TestReleaseFlockOwnerDoesNotReleasePosixLocks --- PASS: TestReleaseFlockOwnerDoesNotReleasePosixLocks (0.00s) === RUN TestReleaseOwnerWakesWaiters --- PASS: TestReleaseOwnerWakesWaiters (0.05s) === RUN TestSetLkwBlocksAndSucceeds --- PASS: TestSetLkwBlocksAndSucceeds (0.05s) === RUN TestSetLkwCancellation --- PASS: TestSetLkwCancellation (0.05s) === RUN TestWholeFileLock --- PASS: TestWholeFileLock (0.00s) === RUN TestUnlockNoExistingLocks --- PASS: TestUnlockNoExistingLocks (0.00s) === RUN TestMultipleInodesIndependent --- PASS: TestMultipleInodesIndependent (0.00s) === RUN TestMemoryCleanup --- PASS: TestMemoryCleanup (0.00s) === RUN TestSelectiveWaking --- PASS: TestSelectiveWaking (0.15s) === RUN TestSameOwnerReplaceDifferentType --- PASS: TestSameOwnerReplaceDifferentType (0.00s) === RUN TestNonAdjacentRangesNotCoalesced --- PASS: TestNonAdjacentRangesNotCoalesced (0.00s) === RUN TestAdjacencyNoOverflowAtMaxUint64 --- PASS: TestAdjacencyNoOverflowAtMaxUint64 (0.00s) === RUN TestSetLkRetriesPastDeadInodeLocks --- PASS: TestSetLkRetriesPastDeadInodeLocks (0.00s) === RUN TestGetInodeLocksEvictsDeadEntry --- PASS: TestGetInodeLocksEvictsDeadEntry (0.00s) === RUN TestConcurrentFlockChurnPreservesMutualExclusion --- PASS: TestConcurrentFlockChurnPreservesMutualExclusion (1.73s) === RUN TestPermissionCheckPerformance === Permission Check Performance Test (WITH CACHE) === Files simulated: 10000 Checks per file: 5 Total checks: 50000 System lookups: 1 (would be 50000 without cache) Lookups eliminated: 49999 (100.0% reduction) Time elapsed: 225.118238ms Throughput: 222106 checks/sec --- PASS: TestPermissionCheckPerformance (0.23s) === RUN TestFlushMetadataWithRetryStopsOnFilerRefusal === RUN TestFlushMetadataWithRetryStopsOnFilerRefusal/response_error I1117 09:37:27.530442 leveldb_store.go:48 filer store dir: /tmp/TestFlushMetadataWithRetryStopsOnFilerRefusalresponse_error1201043001/002/meta I1117 09:37:27.530652 file_util.go:29 Folder /tmp/TestFlushMetadataWithRetryStopsOnFilerRefusalresponse_error1201043001/002/meta Permission: -rwxr-xr-x E1117 09:37:27.585934 weedfs_file_sync.go:369 fh flush create /unavailable-transport.log: CreateEntry: store write refused W1117 09:37:27.586360 weedfs_async_flush.go:154 completeAsyncFlush /unavailable-transport.log: retrying metadata flush (attempt 2/4) after 1s: fh flush create /unavailable-transport.log: CreateEntry: store write refused E1117 09:37:27.591250 weedfs_file_sync.go:369 fh flush create /unavailable-transport.log: CreateEntry: store write refused W1117 09:37:27.591673 weedfs_async_flush.go:154 completeAsyncFlush /unavailable-transport.log: retrying metadata flush (attempt 3/4) after 2s: fh flush create /unavailable-transport.log: CreateEntry: store write refused E1117 09:37:27.595946 weedfs_file_sync.go:369 fh flush create /unavailable-transport.log: CreateEntry: store write refused W1117 09:37:27.596298 weedfs_async_flush.go:154 completeAsyncFlush /unavailable-transport.log: retrying metadata flush (attempt 4/4) after 4s: fh flush create /unavailable-transport.log: CreateEntry: store write refused E1117 09:37:27.600320 weedfs_file_sync.go:369 fh flush create /unavailable-transport.log: CreateEntry: store write refused E1117 09:37:27.600703 weedfs_async_flush.go:161 completeAsyncFlush /unavailable-transport.log: metadata flush failed after 4 attempts: fh flush create /unavailable-transport.log: CreateEntry: store write refused - chunks are uploaded but NOT referenced in filer metadata; they will appear as orphans in volume.fsck === RUN TestFlushMetadataWithRetryStopsOnFilerRefusal/grpc_status I1117 09:37:27.607660 leveldb_store.go:48 filer store dir: /tmp/TestFlushMetadataWithRetryStopsOnFilerRefusalgrpc_status3175927934/002/meta I1117 09:37:27.607917 file_util.go:29 Folder /tmp/TestFlushMetadataWithRetryStopsOnFilerRefusalgrpc_status3175927934/002/meta Permission: -rwxr-xr-x E1117 09:37:27.670253 weedfs_file_sync.go:369 fh flush create /unavailable-transport.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.670634 weedfs_async_flush.go:154 completeAsyncFlush /unavailable-transport.log: retrying metadata flush (attempt 2/4) after 1s: fh flush create /unavailable-transport.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.674728 weedfs_file_sync.go:369 fh flush create /unavailable-transport.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.675088 weedfs_async_flush.go:154 completeAsyncFlush /unavailable-transport.log: retrying metadata flush (attempt 3/4) after 2s: fh flush create /unavailable-transport.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.679834 weedfs_file_sync.go:369 fh flush create /unavailable-transport.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.680215 weedfs_async_flush.go:154 completeAsyncFlush /unavailable-transport.log: retrying metadata flush (attempt 4/4) after 4s: fh flush create /unavailable-transport.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.684009 weedfs_file_sync.go:369 fh flush create /unavailable-transport.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.684407 weedfs_async_flush.go:161 completeAsyncFlush /unavailable-transport.log: metadata flush failed after 4 attempts: fh flush create /unavailable-transport.log: CreateEntry: rpc error: code = PermissionDenied desc = denied - chunks are uploaded but NOT referenced in filer metadata; they will appear as orphans in volume.fsck --- PASS: TestFlushMetadataWithRetryStopsOnFilerRefusal (0.16s) --- PASS: TestFlushMetadataWithRetryStopsOnFilerRefusal/response_error (0.08s) --- PASS: TestFlushMetadataWithRetryStopsOnFilerRefusal/grpc_status (0.08s) === RUN TestAbandonedWritebackFlushFencesInode I1117 09:37:27.690532 leveldb_store.go:48 filer store dir: /tmp/TestAbandonedWritebackFlushFencesInode2886321848/002/meta I1117 09:37:27.690730 file_util.go:29 Folder /tmp/TestAbandonedWritebackFlushFencesInode2886321848/002/meta Permission: -rwxr-xr-x E1117 09:37:27.747747 weedfs_file_sync.go:369 fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.748253 weedfs_async_flush.go:154 completeAsyncFlush /abandoned-writeback.log: retrying metadata flush (attempt 2/4) after 1s: fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.752729 weedfs_file_sync.go:369 fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.753053 weedfs_async_flush.go:154 completeAsyncFlush /abandoned-writeback.log: retrying metadata flush (attempt 3/4) after 2s: fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.757261 weedfs_file_sync.go:369 fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.757593 weedfs_async_flush.go:154 completeAsyncFlush /abandoned-writeback.log: retrying metadata flush (attempt 4/4) after 4s: fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.761834 weedfs_file_sync.go:369 fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.762198 weedfs_async_flush.go:161 completeAsyncFlush /abandoned-writeback.log: metadata flush failed after 4 attempts: fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied - chunks are uploaded but NOT referenced in filer metadata; they will appear as orphans in volume.fsck I1117 09:37:27.764313 leveldb_store.go:48 filer store dir: /tmp/TestAbandonedWritebackFlushFencesInode2886321848/004/meta I1117 09:37:27.764531 file_util.go:29 Folder /tmp/TestAbandonedWritebackFlushFencesInode2886321848/004/meta Permission: -rwxr-xr-x E1117 09:37:27.802562 weedfs_file_sync.go:369 fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.802934 weedfs_async_flush.go:154 completeAsyncFlush /abandoned-writeback.log: retrying metadata flush (attempt 2/4) after 1s: fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.807403 weedfs_file_sync.go:369 fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.807768 weedfs_async_flush.go:154 completeAsyncFlush /abandoned-writeback.log: retrying metadata flush (attempt 3/4) after 2s: fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.811634 weedfs_file_sync.go:369 fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.811954 weedfs_async_flush.go:154 completeAsyncFlush /abandoned-writeback.log: retrying metadata flush (attempt 4/4) after 4s: fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.815731 weedfs_file_sync.go:369 fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.816073 weedfs_async_flush.go:161 completeAsyncFlush /abandoned-writeback.log: metadata flush failed after 4 attempts: fh flush create /abandoned-writeback.log: CreateEntry: rpc error: code = PermissionDenied desc = denied - chunks are uploaded but NOT referenced in filer metadata; they will appear as orphans in volume.fsck --- PASS: TestAbandonedWritebackFlushFencesInode (0.13s) === RUN TestFailedFlockReleaseFencesInode === RUN TestFailedFlockReleaseFencesInode/content I1117 09:37:27.825258 leveldb_store.go:48 filer store dir: /tmp/TestFailedFlockReleaseFencesInodecontent1979192286/002/meta I1117 09:37:27.825463 file_util.go:29 Folder /tmp/TestFailedFlockReleaseFencesInodecontent1979192286/002/meta Permission: -rwxr-xr-x E1117 09:37:27.883826 weedfs_file_sync.go:369 fh flush create /flock-release.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.884418 weedfs_file_sync.go:237 /flock-release.log fh 8962717989180077218 flush: fh flush create /flock-release.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.884779 weedfs_file_io.go:166 release fh 8962717989180077218 inode 7204169071335245331: fallback flush failed: 13=permission denied === RUN TestFailedFlockReleaseFencesInode/metadata_only I1117 09:37:27.891631 leveldb_store.go:48 filer store dir: /tmp/TestFailedFlockReleaseFencesInodemetadata_only2273035306/002/meta I1117 09:37:27.891873 file_util.go:29 Folder /tmp/TestFailedFlockReleaseFencesInodemetadata_only2273035306/002/meta Permission: -rwxr-xr-x E1117 09:37:27.950539 weedfs_file_sync.go:369 fh flush create /flock-release.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.951078 weedfs_file_sync.go:237 /flock-release.log fh 15261321108643768500 flush: fh flush create /flock-release.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.951312 weedfs_file_io.go:166 release fh 15261321108643768500 inode 7204169071335245331: fallback flush failed: 13=permission denied === RUN TestFailedFlockReleaseFencesInode/truncate I1117 09:37:27.957473 leveldb_store.go:48 filer store dir: /tmp/TestFailedFlockReleaseFencesInodetruncate329698112/002/meta I1117 09:37:27.957662 file_util.go:29 Folder /tmp/TestFailedFlockReleaseFencesInodetruncate329698112/002/meta Permission: -rwxr-xr-x E1117 09:37:27.993990 weedfs_file_sync.go:369 fh flush create /flock-release.log: CreateEntry: rpc error: code = PermissionDenied desc = denied E1117 09:37:27.994517 weedfs_file_sync.go:237 /flock-release.log fh 4909835449752367183 flush: fh flush create /flock-release.log: CreateEntry: rpc error: code = PermissionDenied desc = denied W1117 09:37:27.994763 weedfs_file_io.go:166 release fh 4909835449752367183 inode 7204169071335245331: fallback flush failed: 13=permission denied --- PASS: TestFailedFlockReleaseFencesInode (0.18s) --- PASS: TestFailedFlockReleaseFencesInode/content (0.07s) --- PASS: TestFailedFlockReleaseFencesInode/metadata_only (0.07s) --- PASS: TestFailedFlockReleaseFencesInode/truncate (0.04s) === RUN TestReleaseFencesBeforeReopenSeesInode I1117 09:37:28.001013 leveldb_store.go:48 filer store dir: /tmp/TestReleaseFencesBeforeReopenSeesInode3367757410/002/meta I1117 09:37:28.001249 file_util.go:29 Folder /tmp/TestReleaseFencesBeforeReopenSeesInode3367757410/002/meta Permission: -rwxr-xr-x --- PASS: TestReleaseFencesBeforeReopenSeesInode (0.05s) === RUN TestIsFilerUnreachable --- PASS: TestIsFilerUnreachable (0.00s) === RUN TestAttributeOnlyConflictOutcomes === RUN TestAttributeOnlyConflictOutcomes/bounded I1117 09:37:28.054432 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyConflictOutcomesbounded422581880/001/meta I1117 09:37:28.054631 file_util.go:29 Folder /tmp/TestAttributeOnlyConflictOutcomesbounded422581880/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyConflictOutcomes/replacement I1117 09:37:28.275084 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyConflictOutcomesreplacement2580051429/001/meta I1117 09:37:28.275305 file_util.go:29 Folder /tmp/TestAttributeOnlyConflictOutcomesreplacement2580051429/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyConflictOutcomes/deleted I1117 09:37:28.355664 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyConflictOutcomesdeleted1785538353/001/meta I1117 09:37:28.355903 file_util.go:29 Folder /tmp/TestAttributeOnlyConflictOutcomesdeleted1785538353/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyConflictOutcomes/create-existing I1117 09:37:28.397950 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyConflictOutcomescreate-existing425668855/001/meta I1117 09:37:28.398150 file_util.go:29 Folder /tmp/TestAttributeOnlyConflictOutcomescreate-existing425668855/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyConflictOutcomes/replace-removed I1117 09:37:28.482519 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyConflictOutcomesreplace-removed2129707119/001/meta I1117 09:37:28.482723 file_util.go:29 Folder /tmp/TestAttributeOnlyConflictOutcomesreplace-removed2129707119/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyConflictOutcomes/permission I1117 09:37:28.576001 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyConflictOutcomespermission395645253/001/meta I1117 09:37:28.576218 file_util.go:29 Folder /tmp/TestAttributeOnlyConflictOutcomespermission395645253/001/meta Permission: -rwxr-xr-x --- PASS: TestAttributeOnlyConflictOutcomes (0.58s) --- PASS: TestAttributeOnlyConflictOutcomes/bounded (0.22s) --- PASS: TestAttributeOnlyConflictOutcomes/replacement (0.08s) --- PASS: TestAttributeOnlyConflictOutcomes/deleted (0.04s) --- PASS: TestAttributeOnlyConflictOutcomes/create-existing (0.08s) --- PASS: TestAttributeOnlyConflictOutcomes/replace-removed (0.09s) --- PASS: TestAttributeOnlyConflictOutcomes/permission (0.06s) === RUN TestAppendFlushAfterPeerAttributeChange === RUN TestAppendFlushAfterPeerAttributeChange/none I1117 09:37:28.639864 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangenone1675360977/001/meta I1117 09:37:28.640067 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangenone1675360977/001/meta Permission: -rwxr-xr-x I1117 09:37:28.687236 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangenone1675360977/002/meta I1117 09:37:28.687439 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangenone1675360977/002/meta Permission: -rwxr-xr-x === RUN TestAppendFlushAfterPeerAttributeChange/chmod I1117 09:37:28.757242 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangechmod3463206721/001/meta I1117 09:37:28.757451 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangechmod3463206721/001/meta Permission: -rwxr-xr-x I1117 09:37:28.807323 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangechmod3463206721/002/meta I1117 09:37:28.807521 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangechmod3463206721/002/meta Permission: -rwxr-xr-x === RUN TestAppendFlushAfterPeerAttributeChange/chown I1117 09:37:28.905455 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangechown3350982449/001/meta I1117 09:37:28.905660 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangechown3350982449/001/meta Permission: -rwxr-xr-x I1117 09:37:28.960635 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangechown3350982449/002/meta I1117 09:37:28.960888 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangechown3350982449/002/meta Permission: -rwxr-xr-x === RUN TestAppendFlushAfterPeerAttributeChange/utimes I1117 09:37:29.064020 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangeutimes3079927020/001/meta I1117 09:37:29.064278 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangeutimes3079927020/001/meta Permission: -rwxr-xr-x I1117 09:37:29.114974 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangeutimes3079927020/002/meta I1117 09:37:29.115177 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangeutimes3079927020/002/meta Permission: -rwxr-xr-x === RUN TestAppendFlushAfterPeerAttributeChange/setxattr I1117 09:37:29.211787 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangesetxattr4156991685/001/meta I1117 09:37:29.211994 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangesetxattr4156991685/001/meta Permission: -rwxr-xr-x I1117 09:37:29.263433 leveldb_store.go:48 filer store dir: /tmp/TestAppendFlushAfterPeerAttributeChangesetxattr4156991685/002/meta I1117 09:37:29.263633 file_util.go:29 Folder /tmp/TestAppendFlushAfterPeerAttributeChangesetxattr4156991685/002/meta Permission: -rwxr-xr-x --- PASS: TestAppendFlushAfterPeerAttributeChange (0.72s) --- PASS: TestAppendFlushAfterPeerAttributeChange/none (0.12s) --- PASS: TestAppendFlushAfterPeerAttributeChange/chmod (0.15s) --- PASS: TestAppendFlushAfterPeerAttributeChange/chown (0.16s) --- PASS: TestAppendFlushAfterPeerAttributeChange/utimes (0.15s) --- PASS: TestAppendFlushAfterPeerAttributeChange/setxattr (0.15s) === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/chmod/stale=false/open=false I1117 09:37:29.361296 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschmodstale=fals539709132/001/meta I1117 09:37:29.361503 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschmodstale=fals539709132/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/chmod/stale=false/open=true I1117 09:37:29.624743 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschmodstale=fals4280381418/001/meta I1117 09:37:29.624959 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschmodstale=fals4280381418/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/chmod/stale=true/open=false I1117 09:37:29.856570 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschmodstale=true269561185/001/meta I1117 09:37:29.856781 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschmodstale=true269561185/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/chmod/stale=true/open=true I1117 09:37:30.014512 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschmodstale=true2961307637/001/meta I1117 09:37:30.014724 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschmodstale=true2961307637/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/chown/stale=false/open=false I1117 09:37:30.204225 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschownstale=fals3149532884/001/meta I1117 09:37:30.204471 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschownstale=fals3149532884/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/chown/stale=false/open=true I1117 09:37:30.444041 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschownstale=fals2601655514/001/meta I1117 09:37:30.444251 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschownstale=fals2601655514/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/chown/stale=true/open=false I1117 09:37:30.649253 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschownstale=true701359287/001/meta I1117 09:37:30.649464 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschownstale=true701359287/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/chown/stale=true/open=true I1117 09:37:30.809632 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschownstale=true929881270/001/meta I1117 09:37:30.809867 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendschownstale=true929881270/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/utimes/stale=false/open=false I1117 09:37:30.990968 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsutimesstale=fal3516844956/001/meta I1117 09:37:30.991182 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsutimesstale=fal3516844956/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/utimes/stale=false/open=true I1117 09:37:31.234249 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsutimesstale=fal2766881968/001/meta I1117 09:37:31.234457 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsutimesstale=fal2766881968/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/utimes/stale=true/open=false I1117 09:37:31.444710 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsutimesstale=tru3468560720/001/meta I1117 09:37:31.444947 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsutimesstale=tru3468560720/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/utimes/stale=true/open=true I1117 09:37:31.606680 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsutimesstale=tru1502872229/001/meta I1117 09:37:31.606891 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsutimesstale=tru1502872229/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/setxattr/stale=false/open=false I1117 09:37:31.788275 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendssetxattrstale=f1825361780/001/meta I1117 09:37:31.788510 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendssetxattrstale=f1825361780/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/setxattr/stale=false/open=true I1117 09:37:32.027539 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendssetxattrstale=f2840305988/001/meta I1117 09:37:32.027759 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendssetxattrstale=f2840305988/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/setxattr/stale=true/open=false I1117 09:37:32.231606 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendssetxattrstale=t1293748819/001/meta I1117 09:37:32.231816 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendssetxattrstale=t1293748819/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/setxattr/stale=true/open=true I1117 09:37:32.392319 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendssetxattrstale=t4185586162/001/meta I1117 09:37:32.392533 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendssetxattrstale=t4185586162/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/removexattr/stale=false/open=false I1117 09:37:32.564450 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsremovexattrstal1172914611/001/meta I1117 09:37:32.564655 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsremovexattrstal1172914611/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/removexattr/stale=false/open=true I1117 09:37:32.802428 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsremovexattrstal3705079458/001/meta I1117 09:37:32.802630 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsremovexattrstal3705079458/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/removexattr/stale=true/open=false I1117 09:37:33.009332 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsremovexattrstal3440082091/001/meta I1117 09:37:33.009541 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsremovexattrstal3440082091/001/meta Permission: -rwxr-xr-x === RUN TestAttributeOnlyOpsPreserveAcknowledgedAppends/removexattr/stale=true/open=true I1117 09:37:33.173357 leveldb_store.go:48 filer store dir: /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsremovexattrstal3078720690/001/meta I1117 09:37:33.173561 file_util.go:29 Folder /tmp/TestAttributeOnlyOpsPreserveAcknowledgedAppendsremovexattrstal3078720690/001/meta Permission: -rwxr-xr-x --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends (3.99s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/chmod/stale=false/open=false (0.26s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/chmod/stale=false/open=true (0.23s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/chmod/stale=true/open=false (0.16s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/chmod/stale=true/open=true (0.19s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/chown/stale=false/open=false (0.24s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/chown/stale=false/open=true (0.20s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/chown/stale=true/open=false (0.16s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/chown/stale=true/open=true (0.18s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/utimes/stale=false/open=false (0.24s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/utimes/stale=false/open=true (0.21s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/utimes/stale=true/open=false (0.16s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/utimes/stale=true/open=true (0.18s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/setxattr/stale=false/open=false (0.24s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/setxattr/stale=false/open=true (0.20s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/setxattr/stale=true/open=false (0.16s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/setxattr/stale=true/open=true (0.17s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/removexattr/stale=false/open=false (0.24s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/removexattr/stale=false/open=true (0.21s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/removexattr/stale=true/open=false (0.16s) --- PASS: TestAttributeOnlyOpsPreserveAcknowledgedAppends/removexattr/stale=true/open=true (0.18s) === RUN TestAcknowledgedAttributeSurvivesWriteDuringRPC === RUN TestAcknowledgedAttributeSurvivesWriteDuringRPC/chmod I1117 09:37:33.350801 leveldb_store.go:48 filer store dir: /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCchmod1029340339/001/meta I1117 09:37:33.351008 file_util.go:29 Folder /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCchmod1029340339/001/meta Permission: -rwxr-xr-x === RUN TestAcknowledgedAttributeSurvivesWriteDuringRPC/chown I1117 09:37:33.423021 leveldb_store.go:48 filer store dir: /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCchown2304103211/001/meta I1117 09:37:33.423238 file_util.go:29 Folder /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCchown2304103211/001/meta Permission: -rwxr-xr-x === RUN TestAcknowledgedAttributeSurvivesWriteDuringRPC/utimes I1117 09:37:33.500387 leveldb_store.go:48 filer store dir: /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCutimes3970937700/001/meta I1117 09:37:33.500595 file_util.go:29 Folder /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCutimes3970937700/001/meta Permission: -rwxr-xr-x === RUN TestAcknowledgedAttributeSurvivesWriteDuringRPC/setxattr I1117 09:37:33.569506 leveldb_store.go:48 filer store dir: /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCsetxattr3475994555/001/meta I1117 09:37:33.569737 file_util.go:29 Folder /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCsetxattr3475994555/001/meta Permission: -rwxr-xr-x === RUN TestAcknowledgedAttributeSurvivesWriteDuringRPC/removexattr I1117 09:37:33.644995 leveldb_store.go:48 filer store dir: /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCremovexattr482911405/001/meta I1117 09:37:33.645203 file_util.go:29 Folder /tmp/TestAcknowledgedAttributeSurvivesWriteDuringRPCremovexattr482911405/001/meta Permission: -rwxr-xr-x --- PASS: TestAcknowledgedAttributeSurvivesWriteDuringRPC (0.36s) --- PASS: TestAcknowledgedAttributeSurvivesWriteDuringRPC/chmod (0.07s) --- PASS: TestAcknowledgedAttributeSurvivesWriteDuringRPC/chown (0.08s) --- PASS: TestAcknowledgedAttributeSurvivesWriteDuringRPC/utimes (0.07s) --- PASS: TestAcknowledgedAttributeSurvivesWriteDuringRPC/setxattr (0.07s) --- PASS: TestAcknowledgedAttributeSurvivesWriteDuringRPC/removexattr (0.07s) === RUN TestAttributePublicationBeforeResponse === RUN TestAttributePublicationBeforeResponse/response/chmod I1117 09:37:33.714140 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseresponsechmod1007055940/001/meta I1117 09:37:33.714345 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseresponsechmod1007055940/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/response/chown I1117 09:37:33.965449 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseresponsechown3742926102/001/meta I1117 09:37:33.965659 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseresponsechown3742926102/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/response/utimes I1117 09:37:34.235063 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseresponseutimes411561470/001/meta I1117 09:37:34.235362 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseresponseutimes411561470/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/response/setxattr I1117 09:37:34.416295 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseresponsesetxattr2245632638/001/meta I1117 09:37:34.416566 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseresponsesetxattr2245632638/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/response/removexattr I1117 09:37:34.670526 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseresponseremovexattr2228561200/001/meta I1117 09:37:34.670779 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseresponseremovexattr2228561200/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/installation/chmod I1117 09:37:34.967291 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseinstallationchmod1324517520/001/meta I1117 09:37:34.967504 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseinstallationchmod1324517520/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/installation/chown I1117 09:37:35.303930 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseinstallationchown3819831442/001/meta I1117 09:37:35.304135 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseinstallationchown3819831442/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/installation/utimes I1117 09:37:35.889667 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseinstallationutimes1389707078/001/meta I1117 09:37:35.889929 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseinstallationutimes1389707078/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/installation/setxattr I1117 09:37:36.289879 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseinstallationsetxattr3954441438/001/meta I1117 09:37:36.290147 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseinstallationsetxattr3954441438/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/installation/removexattr I1117 09:37:36.699530 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseinstallationremovexattr1865237452/001/meta I1117 09:37:36.699735 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseinstallationremovexattr1865237452/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/retention/chmod I1117 09:37:37.047479 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseretentionchmod2828974219/001/meta I1117 09:37:37.047701 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseretentionchmod2828974219/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/retention/chown I1117 09:37:37.573026 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseretentionchown301914032/001/meta I1117 09:37:37.573244 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseretentionchown301914032/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/retention/utimes I1117 09:37:38.026741 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseretentionutimes2536759451/001/meta I1117 09:37:38.026956 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseretentionutimes2536759451/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/retention/setxattr I1117 09:37:38.471120 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseretentionsetxattr2004471382/001/meta I1117 09:37:38.471333 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseretentionsetxattr2004471382/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate === RUN TestAttributePublicationBeforeResponse/retention/removexattr I1117 09:37:38.980349 leveldb_store.go:48 filer store dir: /tmp/TestAttributePublicationBeforeResponseretentionremovexattr3654067691/001/meta I1117 09:37:38.980570 file_util.go:29 Folder /tmp/TestAttributePublicationBeforeResponseretentionremovexattr3654067691/001/meta Permission: -rwxr-xr-x weedfs_attr_cas_test.go:535: flush arrived and is blocked at publication before opening gate weedfs_attr_cas_test.go:554: flush arrived and is blocked at publication before opening gate --- PASS: TestAttributePublicationBeforeResponse (5.73s) --- PASS: TestAttributePublicationBeforeResponse/response/chmod (0.25s) --- PASS: TestAttributePublicationBeforeResponse/response/chown (0.27s) --- PASS: TestAttributePublicationBeforeResponse/response/utimes (0.18s) --- PASS: TestAttributePublicationBeforeResponse/response/setxattr (0.25s) --- PASS: TestAttributePublicationBeforeResponse/response/removexattr (0.30s) --- PASS: TestAttributePublicationBeforeResponse/installation/chmod (0.34s) --- PASS: TestAttributePublicationBeforeResponse/installation/chown (0.58s) --- PASS: TestAttributePublicationBeforeResponse/installation/utimes (0.40s) --- PASS: TestAttributePublicationBeforeResponse/installation/setxattr (0.41s) --- PASS: TestAttributePublicationBeforeResponse/installation/removexattr (0.35s) --- PASS: TestAttributePublicationBeforeResponse/retention/chmod (0.53s) --- PASS: TestAttributePublicationBeforeResponse/retention/chown (0.45s) --- PASS: TestAttributePublicationBeforeResponse/retention/utimes (0.44s) --- PASS: TestAttributePublicationBeforeResponse/retention/setxattr (0.51s) --- PASS: TestAttributePublicationBeforeResponse/retention/removexattr (0.46s) === RUN TestAttributeSaveSurvivesInterrupt === RUN TestAttributeSaveSurvivesInterrupt/chmod I1117 09:37:39.442842 leveldb_store.go:48 filer store dir: /tmp/TestAttributeSaveSurvivesInterruptchmod992139306/001/meta I1117 09:37:39.443047 file_util.go:29 Folder /tmp/TestAttributeSaveSurvivesInterruptchmod992139306/001/meta Permission: -rwxr-xr-x === RUN TestAttributeSaveSurvivesInterrupt/setxattr I1117 09:37:39.918882 leveldb_store.go:48 filer store dir: /tmp/TestAttributeSaveSurvivesInterruptsetxattr939687356/001/meta I1117 09:37:39.919130 file_util.go:29 Folder /tmp/TestAttributeSaveSurvivesInterruptsetxattr939687356/001/meta Permission: -rwxr-xr-x --- PASS: TestAttributeSaveSurvivesInterrupt (0.93s) --- PASS: TestAttributeSaveSurvivesInterrupt/chmod (0.48s) --- PASS: TestAttributeSaveSurvivesInterrupt/setxattr (0.46s) === RUN TestAttributeSaveKeepsCollidingFilerIds === RUN TestAttributeSaveKeepsCollidingFilerIds/chmod I1117 09:37:40.377852 leveldb_store.go:48 filer store dir: /tmp/TestAttributeSaveKeepsCollidingFilerIdschmod839249259/001/meta I1117 09:37:40.378058 file_util.go:29 Folder /tmp/TestAttributeSaveKeepsCollidingFilerIdschmod839249259/001/meta Permission: -rwxr-xr-x === RUN TestAttributeSaveKeepsCollidingFilerIds/setxattr I1117 09:37:40.455971 leveldb_store.go:48 filer store dir: /tmp/TestAttributeSaveKeepsCollidingFilerIdssetxattr1281894233/001/meta I1117 09:37:40.456177 file_util.go:29 Folder /tmp/TestAttributeSaveKeepsCollidingFilerIdssetxattr1281894233/001/meta Permission: -rwxr-xr-x --- PASS: TestAttributeSaveKeepsCollidingFilerIds (0.13s) --- PASS: TestAttributeSaveKeepsCollidingFilerIds/chmod (0.08s) --- PASS: TestAttributeSaveKeepsCollidingFilerIds/setxattr (0.05s) === RUN TestAttributeRetryReadsOwnerFiler I1117 09:37:40.509477 leveldb_store.go:48 filer store dir: /tmp/TestAttributeRetryReadsOwnerFiler3294026965/001/meta I1117 09:37:40.509678 file_util.go:29 Folder /tmp/TestAttributeRetryReadsOwnerFiler3294026965/001/meta Permission: -rwxr-xr-x --- PASS: TestAttributeRetryReadsOwnerFiler (0.18s) === RUN TestTouchDirMtimeCtimeLeavesTheMountRootOnTheFiler I1117 09:37:40.687279 leveldb_store.go:48 filer store dir: /tmp/TestTouchDirMtimeCtimeLeavesTheMountRootOnTheFiler2915067170/001/meta I1117 09:37:40.687498 file_util.go:29 Folder /tmp/TestTouchDirMtimeCtimeLeavesTheMountRootOnTheFiler2915067170/001/meta Permission: -rwxr-xr-x --- PASS: TestTouchDirMtimeCtimeLeavesTheMountRootOnTheFiler (0.07s) === RUN TestSetAttrChargesTheGrowth --- PASS: TestSetAttrChargesTheGrowth (0.00s) === RUN TestAttrChunkRace --- PASS: TestAttrChunkRace (0.29s) === RUN TestReadFromChunksRace --- PASS: TestReadFromChunksRace (0.26s) === RUN TestSetAttrOnUnlinkedOpenFile --- PASS: TestSetAttrOnUnlinkedOpenFile (0.00s) === RUN TestGetAttrOnUnlinkedOpenFile --- PASS: TestGetAttrOnUnlinkedOpenFile (0.00s) === RUN TestXAttrOnUnlinkedOpenFile --- PASS: TestXAttrOnUnlinkedOpenFile (0.00s) === RUN TestSetAttrOnRemovedOpenDir --- PASS: TestSetAttrOnRemovedOpenDir (0.00s) === RUN TestXAttrOnRemovedOpenDir --- PASS: TestXAttrOnRemovedOpenDir (0.00s) === RUN TestForgetReleasesRemovedOpenDir --- PASS: TestForgetReleasesRemovedOpenDir (0.00s) === RUN TestRemovePathSkipsUnreferencedInode --- PASS: TestRemovePathSkipsUnreferencedInode (0.00s) === RUN TestLookupRebuildsExpiredDirectoryCache I1117 09:37:41.328837 leveldb_store.go:48 filer store dir: /tmp/TestLookupRebuildsExpiredDirectoryCache1342139659/001/meta I1117 09:37:41.329071 file_util.go:29 Folder /tmp/TestLookupRebuildsExpiredDirectoryCache1342139659/001/meta Permission: -rwxr-xr-x --- PASS: TestLookupRebuildsExpiredDirectoryCache (0.10s) === RUN TestLookupRebuildDeduplicatesConcurrentRebuilds I1117 09:37:41.427309 leveldb_store.go:48 filer store dir: /tmp/TestLookupRebuildDeduplicatesConcurrentRebuilds3051989042/001/meta I1117 09:37:41.427502 file_util.go:29 Folder /tmp/TestLookupRebuildDeduplicatesConcurrentRebuilds3051989042/001/meta Permission: -rwxr-xr-x --- PASS: TestLookupRebuildDeduplicatesConcurrentRebuilds (0.13s) === RUN TestLookupRebuildCooldownAfterFailure I1117 09:37:41.554365 leveldb_store.go:48 filer store dir: /tmp/TestLookupRebuildCooldownAfterFailure3967311806/001/meta I1117 09:37:41.554568 file_util.go:29 Folder /tmp/TestLookupRebuildCooldownAfterFailure3967311806/001/meta Permission: -rwxr-xr-x --- PASS: TestLookupRebuildCooldownAfterFailure (0.08s) === RUN TestLookupRebuildsInvalidatedDirectoryCache I1117 09:37:41.636407 leveldb_store.go:48 filer store dir: /tmp/TestLookupRebuildsInvalidatedDirectoryCache435956816/001/meta I1117 09:37:41.636617 file_util.go:29 Folder /tmp/TestLookupRebuildsInvalidatedDirectoryCache435956816/001/meta Permission: -rwxr-xr-x --- PASS: TestLookupRebuildsInvalidatedDirectoryCache (0.08s) === RUN TestLookupNeverCachedDirReadsThrough I1117 09:37:41.719966 leveldb_store.go:48 filer store dir: /tmp/TestLookupNeverCachedDirReadsThrough2855877501/001/meta I1117 09:37:41.720213 file_util.go:29 Folder /tmp/TestLookupNeverCachedDirReadsThrough2855877501/001/meta Permission: -rwxr-xr-x --- PASS: TestLookupNeverCachedDirReadsThrough (0.07s) === RUN TestForgetKeepsDirRebuildable --- PASS: TestForgetKeepsDirRebuildable (0.00s) === RUN TestReusedPathKeepsRebuildRecord --- PASS: TestReusedPathKeepsRebuildRecord (0.23s) === RUN TestLookupRefreshesStaleSection I1117 09:37:42.015260 leveldb_store.go:48 filer store dir: /tmp/TestLookupRefreshesStaleSection3475931715/001/meta I1117 09:37:42.015481 file_util.go:29 Folder /tmp/TestLookupRefreshesStaleSection3475931715/001/meta Permission: -rwxr-xr-x --- PASS: TestLookupRefreshesStaleSection (0.15s) === RUN TestOpenDirEnablesKernelListingCache I1117 09:37:42.169364 leveldb_store.go:48 filer store dir: /tmp/TestOpenDirEnablesKernelListingCache3387145762/001/meta I1117 09:37:42.169565 file_util.go:29 Folder /tmp/TestOpenDirEnablesKernelListingCache3387145762/001/meta Permission: -rwxr-xr-x --- PASS: TestOpenDirEnablesKernelListingCache (0.05s) === RUN TestListDirectoryEntriesOmitsChunks I1117 09:37:42.219133 leveldb_store.go:48 filer store dir: /tmp/TestListDirectoryEntriesOmitsChunks3199582514/001/meta I1117 09:37:42.219327 file_util.go:29 Folder /tmp/TestListDirectoryEntriesOmitsChunks3199582514/001/meta Permission: -rwxr-xr-x === RUN TestListDirectoryEntriesOmitsChunks/plain_listing_keeps_chunks === RUN TestListDirectoryEntriesOmitsChunks/marked_listing_drops_chunks --- PASS: TestListDirectoryEntriesOmitsChunks (0.03s) --- PASS: TestListDirectoryEntriesOmitsChunks/plain_listing_keeps_chunks (0.01s) --- PASS: TestListDirectoryEntriesOmitsChunks/marked_listing_drops_chunks (0.00s) === RUN TestReadDirResumePastShrunkDirectory I1117 09:37:42.254238 leveldb_store.go:48 filer store dir: /tmp/TestReadDirResumePastShrunkDirectory345777311/001/meta I1117 09:37:42.254425 file_util.go:29 Folder /tmp/TestReadDirResumePastShrunkDirectory345777311/001/meta Permission: -rwxr-xr-x --- PASS: TestReadDirResumePastShrunkDirectory (0.09s) === RUN TestReadDirWithExpiredEntries I1117 09:37:42.355437 leveldb_store.go:48 filer store dir: /tmp/TestReadDirWithExpiredEntries3061947553/001/meta I1117 09:37:42.355637 file_util.go:29 Folder /tmp/TestReadDirWithExpiredEntries3061947553/001/meta Permission: -rwxr-xr-x --- PASS: TestReadDirWithExpiredEntries (0.56s) === RUN TestReadDirTrimsConsumedEntries I1117 09:37:42.945123 leveldb_store.go:48 filer store dir: /tmp/TestReadDirTrimsConsumedEntries3645939284/001/meta I1117 09:37:42.945356 file_util.go:29 Folder /tmp/TestReadDirTrimsConsumedEntries3645939284/001/meta Permission: -rwxr-xr-x --- PASS: TestReadDirTrimsConsumedEntries (2.69s) === RUN TestReadDirDirectTrimsConsumedEntries I1117 09:37:45.630933 leveldb_store.go:48 filer store dir: /tmp/TestReadDirDirectTrimsConsumedEntries283495761/001/meta I1117 09:37:45.631298 file_util.go:29 Folder /tmp/TestReadDirDirectTrimsConsumedEntries283495761/001/meta Permission: -rwxr-xr-x --- PASS: TestReadDirDirectTrimsConsumedEntries (7.59s) === RUN TestReadDirPlusSanitizedName I1117 09:37:53.185112 leveldb_store.go:48 filer store dir: /tmp/TestReadDirPlusSanitizedName3886507663/001/meta I1117 09:37:53.185317 file_util.go:29 Folder /tmp/TestReadDirPlusSanitizedName3886507663/001/meta Permission: -rwxr-xr-x --- PASS: TestReadDirPlusSanitizedName (0.02s) === RUN TestLoadDirectoryEntriesDirectFiltersHiddenEntriesAndMapsIds --- PASS: TestLoadDirectoryEntriesDirectFiltersHiddenEntriesAndMapsIds (0.00s) === RUN TestLoadDirectoryEntriesDirectShowsSystemEntriesWhenEnabled --- PASS: TestLoadDirectoryEntriesDirectShowsSystemEntriesWhenEnabled (0.00s) === RUN TestDirReadStatus E1117 09:37:53.206135 weedfs_dir_read.go:427 dir read: filer broke --- PASS: TestDirReadStatus (0.00s) === RUN TestWholeFileServerCopyCandidate --- PASS: TestWholeFileServerCopyCandidate (0.00s) === RUN TestCopyFileRangeUsesServerSideWholeFileCopy --- PASS: TestCopyFileRangeUsesServerSideWholeFileCopy (0.00s) === RUN TestCopyFileRangeDoesNotFallbackAfterCommittedServerCopyRefreshFailure I1117 09:37:53.213894 leveldb_store.go:48 filer store dir: /tmp/TestCopyFileRangeDoesNotFallbackAfterCommittedServerCopyRefreshF3276563340/001/meta I1117 09:37:53.214088 file_util.go:29 Folder /tmp/TestCopyFileRangeDoesNotFallbackAfterCommittedServerCopyRefreshF3276563340/001/meta Permission: -rwxr-xr-x W1117 09:37:53.271707 weedfs_file_copy_range.go:233 CopyFileRange server-side copy /src.txt => /dst.txt committed but local refresh failed: reload copied entry: transient filer read failure --- PASS: TestCopyFileRangeDoesNotFallbackAfterCommittedServerCopyRefreshFailure (0.06s) === RUN TestCopyFileRangeReturnsEIOForAmbiguousServerSideCopy W1117 09:37:53.280313 weedfs_file_copy_range.go:240 CopyFileRange server-side copy /src.txt => /dst.txt outcome ambiguous: transport timeout after request dispatch --- PASS: TestCopyFileRangeReturnsEIOForAmbiguousServerSideCopy (0.00s) === RUN TestStreamingCopyMarksOnlyAcceptedContentDirty === RUN TestStreamingCopyMarksOnlyAcceptedContentDirty/accepted === RUN TestStreamingCopyMarksOnlyAcceptedContentDirty/rejected_first_page E1117 09:37:53.288970 weedfs_file_copy_range.go:194 AddPage error: swap file unavailable --- PASS: TestStreamingCopyMarksOnlyAcceptedContentDirty (0.01s) --- PASS: TestStreamingCopyMarksOnlyAcceptedContentDirty/accepted (0.01s) --- PASS: TestStreamingCopyMarksOnlyAcceptedContentDirty/rejected_first_page (0.00s) === RUN TestStreamingCopyReportsPartlyBufferedCopy E1117 09:37:53.292349 page_chunk_swapfile.go:72 create swap file in /tmp/TestStreamingCopyReportsPartlyBufferedCopy1283444660/001/file/swap: open /tmp/TestStreamingCopyReportsPartlyBufferedCopy1283444660/001/file/swap/646704851: not a directory E1117 09:37:53.293033 weedfs_file_copy_range.go:194 AddPage error: failed to create swap file chunk --- PASS: TestStreamingCopyReportsPartlyBufferedCopy (0.00s) === RUN TestServerSideCopySkipsFencedDestination --- PASS: TestServerSideCopySkipsFencedDestination (0.00s) === RUN TestFallocateWithinFile --- PASS: TestFallocateWithinFile (0.00s) === RUN TestFallocateGrowsFile --- PASS: TestFallocateGrowsFile (0.00s) === RUN TestFallocateKeepSize --- PASS: TestFallocateKeepSize (0.00s) === RUN TestFallocateUnsupportedMode --- PASS: TestFallocateUnsupportedMode (0.00s) === RUN TestFallocateUnknownHandle --- PASS: TestFallocateUnknownHandle (0.00s) === RUN TestFallocateNoOpIgnoresQuotaAndWorm --- PASS: TestFallocateNoOpIgnoresQuotaAndWorm (0.01s) === RUN TestFallocateChargesTheGrowth --- PASS: TestFallocateChargesTheGrowth (0.00s) === RUN TestOpenKeepCache_FirstOpen --- PASS: TestOpenKeepCache_FirstOpen (0.00s) === RUN TestOpenKeepCache_SecondOpenSameMtime --- PASS: TestOpenKeepCache_SecondOpenSameMtime (0.00s) === RUN TestOpenKeepCache_MtimeChanged --- PASS: TestOpenKeepCache_MtimeChanged (0.00s) === RUN TestOpenKeepCache_NanosecondPrecision --- PASS: TestOpenKeepCache_NanosecondPrecision (0.00s) === RUN TestOpenKeepCache_WriteInvalidation --- PASS: TestOpenKeepCache_WriteInvalidation (0.00s) === RUN TestOpenKeepCache_WriteOpenSkipped --- PASS: TestOpenKeepCache_WriteOpenSkipped (0.00s) === RUN TestOpenKeepCache_BoundedEviction --- PASS: TestOpenKeepCache_BoundedEviction (0.01s) === RUN TestLseekReturnsENXIOWhenNoDataFollowsOffset --- PASS: TestLseekReturnsENXIOWhenNoDataFollowsOffset (0.00s) === RUN TestCreateCreatesAndOpensFile I1117 09:37:53.340029 leveldb_store.go:48 filer store dir: /tmp/TestCreateCreatesAndOpensFile540384137/002/meta I1117 09:37:53.340220 file_util.go:29 Folder /tmp/TestCreateCreatesAndOpensFile540384137/002/meta Permission: -rwxr-xr-x W1117 09:37:53.389593 weedfs_access.go:27 hasAccess: user.LookupId for uid 123 failed: user: unknown userid 123 --- PASS: TestCreateCreatesAndOpensFile (0.07s) === RUN TestReleaseFlushesDirtyCreateIfFlushWasSkipped I1117 09:37:53.409540 leveldb_store.go:48 filer store dir: /tmp/TestReleaseFlushesDirtyCreateIfFlushWasSkipped1523510171/002/meta I1117 09:37:53.409760 file_util.go:29 Folder /tmp/TestReleaseFlushesDirtyCreateIfFlushWasSkipped1523510171/002/meta Permission: -rwxr-xr-x W1117 09:37:53.461895 weedfs_access.go:27 hasAccess: user.LookupId for uid 123 failed: user: unknown userid 123 --- PASS: TestReleaseFlushesDirtyCreateIfFlushWasSkipped (0.07s) === RUN TestTruncateEntryClearsDirtyPagesForOpenHandle I1117 09:37:53.479982 leveldb_store.go:48 filer store dir: /tmp/TestTruncateEntryClearsDirtyPagesForOpenHandle388878892/002/meta I1117 09:37:53.480170 file_util.go:29 Folder /tmp/TestTruncateEntryClearsDirtyPagesForOpenHandle388878892/002/meta Permission: -rwxr-xr-x --- PASS: TestTruncateEntryClearsDirtyPagesForOpenHandle (0.07s) === RUN TestAccessChecksPermissions --- PASS: TestAccessChecksPermissions (0.00s) === RUN TestHasAccessUsesSupplementaryGroups --- PASS: TestHasAccessUsesSupplementaryGroups (0.00s) === RUN TestSupplementaryGroupCaching --- PASS: TestSupplementaryGroupCaching (0.00s) === RUN TestSupplementaryGroupCacheExpiry --- PASS: TestSupplementaryGroupCacheExpiry (0.00s) === RUN TestCreateExistingFileIgnoresQuotaPreflight I1117 09:37:53.550188 leveldb_store.go:48 filer store dir: /tmp/TestCreateExistingFileIgnoresQuotaPreflight3898008008/002/meta I1117 09:37:53.550413 file_util.go:29 Folder /tmp/TestCreateExistingFileIgnoresQuotaPreflight3898008008/002/meta Permission: -rwxr-xr-x I1117 09:37:53.568185 weedfs_file_mkrm.go:156 Create O_EXCL /existing.txt: already exists (uid=123 gid=456 mode=644) --- PASS: TestCreateExistingFileIgnoresQuotaPreflight (0.03s) === RUN TestAcquireHandleHonorsDefaultPermissions === RUN TestAcquireHandleHonorsDefaultPermissions/kernel_enforces I1117 09:37:53.579838 leveldb_store.go:48 filer store dir: /tmp/TestAcquireHandleHonorsDefaultPermissionskernel_enforces1627060352/002/meta I1117 09:37:53.580042 file_util.go:29 Folder /tmp/TestAcquireHandleHonorsDefaultPermissionskernel_enforces1627060352/002/meta Permission: -rwxr-xr-x === RUN TestAcquireHandleHonorsDefaultPermissions/mount_enforces I1117 09:37:53.634886 leveldb_store.go:48 filer store dir: /tmp/TestAcquireHandleHonorsDefaultPermissionsmount_enforces586160623/002/meta I1117 09:37:53.635069 file_util.go:29 Folder /tmp/TestAcquireHandleHonorsDefaultPermissionsmount_enforces586160623/002/meta Permission: -rwxr-xr-x --- PASS: TestAcquireHandleHonorsDefaultPermissions (0.11s) --- PASS: TestAcquireHandleHonorsDefaultPermissions/kernel_enforces (0.05s) --- PASS: TestAcquireHandleHonorsDefaultPermissions/mount_enforces (0.05s) === RUN TestCreateRegularFileValidatesParentUnderDefaultPermissions I1117 09:37:53.690387 leveldb_store.go:48 filer store dir: /tmp/TestCreateRegularFileValidatesParentUnderDefaultPermissions1645886654/002/meta I1117 09:37:53.690584 file_util.go:29 Folder /tmp/TestCreateRegularFileValidatesParentUnderDefaultPermissions1645886654/002/meta Permission: -rwxr-xr-x --- PASS: TestCreateRegularFileValidatesParentUnderDefaultPermissions (0.05s) === RUN TestShouldMergeChunks_NoChunks --- PASS: TestShouldMergeChunks_NoChunks (0.00s) === RUN TestShouldMergeChunks_SingleChunk --- PASS: TestShouldMergeChunks_SingleChunk (0.00s) === RUN TestShouldMergeChunks_NonOverlapping --- PASS: TestShouldMergeChunks_NonOverlapping (0.00s) === RUN TestShouldMergeChunks_ExactlyDouble --- PASS: TestShouldMergeChunks_ExactlyDouble (0.00s) === RUN TestShouldMergeChunks_JustOverDouble --- PASS: TestShouldMergeChunks_JustOverDouble (0.00s) === RUN TestShouldMergeChunks_ManifestExtendFileSize --- PASS: TestShouldMergeChunks_ManifestExtendFileSize (0.00s) === RUN TestShouldMergeChunks_ManifestSizesCounted --- PASS: TestShouldMergeChunks_ManifestSizesCounted (0.00s) === RUN TestShouldMergeChunks_AccumulatedManifests --- PASS: TestShouldMergeChunks_AccumulatedManifests (0.00s) === RUN TestShouldMergeChunks_DoesNotMutateInput --- PASS: TestShouldMergeChunks_DoesNotMutateInput (0.00s) === RUN TestCompactThenMergeCondition === RUN TestCompactThenMergeCondition/fully_superseded_chunks_removed,_no_bloat === RUN TestCompactThenMergeCondition/repeated_full_overwrites_all_compacted_away === RUN TestCompactThenMergeCondition/non-overlapping_small_chunks,_no_bloat === RUN TestCompactThenMergeCondition/staggered_partial_overlaps_create_bloat === RUN TestCompactThenMergeCondition/overlapping_writes_with_75pct_overlap === RUN TestCompactThenMergeCondition/many_4K_writes_at_1K_step_over_large_range --- PASS: TestCompactThenMergeCondition (0.01s) --- PASS: TestCompactThenMergeCondition/fully_superseded_chunks_removed,_no_bloat (0.00s) --- PASS: TestCompactThenMergeCondition/repeated_full_overwrites_all_compacted_away (0.00s) --- PASS: TestCompactThenMergeCondition/non-overlapping_small_chunks,_no_bloat (0.00s) --- PASS: TestCompactThenMergeCondition/staggered_partial_overlaps_create_bloat (0.00s) --- PASS: TestCompactThenMergeCondition/overlapping_writes_with_75pct_overlap (0.00s) --- PASS: TestCompactThenMergeCondition/many_4K_writes_at_1K_step_over_large_range (0.00s) === RUN TestRandomWritesBloatDetection --- PASS: TestRandomWritesBloatDetection (0.05s) === RUN TestFlushCycleManifestAccumulation weedfs_file_sync_test.go:353: cycle 2: merge correctly triggered (4 manifests, 10 regular chunks) --- PASS: TestFlushCycleManifestAccumulation (0.00s) === RUN TestVisibleContentPreservedAfterCompact --- PASS: TestVisibleContentPreservedAfterCompact (0.16s) === RUN TestFailedWriteDoesNotGrowFile === RUN TestFailedWriteDoesNotGrowFile/short_write I1117 09:37:53.976521 leveldb_store.go:48 filer store dir: /tmp/TestFailedWriteDoesNotGrowFileshort_write533900355/001/meta I1117 09:37:53.976738 file_util.go:29 Folder /tmp/TestFailedWriteDoesNotGrowFileshort_write533900355/001/meta Permission: -rwxr-xr-x E1117 09:37:54.039716 page_chunk_swapfile.go:72 create swap file in /tmp/TestFailedWriteDoesNotGrowFileshort_write533900355/002/file/swap: open /tmp/TestFailedWriteDoesNotGrowFileshort_write533900355/002/file/swap/1659597994: not a directory E1117 09:37:54.040061 weedfs_file_write.go:78 AddPage error: failed to create swap file chunk E1117 09:37:54.040641 page_chunk_swapfile.go:72 create swap file in /tmp/TestFailedWriteDoesNotGrowFileshort_write533900355/002/file/swap: open /tmp/TestFailedWriteDoesNotGrowFileshort_write533900355/002/file/swap/3462519411: not a directory E1117 09:37:54.040846 weedfs_file_write.go:78 AddPage error: failed to create swap file chunk === RUN TestFailedWriteDoesNotGrowFile/kernel_writeback I1117 09:37:54.062645 leveldb_store.go:48 filer store dir: /tmp/TestFailedWriteDoesNotGrowFilekernel_writeback2165797072/001/meta I1117 09:37:54.062863 file_util.go:29 Folder /tmp/TestFailedWriteDoesNotGrowFilekernel_writeback2165797072/001/meta Permission: -rwxr-xr-x E1117 09:37:54.114263 page_chunk_swapfile.go:72 create swap file in /tmp/TestFailedWriteDoesNotGrowFilekernel_writeback2165797072/002/file/swap: open /tmp/TestFailedWriteDoesNotGrowFilekernel_writeback2165797072/002/file/swap/3721806587: not a directory E1117 09:37:54.114589 weedfs_file_write.go:78 AddPage error: failed to create swap file chunk E1117 09:37:54.115024 page_chunk_swapfile.go:72 create swap file in /tmp/TestFailedWriteDoesNotGrowFilekernel_writeback2165797072/002/file/swap: open /tmp/TestFailedWriteDoesNotGrowFilekernel_writeback2165797072/002/file/swap/1459857114: not a directory E1117 09:37:54.115278 weedfs_file_write.go:78 AddPage error: failed to create swap file chunk --- PASS: TestFailedWriteDoesNotGrowFile (0.16s) --- PASS: TestFailedWriteDoesNotGrowFile/short_write (0.09s) --- PASS: TestFailedWriteDoesNotGrowFile/kernel_writeback (0.07s) === RUN TestFlushCommitsAfterSlowUpload I1117 09:37:54.136232 leveldb_store.go:48 filer store dir: /tmp/TestFlushCommitsAfterSlowUpload1134907552/001/meta I1117 09:37:54.136446 file_util.go:29 Folder /tmp/TestFlushCommitsAfterSlowUpload1134907552/001/meta Permission: -rwxr-xr-x --- PASS: TestFlushCommitsAfterSlowUpload (1.10s) === RUN TestFsyncCommitsAfterSlowUpload I1117 09:37:55.234159 leveldb_store.go:48 filer store dir: /tmp/TestFsyncCommitsAfterSlowUpload1396669959/001/meta I1117 09:37:55.234357 file_util.go:29 Folder /tmp/TestFsyncCommitsAfterSlowUpload1396669959/001/meta Permission: -rwxr-xr-x --- PASS: TestFsyncCommitsAfterSlowUpload (1.09s) === RUN TestTruncateFlushCommitsAfterSlowUpload I1117 09:37:56.321507 leveldb_store.go:48 filer store dir: /tmp/TestTruncateFlushCommitsAfterSlowUpload1828714903/001/meta I1117 09:37:56.321705 file_util.go:29 Folder /tmp/TestTruncateFlushCommitsAfterSlowUpload1828714903/001/meta Permission: -rwxr-xr-x --- PASS: TestTruncateFlushCommitsAfterSlowUpload (1.09s) === RUN TestFlushCommitsAfterSlowManifestUpload I1117 09:37:57.412466 leveldb_store.go:48 filer store dir: /tmp/TestFlushCommitsAfterSlowManifestUpload3873297410/001/meta I1117 09:37:57.412669 file_util.go:29 Folder /tmp/TestFlushCommitsAfterSlowManifestUpload3873297410/001/meta Permission: -rwxr-xr-x --- PASS: TestFlushCommitsAfterSlowManifestUpload (2.22s) === RUN TestFlushCommitDeadlineStillBoundsAStuckFiler I1117 09:37:59.633207 leveldb_store.go:48 filer store dir: /tmp/TestFlushCommitDeadlineStillBoundsAStuckFiler3501258677/001/meta I1117 09:37:59.633437 file_util.go:29 Folder /tmp/TestFlushCommitDeadlineStillBoundsAStuckFiler3501258677/001/meta Permission: -rwxr-xr-x E1117 09:37:59.911710 weedfs_file_sync.go:369 fh flush create /dir/file: context deadline exceeded E1117 09:37:59.912284 weedfs_file_sync.go:237 /dir/file fh 17434074910556200508 flush: fh flush create /dir/file: context deadline exceeded --- PASS: TestFlushCommitDeadlineStillBoundsAStuckFiler (0.28s) === RUN TestCommitBudgetIsSharedByItsCalls --- PASS: TestCommitBudgetIsSharedByItsCalls (0.05s) === RUN TestUpdateEventRefreshesOpenFileHandle I1117 09:37:59.969482 leveldb_store.go:48 filer store dir: /tmp/TestUpdateEventRefreshesOpenFileHandle3647237017/001/meta I1117 09:37:59.969675 file_util.go:29 Folder /tmp/TestUpdateEventRefreshesOpenFileHandle3647237017/001/meta Permission: -rwxr-xr-x --- PASS: TestUpdateEventRefreshesOpenFileHandle (0.06s) === RUN TestQueuedEventDoesNotRollBackNewerLocalState I1117 09:38:00.025341 leveldb_store.go:48 filer store dir: /tmp/TestQueuedEventDoesNotRollBackNewerLocalState897414771/001/meta I1117 09:38:00.025544 file_util.go:29 Folder /tmp/TestQueuedEventDoesNotRollBackNewerLocalState897414771/001/meta Permission: -rwxr-xr-x --- PASS: TestQueuedEventDoesNotRollBackNewerLocalState (0.06s) === RUN TestBufferedBuildEventReinvalidatesOnCompletion I1117 09:38:00.086562 leveldb_store.go:48 filer store dir: /tmp/TestBufferedBuildEventReinvalidatesOnCompletion1076959754/001/meta I1117 09:38:00.086761 file_util.go:29 Folder /tmp/TestBufferedBuildEventReinvalidatesOnCompletion1076959754/001/meta Permission: -rwxr-xr-x --- PASS: TestBufferedBuildEventReinvalidatesOnCompletion (0.06s) === RUN TestUncachedDirStaleStoreEntryDoesNotMaskEvent I1117 09:38:00.144379 leveldb_store.go:48 filer store dir: /tmp/TestUncachedDirStaleStoreEntryDoesNotMaskEvent2175413333/001/meta I1117 09:38:00.144572 file_util.go:29 Folder /tmp/TestUncachedDirStaleStoreEntryDoesNotMaskEvent2175413333/001/meta Permission: -rwxr-xr-x --- PASS: TestUncachedDirStaleStoreEntryDoesNotMaskEvent (0.06s) === RUN TestQueuedEventOlderThanFlushedStateIsIgnored I1117 09:38:00.203522 leveldb_store.go:48 filer store dir: /tmp/TestQueuedEventOlderThanFlushedStateIsIgnored2891593531/001/meta I1117 09:38:00.203767 file_util.go:29 Folder /tmp/TestQueuedEventOlderThanFlushedStateIsIgnored2891593531/001/meta Permission: -rwxr-xr-x --- PASS: TestQueuedEventOlderThanFlushedStateIsIgnored (0.05s) === RUN TestSaveEntryKeepsOpenHandleAheadOfOlderEvents I1117 09:38:00.254058 leveldb_store.go:48 filer store dir: /tmp/TestSaveEntryKeepsOpenHandleAheadOfOlderEvents967507364/001/meta I1117 09:38:00.254261 file_util.go:29 Folder /tmp/TestSaveEntryKeepsOpenHandleAheadOfOlderEvents967507364/001/meta Permission: -rwxr-xr-x --- PASS: TestSaveEntryKeepsOpenHandleAheadOfOlderEvents (0.07s) === RUN TestQueuedEventDoesNotRollBackHandleOpenedAfterEnqueue I1117 09:38:00.323544 leveldb_store.go:48 filer store dir: /tmp/TestQueuedEventDoesNotRollBackHandleOpenedAfterEnqueue2888533396/001/meta I1117 09:38:00.323751 file_util.go:29 Folder /tmp/TestQueuedEventDoesNotRollBackHandleOpenedAfterEnqueue2888533396/001/meta Permission: -rwxr-xr-x --- PASS: TestQueuedEventDoesNotRollBackHandleOpenedAfterEnqueue (0.06s) === RUN TestAbortedBuildEventDoesNotRollBackLaterOpen I1117 09:38:00.387772 leveldb_store.go:48 filer store dir: /tmp/TestAbortedBuildEventDoesNotRollBackLaterOpen791001323/001/meta I1117 09:38:00.387976 file_util.go:29 Folder /tmp/TestAbortedBuildEventDoesNotRollBackLaterOpen791001323/001/meta Permission: -rwxr-xr-x --- PASS: TestAbortedBuildEventDoesNotRollBackLaterOpen (0.07s) === RUN TestEventDuringOpenLookupIsFenced I1117 09:38:00.460216 leveldb_store.go:48 filer store dir: /tmp/TestEventDuringOpenLookupIsFenced3867924405/001/meta I1117 09:38:00.460428 file_util.go:29 Folder /tmp/TestEventDuringOpenLookupIsFenced3867924405/001/meta Permission: -rwxr-xr-x --- PASS: TestEventDuringOpenLookupIsFenced (0.07s) === RUN TestRemoteCacheResponseVersionFencesUndeliveredEvents I1117 09:38:00.529934 leveldb_store.go:48 filer store dir: /tmp/TestRemoteCacheResponseVersionFencesUndeliveredEvents3430093815/001/meta I1117 09:38:00.530151 file_util.go:29 Folder /tmp/TestRemoteCacheResponseVersionFencesUndeliveredEvents3430093815/001/meta Permission: -rwxr-xr-x --- PASS: TestRemoteCacheResponseVersionFencesUndeliveredEvents (0.08s) === RUN TestEventlessSaveAckStillFencesOlderEvents I1117 09:38:00.609670 leveldb_store.go:48 filer store dir: /tmp/TestEventlessSaveAckStillFencesOlderEvents3274977222/001/meta I1117 09:38:00.609880 file_util.go:29 Folder /tmp/TestEventlessSaveAckStillFencesOlderEvents3274977222/001/meta Permission: -rwxr-xr-x --- PASS: TestEventlessSaveAckStillFencesOlderEvents (0.06s) === RUN TestLocalAckDoesNotFenceUnrelatedDelayedEvents I1117 09:38:00.673464 leveldb_store.go:48 filer store dir: /tmp/TestLocalAckDoesNotFenceUnrelatedDelayedEvents4282436022/001/meta I1117 09:38:00.673670 file_util.go:29 Folder /tmp/TestLocalAckDoesNotFenceUnrelatedDelayedEvents4282436022/001/meta Permission: -rwxr-xr-x --- PASS: TestLocalAckDoesNotFenceUnrelatedDelayedEvents (0.06s) === RUN TestSlowerConcurrentOpenDoesNotOverwriteNewerHandle I1117 09:38:00.735956 leveldb_store.go:48 filer store dir: /tmp/TestSlowerConcurrentOpenDoesNotOverwriteNewerHandle4250841265/001/meta I1117 09:38:00.736192 file_util.go:29 Folder /tmp/TestSlowerConcurrentOpenDoesNotOverwriteNewerHandle4250841265/001/meta Permission: -rwxr-xr-x --- PASS: TestSlowerConcurrentOpenDoesNotOverwriteNewerHandle (0.07s) === RUN TestFloorProtectsSnapshotStateFromDelayedEvents I1117 09:38:00.809571 leveldb_store.go:48 filer store dir: /tmp/TestFloorProtectsSnapshotStateFromDelayedEvents114917778/001/meta I1117 09:38:00.809816 file_util.go:29 Folder /tmp/TestFloorProtectsSnapshotStateFromDelayedEvents114917778/001/meta Permission: -rwxr-xr-x --- PASS: TestFloorProtectsSnapshotStateFromDelayedEvents (0.06s) === RUN TestAlreadyReflectedEventDoesNotDestroyDirtyPages I1117 09:38:00.866766 leveldb_store.go:48 filer store dir: /tmp/TestAlreadyReflectedEventDoesNotDestroyDirtyPages64927650/001/meta I1117 09:38:00.866966 file_util.go:29 Folder /tmp/TestAlreadyReflectedEventDoesNotDestroyDirtyPages64927650/001/meta Permission: -rwxr-xr-x --- PASS: TestAlreadyReflectedEventDoesNotDestroyDirtyPages (0.05s) === RUN TestSlowerOpenRejectedWhenHandleDirtyOrLookupUnversioned I1117 09:38:00.918483 leveldb_store.go:48 filer store dir: /tmp/TestSlowerOpenRejectedWhenHandleDirtyOrLookupUnversioned2125627729/001/meta I1117 09:38:00.918722 file_util.go:29 Folder /tmp/TestSlowerOpenRejectedWhenHandleDirtyOrLookupUnversioned2125627729/001/meta Permission: -rwxr-xr-x --- PASS: TestSlowerOpenRejectedWhenHandleDirtyOrLookupUnversioned (0.07s) === RUN TestUnversionedSlowerOpenDoesNotOverwrite I1117 09:38:00.988945 leveldb_store.go:48 filer store dir: /tmp/TestUnversionedSlowerOpenDoesNotOverwrite2174044930/001/meta I1117 09:38:00.989155 file_util.go:29 Folder /tmp/TestUnversionedSlowerOpenDoesNotOverwrite2174044930/001/meta Permission: -rwxr-xr-x --- PASS: TestUnversionedSlowerOpenDoesNotOverwrite (0.06s) === RUN TestAlreadyReflectedEventPreservesDirtyWrites I1117 09:38:01.054523 leveldb_store.go:48 filer store dir: /tmp/TestAlreadyReflectedEventPreservesDirtyWrites3661733031/001/meta I1117 09:38:01.054740 file_util.go:29 Folder /tmp/TestAlreadyReflectedEventPreservesDirtyWrites3661733031/001/meta Permission: -rwxr-xr-x --- PASS: TestAlreadyReflectedEventPreservesDirtyWrites (0.06s) === RUN TestDeleteTombstoneBlocksResurrection I1117 09:38:01.112183 leveldb_store.go:48 filer store dir: /tmp/TestDeleteTombstoneBlocksResurrection1013923822/001/meta I1117 09:38:01.112384 file_util.go:29 Folder /tmp/TestDeleteTombstoneBlocksResurrection1013923822/001/meta Permission: -rwxr-xr-x --- PASS: TestDeleteTombstoneBlocksResurrection (0.06s) === RUN TestServerSideCopyInstallEnrollsInBase I1117 09:38:01.169407 leveldb_store.go:48 filer store dir: /tmp/TestServerSideCopyInstallEnrollsInBase3046539489/001/meta I1117 09:38:01.169605 file_util.go:29 Folder /tmp/TestServerSideCopyInstallEnrollsInBase3046539489/001/meta Permission: -rwxr-xr-x --- PASS: TestServerSideCopyInstallEnrollsInBase (0.06s) === RUN TestAbsenceFloorBlocksGhostCreate I1117 09:38:01.225224 leveldb_store.go:48 filer store dir: /tmp/TestAbsenceFloorBlocksGhostCreate2264714437/001/meta I1117 09:38:01.225425 file_util.go:29 Folder /tmp/TestAbsenceFloorBlocksGhostCreate2264714437/001/meta Permission: -rwxr-xr-x --- PASS: TestAbsenceFloorBlocksGhostCreate (0.05s) === RUN TestVersionedDeleteOfMissingEntryLeavesTombstone I1117 09:38:01.279558 leveldb_store.go:48 filer store dir: /tmp/TestVersionedDeleteOfMissingEntryLeavesTombstone284476698/001/meta I1117 09:38:01.279826 file_util.go:29 Folder /tmp/TestVersionedDeleteOfMissingEntryLeavesTombstone284476698/001/meta Permission: -rwxr-xr-x --- PASS: TestVersionedDeleteOfMissingEntryLeavesTombstone (0.06s) === RUN TestCommittedCopyWithFailedReadbackAdoptsItsEvent I1117 09:38:01.337032 leveldb_store.go:48 filer store dir: /tmp/TestCommittedCopyWithFailedReadbackAdoptsItsEvent2107986086/001/meta I1117 09:38:01.337235 file_util.go:29 Folder /tmp/TestCommittedCopyWithFailedReadbackAdoptsItsEvent2107986086/001/meta Permission: -rwxr-xr-x --- PASS: TestCommittedCopyWithFailedReadbackAdoptsItsEvent (0.05s) === RUN TestNewerAbsenceFloorOverridesOlderTombstone I1117 09:38:01.390753 leveldb_store.go:48 filer store dir: /tmp/TestNewerAbsenceFloorOverridesOlderTombstone3402817138/001/meta I1117 09:38:01.390942 file_util.go:29 Folder /tmp/TestNewerAbsenceFloorOverridesOlderTombstone3402817138/001/meta Permission: -rwxr-xr-x --- PASS: TestNewerAbsenceFloorOverridesOlderTombstone (0.06s) === RUN TestFlushAckCancelsPendingCopyEventAdoption I1117 09:38:01.451158 leveldb_store.go:48 filer store dir: /tmp/TestFlushAckCancelsPendingCopyEventAdoption2240755576/001/meta I1117 09:38:01.451349 file_util.go:29 Folder /tmp/TestFlushAckCancelsPendingCopyEventAdoption2240755576/001/meta Permission: -rwxr-xr-x --- PASS: TestFlushAckCancelsPendingCopyEventAdoption (0.06s) === RUN TestAckedSaveInstallsIntoRacingOpenHandle I1117 09:38:01.515979 leveldb_store.go:48 filer store dir: /tmp/TestAckedSaveInstallsIntoRacingOpenHandle647171290/001/meta I1117 09:38:01.516181 file_util.go:29 Folder /tmp/TestAckedSaveInstallsIntoRacingOpenHandle647171290/001/meta Permission: -rwxr-xr-x --- PASS: TestAckedSaveInstallsIntoRacingOpenHandle (0.07s) === RUN TestEmptyListingTrailerSnapshotSetsAbsenceFloor I1117 09:38:01.587670 leveldb_store.go:48 filer store dir: /tmp/TestEmptyListingTrailerSnapshotSetsAbsenceFloor3971264900/001/meta I1117 09:38:01.587864 file_util.go:29 Folder /tmp/TestEmptyListingTrailerSnapshotSetsAbsenceFloor3971264900/001/meta Permission: -rwxr-xr-x --- PASS: TestEmptyListingTrailerSnapshotSetsAbsenceFloor (0.12s) === RUN TestVacateEventPreservesDirtyPages I1117 09:38:01.707053 leveldb_store.go:48 filer store dir: /tmp/TestVacateEventPreservesDirtyPages1080261257/001/meta I1117 09:38:01.707252 file_util.go:29 Folder /tmp/TestVacateEventPreservesDirtyPages1080261257/001/meta Permission: -rwxr-xr-x --- PASS: TestVacateEventPreservesDirtyPages (0.06s) === RUN TestCopyAdoptRejectsForeignEvent I1117 09:38:01.764475 leveldb_store.go:48 filer store dir: /tmp/TestCopyAdoptRejectsForeignEvent3787944816/001/meta I1117 09:38:01.764669 file_util.go:29 Folder /tmp/TestCopyAdoptRejectsForeignEvent3787944816/001/meta Permission: -rwxr-xr-x --- PASS: TestCopyAdoptRejectsForeignEvent (0.05s) === RUN TestRemoteDownloadBaseMappedToLocal I1117 09:38:01.816445 leveldb_store.go:48 filer store dir: /tmp/TestRemoteDownloadBaseMappedToLocal1472138895/001/meta I1117 09:38:01.816637 file_util.go:29 Folder /tmp/TestRemoteDownloadBaseMappedToLocal1472138895/001/meta Permission: -rwxr-xr-x --- PASS: TestRemoteDownloadBaseMappedToLocal (0.07s) === RUN TestForeignDeleteMarksHandleDeleted I1117 09:38:01.887587 leveldb_store.go:48 filer store dir: /tmp/TestForeignDeleteMarksHandleDeleted4051533758/001/meta I1117 09:38:01.887795 file_util.go:29 Folder /tmp/TestForeignDeleteMarksHandleDeleted4051533758/001/meta Permission: -rwxr-xr-x --- PASS: TestForeignDeleteMarksHandleDeleted (0.05s) === RUN TestEventlessSaveVersionsCacheEntry I1117 09:38:01.938882 leveldb_store.go:48 filer store dir: /tmp/TestEventlessSaveVersionsCacheEntry1960546209/001/meta I1117 09:38:01.939072 file_util.go:29 Folder /tmp/TestEventlessSaveVersionsCacheEntry1960546209/001/meta Permission: -rwxr-xr-x --- PASS: TestEventlessSaveVersionsCacheEntry (0.07s) === RUN TestStaleRemoteDownloadDoesNotRollBack I1117 09:38:02.009789 leveldb_store.go:48 filer store dir: /tmp/TestStaleRemoteDownloadDoesNotRollBack1185229727/001/meta I1117 09:38:02.010001 file_util.go:29 Folder /tmp/TestStaleRemoteDownloadDoesNotRollBack1185229727/001/meta Permission: -rwxr-xr-x --- PASS: TestStaleRemoteDownloadDoesNotRollBack (0.06s) === RUN TestRemoteOnlyHandleTakesUnversionedDownload I1117 09:38:02.071261 leveldb_store.go:48 filer store dir: /tmp/TestRemoteOnlyHandleTakesUnversionedDownload2866974144/001/meta I1117 09:38:02.071460 file_util.go:29 Folder /tmp/TestRemoteOnlyHandleTakesUnversionedDownload2866974144/001/meta Permission: -rwxr-xr-x --- PASS: TestRemoteOnlyHandleTakesUnversionedDownload (0.07s) === RUN TestCopyAdoptRejectsForeignMetadataChange I1117 09:38:02.143983 leveldb_store.go:48 filer store dir: /tmp/TestCopyAdoptRejectsForeignMetadataChange163388669/001/meta I1117 09:38:02.144195 file_util.go:29 Folder /tmp/TestCopyAdoptRejectsForeignMetadataChange163388669/001/meta Permission: -rwxr-xr-x --- PASS: TestCopyAdoptRejectsForeignMetadataChange (0.05s) === RUN TestForeignRenameDoesNotMarkHandleDeleted I1117 09:38:02.196387 leveldb_store.go:48 filer store dir: /tmp/TestForeignRenameDoesNotMarkHandleDeleted1349340981/001/meta I1117 09:38:02.196617 file_util.go:29 Folder /tmp/TestForeignRenameDoesNotMarkHandleDeleted1349340981/001/meta Permission: -rwxr-xr-x --- PASS: TestForeignRenameDoesNotMarkHandleDeleted (0.06s) === RUN TestCopyAdoptAppliesForeignTouchToCleanHandle I1117 09:38:02.255981 leveldb_store.go:48 filer store dir: /tmp/TestCopyAdoptAppliesForeignTouchToCleanHandle617442841/001/meta I1117 09:38:02.256180 file_util.go:29 Folder /tmp/TestCopyAdoptAppliesForeignTouchToCleanHandle617442841/001/meta Permission: -rwxr-xr-x --- PASS: TestCopyAdoptAppliesForeignTouchToCleanHandle (0.05s) === RUN TestUnversionedRemoteDownloadDoesNotOverwriteVersioned I1117 09:38:02.307831 leveldb_store.go:48 filer store dir: /tmp/TestUnversionedRemoteDownloadDoesNotOverwriteVersioned3664635116/001/meta I1117 09:38:02.308033 file_util.go:29 Folder /tmp/TestUnversionedRemoteDownloadDoesNotOverwriteVersioned3664635116/001/meta Permission: -rwxr-xr-x --- PASS: TestUnversionedRemoteDownloadDoesNotOverwriteVersioned (0.06s) === RUN TestEventFromAnotherFilerIsNotFencedByForeignClock I1117 09:38:02.373074 leveldb_store.go:48 filer store dir: /tmp/TestEventFromAnotherFilerIsNotFencedByForeignClock1735623233/001/meta I1117 09:38:02.373280 file_util.go:29 Folder /tmp/TestEventFromAnotherFilerIsNotFencedByForeignClock1735623233/001/meta Permission: -rwxr-xr-x --- PASS: TestEventFromAnotherFilerIsNotFencedByForeignClock (0.06s) === RUN TestTouchBeforeCopyEventKeepsPostCopyWrites I1117 09:38:02.435421 leveldb_store.go:48 filer store dir: /tmp/TestTouchBeforeCopyEventKeepsPostCopyWrites4276305518/001/meta I1117 09:38:02.435615 file_util.go:29 Folder /tmp/TestTouchBeforeCopyEventKeepsPostCopyWrites4276305518/001/meta Permission: -rwxr-xr-x --- PASS: TestTouchBeforeCopyEventKeepsPostCopyWrites (0.06s) === RUN TestRejectedDownloadDoesNotRollBackCache I1117 09:38:02.495368 leveldb_store.go:48 filer store dir: /tmp/TestRejectedDownloadDoesNotRollBackCache2283401222/001/meta I1117 09:38:02.495612 file_util.go:29 Folder /tmp/TestRejectedDownloadDoesNotRollBackCache2283401222/001/meta Permission: -rwxr-xr-x --- PASS: TestRejectedDownloadDoesNotRollBackCache (0.07s) === RUN TestRemoteOnlyHandleRefusesKnownOlderDownload I1117 09:38:02.569478 leveldb_store.go:48 filer store dir: /tmp/TestRemoteOnlyHandleRefusesKnownOlderDownload344212615/001/meta I1117 09:38:02.569696 file_util.go:29 Folder /tmp/TestRemoteOnlyHandleRefusesKnownOlderDownload344212615/001/meta Permission: -rwxr-xr-x --- PASS: TestRemoteOnlyHandleRefusesKnownOlderDownload (0.06s) === RUN TestForeignChmodPreservesDirtyPages I1117 09:38:02.634185 leveldb_store.go:48 filer store dir: /tmp/TestForeignChmodPreservesDirtyPages2197696225/001/meta I1117 09:38:02.634382 file_util.go:29 Folder /tmp/TestForeignChmodPreservesDirtyPages2197696225/001/meta Permission: -rwxr-xr-x --- PASS: TestForeignChmodPreservesDirtyPages (0.05s) === RUN TestRenameOverExistingMarksReplacedHandleDeleted I1117 09:38:02.686375 leveldb_store.go:48 filer store dir: /tmp/TestRenameOverExistingMarksReplacedHandleDeleted3529152865/001/meta I1117 09:38:02.686570 file_util.go:29 Folder /tmp/TestRenameOverExistingMarksReplacedHandleDeleted3529152865/001/meta Permission: -rwxr-xr-x --- PASS: TestRenameOverExistingMarksReplacedHandleDeleted (0.06s) === RUN TestAckFromAnotherFilerIsNotDroppedBehindForeignFence I1117 09:38:02.742017 leveldb_store.go:48 filer store dir: /tmp/TestAckFromAnotherFilerIsNotDroppedBehindForeignFence3617233235/001/meta I1117 09:38:02.742218 file_util.go:29 Folder /tmp/TestAckFromAnotherFilerIsNotDroppedBehindForeignFence3617233235/001/meta Permission: -rwxr-xr-x --- PASS: TestAckFromAnotherFilerIsNotDroppedBehindForeignFence (0.05s) === RUN TestPeerAppendMergesIntoDirtyHandle I1117 09:38:02.791855 leveldb_store.go:48 filer store dir: /tmp/TestPeerAppendMergesIntoDirtyHandle2481787166/001/meta I1117 09:38:02.792041 file_util.go:29 Folder /tmp/TestPeerAppendMergesIntoDirtyHandle2481787166/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerAppendMergesIntoDirtyHandle (0.06s) === RUN TestUnmergeablePeerChangeKeepsDirtyHandle I1117 09:38:02.849028 leveldb_store.go:48 filer store dir: /tmp/TestUnmergeablePeerChangeKeepsDirtyHandle4207187465/001/meta I1117 09:38:02.849265 file_util.go:29 Folder /tmp/TestUnmergeablePeerChangeKeepsDirtyHandle4207187465/001/meta Permission: -rwxr-xr-x --- PASS: TestUnmergeablePeerChangeKeepsDirtyHandle (0.06s) === RUN TestPeerEventKeepsPendingTruncate I1117 09:38:02.907547 leveldb_store.go:48 filer store dir: /tmp/TestPeerEventKeepsPendingTruncate2075906489/001/meta I1117 09:38:02.907731 file_util.go:29 Folder /tmp/TestPeerEventKeepsPendingTruncate2075906489/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerEventKeepsPendingTruncate (0.06s) === RUN TestPeerTruncateWaitsForBufferedWrites I1117 09:38:02.966141 leveldb_store.go:48 filer store dir: /tmp/TestPeerTruncateWaitsForBufferedWrites2008197174/001/meta I1117 09:38:02.966334 file_util.go:29 Folder /tmp/TestPeerTruncateWaitsForBufferedWrites2008197174/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerTruncateWaitsForBufferedWrites (0.06s) === RUN TestPeerReplacementKeepsDirtyHandle === RUN TestPeerReplacementKeepsDirtyHandle/new-content I1117 09:38:03.024296 leveldb_store.go:48 filer store dir: /tmp/TestPeerReplacementKeepsDirtyHandlenew-content1211340829/001/meta I1117 09:38:03.024492 file_util.go:29 Folder /tmp/TestPeerReplacementKeepsDirtyHandlenew-content1211340829/001/meta Permission: -rwxr-xr-x E1117 09:38:03.093513 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:38:03.094024 weedfs_file_sync.go:237 /dir/file fh 17185638205489941895 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed === RUN TestPeerReplacementKeepsDirtyHandle/same-content I1117 09:38:03.099296 leveldb_store.go:48 filer store dir: /tmp/TestPeerReplacementKeepsDirtyHandlesame-content1822711408/001/meta I1117 09:38:03.099514 file_util.go:29 Folder /tmp/TestPeerReplacementKeepsDirtyHandlesame-content1822711408/001/meta Permission: -rwxr-xr-x E1117 09:38:03.169383 weedfs_file_sync.go:369 fh flush create /dir/file: CreateEntry /dir/file: precondition failed E1117 09:38:03.169885 weedfs_file_sync.go:237 /dir/file fh 6959974716518867118 flush: fh flush create /dir/file: CreateEntry /dir/file: precondition failed --- PASS: TestPeerReplacementKeepsDirtyHandle (0.15s) --- PASS: TestPeerReplacementKeepsDirtyHandle/new-content (0.07s) --- PASS: TestPeerReplacementKeepsDirtyHandle/same-content (0.07s) === RUN TestPeerChmodReachesDirtyHandle === RUN TestPeerChmodReachesDirtyHandle/peer-only I1117 09:38:03.174960 leveldb_store.go:48 filer store dir: /tmp/TestPeerChmodReachesDirtyHandlepeer-only3049838965/001/meta I1117 09:38:03.175142 file_util.go:29 Folder /tmp/TestPeerChmodReachesDirtyHandlepeer-only3049838965/001/meta Permission: -rwxr-xr-x === RUN TestPeerChmodReachesDirtyHandle/both-changed I1117 09:38:03.241772 leveldb_store.go:48 filer store dir: /tmp/TestPeerChmodReachesDirtyHandleboth-changed3129362844/001/meta I1117 09:38:03.241965 file_util.go:29 Folder /tmp/TestPeerChmodReachesDirtyHandleboth-changed3129362844/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerChmodReachesDirtyHandle (0.12s) --- PASS: TestPeerChmodReachesDirtyHandle/peer-only (0.07s) --- PASS: TestPeerChmodReachesDirtyHandle/both-changed (0.05s) === RUN TestPeerInlineContentWaitsForBufferedWrite I1117 09:38:03.294630 leveldb_store.go:48 filer store dir: /tmp/TestPeerInlineContentWaitsForBufferedWrite50131838/001/meta I1117 09:38:03.294816 file_util.go:29 Folder /tmp/TestPeerInlineContentWaitsForBufferedWrite50131838/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerInlineContentWaitsForBufferedWrite (0.06s) === RUN TestLinkKeepsOpenHandlePublishing I1117 09:38:03.353296 leveldb_store.go:48 filer store dir: /tmp/TestLinkKeepsOpenHandlePublishing1515068562/001/meta I1117 09:38:03.353486 file_util.go:29 Folder /tmp/TestLinkKeepsOpenHandlePublishing1515068562/001/meta Permission: -rwxr-xr-x --- PASS: TestLinkKeepsOpenHandlePublishing (0.08s) === RUN TestUnlinkedAliasKeepsOpenHandlePublishing === RUN TestUnlinkedAliasKeepsOpenHandlePublishing/clean I1117 09:38:03.434973 leveldb_store.go:48 filer store dir: /tmp/TestUnlinkedAliasKeepsOpenHandlePublishingclean2397088017/001/meta I1117 09:38:03.435179 file_util.go:29 Folder /tmp/TestUnlinkedAliasKeepsOpenHandlePublishingclean2397088017/001/meta Permission: -rwxr-xr-x === RUN TestUnlinkedAliasKeepsOpenHandlePublishing/dirty I1117 09:38:03.539961 leveldb_store.go:48 filer store dir: /tmp/TestUnlinkedAliasKeepsOpenHandlePublishingdirty1298007288/001/meta I1117 09:38:03.540166 file_util.go:29 Folder /tmp/TestUnlinkedAliasKeepsOpenHandlePublishingdirty1298007288/001/meta Permission: -rwxr-xr-x --- PASS: TestUnlinkedAliasKeepsOpenHandlePublishing (0.19s) --- PASS: TestUnlinkedAliasKeepsOpenHandlePublishing/clean (0.10s) --- PASS: TestUnlinkedAliasKeepsOpenHandlePublishing/dirty (0.09s) === RUN TestUnlinkedAliasRereadsLostEntryAtFlush I1117 09:38:03.629007 leveldb_store.go:48 filer store dir: /tmp/TestUnlinkedAliasRereadsLostEntryAtFlush1540498413/001/meta I1117 09:38:03.629204 file_util.go:29 Folder /tmp/TestUnlinkedAliasRereadsLostEntryAtFlush1540498413/001/meta Permission: -rwxr-xr-x --- PASS: TestUnlinkedAliasRereadsLostEntryAtFlush (0.11s) === RUN TestFlushResolvedBeforeAliasUnlinkReachesSurvivor I1117 09:38:03.736655 leveldb_store.go:48 filer store dir: /tmp/TestFlushResolvedBeforeAliasUnlinkReachesSurvivor2582559506/001/meta I1117 09:38:03.736848 file_util.go:29 Folder /tmp/TestFlushResolvedBeforeAliasUnlinkReachesSurvivor2582559506/001/meta Permission: -rwxr-xr-x --- PASS: TestFlushResolvedBeforeAliasUnlinkReachesSurvivor (0.10s) === RUN TestFlushWaitingThroughAliasUnlinkReachesSurvivor I1117 09:38:03.840258 leveldb_store.go:48 filer store dir: /tmp/TestFlushWaitingThroughAliasUnlinkReachesSurvivor1361030784/001/meta I1117 09:38:03.840472 file_util.go:29 Folder /tmp/TestFlushWaitingThroughAliasUnlinkReachesSurvivor1361030784/001/meta Permission: -rwxr-xr-x --- PASS: TestFlushWaitingThroughAliasUnlinkReachesSurvivor (0.10s) === RUN TestFlushWhoseNameKeepsChangingRetries I1117 09:38:03.935950 leveldb_store.go:48 filer store dir: /tmp/TestFlushWhoseNameKeepsChangingRetries2177383868/001/meta I1117 09:38:03.936153 file_util.go:29 Folder /tmp/TestFlushWhoseNameKeepsChangingRetries2177383868/001/meta Permission: -rwxr-xr-x --- PASS: TestFlushWhoseNameKeepsChangingRetries (0.18s) === RUN TestUnlinkedAliasPublishesQueuedClose I1117 09:38:04.112466 leveldb_store.go:48 filer store dir: /tmp/TestUnlinkedAliasPublishesQueuedClose814934052/001/meta I1117 09:38:04.112675 file_util.go:29 Folder /tmp/TestUnlinkedAliasPublishesQueuedClose814934052/001/meta Permission: -rwxr-xr-x --- PASS: TestUnlinkedAliasPublishesQueuedClose (0.30s) === RUN TestLinkWaitsForQueuedClose I1117 09:38:04.413989 leveldb_store.go:48 filer store dir: /tmp/TestLinkWaitsForQueuedClose1027853718/001/meta I1117 09:38:04.414190 file_util.go:29 Folder /tmp/TestLinkWaitsForQueuedClose1027853718/001/meta Permission: -rwxr-xr-x --- PASS: TestLinkWaitsForQueuedClose (0.28s) === RUN TestUnlinkLastLinkKeepsOpenHandleDeleted I1117 09:38:04.692430 leveldb_store.go:48 filer store dir: /tmp/TestUnlinkLastLinkKeepsOpenHandleDeleted359159280/001/meta I1117 09:38:04.692634 file_util.go:29 Folder /tmp/TestUnlinkLastLinkKeepsOpenHandleDeleted359159280/001/meta Permission: -rwxr-xr-x --- PASS: TestUnlinkLastLinkKeepsOpenHandleDeleted (0.10s) === RUN TestAdoptLinkChangeKeepsBaseOnPeerWrite I1117 09:38:04.788905 leveldb_store.go:48 filer store dir: /tmp/TestAdoptLinkChangeKeepsBaseOnPeerWrite2470209686/001/meta I1117 09:38:04.789120 file_util.go:29 Folder /tmp/TestAdoptLinkChangeKeepsBaseOnPeerWrite2470209686/001/meta Permission: -rwxr-xr-x --- PASS: TestAdoptLinkChangeKeepsBaseOnPeerWrite (0.05s) === RUN TestAdoptLinkChangeSkipsOlderVersion I1117 09:38:04.842331 leveldb_store.go:48 filer store dir: /tmp/TestAdoptLinkChangeSkipsOlderVersion4032061648/001/meta I1117 09:38:04.842527 file_util.go:29 Folder /tmp/TestAdoptLinkChangeSkipsOlderVersion4032061648/001/meta Permission: -rwxr-xr-x --- PASS: TestAdoptLinkChangeSkipsOlderVersion (0.06s) === RUN TestLinkReportsKernelNodeIdWhenEntryHasNoPersistedInode I1117 09:38:04.902421 leveldb_store.go:48 filer store dir: /tmp/TestLinkReportsKernelNodeIdWhenEntryHasNoPersistedInode2730568318/002/meta I1117 09:38:04.902640 file_util.go:29 Folder /tmp/TestLinkReportsKernelNodeIdWhenEntryHasNoPersistedInode2730568318/002/meta Permission: -rwxr-xr-x --- PASS: TestLinkReportsKernelNodeIdWhenEntryHasNoPersistedInode (0.07s) === RUN TestLinkReportsKernelNodeIdWhenEntryHasPersistedInode I1117 09:38:04.971956 leveldb_store.go:48 filer store dir: /tmp/TestLinkReportsKernelNodeIdWhenEntryHasPersistedInode2927745442/002/meta I1117 09:38:04.972154 file_util.go:29 Folder /tmp/TestLinkReportsKernelNodeIdWhenEntryHasPersistedInode2927745442/002/meta Permission: -rwxr-xr-x --- PASS: TestLinkReportsKernelNodeIdWhenEntryHasPersistedInode (0.07s) === RUN TestLinkSyncsHardLinkSiblingsOnThirdLink I1117 09:38:05.043338 leveldb_store.go:48 filer store dir: /tmp/TestLinkSyncsHardLinkSiblingsOnThirdLink3813286237/002/meta I1117 09:38:05.043535 file_util.go:29 Folder /tmp/TestLinkSyncsHardLinkSiblingsOnThirdLink3813286237/002/meta Permission: -rwxr-xr-x --- PASS: TestLinkSyncsHardLinkSiblingsOnThirdLink (0.09s) === RUN TestSyncHardLinkSiblingFetchFailureKeepsVersion I1117 09:38:05.135381 leveldb_store.go:48 filer store dir: /tmp/TestSyncHardLinkSiblingFetchFailureKeepsVersion2682524844/002/meta I1117 09:38:05.135585 file_util.go:29 Folder /tmp/TestSyncHardLinkSiblingFetchFailureKeepsVersion2682524844/002/meta Permission: -rwxr-xr-x --- PASS: TestSyncHardLinkSiblingFetchFailureKeepsVersion (0.07s) === RUN TestEntryWriteOwnerMatchesFilerRouting --- PASS: TestEntryWriteOwnerMatchesFilerRouting (0.01s) === RUN TestSubscribeMetaEventsReplaysThroughFilerProxy I1117 09:38:05.218895 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeMetaEventsReplaysThroughFilerProxy1769409392/001/meta I1117 09:38:05.219102 file_util.go:29 Folder /tmp/TestSubscribeMetaEventsReplaysThroughFilerProxy1769409392/001/meta Permission: -rwxr-xr-x --- PASS: TestSubscribeMetaEventsReplaysThroughFilerProxy (0.09s) === RUN TestFlushFileMetadataPreservesUserMtime --- PASS: TestFlushFileMetadataPreservesUserMtime (0.00s) === RUN TestPeriodicFlushSkipsUnlinkedHandle I1117 09:38:05.306629 leveldb_store.go:48 filer store dir: /tmp/TestPeriodicFlushSkipsUnlinkedHandle4132171745/001/meta I1117 09:38:05.306831 file_util.go:29 Folder /tmp/TestPeriodicFlushSkipsUnlinkedHandle4132171745/001/meta Permission: -rwxr-xr-x --- PASS: TestPeriodicFlushSkipsUnlinkedHandle (0.05s) === RUN TestPeerUnlinkedAliasKeepsOpenHandlePublishing === RUN TestPeerUnlinkedAliasKeepsOpenHandlePublishing/tmp/clean I1117 09:38:05.362807 leveldb_store.go:48 filer store dir: /tmp/TestPeerUnlinkedAliasKeepsOpenHandlePublishingtmpclean3242387252/001/meta I1117 09:38:05.363002 file_util.go:29 Folder /tmp/TestPeerUnlinkedAliasKeepsOpenHandlePublishingtmpclean3242387252/001/meta Permission: -rwxr-xr-x === RUN TestPeerUnlinkedAliasKeepsOpenHandlePublishing/tmp/dirty I1117 09:38:05.444040 leveldb_store.go:48 filer store dir: /tmp/TestPeerUnlinkedAliasKeepsOpenHandlePublishingtmpdirty1536092376/001/meta I1117 09:38:05.444238 file_util.go:29 Folder /tmp/TestPeerUnlinkedAliasKeepsOpenHandlePublishingtmpdirty1536092376/001/meta Permission: -rwxr-xr-x === RUN TestPeerUnlinkedAliasKeepsOpenHandlePublishing/final/clean I1117 09:38:05.534027 leveldb_store.go:48 filer store dir: /tmp/TestPeerUnlinkedAliasKeepsOpenHandlePublishingfinalclean295646824/001/meta I1117 09:38:05.534239 file_util.go:29 Folder /tmp/TestPeerUnlinkedAliasKeepsOpenHandlePublishingfinalclean295646824/001/meta Permission: -rwxr-xr-x === RUN TestPeerUnlinkedAliasKeepsOpenHandlePublishing/final/dirty I1117 09:38:05.616105 leveldb_store.go:48 filer store dir: /tmp/TestPeerUnlinkedAliasKeepsOpenHandlePublishingfinaldirty227752663/001/meta I1117 09:38:05.616338 file_util.go:29 Folder /tmp/TestPeerUnlinkedAliasKeepsOpenHandlePublishingfinaldirty227752663/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerUnlinkedAliasKeepsOpenHandlePublishing (0.36s) --- PASS: TestPeerUnlinkedAliasKeepsOpenHandlePublishing/tmp/clean (0.08s) --- PASS: TestPeerUnlinkedAliasKeepsOpenHandlePublishing/tmp/dirty (0.09s) --- PASS: TestPeerUnlinkedAliasKeepsOpenHandlePublishing/final/clean (0.08s) --- PASS: TestPeerUnlinkedAliasKeepsOpenHandlePublishing/final/dirty (0.10s) === RUN TestPeerUnlinkedAliasKeepsLookedUpSurvivor I1117 09:38:05.720944 leveldb_store.go:48 filer store dir: /tmp/TestPeerUnlinkedAliasKeepsLookedUpSurvivor1167111674/001/meta I1117 09:38:05.721192 file_util.go:29 Folder /tmp/TestPeerUnlinkedAliasKeepsLookedUpSurvivor1167111674/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerUnlinkedAliasKeepsLookedUpSurvivor (0.09s) === RUN TestPeerUnlinkedAliasWithUnknownSurvivorStops I1117 09:38:05.809439 leveldb_store.go:48 filer store dir: /tmp/TestPeerUnlinkedAliasWithUnknownSurvivorStops4088338522/001/meta I1117 09:38:05.809640 file_util.go:29 Folder /tmp/TestPeerUnlinkedAliasWithUnknownSurvivorStops4088338522/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerUnlinkedAliasWithUnknownSurvivorStops (0.08s) === RUN TestPeerThenLocalUnlinkKeepsHandleDeleted I1117 09:38:05.889764 leveldb_store.go:48 filer store dir: /tmp/TestPeerThenLocalUnlinkKeepsHandleDeleted4042560756/001/meta I1117 09:38:05.889965 file_util.go:29 Folder /tmp/TestPeerThenLocalUnlinkKeepsHandleDeleted4042560756/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerThenLocalUnlinkKeepsHandleDeleted (0.08s) === RUN TestPeerUnlinkLastNameKeepsHandleDeleted I1117 09:38:05.969020 leveldb_store.go:48 filer store dir: /tmp/TestPeerUnlinkLastNameKeepsHandleDeleted1025092762/001/meta I1117 09:38:05.969220 file_util.go:29 Folder /tmp/TestPeerUnlinkLastNameKeepsHandleDeleted1025092762/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerUnlinkLastNameKeepsHandleDeleted (0.06s) === RUN TestPeerUnlinkedAliasKeepsPeriodicFlushPublishing I1117 09:38:06.028852 leveldb_store.go:48 filer store dir: /tmp/TestPeerUnlinkedAliasKeepsPeriodicFlushPublishing2718359035/001/meta I1117 09:38:06.029072 file_util.go:29 Folder /tmp/TestPeerUnlinkedAliasKeepsPeriodicFlushPublishing2718359035/001/meta Permission: -rwxr-xr-x --- PASS: TestPeerUnlinkedAliasKeepsPeriodicFlushPublishing (0.08s) === RUN TestPosixLockTypeMapping --- PASS: TestPosixLockTypeMapping (0.00s) === RUN TestPosixPollAcquireGrantedImmediately --- PASS: TestPosixPollAcquireGrantedImmediately (0.00s) === RUN TestPosixPollAcquireRetriesThenGrants --- PASS: TestPosixPollAcquireRetriesThenGrants (0.03s) === RUN TestPosixPollAcquireError --- PASS: TestPosixPollAcquireError (0.00s) === RUN TestPosixPollAcquireCancel --- PASS: TestPosixPollAcquireCancel (0.00s) === RUN TestPosixLockHint --- PASS: TestPosixLockHint (0.00s) === RUN TestUncommittedBytesTracking --- PASS: TestUncommittedBytesTracking (0.00s) === RUN TestUncommittedBytesDoesNotGoNegative --- PASS: TestUncommittedBytesDoesNotGoNegative (0.00s) === RUN TestIsOverQuotaWithUncommitted === RUN TestIsOverQuotaWithUncommitted/no_quota_set === RUN TestIsOverQuotaWithUncommitted/under_quota === RUN TestIsOverQuotaWithUncommitted/over_quota_with_uncommitted === RUN TestIsOverQuotaWithUncommitted/already_over_quota_flag_set === RUN TestIsOverQuotaWithUncommitted/exactly_at_quota === RUN TestIsOverQuotaWithUncommitted/one_byte_over_quota --- PASS: TestIsOverQuotaWithUncommitted (0.00s) --- PASS: TestIsOverQuotaWithUncommitted/no_quota_set (0.00s) --- PASS: TestIsOverQuotaWithUncommitted/under_quota (0.00s) --- PASS: TestIsOverQuotaWithUncommitted/over_quota_with_uncommitted (0.00s) --- PASS: TestIsOverQuotaWithUncommitted/already_over_quota_flag_set (0.00s) --- PASS: TestIsOverQuotaWithUncommitted/exactly_at_quota (0.00s) --- PASS: TestIsOverQuotaWithUncommitted/one_byte_over_quota (0.00s) === RUN TestGetQuotaCheckInterval === RUN TestGetQuotaCheckInterval/no_quota === RUN TestGetQuotaCheckInterval/under_90%_threshold === RUN TestGetQuotaCheckInterval/at_90%_threshold === RUN TestGetQuotaCheckInterval/over_90%_with_uncommitted --- PASS: TestGetQuotaCheckInterval (0.00s) --- PASS: TestGetQuotaCheckInterval/no_quota (0.00s) --- PASS: TestGetQuotaCheckInterval/under_90%_threshold (0.00s) --- PASS: TestGetQuotaCheckInterval/at_90%_threshold (0.00s) --- PASS: TestGetQuotaCheckInterval/over_90%_with_uncommitted (0.00s) === RUN TestNoQuotaTrackingWhenDisabled --- PASS: TestNoQuotaTrackingWhenDisabled (0.00s) === RUN TestReleaseDropsFlockWhileFlushBlocked I1117 09:38:06.157861 leveldb_store.go:48 filer store dir: /tmp/TestReleaseDropsFlockWhileFlushBlocked2086478789/001/meta I1117 09:38:06.158123 file_util.go:29 Folder /tmp/TestReleaseDropsFlockWhileFlushBlocked2086478789/001/meta Permission: -rwxr-xr-x --- PASS: TestReleaseDropsFlockWhileFlushBlocked (0.07s) === RUN TestReleaseDropsOfdLocks I1117 09:38:06.232617 leveldb_store.go:48 filer store dir: /tmp/TestReleaseDropsOfdLocks1829291959/001/meta I1117 09:38:06.232818 file_util.go:29 Folder /tmp/TestReleaseDropsOfdLocks1829291959/001/meta Permission: -rwxr-xr-x --- PASS: TestReleaseDropsOfdLocks (0.05s) === RUN TestRemoteRenameMovesInodePaths I1117 09:38:06.285796 leveldb_store.go:48 filer store dir: /tmp/TestRemoteRenameMovesInodePaths62461164/001/meta I1117 09:38:06.286028 file_util.go:29 Folder /tmp/TestRemoteRenameMovesInodePaths62461164/001/meta Permission: -rwxr-xr-x --- PASS: TestRemoteRenameMovesInodePaths (0.06s) === RUN TestRemoteRenameMovesOnceWithAnOpenHandle I1117 09:38:06.345412 leveldb_store.go:48 filer store dir: /tmp/TestRemoteRenameMovesOnceWithAnOpenHandle1137944200/001/meta I1117 09:38:06.345624 file_util.go:29 Folder /tmp/TestRemoteRenameMovesOnceWithAnOpenHandle1137944200/001/meta Permission: -rwxr-xr-x --- PASS: TestRemoteRenameMovesOnceWithAnOpenHandle (0.05s) === RUN TestRemoteRenameReplayLeavesTheTargetAlone I1117 09:38:06.399321 leveldb_store.go:48 filer store dir: /tmp/TestRemoteRenameReplayLeavesTheTargetAlone4163574018/001/meta I1117 09:38:06.399517 file_util.go:29 Folder /tmp/TestRemoteRenameReplayLeavesTheTargetAlone4163574018/001/meta Permission: -rwxr-xr-x --- PASS: TestRemoteRenameReplayLeavesTheTargetAlone (0.05s) === RUN TestRenameBelowTheVersionFenceStillMoves I1117 09:38:06.452174 leveldb_store.go:48 filer store dir: /tmp/TestRenameBelowTheVersionFenceStillMoves825417664/001/meta I1117 09:38:06.452415 file_util.go:29 Folder /tmp/TestRenameBelowTheVersionFenceStillMoves825417664/001/meta Permission: -rwxr-xr-x --- PASS: TestRenameBelowTheVersionFenceStillMoves (0.05s) === RUN TestHandleRenameResponseLeavesUncachedTargetOutOfCache I1117 09:38:06.504203 leveldb_store.go:48 filer store dir: /tmp/TestHandleRenameResponseLeavesUncachedTargetOutOfCache3853584826/001/meta I1117 09:38:06.504404 file_util.go:29 Folder /tmp/TestHandleRenameResponseLeavesUncachedTargetOutOfCache3853584826/001/meta Permission: -rwxr-xr-x --- PASS: TestHandleRenameResponseLeavesUncachedTargetOutOfCache (0.05s) === RUN TestDiskSizes --- PASS: TestDiskSizes (0.00s) === RUN TestHasCreateResponse === RUN TestHasCreateResponse/create_carrying_a_nested_response === RUN TestHasCreateResponse/create_wrapper_with_no_nested_response === RUN TestHasCreateResponse/a_different_mutation === RUN TestHasCreateResponse/no_response_at_all --- PASS: TestHasCreateResponse (0.00s) --- PASS: TestHasCreateResponse/create_carrying_a_nested_response (0.00s) --- PASS: TestHasCreateResponse/create_wrapper_with_no_nested_response (0.00s) --- PASS: TestHasCreateResponse/a_different_mutation (0.00s) --- PASS: TestHasCreateResponse/no_response_at_all (0.00s) === RUN TestStreamMutateCreateEntryUnwrapsAlreadyExists --- PASS: TestStreamMutateCreateEntryUnwrapsAlreadyExists (0.00s) === RUN TestStreamMutateCreateEntryKeepsGenericFailure --- PASS: TestStreamMutateCreateEntryKeepsGenericFailure (0.00s) === RUN TestStreamMutateCreateEntryRejectsMissingNestedResponse --- PASS: TestStreamMutateCreateEntryRejectsMissingNestedResponse (0.00s) === RUN TestStreamMutateCreateEntryKeepsUnexplainedTopLevelError --- PASS: TestStreamMutateCreateEntryKeepsUnexplainedTopLevelError (0.00s) === RUN TestListXAttrCanceledWhileFilerStalled I1117 09:38:06.565881 leveldb_store.go:48 filer store dir: /tmp/TestListXAttrCanceledWhileFilerStalled3956560720/001/meta I1117 09:38:06.566071 file_util.go:29 Folder /tmp/TestListXAttrCanceledWhileFilerStalled3956560720/001/meta Permission: -rwxr-xr-x --- PASS: TestListXAttrCanceledWhileFilerStalled (0.06s) === RUN TestListXAttrTimesOutWhileFilerStalled I1117 09:38:06.625995 leveldb_store.go:48 filer store dir: /tmp/TestListXAttrTimesOutWhileFilerStalled2694492293/001/meta I1117 09:38:06.626199 file_util.go:29 Folder /tmp/TestListXAttrTimesOutWhileFilerStalled2694492293/001/meta Permission: -rwxr-xr-x I1117 09:38:06.733265 retry.go:132 retry filer grpc: err: rpc error: code = Unavailable desc = filer 127.0.0.1:41687: call timed out I1117 09:38:07.786460 retry.go:132 retry filer grpc: err: rpc error: code = Unavailable desc = filer 127.0.0.1:41687: call timed out I1117 09:38:09.339330 retry.go:132 retry filer grpc: err: rpc error: code = Unavailable desc = filer 127.0.0.1:41687: call timed out I1117 09:38:11.642239 retry.go:132 retry filer grpc: err: rpc error: code = Unavailable desc = filer 127.0.0.1:41687: call timed out I1117 09:38:15.070300 retry.go:132 retry filer grpc: err: rpc error: code = Unavailable desc = filer 127.0.0.1:41687: call timed out W1117 09:38:20.134668 weedfs.go:804 lookupEntry GetEntry /dir/f: rpc error: code = Unavailable desc = filer 127.0.0.1:41687: call timed out --- PASS: TestListXAttrTimesOutWhileFilerStalled (13.51s) === RUN TestSetXAttrCopiesValueBuffer --- PASS: TestSetXAttrCopiesValueBuffer (0.00s) === RUN TestWithFilerClientFailsOverPastWedgedFiler I1117 09:38:20.141795 leveldb_store.go:48 filer store dir: /tmp/TestWithFilerClientFailsOverPastWedgedFiler1683204119/001/meta I1117 09:38:20.141998 file_util.go:29 Folder /tmp/TestWithFilerClientFailsOverPastWedgedFiler1683204119/001/meta Permission: -rwxr-xr-x --- PASS: TestWithFilerClientFailsOverPastWedgedFiler (0.47s) === RUN TestStreamMutateTimesOutAndRotatesFiler I1117 09:38:20.610146 leveldb_store.go:48 filer store dir: /tmp/TestStreamMutateTimesOutAndRotatesFiler774216841/001/meta I1117 09:38:20.610345 file_util.go:29 Folder /tmp/TestStreamMutateTimesOutAndRotatesFiler774216841/001/meta Permission: -rwxr-xr-x --- PASS: TestStreamMutateTimesOutAndRotatesFiler (0.28s) === RUN TestWithFilerClientDoesNotOverlapAttempts I1117 09:38:20.886785 leveldb_store.go:48 filer store dir: /tmp/TestWithFilerClientDoesNotOverlapAttempts1382528812/001/meta I1117 09:38:20.886989 file_util.go:29 Folder /tmp/TestWithFilerClientDoesNotOverlapAttempts1382528812/001/meta Permission: -rwxr-xr-x --- PASS: TestWithFilerClientDoesNotOverlapAttempts (0.67s) === RUN TestDoRenameFailsOverPastWedgedFiler I1117 09:38:21.557339 leveldb_store.go:48 filer store dir: /tmp/TestDoRenameFailsOverPastWedgedFiler260495569/001/meta I1117 09:38:21.557601 file_util.go:29 Folder /tmp/TestDoRenameFailsOverPastWedgedFiler260495569/001/meta Permission: -rwxr-xr-x --- PASS: TestDoRenameFailsOverPastWedgedFiler (0.27s) === RUN TestSanitizeFuseName_InvalidBytesReplaced --- PASS: TestSanitizeFuseName_InvalidBytesReplaced (0.00s) === RUN TestSanitizeFuseName_PassThroughValidUTF8 --- PASS: TestSanitizeFuseName_PassThroughValidUTF8 (0.00s) === RUN TestCheckName_SanitizesBeforeLengthCheck --- PASS: TestCheckName_SanitizesBeforeLengthCheck (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/mount 91.677s === RUN TestApplyMetadataResponseAppliesEventsInOrder I1117 09:36:52.432316 leveldb_store.go:48 filer store dir: /tmp/TestApplyMetadataResponseAppliesEventsInOrder1968395108/001/meta I1117 09:36:52.456810 file_util.go:29 Folder /tmp/TestApplyMetadataResponseAppliesEventsInOrder1968395108/001/meta Permission: -rwxr-xr-x --- PASS: TestApplyMetadataResponseAppliesEventsInOrder (0.57s) === RUN TestApplyMetadataResponseRenamesAcrossCachedDirectories I1117 09:36:53.002740 leveldb_store.go:48 filer store dir: /tmp/TestApplyMetadataResponseRenamesAcrossCachedDirectories507716092/001/meta I1117 09:36:53.003880 file_util.go:29 Folder /tmp/TestApplyMetadataResponseRenamesAcrossCachedDirectories507716092/001/meta Permission: -rwxr-xr-x --- PASS: TestApplyMetadataResponseRenamesAcrossCachedDirectories (0.05s) === RUN TestApplyMetadataResponseLocalOptionsSkipInvalidations I1117 09:36:53.053476 leveldb_store.go:48 filer store dir: /tmp/TestApplyMetadataResponseLocalOptionsSkipInvalidations2642243809/001/meta I1117 09:36:53.053754 file_util.go:29 Folder /tmp/TestApplyMetadataResponseLocalOptionsSkipInvalidations2642243809/001/meta Permission: -rwxr-xr-x --- PASS: TestApplyMetadataResponseLocalOptionsSkipInvalidations (0.10s) === RUN TestApplyMetadataResponseDeduplicatesRepeatedFilerEvent I1117 09:36:53.156882 leveldb_store.go:48 filer store dir: /tmp/TestApplyMetadataResponseDeduplicatesRepeatedFilerEvent2042238242/001/meta I1117 09:36:53.157470 file_util.go:29 Folder /tmp/TestApplyMetadataResponseDeduplicatesRepeatedFilerEvent2042238242/001/meta Permission: -rwxr-xr-x --- PASS: TestApplyMetadataResponseDeduplicatesRepeatedFilerEvent (0.08s) === RUN TestApplyMetadataResponseSkipsHiddenSystemEntryWhenDisabled I1117 09:36:53.234648 leveldb_store.go:48 filer store dir: /tmp/TestApplyMetadataResponseSkipsHiddenSystemEntryWhenDisabled2031497514/001/meta I1117 09:36:53.235191 file_util.go:29 Folder /tmp/TestApplyMetadataResponseSkipsHiddenSystemEntryWhenDisabled2031497514/001/meta Permission: -rwxr-xr-x --- PASS: TestApplyMetadataResponseSkipsHiddenSystemEntryWhenDisabled (0.15s) === RUN TestApplyMetadataResponsePurgesHiddenDestinationPath I1117 09:36:53.386215 leveldb_store.go:48 filer store dir: /tmp/TestApplyMetadataResponsePurgesHiddenDestinationPath1197519245/001/meta I1117 09:36:53.389902 file_util.go:29 Folder /tmp/TestApplyMetadataResponsePurgesHiddenDestinationPath1197519245/001/meta Permission: -rwxr-xr-x --- PASS: TestApplyMetadataResponsePurgesHiddenDestinationPath (0.09s) === RUN TestCollectEntryInvalidationsCarryAuthoritativeEntries --- PASS: TestCollectEntryInvalidationsCarryAuthoritativeEntries (0.00s) === RUN TestUnversionedWriteClearsEntryVersion I1117 09:36:53.488841 leveldb_store.go:48 filer store dir: /tmp/TestUnversionedWriteClearsEntryVersion4256540947/001/meta I1117 09:36:53.489144 file_util.go:29 Folder /tmp/TestUnversionedWriteClearsEntryVersion4256540947/001/meta Permission: -rwxr-xr-x --- PASS: TestUnversionedWriteClearsEntryVersion (0.16s) === RUN TestUnversionedRebuildClearsStaleVersions I1117 09:36:53.657736 leveldb_store.go:48 filer store dir: /tmp/TestUnversionedRebuildClearsStaleVersions944472040/001/meta I1117 09:36:53.658040 file_util.go:29 Folder /tmp/TestUnversionedRebuildClearsStaleVersions944472040/001/meta Permission: -rwxr-xr-x --- PASS: TestUnversionedRebuildClearsStaleVersions (0.17s) === RUN TestTombstonesScopedToCachedDirectories I1117 09:36:53.817148 leveldb_store.go:48 filer store dir: /tmp/TestTombstonesScopedToCachedDirectories1704731325/001/meta I1117 09:36:53.817649 file_util.go:29 Folder /tmp/TestTombstonesScopedToCachedDirectories1704731325/001/meta Permission: -rwxr-xr-x --- PASS: TestTombstonesScopedToCachedDirectories (0.09s) === RUN TestBuildCompletionPrunesSupersededTombstones I1117 09:36:53.907310 leveldb_store.go:48 filer store dir: /tmp/TestBuildCompletionPrunesSupersededTombstones1124163271/001/meta I1117 09:36:53.907801 file_util.go:29 Folder /tmp/TestBuildCompletionPrunesSupersededTombstones1124163271/001/meta Permission: -rwxr-xr-x --- PASS: TestBuildCompletionPrunesSupersededTombstones (0.08s) === RUN TestDirectoryEvictionClearsVersionRecords I1117 09:36:53.988278 leveldb_store.go:48 filer store dir: /tmp/TestDirectoryEvictionClearsVersionRecords3126410619/001/meta I1117 09:36:53.988554 file_util.go:29 Folder /tmp/TestDirectoryEvictionClearsVersionRecords3126410619/001/meta Permission: -rwxr-xr-x --- PASS: TestDirectoryEvictionClearsVersionRecords (0.08s) === RUN TestBuildFloorVersionsChildrenWithoutPerChildRecords I1117 09:36:54.066465 leveldb_store.go:48 filer store dir: /tmp/TestBuildFloorVersionsChildrenWithoutPerChildRecords1689483022/001/meta I1117 09:36:54.066919 file_util.go:29 Folder /tmp/TestBuildFloorVersionsChildrenWithoutPerChildRecords1689483022/001/meta Permission: -rwxr-xr-x --- PASS: TestBuildFloorVersionsChildrenWithoutPerChildRecords (0.06s) === RUN TestExpiredEntryIsJudgedByDirectoryFloor I1117 09:36:54.130528 leveldb_store.go:48 filer store dir: /tmp/TestExpiredEntryIsJudgedByDirectoryFloor1174967301/001/meta I1117 09:36:54.130770 file_util.go:29 Folder /tmp/TestExpiredEntryIsJudgedByDirectoryFloor1174967301/001/meta Permission: -rwxr-xr-x --- PASS: TestExpiredEntryIsJudgedByDirectoryFloor (0.07s) === RUN TestUnversionedWriteDoesNotInheritDirectoryFloor I1117 09:36:54.198721 leveldb_store.go:48 filer store dir: /tmp/TestUnversionedWriteDoesNotInheritDirectoryFloor1994456655/001/meta I1117 09:36:54.198958 file_util.go:29 Folder /tmp/TestUnversionedWriteDoesNotInheritDirectoryFloor1994456655/001/meta Permission: -rwxr-xr-x --- PASS: TestUnversionedWriteDoesNotInheritDirectoryFloor (0.06s) === RUN TestEnsureVisitedReplaysBufferedEventsAfterSnapshot I1117 09:36:54.258262 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedReplaysBufferedEventsAfterSnapshot93895957/001/meta I1117 09:36:54.258539 file_util.go:29 Folder /tmp/TestEnsureVisitedReplaysBufferedEventsAfterSnapshot93895957/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureVisitedReplaysBufferedEventsAfterSnapshot (0.07s) === RUN TestDirectoryNotificationsSuppressedDuringBuild I1117 09:36:54.328527 leveldb_store.go:48 filer store dir: /tmp/TestDirectoryNotificationsSuppressedDuringBuild4086764445/001/meta I1117 09:36:54.328844 file_util.go:29 Folder /tmp/TestDirectoryNotificationsSuppressedDuringBuild4086764445/001/meta Permission: -rwxr-xr-x --- PASS: TestDirectoryNotificationsSuppressedDuringBuild (0.07s) === RUN TestEmptyDirectoryBuildReplaysAllBufferedEvents I1117 09:36:54.403806 leveldb_store.go:48 filer store dir: /tmp/TestEmptyDirectoryBuildReplaysAllBufferedEvents3169264769/001/meta I1117 09:36:54.404098 file_util.go:29 Folder /tmp/TestEmptyDirectoryBuildReplaysAllBufferedEvents3169264769/001/meta Permission: -rwxr-xr-x --- PASS: TestEmptyDirectoryBuildReplaysAllBufferedEvents (0.07s) === RUN TestBuildCompletionSurvivesCallerCancellation I1117 09:36:54.472563 leveldb_store.go:48 filer store dir: /tmp/TestBuildCompletionSurvivesCallerCancellation2352227771/001/meta I1117 09:36:54.472806 file_util.go:29 Folder /tmp/TestBuildCompletionSurvivesCallerCancellation2352227771/001/meta Permission: -rwxr-xr-x --- PASS: TestBuildCompletionSurvivesCallerCancellation (0.06s) === RUN TestBufferedRenameUpdatesOtherDirectoryBeforeBuildCompletes I1117 09:36:54.535585 leveldb_store.go:48 filer store dir: /tmp/TestBufferedRenameUpdatesOtherDirectoryBeforeBuildCompletes771776209/001/meta I1117 09:36:54.535852 file_util.go:29 Folder /tmp/TestBufferedRenameUpdatesOtherDirectoryBeforeBuildCompletes771776209/001/meta Permission: -rwxr-xr-x --- PASS: TestBufferedRenameUpdatesOtherDirectoryBeforeBuildCompletes (0.06s) === RUN TestEnsureVisitedPreservesLocalOnlyEntry I1117 09:36:54.597167 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedPreservesLocalOnlyEntry355709997/001/meta I1117 09:36:54.597415 file_util.go:29 Folder /tmp/TestEnsureVisitedPreservesLocalOnlyEntry355709997/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureVisitedPreservesLocalOnlyEntry (0.06s) === RUN TestEnsureVisitedDropsUnpinnedStaleEntry I1117 09:36:54.662127 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedDropsUnpinnedStaleEntry2198285715/001/meta I1117 09:36:54.662362 file_util.go:29 Folder /tmp/TestEnsureVisitedDropsUnpinnedStaleEntry2198285715/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureVisitedDropsUnpinnedStaleEntry (0.07s) === RUN TestEnsureVisitedConfirmsTransientEmptyListing I1117 09:36:54.737696 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedConfirmsTransientEmptyListing3915257411/001/meta I1117 09:36:54.738009 file_util.go:29 Folder /tmp/TestEnsureVisitedConfirmsTransientEmptyListing3915257411/001/meta Permission: -rwxr-xr-x W1117 09:36:54.790111 meta_cache_init.go:229 rebuild of /dir saw a transient empty listing, recovered 1 entries on confirmation --- PASS: TestEnsureVisitedConfirmsTransientEmptyListing (0.06s) === RUN TestEnsureVisitedCachesGenuinelyEmptyDirectory I1117 09:36:54.800059 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedCachesGenuinelyEmptyDirectory475041993/001/meta I1117 09:36:54.800301 file_util.go:29 Folder /tmp/TestEnsureVisitedCachesGenuinelyEmptyDirectory475041993/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureVisitedCachesGenuinelyEmptyDirectory (0.12s) === RUN TestEnsureVisitedSharedBuildSurvivesOwnerRequestCancel I1117 09:36:54.921805 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedSharedBuildSurvivesOwnerRequestCancel4170232914/001/meta I1117 09:36:54.922089 file_util.go:29 Folder /tmp/TestEnsureVisitedSharedBuildSurvivesOwnerRequestCancel4170232914/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureVisitedSharedBuildSurvivesOwnerRequestCancel (2.07s) === RUN TestApplyLoopInvalidateDoesNotDeadlockWithLockHoldingEnqueuer I1117 09:36:56.990288 leveldb_store.go:48 filer store dir: /tmp/TestApplyLoopInvalidateDoesNotDeadlockWithLockHoldingEnqueuer3673646506/001/meta I1117 09:36:56.990528 file_util.go:29 Folder /tmp/TestApplyLoopInvalidateDoesNotDeadlockWithLockHoldingEnqueuer3673646506/001/meta Permission: -rwxr-xr-x --- PASS: TestApplyLoopInvalidateDoesNotDeadlockWithLockHoldingEnqueuer (0.13s) === RUN TestPurgeSkippedWhileDirectoryBuilding I1117 09:36:57.117385 leveldb_store.go:48 filer store dir: /tmp/TestPurgeSkippedWhileDirectoryBuilding1339474299/001/meta I1117 09:36:57.117587 file_util.go:29 Folder /tmp/TestPurgeSkippedWhileDirectoryBuilding1339474299/001/meta Permission: -rwxr-xr-x --- PASS: TestPurgeSkippedWhileDirectoryBuilding (0.05s) === RUN TestPurgeClearsWhenNotBuilding I1117 09:36:57.168207 leveldb_store.go:48 filer store dir: /tmp/TestPurgeClearsWhenNotBuilding1376962970/001/meta I1117 09:36:57.168446 file_util.go:29 Folder /tmp/TestPurgeClearsWhenNotBuilding1376962970/001/meta Permission: -rwxr-xr-x --- PASS: TestPurgeClearsWhenNotBuilding (0.05s) === RUN TestRenameRemovesSourceAtItsOwnVersion I1117 09:36:57.223640 leveldb_store.go:48 filer store dir: /tmp/TestRenameRemovesSourceAtItsOwnVersion4125007440/001/meta I1117 09:36:57.223837 file_util.go:29 Folder /tmp/TestRenameRemovesSourceAtItsOwnVersion4125007440/001/meta Permission: -rwxr-xr-x --- PASS: TestRenameRemovesSourceAtItsOwnVersion (0.05s) === RUN TestRemovalOlderThanTheRecordStillFences I1117 09:36:57.274968 leveldb_store.go:48 filer store dir: /tmp/TestRemovalOlderThanTheRecordStillFences449046156/001/meta I1117 09:36:57.275176 file_util.go:29 Folder /tmp/TestRemovalOlderThanTheRecordStillFences449046156/001/meta Permission: -rwxr-xr-x --- PASS: TestRemovalOlderThanTheRecordStillFences (0.06s) === RUN TestSectionOf --- PASS: TestSectionOf (0.00s) === RUN TestSectionBurstInvalidatesOnlyItsSection I1117 09:36:57.332569 leveldb_store.go:48 filer store dir: /tmp/TestSectionBurstInvalidatesOnlyItsSection3915329355/001/meta I1117 09:36:57.332821 file_util.go:29 Folder /tmp/TestSectionBurstInvalidatesOnlyItsSection3915329355/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionBurstInvalidatesOnlyItsSection (0.12s) === RUN TestLocalChangesDoNotInvalidateSections I1117 09:36:57.448109 leveldb_store.go:48 filer store dir: /tmp/TestLocalChangesDoNotInvalidateSections4170578534/001/meta I1117 09:36:57.448308 file_util.go:29 Folder /tmp/TestLocalChangesDoNotInvalidateSections4170578534/001/meta Permission: -rwxr-xr-x --- PASS: TestLocalChangesDoNotInvalidateSections (0.17s) === RUN TestSectionRefreshReconciles I1117 09:36:57.623409 leveldb_store.go:48 filer store dir: /tmp/TestSectionRefreshReconciles1455422422/001/meta I1117 09:36:57.623650 file_util.go:29 Folder /tmp/TestSectionRefreshReconciles1455422422/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionRefreshReconciles (0.17s) === RUN TestSectionRefreshSplitsOvergrownSection I1117 09:36:57.796250 leveldb_store.go:48 filer store dir: /tmp/TestSectionRefreshSplitsOvergrownSection2962137455/001/meta I1117 09:36:57.796501 file_util.go:29 Folder /tmp/TestSectionRefreshSplitsOvergrownSection2962137455/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionRefreshSplitsOvergrownSection (1.03s) === RUN TestEnsureListingFreshRefreshesFromFiler I1117 09:36:58.824042 leveldb_store.go:48 filer store dir: /tmp/TestEnsureListingFreshRefreshesFromFiler1880409897/001/meta I1117 09:36:58.824252 file_util.go:29 Folder /tmp/TestEnsureListingFreshRefreshesFromFiler1880409897/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureListingFreshRefreshesFromFiler (1.22s) === RUN TestEnsureListingFreshGivesUpOnOvergrownRange I1117 09:37:00.041531 leveldb_store.go:48 filer store dir: /tmp/TestEnsureListingFreshGivesUpOnOvergrownRange2277604606/001/meta I1117 09:37:00.041742 file_util.go:29 Folder /tmp/TestEnsureListingFreshGivesUpOnOvergrownRange2277604606/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureListingFreshGivesUpOnOvergrownRange (0.68s) === RUN TestSectionNoteChangeWindowExpiry --- PASS: TestSectionNoteChangeWindowExpiry (0.00s) === RUN TestSectionCompleteRefreshGuardsChangedTable --- PASS: TestSectionCompleteRefreshGuardsChangedTable (0.00s) === RUN TestSectionCompleteRefreshSplitsMiddleSection --- PASS: TestSectionCompleteRefreshSplitsMiddleSection (0.01s) === RUN TestSectionFloorFencesAbsentNames I1117 09:37:00.740415 leveldb_store.go:48 filer store dir: /tmp/TestSectionFloorFencesAbsentNames2297606993/001/meta I1117 09:37:00.740631 file_util.go:29 Folder /tmp/TestSectionFloorFencesAbsentNames2297606993/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionFloorFencesAbsentNames (0.17s) === RUN TestUnversionedRefreshStaysStale I1117 09:37:00.907636 leveldb_store.go:48 filer store dir: /tmp/TestUnversionedRefreshStaysStale1814053835/001/meta I1117 09:37:00.907862 file_util.go:29 Folder /tmp/TestUnversionedRefreshStaysStale1814053835/001/meta Permission: -rwxr-xr-x --- PASS: TestUnversionedRefreshStaysStale (0.11s) === RUN TestEnsureListingFreshCoversAllStaleSectionsAhead I1117 09:37:01.016906 leveldb_store.go:48 filer store dir: /tmp/TestEnsureListingFreshCoversAllStaleSectionsAhead3658190364/001/meta I1117 09:37:01.017168 file_util.go:29 Folder /tmp/TestEnsureListingFreshCoversAllStaleSectionsAhead3658190364/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureListingFreshCoversAllStaleSectionsAhead (0.26s) === RUN TestSectionCompleteRefreshSetsFloors --- PASS: TestSectionCompleteRefreshSetsFloors (0.01s) === RUN TestSectionFloorOutranksOlderTombstone I1117 09:37:01.292400 leveldb_store.go:48 filer store dir: /tmp/TestSectionFloorOutranksOlderTombstone2667201516/001/meta I1117 09:37:01.292644 file_util.go:29 Folder /tmp/TestSectionFloorOutranksOlderTombstone2667201516/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionFloorOutranksOlderTombstone (0.15s) === RUN TestMismatchedRefreshLeavesStoreAlone I1117 09:37:01.440598 leveldb_store.go:48 filer store dir: /tmp/TestMismatchedRefreshLeavesStoreAlone1803140829/001/meta I1117 09:37:01.440832 file_util.go:29 Folder /tmp/TestMismatchedRefreshLeavesStoreAlone1803140829/001/meta Permission: -rwxr-xr-x --- PASS: TestMismatchedRefreshLeavesStoreAlone (0.13s) === RUN TestRefreshClearsUnversionedMarker I1117 09:37:01.575775 leveldb_store.go:48 filer store dir: /tmp/TestRefreshClearsUnversionedMarker3080471810/001/meta I1117 09:37:01.575973 file_util.go:29 Folder /tmp/TestRefreshClearsUnversionedMarker3080471810/001/meta Permission: -rwxr-xr-x --- PASS: TestRefreshClearsUnversionedMarker (0.15s) === RUN TestRefreshSkipsBuildingDirectory I1117 09:37:01.723176 leveldb_store.go:48 filer store dir: /tmp/TestRefreshSkipsBuildingDirectory1043476658/001/meta I1117 09:37:01.723412 file_util.go:29 Folder /tmp/TestRefreshSkipsBuildingDirectory1043476658/001/meta Permission: -rwxr-xr-x --- PASS: TestRefreshSkipsBuildingDirectory (0.11s) === RUN TestSectionBorderEntries I1117 09:37:01.836790 leveldb_store.go:48 filer store dir: /tmp/TestSectionBorderEntries2219331168/001/meta I1117 09:37:01.837033 file_util.go:29 Folder /tmp/TestSectionBorderEntries2219331168/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionBorderEntries (0.24s) === RUN TestChurnBeyondBuiltEntriesLandsInEdgeSection I1117 09:37:02.078195 leveldb_store.go:48 filer store dir: /tmp/TestChurnBeyondBuiltEntriesLandsInEdgeSection4101446269/001/meta I1117 09:37:02.078418 file_util.go:29 Folder /tmp/TestChurnBeyondBuiltEntriesLandsInEdgeSection4101446269/001/meta Permission: -rwxr-xr-x --- PASS: TestChurnBeyondBuiltEntriesLandsInEdgeSection (0.12s) === RUN TestRenameAcrossSectionsCountsBoth I1117 09:37:02.198668 leveldb_store.go:48 filer store dir: /tmp/TestRenameAcrossSectionsCountsBoth1036371148/001/meta I1117 09:37:02.198873 file_util.go:29 Folder /tmp/TestRenameAcrossSectionsCountsBoth1036371148/001/meta Permission: -rwxr-xr-x --- PASS: TestRenameAcrossSectionsCountsBoth (0.12s) === RUN TestSectionRefreshSweepsANameRecordedAtTheSnapshot I1117 09:37:02.317329 leveldb_store.go:48 filer store dir: /tmp/TestSectionRefreshSweepsANameRecordedAtTheSnapshot1244598951/001/meta I1117 09:37:02.317524 file_util.go:29 Folder /tmp/TestSectionRefreshSweepsANameRecordedAtTheSnapshot1244598951/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionRefreshSweepsANameRecordedAtTheSnapshot (0.06s) === RUN TestSectionRefreshParksHardLinkBlobContent I1117 09:37:02.377711 leveldb_store.go:48 filer store dir: /tmp/TestSectionRefreshParksHardLinkBlobContent2664453552/001/meta I1117 09:37:02.377957 file_util.go:29 Folder /tmp/TestSectionRefreshParksHardLinkBlobContent2664453552/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionRefreshParksHardLinkBlobContent (0.06s) === RUN TestSectionRefreshReplacesReusedNameOccupant I1117 09:37:02.434825 leveldb_store.go:48 filer store dir: /tmp/TestSectionRefreshReplacesReusedNameOccupant2618607594/001/meta I1117 09:37:02.435033 file_util.go:29 Folder /tmp/TestSectionRefreshReplacesReusedNameOccupant2618607594/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionRefreshReplacesReusedNameOccupant (0.06s) === RUN TestSectionRefreshKeepsOccupantGroupCounter I1117 09:37:02.497469 leveldb_store.go:48 filer store dir: /tmp/TestSectionRefreshKeepsOccupantGroupCounter271191628/001/meta I1117 09:37:02.497697 file_util.go:29 Folder /tmp/TestSectionRefreshKeepsOccupantGroupCounter271191628/001/meta Permission: -rwxr-xr-x --- PASS: TestSectionRefreshKeepsOccupantGroupCounter (0.06s) === RUN TestEnsureNameFreshRefreshesOnlyItsSection I1117 09:37:02.558666 leveldb_store.go:48 filer store dir: /tmp/TestEnsureNameFreshRefreshesOnlyItsSection3128400585/001/meta I1117 09:37:02.558869 file_util.go:29 Folder /tmp/TestEnsureNameFreshRefreshesOnlyItsSection3128400585/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureNameFreshRefreshesOnlyItsSection (0.27s) === RUN TestEnsureVisitedRefusesOversizedDirectory I1117 09:37:02.829248 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedRefusesOversizedDirectory2107352246/001/meta I1117 09:37:02.829464 file_util.go:29 Folder /tmp/TestEnsureVisitedRefusesOversizedDirectory2107352246/001/meta Permission: -rwxr-xr-x I1117 09:37:02.876501 meta_cache_init.go:201 directory /dir exceeds 5 entries, reading it through instead of caching W1117 09:37:02.877831 meta_cache.go:762 unsynchronized dir: /dir --- PASS: TestEnsureVisitedRefusesOversizedDirectory (0.05s) === RUN TestEnsureVisitedStepsOverOversizedAncestor I1117 09:37:02.881431 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedStepsOverOversizedAncestor631699628/001/meta I1117 09:37:02.881616 file_util.go:29 Folder /tmp/TestEnsureVisitedStepsOverOversizedAncestor631699628/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureVisitedStepsOverOversizedAncestor (0.06s) === RUN TestEnsureVisitedUnderTheLimitStillCaches I1117 09:37:02.939305 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedUnderTheLimitStillCaches2294583749/001/meta I1117 09:37:02.939513 file_util.go:29 Folder /tmp/TestEnsureVisitedUnderTheLimitStillCaches2294583749/001/meta Permission: -rwxr-xr-x --- PASS: TestEnsureVisitedUnderTheLimitStillCaches (0.05s) === RUN TestEnsureVisitedAncestorFoundOversizedMidVisit I1117 09:37:02.989277 leveldb_store.go:48 filer store dir: /tmp/TestEnsureVisitedAncestorFoundOversizedMidVisit1550086097/001/meta I1117 09:37:02.989472 file_util.go:29 Folder /tmp/TestEnsureVisitedAncestorFoundOversizedMidVisit1550086097/001/meta Permission: -rwxr-xr-x I1117 09:37:03.040050 meta_cache_init.go:201 directory /huge exceeds 5 entries, reading it through instead of caching --- PASS: TestEnsureVisitedAncestorFoundOversizedMidVisit (0.05s) PASS ok github.com/seaweedfs/seaweedfs/weed/mount/meta_cache 12.839s === RUN TestActivityScoreHandlesFutureTimestamp === RUN TestActivityScoreHandlesFutureTimestamp/MarkRead === RUN TestActivityScoreHandlesFutureTimestamp/MarkWrite === RUN TestActivityScoreHandlesFutureTimestamp/ActivityScore --- PASS: TestActivityScoreHandlesFutureTimestamp (0.02s) --- PASS: TestActivityScoreHandlesFutureTimestamp/MarkRead (0.00s) --- PASS: TestActivityScoreHandlesFutureTimestamp/MarkWrite (0.00s) --- PASS: TestActivityScoreHandlesFutureTimestamp/ActivityScore (0.00s) === RUN Test_PageChunkWrittenIntervalList --- PASS: Test_PageChunkWrittenIntervalList (0.00s) === RUN Test_PageChunkWrittenIntervalList1 --- PASS: Test_PageChunkWrittenIntervalList1 (0.00s) === RUN TestIsContiguouslyWritten === RUN TestIsContiguouslyWritten/empty === RUN TestIsContiguouslyWritten/single_full === RUN TestIsContiguouslyWritten/single_partial_at_start === RUN TestIsContiguouslyWritten/two_adjacent_halves_in_order === RUN TestIsContiguouslyWritten/two_adjacent_halves_out_of_order === RUN TestIsContiguouslyWritten/overlapping_covers_everything === RUN TestIsContiguouslyWritten/three_adjacent_thirds === RUN TestIsContiguouslyWritten/single_partial_in_middle === RUN TestIsContiguouslyWritten/first_byte_missing === RUN TestIsContiguouslyWritten/gap_in_middle === RUN TestIsContiguouslyWritten/two_intervals_with_1-byte_gap === RUN TestIsContiguouslyWritten/three_intervals_with_middle_gap --- PASS: TestIsContiguouslyWritten (0.02s) --- PASS: TestIsContiguouslyWritten/empty (0.00s) --- PASS: TestIsContiguouslyWritten/single_full (0.00s) --- PASS: TestIsContiguouslyWritten/single_partial_at_start (0.00s) --- PASS: TestIsContiguouslyWritten/two_adjacent_halves_in_order (0.00s) --- PASS: TestIsContiguouslyWritten/two_adjacent_halves_out_of_order (0.00s) --- PASS: TestIsContiguouslyWritten/overlapping_covers_everything (0.00s) --- PASS: TestIsContiguouslyWritten/three_adjacent_thirds (0.00s) --- PASS: TestIsContiguouslyWritten/single_partial_in_middle (0.00s) --- PASS: TestIsContiguouslyWritten/first_byte_missing (0.00s) --- PASS: TestIsContiguouslyWritten/gap_in_middle (0.00s) --- PASS: TestIsContiguouslyWritten/two_intervals_with_1-byte_gap (0.00s) --- PASS: TestIsContiguouslyWritten/three_intervals_with_middle_gap (0.00s) === RUN TestIsComplete_AdjacentIntervals === RUN TestIsComplete_AdjacentIntervals/single_full_write === RUN TestIsComplete_AdjacentIntervals/two_adjacent_halves_in_order === RUN TestIsComplete_AdjacentIntervals/two_adjacent_halves_out_of_order === RUN TestIsComplete_AdjacentIntervals/eight_adjacent_eighths === RUN TestIsComplete_AdjacentIntervals/gap_in_the_middle === RUN TestIsComplete_AdjacentIntervals/missing_last_byte === RUN TestIsComplete_AdjacentIntervals/missing_first_byte === RUN TestIsComplete_AdjacentIntervals/overlapping_intervals_covering_everything --- PASS: TestIsComplete_AdjacentIntervals (0.01s) --- PASS: TestIsComplete_AdjacentIntervals/single_full_write (0.00s) --- PASS: TestIsComplete_AdjacentIntervals/two_adjacent_halves_in_order (0.00s) --- PASS: TestIsComplete_AdjacentIntervals/two_adjacent_halves_out_of_order (0.00s) --- PASS: TestIsComplete_AdjacentIntervals/eight_adjacent_eighths (0.00s) --- PASS: TestIsComplete_AdjacentIntervals/gap_in_the_middle (0.00s) --- PASS: TestIsComplete_AdjacentIntervals/missing_last_byte (0.00s) --- PASS: TestIsComplete_AdjacentIntervals/missing_first_byte (0.00s) --- PASS: TestIsComplete_AdjacentIntervals/overlapping_intervals_covering_everything (0.00s) === RUN TestSwapFile_NewSwapFileChunk_Concurrent --- PASS: TestSwapFile_NewSwapFileChunk_Concurrent (0.03s) === RUN TestSwapFile_MkdirAll_Permissions --- PASS: TestSwapFile_MkdirAll_Permissions (0.00s) === RUN TestSwapFile_RecreateDir --- PASS: TestSwapFile_RecreateDir (0.00s) === RUN TestMoveToSealed_ReplaceKeepsUploadReference --- PASS: TestMoveToSealed_ReplaceKeepsUploadReference (0.01s) === RUN TestShutdown_LeavesInFlightUploadItsReference --- PASS: TestShutdown_LeavesInFlightUploadItsReference (0.01s) === RUN TestShutdown_ReleasesWritableReservation --- PASS: TestShutdown_ReleasesWritableReservation (0.01s) === RUN TestSealedChunk_FreeReferenceIsIdempotent --- PASS: TestSealedChunk_FreeReferenceIsIdempotent (0.00s) === RUN TestSaveDataAtFailsWhenSwapFileCannotBeCreated === RUN TestSaveDataAtFailsWhenSwapFileCannotBeCreated/no_write_budget E1117 09:36:51.237631 page_chunk_swapfile.go:72 create swap file in /tmp/TestSaveDataAtFailsWhenSwapFileCannotBeCreatedno_write_budget633487719/001/file/swap: open /tmp/TestSaveDataAtFailsWhenSwapFileCannotBeCreatedno_write_budget633487719/001/file/swap/4061770222: not a directory === RUN TestSaveDataAtFailsWhenSwapFileCannotBeCreated/write_budget E1117 09:36:51.409228 page_chunk_swapfile.go:72 create swap file in /tmp/TestSaveDataAtFailsWhenSwapFileCannotBeCreatedwrite_budget1401207777/001/file/swap: open /tmp/TestSaveDataAtFailsWhenSwapFileCannotBeCreatedwrite_budget1401207777/001/file/swap/2253439472: not a directory --- PASS: TestSaveDataAtFailsWhenSwapFileCannotBeCreated (0.18s) --- PASS: TestSaveDataAtFailsWhenSwapFileCannotBeCreated/no_write_budget (0.16s) --- PASS: TestSaveDataAtFailsWhenSwapFileCannotBeCreated/write_budget (0.02s) === RUN TestSaveDataAtReportsFailedSwapWrite E1117 09:36:51.421355 page_chunk_swapfile.go:125 failed to write swap file /tmp/TestSaveDataAtReportsFailedSwapWrite3736209848/001/1487330195: write /tmp/TestSaveDataAtReportsFailedSwapWrite3736209848/001/1487330195: file already closed --- PASS: TestSaveDataAtReportsFailedSwapWrite (0.01s) === RUN TestUploadPipeline --- PASS: TestUploadPipeline (1450.42s) === RUN TestEvictOneWritableChunk_SkipsGappyChunks --- PASS: TestEvictOneWritableChunk_SkipsGappyChunks (0.03s) === RUN TestEvictOneWritableChunk_FallbackPicksOldestGappy --- PASS: TestEvictOneWritableChunk_FallbackPicksOldestGappy (0.02s) === RUN TestEvictOneWritableChunk_PrefersStrictOverFallback --- PASS: TestEvictOneWritableChunk_PrefersStrictOverFallback (0.01s) === RUN TestProactiveFlush_SkipsGappyChunks --- PASS: TestProactiveFlush_SkipsGappyChunks (0.03s) === RUN TestWriteBufferAccountant_Unlimited --- PASS: TestWriteBufferAccountant_Unlimited (0.00s) === RUN TestWriteBufferAccountant_Nil --- PASS: TestWriteBufferAccountant_Nil (0.00s) === RUN TestWriteBufferAccountant_ReserveAndRelease --- PASS: TestWriteBufferAccountant_ReserveAndRelease (0.00s) === RUN TestWriteBufferAccountant_BlocksWhenOverCap --- PASS: TestWriteBufferAccountant_BlocksWhenOverCap (0.05s) === RUN TestWriteBufferAccountant_SoftThrottle --- PASS: TestWriteBufferAccountant_SoftThrottle (0.01s) === RUN TestWriteBufferAccountant_HardThrottle --- PASS: TestWriteBufferAccountant_HardThrottle (0.05s) === RUN TestWriteBufferAccountant_NoThrottleBelowSoft --- PASS: TestWriteBufferAccountant_NoThrottleBelowSoft (0.00s) === RUN TestWriteBufferAccountant_ThrottleCounters --- PASS: TestWriteBufferAccountant_ThrottleCounters (0.06s) === RUN TestWriteBufferAccountant_GraduatedRecovery --- PASS: TestWriteBufferAccountant_GraduatedRecovery (0.06s) === RUN TestWriteBufferAccountant_AllowsOversizeWhenEmpty --- PASS: TestWriteBufferAccountant_AllowsOversizeWhenEmpty (0.00s) === RUN TestWriteBufferCap_SharedAcrossPipelines write_buffer_cap_integration_test.go:173: peak inflight uploads=4, peak Used()=262144 bytes (cap=262144) --- PASS: TestWriteBufferCap_SharedAcrossPipelines (0.49s) PASS ok github.com/seaweedfs/seaweedfs/weed/mount/page_writer 1452.435s ? github.com/seaweedfs/seaweedfs/weed/mount/unmount [no test files] === RUN TestToErrnoUsesCgofuseNumbering --- PASS: TestToErrnoUsesCgofuseNumbering (0.00s) === RUN TestToErrnoUnknownBecomesEIO --- PASS: TestToErrnoUnknownBecomesEIO (0.00s) === RUN TestToErrnoNeverReturnsPositive --- PASS: TestToErrnoNeverReturnsPositive (0.00s) === RUN TestVolumePrefix === RUN TestVolumePrefix/drive_letter === RUN TestVolumePrefix/directory === RUN TestVolumePrefix/relative_directory === RUN TestVolumePrefix/unc === RUN TestVolumePrefix/unc_trailing_separator === RUN TestVolumePrefix/unc_forward_slashes === RUN TestVolumePrefix/unc_dotted_server === RUN TestVolumePrefix/mountmgr_drive === RUN TestVolumePrefix/extended_drive === RUN TestVolumePrefix/server_only === RUN TestVolumePrefix/too_deep === RUN TestVolumePrefix/empty_server === RUN TestVolumePrefix/empty_share --- PASS: TestVolumePrefix (0.03s) --- PASS: TestVolumePrefix/drive_letter (0.00s) --- PASS: TestVolumePrefix/directory (0.00s) --- PASS: TestVolumePrefix/relative_directory (0.00s) --- PASS: TestVolumePrefix/unc (0.00s) --- PASS: TestVolumePrefix/unc_trailing_separator (0.00s) --- PASS: TestVolumePrefix/unc_forward_slashes (0.00s) --- PASS: TestVolumePrefix/unc_dotted_server (0.00s) --- PASS: TestVolumePrefix/mountmgr_drive (0.00s) --- PASS: TestVolumePrefix/extended_drive (0.00s) --- PASS: TestVolumePrefix/server_only (0.00s) --- PASS: TestVolumePrefix/too_deep (0.00s) --- PASS: TestVolumePrefix/empty_server (0.00s) --- PASS: TestVolumePrefix/empty_share (0.00s) === RUN TestRelativeToMount --- PASS: TestRelativeToMount (0.00s) === RUN TestSplitPath --- PASS: TestSplitPath (0.00s) === RUN TestSplitParent --- PASS: TestSplitParent (0.00s) === RUN TestSplitParentRejectsRoot --- PASS: TestSplitParentRejectsRoot (0.00s) === RUN TestPathCacheLookupAndExpiry --- PASS: TestPathCacheLookupAndExpiry (0.07s) === RUN TestPathCacheStealTransfersOwnership --- PASS: TestPathCacheStealTransfersOwnership (0.11s) === RUN TestPathCacheReplaceReturnsOldReference --- PASS: TestPathCacheReplaceReturnsOldReference (0.08s) === RUN TestPathCachePurgePrefix --- PASS: TestPathCachePurgePrefix (0.00s) === RUN TestPathCacheRootNeverCached --- PASS: TestPathCacheRootNeverCached (0.00s) === RUN TestCacheKey --- PASS: TestCacheKey (0.00s) === RUN TestPathCacheInsertAfterCoveringPurgeIsDiscarded --- PASS: TestPathCacheInsertAfterCoveringPurgeIsDiscarded (0.00s) === RUN TestPathCacheInsertUnderPurgedPrefixIsDiscarded --- PASS: TestPathCacheInsertUnderPurgedPrefixIsDiscarded (0.00s) === RUN TestPathCacheUnrelatedPurgeDoesNotDiscard --- PASS: TestPathCacheUnrelatedPurgeDoesNotDiscard (0.00s) === RUN TestPathCacheInsertOlderThanPurgeWindowIsDiscarded --- PASS: TestPathCacheInsertOlderThanPurgeWindowIsDiscarded (0.01s) === RUN TestPathCacheDiscardedInsertRestsBeforeForget --- PASS: TestPathCacheDiscardedInsertRestsBeforeForget (0.07s) === RUN TestPathCacheRootPurgeCoversEveryInsert --- PASS: TestPathCacheRootPurgeCoversEveryInsert (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/mount/winfsp 1.450s ? github.com/seaweedfs/seaweedfs/weed/mq [no test files] ? github.com/seaweedfs/seaweedfs/weed/mq/agent [no test files] === RUN TestConvertOffsetToMessagePosition === RUN TestConvertOffsetToMessagePosition/reset_to_earliest === RUN TestConvertOffsetToMessagePosition/reset_to_latest === RUN TestConvertOffsetToMessagePosition/exact_offset_zero === RUN TestConvertOffsetToMessagePosition/exact_offset_non-zero === RUN TestConvertOffsetToMessagePosition/exact_timestamp --- PASS: TestConvertOffsetToMessagePosition (0.07s) --- PASS: TestConvertOffsetToMessagePosition/reset_to_earliest (0.01s) --- PASS: TestConvertOffsetToMessagePosition/reset_to_latest (0.00s) --- PASS: TestConvertOffsetToMessagePosition/exact_offset_zero (0.00s) --- PASS: TestConvertOffsetToMessagePosition/exact_offset_non-zero (0.00s) --- PASS: TestConvertOffsetToMessagePosition/exact_timestamp (0.00s) === RUN TestConvertOffsetToMessagePosition_OffsetEncoding === RUN TestConvertOffsetToMessagePosition_OffsetEncoding/offset_10 === RUN TestConvertOffsetToMessagePosition_OffsetEncoding/offset_100 === RUN TestConvertOffsetToMessagePosition_OffsetEncoding/offset_0 === RUN TestConvertOffsetToMessagePosition_OffsetEncoding/offset_42 --- PASS: TestConvertOffsetToMessagePosition_OffsetEncoding (0.01s) --- PASS: TestConvertOffsetToMessagePosition_OffsetEncoding/offset_10 (0.00s) --- PASS: TestConvertOffsetToMessagePosition_OffsetEncoding/offset_100 (0.00s) --- PASS: TestConvertOffsetToMessagePosition_OffsetEncoding/offset_0 (0.00s) --- PASS: TestConvertOffsetToMessagePosition_OffsetEncoding/offset_42 (0.00s) === RUN TestConvertOffsetToMessagePosition_ConsistentResults --- PASS: TestConvertOffsetToMessagePosition_ConsistentResults (0.01s) === RUN TestConvertOffsetToMessagePosition_FixVerification --- PASS: TestConvertOffsetToMessagePosition_FixVerification (0.03s) === RUN TestPartitionIdentityConsistency --- PASS: TestPartitionIdentityConsistency (0.00s) === RUN TestBrokerOffsetManager_GetSubscription_Fixed --- PASS: TestBrokerOffsetManager_GetSubscription_Fixed (0.01s) === RUN TestBrokerOffsetManager_ListActiveSubscriptions_Fixed --- PASS: TestBrokerOffsetManager_ListActiveSubscriptions_Fixed (0.01s) === RUN TestMessageQueueBroker_ListActiveSubscriptions_Fixed --- PASS: TestMessageQueueBroker_ListActiveSubscriptions_Fixed (0.00s) === RUN TestSingleWriterPerPartitionCorrectness --- PASS: TestSingleWriterPerPartitionCorrectness (0.00s) === RUN TestEndToEndWorkflowAfterFixes --- PASS: TestEndToEndWorkflowAfterFixes (0.01s) === RUN TestValidateRecordValue --- PASS: TestValidateRecordValue (0.00s) === RUN TestValidateRecordValueEmptyFields --- PASS: TestValidateRecordValueEmptyFields (0.00s) === RUN TestValidateRecordValueNonKafkaTopic --- PASS: TestValidateRecordValueNonKafkaTopic (0.01s) === RUN TestValidateRecordValueNilInputs --- PASS: TestValidateRecordValueNilInputs (0.00s) === RUN TestRecordValueMarshalUnmarshalIntegration --- PASS: TestRecordValueMarshalUnmarshalIntegration (0.06s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/broker 2.770s ? github.com/seaweedfs/seaweedfs/weed/mq/client/agent_client [no test files] ? github.com/seaweedfs/seaweedfs/weed/mq/client/pub_client [no test files] ? github.com/seaweedfs/seaweedfs/weed/mq/client/sub_client [no test files] ? github.com/seaweedfs/seaweedfs/weed/mq/kafka [no test files] === RUN TestCompressionCodec_String === RUN TestCompressionCodec_String/none === RUN TestCompressionCodec_String/gzip === RUN TestCompressionCodec_String/snappy === RUN TestCompressionCodec_String/lz4 === RUN TestCompressionCodec_String/zstd === RUN TestCompressionCodec_String/unknown(99) --- PASS: TestCompressionCodec_String (0.04s) --- PASS: TestCompressionCodec_String/none (0.01s) --- PASS: TestCompressionCodec_String/gzip (0.00s) --- PASS: TestCompressionCodec_String/snappy (0.00s) --- PASS: TestCompressionCodec_String/lz4 (0.00s) --- PASS: TestCompressionCodec_String/zstd (0.00s) --- PASS: TestCompressionCodec_String/unknown(99) (0.00s) === RUN TestCompressionCodec_IsValid === RUN TestCompressionCodec_IsValid/none === RUN TestCompressionCodec_IsValid/gzip === RUN TestCompressionCodec_IsValid/snappy === RUN TestCompressionCodec_IsValid/lz4 === RUN TestCompressionCodec_IsValid/zstd === RUN TestCompressionCodec_IsValid/unknown(-1) === RUN TestCompressionCodec_IsValid/unknown(5) === RUN TestCompressionCodec_IsValid/unknown(99) --- PASS: TestCompressionCodec_IsValid (0.01s) --- PASS: TestCompressionCodec_IsValid/none (0.00s) --- PASS: TestCompressionCodec_IsValid/gzip (0.00s) --- PASS: TestCompressionCodec_IsValid/snappy (0.00s) --- PASS: TestCompressionCodec_IsValid/lz4 (0.00s) --- PASS: TestCompressionCodec_IsValid/zstd (0.00s) --- PASS: TestCompressionCodec_IsValid/unknown(-1) (0.00s) --- PASS: TestCompressionCodec_IsValid/unknown(5) (0.00s) --- PASS: TestCompressionCodec_IsValid/unknown(99) (0.00s) === RUN TestExtractCompressionCodec === RUN TestExtractCompressionCodec/None === RUN TestExtractCompressionCodec/Gzip === RUN TestExtractCompressionCodec/Snappy === RUN TestExtractCompressionCodec/Lz4 === RUN TestExtractCompressionCodec/Zstd === RUN TestExtractCompressionCodec/Gzip_with_transactional === RUN TestExtractCompressionCodec/Snappy_with_control === RUN TestExtractCompressionCodec/Lz4_with_both_flags --- PASS: TestExtractCompressionCodec (0.01s) --- PASS: TestExtractCompressionCodec/None (0.00s) --- PASS: TestExtractCompressionCodec/Gzip (0.00s) --- PASS: TestExtractCompressionCodec/Snappy (0.00s) --- PASS: TestExtractCompressionCodec/Lz4 (0.00s) --- PASS: TestExtractCompressionCodec/Zstd (0.00s) --- PASS: TestExtractCompressionCodec/Gzip_with_transactional (0.00s) --- PASS: TestExtractCompressionCodec/Snappy_with_control (0.00s) --- PASS: TestExtractCompressionCodec/Lz4_with_both_flags (0.00s) === RUN TestSetCompressionCodec === RUN TestSetCompressionCodec/Set_None === RUN TestSetCompressionCodec/Set_Gzip === RUN TestSetCompressionCodec/Set_Snappy === RUN TestSetCompressionCodec/Set_Lz4 === RUN TestSetCompressionCodec/Set_Zstd === RUN TestSetCompressionCodec/Replace_Gzip_with_Snappy === RUN TestSetCompressionCodec/Set_Gzip_preserving_transactional === RUN TestSetCompressionCodec/Set_Lz4_preserving_control === RUN TestSetCompressionCodec/Set_Zstd_preserving_both_flags --- PASS: TestSetCompressionCodec (0.02s) --- PASS: TestSetCompressionCodec/Set_None (0.00s) --- PASS: TestSetCompressionCodec/Set_Gzip (0.00s) --- PASS: TestSetCompressionCodec/Set_Snappy (0.01s) --- PASS: TestSetCompressionCodec/Set_Lz4 (0.00s) --- PASS: TestSetCompressionCodec/Set_Zstd (0.00s) --- PASS: TestSetCompressionCodec/Replace_Gzip_with_Snappy (0.00s) --- PASS: TestSetCompressionCodec/Set_Gzip_preserving_transactional (0.00s) --- PASS: TestSetCompressionCodec/Set_Lz4_preserving_control (0.00s) --- PASS: TestSetCompressionCodec/Set_Zstd_preserving_both_flags (0.00s) === RUN TestCompress_None --- PASS: TestCompress_None (0.00s) === RUN TestCompress_Gzip --- PASS: TestCompress_Gzip (0.02s) === RUN TestCompress_Snappy --- PASS: TestCompress_Snappy (0.00s) === RUN TestCompress_Lz4 --- PASS: TestCompress_Lz4 (0.18s) === RUN TestCompress_Zstd --- PASS: TestCompress_Zstd (0.07s) === RUN TestCompress_InvalidCodec --- PASS: TestCompress_InvalidCodec (0.01s) === RUN TestDecompress_None --- PASS: TestDecompress_None (0.00s) === RUN TestRoundTrip === RUN TestRoundTrip/none === RUN TestRoundTrip/none/data_0 === RUN TestRoundTrip/none/data_1 === RUN TestRoundTrip/none/data_2 === RUN TestRoundTrip/none/data_3 === RUN TestRoundTrip/none/data_4 === RUN TestRoundTrip/none/data_5 === RUN TestRoundTrip/gzip === RUN TestRoundTrip/gzip/data_0 === RUN TestRoundTrip/gzip/data_1 === RUN TestRoundTrip/gzip/data_2 === RUN TestRoundTrip/gzip/data_3 === RUN TestRoundTrip/gzip/data_4 === RUN TestRoundTrip/gzip/data_5 === RUN TestRoundTrip/snappy === RUN TestRoundTrip/snappy/data_0 === RUN TestRoundTrip/snappy/data_1 === RUN TestRoundTrip/snappy/data_2 === RUN TestRoundTrip/snappy/data_3 === RUN TestRoundTrip/snappy/data_4 === RUN TestRoundTrip/snappy/data_5 === RUN TestRoundTrip/lz4 === RUN TestRoundTrip/lz4/data_0 === RUN TestRoundTrip/lz4/data_1 === RUN TestRoundTrip/lz4/data_2 === RUN TestRoundTrip/lz4/data_3 === RUN TestRoundTrip/lz4/data_4 === RUN TestRoundTrip/lz4/data_5 === RUN TestRoundTrip/zstd === RUN TestRoundTrip/zstd/data_0 === RUN TestRoundTrip/zstd/data_1 === RUN TestRoundTrip/zstd/data_2 === RUN TestRoundTrip/zstd/data_3 === RUN TestRoundTrip/zstd/data_4 === RUN TestRoundTrip/zstd/data_5 --- PASS: TestRoundTrip (0.34s) --- PASS: TestRoundTrip/none (0.02s) --- PASS: TestRoundTrip/none/data_0 (0.00s) --- PASS: TestRoundTrip/none/data_1 (0.00s) --- PASS: TestRoundTrip/none/data_2 (0.00s) --- PASS: TestRoundTrip/none/data_3 (0.00s) --- PASS: TestRoundTrip/none/data_4 (0.00s) --- PASS: TestRoundTrip/none/data_5 (0.00s) --- PASS: TestRoundTrip/gzip (0.04s) --- PASS: TestRoundTrip/gzip/data_0 (0.01s) --- PASS: TestRoundTrip/gzip/data_1 (0.00s) --- PASS: TestRoundTrip/gzip/data_2 (0.00s) --- PASS: TestRoundTrip/gzip/data_3 (0.01s) --- PASS: TestRoundTrip/gzip/data_4 (0.00s) --- PASS: TestRoundTrip/gzip/data_5 (0.00s) --- PASS: TestRoundTrip/snappy (0.01s) --- PASS: TestRoundTrip/snappy/data_0 (0.00s) --- PASS: TestRoundTrip/snappy/data_1 (0.00s) --- PASS: TestRoundTrip/snappy/data_2 (0.00s) --- PASS: TestRoundTrip/snappy/data_3 (0.00s) --- PASS: TestRoundTrip/snappy/data_4 (0.00s) --- PASS: TestRoundTrip/snappy/data_5 (0.00s) --- PASS: TestRoundTrip/lz4 (0.11s) --- PASS: TestRoundTrip/lz4/data_0 (0.09s) --- PASS: TestRoundTrip/lz4/data_1 (0.00s) --- PASS: TestRoundTrip/lz4/data_2 (0.00s) --- PASS: TestRoundTrip/lz4/data_3 (0.00s) --- PASS: TestRoundTrip/lz4/data_4 (0.00s) --- PASS: TestRoundTrip/lz4/data_5 (0.00s) --- PASS: TestRoundTrip/zstd (0.15s) --- PASS: TestRoundTrip/zstd/data_0 (0.03s) --- PASS: TestRoundTrip/zstd/data_1 (0.03s) --- PASS: TestRoundTrip/zstd/data_2 (0.02s) --- PASS: TestRoundTrip/zstd/data_3 (0.03s) --- PASS: TestRoundTrip/zstd/data_4 (0.01s) --- PASS: TestRoundTrip/zstd/data_5 (0.01s) === RUN TestDecompress_InvalidCodec --- PASS: TestDecompress_InvalidCodec (0.00s) === RUN TestDecompress_CorruptedData === RUN TestDecompress_CorruptedData/gzip === RUN TestDecompress_CorruptedData/snappy === RUN TestDecompress_CorruptedData/lz4 === RUN TestDecompress_CorruptedData/zstd --- PASS: TestDecompress_CorruptedData (0.01s) --- PASS: TestDecompress_CorruptedData/gzip (0.00s) --- PASS: TestDecompress_CorruptedData/snappy (0.00s) --- PASS: TestDecompress_CorruptedData/lz4 (0.00s) --- PASS: TestDecompress_CorruptedData/zstd (0.00s) === RUN TestCompressRecordBatch === RUN TestCompressRecordBatch/None_codec === RUN TestCompressRecordBatch/Gzip_codec === RUN TestCompressRecordBatch/Snappy_codec --- PASS: TestCompressRecordBatch (0.01s) --- PASS: TestCompressRecordBatch/None_codec (0.00s) --- PASS: TestCompressRecordBatch/Gzip_codec (0.00s) --- PASS: TestCompressRecordBatch/Snappy_codec (0.00s) === RUN TestDecompressRecordBatch === RUN TestDecompressRecordBatch/None_codec === RUN TestDecompressRecordBatch/Round_trip_with_Gzip === RUN TestDecompressRecordBatch/Round_trip_with_Snappy --- PASS: TestDecompressRecordBatch (0.01s) --- PASS: TestDecompressRecordBatch/None_codec (0.00s) --- PASS: TestDecompressRecordBatch/Round_trip_with_Gzip (0.00s) --- PASS: TestDecompressRecordBatch/Round_trip_with_Snappy (0.00s) === RUN TestCompressionEfficiency === RUN TestCompressionEfficiency/gzip compression_test.go:304: Codec: gzip, Original: 5100 bytes, Compressed: 95 bytes, Ratio: 0.02 === RUN TestCompressionEfficiency/snappy compression_test.go:304: Codec: snappy, Original: 5100 bytes, Compressed: 291 bytes, Ratio: 0.06 === RUN TestCompressionEfficiency/lz4 compression_test.go:304: Codec: lz4, Original: 5100 bytes, Compressed: 112 bytes, Ratio: 0.02 === RUN TestCompressionEfficiency/zstd compression_test.go:304: Codec: zstd, Original: 5100 bytes, Compressed: 68 bytes, Ratio: 0.01 --- PASS: TestCompressionEfficiency (0.07s) --- PASS: TestCompressionEfficiency/gzip (0.01s) --- PASS: TestCompressionEfficiency/snappy (0.00s) --- PASS: TestCompressionEfficiency/lz4 (0.03s) --- PASS: TestCompressionEfficiency/zstd (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/kafka/compression 1.282s === RUN TestRangeAssignmentStrategy --- PASS: TestRangeAssignmentStrategy (0.02s) === RUN TestRangeAssignmentStrategy_UnevenPartitions --- PASS: TestRangeAssignmentStrategy_UnevenPartitions (0.01s) === RUN TestRangeAssignmentStrategy_MultipleTopics --- PASS: TestRangeAssignmentStrategy_MultipleTopics (0.00s) === RUN TestRoundRobinAssignmentStrategy --- PASS: TestRoundRobinAssignmentStrategy (0.00s) === RUN TestRoundRobinAssignmentStrategy_MultipleTopics --- PASS: TestRoundRobinAssignmentStrategy_MultipleTopics (0.00s) === RUN TestGetAssignmentStrategy --- PASS: TestGetAssignmentStrategy (0.00s) === RUN TestConsumerGroup_AssignPartitions --- PASS: TestConsumerGroup_AssignPartitions (0.00s) === RUN TestConsumerGroup_GetMemberAssignments --- PASS: TestConsumerGroup_GetMemberAssignments (0.00s) === RUN TestConsumerGroup_UpdateMemberSubscription --- PASS: TestConsumerGroup_UpdateMemberSubscription (0.00s) === RUN TestAssignmentStrategy_EmptyMembers --- PASS: TestAssignmentStrategy_EmptyMembers (0.00s) === RUN TestCooperativeStickyAssignmentStrategy_Name --- PASS: TestCooperativeStickyAssignmentStrategy_Name (0.00s) === RUN TestCooperativeStickyAssignmentStrategy_InitialAssignment --- PASS: TestCooperativeStickyAssignmentStrategy_InitialAssignment (0.01s) === RUN TestCooperativeStickyAssignmentStrategy_StickyBehavior --- PASS: TestCooperativeStickyAssignmentStrategy_StickyBehavior (0.01s) === RUN TestCooperativeStickyAssignmentStrategy_NewMemberJoin cooperative_sticky_test.go:187: Member1 retained 2 out of 4 original partitions --- PASS: TestCooperativeStickyAssignmentStrategy_NewMemberJoin (0.03s) === RUN TestCooperativeStickyAssignmentStrategy_MemberLeave --- PASS: TestCooperativeStickyAssignmentStrategy_MemberLeave (0.00s) === RUN TestCooperativeStickyAssignmentStrategy_MultipleTopics --- PASS: TestCooperativeStickyAssignmentStrategy_MultipleTopics (0.00s) === RUN TestCooperativeStickyAssignmentStrategy_UnevenPartitions --- PASS: TestCooperativeStickyAssignmentStrategy_UnevenPartitions (0.00s) === RUN TestCooperativeStickyAssignmentStrategy_PartialSubscription --- PASS: TestCooperativeStickyAssignmentStrategy_PartialSubscription (0.00s) === RUN TestGetAssignmentStrategy_CooperativeSticky --- PASS: TestGetAssignmentStrategy_CooperativeSticky (0.00s) === RUN TestGroupCoordinator_CreateGroup --- PASS: TestGroupCoordinator_CreateGroup (0.01s) === RUN TestGroupCoordinator_ValidateSessionTimeout --- PASS: TestGroupCoordinator_ValidateSessionTimeout (0.00s) === RUN TestGroupCoordinator_MemberManagement --- PASS: TestGroupCoordinator_MemberManagement (0.00s) === RUN TestGroupCoordinator_Stats --- PASS: TestGroupCoordinator_Stats (0.00s) === RUN TestGroupCoordinator_Cleanup --- PASS: TestGroupCoordinator_Cleanup (0.01s) === RUN TestGroupCoordinator_GenerateMemberID --- PASS: TestGroupCoordinator_GenerateMemberID (0.01s) === RUN TestGroupCoordinator_EvictExpiredMembersLocked --- PASS: TestGroupCoordinator_EvictExpiredMembersLocked (0.00s) === RUN TestGroupCoordinator_Cleanup_SurvivorsRebalance --- PASS: TestGroupCoordinator_Cleanup_SurvivorsRebalance (0.01s) === RUN TestGroupCoordinator_EvictExpiredMembersLocked_ZeroSessionTimeout --- PASS: TestGroupCoordinator_EvictExpiredMembersLocked_ZeroSessionTimeout (0.00s) === RUN TestIncrementalCooperativeAssignmentStrategy_BasicAssignment incremental_rebalancing_test.go:41: Member member-2 assigned 2 partitions: [{topic-1 2} {topic-1 3}] incremental_rebalancing_test.go:41: Member member-1 assigned 2 partitions: [{topic-1 0} {topic-1 1}] --- PASS: TestIncrementalCooperativeAssignmentStrategy_BasicAssignment (0.02s) === RUN TestIncrementalCooperativeAssignmentStrategy_RebalanceWithRevocation incremental_rebalancing_test.go:106: Revocation phase - Member-1: 2 partitions, Member-2: 0 partitions incremental_rebalancing_test.go:139: Final assignment - Member-1: 2 partitions, Member-2: 2 partitions --- PASS: TestIncrementalCooperativeAssignmentStrategy_RebalanceWithRevocation (0.03s) === RUN TestIncrementalCooperativeAssignmentStrategy_NoRevocationNeeded --- PASS: TestIncrementalCooperativeAssignmentStrategy_NoRevocationNeeded (0.00s) === RUN TestIncrementalCooperativeAssignmentStrategy_MultipleTopics incremental_rebalancing_test.go:244: All assigned partitions: map[topic-1:0:true topic-1:1:true topic-1:2:true topic-2:0:true topic-2:1:true] --- PASS: TestIncrementalCooperativeAssignmentStrategy_MultipleTopics (0.01s) === RUN TestIncrementalCooperativeAssignmentStrategy_ForceComplete --- PASS: TestIncrementalCooperativeAssignmentStrategy_ForceComplete (0.00s) === RUN TestIncrementalCooperativeAssignmentStrategy_RevocationTimeout --- PASS: TestIncrementalCooperativeAssignmentStrategy_RevocationTimeout (0.01s) === RUN TestIncrementalCooperativeAssignmentStrategy_StateTransitions --- PASS: TestIncrementalCooperativeAssignmentStrategy_StateTransitions (0.00s) === RUN TestRebalanceTimeoutManager_CheckRebalanceTimeouts --- PASS: TestRebalanceTimeoutManager_CheckRebalanceTimeouts (0.00s) === RUN TestRebalanceTimeoutManager_SessionTimeoutFallback --- PASS: TestRebalanceTimeoutManager_SessionTimeoutFallback (0.00s) === RUN TestRebalanceTimeoutManager_LeaderEviction --- PASS: TestRebalanceTimeoutManager_LeaderEviction (0.00s) === RUN TestRebalanceTimeoutManager_IsRebalanceStuck --- PASS: TestRebalanceTimeoutManager_IsRebalanceStuck (0.00s) === RUN TestRebalanceTimeoutManager_ForceCompleteRebalance --- PASS: TestRebalanceTimeoutManager_ForceCompleteRebalance (0.00s) === RUN TestRebalanceTimeoutManager_GetRebalanceStatus --- PASS: TestRebalanceTimeoutManager_GetRebalanceStatus (0.00s) === RUN TestRebalanceTimeoutManager_DefaultRebalanceTimeout --- PASS: TestRebalanceTimeoutManager_DefaultRebalanceTimeout (0.00s) === RUN TestGroupCoordinator_StaticMembership --- PASS: TestGroupCoordinator_StaticMembership (0.00s) === RUN TestGroupCoordinator_StaticMemberReconnection --- PASS: TestGroupCoordinator_StaticMemberReconnection (0.00s) === RUN TestGroupCoordinator_StaticMembershipEdgeCases --- PASS: TestGroupCoordinator_StaticMembershipEdgeCases (0.00s) === RUN TestGroupCoordinator_StaticMembershipConcurrency --- PASS: TestGroupCoordinator_StaticMembershipConcurrency (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/kafka/consumer 0.733s === RUN TestMemoryStorageCommitAndFetch --- PASS: TestMemoryStorageCommitAndFetch (0.00s) === RUN TestMemoryStorageFetchNonExistent --- PASS: TestMemoryStorageFetchNonExistent (0.00s) === RUN TestMemoryStorageFetchAllOffsets --- PASS: TestMemoryStorageFetchAllOffsets (0.00s) === RUN TestMemoryStorageDeleteGroup --- PASS: TestMemoryStorageDeleteGroup (0.05s) === RUN TestMemoryStorageListGroups --- PASS: TestMemoryStorageListGroups (0.01s) === RUN TestMemoryStorageConcurrency --- PASS: TestMemoryStorageConcurrency (0.02s) === RUN TestMemoryStorageInvalidInputs --- PASS: TestMemoryStorageInvalidInputs (0.00s) === RUN TestMemoryStorageClosedOperations --- PASS: TestMemoryStorageClosedOperations (0.00s) === RUN TestMemoryStorageOverwrite --- PASS: TestMemoryStorageOverwrite (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/kafka/consumer_offset 2.535s === RUN TestCoordinatorRegistry_DeterministicNodeID --- PASS: TestCoordinatorRegistry_DeterministicNodeID (0.00s) === RUN TestCoordinatorRegistry_BasicOperations --- PASS: TestCoordinatorRegistry_BasicOperations (0.00s) === RUN TestCoordinatorRegistry_AssignCoordinator --- PASS: TestCoordinatorRegistry_AssignCoordinator (0.00s) === RUN TestCoordinatorRegistry_HealthyGateways --- PASS: TestCoordinatorRegistry_HealthyGateways (0.00s) === RUN TestCoordinatorRegistry_ConsistentHashing --- PASS: TestCoordinatorRegistry_ConsistentHashing (0.00s) === RUN TestCoordinatorRegistry_CleanupStaleEntries --- PASS: TestCoordinatorRegistry_CleanupStaleEntries (0.01s) === RUN TestCoordinatorRegistry_GetStats --- PASS: TestCoordinatorRegistry_GetStats (0.00s) === RUN TestCoordinatorRegistry_HeartbeatGateway --- PASS: TestCoordinatorRegistry_HeartbeatGateway (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/kafka/gateway 2.629s === RUN TestNeedsRestart === RUN TestNeedsRestart/Stream_is_nil_-_needs_restart === RUN TestNeedsRestart/Offset_in_cache_-_no_restart_needed === RUN TestNeedsRestart/Offset_before_current_-_needs_restart === RUN TestNeedsRestart/Large_gap_ahead_-_needs_restart === RUN TestNeedsRestart/Small_gap_ahead_-_no_restart_needed === RUN TestNeedsRestart/Exact_match_-_no_restart_needed === RUN TestNeedsRestart/Context_is_nil_-_needs_restart --- PASS: TestNeedsRestart (0.08s) --- PASS: TestNeedsRestart/Stream_is_nil_-_needs_restart (0.00s) --- PASS: TestNeedsRestart/Offset_in_cache_-_no_restart_needed (0.00s) --- PASS: TestNeedsRestart/Offset_before_current_-_needs_restart (0.00s) --- PASS: TestNeedsRestart/Large_gap_ahead_-_needs_restart (0.00s) --- PASS: TestNeedsRestart/Small_gap_ahead_-_no_restart_needed (0.00s) --- PASS: TestNeedsRestart/Exact_match_-_no_restart_needed (0.00s) --- PASS: TestNeedsRestart/Context_is_nil_-_needs_restart (0.00s) === RUN TestNeedsRestart_CacheLogic === RUN TestNeedsRestart_CacheLogic/First_offset_in_cache === RUN TestNeedsRestart_CacheLogic/Middle_offset_in_cache === RUN TestNeedsRestart_CacheLogic/Last_offset_in_cache === RUN TestNeedsRestart_CacheLogic/Before_cache_start === RUN TestNeedsRestart_CacheLogic/Current_position === RUN TestNeedsRestart_CacheLogic/One_ahead === RUN TestNeedsRestart_CacheLogic/Large_gap_>_1000 --- PASS: TestNeedsRestart_CacheLogic (0.06s) --- PASS: TestNeedsRestart_CacheLogic/First_offset_in_cache (0.00s) --- PASS: TestNeedsRestart_CacheLogic/Middle_offset_in_cache (0.00s) --- PASS: TestNeedsRestart_CacheLogic/Last_offset_in_cache (0.00s) --- PASS: TestNeedsRestart_CacheLogic/Before_cache_start (0.00s) --- PASS: TestNeedsRestart_CacheLogic/Current_position (0.00s) --- PASS: TestNeedsRestart_CacheLogic/One_ahead (0.00s) --- PASS: TestNeedsRestart_CacheLogic/Large_gap_>_1000 (0.00s) === RUN TestNeedsRestart_EmptyCache === RUN TestNeedsRestart_EmptyCache/Before_current === RUN TestNeedsRestart_EmptyCache/At_current === RUN TestNeedsRestart_EmptyCache/Small_gap_ahead === RUN TestNeedsRestart_EmptyCache/Large_gap_ahead --- PASS: TestNeedsRestart_EmptyCache (0.01s) --- PASS: TestNeedsRestart_EmptyCache/Before_current (0.00s) --- PASS: TestNeedsRestart_EmptyCache/At_current (0.00s) --- PASS: TestNeedsRestart_EmptyCache/Small_gap_ahead (0.00s) --- PASS: TestNeedsRestart_EmptyCache/Large_gap_ahead (0.00s) === RUN TestNeedsRestart_ThreadSafety --- PASS: TestNeedsRestart_ThreadSafety (0.01s) === RUN TestRestartSubscriber_StateManagement --- PASS: TestRestartSubscriber_StateManagement (0.00s) === RUN TestHealthCheckRetriesPastTransientBrokerErrors --- PASS: TestHealthCheckRetriesPastTransientBrokerErrors (0.76s) === RUN TestHealthCheckGivesUpAtDeadline --- PASS: TestHealthCheckGivesUpAtDeadline (0.75s) === RUN TestMapBrokerErrorToKafka === RUN TestMapBrokerErrorToKafka/No_error === RUN TestMapBrokerErrorToKafka/Unknown_server_error === RUN TestMapBrokerErrorToKafka/Topic_not_found === RUN TestMapBrokerErrorToKafka/Partition_not_found === RUN TestMapBrokerErrorToKafka/Not_leader_or_follower === RUN TestMapBrokerErrorToKafka/Request_timed_out === RUN TestMapBrokerErrorToKafka/Broker_not_available === RUN TestMapBrokerErrorToKafka/Message_too_large === RUN TestMapBrokerErrorToKafka/Network_exception === RUN TestMapBrokerErrorToKafka/Offset_load_in_progress === RUN TestMapBrokerErrorToKafka/Invalid_record === RUN TestMapBrokerErrorToKafka/Topic_already_exists === RUN TestMapBrokerErrorToKafka/Invalid_partitions === RUN TestMapBrokerErrorToKafka/Invalid_config === RUN TestMapBrokerErrorToKafka/Publisher_not_found === RUN TestMapBrokerErrorToKafka/Connection_failed === RUN TestMapBrokerErrorToKafka/Follower_connection_failed === RUN TestMapBrokerErrorToKafka/Unknown_error_code --- PASS: TestMapBrokerErrorToKafka (0.01s) --- PASS: TestMapBrokerErrorToKafka/No_error (0.00s) --- PASS: TestMapBrokerErrorToKafka/Unknown_server_error (0.00s) --- PASS: TestMapBrokerErrorToKafka/Topic_not_found (0.00s) --- PASS: TestMapBrokerErrorToKafka/Partition_not_found (0.00s) --- PASS: TestMapBrokerErrorToKafka/Not_leader_or_follower (0.00s) --- PASS: TestMapBrokerErrorToKafka/Request_timed_out (0.00s) --- PASS: TestMapBrokerErrorToKafka/Broker_not_available (0.00s) --- PASS: TestMapBrokerErrorToKafka/Message_too_large (0.00s) --- PASS: TestMapBrokerErrorToKafka/Network_exception (0.00s) --- PASS: TestMapBrokerErrorToKafka/Offset_load_in_progress (0.00s) --- PASS: TestMapBrokerErrorToKafka/Invalid_record (0.00s) --- PASS: TestMapBrokerErrorToKafka/Topic_already_exists (0.00s) --- PASS: TestMapBrokerErrorToKafka/Invalid_partitions (0.00s) --- PASS: TestMapBrokerErrorToKafka/Invalid_config (0.00s) --- PASS: TestMapBrokerErrorToKafka/Publisher_not_found (0.00s) --- PASS: TestMapBrokerErrorToKafka/Connection_failed (0.00s) --- PASS: TestMapBrokerErrorToKafka/Follower_connection_failed (0.00s) --- PASS: TestMapBrokerErrorToKafka/Unknown_error_code (0.00s) === RUN TestHandleBrokerResponse === RUN TestHandleBrokerResponse/No_error === RUN TestHandleBrokerResponse/Structured_error_-_Not_leader === RUN TestHandleBrokerResponse/Structured_error_-_Topic_not_found === RUN TestHandleBrokerResponse/Fallback_string_parsing_-_Not_leader === RUN TestHandleBrokerResponse/Fallback_string_parsing_-_Topic_not_found === RUN TestHandleBrokerResponse/Fallback_string_parsing_-_Unknown_error --- PASS: TestHandleBrokerResponse (0.01s) --- PASS: TestHandleBrokerResponse/No_error (0.00s) --- PASS: TestHandleBrokerResponse/Structured_error_-_Not_leader (0.00s) --- PASS: TestHandleBrokerResponse/Structured_error_-_Topic_not_found (0.00s) --- PASS: TestHandleBrokerResponse/Fallback_string_parsing_-_Not_leader (0.00s) --- PASS: TestHandleBrokerResponse/Fallback_string_parsing_-_Topic_not_found (0.00s) --- PASS: TestHandleBrokerResponse/Fallback_string_parsing_-_Unknown_error (0.00s) === RUN TestParseStringErrorToKafkaCode === RUN TestParseStringErrorToKafkaCode/Empty_error === RUN TestParseStringErrorToKafkaCode/Not_leader_error === RUN TestParseStringErrorToKafkaCode/Not_leader_error_variant === RUN TestParseStringErrorToKafkaCode/Topic_not_found === RUN TestParseStringErrorToKafkaCode/Topic_does_not_exist === RUN TestParseStringErrorToKafkaCode/Partition_not_found === RUN TestParseStringErrorToKafkaCode/Timeout_error === RUN TestParseStringErrorToKafkaCode/Timeout_error_variant === RUN TestParseStringErrorToKafkaCode/Network_error === RUN TestParseStringErrorToKafkaCode/Connection_error === RUN TestParseStringErrorToKafkaCode/Message_too_large === RUN TestParseStringErrorToKafkaCode/Size_error === RUN TestParseStringErrorToKafkaCode/Unknown_error --- PASS: TestParseStringErrorToKafkaCode (0.01s) --- PASS: TestParseStringErrorToKafkaCode/Empty_error (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Not_leader_error (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Not_leader_error_variant (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Topic_not_found (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Topic_does_not_exist (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Partition_not_found (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Timeout_error (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Timeout_error_variant (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Network_error (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Connection_error (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Message_too_large (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Size_error (0.00s) --- PASS: TestParseStringErrorToKafkaCode/Unknown_error (0.00s) === RUN TestAdaptiveFetchTimeout fetch_performance_test.go:11: Testing adaptive fetch timeout strategy... === RUN TestAdaptiveFetchTimeout/OldStrategy_50ms_Timeout fetch_performance_test.go:32: Record 1 timed out (readTime=150ms > timeout=50ms) fetch_performance_test.go:38: Old strategy: received 0/4 records in 1.081941ms fetch_performance_test.go:43: ✓ Bug reproduced: old strategy times out too quickly === RUN TestAdaptiveFetchTimeout/NewStrategy_1s_Timeout fetch_performance_test.go:56: Record 1 received (readTime=150ms) fetch_performance_test.go:56: Record 2 received (readTime=150ms) fetch_performance_test.go:56: Record 3 received (readTime=150ms) fetch_performance_test.go:56: Record 4 received (readTime=150ms) fetch_performance_test.go:64: New strategy: received 4/4 records in 1.288466ms fetch_performance_test.go:69: ✓ Fix verified: new strategy receives all records === RUN TestAdaptiveFetchTimeout/SchemaRegistry_CatchUp_Scenario fetch_performance_test.go:99: Schema Registry catch-up simulation: fetch_performance_test.go:100: Old strategy: 4 round trips, ~800ms total time fetch_performance_test.go:101: New strategy: 1 round trip, ~600ms total time fetch_performance_test.go:102: Schema Registry timeout: 500ms fetch_performance_test.go:108: ✓ Old strategy exceeds timeout: 800ms > 500ms fetch_performance_test.go:112: ✓ New strategy completes within timeout: 600ms <= 700ms --- PASS: TestAdaptiveFetchTimeout (0.01s) --- PASS: TestAdaptiveFetchTimeout/OldStrategy_50ms_Timeout (0.00s) --- PASS: TestAdaptiveFetchTimeout/NewStrategy_1s_Timeout (0.00s) --- PASS: TestAdaptiveFetchTimeout/SchemaRegistry_CatchUp_Scenario (0.00s) === RUN TestFetchTimeoutProgression fetch_performance_test.go:121: Testing fetch timeout progression... fetch_performance_test.go:134: Timeout progression: fetch_performance_test.go:137: Record 1: timeout = 1s fetch_performance_test.go:137: Record 2: timeout = 1s fetch_performance_test.go:137: Record 3: timeout = 1s fetch_performance_test.go:137: Record 4: timeout = 1s fetch_performance_test.go:137: Record 5: timeout = 1s fetch_performance_test.go:137: Record 6: timeout = 100ms fetch_performance_test.go:137: Record 7: timeout = 100ms fetch_performance_test.go:137: Record 8: timeout = 100ms fetch_performance_test.go:137: Record 9: timeout = 100ms fetch_performance_test.go:137: Record 10: timeout = 100ms fetch_performance_test.go:154: ✓ Timeout progression is correct --- PASS: TestFetchTimeoutProgression (0.00s) === RUN TestSeaweedSMQRecord_Interface --- PASS: TestSeaweedSMQRecord_Interface (0.00s) === RUN TestSeaweedMQHandler_GetStoredRecords_EmptyTopic record_retrieval_test.go:96: Test obsolete: ledgers removed, SMQ broker handles offset management --- SKIP: TestSeaweedMQHandler_GetStoredRecords_EmptyTopic (0.00s) === RUN TestSeaweedMQHandler_GetStoredRecords_EmptyPartition record_retrieval_test.go:102: Test obsolete: ledgers removed, SMQ broker handles offset management --- SKIP: TestSeaweedMQHandler_GetStoredRecords_EmptyPartition (0.00s) === RUN TestSeaweedMQHandler_GetStoredRecords_OffsetBeyondHighWaterMark record_retrieval_test.go:108: Test obsolete: ledgers removed, SMQ broker handles offset management --- SKIP: TestSeaweedMQHandler_GetStoredRecords_OffsetBeyondHighWaterMark (0.00s) === RUN TestSeaweedMQHandler_GetStoredRecords_MaxRecordsLimit record_retrieval_test.go:114: Test obsolete: ledgers removed, SMQ broker handles offset management --- SKIP: TestSeaweedMQHandler_GetStoredRecords_MaxRecordsLimit (0.00s) === RUN TestSeaweedMQHandler_MapSeaweedToKafkaOffsets seaweedmq_handler_test.go:15: Test obsolete: ledger system removed, SMQ uses native offsets --- SKIP: TestSeaweedMQHandler_MapSeaweedToKafkaOffsets (0.00s) === RUN TestSeaweedMQHandler_MapSeaweedToKafkaOffsets_EmptyRecords seaweedmq_handler_test.go:21: Test obsolete: ledger system removed, SMQ uses native offsets --- SKIP: TestSeaweedMQHandler_MapSeaweedToKafkaOffsets_EmptyRecords (0.00s) === RUN TestSeaweedMQHandler_ConvertSeaweedToKafkaRecordBatch seaweedmq_handler_test.go:68: Successfully converted 2 records to 119 byte batch --- PASS: TestSeaweedMQHandler_ConvertSeaweedToKafkaRecordBatch (0.00s) === RUN TestSeaweedMQHandler_ConvertSeaweedToKafkaRecordBatch_EmptyRecords --- PASS: TestSeaweedMQHandler_ConvertSeaweedToKafkaRecordBatch_EmptyRecords (0.00s) === RUN TestSeaweedMQHandler_ConvertSingleSeaweedRecord === RUN TestSeaweedMQHandler_ConvertSingleSeaweedRecord/Record_with_key_and_value seaweedmq_handler_test.go:161: Successfully converted single record: 24 bytes === RUN TestSeaweedMQHandler_ConvertSingleSeaweedRecord/Record_with_null_key seaweedmq_handler_test.go:161: Successfully converted single record: 23 bytes === RUN TestSeaweedMQHandler_ConvertSingleSeaweedRecord/Record_with_empty_value seaweedmq_handler_test.go:161: Successfully converted single record: 26 bytes --- PASS: TestSeaweedMQHandler_ConvertSingleSeaweedRecord (0.00s) --- PASS: TestSeaweedMQHandler_ConvertSingleSeaweedRecord/Record_with_key_and_value (0.00s) --- PASS: TestSeaweedMQHandler_ConvertSingleSeaweedRecord/Record_with_null_key (0.00s) --- PASS: TestSeaweedMQHandler_ConvertSingleSeaweedRecord/Record_with_empty_value (0.00s) === RUN TestSeaweedMQHandler_Creation seaweedmq_handler_test.go:171: Integration test requires real SeaweedMQ Broker - run manually with broker available --- SKIP: TestSeaweedMQHandler_Creation (0.00s) === RUN TestSeaweedMQHandler_TopicLifecycle seaweedmq_handler_test.go:190: Integration test requires real SeaweedMQ Broker - run manually with broker available --- SKIP: TestSeaweedMQHandler_TopicLifecycle (0.00s) === RUN TestSeaweedMQHandler_ProduceRecord seaweedmq_handler_test.go:252: Integration test requires real SeaweedMQ Broker - run manually with broker available --- SKIP: TestSeaweedMQHandler_ProduceRecord (0.00s) === RUN TestSeaweedMQHandler_MultiplePartitions seaweedmq_handler_test.go:297: Integration test requires real SeaweedMQ Broker - run manually with broker available --- SKIP: TestSeaweedMQHandler_MultiplePartitions (0.00s) === RUN TestSeaweedMQHandler_FetchRecords seaweedmq_handler_test.go:341: Integration test requires real SeaweedMQ Broker - run manually with broker available --- SKIP: TestSeaweedMQHandler_FetchRecords (0.00s) === RUN TestSeaweedMQHandler_FetchRecords_ErrorHandling seaweedmq_handler_test.go:435: Integration test requires real SeaweedMQ Broker - run manually with broker available --- SKIP: TestSeaweedMQHandler_FetchRecords_ErrorHandling (0.00s) === RUN TestSeaweedMQHandler_ErrorHandling seaweedmq_handler_test.go:485: Integration test requires real SeaweedMQ Broker - run manually with broker available --- SKIP: TestSeaweedMQHandler_ErrorHandling (0.00s) === RUN TestWaitForFilersWaitsOutEmptyListing --- PASS: TestWaitForFilersWaitsOutEmptyListing (2.00s) === RUN TestWaitForFilersGivesUpWithAnError --- PASS: TestWaitForFilersGivesUpWithAnError (2.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/kafka/integration 8.487s === RUN TestBatchConstruction batch_crc_compat_test.go:24: Batch size: 86 bytes batch_crc_compat_test.go:25: Batch hex: 0000: 00000000000000000000004affffffff 0016: 0273b64ac5000000000000000001a1e8 0032: ddd0cd000001a1e8ddd0cdffffffffff 0048: ffffffffffffffffff00000001300000 0064: 0010746573742d6b657914746573742d 0080: 76616c756500 batch_crc_compat_test.go:33: Stored CRC: 0x73b64ac5 batch_crc_compat_test.go:38: Calculated CRC: 0x73b64ac5 (over 65 bytes) batch_crc_compat_test.go:57: CRC verification PASSED batch_crc_compat_test.go:61: === Batch Structure === batch_crc_compat_test.go:238: Base Offset: 0000000000000000 (value: 0) batch_crc_compat_test.go:238: Batch Length: 0000004a (value: 74) batch_crc_compat_test.go:238: Leader Epoch: ffffffff (value: -1) batch_crc_compat_test.go:238: Magic: 02 (value: 2) batch_crc_compat_test.go:238: CRC: 73b64ac5 (value: 1941326533) batch_crc_compat_test.go:238: Attributes: 0000 (value: 0) batch_crc_compat_test.go:238: Last Offset Delta: 00000000 (value: 0) batch_crc_compat_test.go:238: Base Timestamp: 000001a1e8ddd0cd (value: 1794908213453) batch_crc_compat_test.go:238: Max Timestamp: 000001a1e8ddd0cd (value: 1794908213453) batch_crc_compat_test.go:238: Record Count: 00000001 (value: 1) batch_crc_compat_test.go:79: Batch length correct: 74 --- PASS: TestBatchConstruction (0.02s) === RUN TestMultipleRecordsBatch batch_crc_compat_test.go:93: Batch 1 size: 78, CRC: 0xb7381eb3 batch_crc_compat_test.go:94: Batch 2 size: 78, CRC: 0x9a70ba03 batch_crc_compat_test.go:104: Batch 1 CRC valid batch_crc_compat_test.go:104: Batch 2 CRC valid --- PASS: TestMultipleRecordsBatch (0.00s) === RUN TestVarintEncoding batch_crc_compat_test.go:131: encodeVarint(0) = 00 batch_crc_compat_test.go:131: encodeVarint(1) = 02 batch_crc_compat_test.go:131: encodeVarint(-1) = 01 batch_crc_compat_test.go:131: encodeVarint(5) = 0a batch_crc_compat_test.go:131: encodeVarint(-5) = 09 batch_crc_compat_test.go:131: encodeVarint(127) = fe01 batch_crc_compat_test.go:131: encodeVarint(128) = 8002 batch_crc_compat_test.go:131: encodeVarint(-127) = fd01 batch_crc_compat_test.go:131: encodeVarint(-128) = ff01 --- PASS: TestVarintEncoding (0.01s) === RUN TestClientSideCRCValidation batch_crc_compat_test.go:259: Constructed batch: 86 bytes batch_crc_compat_test.go:268: Client read CRC from header: 0x2433ec33 batch_crc_compat_test.go:272: Client calculated CRC: 0x2433ec33 batch_crc_compat_test.go:280: CLIENT WOULD ACCEPT: CRC valid --- PASS: TestClientSideCRCValidation (0.00s) === RUN TestConcurrentBatchConstruction batch_crc_compat_test.go:316: All 10 concurrent batches have valid CRCs --- PASS: TestConcurrentBatchConstruction (0.00s) === RUN TestProductionBatchConstruction batch_crc_compat_test.go:338: Production batch size: 86 bytes batch_crc_compat_test.go:348: Production batch CRC: stored=0x5650e1ae calculated=0x5650e1ae batch_crc_compat_test.go:354: PRODUCTION CODE CRC VALID --- PASS: TestProductionBatchConstruction (0.00s) === RUN TestHeartbeatResponseFormat_V0 --- PASS: TestHeartbeatResponseFormat_V0 (0.00s) === RUN TestHeartbeatResponseFormat_V1ToV3 === RUN TestHeartbeatResponseFormat_V1ToV3/v1 === RUN TestHeartbeatResponseFormat_V1ToV3/v2 === RUN TestHeartbeatResponseFormat_V1ToV3/v3 --- PASS: TestHeartbeatResponseFormat_V1ToV3 (0.01s) --- PASS: TestHeartbeatResponseFormat_V1ToV3/v1 (0.00s) --- PASS: TestHeartbeatResponseFormat_V1ToV3/v2 (0.00s) --- PASS: TestHeartbeatResponseFormat_V1ToV3/v3 (0.00s) === RUN TestHeartbeatResponseFormat_V4Plus === RUN TestHeartbeatResponseFormat_V4Plus/v4 --- PASS: TestHeartbeatResponseFormat_V4Plus (0.00s) --- PASS: TestHeartbeatResponseFormat_V4Plus/v4 (0.00s) === RUN TestHeartbeatResponseFormat_ErrorCode === RUN TestHeartbeatResponseFormat_ErrorCode/None === RUN TestHeartbeatResponseFormat_ErrorCode/UnknownMemberID === RUN TestHeartbeatResponseFormat_ErrorCode/IllegalGeneration === RUN TestHeartbeatResponseFormat_ErrorCode/RebalanceInProgress --- PASS: TestHeartbeatResponseFormat_ErrorCode (0.00s) --- PASS: TestHeartbeatResponseFormat_ErrorCode/None (0.00s) --- PASS: TestHeartbeatResponseFormat_ErrorCode/UnknownMemberID (0.00s) --- PASS: TestHeartbeatResponseFormat_ErrorCode/IllegalGeneration (0.00s) --- PASS: TestHeartbeatResponseFormat_ErrorCode/RebalanceInProgress (0.00s) === RUN TestHeartbeatResponseFormat_BugReproduce heartbeat_response_format_test.go:157: This test documents the original bug - skip to avoid false failures --- SKIP: TestHeartbeatResponseFormat_BugReproduce (0.00s) === RUN TestMetadataRequestBlocking metadata_blocking_test.go:22: This test documents the original bug. The fix is in the broker's ListTopics with filer timeout. Run TestMetadataRequestWithFastMock to verify fast path works. --- SKIP: TestMetadataRequestBlocking (0.00s) === RUN TestMetadataRequestWithFastMock metadata_blocking_test.go:68: Testing Metadata handler with fast-responding backend... metadata_blocking_test.go:88: ✓ Metadata completed in 2.101375ms (283 bytes) --- PASS: TestMetadataRequestWithFastMock (0.01s) === RUN TestMetadataRequestWithTimeoutFix metadata_blocking_test.go:98: Testing Metadata handler with timeout-aware backend... metadata_blocking_test.go:115: Metadata completed in 2.005035214s metadata_blocking_test.go:121: ✓ Metadata returned response (33 bytes) without blocking --- PASS: TestMetadataRequestWithTimeoutFix (2.01s) === RUN TestOffsetCommitFetchPattern offset_fetch_pattern_test.go:18: Integration test - requires mock broker setup --- SKIP: TestOffsetCommitFetchPattern (0.00s) === RUN TestOffsetFetchAfterCommit offset_fetch_pattern_test.go:98: Integration test - requires mock broker setup --- SKIP: TestOffsetFetchAfterCommit (0.00s) === RUN TestOffsetPersistencePattern offset_fetch_pattern_test.go:126: Integration test - requires mock broker setup --- SKIP: TestOffsetPersistencePattern (0.00s) === RUN TestOffsetCommitConsistency offset_fetch_pattern_test.go:167: Integration test - requires mock broker setup --- SKIP: TestOffsetCommitConsistency (0.00s) === RUN TestLongPollWithOffsetCommit offset_fetch_pattern_test.go:200: Integration test - requires mock broker setup --- SKIP: TestLongPollWithOffsetCommit (0.00s) === RUN TestRecordBatchParser_ParseRecordBatch --- PASS: TestRecordBatchParser_ParseRecordBatch (0.00s) === RUN TestRecordBatchParser_ParseRecordBatch_TooSmall --- PASS: TestRecordBatchParser_ParseRecordBatch_TooSmall (0.00s) === RUN TestRecordBatchParser_ParseRecordBatch_InvalidMagic --- PASS: TestRecordBatchParser_ParseRecordBatch_InvalidMagic (0.00s) === RUN TestRecordBatchParser_Compression === RUN TestRecordBatchParser_Compression/none === RUN TestRecordBatchParser_Compression/gzip === RUN TestRecordBatchParser_Compression/snappy === RUN TestRecordBatchParser_Compression/lz4 === RUN TestRecordBatchParser_Compression/zstd --- PASS: TestRecordBatchParser_Compression (0.11s) --- PASS: TestRecordBatchParser_Compression/none (0.00s) --- PASS: TestRecordBatchParser_Compression/gzip (0.02s) --- PASS: TestRecordBatchParser_Compression/snappy (0.00s) --- PASS: TestRecordBatchParser_Compression/lz4 (0.04s) --- PASS: TestRecordBatchParser_Compression/zstd (0.04s) === RUN TestRecordBatchParser_CRCValidation === RUN TestRecordBatchParser_CRCValidation/Valid_CRC === RUN TestRecordBatchParser_CRCValidation/Invalid_CRC === RUN TestRecordBatchParser_CRCValidation/Skip_CRC_validation --- PASS: TestRecordBatchParser_CRCValidation (0.00s) --- PASS: TestRecordBatchParser_CRCValidation/Valid_CRC (0.00s) --- PASS: TestRecordBatchParser_CRCValidation/Invalid_CRC (0.00s) --- PASS: TestRecordBatchParser_CRCValidation/Skip_CRC_validation (0.00s) === RUN TestRecordBatchParser_ExtractRecords --- PASS: TestRecordBatchParser_ExtractRecords (0.00s) === RUN TestCompressRecordBatch === RUN TestCompressRecordBatch/No_compression === RUN TestCompressRecordBatch/Gzip_compression --- PASS: TestCompressRecordBatch (0.04s) --- PASS: TestCompressRecordBatch/No_compression (0.00s) --- PASS: TestCompressRecordBatch/Gzip_compression (0.04s) === RUN TestCreateRecordBatch === RUN TestCreateRecordBatch/Uncompressed_batch === RUN TestCreateRecordBatch/Compressed_batch --- PASS: TestCreateRecordBatch (0.00s) --- PASS: TestCreateRecordBatch/Uncompressed_batch (0.00s) --- PASS: TestCreateRecordBatch/Compressed_batch (0.00s) === RUN TestRecordBatchParser_InvalidRecordCount --- PASS: TestRecordBatchParser_InvalidRecordCount (0.00s) === RUN TestExtractAllRecords_RealKafkaFormat record_extraction_test.go:125: Created batch of 85 bytes, record value: {"type":"string"} record_extraction_test.go:150: Successfully extracted record with value: {"type":"string"} --- PASS: TestExtractAllRecords_RealKafkaFormat (0.00s) === RUN TestExtractAllRecords_CompressedBatch record_extraction_test.go:157: Compressed batch test - implement after uncompressed works --- SKIP: TestExtractAllRecords_CompressedBatch (0.00s) === RUN TestResponseFormatsNoCorrelationID === RUN TestResponseFormatsNoCorrelationID/ApiVersions_v0 response_format_test.go:153: Testing ApiVersions_v0: ApiVersions v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 18 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/ApiVersions_v4 response_format_test.go:153: Testing ApiVersions_v4: ApiVersions v4 (flexible) should not include correlation ID in body response_format_test.go:160: ✓ API Key 18 Version 4: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/Metadata_v0 response_format_test.go:153: Testing Metadata_v0: Metadata v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 3 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/Metadata_v7 response_format_test.go:153: Testing Metadata_v7: Metadata v7 should not include correlation ID in body response_format_test.go:160: ✓ API Key 3 Version 7: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/FindCoordinator_v0 response_format_test.go:153: Testing FindCoordinator_v0: FindCoordinator v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 10 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/FindCoordinator_v2 response_format_test.go:153: Testing FindCoordinator_v2: FindCoordinator v2 should not include correlation ID in body response_format_test.go:160: ✓ API Key 10 Version 2: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/DescribeConfigs_v0 response_format_test.go:153: Testing DescribeConfigs_v0: DescribeConfigs v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 32 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/DescribeConfigs_v4 response_format_test.go:153: Testing DescribeConfigs_v4: DescribeConfigs v4 (flexible) should not include correlation ID in body response_format_test.go:160: ✓ API Key 32 Version 4: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/DescribeCluster_v0 response_format_test.go:153: Testing DescribeCluster_v0: DescribeCluster v0 (flexible) should not include correlation ID in body response_format_test.go:160: ✓ API Key 60 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/InitProducerId_v0 response_format_test.go:153: Testing InitProducerId_v0: InitProducerId v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 22 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/InitProducerId_v4 response_format_test.go:153: Testing InitProducerId_v4: InitProducerId v4 (flexible) should not include correlation ID in body response_format_test.go:160: ✓ API Key 22 Version 4: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/JoinGroup_v0 response_format_test.go:153: Testing JoinGroup_v0: JoinGroup v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 11 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/SyncGroup_v0 response_format_test.go:153: Testing SyncGroup_v0: SyncGroup v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 14 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/Heartbeat_v0 response_format_test.go:153: Testing Heartbeat_v0: Heartbeat v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 12 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/LeaveGroup_v0 response_format_test.go:153: Testing LeaveGroup_v0: LeaveGroup v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 13 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/OffsetFetch_v0 response_format_test.go:153: Testing OffsetFetch_v0: OffsetFetch v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 9 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/OffsetCommit_v0 response_format_test.go:153: Testing OffsetCommit_v0: OffsetCommit v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 8 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/Produce_v0 response_format_test.go:153: Testing Produce_v0: Produce v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 0 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/Produce_v7 response_format_test.go:153: Testing Produce_v7: Produce v7 should not include correlation ID in body response_format_test.go:160: ✓ API Key 0 Version 7: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/Fetch_v0 response_format_test.go:153: Testing Fetch_v0: Fetch v0 should not include correlation ID in body response_format_test.go:160: ✓ API Key 1 Version 0: Correlation ID should be handled by writeResponseWithHeader === RUN TestResponseFormatsNoCorrelationID/Fetch_v7 response_format_test.go:153: Testing Fetch_v7: Fetch v7 should not include correlation ID in body response_format_test.go:160: ✓ API Key 1 Version 7: Correlation ID should be handled by writeResponseWithHeader --- PASS: TestResponseFormatsNoCorrelationID (0.02s) --- PASS: TestResponseFormatsNoCorrelationID/ApiVersions_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/ApiVersions_v4 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/Metadata_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/Metadata_v7 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/FindCoordinator_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/FindCoordinator_v2 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/DescribeConfigs_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/DescribeConfigs_v4 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/DescribeCluster_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/InitProducerId_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/InitProducerId_v4 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/JoinGroup_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/SyncGroup_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/Heartbeat_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/LeaveGroup_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/OffsetFetch_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/OffsetCommit_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/Produce_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/Produce_v7 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/Fetch_v0 (0.00s) --- PASS: TestResponseFormatsNoCorrelationID/Fetch_v7 (0.00s) === RUN TestFlexibleResponseHeaderFormat === RUN TestFlexibleResponseHeaderFormat/ApiVersions_v0 response_format_test.go:252: ✓ ApiVersions_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/ApiVersions_v3 response_format_test.go:252: ✓ ApiVersions_v3: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/ApiVersions_v4 response_format_test.go:252: ✓ ApiVersions_v4: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Metadata_v0 response_format_test.go:252: ✓ Metadata_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Metadata_v7 response_format_test.go:252: ✓ Metadata_v7: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Metadata_v9 response_format_test.go:252: ✓ Metadata_v9: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/Produce_v0 response_format_test.go:252: ✓ Produce_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Produce_v7 response_format_test.go:252: ✓ Produce_v7: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Produce_v9 response_format_test.go:252: ✓ Produce_v9: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/Fetch_v0 response_format_test.go:252: ✓ Fetch_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Fetch_v7 response_format_test.go:252: ✓ Fetch_v7: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Fetch_v12 response_format_test.go:252: ✓ Fetch_v12: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/FindCoordinator_v0 response_format_test.go:252: ✓ FindCoordinator_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/FindCoordinator_v2 response_format_test.go:252: ✓ FindCoordinator_v2: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/FindCoordinator_v3 response_format_test.go:252: ✓ FindCoordinator_v3: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/JoinGroup_v0 response_format_test.go:252: ✓ JoinGroup_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/JoinGroup_v5 response_format_test.go:252: ✓ JoinGroup_v5: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/JoinGroup_v6 response_format_test.go:252: ✓ JoinGroup_v6: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/SyncGroup_v0 response_format_test.go:252: ✓ SyncGroup_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/SyncGroup_v3 response_format_test.go:252: ✓ SyncGroup_v3: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/SyncGroup_v4 response_format_test.go:252: ✓ SyncGroup_v4: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/Heartbeat_v0 response_format_test.go:252: ✓ Heartbeat_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Heartbeat_v3 response_format_test.go:252: ✓ Heartbeat_v3: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/Heartbeat_v4 response_format_test.go:252: ✓ Heartbeat_v4: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/LeaveGroup_v0 response_format_test.go:252: ✓ LeaveGroup_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/LeaveGroup_v3 response_format_test.go:252: ✓ LeaveGroup_v3: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/LeaveGroup_v4 response_format_test.go:252: ✓ LeaveGroup_v4: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/OffsetFetch_v0 response_format_test.go:252: ✓ OffsetFetch_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/OffsetFetch_v5 response_format_test.go:252: ✓ OffsetFetch_v5: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/OffsetFetch_v6 response_format_test.go:252: ✓ OffsetFetch_v6: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/OffsetCommit_v0 response_format_test.go:252: ✓ OffsetCommit_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/OffsetCommit_v7 response_format_test.go:252: ✓ OffsetCommit_v7: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/OffsetCommit_v8 response_format_test.go:252: ✓ OffsetCommit_v8: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/DescribeConfigs_v0 response_format_test.go:252: ✓ DescribeConfigs_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/DescribeConfigs_v3 response_format_test.go:252: ✓ DescribeConfigs_v3: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/DescribeConfigs_v4 response_format_test.go:252: ✓ DescribeConfigs_v4: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/InitProducerId_v0 response_format_test.go:252: ✓ InitProducerId_v0: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/InitProducerId_v1 response_format_test.go:252: ✓ InitProducerId_v1: correctly identified as flexible=false === RUN TestFlexibleResponseHeaderFormat/InitProducerId_v2 response_format_test.go:252: ✓ InitProducerId_v2: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/DescribeCluster_v0 response_format_test.go:252: ✓ DescribeCluster_v0: correctly identified as flexible=true === RUN TestFlexibleResponseHeaderFormat/DescribeCluster_v1 response_format_test.go:252: ✓ DescribeCluster_v1: correctly identified as flexible=true --- PASS: TestFlexibleResponseHeaderFormat (0.03s) --- PASS: TestFlexibleResponseHeaderFormat/ApiVersions_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/ApiVersions_v3 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/ApiVersions_v4 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Metadata_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Metadata_v7 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Metadata_v9 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Produce_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Produce_v7 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Produce_v9 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Fetch_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Fetch_v7 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Fetch_v12 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/FindCoordinator_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/FindCoordinator_v2 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/FindCoordinator_v3 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/JoinGroup_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/JoinGroup_v5 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/JoinGroup_v6 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/SyncGroup_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/SyncGroup_v3 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/SyncGroup_v4 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Heartbeat_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Heartbeat_v3 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/Heartbeat_v4 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/LeaveGroup_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/LeaveGroup_v3 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/LeaveGroup_v4 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/OffsetFetch_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/OffsetFetch_v5 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/OffsetFetch_v6 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/OffsetCommit_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/OffsetCommit_v7 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/OffsetCommit_v8 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/DescribeConfigs_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/DescribeConfigs_v3 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/DescribeConfigs_v4 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/InitProducerId_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/InitProducerId_v1 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/InitProducerId_v2 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/DescribeCluster_v0 (0.00s) --- PASS: TestFlexibleResponseHeaderFormat/DescribeCluster_v1 (0.00s) === RUN TestCorrelationIDNotInResponseBody === RUN TestCorrelationIDNotInResponseBody/DetectCorrelationIDInBody response_format_test.go:283: ✓ Successfully detected correlation ID in body (bad response) response_format_test.go:294: ✓ Correctly identified response without correlation ID --- PASS: TestCorrelationIDNotInResponseBody (0.00s) --- PASS: TestCorrelationIDNotInResponseBody/DetectCorrelationIDInBody (0.00s) === RUN TestWireProtocolFormat response_format_test.go:301: Kafka Wire Protocol Format (KIP-482): response_format_test.go:302: Non-flexible responses: response_format_test.go:303: [Size: 4 bytes][Correlation ID: 4 bytes][Response Body] response_format_test.go:304: response_format_test.go:305: Flexible responses (header version 1+): response_format_test.go:306: [Size: 4 bytes][Correlation ID: 4 bytes][Tagged Fields: 1+ bytes][Response Body] response_format_test.go:307: response_format_test.go:308: Size field: includes correlation ID + tagged fields + body response_format_test.go:309: Tagged Fields: varint-encoded, 0x00 for empty response_format_test.go:310: response_format_test.go:311: CRITICAL: Response body should NEVER include correlation ID! response_format_test.go:312: It is written ONLY by writeResponseWithHeader --- PASS: TestWireProtocolFormat (0.00s) === RUN TestJoinGroupResponseStructure response_validation_example_test.go:14: This is a demonstration test - shows what we SHOULD check --- SKIP: TestJoinGroupResponseStructure (0.00s) === RUN TestProduceResponseStructure response_validation_example_test.go:48: This is a demonstration test - shows what we SHOULD check --- SKIP: TestProduceResponseStructure (0.00s) === RUN TestCompareWithReferenceImplementation response_validation_example_test.go:64: This would require a reference Kafka broker or client library --- SKIP: TestCompareWithReferenceImplementation (0.00s) === RUN TestCurrentTestingApproach response_validation_example_test.go:82: Current testing strategy (as of Oct 2025): response_validation_example_test.go:83: response_validation_example_test.go:84: LEVEL 1: Static Code Analysis response_validation_example_test.go:85: Tool: check_responses.sh response_validation_example_test.go:86: Checks: Correlation ID patterns response_validation_example_test.go:87: Coverage: Good for known issues response_validation_example_test.go:88: response_validation_example_test.go:89: LEVEL 2: Protocol Format Tests response_validation_example_test.go:90: Tool: TestFlexibleResponseHeaderFormat response_validation_example_test.go:91: Checks: Flexible vs non-flexible classification response_validation_example_test.go:92: Coverage: Header format only response_validation_example_test.go:93: response_validation_example_test.go:94: LEVEL 3: Integration Testing response_validation_example_test.go:95: Tool: Schema Registry, kafka-go, Sarama, Java client response_validation_example_test.go:96: Checks: Real client compatibility response_validation_example_test.go:97: Coverage: Complete but requires manual debugging response_validation_example_test.go:98: response_validation_example_test.go:99: MISSING: Field-level response body validation response_validation_example_test.go:100: This is why JoinGroup issue wasn't caught by unit tests --- PASS: TestCurrentTestingApproach (0.00s) === RUN TestMetadataResponseHasBrokers response_validation_example_test.go:105: Example of what a real field-level test would look like --- SKIP: TestMetadataResponseHasBrokers (0.00s) === RUN TestSyncGroup_RaceCondition_BugDocumentation syncgroup_assignment_test.go:52: Original bug: Non-leader in Stable state would trigger server-side assignment syncgroup_assignment_test.go:53: This caused duplicate partition assignments and message re-reads (66.7% duplicates) syncgroup_assignment_test.go:54: Fix: Check if member is non-leader with empty assignments, regardless of group state --- PASS: TestSyncGroup_RaceCondition_BugDocumentation (0.00s) === RUN TestSyncGroup_FixVerification === RUN TestSyncGroup_FixVerification/Leader_with_assignments syncgroup_assignment_test.go:125: ✓ Leader provides client-side assignments, processes them: isLeader=true hasAssignments=true shouldWait=false === RUN TestSyncGroup_FixVerification/Non-leader_without_assignments_(PreparingRebalance) syncgroup_assignment_test.go:125: ✓ Non-leader waits for leader to provide assignments: isLeader=false hasAssignments=false shouldWait=true === RUN TestSyncGroup_FixVerification/Non-leader_without_assignments_(Stable)_-_THE_BUG_CASE syncgroup_assignment_test.go:125: ✓ Non-leader retrieves assignment from leader (already processed): isLeader=false hasAssignments=false shouldWait=true === RUN TestSyncGroup_FixVerification/Leader_without_assignments syncgroup_assignment_test.go:125: ✓ Edge case: server-side assignment (should not happen with Sarama): isLeader=true hasAssignments=false shouldWait=false --- PASS: TestSyncGroup_FixVerification (0.00s) --- PASS: TestSyncGroup_FixVerification/Leader_with_assignments (0.00s) --- PASS: TestSyncGroup_FixVerification/Non-leader_without_assignments_(PreparingRebalance) (0.00s) --- PASS: TestSyncGroup_FixVerification/Non-leader_without_assignments_(Stable)_-_THE_BUG_CASE (0.00s) --- PASS: TestSyncGroup_FixVerification/Leader_without_assignments (0.00s) === RUN TestParseSyncGroupRequestV5SkipsProtocolFields --- PASS: TestParseSyncGroupRequestV5SkipsProtocolFields (0.00s) === RUN TestSyncGroupSchemaRegistryV5LeaderAssignmentDoesNotRebalance --- PASS: TestSyncGroupSchemaRegistryV5LeaderAssignmentDoesNotRebalance (0.02s) === RUN TestEnsureTopicExistsTreatsAlreadyExistsAsSuccess --- PASS: TestEnsureTopicExistsTreatsAlreadyExistsAsSuccess (0.00s) === RUN TestEnsureTopicExistsReportsGenuineFailure --- PASS: TestEnsureTopicExistsReportsGenuineFailure (0.00s) === RUN TestEnsureTopicExistsWhenPresent --- PASS: TestEnsureTopicExistsWhenPresent (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/kafka/protocol 5.222s === RUN TestNewAvroDecoder === RUN TestNewAvroDecoder/valid_record_schema === RUN TestNewAvroDecoder/valid_enum_schema === RUN TestNewAvroDecoder/invalid_schema === RUN TestNewAvroDecoder/empty_schema --- PASS: TestNewAvroDecoder (0.03s) --- PASS: TestNewAvroDecoder/valid_record_schema (0.01s) --- PASS: TestNewAvroDecoder/valid_enum_schema (0.00s) --- PASS: TestNewAvroDecoder/invalid_schema (0.00s) --- PASS: TestNewAvroDecoder/empty_schema (0.00s) === RUN TestAvroDecoder_Decode --- PASS: TestAvroDecoder_Decode (0.01s) === RUN TestAvroDecoder_DecodeToRecordValue --- PASS: TestAvroDecoder_DecodeToRecordValue (0.00s) === RUN TestMapToRecordValue --- PASS: TestMapToRecordValue (0.00s) === RUN TestGoValueToSchemaValue === RUN TestGoValueToSchemaValue/nil_value === RUN TestGoValueToSchemaValue/bool_value === RUN TestGoValueToSchemaValue/int32_value === RUN TestGoValueToSchemaValue/int64_value === RUN TestGoValueToSchemaValue/string_value === RUN TestGoValueToSchemaValue/bytes_value === RUN TestGoValueToSchemaValue/time_value --- PASS: TestGoValueToSchemaValue (0.01s) --- PASS: TestGoValueToSchemaValue/nil_value (0.00s) --- PASS: TestGoValueToSchemaValue/bool_value (0.00s) --- PASS: TestGoValueToSchemaValue/int32_value (0.00s) --- PASS: TestGoValueToSchemaValue/int64_value (0.00s) --- PASS: TestGoValueToSchemaValue/string_value (0.00s) --- PASS: TestGoValueToSchemaValue/bytes_value (0.00s) --- PASS: TestGoValueToSchemaValue/time_value (0.00s) === RUN TestInferRecordTypeFromMap --- PASS: TestInferRecordTypeFromMap (0.00s) === RUN TestInferTypeFromValue === RUN TestInferTypeFromValue/nil === RUN TestInferTypeFromValue/bool === RUN TestInferTypeFromValue/int32 === RUN TestInferTypeFromValue/int64 === RUN TestInferTypeFromValue/int === RUN TestInferTypeFromValue/float32 === RUN TestInferTypeFromValue/float64 === RUN TestInferTypeFromValue/string === RUN TestInferTypeFromValue/bytes === RUN TestInferTypeFromValue/time --- PASS: TestInferTypeFromValue (0.01s) --- PASS: TestInferTypeFromValue/nil (0.00s) --- PASS: TestInferTypeFromValue/bool (0.00s) --- PASS: TestInferTypeFromValue/int32 (0.00s) --- PASS: TestInferTypeFromValue/int64 (0.00s) --- PASS: TestInferTypeFromValue/int (0.00s) --- PASS: TestInferTypeFromValue/float32 (0.00s) --- PASS: TestInferTypeFromValue/float64 (0.00s) --- PASS: TestInferTypeFromValue/string (0.00s) --- PASS: TestInferTypeFromValue/bytes (0.00s) --- PASS: TestInferTypeFromValue/time (0.00s) === RUN TestAvroDecoder_Integration --- PASS: TestAvroDecoder_Integration (0.02s) === RUN TestBrokerClient_FetchIntegration === RUN TestBrokerClient_FetchIntegration/Fetch_Schema_Integration I1117 09:36:54.071939 connect_to_sub_coordinator.go:33 broker coordinator on localhost:17777: getOrCreateConnection localhost:17777: fail to dial localhost:17777: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) I1117 09:36:54.101283 connect_to_sub_coordinator.go:100 subscriber kafka.fetch-test-topic/kafka-gateway waiting for more assignments broker_client_fetch_test.go:57: Fetch integration test completed - connection failed as expected with mock broker: failed to get subscriber for topic fetch-test-topic: failed to connect to brokers: connection timeout === RUN TestBrokerClient_FetchIntegration/Envelope_Reconstruction broker_client_fetch_test.go:88: Expected error in envelope reconstruction due to schema mismatch: failed to encode RecordValue: failed to encode to Avro binary: cannot encode binary record "FetchTest" field "id": schema does not specify default value and no value provided === RUN TestBrokerClient_FetchIntegration/Subscriber_Management I1117 09:36:54.241555 connect_to_sub_coordinator.go:33 broker coordinator on localhost:17777: getOrCreateConnection localhost:17777: fail to dial localhost:17777: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) I1117 09:36:54.242022 connect_to_sub_coordinator.go:100 subscriber kafka.subscriber-test-topic/kafka-gateway waiting for more assignments broker_client_fetch_test.go:106: Subscriber creation failed as expected with mock brokers: failed to connect to brokers: connection timeout broker_client_fetch_test.go:118: Active subscribers: 0 --- PASS: TestBrokerClient_FetchIntegration (0.43s) --- PASS: TestBrokerClient_FetchIntegration/Fetch_Schema_Integration (0.22s) --- PASS: TestBrokerClient_FetchIntegration/Envelope_Reconstruction (0.06s) --- PASS: TestBrokerClient_FetchIntegration/Subscriber_Management (0.11s) === RUN TestBrokerClient_RoundTripIntegration === RUN TestBrokerClient_RoundTripIntegration/Complete_Schema_Workflow broker_client_fetch_test.go:182: Round-trip test completed - schema validation and processing successful === RUN TestBrokerClient_RoundTripIntegration/Error_Handling_in_Fetch I1117 09:36:54.399288 connect_to_sub_coordinator.go:33 broker coordinator on localhost:17777: getOrCreateConnection localhost:17777: fail to dial localhost:17777: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) I1117 09:36:54.399634 connect_to_sub_coordinator.go:100 subscriber kafka.non-existent-topic/kafka-gateway waiting for more assignments broker_client_fetch_test.go:200: Reconstruction result: failed to encode RecordValue: failed to get schema for encoding: schema registry error 404: {"error_code": 40403, "message": "Schema not found"} --- PASS: TestBrokerClient_RoundTripIntegration (0.16s) --- PASS: TestBrokerClient_RoundTripIntegration/Complete_Schema_Workflow (0.04s) --- PASS: TestBrokerClient_RoundTripIntegration/Error_Handling_in_Fetch (0.11s) === RUN TestBrokerClient_SubscriberConfiguration === RUN TestBrokerClient_SubscriberConfiguration/Subscriber_Cache_Management I1117 09:36:54.523265 connect_to_sub_coordinator.go:33 broker coordinator on localhost:17777: getOrCreateConnection localhost:17777: fail to dial localhost:17777: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) I1117 09:36:54.523561 connect_to_sub_coordinator.go:100 subscriber kafka.cache-test-topic/kafka-gateway waiting for more assignments I1117 09:36:54.625803 connect_to_sub_coordinator.go:33 broker coordinator on localhost:17777: getOrCreateConnection localhost:17777: fail to dial localhost:17777: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) I1117 09:36:54.626112 connect_to_sub_coordinator.go:100 subscriber kafka.cache-test-topic/kafka-gateway waiting for more assignments broker_client_fetch_test.go:230: Subscriber creation results: err1=failed to connect to brokers: connection timeout, err2=failed to connect to brokers: connection timeout broker_client_fetch_test.go:235: Broker client remains functional after subscriber creation attempts === RUN TestBrokerClient_SubscriberConfiguration/Multiple_Topic_Subscribers I1117 09:36:54.733058 connect_to_sub_coordinator.go:33 broker coordinator on localhost:17777: getOrCreateConnection localhost:17777: fail to dial localhost:17777: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) I1117 09:36:54.733410 connect_to_sub_coordinator.go:100 subscriber kafka.topic-a/kafka-gateway waiting for more assignments broker_client_fetch_test.go:244: Subscriber creation for topic-a: failed to connect to brokers: connection timeout I1117 09:36:54.835224 connect_to_sub_coordinator.go:33 broker coordinator on localhost:17777: getOrCreateConnection localhost:17777: fail to dial localhost:17777: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) I1117 09:36:54.835620 connect_to_sub_coordinator.go:100 subscriber kafka.topic-b/kafka-gateway waiting for more assignments broker_client_fetch_test.go:244: Subscriber creation for topic-b: failed to connect to brokers: connection timeout I1117 09:36:54.936779 connect_to_sub_coordinator.go:33 broker coordinator on localhost:17777: getOrCreateConnection localhost:17777: fail to dial localhost:17777: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) I1117 09:36:54.937092 connect_to_sub_coordinator.go:100 subscriber kafka.topic-c/kafka-gateway waiting for more assignments broker_client_fetch_test.go:244: Subscriber creation for topic-c: failed to connect to brokers: connection timeout --- PASS: TestBrokerClient_SubscriberConfiguration (0.52s) --- PASS: TestBrokerClient_SubscriberConfiguration/Subscriber_Cache_Management (0.21s) --- PASS: TestBrokerClient_SubscriberConfiguration/Multiple_Topic_Subscribers (0.31s) === RUN TestBrokerClient_SchematizedMessage === RUN TestBrokerClient_SchematizedMessage/Avro_Schematized_Message broker_client_test.go:78: Known issue: Integer value decoded as 0 instead of 42 broker_client_test.go:87: Successfully validated schematized message with schema ID 1 === RUN TestBrokerClient_SchematizedMessage/RecordType_Creation === RUN TestBrokerClient_SchematizedMessage/Publisher_Stats --- PASS: TestBrokerClient_SchematizedMessage (0.10s) --- PASS: TestBrokerClient_SchematizedMessage/Avro_Schematized_Message (0.07s) --- PASS: TestBrokerClient_SchematizedMessage/RecordType_Creation (0.02s) --- PASS: TestBrokerClient_SchematizedMessage/Publisher_Stats (0.00s) === RUN TestBrokerClient_ErrorHandling === RUN TestBrokerClient_ErrorHandling/Invalid_Schematized_Message === RUN TestBrokerClient_ErrorHandling/Non-Schematized_Message === RUN TestBrokerClient_ErrorHandling/Unknown_Schema_ID === RUN TestBrokerClient_ErrorHandling/Invalid_RecordType_Creation --- PASS: TestBrokerClient_ErrorHandling (0.02s) --- PASS: TestBrokerClient_ErrorHandling/Invalid_Schematized_Message (0.01s) --- PASS: TestBrokerClient_ErrorHandling/Non-Schematized_Message (0.00s) --- PASS: TestBrokerClient_ErrorHandling/Unknown_Schema_ID (0.00s) --- PASS: TestBrokerClient_ErrorHandling/Invalid_RecordType_Creation (0.00s) === RUN TestBrokerClient_Integration === RUN TestBrokerClient_Integration/Multiple_Schema_Formats broker_client_test.go:251: Successfully validated JSON Schema message with schema ID 11 === RUN TestBrokerClient_Integration/Cache_Behavior --- PASS: TestBrokerClient_Integration (0.07s) --- PASS: TestBrokerClient_Integration/Multiple_Schema_Formats (0.05s) --- PASS: TestBrokerClient_Integration/Cache_Behavior (0.01s) === RUN TestBasicSchemaDecodeEncode === RUN TestBasicSchemaDecodeEncode/Simple_Avro_String_Record === RUN TestBasicSchemaDecodeEncode/JSON_Schema_with_String_Field === RUN TestBasicSchemaDecodeEncode/Cache_Performance --- PASS: TestBasicSchemaDecodeEncode (0.05s) --- PASS: TestBasicSchemaDecodeEncode/Simple_Avro_String_Record (0.02s) --- PASS: TestBasicSchemaDecodeEncode/JSON_Schema_with_String_Field (0.02s) --- PASS: TestBasicSchemaDecodeEncode/Cache_Performance (0.01s) === RUN TestSchemaValidation === RUN TestSchemaValidation/Valid_Schema_Message === RUN TestSchemaValidation/Non-Schematized_Message === RUN TestSchemaValidation/Invalid_Envelope --- PASS: TestSchemaValidation (0.02s) --- PASS: TestSchemaValidation/Valid_Schema_Message (0.01s) --- PASS: TestSchemaValidation/Non-Schematized_Message (0.00s) --- PASS: TestSchemaValidation/Invalid_Envelope (0.00s) === RUN TestSchemaDecodeEncode_Avro === RUN TestSchemaDecodeEncode_Avro/Simple_User_Record === RUN TestSchemaDecodeEncode_Avro/Complex_Record_with_Arrays === RUN TestSchemaDecodeEncode_Avro/Union_Types --- PASS: TestSchemaDecodeEncode_Avro (0.06s) --- PASS: TestSchemaDecodeEncode_Avro/Simple_User_Record (0.02s) --- PASS: TestSchemaDecodeEncode_Avro/Complex_Record_with_Arrays (0.02s) --- PASS: TestSchemaDecodeEncode_Avro/Union_Types (0.02s) === RUN TestSchemaDecodeEncode_JSONSchema === RUN TestSchemaDecodeEncode_JSONSchema/Product_Schema === RUN TestSchemaDecodeEncode_JSONSchema/Nested_Object_Schema --- PASS: TestSchemaDecodeEncode_JSONSchema (0.08s) --- PASS: TestSchemaDecodeEncode_JSONSchema/Product_Schema (0.05s) --- PASS: TestSchemaDecodeEncode_JSONSchema/Nested_Object_Schema (0.03s) === RUN TestSchemaDecodeEncode_Protobuf --- PASS: TestSchemaDecodeEncode_Protobuf (0.07s) === RUN TestSchemaDecodeEncode_ErrorHandling === RUN TestSchemaDecodeEncode_ErrorHandling/Invalid_Confluent_Envelope === RUN TestSchemaDecodeEncode_ErrorHandling/Schema_Not_Found === RUN TestSchemaDecodeEncode_ErrorHandling/Invalid_Avro_Data === RUN TestSchemaDecodeEncode_ErrorHandling/Invalid_JSON_Data --- PASS: TestSchemaDecodeEncode_ErrorHandling (0.03s) --- PASS: TestSchemaDecodeEncode_ErrorHandling/Invalid_Confluent_Envelope (0.00s) --- PASS: TestSchemaDecodeEncode_ErrorHandling/Schema_Not_Found (0.01s) --- PASS: TestSchemaDecodeEncode_ErrorHandling/Invalid_Avro_Data (0.01s) --- PASS: TestSchemaDecodeEncode_ErrorHandling/Invalid_JSON_Data (0.01s) === RUN TestSchemaDecodeEncode_CachePerformance --- PASS: TestSchemaDecodeEncode_CachePerformance (0.02s) === RUN TestParseConfluentEnvelope === RUN TestParseConfluentEnvelope/valid_Avro_message === RUN TestParseConfluentEnvelope/valid_message_with_larger_schema_ID === RUN TestParseConfluentEnvelope/too_short_message === RUN TestParseConfluentEnvelope/no_magic_byte === RUN TestParseConfluentEnvelope/empty_message === RUN TestParseConfluentEnvelope/minimal_valid_message --- PASS: TestParseConfluentEnvelope (0.00s) --- PASS: TestParseConfluentEnvelope/valid_Avro_message (0.00s) --- PASS: TestParseConfluentEnvelope/valid_message_with_larger_schema_ID (0.00s) --- PASS: TestParseConfluentEnvelope/too_short_message (0.00s) --- PASS: TestParseConfluentEnvelope/no_magic_byte (0.00s) --- PASS: TestParseConfluentEnvelope/empty_message (0.00s) --- PASS: TestParseConfluentEnvelope/minimal_valid_message (0.00s) === RUN TestIsSchematized === RUN TestIsSchematized/schematized_message === RUN TestIsSchematized/non-schematized_message === RUN TestIsSchematized/empty_message --- PASS: TestIsSchematized (0.00s) --- PASS: TestIsSchematized/schematized_message (0.00s) --- PASS: TestIsSchematized/non-schematized_message (0.00s) --- PASS: TestIsSchematized/empty_message (0.00s) === RUN TestExtractSchemaID === RUN TestExtractSchemaID/valid_schema_ID === RUN TestExtractSchemaID/large_schema_ID === RUN TestExtractSchemaID/no_magic_byte === RUN TestExtractSchemaID/too_short --- PASS: TestExtractSchemaID (0.00s) --- PASS: TestExtractSchemaID/valid_schema_ID (0.00s) --- PASS: TestExtractSchemaID/large_schema_ID (0.00s) --- PASS: TestExtractSchemaID/no_magic_byte (0.00s) --- PASS: TestExtractSchemaID/too_short (0.00s) === RUN TestCreateConfluentEnvelope === RUN TestCreateConfluentEnvelope/simple_Avro_message === RUN TestCreateConfluentEnvelope/large_schema_ID === RUN TestCreateConfluentEnvelope/empty_payload --- PASS: TestCreateConfluentEnvelope (0.00s) --- PASS: TestCreateConfluentEnvelope/simple_Avro_message (0.00s) --- PASS: TestCreateConfluentEnvelope/large_schema_ID (0.00s) --- PASS: TestCreateConfluentEnvelope/empty_payload (0.00s) === RUN TestEnvelopeValidate === RUN TestEnvelopeValidate/valid_Avro_envelope === RUN TestEnvelopeValidate/zero_schema_ID === RUN TestEnvelopeValidate/empty_payload === RUN TestEnvelopeValidate/unknown_format --- PASS: TestEnvelopeValidate (0.00s) --- PASS: TestEnvelopeValidate/valid_Avro_envelope (0.00s) --- PASS: TestEnvelopeValidate/zero_schema_ID (0.00s) --- PASS: TestEnvelopeValidate/empty_payload (0.00s) --- PASS: TestEnvelopeValidate/unknown_format (0.00s) === RUN TestEnvelopeMetadata --- PASS: TestEnvelopeMetadata (0.00s) === RUN TestEncodeDecodeVarint === RUN TestEncodeDecodeVarint/zero === RUN TestEncodeDecodeVarint/small === RUN TestEncodeDecodeVarint/medium === RUN TestEncodeDecodeVarint/large === RUN TestEncodeDecodeVarint/very_large === RUN TestEncodeDecodeVarint/max_uint32 --- PASS: TestEncodeDecodeVarint (0.01s) --- PASS: TestEncodeDecodeVarint/zero (0.00s) --- PASS: TestEncodeDecodeVarint/small (0.00s) --- PASS: TestEncodeDecodeVarint/medium (0.00s) --- PASS: TestEncodeDecodeVarint/large (0.00s) --- PASS: TestEncodeDecodeVarint/very_large (0.00s) --- PASS: TestEncodeDecodeVarint/max_uint32 (0.00s) === RUN TestCreateConfluentEnvelopeWithProtobufIndexes === RUN TestCreateConfluentEnvelopeWithProtobufIndexes/avro_no_indexes === RUN TestCreateConfluentEnvelopeWithProtobufIndexes/protobuf_no_indexes === RUN TestCreateConfluentEnvelopeWithProtobufIndexes/protobuf_single_index === RUN TestCreateConfluentEnvelopeWithProtobufIndexes/protobuf_multiple_indexes --- PASS: TestCreateConfluentEnvelopeWithProtobufIndexes (0.01s) --- PASS: TestCreateConfluentEnvelopeWithProtobufIndexes/avro_no_indexes (0.00s) --- PASS: TestCreateConfluentEnvelopeWithProtobufIndexes/protobuf_no_indexes (0.00s) --- PASS: TestCreateConfluentEnvelopeWithProtobufIndexes/protobuf_single_index (0.00s) --- PASS: TestCreateConfluentEnvelopeWithProtobufIndexes/protobuf_multiple_indexes (0.00s) === RUN TestProtobufEnvelopeRoundTrip --- PASS: TestProtobufEnvelopeRoundTrip (0.00s) === RUN TestVarintEdgeCases === RUN TestVarintEdgeCases/empty_data === RUN TestVarintEdgeCases/incomplete_varint === RUN TestVarintEdgeCases/max_varint_length --- PASS: TestVarintEdgeCases (0.00s) --- PASS: TestVarintEdgeCases/empty_data (0.00s) --- PASS: TestVarintEdgeCases/incomplete_varint (0.00s) --- PASS: TestVarintEdgeCases/max_varint_length (0.00s) === RUN TestProtobufEnvelopeValidation === RUN TestProtobufEnvelopeValidation/valid_envelope === RUN TestProtobufEnvelopeValidation/zero_schema_id === RUN TestProtobufEnvelopeValidation/empty_payload --- PASS: TestProtobufEnvelopeValidation (0.00s) --- PASS: TestProtobufEnvelopeValidation/valid_envelope (0.00s) --- PASS: TestProtobufEnvelopeValidation/zero_schema_id (0.00s) --- PASS: TestProtobufEnvelopeValidation/empty_payload (0.00s) === RUN TestSchemaEvolutionChecker_AvroBackwardCompatibility === RUN TestSchemaEvolutionChecker_AvroBackwardCompatibility/Compatible_-_Add_optional_field === RUN TestSchemaEvolutionChecker_AvroBackwardCompatibility/Incompatible_-_Remove_field === RUN TestSchemaEvolutionChecker_AvroBackwardCompatibility/Incompatible_-_Add_required_field === RUN TestSchemaEvolutionChecker_AvroBackwardCompatibility/Compatible_-_Type_promotion --- PASS: TestSchemaEvolutionChecker_AvroBackwardCompatibility (0.02s) --- PASS: TestSchemaEvolutionChecker_AvroBackwardCompatibility/Compatible_-_Add_optional_field (0.01s) --- PASS: TestSchemaEvolutionChecker_AvroBackwardCompatibility/Incompatible_-_Remove_field (0.00s) --- PASS: TestSchemaEvolutionChecker_AvroBackwardCompatibility/Incompatible_-_Add_required_field (0.00s) --- PASS: TestSchemaEvolutionChecker_AvroBackwardCompatibility/Compatible_-_Type_promotion (0.00s) === RUN TestSchemaEvolutionChecker_AvroForwardCompatibility === RUN TestSchemaEvolutionChecker_AvroForwardCompatibility/Compatible_-_Remove_optional_field === RUN TestSchemaEvolutionChecker_AvroForwardCompatibility/Incompatible_-_Add_field_without_default_in_old_schema --- PASS: TestSchemaEvolutionChecker_AvroForwardCompatibility (0.01s) --- PASS: TestSchemaEvolutionChecker_AvroForwardCompatibility/Compatible_-_Remove_optional_field (0.00s) --- PASS: TestSchemaEvolutionChecker_AvroForwardCompatibility/Incompatible_-_Add_field_without_default_in_old_schema (0.00s) === RUN TestSchemaEvolutionChecker_AvroFullCompatibility === RUN TestSchemaEvolutionChecker_AvroFullCompatibility/Compatible_-_Add_optional_field_with_default === RUN TestSchemaEvolutionChecker_AvroFullCompatibility/Incompatible_-_Remove_field --- PASS: TestSchemaEvolutionChecker_AvroFullCompatibility (0.01s) --- PASS: TestSchemaEvolutionChecker_AvroFullCompatibility/Compatible_-_Add_optional_field_with_default (0.00s) --- PASS: TestSchemaEvolutionChecker_AvroFullCompatibility/Incompatible_-_Remove_field (0.00s) === RUN TestSchemaEvolutionChecker_JSONSchemaCompatibility === RUN TestSchemaEvolutionChecker_JSONSchemaCompatibility/Compatible_-_Add_optional_property === RUN TestSchemaEvolutionChecker_JSONSchemaCompatibility/Incompatible_-_Add_required_property === RUN TestSchemaEvolutionChecker_JSONSchemaCompatibility/Incompatible_-_Remove_property --- PASS: TestSchemaEvolutionChecker_JSONSchemaCompatibility (0.01s) --- PASS: TestSchemaEvolutionChecker_JSONSchemaCompatibility/Compatible_-_Add_optional_property (0.00s) --- PASS: TestSchemaEvolutionChecker_JSONSchemaCompatibility/Incompatible_-_Add_required_property (0.00s) --- PASS: TestSchemaEvolutionChecker_JSONSchemaCompatibility/Incompatible_-_Remove_property (0.00s) === RUN TestSchemaEvolutionChecker_ProtobufCompatibility === RUN TestSchemaEvolutionChecker_ProtobufCompatibility/Simplified_Protobuf_check --- PASS: TestSchemaEvolutionChecker_ProtobufCompatibility (0.00s) --- PASS: TestSchemaEvolutionChecker_ProtobufCompatibility/Simplified_Protobuf_check (0.00s) === RUN TestSchemaEvolutionChecker_NoCompatibility --- PASS: TestSchemaEvolutionChecker_NoCompatibility (0.00s) === RUN TestSchemaEvolutionChecker_TypePromotion === RUN TestSchemaEvolutionChecker_TypePromotion/int_to_long === RUN TestSchemaEvolutionChecker_TypePromotion/int_to_float === RUN TestSchemaEvolutionChecker_TypePromotion/int_to_double === RUN TestSchemaEvolutionChecker_TypePromotion/long_to_float === RUN TestSchemaEvolutionChecker_TypePromotion/long_to_double === RUN TestSchemaEvolutionChecker_TypePromotion/float_to_double === RUN TestSchemaEvolutionChecker_TypePromotion/string_to_bytes === RUN TestSchemaEvolutionChecker_TypePromotion/bytes_to_string === RUN TestSchemaEvolutionChecker_TypePromotion/long_to_int === RUN TestSchemaEvolutionChecker_TypePromotion/double_to_float === RUN TestSchemaEvolutionChecker_TypePromotion/string_to_int --- PASS: TestSchemaEvolutionChecker_TypePromotion (0.01s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/int_to_long (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/int_to_float (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/int_to_double (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/long_to_float (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/long_to_double (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/float_to_double (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/string_to_bytes (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/bytes_to_string (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/long_to_int (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/double_to_float (0.00s) --- PASS: TestSchemaEvolutionChecker_TypePromotion/string_to_int (0.00s) === RUN TestSchemaEvolutionChecker_SuggestEvolution === RUN TestSchemaEvolutionChecker_SuggestEvolution/Compatible_schema === RUN TestSchemaEvolutionChecker_SuggestEvolution/Incompatible_schema_with_suggestions --- PASS: TestSchemaEvolutionChecker_SuggestEvolution (0.01s) --- PASS: TestSchemaEvolutionChecker_SuggestEvolution/Compatible_schema (0.00s) --- PASS: TestSchemaEvolutionChecker_SuggestEvolution/Incompatible_schema_with_suggestions (0.00s) === RUN TestSchemaEvolutionChecker_CanEvolve --- PASS: TestSchemaEvolutionChecker_CanEvolve (0.00s) === RUN TestSchemaEvolutionChecker_ExtractFields === RUN TestSchemaEvolutionChecker_ExtractFields/Extract_Avro_fields === RUN TestSchemaEvolutionChecker_ExtractFields/Extract_JSON_Schema_required_fields === RUN TestSchemaEvolutionChecker_ExtractFields/Extract_JSON_Schema_properties --- PASS: TestSchemaEvolutionChecker_ExtractFields (0.01s) --- PASS: TestSchemaEvolutionChecker_ExtractFields/Extract_Avro_fields (0.00s) --- PASS: TestSchemaEvolutionChecker_ExtractFields/Extract_JSON_Schema_required_fields (0.00s) --- PASS: TestSchemaEvolutionChecker_ExtractFields/Extract_JSON_Schema_properties (0.00s) === RUN TestFullIntegration_AvroWorkflow === RUN TestFullIntegration_AvroWorkflow/Producer_Workflow integration_test.go:88: Successfully processed producer message with 5 fields === RUN TestFullIntegration_AvroWorkflow/Consumer_Workflow integration_test.go:140: Successfully reconstructed consumer message: 38 bytes === RUN TestFullIntegration_AvroWorkflow/Round_Trip_Integrity integration_test.go:203: Round-trip integrity test passed --- PASS: TestFullIntegration_AvroWorkflow (0.05s) --- PASS: TestFullIntegration_AvroWorkflow/Producer_Workflow (0.02s) --- PASS: TestFullIntegration_AvroWorkflow/Consumer_Workflow (0.01s) --- PASS: TestFullIntegration_AvroWorkflow/Round_Trip_Integrity (0.01s) === RUN TestFullIntegration_MultiFormatSupport === RUN TestFullIntegration_MultiFormatSupport/Avro_Format integration_test.go:281: Successfully processed Avro_Format format === RUN TestFullIntegration_MultiFormatSupport/JSON_Schema_Format integration_test.go:281: Successfully processed JSON_Schema_Format format --- PASS: TestFullIntegration_MultiFormatSupport (0.04s) --- PASS: TestFullIntegration_MultiFormatSupport/Avro_Format (0.02s) --- PASS: TestFullIntegration_MultiFormatSupport/JSON_Schema_Format (0.01s) === RUN TestIntegration_CachePerformance integration_test.go:343: Cache performance: First decode: 14.019105ms, Average cached: 4.582129ms integration_test.go:345: Cache stats: 1 decoders, 1 schemas, 0 subjects --- PASS: TestIntegration_CachePerformance (0.48s) === RUN TestIntegration_ErrorHandling === RUN TestIntegration_ErrorHandling/Non_Schematized_Message integration_test.go:405: Expected error occurred: message is not schematized === RUN TestIntegration_ErrorHandling/Invalid_Schema_ID integration_test.go:405: Expected error occurred: failed to get schema 999: schema registry error 404: === RUN TestIntegration_ErrorHandling/Empty_Payload integration_test.go:405: Expected error occurred: invalid envelope: empty payload === RUN TestIntegration_ErrorHandling/Corrupted_Avro_Data integration_test.go:405: Expected error occurred: failed to decode Avro message: strict validation failed: failed to decode Avro data: cannot decode binary record "User" field "name": cannot decode binary string: cannot decode binary bytes: short buffer --- PASS: TestIntegration_ErrorHandling (0.02s) --- PASS: TestIntegration_ErrorHandling/Non_Schematized_Message (0.00s) --- PASS: TestIntegration_ErrorHandling/Invalid_Schema_ID (0.01s) --- PASS: TestIntegration_ErrorHandling/Empty_Payload (0.00s) --- PASS: TestIntegration_ErrorHandling/Corrupted_Avro_Data (0.01s) === RUN TestIntegration_SchemaEvolution === RUN TestIntegration_SchemaEvolution/Schema_V1_Message === RUN TestIntegration_SchemaEvolution/Schema_V2_Message --- PASS: TestIntegration_SchemaEvolution (0.02s) --- PASS: TestIntegration_SchemaEvolution/Schema_V1_Message (0.01s) --- PASS: TestIntegration_SchemaEvolution/Schema_V2_Message (0.01s) === RUN TestNewJSONSchemaDecoder === RUN TestNewJSONSchemaDecoder/valid_object_schema === RUN TestNewJSONSchemaDecoder/valid_array_schema === RUN TestNewJSONSchemaDecoder/valid_string_schema_with_format === RUN TestNewJSONSchemaDecoder/invalid_JSON === RUN TestNewJSONSchemaDecoder/empty_schema --- PASS: TestNewJSONSchemaDecoder (0.01s) --- PASS: TestNewJSONSchemaDecoder/valid_object_schema (0.00s) --- PASS: TestNewJSONSchemaDecoder/valid_array_schema (0.00s) --- PASS: TestNewJSONSchemaDecoder/valid_string_schema_with_format (0.00s) --- PASS: TestNewJSONSchemaDecoder/invalid_JSON (0.00s) --- PASS: TestNewJSONSchemaDecoder/empty_schema (0.00s) === RUN TestJSONSchemaDecoder_Decode === RUN TestJSONSchemaDecoder_Decode/valid_complete_data === RUN TestJSONSchemaDecoder_Decode/valid_minimal_data === RUN TestJSONSchemaDecoder_Decode/missing_required_field === RUN TestJSONSchemaDecoder_Decode/invalid_type === RUN TestJSONSchemaDecoder_Decode/invalid_email_format === RUN TestJSONSchemaDecoder_Decode/negative_age --- PASS: TestJSONSchemaDecoder_Decode (0.06s) --- PASS: TestJSONSchemaDecoder_Decode/valid_complete_data (0.01s) --- PASS: TestJSONSchemaDecoder_Decode/valid_minimal_data (0.00s) --- PASS: TestJSONSchemaDecoder_Decode/missing_required_field (0.02s) --- PASS: TestJSONSchemaDecoder_Decode/invalid_type (0.01s) --- PASS: TestJSONSchemaDecoder_Decode/invalid_email_format (0.01s) --- PASS: TestJSONSchemaDecoder_Decode/negative_age (0.01s) === RUN TestJSONSchemaDecoder_DecodeToRecordValue --- PASS: TestJSONSchemaDecoder_DecodeToRecordValue (0.00s) === RUN TestJSONSchemaDecoder_InferRecordType --- PASS: TestJSONSchemaDecoder_InferRecordType (0.01s) === RUN TestJSONSchemaDecoder_EncodeFromRecordValue --- PASS: TestJSONSchemaDecoder_EncodeFromRecordValue (0.01s) === RUN TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas === RUN TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas/array_schema === RUN TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas/string_schema === RUN TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas/number_schema === RUN TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas/boolean_schema --- PASS: TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas (0.01s) --- PASS: TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas/array_schema (0.00s) --- PASS: TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas/string_schema (0.00s) --- PASS: TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas/number_schema (0.00s) --- PASS: TestJSONSchemaDecoder_ArrayAndPrimitiveSchemas/boolean_schema (0.00s) === RUN TestJSONSchemaDecoder_GetSchemaInfo --- PASS: TestJSONSchemaDecoder_GetSchemaInfo (0.00s) === RUN TestAvroLoadTestDecoding loadtest_decode_test.go:127: Avro encoded size: 68 bytes loadtest_decode_test.go:133: Confluent wire format size: 73 bytes loadtest_decode_test.go:170: ✅ Avro decoding successful: 7 fields --- PASS: TestAvroLoadTestDecoding (0.01s) === RUN TestJSONSchemaLoadTestDecoding loadtest_decode_test.go:183: JSON encoded size: 174 bytes loadtest_decode_test.go:184: JSON content: {"id":"msg-test-123","timestamp":1794908216422730784,"producer_id":0,"counter":42,"user_id":"user-789","event_type":"click","properties":{"browser":"chrome","version":"1.0"}} loadtest_decode_test.go:190: Confluent wire format size: 179 bytes loadtest_decode_test.go:227: ✅ JSON Schema decoding successful: 7 fields --- PASS: TestJSONSchemaLoadTestDecoding (0.01s) === RUN TestProtobufLoadTestDecoding loadtest_decode_test.go:241: JSON (for Protobuf) encoded size: 174 bytes loadtest_decode_test.go:242: JSON content: {"id":"msg-test-123","timestamp":1794908216435008225,"producer_id":0,"counter":42,"user_id":"user-789","event_type":"click","properties":{"browser":"chrome","version":"1.0"}} loadtest_decode_test.go:248: Confluent wire format size: 179 bytes loadtest_decode_test.go:275: Unexpectedly succeeded in decoding JSON as Protobuf loadtest_decode_test.go:277: RecordValue has 7 fields --- PASS: TestProtobufLoadTestDecoding (0.04s) === RUN TestManager_SchemaEvolution === RUN TestManager_SchemaEvolution/Compatible_Avro_evolution === RUN TestManager_SchemaEvolution/Incompatible_Avro_evolution === RUN TestManager_SchemaEvolution/Schema_evolution_suggestions === RUN TestManager_SchemaEvolution/JSON_Schema_evolution === RUN TestManager_SchemaEvolution/Full_compatibility_check === RUN TestManager_SchemaEvolution/Type_promotion_compatibility --- PASS: TestManager_SchemaEvolution (0.03s) --- PASS: TestManager_SchemaEvolution/Compatible_Avro_evolution (0.00s) --- PASS: TestManager_SchemaEvolution/Incompatible_Avro_evolution (0.00s) --- PASS: TestManager_SchemaEvolution/Schema_evolution_suggestions (0.00s) --- PASS: TestManager_SchemaEvolution/JSON_Schema_evolution (0.00s) --- PASS: TestManager_SchemaEvolution/Full_compatibility_check (0.00s) --- PASS: TestManager_SchemaEvolution/Type_promotion_compatibility (0.00s) === RUN TestManager_CompatibilityLevels === RUN TestManager_CompatibilityLevels/Get_default_compatibility_level === RUN TestManager_CompatibilityLevels/Set_compatibility_level --- PASS: TestManager_CompatibilityLevels (0.00s) --- PASS: TestManager_CompatibilityLevels/Get_default_compatibility_level (0.00s) --- PASS: TestManager_CompatibilityLevels/Set_compatibility_level (0.00s) === RUN TestManager_CanEvolveSchema === RUN TestManager_CanEvolveSchema/Compatible_evolution === RUN TestManager_CanEvolveSchema/Incompatible_evolution --- PASS: TestManager_CanEvolveSchema (0.01s) --- PASS: TestManager_CanEvolveSchema/Compatible_evolution (0.00s) --- PASS: TestManager_CanEvolveSchema/Incompatible_evolution (0.01s) === RUN TestManager_SchemaEvolutionWorkflow === RUN TestManager_SchemaEvolutionWorkflow/Complete_evolution_workflow --- PASS: TestManager_SchemaEvolutionWorkflow (0.01s) --- PASS: TestManager_SchemaEvolutionWorkflow/Complete_evolution_workflow (0.01s) === RUN TestManager_DecodeMessage --- PASS: TestManager_DecodeMessage (0.01s) === RUN TestManager_IsSchematized === RUN TestManager_IsSchematized/schematized_message === RUN TestManager_IsSchematized/non-schematized_message === RUN TestManager_IsSchematized/empty_message --- PASS: TestManager_IsSchematized (0.00s) --- PASS: TestManager_IsSchematized/schematized_message (0.00s) --- PASS: TestManager_IsSchematized/non-schematized_message (0.00s) --- PASS: TestManager_IsSchematized/empty_message (0.00s) === RUN TestManager_GetSchemaInfo --- PASS: TestManager_GetSchemaInfo (0.01s) === RUN TestManager_CacheManagement --- PASS: TestManager_CacheManagement (0.00s) === RUN TestManager_EncodeMessage --- PASS: TestManager_EncodeMessage (0.01s) === RUN TestProtobufDecoder_BasicDecoding === RUN TestProtobufDecoder_BasicDecoding/NewProtobufDecoder_with_binary_descriptor protobuf_decoder_test.go:40: Protobuf decoder creation succeeded - Phase E3 is working! === RUN TestProtobufDecoder_BasicDecoding/NewProtobufDecoder_with_empty_message_name protobuf_decoder_test.go:60: Empty message name resolution succeeded - Phase E3 is working! --- PASS: TestProtobufDecoder_BasicDecoding (0.02s) --- PASS: TestProtobufDecoder_BasicDecoding/NewProtobufDecoder_with_binary_descriptor (0.01s) --- PASS: TestProtobufDecoder_BasicDecoding/NewProtobufDecoder_with_empty_message_name (0.00s) === RUN TestProtobufDecoder_Integration === RUN TestProtobufDecoder_Integration/Parse_complex_descriptor protobuf_decoder_test.go:86: Empty message name resolution succeeded! protobuf_decoder_test.go:100: Complex message resolution succeeded! --- PASS: TestProtobufDecoder_Integration (0.01s) --- PASS: TestProtobufDecoder_Integration/Parse_complex_descriptor (0.01s) === RUN TestProtobufDecoder_Caching === RUN TestProtobufDecoder_Caching/Decoder_creation_uses_cache --- PASS: TestProtobufDecoder_Caching (0.00s) --- PASS: TestProtobufDecoder_Caching/Decoder_creation_uses_cache (0.00s) === RUN TestProtobufDecoder_ErrorHandling === RUN TestProtobufDecoder_ErrorHandling/Invalid_binary_data === RUN TestProtobufDecoder_ErrorHandling/Empty_binary_data === RUN TestProtobufDecoder_ErrorHandling/FileDescriptorSet_with_no_messages --- PASS: TestProtobufDecoder_ErrorHandling (0.01s) --- PASS: TestProtobufDecoder_ErrorHandling/Invalid_binary_data (0.00s) --- PASS: TestProtobufDecoder_ErrorHandling/Empty_binary_data (0.00s) --- PASS: TestProtobufDecoder_ErrorHandling/FileDescriptorSet_with_no_messages (0.00s) === RUN TestProtobufDescriptorParser_BasicParsing === RUN TestProtobufDescriptorParser_BasicParsing/Parse_Simple_Message_Descriptor protobuf_descriptor_test.go:42: Simple message descriptor resolution succeeded - Phase E3 is working! === RUN TestProtobufDescriptorParser_BasicParsing/Parse_Complex_Message_Descriptor === RUN TestProtobufDescriptorParser_BasicParsing/Cache_Functionality protobuf_descriptor_test.go:101: Cache functionality working with successful descriptor resolution! --- PASS: TestProtobufDescriptorParser_BasicParsing (0.01s) --- PASS: TestProtobufDescriptorParser_BasicParsing/Parse_Simple_Message_Descriptor (0.00s) --- PASS: TestProtobufDescriptorParser_BasicParsing/Parse_Complex_Message_Descriptor (0.00s) --- PASS: TestProtobufDescriptorParser_BasicParsing/Cache_Functionality (0.00s) === RUN TestProtobufDescriptorParser_Validation === RUN TestProtobufDescriptorParser_Validation/Invalid_Binary_Data === RUN TestProtobufDescriptorParser_Validation/Empty_FileDescriptorSet === RUN TestProtobufDescriptorParser_Validation/FileDescriptor_Without_Name === RUN TestProtobufDescriptorParser_Validation/FileDescriptor_Without_Package --- PASS: TestProtobufDescriptorParser_Validation (0.01s) --- PASS: TestProtobufDescriptorParser_Validation/Invalid_Binary_Data (0.00s) --- PASS: TestProtobufDescriptorParser_Validation/Empty_FileDescriptorSet (0.00s) --- PASS: TestProtobufDescriptorParser_Validation/FileDescriptor_Without_Name (0.00s) --- PASS: TestProtobufDescriptorParser_Validation/FileDescriptor_Without_Package (0.00s) === RUN TestProtobufDescriptorParser_MessageSearch === RUN TestProtobufDescriptorParser_MessageSearch/Message_Not_Found === RUN TestProtobufDescriptorParser_MessageSearch/Nested_Message_Search protobuf_descriptor_test.go:235: Nested message resolution succeeded - Phase E3 is working! --- PASS: TestProtobufDescriptorParser_MessageSearch (0.01s) --- PASS: TestProtobufDescriptorParser_MessageSearch/Message_Not_Found (0.00s) --- PASS: TestProtobufDescriptorParser_MessageSearch/Nested_Message_Search (0.00s) === RUN TestProtobufDescriptorParser_Dependencies === RUN TestProtobufDescriptorParser_Dependencies/Extract_Dependencies --- PASS: TestProtobufDescriptorParser_Dependencies (0.00s) --- PASS: TestProtobufDescriptorParser_Dependencies/Extract_Dependencies (0.00s) === RUN TestProtobufSchema_Methods === RUN TestProtobufSchema_Methods/GetMessageFields_Implemented === RUN TestProtobufSchema_Methods/GetFieldByName_Implemented === RUN TestProtobufSchema_Methods/GetFieldByNumber_Implemented === RUN TestProtobufSchema_Methods/ValidateMessage_Requires_MessageDescriptor --- PASS: TestProtobufSchema_Methods (0.01s) --- PASS: TestProtobufSchema_Methods/GetMessageFields_Implemented (0.00s) --- PASS: TestProtobufSchema_Methods/GetFieldByName_Implemented (0.00s) --- PASS: TestProtobufSchema_Methods/GetFieldByNumber_Implemented (0.00s) --- PASS: TestProtobufSchema_Methods/ValidateMessage_Requires_MessageDescriptor (0.00s) === RUN TestProtobufDescriptorParser_CacheManagement --- PASS: TestProtobufDescriptorParser_CacheManagement (0.00s) === RUN TestSchemaReconstruction_Avro reconstruction_test.go:77: Original Avro binary length: 11 reconstruction_test.go:78: Original Confluent message length: 16 reconstruction_test.go:85: Parsed envelope - SchemaID: 1, Format: AVRO, Payload length: 11 reconstruction_test.go:124: Successfully completed round-trip: Original -> Decode -> Encode -> Decode reconstruction_test.go:125: Original message size: 16 bytes reconstruction_test.go:126: Reconstructed message size: 16 bytes --- PASS: TestSchemaReconstruction_Avro (0.02s) === RUN TestSchemaReconstruction_MultipleFormats === RUN TestSchemaReconstruction_MultipleFormats/Avro === RUN TestSchemaReconstruction_MultipleFormats/Protobuf === RUN TestSchemaReconstruction_MultipleFormats/JSON_Schema --- PASS: TestSchemaReconstruction_MultipleFormats (0.10s) --- PASS: TestSchemaReconstruction_MultipleFormats/Avro (0.08s) --- PASS: TestSchemaReconstruction_MultipleFormats/Protobuf (0.01s) --- PASS: TestSchemaReconstruction_MultipleFormats/JSON_Schema (0.01s) === RUN TestConfluentEnvelope_RoundTrip === RUN TestConfluentEnvelope_RoundTrip/Avro_message reconstruction_test.go:259: Successfully round-tripped Avro message envelope: 17 bytes === RUN TestConfluentEnvelope_RoundTrip/Protobuf_message_with_indexes reconstruction_test.go:259: Successfully round-tripped Protobuf message with indexes envelope: 21 bytes === RUN TestConfluentEnvelope_RoundTrip/JSON_Schema_message reconstruction_test.go:259: Successfully round-tripped JSON Schema message envelope: 17 bytes --- PASS: TestConfluentEnvelope_RoundTrip (0.00s) --- PASS: TestConfluentEnvelope_RoundTrip/Avro_message (0.00s) --- PASS: TestConfluentEnvelope_RoundTrip/Protobuf_message_with_indexes (0.00s) --- PASS: TestConfluentEnvelope_RoundTrip/JSON_Schema_message (0.00s) === RUN TestSchemaMetadata_Preservation reconstruction_test.go:306: Successfully preserved and reconstructed schema metadata --- PASS: TestSchemaMetadata_Preservation (0.00s) === RUN TestNewRegistryClient --- PASS: TestNewRegistryClient (0.00s) === RUN TestRegistryClient_GetSchemaByID === RUN TestRegistryClient_GetSchemaByID/successful_fetch === RUN TestRegistryClient_GetSchemaByID/schema_not_found === RUN TestRegistryClient_GetSchemaByID/cache_hit --- PASS: TestRegistryClient_GetSchemaByID (0.02s) --- PASS: TestRegistryClient_GetSchemaByID/successful_fetch (0.01s) --- PASS: TestRegistryClient_GetSchemaByID/schema_not_found (0.00s) --- PASS: TestRegistryClient_GetSchemaByID/cache_hit (0.00s) === RUN TestRegistryClient_GetLatestSchema --- PASS: TestRegistryClient_GetLatestSchema (0.01s) === RUN TestRegistryClient_RegisterSchema --- PASS: TestRegistryClient_RegisterSchema (0.01s) === RUN TestRegistryClient_CheckCompatibility --- PASS: TestRegistryClient_CheckCompatibility (0.01s) === RUN TestRegistryClient_ListSubjects --- PASS: TestRegistryClient_ListSubjects (0.01s) === RUN TestRegistryClient_DetectSchemaFormat === RUN TestRegistryClient_DetectSchemaFormat/Avro_record_schema === RUN TestRegistryClient_DetectSchemaFormat/Avro_enum_schema === RUN TestRegistryClient_DetectSchemaFormat/JSON_Schema === RUN TestRegistryClient_DetectSchemaFormat/Protobuf_(non-JSON) === RUN TestRegistryClient_DetectSchemaFormat/Simple_Avro_primitive --- PASS: TestRegistryClient_DetectSchemaFormat (0.01s) --- PASS: TestRegistryClient_DetectSchemaFormat/Avro_record_schema (0.00s) --- PASS: TestRegistryClient_DetectSchemaFormat/Avro_enum_schema (0.00s) --- PASS: TestRegistryClient_DetectSchemaFormat/JSON_Schema (0.00s) --- PASS: TestRegistryClient_DetectSchemaFormat/Protobuf_(non-JSON) (0.00s) --- PASS: TestRegistryClient_DetectSchemaFormat/Simple_Avro_primitive (0.00s) === RUN TestRegistryClient_CacheManagement --- PASS: TestRegistryClient_CacheManagement (0.00s) === RUN TestRegistryClient_HealthCheck === RUN TestRegistryClient_HealthCheck/healthy_registry === RUN TestRegistryClient_HealthCheck/unhealthy_registry --- PASS: TestRegistryClient_HealthCheck (0.01s) --- PASS: TestRegistryClient_HealthCheck/healthy_registry (0.01s) --- PASS: TestRegistryClient_HealthCheck/unhealthy_registry (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/kafka/schema 5.800s === RUN TestWriteRowsNoPanic --- PASS: TestWriteRowsNoPanic (0.24s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/logstore 2.913s === RUN TestConsumerGroupPosition_JSON === RUN TestConsumerGroupPosition_JSON/offset-based_position consumer_group_storage_test.go:53: JSON: {"type":"offset","value":12345,"offset_type":"EXACT_OFFSET","committed_at":1794908213631,"metadata":"test metadata"} === RUN TestConsumerGroupPosition_JSON/timestamp-based_position consumer_group_storage_test.go:53: JSON: {"type":"timestamp","value":1794908213631519361,"offset_type":"EXACT_TS_NS","committed_at":1794908213631,"metadata":"checkpoint at 2024-10-05"} === RUN TestConsumerGroupPosition_JSON/minimal_position consumer_group_storage_test.go:53: JSON: {"type":"offset","value":42,"offset_type":"","committed_at":0,"metadata":""} --- PASS: TestConsumerGroupPosition_JSON (0.08s) --- PASS: TestConsumerGroupPosition_JSON/offset-based_position (0.04s) --- PASS: TestConsumerGroupPosition_JSON/timestamp-based_position (0.01s) --- PASS: TestConsumerGroupPosition_JSON/minimal_position (0.00s) === RUN TestConsumerGroupPosition_JSONExamples consumer_group_storage_test.go:93: Example 0: Type=offset, Value=12345 consumer_group_storage_test.go:93: Example 1: Type=timestamp, Value=1696521600000000000 consumer_group_storage_test.go:93: Example 2: Type=offset, Value=42 --- PASS: TestConsumerGroupPosition_JSONExamples (0.00s) === RUN TestConsumerGroupPosition_TypeValidation --- PASS: TestConsumerGroupPosition_TypeValidation (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/offset 2.596s === RUN Test_allocateOneBroker === RUN Test_allocateOneBroker/test_only_one_broker I1117 09:36:53.535245 allocate.go:54 allocate topic partitions 1: [partition:{ring_size:2520 range_stop:2520 unix_time_ns:1794908213520804873} leader_broker:"localhost:17777"] --- PASS: Test_allocateOneBroker (0.12s) --- PASS: Test_allocateOneBroker/test_only_one_broker (0.10s) === RUN TestEnsureAssignmentsToActiveBrokersX === RUN TestEnsureAssignmentsToActiveBrokersX/test_empty_leader test empty leader before [partition:{} follower_broker:"localhost:2"] test empty leader after [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:2"] === RUN TestEnsureAssignmentsToActiveBrokersX/test_empty_follower test empty follower before [partition:{} leader_broker:"localhost:1"] test empty follower after [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:3"] === RUN TestEnsureAssignmentsToActiveBrokersX/test_dead_follower test dead follower before [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:200"] test dead follower after [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:6"] === RUN TestEnsureAssignmentsToActiveBrokersX/test_dead_leader_and_follower test dead leader and follower before [partition:{} leader_broker:"localhost:100" follower_broker:"localhost:200"] test dead leader and follower after [partition:{} leader_broker:"localhost:6" follower_broker:"localhost:3"] === RUN TestEnsureAssignmentsToActiveBrokersX/test_low_active_brokers test low active brokers before [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:2"] test low active brokers after [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:2"] === RUN TestEnsureAssignmentsToActiveBrokersX/test_low_active_brokers_with_one_follower test low active brokers with one follower before [partition:{} leader_broker:"localhost:1"] test low active brokers with one follower after [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:1"] === RUN TestEnsureAssignmentsToActiveBrokersX/test_single_active_broker test single active broker before [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:2"] test single active broker after [partition:{} leader_broker:"localhost:1" follower_broker:"localhost:1"] --- PASS: TestEnsureAssignmentsToActiveBrokersX (0.09s) --- PASS: TestEnsureAssignmentsToActiveBrokersX/test_empty_leader (0.02s) --- PASS: TestEnsureAssignmentsToActiveBrokersX/test_empty_follower (0.01s) --- PASS: TestEnsureAssignmentsToActiveBrokersX/test_dead_follower (0.01s) --- PASS: TestEnsureAssignmentsToActiveBrokersX/test_dead_leader_and_follower (0.01s) --- PASS: TestEnsureAssignmentsToActiveBrokersX/test_low_active_brokers (0.01s) --- PASS: TestEnsureAssignmentsToActiveBrokersX/test_low_active_brokers_with_one_follower (0.00s) --- PASS: TestEnsureAssignmentsToActiveBrokersX/test_single_active_broker (0.01s) === RUN TestBalanceTopicPartitionOnBrokers === RUN TestBalanceTopicPartitionOnBrokers/test --- PASS: TestBalanceTopicPartitionOnBrokers (0.02s) --- PASS: TestBalanceTopicPartitionOnBrokers/test (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/pub_balancer 2.597s === RUN TestSplitFlatSchemaToKeyValue --- PASS: TestSplitFlatSchemaToKeyValue (0.00s) === RUN TestSplitFlatSchemaToKeyValueMissingColumns --- PASS: TestSplitFlatSchemaToKeyValueMissingColumns (0.01s) === RUN TestCombineFlatSchemaFromKeyValue --- PASS: TestCombineFlatSchemaFromKeyValue (0.01s) === RUN TestExtractKeyColumnsFromCombinedSchema --- PASS: TestExtractKeyColumnsFromCombinedSchema (0.00s) === RUN TestValidateKeyColumns --- PASS: TestValidateKeyColumns (0.00s) === RUN TestEnumScalarType === RUN TestEnumScalarType/Boolean === RUN TestEnumScalarType/Integer === RUN TestEnumScalarType/Long === RUN TestEnumScalarType/Float === RUN TestEnumScalarType/Double === RUN TestEnumScalarType/Bytes === RUN TestEnumScalarType/String --- PASS: TestEnumScalarType (0.02s) --- PASS: TestEnumScalarType/Boolean (0.00s) --- PASS: TestEnumScalarType/Integer (0.00s) --- PASS: TestEnumScalarType/Long (0.00s) --- PASS: TestEnumScalarType/Float (0.00s) --- PASS: TestEnumScalarType/Double (0.00s) --- PASS: TestEnumScalarType/Bytes (0.00s) --- PASS: TestEnumScalarType/String (0.00s) === RUN TestField --- PASS: TestField (0.00s) === RUN TestRecordType fields: < name: "field_key" field_index: 1 type: < scalar_type: INT32 > > fields: < name: "field_record" field_index: 2 type: < record_type: < fields: < name: "field_1" field_index: 1 type: < scalar_type: INT32 > > fields: < name: "field_2" field_index: 2 type: < scalar_type: STRING > > > > > {"fields":[{"name":"field_key","field_index":1,"type":{"Kind":{"ScalarType":1}}},{"name":"field_record","field_index":2,"type":{"Kind":{"RecordType":{"fields":[{"name":"field_1","field_index":1,"type":{"Kind":{"ScalarType":1}}},{"name":"field_2","field_index":2,"type":{"Kind":{"ScalarType":7}}}]}}}}]} --- PASS: TestRecordType (0.08s) === RUN TestStructToSchema === RUN TestStructToSchema/scalar_type === RUN TestStructToSchema/simple_struct_type === RUN TestStructToSchema/simple_list === RUN TestStructToSchema/simple_[]byte === RUN TestStructToSchema/nested_simple_structs === RUN TestStructToSchema/nested_struct_type --- PASS: TestStructToSchema (0.02s) --- PASS: TestStructToSchema/scalar_type (0.00s) --- PASS: TestStructToSchema/simple_struct_type (0.00s) --- PASS: TestStructToSchema/simple_list (0.00s) --- PASS: TestStructToSchema/simple_[]byte (0.00s) --- PASS: TestStructToSchema/nested_simple_structs (0.00s) --- PASS: TestStructToSchema/nested_struct_type (0.00s) === RUN TestToParquetLevels === RUN TestToParquetLevels/nested_type --- PASS: TestToParquetLevels (0.02s) --- PASS: TestToParquetLevels/nested_type (0.01s) === RUN TestToParquetValue_BasicTypes === RUN TestToParquetValue_BasicTypes/BoolValue_true === RUN TestToParquetValue_BasicTypes/Int32Value === RUN TestToParquetValue_BasicTypes/Int64Value === RUN TestToParquetValue_BasicTypes/FloatValue === RUN TestToParquetValue_BasicTypes/DoubleValue === RUN TestToParquetValue_BasicTypes/BytesValue === RUN TestToParquetValue_BasicTypes/BytesValue_empty === RUN TestToParquetValue_BasicTypes/StringValue --- PASS: TestToParquetValue_BasicTypes (0.01s) --- PASS: TestToParquetValue_BasicTypes/BoolValue_true (0.00s) --- PASS: TestToParquetValue_BasicTypes/Int32Value (0.00s) --- PASS: TestToParquetValue_BasicTypes/Int64Value (0.00s) --- PASS: TestToParquetValue_BasicTypes/FloatValue (0.00s) --- PASS: TestToParquetValue_BasicTypes/DoubleValue (0.00s) --- PASS: TestToParquetValue_BasicTypes/BytesValue (0.00s) --- PASS: TestToParquetValue_BasicTypes/BytesValue_empty (0.00s) --- PASS: TestToParquetValue_BasicTypes/StringValue (0.00s) === RUN TestToParquetValue_TimestampValue === RUN TestToParquetValue_TimestampValue/Valid_TimestampValue_UTC === RUN TestToParquetValue_TimestampValue/Valid_TimestampValue_local === RUN TestToParquetValue_TimestampValue/TimestampValue_zero === RUN TestToParquetValue_TimestampValue/TimestampValue_negative_(before_epoch) === RUN TestToParquetValue_TimestampValue/TimestampValue_nil_pointer --- PASS: TestToParquetValue_TimestampValue (0.01s) --- PASS: TestToParquetValue_TimestampValue/Valid_TimestampValue_UTC (0.00s) --- PASS: TestToParquetValue_TimestampValue/Valid_TimestampValue_local (0.00s) --- PASS: TestToParquetValue_TimestampValue/TimestampValue_zero (0.00s) --- PASS: TestToParquetValue_TimestampValue/TimestampValue_negative_(before_epoch) (0.00s) --- PASS: TestToParquetValue_TimestampValue/TimestampValue_nil_pointer (0.00s) === RUN TestToParquetValue_DateValue === RUN TestToParquetValue_DateValue/Valid_DateValue_(2024-01-01) === RUN TestToParquetValue_DateValue/DateValue_epoch_(1970-01-01) === RUN TestToParquetValue_DateValue/DateValue_before_epoch === RUN TestToParquetValue_DateValue/DateValue_nil_pointer --- PASS: TestToParquetValue_DateValue (0.00s) --- PASS: TestToParquetValue_DateValue/Valid_DateValue_(2024-01-01) (0.00s) --- PASS: TestToParquetValue_DateValue/DateValue_epoch_(1970-01-01) (0.00s) --- PASS: TestToParquetValue_DateValue/DateValue_before_epoch (0.00s) --- PASS: TestToParquetValue_DateValue/DateValue_nil_pointer (0.00s) === RUN TestToParquetValue_DecimalValue === RUN TestToParquetValue_DecimalValue/Small_Decimal_(precision_<=_9)_-_positive === RUN TestToParquetValue_DecimalValue/Small_Decimal_(precision_<=_9)_-_negative === RUN TestToParquetValue_DecimalValue/Medium_Decimal_(9_<_precision_<=_18) === RUN TestToParquetValue_DecimalValue/Large_Decimal_(precision_>_18) === RUN TestToParquetValue_DecimalValue/Decimal_with_zero_precision === RUN TestToParquetValue_DecimalValue/Decimal_nil_pointer === RUN TestToParquetValue_DecimalValue/Decimal_with_nil_Value_bytes === RUN TestToParquetValue_DecimalValue/Decimal_with_empty_Value_bytes === RUN TestToParquetValue_DecimalValue/Decimal_out_of_int32_range_(stored_as_binary) === RUN TestToParquetValue_DecimalValue/Decimal_out_of_int64_range_(stored_as_binary) === RUN TestToParquetValue_DecimalValue/Decimal_extremely_large_value_(should_be_rejected) --- PASS: TestToParquetValue_DecimalValue (0.02s) --- PASS: TestToParquetValue_DecimalValue/Small_Decimal_(precision_<=_9)_-_positive (0.00s) --- PASS: TestToParquetValue_DecimalValue/Small_Decimal_(precision_<=_9)_-_negative (0.00s) --- PASS: TestToParquetValue_DecimalValue/Medium_Decimal_(9_<_precision_<=_18) (0.00s) --- PASS: TestToParquetValue_DecimalValue/Large_Decimal_(precision_>_18) (0.00s) --- PASS: TestToParquetValue_DecimalValue/Decimal_with_zero_precision (0.00s) --- PASS: TestToParquetValue_DecimalValue/Decimal_nil_pointer (0.00s) --- PASS: TestToParquetValue_DecimalValue/Decimal_with_nil_Value_bytes (0.00s) --- PASS: TestToParquetValue_DecimalValue/Decimal_with_empty_Value_bytes (0.00s) --- PASS: TestToParquetValue_DecimalValue/Decimal_out_of_int32_range_(stored_as_binary) (0.00s) --- PASS: TestToParquetValue_DecimalValue/Decimal_out_of_int64_range_(stored_as_binary) (0.00s) --- PASS: TestToParquetValue_DecimalValue/Decimal_extremely_large_value_(should_be_rejected) (0.00s) === RUN TestToParquetValue_TimeValue === RUN TestToParquetValue_TimeValue/Valid_TimeValue_(12:34:56.789) === RUN TestToParquetValue_TimeValue/TimeValue_midnight === RUN TestToParquetValue_TimeValue/TimeValue_end_of_day_(23:59:59.999999) === RUN TestToParquetValue_TimeValue/TimeValue_nil_pointer --- PASS: TestToParquetValue_TimeValue (0.00s) --- PASS: TestToParquetValue_TimeValue/Valid_TimeValue_(12:34:56.789) (0.00s) --- PASS: TestToParquetValue_TimeValue/TimeValue_midnight (0.00s) --- PASS: TestToParquetValue_TimeValue/TimeValue_end_of_day_(23:59:59.999999) (0.00s) --- PASS: TestToParquetValue_TimeValue/TimeValue_nil_pointer (0.00s) === RUN TestToParquetValue_EdgeCases === RUN TestToParquetValue_EdgeCases/Nil_value === RUN TestToParquetValue_EdgeCases/Completely_nil_value === RUN TestToParquetValue_EdgeCases/BytesValue_with_nil_slice --- PASS: TestToParquetValue_EdgeCases (0.00s) --- PASS: TestToParquetValue_EdgeCases/Nil_value (0.00s) --- PASS: TestToParquetValue_EdgeCases/Completely_nil_value (0.00s) --- PASS: TestToParquetValue_EdgeCases/BytesValue_with_nil_slice (0.00s) === RUN TestWriteReadParquet RecordType: fields:{name:"Address" type:{record_type:{fields:{name:"City" type:{scalar_type:STRING}} fields:{name:"Street" type:{scalar_type:STRING}}}}} fields:{name:"Company" type:{scalar_type:STRING}} fields:{name:"CreatedAt" type:{scalar_type:INT64}} fields:{name:"ID" type:{scalar_type:INT64}} fields:{name:"Person" type:{record_type:{fields:{name:"emails" type:{list_type:{element_type:{scalar_type:STRING}}}} fields:{name:"zName" type:{scalar_type:STRING}}}}} ParquetSchema: message example { optional group Address { optional binary City; optional binary Street; } optional binary Company; optional int64 CreatedAt (INT(64,true)); optional int64 ID (INT(64,true)); optional group Person { repeated binary emails; optional binary zName; } } Go Type: struct { Address *struct { City *[]uint8 "parquet:\"City\""; Street *[]uint8 "parquet:\"Street\"" } "parquet:\"Address\""; Company *[]uint8 "parquet:\"Company\""; CreatedAt *int64 "parquet:\"CreatedAt\""; ID *int64 "parquet:\"ID\""; Person *struct { Emails []*[]uint8 "parquet:\"emails\""; ZName *[]uint8 "parquet:\"zName\"" } "parquet:\"Person\"" } Write RecordValue: fields:{key:"Company" value:{string_value:"company_0"}} fields:{key:"CreatedAt" value:{int64_value:2}} fields:{key:"ID" value:{int64_value:1}} fields:{key:"Person" value:{record_value:{fields:{key:"emails" value:{list_value:{values:{string_value:"john_0@a.com"} values:{string_value:"john_0@b.com"} values:{string_value:"john_0@c.com"} values:{string_value:"john_0@d.com"} values:{string_value:"john_0@e.com"}}}} fields:{key:"zName" value:{string_value:"john_0"}}}}} Build Row: [C:0 D:2 R:0 V: C:1 D:2 R:0 V: C:2 D:1 R:0 V:company_0 C:3 D:1 R:0 V:2 C:4 D:1 R:0 V:1 C:5 D:2 R:0 V:john_0@a.com C:5 D:2 R:1 V:john_0@b.com C:5 D:2 R:1 V:john_0@c.com C:5 D:2 R:1 V:john_0@d.com C:5 D:2 R:1 V:john_0@e.com C:6 D:2 R:0 V:john_0] Write RecordValue: fields:{key:"Company" value:{string_value:"company_1"}} fields:{key:"CreatedAt" value:{int64_value:4}} fields:{key:"ID" value:{int64_value:2}} fields:{key:"Person" value:{record_value:{fields:{key:"emails" value:{list_value:{values:{string_value:"john_1@a.com"} values:{string_value:"john_1@b.com"} values:{string_value:"john_1@c.com"} values:{string_value:"john_1@d.com"} values:{string_value:"john_1@e.com"}}}} fields:{key:"zName" value:{string_value:"john_1"}}}}} Build Row: [C:0 D:2 R:0 V: C:1 D:2 R:0 V: C:2 D:1 R:0 V:company_1 C:3 D:1 R:0 V:4 C:4 D:1 R:0 V:2 C:5 D:2 R:0 V:john_1@a.com C:5 D:2 R:1 V:john_1@b.com C:5 D:2 R:1 V:john_1@c.com C:5 D:2 R:1 V:john_1@d.com C:5 D:2 R:1 V:john_1@e.com C:6 D:2 R:0 V:john_1] Write RecordValue: fields:{key:"Company" value:{string_value:"company_2"}} fields:{key:"CreatedAt" value:{int64_value:6}} fields:{key:"ID" value:{int64_value:3}} fields:{key:"Person" value:{record_value:{fields:{key:"emails" value:{list_value:{values:{string_value:"john_2@a.com"} values:{string_value:"john_2@b.com"} values:{string_value:"john_2@c.com"} values:{string_value:"john_2@d.com"} values:{string_value:"john_2@e.com"}}}} fields:{key:"zName" value:{string_value:"john_2"}}}}} Build Row: [C:0 D:2 R:0 V: C:1 D:2 R:0 V: C:2 D:1 R:0 V:company_2 C:3 D:1 R:0 V:6 C:4 D:1 R:0 V:3 C:5 D:2 R:0 V:john_2@a.com C:5 D:2 R:1 V:john_2@b.com C:5 D:2 R:1 V:john_2@c.com C:5 D:2 R:1 V:john_2@d.com C:5 D:2 R:1 V:john_2@e.com C:6 D:2 R:0 V:john_2] Read RecordValue: fields:{key:"Address" value:{record_value:{fields:{key:"City" value:{string_value:""}} fields:{key:"Street" value:{string_value:""}}}}} fields:{key:"Company" value:{string_value:"company_0"}} fields:{key:"CreatedAt" value:{int64_value:2}} fields:{key:"ID" value:{int64_value:1}} fields:{key:"Person" value:{record_value:{fields:{key:"emails" value:{list_value:{values:{string_value:"john_0@a.com"} values:{string_value:"john_0@b.com"} values:{string_value:"john_0@c.com"} values:{string_value:"john_0@d.com"} values:{string_value:"john_0@e.com"}}}} fields:{key:"zName" value:{string_value:"john_0"}}}}} Read RecordValue: fields:{key:"Address" value:{record_value:{fields:{key:"City" value:{string_value:""}} fields:{key:"Street" value:{string_value:""}}}}} fields:{key:"Company" value:{string_value:"company_1"}} fields:{key:"CreatedAt" value:{int64_value:4}} fields:{key:"ID" value:{int64_value:2}} fields:{key:"Person" value:{record_value:{fields:{key:"emails" value:{list_value:{values:{string_value:"john_1@a.com"} values:{string_value:"john_1@b.com"} values:{string_value:"john_1@c.com"} values:{string_value:"john_1@d.com"} values:{string_value:"john_1@e.com"}}}} fields:{key:"zName" value:{string_value:"john_1"}}}}} Read RecordValue: fields:{key:"Address" value:{record_value:{fields:{key:"City" value:{string_value:""}} fields:{key:"Street" value:{string_value:""}}}}} fields:{key:"Company" value:{string_value:"company_2"}} fields:{key:"CreatedAt" value:{int64_value:6}} fields:{key:"ID" value:{int64_value:3}} fields:{key:"Person" value:{record_value:{fields:{key:"emails" value:{list_value:{values:{string_value:"john_2@a.com"} values:{string_value:"john_2@b.com"} values:{string_value:"john_2@c.com"} values:{string_value:"john_2@d.com"} values:{string_value:"john_2@e.com"}}}} fields:{key:"zName" value:{string_value:"john_2"}}}}} total: 3 --- PASS: TestWriteReadParquet (0.57s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/schema 1.415s ? github.com/seaweedfs/seaweedfs/weed/mq/segment [no test files] === RUN TestAddConsumerInstance &{isAssign:true partition:{RangeStart:0 RangeStop:1 RingSize:3 UnixTimeNs:0} consumer:first ts:{wall:14030724866367793574 ext:2650089209 loc:0x1635380}} &{isAssign:true partition:{RangeStart:1 RangeStop:2 RingSize:3 UnixTimeNs:0} consumer:first ts:{wall:14030724866368417248 ext:2650712322 loc:0x1635380}} --- PASS: TestAddConsumerInstance (1.01s) === RUN TestMultipleConsumerInstances &{isAssign:true partition:{RangeStart:0 RangeStop:1 RingSize:3 UnixTimeNs:0} consumer:first ts:{wall:14030724867458788941 ext:3667342772 loc:0x1635380}} &{isAssign:true partition:{RangeStart:1 RangeStop:2 RingSize:3 UnixTimeNs:0} consumer:third ts:{wall:14030724867459163741 ext:3667716922 loc:0x1635380}} &{isAssign:true partition:{RangeStart:2 RangeStop:3 RingSize:3 UnixTimeNs:0} consumer:second ts:{wall:14030724867459203560 ext:3667756541 loc:0x1635380}} --- PASS: TestMultipleConsumerInstances (1.01s) === RUN TestConfirmAdjustment &{isAssign:true partition:{RangeStart:0 RangeStop:1 RingSize:3 UnixTimeNs:0} consumer:first ts:{wall:14030724868539132585 ext:4673944262 loc:0x1635380}} &{isAssign:true partition:{RangeStart:1 RangeStop:2 RingSize:3 UnixTimeNs:0} consumer:third ts:{wall:14030724868539338360 ext:4674149877 loc:0x1635380}} &{isAssign:true partition:{RangeStart:2 RangeStop:3 RingSize:3 UnixTimeNs:0} consumer:second ts:{wall:14030724868539399698 ext:4674210805 loc:0x1635380}} &{isAssign:true partition:{RangeStart:1 RangeStop:2 RingSize:3 UnixTimeNs:0} consumer:first ts:{wall:14030724870116014551 ext:6177084784 loc:0x1635380}} --- PASS: TestConfirmAdjustment (5.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/sub_coordinator 9.453s === RUN TestCleanupIdlePartitionsRemovesEmptyTopicWithoutDeadlock I1117 09:36:54.026895 local_partition.go:371 local partition 0000-2520 shutting down I1117 09:36:54.053174 local_manager.go:110 Cleaned up 1 idle partition(s) --- PASS: TestCleanupIdlePartitionsRemovesEmptyTopicWithoutDeadlock (0.17s) === RUN TestCleanupIdlePartitionsKeepsActiveTopic --- PASS: TestCleanupIdlePartitionsKeepsActiveTopic (0.14s) === RUN TestOffsetBasedSubscribe_AllDataInMemory === RUN TestOffsetBasedSubscribe_AllDataInMemory/ReadFromOffset0 === RUN TestOffsetBasedSubscribe_AllDataInMemory/ReadFromOffset2 --- PASS: TestOffsetBasedSubscribe_AllDataInMemory (0.01s) --- PASS: TestOffsetBasedSubscribe_AllDataInMemory/ReadFromOffset0 (0.00s) --- PASS: TestOffsetBasedSubscribe_AllDataInMemory/ReadFromOffset2 (0.00s) === RUN TestOffsetBasedSubscribe_DataOnDisk === RUN TestOffsetBasedSubscribe_DataOnDisk/ReadFromOffset0_OnDisk === RUN TestOffsetBasedSubscribe_DataOnDisk/ReadFromOffset5_OnDisk === RUN TestOffsetBasedSubscribe_DataOnDisk/ReadFromOffset11_InMemory --- PASS: TestOffsetBasedSubscribe_DataOnDisk (0.01s) --- PASS: TestOffsetBasedSubscribe_DataOnDisk/ReadFromOffset0_OnDisk (0.00s) --- PASS: TestOffsetBasedSubscribe_DataOnDisk/ReadFromOffset5_OnDisk (0.00s) --- PASS: TestOffsetBasedSubscribe_DataOnDisk/ReadFromOffset11_InMemory (0.00s) === RUN TestTimestampBasedSubscribe === RUN TestTimestampBasedSubscribe/ReadFromBeginning === RUN TestTimestampBasedSubscribe/ReadFromMiddleTimestamp --- PASS: TestTimestampBasedSubscribe (0.00s) --- PASS: TestTimestampBasedSubscribe/ReadFromBeginning (0.00s) --- PASS: TestTimestampBasedSubscribe/ReadFromMiddleTimestamp (0.00s) === RUN TestConcurrentSubscribers --- PASS: TestConcurrentSubscribers (0.00s) === RUN TestResumeFromDiskError --- PASS: TestResumeFromDiskError (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/mq/topic 2.732s ? github.com/seaweedfs/seaweedfs/weed/notification [no test files] ? github.com/seaweedfs/seaweedfs/weed/notification/aws_sqs [no test files] ? github.com/seaweedfs/seaweedfs/weed/notification/gocdk_pub_sub [no test files] ? github.com/seaweedfs/seaweedfs/weed/notification/google_pub_sub [no test files] === RUN TestKafkaEventTypes === RUN TestKafkaEventTypes/create_event_allowed === RUN TestKafkaEventTypes/create_event_filtered_out === RUN TestKafkaEventTypes/delete_event_allowed === RUN TestKafkaEventTypes/update_event_allowed === RUN TestKafkaEventTypes/rename_event_allowed === RUN TestKafkaEventTypes/rename_across_directories_allowed === RUN TestKafkaEventTypes/rename_event_filtered_out === RUN TestKafkaEventTypes/empty_filter_publishes_every_event === RUN TestKafkaEventTypes/invalid_type_does_not_remove_a_valid_one W1117 09:36:54.133339 event_filter.go:21 invalid event type: bogus === RUN TestKafkaEventTypes/only_invalid_types_publish_nothing W1117 09:36:54.211704 event_filter.go:21 invalid event type: bogus --- PASS: TestKafkaEventTypes (0.11s) --- PASS: TestKafkaEventTypes/create_event_allowed (0.00s) --- PASS: TestKafkaEventTypes/create_event_filtered_out (0.00s) --- PASS: TestKafkaEventTypes/delete_event_allowed (0.00s) --- PASS: TestKafkaEventTypes/update_event_allowed (0.00s) --- PASS: TestKafkaEventTypes/rename_event_allowed (0.00s) --- PASS: TestKafkaEventTypes/rename_across_directories_allowed (0.00s) --- PASS: TestKafkaEventTypes/rename_event_filtered_out (0.00s) --- PASS: TestKafkaEventTypes/empty_filter_publishes_every_event (0.00s) --- PASS: TestKafkaEventTypes/invalid_type_does_not_remove_a_valid_one (0.07s) --- PASS: TestKafkaEventTypes/only_invalid_types_publish_nothing (0.00s) === RUN TestKafkaEventFilterUnsetPublishesOtherMessages --- PASS: TestKafkaEventFilterUnsetPublishesOtherMessages (0.00s) === RUN TestKafkaEventFilterDropsUnclassifiedMessages --- PASS: TestKafkaEventFilterDropsUnclassifiedMessages (0.00s) === RUN TestConfigureSASLTLSRejectsPartialMTLSConfig === RUN TestConfigureSASLTLSRejectsPartialMTLSConfig/missing_key === RUN TestConfigureSASLTLSRejectsPartialMTLSConfig/missing_cert --- PASS: TestConfigureSASLTLSRejectsPartialMTLSConfig (0.01s) --- PASS: TestConfigureSASLTLSRejectsPartialMTLSConfig/missing_key (0.00s) --- PASS: TestConfigureSASLTLSRejectsPartialMTLSConfig/missing_cert (0.00s) === RUN TestConfigureSASLTLSConfiguresSCRAMSHA256 --- PASS: TestConfigureSASLTLSConfiguresSCRAMSHA256 (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/notification/kafka 2.583s ? github.com/seaweedfs/seaweedfs/weed/notification/log [no test files] === RUN TestFilterEventTypes === RUN TestFilterEventTypes/create_event_-_allowed === RUN TestFilterEventTypes/create_event_-_not_allowed === RUN TestFilterEventTypes/delete_event_-_allowed === RUN TestFilterEventTypes/update_event_-_allowed === RUN TestFilterEventTypes/rename_event_-_allowed === RUN TestFilterEventTypes/rename_event_same_name_different_parent_-_allowed === RUN TestFilterEventTypes/rename_event_-_not_allowed === RUN TestFilterEventTypes/all_events_allowed_when_empty --- PASS: TestFilterEventTypes (0.02s) --- PASS: TestFilterEventTypes/create_event_-_allowed (0.00s) --- PASS: TestFilterEventTypes/create_event_-_not_allowed (0.00s) --- PASS: TestFilterEventTypes/delete_event_-_allowed (0.00s) --- PASS: TestFilterEventTypes/update_event_-_allowed (0.00s) --- PASS: TestFilterEventTypes/rename_event_-_allowed (0.00s) --- PASS: TestFilterEventTypes/rename_event_same_name_different_parent_-_allowed (0.00s) --- PASS: TestFilterEventTypes/rename_event_-_not_allowed (0.00s) --- PASS: TestFilterEventTypes/all_events_allowed_when_empty (0.00s) === RUN TestFilterPathPrefixes === RUN TestFilterPathPrefixes/matches_single_prefix === RUN TestFilterPathPrefixes/matches_one_of_multiple_prefixes === RUN TestFilterPathPrefixes/no_match === RUN TestFilterPathPrefixes/empty_prefixes_allows_all === RUN TestFilterPathPrefixes/exact_prefix_match === RUN TestFilterPathPrefixes/partial_match_not_allowed === RUN TestFilterPathPrefixes/rename_matches_destination_prefix --- PASS: TestFilterPathPrefixes (0.01s) --- PASS: TestFilterPathPrefixes/matches_single_prefix (0.00s) --- PASS: TestFilterPathPrefixes/matches_one_of_multiple_prefixes (0.00s) --- PASS: TestFilterPathPrefixes/no_match (0.00s) --- PASS: TestFilterPathPrefixes/empty_prefixes_allows_all (0.00s) --- PASS: TestFilterPathPrefixes/exact_prefix_match (0.00s) --- PASS: TestFilterPathPrefixes/partial_match_not_allowed (0.00s) --- PASS: TestFilterPathPrefixes/rename_matches_destination_prefix (0.00s) === RUN TestFilterCombined === RUN TestFilterCombined/allowed_event_and_path === RUN TestFilterCombined/allowed_event_but_wrong_path === RUN TestFilterCombined/wrong_event_but_allowed_path === RUN TestFilterCombined/wrong_event_and_wrong_path --- PASS: TestFilterCombined (0.00s) --- PASS: TestFilterCombined/allowed_event_and_path (0.00s) --- PASS: TestFilterCombined/allowed_event_but_wrong_path (0.00s) --- PASS: TestFilterCombined/wrong_event_but_allowed_path (0.00s) --- PASS: TestFilterCombined/wrong_event_and_wrong_path (0.00s) === RUN TestHttpClientSendMessage --- PASS: TestHttpClientSendMessage (0.17s) === RUN TestHttpClientSendMessageWithoutToken --- PASS: TestHttpClientSendMessageWithoutToken (0.06s) === RUN TestHttpClientSendMessageServerError --- PASS: TestHttpClientSendMessageServerError (0.10s) === RUN TestHttpClientSendMessageNetworkError --- PASS: TestHttpClientSendMessageNetworkError (0.01s) === RUN TestHttpClientFollowsRedirectAsPost --- PASS: TestHttpClientFollowsRedirectAsPost (0.04s) === RUN TestHttpClientUsesCachedRedirect --- PASS: TestHttpClientUsesCachedRedirect (0.03s) === RUN TestHttpClientPreservesPostMethod --- PASS: TestHttpClientPreservesPostMethod (0.01s) === RUN TestHttpClientInvalidatesCacheOnError --- PASS: TestHttpClientInvalidatesCacheOnError (0.04s) === RUN TestHttpClientInvalidatesCacheOnNetworkError --- PASS: TestHttpClientInvalidatesCacheOnNetworkError (0.03s) === RUN TestConfigValidation === RUN TestConfigValidation/valid_config === RUN TestConfigValidation/empty_endpoint === RUN TestConfigValidation/invalid_URL === RUN TestConfigValidation/timeout_too_large === RUN TestConfigValidation/too_many_retries === RUN TestConfigValidation/too_many_workers === RUN TestConfigValidation/buffer_too_large --- PASS: TestConfigValidation (0.01s) --- PASS: TestConfigValidation/valid_config (0.00s) --- PASS: TestConfigValidation/empty_endpoint (0.00s) --- PASS: TestConfigValidation/invalid_URL (0.00s) --- PASS: TestConfigValidation/timeout_too_large (0.00s) --- PASS: TestConfigValidation/too_many_retries (0.00s) --- PASS: TestConfigValidation/too_many_workers (0.00s) --- PASS: TestConfigValidation/buffer_too_large (0.00s) === RUN TestWebhookMessageSerialization --- PASS: TestWebhookMessageSerialization (0.06s) === RUN TestQueueInitialize [watermill] 2026/11/17 09:36:54.442627 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.454759 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:54.460976 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.463784 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.464314 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:54.466043 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:54.466169 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:54.466281 router.go:419: level=INFO msg="All messages processed" I1117 09:36:54.467044 webhook_queue.go:312 webhook pubsub worker stopped --- PASS: TestQueueInitialize (0.13s) === RUN TestQueueSendMessage [watermill] 2026/11/17 09:36:54.565829 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.567792 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:54.568661 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.581382 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.581636 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:54.582178 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:54.587007 pubsub.go:160: level=INFO msg="No subscribers to send message" message_uuid=80bd4744-10ee-457b-98a4-ce929d4f2ba8 pubsub_uuid=ufmbHRACdrpTDdvmn5SjeE topic=webhook_topic [watermill] 2026/11/17 09:36:54.587077 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:54.587200 router.go:419: level=INFO msg="All messages processed" I1117 09:36:54.587443 webhook_queue.go:312 webhook pubsub worker stopped --- PASS: TestQueueSendMessage (0.12s) === RUN TestQueueHandleWebhook --- PASS: TestQueueHandleWebhook (0.01s) === RUN TestQueueEndToEnd [watermill] 2026/11/17 09:36:54.700916 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.702086 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:54.705526 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.706159 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.706288 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:54.706708 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:54.706797 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:54.707004 router.go:419: level=INFO msg="All messages processed" I1117 09:36:54.707236 webhook_queue.go:312 webhook pubsub worker stopped [watermill] 2026/11/17 09:36:54.708107 pubsub.go:393: level=INFO msg="Pub/Sub closed, discarding msg" message_uuid=84432adf-8858-457d-9371-2c630ed1103d pubsub_uuid=VU26meBrVtHDxoi6HkXSmU topic=webhook_topic --- PASS: TestQueueEndToEnd (0.11s) === RUN TestQueueRetryMechanism [watermill] 2026/11/17 09:36:54.810811 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.811808 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:54.815537 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.816085 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.816331 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:54.816718 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:54.816814 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:54.816903 router.go:419: level=INFO msg="All messages processed" [watermill] 2026/11/17 09:36:54.816896 pubsub.go:160: level=INFO msg="No subscribers to send message" message_uuid=fff72b8b-25b6-465a-9c3e-4c8cd24d8938 pubsub_uuid=bAeV9yRDA8bYrZhgLVXHj4 topic=webhook_topic I1117 09:36:54.817121 webhook_queue.go:312 webhook pubsub worker stopped --- PASS: TestQueueRetryMechanism (0.11s) === RUN TestQueueNoDuplicateWebhooks === RUN TestQueueNoDuplicateWebhooks/1_worker [watermill] 2026/11/17 09:36:54.919738 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:54.920764 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:54.922291 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:55.623541 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:55.623640 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:55.624084 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:55.624110 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:55.624272 router.go:419: level=INFO msg="All messages processed" I1117 09:36:55.624484 webhook_queue.go:312 webhook pubsub worker stopped === RUN TestQueueNoDuplicateWebhooks/5_workers [watermill] 2026/11/17 09:36:55.727601 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:55.728701 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:55.730295 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:56.435288 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:56.435394 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:56.435886 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:56.435948 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:56.436123 router.go:419: level=INFO msg="All messages processed" I1117 09:36:56.436367 webhook_queue.go:312 webhook pubsub worker stopped === RUN TestQueueNoDuplicateWebhooks/10_workers [watermill] 2026/11/17 09:36:56.539162 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:56.540446 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:56.541838 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:57.245628 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:57.245749 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:57.246102 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:57.246155 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:57.246265 router.go:419: level=INFO msg="All messages processed" I1117 09:36:57.246464 webhook_queue.go:312 webhook pubsub worker stopped --- PASS: TestQueueNoDuplicateWebhooks (2.43s) --- PASS: TestQueueNoDuplicateWebhooks/1_worker (0.81s) --- PASS: TestQueueNoDuplicateWebhooks/5_workers (0.81s) --- PASS: TestQueueNoDuplicateWebhooks/10_workers (0.81s) === RUN TestQueueSendMessageWithFilter === RUN TestQueueSendMessageWithFilter/allowed_event_type === RUN TestQueueSendMessageWithFilter/filtered_event_type === RUN TestQueueSendMessageWithFilter/allowed_path_prefix === RUN TestQueueSendMessageWithFilter/filtered_path_prefix === RUN TestQueueSendMessageWithFilter/combined_filters_-_both_pass === RUN TestQueueSendMessageWithFilter/combined_filters_-_event_fails === RUN TestQueueSendMessageWithFilter/combined_filters_-_path_fails --- PASS: TestQueueSendMessageWithFilter (0.01s) --- PASS: TestQueueSendMessageWithFilter/allowed_event_type (0.00s) --- PASS: TestQueueSendMessageWithFilter/filtered_event_type (0.00s) --- PASS: TestQueueSendMessageWithFilter/allowed_path_prefix (0.00s) --- PASS: TestQueueSendMessageWithFilter/filtered_path_prefix (0.00s) --- PASS: TestQueueSendMessageWithFilter/combined_filters_-_both_pass (0.00s) --- PASS: TestQueueSendMessageWithFilter/combined_filters_-_event_fails (0.00s) --- PASS: TestQueueSendMessageWithFilter/combined_filters_-_path_fails (0.00s) === RUN TestNamedTargets [watermill] 2026/11/17 09:36:57.359574 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler_file_ingress topic=webhook_topic_file_ingress [watermill] 2026/11/17 09:36:57.360349 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:57.361442 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler_file_ingress topic=webhook_topic_file_ingress [watermill] 2026/11/17 09:36:57.362602 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler_metadata_extractor topic=webhook_topic_metadata_extractor [watermill] 2026/11/17 09:36:57.363325 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:57.364012 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler_metadata_extractor topic=webhook_topic_metadata_extractor [watermill] 2026/11/17 09:36:57.817419 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler_metadata_extractor topic=webhook_topic_metadata_extractor [watermill] 2026/11/17 09:36:57.817465 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler_file_ingress topic=webhook_topic_file_ingress [watermill] 2026/11/17 09:36:57.817482 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:57.817566 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:57.818044 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:57.818066 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:57.818073 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:57.818031 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:57.818242 router.go:419: level=INFO msg="All messages processed" [watermill] 2026/11/17 09:36:57.818270 router.go:419: level=INFO msg="All messages processed" I1117 09:36:57.818441 webhook_queue.go:312 webhook pubsub worker stopped I1117 09:36:57.818486 webhook_queue.go:312 webhook pubsub worker stopped --- PASS: TestNamedTargets (0.57s) === RUN TestQueueBurstKeepsPendingEvents [watermill] 2026/11/17 09:36:57.921698 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:57.922675 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:57.923651 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:58.084702 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:58.084810 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:58.085177 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:58.085259 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:58.085364 router.go:419: level=INFO msg="All messages processed" I1117 09:36:58.085593 webhook_queue.go:312 webhook pubsub worker stopped --- PASS: TestQueueBurstKeepsPendingEvents (0.27s) === RUN TestSaturatedTargetDoesNotStarveOthers [watermill] 2026/11/17 09:36:58.189166 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler_slow topic=webhook_topic_slow [watermill] 2026/11/17 09:36:58.189948 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:58.190625 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler_fast topic=webhook_topic_fast [watermill] 2026/11/17 09:36:58.190660 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler_slow topic=webhook_topic_slow [watermill] 2026/11/17 09:36:58.191161 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:58.191862 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler_fast topic=webhook_topic_fast [watermill] 2026/11/17 09:36:58.236470 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler_fast topic=webhook_topic_fast [watermill] 2026/11/17 09:36:58.236406 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler_slow topic=webhook_topic_slow [watermill] 2026/11/17 09:36:58.236406 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:58.236408 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:58.238430 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:58.238440 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:58.239921 router.go:419: level=INFO msg="All messages processed" [watermill] 2026/11/17 09:36:58.243022 router.go:589: level=INFO msg="Router closed" I1117 09:36:58.243155 webhook_queue.go:312 webhook pubsub worker stopped [watermill] 2026/11/17 09:36:58.243068 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:58.243185 router.go:419: level=INFO msg="All messages processed" I1117 09:36:58.243518 webhook_queue.go:312 webhook pubsub worker stopped --- PASS: TestSaturatedTargetDoesNotStarveOthers (0.15s) === RUN TestBuildTargetsDisabledFlat --- PASS: TestBuildTargetsDisabledFlat (0.00s) === RUN TestQueueRetriesBeforeDeadLetter [watermill] 2026/11/17 09:36:58.339835 router.go:280: level=INFO msg="Adding handler" handler_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:58.340714 router.go:434: level=INFO msg="Running router handlers" count=1 [watermill] 2026/11/17 09:36:58.341479 router.go:646: level=INFO msg="Starting handler" subscriber_name=webhook_handler topic=webhook_topic E1117 09:36:58.347387 webhook_queue.go:382 webhook target "" failed to send message for /test/path: webhook returned status code: 500 [watermill] 2026/11/17 09:36:58.359786 retry.go:98: level=ERROR msg="Error occurred, retrying" err="webhook returned status code: 500" max_retries=2 retry_no=1 wait_time=839.078313ms E1117 09:36:59.203727 webhook_queue.go:382 webhook target "" failed to send message for /test/path: webhook returned status code: 500 [watermill] 2026/11/17 09:36:59.206624 retry.go:98: level=ERROR msg="Error occurred, retrying" err="webhook returned status code: 500" max_retries=2 retry_no=2 wait_time=728.944514ms E1117 09:36:59.941296 webhook_queue.go:382 webhook target "" failed to send message for /test/path: webhook returned status code: 500 E1117 09:36:59.947765 webhook_queue.go:424 received dead letter message: new_entry:{name:"f.txt"}, key: /test/path, target: [watermill] 2026/11/17 09:36:59.957298 router.go:481: level=INFO msg="Subscriber stopped" subscriber_name=webhook_handler topic=webhook_topic [watermill] 2026/11/17 09:36:59.957464 router.go:578: level=INFO msg="Closing router" [watermill] 2026/11/17 09:36:59.957830 router.go:413: level=INFO msg="Waiting for messages" timeout=1m0s [watermill] 2026/11/17 09:36:59.957931 router.go:589: level=INFO msg="Router closed" [watermill] 2026/11/17 09:36:59.958010 router.go:419: level=INFO msg="All messages processed" I1117 09:36:59.958198 webhook_queue.go:312 webhook pubsub worker stopped --- PASS: TestQueueRetriesBeforeDeadLetter (1.72s) PASS ok github.com/seaweedfs/seaweedfs/weed/notification/webhook 8.343s === RUN TestAssignRetriesOnUnavailable --- PASS: TestAssignRetriesOnUnavailable (5.17s) === RUN TestAssignStopsOnContextCancel --- PASS: TestAssignStopsOnContextCancel (2.01s) === RUN TestAssignRetryLandsAtWarmupEndWithHint --- PASS: TestAssignRetryLandsAtWarmupEndWithHint (2.72s) === RUN TestToAssignRequestsKeepsEnforcedLocation --- PASS: TestToAssignRequestsKeepsEnforcedLocation (0.00s) === RUN TestToAssignRequestsWidensDefaultLocation --- PASS: TestToAssignRequestsWidensDefaultLocation (0.00s) === RUN TestChunkedFileReaderTriesTheNextReplica I1117 09:37:04.370292 chunked_file.go:223 read chunk 91201,01637037d6 from http://127.0.0.1:39225/91201,01637037d6: Get "http://127.0.0.1:39225/91201,01637037d6": dial tcp 127.0.0.1:39225: connect: connection refused --- PASS: TestChunkedFileReaderTriesTheNextReplica (0.23s) === RUN TestChunkedFileReaderDoesNotContinueAPartlySentChunk I1117 09:37:04.580163 chunked_file.go:223 read chunk 91205,01637037d6 from http://127.0.0.1:42253/91205,01637037d6: unexpected EOF --- PASS: TestChunkedFileReaderDoesNotContinueAPartlySentChunk (0.06s) === RUN TestChunkedFileReaderAsksMasterWhenCachedReplicasFail I1117 09:37:04.639705 chunked_file.go:223 read chunk 91202,02637037d6 from http://127.0.0.1:33679/91202,02637037d6: Get "http://127.0.0.1:33679/91202,02637037d6": dial tcp 127.0.0.1:33679: connect: connection refused --- PASS: TestChunkedFileReaderAsksMasterWhenCachedReplicasFail (0.04s) === RUN TestChunkedFileReaderTreatsAShortBodyAsFailed I1117 09:37:04.679095 chunked_file.go:223 read chunk 91206,01637037d6 from http://127.0.0.1:40391/91206,01637037d6: http://127.0.0.1:40391/91206,01637037d6: 0 of 2048 bytes: unexpected EOF --- PASS: TestChunkedFileReaderTreatsAShortBodyAsFailed (0.02s) === RUN TestChunkedFileReaderStopsWhenTheClientGoesAway --- PASS: TestChunkedFileReaderStopsWhenTheClientGoesAway (0.01s) === RUN TestLookupVolumeIdCacheInvalidation --- PASS: TestLookupVolumeIdCacheInvalidation (0.02s) === RUN TestLookupRaftLeaderMasterFromFollower --- PASS: TestLookupRaftLeaderMasterFromFollower (0.02s) === RUN TestLookupRaftLeaderMasterTriesNextPeer --- PASS: TestLookupRaftLeaderMasterTriesNextPeer (0.03s) === RUN TestLookupRaftLeaderMasterNoPeers --- PASS: TestLookupRaftLeaderMasterNoPeers (0.00s) === RUN TestLookupRaftLeaderMasterCanceledContext --- PASS: TestLookupRaftLeaderMasterCanceledContext (0.00s) === RUN TestCaching vid 123 locations = [{a.com:8080 0 false false false}] --- PASS: TestCaching (2.00s) === RUN TestCachingDelete --- PASS: TestCachingDelete (0.00s) === RUN TestCachingLargeVolumeId --- PASS: TestCachingLargeVolumeId (0.00s) === RUN TestCreateNeedleFromRequest needle: 0f084d17353afda0 Size:0, DataSize:0, Name:t.txt, Mime:text/plain; charset=utf-8 Compressed:true, originalSize: 1422 W1117 09:37:06.812706 upload_content.go:377 uploading 0 to http://localhost:8080/389,0f084d17353afda0: upload t.txt 816 bytes to http://localhost:8080/389,0f084d17353afda0: EOF needle: 0f084d17353afda0 Size:0, DataSize:0, Name:t.txt, Mime:text/plain; charset=utf-8 Compressed:true, originalSize: 1422 W1117 09:37:07.335400 upload_content.go:377 uploading 1 to http://localhost:8080/389,0f084d17353afda0: upload t.txt 816 bytes to http://localhost:8080/389,0f084d17353afda0: EOF needle: 0f084d17353afda0 Size:0, DataSize:0, Name:t.txt, Mime:text/plain; charset=utf-8 Compressed:true, originalSize: 1422 W1117 09:37:08.062695 upload_content.go:377 uploading 2 to http://localhost:8080/389,0f084d17353afda0: upload t.txt 816 bytes to http://localhost:8080/389,0f084d17353afda0: EOF err: upload t.txt 816 bytes to http://localhost:8080/389,0f084d17353afda0: EOF uploadResult: needle: 0f084d17353afda0 Size:0, DataSize:0, Name:t.txt, Mime:text/plain Compressed:true, dataSize:816 originalSize:1422 W1117 09:37:08.076293 upload_content.go:377 uploading 0 to http://localhost:8080/389,0f084d17353afda0: upload t.txt 816 bytes to http://localhost:8080/389,0f084d17353afda0: EOF needle: 0f084d17353afda0 Size:0, DataSize:0, Name:t.txt, Mime:text/plain Compressed:true, dataSize:816 originalSize:1422 W1117 09:37:08.556795 upload_content.go:377 uploading 1 to http://localhost:8080/389,0f084d17353afda0: upload t.txt 816 bytes to http://localhost:8080/389,0f084d17353afda0: EOF needle: 0f084d17353afda0 Size:0, DataSize:0, Name:t.txt, Mime:text/plain Compressed:true, dataSize:816 originalSize:1422 W1117 09:37:09.272894 upload_content.go:377 uploading 2 to http://localhost:8080/389,0f084d17353afda0: upload t.txt 816 bytes to http://localhost:8080/389,0f084d17353afda0: EOF --- PASS: TestCreateNeedleFromRequest (2.49s) === RUN TestUploadKeepsMarginalGzipUncompressed W1117 09:37:09.289204 upload_content.go:377 uploading 0 to http://localhost:8080/389,0f084d17353afda0: upload doc.pdf 4450 bytes to http://localhost:8080/389,0f084d17353afda0: EOF W1117 09:37:09.774185 upload_content.go:377 uploading 1 to http://localhost:8080/389,0f084d17353afda0: upload doc.pdf 4450 bytes to http://localhost:8080/389,0f084d17353afda0: EOF W1117 09:37:10.496739 upload_content.go:377 uploading 2 to http://localhost:8080/389,0f084d17353afda0: upload doc.pdf 4450 bytes to http://localhost:8080/389,0f084d17353afda0: EOF --- PASS: TestUploadKeepsMarginalGzipUncompressed (1.22s) === RUN TestUploadProbesGenericBinaryMimeTypes --- PASS: TestUploadProbesGenericBinaryMimeTypes (0.10s) === RUN TestReplicationKeepsTheSourceMime W1117 09:37:10.600056 upload_content.go:377 uploading 0 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF W1117 09:37:11.077382 upload_content.go:377 uploading 1 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF W1117 09:37:11.791926 upload_content.go:377 uploading 2 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF W1117 09:37:11.793660 upload_content.go:377 uploading 0 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF W1117 09:37:12.270643 upload_content.go:377 uploading 1 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF W1117 09:37:12.984988 upload_content.go:377 uploading 2 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF W1117 09:37:12.986739 upload_content.go:377 uploading 0 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF W1117 09:37:13.463775 upload_content.go:377 uploading 1 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF W1117 09:37:14.178371 upload_content.go:377 uploading 2 to http://localhost:8080/389,0f084d17353afda0?type=replicate: upload report.html 1422 bytes to http://localhost:8080/389,0f084d17353afda0?type=replicate: EOF --- PASS: TestReplicationKeepsTheSourceMime (3.58s) === RUN TestUploadReaderInChunksReturnsPartialResultsOnError E1117 09:37:14.185287 upload_chunked.go:283 chunked upload failed: assign volume: simulated volume assignment failure (returning 1 partial chunks for cleanup) upload_chunked_test.go:72: ✓ Got expected error: assign volume: simulated volume assignment failure upload_chunked_test.go:78: ✓ Result is not nil (partial results returned) upload_chunked_test.go:84: ✓ Result contains 1 chunks (may be 0 if all assignments failed) upload_chunked_test.go:90: ✓ Md5Hash is available for partial data upload_chunked_test.go:97: ✓ TotalSize = 32768 bytes read before failure --- PASS: TestUploadReaderInChunksReturnsPartialResultsOnError (0.01s) === RUN TestUploadReaderInChunksSuccessPath upload_chunked_test.go:140: ✓ Upload completed without error upload_chunked_test.go:146: ✓ Result is not nil upload_chunked_test.go:152: ✓ Result contains 1 file chunk(s) upload_chunked_test.go:159: ✓ TotalSize=15 matches input data upload_chunked_test.go:166: ✓ Md5Hash is available upload_chunked_test.go:181: ✓ Chunk properties validated: FileId=test-fid,1234, Offset=0, Size=15 --- PASS: TestUploadReaderInChunksSuccessPath (0.00s) === RUN TestUploadReaderInChunksContextCancellation E1117 09:37:14.198562 upload_chunked.go:283 chunked upload failed: context canceled (returning 0 partial chunks for cleanup) upload_chunked_test.go:235: ✓ Got partial result on cancellation: chunks=0 --- PASS: TestUploadReaderInChunksContextCancellation (0.00s) === RUN TestUploadChunkToHoldersRollsBackOnPartialFailure E1117 09:37:14.222973 upload_content.go:696 unmarshal http://127.0.0.1:39021/3,01abcdef?type=replicate: boom W1117 09:37:14.223476 upload_content.go:377 uploading 0 to http://127.0.0.1:39021/3,01abcdef?type=replicate: unmarshal http://127.0.0.1:39021/3,01abcdef?type=replicate: invalid character 'b' looking for beginning of value E1117 09:37:14.711599 upload_content.go:696 unmarshal http://127.0.0.1:39021/3,01abcdef?type=replicate: boom W1117 09:37:14.712061 upload_content.go:377 uploading 1 to http://127.0.0.1:39021/3,01abcdef?type=replicate: unmarshal http://127.0.0.1:39021/3,01abcdef?type=replicate: invalid character 'b' looking for beginning of value E1117 09:37:15.429575 upload_content.go:696 unmarshal http://127.0.0.1:39021/3,01abcdef?type=replicate: boom W1117 09:37:15.430052 upload_content.go:377 uploading 2 to http://127.0.0.1:39021/3,01abcdef?type=replicate: unmarshal http://127.0.0.1:39021/3,01abcdef?type=replicate: invalid character 'b' looking for beginning of value --- PASS: TestUploadChunkToHoldersRollsBackOnPartialFailure (1.24s) === RUN TestUploadReaderInChunksReaderFailure E1117 09:37:15.440408 upload_chunked.go:283 chunked upload failed: read chunk at offset 8192 (got 1808 bytes): simulated read failure (returning 1 partial chunks for cleanup) upload_chunked_test.go:372: ✓ Got partial result on read failure: chunks=1, totalSize=8192 --- PASS: TestUploadReaderInChunksReaderFailure (0.00s) === RUN TestUploadReaderInChunksTagsTruncatedBody E1117 09:37:15.442818 upload_chunked.go:283 chunked upload failed: truncated request body: read chunk at offset 8192 (got 1808 bytes): unexpected EOF (returning 1 partial chunks for cleanup) --- PASS: TestUploadReaderInChunksTagsTruncatedBody (0.00s) === RUN TestUploadReaderInChunksReassignsOnFullVolume W1117 09:37:16.297635 upload_chunked.go:451 replica fan-out cleanup: delete 1,0a0b0c0d from volume-1:8080: Delete "http://volume-1:8080/1,0a0b0c0d?type=replicate": dial tcp: lookup volume-1: no such host --- PASS: TestUploadReaderInChunksReassignsOnFullVolume (0.86s) === RUN TestUploadReaderInChunksDoesNotReassignOnClientError W1117 09:37:16.316120 upload_chunked.go:451 replica fan-out cleanup: delete 1,0a0b0c0d from volume-1:8080: Delete "http://volume-1:8080/1,0a0b0c0d?type=replicate": dial tcp: lookup volume-1: no such host E1117 09:37:16.316922 upload_chunked.go:283 chunked upload failed: upload chunk: mismatching cookie (returning 0 partial chunks for cleanup) --- PASS: TestUploadReaderInChunksDoesNotReassignOnClientError (0.02s) === RUN TestUploadReaderInChunksBoundsReassignment W1117 09:37:16.334148 upload_chunked.go:451 replica fan-out cleanup: delete 1,0a0b0c0d from volume-1:8080: Delete "http://volume-1:8080/1,0a0b0c0d?type=replicate": dial tcp: lookup volume-1: no such host W1117 09:37:16.787995 upload_chunked.go:451 replica fan-out cleanup: delete 2,0a0b0c0d from volume-2:8080: Delete "http://volume-2:8080/2,0a0b0c0d?type=replicate": dial tcp: lookup volume-2: no such host W1117 09:37:17.239347 upload_chunked.go:451 replica fan-out cleanup: delete 3,0a0b0c0d from volume-3:8080: Delete "http://volume-3:8080/3,0a0b0c0d?type=replicate": dial tcp: lookup volume-3: no such host E1117 09:37:17.240083 upload_chunked.go:283 chunked upload failed: upload chunk: volume full (returning 0 partial chunks for cleanup) --- PASS: TestUploadReaderInChunksBoundsReassignment (0.92s) === RUN TestUploadReaderInChunksReassignsAcrossHolders W1117 09:37:17.259632 upload_content.go:377 uploading 0 to http://127.0.0.1:43435/1,0a0b0c0d?type=replicate: unmarshalled error http://127.0.0.1:43435/1,0a0b0c0d?type=replicate: failed to write to local disk: Volume Size 34361499680 Exceeded 34359738368 W1117 09:37:17.742621 upload_content.go:377 uploading 1 to http://127.0.0.1:43435/1,0a0b0c0d?type=replicate: unmarshalled error http://127.0.0.1:43435/1,0a0b0c0d?type=replicate: failed to write to local disk: Volume Size 34361499680 Exceeded 34359738368 W1117 09:37:18.460017 upload_content.go:377 uploading 2 to http://127.0.0.1:43435/1,0a0b0c0d?type=replicate: unmarshalled error http://127.0.0.1:43435/1,0a0b0c0d?type=replicate: failed to write to local disk: Volume Size 34361499680 Exceeded 34359738368 --- PASS: TestUploadReaderInChunksReassignsAcrossHolders (1.24s) === RUN TestUploadReaderInChunksDoesNotMultiplyRelayAttempts W1117 09:37:18.486211 upload_content.go:377 uploading 0 to http://127.0.0.1:46177/1,0a0b0c0d: unmarshalled error http://127.0.0.1:46177/1,0a0b0c0d: failed to write to local disk: Volume Size 34361499680 Exceeded 34359738368 W1117 09:37:18.496661 upload_content.go:377 uploading 0 to http://127.0.0.1:46177/2,0a0b0c0d: unmarshalled error http://127.0.0.1:46177/2,0a0b0c0d: failed to write to local disk: Volume Size 34361499680 Exceeded 34359738368 W1117 09:37:18.502274 upload_content.go:377 uploading 0 to http://127.0.0.1:46177/3,0a0b0c0d: unmarshalled error http://127.0.0.1:46177/3,0a0b0c0d: failed to write to local disk: Volume Size 34361499680 Exceeded 34359738368 E1117 09:37:18.504744 upload_chunked.go:283 chunked upload failed: upload chunk: unmarshalled error http://127.0.0.1:46177/3,0a0b0c0d: failed to write to local disk: Volume Size 34361499680 Exceeded 34359738368 (returning 0 partial chunks for cleanup) --- PASS: TestUploadReaderInChunksDoesNotMultiplyRelayAttempts (0.03s) === RUN TestUploadReaderInChunksAppendsFsyncWhenAssigned --- PASS: TestUploadReaderInChunksAppendsFsyncWhenAssigned (0.00s) === RUN TestDeleteChunkFromHoldersRenewsExpiredJwt --- PASS: TestDeleteChunkFromHoldersRenewsExpiredJwt (0.01s) === RUN TestDeleteChunkFromHoldersRenewsPerHolder W1117 09:37:18.521019 upload_chunked.go:457 replica fan-out cleanup: delete 1,0a0b0c0d from 127.0.0.1:43167: status 401: {"error":"wrong jwt"} --- PASS: TestDeleteChunkFromHoldersRenewsPerHolder (0.01s) === RUN TestShouldReassignUpload === RUN TestShouldReassignUpload/nil === RUN TestShouldReassignUpload/no_response_(transport) === RUN TestShouldReassignUpload/500_replica_write_failed === RUN TestShouldReassignUpload/503_service_unavailable === RUN TestShouldReassignUpload/proven_conflict === RUN TestShouldReassignUpload/unmarked_conflict === RUN TestShouldReassignUpload/400_bad_request === RUN TestShouldReassignUpload/401_unauthorized === RUN TestShouldReassignUpload/assign_rpc_transport === RUN TestShouldReassignUpload/other_permanent --- PASS: TestShouldReassignUpload (0.01s) --- PASS: TestShouldReassignUpload/nil (0.00s) --- PASS: TestShouldReassignUpload/no_response_(transport) (0.00s) --- PASS: TestShouldReassignUpload/500_replica_write_failed (0.00s) --- PASS: TestShouldReassignUpload/503_service_unavailable (0.00s) --- PASS: TestShouldReassignUpload/proven_conflict (0.00s) --- PASS: TestShouldReassignUpload/unmarked_conflict (0.00s) --- PASS: TestShouldReassignUpload/400_bad_request (0.00s) --- PASS: TestShouldReassignUpload/401_unauthorized (0.00s) --- PASS: TestShouldReassignUpload/assign_rpc_transport (0.00s) --- PASS: TestShouldReassignUpload/other_permanent (0.00s) === RUN TestUploadWithRetryDataReassignsOnProvenConflict === RUN TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=false/outcome=refused-before-append I1117 09:37:18.543074 retry.go:181 retry uploadWithRetry: err: unmarshalled error http://volume-a/1,first: Conflict I1117 09:37:19.547444 retry.go:175 retry uploadWithRetry successfully === RUN TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=false/outcome= === RUN TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=false/outcome=unknown === RUN TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=true/outcome=refused-before-append I1117 09:37:19.554747 upload_content.go:242 upload content: unmarshalled error http://volume-a/1,first: Conflict === RUN TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=true/outcome= I1117 09:37:20.560355 upload_content.go:242 upload content: unmarshalled error http://volume-a/1,first: Conflict === RUN TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=true/outcome=unknown I1117 09:37:20.562675 upload_content.go:242 upload content: unmarshalled error http://volume-a/1,first: Conflict --- PASS: TestUploadWithRetryDataReassignsOnProvenConflict (2.03s) --- PASS: TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=false/outcome=refused-before-append (1.01s) --- PASS: TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=false/outcome= (0.00s) --- PASS: TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=false/outcome=unknown (0.00s) --- PASS: TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=true/outcome=refused-before-append (1.00s) --- PASS: TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=true/outcome= (0.00s) --- PASS: TestUploadWithRetryDataReassignsOnProvenConflict/retryForever=true/outcome=unknown (0.00s) === RUN TestUploadWithRetryDataRetryForeverPreservesAssignmentRetries I1117 09:37:20.564205 upload_content.go:242 upload content: no writable volumes I1117 09:37:21.564906 upload_content.go:242 upload content: no writable volumes --- PASS: TestUploadWithRetryDataRetryForeverPreservesAssignmentRetries (2.51s) === RUN TestUploadWithRetryDataReassignsOnVolumeSizeExceeded W1117 09:37:23.071469 upload_content.go:377 uploading 0 to http://volume-a/1,first: unmarshalled error http://volume-a/1,first: failed to write to local disk: append to volume 1 size 0 actualSize 0: Volume Size 33555976 Exceeded 33554432 W1117 09:37:23.548014 upload_content.go:377 uploading 1 to http://volume-a/1,first: unmarshalled error http://volume-a/1,first: failed to write to local disk: append to volume 1 size 0 actualSize 0: Volume Size 33555976 Exceeded 33554432 W1117 09:37:24.267280 upload_content.go:377 uploading 2 to http://volume-a/1,first: unmarshalled error http://volume-a/1,first: failed to write to local disk: append to volume 1 size 0 actualSize 0: Volume Size 33555976 Exceeded 33554432 I1117 09:37:24.267859 retry.go:181 retry uploadWithRetry: err: unmarshalled error http://volume-a/1,first: failed to write to local disk: append to volume 1 size 0 actualSize 0: Volume Size 33555976 Exceeded 33554432 I1117 09:37:25.271418 retry.go:175 retry uploadWithRetry successfully --- PASS: TestUploadWithRetryDataReassignsOnVolumeSizeExceeded (2.21s) === RUN TestUploadWithRetryDataReassignsOnReplicaWriteFailure W1117 09:37:25.279857 upload_content.go:377 uploading 0 to http://volume-a/1,first: unmarshalled error http://volume-a/1,first: failed to write to replicas for volume 1: [volume-down:8080]: dial tcp: lookup volume-down: no such host W1117 09:37:25.759854 upload_content.go:377 uploading 1 to http://volume-a/1,first: unmarshalled error http://volume-a/1,first: failed to write to replicas for volume 1: [volume-down:8080]: dial tcp: lookup volume-down: no such host W1117 09:37:26.472947 upload_content.go:377 uploading 2 to http://volume-a/1,first: unmarshalled error http://volume-a/1,first: failed to write to replicas for volume 1: [volume-down:8080]: dial tcp: lookup volume-down: no such host I1117 09:37:26.473390 retry.go:181 retry uploadWithRetry: err: unmarshalled error http://volume-a/1,first: failed to write to replicas for volume 1: [volume-down:8080]: dial tcp: lookup volume-down: no such host I1117 09:37:27.474983 retry.go:175 retry uploadWithRetry successfully --- PASS: TestUploadWithRetryDataReassignsOnReplicaWriteFailure (2.20s) === RUN TestUploadStallWatchdogRetriesOnFreshConn W1117 09:37:27.557708 upload_content.go:600 upload 369 bytes to http://test-host:8080/1,deadbeef stalled on a pooled connection, retrying on a fresh one W1117 09:37:27.558523 upload_content.go:377 uploading 0 to http://test-host:8080/1,deadbeef: upload 369 bytes to http://test-host:8080/1,deadbeef: context canceled --- PASS: TestUploadStallWatchdogRetriesOnFreshConn (0.59s) === RUN TestUploadStallWatchdogCoversResponseRead W1117 09:37:28.141848 upload_content.go:600 upload 369 bytes to http://test-host:8080/1,deadbeef stalled on a pooled connection, retrying on a fresh one W1117 09:37:28.142832 upload_content.go:377 uploading 0 to http://test-host:8080/1,deadbeef: read response body http://test-host:8080/1,deadbeef: context canceled --- PASS: TestUploadStallWatchdogCoversResponseRead (0.58s) === RUN TestUploadStallWatchdogStaysDisarmedOnRetry W1117 09:37:28.715770 upload_content.go:600 upload 369 bytes to http://test-host:8080/1,deadbeef stalled on a pooled connection, retrying on a fresh one W1117 09:37:28.716356 upload_content.go:377 uploading 0 to http://test-host:8080/1,deadbeef: upload 369 bytes to http://test-host:8080/1,deadbeef: context canceled --- PASS: TestUploadStallWatchdogStaysDisarmedOnRetry (0.63s) === RUN TestUploadStallWatchdogRearmsForNextUpload W1117 09:37:29.331143 upload_content.go:600 upload 307200 bytes to http://test-host:8080/1,deadbeef stalled on a pooled connection, retrying on a fresh one W1117 09:37:29.331729 upload_content.go:377 uploading 0 to http://test-host:8080/1,deadbeef: upload 307200 bytes to http://test-host:8080/1,deadbeef: context canceled W1117 09:37:29.865604 upload_content.go:600 upload 307200 bytes to http://test-host:8080/1,deadbeef stalled on a pooled connection, retrying on a fresh one W1117 09:37:29.866116 upload_content.go:377 uploading 0 to http://test-host:8080/1,deadbeef: upload 307200 bytes to http://test-host:8080/1,deadbeef: context canceled --- PASS: TestUploadStallWatchdogRearmsForNextUpload (1.07s) === RUN TestUploadStallWatchdogDialsFreshConn W1117 09:37:30.435512 upload_content.go:600 upload 369 bytes to http://127.0.0.1:42041/1,deadbeef stalled on a pooled connection, retrying on a fresh one W1117 09:37:30.437054 upload_content.go:377 uploading 0 to http://127.0.0.1:42041/1,deadbeef: read response body http://127.0.0.1:42041/1,deadbeef: context canceled --- PASS: TestUploadStallWatchdogDialsFreshConn (0.59s) === RUN TestUploadStallWatchdogAllowsSlowCommit --- PASS: TestUploadStallWatchdogAllowsSlowCommit (0.11s) === RUN TestUploadStallWatchdogIgnoresFailedWrites W1117 09:37:31.084137 upload_content.go:377 uploading 0 to http://test-host:8080/1,deadbeef: unmarshalled error http://test-host:8080/1,deadbeef: volume is read only --- PASS: TestUploadStallWatchdogIgnoresFailedWrites (0.03s) === RUN TestUploadStallWatchdogKeepsUnprovenHost --- PASS: TestUploadStallWatchdogKeepsUnprovenHost (0.09s) === RUN TestUploadObservedBps --- PASS: TestUploadObservedBps (0.00s) === RUN TestUploadStallTimeoutScalesWithMeasuredRate --- PASS: TestUploadStallTimeoutScalesWithMeasuredRate (0.00s) === RUN TestUploadWithRetryAppendsFsyncWhenAssigned === RUN TestUploadWithRetryAppendsFsyncWhenAssigned/direct === RUN TestUploadWithRetryAppendsFsyncWhenAssigned/filer_proxy --- PASS: TestUploadWithRetryAppendsFsyncWhenAssigned (0.02s) --- PASS: TestUploadWithRetryAppendsFsyncWhenAssigned/direct (0.01s) --- PASS: TestUploadWithRetryAppendsFsyncWhenAssigned/filer_proxy (0.01s) === RUN TestUploadWithRetryBoundsAssignVolume I1117 09:37:31.397865 upload_content.go:294 assign volume failure count:1 expected_data_size:3: context deadline exceeded --- PASS: TestUploadWithRetryBoundsAssignVolume (0.22s) === RUN TestUploadRewindsBodyOnConnectionReset === RUN TestUploadRewindsBodyOnConnectionReset/connection_reset_by_peer === RUN TestUploadRewindsBodyOnConnectionReset/use_of_closed_network_connection --- PASS: TestUploadRewindsBodyOnConnectionReset (0.01s) --- PASS: TestUploadRewindsBodyOnConnectionReset/connection_reset_by_peer (0.00s) --- PASS: TestUploadRewindsBodyOnConnectionReset/use_of_closed_network_connection (0.00s) === RUN TestReplicationUploadPreservesUncompressedNeedle === RUN TestReplicationUploadPreservesUncompressedNeedle/unknown_binary_sampling === RUN TestReplicationUploadPreservesUncompressedNeedle/receiver_MIME_detection --- PASS: TestReplicationUploadPreservesUncompressedNeedle (0.02s) --- PASS: TestReplicationUploadPreservesUncompressedNeedle/unknown_binary_sampling (0.01s) --- PASS: TestReplicationUploadPreservesUncompressedNeedle/receiver_MIME_detection (0.01s) === RUN TestUploadToDeadReplicaRetriesThreeTimes W1117 09:37:31.545228 upload_content.go:377 uploading 0 to http://dead-replica:8080/3,01: upload test.bin 5 bytes to http://dead-replica:8080/3,01: dial tcp dead-replica:8080: i/o timeout W1117 09:37:32.122020 upload_content.go:377 uploading 1 to http://dead-replica:8080/3,01: upload test.bin 5 bytes to http://dead-replica:8080/3,01: dial tcp dead-replica:8080: i/o timeout W1117 09:37:32.935951 upload_content.go:377 uploading 2 to http://dead-replica:8080/3,01: upload test.bin 5 bytes to http://dead-replica:8080/3,01: dial tcp dead-replica:8080: i/o timeout upload_content_test.go:888: dead replica stalled the caller for 1.492882769s across 3 attempts --- PASS: TestUploadToDeadReplicaRetriesThreeTimes (1.49s) === RUN TestUploadToDeadReplicaSingleAttempt W1117 09:37:33.040041 upload_content.go:377 uploading 0 to http://dead-replica:8080/3,01: upload test.bin 5 bytes to http://dead-replica:8080/3,01: dial tcp dead-replica:8080: i/o timeout --- PASS: TestUploadToDeadReplicaSingleAttempt (0.10s) === RUN TestUploadRetryStopsOnContextCancel --- PASS: TestUploadRetryStopsOnContextCancel (0.00s) === RUN TestCipherUploadKeepsPlaintextETag --- PASS: TestCipherUploadKeepsPlaintextETag (0.02s) === RUN TestUploadWithRetryKeepsReadOnlyVerdict --- PASS: TestUploadWithRetryKeepsReadOnlyVerdict (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/operation 40.645s === RUN TestMoveEcShardsSequence --- PASS: TestMoveEcShardsSequence (0.01s) === RUN TestMoveEcShardsVerifyFailureKeepsSource --- PASS: TestMoveEcShardsVerifyFailureKeepsSource (0.00s) === RUN TestMoveEcShardsZeroSizedDestinationKeepsSource --- PASS: TestMoveEcShardsZeroSizedDestinationKeepsSource (0.00s) === RUN TestMoveEcShardsRejectsSameServer --- PASS: TestMoveEcShardsRejectsSameServer (0.01s) === RUN TestRemoveEcShards --- PASS: TestRemoveEcShards (0.00s) === RUN TestCopyAndMountEcShardsSameAddressMountsOnly --- PASS: TestCopyAndMountEcShardsSameAddressMountsOnly (0.00s) === RUN TestSameServer --- PASS: TestSameServer (0.00s) === RUN TestCheckDialable --- PASS: TestCheckDialable (0.00s) === RUN TestEmbeddedSourceAddressValidated --- PASS: TestEmbeddedSourceAddressValidated (0.00s) === RUN TestNewMoverRejectsMalformedAddressWithoutDialing --- PASS: TestNewMoverRejectsMalformedAddressWithoutDialing (0.00s) === RUN TestLiveMoveVolumeSequence --- PASS: TestLiveMoveVolumeSequence (0.01s) === RUN TestLiveMoveVolumeVerifyMismatchKeepsSource --- PASS: TestLiveMoveVolumeVerifyMismatchKeepsSource (0.00s) === RUN TestLiveMoveVolumeAbortKeepsSourceReadonlyWhenTargetCleanupFails W1117 09:36:54.619553 volume_move.go:124 volume 7 is left readonly on src:8080: failed to delete the incomplete copy on dst:8080: target unreachable; delete that copy, then re-run the move --- PASS: TestLiveMoveVolumeAbortKeepsSourceReadonlyWhenTargetCleanupFails (0.03s) === RUN TestLiveMoveVolumeAlreadyReadonlyStaysReadonly --- PASS: TestLiveMoveVolumeAlreadyReadonlyStaysReadonly (0.00s) === RUN TestLiveMoveVolumePreFrozenAbortCleansTarget --- PASS: TestLiveMoveVolumePreFrozenAbortCleansTarget (0.01s) === RUN TestLiveMoveVolumeCopyErrorCleansMountedTarget --- PASS: TestLiveMoveVolumeCopyErrorCleansMountedTarget (0.00s) === RUN TestLiveMoveVolumeCopyErrorUnknownTargetKeepsSourceReadonly W1117 09:36:54.675417 volume_move.go:111 volume 7 is left readonly on src:8080: a copy may exist on dst:8080 but its origin cannot be determined; delete one side explicitly, then re-run the move --- PASS: TestLiveMoveVolumeCopyErrorUnknownTargetKeepsSourceReadonly (0.01s) === RUN TestLiveMoveVolumeCopyErrorLeavesPreexistingTarget W1117 09:36:54.681578 volume_move.go:111 volume 7 is left readonly on src:8080: a copy may exist on dst:8080 but its origin cannot be determined; delete one side explicitly, then re-run the move --- PASS: TestLiveMoveVolumeCopyErrorLeavesPreexistingTarget (0.00s) === RUN TestLiveMoveVolumeTailErrorAborts --- PASS: TestLiveMoveVolumeTailErrorAborts (0.00s) === RUN TestLiveMoveVolumeTailErrorToleratedForReadonlySource W1117 09:36:54.689228 volume_move.go:198 tail volume 7 from src:8080 to dst:8080: tail failed --- PASS: TestLiveMoveVolumeTailErrorToleratedForReadonlySource (0.01s) === RUN TestLiveMoveVolumeTailFailureAbortsWhenSourceStillChanging W1117 09:36:54.695576 volume_move.go:198 tail volume 7 from src:8080 to dst:8080: tail failed --- PASS: TestLiveMoveVolumeTailFailureAbortsWhenSourceStillChanging (0.00s) === RUN TestLiveMoveVolumeSourceDeleteFailureKeepsBothReadonly W1117 09:36:54.738593 volume_move.go:83 volume 7 is left readonly on src:8080: the source delete failed with the verified copy on dst:8080 mounted --- PASS: TestLiveMoveVolumeSourceDeleteFailureKeepsBothReadonly (0.04s) === RUN TestLiveMoveVolumeRefusesRecopyOverCompleteTarget --- PASS: TestLiveMoveVolumeRefusesRecopyOverCompleteTarget (0.00s) === RUN TestLiveMoveVolumeReadonlySourceUnknownTargetRefused --- PASS: TestLiveMoveVolumeReadonlySourceUnknownTargetRefused (0.00s) === RUN TestLiveMoveVolumePreFrozenSourceMissingRustTargetProceeds --- PASS: TestLiveMoveVolumePreFrozenSourceMissingRustTargetProceeds (0.00s) === RUN TestLiveMoveVolumeReadonlySourceExistingTargetRefused --- PASS: TestLiveMoveVolumeReadonlySourceExistingTargetRefused (0.00s) === RUN TestCopyVolumeLeavesReadonlySourceUntouched --- PASS: TestCopyVolumeLeavesReadonlySourceUntouched (0.00s) === RUN TestLiveMoveVolumeTargetAheadCommits --- PASS: TestLiveMoveVolumeTargetAheadCommits (0.00s) === RUN TestLiveMoveVolumeRejectsSameServer --- PASS: TestLiveMoveVolumeRejectsSameServer (0.00s) === RUN TestLiveMoveVolumeReadonlyMarkFailureRestores --- PASS: TestLiveMoveVolumeReadonlyMarkFailureRestores (0.00s) === RUN TestReplicateVolumePropagatesThroughput --- PASS: TestReplicateVolumePropagatesThroughput (0.00s) === RUN TestCopyVolumeRestoreWritable --- PASS: TestCopyVolumeRestoreWritable (0.00s) === RUN TestLiveMoveVolumeReadonlySourceFreezeNotPersisted --- PASS: TestLiveMoveVolumeReadonlySourceFreezeNotPersisted (0.00s) === RUN TestLiveMoveVolumeTargetReopenFailureRestores --- PASS: TestLiveMoveVolumeTargetReopenFailureRestores (0.00s) === RUN TestCopyVolumeFreezeNotPersisted --- PASS: TestCopyVolumeFreezeNotPersisted (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/operation/volume_move 2.288s === RUN TestReadLogFileRefsMergeOrder --- PASS: TestReadLogFileRefsMergeOrder (0.16s) === RUN TestReadLogFileRefsPathFilter filer_pb_direct_read_test.go:209: Total events: 200, matching /data/filer00/: 100 --- PASS: TestReadLogFileRefsPathFilter (0.06s) === RUN TestDirectReadVsServerSideThroughput === RUN TestDirectReadVsServerSideThroughput/server_side_sequential filer_pb_direct_read_test.go:255: server-side: 6300 events 4.848s 1299 events/sec (21 files sequential + 20µs send/event) === RUN TestDirectReadVsServerSideThroughput/client_direct_read_parallel_streaming filer_pb_direct_read_test.go:276: direct-read: 6300 events 459ms 13714 events/sec (3 filers parallel + streaming, no gRPC) === NAME TestDirectReadVsServerSideThroughput filer_pb_direct_read_test.go:281: Speedup: 10.6x (parallel + streaming + no gRPC vs server-side sequential) --- PASS: TestDirectReadVsServerSideThroughput (5.92s) --- PASS: TestDirectReadVsServerSideThroughput/server_side_sequential (4.85s) --- PASS: TestDirectReadVsServerSideThroughput/client_direct_read_parallel_streaming (0.46s) === RUN TestReadLogFileRefsMultiFilerGenuineErrorAborts --- PASS: TestReadLogFileRefsMultiFilerGenuineErrorAborts (0.01s) === RUN TestReadLogFileRefsMultiFilerNotFoundSkips I1117 09:37:00.821020 filer_pb_direct_read.go:260 skip log file filer=filer01 ts=1794904620813437561 after 0 entries: create reader: volume not found: filer01:1794904620813437561 --- PASS: TestReadLogFileRefsMultiFilerNotFoundSkips (0.03s) === RUN TestReadLogFileRefsSingleFilerOrder --- PASS: TestReadLogFileRefsSingleFilerOrder (0.04s) === RUN TestReadLogFileRefsSingleFilerProcessErrorStops --- PASS: TestReadLogFileRefsSingleFilerProcessErrorStops (0.03s) === RUN TestReadLogFileRefsCorruptSizePrefix --- PASS: TestReadLogFileRefsCorruptSizePrefix (0.00s) === RUN TestReadLogFileRefsAbortDoesNotJoinWedgedReader --- PASS: TestReadLogFileRefsAbortDoesNotJoinWedgedReader (0.01s) === RUN TestReadLogFileRefsSingleFilerNotFoundSkips I1117 09:37:00.948151 filer_pb_direct_read.go:260 skip log file filer=filer00 ts=1794904680934643835 after 0 entries: create reader: volume not found: filer00:1794904680934643835 --- PASS: TestReadLogFileRefsSingleFilerNotFoundSkips (0.02s) === RUN TestReadLogFileRefsProgressCheckpoints --- PASS: TestReadLogFileRefsProgressCheckpoints (0.03s) === RUN TestReadLogFileRefsProgressWaitsOutTimestampTies --- PASS: TestReadLogFileRefsProgressWaitsOutTimestampTies (0.01s) === RUN TestReadLogFileRefsProgressStopsAtFailedEvent --- PASS: TestReadLogFileRefsProgressStopsAtFailedEvent (0.00s) === RUN TestProcessOneLogEntrySkipsInvalidUTF8 E1117 09:37:00.999366 filer_pb_direct_read.go:274 unmarshal log entry: string field contains invalid UTF-8 --- PASS: TestProcessOneLogEntrySkipsInvalidUTF8 (0.02s) === RUN TestProcessOneLogEntryDeliversStreamPosition --- PASS: TestProcessOneLogEntryDeliversStreamPosition (0.00s) === RUN TestProcessOneLogEntryCursorIgnoresCallbackRestamp --- PASS: TestProcessOneLogEntryCursorIgnoresCallbackRestamp (0.00s) === RUN TestFilerSyncOffsetStaysFreshOnFilteredMarker filer_pb_tail_test.go:115: gauge timeline: [{src:offset ts:1000000000} {src:heartbeat ts:1794908221018621548} {src:heartbeat ts:1794908222018621548}] --- PASS: TestFilerSyncOffsetStaysFreshOnFilteredMarker (0.01s) === RUN TestFilerSyncBatchedFreshnessSignalDoesNotCrash --- PASS: TestFilerSyncBatchedFreshnessSignalDoesNotCrash (0.00s) === RUN TestFilerSyncResumeFromProcessedWatermarkOnReconnect --- PASS: TestFilerSyncResumeFromProcessedWatermarkOnReconnect (0.00s) === RUN TestFilerSyncDoesNotAdvanceStartTsNsOnProcessError E1117 09:37:01.031333 filer_pb_tail.go:127 process /watched/bad -> /watched/bad ts_ns=200: unexpected EOF --- PASS: TestFilerSyncDoesNotAdvanceStartTsNsOnProcessError (0.00s) === RUN TestFilerSyncRecoveredEventAdvancesCursor --- PASS: TestFilerSyncRecoveredEventAdvancesCursor (0.00s) === RUN TestFilerSyncMarkerReachesCallbackConsumer --- PASS: TestFilerSyncMarkerReachesCallbackConsumer (0.00s) === RUN TestFilerSyncMarkerCallbackRetries --- PASS: TestFilerSyncMarkerCallbackRetries (0.00s) === RUN TestFilerSyncReconnectReadsWatermarkEachSubscribe --- PASS: TestFilerSyncReconnectReadsWatermarkEachSubscribe (0.00s) === RUN TestChunkDrainCursorKeepsProgressCheckpoint --- PASS: TestChunkDrainCursorKeepsProgressCheckpoint (0.00s) === RUN TestFilerSyncResubscribeSignalEndsStream --- PASS: TestFilerSyncResubscribeSignalEndsStream (0.00s) === RUN TestChunkReplayCheckpointSurvivesReconnect --- PASS: TestChunkReplayCheckpointSurvivesReconnect (0.00s) === RUN TestWithGrpcClient_AbandonedRequestKeepsSharedConnection --- PASS: TestWithGrpcClient_AbandonedRequestKeepsSharedConnection (0.17s) === RUN TestWithGrpcClient_EndedStreamKeepsSharedConnection --- PASS: TestWithGrpcClient_EndedStreamKeepsSharedConnection (0.07s) === RUN TestWithGrpcClient_LogChunkReadFailureKeepsSharedConnection --- PASS: TestWithGrpcClient_LogChunkReadFailureKeepsSharedConnection (0.07s) === RUN TestShouldInvalidateConnection_MarshalErrorIsPerRequest --- PASS: TestShouldInvalidateConnection_MarshalErrorIsPerRequest (0.00s) === RUN TestShouldInvalidateConnection_CallerContextExpiryIsPerRequest --- PASS: TestShouldInvalidateConnection_CallerContextExpiryIsPerRequest (0.00s) === RUN TestShouldInvalidateConnection_StaleChannelStillInvalidates --- PASS: TestShouldInvalidateConnection_StaleChannelStillInvalidates (0.00s) === RUN TestShouldInvalidateConnection_NonCancellableContextIsNoEvidence --- PASS: TestShouldInvalidateConnection_NonCancellableContextIsNoEvidence (0.00s) === RUN TestShouldInvalidateConnection_ClientConnClosingIsNotStale --- PASS: TestShouldInvalidateConnection_ClientConnClosingIsNotStale (0.00s) === RUN TestShouldInvalidateConnection_ResourceExhaustedIsPerRequest --- PASS: TestShouldInvalidateConnection_ResourceExhaustedIsPerRequest (0.00s) === RUN TestShouldInvalidateConnection_GenuineInternalStillInvalidates --- PASS: TestShouldInvalidateConnection_GenuineInternalStillInvalidates (0.00s) === RUN TestShouldInvalidateConnection_TransportErrorsStillInvalidate --- PASS: TestShouldInvalidateConnection_TransportErrorsStillInvalidate (0.00s) === RUN TestIsClientSideMarshalError_RequiresGrpcStatus --- PASS: TestIsClientSideMarshalError_RequiresGrpcStatus (0.00s) === RUN TestResolveLocalGrpcSocket_RemotePortCollision === RUN TestResolveLocalGrpcSocket_RemotePortCollision/local_advertised_host_routes_to_socket === RUN TestResolveLocalGrpcSocket_RemotePortCollision/loopback_v4_routes_to_socket === RUN TestResolveLocalGrpcSocket_RemotePortCollision/localhost_routes_to_socket === RUN TestResolveLocalGrpcSocket_RemotePortCollision/loopback_v6_routes_to_socket === RUN TestResolveLocalGrpcSocket_RemotePortCollision/empty_host_(bare_port)_routes_to_socket === RUN TestResolveLocalGrpcSocket_RemotePortCollision/remote_host_with_same_port_stays_on_TCP === RUN TestResolveLocalGrpcSocket_RemotePortCollision/unrelated_host_with_same_port_stays_on_TCP === RUN TestResolveLocalGrpcSocket_RemotePortCollision/unregistered_port_stays_on_TCP === RUN TestResolveLocalGrpcSocket_RemotePortCollision/malformed_address_stays_on_TCP --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision (0.01s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/local_advertised_host_routes_to_socket (0.00s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/loopback_v4_routes_to_socket (0.00s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/localhost_routes_to_socket (0.00s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/loopback_v6_routes_to_socket (0.00s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/empty_host_(bare_port)_routes_to_socket (0.00s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/remote_host_with_same_port_stays_on_TCP (0.00s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/unrelated_host_with_same_port_stays_on_TCP (0.00s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/unregistered_port_stays_on_TCP (0.00s) --- PASS: TestResolveLocalGrpcSocket_RemotePortCollision/malformed_address_stays_on_TCP (0.00s) === RUN TestJsonpMarshalUnmarshal marshalled: { "backendType": "aws", "backendId": "", "key": "", "offset": "0", "fileSize": "12", "modifiedTime": "0", "extension": "" } unmarshalled: backend_type:"aws" backend_id:"temp" file_size:12 --- PASS: TestJsonpMarshalUnmarshal (0.03s) === RUN TestServerAddresses_ToAddressMapOrSrv_shouldRemovePrefix --- PASS: TestServerAddresses_ToAddressMapOrSrv_shouldRemovePrefix (0.00s) === RUN TestServerAddresses_ToAddressMapOrSrv_shouldHandleIPPortList --- PASS: TestServerAddresses_ToAddressMapOrSrv_shouldHandleIPPortList (0.00s) === RUN TestServerAddress_ToHost === RUN TestServerAddress_ToHost/hostname_with_port === RUN TestServerAddress_ToHost/IPv4_with_port === RUN TestServerAddress_ToHost/IPv6_with_port === RUN TestServerAddress_ToHost/hostname_without_port === RUN TestServerAddress_ToHost/hostname_with_port.grpcPort === RUN TestServerAddress_ToHost/IPv4_with_port.grpcPort === RUN TestServerAddress_ToHost/IPv6_with_port.grpcPort === RUN TestServerAddress_ToHost/bracketed_IPv6_without_port --- PASS: TestServerAddress_ToHost (0.01s) --- PASS: TestServerAddress_ToHost/hostname_with_port (0.00s) --- PASS: TestServerAddress_ToHost/IPv4_with_port (0.00s) --- PASS: TestServerAddress_ToHost/IPv6_with_port (0.00s) --- PASS: TestServerAddress_ToHost/hostname_without_port (0.00s) --- PASS: TestServerAddress_ToHost/hostname_with_port.grpcPort (0.00s) --- PASS: TestServerAddress_ToHost/IPv4_with_port.grpcPort (0.00s) --- PASS: TestServerAddress_ToHost/IPv6_with_port.grpcPort (0.00s) --- PASS: TestServerAddress_ToHost/bracketed_IPv6_without_port (0.00s) === RUN TestIPv6ServerAddressFormatting === RUN TestIPv6ServerAddressFormatting/unbracketed_IPv6 === RUN TestIPv6ServerAddressFormatting/bracketed_IPv6 --- PASS: TestIPv6ServerAddressFormatting (0.00s) --- PASS: TestIPv6ServerAddressFormatting/unbracketed_IPv6 (0.00s) --- PASS: TestIPv6ServerAddressFormatting/bracketed_IPv6 (0.00s) === RUN TestReceiveVolumeListIsTheSameEitherWay === RUN TestReceiveVolumeListIsTheSameEitherWay/streaming=true === RUN TestReceiveVolumeListIsTheSameEitherWay/streaming=false --- PASS: TestReceiveVolumeListIsTheSameEitherWay (0.18s) --- PASS: TestReceiveVolumeListIsTheSameEitherWay/streaming=true (0.11s) --- PASS: TestReceiveVolumeListIsTheSameEitherWay/streaming=false (0.07s) === RUN TestCollectVolumeListRebuildsTheListing === RUN TestCollectVolumeListRebuildsTheListing/streaming=true === RUN TestCollectVolumeListRebuildsTheListing/streaming=false --- PASS: TestCollectVolumeListRebuildsTheListing (0.06s) --- PASS: TestCollectVolumeListRebuildsTheListing/streaming=true (0.02s) --- PASS: TestCollectVolumeListRebuildsTheListing/streaming=false (0.04s) === RUN TestCollectVolumeListSurvivesADiskAddedMidStream --- PASS: TestCollectVolumeListSurvivesADiskAddedMidStream (0.03s) === RUN TestReceiveVolumeListDoesNotRestartAStreamThatBegan --- PASS: TestReceiveVolumeListDoesNotRestartAStreamThatBegan (0.04s) === RUN TestReceiveVolumeListDoesNotRestartOnACallersError --- PASS: TestReceiveVolumeListDoesNotRestartOnACallersError (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/pb 9.092s === RUN TestScrubCipherKeys --- PASS: TestScrubCipherKeys (0.07s) === RUN TestTraverseBfsVisitsDuplicateDirectoryOnce --- PASS: TestTraverseBfsVisitsDuplicateDirectoryOnce (0.27s) === RUN TestReadDirAllEntriesStuckPagination --- PASS: TestReadDirAllEntriesStuckPagination (1.76s) === RUN TestTraverseBfsTrailingSlashRoot --- PASS: TestTraverseBfsTrailingSlashRoot (0.05s) === RUN TestTraverseDfsResumesAfterEachProgressPath I1117 09:36:56.785909 filer_client_dfs.go:27 traverse / after /a/x I1117 09:36:56.838192 filer_client_dfs.go:27 traverse / after /a/y/1 I1117 09:36:56.872433 filer_client_dfs.go:27 traverse / after /a/y/2 I1117 09:36:56.893020 filer_client_dfs.go:27 traverse / after /a/y/3 I1117 09:36:56.909680 filer_client_dfs.go:27 traverse / after /a/y I1117 09:36:56.924776 filer_client_dfs.go:27 traverse / after /a/z I1117 09:36:56.936964 filer_client_dfs.go:27 traverse / after /a I1117 09:36:56.954291 filer_client_dfs.go:27 traverse / after /b I1117 09:36:56.965805 filer_client_dfs.go:27 traverse / after /c I1117 09:36:56.972418 filer_client_dfs.go:27 traverse / after /d I1117 09:36:56.978571 filer_client_dfs.go:27 traverse / after /e/f I1117 09:36:56.987476 filer_client_dfs.go:27 traverse / after /e --- PASS: TestTraverseDfsResumesAfterEachProgressPath (0.31s) === RUN TestTraverseDfsResumeAfterAMissingOrForeignPath I1117 09:36:57.013799 filer_client_dfs.go:27 traverse /a after /a/y/15 --- PASS: TestTraverseDfsResumeAfterAMissingOrForeignPath (0.03s) === RUN TestTraverseDfsReportsFilesBeforeTheirPageFinishes --- PASS: TestTraverseDfsReportsFilesBeforeTheirPageFinishes (0.02s) === RUN TestReadDirAllEntriesWithSnapshotCarriesSnapshotAcrossPages --- PASS: TestReadDirAllEntriesWithSnapshotCarriesSnapshotAcrossPages (0.18s) === RUN TestReadDirAllEntriesWithSnapshotEmptyDirectory --- PASS: TestReadDirAllEntriesWithSnapshotEmptyDirectory (0.00s) === RUN TestScanMetadataEventSkeletonMatchesFullDecode --- PASS: TestScanMetadataEventSkeletonMatchesFullDecode (0.02s) === RUN TestScanMetadataEventSkeletonFallsBack --- PASS: TestScanMetadataEventSkeletonFallsBack (0.00s) === RUN TestScanMetadataEventSkeletonEmptyPayload --- PASS: TestScanMetadataEventSkeletonEmptyPayload (0.00s) === RUN TestMetadataDirectoryMayMatchSubscriptionCoversMatches --- PASS: TestMetadataDirectoryMayMatchSubscriptionCoversMatches (0.04s) === RUN TestScanMetadataEventDirectories --- PASS: TestScanMetadataEventDirectories (0.00s) === RUN TestAssignVolumeResponseError --- PASS: TestAssignVolumeResponseError (0.00s) === RUN TestIsDirectoryKeyObject === RUN TestIsDirectoryKeyObject/plain_directory === RUN TestIsDirectoryKeyObject/directory_marker_with_mime === RUN TestIsDirectoryKeyObject/directory_promoted_from_file_keeps_chunks === RUN TestIsDirectoryKeyObject/directory_promoted_from_small_file_keeps_content === RUN TestIsDirectoryKeyObject/directory_promoted_from_remote-tiered_file === RUN TestIsDirectoryKeyObject/directory_with_chunks_and_nil_attributes === RUN TestIsDirectoryKeyObject/regular_file_with_chunks === RUN TestIsDirectoryKeyObject/remote_mount_directory_has_no_remote_size === RUN TestIsDirectoryKeyObject/empty_prefix_object_has_only_the_mark --- PASS: TestIsDirectoryKeyObject (0.01s) --- PASS: TestIsDirectoryKeyObject/plain_directory (0.00s) --- PASS: TestIsDirectoryKeyObject/directory_marker_with_mime (0.00s) --- PASS: TestIsDirectoryKeyObject/directory_promoted_from_file_keeps_chunks (0.00s) --- PASS: TestIsDirectoryKeyObject/directory_promoted_from_small_file_keeps_content (0.00s) --- PASS: TestIsDirectoryKeyObject/directory_promoted_from_remote-tiered_file (0.00s) --- PASS: TestIsDirectoryKeyObject/directory_with_chunks_and_nil_attributes (0.00s) --- PASS: TestIsDirectoryKeyObject/regular_file_with_chunks (0.00s) --- PASS: TestIsDirectoryKeyObject/remote_mount_directory_has_no_remote_size (0.00s) --- PASS: TestIsDirectoryKeyObject/empty_prefix_object_has_only_the_mark (0.00s) === RUN TestMarkPrefixObject --- PASS: TestMarkPrefixObject (0.00s) === RUN TestVTWireCompatibility --- PASS: TestVTWireCompatibility (0.04s) === RUN TestUTF8Validation --- PASS: TestUTF8Validation (0.00s) === RUN TestVtProtoPreservesLogTsNs --- PASS: TestVtProtoPreservesLogTsNs (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/pb/filer_pb 4.668s ? github.com/seaweedfs/seaweedfs/weed/pb/iam_pb [no test files] === RUN TestDiskInfoSplitByPhysicalDisk_includesEmptyDiskFromPhysicalDisks --- PASS: TestDiskInfoSplitByPhysicalDisk_includesEmptyDiskFromPhysicalDisks (0.01s) === RUN TestDiskInfoSplitByPhysicalDisk_clampsNegativeFreeOnOverAllocation --- PASS: TestDiskInfoSplitByPhysicalDisk_clampsNegativeFreeOnOverAllocation (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_collapsesOnSingleDisk --- PASS: TestDiskInfoSplitByPhysicalDisk_collapsesOnSingleDisk (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_splitsByVolumeDiskId --- PASS: TestDiskInfoSplitByPhysicalDisk_splitsByVolumeDiskId (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_preservesAggregateCapacityWithRemainder --- PASS: TestDiskInfoSplitByPhysicalDisk_preservesAggregateCapacityWithRemainder (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_countsActiveAndRemoteExactly --- PASS: TestDiskInfoSplitByPhysicalDisk_countsActiveAndRemoteExactly (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_splitsByEcShardDiskId --- PASS: TestDiskInfoSplitByPhysicalDisk_splitsByEcShardDiskId (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_normalizesZeroToOuterDiskId --- PASS: TestDiskInfoSplitByPhysicalDisk_normalizesZeroToOuterDiskId (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_keepsRealDiskZeroWhenMixed --- PASS: TestDiskInfoSplitByPhysicalDisk_keepsRealDiskZeroWhenMixed (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_nilSafe --- PASS: TestDiskInfoSplitByPhysicalDisk_nilSafe (0.00s) === RUN TestDiskInfoSplitByPhysicalDisk_emptyDiskReturnsSelf --- PASS: TestDiskInfoSplitByPhysicalDisk_emptyDiskReturnsSelf (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/pb/master_pb 0.676s ? github.com/seaweedfs/seaweedfs/weed/pb/message_fbs [no test files] ? github.com/seaweedfs/seaweedfs/weed/pb/mount_pb [no test files] ? github.com/seaweedfs/seaweedfs/weed/pb/mount_peer_pb [no test files] === RUN TestPublishRecordResponseSerialization --- PASS: TestPublishRecordResponseSerialization (0.03s) === RUN TestSubscribeRecordResponseSerialization --- PASS: TestSubscribeRecordResponseSerialization (0.02s) === RUN TestPublishRecordResponseBackwardCompatibility --- PASS: TestPublishRecordResponseBackwardCompatibility (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/pb/mq_agent_pb 0.651s ? github.com/seaweedfs/seaweedfs/weed/pb/mq_pb [no test files] ? github.com/seaweedfs/seaweedfs/weed/pb/plugin_pb [no test files] ? github.com/seaweedfs/seaweedfs/weed/pb/remote_pb [no test files] ? github.com/seaweedfs/seaweedfs/weed/pb/s3_lifecycle_pb [no test files] ? github.com/seaweedfs/seaweedfs/weed/pb/s3_pb [no test files] === RUN TestOffsetTypeEnums === RUN TestOffsetTypeEnums/EXACT_OFFSET === RUN TestOffsetTypeEnums/RESET_TO_OFFSET --- PASS: TestOffsetTypeEnums (0.02s) --- PASS: TestOffsetTypeEnums/EXACT_OFFSET (0.00s) --- PASS: TestOffsetTypeEnums/RESET_TO_OFFSET (0.00s) === RUN TestPartitionOffsetSerialization --- PASS: TestPartitionOffsetSerialization (0.05s) === RUN TestPartitionOffsetBackwardCompatibility --- PASS: TestPartitionOffsetBackwardCompatibility (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/pb/schema_pb 0.449s ? github.com/seaweedfs/seaweedfs/weed/pb/vector_pb [no test files] ? github.com/seaweedfs/seaweedfs/weed/pb/volume_server_pb [no test files] ? github.com/seaweedfs/seaweedfs/weed/pb/worker_pb [no test files] === RUN TestPickTargetPrefersTheEmptiestByFreeBytes --- PASS: TestPickTargetPrefersTheEmptiestByFreeBytes (0.01s) === RUN TestPickTargetFallsBackToSlotsWithoutReportedBytes --- PASS: TestPickTargetFallsBackToSlotsWithoutReportedBytes (0.00s) === RUN TestPickTargetSkipsSourceExcludedAndFull --- PASS: TestPickTargetSkipsSourceExcludedAndFull (0.00s) === RUN TestPickTargetReturnsNilWhenNothingFits --- PASS: TestPickTargetReturnsNilWhenNothingFits (0.00s) === RUN TestPickTargetHonoursAnchorDataCenter --- PASS: TestPickTargetHonoursAnchorDataCenter (0.00s) === RUN TestPickTargetPrefersTheSourceRackOverAnEmptierStranger --- PASS: TestPickTargetPrefersTheSourceRackOverAnEmptierStranger (0.00s) === RUN TestPickTargetLeavesTheRackWhenItCannotHoldTheVolume --- PASS: TestPickTargetLeavesTheRackWhenItCannotHoldTheVolume (0.00s) === RUN TestPickTargetPrefersSameDataCenterOverAnother --- PASS: TestPickTargetPrefersSameDataCenterOverAnother (0.00s) === RUN TestPickTargetFallsBackToCapacityForAnUnknownSource --- PASS: TestPickTargetFallsBackToCapacityForAnUnknownSource (0.00s) === RUN TestPickTargetSpendsCapacitySoABatchSpreads --- PASS: TestPickTargetSpendsCapacitySoABatchSpreads (0.00s) === RUN TestPickTargetStopsWhenTheSnapshotIsSpent --- PASS: TestPickTargetStopsWhenTheSnapshotIsSpent (0.00s) === RUN TestPickTargetUsesOneMetricWhenReportingIsMixed --- PASS: TestPickTargetUsesOneMetricWhenReportingIsMixed (0.00s) === RUN TestPickTargetReservesTheVolumeSize --- PASS: TestPickTargetReservesTheVolumeSize (0.01s) === RUN TestPickTargetHonoursTheCallerPredicate --- PASS: TestPickTargetHonoursTheCallerPredicate (0.00s) === RUN TestPickTargetPredicateSeesRackAndDataCenter --- PASS: TestPickTargetPredicateSeesRackAndDataCenter (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/placement 0.894s === RUN TestAdminScriptFilerAddressKeepsGrpcPortOffConvention --- PASS: TestAdminScriptFilerAddressKeepsGrpcPortOffConvention (0.00s) === RUN TestAdminScriptShellOptionsRequireMasters --- PASS: TestAdminScriptShellOptionsRequireMasters (0.00s) === RUN TestAdminScriptDescriptorDefaults --- PASS: TestAdminScriptDescriptorDefaults (0.00s) === RUN TestAdminScriptDetectSkipsByRunInterval --- PASS: TestAdminScriptDetectSkipsByRunInterval (0.00s) === RUN TestAdminScriptDetectCreatesProposalWhenIntervalElapsed --- PASS: TestAdminScriptDetectCreatesProposalWhenIntervalElapsed (0.01s) === RUN TestBuildVolumeMetricsEmptyFilter --- PASS: TestBuildVolumeMetricsEmptyFilter (0.01s) === RUN TestBuildVolumeMetricsAllCollections --- PASS: TestBuildVolumeMetricsAllCollections (0.01s) === RUN TestBuildVolumeMetricsEachCollection --- PASS: TestBuildVolumeMetricsEachCollection (0.00s) === RUN TestBuildVolumeMetricsRegexFilter --- PASS: TestBuildVolumeMetricsRegexFilter (0.01s) === RUN TestBuildVolumeMetricsCollectionList --- PASS: TestBuildVolumeMetricsCollectionList (0.00s) === RUN TestBuildVolumeMetricsInvalidRegex --- PASS: TestBuildVolumeMetricsInvalidRegex (0.00s) === RUN TestWorkerJobContextDoesNotCarryStreamToken --- PASS: TestWorkerJobContextDoesNotCarryStreamToken (0.41s) === RUN TestWorkerConnectionTeardownCancelsJobContext --- PASS: TestWorkerConnectionTeardownCancelsJobContext (0.06s) === RUN TestSkipDetectionByInterval === RUN TestSkipDetectionByInterval/no_history === RUN TestSkipDetectionByInterval/disabled === RUN TestSkipDetectionByInterval/cooldown === RUN TestSkipDetectionByInterval/expired --- PASS: TestSkipDetectionByInterval (0.01s) --- PASS: TestSkipDetectionByInterval/no_history (0.00s) --- PASS: TestSkipDetectionByInterval/disabled (0.00s) --- PASS: TestSkipDetectionByInterval/cooldown (0.00s) --- PASS: TestSkipDetectionByInterval/expired (0.00s) === RUN TestWorkerBuildHelloUsesConfiguredConcurrency --- PASS: TestWorkerBuildHelloUsesConfiguredConcurrency (0.00s) === RUN TestWorkerBuildHelloIncludesMultipleCapabilities --- PASS: TestWorkerBuildHelloIncludesMultipleCapabilities (0.00s) === RUN TestWorkerCancelWorkByTargetID --- PASS: TestWorkerCancelWorkByTargetID (0.00s) === RUN TestWorkerHandleCancelRequestAck --- PASS: TestWorkerHandleCancelRequestAck (0.00s) === RUN TestWorkerSchemaRequestRequiresJobTypeWhenMultipleHandlers --- PASS: TestWorkerSchemaRequestRequiresJobTypeWhenMultipleHandlers (0.00s) === RUN TestWorkerHandleDetectionQueuesWhenAtCapacity --- PASS: TestWorkerHandleDetectionQueuesWhenAtCapacity (0.11s) === RUN TestWorkerHeartbeatReflectsActiveDetectionLoad --- PASS: TestWorkerHeartbeatReflectsActiveDetectionLoad (0.00s) === RUN TestWorkerHeartbeatReflectsActiveExecutionLoad --- PASS: TestWorkerHeartbeatReflectsActiveExecutionLoad (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/plugin/worker 2.930s ? github.com/seaweedfs/seaweedfs/weed/plugin/worker/handlers [no test files] === RUN TestAliasTimestampIntegration === RUN TestAliasTimestampIntegration/AliasWithLargeTimestamps === RUN TestAliasTimestampIntegration/AliasWithLargeTimestamps/Timestamp_1 === RUN TestAliasTimestampIntegration/AliasWithLargeTimestamps/Timestamp_2 === RUN TestAliasTimestampIntegration/AliasWithLargeTimestamps/Timestamp_3 === RUN TestAliasTimestampIntegration/AliasWithTimestampRangeQueries === RUN TestAliasTimestampIntegration/AliasWithTimestampPrecisionEdgeCases === RUN TestAliasTimestampIntegration/MultipleAliasesWithTimestamps === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_=_1756947416566456262 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_=_1756947416566456263 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_>_1756947416566456261 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_>_1756947416566456262 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_>=_1756947416566456262 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_>=_1756947416566456263 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_<_1756947416566456263 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_<_1756947416566456262 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_<=_1756947416566456262 === RUN TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_<=_1756947416566456261 === RUN TestAliasTimestampIntegration/ProductionScenarioReproduction --- PASS: TestAliasTimestampIntegration (0.13s) --- PASS: TestAliasTimestampIntegration/AliasWithLargeTimestamps (0.04s) --- PASS: TestAliasTimestampIntegration/AliasWithLargeTimestamps/Timestamp_1 (0.02s) --- PASS: TestAliasTimestampIntegration/AliasWithLargeTimestamps/Timestamp_2 (0.00s) --- PASS: TestAliasTimestampIntegration/AliasWithLargeTimestamps/Timestamp_3 (0.00s) --- PASS: TestAliasTimestampIntegration/AliasWithTimestampRangeQueries (0.01s) --- PASS: TestAliasTimestampIntegration/AliasWithTimestampPrecisionEdgeCases (0.01s) --- PASS: TestAliasTimestampIntegration/MultipleAliasesWithTimestamps (0.01s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes (0.04s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_=_1756947416566456262 (0.01s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_=_1756947416566456263 (0.00s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_>_1756947416566456261 (0.00s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_>_1756947416566456262 (0.00s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_>=_1756947416566456262 (0.00s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_>=_1756947416566456263 (0.00s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_<_1756947416566456263 (0.00s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_<_1756947416566456262 (0.00s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_<=_1756947416566456262 (0.00s) --- PASS: TestAliasTimestampIntegration/CompatibilityWithExistingTimestampFixes/ts_<=_1756947416566456261 (0.00s) --- PASS: TestAliasTimestampIntegration/ProductionScenarioReproduction (0.01s) === RUN TestArithmeticOperations === RUN TestArithmeticOperations/Add_two_integers === RUN TestArithmeticOperations/Add_integer_and_float === RUN TestArithmeticOperations/Subtract_two_integers === RUN TestArithmeticOperations/Multiply_two_integers === RUN TestArithmeticOperations/Multiply_with_float === RUN TestArithmeticOperations/Divide_two_integers === RUN TestArithmeticOperations/Division_by_zero === RUN TestArithmeticOperations/Modulo_operation === RUN TestArithmeticOperations/Modulo_by_zero === RUN TestArithmeticOperations/Add_string_number_to_integer === RUN TestArithmeticOperations/Invalid_string_conversion === RUN TestArithmeticOperations/Add_boolean_to_integer === RUN TestArithmeticOperations/Add_with_null_left_operand === RUN TestArithmeticOperations/Add_with_null_right_operand --- PASS: TestArithmeticOperations (0.03s) --- PASS: TestArithmeticOperations/Add_two_integers (0.00s) --- PASS: TestArithmeticOperations/Add_integer_and_float (0.00s) --- PASS: TestArithmeticOperations/Subtract_two_integers (0.00s) --- PASS: TestArithmeticOperations/Multiply_two_integers (0.00s) --- PASS: TestArithmeticOperations/Multiply_with_float (0.00s) --- PASS: TestArithmeticOperations/Divide_two_integers (0.00s) --- PASS: TestArithmeticOperations/Division_by_zero (0.00s) --- PASS: TestArithmeticOperations/Modulo_operation (0.00s) --- PASS: TestArithmeticOperations/Modulo_by_zero (0.00s) --- PASS: TestArithmeticOperations/Add_string_number_to_integer (0.00s) --- PASS: TestArithmeticOperations/Invalid_string_conversion (0.00s) --- PASS: TestArithmeticOperations/Add_boolean_to_integer (0.00s) --- PASS: TestArithmeticOperations/Add_with_null_left_operand (0.00s) --- PASS: TestArithmeticOperations/Add_with_null_right_operand (0.00s) === RUN TestIndividualArithmeticFunctions --- PASS: TestIndividualArithmeticFunctions (0.00s) === RUN TestMathematicalFunctions === RUN TestMathematicalFunctions/ROUND_function_tests === RUN TestMathematicalFunctions/ROUND_function_tests/Round_float_to_integer === RUN TestMathematicalFunctions/ROUND_function_tests/Round_integer_stays_integer === RUN TestMathematicalFunctions/ROUND_function_tests/Round_with_precision_2 === RUN TestMathematicalFunctions/ROUND_function_tests/Round_negative_number === RUN TestMathematicalFunctions/ROUND_function_tests/Round_null_value === RUN TestMathematicalFunctions/CEIL_function_tests === RUN TestMathematicalFunctions/CEIL_function_tests/Ceil_positive_decimal === RUN TestMathematicalFunctions/CEIL_function_tests/Ceil_negative_decimal === RUN TestMathematicalFunctions/CEIL_function_tests/Ceil_integer === RUN TestMathematicalFunctions/CEIL_function_tests/Ceil_null_value === RUN TestMathematicalFunctions/FLOOR_function_tests === RUN TestMathematicalFunctions/FLOOR_function_tests/Floor_positive_decimal === RUN TestMathematicalFunctions/FLOOR_function_tests/Floor_negative_decimal === RUN TestMathematicalFunctions/FLOOR_function_tests/Floor_integer === RUN TestMathematicalFunctions/FLOOR_function_tests/Floor_null_value === RUN TestMathematicalFunctions/ABS_function_tests === RUN TestMathematicalFunctions/ABS_function_tests/Abs_positive_integer === RUN TestMathematicalFunctions/ABS_function_tests/Abs_negative_integer === RUN TestMathematicalFunctions/ABS_function_tests/Abs_positive_double === RUN TestMathematicalFunctions/ABS_function_tests/Abs_negative_double === RUN TestMathematicalFunctions/ABS_function_tests/Abs_positive_float === RUN TestMathematicalFunctions/ABS_function_tests/Abs_negative_float === RUN TestMathematicalFunctions/ABS_function_tests/Abs_zero === RUN TestMathematicalFunctions/ABS_function_tests/Abs_null_value --- PASS: TestMathematicalFunctions (0.04s) --- PASS: TestMathematicalFunctions/ROUND_function_tests (0.01s) --- PASS: TestMathematicalFunctions/ROUND_function_tests/Round_float_to_integer (0.00s) --- PASS: TestMathematicalFunctions/ROUND_function_tests/Round_integer_stays_integer (0.00s) --- PASS: TestMathematicalFunctions/ROUND_function_tests/Round_with_precision_2 (0.00s) --- PASS: TestMathematicalFunctions/ROUND_function_tests/Round_negative_number (0.00s) --- PASS: TestMathematicalFunctions/ROUND_function_tests/Round_null_value (0.00s) --- PASS: TestMathematicalFunctions/CEIL_function_tests (0.01s) --- PASS: TestMathematicalFunctions/CEIL_function_tests/Ceil_positive_decimal (0.00s) --- PASS: TestMathematicalFunctions/CEIL_function_tests/Ceil_negative_decimal (0.00s) --- PASS: TestMathematicalFunctions/CEIL_function_tests/Ceil_integer (0.00s) --- PASS: TestMathematicalFunctions/CEIL_function_tests/Ceil_null_value (0.00s) --- PASS: TestMathematicalFunctions/FLOOR_function_tests (0.01s) --- PASS: TestMathematicalFunctions/FLOOR_function_tests/Floor_positive_decimal (0.00s) --- PASS: TestMathematicalFunctions/FLOOR_function_tests/Floor_negative_decimal (0.00s) --- PASS: TestMathematicalFunctions/FLOOR_function_tests/Floor_integer (0.00s) --- PASS: TestMathematicalFunctions/FLOOR_function_tests/Floor_null_value (0.00s) --- PASS: TestMathematicalFunctions/ABS_function_tests (0.01s) --- PASS: TestMathematicalFunctions/ABS_function_tests/Abs_positive_integer (0.00s) --- PASS: TestMathematicalFunctions/ABS_function_tests/Abs_negative_integer (0.00s) --- PASS: TestMathematicalFunctions/ABS_function_tests/Abs_positive_double (0.00s) --- PASS: TestMathematicalFunctions/ABS_function_tests/Abs_negative_double (0.00s) --- PASS: TestMathematicalFunctions/ABS_function_tests/Abs_positive_float (0.00s) --- PASS: TestMathematicalFunctions/ABS_function_tests/Abs_negative_float (0.00s) --- PASS: TestMathematicalFunctions/ABS_function_tests/Abs_zero (0.00s) --- PASS: TestMathematicalFunctions/ABS_function_tests/Abs_null_value (0.00s) === RUN TestSQLEngine_ArithmeticOnlyQueryExecution === RUN TestSQLEngine_ArithmeticOnlyQueryExecution/Basic_arithmetic_only_query arithmetic_only_execution_test.go:75: SUCCESS: SELECT id+user_id, id*2 FROM user_events LIMIT 3 returned 3 rows with calculated values === RUN TestSQLEngine_ArithmeticOnlyQueryExecution/With_LIMIT_and_OFFSET_-_original_user_issue arithmetic_only_execution_test.go:75: SUCCESS: SELECT id+user_id, id*2 FROM user_events LIMIT 2 OFFSET 1 returned 2 rows with calculated values === RUN TestSQLEngine_ArithmeticOnlyQueryExecution/Multiple_arithmetic_expressions arithmetic_only_execution_test.go:75: SUCCESS: SELECT user_id+100, id-1000 FROM user_events LIMIT 1 returned 1 rows with calculated values --- PASS: TestSQLEngine_ArithmeticOnlyQueryExecution (0.08s) --- PASS: TestSQLEngine_ArithmeticOnlyQueryExecution/Basic_arithmetic_only_query (0.05s) --- PASS: TestSQLEngine_ArithmeticOnlyQueryExecution/With_LIMIT_and_OFFSET_-_original_user_issue (0.01s) --- PASS: TestSQLEngine_ArithmeticOnlyQueryExecution/Multiple_arithmetic_expressions (0.01s) === RUN TestSQLEngine_ArithmeticOnlyQueryBugReproduction arithmetic_only_execution_test.go:140: SUCCESS: Arithmetic-only query with OFFSET works correctly! arithmetic_only_execution_test.go:141: Query: SELECT id+user_id, id*amount, id*2 FROM user_events LIMIT 10 OFFSET 5 arithmetic_only_execution_test.go:142: Returned 5 rows with correct calculations --- PASS: TestSQLEngine_ArithmeticOnlyQueryBugReproduction (0.01s) === RUN TestArithmeticExpressionParsing === RUN TestArithmeticExpressionParsing/simple_addition === RUN TestArithmeticExpressionParsing/simple_subtraction === RUN TestArithmeticExpressionParsing/multiplication_with_spaces === RUN TestArithmeticExpressionParsing/string_concatenation === RUN TestArithmeticExpressionParsing/string_concatenation_with_spaces === RUN TestArithmeticExpressionParsing/not_arithmetic --- PASS: TestArithmeticExpressionParsing (0.02s) --- PASS: TestArithmeticExpressionParsing/simple_addition (0.00s) --- PASS: TestArithmeticExpressionParsing/simple_subtraction (0.00s) --- PASS: TestArithmeticExpressionParsing/multiplication_with_spaces (0.00s) --- PASS: TestArithmeticExpressionParsing/string_concatenation (0.00s) --- PASS: TestArithmeticExpressionParsing/string_concatenation_with_spaces (0.00s) --- PASS: TestArithmeticExpressionParsing/not_arithmetic (0.00s) === RUN TestArithmeticExpressionEvaluation === RUN TestArithmeticExpressionEvaluation/integer_addition === RUN TestArithmeticExpressionEvaluation/integer_subtraction === RUN TestArithmeticExpressionEvaluation/mixed_types_multiplication === RUN TestArithmeticExpressionEvaluation/string_concatenation === RUN TestArithmeticExpressionEvaluation/string_concatenation_with_spaces --- PASS: TestArithmeticExpressionEvaluation (0.02s) --- PASS: TestArithmeticExpressionEvaluation/integer_addition (0.00s) --- PASS: TestArithmeticExpressionEvaluation/integer_subtraction (0.00s) --- PASS: TestArithmeticExpressionEvaluation/mixed_types_multiplication (0.00s) --- PASS: TestArithmeticExpressionEvaluation/string_concatenation (0.00s) --- PASS: TestArithmeticExpressionEvaluation/string_concatenation_with_spaces (0.00s) === RUN TestSelectArithmeticExpression --- PASS: TestSelectArithmeticExpression (0.00s) === RUN TestArithmeticWithFunctions === RUN TestArithmeticWithFunctions/Simple_function_arithmetic arithmetic_with_functions_test.go:75: PASS Basic function call with addition: SELECT LENGTH('hello') + 10 FROM user_events LIMIT 1 → 15 === RUN TestArithmeticWithFunctions/Nested_functions_with_arithmetic arithmetic_with_functions_test.go:75: PASS Complex nested functions with arithmetic operation (user's original failing query): SELECT length(trim(' hello world ')) + 12 FROM user_events LIMIT 1 → 23 === RUN TestArithmeticWithFunctions/Function_subtraction arithmetic_with_functions_test.go:75: PASS Function call with subtraction: SELECT LENGTH('programming') - 5 FROM user_events LIMIT 1 → 6 === RUN TestArithmeticWithFunctions/Function_multiplication arithmetic_with_functions_test.go:75: PASS Function call with multiplication: SELECT LENGTH('test') * 3 FROM user_events LIMIT 1 → 12 === RUN TestArithmeticWithFunctions/Multiple_nested_functions arithmetic_with_functions_test.go:75: PASS Triple nested functions: SELECT LENGTH(UPPER(TRIM(' hello '))) FROM user_events LIMIT 1 → 5 --- PASS: TestArithmeticWithFunctions (0.10s) --- PASS: TestArithmeticWithFunctions/Simple_function_arithmetic (0.02s) --- PASS: TestArithmeticWithFunctions/Nested_functions_with_arithmetic (0.02s) --- PASS: TestArithmeticWithFunctions/Function_subtraction (0.01s) --- PASS: TestArithmeticWithFunctions/Function_multiplication (0.00s) --- PASS: TestArithmeticWithFunctions/Multiple_nested_functions (0.03s) === RUN TestConvertMQSchemaToTableInfo_NoSchema === RUN TestConvertMQSchemaToTableInfo_NoSchema/nil_schema === RUN TestConvertMQSchemaToTableInfo_NoSchema/schema_with_nil_RecordType --- PASS: TestConvertMQSchemaToTableInfo_NoSchema (0.01s) --- PASS: TestConvertMQSchemaToTableInfo_NoSchema/nil_schema (0.00s) --- PASS: TestConvertMQSchemaToTableInfo_NoSchema/schema_with_nil_RecordType (0.00s) === RUN TestCockroachDBParserSuccess === RUN TestCockroachDBParserSuccess/Basic_Function cockroach_parser_success_test.go:93: SUCCESS: Simple function call → 5 === RUN TestCockroachDBParserSuccess/Function_Arithmetic cockroach_parser_success_test.go:93: SUCCESS: Function with arithmetic operation (original user issue) → 15 === RUN TestCockroachDBParserSuccess/User_Original_Query cockroach_parser_success_test.go:93: SUCCESS: User's exact original failing query - now fixed! → 23 === RUN TestCockroachDBParserSuccess/String_Concatenation cockroach_parser_success_test.go:93: SUCCESS: Basic string concatenation → helloworld === RUN TestCockroachDBParserSuccess/Function_With_Concat cockroach_parser_success_test.go:93: SUCCESS: Function with string concatenation argument → 10 === RUN TestCockroachDBParserSuccess/Multiple_Arithmetic cockroach_parser_success_test.go:93: SUCCESS: Function with multiplication → 12 === RUN TestCockroachDBParserSuccess/Nested_Functions cockroach_parser_success_test.go:93: SUCCESS: Nested function calls → 5 === RUN TestCockroachDBParserSuccess/Column_Alias cockroach_parser_success_test.go:93: SUCCESS: Column alias functionality (AS keyword) → 4 === NAME TestCockroachDBParserSuccess cockroach_parser_success_test.go:101: CockroachDB Parser Integration: 8/8 tests passed! --- PASS: TestCockroachDBParserSuccess (0.06s) --- PASS: TestCockroachDBParserSuccess/Basic_Function (0.01s) --- PASS: TestCockroachDBParserSuccess/Function_Arithmetic (0.00s) --- PASS: TestCockroachDBParserSuccess/User_Original_Query (0.01s) --- PASS: TestCockroachDBParserSuccess/String_Concatenation (0.01s) --- PASS: TestCockroachDBParserSuccess/Function_With_Concat (0.01s) --- PASS: TestCockroachDBParserSuccess/Multiple_Arithmetic (0.01s) --- PASS: TestCockroachDBParserSuccess/Nested_Functions (0.00s) --- PASS: TestCockroachDBParserSuccess/Column_Alias (0.01s) === RUN TestCompleteSQLFixes === RUN TestCompleteSQLFixes/OriginalFailingProductionQueries === RUN TestCompleteSQLFixes/OriginalFailingProductionQueries/OriginalFailingQuery1 === RUN TestCompleteSQLFixes/OriginalFailingProductionQueries/OriginalFailingQuery2 === RUN TestCompleteSQLFixes/OriginalFailingProductionQueries/CurrentDataQuery === RUN TestCompleteSQLFixes/AllFixesWorkTogether === RUN TestCompleteSQLFixes/BackwardCompatibilityVerified === RUN TestCompleteSQLFixes/PerformanceAndStability === RUN TestCompleteSQLFixes/EdgeCasesAndErrorHandling --- PASS: TestCompleteSQLFixes (0.05s) --- PASS: TestCompleteSQLFixes/OriginalFailingProductionQueries (0.03s) --- PASS: TestCompleteSQLFixes/OriginalFailingProductionQueries/OriginalFailingQuery1 (0.00s) --- PASS: TestCompleteSQLFixes/OriginalFailingProductionQueries/OriginalFailingQuery2 (0.01s) --- PASS: TestCompleteSQLFixes/OriginalFailingProductionQueries/CurrentDataQuery (0.00s) --- PASS: TestCompleteSQLFixes/AllFixesWorkTogether (0.01s) --- PASS: TestCompleteSQLFixes/BackwardCompatibilityVerified (0.00s) --- PASS: TestCompleteSQLFixes/PerformanceAndStability (0.00s) --- PASS: TestCompleteSQLFixes/EdgeCasesAndErrorHandling (0.00s) === RUN TestSQLFixesSummary === RUN TestSQLFixesSummary/Summary complete_sql_fixes_test.go:251: ALL SQL FIXES VERIFIED: complete_sql_fixes_test.go:252: Timestamp precision for large int64 values complete_sql_fixes_test.go:253: SQL alias resolution in WHERE clauses complete_sql_fixes_test.go:254: Scan boundary fixes for equality queries complete_sql_fixes_test.go:255: Range query fixes for equal boundaries complete_sql_fixes_test.go:256: Hybrid scanner time range handling complete_sql_fixes_test.go:257: Backward compatibility maintained complete_sql_fixes_test.go:258: Production stability verified --- PASS: TestSQLFixesSummary (0.01s) --- PASS: TestSQLFixesSummary/Summary (0.01s) === RUN TestComprehensiveSQLSuite === RUN TestComprehensiveSQLSuite/Basic_Select_All comprehensive_sql_test.go:319: PASS: Success: Basic select all columns === RUN TestComprehensiveSQLSuite/Basic_Select_Column comprehensive_sql_test.go:319: PASS: Success: Basic select single column === RUN TestComprehensiveSQLSuite/Basic_Select_Multiple_Columns comprehensive_sql_test.go:319: PASS: Success: Basic select multiple columns === RUN TestComprehensiveSQLSuite/Arithmetic_Multiply_FIXED comprehensive_sql_test.go:319: PASS: Success: FIXED: Arithmetic multiplication works === RUN TestComprehensiveSQLSuite/Arithmetic_Add comprehensive_sql_test.go:319: PASS: Success: Arithmetic addition works === RUN TestComprehensiveSQLSuite/Arithmetic_Subtract comprehensive_sql_test.go:319: PASS: Success: Arithmetic subtraction works === RUN TestComprehensiveSQLSuite/Arithmetic_Divide comprehensive_sql_test.go:319: PASS: Success: Arithmetic division works === RUN TestComprehensiveSQLSuite/Arithmetic_Complex comprehensive_sql_test.go:319: PASS: Success: Complex arithmetic expression works === RUN TestComprehensiveSQLSuite/String_Concatenation comprehensive_sql_test.go:319: PASS: Success: String concatenation === RUN TestComprehensiveSQLSuite/String_Column_Concat comprehensive_sql_test.go:319: PASS: Success: Column string concatenation === RUN TestComprehensiveSQLSuite/Function_LENGTH comprehensive_sql_test.go:319: PASS: Success: LENGTH function with literal === RUN TestComprehensiveSQLSuite/Function_LENGTH_Column comprehensive_sql_test.go:319: PASS: Success: LENGTH function with column === RUN TestComprehensiveSQLSuite/Function_UPPER comprehensive_sql_test.go:319: PASS: Success: UPPER function === RUN TestComprehensiveSQLSuite/Function_Nested comprehensive_sql_test.go:319: PASS: Success: Nested functions === RUN TestComprehensiveSQLSuite/Function_Arithmetic comprehensive_sql_test.go:319: PASS: Success: Function with arithmetic === RUN TestComprehensiveSQLSuite/Function_Arithmetic_Complex comprehensive_sql_test.go:319: PASS: Success: Function with complex arithmetic === RUN TestComprehensiveSQLSuite/Table_Simple comprehensive_sql_test.go:319: PASS: Success: Simple table reference === RUN TestComprehensiveSQLSuite/Table_With_Database comprehensive_sql_test.go:319: PASS: Success: Table with database qualifier === RUN TestComprehensiveSQLSuite/Table_Quoted comprehensive_sql_test.go:319: PASS: Success: Quoted table name === RUN TestComprehensiveSQLSuite/Where_Simple comprehensive_sql_test.go:319: PASS: Success: Simple WHERE clause === RUN TestComprehensiveSQLSuite/Where_String comprehensive_sql_test.go:319: PASS: Success: WHERE clause with string === RUN TestComprehensiveSQLSuite/Limit_Only comprehensive_sql_test.go:319: PASS: Success: LIMIT clause only === RUN TestComprehensiveSQLSuite/Limit_Offset comprehensive_sql_test.go:319: PASS: Success: LIMIT with OFFSET === RUN TestComprehensiveSQLSuite/DateTime_CURRENT_DATE comprehensive_sql_test.go:319: PASS: Success: CURRENT_DATE function === RUN TestComprehensiveSQLSuite/DateTime_NOW comprehensive_sql_test.go:319: PASS: Success: NOW() function === RUN TestComprehensiveSQLSuite/DateTime_EXTRACT comprehensive_sql_test.go:319: PASS: Success: EXTRACT function === RUN TestComprehensiveSQLSuite/Empty_String comprehensive_sql_test.go:319: PASS: Success: Empty string literal === RUN TestComprehensiveSQLSuite/Multiple_Spaces comprehensive_sql_test.go:319: PASS: Success: Query with multiple spaces === RUN TestComprehensiveSQLSuite/Mixed_Case comprehensive_sql_test.go:319: PASS: Success: Mixed case SQL === RUN TestComprehensiveSQLSuite/Show_Databases comprehensive_sql_test.go:319: PASS: Success: SHOW DATABASES statement === RUN TestComprehensiveSQLSuite/Show_Tables comprehensive_sql_test.go:319: PASS: Success: SHOW TABLES statement === NAME TestComprehensiveSQLSuite comprehensive_sql_test.go:327: ================================================================================ comprehensive_sql_test.go:328: COMPREHENSIVE SQL TEST SUITE SUMMARY comprehensive_sql_test.go:329: ================================================================================ comprehensive_sql_test.go:330: Total Tests: 31 comprehensive_sql_test.go:331: Successful: 31 comprehensive_sql_test.go:332: Panics: 0 comprehensive_sql_test.go:333: Errors: 0 comprehensive_sql_test.go:334: ================================================================================ --- PASS: TestComprehensiveSQLSuite (0.23s) --- PASS: TestComprehensiveSQLSuite/Basic_Select_All (0.01s) --- PASS: TestComprehensiveSQLSuite/Basic_Select_Column (0.01s) --- PASS: TestComprehensiveSQLSuite/Basic_Select_Multiple_Columns (0.01s) --- PASS: TestComprehensiveSQLSuite/Arithmetic_Multiply_FIXED (0.01s) --- PASS: TestComprehensiveSQLSuite/Arithmetic_Add (0.00s) --- PASS: TestComprehensiveSQLSuite/Arithmetic_Subtract (0.00s) --- PASS: TestComprehensiveSQLSuite/Arithmetic_Divide (0.01s) --- PASS: TestComprehensiveSQLSuite/Arithmetic_Complex (0.01s) --- PASS: TestComprehensiveSQLSuite/String_Concatenation (0.00s) --- PASS: TestComprehensiveSQLSuite/String_Column_Concat (0.01s) --- PASS: TestComprehensiveSQLSuite/Function_LENGTH (0.00s) --- PASS: TestComprehensiveSQLSuite/Function_LENGTH_Column (0.01s) --- PASS: TestComprehensiveSQLSuite/Function_UPPER (0.00s) --- PASS: TestComprehensiveSQLSuite/Function_Nested (0.01s) --- PASS: TestComprehensiveSQLSuite/Function_Arithmetic (0.00s) --- PASS: TestComprehensiveSQLSuite/Function_Arithmetic_Complex (0.01s) --- PASS: TestComprehensiveSQLSuite/Table_Simple (0.00s) --- PASS: TestComprehensiveSQLSuite/Table_With_Database (0.01s) --- PASS: TestComprehensiveSQLSuite/Table_Quoted (0.01s) --- PASS: TestComprehensiveSQLSuite/Where_Simple (0.01s) --- PASS: TestComprehensiveSQLSuite/Where_String (0.01s) --- PASS: TestComprehensiveSQLSuite/Limit_Only (0.01s) --- PASS: TestComprehensiveSQLSuite/Limit_Offset (0.00s) --- PASS: TestComprehensiveSQLSuite/DateTime_CURRENT_DATE (0.01s) --- PASS: TestComprehensiveSQLSuite/DateTime_NOW (0.01s) --- PASS: TestComprehensiveSQLSuite/DateTime_EXTRACT (0.01s) --- PASS: TestComprehensiveSQLSuite/Empty_String (0.01s) --- PASS: TestComprehensiveSQLSuite/Multiple_Spaces (0.00s) --- PASS: TestComprehensiveSQLSuite/Mixed_Case (0.00s) --- PASS: TestComprehensiveSQLSuite/Show_Databases (0.01s) --- PASS: TestComprehensiveSQLSuite/Show_Tables (0.00s) === RUN TestDateTimeFunctions === RUN TestDateTimeFunctions/CURRENT_DATE_function_tests === RUN TestDateTimeFunctions/CURRENT_TIMESTAMP_function_tests === RUN TestDateTimeFunctions/NOW_function_tests === RUN TestDateTimeFunctions/CURRENT_TIME_function_tests --- PASS: TestDateTimeFunctions (0.01s) --- PASS: TestDateTimeFunctions/CURRENT_DATE_function_tests (0.00s) --- PASS: TestDateTimeFunctions/CURRENT_TIMESTAMP_function_tests (0.00s) --- PASS: TestDateTimeFunctions/NOW_function_tests (0.00s) --- PASS: TestDateTimeFunctions/CURRENT_TIME_function_tests (0.00s) === RUN TestExtractFunction === RUN TestExtractFunction/Extract_YEAR === RUN TestExtractFunction/Extract_MONTH === RUN TestExtractFunction/Extract_DAY === RUN TestExtractFunction/Extract_HOUR === RUN TestExtractFunction/Extract_MINUTE === RUN TestExtractFunction/Extract_SECOND === RUN TestExtractFunction/Extract_QUARTER_from_June === RUN TestExtractFunction/Extract_from_string_date === RUN TestExtractFunction/Extract_from_Unix_timestamp === RUN TestExtractFunction/Extract_from_null_value === RUN TestExtractFunction/Extract_invalid_part === RUN TestExtractFunction/Extract_from_invalid_string --- PASS: TestExtractFunction (0.02s) --- PASS: TestExtractFunction/Extract_YEAR (0.00s) --- PASS: TestExtractFunction/Extract_MONTH (0.00s) --- PASS: TestExtractFunction/Extract_DAY (0.00s) --- PASS: TestExtractFunction/Extract_HOUR (0.00s) --- PASS: TestExtractFunction/Extract_MINUTE (0.00s) --- PASS: TestExtractFunction/Extract_SECOND (0.00s) --- PASS: TestExtractFunction/Extract_QUARTER_from_June (0.00s) --- PASS: TestExtractFunction/Extract_from_string_date (0.00s) --- PASS: TestExtractFunction/Extract_from_Unix_timestamp (0.00s) --- PASS: TestExtractFunction/Extract_from_null_value (0.00s) --- PASS: TestExtractFunction/Extract_invalid_part (0.00s) --- PASS: TestExtractFunction/Extract_from_invalid_string (0.00s) === RUN TestDateTruncFunction === RUN TestDateTruncFunction/Truncate_to_second === RUN TestDateTruncFunction/Truncate_to_minute === RUN TestDateTruncFunction/Truncate_to_hour === RUN TestDateTruncFunction/Truncate_to_day === RUN TestDateTruncFunction/Truncate_to_month === RUN TestDateTruncFunction/Truncate_to_quarter === RUN TestDateTruncFunction/Truncate_to_year === RUN TestDateTruncFunction/Truncate_with_plural_precision === RUN TestDateTruncFunction/Truncate_from_string_date === RUN TestDateTruncFunction/Truncate_null_value === RUN TestDateTruncFunction/Invalid_precision --- PASS: TestDateTruncFunction (0.02s) --- PASS: TestDateTruncFunction/Truncate_to_second (0.00s) --- PASS: TestDateTruncFunction/Truncate_to_minute (0.00s) --- PASS: TestDateTruncFunction/Truncate_to_hour (0.00s) --- PASS: TestDateTruncFunction/Truncate_to_day (0.00s) --- PASS: TestDateTruncFunction/Truncate_to_month (0.00s) --- PASS: TestDateTruncFunction/Truncate_to_quarter (0.00s) --- PASS: TestDateTruncFunction/Truncate_to_year (0.00s) --- PASS: TestDateTruncFunction/Truncate_with_plural_precision (0.00s) --- PASS: TestDateTruncFunction/Truncate_from_string_date (0.00s) --- PASS: TestDateTruncFunction/Truncate_null_value (0.00s) --- PASS: TestDateTruncFunction/Invalid_precision (0.00s) === RUN TestDateTimeConstantsInSQL === RUN TestDateTimeConstantsInSQL/CURRENT_TIME_in_SQL_query datetime_functions_test.go:468: CURRENT_TIME returned valid time: 09:40:35 === RUN TestDateTimeConstantsInSQL/CURRENT_DATE_in_SQL_query datetime_functions_test.go:494: CURRENT_DATE returned: 2026-11-17 --- PASS: TestDateTimeConstantsInSQL (0.01s) --- PASS: TestDateTimeConstantsInSQL/CURRENT_TIME_in_SQL_query (0.01s) --- PASS: TestDateTimeConstantsInSQL/CURRENT_DATE_in_SQL_query (0.00s) === RUN TestFunctionArgumentCountHandling === RUN TestFunctionArgumentCountHandling/Zero-argument_function_should_fail_appropriately === RUN TestFunctionArgumentCountHandling/Single-argument_function_should_still_work === RUN TestFunctionArgumentCountHandling/Any_zero-argument_function_should_fail === RUN TestFunctionArgumentCountHandling/Wrong_argument_count_for_single-arg_function_should_fail --- PASS: TestFunctionArgumentCountHandling (0.01s) --- PASS: TestFunctionArgumentCountHandling/Zero-argument_function_should_fail_appropriately (0.00s) --- PASS: TestFunctionArgumentCountHandling/Single-argument_function_should_still_work (0.00s) --- PASS: TestFunctionArgumentCountHandling/Any_zero-argument_function_should_fail (0.00s) --- PASS: TestFunctionArgumentCountHandling/Wrong_argument_count_for_single-arg_function_should_fail (0.00s) === RUN TestExtractFunctionSQL === RUN TestExtractFunctionSQL/Extract_YEAR_from_current_date === RUN TestExtractFunctionSQL/Extract_MONTH_from_current_date === RUN TestExtractFunctionSQL/Extract_DAY_from_current_date === RUN TestExtractFunctionSQL/Extract_HOUR_from_current_timestamp === RUN TestExtractFunctionSQL/Extract_MINUTE_from_current_timestamp === RUN TestExtractFunctionSQL/Extract_QUARTER_from_current_date === RUN TestExtractFunctionSQL/Multiple_EXTRACT_functions === RUN TestExtractFunctionSQL/EXTRACT_with_invalid_date_part === RUN TestExtractFunctionSQL/EXTRACT_with_wrong_number_of_arguments === RUN TestExtractFunctionSQL/EXTRACT_with_too_many_arguments --- PASS: TestExtractFunctionSQL (0.06s) --- PASS: TestExtractFunctionSQL/Extract_YEAR_from_current_date (0.00s) --- PASS: TestExtractFunctionSQL/Extract_MONTH_from_current_date (0.00s) --- PASS: TestExtractFunctionSQL/Extract_DAY_from_current_date (0.00s) --- PASS: TestExtractFunctionSQL/Extract_HOUR_from_current_timestamp (0.00s) --- PASS: TestExtractFunctionSQL/Extract_MINUTE_from_current_timestamp (0.00s) --- PASS: TestExtractFunctionSQL/Extract_QUARTER_from_current_date (0.01s) --- PASS: TestExtractFunctionSQL/Multiple_EXTRACT_functions (0.01s) --- PASS: TestExtractFunctionSQL/EXTRACT_with_invalid_date_part (0.00s) --- PASS: TestExtractFunctionSQL/EXTRACT_with_wrong_number_of_arguments (0.00s) --- PASS: TestExtractFunctionSQL/EXTRACT_with_too_many_arguments (0.00s) === RUN TestDateTruncFunctionSQL === RUN TestDateTruncFunctionSQL/DATE_TRUNC_to_day === RUN TestDateTruncFunctionSQL/DATE_TRUNC_to_hour === RUN TestDateTruncFunctionSQL/DATE_TRUNC_to_month === RUN TestDateTruncFunctionSQL/DATE_TRUNC_with_invalid_precision === RUN TestDateTruncFunctionSQL/DATE_TRUNC_with_wrong_number_of_arguments --- PASS: TestDateTruncFunctionSQL (0.03s) --- PASS: TestDateTruncFunctionSQL/DATE_TRUNC_to_day (0.00s) --- PASS: TestDateTruncFunctionSQL/DATE_TRUNC_to_hour (0.00s) --- PASS: TestDateTruncFunctionSQL/DATE_TRUNC_to_month (0.00s) --- PASS: TestDateTruncFunctionSQL/DATE_TRUNC_with_invalid_precision (0.00s) --- PASS: TestDateTruncFunctionSQL/DATE_TRUNC_with_wrong_number_of_arguments (0.00s) === RUN TestFastPathPredicateValidation === RUN TestFastPathPredicateValidation/No_WHERE_clause fast_path_predicate_validation_test.go:142: No WHERE clause: onlyTimePredicates=true, startTimeNs=0, stopTimeNs=0 === RUN TestFastPathPredicateValidation/Time-only_predicate_(greater_than) fast_path_predicate_validation_test.go:142: Time-only predicate (greater than): onlyTimePredicates=true, startTimeNs=1640995200000000000, stopTimeNs=0 === RUN TestFastPathPredicateValidation/Time-only_predicate_(less_than) fast_path_predicate_validation_test.go:142: Time-only predicate (less than): onlyTimePredicates=true, startTimeNs=0, stopTimeNs=1640995200000000000 === RUN TestFastPathPredicateValidation/Time-only_predicate_(range_with_AND) fast_path_predicate_validation_test.go:142: Time-only predicate (range with AND): onlyTimePredicates=true, startTimeNs=1640995200000000000, stopTimeNs=1641081600000000000 === RUN TestFastPathPredicateValidation/Mixed_predicate_(time_+_non-time) fast_path_predicate_validation_test.go:142: Mixed predicate (time + non-time): onlyTimePredicates=false, startTimeNs=1640995200000000000, stopTimeNs=0 === RUN TestFastPathPredicateValidation/Non-time_predicate_only fast_path_predicate_validation_test.go:142: Non-time predicate only: onlyTimePredicates=false, startTimeNs=0, stopTimeNs=0 === RUN TestFastPathPredicateValidation/Multiple_non-time_predicates fast_path_predicate_validation_test.go:142: Multiple non-time predicates: onlyTimePredicates=false, startTimeNs=0, stopTimeNs=0 === RUN TestFastPathPredicateValidation/OR_with_time_predicate_(unsafe) fast_path_predicate_validation_test.go:142: OR with time predicate (unsafe): onlyTimePredicates=false, startTimeNs=0, stopTimeNs=0 === RUN TestFastPathPredicateValidation/OR_with_only_time_predicates_(still_unsafe) fast_path_predicate_validation_test.go:142: OR with only time predicates (still unsafe): onlyTimePredicates=false, startTimeNs=0, stopTimeNs=0 === RUN TestFastPathPredicateValidation/String_column_comparison fast_path_predicate_validation_test.go:142: String column comparison: onlyTimePredicates=false, startTimeNs=0, stopTimeNs=0 === RUN TestFastPathPredicateValidation/Numeric_column_comparison fast_path_predicate_validation_test.go:142: Numeric column comparison: onlyTimePredicates=false, startTimeNs=0, stopTimeNs=0 === RUN TestFastPathPredicateValidation/Internal_timestamp_column fast_path_predicate_validation_test.go:142: Internal timestamp column: onlyTimePredicates=true, startTimeNs=1640995200000000000, stopTimeNs=0 --- PASS: TestFastPathPredicateValidation (0.06s) --- PASS: TestFastPathPredicateValidation/No_WHERE_clause (0.00s) --- PASS: TestFastPathPredicateValidation/Time-only_predicate_(greater_than) (0.01s) --- PASS: TestFastPathPredicateValidation/Time-only_predicate_(less_than) (0.00s) --- PASS: TestFastPathPredicateValidation/Time-only_predicate_(range_with_AND) (0.00s) --- PASS: TestFastPathPredicateValidation/Mixed_predicate_(time_+_non-time) (0.00s) --- PASS: TestFastPathPredicateValidation/Non-time_predicate_only (0.00s) --- PASS: TestFastPathPredicateValidation/Multiple_non-time_predicates (0.01s) --- PASS: TestFastPathPredicateValidation/OR_with_time_predicate_(unsafe) (0.00s) --- PASS: TestFastPathPredicateValidation/OR_with_only_time_predicates_(still_unsafe) (0.00s) --- PASS: TestFastPathPredicateValidation/String_column_comparison (0.00s) --- PASS: TestFastPathPredicateValidation/Numeric_column_comparison (0.01s) --- PASS: TestFastPathPredicateValidation/Internal_timestamp_column (0.00s) === RUN TestFastPathAggregationSafety === RUN TestFastPathAggregationSafety/No_WHERE_-_should_use_fast_path fast_path_predicate_validation_test.go:215: No WHERE - should use fast path: canAttemptFastPath=true (onlyTimePredicates=true, startTimeNs=0, stopTimeNs=0) === RUN TestFastPathAggregationSafety/Time-only_WHERE_-_should_use_fast_path fast_path_predicate_validation_test.go:215: Time-only WHERE - should use fast path: canAttemptFastPath=true (onlyTimePredicates=true, startTimeNs=1640995200000000000, stopTimeNs=0) === RUN TestFastPathAggregationSafety/Mixed_WHERE_-_should_NOT_use_fast_path fast_path_predicate_validation_test.go:215: Mixed WHERE - should NOT use fast path: canAttemptFastPath=false (onlyTimePredicates=false, startTimeNs=1640995200000000000, stopTimeNs=0) === RUN TestFastPathAggregationSafety/Non-time_WHERE_-_should_NOT_use_fast_path fast_path_predicate_validation_test.go:215: Non-time WHERE - should NOT use fast path: canAttemptFastPath=false (onlyTimePredicates=false, startTimeNs=0, stopTimeNs=0) === RUN TestFastPathAggregationSafety/OR_expression_-_should_NOT_use_fast_path fast_path_predicate_validation_test.go:215: OR expression - should NOT use fast path: canAttemptFastPath=false (onlyTimePredicates=false, startTimeNs=0, stopTimeNs=0) --- PASS: TestFastPathAggregationSafety (0.03s) --- PASS: TestFastPathAggregationSafety/No_WHERE_-_should_use_fast_path (0.00s) --- PASS: TestFastPathAggregationSafety/Time-only_WHERE_-_should_use_fast_path (0.00s) --- PASS: TestFastPathAggregationSafety/Mixed_WHERE_-_should_NOT_use_fast_path (0.01s) --- PASS: TestFastPathAggregationSafety/Non-time_WHERE_-_should_NOT_use_fast_path (0.00s) --- PASS: TestFastPathAggregationSafety/OR_expression_-_should_NOT_use_fast_path (0.00s) === RUN TestTimestampColumnDetection === RUN TestTimestampColumnDetection/_ts fast_path_predicate_validation_test.go:269: Column '_ts': isTimestamp=true === RUN TestTimestampColumnDetection/_ts_ns fast_path_predicate_validation_test.go:269: Column '_ts_ns': isTimestamp=true === RUN TestTimestampColumnDetection/user_id fast_path_predicate_validation_test.go:269: Column 'user_id': isTimestamp=false === RUN TestTimestampColumnDetection/id fast_path_predicate_validation_test.go:269: Column 'id': isTimestamp=false === RUN TestTimestampColumnDetection/status fast_path_predicate_validation_test.go:269: Column 'status': isTimestamp=false === RUN TestTimestampColumnDetection/event_type fast_path_predicate_validation_test.go:269: Column 'event_type': isTimestamp=false --- PASS: TestTimestampColumnDetection (0.01s) --- PASS: TestTimestampColumnDetection/_ts (0.00s) --- PASS: TestTimestampColumnDetection/_ts_ns (0.00s) --- PASS: TestTimestampColumnDetection/user_id (0.00s) --- PASS: TestTimestampColumnDetection/id (0.00s) --- PASS: TestTimestampColumnDetection/status (0.00s) --- PASS: TestTimestampColumnDetection/event_type (0.00s) === RUN TestSQLEngine_HybridSelectBasic hybrid_test.go:67: Found live_log data source from unflushed messages --- PASS: TestSQLEngine_HybridSelectBasic (0.01s) === RUN TestSQLEngine_HybridSelectWithLimit --- PASS: TestSQLEngine_HybridSelectWithLimit (0.01s) === RUN TestSQLEngine_HybridSelectDifferentTables hybrid_test.go:129: Table user_events: 1 columns, 10 rows with hybrid data sources hybrid_test.go:129: Table system_logs: 1 columns, 4 rows with hybrid data sources --- PASS: TestSQLEngine_HybridSelectDifferentTables (0.02s) === RUN TestSQLEngine_HybridDataSource hybrid_test.go:178: Found live event: live_login from live_log hybrid_test.go:178: Found live event: live_action from live_log hybrid_test.go:183: Found archived event: archived_login from parquet_archive hybrid_test.go:183: Found archived event: archived_logout from parquet_archive --- PASS: TestSQLEngine_HybridDataSource (0.01s) === RUN TestSQLEngine_HybridSystemLogs hybrid_test.go:240: Live system log: level=INFO hybrid_test.go:240: Live system log: level=WARN hybrid_test.go:248: Archived system log: level=ERROR hybrid_test.go:248: Archived system log: level=INFO --- PASS: TestSQLEngine_HybridSystemLogs (0.01s) === RUN TestSQLEngine_HybridSelectWithTimeImplications hybrid_test.go:304: Hybrid query results: 4 live messages, 6 archived messages --- PASS: TestSQLEngine_HybridSelectWithTimeImplications (0.01s) === RUN TestMockBrokerClient_BasicFunctionality --- PASS: TestMockBrokerClient_BasicFunctionality (0.00s) === RUN TestMockBrokerClient_FailureScenarios --- PASS: TestMockBrokerClient_FailureScenarios (0.00s) === RUN TestMockBrokerClient_TopicManagement --- PASS: TestMockBrokerClient_TopicManagement (0.00s) === RUN TestSQLEngineWithMockBrokerClient_ErrorHandling mock_test.go:147: ExecuteSQL returned error (acceptable): topic default.nonexistent_topic not found or no schema available: mock broker failure: mock broker unavailable --- PASS: TestSQLEngineWithMockBrokerClient_ErrorHandling (0.06s) === RUN TestNoSchemaError --- PASS: TestNoSchemaError (0.01s) === RUN TestParseSQL_OFFSET_EdgeCases === RUN TestParseSQL_OFFSET_EdgeCases/Valid_LIMIT_OFFSET_with_WHERE === RUN TestParseSQL_OFFSET_EdgeCases/LIMIT_OFFSET_with_mixed_case === RUN TestParseSQL_OFFSET_EdgeCases/LIMIT_OFFSET_with_extra_spaces --- PASS: TestParseSQL_OFFSET_EdgeCases (0.05s) --- PASS: TestParseSQL_OFFSET_EdgeCases/Valid_LIMIT_OFFSET_with_WHERE (0.01s) --- PASS: TestParseSQL_OFFSET_EdgeCases/LIMIT_OFFSET_with_mixed_case (0.01s) --- PASS: TestParseSQL_OFFSET_EdgeCases/LIMIT_OFFSET_with_extra_spaces (0.01s) === RUN TestSQLEngine_OFFSET_EdgeCases === RUN TestSQLEngine_OFFSET_EdgeCases/OFFSET_larger_than_result_set === RUN TestSQLEngine_OFFSET_EdgeCases/OFFSET_with_LIMIT_0 === RUN TestSQLEngine_OFFSET_EdgeCases/High_OFFSET_with_small_LIMIT --- PASS: TestSQLEngine_OFFSET_EdgeCases (0.08s) --- PASS: TestSQLEngine_OFFSET_EdgeCases/OFFSET_larger_than_result_set (0.04s) --- PASS: TestSQLEngine_OFFSET_EdgeCases/OFFSET_with_LIMIT_0 (0.02s) --- PASS: TestSQLEngine_OFFSET_EdgeCases/High_OFFSET_with_small_LIMIT (0.00s) === RUN TestSQLEngine_OFFSET_ErrorCases === RUN TestSQLEngine_OFFSET_ErrorCases/Negative_OFFSET_value offset_test.go:149: Parser accepts negative OFFSET, execution should validate === RUN TestSQLEngine_OFFSET_ErrorCases/Very_large_OFFSET_value --- PASS: TestSQLEngine_OFFSET_ErrorCases (0.01s) --- PASS: TestSQLEngine_OFFSET_ErrorCases/Negative_OFFSET_value (0.00s) --- PASS: TestSQLEngine_OFFSET_ErrorCases/Very_large_OFFSET_value (0.00s) === RUN TestSQLEngine_OFFSET_Consistency === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_0 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_1 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_2 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_3 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_4 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_5 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_6 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_7 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_8 === RUN TestSQLEngine_OFFSET_Consistency/OFFSET_9 --- PASS: TestSQLEngine_OFFSET_Consistency (0.06s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_0 (0.00s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_1 (0.00s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_2 (0.00s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_3 (0.01s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_4 (0.00s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_5 (0.00s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_6 (0.01s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_7 (0.00s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_8 (0.00s) --- PASS: TestSQLEngine_OFFSET_Consistency/OFFSET_9 (0.00s) === RUN TestSQLEngine_LIMIT_OFFSET_BugFix === RUN TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_10_OFFSET_5_returns_correct_count offset_test.go:240: LIMIT 10 OFFSET 5 returned 5 rows (within limit) === RUN TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_5_OFFSET_0 offset_test.go:287: LIMIT 5 OFFSET 0: returned 5 rows (within limit 5) === RUN TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_5_OFFSET_2 offset_test.go:287: LIMIT 5 OFFSET 2: returned 5 rows (within limit 5) === RUN TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_8_OFFSET_3 offset_test.go:287: LIMIT 8 OFFSET 3: returned 7 rows (within limit 8) === RUN TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_15_OFFSET_1 offset_test.go:287: LIMIT 15 OFFSET 1: returned 9 rows (within limit 15) === RUN TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_3_OFFSET_7 offset_test.go:287: LIMIT 3 OFFSET 7: returned 3 rows (within limit 3) === RUN TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_12_OFFSET_4 offset_test.go:287: LIMIT 12 OFFSET 4: returned 6 rows (within limit 12) --- PASS: TestSQLEngine_LIMIT_OFFSET_BugFix (0.04s) --- PASS: TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_10_OFFSET_5_returns_correct_count (0.01s) --- PASS: TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_5_OFFSET_0 (0.01s) --- PASS: TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_5_OFFSET_2 (0.00s) --- PASS: TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_8_OFFSET_3 (0.00s) --- PASS: TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_15_OFFSET_1 (0.01s) --- PASS: TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_3_OFFSET_7 (0.00s) --- PASS: TestSQLEngine_LIMIT_OFFSET_BugFix/LIMIT_12_OFFSET_4 (0.00s) === RUN TestSQLEngine_OFFSET_DataCollectionBuffer === RUN TestSQLEngine_OFFSET_DataCollectionBuffer/Large_OFFSET_with_small_LIMIT === RUN TestSQLEngine_OFFSET_DataCollectionBuffer/Medium_OFFSET_with_medium_LIMIT === RUN TestSQLEngine_OFFSET_DataCollectionBuffer/Progressive_OFFSET_test offset_test.go:351: OFFSET 0: returned 3 rows offset_test.go:351: OFFSET 1: returned 3 rows offset_test.go:351: OFFSET 2: returned 3 rows offset_test.go:351: OFFSET 3: returned 3 rows offset_test.go:351: OFFSET 4: returned 3 rows offset_test.go:351: OFFSET 5: returned 3 rows --- PASS: TestSQLEngine_OFFSET_DataCollectionBuffer (0.05s) --- PASS: TestSQLEngine_OFFSET_DataCollectionBuffer/Large_OFFSET_with_small_LIMIT (0.00s) --- PASS: TestSQLEngine_OFFSET_DataCollectionBuffer/Medium_OFFSET_with_medium_LIMIT (0.00s) --- PASS: TestSQLEngine_OFFSET_DataCollectionBuffer/Progressive_OFFSET_test (0.04s) === RUN TestSQLEngine_LIMIT_OFFSET_ArithmeticExpressions === RUN TestSQLEngine_LIMIT_OFFSET_ArithmeticExpressions/Arithmetic_expressions_with_LIMIT_OFFSET offset_test.go:391: LIMIT 10: returned 10 rows offset_test.go:392: LIMIT 10 OFFSET 5: returned 5 rows offset_test.go:399: Insufficient data (10 rows) to fully test LIMIT 10 OFFSET 5 scenario offset_test.go:409: Row 0: id=417224, user_id=7810, id+user_id=425034 offset_test.go:409: Row 1: id=424297, user_id=8897, id+user_id=433194 offset_test.go:409: Row 2: id=431189, user_id=3400, id+user_id=434589 offset_test.go:409: Row 3: id=413249, user_id=5175, id+user_id=418424 offset_test.go:409: Row 4: id=120612, user_id=5429, id+user_id=126041 === RUN TestSQLEngine_LIMIT_OFFSET_ArithmeticExpressions/Multiplication_expressions offset_test.go:441: Row 0: id=82460, id*2=164920 ✓ offset_test.go:441: Row 1: id=841256, id*2=1682512 ✓ offset_test.go:441: Row 2: id=55537, id*2=111074 ✓ --- PASS: TestSQLEngine_LIMIT_OFFSET_ArithmeticExpressions (0.02s) --- PASS: TestSQLEngine_LIMIT_OFFSET_ArithmeticExpressions/Arithmetic_expressions_with_LIMIT_OFFSET (0.01s) --- PASS: TestSQLEngine_LIMIT_OFFSET_ArithmeticExpressions/Multiplication_expressions (0.01s) === RUN TestSQLEngine_OFFSET_WithAggregation === RUN TestSQLEngine_OFFSET_WithAggregation/COUNT_with_OFFSET === RUN TestSQLEngine_OFFSET_WithAggregation/COUNT_with_OFFSET_1 --- PASS: TestSQLEngine_OFFSET_WithAggregation (0.01s) --- PASS: TestSQLEngine_OFFSET_WithAggregation/COUNT_with_OFFSET (0.00s) --- PASS: TestSQLEngine_OFFSET_WithAggregation/COUNT_with_OFFSET_1 (0.00s) === RUN TestBasicParsing === RUN TestBasicParsing/Query_1 parsing_debug_test.go:20: Testing SQL: SELECT * FROM user_events parsing_debug_test.go:28: Parsed statement type: *engine.SelectStatement parsing_debug_test.go:31: SelectStatement details: parsing_debug_test.go:32: SelectExprs count: 1 parsing_debug_test.go:33: From count: 1 parsing_debug_test.go:34: WHERE clause exists: false parsing_debug_test.go:39: WHERE clause is NIL - this is the bug! === RUN TestBasicParsing/Query_2 parsing_debug_test.go:20: Testing SQL: SELECT id FROM user_events parsing_debug_test.go:28: Parsed statement type: *engine.SelectStatement parsing_debug_test.go:31: SelectStatement details: parsing_debug_test.go:32: SelectExprs count: 1 parsing_debug_test.go:33: From count: 1 parsing_debug_test.go:34: WHERE clause exists: false parsing_debug_test.go:39: WHERE clause is NIL - this is the bug! === RUN TestBasicParsing/Query_3 parsing_debug_test.go:20: Testing SQL: SELECT id FROM user_events WHERE id = 123 parsing_debug_test.go:28: Parsed statement type: *engine.SelectStatement parsing_debug_test.go:31: SelectStatement details: parsing_debug_test.go:32: SelectExprs count: 1 parsing_debug_test.go:33: From count: 1 parsing_debug_test.go:34: WHERE clause exists: true parsing_debug_test.go:37: WHERE expression type: *engine.ComparisonExpr === RUN TestBasicParsing/Query_4 parsing_debug_test.go:20: Testing SQL: SELECT id FROM user_events WHERE id > 123 parsing_debug_test.go:28: Parsed statement type: *engine.SelectStatement parsing_debug_test.go:31: SelectStatement details: parsing_debug_test.go:32: SelectExprs count: 1 parsing_debug_test.go:33: From count: 1 parsing_debug_test.go:34: WHERE clause exists: true parsing_debug_test.go:37: WHERE expression type: *engine.ComparisonExpr === RUN TestBasicParsing/Query_5 parsing_debug_test.go:20: Testing SQL: SELECT id FROM user_events WHERE status = 'active' parsing_debug_test.go:28: Parsed statement type: *engine.SelectStatement parsing_debug_test.go:31: SelectStatement details: parsing_debug_test.go:32: SelectExprs count: 1 parsing_debug_test.go:33: From count: 1 parsing_debug_test.go:34: WHERE clause exists: true parsing_debug_test.go:37: WHERE expression type: *engine.ComparisonExpr --- PASS: TestBasicParsing (0.03s) --- PASS: TestBasicParsing/Query_1 (0.01s) --- PASS: TestBasicParsing/Query_2 (0.00s) --- PASS: TestBasicParsing/Query_3 (0.01s) --- PASS: TestBasicParsing/Query_4 (0.01s) --- PASS: TestBasicParsing/Query_5 (0.01s) === RUN TestCockroachParserDirectly parsing_debug_test.go:53: Testing CockroachDB parser directly with: SELECT id FROM user_events WHERE id > 123 parsing_debug_test.go:61: Our ParseSQL returned: *engine.SelectStatement parsing_debug_test.go:68: Our ParseSQL extracted WHERE clause: *engine.ComparisonExpr --- PASS: TestCockroachParserDirectly (0.00s) === RUN TestParseMethodComparison parsing_debug_test.go:77: Comparing parsing methods for: SELECT id FROM user_events WHERE id > 123 parsing_debug_test.go:81: Global ParseSQL: *engine.SelectStatement, error: parsing_debug_test.go:84: WHERE clause: true parsing_debug_test.go:92: ExecuteSQL error (helps identify parsing path): --- PASS: TestParseMethodComparison (0.01s) === RUN TestPostgreSQLOnlySupport === RUN TestPostgreSQLOnlySupport/MySQL_Backticks_Table postgresql_only_test.go:89: CORRECTLY REJECTED: MySQL backticks for table names should be rejected === RUN TestPostgreSQLOnlySupport/MySQL_Backticks_Column postgresql_only_test.go:89: CORRECTLY REJECTED: MySQL backticks for column names should be rejected === RUN TestPostgreSQLOnlySupport/PostgreSQL_Double_Quotes_OK postgresql_only_test.go:103: CORRECTLY ACCEPTED: PostgreSQL double quotes for identifiers should work === RUN TestPostgreSQLOnlySupport/PostgreSQL_EXTRACT_OK postgresql_only_test.go:103: CORRECTLY ACCEPTED: PostgreSQL EXTRACT function should work === RUN TestPostgreSQLOnlySupport/Single_Quotes_String_Literal_OK postgresql_only_test.go:103: CORRECTLY ACCEPTED: Single quotes for string literals should work === NAME TestPostgreSQLOnlySupport postgresql_only_test.go:109: PostgreSQL-only compliance: 5/5 tests passed --- PASS: TestPostgreSQLOnlySupport (0.05s) --- PASS: TestPostgreSQLOnlySupport/MySQL_Backticks_Table (0.01s) --- PASS: TestPostgreSQLOnlySupport/MySQL_Backticks_Column (0.01s) --- PASS: TestPostgreSQLOnlySupport/PostgreSQL_Double_Quotes_OK (0.01s) --- PASS: TestPostgreSQLOnlySupport/PostgreSQL_EXTRACT_OK (0.00s) --- PASS: TestPostgreSQLOnlySupport/Single_Quotes_String_Literal_OK (0.00s) === RUN TestParseSQL_COUNT_Functions === RUN TestParseSQL_COUNT_Functions/COUNT(*)_basic === RUN TestParseSQL_COUNT_Functions/COUNT(column_name) === RUN TestParseSQL_COUNT_Functions/Multiple_aggregate_functions --- PASS: TestParseSQL_COUNT_Functions (0.01s) --- PASS: TestParseSQL_COUNT_Functions/COUNT(*)_basic (0.00s) --- PASS: TestParseSQL_COUNT_Functions/COUNT(column_name) (0.00s) --- PASS: TestParseSQL_COUNT_Functions/Multiple_aggregate_functions (0.00s) === RUN TestParseSQL_SELECT_Expressions === RUN TestParseSQL_SELECT_Expressions/SELECT_*_FROM_table === RUN TestParseSQL_SELECT_Expressions/SELECT_column_FROM_table === RUN TestParseSQL_SELECT_Expressions/SELECT_multiple_columns --- PASS: TestParseSQL_SELECT_Expressions (0.01s) --- PASS: TestParseSQL_SELECT_Expressions/SELECT_*_FROM_table (0.00s) --- PASS: TestParseSQL_SELECT_Expressions/SELECT_column_FROM_table (0.00s) --- PASS: TestParseSQL_SELECT_Expressions/SELECT_multiple_columns (0.00s) === RUN TestParseSQL_WHERE_Clauses === RUN TestParseSQL_WHERE_Clauses/WHERE_with_simple_comparison === RUN TestParseSQL_WHERE_Clauses/WHERE_with_AND_condition === RUN TestParseSQL_WHERE_Clauses/WHERE_with_OR_condition --- PASS: TestParseSQL_WHERE_Clauses (0.01s) --- PASS: TestParseSQL_WHERE_Clauses/WHERE_with_simple_comparison (0.00s) --- PASS: TestParseSQL_WHERE_Clauses/WHERE_with_AND_condition (0.00s) --- PASS: TestParseSQL_WHERE_Clauses/WHERE_with_OR_condition (0.00s) === RUN TestParseSQL_LIMIT_Clauses === RUN TestParseSQL_LIMIT_Clauses/LIMIT_with_number === RUN TestParseSQL_LIMIT_Clauses/LIMIT_with_OFFSET === RUN TestParseSQL_LIMIT_Clauses/LIMIT_with_OFFSET_zero === RUN TestParseSQL_LIMIT_Clauses/LIMIT_with_large_OFFSET --- PASS: TestParseSQL_LIMIT_Clauses (0.01s) --- PASS: TestParseSQL_LIMIT_Clauses/LIMIT_with_number (0.00s) --- PASS: TestParseSQL_LIMIT_Clauses/LIMIT_with_OFFSET (0.00s) --- PASS: TestParseSQL_LIMIT_Clauses/LIMIT_with_OFFSET_zero (0.00s) --- PASS: TestParseSQL_LIMIT_Clauses/LIMIT_with_large_OFFSET (0.00s) === RUN TestParseSQL_SHOW_Statements === RUN TestParseSQL_SHOW_Statements/SHOW_DATABASES === RUN TestParseSQL_SHOW_Statements/SHOW_TABLES === RUN TestParseSQL_SHOW_Statements/SHOW_TABLES_FROM_database --- PASS: TestParseSQL_SHOW_Statements (0.00s) --- PASS: TestParseSQL_SHOW_Statements/SHOW_DATABASES (0.00s) --- PASS: TestParseSQL_SHOW_Statements/SHOW_TABLES (0.00s) --- PASS: TestParseSQL_SHOW_Statements/SHOW_TABLES_FROM_database (0.00s) === RUN TestRealNamespaceDiscovery real_namespace_test.go:24: Discovered 0 namespaces (no fallback data): real_namespace_test.go:26: (No namespaces found - requires real SeaweedFS MQ cluster) --- PASS: TestRealNamespaceDiscovery (0.17s) === RUN TestRealTopicDiscovery real_namespace_test.go:53: Discovered 0 topics in 'default' namespace (no fallback data): real_namespace_test.go:55: (No topics found - requires real SeaweedFS MQ cluster with 'default' namespace) --- PASS: TestRealTopicDiscovery (0.03s) === RUN TestNamespaceDiscoveryNoFallback real_namespace_test.go:79: ListNamespaces failed as expected: failed to get filer client: failed to discover filer: failed to list filers from master: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp [::1]:18888: connect: connection refused" real_namespace_test.go:99: No fallback behavior - returns empty lists when filer unavailable --- PASS: TestNamespaceDiscoveryNoFallback (0.07s) === RUN TestRealWorldWhereClauseFailure real_world_where_clause_test.go:44: TESTING REAL-WORLD WHERE CLAUSE SCENARIOS real_world_where_clause_test.go:45: ============================================ === RUN TestRealWorldWhereClauseFailure/Where_ID_Greater_Than_Large_Number real_world_where_clause_test.go:65: Query: SELECT id FROM user_events WHERE id > 10000000 real_world_where_clause_test.go:66: Total rows returned: 0 real_world_where_clause_test.go:131: No rows returned - this could be correct if no data matches === RUN TestRealWorldWhereClauseFailure/Where_ID_Greater_Than_Small_Number real_world_where_clause_test.go:65: Query: SELECT id FROM user_events WHERE id > 100000 real_world_where_clause_test.go:66: Total rows returned: 7 real_world_where_clause_test.go:69: Sample IDs returned: real_world_where_clause_test.go:78: Row 1: id = 841256 real_world_where_clause_test.go:78: Row 2: id = 686003 real_world_where_clause_test.go:78: Row 3: id = 417224 real_world_where_clause_test.go:78: Row 4: id = 424297 real_world_where_clause_test.go:78: Row 5: id = 431189 real_world_where_clause_test.go:120: Analysis: real_world_where_clause_test.go:121: Rows matching WHERE condition: 7 real_world_where_clause_test.go:122: Rows NOT matching WHERE condition: 0 real_world_where_clause_test.go:128: PASS: WHERE id > 100000 should filter results - All returned rows match the WHERE condition === RUN TestRealWorldWhereClauseFailure/Where_ID_Less_Than real_world_where_clause_test.go:65: Query: SELECT id FROM user_events WHERE id < 100000 real_world_where_clause_test.go:66: Total rows returned: 3 real_world_where_clause_test.go:69: Sample IDs returned: real_world_where_clause_test.go:78: Row 1: id = 82460 real_world_where_clause_test.go:78: Row 2: id = 55537 real_world_where_clause_test.go:78: Row 3: id = 65143 real_world_where_clause_test.go:120: Analysis: real_world_where_clause_test.go:121: Rows matching WHERE condition: 3 real_world_where_clause_test.go:122: Rows NOT matching WHERE condition: 0 real_world_where_clause_test.go:128: PASS: WHERE id < 100000 should filter results - All returned rows match the WHERE condition --- PASS: TestRealWorldWhereClauseFailure (0.04s) --- PASS: TestRealWorldWhereClauseFailure/Where_ID_Greater_Than_Large_Number (0.01s) --- PASS: TestRealWorldWhereClauseFailure/Where_ID_Greater_Than_Small_Number (0.01s) --- PASS: TestRealWorldWhereClauseFailure/Where_ID_Less_Than (0.01s) === RUN TestWhereClauseWithLimitOffset real_world_where_clause_test.go:144: Testing exact failing query: SELECT id FROM user_events WHERE id > 10000000 LIMIT 10 OFFSET 5 real_world_where_clause_test.go:159: Returned 0 rows (LIMIT 10 worked) real_world_where_clause_test.go:181: WHERE clause working correctly --- PASS: TestWhereClauseWithLimitOffset (0.01s) === RUN TestWhatShouldHaveBeenTested real_world_where_clause_test.go:189: THE TEST THAT SHOULD HAVE CAUGHT THE WHERE CLAUSE ISSUE real_world_where_clause_test.go:190: ======================================================== real_world_where_clause_test.go:199: All rows: 10 real_world_where_clause_test.go:200: WHERE id > 999999999: 0 rows real_world_where_clause_test.go:213: WHERE 1 = 0 (impossible): 0 rows --- PASS: TestWhatShouldHaveBeenTested (0.01s) === RUN TestSchemaAwareParsing === RUN TestSchemaAwareParsing/JSON_Message_Parsing schema_parsing_test.go:74: JSON parsing correctly converted types: int32=1234, string='login', double=75.5, bool=true === RUN TestSchemaAwareParsing/Raw_Data_Type_Conversion schema_parsing_test.go:118: Raw data type conversions working correctly === RUN TestSchemaAwareParsing/Invalid_JSON_Graceful_Handling schema_parsing_test.go:129: Invalid JSON handled gracefully with error --- PASS: TestSchemaAwareParsing (0.03s) --- PASS: TestSchemaAwareParsing/JSON_Message_Parsing (0.01s) --- PASS: TestSchemaAwareParsing/Raw_Data_Type_Conversion (0.00s) --- PASS: TestSchemaAwareParsing/Invalid_JSON_Graceful_Handling (0.01s) === RUN TestSchemaAwareParsingIntegration schema_parsing_test.go:160: Schema-aware parsing integrates correctly with SQL engine --- PASS: TestSchemaAwareParsingIntegration (0.00s) === RUN TestSQLEngine_SelectBasic --- PASS: TestSQLEngine_SelectBasic (0.01s) === RUN TestSQLEngine_SelectWithLimit --- PASS: TestSQLEngine_SelectWithLimit (0.00s) === RUN TestSQLEngine_SelectSpecificColumns --- PASS: TestSQLEngine_SelectSpecificColumns (0.00s) === RUN TestSQLEngine_SelectFromNonExistentTable select_test.go:83: Skipping non-existent table test - table name parsing issue needs investigation --- SKIP: TestSQLEngine_SelectFromNonExistentTable (0.00s) === RUN TestSQLEngine_SelectWithOffset --- PASS: TestSQLEngine_SelectWithOffset (0.01s) === RUN TestSQLEngine_SelectWithLimitAndOffset --- PASS: TestSQLEngine_SelectWithLimitAndOffset (0.00s) === RUN TestSQLEngine_SelectWithOffsetExceedsRows --- PASS: TestSQLEngine_SelectWithOffsetExceedsRows (0.00s) === RUN TestSQLEngine_SelectWithOffsetZero --- PASS: TestSQLEngine_SelectWithOffsetZero (0.01s) === RUN TestSQLEngine_SelectDifferentTables select_test.go:211: Table user_events: 4 columns, 10 rows select_test.go:211: Table system_logs: 3 columns, 4 rows --- PASS: TestSQLEngine_SelectDifferentTables (0.01s) === RUN TestSQLAliasResolution === RUN TestSQLAliasResolution/ResolveColumnAlias === RUN TestSQLAliasResolution/SingleAliasInWhere === RUN TestSQLAliasResolution/MultipleAliasesInWhere === RUN TestSQLAliasResolution/RangeQueryWithAliases === RUN TestSQLAliasResolution/MixedAliasAndDirectColumn === RUN TestSQLAliasResolution/AliasCompatibilityWithTimestampFixes === RUN TestSQLAliasResolution/EdgeCasesAndErrorHandling === RUN TestSQLAliasResolution/ComparisonOperators === RUN TestSQLAliasResolution/ComparisonOperators/=_1000 === RUN TestSQLAliasResolution/ComparisonOperators/=_999 === RUN TestSQLAliasResolution/ComparisonOperators/>_999 === RUN TestSQLAliasResolution/ComparisonOperators/>_1000 === RUN TestSQLAliasResolution/ComparisonOperators/>=_1000 === RUN TestSQLAliasResolution/ComparisonOperators/>=_1001 === RUN TestSQLAliasResolution/ComparisonOperators/<_1001 === RUN TestSQLAliasResolution/ComparisonOperators/<_1000 === RUN TestSQLAliasResolution/ComparisonOperators/<=_1000 === RUN TestSQLAliasResolution/ComparisonOperators/<=_999 === RUN TestSQLAliasResolution/BackwardCompatibility --- PASS: TestSQLAliasResolution (0.09s) --- PASS: TestSQLAliasResolution/ResolveColumnAlias (0.00s) --- PASS: TestSQLAliasResolution/SingleAliasInWhere (0.00s) --- PASS: TestSQLAliasResolution/MultipleAliasesInWhere (0.00s) --- PASS: TestSQLAliasResolution/RangeQueryWithAliases (0.00s) --- PASS: TestSQLAliasResolution/MixedAliasAndDirectColumn (0.00s) --- PASS: TestSQLAliasResolution/AliasCompatibilityWithTimestampFixes (0.01s) --- PASS: TestSQLAliasResolution/EdgeCasesAndErrorHandling (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators (0.04s) --- PASS: TestSQLAliasResolution/ComparisonOperators/=_1000 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/=_999 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/>_999 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/>_1000 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/>=_1000 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/>=_1001 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/<_1001 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/<_1000 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/<=_1000 (0.00s) --- PASS: TestSQLAliasResolution/ComparisonOperators/<=_999 (0.00s) --- PASS: TestSQLAliasResolution/BackwardCompatibility (0.00s) === RUN TestAliasIntegrationWithProductionScenarios === RUN TestAliasIntegrationWithProductionScenarios/OriginalFailingQuery === RUN TestAliasIntegrationWithProductionScenarios/ComplexProductionQuery === RUN TestAliasIntegrationWithProductionScenarios/PerformanceRegression --- PASS: TestAliasIntegrationWithProductionScenarios (0.05s) --- PASS: TestAliasIntegrationWithProductionScenarios/OriginalFailingQuery (0.03s) --- PASS: TestAliasIntegrationWithProductionScenarios/ComplexProductionQuery (0.01s) --- PASS: TestAliasIntegrationWithProductionScenarios/PerformanceRegression (0.00s) === RUN TestSQLFeatureDiagnostic sql_feature_diagnostic_test.go:14: SEAWEEDFS SQL ENGINE FEATURE DIAGNOSTIC sql_feature_diagnostic_test.go:15: ================================================================================ sql_feature_diagnostic_test.go:18: 1. TESTING LIMIT FUNCTIONALITY: sql_feature_diagnostic_test.go:35: LIMIT 0: PASS - Got 0 rows sql_feature_diagnostic_test.go:35: LIMIT 1: PASS - Got 1 rows sql_feature_diagnostic_test.go:35: LIMIT 3: PASS - Got 3 rows sql_feature_diagnostic_test.go:35: LIMIT 5: PASS - Got 5 rows sql_feature_diagnostic_test.go:35: LIMIT 10: PASS - Got 10 rows sql_feature_diagnostic_test.go:35: LIMIT 100: PASS - Got 10 rows sql_feature_diagnostic_test.go:43: 2. TESTING OFFSET FUNCTIONALITY: sql_feature_diagnostic_test.go:58: OFFSET 0: PASS - Got 3 rows sql_feature_diagnostic_test.go:58: OFFSET 1: PASS - Got 3 rows sql_feature_diagnostic_test.go:58: OFFSET 2: PASS - Got 3 rows sql_feature_diagnostic_test.go:58: OFFSET 5: PASS - Got 3 rows sql_feature_diagnostic_test.go:56: OFFSET 10: PASS - Beyond data range, got 0 rows sql_feature_diagnostic_test.go:56: OFFSET 100: PASS - Beyond data range, got 0 rows sql_feature_diagnostic_test.go:64: 3. TESTING WHERE CLAUSE FUNCTIONALITY: sql_feature_diagnostic_test.go:90: Specific ID match: PASS - WHERE clause working, got 1 rows sql_feature_diagnostic_test.go:90: Greater than comparison: PASS - WHERE clause working, got 7 rows sql_feature_diagnostic_test.go:90: String equality: PASS - WHERE clause working, got 1 rows sql_feature_diagnostic_test.go:90: Non-existent ID: PASS - WHERE clause working, got 0 rows sql_feature_diagnostic_test.go:90: Always false condition: PASS - WHERE clause working, got 0 rows sql_feature_diagnostic_test.go:96: 4. TESTING COMBINED LIMIT + OFFSET + WHERE: sql_feature_diagnostic_test.go:106: Combined query: Got 2 rows (LIMIT=2 part works, WHERE filtering unknown) sql_feature_diagnostic_test.go:110: ================================================================================ sql_feature_diagnostic_test.go:111: FEATURE SUMMARY: sql_feature_diagnostic_test.go:112: LIMIT: FULLY WORKING - Correctly limits result rows sql_feature_diagnostic_test.go:113: OFFSET: FULLY WORKING - Correctly skips rows sql_feature_diagnostic_test.go:114: WHERE: FULLY WORKING - All comparison operators working sql_feature_diagnostic_test.go:115: SELECT: WORKING - Supports *, columns, functions, arithmetic sql_feature_diagnostic_test.go:116: Functions: WORKING - String and datetime functions work sql_feature_diagnostic_test.go:117: Arithmetic: WORKING - +, -, *, / operations work sql_feature_diagnostic_test.go:118: ================================================================================ --- PASS: TestSQLFeatureDiagnostic (0.07s) === RUN TestSQLWhereClauseIssue sql_feature_diagnostic_test.go:125: DEMONSTRATING WHERE CLAUSE ISSUE: sql_feature_diagnostic_test.go:130: Total rows in test data: 10 sql_feature_diagnostic_test.go:134: First row ID: 82460 sql_feature_diagnostic_test.go:144: WHERE id = 82460 returned 1 rows sql_feature_diagnostic_test.go:152: WHERE clause working correctly sql_feature_diagnostic_test.go:162: WHERE 1 = 0 returned 0 rows sql_feature_diagnostic_test.go:167: Impossible WHERE condition correctly returns no rows --- PASS: TestSQLWhereClauseIssue (0.02s) === RUN TestSQLFilteringLimitOffset === RUN TestSQLFilteringLimitOffset/Where_Equals_Integer sql_filtering_limit_offset_test.go:295: PASS: WHERE with equals operator (integer) - Correct row count: 1 === RUN TestSQLFilteringLimitOffset/Where_Equals_String sql_filtering_limit_offset_test.go:298: PASS: WHERE with equals operator (string) - Row count: 1 (not validated) === RUN TestSQLFilteringLimitOffset/Where_Not_Equals sql_filtering_limit_offset_test.go:298: PASS: WHERE with not equals operator - Row count: 2 (not validated) === RUN TestSQLFilteringLimitOffset/Where_Greater_Than sql_filtering_limit_offset_test.go:298: PASS: WHERE with greater than operator - Row count: 7 (not validated) === RUN TestSQLFilteringLimitOffset/Where_Less_Than sql_filtering_limit_offset_test.go:298: PASS: WHERE with less than operator - Row count: 3 (not validated) === RUN TestSQLFilteringLimitOffset/Where_Greater_Equal sql_filtering_limit_offset_test.go:298: PASS: WHERE with greater than or equal operator - Row count: 8 (not validated) === RUN TestSQLFilteringLimitOffset/Where_Less_Equal sql_filtering_limit_offset_test.go:298: PASS: WHERE with less than or equal operator - Row count: 3 (not validated) === RUN TestSQLFilteringLimitOffset/Where_Column_Comparison sql_filtering_limit_offset_test.go:295: PASS: WHERE filtering with specific columns selected - Correct row count: 1 === RUN TestSQLFilteringLimitOffset/Where_With_Function sql_filtering_limit_offset_test.go:298: PASS: WHERE with function in SELECT - Row count: 1 (not validated) === RUN TestSQLFilteringLimitOffset/Where_With_Arithmetic sql_filtering_limit_offset_test.go:295: PASS: WHERE with arithmetic in SELECT - Correct row count: 1 === RUN TestSQLFilteringLimitOffset/Limit_1 sql_filtering_limit_offset_test.go:295: PASS: LIMIT 1 row - Correct row count: 1 === RUN TestSQLFilteringLimitOffset/Limit_5 sql_filtering_limit_offset_test.go:295: PASS: LIMIT 5 rows - Correct row count: 5 === RUN TestSQLFilteringLimitOffset/Limit_0 sql_filtering_limit_offset_test.go:295: PASS: LIMIT 0 rows (should return no results) - Correct row count: 0 === RUN TestSQLFilteringLimitOffset/Limit_Large sql_filtering_limit_offset_test.go:298: PASS: LIMIT with large number - Row count: 10 (not validated) === RUN TestSQLFilteringLimitOffset/Limit_With_Columns sql_filtering_limit_offset_test.go:295: PASS: LIMIT with specific columns - Correct row count: 3 === RUN TestSQLFilteringLimitOffset/Limit_With_Functions sql_filtering_limit_offset_test.go:295: PASS: LIMIT with functions - Correct row count: 2 === RUN TestSQLFilteringLimitOffset/Offset_0 sql_filtering_limit_offset_test.go:295: PASS: OFFSET 0 (same as no offset) - Correct row count: 5 === RUN TestSQLFilteringLimitOffset/Offset_1 sql_filtering_limit_offset_test.go:295: PASS: OFFSET 1 row - Correct row count: 3 === RUN TestSQLFilteringLimitOffset/Offset_5 sql_filtering_limit_offset_test.go:295: PASS: OFFSET 5 rows - Correct row count: 2 === RUN TestSQLFilteringLimitOffset/Offset_Large sql_filtering_limit_offset_test.go:298: PASS: OFFSET with large number - Row count: 0 (not validated) === RUN TestSQLFilteringLimitOffset/Limit_Offset_Pagination_Page1 sql_filtering_limit_offset_test.go:295: PASS: Pagination: Page 1 (LIMIT 3, OFFSET 0) - Correct row count: 3 === RUN TestSQLFilteringLimitOffset/Limit_Offset_Pagination_Page2 sql_filtering_limit_offset_test.go:295: PASS: Pagination: Page 2 (LIMIT 3, OFFSET 3) - Correct row count: 3 === RUN TestSQLFilteringLimitOffset/Limit_Offset_Pagination_Page3 sql_filtering_limit_offset_test.go:295: PASS: Pagination: Page 3 (LIMIT 3, OFFSET 6) - Correct row count: 3 === RUN TestSQLFilteringLimitOffset/Where_Limit sql_filtering_limit_offset_test.go:298: PASS: WHERE clause with LIMIT - Row count: 1 (not validated) === RUN TestSQLFilteringLimitOffset/Where_Limit_Offset sql_filtering_limit_offset_test.go:298: PASS: WHERE clause with LIMIT and OFFSET - Row count: 0 (not validated) === RUN TestSQLFilteringLimitOffset/Where_Complex_Limit sql_filtering_limit_offset_test.go:298: PASS: Complex WHERE with functions and arithmetic, plus LIMIT - Row count: 3 (not validated) === RUN TestSQLFilteringLimitOffset/Where_No_Match sql_filtering_limit_offset_test.go:295: PASS: WHERE clause that matches no rows - Correct row count: 0 === RUN TestSQLFilteringLimitOffset/Limit_Offset_Beyond_Data sql_filtering_limit_offset_test.go:295: PASS: OFFSET beyond available data - Correct row count: 0 === RUN TestSQLFilteringLimitOffset/Where_Empty_String sql_filtering_limit_offset_test.go:298: PASS: WHERE with empty string value - Row count: 0 (not validated) === RUN TestSQLFilteringLimitOffset/Small_Result_Set sql_filtering_limit_offset_test.go:295: PASS: Optimized query: specific WHERE + LIMIT 1 - Correct row count: 1 === RUN TestSQLFilteringLimitOffset/Batch_Processing sql_filtering_limit_offset_test.go:298: PASS: Batch processing pattern: moderate LIMIT - Row count: 10 (not validated) === NAME TestSQLFilteringLimitOffset sql_filtering_limit_offset_test.go:307: ================================================================================ sql_filtering_limit_offset_test.go:308: SQL FILTERING, LIMIT & OFFSET TEST SUITE SUMMARY sql_filtering_limit_offset_test.go:309: ================================================================================ sql_filtering_limit_offset_test.go:310: Total Tests: 31 sql_filtering_limit_offset_test.go:311: Successful: 31 sql_filtering_limit_offset_test.go:312: Errors: 0 sql_filtering_limit_offset_test.go:313: Row Count Mismatches: 0 sql_filtering_limit_offset_test.go:314: ================================================================================ --- PASS: TestSQLFilteringLimitOffset (0.21s) --- PASS: TestSQLFilteringLimitOffset/Where_Equals_Integer (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Equals_String (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Not_Equals (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Greater_Than (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Less_Than (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Greater_Equal (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Less_Equal (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Column_Comparison (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_With_Function (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_With_Arithmetic (0.01s) --- PASS: TestSQLFilteringLimitOffset/Limit_1 (0.00s) --- PASS: TestSQLFilteringLimitOffset/Limit_5 (0.00s) --- PASS: TestSQLFilteringLimitOffset/Limit_0 (0.00s) --- PASS: TestSQLFilteringLimitOffset/Limit_Large (0.00s) --- PASS: TestSQLFilteringLimitOffset/Limit_With_Columns (0.00s) --- PASS: TestSQLFilteringLimitOffset/Limit_With_Functions (0.01s) --- PASS: TestSQLFilteringLimitOffset/Offset_0 (0.01s) --- PASS: TestSQLFilteringLimitOffset/Offset_1 (0.00s) --- PASS: TestSQLFilteringLimitOffset/Offset_5 (0.00s) --- PASS: TestSQLFilteringLimitOffset/Offset_Large (0.00s) --- PASS: TestSQLFilteringLimitOffset/Limit_Offset_Pagination_Page1 (0.01s) --- PASS: TestSQLFilteringLimitOffset/Limit_Offset_Pagination_Page2 (0.00s) --- PASS: TestSQLFilteringLimitOffset/Limit_Offset_Pagination_Page3 (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Limit (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Limit_Offset (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_Complex_Limit (0.01s) --- PASS: TestSQLFilteringLimitOffset/Where_No_Match (0.00s) --- PASS: TestSQLFilteringLimitOffset/Limit_Offset_Beyond_Data (0.00s) --- PASS: TestSQLFilteringLimitOffset/Where_Empty_String (0.01s) --- PASS: TestSQLFilteringLimitOffset/Small_Result_Set (0.01s) --- PASS: TestSQLFilteringLimitOffset/Batch_Processing (0.01s) === RUN TestSQLFilteringAccuracy sql_filtering_limit_offset_test.go:335: Testing SQL filtering accuracy with specific data verification sql_filtering_limit_offset_test.go:350: PASS: Exact ID filtering works correctly sql_filtering_limit_offset_test.go:363: PASS: LIMIT 3 returns exactly 3 rows sql_filtering_limit_offset_test.go:380: PASS: OFFSET 1 correctly skips first row --- PASS: TestSQLFilteringAccuracy (0.01s) === RUN TestSQLFilteringEdgeCases === RUN TestSQLFilteringEdgeCases/Zero_Limit sql_filtering_limit_offset_test.go:441: PASS: LIMIT 0 should return empty result set - Rows: 0 === RUN TestSQLFilteringEdgeCases/Large_Offset sql_filtering_limit_offset_test.go:441: PASS: Very large OFFSET should handle gracefully - Rows: 0 === RUN TestSQLFilteringEdgeCases/Where_False_Condition sql_filtering_limit_offset_test.go:431: UNEXPECTED SUCCESS: WHERE with always-false condition (may indicate feature is implemented) === RUN TestSQLFilteringEdgeCases/Complex_Where sql_filtering_limit_offset_test.go:431: UNEXPECTED SUCCESS: Complex WHERE with AND condition (may indicate feature is implemented) --- PASS: TestSQLFilteringEdgeCases (0.03s) --- PASS: TestSQLFilteringEdgeCases/Zero_Limit (0.00s) --- PASS: TestSQLFilteringEdgeCases/Large_Offset (0.00s) --- PASS: TestSQLFilteringEdgeCases/Where_False_Condition (0.01s) --- PASS: TestSQLFilteringEdgeCases/Complex_Where (0.01s) === RUN TestSQLEngine_StringConcatenationWithLiterals === RUN TestSQLEngine_StringConcatenationWithLiterals/Simple_concatenation_with_literals string_concatenation_test.go:108: Query: SELECT 'test' || action || 'end' FROM user_events LIMIT 1 string_concatenation_test.go:109: Columns: ['test'||action||'end'] string_concatenation_test.go:115: Row 0: [testloginend] === RUN TestSQLEngine_StringConcatenationWithLiterals/User's_original_complex_concatenation string_concatenation_test.go:92: Expected column 0 to be ''test'||action||'xxx'||action||'~~~'||status', got ''test'||action||'xxx'||action||' ~~~ '||status' string_concatenation_test.go:108: Query: SELECT 'test' || action || 'xxx' || action || ' ~~~ ' || status FROM user_events LIMIT 1 string_concatenation_test.go:109: Columns: ['test'||action||'xxx'||action||' ~~~ '||status] string_concatenation_test.go:115: Row 0: [testloginxxxlogin ~~~ active] === RUN TestSQLEngine_StringConcatenationWithLiterals/Mixed_columns_and_literals string_concatenation_test.go:108: Query: SELECT status || '=' || action, 'prefix:' || user_type FROM user_events LIMIT 1 string_concatenation_test.go:109: Columns: [status||'='||action 'prefix:'||user_type] string_concatenation_test.go:115: Row 0: [active=login prefix:premium] === RUN TestSQLEngine_StringConcatenationWithLiterals/Concatenation_with_spaces_in_literals string_concatenation_test.go:92: Expected column 0 to be ''['||status||']'', got '' [ '||status||' ] '' string_concatenation_test.go:108: Query: SELECT ' [ ' || status || ' ] ' FROM user_events LIMIT 2 string_concatenation_test.go:109: Columns: [' [ '||status||' ] '] string_concatenation_test.go:115: Row 0: [ [ active ] ] string_concatenation_test.go:115: Row 1: [ [ pending ] ] --- PASS: TestSQLEngine_StringConcatenationWithLiterals (0.03s) --- PASS: TestSQLEngine_StringConcatenationWithLiterals/Simple_concatenation_with_literals (0.01s) --- PASS: TestSQLEngine_StringConcatenationWithLiterals/User's_original_complex_concatenation (0.01s) --- PASS: TestSQLEngine_StringConcatenationWithLiterals/Mixed_columns_and_literals (0.01s) --- PASS: TestSQLEngine_StringConcatenationWithLiterals/Concatenation_with_spaces_in_literals (0.01s) === RUN TestSQLEngine_StringConcatenationBugReproduction string_concatenation_test.go:180: SUCCESS: Complex string concatenation works correctly! string_concatenation_test.go:181: Query: SELECT UPPER(status), id*2, 'test' || action || 'xxx' || action || ' ~~~ ' || status FROM user_events LIMIT 2 string_concatenation_test.go:188: Row 0: [ACTIVE 164920 testloginxxxlogin ~~~ active] string_concatenation_test.go:188: Row 1: [PENDING 1682512 testclickxxxclick ~~~ pending] --- PASS: TestSQLEngine_StringConcatenationBugReproduction (0.01s) === RUN TestStringFunctions === RUN TestStringFunctions/LENGTH_function_tests === RUN TestStringFunctions/LENGTH_function_tests/Length_of_string === RUN TestStringFunctions/LENGTH_function_tests/Length_of_empty_string === RUN TestStringFunctions/LENGTH_function_tests/Length_of_number === RUN TestStringFunctions/LENGTH_function_tests/Length_of_null_value === RUN TestStringFunctions/UPPER/LOWER_function_tests === RUN TestStringFunctions/TRIM_function_tests === RUN TestStringFunctions/TRIM_function_tests/TRIM_whitespace === RUN TestStringFunctions/TRIM_function_tests/LTRIM_whitespace === RUN TestStringFunctions/TRIM_function_tests/RTRIM_whitespace === RUN TestStringFunctions/TRIM_function_tests/TRIM_with_tabs_and_newlines === RUN TestStringFunctions/SUBSTRING_function_tests === RUN TestStringFunctions/CONCAT_function_tests === RUN TestStringFunctions/REPLACE_function_tests === RUN TestStringFunctions/POSITION_function_tests === RUN TestStringFunctions/LEFT/RIGHT_function_tests === RUN TestStringFunctions/REVERSE_function_tests --- PASS: TestStringFunctions (0.03s) --- PASS: TestStringFunctions/LENGTH_function_tests (0.01s) --- PASS: TestStringFunctions/LENGTH_function_tests/Length_of_string (0.00s) --- PASS: TestStringFunctions/LENGTH_function_tests/Length_of_empty_string (0.00s) --- PASS: TestStringFunctions/LENGTH_function_tests/Length_of_number (0.00s) --- PASS: TestStringFunctions/LENGTH_function_tests/Length_of_null_value (0.00s) --- PASS: TestStringFunctions/UPPER/LOWER_function_tests (0.00s) --- PASS: TestStringFunctions/TRIM_function_tests (0.01s) --- PASS: TestStringFunctions/TRIM_function_tests/TRIM_whitespace (0.00s) --- PASS: TestStringFunctions/TRIM_function_tests/LTRIM_whitespace (0.00s) --- PASS: TestStringFunctions/TRIM_function_tests/RTRIM_whitespace (0.00s) --- PASS: TestStringFunctions/TRIM_function_tests/TRIM_with_tabs_and_newlines (0.00s) --- PASS: TestStringFunctions/SUBSTRING_function_tests (0.00s) --- PASS: TestStringFunctions/CONCAT_function_tests (0.00s) --- PASS: TestStringFunctions/REPLACE_function_tests (0.00s) --- PASS: TestStringFunctions/POSITION_function_tests (0.00s) --- PASS: TestStringFunctions/LEFT/RIGHT_function_tests (0.00s) --- PASS: TestStringFunctions/REVERSE_function_tests (0.00s) === RUN TestStringFunctionsSQL === RUN TestStringFunctionsSQL/UPPER_function === RUN TestStringFunctionsSQL/LOWER_function === RUN TestStringFunctionsSQL/LENGTH_function === RUN TestStringFunctionsSQL/TRIM_function === RUN TestStringFunctionsSQL/LTRIM_function === RUN TestStringFunctionsSQL/RTRIM_function === RUN TestStringFunctionsSQL/Multiple_string_functions === RUN TestStringFunctionsSQL/String_function_with_wrong_argument_count === RUN TestStringFunctionsSQL/String_function_with_no_arguments --- PASS: TestStringFunctionsSQL (0.20s) --- PASS: TestStringFunctionsSQL/UPPER_function (0.02s) --- PASS: TestStringFunctionsSQL/LOWER_function (0.04s) --- PASS: TestStringFunctionsSQL/LENGTH_function (0.04s) --- PASS: TestStringFunctionsSQL/TRIM_function (0.02s) --- PASS: TestStringFunctionsSQL/LTRIM_function (0.01s) --- PASS: TestStringFunctionsSQL/RTRIM_function (0.01s) --- PASS: TestStringFunctionsSQL/Multiple_string_functions (0.01s) --- PASS: TestStringFunctionsSQL/String_function_with_wrong_argument_count (0.00s) --- PASS: TestStringFunctionsSQL/String_function_with_no_arguments (0.00s) === RUN TestSQLEngine_StringFunctionsAndLiterals === RUN TestSQLEngine_StringFunctionsAndLiterals/String_functions_-_UPPER_and_LENGTH string_literal_function_test.go:48: Status: 'active', UPPER: 'ACTIVE', LENGTH: '6' string_literal_function_test.go:160: Query: SELECT status, UPPER(status), LENGTH(status) FROM user_events LIMIT 3 string_literal_function_test.go:161: Columns: [status UPPER(status) LENGTH(status)] string_literal_function_test.go:167: Row 0: [active ACTIVE 6] string_literal_function_test.go:167: Row 1: [pending PENDING 7] string_literal_function_test.go:167: Row 2: [ ] === RUN TestSQLEngine_StringFunctionsAndLiterals/String_literal_in_SELECT string_literal_function_test.go:160: Query: SELECT id, user_id, 'good' FROM user_events LIMIT 2 string_literal_function_test.go:161: Columns: [id user_id 'good'] string_literal_function_test.go:167: Row 0: [82460 9465 good] string_literal_function_test.go:167: Row 1: [841256 2336 good] === RUN TestSQLEngine_StringFunctionsAndLiterals/Mixed:_columns,_functions,_arithmetic,_and_literals string_literal_function_test.go:160: Query: SELECT id, UPPER(status), id*2, 'test' FROM user_events LIMIT 2 string_literal_function_test.go:161: Columns: [id UPPER(status) id*2 'test'] string_literal_function_test.go:167: Row 0: [82460 ACTIVE 164920 test] string_literal_function_test.go:167: Row 1: [841256 PENDING 1682512 test] === RUN TestSQLEngine_StringFunctionsAndLiterals/User's_original_failing_query_-_fixed string_literal_function_test.go:160: Query: SELECT status, action, user_type, UPPER(action), LENGTH(action) FROM user_events LIMIT 2 string_literal_function_test.go:161: Columns: [status action user_type UPPER(action) LENGTH(action)] string_literal_function_test.go:167: Row 0: [active login premium LOGIN 5] string_literal_function_test.go:167: Row 1: [pending click standard CLICK 5] --- PASS: TestSQLEngine_StringFunctionsAndLiterals (0.04s) --- PASS: TestSQLEngine_StringFunctionsAndLiterals/String_functions_-_UPPER_and_LENGTH (0.01s) --- PASS: TestSQLEngine_StringFunctionsAndLiterals/String_literal_in_SELECT (0.01s) --- PASS: TestSQLEngine_StringFunctionsAndLiterals/Mixed:_columns,_functions,_arithmetic,_and_literals (0.01s) --- PASS: TestSQLEngine_StringFunctionsAndLiterals/User's_original_failing_query_-_fixed (0.01s) === RUN TestSQLEngine_StringFunctionErrorHandling string_literal_function_test.go:186: UPPER function works correctly string_literal_function_test.go:197: LENGTH function works correctly --- PASS: TestSQLEngine_StringFunctionErrorHandling (0.01s) === RUN TestTimestampIntegrationScenarios === RUN TestTimestampIntegrationScenarios/EndToEndTimestampEquality === RUN TestTimestampIntegrationScenarios/EndToEndTimestampEquality/original_failing_1 === RUN TestTimestampIntegrationScenarios/EndToEndTimestampEquality/original_failing_2 === RUN TestTimestampIntegrationScenarios/EndToEndTimestampEquality/current_data === RUN TestTimestampIntegrationScenarios/ComplexRangeQueries === RUN TestTimestampIntegrationScenarios/ComplexRangeQueries/RangeWithDifferentBounds === RUN TestTimestampIntegrationScenarios/ComplexRangeQueries/RangeWithSameBounds === RUN TestTimestampIntegrationScenarios/ComplexRangeQueries/OpenEndedRange === RUN TestTimestampIntegrationScenarios/ProductionScenarioReproduction --- PASS: TestTimestampIntegrationScenarios (0.03s) --- PASS: TestTimestampIntegrationScenarios/EndToEndTimestampEquality (0.01s) --- PASS: TestTimestampIntegrationScenarios/EndToEndTimestampEquality/original_failing_1 (0.00s) --- PASS: TestTimestampIntegrationScenarios/EndToEndTimestampEquality/original_failing_2 (0.00s) --- PASS: TestTimestampIntegrationScenarios/EndToEndTimestampEquality/current_data (0.00s) --- PASS: TestTimestampIntegrationScenarios/ComplexRangeQueries (0.01s) --- PASS: TestTimestampIntegrationScenarios/ComplexRangeQueries/RangeWithDifferentBounds (0.00s) --- PASS: TestTimestampIntegrationScenarios/ComplexRangeQueries/RangeWithSameBounds (0.00s) --- PASS: TestTimestampIntegrationScenarios/ComplexRangeQueries/OpenEndedRange (0.00s) --- PASS: TestTimestampIntegrationScenarios/ProductionScenarioReproduction (0.00s) === RUN TestRegressionPrevention === RUN TestRegressionPrevention/SmallTimestamps === RUN TestRegressionPrevention/NonTimestampColumns === RUN TestRegressionPrevention/StringComparisons --- PASS: TestRegressionPrevention (0.01s) --- PASS: TestRegressionPrevention/SmallTimestamps (0.00s) --- PASS: TestRegressionPrevention/NonTimestampColumns (0.01s) --- PASS: TestRegressionPrevention/StringComparisons (0.00s) === RUN TestTimestampQueryFixes === RUN TestTimestampQueryFixes/Fix1_PrecisionLoss === RUN TestTimestampQueryFixes/Fix2_TimeFilterExtraction === RUN TestTimestampQueryFixes/Fix3_RangeBoundaryFix === RUN TestTimestampQueryFixes/Fix4_DifferentRangeBoundaries === RUN TestTimestampQueryFixes/Fix5_PredicateAccuracy === RUN TestTimestampQueryFixes/Fix6_ComparisonOperators === RUN TestTimestampQueryFixes/Fix7_EdgeCases --- PASS: TestTimestampQueryFixes (0.03s) --- PASS: TestTimestampQueryFixes/Fix1_PrecisionLoss (0.00s) --- PASS: TestTimestampQueryFixes/Fix2_TimeFilterExtraction (0.00s) --- PASS: TestTimestampQueryFixes/Fix3_RangeBoundaryFix (0.00s) --- PASS: TestTimestampQueryFixes/Fix4_DifferentRangeBoundaries (0.00s) --- PASS: TestTimestampQueryFixes/Fix5_PredicateAccuracy (0.00s) --- PASS: TestTimestampQueryFixes/Fix6_ComparisonOperators (0.01s) --- PASS: TestTimestampQueryFixes/Fix7_EdgeCases (0.00s) === RUN TestOriginalFailingQueries === RUN TestOriginalFailingQueries/OriginalQuery1 === RUN TestOriginalFailingQueries/OriginalQuery2 === RUN TestOriginalFailingQueries/CurrentDataQuery --- PASS: TestOriginalFailingQueries (0.01s) --- PASS: TestOriginalFailingQueries/OriginalQuery1 (0.00s) --- PASS: TestOriginalFailingQueries/OriginalQuery2 (0.00s) --- PASS: TestOriginalFailingQueries/CurrentDataQuery (0.00s) === RUN TestWhereParsing === RUN TestWhereParsing/Simple_Equals where_clause_debug_test.go:78: PASS: WHERE clause parsed successfully for: Simple equality WHERE clause where_clause_debug_test.go:79: WHERE expression type: *engine.ComparisonExpr === RUN TestWhereParsing/Greater_Than where_clause_debug_test.go:78: PASS: WHERE clause parsed successfully for: Greater than WHERE clause where_clause_debug_test.go:79: WHERE expression type: *engine.ComparisonExpr === RUN TestWhereParsing/String_Equals where_clause_debug_test.go:78: PASS: WHERE clause parsed successfully for: String equality WHERE clause where_clause_debug_test.go:79: WHERE expression type: *engine.ComparisonExpr === RUN TestWhereParsing/Impossible_Condition where_clause_debug_test.go:78: PASS: WHERE clause parsed successfully for: Impossible WHERE condition (should parse but return no rows) where_clause_debug_test.go:79: WHERE expression type: *engine.ComparisonExpr --- PASS: TestWhereParsing (0.02s) --- PASS: TestWhereParsing/Simple_Equals (0.00s) --- PASS: TestWhereParsing/Greater_Than (0.00s) --- PASS: TestWhereParsing/String_Equals (0.00s) --- PASS: TestWhereParsing/Impossible_Condition (0.00s) === RUN TestPredicateBuilding === RUN TestPredicateBuilding/Simple_Equals_Match where_clause_debug_test.go:172: PASS: Simple equality - should match - Predicate worked correctly (match=true) === RUN TestPredicateBuilding/Simple_Equals_NoMatch where_clause_debug_test.go:172: PASS: Simple equality - should not match - Predicate worked correctly (match=false) === RUN TestPredicateBuilding/Greater_Than_Match where_clause_debug_test.go:172: PASS: Greater than - should match - Predicate worked correctly (match=true) === RUN TestPredicateBuilding/Greater_Than_NoMatch where_clause_debug_test.go:172: PASS: Greater than - should not match - Predicate worked correctly (match=false) === RUN TestPredicateBuilding/String_Equals_Match where_clause_debug_test.go:172: PASS: String equality - should match - Predicate worked correctly (match=true) === RUN TestPredicateBuilding/String_Equals_NoMatch where_clause_debug_test.go:172: PASS: String equality - should not match - Predicate worked correctly (match=false) === RUN TestPredicateBuilding/Impossible_Condition where_clause_debug_test.go:172: PASS: Impossible condition - should never match - Predicate worked correctly (match=false) --- PASS: TestPredicateBuilding (0.03s) --- PASS: TestPredicateBuilding/Simple_Equals_Match (0.00s) --- PASS: TestPredicateBuilding/Simple_Equals_NoMatch (0.00s) --- PASS: TestPredicateBuilding/Greater_Than_Match (0.00s) --- PASS: TestPredicateBuilding/Greater_Than_NoMatch (0.00s) --- PASS: TestPredicateBuilding/String_Equals_Match (0.00s) --- PASS: TestPredicateBuilding/String_Equals_NoMatch (0.00s) --- PASS: TestPredicateBuilding/Impossible_Condition (0.00s) === RUN TestWhereClauseEndToEnd where_clause_debug_test.go:185: END-TO-END WHERE CLAUSE VALIDATION where_clause_debug_test.go:186: =================================== where_clause_debug_test.go:194: Baseline (no WHERE): 10 rows where_clause_debug_test.go:202: WHERE 1 = 0: 0 rows where_clause_debug_test.go:210: Impossible WHERE condition correctly returns 0 rows where_clause_debug_test.go:222: WHERE id = 82460: 1 rows where_clause_debug_test.go:227: Specific ID WHERE clause working correctly where_clause_debug_test.go:239: WHERE id > 10000000: 0 rows where_clause_debug_test.go:256: WHERE id > 10000000 correctly filtered results --- PASS: TestWhereClauseEndToEnd (0.02s) === RUN TestSpecificWhereClauseBug where_clause_debug_test.go:298: REPRODUCING EXACT WHERE CLAUSE BUG where_clause_debug_test.go:299: ================================== where_clause_debug_test.go:309: Query: SELECT id FROM user_events WHERE id > 10000000 LIMIT 10 OFFSET 5 where_clause_debug_test.go:310: Returned 0 rows: where_clause_debug_test.go:326: WHERE clause working correctly - all IDs > 10,000,000 --- PASS: TestSpecificWhereClauseBug (0.01s) === RUN TestWhereClauseValidation where_validation_test.go:13: WHERE CLAUSE VALIDATION TESTS where_validation_test.go:14: ============================== where_validation_test.go:22: Baseline data - Total rows: 10 where_validation_test.go:24: Sample IDs: 82460, 841256, 55537 where_validation_test.go:38: WHERE id = 82460: 1 rows where_validation_test.go:40: Specific ID filtering works correctly where_validation_test.go:59: Data range: min ID = 55537, max ID = 841256 where_validation_test.go:69: WHERE id > 448396: 2 rows where_validation_test.go:83: Range filtering works correctly - all returned IDs > 448396 where_validation_test.go:95: WHERE status = 'active': 1 rows where_validation_test.go:107: String filtering works correctly where_validation_test.go:111: TESTING REAL-WORLD CASE: where_validation_test.go:118: Real-world query returned: 0 rows where_validation_test.go:131: Real-world case FIXED: No violations found --- PASS: TestWhereClauseValidation (0.02s) === RUN TestWhereClauseComparisonOperators where_validation_test.go:164: Testing comparison operators with ID = 841256 where_validation_test.go:175: WHERE id = 841256: 1 rows (equals) where_validation_test.go:175: WHERE id != 841256: 9 rows (not equals) where_validation_test.go:175: WHERE id > 841256: 0 rows (greater than) where_validation_test.go:175: WHERE id < 841256: 9 rows (less than) where_validation_test.go:175: WHERE id >= 841256: 1 rows (greater or equal) where_validation_test.go:175: WHERE id <= 841256: 10 rows (less or equal) --- PASS: TestWhereClauseComparisonOperators (0.03s) PASS ok github.com/seaweedfs/seaweedfs/weed/query/engine 6.635s === RUN TestGjson { "quiz": { "sport": { "q1": { "question": "Which one is correct team name in NBA?", "options": [ "New York Bulls", "Los Angeles Kings", "Golden State Warriros", "Huston Rocket" ], "answer": "Huston Rocket" } }, "maths": { "q1": { "question": "5 + 7 = ?", "options": [ "10", "11", "12", "13" ], "answer": "12" }, "q2": { "question": "12 - 8 = ?", "options": [ "1", "2", "3", "4" ], "answer": "4" } } } } +++++++++++ 12 5 { "sport": { "q1": { "question": "Which one is correct team name in NBA?", "options": [ "New York Bulls", "Los Angeles Kings", "Golden State Warriros", "Huston Rocket" ], "answer": "Huston Rocket" } }, "maths": { "q1": { "question": "5 + 7 = ?", "options": [ "10", "11", "12", "13" ], "answer": "12" }, "q2": { "question": "12 - 8 = ?", "options": [ "1", "2", "3", "4" ], "answer": "4" } } } 0 0 ----------- { "fruit": "Apple", "size": "Large", "quiz": "Red" } +++++++++++ 51 3 Red 13 3 Apple ----------- --- PASS: TestGjson (0.01s) === RUN TestJsonQueryRow {fruit:"Bl\"ue",size:6} --- PASS: TestJsonQueryRow (0.01s) === RUN TestJsonQueryNumber {fruit:"Bl\"ue",quiz:"green"} --- PASS: TestJsonQueryNumber (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/query/json 0.300s ? github.com/seaweedfs/seaweedfs/weed/query/sqltypes [no test files] === RUN TestRemoteClientCache_SameConfigurationOneClient --- PASS: TestRemoteClientCache_SameConfigurationOneClient (0.05s) === RUN TestRemoteClientCache_TwoConfigurationsUnderOneNameCoexist --- PASS: TestRemoteClientCache_TwoConfigurationsUnderOneNameCoexist (0.01s) === RUN TestRemoteClientCache_VersionIsPartOfTheKey --- PASS: TestRemoteClientCache_VersionIsPartOfTheKey (0.00s) === RUN TestRemoteClientCache_BoundedLRU --- PASS: TestRemoteClientCache_BoundedLRU (0.00s) === RUN TestRemoteClientCache_RetainDropsWhatIsGone --- PASS: TestRemoteClientCache_RetainDropsWhatIsGone (0.01s) === RUN TestRemoteClientCache_BuildsOutsideTheLockOncePerKey --- PASS: TestRemoteClientCache_BuildsOutsideTheLockOncePerKey (0.06s) === RUN TestRemoteClientCache_BuildsFromACopy --- PASS: TestRemoteClientCache_BuildsFromACopy (0.01s) === RUN TestRemoteClientCache_Reset --- PASS: TestRemoteClientCache_Reset (0.01s) === RUN TestRemoteClientCache_RetainKeepsOnlyTheNewestPerName --- PASS: TestRemoteClientCache_RetainKeepsOnlyTheNewestPerName (0.00s) === RUN TestRemoteClientCache_BuildSpanningRetainIsDropped --- PASS: TestRemoteClientCache_BuildSpanningRetainIsDropped (0.00s) === RUN TestRemoteClientCache_UnknownNameStillCaches --- PASS: TestRemoteClientCache_UnknownNameStillCaches (0.00s) === RUN TestPlainClientGcsCredentialsVersion --- PASS: TestPlainClientGcsCredentialsVersion (0.08s) === RUN TestPlainClientGcsWellKnownCredentialsVersion --- PASS: TestPlainClientGcsWellKnownCredentialsVersion (0.01s) === RUN TestFileVersionResolvesHome --- PASS: TestFileVersionResolvesHome (0.00s) === RUN TestGetRemoteStorageErrorNamesTheRemote --- PASS: TestGetRemoteStorageErrorNamesTheRemote (0.00s) === RUN TestCacheWaitTimeout === RUN TestCacheWaitTimeout/large_file_fails_fast === RUN TestCacheWaitTimeout/small_file_waits_longer === RUN TestCacheWaitTimeout/medium_file === RUN TestCacheWaitTimeout/unknown_size === RUN TestCacheWaitTimeout/mount_replaces_the_size_tier === RUN TestCacheWaitTimeout/mount_opts_out_of_caching === RUN TestCacheWaitTimeout/negative_wait_never_waits === RUN TestCacheWaitTimeout/unset_wait_keeps_the_size_tier --- PASS: TestCacheWaitTimeout (0.01s) --- PASS: TestCacheWaitTimeout/large_file_fails_fast (0.00s) --- PASS: TestCacheWaitTimeout/small_file_waits_longer (0.00s) --- PASS: TestCacheWaitTimeout/medium_file (0.00s) --- PASS: TestCacheWaitTimeout/unknown_size (0.00s) --- PASS: TestCacheWaitTimeout/mount_replaces_the_size_tier (0.00s) --- PASS: TestCacheWaitTimeout/mount_opts_out_of_caching (0.00s) --- PASS: TestCacheWaitTimeout/negative_wait_never_waits (0.00s) --- PASS: TestCacheWaitTimeout/unset_wait_keeps_the_size_tier (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/remote_storage 2.400s === RUN TestNewAzBlobClientRequiresAccountName --- PASS: TestNewAzBlobClientRequiresAccountName (0.00s) === RUN TestNewAzBlobClientRejectsMalformedAccountName --- PASS: TestNewAzBlobClientRejectsMalformedAccountName (0.00s) === RUN TestNewAzBlobClientSharedKey --- PASS: TestNewAzBlobClientSharedKey (0.01s) === RUN TestNewAzBlobClientSharedKeyRejectsMalformedKey --- PASS: TestNewAzBlobClientSharedKeyRejectsMalformedKey (0.00s) === RUN TestAzureServiceURL --- PASS: TestAzureServiceURL (0.01s) === RUN TestNewAzBlobClientEntraID --- PASS: TestNewAzBlobClientEntraID (0.02s) === RUN TestNewAzBlobClientWorkloadIdentity --- PASS: TestNewAzBlobClientWorkloadIdentity (0.05s) === RUN TestNewAzureTokenCredentialManagedIdentity --- PASS: TestNewAzureTokenCredentialManagedIdentity (0.01s) === RUN TestAzureStorageClientBasic azure_storage_client_test.go:29: Skipping Azure storage test: AZURE_STORAGE_ACCOUNT or AZURE_STORAGE_ACCESS_KEY not set --- SKIP: TestAzureStorageClientBasic (0.01s) === RUN TestToMetadata === RUN TestToMetadata/basic_metadata === RUN TestToMetadata/metadata_with_dashes === RUN TestToMetadata/non-metadata_keys_ignored === RUN TestToMetadata/keys_starting_with_digits === RUN TestToMetadata/uppercase_and_mixed_case_keys === RUN TestToMetadata/keys_with_invalid_characters === RUN TestToMetadata/collision_prevention === RUN TestToMetadata/empty_input --- PASS: TestToMetadata (0.04s) --- PASS: TestToMetadata/basic_metadata (0.00s) --- PASS: TestToMetadata/metadata_with_dashes (0.00s) --- PASS: TestToMetadata/non-metadata_keys_ignored (0.00s) --- PASS: TestToMetadata/keys_starting_with_digits (0.00s) --- PASS: TestToMetadata/uppercase_and_mixed_case_keys (0.00s) --- PASS: TestToMetadata/keys_with_invalid_characters (0.00s) --- PASS: TestToMetadata/collision_prevention (0.00s) --- PASS: TestToMetadata/empty_input (0.00s) === RUN TestAzureRemoteStorageMaker --- PASS: TestAzureRemoteStorageMaker (0.01s) === RUN TestResolveAzureAccount --- PASS: TestResolveAzureAccount (0.00s) === RUN TestAzureRemoteStorageMakerWithoutAccountKey --- PASS: TestAzureRemoteStorageMakerWithoutAccountKey (0.01s) === RUN TestAzureStorageClientErrors --- PASS: TestAzureStorageClientErrors (12.23s) === RUN TestAzureRemoteStorageClientImplementsInterface --- PASS: TestAzureRemoteStorageClientImplementsInterface (0.00s) === RUN TestAzureErrRemoteObjectNotFoundIsAccessible --- PASS: TestAzureErrRemoteObjectNotFoundIsAccessible (0.00s) === RUN TestAzureReadNotFoundClassification === RUN TestAzureReadNotFoundClassification/missing_blob === RUN TestAzureReadNotFoundClassification/missing_blob,_read_to_end === RUN TestAzureReadNotFoundClassification/missing_container === RUN TestAzureReadNotFoundClassification/auth_failure --- PASS: TestAzureReadNotFoundClassification (0.10s) --- PASS: TestAzureReadNotFoundClassification/missing_blob (0.04s) --- PASS: TestAzureReadNotFoundClassification/missing_blob,_read_to_end (0.02s) --- PASS: TestAzureReadNotFoundClassification/missing_container (0.02s) --- PASS: TestAzureReadNotFoundClassification/auth_failure (0.01s) === RUN TestAzureDeleteBucketOfAMissingContainerSucceeds === RUN TestAzureDeleteBucketOfAMissingContainerSucceeds/missing_container === RUN TestAzureDeleteBucketOfAMissingContainerSucceeds/container_being_deleted === RUN TestAzureDeleteBucketOfAMissingContainerSucceeds/auth_failure --- PASS: TestAzureDeleteBucketOfAMissingContainerSucceeds (0.05s) --- PASS: TestAzureDeleteBucketOfAMissingContainerSucceeds/missing_container (0.02s) --- PASS: TestAzureDeleteBucketOfAMissingContainerSucceeds/container_being_deleted (0.01s) --- PASS: TestAzureDeleteBucketOfAMissingContainerSucceeds/auth_failure (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/remote_storage/azure 14.855s === RUN TestGCSRemoteStorageClientImplementsInterface --- PASS: TestGCSRemoteStorageClientImplementsInterface (0.00s) === RUN TestGCSErrRemoteObjectNotFoundIsAccessible --- PASS: TestGCSErrRemoteObjectNotFoundIsAccessible (0.00s) === RUN TestMakeWithHTTPClientAllowedTypes W1117 09:40:33.585318 gcs_storage_client.go:103 need to specify GOOGLE_CLOUD_PROJECT env variable W1117 09:40:33.623327 gcs_storage_client.go:103 need to specify GOOGLE_CLOUD_PROJECT env variable --- PASS: TestMakeWithHTTPClientAllowedTypes (0.08s) === RUN TestParseInlineCredentials --- PASS: TestParseInlineCredentials (0.01s) === RUN TestGCSReadNotFoundClassification === RUN TestGCSReadNotFoundClassification/missing_object === RUN TestGCSReadNotFoundClassification/missing_bucket === RUN TestGCSReadNotFoundClassification/bucket_listing_denied === RUN TestGCSReadNotFoundClassification/object_listed_after_the_read_missed_it === RUN TestGCSReadNotFoundClassification/read_denied --- PASS: TestGCSReadNotFoundClassification (0.68s) --- PASS: TestGCSReadNotFoundClassification/missing_object (0.36s) --- PASS: TestGCSReadNotFoundClassification/missing_bucket (0.15s) --- PASS: TestGCSReadNotFoundClassification/bucket_listing_denied (0.06s) --- PASS: TestGCSReadNotFoundClassification/object_listed_after_the_read_missed_it (0.06s) --- PASS: TestGCSReadNotFoundClassification/read_denied (0.04s) === RUN TestGCSDeleteBucketOfAMissingBucketSucceeds === RUN TestGCSDeleteBucketOfAMissingBucketSucceeds/missing_bucket === RUN TestGCSDeleteBucketOfAMissingBucketSucceeds/bucket_not_empty === RUN TestGCSDeleteBucketOfAMissingBucketSucceeds/access_denied --- PASS: TestGCSDeleteBucketOfAMissingBucketSucceeds (0.06s) --- PASS: TestGCSDeleteBucketOfAMissingBucketSucceeds/missing_bucket (0.02s) --- PASS: TestGCSDeleteBucketOfAMissingBucketSucceeds/bucket_not_empty (0.02s) --- PASS: TestGCSDeleteBucketOfAMissingBucketSucceeds/access_denied (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/remote_storage/gcs 3.625s === RUN TestUsesDefaultCredentialChain --- PASS: TestUsesDefaultCredentialChain (0.00s) === RUN TestS3CompatibleEndpointCoversAllProviders --- PASS: TestS3CompatibleEndpointCoversAllProviders (0.01s) === RUN TestS3ClientImplementsObjectCopier --- PASS: TestS3ClientImplementsObjectCopier (0.00s) === RUN TestS3CopyFileUsesCopyObjectUpToTheLimit --- PASS: TestS3CopyFileUsesCopyObjectUpToTheLimit (0.01s) === RUN TestS3CopyFileCopiesLargeObjectsInParts --- PASS: TestS3CopyFileCopiesLargeObjectsInParts (0.01s) === RUN TestS3CopyFileCarriesTagsIntoAMultipartCopy --- PASS: TestS3CopyFileCarriesTagsIntoAMultipartCopy (0.07s) === RUN TestS3CopyFileAbortsAFailedMultipartCopy --- PASS: TestS3CopyFileAbortsAFailedMultipartCopy (0.01s) === RUN TestS3CopyFileMissingSource --- PASS: TestS3CopyFileMissingSource (0.00s) === RUN TestS3MakeUsesAnonymousCredentialsWhenKeysAreEmpty --- PASS: TestS3MakeUsesAnonymousCredentialsWhenKeysAreEmpty (0.10s) === RUN TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured === RUN TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_ACCESS_KEY_ID === RUN TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_PROFILE === RUN TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_WEB_IDENTITY_TOKEN_FILE === RUN TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_CONTAINER_CREDENTIALS_FULL_URI === RUN TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_CONTAINER_CREDENTIALS_RELATIVE_URI --- PASS: TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured (0.10s) --- PASS: TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_ACCESS_KEY_ID (0.04s) --- PASS: TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_PROFILE (0.01s) --- PASS: TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_WEB_IDENTITY_TOKEN_FILE (0.01s) --- PASS: TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_CONTAINER_CREDENTIALS_FULL_URI (0.01s) --- PASS: TestS3MakeUsesDefaultCredentialChainWhenKeysAreEmptyAndSourceIsConfigured/AWS_CONTAINER_CREDENTIALS_RELATIVE_URI (0.01s) === RUN TestS3MakeResolvesEnvCredentialsWithCustomHTTPClient --- PASS: TestS3MakeResolvesEnvCredentialsWithCustomHTTPClient (0.01s) === RUN TestS3MakeUsesStaticCredentialsWhenKeysAreProvided --- PASS: TestS3MakeUsesStaticCredentialsWhenKeysAreProvided (0.02s) === RUN TestS3RemoteStorageClientImplementsInterface --- PASS: TestS3RemoteStorageClientImplementsInterface (0.00s) === RUN TestS3ErrRemoteObjectNotFoundIsAccessible --- PASS: TestS3ErrRemoteObjectNotFoundIsAccessible (0.00s) === RUN TestS3RemoveDirectoryDeletesEveryListedObject --- PASS: TestS3RemoveDirectoryDeletesEveryListedObject (0.01s) === RUN TestS3RemoveDirectoryEmptyListingSendsNoDeletes --- PASS: TestS3RemoveDirectoryEmptyListingSendsNoDeletes (0.00s) === RUN TestS3RemoveDirectoryRefusesBucketRoot W1117 09:40:33.615818 s3_storage_client.go:529 s3 bucket: skip removing directory mapped to the bucket root --- PASS: TestS3RemoveDirectoryRefusesBucketRoot (0.02s) === RUN TestS3RemoveDirectoryReturnsBatchError --- PASS: TestS3RemoveDirectoryReturnsBatchError (0.00s) === RUN TestS3RemoveDirectoryReturnsPerKeyError --- PASS: TestS3RemoveDirectoryReturnsPerKeyError (0.00s) === RUN TestS3RemoveDirectorySendsContentMD5 --- PASS: TestS3RemoveDirectorySendsContentMD5 (0.12s) === RUN TestS3WriteFilePassesMimeAsContentType --- PASS: TestS3WriteFilePassesMimeAsContentType (0.04s) === RUN TestS3UpdateFileMetadataSkipsTaggingWhenUnsupported --- PASS: TestS3UpdateFileMetadataSkipsTaggingWhenUnsupported (0.01s) === RUN TestS3UpdateFileMetadataIgnoresNonTagAttributes --- PASS: TestS3UpdateFileMetadataIgnoresNonTagAttributes (0.01s) === RUN TestS3UpdateFileMetadataSendsTaggingWhenSupported --- PASS: TestS3UpdateFileMetadataSendsTaggingWhenSupported (0.04s) === RUN TestS3WriteFileSendsOnlyTagAttributes --- PASS: TestS3WriteFileSendsOnlyTagAttributes (0.03s) === RUN TestS3WriteFileOmitsTaggingWhenNoTagAttributes --- PASS: TestS3WriteFileOmitsTaggingWhenNoTagAttributes (0.02s) === RUN TestS3WriteFileOmitsContentTypeWhenMimeMissing --- PASS: TestS3WriteFileOmitsContentTypeWhenMimeMissing (0.02s) === RUN TestS3ReadNotFoundClassification === RUN TestS3ReadNotFoundClassification/missing_key === RUN TestS3ReadNotFoundClassification/missing_bucket === RUN TestS3ReadNotFoundClassification/access_denied --- PASS: TestS3ReadNotFoundClassification (0.13s) --- PASS: TestS3ReadNotFoundClassification/missing_key (0.06s) --- PASS: TestS3ReadNotFoundClassification/missing_bucket (0.03s) --- PASS: TestS3ReadNotFoundClassification/access_denied (0.03s) === RUN TestIsNoSuchKey --- PASS: TestIsNoSuchKey (0.00s) === RUN TestS3MakeResolvesEnvCredentialsWhenAnonymousDefault --- PASS: TestS3MakeResolvesEnvCredentialsWhenAnonymousDefault (0.01s) === RUN TestS3DeleteBucketOfAMissingBucketSucceeds === RUN TestS3DeleteBucketOfAMissingBucketSucceeds/missing_bucket === RUN TestS3DeleteBucketOfAMissingBucketSucceeds/bucket_not_empty === RUN TestS3DeleteBucketOfAMissingBucketSucceeds/access_denied --- PASS: TestS3DeleteBucketOfAMissingBucketSucceeds (0.04s) --- PASS: TestS3DeleteBucketOfAMissingBucketSucceeds/missing_bucket (0.01s) --- PASS: TestS3DeleteBucketOfAMissingBucketSucceeds/bucket_not_empty (0.01s) --- PASS: TestS3DeleteBucketOfAMissingBucketSucceeds/access_denied (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/remote_storage/s3 3.325s === RUN TestReplicateRenameUsesTargetKeyForNonFilerSink --- PASS: TestReplicateRenameUsesTargetKeyForNonFilerSink (0.01s) === RUN TestReplicateRenameWithoutMoverUsesCreateThenDelete --- PASS: TestReplicateRenameWithoutMoverUsesCreateThenDelete (0.00s) === RUN TestReplicateRenameUsesMoveEntryWhenSupported --- PASS: TestReplicateRenameUsesMoveEntryWhenSupported (0.00s) === RUN TestReplicateInPlaceUpdateUsesUpdateEntry --- PASS: TestReplicateInPlaceUpdateUsesUpdateEntry (0.00s) === RUN TestReplicateInPlaceUpdateFallbackCreates --- PASS: TestReplicateInPlaceUpdateFallbackCreates (0.00s) === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/equal === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/descendant === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/sibling_prefix === RUN TestPathIsEqualOrUnderUsesDirectoryBoundaries/root --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries (0.01s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/equal (0.00s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/descendant (0.00s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/sibling_prefix (0.00s) --- PASS: TestPathIsEqualOrUnderUsesDirectoryBoundaries/root (0.00s) === RUN TestReplicateRenameOutToSiblingPrefixBecomesDelete --- PASS: TestReplicateRenameOutToSiblingPrefixBecomesDelete (0.00s) === RUN TestReplicateRenameFromExcludedDirBecomesCreate --- PASS: TestReplicateRenameFromExcludedDirBecomesCreate (0.00s) === RUN TestReplicateMetadataOnlyDeleteKeepsTheRemoteObject --- PASS: TestReplicateMetadataOnlyDeleteKeepsTheRemoteObject (0.00s) === RUN TestReplicateDeletesHandTheDeletedVersionToTheSink --- PASS: TestReplicateDeletesHandTheDeletedVersionToTheSink (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/replication 3.869s === RUN TestDetectSSEType === RUN TestDetectSSEType/no_chunks_no_extended === RUN TestDetectSSEType/plaintext_chunks === RUN TestDetectSSEType/uniform_SSE-S3_chunks === RUN TestDetectSSEType/uniform_SSE-KMS_chunks === RUN TestDetectSSEType/mixed_chunk_SSE_types === RUN TestDetectSSEType/inline_SSE-S3_via_extended === RUN TestDetectSSEType/inline_SSE-KMS_via_extended === RUN TestDetectSSEType/inline_SSE-C_via_extended === RUN TestDetectSSEType/conflicting_extended_metadata === RUN TestDetectSSEType/chunks_take_precedence_over_extended --- PASS: TestDetectSSEType (0.03s) --- PASS: TestDetectSSEType/no_chunks_no_extended (0.00s) --- PASS: TestDetectSSEType/plaintext_chunks (0.00s) --- PASS: TestDetectSSEType/uniform_SSE-S3_chunks (0.00s) --- PASS: TestDetectSSEType/uniform_SSE-KMS_chunks (0.00s) --- PASS: TestDetectSSEType/mixed_chunk_SSE_types (0.00s) --- PASS: TestDetectSSEType/inline_SSE-S3_via_extended (0.00s) --- PASS: TestDetectSSEType/inline_SSE-KMS_via_extended (0.00s) --- PASS: TestDetectSSEType/inline_SSE-C_via_extended (0.00s) --- PASS: TestDetectSSEType/conflicting_extended_metadata (0.00s) --- PASS: TestDetectSSEType/chunks_take_precedence_over_extended (0.00s) === RUN TestMaybeDecryptReader_Plaintext --- PASS: TestMaybeDecryptReader_Plaintext (0.00s) === RUN TestMaybeDecryptReader_NilEntry --- PASS: TestMaybeDecryptReader_NilEntry (0.00s) === RUN TestMaybeDecryptReader_SSEC_Error --- PASS: TestMaybeDecryptReader_SSEC_Error (0.00s) === RUN TestMaybeDecryptContent_Plaintext --- PASS: TestMaybeDecryptContent_Plaintext (0.00s) === RUN TestMaybeDecryptContent_NilEntry --- PASS: TestMaybeDecryptContent_NilEntry (0.00s) === RUN TestMaybeDecryptContent_Empty --- PASS: TestMaybeDecryptContent_Empty (0.00s) === RUN TestMaybeDecryptContent_SSEC_Error --- PASS: TestMaybeDecryptContent_SSEC_Error (0.00s) === RUN TestMaybeDecryptContent_MixedExtended_Error --- PASS: TestMaybeDecryptContent_MixedExtended_Error (0.00s) === RUN TestMaybeDecryptReader_SSES3 I1117 09:40:34.972146 s3_sse_s3.go:529 SSE-S3 KeyManager: Loaded KEK from s3.sse.kek config I1117 09:40:35.097112 s3_sse_s3.go:566 SSE-S3 KeyManager: No KEK configured. SSE-S3 encryption is disabled. Set s3.sse.kek or s3.sse.key in security.toml to enable it. --- PASS: TestMaybeDecryptReader_SSES3 (0.14s) === RUN TestMaybeDecryptContent_SSES3 I1117 09:40:35.157306 s3_sse_s3.go:529 SSE-S3 KeyManager: Loaded KEK from s3.sse.kek config I1117 09:40:35.241033 s3_sse_s3.go:566 SSE-S3 KeyManager: No KEK configured. SSE-S3 encryption is disabled. Set s3.sse.kek or s3.sse.key in security.toml to enable it. --- PASS: TestMaybeDecryptContent_SSES3 (0.12s) === RUN TestMaybeDecryptReader_SSEKMS --- PASS: TestMaybeDecryptReader_SSEKMS (0.04s) === RUN TestMaybeDecryptContent_SSEKMS --- PASS: TestMaybeDecryptContent_SSEKMS (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/replication/repl_util 4.521s ? github.com/seaweedfs/seaweedfs/weed/replication/sink [no test files] === RUN TestAzureSinkInterface --- PASS: TestAzureSinkInterface (0.00s) === RUN TestAzureSinkInitialization azure_sink_test.go:99: Skipping Azure sink test: AZURE_STORAGE_ACCOUNT or AZURE_STORAGE_ACCESS_KEY not set --- SKIP: TestAzureSinkInitialization (0.01s) === RUN TestAzureSinkInitializeFromConfig azure_sink_test.go:132: Skipping Azure sink config test: AZURE_STORAGE_ACCOUNT or AZURE_STORAGE_ACCESS_KEY not set --- SKIP: TestAzureSinkInitializeFromConfig (0.00s) === RUN TestCleanKey === RUN TestCleanKey//test/file.txt === RUN TestCleanKey/test/file.txt === RUN TestCleanKey// === RUN TestCleanKey/#00 === RUN TestCleanKey//a/b/c --- PASS: TestCleanKey (0.01s) --- PASS: TestCleanKey//test/file.txt (0.00s) --- PASS: TestCleanKey/test/file.txt (0.00s) --- PASS: TestCleanKey// (0.00s) --- PASS: TestCleanKey/#00 (0.00s) --- PASS: TestCleanKey//a/b/c (0.00s) === RUN TestAzureSinkEntryOperations azure_sink_test.go:186: Skipping Azure sink entry test: credentials not set --- SKIP: TestAzureSinkEntryOperations (0.00s) === RUN TestAzureSinkPrecondition azure_sink_test.go:281: Skipping Azure sink precondition test: credentials not set --- SKIP: TestAzureSinkPrecondition (0.00s) === RUN TestAzureSinkIdempotentCreate azure_sink_test.go:350: Skipping Azure sink idempotent create test: credentials not set --- SKIP: TestAzureSinkIdempotentCreate (0.00s) === RUN TestAzureSinkInvalidCredentials azure_sink_test.go:465: Invalid credentials correctly rejected at initialization --- SKIP: TestAzureSinkInvalidCredentials (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/replication/sink/azuresink 4.043s ? github.com/seaweedfs/seaweedfs/weed/replication/sink/b2sink [no test files] === RUN TestTargetPathToSourcePath === RUN TestTargetPathToSourcePath/basic_mapping === RUN TestTargetPathToSourcePath/incremental_sink_is_unmappable === RUN TestTargetPathToSourcePath/trailing_slash_roots === RUN TestTargetPathToSourcePath/root_target_mapping === RUN TestTargetPathToSourcePath/target_root_itself === RUN TestTargetPathToSourcePath/outside_target_root --- PASS: TestTargetPathToSourcePath (0.01s) --- PASS: TestTargetPathToSourcePath/basic_mapping (0.00s) --- PASS: TestTargetPathToSourcePath/incremental_sink_is_unmappable (0.00s) --- PASS: TestTargetPathToSourcePath/trailing_slash_roots (0.00s) --- PASS: TestTargetPathToSourcePath/root_target_mapping (0.00s) --- PASS: TestTargetPathToSourcePath/target_root_itself (0.00s) --- PASS: TestTargetPathToSourcePath/outside_target_root (0.00s) === RUN TestValidateReplicatedChunkSize === RUN TestValidateReplicatedChunkSize/healthy === RUN TestValidateReplicatedChunkSize/legitimately_empty_file === RUN TestValidateReplicatedChunkSize/zero-byte_read_for_non-empty_source === RUN TestValidateReplicatedChunkSize/short_read === RUN TestValidateReplicatedChunkSize/over-read_(server_returned_more_than_metadata) --- PASS: TestValidateReplicatedChunkSize (0.01s) --- PASS: TestValidateReplicatedChunkSize/healthy (0.00s) --- PASS: TestValidateReplicatedChunkSize/legitimately_empty_file (0.00s) --- PASS: TestValidateReplicatedChunkSize/zero-byte_read_for_non-empty_source (0.00s) --- PASS: TestValidateReplicatedChunkSize/short_read (0.00s) --- PASS: TestValidateReplicatedChunkSize/over-read_(server_returned_more_than_metadata) (0.00s) === RUN TestFetchAndWriteRejectsZeroByteSource I1117 09:40:33.364703 fetch_write.go:513 permanent size mismatch replicating 74,047d16a94aa581 for /dst/index.bin: chunk size mismatch: read 74,047d16a94aa581 got 0 bytes, source metadata says 5171 --- PASS: TestFetchAndWriteRejectsZeroByteSource (0.23s) === RUN TestIsRetryableNetworkError === RUN TestIsRetryableNetworkError/nil === RUN TestIsRetryableNetworkError/eof === RUN TestIsRetryableNetworkError/unexpected_eof === RUN TestIsRetryableNetworkError/volume_idle_timeout_json === RUN TestIsRetryableNetworkError/volume_idle_timeout_capitalized === RUN TestIsRetryableNetworkError/connection_reset === RUN TestIsRetryableNetworkError/connection_reset_capitalized === RUN TestIsRetryableNetworkError/broken_pipe === RUN TestIsRetryableNetworkError/broken_pipe_capitalized === RUN TestIsRetryableNetworkError/net.Error_timeout === RUN TestIsRetryableNetworkError/size_mismatch_is_permanent === RUN TestIsRetryableNetworkError/unrelated_error --- PASS: TestIsRetryableNetworkError (0.03s) --- PASS: TestIsRetryableNetworkError/nil (0.00s) --- PASS: TestIsRetryableNetworkError/eof (0.00s) --- PASS: TestIsRetryableNetworkError/unexpected_eof (0.00s) --- PASS: TestIsRetryableNetworkError/volume_idle_timeout_json (0.00s) --- PASS: TestIsRetryableNetworkError/volume_idle_timeout_capitalized (0.00s) --- PASS: TestIsRetryableNetworkError/connection_reset (0.00s) --- PASS: TestIsRetryableNetworkError/connection_reset_capitalized (0.00s) --- PASS: TestIsRetryableNetworkError/broken_pipe (0.00s) --- PASS: TestIsRetryableNetworkError/broken_pipe_capitalized (0.00s) --- PASS: TestIsRetryableNetworkError/net.Error_timeout (0.00s) --- PASS: TestIsRetryableNetworkError/size_mismatch_is_permanent (0.00s) --- PASS: TestIsRetryableNetworkError/unrelated_error (0.00s) === RUN TestReplicateChunksPreservesSizeMismatchSentinel I1117 09:40:33.534652 fetch_write.go:513 permanent size mismatch replicating 74,047d16a94aa581 for /dst/index.bin: chunk size mismatch: read 74,047d16a94aa581 got 0 bytes, source metadata says 5171 --- PASS: TestReplicateChunksPreservesSizeMismatchSentinel (0.03s) === RUN TestSourceSupersedes === RUN TestSourceSupersedes/not-found_sentinel === RUN TestSourceSupersedes/not-found_wrapped === RUN TestSourceSupersedes/not-found_as_string_(gRPC) === RUN TestSourceSupersedes/nil_entry,_nil_error === RUN TestSourceSupersedes/network_error === RUN TestSourceSupersedes/source_strictly_newer === RUN TestSourceSupersedes/source_same_version === RUN TestSourceSupersedes/source_older_(out-of-order_replay) --- PASS: TestSourceSupersedes (0.01s) --- PASS: TestSourceSupersedes/not-found_sentinel (0.00s) --- PASS: TestSourceSupersedes/not-found_wrapped (0.00s) --- PASS: TestSourceSupersedes/not-found_as_string_(gRPC) (0.00s) --- PASS: TestSourceSupersedes/nil_entry,_nil_error (0.00s) --- PASS: TestSourceSupersedes/network_error (0.00s) --- PASS: TestSourceSupersedes/source_strictly_newer (0.00s) --- PASS: TestSourceSupersedes/source_same_version (0.00s) --- PASS: TestSourceSupersedes/source_older_(out-of-order_replay) (0.00s) === RUN TestSourceSupersedesEpochMtime --- PASS: TestSourceSupersedesEpochMtime (0.00s) === RUN TestManifestResolveRetryGateUnverifiableSupersessionBounded I1117 09:40:33.563598 fetch_write.go:324 resolve manifest 3,01abc for /backup/2026-07-10/buckets/x/f.pt: LookupFileId volume id 3: not found I1117 09:40:33.564025 fetch_write.go:324 resolve manifest 3,01abc for /backup/2026-07-10/buckets/x/f.pt: LookupFileId volume id 3: not found I1117 09:40:33.564506 fetch_write.go:321 resolve manifest 3,01abc for /backup/2026-07-10/buckets/x/f.pt: supersession unverifiable, propagating after 3 attempts: LookupFileId volume id 3: not found --- PASS: TestManifestResolveRetryGateUnverifiableSupersessionBounded (0.00s) === RUN TestManifestResolveRetryGateNonTransientPropagates I1117 09:40:33.566216 fetch_write.go:316 resolve manifest 3,01abc for /backup/buckets/x/f.pt: non-transient error, propagating: fail to unmarshal manifest 3,01abc: proto: cannot parse invalid wire-format data I1117 09:40:33.567287 fetch_write.go:316 resolve manifest 3,01abc for /backup/buckets/x/f.pt: non-transient error, propagating: invalid fileId abc I1117 09:40:33.567732 fetch_write.go:324 resolve manifest 3,01abc for /backup/buckets/x/f.pt: LookupFileId volume id 3: not found --- PASS: TestManifestResolveRetryGateNonTransientPropagates (0.00s) === RUN TestFetchAndWriteStopsOnMissingSourceChunk I1117 09:40:33.916780 fetch_write.go:561 replicate 5617,01abc for /dst/x.bin: read part 5617,01abc: LookupFileId locate volume id 5617: volume not found E1117 09:40:35.001592 fetch_write.go:544 source has not had 5617,01abc for /dst/x.bin in 500ms, giving up on it: read part 5617,01abc: LookupFileId locate volume id 5617: volume not found --- PASS: TestFetchAndWriteStopsOnMissingSourceChunk (1.47s) === RUN TestMissingSourceChunkGate --- PASS: TestMissingSourceChunkGate (0.01s) === RUN TestMissingSourceChunkGateConfirmedNotFound --- PASS: TestMissingSourceChunkGateConfirmedNotFound (0.00s) === RUN TestCreateEntryConfirmedMissingChunksUseShortGrace I1117 09:40:35.176002 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:41577/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:41577/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:35.190835 fetch_write.go:561 replicate 5617,01abc for /dst/x.bin: read part 5617,01abc: chunk not found on any volume replica: http://127.0.0.1:41577/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:36.238891 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:41577/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:41577/5617,01abc?readDeleted=true: 404 Not Found: not found E1117 09:40:36.269304 fetch_write.go:544 source has not had 5617,01abc for /dst/x.bin in 20ms, giving up on it: read part 5617,01abc: chunk not found on any volume replica: http://127.0.0.1:41577/5617,01abc?readDeleted=true: 404 Not Found: not found E1117 09:40:36.293764 filer_sink.go:568 skip /dst/x.bin: the source cluster cannot produce its data, so it stays unreplicated: copy 5617,01abc: source chunk missing: read part 5617,01abc: chunk not found on any volume replica: http://127.0.0.1:41577/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:36.333885 filer_source.go:183 fail to read part 5617,02abc from http://127.0.0.1:41577/5617,02abc?readDeleted=true offset 0: http://127.0.0.1:41577/5617,02abc?readDeleted=true: 404 Not Found: not found I1117 09:40:36.366191 fetch_write.go:561 replicate 5617,02abc for /dst/y.bin: read part 5617,02abc: chunk not found on any volume replica: http://127.0.0.1:41577/5617,02abc?readDeleted=true: 404 Not Found: not found I1117 09:40:37.395126 filer_source.go:183 fail to read part 5617,02abc from http://127.0.0.1:41577/5617,02abc?readDeleted=true offset 0: http://127.0.0.1:41577/5617,02abc?readDeleted=true: 404 Not Found: not found E1117 09:40:37.419988 fetch_write.go:544 source has not had 5617,02abc for /dst/y.bin in 20ms, giving up on it: read part 5617,02abc: chunk not found on any volume replica: http://127.0.0.1:41577/5617,02abc?readDeleted=true: 404 Not Found: not found E1117 09:40:37.429224 filer_sink.go:568 skip /dst/y.bin: the source cluster cannot produce its data, so it stays unreplicated: copy 5617,02abc: source chunk missing: read part 5617,02abc: chunk not found on any volume replica: http://127.0.0.1:41577/5617,02abc?readDeleted=true: 404 Not Found: not found --- PASS: TestCreateEntryConfirmedMissingChunksUseShortGrace (2.39s) === RUN TestOnReplicateChunkErrorMissingSourceChunk === RUN TestOnReplicateChunkErrorMissingSourceChunk/source_still_serving E1117 09:40:37.476978 filer_sink.go:568 skip /dst/x.bin: the source cluster cannot produce its data, so it stays unreplicated: copy 5617,02def: source chunk missing: volume not found === RUN TestOnReplicateChunkErrorMissingSourceChunk/needle_404_needs_no_probe E1117 09:40:37.513913 filer_sink.go:568 skip /dst/x.bin: the source cluster cannot produce its data, so it stays unreplicated: copy 5617,02def: source chunk missing: not found === RUN TestOnReplicateChunkErrorMissingSourceChunk/proxied_404_still_needs_the_probe === RUN TestOnReplicateChunkErrorMissingSourceChunk/source_locating_nothing I1117 09:40:37.591697 fetch_write.go:661 source cannot serve 5616,01abc either, so it is not only the one chunk: LookupFileId locate volume id 5616: volume not found === RUN TestOnReplicateChunkErrorMissingSourceChunk/probe_locates_but_cannot_be_read I1117 09:40:37.635008 filer_source.go:183 fail to read part 5616,01abc from http://127.0.0.1:42601/5616,01abc?readDeleted=true offset 0: http://127.0.0.1:42601/5616,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:37.635462 fetch_write.go:661 source cannot serve 5616,01abc either, so it is not only the one chunk: chunk not found on any volume replica: http://127.0.0.1:42601/5616,01abc?readDeleted=true: 404 Not Found: not found === RUN TestOnReplicateChunkErrorMissingSourceChunk/nothing_served_yet --- PASS: TestOnReplicateChunkErrorMissingSourceChunk (0.23s) --- PASS: TestOnReplicateChunkErrorMissingSourceChunk/source_still_serving (0.04s) --- PASS: TestOnReplicateChunkErrorMissingSourceChunk/needle_404_needs_no_probe (0.03s) --- PASS: TestOnReplicateChunkErrorMissingSourceChunk/proxied_404_still_needs_the_probe (0.05s) --- PASS: TestOnReplicateChunkErrorMissingSourceChunk/source_locating_nothing (0.03s) --- PASS: TestOnReplicateChunkErrorMissingSourceChunk/probe_locates_but_cannot_be_read (0.05s) --- PASS: TestOnReplicateChunkErrorMissingSourceChunk/nothing_served_yet (0.03s) === RUN TestFetchAndWriteMissingSourceChunkUnverifiableSupersession I1117 09:40:37.697045 fetch_write.go:529 source does not have 5617,01abc for /backup/2026-07-10/x.bin, supersession unverifiable, propagating: read part 5617,01abc: LookupFileId locate volume id 5617: volume not found --- PASS: TestFetchAndWriteMissingSourceChunkUnverifiableSupersession (0.03s) === RUN TestSourceDroppedChunk --- PASS: TestSourceDroppedChunk (0.05s) === RUN TestSourceMovedOn --- PASS: TestSourceMovedOn (0.19s) === RUN TestSourceMovedOnStalledLookupContinues --- PASS: TestSourceMovedOnStalledLookupContinues (0.21s) === RUN TestFetchAndWriteStopsWhenSourceDroppedChunk I1117 09:40:38.219602 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:37109/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:37109/5617,01abc?readDeleted=true: 404 Not Found: not found --- PASS: TestFetchAndWriteStopsWhenSourceDroppedChunk (0.08s) === RUN TestFetchAndWriteStopsWhenOlderLiveEntryDroppedChunk I1117 09:40:38.277471 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:37111/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:37111/5617,01abc?readDeleted=true: 404 Not Found: not found --- PASS: TestFetchAndWriteStopsWhenOlderLiveEntryDroppedChunk (0.05s) === RUN TestFetchAndWriteManifestChildKeepsRetrying I1117 09:40:38.332259 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:45357/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:45357/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:38.345813 fetch_write.go:561 replicate 5617,01abc for /dst/x.bin: read part 5617,01abc: chunk not found on any volume replica: http://127.0.0.1:45357/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:39.363733 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:45357/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:45357/5617,01abc?readDeleted=true: 404 Not Found: not found E1117 09:40:39.375964 fetch_write.go:544 source has not had 5617,01abc for /dst/x.bin in 500ms, giving up on it: read part 5617,01abc: chunk not found on any volume replica: http://127.0.0.1:45357/5617,01abc?readDeleted=true: 404 Not Found: not found --- PASS: TestFetchAndWriteManifestChildKeepsRetrying (1.09s) === RUN TestFetchAndWriteStopsOnTransientErrorWhenCommittedOver I1117 09:40:39.424145 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:39085/5617,01abc?readDeleted=true offset 0: Get "http://127.0.0.1:39085/5617,01abc?readDeleted=true": dial tcp 127.0.0.1:39085: connect: connection refused --- PASS: TestFetchAndWriteStopsOnTransientErrorWhenCommittedOver (0.05s) === RUN TestManifestResolveRetryGateOrdersByCommit I1117 09:40:39.475576 fetch_write.go:324 resolve manifest 5617,01abc for /dst/x.bin: dial tcp: connection refused I1117 09:40:39.486579 fetch_write.go:324 resolve manifest 5617,01abc for /dst/x.bin: LookupFileId locate volume id 5617: volume not found --- PASS: TestManifestResolveRetryGateOrdersByCommit (0.05s) === RUN TestOnReplicateChunkErrorSkipsSupersededVersion === RUN TestOnReplicateChunkErrorSkipsSupersededVersion/source_entry_gone W1117 09:40:39.521334 filer_sink.go:560 skip stale entry /dst/x.bin, source superseded during replicate: copy 5617,01abc: dial tcp: connection refused === RUN TestOnReplicateChunkErrorSkipsSupersededVersion/committed_over_with_an_older_mtime W1117 09:40:39.546246 filer_sink.go:560 skip stale entry /dst/x.bin, source superseded during replicate: copy 5617,01abc: dial tcp: connection refused === RUN TestOnReplicateChunkErrorSkipsSupersededVersion/source_unchanged --- PASS: TestOnReplicateChunkErrorSkipsSupersededVersion (0.07s) --- PASS: TestOnReplicateChunkErrorSkipsSupersededVersion/source_entry_gone (0.03s) --- PASS: TestOnReplicateChunkErrorSkipsSupersededVersion/committed_over_with_an_older_mtime (0.02s) --- PASS: TestOnReplicateChunkErrorSkipsSupersededVersion/source_unchanged (0.01s) === RUN TestFetchAndWriteLaggingLookupKeepsRetrying I1117 09:40:39.601239 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:36465/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:36465/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:39.614133 fetch_write.go:561 replicate 5617,01abc for /dst/x.bin: read part 5617,01abc: chunk not found on any volume replica: http://127.0.0.1:36465/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:40.642025 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:36465/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:36465/5617,01abc?readDeleted=true: 404 Not Found: not found E1117 09:40:40.665014 fetch_write.go:544 source has not had 5617,01abc for /dst/x.bin in 500ms, giving up on it: read part 5617,01abc: chunk not found on any volume replica: http://127.0.0.1:36465/5617,01abc?readDeleted=true: 404 Not Found: not found --- PASS: TestFetchAndWriteLaggingLookupKeepsRetrying (1.11s) === RUN TestCreateEntrySkipsSupersededVersion W1117 09:40:40.728584 filer_sink.go:333 skip stale entry /dst/x.bin, source superseded before replicate --- PASS: TestCreateEntrySkipsSupersededVersion (0.05s) === RUN TestCreateEntryReplicatesCurrentVersion I1117 09:40:40.799630 fetch_write.go:561 replicate 5617,01abc for /dst/x.bin: read part 5617,01abc: LookupFileId locate volume id 5617: volume not found E1117 09:40:41.821299 fetch_write.go:544 source has not had 5617,01abc for /dst/x.bin in 200ms, giving up on it: read part 5617,01abc: LookupFileId locate volume id 5617: volume not found --- PASS: TestCreateEntryReplicatesCurrentVersion (1.10s) === RUN TestUpdateEntrySkipsSupersededVersion W1117 09:40:41.893778 filer_sink.go:417 skip stale entry /dst/x.bin, source superseded before replicate --- PASS: TestUpdateEntrySkipsSupersededVersion (0.06s) === RUN TestCreateEntrySyncsLiveVersion W1117 09:40:41.983050 filer_sink.go:336 entry /dst/x.bin superseded before replicate; syncing live version --- PASS: TestCreateEntrySyncsLiveVersion (0.12s) === RUN TestUpdateEntrySyncsLiveVersion W1117 09:40:42.091319 filer_sink.go:420 entry /dst/x.bin superseded before replicate; syncing live version W1117 09:40:42.092741 filer_sink.go:440 repair /dst/x.bin: destination diverged from source (dst 1 chunks, src 0 chunks); re-replicating full source content --- PASS: TestUpdateEntrySyncsLiveVersion (0.09s) === RUN TestUpdateEntrySyncsOlderLiveVersion W1117 09:40:42.169515 filer_sink.go:420 entry /dst/x.bin superseded before replicate; syncing live version W1117 09:40:42.170021 filer_sink.go:440 repair /dst/x.bin: destination diverged from source (dst 1 chunks, src 0 chunks); re-replicating full source content --- PASS: TestUpdateEntrySyncsOlderLiveVersion (0.06s) === RUN TestUpdateEntryAppliesReplayAheadOfLiveLookup --- PASS: TestUpdateEntryAppliesReplayAheadOfLiveLookup (0.05s) === RUN TestUpdateEntryKeepsDestinationHoldingLiveVersion W1117 09:40:42.275557 filer_sink.go:420 entry /dst/x.bin superseded before replicate; syncing live version --- PASS: TestUpdateEntryKeepsDestinationHoldingLiveVersion (0.06s) === RUN TestMoveEntryReconcilesMovedContent W1117 09:40:42.328234 filer_sink.go:440 repair /dst/y.bin: destination diverged from source (dst 1 chunks, src 0 chunks); re-replicating full source content --- PASS: TestMoveEntryReconcilesMovedContent (0.05s) === RUN TestGetEntryMtimeNs --- PASS: TestGetEntryMtimeNs (0.00s) === RUN TestOnCorruptChunkRefusesWhenSupersessionUnconfirmed E1117 09:40:42.336481 filer_sink.go:547 refuse to replicate entry with corrupt chunk /buckets/x/config: corrupt chunk: read 0 bytes, source says 107 --- PASS: TestOnCorruptChunkRefusesWhenSupersessionUnconfirmed (0.00s) === RUN TestOnReplicateChunkErrorPropagatesWhenSupersessionUnconfirmed --- PASS: TestOnReplicateChunkErrorPropagatesWhenSupersessionUnconfirmed (0.00s) === RUN TestChooseUpdateAction === RUN TestChooseUpdateAction/nil_existing_entry === RUN TestChooseUpdateAction/destination_older,_catching_up === RUN TestChooseUpdateAction/same_mtime === RUN TestChooseUpdateAction/destination_newer_and_complete === RUN TestChooseUpdateAction/destination_newer_and_larger === RUN TestChooseUpdateAction/newer_smaller_dest,_older_larger_event_->_skip === RUN TestChooseUpdateAction/same_second,_destination_newer_and_complete === RUN TestChooseUpdateAction/same_second,_destination_older === RUN TestChooseUpdateAction/behind,_covers_less_than_oldEntry_->_repair === RUN TestChooseUpdateAction/behind,_matches_oldEntry_coverage_->_normal === RUN TestChooseUpdateAction/behind,_exceeds_oldEntry_coverage_->_normal === RUN TestChooseUpdateAction/behind,_equal_total_but_range_gap_->_repair === RUN TestChooseUpdateAction/older,_stale_backup_chunk_->_repair === RUN TestChooseUpdateAction/equal-mtime_stale_->_deferred_(normal) === RUN TestChooseUpdateAction/older,_rsync_chunks_->_normal === RUN TestChooseUpdateAction/in-sync_(fast_path)_->_normal --- PASS: TestChooseUpdateAction (0.02s) --- PASS: TestChooseUpdateAction/nil_existing_entry (0.00s) --- PASS: TestChooseUpdateAction/destination_older,_catching_up (0.00s) --- PASS: TestChooseUpdateAction/same_mtime (0.00s) --- PASS: TestChooseUpdateAction/destination_newer_and_complete (0.00s) --- PASS: TestChooseUpdateAction/destination_newer_and_larger (0.00s) --- PASS: TestChooseUpdateAction/newer_smaller_dest,_older_larger_event_->_skip (0.00s) --- PASS: TestChooseUpdateAction/same_second,_destination_newer_and_complete (0.00s) --- PASS: TestChooseUpdateAction/same_second,_destination_older (0.00s) --- PASS: TestChooseUpdateAction/behind,_covers_less_than_oldEntry_->_repair (0.00s) --- PASS: TestChooseUpdateAction/behind,_matches_oldEntry_coverage_->_normal (0.00s) --- PASS: TestChooseUpdateAction/behind,_exceeds_oldEntry_coverage_->_normal (0.00s) --- PASS: TestChooseUpdateAction/behind,_equal_total_but_range_gap_->_repair (0.00s) --- PASS: TestChooseUpdateAction/older,_stale_backup_chunk_->_repair (0.00s) --- PASS: TestChooseUpdateAction/equal-mtime_stale_->_deferred_(normal) (0.00s) --- PASS: TestChooseUpdateAction/older,_rsync_chunks_->_normal (0.00s) --- PASS: TestChooseUpdateAction/in-sync_(fast_path)_->_normal (0.00s) === RUN TestCoversReference === RUN TestCoversReference/empty_reference === RUN TestCoversReference/reference_no_chunks === RUN TestCoversReference/exact === RUN TestCoversReference/superset === RUN TestCoversReference/truncated_tail === RUN TestCoversReference/equal_total,_range_gap === RUN TestCoversReference/contiguous_parts_cover === RUN TestCoversReference/overlapping_parts_cover === RUN TestCoversReference/existing_empty,_reference_has_bytes --- PASS: TestCoversReference (0.01s) --- PASS: TestCoversReference/empty_reference (0.00s) --- PASS: TestCoversReference/reference_no_chunks (0.00s) --- PASS: TestCoversReference/exact (0.00s) --- PASS: TestCoversReference/superset (0.00s) --- PASS: TestCoversReference/truncated_tail (0.00s) --- PASS: TestCoversReference/equal_total,_range_gap (0.00s) --- PASS: TestCoversReference/contiguous_parts_cover (0.00s) --- PASS: TestCoversReference/overlapping_parts_cover (0.00s) --- PASS: TestCoversReference/existing_empty,_reference_has_bytes (0.00s) === RUN TestDestinationSatisfiesSource === RUN TestDestinationSatisfiesSource/nil_existing === RUN TestDestinationSatisfiesSource/identical_complete_->_skip === RUN TestDestinationSatisfiesSource/truncated_(no_md5)_->_replicate === RUN TestDestinationSatisfiesSource/md5-backed_truncated_->_replicate === RUN TestDestinationSatisfiesSource/md5_equal_and_complete_->_skip === RUN TestDestinationSatisfiesSource/complete,_dest_newer_->_skip === RUN TestDestinationSatisfiesSource/complete,_dest_older_->_replicate === RUN TestDestinationSatisfiesSource/older,_stale_backup_chunk_->_replicate === RUN TestDestinationSatisfiesSource/equal-mtime_stale_->_skip_(deferred) === RUN TestDestinationSatisfiesSource/rsync_complete_->_skip === RUN TestDestinationSatisfiesSource/in-sync_(fast_path)_->_skip === RUN TestDestinationSatisfiesSource/newer_smaller_dest,_older_larger_source_->_skip === RUN TestDestinationSatisfiesSource/inline_same_->_skip === RUN TestDestinationSatisfiesSource/inline_different,_dest_older_->_replicate === RUN TestDestinationSatisfiesSource/inline_different,_equal_mtime_->_replicate === RUN TestDestinationSatisfiesSource/inline_different,_dest_newer_->_skip --- PASS: TestDestinationSatisfiesSource (0.02s) --- PASS: TestDestinationSatisfiesSource/nil_existing (0.00s) --- PASS: TestDestinationSatisfiesSource/identical_complete_->_skip (0.00s) --- PASS: TestDestinationSatisfiesSource/truncated_(no_md5)_->_replicate (0.00s) --- PASS: TestDestinationSatisfiesSource/md5-backed_truncated_->_replicate (0.00s) --- PASS: TestDestinationSatisfiesSource/md5_equal_and_complete_->_skip (0.00s) --- PASS: TestDestinationSatisfiesSource/complete,_dest_newer_->_skip (0.00s) --- PASS: TestDestinationSatisfiesSource/complete,_dest_older_->_replicate (0.00s) --- PASS: TestDestinationSatisfiesSource/older,_stale_backup_chunk_->_replicate (0.00s) --- PASS: TestDestinationSatisfiesSource/equal-mtime_stale_->_skip_(deferred) (0.00s) --- PASS: TestDestinationSatisfiesSource/rsync_complete_->_skip (0.00s) --- PASS: TestDestinationSatisfiesSource/in-sync_(fast_path)_->_skip (0.00s) --- PASS: TestDestinationSatisfiesSource/newer_smaller_dest,_older_larger_source_->_skip (0.00s) --- PASS: TestDestinationSatisfiesSource/inline_same_->_skip (0.00s) --- PASS: TestDestinationSatisfiesSource/inline_different,_dest_older_->_replicate (0.00s) --- PASS: TestDestinationSatisfiesSource/inline_different,_equal_mtime_->_replicate (0.00s) --- PASS: TestDestinationSatisfiesSource/inline_different,_dest_newer_->_skip (0.00s) === RUN TestDestinationHoldsContent === RUN TestDestinationHoldsContent/nil_existing === RUN TestDestinationHoldsContent/identical_->_skip === RUN TestDestinationHoldsContent/in-sync_(fast_path)_->_skip === RUN TestDestinationHoldsContent/md5_equal_and_complete_->_skip === RUN TestDestinationHoldsContent/truncated_(no_md5)_->_write === RUN TestDestinationHoldsContent/md5-backed_truncated_->_write === RUN TestDestinationHoldsContent/complete,_dest_newer,_different_->_write === RUN TestDestinationHoldsContent/newer_smaller_dest_->_write === RUN TestDestinationHoldsContent/equal-mtime_different_->_write === RUN TestDestinationHoldsContent/inline_same_->_skip === RUN TestDestinationHoldsContent/inline_different_->_write === RUN TestDestinationHoldsContent/inline_different,_dest_newer_->_write === RUN TestDestinationHoldsContent/inline_vs_empty_->_write === RUN TestDestinationHoldsContent/same_chunks,_different_mtime_->_write === RUN TestDestinationHoldsContent/same_chunks,_stale_tag_->_write === RUN TestDestinationHoldsContent/same_chunks,_same_tag_->_skip === RUN TestDestinationHoldsContent/same_chunks,_renamed_empty_tag_->_write === RUN TestDestinationHoldsContent/same_chunks,_same_empty_tag_->_skip === RUN TestDestinationHoldsContent/same_chunks,_stale_uid_->_write === RUN TestDestinationHoldsContent/same_chunks,_rule_ttl_->_skip === RUN TestDestinationHoldsContent/same_chunks,_ttl_mismatch_->_write === RUN TestDestinationHoldsContent/assigned_fields_differ_->_skip --- PASS: TestDestinationHoldsContent (0.03s) --- PASS: TestDestinationHoldsContent/nil_existing (0.00s) --- PASS: TestDestinationHoldsContent/identical_->_skip (0.00s) --- PASS: TestDestinationHoldsContent/in-sync_(fast_path)_->_skip (0.00s) --- PASS: TestDestinationHoldsContent/md5_equal_and_complete_->_skip (0.00s) --- PASS: TestDestinationHoldsContent/truncated_(no_md5)_->_write (0.00s) --- PASS: TestDestinationHoldsContent/md5-backed_truncated_->_write (0.00s) --- PASS: TestDestinationHoldsContent/complete,_dest_newer,_different_->_write (0.00s) --- PASS: TestDestinationHoldsContent/newer_smaller_dest_->_write (0.00s) --- PASS: TestDestinationHoldsContent/equal-mtime_different_->_write (0.00s) --- PASS: TestDestinationHoldsContent/inline_same_->_skip (0.00s) --- PASS: TestDestinationHoldsContent/inline_different_->_write (0.00s) --- PASS: TestDestinationHoldsContent/inline_different,_dest_newer_->_write (0.00s) --- PASS: TestDestinationHoldsContent/inline_vs_empty_->_write (0.00s) --- PASS: TestDestinationHoldsContent/same_chunks,_different_mtime_->_write (0.00s) --- PASS: TestDestinationHoldsContent/same_chunks,_stale_tag_->_write (0.00s) --- PASS: TestDestinationHoldsContent/same_chunks,_same_tag_->_skip (0.00s) --- PASS: TestDestinationHoldsContent/same_chunks,_renamed_empty_tag_->_write (0.00s) --- PASS: TestDestinationHoldsContent/same_chunks,_same_empty_tag_->_skip (0.00s) --- PASS: TestDestinationHoldsContent/same_chunks,_stale_uid_->_write (0.00s) --- PASS: TestDestinationHoldsContent/same_chunks,_rule_ttl_->_skip (0.00s) --- PASS: TestDestinationHoldsContent/same_chunks,_ttl_mismatch_->_write (0.00s) --- PASS: TestDestinationHoldsContent/assigned_fields_differ_->_skip (0.00s) === RUN TestDestinationMatchesReference === RUN TestDestinationMatchesReference/both_empty === RUN TestDestinationMatchesReference/exact_in_order === RUN TestDestinationMatchesReference/count_mismatch === RUN TestDestinationMatchesReference/reordered === RUN TestDestinationMatchesReference/stale_identity === RUN TestDestinationMatchesReference/out-of-band_chunk === RUN TestDestinationMatchesReference/shifted_offset,_same_identity === RUN TestDestinationMatchesReference/larger_size,_same_identity === RUN TestDestinationMatchesReference/inline_same === RUN TestDestinationMatchesReference/inline_different === RUN TestDestinationMatchesReference/inline_vs_none --- PASS: TestDestinationMatchesReference (0.01s) --- PASS: TestDestinationMatchesReference/both_empty (0.00s) --- PASS: TestDestinationMatchesReference/exact_in_order (0.00s) --- PASS: TestDestinationMatchesReference/count_mismatch (0.00s) --- PASS: TestDestinationMatchesReference/reordered (0.00s) --- PASS: TestDestinationMatchesReference/stale_identity (0.00s) --- PASS: TestDestinationMatchesReference/out-of-band_chunk (0.00s) --- PASS: TestDestinationMatchesReference/shifted_offset,_same_identity (0.00s) --- PASS: TestDestinationMatchesReference/larger_size,_same_identity (0.00s) --- PASS: TestDestinationMatchesReference/inline_same (0.00s) --- PASS: TestDestinationMatchesReference/inline_different (0.00s) --- PASS: TestDestinationMatchesReference/inline_vs_none (0.00s) === RUN TestHasStaleBackupChunk === RUN TestHasStaleBackupChunk/nil_existing === RUN TestHasStaleBackupChunk/in_sync === RUN TestHasStaleBackupChunk/stale_backup_chunk === RUN TestHasStaleBackupChunk/rsync_chunks_ignored === RUN TestHasStaleBackupChunk/synced_backup_+_rsync === RUN TestHasStaleBackupChunk/stale_backup_among_rsync --- PASS: TestHasStaleBackupChunk (0.01s) --- PASS: TestHasStaleBackupChunk/nil_existing (0.00s) --- PASS: TestHasStaleBackupChunk/in_sync (0.00s) --- PASS: TestHasStaleBackupChunk/stale_backup_chunk (0.00s) --- PASS: TestHasStaleBackupChunk/rsync_chunks_ignored (0.00s) --- PASS: TestHasStaleBackupChunk/synced_backup_+_rsync (0.00s) --- PASS: TestHasStaleBackupChunk/stale_backup_among_rsync (0.00s) === RUN TestUpdatedEntryKey === RUN TestUpdatedEntryKey/content_update,_no_new_parent === RUN TestUpdatedEntryKey/rename_same_dir === RUN TestUpdatedEntryKey/rename_to_subdir === RUN TestUpdatedEntryKey/root_parent --- PASS: TestUpdatedEntryKey (0.00s) --- PASS: TestUpdatedEntryKey/content_update,_no_new_parent (0.00s) --- PASS: TestUpdatedEntryKey/rename_same_dir (0.00s) --- PASS: TestUpdatedEntryKey/rename_to_subdir (0.00s) --- PASS: TestUpdatedEntryKey/root_parent (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/replication/sink/filersink 11.644s ? github.com/seaweedfs/seaweedfs/weed/replication/sink/gcssink [no test files] === RUN TestDeleteEntryVersionAgainstLiveSource === RUN TestDeleteEntryVersionAgainstLiveSource/source_recreated_the_path === RUN TestDeleteEntryVersionAgainstLiveSource/source_deleted_the_path === RUN TestDeleteEntryVersionAgainstLiveSource/source_store_lags_the_delete === RUN TestDeleteEntryVersionAgainstLiveSource/source_holds_a_version_written_before_the_delete === RUN TestDeleteEntryVersionAgainstLiveSource/source_recreated_a_directory === RUN TestDeleteEntryVersionAgainstLiveSource/stamped_replacement_of_an_unstamped_entry === RUN TestDeleteEntryVersionAgainstLiveSource/no_delete_time,_newer_than_the_deleted_stamp === RUN TestDeleteEntryVersionAgainstLiveSource/no_delete_time,_the_deleted_version === RUN TestDeleteEntryVersionAgainstLiveSource/no_delete_time,_stamped_replacement_of_an_unstamped_entry === RUN TestDeleteEntryVersionAgainstLiveSource/no_delete_time,_unstamped_entry_with_an_older_mtime === RUN TestDeleteEntryVersionAgainstLiveSource/unstamped_source,_replacement_written_after_the_delete === RUN TestDeleteEntryVersionAgainstLiveSource/unstamped_source,_entry_written_before_the_delete === RUN TestDeleteEntryVersionAgainstLiveSource/nothing_stamped,_newer_mtime === RUN TestDeleteEntryVersionAgainstLiveSource/nothing_stamped,_same_mtime === RUN TestDeleteEntryVersionAgainstLiveSource/source_lookup_fails --- PASS: TestDeleteEntryVersionAgainstLiveSource (1.19s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/source_recreated_the_path (0.41s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/source_deleted_the_path (0.09s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/source_store_lags_the_delete (0.04s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/source_holds_a_version_written_before_the_delete (0.03s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/source_recreated_a_directory (0.18s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/stamped_replacement_of_an_unstamped_entry (0.05s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/no_delete_time,_newer_than_the_deleted_stamp (0.04s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/no_delete_time,_the_deleted_version (0.03s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/no_delete_time,_stamped_replacement_of_an_unstamped_entry (0.03s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/no_delete_time,_unstamped_entry_with_an_older_mtime (0.04s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/unstamped_source,_replacement_written_after_the_delete (0.04s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/unstamped_source,_entry_written_before_the_delete (0.03s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/nothing_stamped,_newer_mtime (0.05s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/nothing_stamped,_same_mtime (0.03s) --- PASS: TestDeleteEntryVersionAgainstLiveSource/source_lookup_fails (0.05s) === RUN TestDeleteEntryVersionSkipsLookupWhenDestinationIsGone --- PASS: TestDeleteEntryVersionSkipsLookupWhenDestinationIsGone (0.01s) === RUN TestLocalSinkStaysInsideDir W1117 09:40:36.078193 local_sink.go:53 local sink: skip /tmp/TestLocalSinkStaysInsideDir2492864964/001/escape/marker.txt outside /tmp/TestLocalSinkStaysInsideDir2492864964/001/backup W1117 09:40:36.108356 local_sink.go:53 local sink: skip /tmp/TestLocalSinkStaysInsideDir2492864964/001/escape/marker.txt outside /tmp/TestLocalSinkStaysInsideDir2492864964/001/backup W1117 09:40:36.111612 local_sink.go:53 local sink: skip /tmp/TestLocalSinkStaysInsideDir2492864964/001/victim.txt outside /tmp/TestLocalSinkStaysInsideDir2492864964/001/backup --- PASS: TestLocalSinkStaysInsideDir (0.05s) === RUN TestLocalSinkDoesNotFollowSymlinksOutOfDir I1117 09:40:36.120795 local_sink.go:140 remove entry key /tmp/TestLocalSinkDoesNotFollowSymlinksOutOfDir3722702236/001/backup/link/victim.txt: removeat link/victim.txt: path escapes from parent --- PASS: TestLocalSinkDoesNotFollowSymlinksOutOfDir (0.01s) === RUN TestLocalSinkFollowsAbsoluteSymlinksInsideDir --- PASS: TestLocalSinkFollowsAbsoluteSymlinksInsideDir (0.01s) === RUN TestSanitizeFsKeyKeepsColons --- PASS: TestSanitizeFsKeyKeepsColons (0.00s) === RUN TestCreateEntry_OverwriteReadOnlyFile --- PASS: TestCreateEntry_OverwriteReadOnlyFile (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/replication/sink/localsink 5.360s === RUN TestBuildTaggingString_ShouldStripTagPrefix --- PASS: TestBuildTaggingString_ShouldStripTagPrefix (0.00s) === RUN TestBuildTaggingString_ShouldURLEncodeValues --- PASS: TestBuildTaggingString_ShouldURLEncodeValues (0.00s) === RUN TestS3SinkCreateEntryPassesMimeAsContentType --- PASS: TestS3SinkCreateEntryPassesMimeAsContentType (0.13s) === RUN TestS3SinkCreateEntryOmitsContentTypeWhenMimeMissing --- PASS: TestS3SinkCreateEntryOmitsContentTypeWhenMimeMissing (0.06s) === RUN TestBuildTaggingString_EmptyWhenNoTags --- PASS: TestBuildTaggingString_EmptyWhenNoTags (0.00s) === RUN TestS3SinkCreateEntryForwardsUserMetadata --- PASS: TestS3SinkCreateEntryForwardsUserMetadata (0.04s) === RUN TestS3SinkCreateEntryLeavesEntryExtendedUnchanged --- PASS: TestS3SinkCreateEntryLeavesEntryExtendedUnchanged (0.12s) === RUN TestS3SinkCreateEntryEncodesNonASCIIMetadata --- PASS: TestS3SinkCreateEntryEncodesNonASCIIMetadata (0.02s) === RUN TestS3SinkCreateEntrySkipsOversizedMetadata W1117 09:40:35.273280 s3_sink.go:219 [bucket] dir/big.bin: 2066 bytes of user metadata exceed the S3 limit of 2048, uploading without it --- PASS: TestS3SinkCreateEntrySkipsOversizedMetadata (0.06s) === RUN TestToMetadataSkipsInvalidHeaderNames W1117 09:40:35.326687 s3_sink.go:279 skip metadata "X-Amz-Meta-bad\nkey": not a valid header name W1117 09:40:35.329464 s3_sink.go:279 skip metadata "X-Amz-Meta-bad key": not a valid header name --- PASS: TestToMetadataSkipsInvalidHeaderNames (0.00s) === RUN TestToMetadataPrefersCanonicalKeyOnCaseCollision --- PASS: TestToMetadataPrefersCanonicalKeyOnCaseCollision (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/replication/sink/s3sink 4.528s === RUN TestDownloadFile_NoOffset --- PASS: TestDownloadFile_NoOffset (0.12s) === RUN TestDownloadFile_WithOffset --- PASS: TestDownloadFile_WithOffset (0.08s) === RUN TestDownloadFile_RejectsIgnoredRange --- PASS: TestDownloadFile_RejectsIgnoredRange (0.03s) === RUN TestDownloadFile_ContentDisposition --- PASS: TestDownloadFile_ContentDisposition (0.03s) === RUN TestDownloadFile_PartialReadThenResume --- PASS: TestDownloadFile_PartialReadThenResume (0.08s) === RUN TestDownloadFile_GzipPartialReadThenResume --- PASS: TestDownloadFile_GzipPartialReadThenResume (0.06s) === RUN TestLookupFileIdVolumeNotFound --- PASS: TestLookupFileIdVolumeNotFound (0.22s) === RUN TestReadPartSkipsNotFoundReplica I1117 09:40:33.949682 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:34231/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:34231/5617,01abc?readDeleted=true: 404 Not Found: not found --- PASS: TestReadPartSkipsNotFoundReplica (0.18s) === RUN TestReadPartAllReplicasNotFound I1117 09:40:34.119063 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:35277/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:35277/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:34.137170 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:39847/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:39847/5617,01abc?readDeleted=true: 404 Not Found: not found --- PASS: TestReadPartAllReplicasNotFound (0.15s) === RUN TestReadPartPreservesReplicaFailure === RUN TestReadPartPreservesReplicaFailure/Service_Unavailable I1117 09:40:34.223122 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:46617/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:46617/5617,01abc?readDeleted=true: 503 Service Unavailable I1117 09:40:34.234643 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:37009/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:37009/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:34.282391 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:37009/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:37009/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:34.291930 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:46617/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:46617/5617,01abc?readDeleted=true: 503 Service Unavailable === RUN TestReadPartPreservesReplicaFailure/Unauthorized I1117 09:40:34.331146 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:39165/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:39165/5617,01abc?readDeleted=true: 401 Unauthorized I1117 09:40:34.335638 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:37009/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:37009/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:34.363877 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:37009/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:37009/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:34.370409 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:39165/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:39165/5617,01abc?readDeleted=true: 401 Unauthorized === RUN TestReadPartPreservesReplicaFailure/connection_refused I1117 09:40:34.402746 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:36947/5617,01abc?readDeleted=true offset 0: Get "http://127.0.0.1:36947/5617,01abc?readDeleted=true": dial tcp 127.0.0.1:36947: connect: connection refused I1117 09:40:34.408935 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:37009/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:37009/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:34.449771 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:37009/5617,01abc?readDeleted=true offset 0: http://127.0.0.1:37009/5617,01abc?readDeleted=true: 404 Not Found: not found I1117 09:40:34.451993 filer_source.go:183 fail to read part 5617,01abc from http://127.0.0.1:36947/5617,01abc?readDeleted=true offset 0: Get "http://127.0.0.1:36947/5617,01abc?readDeleted=true": dial tcp 127.0.0.1:36947: connect: connection refused --- PASS: TestReadPartPreservesReplicaFailure (0.32s) --- PASS: TestReadPartPreservesReplicaFailure/Service_Unavailable (0.14s) --- PASS: TestReadPartPreservesReplicaFailure/Unauthorized (0.08s) --- PASS: TestReadPartPreservesReplicaFailure/connection_refused (0.08s) === RUN TestReadPartProxyNotFoundIsUnconfirmed I1117 09:40:34.491937 filer_source.go:160 read part 5617,01abc via filer proxy 127.0.0.1:40595 offset 0: http://127.0.0.1:40595/?proxyChunkId=5617,01abc: 404 Not Found: not found --- PASS: TestReadPartProxyNotFoundIsUnconfirmed (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/replication/source 3.644s === RUN TestKafkaProgressHoldsOffsetAtFailure E1117 09:40:33.658951 notification_kafka.go:201 replicate kafka test partition 0 offset 11 failed; holding the committed offset before it --- PASS: TestKafkaProgressHoldsOffsetAtFailure (0.05s) === RUN TestKafkaProgressKeepsOldestFailure E1117 09:40:33.712107 notification_kafka.go:201 replicate kafka test partition 0 offset 20 failed; holding the committed offset before it E1117 09:40:33.714265 notification_kafka.go:201 replicate kafka test partition 0 offset 11 failed; holding the committed offset before it --- PASS: TestKafkaProgressKeepsOldestFailure (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/replication/sub 2.860s === RUN TestAuditLogCarriesTheSigningAccessKey --- PASS: TestAuditLogCarriesTheSigningAccessKey (0.06s) === RUN TestAuditLogCarriesTheAccessKeyOnTheDenyPath --- PASS: TestAuditLogCarriesTheAccessKeyOnTheDenyPath (0.02s) === RUN TestPostPolicyUploadRecordsTheSigningKey --- PASS: TestPostPolicyUploadRecordsTheSigningKey (0.27s) === RUN TestSignedVirtualHostRetargetRecordsTheSigningKey --- PASS: TestSignedVirtualHostRetargetRecordsTheSigningKey (0.01s) === RUN TestRecordedKeyIsTheVerifiedKeyForSigV4Header --- PASS: TestRecordedKeyIsTheVerifiedKeyForSigV4Header (0.01s) === RUN TestRecordedKeyIgnoresAJunkCredentialQueryOnASigV2Request --- PASS: TestRecordedKeyIgnoresAJunkCredentialQueryOnASigV2Request (0.01s) === RUN TestRecordedKeyIgnoresAJunkSigV4HeaderOnASigV2PresignedRequest --- PASS: TestRecordedKeyIgnoresAJunkSigV4HeaderOnASigV2PresignedRequest (0.00s) === RUN TestRecordedKeyIsEmptyWhenTheSignatureFails --- PASS: TestRecordedKeyIsEmptyWhenTheSignatureFails (0.01s) === RUN TestRecordedKeyForAStreamingUpload --- PASS: TestRecordedKeyForAStreamingUpload (0.01s) === RUN TestRecordedKeyForAnSTSSession I1117 09:40:41.833275 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRecordedKeyForAnSTSSession (0.09s) === RUN TestAccountForUnscopedIdentity --- PASS: TestAccountForUnscopedIdentity (0.00s) === RUN TestUnscopedIdentitiesGetDistinctAccounts I1117 09:40:41.933944 config_loader.go:73 Using explicit credential store: memory --- PASS: TestUnscopedIdentitiesGetDistinctAccounts (0.06s) === RUN TestCheckAccessByOwnershipDeniesNonOwner --- PASS: TestCheckAccessByOwnershipDeniesNonOwner (0.00s) === RUN TestCheckAccessByOwnershipAllowsWhenAuthDisabled --- PASS: TestCheckAccessByOwnershipAllowsWhenAuthDisabled (0.00s) === RUN TestUnscopedIdentityAccountResolvesByName I1117 09:40:41.995800 config_loader.go:73 Using explicit credential store: memory --- PASS: TestUnscopedIdentityAccountResolvesByName (0.02s) === RUN TestUnscopedIdentityReusesConfiguredAccount I1117 09:40:42.012420 config_loader.go:73 Using explicit credential store: memory --- PASS: TestUnscopedIdentityReusesConfiguredAccount (0.02s) === RUN TestInlineIdentityAccountIsRegistered I1117 09:40:42.037730 config_loader.go:73 Using explicit credential store: memory --- PASS: TestInlineIdentityAccountIsRegistered (0.01s) === RUN TestInlineIdentityAccountIsRegisteredOnUpsert I1117 09:40:42.053740 config_loader.go:73 Using explicit credential store: memory --- PASS: TestInlineIdentityAccountIsRegisteredOnUpsert (0.01s) === RUN TestInlineAccountEmailClaimAndHandoff I1117 09:40:42.067175 config_loader.go:73 Using explicit credential store: memory --- PASS: TestInlineAccountEmailClaimAndHandoff (0.01s) === RUN TestDeclaredAccountOutranksInlineIdentityAccount I1117 09:40:42.079698 config_loader.go:73 Using explicit credential store: memory --- PASS: TestDeclaredAccountOutranksInlineIdentityAccount (0.01s) === RUN TestIsConfiguredAccountID I1117 09:40:42.088897 config_loader.go:73 Using explicit credential store: memory --- PASS: TestIsConfiguredAccountID (0.01s) === RUN TestAuditRequesterArnForSTSSession --- PASS: TestAuditRequesterArnForSTSSession (0.00s) === RUN TestAuditRequesterIdentityForOIDCFederatedSession --- PASS: TestAuditRequesterIdentityForOIDCFederatedSession (0.00s) === RUN TestAuditRequesterIdentityEmptyForNonFederatedSession --- PASS: TestAuditRequesterIdentityEmptyForNonFederatedSession (0.00s) === RUN TestAuditRequesterForDeniedRequest --- PASS: TestAuditRequesterForDeniedRequest (0.02s) === RUN TestAuditRequesterArnForJWTIdentity --- PASS: TestAuditRequesterArnForJWTIdentity (0.00s) === RUN TestAuditRequesterForAssumeRole --- PASS: TestAuditRequesterForAssumeRole (0.04s) === RUN TestConfigWithoutIdentitiesDeniesAnonymous === RUN TestConfigWithoutIdentitiesDeniesAnonymous/no_identities_key I1117 09:40:42.190208 config_loader.go:73 Using explicit credential store: memory W1117 09:40:42.196555 auth_credentials.go:435 S3 config file /tmp/TestConfigWithoutIdentitiesDeniesAnonymousno_identities_key1869651149/001/iam.json loaded no identities - every request is denied until one is configured === RUN TestConfigWithoutIdentitiesDeniesAnonymous/empty I1117 09:40:42.250601 config_loader.go:73 Using explicit credential store: memory W1117 09:40:42.253009 auth_credentials.go:435 S3 config file /tmp/TestConfigWithoutIdentitiesDeniesAnonymousempty3686884734/001/iam.json loaded no identities - every request is denied until one is configured === RUN TestConfigWithoutIdentitiesDeniesAnonymous/unrecognised_key I1117 09:40:42.265187 config_loader.go:73 Using explicit credential store: memory W1117 09:40:42.266876 auth_credentials.go:668 S3 config /tmp/TestConfigWithoutIdentitiesDeniesAnonymousunrecognised_key3649007628/001/iam.json: ignoring unknown top-level keys [identity] W1117 09:40:42.270339 auth_credentials.go:435 S3 config file /tmp/TestConfigWithoutIdentitiesDeniesAnonymousunrecognised_key3649007628/001/iam.json loaded no identities - every request is denied until one is configured --- PASS: TestConfigWithoutIdentitiesDeniesAnonymous (0.11s) --- PASS: TestConfigWithoutIdentitiesDeniesAnonymous/no_identities_key (0.07s) --- PASS: TestConfigWithoutIdentitiesDeniesAnonymous/empty (0.01s) --- PASS: TestConfigWithoutIdentitiesDeniesAnonymous/unrecognised_key (0.02s) === RUN TestNoConfigKeepsAnonymousAllowed I1117 09:40:42.288088 config_loader.go:73 Using explicit credential store: memory --- PASS: TestNoConfigKeepsAnonymousAllowed (0.01s) === RUN TestUnknownS3ConfigKeys --- PASS: TestUnknownS3ConfigKeys (0.01s) === RUN TestAuthorizeCopySource_AuthDisabled --- PASS: TestAuthorizeCopySource_AuthDisabled (0.00s) === RUN TestAuthorizeCopySource_NilIdentityDenies --- PASS: TestAuthorizeCopySource_NilIdentityDenies (0.00s) === RUN TestAuthorizeCopySource_AdminAllowed --- PASS: TestAuthorizeCopySource_AdminAllowed (0.00s) === RUN TestAuthorizeCopySource_PrefixScopedIdentity === RUN TestAuthorizeCopySource_PrefixScopedIdentity/source_within_scope_is_allowed === RUN TestAuthorizeCopySource_PrefixScopedIdentity/source_outside_scope_is_denied === RUN TestAuthorizeCopySource_PrefixScopedIdentity/source_in_different_bucket_is_denied --- PASS: TestAuthorizeCopySource_PrefixScopedIdentity (0.01s) --- PASS: TestAuthorizeCopySource_PrefixScopedIdentity/source_within_scope_is_allowed (0.00s) --- PASS: TestAuthorizeCopySource_PrefixScopedIdentity/source_outside_scope_is_denied (0.00s) --- PASS: TestAuthorizeCopySource_PrefixScopedIdentity/source_in_different_bucket_is_denied (0.00s) === RUN TestAuthorizeCopySource_IAMIntegrationGetsSourceResource --- PASS: TestAuthorizeCopySource_IAMIntegrationGetsSourceResource (0.00s) === RUN TestAuthorizeCopySource_IAMIntegrationAllow --- PASS: TestAuthorizeCopySource_IAMIntegrationAllow (0.00s) === RUN TestAuthorizeCopySource_VersionIdPropagated --- PASS: TestAuthorizeCopySource_VersionIdPropagated (0.00s) === RUN TestAuthorizeCopySource_PresignedURLSessionTokenPreserved --- PASS: TestAuthorizeCopySource_PresignedURLSessionTokenPreserved (0.00s) === RUN TestAuthorizeCopySource_PreservesCopySourceHeader --- PASS: TestAuthorizeCopySource_PreservesCopySourceHeader (0.00s) === RUN TestNativeAdminSurvivesAttachedPolicy --- PASS: TestNativeAdminSurvivesAttachedPolicy (0.01s) === RUN TestNativeAdminSurvivesDeletedPolicy --- PASS: TestNativeAdminSurvivesDeletedPolicy (0.01s) === RUN TestNativeAdminSurvivesAttachedPolicyWithoutPrincipalArn --- PASS: TestNativeAdminSurvivesAttachedPolicyWithoutPrincipalArn (0.01s) === RUN TestAttachedPolicyExplicitDenyOverridesNativeAdmin --- PASS: TestAttachedPolicyExplicitDenyOverridesNativeAdmin (0.01s) === RUN TestMultipartListingResolvesBucketAction --- PASS: TestMultipartListingResolvesBucketAction (0.02s) === RUN TestLoadAdvancedIAMConfigPolicyDocument --- PASS: TestLoadAdvancedIAMConfigPolicyDocument (0.01s) === RUN TestNormalizeAdvancedIAMPolicies === RUN TestNormalizeAdvancedIAMPolicies/document_object === RUN TestNormalizeAdvancedIAMPolicies/document_already_encoded_as_a_string === RUN TestNormalizeAdvancedIAMPolicies/content_wins_over_document === RUN TestNormalizeAdvancedIAMPolicies/content_only --- PASS: TestNormalizeAdvancedIAMPolicies (0.03s) --- PASS: TestNormalizeAdvancedIAMPolicies/document_object (0.01s) --- PASS: TestNormalizeAdvancedIAMPolicies/document_already_encoded_as_a_string (0.01s) --- PASS: TestNormalizeAdvancedIAMPolicies/content_wins_over_document (0.00s) --- PASS: TestNormalizeAdvancedIAMPolicies/content_only (0.00s) === RUN TestNormalizeAdvancedIAMPoliciesLeavesOtherConfigsAlone --- PASS: TestNormalizeAdvancedIAMPoliciesLeavesOtherConfigsAlone (0.00s) === RUN TestPutPolicy_SyncsToIAMManager --- PASS: TestPutPolicy_SyncsToIAMManager (0.01s) === RUN TestDeletePolicy_SyncsToIAMManager --- PASS: TestDeletePolicy_SyncsToIAMManager (0.01s) === RUN TestSetIAMIntegration_FlushesLoadedPolicies --- PASS: TestSetIAMIntegration_FlushesLoadedPolicies (0.01s) === RUN TestResyncIAMManager_ReflectsCurrentPolicies --- PASS: TestResyncIAMManager_ReflectsCurrentPolicies (0.01s) === RUN TestResync_SkipsUnparsablePolicy W1117 09:40:42.482376 iam_manager.go:634 skipping unparsable runtime policy "broken": unexpected end of JSON input --- PASS: TestResync_SkipsUnparsablePolicy (0.01s) === RUN TestResync_UnparsablePolicyStopsGranting W1117 09:40:42.495024 iam_manager.go:634 skipping unparsable runtime policy "good": invalid character 'n' looking for beginning of object key string --- PASS: TestResync_UnparsablePolicyStopsGranting (0.01s) === RUN TestIamConfigWithoutIdentitiesIsNotStatic --- PASS: TestIamConfigWithoutIdentitiesIsNotStatic (0.02s) === RUN TestConfigWithIdentitiesStillLiveReloadsDynamic --- PASS: TestConfigWithIdentitiesStillLiveReloadsDynamic (0.04s) === RUN TestUpsertIdentityKeepsOtherDynamicIdentities --- PASS: TestUpsertIdentityKeepsOtherDynamicIdentities (0.01s) === RUN TestReloadStaticConfigMarksNewIdentitiesWithoutFreezingDynamic --- PASS: TestReloadStaticConfigMarksNewIdentitiesWithoutFreezingDynamic (0.01s) === RUN TestReloadStaticConfigUpdatesExistingSecretKey --- PASS: TestReloadStaticConfigUpdatesExistingSecretKey (0.01s) === RUN TestReloadStaticConfigUpdatesServiceAccountSecret --- PASS: TestReloadStaticConfigUpdatesServiceAccountSecret (0.01s) === RUN TestFullStateMergeReconcilesPoliciesAndGroups W1117 09:40:42.612024 auth_credentials.go:730 ignoring 1 groups in static config file: groups are managed via the IAM API W1117 09:40:42.616320 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "file-policy": invalid policy: failed to parse policy JSON: Statement must be an array or a single object W1117 09:40:42.618530 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "file-policy": invalid policy: failed to parse policy JSON: Statement must be an array or a single object W1117 09:40:42.619166 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "dynamic-policy": invalid policy: failed to parse policy JSON: Statement must be an array or a single object W1117 09:40:42.621140 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "file-policy": invalid policy: failed to parse policy JSON: Statement must be an array or a single object W1117 09:40:42.621670 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "dynamic-policy": invalid policy: failed to parse policy JSON: Statement must be an array or a single object W1117 09:40:42.625183 auth_credentials.go:730 ignoring 1 groups in static config file: groups are managed via the IAM API W1117 09:40:42.626444 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "file-policy": invalid policy: failed to parse policy JSON: Statement must be an array or a single object W1117 09:40:42.627415 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "dynamic-policy": invalid policy: failed to parse policy JSON: Statement must be an array or a single object W1117 09:40:42.628958 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "file-policy": invalid policy: failed to parse policy JSON: Statement must be an array or a single object --- PASS: TestFullStateMergeReconcilesPoliciesAndGroups (0.03s) === RUN TestFailedReloadRetriesUntilSuccess E1117 09:40:42.634913 auth_credentials.go:2557 Failed to load configuration from credential manager: transient store failure W1117 09:40:42.642417 auth_credentials.go:515 retrying IAM reload: failed to load configuration from credential manager: transient store failure E1117 09:40:42.653908 auth_credentials.go:2557 Failed to load configuration from credential manager: transient store failure W1117 09:40:42.655141 auth_credentials.go:515 retrying IAM reload: failed to load configuration from credential manager: transient store failure --- PASS: TestFailedReloadRetriesUntilSuccess (0.05s) === RUN TestStaticConfigExpandsEnvCredentialRefs --- PASS: TestStaticConfigExpandsEnvCredentialRefs (0.01s) === RUN TestStaticConfigDropsUnresolvedEnvCredentialRefs W1117 09:40:42.697654 auth_credentials.go:764 identity anvAdmin: dropping credential ${SEAWEEDFS_S3_MISSING_ACCESS_KEY_ID}, it references an unset environment variable --- PASS: TestStaticConfigDropsUnresolvedEnvCredentialRefs (0.01s) === RUN TestEnvCredentialRefsOnlyApplyToStaticConfig --- PASS: TestEnvCredentialRefsOnlyApplyToStaticConfig (0.01s) === RUN TestStaticConfigKeepsLiteralDollarSigns --- PASS: TestStaticConfigKeepsLiteralDollarSigns (0.01s) === RUN TestStaticConfigDropsEmptyEnvCredentialRefs W1117 09:40:42.723143 auth_credentials.go:764 identity anvAdmin: dropping credential ${SEAWEEDFS_S3_ADMIN_ACCESS_KEY_ID}, it references an unset environment variable --- PASS: TestStaticConfigDropsEmptyEnvCredentialRefs (0.01s) === RUN TestStaticConfigDropsMalformedEnvCredentialRefs === RUN TestStaticConfigDropsMalformedEnvCredentialRefs/${MY-VAR} W1117 09:40:42.740118 auth_credentials.go:764 identity anvAdmin: dropping credential ${MY-VAR}, it references an unset environment variable === RUN TestStaticConfigDropsMalformedEnvCredentialRefs/${1VAR} W1117 09:40:42.748515 auth_credentials.go:764 identity anvAdmin: dropping credential ${1VAR}, it references an unset environment variable === RUN TestStaticConfigDropsMalformedEnvCredentialRefs/${} W1117 09:40:42.757027 auth_credentials.go:764 identity anvAdmin: dropping credential ${}, it references an unset environment variable === RUN TestStaticConfigDropsMalformedEnvCredentialRefs/${UNTERMINATED W1117 09:40:42.767205 auth_credentials.go:764 identity anvAdmin: dropping credential ${UNTERMINATED, it references an unset environment variable === RUN TestStaticConfigDropsMalformedEnvCredentialRefs/${A}${B W1117 09:40:42.775729 auth_credentials.go:764 identity anvAdmin: dropping credential ${A}${B, it references an unset environment variable --- PASS: TestStaticConfigDropsMalformedEnvCredentialRefs (0.05s) --- PASS: TestStaticConfigDropsMalformedEnvCredentialRefs/${MY-VAR} (0.01s) --- PASS: TestStaticConfigDropsMalformedEnvCredentialRefs/${1VAR} (0.01s) --- PASS: TestStaticConfigDropsMalformedEnvCredentialRefs/${} (0.01s) --- PASS: TestStaticConfigDropsMalformedEnvCredentialRefs/${UNTERMINATED (0.01s) --- PASS: TestStaticConfigDropsMalformedEnvCredentialRefs/${A}${B (0.01s) === RUN TestStaticConfigKeepsBracesComingFromTheEnvironment --- PASS: TestStaticConfigKeepsBracesComingFromTheEnvironment (0.01s) === RUN TestReloadStaticConfigRevokesRemovedIdentity I1117 09:40:42.791480 auth_credentials.go:611 Added admin identity from AWS environment variables: name=admin-AKIAENV1, accessKey=AKIAENV1 --- PASS: TestReloadStaticConfigRevokesRemovedIdentity (0.02s) === RUN TestReloadStaticConfigWithoutIdentitiesKeepsDynamic --- PASS: TestReloadStaticConfigWithoutIdentitiesKeepsDynamic (0.01s) === RUN TestOnIamConfigChangeLegacyIdentityDeletionReloadsConfiguration --- PASS: TestOnIamConfigChangeLegacyIdentityDeletionReloadsConfiguration (0.00s) === RUN TestOnIamConfigChangeReloadsOnIamIdentityDirectoryChanges E1117 09:40:42.826860 auth_credentials.go:2557 Failed to load configuration from credential manager: store not initialized W1117 09:40:42.827204 auth_credentials.go:515 retrying IAM reload: failed to load configuration from credential manager: store not initialized --- PASS: TestOnIamConfigChangeReloadsOnIamIdentityDirectoryChanges (0.02s) === RUN TestOnIamConfigChangeCoalescesBurstReloads --- PASS: TestOnIamConfigChangeCoalescesBurstReloads (0.06s) === RUN TestUpsertIdentityKeepsInlinePolicyAuthorization --- PASS: TestUpsertIdentityKeepsInlinePolicyAuthorization (0.02s) === RUN TestUpsertIdentityRefreshesInlinePolicyDocument --- PASS: TestUpsertIdentityRefreshesInlinePolicyDocument (0.02s) === RUN TestPutGroupKeepsInlinePolicyAuthorization --- PASS: TestPutGroupKeepsInlinePolicyAuthorization (0.01s) === RUN TestUpsertIdentityRaceKeepsNewerInlinePolicy --- PASS: TestUpsertIdentityRaceKeepsNewerInlinePolicy (0.52s) === RUN TestPutGroupRaceKeepsNewerInlinePolicy --- PASS: TestPutGroupRaceKeepsNewerInlinePolicy (0.52s) === RUN TestUpsertIdentityKeepsServiceAccountKeys --- PASS: TestUpsertIdentityKeepsServiceAccountKeys (0.03s) === RUN TestAuthDeniedInvalidBucketName --- PASS: TestAuthDeniedInvalidBucketName (0.05s) === RUN TestRefineDenialForBucketName --- PASS: TestRefineDenialForBucketName (0.01s) === RUN TestPostPolicyDeniedInvalidBucketName --- PASS: TestPostPolicyDeniedInvalidBucketName (0.07s) === RUN TestAnonymousReadDeniedInvalidBucketName --- PASS: TestAnonymousReadDeniedInvalidBucketName (1.07s) === RUN TestAnonymousReadDeniedInvalidBucketNameExistingKey --- PASS: TestAnonymousReadDeniedInvalidBucketNameExistingKey (0.40s) === RUN TestJWTStreamingUnsignedAuth I1117 09:40:45.661865 config_loader.go:73 Using explicit credential store: memory --- PASS: TestJWTStreamingUnsignedAuth (0.01s) === RUN TestJWTStreamingUnsignedChunkedReader --- PASS: TestJWTStreamingUnsignedChunkedReader (0.02s) === RUN TestPresignedPutSignedContentTypeWithRawSemicolon --- PASS: TestPresignedPutSignedContentTypeWithRawSemicolon (0.03s) === RUN TestReverseProxySignatureVerification === RUN TestReverseProxySignatureVerification/non-standard_port,_externalUrl_matches_proxy_address I1117 09:40:45.744355 auth_credentials.go:335 S3 signature verification will try external host "127.0.0.1:36845" (from "http://127.0.0.1:36845") first I1117 09:40:45.744683 config_loader.go:73 Using explicit credential store: memory === RUN TestReverseProxySignatureVerification/externalUrl_with_non-standard_port,_client_signs_against_external_host I1117 09:40:45.895746 auth_credentials.go:335 S3 signature verification will try external host "api.example.com:9000" (from "http://api.example.com:9000") first I1117 09:40:45.896146 config_loader.go:73 Using explicit credential store: memory === RUN TestReverseProxySignatureVerification/externalUrl_with_HTTPS_default_port_stripped,_client_signs_without_port I1117 09:40:45.950039 auth_credentials.go:335 S3 signature verification will try external host "api.example.com" (from "https://api.example.com:443") first I1117 09:40:45.950404 config_loader.go:73 Using explicit credential store: memory === RUN TestReverseProxySignatureVerification/externalUrl_with_HTTP_default_port_stripped,_client_signs_without_port I1117 09:40:46.002136 auth_credentials.go:335 S3 signature verification will try external host "api.example.com" (from "http://api.example.com:80") first I1117 09:40:46.002580 config_loader.go:73 Using explicit credential store: memory === RUN TestReverseProxySignatureVerification/proxy_forwards_X-Forwarded-Host_correctly,_no_externalUrl_needed I1117 09:40:46.039659 config_loader.go:73 Using explicit credential store: memory === RUN TestReverseProxySignatureVerification/proxy_without_X-Forwarded-Host,_no_externalUrl:_host_mismatch I1117 09:40:46.068383 config_loader.go:73 Using explicit credential store: memory === RUN TestReverseProxySignatureVerification/nginx_$host/$server_port_forwarding,_backend_on_same_hostname I1117 09:40:46.105563 config_loader.go:73 Using explicit credential store: memory === RUN TestReverseProxySignatureVerification/portless_X-Forwarded-Host_on_default_port,_backend_on_same_hostname I1117 09:40:46.148215 config_loader.go:73 Using explicit credential store: memory === RUN TestReverseProxySignatureVerification/proxy_without_X-Forwarded-Host,_externalUrl_saves_the_day I1117 09:40:46.177336 auth_credentials.go:335 S3 signature verification will try external host "api.example.com:9000" (from "http://api.example.com:9000") first I1117 09:40:46.177658 config_loader.go:73 Using explicit credential store: memory --- PASS: TestReverseProxySignatureVerification (0.47s) --- PASS: TestReverseProxySignatureVerification/non-standard_port,_externalUrl_matches_proxy_address (0.16s) --- PASS: TestReverseProxySignatureVerification/externalUrl_with_non-standard_port,_client_signs_against_external_host (0.05s) --- PASS: TestReverseProxySignatureVerification/externalUrl_with_HTTPS_default_port_stripped,_client_signs_without_port (0.06s) --- PASS: TestReverseProxySignatureVerification/externalUrl_with_HTTP_default_port_stripped,_client_signs_without_port (0.03s) --- PASS: TestReverseProxySignatureVerification/proxy_forwards_X-Forwarded-Host_correctly,_no_externalUrl_needed (0.03s) --- PASS: TestReverseProxySignatureVerification/proxy_without_X-Forwarded-Host,_no_externalUrl:_host_mismatch (0.04s) --- PASS: TestReverseProxySignatureVerification/nginx_$host/$server_port_forwarding,_backend_on_same_hostname (0.04s) --- PASS: TestReverseProxySignatureVerification/portless_X-Forwarded-Host_on_default_port,_backend_on_same_hostname (0.03s) --- PASS: TestReverseProxySignatureVerification/proxy_without_X-Forwarded-Host,_externalUrl_saves_the_day (0.03s) === RUN TestActionScopedToBucket --- PASS: TestActionScopedToBucket (0.00s) === RUN TestReproIssue7912 I1117 09:40:46.206776 config_loader.go:73 Using explicit credential store: memory === RUN TestReproIssue7912/Unknown_access_key W1117 09:40:46.218035 auth_signature_v4.go:296 InvalidAccessKeyId: attempted key 'unknown_key' not found. Available keys: 2, Auth enabled: true === RUN TestReproIssue7912/Positive_test_case:_properly_signed_credentials === RUN TestReproIssue7912/Nil_identity_tests_for_guards === RUN TestReproIssue7912/AuthSignatureOnly_path === RUN TestReproIssue7912/Wrong_secret_key === RUN TestReproIssue7912/Anonymous_request_to_protected_bucket === RUN TestReproIssue7912/Non-S3_request_should_be_denied === RUN TestReproIssue7912/Any_other_credentials W1117 09:40:46.257339 auth_signature_v4.go:296 InvalidAccessKeyId: attempted key 'some_other_key' not found. Available keys: 2, Auth enabled: true === RUN TestReproIssue7912/Streaming_unsigned_payload_bypass_attempt --- PASS: TestReproIssue7912 (0.06s) --- PASS: TestReproIssue7912/Unknown_access_key (0.00s) --- PASS: TestReproIssue7912/Positive_test_case:_properly_signed_credentials (0.00s) --- PASS: TestReproIssue7912/Nil_identity_tests_for_guards (0.00s) --- PASS: TestReproIssue7912/AuthSignatureOnly_path (0.01s) --- PASS: TestReproIssue7912/Wrong_secret_key (0.00s) --- PASS: TestReproIssue7912/Anonymous_request_to_protected_bucket (0.00s) --- PASS: TestReproIssue7912/Non-S3_request_should_be_denied (0.00s) --- PASS: TestReproIssue7912/Any_other_credentials (0.00s) --- PASS: TestReproIssue7912/Streaming_unsigned_payload_bypass_attempt (0.00s) === RUN TestAnonymousStreamingUnsignedUpload I1117 09:40:46.264289 config_loader.go:73 Using explicit credential store: memory --- PASS: TestAnonymousStreamingUnsignedUpload (0.01s) === RUN TestExternalUrlSignatureVerification === RUN TestExternalUrlSignatureVerification/non-standard_port_with_externalUrl I1117 09:40:46.276496 auth_credentials.go:335 S3 signature verification will try external host "api.example.com:9000" (from "https://api.example.com:9000") first I1117 09:40:46.276909 config_loader.go:73 Using explicit credential store: memory === RUN TestExternalUrlSignatureVerification/HTTPS_default_port_443_with_externalUrl_(port_stripped_by_SDK_and_parseExternalUrlToHost) I1117 09:40:46.287886 auth_credentials.go:335 S3 signature verification will try external host "api.example.com" (from "https://api.example.com:443") first I1117 09:40:46.288222 config_loader.go:73 Using explicit credential store: memory === RUN TestExternalUrlSignatureVerification/HTTPS_without_explicit_port_with_externalUrl I1117 09:40:46.309556 auth_credentials.go:335 S3 signature verification will try external host "api.example.com" (from "https://api.example.com") first I1117 09:40:46.310007 config_loader.go:73 Using explicit credential store: memory === RUN TestExternalUrlSignatureVerification/HTTP_default_port_80_with_externalUrl I1117 09:40:46.323428 auth_credentials.go:335 S3 signature verification will try external host "api.example.com" (from "http://api.example.com:80") first I1117 09:40:46.323787 config_loader.go:73 Using explicit credential store: memory === RUN TestExternalUrlSignatureVerification/externalUrl_set,_in-cluster_client_signs_the_service_host I1117 09:40:46.335846 auth_credentials.go:335 S3 signature verification will try external host "api.example.com" (from "https://api.example.com") first I1117 09:40:46.336235 config_loader.go:73 Using explicit credential store: memory === RUN TestExternalUrlSignatureVerification/externalUrl_set,_external_client_signs_a_virtual-hosted_bucket_name I1117 09:40:46.348015 auth_credentials.go:335 S3 signature verification will try external host "api.example.com" (from "https://api.example.com") first I1117 09:40:46.348548 config_loader.go:73 Using explicit credential store: memory === RUN TestExternalUrlSignatureVerification/without_externalUrl,_internal_host_causes_mismatch I1117 09:40:46.358082 config_loader.go:73 Using explicit credential store: memory === RUN TestExternalUrlSignatureVerification/without_externalUrl,_matching_host_works I1117 09:40:46.367084 config_loader.go:73 Using explicit credential store: memory --- PASS: TestExternalUrlSignatureVerification (0.10s) --- PASS: TestExternalUrlSignatureVerification/non-standard_port_with_externalUrl (0.01s) --- PASS: TestExternalUrlSignatureVerification/HTTPS_default_port_443_with_externalUrl_(port_stripped_by_SDK_and_parseExternalUrlToHost) (0.02s) --- PASS: TestExternalUrlSignatureVerification/HTTPS_without_explicit_port_with_externalUrl (0.01s) --- PASS: TestExternalUrlSignatureVerification/HTTP_default_port_80_with_externalUrl (0.01s) --- PASS: TestExternalUrlSignatureVerification/externalUrl_set,_in-cluster_client_signs_the_service_host (0.01s) --- PASS: TestExternalUrlSignatureVerification/externalUrl_set,_external_client_signs_a_virtual-hosted_bucket_name (0.01s) --- PASS: TestExternalUrlSignatureVerification/without_externalUrl,_internal_host_causes_mismatch (0.01s) --- PASS: TestExternalUrlSignatureVerification/without_externalUrl,_matching_host_works (0.01s) === RUN TestRealSDKSignerWithForwardedHeaders === RUN TestRealSDKSignerWithForwardedHeaders/HTTPS_non-standard_port I1117 09:40:46.377930 config_loader.go:73 Using explicit credential store: memory === RUN TestRealSDKSignerWithForwardedHeaders/HTTPS_standard_port_443_(SDK_strips,_we_must_too) I1117 09:40:46.388078 config_loader.go:73 Using explicit credential store: memory === RUN TestRealSDKSignerWithForwardedHeaders/HTTP_standard_port_80_(SDK_strips,_we_must_too) I1117 09:40:46.396823 config_loader.go:73 Using explicit credential store: memory === RUN TestRealSDKSignerWithForwardedHeaders/HTTP_non-standard_port_8080 I1117 09:40:46.407636 config_loader.go:73 Using explicit credential store: memory === RUN TestRealSDKSignerWithForwardedHeaders/X-Forwarded-Host_with_port_(Traefik_style),_HTTPS_443 I1117 09:40:46.418325 config_loader.go:73 Using explicit credential store: memory === RUN TestRealSDKSignerWithForwardedHeaders/X-Forwarded-Host_with_port_(Traefik_style),_HTTP_80 I1117 09:40:46.429063 config_loader.go:73 Using explicit credential store: memory === RUN TestRealSDKSignerWithForwardedHeaders/no_forwarded_headers,_direct_access I1117 09:40:46.439198 config_loader.go:73 Using explicit credential store: memory === RUN TestRealSDKSignerWithForwardedHeaders/empty_proto_with_port_80_(defaults_to_http,_strip) I1117 09:40:46.449021 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRealSDKSignerWithForwardedHeaders (0.08s) --- PASS: TestRealSDKSignerWithForwardedHeaders/HTTPS_non-standard_port (0.01s) --- PASS: TestRealSDKSignerWithForwardedHeaders/HTTPS_standard_port_443_(SDK_strips,_we_must_too) (0.01s) --- PASS: TestRealSDKSignerWithForwardedHeaders/HTTP_standard_port_80_(SDK_strips,_we_must_too) (0.01s) --- PASS: TestRealSDKSignerWithForwardedHeaders/HTTP_non-standard_port_8080 (0.01s) --- PASS: TestRealSDKSignerWithForwardedHeaders/X-Forwarded-Host_with_port_(Traefik_style),_HTTPS_443 (0.01s) --- PASS: TestRealSDKSignerWithForwardedHeaders/X-Forwarded-Host_with_port_(Traefik_style),_HTTP_80 (0.01s) --- PASS: TestRealSDKSignerWithForwardedHeaders/no_forwarded_headers,_direct_access (0.01s) --- PASS: TestRealSDKSignerWithForwardedHeaders/empty_proto_with_port_80_(defaults_to_http,_strip) (0.01s) === RUN TestPrefixParameterDoesNotEscalateBucketActions I1117 09:40:46.461598 config_loader.go:73 Using explicit credential store: memory === RUN TestPrefixParameterDoesNotEscalateBucketActions/writer_put_object === RUN TestPrefixParameterDoesNotEscalateBucketActions/writer_put_versioning === RUN TestPrefixParameterDoesNotEscalateBucketActions/writer_put_versioning_with_prefix === RUN TestPrefixParameterDoesNotEscalateBucketActions/writer_put_lifecycle_with_prefix === RUN TestPrefixParameterDoesNotEscalateBucketActions/writer_list_with_prefix === RUN TestPrefixParameterDoesNotEscalateBucketActions/policywriter_put_object === RUN TestPrefixParameterDoesNotEscalateBucketActions/policywriter_put_versioning_with_prefix === RUN TestPrefixParameterDoesNotEscalateBucketActions/uploadreader_lists_uploads_under_prefix === RUN TestPrefixParameterDoesNotEscalateBucketActions/uploadreader_cannot_list_outside_prefix === RUN TestPrefixParameterDoesNotEscalateBucketActions/uploadlister_lists_uploads === RUN TestPrefixParameterDoesNotEscalateBucketActions/getonly_cannot_list_uploads --- PASS: TestPrefixParameterDoesNotEscalateBucketActions (0.17s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/writer_put_object (0.01s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/writer_put_versioning (0.01s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/writer_put_versioning_with_prefix (0.00s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/writer_put_lifecycle_with_prefix (0.01s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/writer_list_with_prefix (0.00s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/policywriter_put_object (0.01s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/policywriter_put_versioning_with_prefix (0.01s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/uploadreader_lists_uploads_under_prefix (0.01s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/uploadreader_cannot_list_outside_prefix (0.01s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/uploadlister_lists_uploads (0.01s) --- PASS: TestPrefixParameterDoesNotEscalateBucketActions/getonly_cannot_list_uploads (0.01s) === RUN TestResolveS3AuthTarget_BucketListings === RUN TestResolveS3AuthTarget_BucketListings/uploads_listing_keeps_its_action === RUN TestResolveS3AuthTarget_BucketListings/versions_listing_keeps_its_action === RUN TestResolveS3AuthTarget_BucketListings/plain_list_keeps_its_action --- PASS: TestResolveS3AuthTarget_BucketListings (0.01s) --- PASS: TestResolveS3AuthTarget_BucketListings/uploads_listing_keeps_its_action (0.00s) --- PASS: TestResolveS3AuthTarget_BucketListings/versions_listing_keeps_its_action (0.00s) --- PASS: TestResolveS3AuthTarget_BucketListings/plain_list_keeps_its_action (0.00s) === RUN TestValidateV2AuthHeader === RUN TestValidateV2AuthHeader/valid_auth_header_with_space === RUN TestValidateV2AuthHeader/empty_auth_header === RUN TestValidateV2AuthHeader/wrong_algorithm_prefix === RUN TestValidateV2AuthHeader/algorithm_prefix_without_space === RUN TestValidateV2AuthHeader/missing_colon_separator === RUN TestValidateV2AuthHeader/empty_access_key === RUN TestValidateV2AuthHeader/empty_signature --- PASS: TestValidateV2AuthHeader (0.01s) --- PASS: TestValidateV2AuthHeader/valid_auth_header_with_space (0.00s) --- PASS: TestValidateV2AuthHeader/empty_auth_header (0.00s) --- PASS: TestValidateV2AuthHeader/wrong_algorithm_prefix (0.00s) --- PASS: TestValidateV2AuthHeader/algorithm_prefix_without_space (0.00s) --- PASS: TestValidateV2AuthHeader/missing_colon_separator (0.00s) --- PASS: TestValidateV2AuthHeader/empty_access_key (0.00s) --- PASS: TestValidateV2AuthHeader/empty_signature (0.00s) === RUN TestSignatureV2Format --- PASS: TestSignatureV2Format (0.01s) === RUN TestDoesSignV2Match === RUN TestDoesSignV2Match/valid_GET_request === RUN TestDoesSignV2Match/valid_PUT_request_with_content_headers === RUN TestDoesSignV2Match/request_with_query_parameters === RUN TestDoesSignV2Match/request_with_x-amz_headers === RUN TestDoesSignV2Match/invalid_signature === RUN TestDoesSignV2Match/non-existent_access_key W1117 09:40:46.673233 auth_signature_v2.go:161 InvalidAccessKeyId (V2 signed): attempted key 'NONEXISTENTKEY' not found. Available keys: 1, Auth enabled: false === RUN TestDoesSignV2Match/empty_authorization_header === RUN TestDoesSignV2Match/malformed_auth_-_missing_signature === RUN TestDoesSignV2Match/malformed_auth_-_wrong_prefix === RUN TestDoesSignV2Match/malformed_auth_-_no_space_after_AWS --- PASS: TestDoesSignV2Match (0.03s) --- PASS: TestDoesSignV2Match/valid_GET_request (0.01s) --- PASS: TestDoesSignV2Match/valid_PUT_request_with_content_headers (0.00s) --- PASS: TestDoesSignV2Match/request_with_query_parameters (0.00s) --- PASS: TestDoesSignV2Match/request_with_x-amz_headers (0.00s) --- PASS: TestDoesSignV2Match/invalid_signature (0.00s) --- PASS: TestDoesSignV2Match/non-existent_access_key (0.00s) --- PASS: TestDoesSignV2Match/empty_authorization_header (0.00s) --- PASS: TestDoesSignV2Match/malformed_auth_-_missing_signature (0.00s) --- PASS: TestDoesSignV2Match/malformed_auth_-_wrong_prefix (0.00s) --- PASS: TestDoesSignV2Match/malformed_auth_-_no_space_after_AWS (0.00s) === RUN TestDoesSignV2MatchUnicodePath === RUN TestDoesSignV2MatchUnicodePath/CJK_conversation_key_from_ai-dial-core === RUN TestDoesSignV2MatchUnicodePath/Japanese_filename_from_issue_8598 --- PASS: TestDoesSignV2MatchUnicodePath (0.01s) --- PASS: TestDoesSignV2MatchUnicodePath/CJK_conversation_key_from_ai-dial-core (0.00s) --- PASS: TestDoesSignV2MatchUnicodePath/Japanese_filename_from_issue_8598 (0.00s) === RUN TestDoesPresignV2MatchUnicodePath --- PASS: TestDoesPresignV2MatchUnicodePath (0.00s) === RUN TestSignatureV2CoversOperationSubresources --- PASS: TestSignatureV2CoversOperationSubresources (0.00s) === RUN TestSignatureV2RejectsAppendedSubresource === RUN TestSignatureV2RejectsAppendedSubresource/presigned_website === RUN TestSignatureV2RejectsAppendedSubresource/header_website === RUN TestSignatureV2RejectsAppendedSubresource/presigned_encryption === RUN TestSignatureV2RejectsAppendedSubresource/header_encryption === RUN TestSignatureV2RejectsAppendedSubresource/presigned_intelligent-tiering === RUN TestSignatureV2RejectsAppendedSubresource/header_intelligent-tiering === RUN TestSignatureV2RejectsAppendedSubresource/presigned_inventory === RUN TestSignatureV2RejectsAppendedSubresource/header_inventory === RUN TestSignatureV2RejectsAppendedSubresource/presigned_lifecycle === RUN TestSignatureV2RejectsAppendedSubresource/header_lifecycle === RUN TestSignatureV2RejectsAppendedSubresource/presigned_policy === RUN TestSignatureV2RejectsAppendedSubresource/header_policy === RUN TestSignatureV2RejectsAppendedSubresource/presigned_policyStatus === RUN TestSignatureV2RejectsAppendedSubresource/header_policyStatus === RUN TestSignatureV2RejectsAppendedSubresource/presigned_publicAccessBlock === RUN TestSignatureV2RejectsAppendedSubresource/header_publicAccessBlock === RUN TestSignatureV2RejectsAppendedSubresource/presigned_logging === RUN TestSignatureV2RejectsAppendedSubresource/header_logging === RUN TestSignatureV2RejectsAppendedSubresource/presigned_retention === RUN TestSignatureV2RejectsAppendedSubresource/header_retention === RUN TestSignatureV2RejectsAppendedSubresource/presigned_uploads === RUN TestSignatureV2RejectsAppendedSubresource/header_uploads === RUN TestSignatureV2RejectsAppendedSubresource/presigned_legal-hold === RUN TestSignatureV2RejectsAppendedSubresource/header_legal-hold === RUN TestSignatureV2RejectsAppendedSubresource/presigned_object-lock === RUN TestSignatureV2RejectsAppendedSubresource/header_object-lock === RUN TestSignatureV2RejectsAppendedSubresource/presigned_replication === RUN TestSignatureV2RejectsAppendedSubresource/header_replication === RUN TestSignatureV2RejectsAppendedSubresource/presigned_versions === RUN TestSignatureV2RejectsAppendedSubresource/header_versions === RUN TestSignatureV2RejectsAppendedSubresource/presigned_accelerate === RUN TestSignatureV2RejectsAppendedSubresource/header_accelerate === RUN TestSignatureV2RejectsAppendedSubresource/presigned_uploadId === RUN TestSignatureV2RejectsAppendedSubresource/header_uploadId === RUN TestSignatureV2RejectsAppendedSubresource/presigned_attributes === RUN TestSignatureV2RejectsAppendedSubresource/header_attributes === RUN TestSignatureV2RejectsAppendedSubresource/presigned_requestPayment === RUN TestSignatureV2RejectsAppendedSubresource/header_requestPayment === RUN TestSignatureV2RejectsAppendedSubresource/presigned_location === RUN TestSignatureV2RejectsAppendedSubresource/header_location === RUN TestSignatureV2RejectsAppendedSubresource/presigned_seaweedfs-quota === RUN TestSignatureV2RejectsAppendedSubresource/header_seaweedfs-quota === RUN TestSignatureV2RejectsAppendedSubresource/presigned_analytics === RUN TestSignatureV2RejectsAppendedSubresource/header_analytics === RUN TestSignatureV2RejectsAppendedSubresource/presigned_metrics === RUN TestSignatureV2RejectsAppendedSubresource/header_metrics === RUN TestSignatureV2RejectsAppendedSubresource/presigned_renameObject === RUN TestSignatureV2RejectsAppendedSubresource/header_renameObject === RUN TestSignatureV2RejectsAppendedSubresource/presigned_acl === RUN TestSignatureV2RejectsAppendedSubresource/header_acl === RUN TestSignatureV2RejectsAppendedSubresource/presigned_cors === RUN TestSignatureV2RejectsAppendedSubresource/header_cors === RUN TestSignatureV2RejectsAppendedSubresource/presigned_delete === RUN TestSignatureV2RejectsAppendedSubresource/header_delete === RUN TestSignatureV2RejectsAppendedSubresource/presigned_notification === RUN TestSignatureV2RejectsAppendedSubresource/header_notification === RUN TestSignatureV2RejectsAppendedSubresource/presigned_ownershipControls === RUN TestSignatureV2RejectsAppendedSubresource/header_ownershipControls === RUN TestSignatureV2RejectsAppendedSubresource/presigned_tagging === RUN TestSignatureV2RejectsAppendedSubresource/header_tagging === RUN TestSignatureV2RejectsAppendedSubresource/presigned_versioning === RUN TestSignatureV2RejectsAppendedSubresource/header_versioning --- PASS: TestSignatureV2RejectsAppendedSubresource (0.13s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_website (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_website (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_encryption (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_encryption (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_intelligent-tiering (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_intelligent-tiering (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_inventory (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_inventory (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_lifecycle (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_lifecycle (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_policy (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_policy (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_policyStatus (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_policyStatus (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_publicAccessBlock (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_publicAccessBlock (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_logging (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_logging (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_retention (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_retention (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_uploads (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_uploads (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_legal-hold (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_legal-hold (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_object-lock (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_object-lock (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_replication (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_replication (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_versions (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_versions (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_accelerate (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_accelerate (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_uploadId (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_uploadId (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_attributes (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_attributes (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_requestPayment (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_requestPayment (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_location (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_location (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_seaweedfs-quota (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_seaweedfs-quota (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_analytics (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_analytics (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_metrics (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_metrics (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_renameObject (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_renameObject (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_acl (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_acl (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_cors (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_cors (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_delete (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_delete (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_notification (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_notification (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_ownershipControls (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_ownershipControls (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_tagging (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_tagging (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/presigned_versioning (0.00s) --- PASS: TestSignatureV2RejectsAppendedSubresource/header_versioning (0.00s) === RUN TestPresignV2AcceptsClientSignedSubresource === RUN TestPresignV2AcceptsClientSignedSubresource/PUT_tagging === RUN TestPresignV2AcceptsClientSignedSubresource/GET_tagging&versionId=v1 === RUN TestPresignV2AcceptsClientSignedSubresource/GET_cors === RUN TestPresignV2AcceptsClientSignedSubresource/PUT_retention --- PASS: TestPresignV2AcceptsClientSignedSubresource (0.01s) --- PASS: TestPresignV2AcceptsClientSignedSubresource/PUT_tagging (0.01s) --- PASS: TestPresignV2AcceptsClientSignedSubresource/GET_tagging&versionId=v1 (0.00s) --- PASS: TestPresignV2AcceptsClientSignedSubresource/GET_cors (0.00s) --- PASS: TestPresignV2AcceptsClientSignedSubresource/PUT_retention (0.00s) === RUN TestSignatureV2RejectsRepeatedSubresource === RUN TestSignatureV2RejectsRepeatedSubresource/presigned_appended === RUN TestSignatureV2RejectsRepeatedSubresource/header_appended === RUN TestSignatureV2RejectsRepeatedSubresource/presigned_prepended === RUN TestSignatureV2RejectsRepeatedSubresource/header_prepended --- PASS: TestSignatureV2RejectsRepeatedSubresource (0.02s) --- PASS: TestSignatureV2RejectsRepeatedSubresource/presigned_appended (0.00s) --- PASS: TestSignatureV2RejectsRepeatedSubresource/header_appended (0.00s) --- PASS: TestSignatureV2RejectsRepeatedSubresource/presigned_prepended (0.00s) --- PASS: TestSignatureV2RejectsRepeatedSubresource/header_prepended (0.00s) === RUN TestValidateSTSSessionTokenAssignsDistinctAccount === RUN TestValidateSTSSessionTokenAssignsDistinctAccount/prefers_the_subject === RUN TestValidateSTSSessionTokenAssignsDistinctAccount/falls_back_to_the_assumed-role_user --- PASS: TestValidateSTSSessionTokenAssignsDistinctAccount (0.01s) --- PASS: TestValidateSTSSessionTokenAssignsDistinctAccount/prefers_the_subject (0.00s) --- PASS: TestValidateSTSSessionTokenAssignsDistinctAccount/falls_back_to_the_assumed-role_user (0.00s) === RUN TestVerifyV4SignatureWithSTSIdentity === RUN TestVerifyV4SignatureWithSTSIdentity/STS_identity_with_IAM_integration_-_should_authorize_via_IAM === RUN TestVerifyV4SignatureWithSTSIdentity/STS_identity_with_IAM_integration_-_IAM_denies === RUN TestVerifyV4SignatureWithSTSIdentity/STS_identity_without_IAM_integration_-_should_deny === RUN TestVerifyV4SignatureWithSTSIdentity/Traditional_identity_with_Actions_-_should_use_CanDo === RUN TestVerifyV4SignatureWithSTSIdentity/Traditional_identity_with_Actions_-_CanDo_denies === RUN TestVerifyV4SignatureWithSTSIdentity/shouldCheckPermissions_false_-_skip_authorization --- PASS: TestVerifyV4SignatureWithSTSIdentity (0.01s) --- PASS: TestVerifyV4SignatureWithSTSIdentity/STS_identity_with_IAM_integration_-_should_authorize_via_IAM (0.00s) --- PASS: TestVerifyV4SignatureWithSTSIdentity/STS_identity_with_IAM_integration_-_IAM_denies (0.00s) --- PASS: TestVerifyV4SignatureWithSTSIdentity/STS_identity_without_IAM_integration_-_should_deny (0.00s) --- PASS: TestVerifyV4SignatureWithSTSIdentity/Traditional_identity_with_Actions_-_should_use_CanDo (0.00s) --- PASS: TestVerifyV4SignatureWithSTSIdentity/Traditional_identity_with_Actions_-_CanDo_denies (0.00s) --- PASS: TestVerifyV4SignatureWithSTSIdentity/shouldCheckPermissions_false_-_skip_authorization (0.00s) === RUN TestVerifyV4SignatureSTSStreamingUpload --- PASS: TestVerifyV4SignatureSTSStreamingUpload (0.00s) === RUN TestVerifyV4SignatureActionDetermination === RUN TestVerifyV4SignatureActionDetermination/GET === RUN TestVerifyV4SignatureActionDetermination/HEAD === RUN TestVerifyV4SignatureActionDetermination/PUT === RUN TestVerifyV4SignatureActionDetermination/POST === RUN TestVerifyV4SignatureActionDetermination/DELETE --- PASS: TestVerifyV4SignatureActionDetermination (0.01s) --- PASS: TestVerifyV4SignatureActionDetermination/GET (0.00s) --- PASS: TestVerifyV4SignatureActionDetermination/HEAD (0.00s) --- PASS: TestVerifyV4SignatureActionDetermination/PUT (0.00s) --- PASS: TestVerifyV4SignatureActionDetermination/POST (0.00s) --- PASS: TestVerifyV4SignatureActionDetermination/DELETE (0.00s) === RUN TestExtractV4AuthInfoFromHeader_S3Tables === RUN TestExtractV4AuthInfoFromHeader_S3Tables/s3_service_should_not_auto-hash === RUN TestExtractV4AuthInfoFromHeader_S3Tables/s3tables_service_should_auto-hash --- PASS: TestExtractV4AuthInfoFromHeader_S3Tables (0.01s) --- PASS: TestExtractV4AuthInfoFromHeader_S3Tables/s3_service_should_not_auto-hash (0.00s) --- PASS: TestExtractV4AuthInfoFromHeader_S3Tables/s3tables_service_should_auto-hash (0.00s) === RUN TestParseSignedHeaderRejectsEmptyHeaderNames --- PASS: TestParseSignedHeaderRejectsEmptyHeaderNames (0.00s) === RUN TestExtractV4AuthInfoFromQueryRejectsEmptySignedHeaderNames === RUN TestExtractV4AuthInfoFromQueryRejectsEmptySignedHeaderNames/host; === RUN TestExtractV4AuthInfoFromQueryRejectsEmptySignedHeaderNames/;host === RUN TestExtractV4AuthInfoFromQueryRejectsEmptySignedHeaderNames/host;;x-amz-date --- PASS: TestExtractV4AuthInfoFromQueryRejectsEmptySignedHeaderNames (0.01s) --- PASS: TestExtractV4AuthInfoFromQueryRejectsEmptySignedHeaderNames/host; (0.00s) --- PASS: TestExtractV4AuthInfoFromQueryRejectsEmptySignedHeaderNames/;host (0.00s) --- PASS: TestExtractV4AuthInfoFromQueryRejectsEmptySignedHeaderNames/host;;x-amz-date (0.00s) === RUN TestGetCanonicalQueryString === RUN TestGetCanonicalQueryString/sorts_repeated_values === RUN TestGetCanonicalQueryString/removes_presigned_signature === RUN TestGetCanonicalQueryString/sorts_mixed_single_and_repeated_parameters === RUN TestGetCanonicalQueryString/encodes_query_parameter_values === RUN TestGetCanonicalQueryString/empty_query_string --- PASS: TestGetCanonicalQueryString (0.01s) --- PASS: TestGetCanonicalQueryString/sorts_repeated_values (0.00s) --- PASS: TestGetCanonicalQueryString/removes_presigned_signature (0.00s) --- PASS: TestGetCanonicalQueryString/sorts_mixed_single_and_repeated_parameters (0.00s) --- PASS: TestGetCanonicalQueryString/encodes_query_parameter_values (0.00s) --- PASS: TestGetCanonicalQueryString/empty_query_string (0.00s) === RUN TestBuildPathWithForwardedPrefix === RUN TestBuildPathWithForwardedPrefix/empty_prefix_returns_urlPath === RUN TestBuildPathWithForwardedPrefix/prefix_without_trailing_slash === RUN TestBuildPathWithForwardedPrefix/prefix_with_trailing_slash === RUN TestBuildPathWithForwardedPrefix/prefix_without_leading_slash === RUN TestBuildPathWithForwardedPrefix/prefix_without_leading_slash_and_with_trailing_slash === RUN TestBuildPathWithForwardedPrefix/preserve_double_slashes_in_key === RUN TestBuildPathWithForwardedPrefix/preserve_trailing_slash_in_urlPath === RUN TestBuildPathWithForwardedPrefix/preserve_trailing_slash_with_prefix_having_trailing_slash === RUN TestBuildPathWithForwardedPrefix/root_path === RUN TestBuildPathWithForwardedPrefix/complex_key_with_multiple_slashes === RUN TestBuildPathWithForwardedPrefix/urlPath_without_leading_slash === RUN TestBuildPathWithForwardedPrefix/empty_urlPath_with_prefix --- PASS: TestBuildPathWithForwardedPrefix (0.01s) --- PASS: TestBuildPathWithForwardedPrefix/empty_prefix_returns_urlPath (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/prefix_without_trailing_slash (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/prefix_with_trailing_slash (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/prefix_without_leading_slash (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/prefix_without_leading_slash_and_with_trailing_slash (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/preserve_double_slashes_in_key (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/preserve_trailing_slash_in_urlPath (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/preserve_trailing_slash_with_prefix_having_trailing_slash (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/root_path (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/complex_key_with_multiple_slashes (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/urlPath_without_leading_slash (0.00s) --- PASS: TestBuildPathWithForwardedPrefix/empty_urlPath_with_prefix (0.00s) === RUN TestExtractHostHeader === RUN TestExtractHostHeader/basic_host_without_forwarding === RUN TestExtractHostHeader/host_with_port_without_forwarding === RUN TestExtractHostHeader/X-Forwarded-Host_without_port === RUN TestExtractHostHeader/X-Forwarded-Host_with_X-Forwarded-Port_(HTTP_non-standard) === RUN TestExtractHostHeader/X-Forwarded-Host_with_X-Forwarded-Port_(HTTPS_non-standard) === RUN TestExtractHostHeader/X-Forwarded-Host_with_X-Forwarded-Port_(HTTP_standard_port_80) === RUN TestExtractHostHeader/X-Forwarded-Host_with_X-Forwarded-Port_(HTTPS_standard_port_443) === RUN TestExtractHostHeader/X-Forwarded-Host_with_port_already_included_(should_not_add_port_again) === RUN TestExtractHostHeader/X-Forwarded-Host_with_standard_port_already_included_(HTTPS_443) === RUN TestExtractHostHeader/X-Forwarded-Host_with_port,_no_X-Forwarded-Port_header === RUN TestExtractHostHeader/IPv6_address_with_brackets_and_port_in_X-Forwarded-Host === RUN TestExtractHostHeader/IPv6_address_without_brackets,_should_add_brackets_with_port === RUN TestExtractHostHeader/IPv6_address_without_brackets_and_standard_port,_should_strip_default_port === RUN TestExtractHostHeader/IPv6_address_without_brackets_and_standard_HTTPS_port,_should_strip_default_port === RUN TestExtractHostHeader/IPv6_address_with_brackets_but_no_port,_should_add_port === RUN TestExtractHostHeader/IPv6_full_address_with_brackets_and_default_port_(should_strip_default_port) === RUN TestExtractHostHeader/IPv4-mapped_IPv6_address_without_brackets,_should_add_brackets_with_port === RUN TestExtractHostHeader/Simple_port_442 === RUN TestExtractHostHeader/Port_442_with_X-Forwarded-Host === RUN TestExtractHostHeader/Port_442_with_X-Forwarded-Port === RUN TestExtractHostHeader/HTTPS_with_port_442_(should_NOT_strip) === RUN TestExtractHostHeader/X-Forwarded-Host_with_multiple_hosts_(including_port) === RUN TestExtractHostHeader/IPv6_with_port === RUN TestExtractHostHeader/X-Forwarded-Host_with_port_442,_but_X-Forwarded-Port_is_80_(should_PREFER_442) === RUN TestExtractHostHeader/externalHost_overrides_everything === RUN TestExtractHostHeader/externalHost_overrides_X-Forwarded-Host === RUN TestExtractHostHeader/externalHost_with_IPv6 === RUN TestExtractHostHeader/User_reported_case:_X-Forwarded-Port_misreports_443_but_Host_has_30007 === RUN TestExtractHostHeader/X-Forwarded-Host_already_contains_correct_port,_ignore_misaligned_X-Forwarded-Port === RUN TestExtractHostHeader/X-Forwarded-Host_has_no_port,_match_r.Host_hostname_and_take_its_port --- PASS: TestExtractHostHeader (0.03s) --- PASS: TestExtractHostHeader/basic_host_without_forwarding (0.00s) --- PASS: TestExtractHostHeader/host_with_port_without_forwarding (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_without_port (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_X-Forwarded-Port_(HTTP_non-standard) (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_X-Forwarded-Port_(HTTPS_non-standard) (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_X-Forwarded-Port_(HTTP_standard_port_80) (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_X-Forwarded-Port_(HTTPS_standard_port_443) (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_port_already_included_(should_not_add_port_again) (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_standard_port_already_included_(HTTPS_443) (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_port,_no_X-Forwarded-Port_header (0.00s) --- PASS: TestExtractHostHeader/IPv6_address_with_brackets_and_port_in_X-Forwarded-Host (0.00s) --- PASS: TestExtractHostHeader/IPv6_address_without_brackets,_should_add_brackets_with_port (0.00s) --- PASS: TestExtractHostHeader/IPv6_address_without_brackets_and_standard_port,_should_strip_default_port (0.00s) --- PASS: TestExtractHostHeader/IPv6_address_without_brackets_and_standard_HTTPS_port,_should_strip_default_port (0.00s) --- PASS: TestExtractHostHeader/IPv6_address_with_brackets_but_no_port,_should_add_port (0.00s) --- PASS: TestExtractHostHeader/IPv6_full_address_with_brackets_and_default_port_(should_strip_default_port) (0.00s) --- PASS: TestExtractHostHeader/IPv4-mapped_IPv6_address_without_brackets,_should_add_brackets_with_port (0.00s) --- PASS: TestExtractHostHeader/Simple_port_442 (0.00s) --- PASS: TestExtractHostHeader/Port_442_with_X-Forwarded-Host (0.00s) --- PASS: TestExtractHostHeader/Port_442_with_X-Forwarded-Port (0.00s) --- PASS: TestExtractHostHeader/HTTPS_with_port_442_(should_NOT_strip) (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_multiple_hosts_(including_port) (0.00s) --- PASS: TestExtractHostHeader/IPv6_with_port (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_with_port_442,_but_X-Forwarded-Port_is_80_(should_PREFER_442) (0.00s) --- PASS: TestExtractHostHeader/externalHost_overrides_everything (0.00s) --- PASS: TestExtractHostHeader/externalHost_overrides_X-Forwarded-Host (0.00s) --- PASS: TestExtractHostHeader/externalHost_with_IPv6 (0.00s) --- PASS: TestExtractHostHeader/User_reported_case:_X-Forwarded-Port_misreports_443_but_Host_has_30007 (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_already_contains_correct_port,_ignore_misaligned_X-Forwarded-Port (0.00s) --- PASS: TestExtractHostHeader/X-Forwarded-Host_has_no_port,_match_r.Host_hostname_and_take_its_port (0.00s) === RUN TestExtractHostHeaderCandidates === RUN TestExtractHostHeaderCandidates/externalHost_leads,_request_host_still_follows === RUN TestExtractHostHeaderCandidates/externalHost_leads_the_forwarded_candidates === RUN TestExtractHostHeaderCandidates/externalHost_equal_to_the_request_host_is_not_repeated === RUN TestExtractHostHeaderCandidates/X-Forwarded-Host_with_port_is_trusted_as-is === RUN TestExtractHostHeaderCandidates/plain_Host_with_port_is_the_only_candidate === RUN TestExtractHostHeaderCandidates/portless_X-Forwarded-Host,_hostnames_match:_r.Host_port_first,_then_X-Forwarded-Port,_then_bare === RUN TestExtractHostHeaderCandidates/portless_X-Forwarded-Host,_hostnames_match,_no_X-Forwarded-Port:_bare_host_as_fallback === RUN TestExtractHostHeaderCandidates/portless_X-Forwarded-Host,_hostnames_differ:_X-Forwarded-Port,_then_bare === RUN TestExtractHostHeaderCandidates/default_X-Forwarded-Port_collapses_into_the_bare_candidate === RUN TestExtractHostHeaderCandidates/portless_Host_with_X-Forwarded-Port:_forwarded_port,_then_bare === RUN TestExtractHostHeaderCandidates/bracketed_portless_IPv6_X-Forwarded-Host_matches_the_request_host === RUN TestExtractHostHeaderCandidates/unbracketed_portless_IPv6_X-Forwarded-Host_with_X-Forwarded-Port --- PASS: TestExtractHostHeaderCandidates (0.02s) --- PASS: TestExtractHostHeaderCandidates/externalHost_leads,_request_host_still_follows (0.00s) --- PASS: TestExtractHostHeaderCandidates/externalHost_leads_the_forwarded_candidates (0.00s) --- PASS: TestExtractHostHeaderCandidates/externalHost_equal_to_the_request_host_is_not_repeated (0.00s) --- PASS: TestExtractHostHeaderCandidates/X-Forwarded-Host_with_port_is_trusted_as-is (0.00s) --- PASS: TestExtractHostHeaderCandidates/plain_Host_with_port_is_the_only_candidate (0.00s) --- PASS: TestExtractHostHeaderCandidates/portless_X-Forwarded-Host,_hostnames_match:_r.Host_port_first,_then_X-Forwarded-Port,_then_bare (0.00s) --- PASS: TestExtractHostHeaderCandidates/portless_X-Forwarded-Host,_hostnames_match,_no_X-Forwarded-Port:_bare_host_as_fallback (0.00s) --- PASS: TestExtractHostHeaderCandidates/portless_X-Forwarded-Host,_hostnames_differ:_X-Forwarded-Port,_then_bare (0.00s) --- PASS: TestExtractHostHeaderCandidates/default_X-Forwarded-Port_collapses_into_the_bare_candidate (0.00s) --- PASS: TestExtractHostHeaderCandidates/portless_Host_with_X-Forwarded-Port:_forwarded_port,_then_bare (0.00s) --- PASS: TestExtractHostHeaderCandidates/bracketed_portless_IPv6_X-Forwarded-Host_matches_the_request_host (0.00s) --- PASS: TestExtractHostHeaderCandidates/unbracketed_portless_IPv6_X-Forwarded-Host_with_X-Forwarded-Port (0.00s) === RUN TestExtractSignedHeadersCase === RUN TestExtractSignedHeadersCase/lowercase_host === RUN TestExtractSignedHeadersCase/uppercase_Host --- PASS: TestExtractSignedHeadersCase (0.00s) --- PASS: TestExtractSignedHeadersCase/lowercase_host (0.00s) --- PASS: TestExtractSignedHeadersCase/uppercase_Host (0.00s) === RUN TestExtractSignedHeadersContentLength --- PASS: TestExtractSignedHeadersContentLength (0.00s) === RUN TestVerifyV4SignatureUsesOriginalRequestPath --- PASS: TestVerifyV4SignatureUsesOriginalRequestPath (0.01s) === RUN TestSignatureV4WithForwardedPrefixUnicodeKey --- PASS: TestSignatureV4WithForwardedPrefixUnicodeKey (0.01s) === RUN TestVerifySignedHeadersCoverage_Unit === RUN TestVerifySignedHeadersCoverage_Unit/no_x-amz_headers_is_fine === RUN TestVerifySignedHeadersCoverage_Unit/signed_x-amz_header_is_accepted === RUN TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-tagging_is_rejected_(header-based) === RUN TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-meta-*_is_rejected === RUN TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-acl_is_rejected === RUN TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-storage-class_is_rejected === RUN TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-server-side-encryption_is_rejected === RUN TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-object-lock-retain-until-date_is_rejected === RUN TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-security-token_is_rejected_(even_presigned) === RUN TestVerifySignedHeadersCoverage_Unit/x-amz-content-sha256_is_always_exempt_(presigned) === RUN TestVerifySignedHeadersCoverage_Unit/x-amz-content-sha256_is_always_exempt_(header-based) === RUN TestVerifySignedHeadersCoverage_Unit/presigned_exempts_sigv4_query_params_echoed_as_headers === RUN TestVerifySignedHeadersCoverage_Unit/header-based_does_NOT_exempt_x-amz-date_when_unsigned === RUN TestVerifySignedHeadersCoverage_Unit/signed_headers_match_is_case-insensitive === RUN TestVerifySignedHeadersCoverage_Unit/presigned_exempts_unsigned_SSE-C_key_headers === RUN TestVerifySignedHeadersCoverage_Unit/presigned_exempts_unsigned_SSE-C_copy-source_key_headers === RUN TestVerifySignedHeadersCoverage_Unit/presigned_still_requires_SSE-C_algorithm_to_be_signed === RUN TestVerifySignedHeadersCoverage_Unit/header-based_does_NOT_exempt_unsigned_SSE-C_key_headers --- PASS: TestVerifySignedHeadersCoverage_Unit (0.03s) --- PASS: TestVerifySignedHeadersCoverage_Unit/no_x-amz_headers_is_fine (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/signed_x-amz_header_is_accepted (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-tagging_is_rejected_(header-based) (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-meta-*_is_rejected (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-acl_is_rejected (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-storage-class_is_rejected (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-server-side-encryption_is_rejected (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-object-lock-retain-until-date_is_rejected (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/unsigned_x-amz-security-token_is_rejected_(even_presigned) (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/x-amz-content-sha256_is_always_exempt_(presigned) (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/x-amz-content-sha256_is_always_exempt_(header-based) (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/presigned_exempts_sigv4_query_params_echoed_as_headers (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/header-based_does_NOT_exempt_x-amz-date_when_unsigned (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/signed_headers_match_is_case-insensitive (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/presigned_exempts_unsigned_SSE-C_key_headers (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/presigned_exempts_unsigned_SSE-C_copy-source_key_headers (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/presigned_still_requires_SSE-C_algorithm_to_be_signed (0.00s) --- PASS: TestVerifySignedHeadersCoverage_Unit/header-based_does_NOT_exempt_unsigned_SSE-C_key_headers (0.00s) === RUN TestPresignedPutRejectsUnsignedTagging --- PASS: TestPresignedPutRejectsUnsignedTagging (0.00s) === RUN TestPresignedPutAcceptsSignedTagging --- PASS: TestPresignedPutAcceptsSignedTagging (0.01s) === RUN TestPresignedGetAcceptsUnsignedSSECKeyHeaders --- PASS: TestPresignedGetAcceptsUnsignedSSECKeyHeaders (0.01s) === RUN TestPresignedPutRejectsUnsignedMetadataHeaders === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/acl === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/user-metadata === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/storage-class === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/server-side-encryption === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/sse-kms-key-id === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/object-lock-mode === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/object-lock-retain-until === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/website-redirect-location === RUN TestPresignedPutRejectsUnsignedMetadataHeaders/grant-full-control --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders (0.05s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/acl (0.00s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/user-metadata (0.00s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/storage-class (0.00s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/server-side-encryption (0.00s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/sse-kms-key-id (0.00s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/object-lock-mode (0.00s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/object-lock-retain-until (0.00s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/website-redirect-location (0.00s) --- PASS: TestPresignedPutRejectsUnsignedMetadataHeaders/grant-full-control (0.00s) === RUN TestParseSignV4MissingFields === RUN TestParseSignV4MissingFields/valid === RUN TestParseSignV4MissingFields/no_signature_field === RUN TestParseSignV4MissingFields/empty_signature_field === RUN TestParseSignV4MissingFields/no_credential_field === RUN TestParseSignV4MissingFields/leading_comma_after_dropping_credential --- PASS: TestParseSignV4MissingFields (0.01s) --- PASS: TestParseSignV4MissingFields/valid (0.00s) --- PASS: TestParseSignV4MissingFields/no_signature_field (0.00s) --- PASS: TestParseSignV4MissingFields/empty_signature_field (0.00s) --- PASS: TestParseSignV4MissingFields/no_credential_field (0.00s) --- PASS: TestParseSignV4MissingFields/leading_comma_after_dropping_credential (0.00s) === RUN TestStaticCredentialWithSessionToken === RUN TestStaticCredentialWithSessionToken/authenticates_as_the_static_identity === RUN TestStaticCredentialWithSessionToken/authorized_through_the_static_action_path === RUN TestStaticCredentialWithSessionToken/repeat_verification_stays_idempotent === RUN TestStaticCredentialWithSessionToken/unsigned_token_is_still_rejected === RUN TestStaticCredentialWithSessionToken/unknown_access_key_with_token_still_rejected === RUN TestStaticCredentialWithSessionToken/wrong_secret_with_token_still_rejected === RUN TestStaticCredentialWithSessionToken/presigned_URL_with_token_works --- PASS: TestStaticCredentialWithSessionToken (0.05s) --- PASS: TestStaticCredentialWithSessionToken/authenticates_as_the_static_identity (0.01s) --- PASS: TestStaticCredentialWithSessionToken/authorized_through_the_static_action_path (0.01s) --- PASS: TestStaticCredentialWithSessionToken/repeat_verification_stays_idempotent (0.01s) --- PASS: TestStaticCredentialWithSessionToken/unsigned_token_is_still_rejected (0.00s) --- PASS: TestStaticCredentialWithSessionToken/unknown_access_key_with_token_still_rejected (0.00s) --- PASS: TestStaticCredentialWithSessionToken/wrong_secret_with_token_still_rejected (0.00s) --- PASS: TestStaticCredentialWithSessionToken/presigned_URL_with_token_works (0.01s) === RUN TestSTSIdentityPolicyNamesPopulation I1117 09:40:47.160007 config_loader.go:73 Using explicit credential store: memory auth_sts_identity_test.go:94: ✓ STS identity will use IAM authorization path (correct behavior) --- PASS: TestSTSIdentityPolicyNamesPopulation (0.04s) === RUN TestSTSIdentityAuthorizationFlow auth_sts_identity_test.go:154: ✓ Verified: STS identity correctly bypasses legacy CanDo() to use IAM authorization path --- PASS: TestSTSIdentityAuthorizationFlow (0.00s) === RUN TestSTSIdentityWithoutPolicyNames auth_sts_identity_test.go:174: Bug scenario: Actions=0, PolicyNames=0 → Would be denied auth_sts_identity_test.go:176: Fixed scenario: Actions=0, PolicyNames=1 → Can use IAM authorization --- PASS: TestSTSIdentityWithoutPolicyNames (0.00s) === RUN TestCanDoPathConstruction === RUN TestCanDoPathConstruction/Wildcard_match_for_write auth_sts_identity_test.go:249: Testing path: test-bucket/path/to/object.txt === RUN TestCanDoPathConstruction/Wildcard_match_for_read_in_docs_path auth_sts_identity_test.go:249: Testing path: test-bucket/docs/file.txt === RUN TestCanDoPathConstruction/No_match_-_wrong_action auth_sts_identity_test.go:249: Testing path: test-bucket/file.txt === RUN TestCanDoPathConstruction/No_match_-_read_outside_docs_path auth_sts_identity_test.go:249: Testing path: test-bucket/other/file.txt === RUN TestCanDoPathConstruction/ObjectKey_with_leading_slash auth_sts_identity_test.go:249: Testing path: test-bucket/docs/file.txt --- PASS: TestCanDoPathConstruction (0.01s) --- PASS: TestCanDoPathConstruction/Wildcard_match_for_write (0.00s) --- PASS: TestCanDoPathConstruction/Wildcard_match_for_read_in_docs_path (0.00s) --- PASS: TestCanDoPathConstruction/No_match_-_wrong_action (0.00s) --- PASS: TestCanDoPathConstruction/No_match_-_read_outside_docs_path (0.00s) --- PASS: TestCanDoPathConstruction/ObjectKey_with_leading_slash (0.00s) === RUN TestValidateSTSSessionTokenIntegration I1117 09:40:47.218025 config_loader.go:73 Using explicit credential store: memory auth_sts_identity_test.go:304: ✓ Integration test passed: STS identity properly configured for IAM authorization --- PASS: TestValidateSTSSessionTokenIntegration (0.03s) === RUN TestSTSIdentityClaimsPopulation I1117 09:40:47.245275 config_loader.go:73 Using explicit credential store: memory auth_sts_identity_test.go:369: ✓ Claims properly populated from RequestContext for policy variable substitution --- PASS: TestSTSIdentityClaimsPopulation (0.02s) === RUN TestSTSSessionClaimsKeepOnlyServerAssertedUserID I1117 09:40:47.270846 config_loader.go:73 Using explicit credential store: memory === RUN TestSTSSessionClaimsKeepOnlyServerAssertedUserID/no_parent_user === RUN TestSTSSessionClaimsKeepOnlyServerAssertedUserID/parent_user --- PASS: TestSTSSessionClaimsKeepOnlyServerAssertedUserID (0.04s) --- PASS: TestSTSSessionClaimsKeepOnlyServerAssertedUserID/no_parent_user (0.02s) --- PASS: TestSTSSessionClaimsKeepOnlyServerAssertedUserID/parent_user (0.01s) === RUN TestSTSSessionTokenDoesNotRevealCredential I1117 09:40:47.310377 config_loader.go:73 Using explicit credential store: memory --- PASS: TestSTSSessionTokenDoesNotRevealCredential (0.03s) === RUN TestAuthorizeWithIAMSessionTokenExtraction === RUN TestAuthorizeWithIAMSessionTokenExtraction/Extracts_X-SeaweedFS-Session-Token_from_JWT_auth === RUN TestAuthorizeWithIAMSessionTokenExtraction/Extracts_X-Amz-Security-Token_from_V4_STS_auth_header === RUN TestAuthorizeWithIAMSessionTokenExtraction/Extracts_X-Amz-Security-Token_from_query_parameter_(presigned_URL) === RUN TestAuthorizeWithIAMSessionTokenExtraction/JWT_token_takes_precedence_over_X-Amz-Security-Token --- PASS: TestAuthorizeWithIAMSessionTokenExtraction (0.01s) --- PASS: TestAuthorizeWithIAMSessionTokenExtraction/Extracts_X-SeaweedFS-Session-Token_from_JWT_auth (0.00s) --- PASS: TestAuthorizeWithIAMSessionTokenExtraction/Extracts_X-Amz-Security-Token_from_V4_STS_auth_header (0.00s) --- PASS: TestAuthorizeWithIAMSessionTokenExtraction/Extracts_X-Amz-Security-Token_from_query_parameter_(presigned_URL) (0.00s) --- PASS: TestAuthorizeWithIAMSessionTokenExtraction/JWT_token_takes_precedence_over_X-Amz-Security-Token (0.00s) === RUN TestSTSSessionTokenIntoCredentials --- PASS: TestSTSSessionTokenIntoCredentials (0.00s) === RUN TestActionConstantsForV4Auth --- PASS: TestActionConstantsForV4Auth (0.00s) === RUN TestIsRequestPresignedSignatureV4 --- PASS: TestIsRequestPresignedSignatureV4 (0.00s) === RUN TestIsReqAuthenticated --- PASS: TestIsReqAuthenticated (0.01s) === RUN TestCheckaAnonymousRequestAuthType --- PASS: TestCheckaAnonymousRequestAuthType (0.00s) === RUN TestAnonymousListBucketsWithPrefixAction --- PASS: TestAnonymousListBucketsWithPrefixAction (0.00s) === RUN TestCheckAdminRequestAuthType --- PASS: TestCheckAdminRequestAuthType (0.01s) === RUN TestSignatureV4WithForwardedPrefix === RUN TestSignatureV4WithForwardedPrefix/prefix_without_trailing_slash === RUN TestSignatureV4WithForwardedPrefix/prefix_with_trailing_slash --- PASS: TestSignatureV4WithForwardedPrefix (0.01s) --- PASS: TestSignatureV4WithForwardedPrefix/prefix_without_trailing_slash (0.00s) --- PASS: TestSignatureV4WithForwardedPrefix/prefix_with_trailing_slash (0.00s) === RUN TestSignatureV4WithForwardedPrefixTrailingSlash === RUN TestSignatureV4WithForwardedPrefixTrailingSlash/bucket_listObjects_with_trailing_slash === RUN TestSignatureV4WithForwardedPrefixTrailingSlash/prefix_path_with_trailing_slash === RUN TestSignatureV4WithForwardedPrefixTrailingSlash/root_bucket_with_trailing_slash === RUN TestSignatureV4WithForwardedPrefixTrailingSlash/nested_folder_with_trailing_slash --- PASS: TestSignatureV4WithForwardedPrefixTrailingSlash (0.02s) --- PASS: TestSignatureV4WithForwardedPrefixTrailingSlash/bucket_listObjects_with_trailing_slash (0.00s) --- PASS: TestSignatureV4WithForwardedPrefixTrailingSlash/prefix_path_with_trailing_slash (0.00s) --- PASS: TestSignatureV4WithForwardedPrefixTrailingSlash/root_bucket_with_trailing_slash (0.00s) --- PASS: TestSignatureV4WithForwardedPrefixTrailingSlash/nested_folder_with_trailing_slash (0.00s) === RUN TestSignatureV4WithoutProxy === RUN TestSignatureV4WithoutProxy/HTTP_with_non-standard_port === RUN TestSignatureV4WithoutProxy/HTTPS_with_non-standard_port === RUN TestSignatureV4WithoutProxy/HTTP_with_standard_port === RUN TestSignatureV4WithoutProxy/HTTPS_with_standard_port === RUN TestSignatureV4WithoutProxy/HTTP_without_port === RUN TestSignatureV4WithoutProxy/HTTPS_without_port === RUN TestSignatureV4WithoutProxy/IPv6_HTTP_with_non-standard_port === RUN TestSignatureV4WithoutProxy/IPv6_HTTPS_with_non-standard_port === RUN TestSignatureV4WithoutProxy/IPv6_HTTP_with_standard_port === RUN TestSignatureV4WithoutProxy/IPv6_HTTPS_with_standard_port === RUN TestSignatureV4WithoutProxy/IPv6_HTTP_without_port === RUN TestSignatureV4WithoutProxy/IPv6_HTTPS_without_port --- PASS: TestSignatureV4WithoutProxy (0.05s) --- PASS: TestSignatureV4WithoutProxy/HTTP_with_non-standard_port (0.01s) --- PASS: TestSignatureV4WithoutProxy/HTTPS_with_non-standard_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/HTTP_with_standard_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/HTTPS_with_standard_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/HTTP_without_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/HTTPS_without_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/IPv6_HTTP_with_non-standard_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/IPv6_HTTPS_with_non-standard_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/IPv6_HTTP_with_standard_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/IPv6_HTTPS_with_standard_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/IPv6_HTTP_without_port (0.00s) --- PASS: TestSignatureV4WithoutProxy/IPv6_HTTPS_without_port (0.00s) === RUN TestSignatureV4WithForwardedPort === RUN TestSignatureV4WithForwardedPort/HTTP_with_non-standard_port === RUN TestSignatureV4WithForwardedPort/HTTPS_with_non-standard_port === RUN TestSignatureV4WithForwardedPort/HTTP_with_standard_port_(80) === RUN TestSignatureV4WithForwardedPort/HTTPS_with_standard_port_(443) === RUN TestSignatureV4WithForwardedPort/empty_proto_with_non-standard_port === RUN TestSignatureV4WithForwardedPort/empty_proto_with_port_80_(scheme_defaults_to_https_from_URL,_so_80_is_NOT_default) === RUN TestSignatureV4WithForwardedPort/X-Forwarded-Host_with_port_already_included_(Traefik/HAProxy_style) === RUN TestSignatureV4WithForwardedPort/X-Forwarded-Host_with_port,_no_X-Forwarded-Port_header === RUN TestSignatureV4WithForwardedPort/X-Forwarded-Host_with_standard_https_port_already_included_(Traefik/HAProxy_style) === RUN TestSignatureV4WithForwardedPort/X-Forwarded-Host_with_standard_http_port_already_included_(Traefik/HAProxy_style) === RUN TestSignatureV4WithForwardedPort/IPv6_X-Forwarded-Host_with_standard_https_port_already_included_(Traefik/HAProxy_style) === RUN TestSignatureV4WithForwardedPort/IPv6_X-Forwarded-Host_with_standard_http_port_already_included_(Traefik/HAProxy_style) === RUN TestSignatureV4WithForwardedPort/IPv6_with_port_in_brackets === RUN TestSignatureV4WithForwardedPort/IPv6_without_port_-_should_add_port_with_brackets === RUN TestSignatureV4WithForwardedPort/IPv6_in_brackets_without_port_-_should_add_port === RUN TestSignatureV4WithForwardedPort/IPv4-mapped_IPv6_without_port_-_should_add_port_with_brackets --- PASS: TestSignatureV4WithForwardedPort (0.08s) --- PASS: TestSignatureV4WithForwardedPort/HTTP_with_non-standard_port (0.00s) --- PASS: TestSignatureV4WithForwardedPort/HTTPS_with_non-standard_port (0.01s) --- PASS: TestSignatureV4WithForwardedPort/HTTP_with_standard_port_(80) (0.00s) --- PASS: TestSignatureV4WithForwardedPort/HTTPS_with_standard_port_(443) (0.00s) --- PASS: TestSignatureV4WithForwardedPort/empty_proto_with_non-standard_port (0.00s) --- PASS: TestSignatureV4WithForwardedPort/empty_proto_with_port_80_(scheme_defaults_to_https_from_URL,_so_80_is_NOT_default) (0.00s) --- PASS: TestSignatureV4WithForwardedPort/X-Forwarded-Host_with_port_already_included_(Traefik/HAProxy_style) (0.00s) --- PASS: TestSignatureV4WithForwardedPort/X-Forwarded-Host_with_port,_no_X-Forwarded-Port_header (0.00s) --- PASS: TestSignatureV4WithForwardedPort/X-Forwarded-Host_with_standard_https_port_already_included_(Traefik/HAProxy_style) (0.00s) --- PASS: TestSignatureV4WithForwardedPort/X-Forwarded-Host_with_standard_http_port_already_included_(Traefik/HAProxy_style) (0.00s) --- PASS: TestSignatureV4WithForwardedPort/IPv6_X-Forwarded-Host_with_standard_https_port_already_included_(Traefik/HAProxy_style) (0.00s) --- PASS: TestSignatureV4WithForwardedPort/IPv6_X-Forwarded-Host_with_standard_http_port_already_included_(Traefik/HAProxy_style) (0.01s) --- PASS: TestSignatureV4WithForwardedPort/IPv6_with_port_in_brackets (0.00s) --- PASS: TestSignatureV4WithForwardedPort/IPv6_without_port_-_should_add_port_with_brackets (0.00s) --- PASS: TestSignatureV4WithForwardedPort/IPv6_in_brackets_without_port_-_should_add_port (0.00s) --- PASS: TestSignatureV4WithForwardedPort/IPv4-mapped_IPv6_without_port_-_should_add_port_with_brackets (0.00s) === RUN TestPresignedSignatureV4Basic --- PASS: TestPresignedSignatureV4Basic (0.00s) === RUN TestPresignedSignatureV4MissingExpires --- PASS: TestPresignedSignatureV4MissingExpires (0.00s) === RUN TestPresignedSignatureV4WithForwardedPrefix === RUN TestPresignedSignatureV4WithForwardedPrefix/prefix_without_trailing_slash === RUN TestPresignedSignatureV4WithForwardedPrefix/prefix_with_trailing_slash --- PASS: TestPresignedSignatureV4WithForwardedPrefix (0.01s) --- PASS: TestPresignedSignatureV4WithForwardedPrefix/prefix_without_trailing_slash (0.00s) --- PASS: TestPresignedSignatureV4WithForwardedPrefix/prefix_with_trailing_slash (0.00s) === RUN TestPresignedSignatureV4WithForwardedPrefixTrailingSlash === RUN TestPresignedSignatureV4WithForwardedPrefixTrailingSlash/bucket_listObjects_with_trailing_slash === RUN TestPresignedSignatureV4WithForwardedPrefixTrailingSlash/prefix_path_with_trailing_slash === RUN TestPresignedSignatureV4WithForwardedPrefixTrailingSlash/api_path_with_trailing_slash --- PASS: TestPresignedSignatureV4WithForwardedPrefixTrailingSlash (0.02s) --- PASS: TestPresignedSignatureV4WithForwardedPrefixTrailingSlash/bucket_listObjects_with_trailing_slash (0.00s) --- PASS: TestPresignedSignatureV4WithForwardedPrefixTrailingSlash/prefix_path_with_trailing_slash (0.00s) --- PASS: TestPresignedSignatureV4WithForwardedPrefixTrailingSlash/api_path_with_trailing_slash (0.00s) === RUN TestPresignedSignatureV4ForwardedPrefixPeerTrust === RUN TestPresignedSignatureV4ForwardedPrefixPeerTrust/untrusted_peer === RUN TestPresignedSignatureV4ForwardedPrefixPeerTrust/trusted_proxy --- PASS: TestPresignedSignatureV4ForwardedPrefixPeerTrust (0.01s) --- PASS: TestPresignedSignatureV4ForwardedPrefixPeerTrust/untrusted_peer (0.01s) --- PASS: TestPresignedSignatureV4ForwardedPrefixPeerTrust/trusted_proxy (0.01s) === RUN TestGetStringToSignPUT --- PASS: TestGetStringToSignPUT (0.00s) === RUN TestGetStringToSignGETEmptyStringHash --- PASS: TestGetStringToSignGETEmptyStringHash (0.00s) === RUN TestIAMPayloadHashComputation --- PASS: TestIAMPayloadHashComputation (0.00s) === RUN TestS3PayloadHashNoRegression --- PASS: TestS3PayloadHashNoRegression (0.00s) === RUN TestIAMEmptyBodyPayloadHash --- PASS: TestIAMEmptyBodyPayloadHash (0.00s) === RUN TestSTSPayloadHashComputation --- PASS: TestSTSPayloadHashComputation (0.00s) === RUN TestGitHubIssue7080Scenario --- PASS: TestGitHubIssue7080Scenario (0.00s) === RUN TestIAMSignatureServiceMatching --- PASS: TestIAMSignatureServiceMatching (0.01s) === RUN TestStreamingSignatureServiceField --- PASS: TestStreamingSignatureServiceField (0.00s) === RUN TestIAMLargeBodySecurityLimit --- PASS: TestIAMLargeBodySecurityLimit (0.46s) === RUN TestStreamHashRequestBody === RUN TestStreamHashRequestBody/empty_body === RUN TestStreamHashRequestBody/small_payload === RUN TestStreamHashRequestBody/medium_payload === RUN TestStreamHashRequestBody/large_payload_within_limit --- PASS: TestStreamHashRequestBody (0.31s) --- PASS: TestStreamHashRequestBody/empty_body (0.00s) --- PASS: TestStreamHashRequestBody/small_payload (0.00s) --- PASS: TestStreamHashRequestBody/medium_payload (0.00s) --- PASS: TestStreamHashRequestBody/large_payload_within_limit (0.27s) === RUN TestStreamingVsNonStreamingConsistency === RUN TestStreamingVsNonStreamingConsistency/payload_0 === RUN TestStreamingVsNonStreamingConsistency/payload_1 === RUN TestStreamingVsNonStreamingConsistency/payload_2 === RUN TestStreamingVsNonStreamingConsistency/payload_3 === RUN TestStreamingVsNonStreamingConsistency/payload_4 === RUN TestStreamingVsNonStreamingConsistency/payload_5 --- PASS: TestStreamingVsNonStreamingConsistency (0.03s) --- PASS: TestStreamingVsNonStreamingConsistency/payload_0 (0.00s) --- PASS: TestStreamingVsNonStreamingConsistency/payload_1 (0.00s) --- PASS: TestStreamingVsNonStreamingConsistency/payload_2 (0.00s) --- PASS: TestStreamingVsNonStreamingConsistency/payload_3 (0.00s) --- PASS: TestStreamingVsNonStreamingConsistency/payload_4 (0.00s) --- PASS: TestStreamingVsNonStreamingConsistency/payload_5 (0.00s) === RUN TestStreamingWithSizeLimit --- PASS: TestStreamingWithSizeLimit (0.27s) === RUN TestNonS3BodyHashLimitFollowsRoute === RUN TestNonS3BodyHashLimitFollowsRoute/s3vectors_route33554432_20971520 === RUN TestNonS3BodyHashLimitFollowsRoute/s3vectors_route33554432_33554432 === RUN TestNonS3BodyHashLimitFollowsRoute/s3vectors_route33554432_33554433 === RUN TestNonS3BodyHashLimitFollowsRoute/s3vectors_route0_10485761 === RUN TestNonS3BodyHashLimitFollowsRoute/iam_route0_10485761 --- PASS: TestNonS3BodyHashLimitFollowsRoute (18.11s) --- PASS: TestNonS3BodyHashLimitFollowsRoute/s3vectors_route33554432_20971520 (4.82s) --- PASS: TestNonS3BodyHashLimitFollowsRoute/s3vectors_route33554432_33554432 (7.20s) --- PASS: TestNonS3BodyHashLimitFollowsRoute/s3vectors_route33554432_33554433 (3.85s) --- PASS: TestNonS3BodyHashLimitFollowsRoute/s3vectors_route0_10485761 (1.11s) --- PASS: TestNonS3BodyHashLimitFollowsRoute/iam_route0_10485761 (1.11s) === RUN TestBucketFromVirtualHost === RUN TestBucketFromVirtualHost/alpha-bkt.s3.test === RUN TestBucketFromVirtualHost/alpha-bkt.s3.test:8333 === RUN TestBucketFromVirtualHost/alpha-bkt.S3.TEST === RUN TestBucketFromVirtualHost/s3.test === RUN TestBucketFromVirtualHost/example.com === RUN TestBucketFromVirtualHost/alpha-bkt.s3.test#01 === RUN TestBucketFromVirtualHost/alpha-bkt.s3.test#02 === RUN TestBucketFromVirtualHost/bucket.develop.s3.test === RUN TestBucketFromVirtualHost/develop.s3.test --- PASS: TestBucketFromVirtualHost (0.01s) --- PASS: TestBucketFromVirtualHost/alpha-bkt.s3.test (0.00s) --- PASS: TestBucketFromVirtualHost/alpha-bkt.s3.test:8333 (0.00s) --- PASS: TestBucketFromVirtualHost/alpha-bkt.S3.TEST (0.00s) --- PASS: TestBucketFromVirtualHost/s3.test (0.00s) --- PASS: TestBucketFromVirtualHost/example.com (0.00s) --- PASS: TestBucketFromVirtualHost/alpha-bkt.s3.test#01 (0.00s) --- PASS: TestBucketFromVirtualHost/alpha-bkt.s3.test#02 (0.00s) --- PASS: TestBucketFromVirtualHost/bucket.develop.s3.test (0.00s) --- PASS: TestBucketFromVirtualHost/develop.s3.test (0.00s) === RUN TestPresignedVirtualHostRetargetRejected --- PASS: TestPresignedVirtualHostRetargetRejected (0.01s) === RUN TestSignedVirtualHostRetargetRejected --- PASS: TestSignedVirtualHostRetargetRejected (0.00s) === RUN TestPresignedVirtualHostNoRetarget --- PASS: TestPresignedVirtualHostNoRetarget (0.00s) === RUN TestBuildBucketMetadata W1117 09:41:06.897459 bucket_metadata.go:116 Invalid ownership: , bucket: ownershipEmptyStr W1117 09:41:06.901691 bucket_metadata.go:127 owner[id=xxxxx] is invalid, bucket: acpEmptyObject --- PASS: TestBuildBucketMetadata (0.03s) === RUN TestGetBucketMetadata --- PASS: TestGetBucketMetadata (1.01s) === RUN TestBucketOwnerFromIdentityId === RUN TestBucketOwnerFromIdentityId/account-less_identity === RUN TestBucketOwnerFromIdentityId/identity_scoped_to_an_account === RUN TestBucketOwnerFromIdentityId/unknown_identity --- PASS: TestBucketOwnerFromIdentityId (0.01s) --- PASS: TestBucketOwnerFromIdentityId/account-less_identity (0.00s) --- PASS: TestBucketOwnerFromIdentityId/identity_scoped_to_an_account (0.00s) --- PASS: TestBucketOwnerFromIdentityId/unknown_identity (0.00s) === RUN TestBucketOwnerPrefersAccountId --- PASS: TestBucketOwnerPrefersAccountId (0.00s) === RUN TestCollectionInfoLogicalSize === RUN TestCollectionInfoLogicalSize/no_garbage === RUN TestCollectionInfoLogicalSize/some_garbage === RUN TestCollectionInfoLogicalSize/all_garbage === RUN TestCollectionInfoLogicalSize/deleted_exceeds_size_clamps_to_zero --- PASS: TestCollectionInfoLogicalSize (0.00s) --- PASS: TestCollectionInfoLogicalSize/no_garbage (0.00s) --- PASS: TestCollectionInfoLogicalSize/some_garbage (0.00s) --- PASS: TestCollectionInfoLogicalSize/all_garbage (0.00s) --- PASS: TestCollectionInfoLogicalSize/deleted_exceeds_size_clamps_to_zero (0.00s) === RUN TestChunkedEncodingMixedFormat --- PASS: TestChunkedEncodingMixedFormat (0.00s) === RUN TestTrailerChecksumSurvivesSplitTrailerLines --- PASS: TestTrailerChecksumSurvivesSplitTrailerLines (0.00s) === RUN TestChunkedReaderDoesNotReauthorizeBucketPolicyPrincipal --- PASS: TestChunkedReaderDoesNotReauthorizeBucketPolicyPrincipal (0.03s) === RUN TestExtractChecksumAlgorithmIsCaseInsensitive --- PASS: TestExtractChecksumAlgorithmIsCaseInsensitive (0.00s) === RUN TestNewSignV4ChunkedReaderStreamingUnsignedPayloadTrailer --- PASS: TestNewSignV4ChunkedReaderStreamingUnsignedPayloadTrailer (0.01s) === RUN TestSignedStreamingUpload --- PASS: TestSignedStreamingUpload (0.01s) === RUN TestSignedStreamingUploadWithTrailer --- PASS: TestSignedStreamingUploadWithTrailer (0.01s) === RUN TestSignedStreamingUploadWithTrailerInvalidSignature --- PASS: TestSignedStreamingUploadWithTrailerInvalidSignature (0.01s) === RUN TestSignedStreamingUploadInvalidSignature --- PASS: TestSignedStreamingUploadInvalidSignature (0.01s) === RUN TestSignedStreamingUploadWithoutIAM --- PASS: TestSignedStreamingUploadWithoutIAM (0.00s) === RUN TestTrailerStreamingUploadWithoutIAM --- PASS: TestTrailerStreamingUploadWithoutIAM (0.00s) === RUN TestCopySourceWithExclamationMark === RUN TestCopySourceWithExclamationMark/encoded_exclamation_mark_-_different_dest === RUN TestCopySourceWithExclamationMark/unencoded_exclamation_mark_-_different_dest === RUN TestCopySourceWithExclamationMark/encoded_exclamation_mark_-_same_dest === RUN TestCopySourceWithExclamationMark/encoded_path_with_versionId === RUN TestCopySourceWithExclamationMark/unencoded_path_with_versionId === RUN TestCopySourceWithExclamationMark/plus_sign_in_key_with_versionId --- PASS: TestCopySourceWithExclamationMark (0.01s) --- PASS: TestCopySourceWithExclamationMark/encoded_exclamation_mark_-_different_dest (0.00s) --- PASS: TestCopySourceWithExclamationMark/unencoded_exclamation_mark_-_different_dest (0.00s) --- PASS: TestCopySourceWithExclamationMark/encoded_exclamation_mark_-_same_dest (0.00s) --- PASS: TestCopySourceWithExclamationMark/encoded_path_with_versionId (0.00s) --- PASS: TestCopySourceWithExclamationMark/unencoded_path_with_versionId (0.00s) --- PASS: TestCopySourceWithExclamationMark/plus_sign_in_key_with_versionId (0.00s) === RUN TestCopySourceDecodingPlusSign --- PASS: TestCopySourceDecodingPlusSign (0.00s) === RUN TestCopySourceRejectsTraversal === RUN TestCopySourceRejectsTraversal/clean_source_passes === RUN TestCopySourceRejectsTraversal/leading_slash_source_passes === RUN TestCopySourceRejectsTraversal/source_with_versionId_passes === RUN TestCopySourceRejectsTraversal/dotdot_escapes_bucket === RUN TestCopySourceRejectsTraversal/leading_slash_dotdot_escapes_bucket === RUN TestCopySourceRejectsTraversal/percent-encoded_dotdot_escapes_bucket === RUN TestCopySourceRejectsTraversal/encoded_slash_dotdot_escapes_bucket === RUN TestCopySourceRejectsTraversal/backslash_dotdot_escapes_bucket === RUN TestCopySourceRejectsTraversal/nested_dotdot_escapes_bucket === RUN TestCopySourceRejectsTraversal/bare_dot_segment_rejected === RUN TestCopySourceRejectsTraversal/dotdot_bucket_rejected === RUN TestCopySourceRejectsTraversal/dotdot_with_versionId_escapes_bucket === RUN TestCopySourceRejectsTraversal/versionId_encoded_slash_rejected === RUN TestCopySourceRejectsTraversal/versionId_backslash_rejected --- PASS: TestCopySourceRejectsTraversal (0.01s) --- PASS: TestCopySourceRejectsTraversal/clean_source_passes (0.00s) --- PASS: TestCopySourceRejectsTraversal/leading_slash_source_passes (0.00s) --- PASS: TestCopySourceRejectsTraversal/source_with_versionId_passes (0.00s) --- PASS: TestCopySourceRejectsTraversal/dotdot_escapes_bucket (0.00s) --- PASS: TestCopySourceRejectsTraversal/leading_slash_dotdot_escapes_bucket (0.00s) --- PASS: TestCopySourceRejectsTraversal/percent-encoded_dotdot_escapes_bucket (0.00s) --- PASS: TestCopySourceRejectsTraversal/encoded_slash_dotdot_escapes_bucket (0.00s) --- PASS: TestCopySourceRejectsTraversal/backslash_dotdot_escapes_bucket (0.00s) --- PASS: TestCopySourceRejectsTraversal/nested_dotdot_escapes_bucket (0.00s) --- PASS: TestCopySourceRejectsTraversal/bare_dot_segment_rejected (0.00s) --- PASS: TestCopySourceRejectsTraversal/dotdot_bucket_rejected (0.00s) --- PASS: TestCopySourceRejectsTraversal/dotdot_with_versionId_escapes_bucket (0.00s) --- PASS: TestCopySourceRejectsTraversal/versionId_encoded_slash_rejected (0.00s) --- PASS: TestCopySourceRejectsTraversal/versionId_backslash_rejected (0.00s) === RUN TestCopySourceRoutingWithSpecialChars === RUN TestCopySourceRoutingWithSpecialChars/different_keys,_source_has_encoded_! === RUN TestCopySourceRoutingWithSpecialChars/same_key_with_!,_source_encoded,_dest_unencoded === RUN TestCopySourceRoutingWithSpecialChars/same_key_with_!,_both_percent-encoded_differently === RUN TestCopySourceRoutingWithSpecialChars/key_with_+_sign,_source_has_literal_+ === RUN TestCopySourceRoutingWithSpecialChars/key_with_+_sign,_source_has_%2B === RUN TestCopySourceRoutingWithSpecialChars/lowercase_%2f_in_copy_source --- PASS: TestCopySourceRoutingWithSpecialChars (0.06s) --- PASS: TestCopySourceRoutingWithSpecialChars/different_keys,_source_has_encoded_! (0.02s) --- PASS: TestCopySourceRoutingWithSpecialChars/same_key_with_!,_source_encoded,_dest_unencoded (0.01s) --- PASS: TestCopySourceRoutingWithSpecialChars/same_key_with_!,_both_percent-encoded_differently (0.01s) --- PASS: TestCopySourceRoutingWithSpecialChars/key_with_+_sign,_source_has_literal_+ (0.01s) --- PASS: TestCopySourceRoutingWithSpecialChars/key_with_+_sign,_source_has_%2B (0.00s) --- PASS: TestCopySourceRoutingWithSpecialChars/lowercase_%2f_in_copy_source (0.00s) === RUN TestCombineCRC64NVME --- PASS: TestCombineCRC64NVME (0.74s) === RUN TestCombineCRC32 --- PASS: TestCombineCRC32 (1.11s) === RUN TestCombineCRC32C --- PASS: TestCombineCRC32C (0.68s) === RUN TestCombineCRC64NVMEEmptySecond --- PASS: TestCombineCRC64NVMEEmptySecond (0.00s) === RUN TestCombineCRC32EmptySecond --- PASS: TestCombineCRC32EmptySecond (0.00s) === RUN TestGenerateDirectReadFixture direct_read_fixture_test.go:24: set DIRECT_READ_FIXTURE to write the fixture --- SKIP: TestGenerateDirectReadFixture (0.00s) === RUN TestAbortCompletedUploadDeletesMetadataOnly --- PASS: TestAbortCompletedUploadDeletesMetadataOnly (0.03s) === RUN TestAbortCompletedVersionDeletesMetadataOnly --- PASS: TestAbortCompletedVersionDeletesMetadataOnly (0.03s) === RUN TestAbortCompletedUploadWithoutRecordedKey --- PASS: TestAbortCompletedUploadWithoutRecordedKey (0.02s) === RUN TestAbortOpenUploadDeletesData --- PASS: TestAbortOpenUploadDeletesData (0.03s) === RUN TestAbortUndecidableCheckRefuses E1117 09:41:10.776208 filer_multipart.go:1214 bucket b remove upload up1 completed check: all filers failed, last error: LookupEntry1: rpc error: code = Unavailable desc = store down --- PASS: TestAbortUndecidableCheckRefuses (0.03s) === RUN TestAbortGoneUploadAnswersNoSuchUpload --- PASS: TestAbortGoneUploadAnswersNoSuchUpload (0.02s) === RUN TestAbortAfterCompleteAnswersNoSuchUpload --- PASS: TestAbortAfterCompleteAnswersNoSuchUpload (0.01s) === RUN TestAbortVersionsListErrorRefuses E1117 09:41:10.833931 filer_multipart.go:1214 bucket b remove upload up1 completed check: all filers failed, last error: rpc error: code = Internal desc = store down --- PASS: TestAbortVersionsListErrorRefuses (0.03s) === RUN TestLifecycleAbortCompletedUploadDeletesMetadataOnly --- PASS: TestLifecycleAbortCompletedUploadDeletesMetadataOnly (0.02s) === RUN TestLifecycleAbortUndecidableCheckRetriesLater E1117 09:41:10.882544 filer_multipart.go:1214 bucket b remove upload up1 completed check: all filers failed, last error: LookupEntry1: rpc error: code = Unavailable desc = store down --- PASS: TestLifecycleAbortUndecidableCheckRetriesLater (0.02s) === RUN TestRoutedAbortLocksTheCompletionCommitPath --- PASS: TestRoutedAbortLocksTheCompletionCommitPath (0.11s) === RUN TestComputeFullObjectChecksumCRC64NVME --- PASS: TestComputeFullObjectChecksumCRC64NVME (1.23s) === RUN TestComputeFullObjectChecksumCRC32 --- PASS: TestComputeFullObjectChecksumCRC32 (0.67s) === RUN TestResolveMultipartChecksumType === RUN TestResolveMultipartChecksumType/crc64_default_full === RUN TestResolveMultipartChecksumType/crc64_explicit_full === RUN TestResolveMultipartChecksumType/crc64_composite_rejected === RUN TestResolveMultipartChecksumType/crc32_default_composite === RUN TestResolveMultipartChecksumType/crc32_explicit_composite === RUN TestResolveMultipartChecksumType/crc32_explicit_full === RUN TestResolveMultipartChecksumType/crc32c_explicit_full === RUN TestResolveMultipartChecksumType/sha256_default_composite === RUN TestResolveMultipartChecksumType/sha256_full_rejected === RUN TestResolveMultipartChecksumType/invalid_checksum_type --- PASS: TestResolveMultipartChecksumType (0.01s) --- PASS: TestResolveMultipartChecksumType/crc64_default_full (0.00s) --- PASS: TestResolveMultipartChecksumType/crc64_explicit_full (0.00s) --- PASS: TestResolveMultipartChecksumType/crc64_composite_rejected (0.00s) --- PASS: TestResolveMultipartChecksumType/crc32_default_composite (0.00s) --- PASS: TestResolveMultipartChecksumType/crc32_explicit_composite (0.00s) --- PASS: TestResolveMultipartChecksumType/crc32_explicit_full (0.00s) --- PASS: TestResolveMultipartChecksumType/crc32c_explicit_full (0.00s) --- PASS: TestResolveMultipartChecksumType/sha256_default_composite (0.00s) --- PASS: TestResolveMultipartChecksumType/sha256_full_rejected (0.00s) --- PASS: TestResolveMultipartChecksumType/invalid_checksum_type (0.00s) === RUN TestCompleteMultipartUploadResultChecksumXML --- PASS: TestCompleteMultipartUploadResultChecksumXML (0.00s) === RUN TestCompleteMultipartResultChecksumFromEntry --- PASS: TestCompleteMultipartResultChecksumFromEntry (0.00s) === RUN TestCreateMultipartUploadResultChecksumHeaders --- PASS: TestCreateMultipartUploadResultChecksumHeaders (0.00s) === RUN TestMatchesObjectChecksum --- PASS: TestMatchesObjectChecksum (0.00s) === RUN TestCompleteMultipartUploadCommittedDespiteFailure E1117 09:41:12.977611 filer_multipart.go:462 completeMultipartUpload 0001_old.part ETag mismatch stored: 0f343b0931126a20f133d67c2b018a3b part: 5eb63bbbe01eeed093cb22bb8f5acdc3 I1117 09:41:13.003851 filer_client.go:340 create file b/a.bin: CreateEntry: rpc error: code = Internal desc = response lost after commit E1117 09:41:13.020523 filer_multipart.go:1016 completeMultipartUpload b/a.bin error: all filers failed, last error: create file b/a.bin: CreateEntry: rpc error: code = Internal desc = response lost after commit W1117 09:41:13.026328 filer_multipart.go:1059 completeMultipartUpload b/a.bin upload u1: committed despite InternalError --- PASS: TestCompleteMultipartUploadCommittedDespiteFailure (0.11s) === RUN TestCommittedCompletionReadsTheLatestVersion --- PASS: TestCommittedCompletionReadsTheLatestVersion (0.02s) === RUN TestCompleteMultipartUploadVersionedCommittedDespiteFailure E1117 09:41:13.084326 filer_multipart.go:462 completeMultipartUpload 0001_old.part ETag mismatch stored: 0f343b0931126a20f133d67c2b018a3b part: 5eb63bbbe01eeed093cb22bb8f5acdc3 E1117 09:41:13.112951 s3api_object_versioned_finalize.go:178 routedMultipartFinalize: b/a.bin upload u1 on : rpc error: code = Internal desc = response lost after commit W1117 09:41:13.129947 filer_multipart.go:1059 completeMultipartUpload b/a.bin upload u1: committed despite InternalError --- PASS: TestCompleteMultipartUploadVersionedCommittedDespiteFailure (0.08s) === RUN TestCommittedCompletionBehindADeleteMarker --- PASS: TestCommittedCompletionBehindADeleteMarker (0.01s) === RUN TestCompleteMultipartUploadKeepsPartDataUnderAnotherAttemptsCommit E1117 09:41:13.170879 filer_multipart.go:462 completeMultipartUpload 0001_old.part ETag mismatch stored: 0f343b0931126a20f133d67c2b018a3b part: 5eb63bbbe01eeed093cb22bb8f5acdc3 I1117 09:41:13.176112 filer_client.go:340 create file b/a.bin: CreateEntry: rpc error: code = Internal desc = lost the race E1117 09:41:13.188823 filer_multipart.go:1016 completeMultipartUpload b/a.bin error: all filers failed, last error: create file b/a.bin: CreateEntry: rpc error: code = Internal desc = lost the race W1117 09:41:13.198022 filer_multipart.go:1059 completeMultipartUpload b/a.bin upload u1: committed despite InternalError --- PASS: TestCompleteMultipartUploadKeepsPartDataUnderAnotherAttemptsCommit (0.05s) === RUN TestCompleteMultipartUploadFailureOverAnotherObject E1117 09:41:13.226970 filer_multipart.go:462 completeMultipartUpload 0001_old.part ETag mismatch stored: 0f343b0931126a20f133d67c2b018a3b part: 5eb63bbbe01eeed093cb22bb8f5acdc3 I1117 09:41:13.231059 filer_client.go:340 create file b/a.bin: CreateEntry: rpc error: code = Internal desc = store failed E1117 09:41:13.243307 filer_multipart.go:1016 completeMultipartUpload b/a.bin error: all filers failed, last error: create file b/a.bin: CreateEntry: rpc error: code = Internal desc = store failed --- PASS: TestCompleteMultipartUploadFailureOverAnotherObject (0.04s) === RUN TestGetEtagFromEntryPrefersStoredExtendedETag --- PASS: TestGetEtagFromEntryPrefersStoredExtendedETag (0.00s) === RUN TestGetEtagFromEntryFallbacksToFilerETag --- PASS: TestGetEtagFromEntryFallbacksToFilerETag (0.00s) === RUN TestCalculateMultipartETagUsesStoredPartETags --- PASS: TestCalculateMultipartETagUsesStoredPartETags (0.00s) === RUN TestParseS3MetadataIgnoresInternalAclHeaders --- PASS: TestParseS3MetadataIgnoresInternalAclHeaders (0.00s) === RUN TestNewMultipartUploadInitiateACL === RUN TestNewMultipartUploadInitiateACL/forged_internal_headers_are_ignored I1117 09:41:13.260282 config_loader.go:73 Using explicit credential store: memory === RUN TestNewMultipartUploadInitiateACL/explicit_acl_requires_write_acp I1117 09:41:13.303124 config_loader.go:73 Using explicit credential store: memory I1117 09:41:13.325056 s3api_object_upload_acl.go:164 denied POST "mpu-bucket/dir/blob.bin" for "mpu-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestNewMultipartUploadInitiateACL/explicit_acl_lands_on_upload_entry I1117 09:41:13.334773 config_loader.go:73 Using explicit credential store: memory === RUN TestNewMultipartUploadInitiateACL/blocked_public_acl_is_refused I1117 09:41:13.370175 config_loader.go:73 Using explicit credential store: memory --- PASS: TestNewMultipartUploadInitiateACL (0.14s) --- PASS: TestNewMultipartUploadInitiateACL/forged_internal_headers_are_ignored (0.04s) --- PASS: TestNewMultipartUploadInitiateACL/explicit_acl_requires_write_acp (0.03s) --- PASS: TestNewMultipartUploadInitiateACL/explicit_acl_lands_on_upload_entry (0.04s) --- PASS: TestNewMultipartUploadInitiateACL/blocked_public_acl_is_refused (0.03s) === RUN TestSelectMultipartUploadsEncodingTypeURL --- PASS: TestSelectMultipartUploadsEncodingTypeURL (0.01s) === RUN TestSelectMultipartUploadsEncodingTypeURLNextKeyMarker --- PASS: TestSelectMultipartUploadsEncodingTypeURLNextKeyMarker (0.00s) === RUN TestSelectMultipartUploadsKeepsKeysRawWithoutEncodingType --- PASS: TestSelectMultipartUploadsKeepsKeysRawWithoutEncodingType (0.00s) === RUN TestListMultipartUploadsUrlKeyMarkerIsRawKey --- PASS: TestListMultipartUploadsUrlKeyMarkerIsRawKey (0.03s) === RUN TestSelectMultipartUploads === RUN TestSelectMultipartUploads/sorted_by_key,_then_by_upload_id === RUN TestSelectMultipartUploads/key-marker_starts_after_that_key === RUN TestSelectMultipartUploads/key-marker_between_keys === RUN TestSelectMultipartUploads/upload-id-marker_continues_inside_its_key === RUN TestSelectMultipartUploads/upload-id-marker_of_an_aborted_upload === RUN TestSelectMultipartUploads/upload-id-marker_without_key-marker_is_ignored === RUN TestSelectMultipartUploads/prefix === RUN TestSelectMultipartUploads/page === RUN TestSelectMultipartUploads/exact_last_page_is_not_truncated === RUN TestSelectMultipartUploads/max-uploads_0 --- PASS: TestSelectMultipartUploads (0.01s) --- PASS: TestSelectMultipartUploads/sorted_by_key,_then_by_upload_id (0.00s) --- PASS: TestSelectMultipartUploads/key-marker_starts_after_that_key (0.00s) --- PASS: TestSelectMultipartUploads/key-marker_between_keys (0.00s) --- PASS: TestSelectMultipartUploads/upload-id-marker_continues_inside_its_key (0.00s) --- PASS: TestSelectMultipartUploads/upload-id-marker_of_an_aborted_upload (0.00s) --- PASS: TestSelectMultipartUploads/upload-id-marker_without_key-marker_is_ignored (0.00s) --- PASS: TestSelectMultipartUploads/prefix (0.00s) --- PASS: TestSelectMultipartUploads/page (0.00s) --- PASS: TestSelectMultipartUploads/exact_last_page_is_not_truncated (0.00s) --- PASS: TestSelectMultipartUploads/max-uploads_0 (0.00s) === RUN TestSelectMultipartUploadsPaginatesEveryUploadOnce --- PASS: TestSelectMultipartUploadsPaginatesEveryUploadOnce (0.00s) === RUN TestSelectMultipartUploadsHoldsOnlyThePage --- PASS: TestSelectMultipartUploadsHoldsOnlyThePage (1.09s) === RUN TestSelectMultipartUploadsUrlEncodesMarkersAndKeys --- PASS: TestSelectMultipartUploadsUrlEncodesMarkersAndKeys (0.00s) === RUN TestSelectMultipartUploadsUrlTokenPrefixedKeyRoundTrip --- PASS: TestSelectMultipartUploadsUrlTokenPrefixedKeyRoundTrip (0.00s) === RUN TestSelectMultipartUploadsCapsRequestedPageSize --- PASS: TestSelectMultipartUploadsCapsRequestedPageSize (0.00s) === RUN TestListMultipartUploadsRetryCollectsEachUploadOnce --- PASS: TestListMultipartUploadsRetryCollectsEachUploadOnce (0.10s) === RUN TestSelectMultipartUploadsDelimiter --- PASS: TestSelectMultipartUploadsDelimiter (0.00s) === RUN TestSelectMultipartUploadsDelimiterDropsLosingPrefixes --- PASS: TestSelectMultipartUploadsDelimiterDropsLosingPrefixes (0.00s) === RUN TestCompletedMultipartChunkBackfillsSSES3MetadataFromUploadEntry --- PASS: TestCompletedMultipartChunkBackfillsSSES3MetadataFromUploadEntry (0.01s) === RUN TestCompletedMultipartChunkPreservesExistingSSES3Metadata --- PASS: TestCompletedMultipartChunkPreservesExistingSSES3Metadata (0.00s) === RUN TestApplyMultipartSSES3HeadersFromUploadEntry === RUN TestApplyMultipartSSES3HeadersFromUploadEntry/backfills_missing_canonical_attributes === RUN TestApplyMultipartSSES3HeadersFromUploadEntry/does_not_clobber_existing_canonical_attributes === RUN TestApplyMultipartSSES3HeadersFromUploadEntry/nil_info_is_a_no-op --- PASS: TestApplyMultipartSSES3HeadersFromUploadEntry (0.01s) --- PASS: TestApplyMultipartSSES3HeadersFromUploadEntry/backfills_missing_canonical_attributes (0.00s) --- PASS: TestApplyMultipartSSES3HeadersFromUploadEntry/does_not_clobber_existing_canonical_attributes (0.00s) --- PASS: TestApplyMultipartSSES3HeadersFromUploadEntry/nil_info_is_a_no-op (0.00s) === RUN TestCompletedMultipartChunkBackfilledIVDecryptsActualCiphertext === RUN TestCompletedMultipartChunkBackfilledIVDecryptsActualCiphertext/part1 === RUN TestCompletedMultipartChunkBackfilledIVDecryptsActualCiphertext/part2 --- PASS: TestCompletedMultipartChunkBackfilledIVDecryptsActualCiphertext (30.47s) --- PASS: TestCompletedMultipartChunkBackfilledIVDecryptsActualCiphertext/part1 (18.42s) --- PASS: TestCompletedMultipartChunkBackfilledIVDecryptsActualCiphertext/part2 (11.92s) === RUN TestCompletedMultipartChunkRejectsPartNumberMultiplierFormula --- PASS: TestCompletedMultipartChunkRejectsPartNumberMultiplierFormula (0.01s) === RUN TestDeleteObjectEntryDemotesNonEmptyDirectoryMarker --- PASS: TestDeleteObjectEntryDemotesNonEmptyDirectoryMarker (0.00s) === RUN TestDeleteObjectEntryDemotesPrefixObject --- PASS: TestDeleteObjectEntryDemotesPrefixObject (0.00s) === RUN TestDeleteObjectEntryTreatsImplicitDirectoryAsSuccessfulNoop --- PASS: TestDeleteObjectEntryTreatsImplicitDirectoryAsSuccessfulNoop (0.00s) === RUN TestDeleteObjectEntryIgnoresConcurrentUpdateNotFound --- PASS: TestDeleteObjectEntryIgnoresConcurrentUpdateNotFound (0.00s) === RUN TestDeleteObjectEntryIgnoresMarkerSpoofedByKey --- PASS: TestDeleteObjectEntryIgnoresMarkerSpoofedByKey (0.00s) === RUN TestDeleteObjectEntryPropagatesNonDirectoryDeleteErrors --- PASS: TestDeleteObjectEntryPropagatesNonDirectoryDeleteErrors (0.00s) === RUN TestDeleteUnversionedObjectReplaysADroppedReply --- PASS: TestDeleteUnversionedObjectReplaysADroppedReply (0.04s) === RUN TestDeleteUnversionedObjectReplayIgnoresTheObjectName --- PASS: TestDeleteUnversionedObjectReplayIgnoresTheObjectName (0.06s) === RUN TestDeleteUnversionedObjectDoesNotReplayANonEmptyFolder --- PASS: TestDeleteUnversionedObjectDoesNotReplayANonEmptyFolder (0.00s) === RUN TestDeleteUnversionedObjectDoesNotReplayForACancelledCaller --- PASS: TestDeleteUnversionedObjectDoesNotReplayForACancelledCaller (0.00s) === RUN TestDeleteUnversionedObjectDrawsFromTheRequestAllowance --- PASS: TestDeleteUnversionedObjectDrawsFromTheRequestAllowance (0.04s) === RUN TestIsRetryableFilerErr --- PASS: TestIsRetryableFilerErr (0.00s) === RUN TestListWithRetryRecoversFromTransientListEntriesCall --- PASS: TestListWithRetryRecoversFromTransientListEntriesCall (0.33s) === RUN TestListWithRetryRecoversFromTransientStreamRecv --- PASS: TestListWithRetryRecoversFromTransientStreamRecv (0.10s) === RUN TestListWithRetryGivesUpAfterBoundedAttempts --- PASS: TestListWithRetryGivesUpAfterBoundedAttempts (0.30s) === RUN TestListWithRetryPropagatesNonTransientError === RUN TestListWithRetryPropagatesNonTransientError/permission_denied === RUN TestListWithRetryPropagatesNonTransientError/invalid_argument --- PASS: TestListWithRetryPropagatesNonTransientError (0.00s) --- PASS: TestListWithRetryPropagatesNonTransientError/permission_denied (0.00s) --- PASS: TestListWithRetryPropagatesNonTransientError/invalid_argument (0.00s) === RUN TestListWithRetryPropagatesNotFound --- PASS: TestListWithRetryPropagatesNotFound (0.00s) === RUN TestIsRetryableListError --- PASS: TestIsRetryableListError (0.00s) === RUN TestListWithRetryIgnoresUserControlledPath === RUN TestListWithRetryIgnoresUserControlledPath/permission_denied === RUN TestListWithRetryIgnoresUserControlledPath/invalid_argument --- PASS: TestListWithRetryIgnoresUserControlledPath (0.00s) --- PASS: TestListWithRetryIgnoresUserControlledPath/permission_denied (0.00s) --- PASS: TestListWithRetryIgnoresUserControlledPath/invalid_argument (0.00s) === RUN TestListWithRetryIgnoresSpoofedNotFoundPath --- PASS: TestListWithRetryIgnoresSpoofedNotFoundPath (0.10s) === RUN TestAuthorizeObjectDelete_AwsCanonicalPolicy --- PASS: TestAuthorizeObjectDelete_AwsCanonicalPolicy (0.01s) === RUN TestAuthorizeObjectDelete_PrefixScopedPolicy --- PASS: TestAuthorizeObjectDelete_PrefixScopedPolicy (0.00s) === RUN TestLoadIAMManagerFromConfig_Defaults --- PASS: TestLoadIAMManagerFromConfig_Defaults (0.01s) === RUN TestLoadIAMManagerFromConfig_Overrides --- PASS: TestLoadIAMManagerFromConfig_Overrides (0.00s) === RUN TestLoadIAMManagerFromConfig_PartialDefaults --- PASS: TestLoadIAMManagerFromConfig_PartialDefaults (0.00s) === RUN TestLoadIAMManagerFromConfig_ExplicitEmptyKey --- PASS: TestLoadIAMManagerFromConfig_ExplicitEmptyKey (0.00s) === RUN TestLoadIAMManagerFromConfig_MissingKeyError --- PASS: TestLoadIAMManagerFromConfig_MissingKeyError (0.00s) === RUN TestLoadIAMManagerFromConfig_ExplicitFileDefaultsToDeny --- PASS: TestLoadIAMManagerFromConfig_ExplicitFileDefaultsToDeny (0.00s) === RUN TestLoadIAMManagerFromConfig_NoFileDefaultsToAllow W1117 09:41:46.205193 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestLoadIAMManagerFromConfig_NoFileDefaultsToAllow (0.01s) === RUN TestLoadIAMManagerFromConfig_ExplicitFileEnforcesUserScopedPolicy --- PASS: TestLoadIAMManagerFromConfig_ExplicitFileEnforcesUserScopedPolicy (0.02s) === RUN TestLoadIAMManagerFromConfig_HonorsOIDCProviderStore === RUN TestLoadIAMManagerFromConfig_HonorsOIDCProviderStore/absent_keeps_memory === RUN TestLoadIAMManagerFromConfig_HonorsOIDCProviderStore/filer_persists W1117 09:41:46.229767 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background === RUN TestLoadIAMManagerFromConfig_HonorsOIDCProviderStore/no_config_file_persists W1117 09:41:46.232749 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestLoadIAMManagerFromConfig_HonorsOIDCProviderStore (0.01s) --- PASS: TestLoadIAMManagerFromConfig_HonorsOIDCProviderStore/absent_keeps_memory (0.00s) --- PASS: TestLoadIAMManagerFromConfig_HonorsOIDCProviderStore/filer_persists (0.00s) --- PASS: TestLoadIAMManagerFromConfig_HonorsOIDCProviderStore/no_config_file_persists (0.00s) === RUN TestLoadIAMManagerFromConfig_HonorsRoleStoreAndMarksStaticRoles === RUN TestLoadIAMManagerFromConfig_HonorsRoleStoreAndMarksStaticRoles/absent_keeps_memory === RUN TestLoadIAMManagerFromConfig_HonorsRoleStoreAndMarksStaticRoles/filer_persists === RUN TestLoadIAMManagerFromConfig_HonorsRoleStoreAndMarksStaticRoles/no_config_file_persists W1117 09:41:46.246492 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestLoadIAMManagerFromConfig_HonorsRoleStoreAndMarksStaticRoles (0.01s) --- PASS: TestLoadIAMManagerFromConfig_HonorsRoleStoreAndMarksStaticRoles/absent_keeps_memory (0.00s) --- PASS: TestLoadIAMManagerFromConfig_HonorsRoleStoreAndMarksStaticRoles/filer_persists (0.01s) --- PASS: TestLoadIAMManagerFromConfig_HonorsRoleStoreAndMarksStaticRoles/no_config_file_persists (0.00s) === RUN TestEvaluateIAMPolicies_ListBucketWithPrefix --- PASS: TestEvaluateIAMPolicies_ListBucketWithPrefix (0.00s) === RUN TestEvaluateIAMPolicies_ListBucketPrefixCondition --- PASS: TestEvaluateIAMPolicies_ListBucketPrefixCondition (0.01s) === RUN TestEvaluateIAMPolicies_ListBucketVersionsWithPrefix --- PASS: TestEvaluateIAMPolicies_ListBucketVersionsWithPrefix (0.00s) === RUN TestEvaluateIAMPolicies_ListMultipartUploadsWithPrefix --- PASS: TestEvaluateIAMPolicies_ListMultipartUploadsWithPrefix (0.01s) === RUN TestAuthorizeAction_ListVersionsWithPromotedPrefix --- PASS: TestAuthorizeAction_ListVersionsWithPromotedPrefix (0.01s) === RUN TestLoadIAMManagerWithNoConfig I1117 09:41:46.276726 config_loader.go:73 Using explicit credential store: memory --- PASS: TestLoadIAMManagerWithNoConfig (0.00s) === RUN TestLoadIAMManagerFromConfig_EmptyConfigWithFallbackKey I1117 09:41:46.278035 config_loader.go:73 Using explicit credential store: memory --- PASS: TestLoadIAMManagerFromConfig_EmptyConfigWithFallbackKey (0.00s) === RUN TestSetIAMIntegrationKeepsAuthDisabledWithoutConfig I1117 09:41:46.279342 config_loader.go:73 Using explicit credential store: memory --- PASS: TestSetIAMIntegrationKeepsAuthDisabledWithoutConfig (0.00s) === RUN TestIdentityFieldsForS3TablesReflection --- PASS: TestIdentityFieldsForS3TablesReflection (0.00s) === RUN TestReadRequestBodyLeavesOversizedBodyDrainable --- PASS: TestReadRequestBodyLeavesOversizedBodyDrainable (0.00s) === RUN TestSignedRequestBodyIsBoundToPayloadHash === RUN TestSignedRequestBodyIsBoundToPayloadHash/signed_body_is_readable === RUN TestSignedRequestBodyIsBoundToPayloadHash/replaced_body_is_refused === RUN TestSignedRequestBodyIsBoundToPayloadHash/decoder_that_stops_early_sees_no_replaced_bytes === RUN TestSignedRequestBodyIsBoundToPayloadHash/emptied_body_is_refused === RUN TestSignedRequestBodyIsBoundToPayloadHash/oversized_body_is_refused_before_it_is_read --- PASS: TestSignedRequestBodyIsBoundToPayloadHash (0.02s) --- PASS: TestSignedRequestBodyIsBoundToPayloadHash/signed_body_is_readable (0.00s) --- PASS: TestSignedRequestBodyIsBoundToPayloadHash/replaced_body_is_refused (0.00s) --- PASS: TestSignedRequestBodyIsBoundToPayloadHash/decoder_that_stops_early_sees_no_replaced_bytes (0.01s) --- PASS: TestSignedRequestBodyIsBoundToPayloadHash/emptied_body_is_refused (0.00s) --- PASS: TestSignedRequestBodyIsBoundToPayloadHash/oversized_body_is_refused_before_it_is_read (0.00s) === RUN TestGetRequestDataReaderStreamsSignedUploads --- PASS: TestGetRequestDataReaderStreamsSignedUploads (0.00s) === RUN TestDeleteObjectsRefusesReplacedBody --- PASS: TestDeleteObjectsRefusesReplacedBody (0.01s) === RUN TestSignedRequestBodyIsBoundToContentMd5 === RUN TestSignedRequestBodyIsBoundToContentMd5/v4_unsigned_payload === RUN TestSignedRequestBodyIsBoundToContentMd5/v2 === RUN TestSignedRequestBodyIsBoundToContentMd5/malformed_digest --- PASS: TestSignedRequestBodyIsBoundToContentMd5 (0.01s) --- PASS: TestSignedRequestBodyIsBoundToContentMd5/v4_unsigned_payload (0.00s) --- PASS: TestSignedRequestBodyIsBoundToContentMd5/v2 (0.00s) --- PASS: TestSignedRequestBodyIsBoundToContentMd5/malformed_digest (0.00s) === RUN TestGetRequestDataReaderVerifiesPresignedPayloadHash --- PASS: TestGetRequestDataReaderVerifiesPresignedPayloadHash (0.00s) === RUN TestPrebufferedSignedBodyChecksContentMd5 --- PASS: TestPrebufferedSignedBodyChecksContentMd5 (0.01s) === RUN TestMapBaseActionToS3Format_ServicePrefixPassthrough === RUN TestMapBaseActionToS3Format_ServicePrefixPassthrough/s3_prefix === RUN TestMapBaseActionToS3Format_ServicePrefixPassthrough/iam_prefix === RUN TestMapBaseActionToS3Format_ServicePrefixPassthrough/sts:AssumeRole === RUN TestMapBaseActionToS3Format_ServicePrefixPassthrough/sts:GetFederationToken === RUN TestMapBaseActionToS3Format_ServicePrefixPassthrough/sts:GetCallerIdentity === RUN TestMapBaseActionToS3Format_ServicePrefixPassthrough/coarse_Read_maps_to_s3:GetObject === RUN TestMapBaseActionToS3Format_ServicePrefixPassthrough/coarse_Write_maps_to_s3:PutObject --- PASS: TestMapBaseActionToS3Format_ServicePrefixPassthrough (0.00s) --- PASS: TestMapBaseActionToS3Format_ServicePrefixPassthrough/s3_prefix (0.00s) --- PASS: TestMapBaseActionToS3Format_ServicePrefixPassthrough/iam_prefix (0.00s) --- PASS: TestMapBaseActionToS3Format_ServicePrefixPassthrough/sts:AssumeRole (0.00s) --- PASS: TestMapBaseActionToS3Format_ServicePrefixPassthrough/sts:GetFederationToken (0.00s) --- PASS: TestMapBaseActionToS3Format_ServicePrefixPassthrough/sts:GetCallerIdentity (0.00s) --- PASS: TestMapBaseActionToS3Format_ServicePrefixPassthrough/coarse_Read_maps_to_s3:GetObject (0.00s) --- PASS: TestMapBaseActionToS3Format_ServicePrefixPassthrough/coarse_Write_maps_to_s3:PutObject (0.00s) === RUN TestResolveS3Action_STSActionsPassthrough === RUN TestResolveS3Action_STSActionsPassthrough/nil_request_sts:AssumeRole === RUN TestResolveS3Action_STSActionsPassthrough/with_request_sts:AssumeRole === RUN TestResolveS3Action_STSActionsPassthrough/nil_request_sts:GetFederationToken === RUN TestResolveS3Action_STSActionsPassthrough/with_request_sts:GetFederationToken === RUN TestResolveS3Action_STSActionsPassthrough/nil_request_sts:GetCallerIdentity === RUN TestResolveS3Action_STSActionsPassthrough/with_request_sts:GetCallerIdentity --- PASS: TestResolveS3Action_STSActionsPassthrough (0.00s) --- PASS: TestResolveS3Action_STSActionsPassthrough/nil_request_sts:AssumeRole (0.00s) --- PASS: TestResolveS3Action_STSActionsPassthrough/with_request_sts:AssumeRole (0.00s) --- PASS: TestResolveS3Action_STSActionsPassthrough/nil_request_sts:GetFederationToken (0.00s) --- PASS: TestResolveS3Action_STSActionsPassthrough/with_request_sts:GetFederationToken (0.00s) --- PASS: TestResolveS3Action_STSActionsPassthrough/nil_request_sts:GetCallerIdentity (0.00s) --- PASS: TestResolveS3Action_STSActionsPassthrough/with_request_sts:GetCallerIdentity (0.00s) === RUN TestResolveS3Action_AttributesBeforeVersionId === RUN TestResolveS3Action_AttributesBeforeVersionId/attributes_only === RUN TestResolveS3Action_AttributesBeforeVersionId/attributes_with_versionId === RUN TestResolveS3Action_AttributesBeforeVersionId/versionId_only_GET === RUN TestResolveS3Action_AttributesBeforeVersionId/versionId_only_DELETE --- PASS: TestResolveS3Action_AttributesBeforeVersionId (0.00s) --- PASS: TestResolveS3Action_AttributesBeforeVersionId/attributes_only (0.00s) --- PASS: TestResolveS3Action_AttributesBeforeVersionId/attributes_with_versionId (0.00s) --- PASS: TestResolveS3Action_AttributesBeforeVersionId/versionId_only_GET (0.00s) --- PASS: TestResolveS3Action_AttributesBeforeVersionId/versionId_only_DELETE (0.00s) === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/get_empty === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/get_bare === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/head_empty === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/delete_empty === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/delete_bare === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/duplicate_empty_first === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/get_null_version === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/head_null_version === RUN TestResolveS3Action_EmptyVersionIdIsCurrentObject/delete_null_version --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject (0.01s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/get_empty (0.00s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/get_bare (0.00s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/head_empty (0.00s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/delete_empty (0.00s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/delete_bare (0.00s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/duplicate_empty_first (0.00s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/get_null_version (0.00s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/head_null_version (0.00s) --- PASS: TestResolveS3Action_EmptyVersionIdIsCurrentObject/delete_null_version (0.00s) === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/GET === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/GET?versionId= === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/GET?versionId === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/HEAD?versionId= === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/HEAD?versionId === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/DELETE?versionId= === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/DELETE?versionId === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/GET?versionId=v1 === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/HEAD?versionId=null === RUN TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/DELETE?versionId=v1 --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny (0.01s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/GET (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/GET?versionId= (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/GET?versionId (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/HEAD?versionId= (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/HEAD?versionId (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/DELETE?versionId= (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/DELETE?versionId (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/GET?versionId=v1 (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/HEAD?versionId=null (0.00s) --- PASS: TestEmptyVersionIdDoesNotBypassCurrentObjectDeny/DELETE?versionId=v1 (0.00s) === RUN TestResolveS3Action_VersionTagging === RUN TestResolveS3Action_VersionTagging/get_current_tags === RUN TestResolveS3Action_VersionTagging/put_current_tags === RUN TestResolveS3Action_VersionTagging/delete_current_tags === RUN TestResolveS3Action_VersionTagging/get_version_tags === RUN TestResolveS3Action_VersionTagging/put_version_tags === RUN TestResolveS3Action_VersionTagging/delete_version_tags === RUN TestResolveS3Action_VersionTagging/empty_versionId_stays_current === RUN TestResolveS3Action_VersionTagging/bucket_tagging_ignores_versionId === RUN TestResolveS3Action_VersionTagging/non-empty_tagging_is_still_tagging === RUN TestResolveS3Action_VersionTagging/non-empty_tagging_plain --- PASS: TestResolveS3Action_VersionTagging (0.01s) --- PASS: TestResolveS3Action_VersionTagging/get_current_tags (0.00s) --- PASS: TestResolveS3Action_VersionTagging/put_current_tags (0.00s) --- PASS: TestResolveS3Action_VersionTagging/delete_current_tags (0.00s) --- PASS: TestResolveS3Action_VersionTagging/get_version_tags (0.00s) --- PASS: TestResolveS3Action_VersionTagging/put_version_tags (0.00s) --- PASS: TestResolveS3Action_VersionTagging/delete_version_tags (0.00s) --- PASS: TestResolveS3Action_VersionTagging/empty_versionId_stays_current (0.00s) --- PASS: TestResolveS3Action_VersionTagging/bucket_tagging_ignores_versionId (0.00s) --- PASS: TestResolveS3Action_VersionTagging/non-empty_tagging_is_still_tagging (0.00s) --- PASS: TestResolveS3Action_VersionTagging/non-empty_tagging_plain (0.00s) === RUN TestResolveS3Action_VersionAcl === RUN TestResolveS3Action_VersionAcl/get_current_acl === RUN TestResolveS3Action_VersionAcl/put_current_acl === RUN TestResolveS3Action_VersionAcl/get_version_acl === RUN TestResolveS3Action_VersionAcl/head_acl_resolves_as_head_object === RUN TestResolveS3Action_VersionAcl/head_version_acl_resolves_as_head_version === RUN TestResolveS3Action_VersionAcl/put_version_acl === RUN TestResolveS3Action_VersionAcl/empty_versionId_stays_current === RUN TestResolveS3Action_VersionAcl/bucket_acl_ignores_versionId --- PASS: TestResolveS3Action_VersionAcl (0.01s) --- PASS: TestResolveS3Action_VersionAcl/get_current_acl (0.00s) --- PASS: TestResolveS3Action_VersionAcl/put_current_acl (0.00s) --- PASS: TestResolveS3Action_VersionAcl/get_version_acl (0.00s) --- PASS: TestResolveS3Action_VersionAcl/head_acl_resolves_as_head_object (0.00s) --- PASS: TestResolveS3Action_VersionAcl/head_version_acl_resolves_as_head_version (0.00s) --- PASS: TestResolveS3Action_VersionAcl/put_version_acl (0.00s) --- PASS: TestResolveS3Action_VersionAcl/empty_versionId_stays_current (0.00s) --- PASS: TestResolveS3Action_VersionAcl/bucket_acl_ignores_versionId (0.00s) === RUN TestResolveS3Action_VersionAttributes === RUN TestResolveS3Action_VersionAttributes/get_current_attributes === RUN TestResolveS3Action_VersionAttributes/get_version_attributes --- PASS: TestResolveS3Action_VersionAttributes (0.00s) --- PASS: TestResolveS3Action_VersionAttributes/get_current_attributes (0.00s) --- PASS: TestResolveS3Action_VersionAttributes/get_version_attributes (0.00s) === RUN TestResolveS3Action_AdminBucketSubresources === RUN TestResolveS3Action_AdminBucketSubresources/get_encryption === RUN TestResolveS3Action_AdminBucketSubresources/put_encryption === RUN TestResolveS3Action_AdminBucketSubresources/delete_encryption === RUN TestResolveS3Action_AdminBucketSubresources/get_requestPayment === RUN TestResolveS3Action_AdminBucketSubresources/put_requestPayment === RUN TestResolveS3Action_AdminBucketSubresources/get_publicAccessBlock === RUN TestResolveS3Action_AdminBucketSubresources/put_publicAccessBlock === RUN TestResolveS3Action_AdminBucketSubresources/delete_publicAccessBlock === RUN TestResolveS3Action_AdminBucketSubresources/get_ownershipControls === RUN TestResolveS3Action_AdminBucketSubresources/put_ownershipControls === RUN TestResolveS3Action_AdminBucketSubresources/delete_ownershipControls --- PASS: TestResolveS3Action_AdminBucketSubresources (0.01s) --- PASS: TestResolveS3Action_AdminBucketSubresources/get_encryption (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/put_encryption (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/delete_encryption (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/get_requestPayment (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/put_requestPayment (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/get_publicAccessBlock (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/put_publicAccessBlock (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/delete_publicAccessBlock (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/get_ownershipControls (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/put_ownershipControls (0.00s) --- PASS: TestResolveS3Action_AdminBucketSubresources/delete_ownershipControls (0.00s) === RUN TestResolveS3Action_CreateBucket --- PASS: TestResolveS3Action_CreateBucket (0.00s) === RUN TestResolveS3Action_ListType === RUN TestResolveS3Action_ListType/list-type_alone === RUN TestResolveS3Action_ListType/list-type_with_listing_params === RUN TestResolveS3Action_ListType/list-type_with_ownershipControls === RUN TestResolveS3Action_ListType/list-type=1_with_ownershipControls --- PASS: TestResolveS3Action_ListType (0.00s) --- PASS: TestResolveS3Action_ListType/list-type_alone (0.00s) --- PASS: TestResolveS3Action_ListType/list-type_with_listing_params (0.00s) --- PASS: TestResolveS3Action_ListType/list-type_with_ownershipControls (0.00s) --- PASS: TestResolveS3Action_ListType/list-type=1_with_ownershipControls (0.00s) === RUN TestResolveS3Action_Quota === RUN TestResolveS3Action_Quota/quota_get === RUN TestResolveS3Action_Quota/quota_put === RUN TestResolveS3Action_Quota/policy_wins_over_quota === RUN TestResolveS3Action_Quota/quota_after_policy_wins_too === RUN TestResolveS3Action_Quota/tagging_wins_over_quota --- PASS: TestResolveS3Action_Quota (0.00s) --- PASS: TestResolveS3Action_Quota/quota_get (0.00s) --- PASS: TestResolveS3Action_Quota/quota_put (0.00s) --- PASS: TestResolveS3Action_Quota/policy_wins_over_quota (0.00s) --- PASS: TestResolveS3Action_Quota/quota_after_policy_wins_too (0.00s) --- PASS: TestResolveS3Action_Quota/tagging_wins_over_quota (0.00s) === RUN TestResolveS3ActionDedicatedObjectLockActions === RUN TestResolveS3ActionDedicatedObjectLockActions/bypass_on_versioned_delete_shape === RUN TestResolveS3ActionDedicatedObjectLockActions/bypass_on_batch_delete_shape === RUN TestResolveS3ActionDedicatedObjectLockActions/get_retention_with_versionId === RUN TestResolveS3ActionDedicatedObjectLockActions/put_retention_with_versionId === RUN TestResolveS3ActionDedicatedObjectLockActions/get_legal_hold_with_versionId === RUN TestResolveS3ActionDedicatedObjectLockActions/put_legal_hold_with_versionId === RUN TestResolveS3ActionDedicatedObjectLockActions/get_object-lock_config === RUN TestResolveS3ActionDedicatedObjectLockActions/put_object-lock_config --- PASS: TestResolveS3ActionDedicatedObjectLockActions (0.01s) --- PASS: TestResolveS3ActionDedicatedObjectLockActions/bypass_on_versioned_delete_shape (0.00s) --- PASS: TestResolveS3ActionDedicatedObjectLockActions/bypass_on_batch_delete_shape (0.00s) --- PASS: TestResolveS3ActionDedicatedObjectLockActions/get_retention_with_versionId (0.00s) --- PASS: TestResolveS3ActionDedicatedObjectLockActions/put_retention_with_versionId (0.00s) --- PASS: TestResolveS3ActionDedicatedObjectLockActions/get_legal_hold_with_versionId (0.00s) --- PASS: TestResolveS3ActionDedicatedObjectLockActions/put_legal_hold_with_versionId (0.00s) --- PASS: TestResolveS3ActionDedicatedObjectLockActions/get_object-lock_config (0.00s) --- PASS: TestResolveS3ActionDedicatedObjectLockActions/put_object-lock_config (0.00s) === RUN TestResolveS3ActionKeepsNonS3Service === RUN TestResolveS3ActionKeepsNonS3Service/iam_action_with_batch_delete_query === RUN TestResolveS3ActionKeepsNonS3Service/iam_action_with_acl_query === RUN TestResolveS3ActionKeepsNonS3Service/iam_action_with_tagging_query === RUN TestResolveS3ActionKeepsNonS3Service/sts_action_with_batch_delete_query --- PASS: TestResolveS3ActionKeepsNonS3Service (0.00s) --- PASS: TestResolveS3ActionKeepsNonS3Service/iam_action_with_batch_delete_query (0.00s) --- PASS: TestResolveS3ActionKeepsNonS3Service/iam_action_with_acl_query (0.00s) --- PASS: TestResolveS3ActionKeepsNonS3Service/iam_action_with_tagging_query (0.00s) --- PASS: TestResolveS3ActionKeepsNonS3Service/sts_action_with_batch_delete_query (0.00s) === RUN TestBucketEncryptionOpsOnMissingBucket --- PASS: TestBucketEncryptionOpsOnMissingBucket (0.04s) === RUN TestPutBucketPolicyOnMissingBucket --- PASS: TestPutBucketPolicyOnMissingBucket (0.01s) === RUN TestBucketPolicyOpsOnVanishedUpdateEntry === RUN TestBucketPolicyOpsOnVanishedUpdateEntry/put === RUN TestBucketPolicyOpsOnVanishedUpdateEntry/delete --- PASS: TestBucketPolicyOpsOnVanishedUpdateEntry (0.04s) --- PASS: TestBucketPolicyOpsOnVanishedUpdateEntry/put (0.02s) --- PASS: TestBucketPolicyOpsOnVanishedUpdateEntry/delete (0.02s) === RUN TestBucketConfigWritesOnVanishedPatch === RUN TestBucketConfigWritesOnVanishedPatch/put_bucket_encryption === RUN TestBucketConfigWritesOnVanishedPatch/update_bucket_config === RUN TestBucketConfigWritesOnVanishedPatch/unchanged_config_value --- PASS: TestBucketConfigWritesOnVanishedPatch (0.11s) --- PASS: TestBucketConfigWritesOnVanishedPatch/put_bucket_encryption (0.06s) --- PASS: TestBucketConfigWritesOnVanishedPatch/update_bucket_config (0.03s) --- PASS: TestBucketConfigWritesOnVanishedPatch/unchanged_config_value (0.01s) === RUN TestContentEncodingPreservation === RUN TestContentEncodingPreservation/gzip_encoding === RUN TestContentEncodingPreservation/zstd_encoding === RUN TestContentEncodingPreservation/deflate_encoding === RUN TestContentEncodingPreservation/br_(Brotli)_encoding === RUN TestContentEncodingPreservation/multiple_encodings === RUN TestContentEncodingPreservation/encoding_with_language === RUN TestContentEncodingPreservation/language_only --- PASS: TestContentEncodingPreservation (0.01s) --- PASS: TestContentEncodingPreservation/gzip_encoding (0.00s) --- PASS: TestContentEncodingPreservation/zstd_encoding (0.00s) --- PASS: TestContentEncodingPreservation/deflate_encoding (0.00s) --- PASS: TestContentEncodingPreservation/br_(Brotli)_encoding (0.00s) --- PASS: TestContentEncodingPreservation/multiple_encodings (0.00s) --- PASS: TestContentEncodingPreservation/encoding_with_language (0.00s) --- PASS: TestContentEncodingPreservation/language_only (0.00s) === RUN TestContentEncodingWithOtherHeaders --- PASS: TestContentEncodingWithOtherHeaders (0.00s) === RUN TestContentEncodingDropsAwsChunked === RUN TestContentEncodingDropsAwsChunked/last === RUN TestContentEncodingDropsAwsChunked/first === RUN TestContentEncodingDropsAwsChunked/no_spaces === RUN TestContentEncodingDropsAwsChunked/alone === RUN TestContentEncodingDropsAwsChunked/capitals === RUN TestContentEncodingDropsAwsChunked/twice === RUN TestContentEncodingDropsAwsChunked/separate_fields === RUN TestContentEncodingDropsAwsChunked/separate_fields,_alone === RUN TestContentEncodingDropsAwsChunked/without_aws-chunked === RUN TestContentEncodingDropsAwsChunked/without_aws-chunked,_separate_fields --- PASS: TestContentEncodingDropsAwsChunked (0.01s) --- PASS: TestContentEncodingDropsAwsChunked/last (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/first (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/no_spaces (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/alone (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/capitals (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/twice (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/separate_fields (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/separate_fields,_alone (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/without_aws-chunked (0.00s) --- PASS: TestContentEncodingDropsAwsChunked/without_aws-chunked,_separate_fields (0.00s) === RUN TestEncodePath --- PASS: TestEncodePath (0.00s) === RUN TestEncodePathEqual --- PASS: TestEncodePathEqual (0.00s) === RUN TestS3EndToEndWithJWT I1117 09:41:46.664145 config_loader.go:73 Using explicit credential store: memory === RUN TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow === RUN TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_CreateBucket s3_end_to_end_test.go:916: S3 Operation: PUT /test-bucket -> 403 (DENIED) === RUN TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_ListBucket s3_end_to_end_test.go:916: S3 Operation: GET /test-bucket -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_PutObject s3_end_to_end_test.go:916: S3 Operation: PUT /test-bucket/test-file.txt -> 403 (DENIED) === RUN TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_GetObject s3_end_to_end_test.go:916: S3 Operation: GET /test-bucket/test-file.txt -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_HeadObject s3_end_to_end_test.go:916: S3 Operation: HEAD /test-bucket/test-file.txt -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_DeleteObject s3_end_to_end_test.go:916: S3 Operation: DELETE /test-bucket/test-file.txt -> 403 (DENIED) === RUN TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow === RUN TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_CreateBucket s3_end_to_end_test.go:916: S3 Operation: PUT /admin-bucket -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_PutObject s3_end_to_end_test.go:916: S3 Operation: PUT /admin-bucket/admin-file.txt -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_GetObject s3_end_to_end_test.go:916: S3 Operation: GET /admin-bucket/admin-file.txt -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_DeleteObject s3_end_to_end_test.go:916: S3 Operation: DELETE /admin-bucket/admin-file.txt -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_DeleteBucket s3_end_to_end_test.go:916: S3 Operation: DELETE /admin-bucket -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_IP-Restricted_Role === RUN TestS3EndToEndWithJWT/S3_IP-Restricted_Role/S3_IP-Restricted_Role_GetObject s3_end_to_end_test.go:916: S3 Operation: GET /restricted-bucket/file.txt -> 200 (ALLOWED) === RUN TestS3EndToEndWithJWT/S3_IP-Restricted_Role/S3_IP-Restricted_Role_GetObject#01 s3_end_to_end_test.go:916: S3 Operation: GET /restricted-bucket/file.txt -> 403 (DENIED) --- PASS: TestS3EndToEndWithJWT (0.22s) --- PASS: TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow (0.10s) --- PASS: TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_CreateBucket (0.02s) --- PASS: TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_ListBucket (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_PutObject (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_GetObject (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_HeadObject (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Read-Only_Role_Complete_Workflow/S3_Read-Only_Role_Complete_Workflow_DeleteObject (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow (0.07s) --- PASS: TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_CreateBucket (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_PutObject (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_GetObject (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_DeleteObject (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_Admin_Role_Complete_Workflow/S3_Admin_Role_Complete_Workflow_DeleteBucket (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_IP-Restricted_Role (0.04s) --- PASS: TestS3EndToEndWithJWT/S3_IP-Restricted_Role/S3_IP-Restricted_Role_GetObject (0.01s) --- PASS: TestS3EndToEndWithJWT/S3_IP-Restricted_Role/S3_IP-Restricted_Role_GetObject#01 (0.01s) === RUN TestS3MultipartUploadWithJWT I1117 09:41:46.881958 config_loader.go:73 Using explicit credential store: memory === RUN TestS3MultipartUploadWithJWT/Initialize_Multipart_Upload s3_end_to_end_test.go:916: S3 Operation: POST /multipart-bucket/large-file.txt?uploads -> 404 (DENIED) s3_end_to_end_test.go:922: Non-auth error: Not found === RUN TestS3MultipartUploadWithJWT/Upload_Part s3_end_to_end_test.go:916: S3 Operation: PUT /multipart-bucket/large-file.txt?partNumber=1&uploadId=test-upload-id -> 200 (ALLOWED) === RUN TestS3MultipartUploadWithJWT/List_Parts s3_end_to_end_test.go:916: S3 Operation: GET /multipart-bucket/large-file.txt?uploadId=test-upload-id -> 200 (ALLOWED) === RUN TestS3MultipartUploadWithJWT/Complete_Multipart_Upload s3_end_to_end_test.go:916: S3 Operation: POST /multipart-bucket/large-file.txt?uploadId=test-upload-id -> 404 (DENIED) s3_end_to_end_test.go:922: Non-auth error: Not found --- PASS: TestS3MultipartUploadWithJWT (0.04s) --- PASS: TestS3MultipartUploadWithJWT/Initialize_Multipart_Upload (0.00s) --- PASS: TestS3MultipartUploadWithJWT/Upload_Part (0.01s) --- PASS: TestS3MultipartUploadWithJWT/List_Parts (0.01s) --- PASS: TestS3MultipartUploadWithJWT/Complete_Multipart_Upload (0.00s) === RUN TestS3ListObjectsV2PrefixCondition === RUN TestS3ListObjectsV2PrefixCondition/ListObjectsV2_with_matching_prefix_query_param_and_empty_objectKey === RUN TestS3ListObjectsV2PrefixCondition/ListObjectsV2_with_matching_prefix_propagated_as_objectKey === RUN TestS3ListObjectsV2PrefixCondition/ListObjectsV1_with_matching_prefix_query_param === RUN TestS3ListObjectsV2PrefixCondition/ListObjectsV2_with_non-matching_prefix_should_be_denied === RUN TestS3ListObjectsV2PrefixCondition/ListObjectsV2_with_no_prefix_should_be_denied --- PASS: TestS3ListObjectsV2PrefixCondition (0.05s) --- PASS: TestS3ListObjectsV2PrefixCondition/ListObjectsV2_with_matching_prefix_query_param_and_empty_objectKey (0.01s) --- PASS: TestS3ListObjectsV2PrefixCondition/ListObjectsV2_with_matching_prefix_propagated_as_objectKey (0.01s) --- PASS: TestS3ListObjectsV2PrefixCondition/ListObjectsV1_with_matching_prefix_query_param (0.01s) --- PASS: TestS3ListObjectsV2PrefixCondition/ListObjectsV2_with_non-matching_prefix_should_be_denied (0.01s) --- PASS: TestS3ListObjectsV2PrefixCondition/ListObjectsV2_with_no_prefix_should_be_denied (0.01s) === RUN TestS3CreateBucketWithAttachedPolicy === RUN TestS3CreateBucketWithAttachedPolicy/CreateBucket_on_matching_bucket_is_allowed === RUN TestS3CreateBucketWithAttachedPolicy/CreateBucket_outside_the_resource_pattern_is_denied === RUN TestS3CreateBucketWithAttachedPolicy/PutBucketEncryption_is_not_swept_into_CreateBucket === RUN TestS3CreateBucketWithAttachedPolicy/DeleteBucket_on_matching_bucket_is_allowed --- PASS: TestS3CreateBucketWithAttachedPolicy (0.04s) --- PASS: TestS3CreateBucketWithAttachedPolicy/CreateBucket_on_matching_bucket_is_allowed (0.01s) --- PASS: TestS3CreateBucketWithAttachedPolicy/CreateBucket_outside_the_resource_pattern_is_denied (0.01s) --- PASS: TestS3CreateBucketWithAttachedPolicy/PutBucketEncryption_is_not_swept_into_CreateBucket (0.01s) --- PASS: TestS3CreateBucketWithAttachedPolicy/DeleteBucket_on_matching_bucket_is_allowed (0.01s) === RUN TestS3CORSWithJWT I1117 09:41:47.010558 config_loader.go:73 Using explicit credential store: memory --- PASS: TestS3CORSWithJWT (0.01s) === RUN TestS3PerformanceWithIAM I1117 09:41:47.016999 config_loader.go:73 Using explicit credential store: memory s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-0.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-1.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-2.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-3.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-4.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-5.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-6.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-7.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-8.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-9.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-10.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-11.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-12.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-13.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-14.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-15.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-16.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-17.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-18.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-19.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-20.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-21.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-22.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-23.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-24.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-25.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-26.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-27.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-28.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-29.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-30.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-31.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-32.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-33.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-34.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-35.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-36.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-37.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-38.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-39.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-40.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-41.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-42.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-43.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-44.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-45.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-46.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-47.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-48.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-49.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-50.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-51.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-52.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-53.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-54.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-55.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-56.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-57.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-58.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-59.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-60.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-61.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-62.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-63.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-64.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-65.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-66.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-67.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-68.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-69.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-70.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-71.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-72.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-73.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-74.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-75.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-76.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-77.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-78.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-79.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-80.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-81.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-82.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-83.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-84.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-85.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-86.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-87.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-88.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-89.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-90.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-91.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-92.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-93.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-94.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-95.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-96.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-97.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-98.txt -> 200 (ALLOWED) s3_end_to_end_test.go:916: S3 Operation: GET /perf-bucket/file-99.txt -> 200 (ALLOWED) s3_end_to_end_test.go:550: Performance Results: s3_end_to_end_test.go:551: - Total requests: 100 s3_end_to_end_test.go:552: - Total time: 1.102557692s s3_end_to_end_test.go:553: - Average latency: 11.025576ms s3_end_to_end_test.go:554: - Requests per second: 90.70 s3_end_to_end_test.go:557: Error Trace: /build/seaweedfs/src/seaweedfs-4.54/weed/s3api/s3_end_to_end_test.go:557 Error: "11.025576ms" is not less than "10ms" Test: TestS3PerformanceWithIAM Messages: IAM overhead should be minimal --- FAIL: TestS3PerformanceWithIAM (1.12s) === RUN TestS3AuthenticationDenied I1117 09:41:48.136284 config_loader.go:73 Using explicit credential store: memory === RUN TestS3AuthenticationDenied/no_authorization_header === RUN TestS3AuthenticationDenied/empty_bearer_token === RUN TestS3AuthenticationDenied/invalid_jwt_token === RUN TestS3AuthenticationDenied/malformed_authorization_header === RUN TestS3AuthenticationDenied/expired_jwt_token --- PASS: TestS3AuthenticationDenied (0.02s) --- PASS: TestS3AuthenticationDenied/no_authorization_header (0.00s) --- PASS: TestS3AuthenticationDenied/empty_bearer_token (0.00s) --- PASS: TestS3AuthenticationDenied/invalid_jwt_token (0.00s) --- PASS: TestS3AuthenticationDenied/malformed_authorization_header (0.00s) --- PASS: TestS3AuthenticationDenied/expired_jwt_token (0.00s) === RUN TestS3IAMOnlyModeRejectsAnonymous --- PASS: TestS3IAMOnlyModeRejectsAnonymous (0.00s) === RUN TestCheckPolicyWithEntry === RUN TestCheckPolicyWithEntry/object_with_public_tag_-_allow === RUN TestCheckPolicyWithEntry/object_with_private_tag_-_indeterminate_(no_matching_statement) === RUN TestCheckPolicyWithEntry/object_with_no_tags_-_indeterminate_(no_matching_statement) === RUN TestCheckPolicyWithEntry/nil_entry_-_indeterminate_(condition_cannot_be_evaluated) === RUN TestCheckPolicyWithEntry/object_with_multiple_tags_including_public_-_allow --- PASS: TestCheckPolicyWithEntry (0.01s) --- PASS: TestCheckPolicyWithEntry/object_with_public_tag_-_allow (0.00s) --- PASS: TestCheckPolicyWithEntry/object_with_private_tag_-_indeterminate_(no_matching_statement) (0.00s) --- PASS: TestCheckPolicyWithEntry/object_with_no_tags_-_indeterminate_(no_matching_statement) (0.00s) --- PASS: TestCheckPolicyWithEntry/nil_entry_-_indeterminate_(condition_cannot_be_evaluated) (0.00s) --- PASS: TestCheckPolicyWithEntry/object_with_multiple_tags_including_public_-_allow (0.00s) === RUN TestCheckPolicyWithEntryNoPolicyForBucket --- PASS: TestCheckPolicyWithEntryNoPolicyForBucket (0.00s) === RUN TestCheckPolicyWithEntryNilPolicyEngine --- PASS: TestCheckPolicyWithEntryNilPolicyEngine (0.00s) === RUN TestCheckPolicyWithEntryDenyPolicy === RUN TestCheckPolicyWithEntryDenyPolicy/public_object_-_allow === RUN TestCheckPolicyWithEntryDenyPolicy/confidential_object_-_deny === RUN TestCheckPolicyWithEntryDenyPolicy/no_classification_tag_-_allow --- PASS: TestCheckPolicyWithEntryDenyPolicy (0.01s) --- PASS: TestCheckPolicyWithEntryDenyPolicy/public_object_-_allow (0.00s) --- PASS: TestCheckPolicyWithEntryDenyPolicy/confidential_object_-_deny (0.00s) --- PASS: TestCheckPolicyWithEntryDenyPolicy/no_classification_tag_-_allow (0.00s) === RUN TestHasPolicyForBucket --- PASS: TestHasPolicyForBucket (0.00s) === RUN TestRecheckCopySourcePolicy --- PASS: TestRecheckCopySourcePolicy (0.01s) === RUN TestRecheckPolicyForKeyWithLookup --- PASS: TestRecheckPolicyForKeyWithLookup (0.02s) === RUN TestRecheckTagConditionedPolicyWithLookupDelete --- PASS: TestRecheckTagConditionedPolicyWithLookupDelete (0.05s) === RUN TestRecheckObjectAclTagConditionedPolicy --- PASS: TestRecheckObjectAclTagConditionedPolicy (0.01s) === RUN TestCheckVersionReadGrant --- PASS: TestCheckVersionReadGrant (0.01s) === RUN TestCheckVersionReadGrantPreservesQueryAuth --- PASS: TestCheckVersionReadGrantPreservesQueryAuth (0.01s) === RUN TestGranularActionMappingSecurity === RUN TestGranularActionMappingSecurity/delete_object_security_fix s3_granular_action_security_test.go:167: SECURITY IMPROVEMENT: DELETE object operations should map to s3:DeleteObject, not s3:PutObject s3_granular_action_security_test.go:168: Problem Fixed: Old mapping incorrectly mapped DELETE object to s3:PutObject, allowing users with only PUT permissions to delete objects - a critical security flaw s3_granular_action_security_test.go:169: Granular Action: s3:DeleteObject === RUN TestGranularActionMappingSecurity/get_object_acl_precision s3_granular_action_security_test.go:167: SECURITY IMPROVEMENT: GET object ACL should map to s3:GetObjectAcl, not generic s3:GetObject s3_granular_action_security_test.go:168: Problem Fixed: Old mapping would allow users with s3:GetObject permission to read ACLs, potentially exposing sensitive permission information s3_granular_action_security_test.go:169: Granular Action: s3:GetObjectAcl === RUN TestGranularActionMappingSecurity/put_object_tagging_precision s3_granular_action_security_test.go:167: SECURITY IMPROVEMENT: PUT object tagging should map to s3:PutObjectTagging, not generic s3:PutObject s3_granular_action_security_test.go:168: Problem Fixed: Old mapping couldn't distinguish between actual object uploads and metadata operations like tagging, making fine-grained permissions impossible s3_granular_action_security_test.go:169: Granular Action: s3:PutObjectTagging === RUN TestGranularActionMappingSecurity/multipart_upload_precision s3_granular_action_security_test.go:167: SECURITY IMPROVEMENT: Multipart upload initiation should map to s3:CreateMultipartUpload s3_granular_action_security_test.go:168: Problem Fixed: Old mapping would treat multipart operations as generic s3:PutObject, preventing policies that allow regular uploads but restrict large multipart operations s3_granular_action_security_test.go:169: Granular Action: s3:CreateMultipartUpload === RUN TestGranularActionMappingSecurity/bucket_policy_vs_bucket_creation s3_granular_action_security_test.go:167: SECURITY IMPROVEMENT: Bucket policy modifications should map to s3:PutBucketPolicy, not s3:CreateBucket s3_granular_action_security_test.go:168: Problem Fixed: Old mapping couldn't distinguish between creating buckets and modifying bucket policies, potentially allowing unauthorized policy changes s3_granular_action_security_test.go:169: Granular Action: s3:PutBucketPolicy === RUN TestGranularActionMappingSecurity/list_vs_read_distinction s3_granular_action_security_test.go:167: SECURITY IMPROVEMENT: Listing multipart uploads should map to s3:ListBucketMultipartUploads s3_granular_action_security_test.go:168: Problem Fixed: Old mapping would use generic s3:ListBucket for all bucket operations, preventing fine-grained control over who can see ongoing multipart operations s3_granular_action_security_test.go:169: Granular Action: s3:ListBucketMultipartUploads === RUN TestGranularActionMappingSecurity/delete_object_tagging_precision s3_granular_action_security_test.go:167: SECURITY IMPROVEMENT: Delete object tagging should map to s3:DeleteObjectTagging, not s3:DeleteObject s3_granular_action_security_test.go:168: Problem Fixed: Old mapping couldn't distinguish between deleting objects and deleting tags, preventing policies that allow tag management but not object deletion s3_granular_action_security_test.go:169: Granular Action: s3:DeleteObjectTagging --- PASS: TestGranularActionMappingSecurity (0.01s) --- PASS: TestGranularActionMappingSecurity/delete_object_security_fix (0.00s) --- PASS: TestGranularActionMappingSecurity/get_object_acl_precision (0.00s) --- PASS: TestGranularActionMappingSecurity/put_object_tagging_precision (0.00s) --- PASS: TestGranularActionMappingSecurity/multipart_upload_precision (0.00s) --- PASS: TestGranularActionMappingSecurity/bucket_policy_vs_bucket_creation (0.00s) --- PASS: TestGranularActionMappingSecurity/list_vs_read_distinction (0.00s) --- PASS: TestGranularActionMappingSecurity/delete_object_tagging_precision (0.00s) === RUN TestBackwardCompatibilityFallback === RUN TestBackwardCompatibilityFallback/generic_read_fallback s3_granular_action_security_test.go:237: COMPATIBILITY: Generic read operations should fall back to s3:GetObject for compatibility - s3:GetObject === RUN TestBackwardCompatibilityFallback/generic_write_fallback s3_granular_action_security_test.go:237: COMPATIBILITY: Generic write operations should fall back to s3:PutObject for compatibility - s3:PutObject === RUN TestBackwardCompatibilityFallback/already_granular_passthrough s3_granular_action_security_test.go:237: COMPATIBILITY: Already granular actions should pass through unchanged - s3:GetBucketLocation === RUN TestBackwardCompatibilityFallback/unknown_action_conversion s3_granular_action_security_test.go:237: COMPATIBILITY: Unknown actions should be converted to S3 format for consistency - s3:CustomAction --- PASS: TestBackwardCompatibilityFallback (0.00s) --- PASS: TestBackwardCompatibilityFallback/generic_read_fallback (0.00s) --- PASS: TestBackwardCompatibilityFallback/generic_write_fallback (0.00s) --- PASS: TestBackwardCompatibilityFallback/already_granular_passthrough (0.00s) --- PASS: TestBackwardCompatibilityFallback/unknown_action_conversion (0.00s) === RUN TestPolicyEnforcementScenarios === RUN TestPolicyEnforcementScenarios/allow_read_deny_acl_access s3_granular_action_security_test.go:338: SECURITY SCENARIO: allow_read_deny_acl_access s3_granular_action_security_test.go:339: Expected Action: s3:GetObjectAcl s3_granular_action_security_test.go:340: Security Benefit: Policy allows reading objects but denies ACL access - granular actions enable this distinction s3_granular_action_security_test.go:341: Policy Example: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": "s3:GetObject", "Resource": "arn:aws:s3:::sensitive-bucket/*" } ] } === RUN TestPolicyEnforcementScenarios/allow_tagging_deny_object_modification s3_granular_action_security_test.go:338: SECURITY SCENARIO: allow_tagging_deny_object_modification s3_granular_action_security_test.go:339: Expected Action: s3:PutObjectTagging s3_granular_action_security_test.go:340: Security Benefit: Policy allows tag management but prevents actual object uploads - critical for metadata-only roles s3_granular_action_security_test.go:341: Policy Example: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": ["s3:PutObjectTagging", "s3:DeleteObjectTagging"], "Resource": "arn:aws:s3:::data-bucket/*" } ] } === RUN TestPolicyEnforcementScenarios/restrict_multipart_uploads s3_granular_action_security_test.go:338: SECURITY SCENARIO: restrict_multipart_uploads s3_granular_action_security_test.go:339: Expected Action: s3:CreateMultipartUpload s3_granular_action_security_test.go:340: Security Benefit: Policy allows regular uploads but blocks large multipart uploads - prevents resource abuse s3_granular_action_security_test.go:341: Policy Example: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": "s3:PutObject", "Resource": "arn:aws:s3:::uploads/*" }, { "Effect": "Deny", "Action": ["s3:CreateMultipartUpload", "s3:UploadPart"], "Resource": "arn:aws:s3:::uploads/*" } ] } --- PASS: TestPolicyEnforcementScenarios (0.01s) --- PASS: TestPolicyEnforcementScenarios/allow_read_deny_acl_access (0.00s) --- PASS: TestPolicyEnforcementScenarios/allow_tagging_deny_object_modification (0.00s) --- PASS: TestPolicyEnforcementScenarios/restrict_multipart_uploads (0.00s) === RUN TestDeleteObjectPolicyEnforcement === RUN TestDeleteObjectPolicyEnforcement/delete_object_maps_to_correct_action s3_granular_action_security_test.go:414: ARCHITECTURAL FIX VERIFIED: delete_object_maps_to_correct_action s3_granular_action_security_test.go:415: Method: DELETE -> S3 Action: s3:DeleteObject s3_granular_action_security_test.go:416: Policy Scenario: Policy that denies s3:DeleteObject but allows s3:PutObject should now work correctly === RUN TestDeleteObjectPolicyEnforcement/put_object_maps_to_correct_action s3_granular_action_security_test.go:414: ARCHITECTURAL FIX VERIFIED: put_object_maps_to_correct_action s3_granular_action_security_test.go:415: Method: PUT -> S3 Action: s3:PutObject s3_granular_action_security_test.go:416: Policy Scenario: Policy that allows s3:PutObject but denies s3:DeleteObject should allow uploads === RUN TestDeleteObjectPolicyEnforcement/batch_delete_maps_to_delete_action s3_granular_action_security_test.go:414: ARCHITECTURAL FIX VERIFIED: batch_delete_maps_to_delete_action s3_granular_action_security_test.go:415: Method: POST -> S3 Action: s3:DeleteObject s3_granular_action_security_test.go:416: Policy Scenario: Batch delete operations should also map to s3:DeleteObject --- PASS: TestDeleteObjectPolicyEnforcement (0.01s) --- PASS: TestDeleteObjectPolicyEnforcement/delete_object_maps_to_correct_action (0.00s) --- PASS: TestDeleteObjectPolicyEnforcement/put_object_maps_to_correct_action (0.00s) --- PASS: TestDeleteObjectPolicyEnforcement/batch_delete_maps_to_delete_action (0.00s) === RUN TestFineGrainedPolicyExample s3_granular_action_security_test.go:486: Testing Fine-Grained Policy: s3_granular_action_security_test.go:487: { "Version": "2012-10-17", "Statement": [ { "Sid": "AllowObjectUploads", "Effect": "Allow", "Action": "s3:PutObject", "Resource": "arn:aws:s3:::test-bucket/*" }, { "Sid": "DenyObjectDeletion", "Effect": "Deny", "Action": "s3:DeleteObject", "Resource": "arn:aws:s3:::test-bucket/*" } ] } === RUN TestFineGrainedPolicyExample/PUT_object s3_granular_action_security_test.go:519: [ALLOWED] PUT object -> s3:PutObject s3_granular_action_security_test.go:520: Rationale: Policy explicitly allows s3:PutObject - upload should succeed === RUN TestFineGrainedPolicyExample/DELETE_object s3_granular_action_security_test.go:519: [DENIED] DELETE object -> s3:DeleteObject s3_granular_action_security_test.go:520: Rationale: Policy explicitly denies s3:DeleteObject - deletion should be blocked === RUN TestFineGrainedPolicyExample/Batch_DELETE s3_granular_action_security_test.go:519: [DENIED] Batch DELETE -> s3:DeleteObject s3_granular_action_security_test.go:520: Rationale: Policy explicitly denies s3:DeleteObject - batch deletion should be blocked === NAME TestFineGrainedPolicyExample s3_granular_action_security_test.go:524: ARCHITECTURAL LIMITATION RESOLVED! s3_granular_action_security_test.go:525: Fine-grained policies like 'allow PUT but deny DELETE' now work correctly s3_granular_action_security_test.go:526: The policy engine can distinguish between s3:PutObject and s3:DeleteObject --- PASS: TestFineGrainedPolicyExample (0.01s) --- PASS: TestFineGrainedPolicyExample/PUT_object (0.00s) --- PASS: TestFineGrainedPolicyExample/DELETE_object (0.00s) --- PASS: TestFineGrainedPolicyExample/Batch_DELETE (0.00s) === RUN TestCoarseActionResolution === RUN TestCoarseActionResolution/PUT_with_ACTION_WRITE_resolves_to_PutObject s3_granular_action_security_test.go:595: SUCCESS: PUT_with_ACTION_WRITE_resolves_to_PutObject s3_granular_action_security_test.go:596: Input: PUT /test-bucket/test-file.txt + ACTION_WRITE s3_granular_action_security_test.go:597: Output: s3:PutObject s3_granular_action_security_test.go:598: Policy impact: Policy allowing s3:PutObject should match PUT requests === RUN TestCoarseActionResolution/DELETE_with_ACTION_WRITE_resolves_to_DeleteObject s3_granular_action_security_test.go:595: SUCCESS: DELETE_with_ACTION_WRITE_resolves_to_DeleteObject s3_granular_action_security_test.go:596: Input: DELETE /test-bucket/test-file.txt + ACTION_WRITE s3_granular_action_security_test.go:597: Output: s3:DeleteObject s3_granular_action_security_test.go:598: Policy impact: Policy denying s3:DeleteObject should block DELETE requests === RUN TestCoarseActionResolution/batch_DELETE_with_ACTION_WRITE_resolves_to_DeleteObject s3_granular_action_security_test.go:595: SUCCESS: batch_DELETE_with_ACTION_WRITE_resolves_to_DeleteObject s3_granular_action_security_test.go:596: Input: POST /test-bucket + ACTION_WRITE s3_granular_action_security_test.go:597: Output: s3:DeleteObject s3_granular_action_security_test.go:598: Policy impact: Policy denying s3:DeleteObject should block batch DELETE === RUN TestCoarseActionResolution/POST_multipart_with_ACTION_WRITE_resolves_to_CreateMultipartUpload s3_granular_action_security_test.go:595: SUCCESS: POST_multipart_with_ACTION_WRITE_resolves_to_CreateMultipartUpload s3_granular_action_security_test.go:596: Input: POST /test-bucket/large-file.mp4 + ACTION_WRITE s3_granular_action_security_test.go:597: Output: s3:CreateMultipartUpload s3_granular_action_security_test.go:598: Policy impact: Policy allowing s3:PutObject but denying s3:CreateMultipartUpload can now work === NAME TestCoarseActionResolution s3_granular_action_security_test.go:602: === ARCHITECTURAL LIMITATION RESOLVED === s3_granular_action_security_test.go:603: Handlers can use coarse ACTION_WRITE constant, and the context-aware s3_granular_action_security_test.go:604: resolver will map it to the correct specific S3 action (PutObject, s3_granular_action_security_test.go:605: DeleteObject, CreateMultipartUpload, etc.) based on HTTP method and s3_granular_action_security_test.go:606: query parameters. This enables fine-grained bucket policies like: s3_granular_action_security_test.go:607: - Allow s3:PutObject but Deny s3:DeleteObject (append-only) s3_granular_action_security_test.go:608: - Allow regular uploads but Deny multipart (size limits) --- PASS: TestCoarseActionResolution (0.01s) --- PASS: TestCoarseActionResolution/PUT_with_ACTION_WRITE_resolves_to_PutObject (0.00s) --- PASS: TestCoarseActionResolution/DELETE_with_ACTION_WRITE_resolves_to_DeleteObject (0.00s) --- PASS: TestCoarseActionResolution/batch_DELETE_with_ACTION_WRITE_resolves_to_DeleteObject (0.00s) --- PASS: TestCoarseActionResolution/POST_multipart_with_ACTION_WRITE_resolves_to_CreateMultipartUpload (0.00s) === RUN TestOIDCBearerEnforcesRoleTrustPolicy --- PASS: TestOIDCBearerEnforcesRoleTrustPolicy (2.13s) === RUN TestOIDCBearerUserIDIsIssuerScoped --- PASS: TestOIDCBearerUserIDIsIssuerScoped (2.66s) === RUN TestTrustedOIDCIssuersFailsClosedOnStoreError --- PASS: TestTrustedOIDCIssuersFailsClosedOnStoreError (0.00s) === RUN TestGroupsRolesPolicyEnforcement === RUN TestGroupsRolesPolicyEnforcement/group_member_gets_team-a_bucket_only === RUN TestGroupsRolesPolicyEnforcement/role_holder_gets_team-b_bucket_only === RUN TestGroupsRolesPolicyEnforcement/member_of_both_gets_both_buckets_in_one_session === RUN TestGroupsRolesPolicyEnforcement/user_without_matching_claims_is_denied_everywhere --- PASS: TestGroupsRolesPolicyEnforcement (0.13s) --- PASS: TestGroupsRolesPolicyEnforcement/group_member_gets_team-a_bucket_only (0.02s) --- PASS: TestGroupsRolesPolicyEnforcement/role_holder_gets_team-b_bucket_only (0.04s) --- PASS: TestGroupsRolesPolicyEnforcement/member_of_both_gets_both_buckets_in_one_session (0.03s) --- PASS: TestGroupsRolesPolicyEnforcement/user_without_matching_claims_is_denied_everywhere (0.02s) === RUN TestGroupsRolesSessionRequestContext --- PASS: TestGroupsRolesSessionRequestContext (0.01s) === RUN TestSelectPrimaryRole === RUN TestSelectPrimaryRole/empty_roles_returns_empty === RUN TestSelectPrimaryRole/single_role_returns_that_role === RUN TestSelectPrimaryRole/multiple_roles_returns_first === RUN TestSelectPrimaryRole/order_matters === RUN TestSelectPrimaryRole/complex_enterprise_roles --- PASS: TestSelectPrimaryRole (0.00s) --- PASS: TestSelectPrimaryRole/empty_roles_returns_empty (0.00s) --- PASS: TestSelectPrimaryRole/single_role_returns_that_role (0.00s) --- PASS: TestSelectPrimaryRole/multiple_roles_returns_first (0.00s) --- PASS: TestSelectPrimaryRole/order_matters (0.00s) --- PASS: TestSelectPrimaryRole/complex_enterprise_roles (0.00s) === RUN TestJWTAuthenticationFlow === RUN TestJWTAuthenticationFlow/Read-Only_JWT_Authentication === RUN TestJWTAuthenticationFlow/Read-Only_JWT_Authentication/Read === RUN TestJWTAuthenticationFlow/Read-Only_JWT_Authentication/Write === RUN TestJWTAuthenticationFlow/Read-Only_JWT_Authentication/List === RUN TestJWTAuthenticationFlow/Admin_JWT_Authentication === RUN TestJWTAuthenticationFlow/Admin_JWT_Authentication/Read === RUN TestJWTAuthenticationFlow/Admin_JWT_Authentication/Write === RUN TestJWTAuthenticationFlow/Admin_JWT_Authentication/DeleteBucket --- PASS: TestJWTAuthenticationFlow (0.08s) --- PASS: TestJWTAuthenticationFlow/Read-Only_JWT_Authentication (0.04s) --- PASS: TestJWTAuthenticationFlow/Read-Only_JWT_Authentication/Read (0.01s) --- PASS: TestJWTAuthenticationFlow/Read-Only_JWT_Authentication/Write (0.01s) --- PASS: TestJWTAuthenticationFlow/Read-Only_JWT_Authentication/List (0.01s) --- PASS: TestJWTAuthenticationFlow/Admin_JWT_Authentication (0.04s) --- PASS: TestJWTAuthenticationFlow/Admin_JWT_Authentication/Read (0.01s) --- PASS: TestJWTAuthenticationFlow/Admin_JWT_Authentication/Write (0.01s) --- PASS: TestJWTAuthenticationFlow/Admin_JWT_Authentication/DeleteBucket (0.01s) === RUN TestJWTTokenValidation === RUN TestJWTTokenValidation/Empty_token === RUN TestJWTTokenValidation/Invalid_token_format === RUN TestJWTTokenValidation/Expired_token --- PASS: TestJWTTokenValidation (0.00s) --- PASS: TestJWTTokenValidation/Empty_token (0.00s) --- PASS: TestJWTTokenValidation/Invalid_token_format (0.00s) --- PASS: TestJWTTokenValidation/Expired_token (0.00s) === RUN TestRequestContextExtraction === RUN TestRequestContextExtraction/Standard_request_with_IP === RUN TestRequestContextExtraction/Request_with_X-Real-IP --- PASS: TestRequestContextExtraction (0.00s) --- PASS: TestRequestContextExtraction/Standard_request_with_IP (0.00s) --- PASS: TestRequestContextExtraction/Request_with_X-Real-IP (0.00s) === RUN TestRequestContextExtraction_TrustedProxy --- PASS: TestRequestContextExtraction_TrustedProxy (0.00s) === RUN TestIPBasedPolicyEnforcement === RUN TestIPBasedPolicyEnforcement/Allow_from_office_IP === RUN TestIPBasedPolicyEnforcement/Block_from_external_IP === RUN TestIPBasedPolicyEnforcement/Allow_from_internal_range --- PASS: TestIPBasedPolicyEnforcement (0.02s) --- PASS: TestIPBasedPolicyEnforcement/Allow_from_office_IP (0.01s) --- PASS: TestIPBasedPolicyEnforcement/Block_from_external_IP (0.00s) --- PASS: TestIPBasedPolicyEnforcement/Allow_from_internal_range (0.01s) === RUN TestListPartsActionMapping === RUN TestListPartsActionMapping/get_object_without_uploadId === RUN TestListPartsActionMapping/get_object_with_uploadId === RUN TestListPartsActionMapping/get_object_with_uploadId_and_other_params === RUN TestListPartsActionMapping/get_object_with_versionId === RUN TestListPartsActionMapping/get_object_acl_without_uploadId === RUN TestListPartsActionMapping/post_multipart_upload_without_uploadId --- PASS: TestListPartsActionMapping (0.01s) --- PASS: TestListPartsActionMapping/get_object_without_uploadId (0.00s) --- PASS: TestListPartsActionMapping/get_object_with_uploadId (0.00s) --- PASS: TestListPartsActionMapping/get_object_with_uploadId_and_other_params (0.00s) --- PASS: TestListPartsActionMapping/get_object_with_versionId (0.00s) --- PASS: TestListPartsActionMapping/get_object_acl_without_uploadId (0.00s) --- PASS: TestListPartsActionMapping/post_multipart_upload_without_uploadId (0.00s) === RUN TestListPartsActionMappingSecurityScenarios === RUN TestListPartsActionMappingSecurityScenarios/privilege_separation_listparts_vs_getobject === RUN TestListPartsActionMappingSecurityScenarios/policy_enforcement_precision --- PASS: TestListPartsActionMappingSecurityScenarios (0.00s) --- PASS: TestListPartsActionMappingSecurityScenarios/privilege_separation_listparts_vs_getobject (0.00s) --- PASS: TestListPartsActionMappingSecurityScenarios/policy_enforcement_precision (0.00s) === RUN TestListPartsActionRealWorldScenarios === RUN TestListPartsActionRealWorldScenarios/large_file_upload_workflow === RUN TestListPartsActionRealWorldScenarios/edge_case_upload_ids --- PASS: TestListPartsActionRealWorldScenarios (0.01s) --- PASS: TestListPartsActionRealWorldScenarios/large_file_upload_workflow (0.00s) --- PASS: TestListPartsActionRealWorldScenarios/edge_case_upload_ids (0.00s) === RUN TestCalculateIVWithOffset === RUN TestCalculateIVWithOffset/BlockAligned_0 === RUN TestCalculateIVWithOffset/BlockAligned_16 === RUN TestCalculateIVWithOffset/BlockAligned_32 === RUN TestCalculateIVWithOffset/BlockAligned_48 === RUN TestCalculateIVWithOffset/NonAligned_1 === RUN TestCalculateIVWithOffset/NonAligned_5 === RUN TestCalculateIVWithOffset/NonAligned_10 === RUN TestCalculateIVWithOffset/NonAligned_15 === RUN TestCalculateIVWithOffset/NonAligned_17 === RUN TestCalculateIVWithOffset/NonAligned_21 === RUN TestCalculateIVWithOffset/NonAligned_33 === RUN TestCalculateIVWithOffset/NonAligned_47 === RUN TestCalculateIVWithOffset/LargeOffset --- PASS: TestCalculateIVWithOffset (0.01s) --- PASS: TestCalculateIVWithOffset/BlockAligned_0 (0.00s) --- PASS: TestCalculateIVWithOffset/BlockAligned_16 (0.00s) --- PASS: TestCalculateIVWithOffset/BlockAligned_32 (0.00s) --- PASS: TestCalculateIVWithOffset/BlockAligned_48 (0.00s) --- PASS: TestCalculateIVWithOffset/NonAligned_1 (0.00s) --- PASS: TestCalculateIVWithOffset/NonAligned_5 (0.00s) --- PASS: TestCalculateIVWithOffset/NonAligned_10 (0.00s) --- PASS: TestCalculateIVWithOffset/NonAligned_15 (0.00s) --- PASS: TestCalculateIVWithOffset/NonAligned_17 (0.00s) --- PASS: TestCalculateIVWithOffset/NonAligned_21 (0.00s) --- PASS: TestCalculateIVWithOffset/NonAligned_33 (0.00s) --- PASS: TestCalculateIVWithOffset/NonAligned_47 (0.00s) --- PASS: TestCalculateIVWithOffset/LargeOffset (0.00s) === RUN TestCTRDecryptionWithNonBlockAlignedOffset === RUN TestCTRDecryptionWithNonBlockAlignedOffset/A === RUN TestCTRDecryptionWithNonBlockAlignedOffset/B === RUN TestCTRDecryptionWithNonBlockAlignedOffset/F === RUN TestCTRDecryptionWithNonBlockAlignedOffset/K === RUN TestCTRDecryptionWithNonBlockAlignedOffset/P === RUN TestCTRDecryptionWithNonBlockAlignedOffset/Q === RUN TestCTRDecryptionWithNonBlockAlignedOffset/R === RUN TestCTRDecryptionWithNonBlockAlignedOffset/V === RUN TestCTRDecryptionWithNonBlockAlignedOffset/a === RUN TestCTRDecryptionWithNonBlockAlignedOffset/b === RUN TestCTRDecryptionWithNonBlockAlignedOffset/p === RUN TestCTRDecryptionWithNonBlockAlignedOffset/q === RUN TestCTRDecryptionWithNonBlockAlignedOffset/¥ === RUN TestCTRDecryptionWithNonBlockAlignedOffset/ȵ --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset (0.02s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/A (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/B (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/F (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/K (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/P (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/Q (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/R (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/V (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/a (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/b (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/p (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/q (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/¥ (0.00s) --- PASS: TestCTRDecryptionWithNonBlockAlignedOffset/ȵ (0.00s) === RUN TestCTRRangeRequestSimulation === RUN TestCTRRangeRequestSimulation/First_byte === RUN TestCTRRangeRequestSimulation/First_100_bytes === RUN TestCTRRangeRequestSimulation/Mid-block_range === RUN TestCTRRangeRequestSimulation/Single_mid-block_byte === RUN TestCTRRangeRequestSimulation/Cross-block_range === RUN TestCTRRangeRequestSimulation/Large_range === RUN TestCTRRangeRequestSimulation/Tail_range --- PASS: TestCTRRangeRequestSimulation (1.91s) --- PASS: TestCTRRangeRequestSimulation/First_byte (0.00s) --- PASS: TestCTRRangeRequestSimulation/First_100_bytes (0.00s) --- PASS: TestCTRRangeRequestSimulation/Mid-block_range (0.00s) --- PASS: TestCTRRangeRequestSimulation/Single_mid-block_byte (0.00s) --- PASS: TestCTRRangeRequestSimulation/Cross-block_range (0.00s) --- PASS: TestCTRRangeRequestSimulation/Large_range (0.00s) --- PASS: TestCTRRangeRequestSimulation/Tail_range (0.00s) === RUN TestCTRDecryptionWithIOReader === RUN TestCTRDecryptionWithIOReader/A === RUN TestCTRDecryptionWithIOReader/F === RUN TestCTRDecryptionWithIOReader/K === RUN TestCTRDecryptionWithIOReader/Q === RUN TestCTRDecryptionWithIOReader/R === RUN TestCTRDecryptionWithIOReader/_ --- PASS: TestCTRDecryptionWithIOReader (0.01s) --- PASS: TestCTRDecryptionWithIOReader/A (0.00s) --- PASS: TestCTRDecryptionWithIOReader/F (0.00s) --- PASS: TestCTRDecryptionWithIOReader/K (0.00s) --- PASS: TestCTRDecryptionWithIOReader/Q (0.00s) --- PASS: TestCTRDecryptionWithIOReader/R (0.00s) --- PASS: TestCTRDecryptionWithIOReader/_ (0.00s) === RUN TestSSES3EndToEndSmallFile === RUN TestSSES3EndToEndSmallFile/tiny_file_(10_bytes) === RUN TestSSES3EndToEndSmallFile/small_file_(50_bytes) === RUN TestSSES3EndToEndSmallFile/medium_file_(256_bytes) --- PASS: TestSSES3EndToEndSmallFile (0.04s) --- PASS: TestSSES3EndToEndSmallFile/tiny_file_(10_bytes) (0.00s) --- PASS: TestSSES3EndToEndSmallFile/small_file_(50_bytes) (0.02s) --- PASS: TestSSES3EndToEndSmallFile/medium_file_(256_bytes) (0.02s) === RUN TestSSES3EndToEndChunkedFile --- PASS: TestSSES3EndToEndChunkedFile (0.01s) === RUN TestSSES3EndToEndWithDetectPrimaryType === RUN TestSSES3EndToEndWithDetectPrimaryType/Inline_SSE-S3_file_(no_chunks) === RUN TestSSES3EndToEndWithDetectPrimaryType/Single_chunk_SSE-S3_file === RUN TestSSES3EndToEndWithDetectPrimaryType/SSE-KMS_file_(has_KMS_key_ID) --- PASS: TestSSES3EndToEndWithDetectPrimaryType (0.00s) --- PASS: TestSSES3EndToEndWithDetectPrimaryType/Inline_SSE-S3_file_(no_chunks) (0.00s) --- PASS: TestSSES3EndToEndWithDetectPrimaryType/Single_chunk_SSE-S3_file (0.00s) --- PASS: TestSSES3EndToEndWithDetectPrimaryType/SSE-KMS_file_(has_KMS_key_ID) (0.00s) === RUN TestBuildMultipartSSES3Reader_PerChunkKeys --- PASS: TestBuildMultipartSSES3Reader_PerChunkKeys (0.01s) === RUN TestBuildMultipartSSES3Reader_InvalidIVLength === RUN TestBuildMultipartSSES3Reader_InvalidIVLength/missing_IV === RUN TestBuildMultipartSSES3Reader_InvalidIVLength/short_IV --- PASS: TestBuildMultipartSSES3Reader_InvalidIVLength (0.00s) --- PASS: TestBuildMultipartSSES3Reader_InvalidIVLength/missing_IV (0.00s) --- PASS: TestBuildMultipartSSES3Reader_InvalidIVLength/short_IV (0.00s) === RUN TestBuildMultipartSSES3Reader_RejectsBadChunkBeforeAnyFetch --- PASS: TestBuildMultipartSSES3Reader_RejectsBadChunkBeforeAnyFetch (0.00s) === RUN TestSetKEKPassphraseEnablesEncryptedRoundTrip --- PASS: TestSetKEKPassphraseEnablesEncryptedRoundTrip (0.00s) === RUN TestSetKEKPassphraseDifferentInstancesNoCollision --- PASS: TestSetKEKPassphraseDifferentInstancesNoCollision (0.00s) === RUN TestNoPassphraseKeepsLegacyHexDecodePath --- PASS: TestNoPassphraseKeepsLegacyHexDecodePath (0.00s) === RUN TestUnwrapKEKReadsPinnedLegacyV1 --- PASS: TestUnwrapKEKReadsPinnedLegacyV1 (0.00s) === RUN TestSSES3MultipartChunkViewDecryption === RUN TestSSES3MultipartChunkViewDecryption/Part_1 === RUN TestSSES3MultipartChunkViewDecryption/Part_2 --- PASS: TestSSES3MultipartChunkViewDecryption (0.00s) --- PASS: TestSSES3MultipartChunkViewDecryption/Part_1 (0.00s) --- PASS: TestSSES3MultipartChunkViewDecryption/Part_2 (0.00s) === RUN TestSSES3SinglePartChunkViewDecryption --- PASS: TestSSES3SinglePartChunkViewDecryption (0.00s) === RUN TestSSES3IVOffsetCalculation === RUN TestSSES3IVOffsetCalculation/Part_1 === RUN TestSSES3IVOffsetCalculation/Part_2 === RUN TestSSES3IVOffsetCalculation/Part_3 === RUN TestSSES3IVOffsetCalculation/Part_10 --- PASS: TestSSES3IVOffsetCalculation (0.00s) --- PASS: TestSSES3IVOffsetCalculation/Part_1 (0.00s) --- PASS: TestSSES3IVOffsetCalculation/Part_2 (0.00s) --- PASS: TestSSES3IVOffsetCalculation/Part_3 (0.00s) --- PASS: TestSSES3IVOffsetCalculation/Part_10 (0.00s) === RUN TestSSES3ChunkMetadataDetection === RUN TestSSES3ChunkMetadataDetection/Multipart_chunk_with_metadata === RUN TestSSES3ChunkMetadataDetection/Single-part_chunk_without_metadata === RUN TestSSES3ChunkMetadataDetection/Non-SSE-S3_chunk --- PASS: TestSSES3ChunkMetadataDetection (0.00s) --- PASS: TestSSES3ChunkMetadataDetection/Multipart_chunk_with_metadata (0.00s) --- PASS: TestSSES3ChunkMetadataDetection/Single-part_chunk_without_metadata (0.00s) --- PASS: TestSSES3ChunkMetadataDetection/Non-SSE-S3_chunk (0.00s) === RUN TestSSES3EncryptionConsistency --- PASS: TestSSES3EncryptionConsistency (0.00s) === RUN TestS3IAMIntegration_isSTSIssuer === RUN TestS3IAMIntegration_isSTSIssuer/exact_match_with_configured_issuer === RUN TestS3IAMIntegration_isSTSIssuer/similar_but_not_exact_issuer === RUN TestS3IAMIntegration_isSTSIssuer/substring_of_configured_issuer === RUN TestS3IAMIntegration_isSTSIssuer/contains_configured_issuer_as_substring === RUN TestS3IAMIntegration_isSTSIssuer/case_sensitive_-_different_case === RUN TestS3IAMIntegration_isSTSIssuer/Google_OIDC === RUN TestS3IAMIntegration_isSTSIssuer/Azure_AD === RUN TestS3IAMIntegration_isSTSIssuer/Auth0 === RUN TestS3IAMIntegration_isSTSIssuer/Keycloak === RUN TestS3IAMIntegration_isSTSIssuer/Empty_string --- PASS: TestS3IAMIntegration_isSTSIssuer (0.01s) --- PASS: TestS3IAMIntegration_isSTSIssuer/exact_match_with_configured_issuer (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/similar_but_not_exact_issuer (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/substring_of_configured_issuer (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/contains_configured_issuer_as_substring (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/case_sensitive_-_different_case (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/Google_OIDC (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/Azure_AD (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/Auth0 (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/Keycloak (0.00s) --- PASS: TestS3IAMIntegration_isSTSIssuer/Empty_string (0.00s) === RUN TestS3IAMIntegration_isSTSIssuer_NoSTSService --- PASS: TestS3IAMIntegration_isSTSIssuer_NoSTSService (0.00s) === RUN TestVerifyKeyCommitment_DefaultAcceptsMissing --- PASS: TestVerifyKeyCommitment_DefaultAcceptsMissing (0.00s) === RUN TestVerifyKeyCommitment_StrictRejectsMissing --- PASS: TestVerifyKeyCommitment_StrictRejectsMissing (0.00s) === RUN TestVerifyKeyCommitment_StrictAcceptsValidCommitment --- PASS: TestVerifyKeyCommitment_StrictAcceptsValidCommitment (0.00s) === RUN TestVerifyKeyCommitment_RejectsTamperedKey === RUN TestVerifyKeyCommitment_RejectsTamperedKey/tampered_key === RUN TestVerifyKeyCommitment_RejectsTamperedKey/tampered_IV === RUN TestVerifyKeyCommitment_RejectsTamperedKey/tampered_algorithm === RUN TestVerifyKeyCommitment_RejectsTamperedKey/tampered_commitment --- PASS: TestVerifyKeyCommitment_RejectsTamperedKey (0.00s) --- PASS: TestVerifyKeyCommitment_RejectsTamperedKey/tampered_key (0.00s) --- PASS: TestVerifyKeyCommitment_RejectsTamperedKey/tampered_IV (0.00s) --- PASS: TestVerifyKeyCommitment_RejectsTamperedKey/tampered_algorithm (0.00s) --- PASS: TestVerifyKeyCommitment_RejectsTamperedKey/tampered_commitment (0.00s) === RUN TestSetRequireKeyCommitment --- PASS: TestSetRequireKeyCommitment (0.00s) === RUN TestParseCustomAclHeaderList === RUN TestParseCustomAclHeaderList/absent === RUN TestParseCustomAclHeaderList/single === RUN TestParseCustomAclHeaderList/comma_without_space === RUN TestParseCustomAclHeaderList/comma_with_space === RUN TestParseCustomAclHeaderList/optional_whitespace === RUN TestParseCustomAclHeaderList/quoted_comma_and_equals === RUN TestParseCustomAclHeaderList/escaped_quote === RUN TestParseCustomAclHeaderList/email === RUN TestParseCustomAclHeaderList/group === RUN TestParseCustomAclHeaderList/unknown_type === RUN TestParseCustomAclHeaderList/mixed_unknown_type === RUN TestParseCustomAclHeaderList/empty_grantee === RUN TestParseCustomAclHeaderList/unquoted === RUN TestParseCustomAclHeaderList/unterminated === RUN TestParseCustomAclHeaderList/trailing_comma === RUN TestParseCustomAclHeaderList/empty_element === RUN TestParseCustomAclHeaderList/missing_comma === RUN TestParseCustomAclHeaderList/invalid_escape === RUN TestParseCustomAclHeaderList/whitespace_only --- PASS: TestParseCustomAclHeaderList (0.02s) --- PASS: TestParseCustomAclHeaderList/absent (0.00s) --- PASS: TestParseCustomAclHeaderList/single (0.00s) --- PASS: TestParseCustomAclHeaderList/comma_without_space (0.00s) --- PASS: TestParseCustomAclHeaderList/comma_with_space (0.00s) --- PASS: TestParseCustomAclHeaderList/optional_whitespace (0.00s) --- PASS: TestParseCustomAclHeaderList/quoted_comma_and_equals (0.00s) --- PASS: TestParseCustomAclHeaderList/escaped_quote (0.00s) --- PASS: TestParseCustomAclHeaderList/email (0.00s) --- PASS: TestParseCustomAclHeaderList/group (0.00s) --- PASS: TestParseCustomAclHeaderList/unknown_type (0.00s) --- PASS: TestParseCustomAclHeaderList/mixed_unknown_type (0.00s) --- PASS: TestParseCustomAclHeaderList/empty_grantee (0.00s) --- PASS: TestParseCustomAclHeaderList/unquoted (0.00s) --- PASS: TestParseCustomAclHeaderList/unterminated (0.00s) --- PASS: TestParseCustomAclHeaderList/trailing_comma (0.00s) --- PASS: TestParseCustomAclHeaderList/empty_element (0.00s) --- PASS: TestParseCustomAclHeaderList/missing_comma (0.00s) --- PASS: TestParseCustomAclHeaderList/invalid_escape (0.00s) --- PASS: TestParseCustomAclHeaderList/whitespace_only (0.00s) === RUN TestAmbiguousSubresource --- PASS: TestAmbiguousSubresource (0.00s) === RUN TestAmbiguousSubresourceRejectedBeforeHandler --- PASS: TestAmbiguousSubresourceRejectedBeforeHandler (0.00s) === RUN TestListTypeOwnershipControlsRejectedBeforeHandler --- PASS: TestListTypeOwnershipControlsRejectedBeforeHandler (0.00s) === RUN TestRouteQueryKeysAreClassified I1117 09:41:55.488546 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouteQueryKeysAreClassified (0.16s) === RUN TestBucketConfigStubs === RUN TestBucketConfigStubs/AnalyticsList === RUN TestBucketConfigStubs/InventoryList === RUN TestBucketConfigStubs/IntelligentTieringList === RUN TestBucketConfigStubs/MetricsList === RUN TestBucketConfigStubs/AnalyticsGet === RUN TestBucketConfigStubs/InventoryGet === RUN TestBucketConfigStubs/IntelligentTieringGet === RUN TestBucketConfigStubs/MetricsGet --- PASS: TestBucketConfigStubs (0.01s) --- PASS: TestBucketConfigStubs/AnalyticsList (0.00s) --- PASS: TestBucketConfigStubs/InventoryList (0.00s) --- PASS: TestBucketConfigStubs/IntelligentTieringList (0.00s) --- PASS: TestBucketConfigStubs/MetricsList (0.00s) --- PASS: TestBucketConfigStubs/AnalyticsGet (0.00s) --- PASS: TestBucketConfigStubs/InventoryGet (0.00s) --- PASS: TestBucketConfigStubs/IntelligentTieringGet (0.00s) --- PASS: TestBucketConfigStubs/MetricsGet (0.00s) === RUN TestUpdateBucketConfigDoesNotMutateCacheOnPersistFailure W1117 09:41:55.662327 s3api_server.go:596 getFilerAddress: no filer addresses available E1117 09:41:55.663839 s3api_bucket_config.go:517 updateBucketConfig: failed to get bucket entry for cleanup-test-net: getOrCreateConnection : fail to dial : grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) --- PASS: TestUpdateBucketConfigDoesNotMutateCacheOnPersistFailure (0.00s) === RUN TestCorsRuleProtoRoundTripMaxAge --- PASS: TestCorsRuleProtoRoundTripMaxAge (0.00s) === RUN TestPutObjectAppliesBucketDefaultEncryptionWithVolumeCipher === RUN TestPutObjectAppliesBucketDefaultEncryptionWithVolumeCipher/volume_encryption_enabled_(s3a.cipher=true) === RUN TestPutObjectAppliesBucketDefaultEncryptionWithVolumeCipher/volume_encryption_disabled_(s3a.cipher=false) --- PASS: TestPutObjectAppliesBucketDefaultEncryptionWithVolumeCipher (0.20s) --- PASS: TestPutObjectAppliesBucketDefaultEncryptionWithVolumeCipher/volume_encryption_enabled_(s3a.cipher=true) (0.17s) --- PASS: TestPutObjectAppliesBucketDefaultEncryptionWithVolumeCipher/volume_encryption_disabled_(s3a.cipher=false) (0.03s) === RUN TestPutObjectPartSkipsBucketDefaultEncryption --- PASS: TestPutObjectPartSkipsBucketDefaultEncryption (0.03s) === RUN TestPutObjectUnderUploadsFolderKeepsBucketDefaultEncryption --- PASS: TestPutObjectUnderUploadsFolderKeepsBucketDefaultEncryption (0.02s) === RUN TestPutObjectAppliesTableBucketDeclaredEncryption --- PASS: TestPutObjectAppliesTableBucketDeclaredEncryption (0.04s) === RUN TestBucketHasUserObjects_EmptyDirectories === RUN TestBucketHasUserObjects_EmptyDirectories/completely_empty_bucket === RUN TestBucketHasUserObjects_EmptyDirectories/bucket_with_root_file === RUN TestBucketHasUserObjects_EmptyDirectories/bucket_with_leftover_empty_directory_from_rm_--recursive === RUN TestBucketHasUserObjects_EmptyDirectories/bucket_with_nested_leftover_empty_directories === RUN TestBucketHasUserObjects_EmptyDirectories/bucket_with_nested_directory_containing_a_file === RUN TestBucketHasUserObjects_EmptyDirectories/bucket_with_explicit_directory_object_(MIME_set) === RUN TestBucketHasUserObjects_EmptyDirectories/empty_*.versions_folder_and_.uploads_do_not_count === RUN TestBucketHasUserObjects_EmptyDirectories/nested_versions_directory_with_stored_versions_counts === RUN TestBucketHasUserObjects_EmptyDirectories/nested_versions_directory_left_empty_does_not_count === RUN TestBucketHasUserObjects_EmptyDirectories/nested_uploads-named_directories_are_internal === RUN TestBucketHasUserObjects_EmptyDirectories/directory_object_with_a_reserved_name_counts === RUN TestBucketHasUserObjects_EmptyDirectories/file_with_a_reserved_name_counts === RUN TestBucketHasUserObjects_EmptyDirectories/file_with_backslash_in_name --- PASS: TestBucketHasUserObjects_EmptyDirectories (0.15s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/completely_empty_bucket (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/bucket_with_root_file (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/bucket_with_leftover_empty_directory_from_rm_--recursive (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/bucket_with_nested_leftover_empty_directories (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/bucket_with_nested_directory_containing_a_file (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/bucket_with_explicit_directory_object_(MIME_set) (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/empty_*.versions_folder_and_.uploads_do_not_count (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/nested_versions_directory_with_stored_versions_counts (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/nested_versions_directory_left_empty_does_not_count (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/nested_uploads-named_directories_are_internal (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/directory_object_with_a_reserved_name_counts (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/file_with_a_reserved_name_counts (0.01s) --- PASS: TestBucketHasUserObjects_EmptyDirectories/file_with_backslash_in_name (0.01s) === RUN TestBucketHasUserObjects_DeepEmptyChain --- PASS: TestBucketHasUserObjects_DeepEmptyChain (1.12s) === RUN TestDeleteBucketHandler_EmptyDirectoriesAllowedWhenNotEmptyFalse I1117 09:41:57.250302 metrics.go:1258 delete bucket metrics, repro-bucket: 0 --- PASS: TestDeleteBucketHandler_EmptyDirectoriesAllowedWhenNotEmptyFalse (0.02s) === RUN TestDeleteBucketHandler_RefusesBucketWithFilesWhenNotEmptyFalse --- PASS: TestDeleteBucketHandler_RefusesBucketWithFilesWhenNotEmptyFalse (0.02s) === RUN TestDeleteBucketHandler_RefusesBucketWithDirectoryObjectWhenNotEmptyFalse --- PASS: TestDeleteBucketHandler_RefusesBucketWithDirectoryObjectWhenNotEmptyFalse (0.01s) === RUN TestGetListBucketsArgs === RUN TestGetListBucketsArgs/defaults === RUN TestGetListBucketsArgs/max-buckets === RUN TestGetListBucketsArgs/max-buckets_upper_bound === RUN TestGetListBucketsArgs/max-buckets_zero === RUN TestGetListBucketsArgs/max-buckets_negative === RUN TestGetListBucketsArgs/max-buckets_too_large === RUN TestGetListBucketsArgs/max-buckets_not_a_number === RUN TestGetListBucketsArgs/prefix === RUN TestGetListBucketsArgs/continuation_token === RUN TestGetListBucketsArgs/bad_continuation_token --- PASS: TestGetListBucketsArgs (0.01s) --- PASS: TestGetListBucketsArgs/defaults (0.00s) --- PASS: TestGetListBucketsArgs/max-buckets (0.00s) --- PASS: TestGetListBucketsArgs/max-buckets_upper_bound (0.00s) --- PASS: TestGetListBucketsArgs/max-buckets_zero (0.00s) --- PASS: TestGetListBucketsArgs/max-buckets_negative (0.00s) --- PASS: TestGetListBucketsArgs/max-buckets_too_large (0.00s) --- PASS: TestGetListBucketsArgs/max-buckets_not_a_number (0.00s) --- PASS: TestGetListBucketsArgs/prefix (0.00s) --- PASS: TestGetListBucketsArgs/continuation_token (0.00s) --- PASS: TestGetListBucketsArgs/bad_continuation_token (0.00s) === RUN TestCanListBucketsFromOwnerIndex === RUN TestCanListBucketsFromOwnerIndex/nil_identity_scans === RUN TestCanListBucketsFromOwnerIndex/admin_scans === RUN TestCanListBucketsFromOwnerIndex/bare_List_scans === RUN TestCanListBucketsFromOwnerIndex/wildcard_scans === RUN TestCanListBucketsFromOwnerIndex/no_actions_is_owned-only === RUN TestCanListBucketsFromOwnerIndex/attached_policy_with_no_loaded_document_scans === RUN TestCanListBucketsFromOwnerIndex/named_grants_enumerate === RUN TestCanListBucketsFromOwnerIndex/unsorted_grants_keep_action_order === RUN TestCanListBucketsFromOwnerIndex/session_token_scans --- PASS: TestCanListBucketsFromOwnerIndex (0.01s) --- PASS: TestCanListBucketsFromOwnerIndex/nil_identity_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndex/admin_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndex/bare_List_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndex/wildcard_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndex/no_actions_is_owned-only (0.00s) --- PASS: TestCanListBucketsFromOwnerIndex/attached_policy_with_no_loaded_document_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndex/named_grants_enumerate (0.00s) --- PASS: TestCanListBucketsFromOwnerIndex/unsorted_grants_keep_action_order (0.00s) --- PASS: TestCanListBucketsFromOwnerIndex/session_token_scans (0.00s) === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/named_bucket_enumerates === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/wildcard_resource_scans === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/not-resource_scans === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/unknown_policy_scans === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/one_wildcard_policy_scans === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/action_wildcard_on_a_named_bucket_enumerates === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/denied_bucket_stays_a_candidate === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/group_policy_contributes === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/disabled_group_is_ignored === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/resource_variable_scans === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/action_variable_keeps_its_bucket === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/mixed_case_action_enumerates === RUN TestCanListBucketsFromOwnerIndexAttachedPolicy/mixed_case_wildcard_action_enumerates --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy (0.03s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/named_bucket_enumerates (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/wildcard_resource_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/not-resource_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/unknown_policy_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/one_wildcard_policy_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/action_wildcard_on_a_named_bucket_enumerates (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/denied_bucket_stays_a_candidate (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/group_policy_contributes (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/disabled_group_is_ignored (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/resource_variable_scans (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/action_variable_keeps_its_bucket (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/mixed_case_action_enumerates (0.00s) --- PASS: TestCanListBucketsFromOwnerIndexAttachedPolicy/mixed_case_wildcard_action_enumerates (0.00s) === RUN TestContinuationTokenRoundTrip --- PASS: TestContinuationTokenRoundTrip (0.00s) === RUN TestListBucketsWithoutAuthListsEveryBucket --- PASS: TestListBucketsWithoutAuthListsEveryBucket (0.05s) === RUN TestListBucketsWithAuthListsNothingForAnonymous --- PASS: TestListBucketsWithAuthListsNothingForAnonymous (0.00s) === RUN TestHasExplicitBucketACL === RUN TestHasExplicitBucketACL/none === RUN TestHasExplicitBucketACL/private_is_default === RUN TestHasExplicitBucketACL/canned_public-read === RUN TestHasExplicitBucketACL/canned_case-insensitive_private === RUN TestHasExplicitBucketACL/grant_read === RUN TestHasExplicitBucketACL/grant_full_control --- PASS: TestHasExplicitBucketACL (0.01s) --- PASS: TestHasExplicitBucketACL/none (0.00s) --- PASS: TestHasExplicitBucketACL/private_is_default (0.00s) --- PASS: TestHasExplicitBucketACL/canned_public-read (0.00s) --- PASS: TestHasExplicitBucketACL/canned_case-insensitive_private (0.00s) --- PASS: TestHasExplicitBucketACL/grant_read (0.00s) --- PASS: TestHasExplicitBucketACL/grant_full_control (0.00s) === RUN TestGetBucketPolicyStatusIsPublic === RUN TestGetBucketPolicyStatusIsPublic/public_allow_star === RUN TestGetBucketPolicyStatusIsPublic/deny_is_not_public === RUN TestGetBucketPolicyStatusIsPublic/condition_makes_it_non-public === RUN TestGetBucketPolicyStatusIsPublic/specific_principal_is_not_public --- PASS: TestGetBucketPolicyStatusIsPublic (0.01s) --- PASS: TestGetBucketPolicyStatusIsPublic/public_allow_star (0.00s) --- PASS: TestGetBucketPolicyStatusIsPublic/deny_is_not_public (0.00s) --- PASS: TestGetBucketPolicyStatusIsPublic/condition_makes_it_non-public (0.00s) --- PASS: TestGetBucketPolicyStatusIsPublic/specific_principal_is_not_public (0.00s) === RUN TestPutBucketRequestPaymentBucketOwner --- PASS: TestPutBucketRequestPaymentBucketOwner (0.00s) === RUN TestPutBucketRequestPaymentRequesterRejected --- PASS: TestPutBucketRequestPaymentRequesterRejected (0.00s) === RUN TestPutBucketOwnershipControlsRejectsRuleWithoutObjectOwnership --- PASS: TestPutBucketOwnershipControlsRejectsRuleWithoutObjectOwnership (0.01s) === RUN TestGetBucketOwnershipControlsDefaultsToBucketOwnerEnforced --- PASS: TestGetBucketOwnershipControlsDefaultsToBucketOwnerEnforced (0.01s) === RUN TestGetBucketAccelerateConfiguration --- PASS: TestGetBucketAccelerateConfiguration (0.00s) === RUN TestGetBucketLogging --- PASS: TestGetBucketLogging (0.00s) === RUN TestGetBucketLocationInvalidBucketName --- PASS: TestGetBucketLocationInvalidBucketName (0.00s) === RUN TestHandleAutoCreateBucketDisabled W1117 09:41:57.410324 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket test-bucket: bucket auto-creation is disabled --- PASS: TestHandleAutoCreateBucketDisabled (0.00s) === RUN TestHandleAutoCreateBucketNonAdmin W1117 09:41:57.413457 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket test-bucket: permission denied - requires Admin permission --- PASS: TestHandleAutoCreateBucketNonAdmin (0.00s) === RUN TestAutoCreateBucketScopedAdmin === RUN TestAutoCreateBucketScopedAdmin/global_admin === RUN TestAutoCreateBucketScopedAdmin/matching_prefix === RUN TestAutoCreateBucketScopedAdmin/exact_bucket === RUN TestAutoCreateBucketScopedAdmin/non-matching_prefix W1117 09:41:57.457509 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket other-bucket: permission denied - requires Admin permission === RUN TestAutoCreateBucketScopedAdmin/write-scoped_grant_is_not_admin W1117 09:41:57.460692 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket app-uploads: permission denied - requires Admin permission === RUN TestAutoCreateBucketScopedAdmin/unscoped_write W1117 09:41:57.463576 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket app-uploads: permission denied - requires Admin permission --- PASS: TestAutoCreateBucketScopedAdmin (0.05s) --- PASS: TestAutoCreateBucketScopedAdmin/global_admin (0.02s) --- PASS: TestAutoCreateBucketScopedAdmin/matching_prefix (0.01s) --- PASS: TestAutoCreateBucketScopedAdmin/exact_bucket (0.01s) --- PASS: TestAutoCreateBucketScopedAdmin/non-matching_prefix (0.00s) --- PASS: TestAutoCreateBucketScopedAdmin/write-scoped_grant_is_not_admin (0.00s) --- PASS: TestAutoCreateBucketScopedAdmin/unscoped_write (0.00s) === RUN TestAutoCreateBucketAttachedPolicy === RUN TestAutoCreateBucketAttachedPolicy/deny_beats_scoped_admin W1117 09:41:57.471100 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket app-uploads: permission denied - requires Admin permission === RUN TestAutoCreateBucketAttachedPolicy/allow_without_scoped_grant === RUN TestAutoCreateBucketAttachedPolicy/scoped_admin_with_unrelated_policy_is_denied W1117 09:41:57.491158 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket app-uploads: permission denied - requires Admin permission === RUN TestAutoCreateBucketAttachedPolicy/bare_admin_survives_unrelated_policy --- PASS: TestAutoCreateBucketAttachedPolicy (0.04s) --- PASS: TestAutoCreateBucketAttachedPolicy/deny_beats_scoped_admin (0.01s) --- PASS: TestAutoCreateBucketAttachedPolicy/allow_without_scoped_grant (0.01s) --- PASS: TestAutoCreateBucketAttachedPolicy/scoped_admin_with_unrelated_policy_is_denied (0.00s) --- PASS: TestAutoCreateBucketAttachedPolicy/bare_admin_survives_unrelated_policy (0.01s) === RUN TestSetBucketOwnerVerifiedIdentityFallback --- PASS: TestSetBucketOwnerVerifiedIdentityFallback (0.00s) === RUN TestUploadMissingBucketAutoCreateDisabled === RUN TestUploadMissingBucketAutoCreateDisabled/put_object W1117 09:41:57.512070 s3api_server.go:596 getFilerAddress: no filer addresses available W1117 09:41:57.515185 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket missing: bucket auto-creation is disabled === RUN TestUploadMissingBucketAutoCreateDisabled/put_directory_marker W1117 09:41:57.517323 s3api_server.go:596 getFilerAddress: no filer addresses available W1117 09:41:57.519233 s3api_bucket_handlers.go:856 PutObjectHandler: auto-create bucket missing: bucket auto-creation is disabled === RUN TestUploadMissingBucketAutoCreateDisabled/new_multipart_upload W1117 09:41:57.521506 s3api_bucket_handlers.go:856 NewMultipartUploadHandler: auto-create bucket missing: bucket auto-creation is disabled --- PASS: TestUploadMissingBucketAutoCreateDisabled (0.01s) --- PASS: TestUploadMissingBucketAutoCreateDisabled/put_object (0.01s) --- PASS: TestUploadMissingBucketAutoCreateDisabled/put_directory_marker (0.00s) --- PASS: TestUploadMissingBucketAutoCreateDisabled/new_multipart_upload (0.00s) === RUN TestAuthWithPublicReadHonorsPolicyDeny --- PASS: TestAuthWithPublicReadHonorsPolicyDeny (0.02s) === RUN TestPutBucketAclWithoutAuth I1117 09:41:57.571751 config_loader.go:73 Using explicit credential store: memory --- PASS: TestPutBucketAclWithoutAuth (0.12s) === RUN TestPutBucketAclXmlWithoutAuth I1117 09:41:57.676328 config_loader.go:73 Using explicit credential store: memory --- PASS: TestPutBucketAclXmlWithoutAuth (0.08s) === RUN TestGetBucketAclReportsAnonymousGrantVerbatim I1117 09:41:57.751441 config_loader.go:73 Using explicit credential store: memory --- PASS: TestGetBucketAclReportsAnonymousGrantVerbatim (0.01s) === RUN TestPutBucketAclKeepsOwner I1117 09:41:57.762548 config_loader.go:73 Using explicit credential store: memory I1117 09:41:57.831841 config_loader.go:73 Using explicit credential store: memory --- PASS: TestPutBucketAclKeepsOwner (0.14s) === RUN TestFastpathWarn_Lengthened --- PASS: TestFastpathWarn_Lengthened (0.01s) === RUN TestFastpathWarn_Shortened_NoWarn --- PASS: TestFastpathWarn_Shortened_NoWarn (0.01s) === RUN TestFastpathWarn_Removed --- PASS: TestFastpathWarn_Removed (0.00s) === RUN TestFastpathWarn_Delete --- PASS: TestFastpathWarn_Delete (0.00s) === RUN TestFastpathWarn_Unchanged_NoWarn --- PASS: TestFastpathWarn_Unchanged_NoWarn (0.00s) === RUN TestFastpathWarn_NoOldRules_NoWarn --- PASS: TestFastpathWarn_NoOldRules_NoWarn (0.00s) === RUN TestFastpathWarn_TagFilteredRule_NoWarn --- PASS: TestFastpathWarn_TagFilteredRule_NoWarn (0.00s) === RUN TestFastpathWarn_DisabledInNew_Warns --- PASS: TestFastpathWarn_DisabledInNew_Warns (0.00s) === RUN TestFastpathWarn_PrefixChanged_Warns --- PASS: TestFastpathWarn_PrefixChanged_Warns (0.00s) === RUN TestFastpathWarn_OverflowDays_NoWarn --- PASS: TestFastpathWarn_OverflowDays_NoWarn (0.00s) === RUN TestFastpathWarn_IDOnlyRename_NoWarn --- PASS: TestFastpathWarn_IDOnlyRename_NoWarn (0.00s) === RUN TestFastpathWarn_IDRenameAndLengthen_Warns --- PASS: TestFastpathWarn_IDRenameAndLengthen_Warns (0.00s) === RUN TestFastpathWarn_IDRenameAndShorten_NoWarn --- PASS: TestFastpathWarn_IDRenameAndShorten_NoWarn (0.00s) === RUN TestGetBucketLifecycleConfigurationHandlerUsesStoredLifecycleConfig --- PASS: TestGetBucketLifecycleConfigurationHandlerUsesStoredLifecycleConfig (0.00s) === RUN TestGetBucketLifecycleConfigurationHandlerDefaultsTransitionMinimumObjectSize --- PASS: TestGetBucketLifecycleConfigurationHandlerDefaultsTransitionMinimumObjectSize (0.00s) === RUN TestPutBucketLifecycleConfigurationHandlerRejectsOversizedBody W1117 09:41:57.959229 s3api_bucket_handlers.go:1269 PutBucketLifecycleConfigurationHandler read body: request body too large --- PASS: TestPutBucketLifecycleConfigurationHandlerRejectsOversizedBody (0.02s) === RUN TestPutBucketLifecycleConfigurationHandlerMapsReadErrorsToInvalidRequest W1117 09:41:57.962110 s3api_bucket_handlers.go:1269 PutBucketLifecycleConfigurationHandler read body: read failed --- PASS: TestPutBucketLifecycleConfigurationHandlerMapsReadErrorsToInvalidRequest (0.00s) === RUN TestBucketMetadataStruct --- PASS: TestBucketMetadataStruct (0.00s) === RUN TestBucketMetadataUpdatePattern --- PASS: TestBucketMetadataUpdatePattern (0.00s) === RUN TestBucketMetadataHelperFunctions --- PASS: TestBucketMetadataHelperFunctions (0.00s) === RUN TestBucketSubresourceWritesOnMissingBucket === RUN TestBucketSubresourceWritesOnMissingBucket/put_bucket_encryption === RUN TestBucketSubresourceWritesOnMissingBucket/delete_bucket_encryption === RUN TestBucketSubresourceWritesOnMissingBucket/put_bucket_policy === RUN TestBucketSubresourceWritesOnMissingBucket/delete_bucket_policy === RUN TestBucketSubresourceWritesOnMissingBucket/get_bucket_encryption --- PASS: TestBucketSubresourceWritesOnMissingBucket (0.06s) --- PASS: TestBucketSubresourceWritesOnMissingBucket/put_bucket_encryption (0.01s) --- PASS: TestBucketSubresourceWritesOnMissingBucket/delete_bucket_encryption (0.01s) --- PASS: TestBucketSubresourceWritesOnMissingBucket/put_bucket_policy (0.01s) --- PASS: TestBucketSubresourceWritesOnMissingBucket/delete_bucket_policy (0.01s) --- PASS: TestBucketSubresourceWritesOnMissingBucket/get_bucket_encryption (0.01s) === RUN TestGetBucketEncryptionOnLiveBucketWithoutConfig --- PASS: TestGetBucketEncryptionOnLiveBucketWithoutConfig (0.01s) === RUN TestBucketSubresourceWritesOnFilerFailureMidRequest === RUN TestBucketSubresourceWritesOnFilerFailureMidRequest/put_bucket_policy E1117 09:41:58.050695 s3api_bucket_policy_handlers.go:120 Failed to store bucket policy for flaky-bucket: rpc error: code = Internal desc = filer store unavailable === RUN TestBucketSubresourceWritesOnFilerFailureMidRequest/delete_bucket_policy E1117 09:41:58.068912 s3api_bucket_policy_handlers.go:181 Failed to delete bucket policy for flaky-bucket: rpc error: code = Internal desc = filer store unavailable === RUN TestBucketSubresourceWritesOnFilerFailureMidRequest/put_bucket_encryption E1117 09:41:58.084447 s3_bucket_encryption.go:248 updateEncryptionConfiguration: failed to update encryption config for bucket flaky-bucket: all filers failed, last error: rpc error: code = Internal desc = filer store unavailable --- PASS: TestBucketSubresourceWritesOnFilerFailureMidRequest (0.05s) --- PASS: TestBucketSubresourceWritesOnFilerFailureMidRequest/put_bucket_policy (0.02s) --- PASS: TestBucketSubresourceWritesOnFilerFailureMidRequest/delete_bucket_policy (0.02s) --- PASS: TestBucketSubresourceWritesOnFilerFailureMidRequest/put_bucket_encryption (0.02s) === RUN TestBucketSubresourceWritesOnFilerFailure === RUN TestBucketSubresourceWritesOnFilerFailure/put_bucket_encryption E1117 09:41:58.099752 s3_bucket_encryption.go:248 updateEncryptionConfiguration: failed to update encryption config for bucket unreachable-bucket: failed to get current bucket metadata: error retrieving bucket directory unreachable-bucket: all filers failed, last error: LookupEntry1: rpc error: code = Internal desc = filer store unavailable === RUN TestBucketSubresourceWritesOnFilerFailure/delete_bucket_encryption E1117 09:41:58.112522 s3_bucket_encryption.go:263 removeEncryptionConfiguration: failed to get bucket metadata for bucket unreachable-bucket: error retrieving bucket directory unreachable-bucket: all filers failed, last error: LookupEntry1: rpc error: code = Internal desc = filer store unavailable === RUN TestBucketSubresourceWritesOnFilerFailure/put_bucket_policy E1117 09:41:58.126324 s3api_bucket_policy_handlers.go:120 Failed to store bucket policy for unreachable-bucket: all filers failed, last error: LookupEntry1: rpc error: code = Internal desc = filer store unavailable === RUN TestBucketSubresourceWritesOnFilerFailure/delete_bucket_policy E1117 09:41:58.138829 s3api_bucket_policy_handlers.go:158 Failed to check bucket existence for unreachable-bucket: all filers failed, last error: LookupEntry1: rpc error: code = Internal desc = filer store unavailable --- PASS: TestBucketSubresourceWritesOnFilerFailure (0.05s) --- PASS: TestBucketSubresourceWritesOnFilerFailure/put_bucket_encryption (0.01s) --- PASS: TestBucketSubresourceWritesOnFilerFailure/delete_bucket_encryption (0.01s) --- PASS: TestBucketSubresourceWritesOnFilerFailure/put_bucket_policy (0.01s) --- PASS: TestBucketSubresourceWritesOnFilerFailure/delete_bucket_policy (0.01s) === RUN TestDeleteBucketPolicyOnBucketVanishingMidRequest --- PASS: TestDeleteBucketPolicyOnBucketVanishingMidRequest (0.02s) === RUN TestPutBucketPolicyOnExistingBucket --- PASS: TestPutBucketPolicyOnExistingBucket (0.01s) === RUN TestEscapeOwnerName --- PASS: TestEscapeOwnerName (0.00s) === RUN TestListMergedBuckets === RUN TestListMergedBuckets/interleave_and_dedup === RUN TestListMergedBuckets/truncation_and_resume === RUN TestListMergedBuckets/no_owned_stream === RUN TestListMergedBuckets/owned_only --- PASS: TestListMergedBuckets (0.01s) --- PASS: TestListMergedBuckets/interleave_and_dedup (0.00s) --- PASS: TestListMergedBuckets/truncation_and_resume (0.00s) --- PASS: TestListMergedBuckets/no_owned_stream (0.00s) --- PASS: TestListMergedBuckets/owned_only (0.00s) === RUN TestBucketEntryOwner --- PASS: TestBucketEntryOwner (0.00s) === RUN TestBuildResourceARN === RUN TestBuildResourceARN/bucket_only === RUN TestBuildResourceARN/bucket_with_slash === RUN TestBuildResourceARN/bucket_and_object === RUN TestBuildResourceARN/bucket_and_object_with_leading_slash --- PASS: TestBuildResourceARN (0.00s) --- PASS: TestBuildResourceARN/bucket_only (0.00s) --- PASS: TestBuildResourceARN/bucket_with_slash (0.00s) --- PASS: TestBuildResourceARN/bucket_and_object (0.00s) --- PASS: TestBuildResourceARN/bucket_and_object_with_leading_slash (0.00s) === RUN TestBuildPrincipalARN === RUN TestBuildPrincipalARN/nil_identity_(anonymous) === RUN TestBuildPrincipalARN/explicit_principal_ARN === RUN TestBuildPrincipalARN/anonymous_user_by_name === RUN TestBuildPrincipalARN/anonymous_user_by_account_ID === RUN TestBuildPrincipalARN/identity_with_account_and_name === RUN TestBuildPrincipalARN/identity_without_account_ID === RUN TestBuildPrincipalARN/identity_without_name --- PASS: TestBuildPrincipalARN (0.00s) --- PASS: TestBuildPrincipalARN/nil_identity_(anonymous) (0.00s) --- PASS: TestBuildPrincipalARN/explicit_principal_ARN (0.00s) --- PASS: TestBuildPrincipalARN/anonymous_user_by_name (0.00s) --- PASS: TestBuildPrincipalARN/anonymous_user_by_account_ID (0.00s) --- PASS: TestBuildPrincipalARN/identity_with_account_and_name (0.00s) --- PASS: TestBuildPrincipalARN/identity_without_account_ID (0.00s) --- PASS: TestBuildPrincipalARN/identity_without_name (0.00s) === RUN TestBucketPolicyRoutesUseTheirOwnActions --- PASS: TestBucketPolicyRoutesUseTheirOwnActions (0.15s) === RUN TestBucketPolicyWriteIsNotImpliedByObjectWrite --- PASS: TestBucketPolicyWriteIsNotImpliedByObjectWrite (0.00s) === RUN TestBucketPolicyWriteAllowedForAdmin === RUN TestBucketPolicyWriteAllowedForAdmin/global_admin === RUN TestBucketPolicyWriteAllowedForAdmin/bucket_admin === RUN TestBucketPolicyWriteAllowedForAdmin/explicit_delegation --- PASS: TestBucketPolicyWriteAllowedForAdmin (0.00s) --- PASS: TestBucketPolicyWriteAllowedForAdmin/global_admin (0.00s) --- PASS: TestBucketPolicyWriteAllowedForAdmin/bucket_admin (0.00s) --- PASS: TestBucketPolicyWriteAllowedForAdmin/explicit_delegation (0.00s) === RUN TestBucketPolicyActionsAreGrantableViaIamPolicy --- PASS: TestBucketPolicyActionsAreGrantableViaIamPolicy (0.00s) === RUN TestBucketPolicyActionsMapToAwsActionNames --- PASS: TestBucketPolicyActionsMapToAwsActionNames (0.00s) === RUN TestBucketPolicyAllowDoesNotOverrideIdentityExplicitDeny --- PASS: TestBucketPolicyAllowDoesNotOverrideIdentityExplicitDeny (0.02s) === RUN TestBucketPolicyAllowSuppliesImplicitIdentityDeny --- PASS: TestBucketPolicyAllowSuppliesImplicitIdentityDeny (0.01s) === RUN TestBucketPolicyAllowControlPathUnaffected --- PASS: TestBucketPolicyAllowControlPathUnaffected (0.01s) === RUN TestAuthorizeObjectKeyActionBucketAllowDoesNotOverrideIdentityDeny --- PASS: TestAuthorizeObjectKeyActionBucketAllowDoesNotOverrideIdentityDeny (0.01s) === RUN TestRecheckPolicyForKeyWithLookupHonorsIdentityDeny --- PASS: TestRecheckPolicyForKeyWithLookupHonorsIdentityDeny (0.02s) === RUN TestBucketPolicyMirrorOps === RUN TestBucketPolicyMirrorOps/create_without_policy === RUN TestBucketPolicyMirrorOps/policy_set === RUN TestBucketPolicyMirrorOps/policy_replaced === RUN TestBucketPolicyMirrorOps/policy_unchanged === RUN TestBucketPolicyMirrorOps/policy_removed === RUN TestBucketPolicyMirrorOps/bucket_deleted === RUN TestBucketPolicyMirrorOps/bucket_deleted_without_policy === RUN TestBucketPolicyMirrorOps/renamed_with_unchanged_policy === RUN TestBucketPolicyMirrorOps/renamed_with_changed_policy === RUN TestBucketPolicyMirrorOps/renamed_and_policy_dropped === RUN TestBucketPolicyMirrorOps/renamed_without_prior_policy --- PASS: TestBucketPolicyMirrorOps (0.01s) --- PASS: TestBucketPolicyMirrorOps/create_without_policy (0.00s) --- PASS: TestBucketPolicyMirrorOps/policy_set (0.00s) --- PASS: TestBucketPolicyMirrorOps/policy_replaced (0.00s) --- PASS: TestBucketPolicyMirrorOps/policy_unchanged (0.00s) --- PASS: TestBucketPolicyMirrorOps/policy_removed (0.00s) --- PASS: TestBucketPolicyMirrorOps/bucket_deleted (0.00s) --- PASS: TestBucketPolicyMirrorOps/bucket_deleted_without_policy (0.00s) --- PASS: TestBucketPolicyMirrorOps/renamed_with_unchanged_policy (0.00s) --- PASS: TestBucketPolicyMirrorOps/renamed_with_changed_policy (0.00s) --- PASS: TestBucketPolicyMirrorOps/renamed_and_policy_dropped (0.00s) --- PASS: TestBucketPolicyMirrorOps/renamed_without_prior_policy (0.00s) === RUN TestNormalizeQuotaUnit === RUN TestNormalizeQuotaUnit/#00 === RUN TestNormalizeQuotaUnit/B === RUN TestNormalizeQuotaUnit/b === RUN TestNormalizeQuotaUnit/KB === RUN TestNormalizeQuotaUnit/kb === RUN TestNormalizeQuotaUnit/MB === RUN TestNormalizeQuotaUnit/mb === RUN TestNormalizeQuotaUnit/GB === RUN TestNormalizeQuotaUnit/gb === RUN TestNormalizeQuotaUnit/TB === RUN TestNormalizeQuotaUnit/tb === RUN TestNormalizeQuotaUnit/PB === RUN TestNormalizeQuotaUnit/invalid --- PASS: TestNormalizeQuotaUnit (0.01s) --- PASS: TestNormalizeQuotaUnit/#00 (0.00s) --- PASS: TestNormalizeQuotaUnit/B (0.00s) --- PASS: TestNormalizeQuotaUnit/b (0.00s) --- PASS: TestNormalizeQuotaUnit/KB (0.00s) --- PASS: TestNormalizeQuotaUnit/kb (0.00s) --- PASS: TestNormalizeQuotaUnit/MB (0.00s) --- PASS: TestNormalizeQuotaUnit/mb (0.00s) --- PASS: TestNormalizeQuotaUnit/GB (0.00s) --- PASS: TestNormalizeQuotaUnit/gb (0.00s) --- PASS: TestNormalizeQuotaUnit/TB (0.00s) --- PASS: TestNormalizeQuotaUnit/tb (0.00s) --- PASS: TestNormalizeQuotaUnit/PB (0.00s) --- PASS: TestNormalizeQuotaUnit/invalid (0.00s) === RUN TestConvertQuotaToBytes === RUN TestConvertQuotaToBytes/B === RUN TestConvertQuotaToBytes/GB === RUN TestConvertQuotaToBytes/B#01 === RUN TestConvertQuotaToBytes/KB === RUN TestConvertQuotaToBytes/MB === RUN TestConvertQuotaToBytes/GB#01 === RUN TestConvertQuotaToBytes/TB === RUN TestConvertQuotaToBytes/GB#02 === RUN TestConvertQuotaToBytes/GB#03 === RUN TestConvertQuotaToBytes/TB#01 === RUN TestConvertQuotaToBytes/KB#01 === RUN TestConvertQuotaToBytes/B#02 --- PASS: TestConvertQuotaToBytes (0.01s) --- PASS: TestConvertQuotaToBytes/B (0.00s) --- PASS: TestConvertQuotaToBytes/GB (0.00s) --- PASS: TestConvertQuotaToBytes/B#01 (0.00s) --- PASS: TestConvertQuotaToBytes/KB (0.00s) --- PASS: TestConvertQuotaToBytes/MB (0.00s) --- PASS: TestConvertQuotaToBytes/GB#01 (0.00s) --- PASS: TestConvertQuotaToBytes/TB (0.00s) --- PASS: TestConvertQuotaToBytes/GB#02 (0.00s) --- PASS: TestConvertQuotaToBytes/GB#03 (0.00s) --- PASS: TestConvertQuotaToBytes/TB#01 (0.00s) --- PASS: TestConvertQuotaToBytes/KB#01 (0.00s) --- PASS: TestConvertQuotaToBytes/B#02 (0.00s) === RUN TestPutBucketQuotaHandler_InvalidBody --- PASS: TestPutBucketQuotaHandler_InvalidBody (0.00s) === RUN TestPutBucketQuotaHandler_TrailingData --- PASS: TestPutBucketQuotaHandler_TrailingData (0.00s) === RUN TestPutBucketQuotaHandler_EnabledWithZeroSize --- PASS: TestPutBucketQuotaHandler_EnabledWithZeroSize (0.00s) === RUN TestPutBucketQuotaHandler_InvalidUnit --- PASS: TestPutBucketQuotaHandler_InvalidUnit (0.00s) === RUN TestPutBucketQuotaHandler_NoBucket --- PASS: TestPutBucketQuotaHandler_NoBucket (0.00s) === RUN TestGetBucketQuotaHandler_NoBucket --- PASS: TestGetBucketQuotaHandler_NoBucket (0.00s) === RUN TestUnroutedBucketSubresource --- PASS: TestUnroutedBucketSubresource (0.00s) === RUN TestPutBucketTaggingTagCountLimit === RUN TestPutBucketTaggingTagCountLimit/10_tags === RUN TestPutBucketTaggingTagCountLimit/11_tags === RUN TestPutBucketTaggingTagCountLimit/50_tags === RUN TestPutBucketTaggingTagCountLimit/51_tags E1117 09:41:58.523519 s3api_bucket_tagging_handlers.go:80 PutBucketTagging ValidateTags error /tag-limit-bucket?tagging: validate tags: 51 tags more than 50 === RUN TestPutBucketTaggingTagCountLimit/2_tags_with_a_repeated_key E1117 09:41:58.528255 s3api_bucket_tagging_handlers.go:73 PutBucketTagging duplicate tag keys /tag-limit-bucket?tagging === RUN TestPutBucketTaggingTagCountLimit/51_tags_with_a_repeated_key E1117 09:41:58.544152 s3api_bucket_tagging_handlers.go:73 PutBucketTagging duplicate tag keys /tag-limit-bucket?tagging === RUN TestPutBucketTaggingTagCountLimit/1_tags_with_an_empty_key E1117 09:41:58.547638 s3api_bucket_tagging_handlers.go:80 PutBucketTagging ValidateTags error /tag-limit-bucket?tagging: validate tags: empty tag key --- PASS: TestPutBucketTaggingTagCountLimit (0.10s) --- PASS: TestPutBucketTaggingTagCountLimit/10_tags (0.02s) --- PASS: TestPutBucketTaggingTagCountLimit/11_tags (0.01s) --- PASS: TestPutBucketTaggingTagCountLimit/50_tags (0.03s) --- PASS: TestPutBucketTaggingTagCountLimit/51_tags (0.01s) --- PASS: TestPutBucketTaggingTagCountLimit/2_tags_with_a_repeated_key (0.00s) --- PASS: TestPutBucketTaggingTagCountLimit/51_tags_with_a_repeated_key (0.02s) --- PASS: TestPutBucketTaggingTagCountLimit/1_tags_with_an_empty_key (0.00s) === RUN TestDetectPrimarySSETypeFromManifestedEntry === RUN TestDetectPrimarySSETypeFromManifestedEntry/SSE-C === RUN TestDetectPrimarySSETypeFromManifestedEntry/SSE-KMS === RUN TestDetectPrimarySSETypeFromManifestedEntry/SSE-S3 --- PASS: TestDetectPrimarySSETypeFromManifestedEntry (0.00s) --- PASS: TestDetectPrimarySSETypeFromManifestedEntry/SSE-C (0.00s) --- PASS: TestDetectPrimarySSETypeFromManifestedEntry/SSE-KMS (0.00s) --- PASS: TestDetectPrimarySSETypeFromManifestedEntry/SSE-S3 (0.00s) === RUN TestSSECReadsResolveChunkManifests === RUN TestSSECReadsResolveChunkManifests/full_object === RUN TestSSECReadsResolveChunkManifests/range === RUN TestSSECReadsResolveChunkManifests/invalid_range === RUN TestSSECReadsResolveChunkManifests/wrong_key --- PASS: TestSSECReadsResolveChunkManifests (0.13s) --- PASS: TestSSECReadsResolveChunkManifests/full_object (0.10s) --- PASS: TestSSECReadsResolveChunkManifests/range (0.02s) --- PASS: TestSSECReadsResolveChunkManifests/invalid_range (0.00s) --- PASS: TestSSECReadsResolveChunkManifests/wrong_key (0.00s) === RUN TestPartRange --- PASS: TestPartRange (0.00s) === RUN TestLimit --- PASS: TestLimit (0.01s) === RUN TestLimitInterceptor === RUN TestLimitInterceptor/nil_interceptor_is_a_no-op === RUN TestLimitInterceptor/interceptor_can_reject === RUN TestLimitInterceptor/interceptor_can_pass_through === RUN TestLimitInterceptor/interceptor_installed_after_registration_takes_effect --- PASS: TestLimitInterceptor (0.01s) --- PASS: TestLimitInterceptor/nil_interceptor_is_a_no-op (0.00s) --- PASS: TestLimitInterceptor/interceptor_can_reject (0.00s) --- PASS: TestLimitInterceptor/interceptor_can_pass_through (0.00s) --- PASS: TestLimitInterceptor/interceptor_installed_after_registration_takes_effect (0.00s) === RUN TestLimitUploadSlotWait === RUN TestLimitUploadSlotWait/wait_for_a_slot_times_out_with_SlowDown === RUN TestLimitUploadSlotWait/cancelled_request_stops_waiting === RUN TestLimitUploadSlotWait/freed_bytes_admit_every_waiter_that_fits --- PASS: TestLimitUploadSlotWait (0.21s) --- PASS: TestLimitUploadSlotWait/wait_for_a_slot_times_out_with_SlowDown (0.11s) --- PASS: TestLimitUploadSlotWait/cancelled_request_stops_waiting (0.05s) --- PASS: TestLimitUploadSlotWait/freed_bytes_admit_every_waiter_that_fits (0.05s) === RUN TestLimitUploadSlotRejectsStalledBody --- PASS: TestLimitUploadSlotRejectsStalledBody (0.61s) === RUN TestCopyAfterRoutedPut === RUN TestCopyAfterRoutedPut/versioning=/multipart=false === RUN TestCopyAfterRoutedPut/versioning=/multipart=true === RUN TestCopyAfterRoutedPut/versioning=Suspended/multipart=false === RUN TestCopyAfterRoutedPut/versioning=Suspended/multipart=true --- PASS: TestCopyAfterRoutedPut (0.23s) --- PASS: TestCopyAfterRoutedPut/versioning=/multipart=false (0.07s) --- PASS: TestCopyAfterRoutedPut/versioning=/multipart=true (0.05s) --- PASS: TestCopyAfterRoutedPut/versioning=Suspended/multipart=false (0.05s) --- PASS: TestCopyAfterRoutedPut/versioning=Suspended/multipart=true (0.05s) === RUN TestVersionedCopyDestinationReadsOnOwner --- PASS: TestVersionedCopyDestinationReadsOnOwner (0.08s) === RUN TestCopySourcePrefersWriteOwner === RUN TestCopySourcePrefersWriteOwner/overwrite === RUN TestCopySourcePrefersWriteOwner/deleted --- PASS: TestCopySourcePrefersWriteOwner (0.02s) --- PASS: TestCopySourcePrefersWriteOwner/overwrite (0.01s) --- PASS: TestCopySourcePrefersWriteOwner/deleted (0.01s) === RUN TestClassifyCopySourceError === RUN TestClassifyCopySourceError/regular_entry === RUN TestClassifyCopySourceError/nil_entry === RUN TestClassifyCopySourceError/directory_entry === RUN TestClassifyCopySourceError/delete_marker_entry === RUN TestClassifyCopySourceError/not_found_sentinel === RUN TestClassifyCopySourceError/wrapped_not_found === RUN TestClassifyCopySourceError/grpc_not_found === RUN TestClassifyCopySourceError/invalid_version_id === RUN TestClassifyCopySourceError/delete_marker_error === RUN TestClassifyCopySourceError/transient_unavailable === RUN TestClassifyCopySourceError/store_error === RUN TestClassifyCopySourceError/sentinel_text_in_message --- PASS: TestClassifyCopySourceError (0.01s) --- PASS: TestClassifyCopySourceError/regular_entry (0.00s) --- PASS: TestClassifyCopySourceError/nil_entry (0.00s) --- PASS: TestClassifyCopySourceError/directory_entry (0.00s) --- PASS: TestClassifyCopySourceError/delete_marker_entry (0.00s) --- PASS: TestClassifyCopySourceError/not_found_sentinel (0.00s) --- PASS: TestClassifyCopySourceError/wrapped_not_found (0.00s) --- PASS: TestClassifyCopySourceError/grpc_not_found (0.00s) --- PASS: TestClassifyCopySourceError/invalid_version_id (0.00s) --- PASS: TestClassifyCopySourceError/delete_marker_error (0.00s) --- PASS: TestClassifyCopySourceError/transient_unavailable (0.00s) --- PASS: TestClassifyCopySourceError/store_error (0.00s) --- PASS: TestClassifyCopySourceError/sentinel_text_in_message (0.00s) === RUN TestValidateRequestEncryption === RUN TestValidateRequestEncryption/no_encryption === RUN TestValidateRequestEncryption/SSE-S3 === RUN TestValidateRequestEncryption/SSE-KMS === RUN TestValidateRequestEncryption/SSE-C === RUN TestValidateRequestEncryption/unknown_algorithm === RUN TestValidateRequestEncryption/misspelled_AES256 === RUN TestValidateRequestEncryption/SSE-C_and_SSE-S3 === RUN TestValidateRequestEncryption/SSE-C_and_SSE-KMS === RUN TestValidateRequestEncryption/repeated_algorithm_header === RUN TestValidateRequestEncryption/repeated_identical_algorithm === RUN TestValidateRequestEncryption/empty_value_before_KMS === RUN TestValidateRequestEncryption/SSE-S3_hidden_behind_empty_value === RUN TestValidateRequestEncryption/repeated_SSE-C_key_header === RUN TestValidateRequestEncryption/repeated_KMS_key_id === RUN TestValidateRequestEncryption/SSE-S3_with_KMS_key_id === RUN TestValidateRequestEncryption/KMS_key_id_without_method === RUN TestValidateRequestEncryption/KMS_key_id_with_aws:kms --- PASS: TestValidateRequestEncryption (0.02s) --- PASS: TestValidateRequestEncryption/no_encryption (0.00s) --- PASS: TestValidateRequestEncryption/SSE-S3 (0.00s) --- PASS: TestValidateRequestEncryption/SSE-KMS (0.00s) --- PASS: TestValidateRequestEncryption/SSE-C (0.00s) --- PASS: TestValidateRequestEncryption/unknown_algorithm (0.00s) --- PASS: TestValidateRequestEncryption/misspelled_AES256 (0.00s) --- PASS: TestValidateRequestEncryption/SSE-C_and_SSE-S3 (0.00s) --- PASS: TestValidateRequestEncryption/SSE-C_and_SSE-KMS (0.00s) --- PASS: TestValidateRequestEncryption/repeated_algorithm_header (0.00s) --- PASS: TestValidateRequestEncryption/repeated_identical_algorithm (0.00s) --- PASS: TestValidateRequestEncryption/empty_value_before_KMS (0.00s) --- PASS: TestValidateRequestEncryption/SSE-S3_hidden_behind_empty_value (0.00s) --- PASS: TestValidateRequestEncryption/repeated_SSE-C_key_header (0.00s) --- PASS: TestValidateRequestEncryption/repeated_KMS_key_id (0.00s) --- PASS: TestValidateRequestEncryption/SSE-S3_with_KMS_key_id (0.00s) --- PASS: TestValidateRequestEncryption/KMS_key_id_without_method (0.00s) --- PASS: TestValidateRequestEncryption/KMS_key_id_with_aws:kms (0.00s) === RUN TestDirectoryMarkerSSEC --- PASS: TestDirectoryMarkerSSEC (0.00s) === RUN TestClassifyDomainNames === RUN TestClassifyDomainNames/Mixed_path-style_and_virtual-host_with_single_parent === RUN TestClassifyDomainNames/Multiple_subdomains_with_same_parent === RUN TestClassifyDomainNames/Subdomain_without_parent_in_list === RUN TestClassifyDomainNames/Only_top-level_domain === RUN TestClassifyDomainNames/Multiple_independent_domains === RUN TestClassifyDomainNames/Mixed_with_nested_levels === RUN TestClassifyDomainNames/Domain_without_dot === RUN TestClassifyDomainNames/Empty_list === RUN TestClassifyDomainNames/Mixed_localhost_and_domain === RUN TestClassifyDomainNames/Three-level_subdomain_hierarchy === RUN TestClassifyDomainNames/Real-world_example_from_issue_#7356 --- PASS: TestClassifyDomainNames (0.01s) --- PASS: TestClassifyDomainNames/Mixed_path-style_and_virtual-host_with_single_parent (0.00s) --- PASS: TestClassifyDomainNames/Multiple_subdomains_with_same_parent (0.00s) --- PASS: TestClassifyDomainNames/Subdomain_without_parent_in_list (0.00s) --- PASS: TestClassifyDomainNames/Only_top-level_domain (0.00s) --- PASS: TestClassifyDomainNames/Multiple_independent_domains (0.00s) --- PASS: TestClassifyDomainNames/Mixed_with_nested_levels (0.00s) --- PASS: TestClassifyDomainNames/Domain_without_dot (0.00s) --- PASS: TestClassifyDomainNames/Empty_list (0.00s) --- PASS: TestClassifyDomainNames/Mixed_localhost_and_domain (0.00s) --- PASS: TestClassifyDomainNames/Three-level_subdomain_hierarchy (0.00s) --- PASS: TestClassifyDomainNames/Real-world_example_from_issue_#7356 (0.00s) === RUN TestClassifyDomainNamesOrder === RUN TestClassifyDomainNamesOrder/Parent_before_child === RUN TestClassifyDomainNamesOrder/Child_before_parent === RUN TestClassifyDomainNamesOrder/Mixed_order_with_multiple_children --- PASS: TestClassifyDomainNamesOrder (0.00s) --- PASS: TestClassifyDomainNamesOrder/Parent_before_child (0.00s) --- PASS: TestClassifyDomainNamesOrder/Child_before_parent (0.00s) --- PASS: TestClassifyDomainNamesOrder/Mixed_order_with_multiple_children (0.00s) === RUN TestClassifyDomainNamesEdgeCases === RUN TestClassifyDomainNamesEdgeCases/Duplicate_domains === RUN TestClassifyDomainNamesEdgeCases/Very_long_domain_name === RUN TestClassifyDomainNamesEdgeCases/Similar_but_different_domains === RUN TestClassifyDomainNamesEdgeCases/IP_address_as_domain --- PASS: TestClassifyDomainNamesEdgeCases (0.00s) --- PASS: TestClassifyDomainNamesEdgeCases/Duplicate_domains (0.00s) --- PASS: TestClassifyDomainNamesEdgeCases/Very_long_domain_name (0.00s) --- PASS: TestClassifyDomainNamesEdgeCases/Similar_but_different_domains (0.00s) --- PASS: TestClassifyDomainNamesEdgeCases/IP_address_as_domain (0.00s) === RUN TestClassifyDomainNamesUseCases === RUN TestClassifyDomainNamesUseCases/Issue_#7356_-_Prometheus_blackbox_exporter_scenario === RUN TestClassifyDomainNamesUseCases/Multi-environment_setup === RUN TestClassifyDomainNamesUseCases/Mixed_production_setup --- PASS: TestClassifyDomainNamesUseCases (0.00s) --- PASS: TestClassifyDomainNamesUseCases/Issue_#7356_-_Prometheus_blackbox_exporter_scenario (0.00s) --- PASS: TestClassifyDomainNamesUseCases/Multi-environment_setup (0.00s) --- PASS: TestClassifyDomainNamesUseCases/Mixed_production_setup (0.00s) === RUN TestAuthorizeIamActionDeniesDataPlanePolicy === RUN TestAuthorizeIamActionDeniesDataPlanePolicy/query= === RUN TestAuthorizeIamActionDeniesDataPlanePolicy/query=delete === RUN TestAuthorizeIamActionDeniesDataPlanePolicy/query=acl === RUN TestAuthorizeIamActionDeniesDataPlanePolicy/query=tagging === RUN TestAuthorizeIamActionDeniesDataPlanePolicy/query=policy === RUN TestAuthorizeIamActionDeniesDataPlanePolicy/query=versions --- PASS: TestAuthorizeIamActionDeniesDataPlanePolicy (0.01s) --- PASS: TestAuthorizeIamActionDeniesDataPlanePolicy/query= (0.00s) --- PASS: TestAuthorizeIamActionDeniesDataPlanePolicy/query=delete (0.00s) --- PASS: TestAuthorizeIamActionDeniesDataPlanePolicy/query=acl (0.00s) --- PASS: TestAuthorizeIamActionDeniesDataPlanePolicy/query=tagging (0.00s) --- PASS: TestAuthorizeIamActionDeniesDataPlanePolicy/query=policy (0.00s) --- PASS: TestAuthorizeIamActionDeniesDataPlanePolicy/query=versions (0.00s) === RUN TestAuthorizeIamActionAllowsIamPolicy === RUN TestAuthorizeIamActionAllowsIamPolicy/query= === RUN TestAuthorizeIamActionAllowsIamPolicy/query=delete --- PASS: TestAuthorizeIamActionAllowsIamPolicy (0.00s) --- PASS: TestAuthorizeIamActionAllowsIamPolicy/query= (0.00s) --- PASS: TestAuthorizeIamActionAllowsIamPolicy/query=delete (0.00s) === RUN TestAuthorizeIamActionSelfServiceAndAdmin --- PASS: TestAuthorizeIamActionSelfServiceAndAdmin (0.00s) === RUN TestAuthorizeIamActionDeniesUngrantedIdentity --- PASS: TestAuthorizeIamActionDeniesUngrantedIdentity (0.00s) === RUN TestAuthorizeIamActionDeniesAnonymous --- PASS: TestAuthorizeIamActionDeniesAnonymous (0.00s) === RUN TestAuthorizeIamActionCreateServiceAccountScopedByPolicyResource --- PASS: TestAuthorizeIamActionCreateServiceAccountScopedByPolicyResource (0.01s) === RUN TestAuthorizeIamActionSelfServiceRequiresGrantWhenConfigured --- PASS: TestAuthorizeIamActionSelfServiceRequiresGrantWhenConfigured (0.01s) === RUN TestAuthorizeIamActionSelfServiceGrantIsScopedByResource === RUN TestAuthorizeIamActionSelfServiceGrantIsScopedByResource/arn:aws:iam:::user/key_owner === RUN TestAuthorizeIamActionSelfServiceGrantIsScopedByResource/arn:aws:iam:::user/${aws:username} --- PASS: TestAuthorizeIamActionSelfServiceGrantIsScopedByResource (0.02s) --- PASS: TestAuthorizeIamActionSelfServiceGrantIsScopedByResource/arn:aws:iam:::user/key_owner (0.01s) --- PASS: TestAuthorizeIamActionSelfServiceGrantIsScopedByResource/arn:aws:iam:::user/${aws:username} (0.01s) === RUN TestAuthorizeIamActionSelfServiceRequiresGrantKeepsAdmin --- PASS: TestAuthorizeIamActionSelfServiceRequiresGrantKeepsAdmin (0.01s) === RUN TestAuthorizeIamActionSelfServiceDefaultUnchanged --- PASS: TestAuthorizeIamActionSelfServiceDefaultUnchanged (0.00s) === RUN TestEmbeddedIamCreateAccessKeyTargeted --- PASS: TestEmbeddedIamCreateAccessKeyTargeted (0.01s) === RUN TestEmbeddedIamDeleteAccessKeyTargeted --- PASS: TestEmbeddedIamDeleteAccessKeyTargeted (0.00s) === RUN TestEmbeddedIamUpdateAccessKeyTargeted --- PASS: TestEmbeddedIamUpdateAccessKeyTargeted (0.01s) === RUN TestEmbeddedIamPutUserPolicyTargeted --- PASS: TestEmbeddedIamPutUserPolicyTargeted (0.01s) === RUN TestEmbeddedIamDeleteUserPolicyTargeted --- PASS: TestEmbeddedIamDeleteUserPolicyTargeted (0.01s) === RUN TestEmbeddedIamSetUserStatusTargeted --- PASS: TestEmbeddedIamSetUserStatusTargeted (0.00s) === RUN TestEmbeddedIamUpdateUserRenameTargeted --- PASS: TestEmbeddedIamUpdateUserRenameTargeted (0.01s) === RUN TestEmbeddedIamDeleteUserTargeted --- PASS: TestEmbeddedIamDeleteUserTargeted (0.00s) === RUN TestEmbeddedIamTargetedSkipPersist --- PASS: TestEmbeddedIamTargetedSkipPersist (0.01s) === RUN TestEmbeddedIamStaticIdentityKeepsFullSave --- PASS: TestEmbeddedIamStaticIdentityKeepsFullSave (0.00s) === RUN TestEmbeddedIamCreateUser --- PASS: TestEmbeddedIamCreateUser (0.03s) === RUN TestEmbeddedIamCreateUserDoesNotSaveAllUsers --- PASS: TestEmbeddedIamCreateUserDoesNotSaveAllUsers (0.01s) === RUN TestEmbeddedIamCreateUserSkipPersist --- PASS: TestEmbeddedIamCreateUserSkipPersist (0.00s) === RUN TestEmbeddedIamListUsers --- PASS: TestEmbeddedIamListUsers (0.01s) === RUN TestEmbeddedIamListAccessKeys --- PASS: TestEmbeddedIamListAccessKeys (0.00s) === RUN TestEmbeddedIamGetUser --- PASS: TestEmbeddedIamGetUser (0.00s) === RUN TestEmbeddedIamGetUserImplicitUsername --- PASS: TestEmbeddedIamGetUserImplicitUsername (0.01s) === RUN TestEmbeddedIamCreatePolicy --- PASS: TestEmbeddedIamCreatePolicy (0.01s) === RUN TestEmbeddedIamCreatePolicyVersion --- PASS: TestEmbeddedIamCreatePolicyVersion (0.02s) === RUN TestEmbeddedIamCreatePolicyVersionMissingPolicy E1117 09:42:00.181612 s3api_embedded_iam.go:3074 CreatePolicyVersion: policy does-not-exist not found E1117 09:42:00.181937 s3api_embedded_iam.go:363 IAM Response policy does-not-exist not found --- PASS: TestEmbeddedIamCreatePolicyVersionMissingPolicy (0.01s) === RUN TestEmbeddedIamCreatePolicyVersionRequiresSetAsDefault E1117 09:42:00.193863 s3api_embedded_iam.go:3074 CreatePolicyVersion: SetAsDefault must be true: SeaweedFS stores a single managed policy version E1117 09:42:00.194055 s3api_embedded_iam.go:363 IAM Response SetAsDefault must be true: SeaweedFS stores a single managed policy version --- PASS: TestEmbeddedIamCreatePolicyVersionRequiresSetAsDefault (0.01s) === RUN TestEmbeddedIamPutUserPolicy --- PASS: TestEmbeddedIamPutUserPolicy (0.01s) === RUN TestEmbeddedIamPutUserPolicyError E1117 09:42:00.212494 s3api_embedded_iam.go:2964 PutUserPolicy: the user with name InvalidUser cannot be found E1117 09:42:00.212790 s3api_embedded_iam.go:363 IAM Response the user with name InvalidUser cannot be found --- PASS: TestEmbeddedIamPutUserPolicyError (0.01s) === RUN TestEmbeddedIamGetUserPolicy --- PASS: TestEmbeddedIamGetUserPolicy (0.01s) === RUN TestEmbeddedIamDeleteUserPolicy --- PASS: TestEmbeddedIamDeleteUserPolicy (0.01s) === RUN TestEmbeddedIamDeleteUserPolicyUserNotFound E1117 09:42:00.233970 s3api_embedded_iam.go:363 IAM Response the user with name NonExistentUser cannot be found. --- PASS: TestEmbeddedIamDeleteUserPolicyUserNotFound (0.00s) === RUN TestEmbeddedIamListUserPolicies E1117 09:42:00.242777 s3api_embedded_iam.go:363 IAM Response the user with name NonExistentUser cannot be found. --- PASS: TestEmbeddedIamListUserPolicies (0.01s) === RUN TestEmbeddedIamGroupInlinePolicies_CRUD --- PASS: TestEmbeddedIamGroupInlinePolicies_CRUD (0.01s) === RUN TestEmbeddedIamAttachUserPolicy W1117 09:42:00.258418 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "TestManagedPolicy": invalid policy: invalid policy: policy must contain at least one statement W1117 09:42:00.260217 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "TestManagedPolicy": invalid policy: invalid policy: policy must contain at least one statement --- PASS: TestEmbeddedIamAttachUserPolicy (0.01s) === RUN TestEmbeddedIamAttachUserPolicyRefreshesIAM --- PASS: TestEmbeddedIamAttachUserPolicyRefreshesIAM (0.01s) === RUN TestEmbeddedIamAttachUserPolicyNoSuchPolicy E1117 09:42:00.275593 s3api_embedded_iam.go:363 IAM Response policy DoesNotExist not found --- PASS: TestEmbeddedIamAttachUserPolicyNoSuchPolicy (0.01s) === RUN TestEmbeddedIamDetachUserPolicy W1117 09:42:00.285033 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "TestManagedPolicy": invalid policy: invalid policy: policy must contain at least one statement W1117 09:42:00.285676 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "KeepPolicy": invalid policy: invalid policy: policy must contain at least one statement W1117 09:42:00.287627 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "KeepPolicy": invalid policy: invalid policy: policy must contain at least one statement W1117 09:42:00.288097 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "TestManagedPolicy": invalid policy: invalid policy: policy must contain at least one statement --- PASS: TestEmbeddedIamDetachUserPolicy (0.01s) === RUN TestEmbeddedIamDeletePolicyInUse E1117 09:42:00.296253 s3api_embedded_iam.go:2955 DeletePolicy: policy TestPolicy is attached to user TestUser E1117 09:42:00.296732 s3api_embedded_iam.go:363 IAM Response policy TestPolicy is attached to user TestUser --- PASS: TestEmbeddedIamDeletePolicyInUse (0.01s) === RUN TestEmbeddedIamAttachAlreadyAttachedPolicy W1117 09:42:00.305978 auth_credentials.go:3493 IAM policy cache rebuild: skipping invalid policy "TestManagedPolicy": invalid policy: invalid policy: policy must contain at least one statement --- PASS: TestEmbeddedIamAttachAlreadyAttachedPolicy (0.01s) === RUN TestEmbeddedIamDetachNotAttachedPolicy E1117 09:42:00.313112 s3api_embedded_iam.go:363 IAM Response policy MissingPolicy not attached to user TestUser --- PASS: TestEmbeddedIamDetachNotAttachedPolicy (0.01s) === RUN TestEmbeddedIamAttachPolicyLimitExceeded E1117 09:42:00.324958 s3api_embedded_iam.go:363 IAM Response cannot attach more than 10 managed policies to user TestUser --- PASS: TestEmbeddedIamAttachPolicyLimitExceeded (0.01s) === RUN TestEmbeddedIamListAttachedUserPolicies --- PASS: TestEmbeddedIamListAttachedUserPolicies (0.01s) === RUN TestEmbeddedIamUpdateUser --- PASS: TestEmbeddedIamUpdateUser (0.01s) === RUN TestEmbeddedIamUpdateUserPreservesInlinePolicies --- PASS: TestEmbeddedIamUpdateUserPreservesInlinePolicies (0.01s) === RUN TestEmbeddedIamDeleteUser --- PASS: TestEmbeddedIamDeleteUser (0.01s) === RUN TestEmbeddedIamCreateAccessKey --- PASS: TestEmbeddedIamCreateAccessKey (0.01s) === RUN TestEmbeddedIamCreateAccessKeyRejectsMissingUser E1117 09:42:00.372597 s3api_embedded_iam.go:2913 CreateAccessKey: the user with name GhostUser cannot be found. E1117 09:42:00.372832 s3api_embedded_iam.go:363 IAM Response the user with name GhostUser cannot be found. --- PASS: TestEmbeddedIamCreateAccessKeyRejectsMissingUser (0.00s) === RUN TestEmbeddedIamCreateAccessKeyWithCallerSuppliedKeys --- PASS: TestEmbeddedIamCreateAccessKeyWithCallerSuppliedKeys (0.01s) === RUN TestEmbeddedIamCreateAccessKeyRejectsWeakKeys E1117 09:42:00.383289 s3api_embedded_iam.go:2913 CreateAccessKey: AccessKeyId must be 4 to 128 alphanumeric characters E1117 09:42:00.383460 s3api_embedded_iam.go:363 IAM Response AccessKeyId must be 4 to 128 alphanumeric characters E1117 09:42:00.385605 s3api_embedded_iam.go:2913 CreateAccessKey: SecretAccessKey must be between 8 and 128 characters E1117 09:42:00.385751 s3api_embedded_iam.go:363 IAM Response SecretAccessKey must be between 8 and 128 characters E1117 09:42:00.387400 s3api_embedded_iam.go:2913 CreateAccessKey: AccessKeyId must be 4 to 128 alphanumeric characters E1117 09:42:00.387545 s3api_embedded_iam.go:363 IAM Response AccessKeyId must be 4 to 128 alphanumeric characters --- PASS: TestEmbeddedIamCreateAccessKeyRejectsWeakKeys (0.01s) === RUN TestEmbeddedIamCreateAccessKeyRejectsCollision E1117 09:42:00.391498 s3api_embedded_iam.go:2913 CreateAccessKey: AccessKeyId is already in use E1117 09:42:00.391650 s3api_embedded_iam.go:363 IAM Response AccessKeyId is already in use --- PASS: TestEmbeddedIamCreateAccessKeyRejectsCollision (0.00s) === RUN TestEmbeddedIamCreateAccessKeyRejectsPartialSupply E1117 09:42:00.395178 s3api_embedded_iam.go:2913 CreateAccessKey: AccessKeyId and SecretAccessKey must be supplied together E1117 09:42:00.395326 s3api_embedded_iam.go:363 IAM Response AccessKeyId and SecretAccessKey must be supplied together E1117 09:42:00.397115 s3api_embedded_iam.go:2913 CreateAccessKey: AccessKeyId and SecretAccessKey must be supplied together E1117 09:42:00.397288 s3api_embedded_iam.go:363 IAM Response AccessKeyId and SecretAccessKey must be supplied together --- PASS: TestEmbeddedIamCreateAccessKeyRejectsPartialSupply (0.00s) === RUN TestEmbeddedIamCreateAccessKeyBoundary E1117 09:42:00.402204 s3api_embedded_iam.go:2913 CreateAccessKey: AccessKeyId must be 4 to 128 alphanumeric characters E1117 09:42:00.402369 s3api_embedded_iam.go:363 IAM Response AccessKeyId must be 4 to 128 alphanumeric characters E1117 09:42:00.406788 s3api_embedded_iam.go:2913 CreateAccessKey: AccessKeyId must be 4 to 128 alphanumeric characters E1117 09:42:00.406934 s3api_embedded_iam.go:363 IAM Response AccessKeyId must be 4 to 128 alphanumeric characters E1117 09:42:00.408714 s3api_embedded_iam.go:2913 CreateAccessKey: SecretAccessKey must be between 8 and 128 characters E1117 09:42:00.408856 s3api_embedded_iam.go:363 IAM Response SecretAccessKey must be between 8 and 128 characters E1117 09:42:00.413367 s3api_embedded_iam.go:2913 CreateAccessKey: SecretAccessKey must be between 8 and 128 characters E1117 09:42:00.413514 s3api_embedded_iam.go:363 IAM Response SecretAccessKey must be between 8 and 128 characters --- PASS: TestEmbeddedIamCreateAccessKeyBoundary (0.02s) === RUN TestEmbeddedIamDeleteAccessKey --- PASS: TestEmbeddedIamDeleteAccessKey (0.00s) === RUN TestEmbeddedIamHandleImplicitUsername --- PASS: TestEmbeddedIamHandleImplicitUsername (0.00s) === RUN TestEmbeddedIamFullWorkflow === RUN TestEmbeddedIamFullWorkflow/CreateUser === RUN TestEmbeddedIamFullWorkflow/CreateAccessKey === RUN TestEmbeddedIamFullWorkflow/PutUserPolicy === RUN TestEmbeddedIamFullWorkflow/ListUsers === RUN TestEmbeddedIamFullWorkflow/DeleteUserConflict E1117 09:42:00.441920 s3api_embedded_iam.go:363 IAM Response cannot delete user WorkflowUser: user has 1 access key(s). Delete access keys first === RUN TestEmbeddedIamFullWorkflow/DeleteAccessKey === RUN TestEmbeddedIamFullWorkflow/DeleteUser --- PASS: TestEmbeddedIamFullWorkflow (0.03s) --- PASS: TestEmbeddedIamFullWorkflow/CreateUser (0.00s) --- PASS: TestEmbeddedIamFullWorkflow/CreateAccessKey (0.00s) --- PASS: TestEmbeddedIamFullWorkflow/PutUserPolicy (0.01s) --- PASS: TestEmbeddedIamFullWorkflow/ListUsers (0.00s) --- PASS: TestEmbeddedIamFullWorkflow/DeleteUserConflict (0.00s) --- PASS: TestEmbeddedIamFullWorkflow/DeleteAccessKey (0.01s) --- PASS: TestEmbeddedIamFullWorkflow/DeleteUser (0.00s) === RUN TestIamStringSlicesEqual === RUN TestIamStringSlicesEqual/both_empty === RUN TestIamStringSlicesEqual/both_nil === RUN TestIamStringSlicesEqual/same_elements_same_order === RUN TestIamStringSlicesEqual/same_elements_different_order === RUN TestIamStringSlicesEqual/different_lengths === RUN TestIamStringSlicesEqual/different_elements === RUN TestIamStringSlicesEqual/one_empty_one_not === RUN TestIamStringSlicesEqual/duplicates_same --- PASS: TestIamStringSlicesEqual (0.01s) --- PASS: TestIamStringSlicesEqual/both_empty (0.00s) --- PASS: TestIamStringSlicesEqual/both_nil (0.00s) --- PASS: TestIamStringSlicesEqual/same_elements_same_order (0.00s) --- PASS: TestIamStringSlicesEqual/same_elements_different_order (0.00s) --- PASS: TestIamStringSlicesEqual/different_lengths (0.00s) --- PASS: TestIamStringSlicesEqual/different_elements (0.00s) --- PASS: TestIamStringSlicesEqual/one_empty_one_not (0.00s) --- PASS: TestIamStringSlicesEqual/duplicates_same (0.00s) === RUN TestIamHash --- PASS: TestIamHash (0.00s) === RUN TestIamStringWithCharset --- PASS: TestIamStringWithCharset (0.00s) === RUN TestIamMapToStatementAction === RUN TestIamMapToStatementAction/* === RUN TestIamMapToStatementAction/Get* === RUN TestIamMapToStatementAction/Put* === RUN TestIamMapToStatementAction/List* === RUN TestIamMapToStatementAction/Tagging* === RUN TestIamMapToStatementAction/DeleteBucket* === RUN TestIamMapToStatementAction/PutBucketAcl === RUN TestIamMapToStatementAction/GetBucketAcl === RUN TestIamMapToStatementAction/InvalidAction --- PASS: TestIamMapToStatementAction (0.01s) --- PASS: TestIamMapToStatementAction/* (0.00s) --- PASS: TestIamMapToStatementAction/Get* (0.00s) --- PASS: TestIamMapToStatementAction/Put* (0.00s) --- PASS: TestIamMapToStatementAction/List* (0.00s) --- PASS: TestIamMapToStatementAction/Tagging* (0.00s) --- PASS: TestIamMapToStatementAction/DeleteBucket* (0.00s) --- PASS: TestIamMapToStatementAction/PutBucketAcl (0.00s) --- PASS: TestIamMapToStatementAction/GetBucketAcl (0.00s) --- PASS: TestIamMapToStatementAction/InvalidAction (0.00s) === RUN TestIamMapToIdentitiesAction === RUN TestIamMapToIdentitiesAction/Admin === RUN TestIamMapToIdentitiesAction/Read === RUN TestIamMapToIdentitiesAction/Write === RUN TestIamMapToIdentitiesAction/List === RUN TestIamMapToIdentitiesAction/Tagging === RUN TestIamMapToIdentitiesAction/Unknown --- PASS: TestIamMapToIdentitiesAction (0.00s) --- PASS: TestIamMapToIdentitiesAction/Admin (0.00s) --- PASS: TestIamMapToIdentitiesAction/Read (0.00s) --- PASS: TestIamMapToIdentitiesAction/Write (0.00s) --- PASS: TestIamMapToIdentitiesAction/List (0.00s) --- PASS: TestIamMapToIdentitiesAction/Tagging (0.00s) --- PASS: TestIamMapToIdentitiesAction/Unknown (0.00s) === RUN TestEmbeddedIamGetUserNotFound E1117 09:42:00.476642 s3api_embedded_iam.go:363 IAM Response the user with name NonExistentUser cannot be found. --- PASS: TestEmbeddedIamGetUserNotFound (0.00s) === RUN TestEmbeddedIamDeleteUserNotFound E1117 09:42:00.479894 s3api_embedded_iam.go:363 IAM Response the user with name NonExistentUser cannot be found. --- PASS: TestEmbeddedIamDeleteUserNotFound (0.00s) === RUN TestEmbeddedIamUpdateUserNotFound E1117 09:42:00.483112 s3api_embedded_iam.go:363 IAM Response the user with name NonExistentUser cannot be found. --- PASS: TestEmbeddedIamUpdateUserNotFound (0.00s) === RUN TestEmbeddedIamCreateAccessKeyForExistingUser --- PASS: TestEmbeddedIamCreateAccessKeyForExistingUser (0.00s) === RUN TestEmbeddedIamPutGetUserPolicyRoundTrip --- PASS: TestEmbeddedIamPutGetUserPolicyRoundTrip (0.00s) === RUN TestEmbeddedIamGetUserPolicyFallback --- PASS: TestEmbeddedIamGetUserPolicyFallback (0.00s) === RUN TestEmbeddedIamGetUserPolicyMissingName --- PASS: TestEmbeddedIamGetUserPolicyMissingName (0.00s) === RUN TestEmbeddedIamGetUserPolicyStoreError --- PASS: TestEmbeddedIamGetUserPolicyStoreError (0.00s) === RUN TestEmbeddedIamGetUserPolicyUserNotFound E1117 09:42:00.505499 s3api_embedded_iam.go:363 IAM Response the user with name NonExistentUser cannot be found. --- PASS: TestEmbeddedIamGetUserPolicyUserNotFound (0.00s) === RUN TestEmbeddedIamCreatePolicyMalformed E1117 09:42:00.514484 s3api_embedded_iam.go:2947 CreatePolicy: invalid character 'i' looking for beginning of value E1117 09:42:00.514722 s3api_embedded_iam.go:363 IAM Response invalid character 'i' looking for beginning of value --- PASS: TestEmbeddedIamCreatePolicyMalformed (0.01s) === RUN TestEmbeddedIamListAccessKeysForUser --- PASS: TestEmbeddedIamListAccessKeysForUser (0.01s) === RUN TestEmbeddedIamNotImplementedAction E1117 09:42:00.523920 s3api_embedded_iam.go:363 IAM Response The action SomeUnknownAction is not valid for this endpoint --- PASS: TestEmbeddedIamNotImplementedAction (0.00s) === RUN TestGetPolicyDocument --- PASS: TestGetPolicyDocument (0.00s) === RUN TestEmbeddedIamGetActionsFromPolicy --- PASS: TestEmbeddedIamGetActionsFromPolicy (0.00s) === RUN TestEmbeddedIamGetActionsPrefixScopedResource --- PASS: TestEmbeddedIamGetActionsPrefixScopedResource (0.00s) === RUN TestEmbeddedIamGetActionsMultipartListing I1117 09:42:00.532126 config_loader.go:73 Using explicit credential store: memory === RUN TestEmbeddedIamGetActionsMultipartListing/s3:ListBucketMultipartUploads === RUN TestEmbeddedIamGetActionsMultipartListing/s3:ListMultipartUploadParts === RUN TestEmbeddedIamGetActionsMultipartListing/upload_listing_with_prefix === RUN TestEmbeddedIamGetActionsMultipartListing/upload_listing_with_extra_subresource --- PASS: TestEmbeddedIamGetActionsMultipartListing (0.01s) --- PASS: TestEmbeddedIamGetActionsMultipartListing/s3:ListBucketMultipartUploads (0.00s) --- PASS: TestEmbeddedIamGetActionsMultipartListing/s3:ListMultipartUploadParts (0.00s) --- PASS: TestEmbeddedIamGetActionsMultipartListing/upload_listing_with_prefix (0.00s) --- PASS: TestEmbeddedIamGetActionsMultipartListing/upload_listing_with_extra_subresource (0.00s) === RUN TestEmbeddedIamPutUserPolicyAllResourceWildcard --- PASS: TestEmbeddedIamPutUserPolicyAllResourceWildcard (0.00s) === RUN TestEmbeddedIamSetUserStatus === RUN TestEmbeddedIamSetUserStatus/DisableUser === RUN TestEmbeddedIamSetUserStatus/EnableUser --- PASS: TestEmbeddedIamSetUserStatus (0.01s) --- PASS: TestEmbeddedIamSetUserStatus/DisableUser (0.00s) --- PASS: TestEmbeddedIamSetUserStatus/EnableUser (0.00s) === RUN TestEmbeddedIamSetUserStatusErrors === RUN TestEmbeddedIamSetUserStatusErrors/UserNotFound E1117 09:42:00.553872 s3api_embedded_iam.go:363 IAM Response the user with name NonExistentUser cannot be found. === RUN TestEmbeddedIamSetUserStatusErrors/InvalidStatus E1117 09:42:00.556671 s3api_embedded_iam.go:363 IAM Response Status must be 'Active' or 'Inactive' === RUN TestEmbeddedIamSetUserStatusErrors/MissingUserName E1117 09:42:00.559047 s3api_embedded_iam.go:363 IAM Response UserName is required === RUN TestEmbeddedIamSetUserStatusErrors/MissingStatus E1117 09:42:00.561427 s3api_embedded_iam.go:363 IAM Response Status parameter is required --- PASS: TestEmbeddedIamSetUserStatusErrors (0.01s) --- PASS: TestEmbeddedIamSetUserStatusErrors/UserNotFound (0.00s) --- PASS: TestEmbeddedIamSetUserStatusErrors/InvalidStatus (0.00s) --- PASS: TestEmbeddedIamSetUserStatusErrors/MissingUserName (0.00s) --- PASS: TestEmbeddedIamSetUserStatusErrors/MissingStatus (0.00s) === RUN TestEmbeddedIamUpdateAccessKey === RUN TestEmbeddedIamUpdateAccessKey/DeactivateAccessKey === RUN TestEmbeddedIamUpdateAccessKey/ActivateAccessKey --- PASS: TestEmbeddedIamUpdateAccessKey (0.01s) --- PASS: TestEmbeddedIamUpdateAccessKey/DeactivateAccessKey (0.00s) --- PASS: TestEmbeddedIamUpdateAccessKey/ActivateAccessKey (0.00s) === RUN TestEmbeddedIamUpdateAccessKeyErrors === RUN TestEmbeddedIamUpdateAccessKeyErrors/AccessKeyNotFound E1117 09:42:00.573648 s3api_embedded_iam.go:363 IAM Response the access key with id NONEXISTENT123 for user TestUser cannot be found === RUN TestEmbeddedIamUpdateAccessKeyErrors/InvalidStatus E1117 09:42:00.576451 s3api_embedded_iam.go:363 IAM Response Status must be 'Active' or 'Inactive' === RUN TestEmbeddedIamUpdateAccessKeyErrors/MissingUserName E1117 09:42:00.579000 s3api_embedded_iam.go:363 IAM Response UserName is required === RUN TestEmbeddedIamUpdateAccessKeyErrors/MissingAccessKeyId E1117 09:42:00.581635 s3api_embedded_iam.go:363 IAM Response AccessKeyId is required === RUN TestEmbeddedIamUpdateAccessKeyErrors/UserNotFound E1117 09:42:00.584119 s3api_embedded_iam.go:363 IAM Response the user with name NonExistentUser cannot be found. === RUN TestEmbeddedIamUpdateAccessKeyErrors/MissingStatus E1117 09:42:00.586626 s3api_embedded_iam.go:363 IAM Response Status parameter is required --- PASS: TestEmbeddedIamUpdateAccessKeyErrors (0.02s) --- PASS: TestEmbeddedIamUpdateAccessKeyErrors/AccessKeyNotFound (0.00s) --- PASS: TestEmbeddedIamUpdateAccessKeyErrors/InvalidStatus (0.00s) --- PASS: TestEmbeddedIamUpdateAccessKeyErrors/MissingUserName (0.00s) --- PASS: TestEmbeddedIamUpdateAccessKeyErrors/MissingAccessKeyId (0.00s) --- PASS: TestEmbeddedIamUpdateAccessKeyErrors/UserNotFound (0.00s) --- PASS: TestEmbeddedIamUpdateAccessKeyErrors/MissingStatus (0.00s) === RUN TestEmbeddedIamListAccessKeysShowsStatus --- PASS: TestEmbeddedIamListAccessKeysShowsStatus (0.01s) === RUN TestDisabledUserLookupFails --- PASS: TestDisabledUserLookupFails (0.00s) === RUN TestInactiveAccessKeyLookupFails --- PASS: TestInactiveAccessKeyLookupFails (0.00s) === RUN TestAuthIamAuthenticatesBeforeParseForm --- PASS: TestAuthIamAuthenticatesBeforeParseForm (0.00s) === RUN TestOldCodeOrderWouldFail s3api_embedded_iam_test.go:2948: This demonstrates the bug: ParseForm before auth causes SignatureDoesNotMatch --- PASS: TestOldCodeOrderWouldFail (0.00s) === RUN TestEmbeddedIamExecuteAction --- PASS: TestEmbeddedIamExecuteAction (0.00s) === RUN TestEmbeddedIamReadOnly E1117 09:42:00.614589 s3api_embedded_iam.go:363 IAM Response IAM write operations are disabled on this server --- PASS: TestEmbeddedIamReadOnly (0.01s) === RUN TestWriteIamErrorResponseMapping === RUN TestWriteIamErrorResponseMapping/NoSuchEntity E1117 09:42:00.621930 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/EntityAlreadyExists E1117 09:42:00.623851 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/InvalidInput E1117 09:42:00.625562 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/LimitExceeded E1117 09:42:00.627071 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/DeleteConflict E1117 09:42:00.628551 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/InvalidAction E1117 09:42:00.630066 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/AccessDenied E1117 09:42:00.631524 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/InvalidClientTokenId E1117 09:42:00.632970 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/SignatureDoesNotMatch E1117 09:42:00.634581 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/IncompleteSignature E1117 09:42:00.636182 s3api_embedded_iam.go:363 IAM Response boom === RUN TestWriteIamErrorResponseMapping/ServiceFailure E1117 09:42:00.637712 s3api_embedded_iam.go:363 IAM Response boom --- PASS: TestWriteIamErrorResponseMapping (0.02s) --- PASS: TestWriteIamErrorResponseMapping/NoSuchEntity (0.00s) --- PASS: TestWriteIamErrorResponseMapping/EntityAlreadyExists (0.00s) --- PASS: TestWriteIamErrorResponseMapping/InvalidInput (0.00s) --- PASS: TestWriteIamErrorResponseMapping/LimitExceeded (0.00s) --- PASS: TestWriteIamErrorResponseMapping/DeleteConflict (0.00s) --- PASS: TestWriteIamErrorResponseMapping/InvalidAction (0.00s) --- PASS: TestWriteIamErrorResponseMapping/AccessDenied (0.00s) --- PASS: TestWriteIamErrorResponseMapping/InvalidClientTokenId (0.00s) --- PASS: TestWriteIamErrorResponseMapping/SignatureDoesNotMatch (0.00s) --- PASS: TestWriteIamErrorResponseMapping/IncompleteSignature (0.00s) --- PASS: TestWriteIamErrorResponseMapping/ServiceFailure (0.00s) === RUN TestIamAuthErrorCode --- PASS: TestIamAuthErrorCode (0.00s) === RUN TestEmbeddedIamTagUser --- PASS: TestEmbeddedIamTagUser (0.01s) === RUN TestEmbeddedIamListUserTags --- PASS: TestEmbeddedIamListUserTags (0.01s) === RUN TestEmbeddedIamUntagUser --- PASS: TestEmbeddedIamUntagUser (0.01s) === RUN TestEmbeddedIamTagUserInvalidKeyLength E1117 09:42:00.669776 s3api_embedded_iam.go:363 IAM Response tag key "kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk" exceeds 128 characters --- PASS: TestEmbeddedIamTagUserInvalidKeyLength (0.01s) === RUN TestEmbeddedIamTagUserReplacesDuplicate --- PASS: TestEmbeddedIamTagUserReplacesDuplicate (0.01s) === RUN TestEmbeddedIamTagUserLimitExceeded E1117 09:42:00.685834 s3api_embedded_iam.go:363 IAM Response cannot exceed 50 tags per user --- PASS: TestEmbeddedIamTagUserLimitExceeded (0.01s) === RUN TestEmbeddedIamUntagUserNoOpForMissingKey --- PASS: TestEmbeddedIamUntagUserNoOpForMissingKey (0.00s) === RUN TestEmbeddedIamTagUserRejectsDuplicateKeyInRequest E1117 09:42:00.696146 s3api_embedded_iam.go:363 IAM Response duplicate tag key "env" --- PASS: TestEmbeddedIamTagUserRejectsDuplicateKeyInRequest (0.01s) === RUN TestEmbeddedIamUntagUserRejectsInvalidKeys === RUN TestEmbeddedIamUntagUserRejectsInvalidKeys/no_TagKeys_entries E1117 09:42:00.700522 s3api_embedded_iam.go:363 IAM Response at least one TagKeys entry is required === RUN TestEmbeddedIamUntagUserRejectsInvalidKeys/empty_TagKeys_entry E1117 09:42:00.703090 s3api_embedded_iam.go:363 IAM Response tag key cannot be empty === RUN TestEmbeddedIamUntagUserRejectsInvalidKeys/TagKeys_entry_over_MaxUserTagKeyLength E1117 09:42:00.705897 s3api_embedded_iam.go:363 IAM Response tag key "kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk" exceeds 128 characters --- PASS: TestEmbeddedIamUntagUserRejectsInvalidKeys (0.01s) --- PASS: TestEmbeddedIamUntagUserRejectsInvalidKeys/no_TagKeys_entries (0.00s) --- PASS: TestEmbeddedIamUntagUserRejectsInvalidKeys/empty_TagKeys_entry (0.00s) --- PASS: TestEmbeddedIamUntagUserRejectsInvalidKeys/TagKeys_entry_over_MaxUserTagKeyLength (0.00s) === RUN TestEmbeddedIamTagUserNotFound E1117 09:42:00.709939 s3api_embedded_iam.go:363 IAM Response the user with name ghost cannot be found. --- PASS: TestEmbeddedIamTagUserNotFound (0.00s) === RUN TestCreateDestinationChunkPreservesEncryption === RUN TestCreateDestinationChunkPreservesEncryption/Encrypted_and_compressed_chunk === RUN TestCreateDestinationChunkPreservesEncryption/Only_encrypted_chunk === RUN TestCreateDestinationChunkPreservesEncryption/Only_compressed_chunk === RUN TestCreateDestinationChunkPreservesEncryption/Unencrypted_and_uncompressed_chunk --- PASS: TestCreateDestinationChunkPreservesEncryption (0.00s) --- PASS: TestCreateDestinationChunkPreservesEncryption/Encrypted_and_compressed_chunk (0.00s) --- PASS: TestCreateDestinationChunkPreservesEncryption/Only_encrypted_chunk (0.00s) --- PASS: TestCreateDestinationChunkPreservesEncryption/Only_compressed_chunk (0.00s) --- PASS: TestCreateDestinationChunkPreservesEncryption/Unencrypted_and_uncompressed_chunk (0.00s) === RUN TestEncryptedVolumeCopyScenario === RUN TestEncryptedVolumeCopyScenario/Scenario:_Copy_file_on_encrypted_volume_with_multiple_chunks s3api_encrypted_volume_copy_test.go:175: ✓ All chunk metadata properly preserved for encrypted volume copy scenario --- PASS: TestEncryptedVolumeCopyScenario (0.00s) --- PASS: TestEncryptedVolumeCopyScenario/Scenario:_Copy_file_on_encrypted_volume_with_multiple_chunks (0.00s) === RUN TestSourceEntryIsEncryptedForVolumeCipher === RUN TestSourceEntryIsEncryptedForVolumeCipher/nil_entry === RUN TestSourceEntryIsEncryptedForVolumeCipher/plaintext_chunks === RUN TestSourceEntryIsEncryptedForVolumeCipher/volume-encrypted_chunk === RUN TestSourceEntryIsEncryptedForVolumeCipher/volume-encrypted_second_chunk === RUN TestSourceEntryIsEncryptedForVolumeCipher/SSE-S3_chunk --- PASS: TestSourceEntryIsEncryptedForVolumeCipher (0.00s) --- PASS: TestSourceEntryIsEncryptedForVolumeCipher/nil_entry (0.00s) --- PASS: TestSourceEntryIsEncryptedForVolumeCipher/plaintext_chunks (0.00s) --- PASS: TestSourceEntryIsEncryptedForVolumeCipher/volume-encrypted_chunk (0.00s) --- PASS: TestSourceEntryIsEncryptedForVolumeCipher/volume-encrypted_second_chunk (0.00s) --- PASS: TestSourceEntryIsEncryptedForVolumeCipher/SSE-S3_chunk (0.00s) === RUN TestGetEncryptedStreamFromVolumesRangesInlineContent === RUN TestGetEncryptedStreamFromVolumesRangesInlineContent/whole_content === RUN TestGetEncryptedStreamFromVolumesRangesInlineContent/leading_slice === RUN TestGetEncryptedStreamFromVolumesRangesInlineContent/middle_slice === RUN TestGetEncryptedStreamFromVolumesRangesInlineContent/trailing_slice === RUN TestGetEncryptedStreamFromVolumesRangesInlineContent/size_past_the_end === RUN TestGetEncryptedStreamFromVolumesRangesInlineContent/offset_past_the_end === RUN TestGetEncryptedStreamFromVolumesRangesInlineContent/empty_range --- PASS: TestGetEncryptedStreamFromVolumesRangesInlineContent (0.00s) --- PASS: TestGetEncryptedStreamFromVolumesRangesInlineContent/whole_content (0.00s) --- PASS: TestGetEncryptedStreamFromVolumesRangesInlineContent/leading_slice (0.00s) --- PASS: TestGetEncryptedStreamFromVolumesRangesInlineContent/middle_slice (0.00s) --- PASS: TestGetEncryptedStreamFromVolumesRangesInlineContent/trailing_slice (0.00s) --- PASS: TestGetEncryptedStreamFromVolumesRangesInlineContent/size_past_the_end (0.00s) --- PASS: TestGetEncryptedStreamFromVolumesRangesInlineContent/offset_past_the_end (0.00s) --- PASS: TestGetEncryptedStreamFromVolumesRangesInlineContent/empty_range (0.00s) === RUN TestDetermineUnifiedCopyStrategySSES3 === RUN TestDetermineUnifiedCopyStrategySSES3/SSE-S3_to_SSE-S3_direct_copy === RUN TestDetermineUnifiedCopyStrategySSES3/SSE-S3_to_plain_decrypt_copy === RUN TestDetermineUnifiedCopyStrategySSES3/Plain_to_SSE-S3_encrypt_copy --- PASS: TestDetermineUnifiedCopyStrategySSES3 (0.00s) --- PASS: TestDetermineUnifiedCopyStrategySSES3/SSE-S3_to_SSE-S3_direct_copy (0.00s) --- PASS: TestDetermineUnifiedCopyStrategySSES3/SSE-S3_to_plain_decrypt_copy (0.00s) --- PASS: TestDetermineUnifiedCopyStrategySSES3/Plain_to_SSE-S3_encrypt_copy (0.00s) === RUN TestDecryptChunkVolumeCipher === RUN TestDecryptChunkVolumeCipher/unencrypted_chunk_passes_through === RUN TestDecryptChunkVolumeCipher/volume_cipher_encrypted_chunk_decrypts_correctly === RUN TestDecryptChunkVolumeCipher/volume_cipher_encrypted_and_compressed_chunk_decrypts_correctly --- PASS: TestDecryptChunkVolumeCipher (0.01s) --- PASS: TestDecryptChunkVolumeCipher/unencrypted_chunk_passes_through (0.00s) --- PASS: TestDecryptChunkVolumeCipher/volume_cipher_encrypted_chunk_decrypts_correctly (0.00s) --- PASS: TestDecryptChunkVolumeCipher/volume_cipher_encrypted_and_compressed_chunk_decrypts_correctly (0.01s) === RUN TestCheckGovernanceBypassPermissionResourceGeneration === RUN TestCheckGovernanceBypassPermissionResourceGeneration/simple_object === RUN TestCheckGovernanceBypassPermissionResourceGeneration/object_with_leading_slash === RUN TestCheckGovernanceBypassPermissionResourceGeneration/nested_object === RUN TestCheckGovernanceBypassPermissionResourceGeneration/empty_object === RUN TestCheckGovernanceBypassPermissionResourceGeneration/root_object --- PASS: TestCheckGovernanceBypassPermissionResourceGeneration (0.00s) --- PASS: TestCheckGovernanceBypassPermissionResourceGeneration/simple_object (0.00s) --- PASS: TestCheckGovernanceBypassPermissionResourceGeneration/object_with_leading_slash (0.00s) --- PASS: TestCheckGovernanceBypassPermissionResourceGeneration/nested_object (0.00s) --- PASS: TestCheckGovernanceBypassPermissionResourceGeneration/empty_object (0.00s) --- PASS: TestCheckGovernanceBypassPermissionResourceGeneration/root_object (0.00s) === RUN TestCheckGovernanceBypassPermissionActionGeneration === RUN TestCheckGovernanceBypassPermissionActionGeneration/bypass_action_generation === RUN TestCheckGovernanceBypassPermissionActionGeneration/leading_slash_handling --- PASS: TestCheckGovernanceBypassPermissionActionGeneration (0.00s) --- PASS: TestCheckGovernanceBypassPermissionActionGeneration/bypass_action_generation (0.00s) --- PASS: TestCheckGovernanceBypassPermissionActionGeneration/leading_slash_handling (0.00s) === RUN TestCheckGovernanceBypassPermissionErrorHandling === RUN TestCheckGovernanceBypassPermissionErrorHandling/empty_bucket s3api_governance_permissions_test.go:169: Generated resource path for Empty bucket should be handled gracefully: /test-object.txt === RUN TestCheckGovernanceBypassPermissionErrorHandling/special_characters s3api_governance_permissions_test.go:169: Generated resource path for Objects with special characters should be handled: test-bucket/test object with spaces.txt === RUN TestCheckGovernanceBypassPermissionErrorHandling/unicode_characters s3api_governance_permissions_test.go:169: Generated resource path for Objects with unicode characters should be handled: test-bucket/测试文件.txt --- PASS: TestCheckGovernanceBypassPermissionErrorHandling (0.00s) --- PASS: TestCheckGovernanceBypassPermissionErrorHandling/empty_bucket (0.00s) --- PASS: TestCheckGovernanceBypassPermissionErrorHandling/special_characters (0.00s) --- PASS: TestCheckGovernanceBypassPermissionErrorHandling/unicode_characters (0.00s) === RUN TestCheckGovernanceBypassPermissionIntegrationBehavior s3api_governance_permissions_test.go:177: Documentation test - describes expected behavior with full IAM integration --- SKIP: TestCheckGovernanceBypassPermissionIntegrationBehavior (0.00s) === RUN TestGovernanceBypassWithIAMPermission s3api_governance_permissions_test.go:202: Integration test requires full IAM setup - demonstrates expected behavior --- SKIP: TestGovernanceBypassWithIAMPermission (0.00s) === RUN TestGovernancePermissionIntegration s3api_governance_permissions_test.go:220: Integration test requires full IAM setup - demonstrates expected behavior --- SKIP: TestGovernancePermissionIntegration (0.00s) === RUN TestGovernanceBypassHeader === RUN TestGovernanceBypassHeader/bypass_header_true === RUN TestGovernanceBypassHeader/bypass_header_title_case === RUN TestGovernanceBypassHeader/bypass_header_upper_case === RUN TestGovernanceBypassHeader/bypass_header_false === RUN TestGovernanceBypassHeader/bypass_header_empty === RUN TestGovernanceBypassHeader/bypass_header_invalid --- PASS: TestGovernanceBypassHeader (0.00s) --- PASS: TestGovernanceBypassHeader/bypass_header_true (0.00s) --- PASS: TestGovernanceBypassHeader/bypass_header_title_case (0.00s) --- PASS: TestGovernanceBypassHeader/bypass_header_upper_case (0.00s) --- PASS: TestGovernanceBypassHeader/bypass_header_false (0.00s) --- PASS: TestGovernanceBypassHeader/bypass_header_empty (0.00s) --- PASS: TestGovernanceBypassHeader/bypass_header_invalid (0.00s) === RUN TestGovernanceRetentionModeChecking === RUN TestGovernanceRetentionModeChecking/compliance_mode_cannot_bypass === RUN TestGovernanceRetentionModeChecking/governance_mode_without_bypass === RUN TestGovernanceRetentionModeChecking/governance_mode_with_bypass_no_permission === RUN TestGovernanceRetentionModeChecking/governance_mode_with_bypass_and_permission --- PASS: TestGovernanceRetentionModeChecking (0.00s) --- PASS: TestGovernanceRetentionModeChecking/compliance_mode_cannot_bypass (0.00s) --- PASS: TestGovernanceRetentionModeChecking/governance_mode_without_bypass (0.00s) --- PASS: TestGovernanceRetentionModeChecking/governance_mode_with_bypass_no_permission (0.00s) --- PASS: TestGovernanceRetentionModeChecking/governance_mode_with_bypass_and_permission (0.00s) === RUN TestGovernancePermissionActionGeneration === RUN TestGovernancePermissionActionGeneration/bucket_and_object_action === RUN TestGovernancePermissionActionGeneration/bucket_only_action === RUN TestGovernancePermissionActionGeneration/nested_object_action --- PASS: TestGovernancePermissionActionGeneration (0.00s) --- PASS: TestGovernancePermissionActionGeneration/bucket_and_object_action (0.00s) --- PASS: TestGovernancePermissionActionGeneration/bucket_only_action (0.00s) --- PASS: TestGovernancePermissionActionGeneration/nested_object_action (0.00s) === RUN TestGovernancePermissionEndToEnd s3api_governance_permissions_test.go:414: End-to-end testing requires full S3 API server setup - demonstrates expected behavior --- SKIP: TestGovernancePermissionEndToEnd (0.00s) === RUN TestGovernancePermissionHTTPFlow === RUN TestGovernancePermissionHTTPFlow/bypass_header_true === RUN TestGovernancePermissionHTTPFlow/bypass_header_false === RUN TestGovernancePermissionHTTPFlow/bypass_header_missing --- PASS: TestGovernancePermissionHTTPFlow (0.00s) --- PASS: TestGovernancePermissionHTTPFlow/bypass_header_true (0.00s) --- PASS: TestGovernancePermissionHTTPFlow/bypass_header_false (0.00s) --- PASS: TestGovernancePermissionHTTPFlow/bypass_header_missing (0.00s) === RUN TestGovernancePermissionMethodCalls === RUN TestGovernancePermissionMethodCalls/delete_object_handler_pattern s3api_governance_permissions_test.go:490: Extracted bucket: , object: === RUN TestGovernancePermissionMethodCalls/put_object_handler_pattern s3api_governance_permissions_test.go:511: Extracted bucket: , object: --- PASS: TestGovernancePermissionMethodCalls (0.00s) --- PASS: TestGovernancePermissionMethodCalls/delete_object_handler_pattern (0.00s) --- PASS: TestGovernancePermissionMethodCalls/put_object_handler_pattern (0.00s) === RUN TestGovernanceBypassNotPermittedError === RUN TestGovernanceBypassNotPermittedError/governance_bypass_without_permission === RUN TestGovernanceBypassNotPermittedError/governance_bypass_with_permission === RUN TestGovernanceBypassNotPermittedError/governance_no_bypass --- PASS: TestGovernanceBypassNotPermittedError (0.00s) --- PASS: TestGovernanceBypassNotPermittedError/governance_bypass_without_permission (0.00s) --- PASS: TestGovernanceBypassNotPermittedError/governance_bypass_with_permission (0.00s) --- PASS: TestGovernanceBypassNotPermittedError/governance_no_bypass (0.00s) === RUN TestFailoverStopsAfterPartialResponse --- PASS: TestFailoverStopsAfterPartialResponse (0.01s) === RUN TestFailoverBeforeFirstResponse --- PASS: TestFailoverBeforeFirstResponse (0.02s) === RUN TestListAfterMidStreamFailureHasNoDuplicates --- PASS: TestListAfterMidStreamFailureHasNoDuplicates (0.12s) === RUN TestFailoverDoesNotBlameFilersForTheCallersExpiredBudget --- PASS: TestFailoverDoesNotBlameFilersForTheCallersExpiredBudget (0.52s) === RUN TestHeadBucketSeparatesLookupFailureFromMissingBucket === RUN TestHeadBucketSeparatesLookupFailureFromMissingBucket/transient_lookup_failure E1117 09:42:01.463039 s3api_bucket_handlers.go:620 HeadBucketHandler: failed to get bucket entry for head-bucket: all filers failed, last error: LookupEntry1: rpc error: code = Internal desc = filer store unavailable === RUN TestHeadBucketSeparatesLookupFailureFromMissingBucket/missing_bucket === RUN TestHeadBucketSeparatesLookupFailureFromMissingBucket/existing_bucket --- PASS: TestHeadBucketSeparatesLookupFailureFromMissingBucket (0.04s) --- PASS: TestHeadBucketSeparatesLookupFailureFromMissingBucket/transient_lookup_failure (0.01s) --- PASS: TestHeadBucketSeparatesLookupFailureFromMissingBucket/missing_bucket (0.01s) --- PASS: TestHeadBucketSeparatesLookupFailureFromMissingBucket/existing_bucket (0.01s) === RUN TestListOpenIDConnectProviders --- PASS: TestListOpenIDConnectProviders (0.01s) === RUN TestGetOpenIDConnectProvider --- PASS: TestGetOpenIDConnectProvider (0.00s) === RUN TestGetOpenIDConnectProviderMissing --- PASS: TestGetOpenIDConnectProviderMissing (0.00s) === RUN TestGetOpenIDConnectProviderRequiresArn --- PASS: TestGetOpenIDConnectProviderRequiresArn (0.00s) === RUN TestReadOnlyAllowsOIDCList --- PASS: TestReadOnlyAllowsOIDCList (0.00s) === RUN TestReadOnlyDeniesOIDCMutations === RUN TestReadOnlyDeniesOIDCMutations/CreateOpenIDConnectProvider === RUN TestReadOnlyDeniesOIDCMutations/DeleteOpenIDConnectProvider === RUN TestReadOnlyDeniesOIDCMutations/AddClientIDToOpenIDConnectProvider === RUN TestReadOnlyDeniesOIDCMutations/RemoveClientIDFromOpenIDConnectProvider === RUN TestReadOnlyDeniesOIDCMutations/UpdateOpenIDConnectProviderThumbprint === RUN TestReadOnlyDeniesOIDCMutations/TagOpenIDConnectProvider === RUN TestReadOnlyDeniesOIDCMutations/UntagOpenIDConnectProvider --- PASS: TestReadOnlyDeniesOIDCMutations (0.01s) --- PASS: TestReadOnlyDeniesOIDCMutations/CreateOpenIDConnectProvider (0.00s) --- PASS: TestReadOnlyDeniesOIDCMutations/DeleteOpenIDConnectProvider (0.00s) --- PASS: TestReadOnlyDeniesOIDCMutations/AddClientIDToOpenIDConnectProvider (0.00s) --- PASS: TestReadOnlyDeniesOIDCMutations/RemoveClientIDFromOpenIDConnectProvider (0.00s) --- PASS: TestReadOnlyDeniesOIDCMutations/UpdateOpenIDConnectProviderThumbprint (0.00s) --- PASS: TestReadOnlyDeniesOIDCMutations/TagOpenIDConnectProvider (0.00s) --- PASS: TestReadOnlyDeniesOIDCMutations/UntagOpenIDConnectProvider (0.00s) === RUN TestCreateOpenIDConnectProvider I1117 09:42:01.523297 oidc_provider_audit.go:66 oidc-audit: {"type":"Create","arn":"arn:aws:iam::111122223333:oidc-provider/auth.example.com","url":"https://auth.example.com","occurredAt":"2026-11-17T09:42:01.521930662Z"} --- PASS: TestCreateOpenIDConnectProvider (0.01s) === RUN TestCreateOpenIDConnectProviderRejectsBadInput === RUN TestCreateOpenIDConnectProviderRejectsBadInput/missing_Url === RUN TestCreateOpenIDConnectProviderRejectsBadInput/missing_ClientIDList === RUN TestCreateOpenIDConnectProviderRejectsBadInput/invalid_thumbprint --- PASS: TestCreateOpenIDConnectProviderRejectsBadInput (0.00s) --- PASS: TestCreateOpenIDConnectProviderRejectsBadInput/missing_Url (0.00s) --- PASS: TestCreateOpenIDConnectProviderRejectsBadInput/missing_ClientIDList (0.00s) --- PASS: TestCreateOpenIDConnectProviderRejectsBadInput/invalid_thumbprint (0.00s) === RUN TestCreateOpenIDConnectProviderConflict --- PASS: TestCreateOpenIDConnectProviderConflict (0.00s) === RUN TestDeleteOpenIDConnectProvider I1117 09:42:01.536291 oidc_provider_audit.go:66 oidc-audit: {"type":"Delete","arn":"arn:aws:iam::111122223333:oidc-provider/accounts.google.com","occurredAt":"2026-11-17T09:42:01.535829891Z"} I1117 09:42:01.539025 oidc_provider_audit.go:66 oidc-audit: {"type":"Delete","arn":"arn:aws:iam::111122223333:oidc-provider/accounts.google.com","occurredAt":"2026-11-17T09:42:01.538835662Z"} --- PASS: TestDeleteOpenIDConnectProvider (0.01s) === RUN TestAddRemoveClientID I1117 09:42:01.541827 oidc_provider_audit.go:66 oidc-audit: {"type":"AddClientID","arn":"arn:aws:iam::111122223333:oidc-provider/accounts.google.com","url":"https://accounts.google.com","detail":{"clientId":"extra-client"},"occurredAt":"2026-11-17T09:42:01.541597071Z"} I1117 09:42:01.545596 oidc_provider_audit.go:66 oidc-audit: {"type":"RemoveClientID","arn":"arn:aws:iam::111122223333:oidc-provider/accounts.google.com","url":"https://accounts.google.com","detail":{"clientId":"extra-client"},"occurredAt":"2026-11-17T09:42:01.545193807Z"} --- PASS: TestAddRemoveClientID (0.01s) === RUN TestUpdateThumbprintAndTags I1117 09:42:01.549193 oidc_provider_audit.go:66 oidc-audit: {"type":"UpdateThumbprints","arn":"arn:aws:iam::111122223333:oidc-provider/accounts.google.com","url":"https://accounts.google.com","detail":{"count":"2"},"occurredAt":"2026-11-17T09:42:01.54895347Z"} I1117 09:42:01.550693 oidc_provider_audit.go:66 oidc-audit: {"type":"Tag","arn":"arn:aws:iam::111122223333:oidc-provider/accounts.google.com","url":"https://accounts.google.com","detail":{"count":"1"},"occurredAt":"2026-11-17T09:42:01.55049713Z"} I1117 09:42:01.552509 oidc_provider_audit.go:66 oidc-audit: {"type":"Untag","arn":"arn:aws:iam::111122223333:oidc-provider/accounts.google.com","url":"https://accounts.google.com","detail":{"count":"1"},"occurredAt":"2026-11-17T09:42:01.552339992Z"} --- PASS: TestUpdateThumbprintAndTags (0.01s) === RUN TestUnmodifiableEntityIsAClientError E1117 09:42:01.554538 s3api_embedded_iam.go:363 IAM Response OIDC provider is defined in the IAM config file: arn:aws:iam:::oidc-provider/static.example --- PASS: TestUnmodifiableEntityIsAClientError (0.00s) === RUN TestRoleLifecycle --- PASS: TestRoleLifecycle (0.02s) === RUN TestUpdateAssumeRolePolicyReplacesTheTrustPolicy --- PASS: TestUpdateAssumeRolePolicyReplacesTheTrustPolicy (0.01s) === RUN TestRoleActionsRefuseWhatTheyCannotHonour === RUN TestRoleActionsRefuseWhatTheyCannotHonour/duplicate === RUN TestRoleActionsRefuseWhatTheyCannotHonour/no_trust_policy === RUN TestRoleActionsRefuseWhatTheyCannotHonour/malformed_trust_policy === RUN TestRoleActionsRefuseWhatTheyCannotHonour/path === RUN TestRoleActionsRefuseWhatTheyCannotHonour/tags === RUN TestRoleActionsRefuseWhatTheyCannotHonour/session_out_of_bounds === RUN TestRoleActionsRefuseWhatTheyCannotHonour/attach_missing_policy === RUN TestRoleActionsRefuseWhatTheyCannotHonour/detach_unattached === RUN TestRoleActionsRefuseWhatTheyCannotHonour/missing_role === RUN TestRoleActionsRefuseWhatTheyCannotHonour/name_leaving_the_role_store === RUN TestRoleActionsRefuseWhatTheyCannotHonour/name_too_long --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour (0.02s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/duplicate (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/no_trust_policy (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/malformed_trust_policy (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/path (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/tags (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/session_out_of_bounds (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/attach_missing_policy (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/detach_unattached (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/missing_role (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/name_leaving_the_role_store (0.00s) --- PASS: TestRoleActionsRefuseWhatTheyCannotHonour/name_too_long (0.00s) === RUN TestConfigFileRolesAreUnmodifiable === RUN TestConfigFileRolesAreUnmodifiable/DeleteRole === RUN TestConfigFileRolesAreUnmodifiable/UpdateAssumeRolePolicy === RUN TestConfigFileRolesAreUnmodifiable/AttachRolePolicy === RUN TestConfigFileRolesAreUnmodifiable/DetachRolePolicy --- PASS: TestConfigFileRolesAreUnmodifiable (0.01s) --- PASS: TestConfigFileRolesAreUnmodifiable/DeleteRole (0.00s) --- PASS: TestConfigFileRolesAreUnmodifiable/UpdateAssumeRolePolicy (0.00s) --- PASS: TestConfigFileRolesAreUnmodifiable/AttachRolePolicy (0.00s) --- PASS: TestConfigFileRolesAreUnmodifiable/DetachRolePolicy (0.00s) === RUN TestReadOnlyAllowsRoleReadsAndDeniesMutations --- PASS: TestReadOnlyAllowsRoleReadsAndDeniesMutations (0.01s) === RUN TestRoleActionsTreatAnUnreadableStoreAsAFailureNotAnAbsence --- PASS: TestRoleActionsTreatAnUnreadableStoreAsAFailureNotAnAbsence (0.00s) === RUN TestDeletePolicyAttachedToARoleIsAConflict E1117 09:42:01.634178 s3api_embedded_iam.go:2955 DeletePolicy: policy read-bucket is attached to role app --- PASS: TestDeletePolicyAttachedToARoleIsAConflict (0.01s) === RUN TestAttachRolePolicyStopsAtTheRoleQuota --- PASS: TestAttachRolePolicyStopsAtTheRoleQuota (0.03s) === RUN TestRoleWithoutACreationTimeOmitsCreateDate --- PASS: TestRoleWithoutACreationTimeOmitsCreateDate (0.00s) === RUN TestCreateRoleRefusesEveryTagParameter --- PASS: TestCreateRoleRefusesEveryTagParameter (0.00s) === RUN TestCreateRoleReportsAFailedWriteAsAServiceFailure --- PASS: TestCreateRoleReportsAFailedWriteAsAServiceFailure (0.00s) === RUN TestCreateRoleRacingAnotherCreateIsEntityAlreadyExists --- PASS: TestCreateRoleRacingAnotherCreateIsEntityAlreadyExists (0.00s) === RUN TestListRolesSkipsARoleDeletedWhileListing --- PASS: TestListRolesSkipsARoleDeletedWhileListing (0.00s) === RUN TestRoleChangesAreWatchedInTheRoleStoresDirectory --- PASS: TestRoleChangesAreWatchedInTheRoleStoresDirectory (0.00s) === RUN TestTablePrefixSessionPolicyScopesToTheTable --- PASS: TestTablePrefixSessionPolicyScopesToTheTable (0.00s) === RUN TestTablePrefixSessionPolicyReadOnly --- PASS: TestTablePrefixSessionPolicyReadOnly (0.00s) === RUN TestTablePrefixSessionPolicyRefusesAWholeBucket --- PASS: TestTablePrefixSessionPolicyRefusesAWholeBucket (0.00s) === RUN TestTablePrefixSessionPolicyLeavesBucketLocationUnconditioned --- PASS: TestTablePrefixSessionPolicyLeavesBucketLocationUnconditioned (0.00s) === RUN TestIcebergSessionNameIsBounded --- PASS: TestIcebergSessionNameIsBounded (0.00s) === RUN TestVendTableCredentialsDisabledWithoutRole --- PASS: TestVendTableCredentialsDisabledWithoutRole (0.00s) === RUN TestVendTableCredentialsNeedsSTS --- PASS: TestVendTableCredentialsNeedsSTS (0.00s) === RUN TestTablePrefixSessionPolicyRestrictsListing --- PASS: TestTablePrefixSessionPolicyRestrictsListing (0.00s) === RUN TestTablePrefixSessionPolicyRefusesWildcards --- PASS: TestTablePrefixSessionPolicyRefusesWildcards (0.00s) === RUN TestIcebergSessionNameWithoutKeyIsUnchanged --- PASS: TestIcebergSessionNameWithoutKeyIsUnchanged (0.00s) === RUN TestIcebergSessionNameEndsWithTheKeyTag --- PASS: TestIcebergSessionNameEndsWithTheKeyTag (0.00s) === RUN TestIcebergSessionNameKeepsTheWholeTagWithinTheLimit --- PASS: TestIcebergSessionNameKeepsTheWholeTagWithinTheLimit (0.00s) === RUN TestVendTableCredentialsReadsTheKeyFromTheContext --- PASS: TestVendTableCredentialsReadsTheKeyFromTheContext (0.00s) === RUN TestVendTableCredentialsRecordsTheCallersKey --- PASS: TestVendTableCredentialsRecordsTheCallersKey (0.03s) === RUN TestVendedSessionEndsWithItsAccessKey --- PASS: TestVendedSessionEndsWithItsAccessKey (0.04s) === RUN TestVendedSessionEndsWithItsIdentity --- PASS: TestVendedSessionEndsWithItsIdentity (0.02s) === RUN TestVendedSessionIsBoundOnlyForAStoredIdentitysKey --- PASS: TestVendedSessionIsBoundOnlyForAStoredIdentitysKey (0.04s) === RUN TestLegacyVendedSessionStaysUnbound --- PASS: TestLegacyVendedSessionStaysUnbound (0.00s) === RUN TestRecreatedKeyDoesNotReviveVendedSession --- PASS: TestRecreatedKeyDoesNotReviveVendedSession (0.01s) === RUN TestVendedSessionStaysBoundWhenTheKeyIsGoneAtVend --- PASS: TestVendedSessionStaysBoundWhenTheKeyIsGoneAtVend (0.01s) === RUN TestOtherSessionsAreNotBoundToAKey --- PASS: TestOtherSessionsAreNotBoundToAKey (0.00s) === RUN TestImplicitDirectoryBehaviorLogic === RUN TestImplicitDirectoryBehaviorLogic/Implicit_directory:_0-byte_file_with_children,_no_trailing_slash s3api_implicit_directory_test.go:143: ✓ Implicit directory: 0-byte file with children, no trailing slash: correctly returns 404 === RUN TestImplicitDirectoryBehaviorLogic/Implicit_directory:_actual_directory_with_children,_no_trailing_slash s3api_implicit_directory_test.go:143: ✓ Implicit directory: actual directory with children, no trailing slash: correctly returns 404 === RUN TestImplicitDirectoryBehaviorLogic/Explicit_directory_request:_trailing_slash s3api_implicit_directory_test.go:143: ✓ Explicit directory request: trailing slash: correctly returns 200 === RUN TestImplicitDirectoryBehaviorLogic/Empty_file:_0-byte_file_without_children s3api_implicit_directory_test.go:143: ✓ Empty file: 0-byte file without children: correctly returns 200 === RUN TestImplicitDirectoryBehaviorLogic/Empty_directory:_0-byte_directory_without_children s3api_implicit_directory_test.go:143: ✓ Empty directory: 0-byte directory without children: correctly returns 404 === RUN TestImplicitDirectoryBehaviorLogic/Regular_file:_non-zero_size s3api_implicit_directory_test.go:143: ✓ Regular file: non-zero size: correctly returns 200 === RUN TestImplicitDirectoryBehaviorLogic/Versioned_bucket:_implicit_directory_should_return_200 s3api_implicit_directory_test.go:143: ✓ Versioned bucket: implicit directory should return 200: correctly returns 200 === RUN TestImplicitDirectoryBehaviorLogic/PyArrow_directory_marker:_0-byte_with_children s3api_implicit_directory_test.go:143: ✓ PyArrow directory marker: 0-byte with children: correctly returns 404 --- PASS: TestImplicitDirectoryBehaviorLogic (0.01s) --- PASS: TestImplicitDirectoryBehaviorLogic/Implicit_directory:_0-byte_file_with_children,_no_trailing_slash (0.00s) --- PASS: TestImplicitDirectoryBehaviorLogic/Implicit_directory:_actual_directory_with_children,_no_trailing_slash (0.00s) --- PASS: TestImplicitDirectoryBehaviorLogic/Explicit_directory_request:_trailing_slash (0.00s) --- PASS: TestImplicitDirectoryBehaviorLogic/Empty_file:_0-byte_file_without_children (0.00s) --- PASS: TestImplicitDirectoryBehaviorLogic/Empty_directory:_0-byte_directory_without_children (0.00s) --- PASS: TestImplicitDirectoryBehaviorLogic/Regular_file:_non-zero_size (0.00s) --- PASS: TestImplicitDirectoryBehaviorLogic/Versioned_bucket:_implicit_directory_should_return_200 (0.00s) --- PASS: TestImplicitDirectoryBehaviorLogic/PyArrow_directory_marker:_0-byte_with_children (0.00s) === RUN TestHasChildrenLogic === RUN TestHasChildrenLogic/Directory_with_children s3api_implicit_directory_test.go:218: ✓ Directory with children: correctly returns true === RUN TestHasChildrenLogic/Empty_directory s3api_implicit_directory_test.go:218: ✓ Empty directory: correctly returns false === RUN TestHasChildrenLogic/Directory_with_leading_slash_in_prefix s3api_implicit_directory_test.go:218: ✓ Directory with leading slash in prefix: correctly returns true --- PASS: TestHasChildrenLogic (0.00s) --- PASS: TestHasChildrenLogic/Directory_with_children (0.00s) --- PASS: TestHasChildrenLogic/Empty_directory (0.00s) --- PASS: TestHasChildrenLogic/Directory_with_leading_slash_in_prefix (0.00s) === RUN TestImplicitDirectoryEdgeCases === RUN TestImplicitDirectoryEdgeCases/PyArrow_write_dataset_creates_0-byte_files s3api_implicit_directory_test.go:265: Scenario: PyArrow creates 'dataset' as 0-byte file, then writes 'dataset/file.parquet' s3api_implicit_directory_test.go:266: Expected: HEAD dataset → 404 (has children), s3fs uses LIST → correctly identifies as directory === RUN TestImplicitDirectoryEdgeCases/Filer_creates_actual_directories s3api_implicit_directory_test.go:265: Scenario: Filer creates 'dataset' as actual directory with IsDirectory=true s3api_implicit_directory_test.go:266: Expected: HEAD dataset → 404 (has children), s3fs uses LIST → correctly identifies as directory === RUN TestImplicitDirectoryEdgeCases/Empty_file_edge_case s3api_implicit_directory_test.go:265: Scenario: User creates 'empty.txt' as 0-byte file with no children s3api_implicit_directory_test.go:266: Expected: HEAD empty.txt → 200 (no children), s3fs correctly reports as file === RUN TestImplicitDirectoryEdgeCases/Explicit_directory_request s3api_implicit_directory_test.go:265: Scenario: User requests 'dataset/' with trailing slash s3api_implicit_directory_test.go:266: Expected: HEAD dataset/ → 200 (explicit directory request), normal directory behavior === RUN TestImplicitDirectoryEdgeCases/Versioned_bucket s3api_implicit_directory_test.go:265: Scenario: Bucket has versioning enabled s3api_implicit_directory_test.go:266: Expected: HEAD dataset → 200 (skip implicit dir check), versioned semantics apply === RUN TestImplicitDirectoryEdgeCases/AWS_S3_compatibility s3api_implicit_directory_test.go:265: Scenario: Only 'dataset/file.txt' exists, no marker at 'dataset' s3api_implicit_directory_test.go:266: Expected: HEAD dataset → 404 (object doesn't exist), matches AWS S3 behavior --- PASS: TestImplicitDirectoryEdgeCases (0.01s) --- PASS: TestImplicitDirectoryEdgeCases/PyArrow_write_dataset_creates_0-byte_files (0.00s) --- PASS: TestImplicitDirectoryEdgeCases/Filer_creates_actual_directories (0.00s) --- PASS: TestImplicitDirectoryEdgeCases/Empty_file_edge_case (0.00s) --- PASS: TestImplicitDirectoryEdgeCases/Explicit_directory_request (0.00s) --- PASS: TestImplicitDirectoryEdgeCases/Versioned_bucket (0.00s) --- PASS: TestImplicitDirectoryEdgeCases/AWS_S3_compatibility (0.00s) === RUN TestImplicitDirectoryIntegration s3api_implicit_directory_test.go:278: Integration test - run manually with: cd test/s3/parquet && make test-implicit-dir-with-server --- SKIP: TestImplicitDirectoryIntegration (0.00s) === RUN TestUserInlinePolicySourceIpCondition_Denies --- PASS: TestUserInlinePolicySourceIpCondition_Denies (0.01s) === RUN TestUserInlinePolicySourceIpCondition_Allows --- PASS: TestUserInlinePolicySourceIpCondition_Allows (0.01s) === RUN TestUserInlinePolicySourceIpCondition_IgnoresForwardedHeaders --- PASS: TestUserInlinePolicySourceIpCondition_IgnoresForwardedHeaders (0.02s) === RUN TestGroupInlinePolicy_PutAndEnforce --- PASS: TestGroupInlinePolicy_PutAndEnforce (0.04s) === RUN TestUserInlinePolicy_ConditionDiscriminatesAllowVsDeny --- PASS: TestUserInlinePolicy_ConditionDiscriminatesAllowVsDeny (0.01s) === RUN TestUserInlinePolicy_ReloadFromStore --- PASS: TestUserInlinePolicy_ReloadFromStore (0.01s) === RUN TestComputeEntryIdentity_BasicFields --- PASS: TestComputeEntryIdentity_BasicFields (0.00s) === RUN TestComputeEntryIdentity_NilSafeMissingChunks --- PASS: TestComputeEntryIdentity_NilSafeMissingChunks (0.00s) === RUN TestHashExtended_OrderStable --- PASS: TestHashExtended_OrderStable (0.00s) === RUN TestHashExtended_DelimiterCollisionResistant --- PASS: TestHashExtended_DelimiterCollisionResistant (0.00s) === RUN TestHashExtended_NilEqualsEmpty --- PASS: TestHashExtended_NilEqualsEmpty (0.00s) === RUN TestIdentityMatches_NilWantTreatedAsMatch --- PASS: TestIdentityMatches_NilWantTreatedAsMatch (0.00s) === RUN TestIdentityMatches_NilLiveDoesNotMatch --- PASS: TestIdentityMatches_NilLiveDoesNotMatch (0.00s) === RUN TestIdentityMatches_AllFieldsCompared === RUN TestIdentityMatches_AllFieldsCompared/identical === RUN TestIdentityMatches_AllFieldsCompared/mtime-drift === RUN TestIdentityMatches_AllFieldsCompared/size-drift === RUN TestIdentityMatches_AllFieldsCompared/fid-drift === RUN TestIdentityMatches_AllFieldsCompared/extended-drift --- PASS: TestIdentityMatches_AllFieldsCompared (0.00s) --- PASS: TestIdentityMatches_AllFieldsCompared/identical (0.00s) --- PASS: TestIdentityMatches_AllFieldsCompared/mtime-drift (0.00s) --- PASS: TestIdentityMatches_AllFieldsCompared/size-drift (0.00s) --- PASS: TestIdentityMatches_AllFieldsCompared/fid-drift (0.00s) --- PASS: TestIdentityMatches_AllFieldsCompared/extended-drift (0.00s) === RUN TestLifecycleDelete_RejectsEmptyRequest --- PASS: TestLifecycleDelete_RejectsEmptyRequest (0.00s) === RUN TestLifecycleAbortMPU_RejectsTraversalUploadIDs === RUN TestLifecycleAbortMPU_RejectsTraversalUploadIDs/#00 === RUN TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads === RUN TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads/ === RUN TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads/. === RUN TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads/.. === RUN TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads/u1/extra --- PASS: TestLifecycleAbortMPU_RejectsTraversalUploadIDs (0.00s) --- PASS: TestLifecycleAbortMPU_RejectsTraversalUploadIDs/#00 (0.00s) --- PASS: TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads (0.00s) --- PASS: TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads/ (0.00s) --- PASS: TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads/. (0.00s) --- PASS: TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads/.. (0.00s) --- PASS: TestLifecycleAbortMPU_RejectsTraversalUploadIDs/.uploads/u1/extra (0.00s) === RUN TestLifecycleDispatch_AbortMPUAfterFetchIsBlocked --- PASS: TestLifecycleDispatch_AbortMPUAfterFetchIsBlocked (0.00s) === RUN TestLifecycleDispatch_UnknownActionKindIsBlocked --- PASS: TestLifecycleDispatch_UnknownActionKindIsBlocked (0.00s) === RUN TestLifecycleDispatch_NoncurrentRequiresVersionID === RUN TestLifecycleDispatch_NoncurrentRequiresVersionID/NONCURRENT_DAYS === RUN TestLifecycleDispatch_NoncurrentRequiresVersionID/NEWER_NONCURRENT === RUN TestLifecycleDispatch_NoncurrentRequiresVersionID/EXPIRED_DELETE_MARKER --- PASS: TestLifecycleDispatch_NoncurrentRequiresVersionID (0.00s) --- PASS: TestLifecycleDispatch_NoncurrentRequiresVersionID/NONCURRENT_DAYS (0.00s) --- PASS: TestLifecycleDispatch_NoncurrentRequiresVersionID/NEWER_NONCURRENT (0.00s) --- PASS: TestLifecycleDispatch_NoncurrentRequiresVersionID/EXPIRED_DELETE_MARKER (0.00s) === RUN TestEntryUsesMetadataOnlyDelete === RUN TestEntryUsesMetadataOnlyDelete/nil_entry === RUN TestEntryUsesMetadataOnlyDelete/nil_attributes === RUN TestEntryUsesMetadataOnlyDelete/TtlSec=0_(no_per-write_stamp) === RUN TestEntryUsesMetadataOnlyDelete/TtlSec>0_(PR_9377_stamped_a_fast-path_TTL) === RUN TestEntryUsesMetadataOnlyDelete/TtlSec<0_should_not_happen_but_must_not_flip_the_path_on --- PASS: TestEntryUsesMetadataOnlyDelete (0.00s) --- PASS: TestEntryUsesMetadataOnlyDelete/nil_entry (0.00s) --- PASS: TestEntryUsesMetadataOnlyDelete/nil_attributes (0.00s) --- PASS: TestEntryUsesMetadataOnlyDelete/TtlSec=0_(no_per-write_stamp) (0.00s) --- PASS: TestEntryUsesMetadataOnlyDelete/TtlSec>0_(PR_9377_stamped_a_fast-path_TTL) (0.00s) --- PASS: TestEntryUsesMetadataOnlyDelete/TtlSec<0_should_not_happen_but_must_not_flip_the_path_on (0.00s) === RUN TestRecordMetadataOnlyIf_OnlyFiresWhenOn --- PASS: TestRecordMetadataOnlyIf_OnlyFiresWhenOn (0.00s) === RUN TestRecordMetadataOnlyIf_NilRequestSafe --- PASS: TestRecordMetadataOnlyIf_NilRequestSafe (0.00s) === RUN TestRecordMetadataOnlyIf_EmptyRuleHashCollapsesToEmptyLabel --- PASS: TestRecordMetadataOnlyIf_EmptyRuleHashCollapsesToEmptyLabel (0.00s) === RUN TestLifecycleDelete_RequiresAdminAuth --- PASS: TestLifecycleDelete_RequiresAdminAuth (0.01s) === RUN TestLifecycleDelete_NoSigningKey_LocalPeerOnly --- PASS: TestLifecycleDelete_NoSigningKey_LocalPeerOnly (0.00s) === RUN TestLifecycleReady_AuthorizesLikeLifecycleDelete === RUN TestLifecycleReady_AuthorizesLikeLifecycleDelete/key,_no_token === RUN TestLifecycleReady_AuthorizesLikeLifecycleDelete/key,_mis-signed_token === RUN TestLifecycleReady_AuthorizesLikeLifecycleDelete/key,_valid_token === RUN TestLifecycleReady_AuthorizesLikeLifecycleDelete/no_key,_remote_peer === RUN TestLifecycleReady_AuthorizesLikeLifecycleDelete/no_key,_loopback_peer --- PASS: TestLifecycleReady_AuthorizesLikeLifecycleDelete (0.01s) --- PASS: TestLifecycleReady_AuthorizesLikeLifecycleDelete/key,_no_token (0.00s) --- PASS: TestLifecycleReady_AuthorizesLikeLifecycleDelete/key,_mis-signed_token (0.00s) --- PASS: TestLifecycleReady_AuthorizesLikeLifecycleDelete/key,_valid_token (0.00s) --- PASS: TestLifecycleReady_AuthorizesLikeLifecycleDelete/no_key,_remote_peer (0.00s) --- PASS: TestLifecycleReady_AuthorizesLikeLifecycleDelete/no_key,_loopback_peer (0.00s) === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DAYS/newer_version === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DAYS/null_version_written_while_suspended === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DAYS/unaddressed_null_behind_a_newer_version_while_suspended === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DAYS/still_latest === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DATE/newer_version === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DATE/null_version_written_while_suspended === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DATE/unaddressed_null_behind_a_newer_version_while_suspended === RUN TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DATE/still_latest --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion (0.79s) --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DAYS/newer_version (0.02s) --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DAYS/null_version_written_while_suspended (0.33s) --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DAYS/unaddressed_null_behind_a_newer_version_while_suspended (0.02s) --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DAYS/still_latest (0.03s) --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DATE/newer_version (0.01s) --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DATE/null_version_written_while_suspended (0.32s) --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DATE/unaddressed_null_behind_a_newer_version_while_suspended (0.02s) --- PASS: TestLifecycleDelete_CurrentExpirationRequiresLatestVersion/EXPIRATION_DATE/still_latest (0.04s) === RUN TestLifecycleDelete_ExpiredAttemptWritesNoMarker === RUN TestLifecycleDelete_ExpiredAttemptWritesNoMarker/Enabled === RUN TestLifecycleDelete_ExpiredAttemptWritesNoMarker/Suspended --- PASS: TestLifecycleDelete_ExpiredAttemptWritesNoMarker (0.03s) --- PASS: TestLifecycleDelete_ExpiredAttemptWritesNoMarker/Enabled (0.02s) --- PASS: TestLifecycleDelete_ExpiredAttemptWritesNoMarker/Suspended (0.02s) === RUN TestLifecycleDelete_DeadlineDuringMarkerStillDeletesNull --- PASS: TestLifecycleDelete_DeadlineDuringMarkerStillDeletesNull (0.35s) === RUN TestLifecycleDelete_DeadlineDuringNullReadWritesNoMarker --- PASS: TestLifecycleDelete_DeadlineDuringNullReadWritesNoMarker (0.68s) === RUN TestLifecycleDelete_SuspendedMarkerFailureLeavesNullForRetry === RUN TestLifecycleDelete_SuspendedMarkerFailureLeavesNullForRetry/routed=true E1117 09:42:04.230817 s3api_object_versioned_finalize.go:100 routedVersionedFinalize: b/obj on 127.0.0.1:1: rpc error: code = Unknown desc = owner unavailable === RUN TestLifecycleDelete_SuspendedMarkerFailureLeavesNullForRetry/routed=false I1117 09:42:04.907227 filer_client.go:340 create file /buckets/b/obj.versions/v_67173434d8c2fb23e3e4bc8fe39f48b4: CreateEntry: rpc error: code = Unknown desc = filer unavailable --- PASS: TestLifecycleDelete_SuspendedMarkerFailureLeavesNullForRetry (1.37s) --- PASS: TestLifecycleDelete_SuspendedMarkerFailureLeavesNullForRetry/routed=true (0.68s) --- PASS: TestLifecycleDelete_SuspendedMarkerFailureLeavesNullForRetry/routed=false (0.69s) === RUN TestLifecycleDelete_RoutedNullDeleteFailureRetries E1117 09:42:05.602421 s3api_object_versioned_finalize.go:287 routedDeleteNullVersion: b/obj on 127.0.0.1:1: rpc error: code = Unknown desc = owner unavailable --- PASS: TestLifecycleDelete_RoutedNullDeleteFailureRetries (0.35s) === RUN TestLifecycleDelete_RoutedNullDeleteObjectLockLookupFailureRetries E1117 09:42:05.961321 s3api_bucket_config.go:382 getBucketConfig: failed to get bucket entry for b: all filers failed, last error: LookupEntry1: rpc error: code = Unavailable desc = filer unavailable --- PASS: TestLifecycleDelete_RoutedNullDeleteObjectLockLookupFailureRetries (0.35s) === RUN TestLifecycleDelete_SuspendedNullRewrittenBeforeDeleteSurvives === RUN TestLifecycleDelete_SuspendedNullRewrittenBeforeDeleteSurvives/routed=true === RUN TestLifecycleDelete_SuspendedNullRewrittenBeforeDeleteSurvives/routed=false --- PASS: TestLifecycleDelete_SuspendedNullRewrittenBeforeDeleteSurvives (0.98s) --- PASS: TestLifecycleDelete_SuspendedNullRewrittenBeforeDeleteSurvives/routed=true (0.35s) --- PASS: TestLifecycleDelete_SuspendedNullRewrittenBeforeDeleteSurvives/routed=false (0.62s) === RUN TestLifecycleDelete_SuspendedPutOverNamedVersionSurvives === RUN TestLifecycleDelete_SuspendedPutOverNamedVersionSurvives/routed/at-null-read === RUN TestLifecycleDelete_SuspendedPutOverNamedVersionSurvives/routed/at-marker === RUN TestLifecycleDelete_SuspendedPutOverNamedVersionSurvives/unrouted/at-null-read --- PASS: TestLifecycleDelete_SuspendedPutOverNamedVersionSurvives (0.32s) --- PASS: TestLifecycleDelete_SuspendedPutOverNamedVersionSurvives/routed/at-null-read (0.14s) --- PASS: TestLifecycleDelete_SuspendedPutOverNamedVersionSurvives/routed/at-marker (0.11s) --- PASS: TestLifecycleDelete_SuspendedPutOverNamedVersionSurvives/unrouted/at-null-read (0.04s) === RUN TestLifecycleDelete_OverlappingAttemptWritesOneMarker === RUN TestLifecycleDelete_OverlappingAttemptWritesOneMarker/Enabled === RUN TestLifecycleDelete_OverlappingAttemptWritesOneMarker/Suspended --- PASS: TestLifecycleDelete_OverlappingAttemptWritesOneMarker (0.11s) --- PASS: TestLifecycleDelete_OverlappingAttemptWritesOneMarker/Enabled (0.05s) --- PASS: TestLifecycleDelete_OverlappingAttemptWritesOneMarker/Suspended (0.05s) === RUN TestLifecycleDelete_VersionPromotedBeforeMarkerIsNotHidden === RUN TestLifecycleDelete_VersionPromotedBeforeMarkerIsNotHidden/version=old === RUN TestLifecycleDelete_VersionPromotedBeforeMarkerIsNotHidden/version= --- PASS: TestLifecycleDelete_VersionPromotedBeforeMarkerIsNotHidden (0.09s) --- PASS: TestLifecycleDelete_VersionPromotedBeforeMarkerIsNotHidden/version=old (0.05s) --- PASS: TestLifecycleDelete_VersionPromotedBeforeMarkerIsNotHidden/version= (0.04s) === RUN TestLifecycleDelete_VersionPromotedOverNullBeforeMarkerIsNotHidden === RUN TestLifecycleDelete_VersionPromotedOverNullBeforeMarkerIsNotHidden/version=null === RUN TestLifecycleDelete_VersionPromotedOverNullBeforeMarkerIsNotHidden/version= --- PASS: TestLifecycleDelete_VersionPromotedOverNullBeforeMarkerIsNotHidden (0.07s) --- PASS: TestLifecycleDelete_VersionPromotedOverNullBeforeMarkerIsNotHidden/version=null (0.03s) --- PASS: TestLifecycleDelete_VersionPromotedOverNullBeforeMarkerIsNotHidden/version= (0.03s) === RUN TestLifecycleDelete_SuspendedPutOverVersionBeforeMarkerIsNotHidden === RUN TestLifecycleDelete_SuspendedPutOverVersionBeforeMarkerIsNotHidden/version=old === RUN TestLifecycleDelete_SuspendedPutOverVersionBeforeMarkerIsNotHidden/version= --- PASS: TestLifecycleDelete_SuspendedPutOverVersionBeforeMarkerIsNotHidden (0.06s) --- PASS: TestLifecycleDelete_SuspendedPutOverVersionBeforeMarkerIsNotHidden/version=old (0.03s) --- PASS: TestLifecycleDelete_SuspendedPutOverVersionBeforeMarkerIsNotHidden/version= (0.03s) === RUN TestLifecycleDelete_NullUnderIdOnlyPointerExpires === RUN TestLifecycleDelete_NullUnderIdOnlyPointerExpires/version=null === RUN TestLifecycleDelete_NullUnderIdOnlyPointerExpires/version= --- PASS: TestLifecycleDelete_NullUnderIdOnlyPointerExpires (0.06s) --- PASS: TestLifecycleDelete_NullUnderIdOnlyPointerExpires/version=null (0.03s) --- PASS: TestLifecycleDelete_NullUnderIdOnlyPointerExpires/version= (0.03s) === RUN TestLifecycleDelete_UnroutedMarkerHoldsObjectWriteLock --- PASS: TestLifecycleDelete_UnroutedMarkerHoldsObjectWriteLock (0.04s) === RUN TestLifecycleDelete_LockedExpiredDeleteMarkerSkipsWormGuard --- PASS: TestLifecycleDelete_LockedExpiredDeleteMarkerSkipsWormGuard (0.04s) === RUN TestLifecycleDelete_ReplayAfterLostReply === RUN TestLifecycleDelete_ReplayAfterLostReply/current_expiration_writes_one_delete_marker === RUN TestLifecycleDelete_ReplayAfterLostReply/noncurrent_version === RUN TestLifecycleDelete_ReplayAfterLostReply/object-locked_noncurrent_version --- PASS: TestLifecycleDelete_ReplayAfterLostReply (0.12s) --- PASS: TestLifecycleDelete_ReplayAfterLostReply/current_expiration_writes_one_delete_marker (0.06s) --- PASS: TestLifecycleDelete_ReplayAfterLostReply/noncurrent_version (0.03s) --- PASS: TestLifecycleDelete_ReplayAfterLostReply/object-locked_noncurrent_version (0.03s) === RUN TestPrefixNormalizationInList === RUN TestPrefixNormalizationInList/simple_prefix === RUN TestPrefixNormalizationInList/leading_slash === RUN TestPrefixNormalizationInList/duplicate_slashes === RUN TestPrefixNormalizationInList/backslashes --- PASS: TestPrefixNormalizationInList (0.00s) --- PASS: TestPrefixNormalizationInList/simple_prefix (0.00s) --- PASS: TestPrefixNormalizationInList/leading_slash (0.00s) --- PASS: TestPrefixNormalizationInList/duplicate_slashes (0.00s) --- PASS: TestPrefixNormalizationInList/backslashes (0.00s) === RUN TestListPrefixConsistency --- PASS: TestListPrefixConsistency (0.00s) === RUN TestListPartsGoneUploadAnswersNoSuchUpload --- PASS: TestListPartsGoneUploadAnswersNoSuchUpload (0.02s) === RUN TestListPartsResurrectedDirectoryAnswersNoSuchUpload --- PASS: TestListPartsResurrectedDirectoryAnswersNoSuchUpload (0.01s) === RUN TestListPartsOpenUploadWithNoPartsAnswersEmptyList --- PASS: TestListPartsOpenUploadWithNoPartsAnswersEmptyList (0.02s) === RUN TestListPartsOpenUploadListsParts --- PASS: TestListPartsOpenUploadListsParts (0.02s) === RUN TestListPartsPartNumberMarkerIsExclusive --- PASS: TestListPartsPartNumberMarkerIsExclusive (0.02s) === RUN TestListPartsPaginationWithUUIDParts --- PASS: TestListPartsPaginationWithUUIDParts (0.03s) === RUN TestProbeReadable === RUN TestProbeReadable/readable_local_copy === RUN TestProbeReadable/final_byte_with_trailing_EOF_counts_as_readable === RUN TestProbeReadable/zero-byte_EOF_is_unreadable === RUN TestProbeReadable/zero-byte_read_without_error_is_unreadable === RUN TestProbeReadable/read_error_surfaces === RUN TestProbeReadable/stuck_volume_trips_the_timeout_instead_of_blocking --- PASS: TestProbeReadable (0.06s) --- PASS: TestProbeReadable/readable_local_copy (0.00s) --- PASS: TestProbeReadable/final_byte_with_trailing_EOF_counts_as_readable (0.00s) --- PASS: TestProbeReadable/zero-byte_EOF_is_unreadable (0.00s) --- PASS: TestProbeReadable/zero-byte_read_without_error_is_unreadable (0.00s) --- PASS: TestProbeReadable/read_error_surfaces (0.00s) --- PASS: TestProbeReadable/stuck_volume_trips_the_timeout_instead_of_blocking (0.05s) === RUN TestShouldFallBackToRemote === RUN TestShouldFallBackToRemote/matching_remote === RUN TestShouldFallBackToRemote/null_versionId_is_treated_as_unversioned === RUN TestShouldFallBackToRemote/versioned_read_cannot_use_the_unversioned_remote_key === RUN TestShouldFallBackToRemote/latest_read_that_resolves_to_a_version_cannot_use_the_unversioned_key === RUN TestShouldFallBackToRemote/no_remote_entry === RUN TestShouldFallBackToRemote/size_mismatch_is_not_served_as_identical_bytes --- PASS: TestShouldFallBackToRemote (0.00s) --- PASS: TestShouldFallBackToRemote/matching_remote (0.00s) --- PASS: TestShouldFallBackToRemote/null_versionId_is_treated_as_unversioned (0.00s) --- PASS: TestShouldFallBackToRemote/versioned_read_cannot_use_the_unversioned_remote_key (0.00s) --- PASS: TestShouldFallBackToRemote/latest_read_that_resolves_to_a_version_cannot_use_the_unversioned_key (0.00s) --- PASS: TestShouldFallBackToRemote/no_remote_entry (0.00s) --- PASS: TestShouldFallBackToRemote/size_mismatch_is_not_served_as_identical_bytes (0.00s) === RUN TestS3CachedReadFallsBackToRemote === RUN TestS3CachedReadFallsBackToRemote/unreadable_local_copy_is_served_from_the_mounted_remote E1117 09:42:08.123340 reader_at.go:270 fetching chunk {FileId:1,0123456789ab OffsetInChunk:0 ViewSize:10 ViewOffset:0 ChunkSize:10 IsGzipped:false ModifiedTsNs:0}: operation LookupFileId 1,0123456789ab failed, err: volume 1 not found for fileId 1,0123456789ab: provider lookup failed: all 1 filer(s) failed with non-retryable error: filer.LookupVolume failed: rpc error: code = Unimplemented desc = method LookupVolume not implemented volume 1 not found === RUN TestS3CachedReadFallsBackToRemote/range_fallback_serves_the_requested_window_from_the_remote E1117 09:42:08.163865 reader_cache.go:144 operation LookupFileId 1,0123456789ab failed, err: volume 1 not found for fileId 1,0123456789ab: provider lookup failed: all 1 filer(s) failed with non-retryable error: filer.LookupVolume failed: rpc error: code = Unimplemented desc = method LookupVolume not implemented volume 1 not found E1117 09:42:08.164375 reader_at.go:270 fetching chunk {FileId:1,0123456789ab OffsetInChunk:2 ViewSize:4 ViewOffset:2 ChunkSize:10 IsGzipped:false ModifiedTsNs:0}: volume 1 not found for fileId 1,0123456789ab: provider lookup failed: all 1 filer(s) failed with non-retryable error: filer.LookupVolume failed: rpc error: code = Unimplemented desc = method LookupVolume not implemented volume 1 not found === RUN TestS3CachedReadFallsBackToRemote/a_local-only_object_gets_a_clean_500,_not_a_broken_200_body E1117 09:42:08.190688 reader_at.go:270 fetching chunk {FileId:1,0123456789ab OffsetInChunk:0 ViewSize:10 ViewOffset:0 ChunkSize:10 IsGzipped:false ModifiedTsNs:0}: operation LookupFileId 1,0123456789ab failed, err: volume 1 not found for fileId 1,0123456789ab: provider lookup failed: all 1 filer(s) failed with non-retryable error: filer.LookupVolume failed: rpc error: code = Unimplemented desc = method LookupVolume not implemented volume 1 not found E1117 09:42:08.191839 s3api_object_handlers.go:1441 streamFromVolumeServers: first read of mybucket/dir/obj.bin failed: operation LookupFileId 1,0123456789ab failed, err: volume 1 not found for fileId 1,0123456789ab: provider lookup failed: all 1 filer(s) failed with non-retryable error: filer.LookupVolume failed: rpc error: code = Unimplemented desc = method LookupVolume not implemented volume 1 not found === RUN TestS3CachedReadFallsBackToRemote/versioned_read_does_not_fall_back_to_the_unversioned_remote_key E1117 09:42:08.215947 reader_at.go:270 fetching chunk {FileId:1,0123456789ab OffsetInChunk:0 ViewSize:10 ViewOffset:0 ChunkSize:10 IsGzipped:false ModifiedTsNs:0}: operation LookupFileId 1,0123456789ab failed, err: volume 1 not found for fileId 1,0123456789ab: provider lookup failed: all 1 filer(s) failed with non-retryable error: filer.LookupVolume failed: rpc error: code = Unimplemented desc = method LookupVolume not implemented volume 1 not found E1117 09:42:08.216700 s3api_object_handlers.go:1441 streamFromVolumeServers: first read of mybucket/dir/obj.bin failed: operation LookupFileId 1,0123456789ab failed, err: volume 1 not found for fileId 1,0123456789ab: provider lookup failed: all 1 filer(s) failed with non-retryable error: filer.LookupVolume failed: rpc error: code = Unimplemented desc = method LookupVolume not implemented volume 1 not found --- PASS: TestS3CachedReadFallsBackToRemote (0.16s) --- PASS: TestS3CachedReadFallsBackToRemote/unreadable_local_copy_is_served_from_the_mounted_remote (0.09s) --- PASS: TestS3CachedReadFallsBackToRemote/range_fallback_serves_the_requested_window_from_the_remote (0.03s) --- PASS: TestS3CachedReadFallsBackToRemote/a_local-only_object_gets_a_clean_500,_not_a_broken_200_body (0.02s) --- PASS: TestS3CachedReadFallsBackToRemote/versioned_read_does_not_fall_back_to_the_unversioned_remote_key (0.02s) === RUN TestS3LocalReadCommitsStatusOnFirstWrite === RUN TestS3LocalReadCommitsStatusOnFirstWrite/readable_local_object_streams_a_200 === RUN TestS3LocalReadCommitsStatusOnFirstWrite/readable_range_streams_a_206_with_range_headers --- PASS: TestS3LocalReadCommitsStatusOnFirstWrite (0.02s) --- PASS: TestS3LocalReadCommitsStatusOnFirstWrite/readable_local_object_streams_a_200 (0.01s) --- PASS: TestS3LocalReadCommitsStatusOnFirstWrite/readable_range_streams_a_206_with_range_headers (0.00s) === RUN TestStreamRangeToClientFinishesFromRemote === RUN TestStreamRangeToClientFinishesFromRemote/later_chunk_failure_is_finished_from_the_remote === RUN TestStreamRangeToClientFinishesFromRemote/a_short_local_read_reported_as_clean_EOF_is_not_served_truncated === RUN TestStreamRangeToClientFinishesFromRemote/range_read_resumes_at_the_absolute_offset === RUN TestStreamRangeToClientFinishesFromRemote/a_remote_overwritten_since_caching_is_not_spliced_onto_the_local_prefix W1117 09:42:08.314529 s3api_object_handlers.go:1573 streamFromVolumeServers: origin stream mybucket/dir/obj.bin: remote mybucket/dir/obj.bin changed since it was cached === RUN TestStreamRangeToClientFinishesFromRemote/a_local-only_object_keeps_the_mid-stream_error === RUN TestStreamRangeToClientFinishesFromRemote/a_failed_write_to_the_client_is_not_refetched_from_the_remote --- PASS: TestStreamRangeToClientFinishesFromRemote (0.09s) --- PASS: TestStreamRangeToClientFinishesFromRemote/later_chunk_failure_is_finished_from_the_remote (0.02s) --- PASS: TestStreamRangeToClientFinishesFromRemote/a_short_local_read_reported_as_clean_EOF_is_not_served_truncated (0.02s) --- PASS: TestStreamRangeToClientFinishesFromRemote/range_read_resumes_at_the_absolute_offset (0.02s) --- PASS: TestStreamRangeToClientFinishesFromRemote/a_remote_overwritten_since_caching_is_not_spliced_onto_the_local_prefix (0.02s) --- PASS: TestStreamRangeToClientFinishesFromRemote/a_local-only_object_keeps_the_mid-stream_error (0.00s) --- PASS: TestStreamRangeToClientFinishesFromRemote/a_failed_write_to_the_client_is_not_refetched_from_the_remote (0.00s) === RUN TestMultipartListingsRejectNonIntegerArguments === RUN TestMultipartListingsRejectNonIntegerArguments/ListParts_max-parts === RUN TestMultipartListingsRejectNonIntegerArguments/ListParts_max-parts_out_of_range === RUN TestMultipartListingsRejectNonIntegerArguments/ListParts_part-number-marker === RUN TestMultipartListingsRejectNonIntegerArguments/ListParts_part-number-marker_out_of_range === RUN TestMultipartListingsRejectNonIntegerArguments/ListMultipartUploads_max-uploads === RUN TestMultipartListingsRejectNonIntegerArguments/ListMultipartUploads_max-uploads_out_of_range --- PASS: TestMultipartListingsRejectNonIntegerArguments (0.05s) --- PASS: TestMultipartListingsRejectNonIntegerArguments/ListParts_max-parts (0.01s) --- PASS: TestMultipartListingsRejectNonIntegerArguments/ListParts_max-parts_out_of_range (0.00s) --- PASS: TestMultipartListingsRejectNonIntegerArguments/ListParts_part-number-marker (0.00s) --- PASS: TestMultipartListingsRejectNonIntegerArguments/ListParts_part-number-marker_out_of_range (0.00s) --- PASS: TestMultipartListingsRejectNonIntegerArguments/ListMultipartUploads_max-uploads (0.00s) --- PASS: TestMultipartListingsRejectNonIntegerArguments/ListMultipartUploads_max-uploads_out_of_range (0.00s) === RUN TestCheckUploadIDRequiresGeneratedFormat === RUN TestCheckUploadIDRequiresGeneratedFormat/legacy_hash === RUN TestCheckUploadIDRequiresGeneratedFormat/current_format === RUN TestCheckUploadIDRequiresGeneratedFormat/wrong_object_hash E1117 09:42:08.378645 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0000000000000000000000000000000000000000_aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa are not matched === RUN TestCheckUploadIDRequiresGeneratedFormat/arbitrary_suffix E1117 09:42:08.379626 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0fb17d4690a62965c850aca2ac98bd432bdd2331_suffix are not matched === RUN TestCheckUploadIDRequiresGeneratedFormat/uppercase_suffix E1117 09:42:08.380408 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0fb17d4690a62965c850aca2ac98bd432bdd2331_AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA are not matched === RUN TestCheckUploadIDRequiresGeneratedFormat/short_suffix E1117 09:42:08.381195 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0fb17d4690a62965c850aca2ac98bd432bdd2331_aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa are not matched === RUN TestCheckUploadIDRequiresGeneratedFormat/long_suffix E1117 09:42:08.381944 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0fb17d4690a62965c850aca2ac98bd432bdd2331_aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa are not matched === RUN TestCheckUploadIDRequiresGeneratedFormat/slash_traversal E1117 09:42:08.382732 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0fb17d4690a62965c850aca2ac98bd432bdd2331/../../../victim-bucket are not matched === RUN TestCheckUploadIDRequiresGeneratedFormat/suffix_traversal E1117 09:42:08.383491 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0fb17d4690a62965c850aca2ac98bd432bdd2331_aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/../../../victim-bucket are not matched === RUN TestCheckUploadIDRequiresGeneratedFormat/backslash_traversal E1117 09:42:08.384284 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0fb17d4690a62965c850aca2ac98bd432bdd2331\..\..\victim-bucket are not matched === RUN TestCheckUploadIDRequiresGeneratedFormat/nul_suffix E1117 09:42:08.385022 s3api_object_handlers_multipart.go:625 object dir/object and uploadID 0fb17d4690a62965c850aca2ac98bd432bdd2331_abcdef are not matched --- PASS: TestCheckUploadIDRequiresGeneratedFormat (0.01s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/legacy_hash (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/current_format (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/wrong_object_hash (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/arbitrary_suffix (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/uppercase_suffix (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/short_suffix (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/long_suffix (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/slash_traversal (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/suffix_traversal (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/backslash_traversal (0.00s) --- PASS: TestCheckUploadIDRequiresGeneratedFormat/nul_suffix (0.00s) === RUN TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch === RUN TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch/missing_IV === RUN TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch/empty_IV === RUN TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch/short_IV === RUN TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch/long_IV --- PASS: TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch (0.03s) --- PASS: TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch/missing_IV (0.02s) --- PASS: TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch/empty_IV (0.01s) --- PASS: TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch/short_IV (0.00s) --- PASS: TestBuildMultipartSSEKMSReader_RejectsBadIVBeforeAnyFetch/long_IV (0.00s) === RUN TestBuildMultipartSSEKMSReader_RejectsMissingMetadataBeforeAnyFetch --- PASS: TestBuildMultipartSSEKMSReader_RejectsMissingMetadataBeforeAnyFetch (0.00s) === RUN TestBuildMultipartSSEKMSReader_RejectsUnparseableMetadataBeforeAnyFetch --- PASS: TestBuildMultipartSSEKMSReader_RejectsUnparseableMetadataBeforeAnyFetch (0.00s) === RUN TestBuildMultipartSSEKMSReader_SortsByOffset --- PASS: TestBuildMultipartSSEKMSReader_SortsByOffset (0.00s) === RUN TestIsMultipartUploadEntry === RUN TestIsMultipartUploadEntry/aborted_upload === RUN TestIsMultipartUploadEntry/directory_re-created_by_a_part_write === RUN TestIsMultipartUploadEntry/key_emptied === RUN TestIsMultipartUploadEntry/open_upload --- PASS: TestIsMultipartUploadEntry (0.00s) --- PASS: TestIsMultipartUploadEntry/aborted_upload (0.00s) --- PASS: TestIsMultipartUploadEntry/directory_re-created_by_a_part_write (0.00s) --- PASS: TestIsMultipartUploadEntry/key_emptied (0.00s) --- PASS: TestIsMultipartUploadEntry/open_upload (0.00s) === RUN TestNextMarkerWithNestedPrefix === RUN TestNextMarkerWithNestedPrefix/nested_prefix_with_both_requestDir_and_prefix === RUN TestNextMarkerWithNestedPrefix/only_requestDir,_no_prefix === RUN TestNextMarkerWithNestedPrefix/no_requestDir,_only_prefix === RUN TestNextMarkerWithNestedPrefix/deeply_nested_prefix --- PASS: TestNextMarkerWithNestedPrefix (0.00s) --- PASS: TestNextMarkerWithNestedPrefix/nested_prefix_with_both_requestDir_and_prefix (0.00s) --- PASS: TestNextMarkerWithNestedPrefix/only_requestDir,_no_prefix (0.00s) --- PASS: TestNextMarkerWithNestedPrefix/no_requestDir,_only_prefix (0.00s) --- PASS: TestNextMarkerWithNestedPrefix/deeply_nested_prefix (0.00s) === RUN TestNextMarkerWithCommonPrefix === RUN TestNextMarkerWithCommonPrefix/nested_prefix_with_CommonPrefix === RUN TestNextMarkerWithCommonPrefix/only_requestDir_with_CommonPrefix === RUN TestNextMarkerWithCommonPrefix/no_requestDir_with_CommonPrefix --- PASS: TestNextMarkerWithCommonPrefix (0.00s) --- PASS: TestNextMarkerWithCommonPrefix/nested_prefix_with_CommonPrefix (0.00s) --- PASS: TestNextMarkerWithCommonPrefix/only_requestDir_with_CommonPrefix (0.00s) --- PASS: TestNextMarkerWithCommonPrefix/no_requestDir_with_CommonPrefix (0.00s) === RUN TestPutObjectAclPermissions === RUN TestPutObjectAclPermissions/bucket-wide_write-acp_grant I1117 09:42:08.443837 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/prefix_write-acp_grant I1117 09:42:08.521945 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/grant_outside_prefix_denied I1117 09:42:08.569970 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/grant_on_other_bucket_denied I1117 09:42:08.584938 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/read-only_grant_denied I1117 09:42:08.600562 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/non-owner_denied I1117 09:42:08.609730 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/admin_sets_private I1117 09:42:08.629766 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/admin_sets_public-read I1117 09:42:08.655472 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/iam_policy_allow I1117 09:42:08.677664 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/bucket_policy_allow I1117 09:42:08.735029 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/iam_policy_explicit_deny I1117 09:42:08.774172 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/bucket_policy_explicit_deny I1117 09:42:08.799283 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/retired_owner_private I1117 09:42:08.810685 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/retired_owner_public-read I1117 09:42:08.835208 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/bucket-owner-read_with_distinct_bucket_owner I1117 09:42:08.855649 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/bucket-owner-full-control_with_distinct_bucket_owner I1117 09:42:08.878113 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/xml_acl_preserves_retired_owner I1117 09:42:08.905231 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/xml_acl_unknown_grantee_denied I1117 09:42:08.937601 config_loader.go:73 Using explicit credential store: memory W1117 09:42:08.955011 s3api_acl_helper.go:317 invalid canonical grantee! account id[unknown-grantee] is not exists === RUN TestPutObjectAclPermissions/xml_acl_owner_change_denied I1117 09:42:08.959449 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/nil_extended_metadata_denied I1117 09:42:08.983201 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/absent_owner_denied I1117 09:42:09.000596 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/empty_owner_denied I1117 09:42:09.026160 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/ownerless_iam_policy_denied I1117 09:42:09.043683 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/ownerless_bucket_policy_denied I1117 09:42:09.065184 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/admin_takes_ownerless_object_private I1117 09:42:09.092207 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclPermissions/admin_takes_ownerless_object_public-read I1117 09:42:09.119942 config_loader.go:73 Using explicit credential store: memory --- PASS: TestPutObjectAclPermissions (0.70s) --- PASS: TestPutObjectAclPermissions/bucket-wide_write-acp_grant (0.08s) --- PASS: TestPutObjectAclPermissions/prefix_write-acp_grant (0.05s) --- PASS: TestPutObjectAclPermissions/grant_outside_prefix_denied (0.01s) --- PASS: TestPutObjectAclPermissions/grant_on_other_bucket_denied (0.01s) --- PASS: TestPutObjectAclPermissions/read-only_grant_denied (0.01s) --- PASS: TestPutObjectAclPermissions/non-owner_denied (0.02s) --- PASS: TestPutObjectAclPermissions/admin_sets_private (0.02s) --- PASS: TestPutObjectAclPermissions/admin_sets_public-read (0.02s) --- PASS: TestPutObjectAclPermissions/iam_policy_allow (0.06s) --- PASS: TestPutObjectAclPermissions/bucket_policy_allow (0.04s) --- PASS: TestPutObjectAclPermissions/iam_policy_explicit_deny (0.02s) --- PASS: TestPutObjectAclPermissions/bucket_policy_explicit_deny (0.01s) --- PASS: TestPutObjectAclPermissions/retired_owner_private (0.02s) --- PASS: TestPutObjectAclPermissions/retired_owner_public-read (0.02s) --- PASS: TestPutObjectAclPermissions/bucket-owner-read_with_distinct_bucket_owner (0.02s) --- PASS: TestPutObjectAclPermissions/bucket-owner-full-control_with_distinct_bucket_owner (0.03s) --- PASS: TestPutObjectAclPermissions/xml_acl_preserves_retired_owner (0.03s) --- PASS: TestPutObjectAclPermissions/xml_acl_unknown_grantee_denied (0.02s) --- PASS: TestPutObjectAclPermissions/xml_acl_owner_change_denied (0.02s) --- PASS: TestPutObjectAclPermissions/nil_extended_metadata_denied (0.02s) --- PASS: TestPutObjectAclPermissions/absent_owner_denied (0.02s) --- PASS: TestPutObjectAclPermissions/empty_owner_denied (0.02s) --- PASS: TestPutObjectAclPermissions/ownerless_iam_policy_denied (0.02s) --- PASS: TestPutObjectAclPermissions/ownerless_bucket_policy_denied (0.03s) --- PASS: TestPutObjectAclPermissions/admin_takes_ownerless_object_private (0.02s) --- PASS: TestPutObjectAclPermissions/admin_takes_ownerless_object_public-read (0.03s) === RUN TestPutObjectAclWithoutAuth === RUN TestPutObjectAclWithoutAuth/stored_owner I1117 09:42:09.146170 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclWithoutAuth/ownerless I1117 09:42:09.166060 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectAclWithoutAuth/forged_account_header I1117 09:42:09.185805 config_loader.go:73 Using explicit credential store: memory --- PASS: TestPutObjectAclWithoutAuth (0.06s) --- PASS: TestPutObjectAclWithoutAuth/stored_owner (0.02s) --- PASS: TestPutObjectAclWithoutAuth/ownerless (0.02s) --- PASS: TestPutObjectAclWithoutAuth/forged_account_header (0.02s) === RUN TestCreateAfterAmbiguousRoute === RUN TestCreateAfterAmbiguousRoute/stored_entry_is_this_PUT's_—_route_landed === RUN TestCreateAfterAmbiguousRoute/stored_entry_is_a_newer_write_—_refuse_stale_re-commit W1117 09:42:09.227217 s3api_object_handlers_put.go:1300 putToFiler: ambiguous routed PUT for /buckets/b/o was superseded by another write; not committing stale entry === RUN TestCreateAfterAmbiguousRoute/stored_entry_is_a_directory,_chunks_alive_—_lock_path_answers === RUN TestCreateAfterAmbiguousRoute/stored_entry_is_a_directory,_chunks_unverifiable_—_refuse W1117 09:42:09.250426 s3api_object_handlers_put.go:1286 putToFiler: ambiguous routed PUT for /buckets/b/o resolved to a directory and its chunks cannot be verified; not re-applying entry === RUN TestCreateAfterAmbiguousRoute/match_behind_an_unanswered_filer_—_refuse W1117 09:42:09.277289 s3api_object_handlers_put.go:1274 putToFiler: ambiguous routed PUT for /buckets/b/o matches an entry but a filer could not be checked; not recovering === RUN TestCreateAfterAmbiguousRoute/entry_proven_absent,_chunks_alive_—_conditional_create_proceeds === RUN TestCreateAfterAmbiguousRoute/entry_absent_but_chunks_unverifiable_—_refuse W1117 09:42:09.301430 s3api_object_handlers_put.go:1336 putToFiler: ambiguous routed PUT for /buckets/b/o left no entry and its chunks cannot be verified; not re-applying entry === RUN TestCreateAfterAmbiguousRoute/lookup_cannot_resolve_state_—_refuse W1117 09:42:09.312181 s3api_object_handlers_put.go:1324 putToFiler: cannot confirm what ambiguous routed PUT for /buckets/b/o committed; not re-applying entry === RUN TestCreateAfterAmbiguousRoute/finalize_fails_—_recovered_entry_rolls_back --- PASS: TestCreateAfterAmbiguousRoute (0.13s) --- PASS: TestCreateAfterAmbiguousRoute/stored_entry_is_this_PUT's_—_route_landed (0.01s) --- PASS: TestCreateAfterAmbiguousRoute/stored_entry_is_a_newer_write_—_refuse_stale_re-commit (0.01s) --- PASS: TestCreateAfterAmbiguousRoute/stored_entry_is_a_directory,_chunks_alive_—_lock_path_answers (0.01s) --- PASS: TestCreateAfterAmbiguousRoute/stored_entry_is_a_directory,_chunks_unverifiable_—_refuse (0.01s) --- PASS: TestCreateAfterAmbiguousRoute/match_behind_an_unanswered_filer_—_refuse (0.03s) --- PASS: TestCreateAfterAmbiguousRoute/entry_proven_absent,_chunks_alive_—_conditional_create_proceeds (0.01s) --- PASS: TestCreateAfterAmbiguousRoute/entry_absent_but_chunks_unverifiable_—_refuse (0.01s) --- PASS: TestCreateAfterAmbiguousRoute/lookup_cannot_resolve_state_—_refuse (0.01s) --- PASS: TestCreateAfterAmbiguousRoute/finalize_fails_—_recovered_entry_rolls_back (0.02s) === RUN TestUpdateLatestVersionInDirectoryBornNoncurrent --- PASS: TestUpdateLatestVersionInDirectoryBornNoncurrent (0.02s) === RUN TestAnonymousObjectACLCacheMetadata === RUN TestAnonymousObjectACLCacheMetadata/uncached_ACL_revoked E1117 09:42:09.414805 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/uncached_policy_tag_changed E1117 09:42:09.549194 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/uncached_policy_tag_removed E1117 09:42:09.610722 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/uncached_delete_marker E1117 09:42:09.644291 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/cached_ACL_revoked E1117 09:42:09.677067 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/cached_policy_tag_changed E1117 09:42:09.704652 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/versioned_cached_denial_clears_metadata E1117 09:42:09.738217 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/versioned_uncached_denial_clears_metadata E1117 09:42:09.768615 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/part_denial_clears_metadata E1117 09:42:09.803075 s3api_object_handlers.go:1150 GetObjectHandler: failed to stream b/o from volume servers: cached entry authorization failed: 1 === RUN TestAnonymousObjectACLCacheMetadata/uncached_public_origin_read === RUN TestAnonymousObjectACLCacheMetadata/uncached_public_origin_range === RUN TestAnonymousObjectACLCacheMetadata/uncached_public_origin_part --- PASS: TestAnonymousObjectACLCacheMetadata (0.57s) --- PASS: TestAnonymousObjectACLCacheMetadata/uncached_ACL_revoked (0.07s) --- PASS: TestAnonymousObjectACLCacheMetadata/uncached_policy_tag_changed (0.15s) --- PASS: TestAnonymousObjectACLCacheMetadata/uncached_policy_tag_removed (0.04s) --- PASS: TestAnonymousObjectACLCacheMetadata/uncached_delete_marker (0.03s) --- PASS: TestAnonymousObjectACLCacheMetadata/cached_ACL_revoked (0.03s) --- PASS: TestAnonymousObjectACLCacheMetadata/cached_policy_tag_changed (0.03s) --- PASS: TestAnonymousObjectACLCacheMetadata/versioned_cached_denial_clears_metadata (0.03s) --- PASS: TestAnonymousObjectACLCacheMetadata/versioned_uncached_denial_clears_metadata (0.03s) --- PASS: TestAnonymousObjectACLCacheMetadata/part_denial_clears_metadata (0.03s) --- PASS: TestAnonymousObjectACLCacheMetadata/uncached_public_origin_read (0.03s) --- PASS: TestAnonymousObjectACLCacheMetadata/uncached_public_origin_range (0.04s) --- PASS: TestAnonymousObjectACLCacheMetadata/uncached_public_origin_part (0.03s) === RUN TestAnonymousObjectACLVersionedEmptyDirectoryMarker === RUN TestAnonymousObjectACLVersionedEmptyDirectoryMarker/Enabled/GET === RUN TestAnonymousObjectACLVersionedEmptyDirectoryMarker/Enabled/HEAD === RUN TestAnonymousObjectACLVersionedEmptyDirectoryMarker/Suspended/GET === RUN TestAnonymousObjectACLVersionedEmptyDirectoryMarker/Suspended/HEAD --- PASS: TestAnonymousObjectACLVersionedEmptyDirectoryMarker (0.18s) --- PASS: TestAnonymousObjectACLVersionedEmptyDirectoryMarker/Enabled/GET (0.05s) --- PASS: TestAnonymousObjectACLVersionedEmptyDirectoryMarker/Enabled/HEAD (0.04s) --- PASS: TestAnonymousObjectACLVersionedEmptyDirectoryMarker/Suspended/GET (0.05s) --- PASS: TestAnonymousObjectACLVersionedEmptyDirectoryMarker/Suspended/HEAD (0.04s) === RUN TestAnonymousObjectACLVersionedDirectoryIdentity === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/null E1117 09:42:10.212723 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.222261 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.233761 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.244842 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:10.254329 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/conditional_null E1117 09:42:10.435196 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.448314 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.458892 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.476911 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:10.487992 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/empty_history W1117 09:42:10.543363 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:10.549759 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:10.550533 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/null E1117 09:42:10.735935 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.745787 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.755267 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.764949 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:10.774535 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/conditional_null E1117 09:42:10.922112 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.933537 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.944631 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:10.956221 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:10.967158 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/empty_history W1117 09:42:11.017313 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:11.022044 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:11.022416 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/null E1117 09:42:11.202792 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.212291 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.221015 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.230678 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:11.240274 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/conditional_null E1117 09:42:11.447206 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.461681 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.476158 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.488276 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:11.501697 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/empty_history W1117 09:42:11.578592 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:11.583470 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:11.583897 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/null E1117 09:42:11.800708 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.815176 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.825928 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:11.834722 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:11.852032 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/conditional_null E1117 09:42:12.109274 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.130136 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.142936 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.154303 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:12.170518 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/empty_history W1117 09:42:12.247544 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:12.252486 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:12.252871 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/null E1117 09:42:12.468300 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.478192 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.489647 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.500917 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:12.510630 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/conditional_null E1117 09:42:12.720517 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.734593 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.748987 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:12.759815 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:12.773886 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/empty_history W1117 09:42:12.846352 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:12.851677 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:12.852058 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/null E1117 09:42:13.051388 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.067365 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.077221 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.085741 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:13.094669 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/conditional_null E1117 09:42:13.278575 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.290401 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.308591 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.321756 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:13.333136 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/empty_history W1117 09:42:13.386514 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:13.391828 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:13.392329 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/null E1117 09:42:13.586533 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.595822 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.610463 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.624134 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:13.633212 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/conditional_null E1117 09:42:13.820087 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.834207 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.846943 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:13.858564 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:13.870890 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/empty_history W1117 09:42:13.925247 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:13.930392 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:13.930802 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/null E1117 09:42:14.133264 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.143244 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.151851 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.161964 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:14.172805 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/conditional_null E1117 09:42:14.371004 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.385926 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.398035 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.410729 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:14.422500 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/empty_history W1117 09:42:14.488342 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:14.492771 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:14.493157 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/null E1117 09:42:14.775916 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.785211 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.795508 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:14.807605 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:14.816323 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/conditional_null E1117 09:42:15.026750 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.039118 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.053677 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.065944 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:15.076994 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/empty_history W1117 09:42:15.149975 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:15.154255 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:15.154572 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/null E1117 09:42:15.371689 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.382252 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.393081 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.402278 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:15.411216 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/conditional_null E1117 09:42:15.619102 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.632453 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.649000 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.660169 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:15.673285 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/empty_history W1117 09:42:15.738352 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:15.742648 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:15.742983 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/null E1117 09:42:15.932278 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.943991 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.952869 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:15.961893 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:15.971145 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/conditional_null E1117 09:42:16.138435 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.150955 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.163003 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.173562 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:16.188901 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/empty_history W1117 09:42:16.237404 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:16.247620 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:16.248025 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/null E1117 09:42:16.411147 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.420166 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.433868 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.442699 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:16.450790 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/conditional_null E1117 09:42:16.609003 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.622060 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.632978 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.643551 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:16.656784 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/empty_history W1117 09:42:16.705783 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:16.710536 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:16.711099 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/null E1117 09:42:16.898702 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.907690 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.916211 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:16.924214 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:16.932195 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/conditional_null E1117 09:42:17.121710 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.133066 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.143671 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.153458 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:17.162959 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/empty_history W1117 09:42:17.217182 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:17.222026 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:17.222338 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/null E1117 09:42:17.443320 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.452613 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.462044 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.470701 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:17.479033 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/conditional_null E1117 09:42:17.651693 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.662870 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.673827 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.683964 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:17.694105 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/empty_history W1117 09:42:17.749363 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:17.753183 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:17.753512 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/null E1117 09:42:17.932857 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.943293 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.952232 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:17.960469 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:17.968502 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/conditional_null E1117 09:42:18.142260 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.153271 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.164270 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.174545 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:18.184313 s3api_object_handlers.go:959 Failed to get specific version null: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/empty_history W1117 09:42:18.247877 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:18.252554 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:18.252930 s3api_object_handlers.go:986 GetObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/null E1117 09:42:18.435127 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.445646 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.455853 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.464968 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:18.473798 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/conditional_null E1117 09:42:18.628760 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.646991 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.658045 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.672475 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:18.684529 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/empty_history W1117 09:42:18.735163 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:18.739455 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:18.739999 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/null E1117 09:42:18.910868 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.924732 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.933951 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:18.944058 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:18.954231 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/conditional_null E1117 09:42:19.122390 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.133531 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.148317 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.159396 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:19.173740 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/empty_history W1117 09:42:19.226119 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:19.230219 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:19.230535 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/null E1117 09:42:19.416738 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.425589 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.434223 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.442453 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:19.450533 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/conditional_null E1117 09:42:19.648291 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.664217 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.678703 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:19.691524 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:19.708288 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/empty_history W1117 09:42:19.778181 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:19.782647 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:19.783008 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/null E1117 09:42:20.057043 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.077768 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.086730 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.096325 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:20.106300 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/conditional_null E1117 09:42:20.302284 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.316375 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.331908 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.344658 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:20.357328 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/empty_history W1117 09:42:20.427530 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:20.432393 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:20.432759 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/null E1117 09:42:20.643683 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.655444 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.665180 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.673875 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:20.683511 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/conditional_latest === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/conditional_null E1117 09:42:20.879185 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.891191 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.904678 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/: null version object folder/ not found: filer: no entry is found in filer store E1117 09:42:20.915938 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store E1117 09:42:20.928727 s3api_object_handlers.go:2649 Failed to get specific version null for b/folder/x: null version object folder/x not found: filer: no entry is found in filer store === RUN TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/empty_history W1117 09:42:20.994708 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:42:21.002913 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=empty_dir_removed E1117 09:42:21.004146 s3api_object_handlers.go:2676 HeadObject: Failed to get latest version for b/folder/: no version metadata in .versions directory and no regular object found for b/folder/: filer: no entry is found in filer store --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity (10.99s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/latest (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/conditional_latest (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/conditional_null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/implicit_parent/empty_history (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/latest (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/null (0.08s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/conditional_latest (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/conditional_null (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/deleted_marker/empty_history (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/latest (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/conditional_latest (0.14s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/conditional_null (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/regular_file/empty_history (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/null (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/conditional_latest (0.19s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/conditional_null (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/prefix_object/empty_history (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/null (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/conditional_latest (0.14s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/conditional_null (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/GET/empty_prefix_object/empty_history (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/latest (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/null (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/conditional_latest (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/conditional_null (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/implicit_parent/empty_history (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/latest (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/null (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/conditional_latest (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/conditional_null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/deleted_marker/empty_history (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/null (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/conditional_latest (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/conditional_null (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/regular_file/empty_history (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/latest (0.17s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/null (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/conditional_latest (0.14s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/conditional_null (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/prefix_object/empty_history (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/null (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/conditional_latest (0.14s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/conditional_null (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Enabled/HEAD/empty_prefix_object/empty_history (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/latest (0.08s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/null (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/conditional_latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/conditional_null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/implicit_parent/empty_history (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/latest (0.08s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/null (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/conditional_latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/conditional_null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/deleted_marker/empty_history (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/latest (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/conditional_latest (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/conditional_null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/regular_file/empty_history (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/latest (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/null (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/conditional_latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/conditional_null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/prefix_object/empty_history (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/latest (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/null (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/conditional_latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/conditional_null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/GET/empty_prefix_object/empty_history (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/latest (0.08s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/null (0.08s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/conditional_latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/conditional_null (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/implicit_parent/empty_history (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/latest (0.08s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/null (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/conditional_latest (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/conditional_null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/deleted_marker/empty_history (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/latest (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/null (0.09s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/conditional_latest (0.14s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/conditional_null (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/regular_file/empty_history (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/latest (0.17s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/null (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/conditional_latest (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/conditional_null (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/prefix_object/empty_history (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/latest (0.11s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/null (0.10s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/conditional_latest (0.13s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/conditional_null (0.12s) --- PASS: TestAnonymousObjectACLVersionedDirectoryIdentity/Suspended/HEAD/empty_prefix_object/empty_history (0.12s) === RUN TestAnonymousObjectACLBackslashKeyIdentity === RUN TestAnonymousObjectACLBackslashKeyIdentity/allowBackslashInKey=false === RUN TestAnonymousObjectACLBackslashKeyIdentity/allowBackslashInKey=true --- PASS: TestAnonymousObjectACLBackslashKeyIdentity (0.06s) --- PASS: TestAnonymousObjectACLBackslashKeyIdentity/allowBackslashInKey=false (0.03s) --- PASS: TestAnonymousObjectACLBackslashKeyIdentity/allowBackslashInKey=true (0.03s) === RUN TestAnonymousObjectACLRead === RUN TestAnonymousObjectACLRead/public_read/GET === RUN TestAnonymousObjectACLRead/public_read/HEAD === RUN TestAnonymousObjectACLRead/public_full_control/GET === RUN TestAnonymousObjectACLRead/public_full_control/HEAD === RUN TestAnonymousObjectACLRead/write_is_not_read/GET === RUN TestAnonymousObjectACLRead/write_is_not_read/HEAD === RUN TestAnonymousObjectACLRead/private/GET === RUN TestAnonymousObjectACLRead/private/HEAD === RUN TestAnonymousObjectACLRead/missing_ACL_private_bucket/GET === RUN TestAnonymousObjectACLRead/missing_ACL_private_bucket/HEAD === RUN TestAnonymousObjectACLRead/legacy_public_bucket/GET === RUN TestAnonymousObjectACLRead/legacy_public_bucket/HEAD === RUN TestAnonymousObjectACLRead/explicit_private_public_bucket/GET === RUN TestAnonymousObjectACLRead/explicit_private_public_bucket/HEAD === RUN TestAnonymousObjectACLRead/malformed_public_bucket/GET === RUN TestAnonymousObjectACLRead/malformed_public_bucket/HEAD === RUN TestAnonymousObjectACLRead/null_grant/GET === RUN TestAnonymousObjectACLRead/null_grant/HEAD === RUN TestAnonymousObjectACLRead/wrong_grantee_type/GET === RUN TestAnonymousObjectACLRead/wrong_grantee_type/HEAD === RUN TestAnonymousObjectACLRead/authenticated_users_are_not_anonymous/GET === RUN TestAnonymousObjectACLRead/authenticated_users_are_not_anonymous/HEAD === RUN TestAnonymousObjectACLRead/ACL_disabled/GET === RUN TestAnonymousObjectACLRead/ACL_disabled/HEAD --- PASS: TestAnonymousObjectACLRead (0.41s) --- PASS: TestAnonymousObjectACLRead/public_read/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/public_read/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/public_full_control/GET (0.01s) --- PASS: TestAnonymousObjectACLRead/public_full_control/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/write_is_not_read/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/write_is_not_read/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/private/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/private/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/missing_ACL_private_bucket/GET (0.01s) --- PASS: TestAnonymousObjectACLRead/missing_ACL_private_bucket/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/legacy_public_bucket/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/legacy_public_bucket/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/explicit_private_public_bucket/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/explicit_private_public_bucket/HEAD (0.01s) --- PASS: TestAnonymousObjectACLRead/malformed_public_bucket/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/malformed_public_bucket/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/null_grant/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/null_grant/HEAD (0.01s) --- PASS: TestAnonymousObjectACLRead/wrong_grantee_type/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/wrong_grantee_type/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/authenticated_users_are_not_anonymous/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/authenticated_users_are_not_anonymous/HEAD (0.02s) --- PASS: TestAnonymousObjectACLRead/ACL_disabled/GET (0.02s) --- PASS: TestAnonymousObjectACLRead/ACL_disabled/HEAD (0.01s) === RUN TestAnonymousObjectACLRangeConditionalAndRevocation --- PASS: TestAnonymousObjectACLRangeConditionalAndRevocation (0.07s) === RUN TestAnonymousObjectACLPolicy === RUN TestAnonymousObjectACLPolicy/explicit_deny === RUN TestAnonymousObjectACLPolicy/unrelated_deny === RUN TestAnonymousObjectACLPolicy/tag_deny_matching === RUN TestAnonymousObjectACLPolicy/tag_deny_nonmatching === RUN TestAnonymousObjectACLPolicy/tag_allow_private_ACL === RUN TestAnonymousObjectACLPolicy/tag_allow_nonmatching --- PASS: TestAnonymousObjectACLPolicy (0.15s) --- PASS: TestAnonymousObjectACLPolicy/explicit_deny (0.02s) --- PASS: TestAnonymousObjectACLPolicy/unrelated_deny (0.03s) --- PASS: TestAnonymousObjectACLPolicy/tag_deny_matching (0.03s) --- PASS: TestAnonymousObjectACLPolicy/tag_deny_nonmatching (0.02s) --- PASS: TestAnonymousObjectACLPolicy/tag_allow_private_ACL (0.03s) --- PASS: TestAnonymousObjectACLPolicy/tag_allow_nonmatching (0.02s) === RUN TestAnonymousObjectACLVersionAndDirectory --- PASS: TestAnonymousObjectACLVersionAndDirectory (0.09s) === RUN TestSignedReadOfVersionFileKey --- PASS: TestSignedReadOfVersionFileKey (0.12s) === RUN TestWriteToVersionFileKey --- PASS: TestWriteToVersionFileKey (0.04s) === RUN TestWriteToVersionFileKeyReadsLogicalOwner E1117 09:42:22.104890 s3api_server.go:780 t: version file lookup for b/o0.versions/v_v2 failed: LookupEntry1: rpc error: code = Unavailable desc = owner down --- PASS: TestWriteToVersionFileKeyReadsLogicalOwner (0.05s) === RUN TestAnonymousObjectACLDoesNotReplaceAuthentication W1117 09:42:22.113763 auth_signature_v2.go:161 InvalidAccessKeyId (V2 signed): attempted key 'invalid' not found. Available keys: 0, Auth enabled: true --- PASS: TestAnonymousObjectACLDoesNotReplaceAuthentication (0.03s) === RUN TestAnonymousObjectACLMetadataFailure W1117 09:42:22.164921 s3api_object_handlers.go:1071 GetObjectHandler: failed to get entry for b/o: all filers failed, last error: LookupEntry1: rpc error: code = Internal desc = metadata unavailable --- PASS: TestAnonymousObjectACLMetadataFailure (0.04s) === RUN TestAnonymousObjectACLLegacyOwnership --- PASS: TestAnonymousObjectACLLegacyOwnership (0.07s) === RUN TestAnonymousObjectACLIgnorePublicAcls === RUN TestAnonymousObjectACLIgnorePublicAcls/public_object/GET === RUN TestAnonymousObjectACLIgnorePublicAcls/public_object/HEAD === RUN TestAnonymousObjectACLIgnorePublicAcls/public_object_ignored/GET === RUN TestAnonymousObjectACLIgnorePublicAcls/public_object_ignored/HEAD === RUN TestAnonymousObjectACLIgnorePublicAcls/public_bucket/GET === RUN TestAnonymousObjectACLIgnorePublicAcls/public_bucket/HEAD === RUN TestAnonymousObjectACLIgnorePublicAcls/public_bucket_ignored/GET === RUN TestAnonymousObjectACLIgnorePublicAcls/public_bucket_ignored/HEAD --- PASS: TestAnonymousObjectACLIgnorePublicAcls (0.13s) --- PASS: TestAnonymousObjectACLIgnorePublicAcls/public_object/GET (0.02s) --- PASS: TestAnonymousObjectACLIgnorePublicAcls/public_object/HEAD (0.01s) --- PASS: TestAnonymousObjectACLIgnorePublicAcls/public_object_ignored/GET (0.02s) --- PASS: TestAnonymousObjectACLIgnorePublicAcls/public_object_ignored/HEAD (0.02s) --- PASS: TestAnonymousObjectACLIgnorePublicAcls/public_bucket/GET (0.01s) --- PASS: TestAnonymousObjectACLIgnorePublicAcls/public_bucket/HEAD (0.01s) --- PASS: TestAnonymousObjectACLIgnorePublicAcls/public_bucket_ignored/GET (0.02s) --- PASS: TestAnonymousObjectACLIgnorePublicAcls/public_bucket_ignored/HEAD (0.01s) === RUN TestAnonymousObjectACLConfiguredIdentity === RUN TestAnonymousObjectACLConfiguredIdentity/legacy_anonymous_permission === RUN TestAnonymousObjectACLConfiguredIdentity/identity_policy_allow === RUN TestAnonymousObjectACLConfiguredIdentity/identity_deny_beats_object_ACL === RUN TestAnonymousObjectACLConfiguredIdentity/disabled_identity_cannot_grant === RUN TestAnonymousObjectACLConfiguredIdentity/public_ACL_does_not_require_identity --- PASS: TestAnonymousObjectACLConfiguredIdentity (0.10s) --- PASS: TestAnonymousObjectACLConfiguredIdentity/legacy_anonymous_permission (0.02s) --- PASS: TestAnonymousObjectACLConfiguredIdentity/identity_policy_allow (0.02s) --- PASS: TestAnonymousObjectACLConfiguredIdentity/identity_deny_beats_object_ACL (0.02s) --- PASS: TestAnonymousObjectACLConfiguredIdentity/disabled_identity_cannot_grant (0.02s) --- PASS: TestAnonymousObjectACLConfiguredIdentity/public_ACL_does_not_require_identity (0.01s) === RUN TestAnonymousObjectACLRemoteCacheReauthorization === RUN TestAnonymousObjectACLRemoteCacheReauthorization/ACL_revoked === RUN TestAnonymousObjectACLRemoteCacheReauthorization/policy_tag_changed --- PASS: TestAnonymousObjectACLRemoteCacheReauthorization (0.04s) --- PASS: TestAnonymousObjectACLRemoteCacheReauthorization/ACL_revoked (0.02s) --- PASS: TestAnonymousObjectACLRemoteCacheReauthorization/policy_tag_changed (0.02s) === RUN TestWriteDeleteMarkerResponse --- PASS: TestWriteDeleteMarkerResponse (0.00s) === RUN TestWriteDeleteMarkerResponseAnonymous --- PASS: TestWriteDeleteMarkerResponseAnonymous (0.01s) === RUN TestWriteConditionalCheckErrorDeleteMarker --- PASS: TestWriteConditionalCheckErrorDeleteMarker (0.00s) === RUN TestWriteConditionalCheckErrorDeleteMarkerVersionFromName --- PASS: TestWriteConditionalCheckErrorDeleteMarkerVersionFromName (0.00s) === RUN TestGetHeadDeleteMarker === RUN TestGetHeadDeleteMarker/current_marker/GET === RUN TestGetHeadDeleteMarker/current_marker/HEAD === RUN TestGetHeadDeleteMarker/marker_by_versionId/GET === RUN TestGetHeadDeleteMarker/marker_by_versionId/HEAD --- PASS: TestGetHeadDeleteMarker (0.08s) --- PASS: TestGetHeadDeleteMarker/current_marker/GET (0.02s) --- PASS: TestGetHeadDeleteMarker/current_marker/HEAD (0.02s) --- PASS: TestGetHeadDeleteMarker/marker_by_versionId/GET (0.01s) --- PASS: TestGetHeadDeleteMarker/marker_by_versionId/HEAD (0.02s) === RUN TestGetHeadNullDeleteMarker === RUN TestGetHeadNullDeleteMarker/GET === RUN TestGetHeadNullDeleteMarker/HEAD --- PASS: TestGetHeadNullDeleteMarker (0.09s) --- PASS: TestGetHeadNullDeleteMarker/GET (0.04s) --- PASS: TestGetHeadNullDeleteMarker/HEAD (0.05s) === RUN TestGetHeadNullVersionAbsent E1117 09:42:22.732043 s3api_object_handlers.go:959 Failed to get specific version null: null version object o not found: filer: no entry is found in filer store --- PASS: TestGetHeadNullVersionAbsent (0.02s) === RUN TestGetHeadDeleteMarkerConditionalMiss === RUN TestGetHeadDeleteMarkerConditionalMiss/GET === RUN TestGetHeadDeleteMarkerConditionalMiss/HEAD --- PASS: TestGetHeadDeleteMarkerConditionalMiss (0.04s) --- PASS: TestGetHeadDeleteMarkerConditionalMiss/GET (0.02s) --- PASS: TestGetHeadDeleteMarkerConditionalMiss/HEAD (0.02s) === RUN TestObjectMetadataUpdateDirectory === RUN TestObjectMetadataUpdateDirectory/non-versioned_nested_key === RUN TestObjectMetadataUpdateDirectory/non-versioned_root_key === RUN TestObjectMetadataUpdateDirectory/non-versioned_deep_key === RUN TestObjectMetadataUpdateDirectory/null_version_nested_key === RUN TestObjectMetadataUpdateDirectory/explicit_null_version_nested_key === RUN TestObjectMetadataUpdateDirectory/empty_version_nested_key === RUN TestObjectMetadataUpdateDirectory/specific_version_nested_key === RUN TestObjectMetadataUpdateDirectory/latest_versioned_nested_key --- PASS: TestObjectMetadataUpdateDirectory (0.01s) --- PASS: TestObjectMetadataUpdateDirectory/non-versioned_nested_key (0.00s) --- PASS: TestObjectMetadataUpdateDirectory/non-versioned_root_key (0.00s) --- PASS: TestObjectMetadataUpdateDirectory/non-versioned_deep_key (0.00s) --- PASS: TestObjectMetadataUpdateDirectory/null_version_nested_key (0.00s) --- PASS: TestObjectMetadataUpdateDirectory/explicit_null_version_nested_key (0.00s) --- PASS: TestObjectMetadataUpdateDirectory/empty_version_nested_key (0.00s) --- PASS: TestObjectMetadataUpdateDirectory/specific_version_nested_key (0.00s) --- PASS: TestObjectMetadataUpdateDirectory/latest_versioned_nested_key (0.00s) === RUN TestObjectAttributesChecksum === RUN TestObjectAttributesChecksum/PutObject_with_SHA256 === RUN TestObjectAttributesChecksum/multipart_upload_with_a_composite_CRC32C === RUN TestObjectAttributesChecksum/multipart_upload_with_a_full_object_CRC64NVME === RUN TestObjectAttributesChecksum/no_checksum === RUN TestObjectAttributesChecksum/unknown_algorithm --- PASS: TestObjectAttributesChecksum (0.01s) --- PASS: TestObjectAttributesChecksum/PutObject_with_SHA256 (0.00s) --- PASS: TestObjectAttributesChecksum/multipart_upload_with_a_composite_CRC32C (0.00s) --- PASS: TestObjectAttributesChecksum/multipart_upload_with_a_full_object_CRC64NVME (0.00s) --- PASS: TestObjectAttributesChecksum/no_checksum (0.00s) --- PASS: TestObjectAttributesChecksum/unknown_algorithm (0.00s) === RUN TestGetObjectAttributesChecksumXML --- PASS: TestGetObjectAttributesChecksumXML (0.00s) === RUN TestValidateConditionalHeadersForReadsMissingObject === RUN TestValidateConditionalHeadersForReadsMissingObject/if-match_on_missing_object === RUN TestValidateConditionalHeadersForReadsMissingObject/if-match_star_on_missing_object === RUN TestValidateConditionalHeadersForReadsMissingObject/if-unmodified-since_on_missing_object === RUN TestValidateConditionalHeadersForReadsMissingObject/if-match_on_delete_marker === RUN TestValidateConditionalHeadersForReadsMissingObject/if-none-match_on_missing_object === RUN TestValidateConditionalHeadersForReadsMissingObject/if-modified-since_on_missing_object === RUN TestValidateConditionalHeadersForReadsMissingObject/if-match_mismatch_on_existing_object === RUN TestValidateConditionalHeadersForReadsMissingObject/if-match_hit_on_existing_object --- PASS: TestValidateConditionalHeadersForReadsMissingObject (0.01s) --- PASS: TestValidateConditionalHeadersForReadsMissingObject/if-match_on_missing_object (0.00s) --- PASS: TestValidateConditionalHeadersForReadsMissingObject/if-match_star_on_missing_object (0.00s) --- PASS: TestValidateConditionalHeadersForReadsMissingObject/if-unmodified-since_on_missing_object (0.00s) --- PASS: TestValidateConditionalHeadersForReadsMissingObject/if-match_on_delete_marker (0.00s) --- PASS: TestValidateConditionalHeadersForReadsMissingObject/if-none-match_on_missing_object (0.00s) --- PASS: TestValidateConditionalHeadersForReadsMissingObject/if-modified-since_on_missing_object (0.00s) --- PASS: TestValidateConditionalHeadersForReadsMissingObject/if-match_mismatch_on_existing_object (0.00s) --- PASS: TestValidateConditionalHeadersForReadsMissingObject/if-match_hit_on_existing_object (0.00s) === RUN TestRemoteObjectETagAcrossCacheFill --- PASS: TestRemoteObjectETagAcrossCacheFill (0.00s) === RUN TestRemoteObjectETagMetadataOnlyTouch --- PASS: TestRemoteObjectETagMetadataOnlyTouch (0.00s) === RUN TestRemoteObjectETagLocalResize --- PASS: TestRemoteObjectETagLocalResize (0.00s) === RUN TestRemoteObjectETagCopyConditions --- PASS: TestRemoteObjectETagCopyConditions (0.00s) === RUN TestRemoteObjectETagLocalChanges --- PASS: TestRemoteObjectETagLocalChanges (0.00s) === RUN TestRemoteObjectETagFallback --- PASS: TestRemoteObjectETagFallback (0.00s) === RUN TestSetResponseHeadersIgnoresOverridesForAnonymous --- PASS: TestSetResponseHeadersIgnoresOverridesForAnonymous (0.00s) === RUN TestValidateConditionalHeadersMissingObject === RUN TestValidateConditionalHeadersMissingObject/if-match_on_missing_object === RUN TestValidateConditionalHeadersMissingObject/if-match_star_on_missing_object === RUN TestValidateConditionalHeadersMissingObject/if-match_on_delete_marker === RUN TestValidateConditionalHeadersMissingObject/if-match_mismatch_on_existing_object === RUN TestValidateConditionalHeadersMissingObject/if-match_hit_on_existing_object === RUN TestValidateConditionalHeadersMissingObject/if-none-match_star_on_missing_object === RUN TestValidateConditionalHeadersMissingObject/if-none-match_star_on_delete_marker === RUN TestValidateConditionalHeadersMissingObject/if-none-match_star_on_existing_object --- PASS: TestValidateConditionalHeadersMissingObject (0.01s) --- PASS: TestValidateConditionalHeadersMissingObject/if-match_on_missing_object (0.00s) --- PASS: TestValidateConditionalHeadersMissingObject/if-match_star_on_missing_object (0.00s) --- PASS: TestValidateConditionalHeadersMissingObject/if-match_on_delete_marker (0.00s) --- PASS: TestValidateConditionalHeadersMissingObject/if-match_mismatch_on_existing_object (0.00s) --- PASS: TestValidateConditionalHeadersMissingObject/if-match_hit_on_existing_object (0.00s) --- PASS: TestValidateConditionalHeadersMissingObject/if-none-match_star_on_missing_object (0.00s) --- PASS: TestValidateConditionalHeadersMissingObject/if-none-match_star_on_delete_marker (0.00s) --- PASS: TestValidateConditionalHeadersMissingObject/if-none-match_star_on_existing_object (0.00s) === RUN TestRoutedSelfCopyBusinessErrors === RUN TestRoutedSelfCopyBusinessErrors/FailedPrecondition === RUN TestRoutedSelfCopyBusinessErrors/NotFound --- PASS: TestRoutedSelfCopyBusinessErrors (0.03s) --- PASS: TestRoutedSelfCopyBusinessErrors/FailedPrecondition (0.01s) --- PASS: TestRoutedSelfCopyBusinessErrors/NotFound (0.01s) === RUN TestCopyObjectDestinationACL === RUN TestCopyObjectDestinationACL/default_private I1117 09:42:22.852054 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/replace_metadata_also_defaults_private I1117 09:42:22.909590 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/explicit_private I1117 09:42:22.945574 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/explicit_public_read I1117 09:42:22.988607 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/signed_query_public_read I1117 09:42:23.024330 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/custom_read I1117 09:42:23.069400 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/custom_full_control I1117 09:42:23.105594 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/custom_read_acp I1117 09:42:23.140975 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/custom_write_acp I1117 09:42:23.174635 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/self_copy_bootstrap I1117 09:42:23.216528 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/self_copy_routed_private I1117 09:42:23.253233 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/self_copy_routed_explicit_public I1117 09:42:23.290232 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/self_copy_routed_custom I1117 09:42:23.327385 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/self_copy_changes_file_mode I1117 09:42:23.366613 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/self_copy_changes_mime I1117 09:42:23.404169 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/versioned_destination I1117 09:42:23.438418 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/versioned_public_destination I1117 09:42:23.480305 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/suspended_destination I1117 09:42:23.523790 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/specific_source_version I1117 09:42:23.563657 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/versioned_self_copy I1117 09:42:23.593311 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/preferred_bucket_owner I1117 09:42:23.638643 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/enforced_bucket_owner I1117 09:42:23.674595 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/enforced_accepts_full_control I1117 09:42:23.707916 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/enforced_rejects_public I1117 09:42:23.736096 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/default_needs_no_write_acp I1117 09:42:23.758473 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/public_requires_write_acp I1117 09:42:23.781491 config_loader.go:73 Using explicit credential store: memory I1117 09:42:23.797047 s3api_object_upload_acl.go:164 denied PUT "copy-acl/destination" for "copy-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestCopyObjectDestinationACL/custom_requires_write_acp I1117 09:42:23.801767 config_loader.go:73 Using explicit credential store: memory I1117 09:42:23.817528 s3api_object_upload_acl.go:164 denied PUT "copy-acl/destination" for "copy-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestCopyObjectDestinationACL/requires_source_read I1117 09:42:23.821340 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/requires_destination_write I1117 09:42:23.838098 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/query_put_deny I1117 09:42:23.846214 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/query_acl_deny I1117 09:42:23.860027 config_loader.go:73 Using explicit credential store: memory I1117 09:42:23.890278 s3api_object_upload_acl.go:164 denied PUT "copy-acl/destination" for "copy-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestCopyObjectDestinationACL/query_custom_put_deny I1117 09:42:23.894446 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/query_custom_acl_deny I1117 09:42:23.910039 config_loader.go:73 Using explicit credential store: memory I1117 09:42:23.938274 s3api_object_upload_acl.go:164 denied PUT "copy-acl/destination" for "copy-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestCopyObjectDestinationACL/invalid_canned I1117 09:42:23.942233 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/conflicting_canned_and_grants I1117 09:42:23.961832 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/duplicate_signed_query I1117 09:42:23.981982 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/v2_unsigned_query_ignored I1117 09:42:23.990462 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/private_mode_changes_after_first_read I1117 09:42:24.020522 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/public_mode_changes_after_first_read I1117 09:42:24.050190 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/private_mode_changes_before_commit I1117 09:42:24.082494 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/public_mode_changes_before_commit I1117 09:42:24.118696 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/mime_changes_before_commit I1117 09:42:24.157106 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/content_changes_before_commit I1117 09:42:24.195396 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/source_condition_rechecked_on_retry I1117 09:42:24.245128 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/destination_condition_rechecked_on_retry I1117 09:42:24.273706 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/deleted_before_commit I1117 09:42:24.308340 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/bounded_self_copy_conflicts I1117 09:42:24.342860 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/prefix_private_control I1117 09:42:24.390323 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/prefix_mode_changes_before_commit I1117 09:42:24.426828 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/self_copy_reads_owner_ahead_of_replica I1117 09:42:24.475327 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/block_public_acls_private I1117 09:42:24.527992 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/block_public_acls_rejects_public I1117 09:42:24.562443 config_loader.go:73 Using explicit credential store: memory === RUN TestCopyObjectDestinationACL/block_public_acls_rejects_public_self_copy I1117 09:42:24.587315 config_loader.go:73 Using explicit credential store: memory --- PASS: TestCopyObjectDestinationACL (1.76s) --- PASS: TestCopyObjectDestinationACL/default_private (0.06s) --- PASS: TestCopyObjectDestinationACL/replace_metadata_also_defaults_private (0.04s) --- PASS: TestCopyObjectDestinationACL/explicit_private (0.04s) --- PASS: TestCopyObjectDestinationACL/explicit_public_read (0.04s) --- PASS: TestCopyObjectDestinationACL/signed_query_public_read (0.04s) --- PASS: TestCopyObjectDestinationACL/custom_read (0.04s) --- PASS: TestCopyObjectDestinationACL/custom_full_control (0.03s) --- PASS: TestCopyObjectDestinationACL/custom_read_acp (0.03s) --- PASS: TestCopyObjectDestinationACL/custom_write_acp (0.04s) --- PASS: TestCopyObjectDestinationACL/self_copy_bootstrap (0.03s) --- PASS: TestCopyObjectDestinationACL/self_copy_routed_private (0.04s) --- PASS: TestCopyObjectDestinationACL/self_copy_routed_explicit_public (0.04s) --- PASS: TestCopyObjectDestinationACL/self_copy_routed_custom (0.04s) --- PASS: TestCopyObjectDestinationACL/self_copy_changes_file_mode (0.04s) --- PASS: TestCopyObjectDestinationACL/self_copy_changes_mime (0.03s) --- PASS: TestCopyObjectDestinationACL/versioned_destination (0.04s) --- PASS: TestCopyObjectDestinationACL/versioned_public_destination (0.04s) --- PASS: TestCopyObjectDestinationACL/suspended_destination (0.04s) --- PASS: TestCopyObjectDestinationACL/specific_source_version (0.03s) --- PASS: TestCopyObjectDestinationACL/versioned_self_copy (0.04s) --- PASS: TestCopyObjectDestinationACL/preferred_bucket_owner (0.03s) --- PASS: TestCopyObjectDestinationACL/enforced_bucket_owner (0.03s) --- PASS: TestCopyObjectDestinationACL/enforced_accepts_full_control (0.03s) --- PASS: TestCopyObjectDestinationACL/enforced_rejects_public (0.02s) --- PASS: TestCopyObjectDestinationACL/default_needs_no_write_acp (0.02s) --- PASS: TestCopyObjectDestinationACL/public_requires_write_acp (0.02s) --- PASS: TestCopyObjectDestinationACL/custom_requires_write_acp (0.02s) --- PASS: TestCopyObjectDestinationACL/requires_source_read (0.02s) --- PASS: TestCopyObjectDestinationACL/requires_destination_write (0.01s) --- PASS: TestCopyObjectDestinationACL/query_put_deny (0.01s) --- PASS: TestCopyObjectDestinationACL/query_acl_deny (0.03s) --- PASS: TestCopyObjectDestinationACL/query_custom_put_deny (0.02s) --- PASS: TestCopyObjectDestinationACL/query_custom_acl_deny (0.03s) --- PASS: TestCopyObjectDestinationACL/invalid_canned (0.02s) --- PASS: TestCopyObjectDestinationACL/conflicting_canned_and_grants (0.02s) --- PASS: TestCopyObjectDestinationACL/duplicate_signed_query (0.01s) --- PASS: TestCopyObjectDestinationACL/v2_unsigned_query_ignored (0.03s) --- PASS: TestCopyObjectDestinationACL/private_mode_changes_after_first_read (0.03s) --- PASS: TestCopyObjectDestinationACL/public_mode_changes_after_first_read (0.03s) --- PASS: TestCopyObjectDestinationACL/private_mode_changes_before_commit (0.04s) --- PASS: TestCopyObjectDestinationACL/public_mode_changes_before_commit (0.04s) --- PASS: TestCopyObjectDestinationACL/mime_changes_before_commit (0.04s) --- PASS: TestCopyObjectDestinationACL/content_changes_before_commit (0.05s) --- PASS: TestCopyObjectDestinationACL/source_condition_rechecked_on_retry (0.03s) --- PASS: TestCopyObjectDestinationACL/destination_condition_rechecked_on_retry (0.03s) --- PASS: TestCopyObjectDestinationACL/deleted_before_commit (0.03s) --- PASS: TestCopyObjectDestinationACL/bounded_self_copy_conflicts (0.05s) --- PASS: TestCopyObjectDestinationACL/prefix_private_control (0.04s) --- PASS: TestCopyObjectDestinationACL/prefix_mode_changes_before_commit (0.05s) --- PASS: TestCopyObjectDestinationACL/self_copy_reads_owner_ahead_of_replica (0.05s) --- PASS: TestCopyObjectDestinationACL/block_public_acls_private (0.03s) --- PASS: TestCopyObjectDestinationACL/block_public_acls_rejects_public (0.02s) --- PASS: TestCopyObjectDestinationACL/block_public_acls_rejects_public_self_copy (0.02s) === RUN TestCopyObjectACLWithBucketDefaultEncryption I1117 09:42:24.615458 config_loader.go:73 Using explicit credential store: memory --- PASS: TestCopyObjectACLWithBucketDefaultEncryption (0.05s) === RUN TestDownloadChunkData_AllocationBound s3api_object_handlers_copy_alloc_test.go:105: allocated=17086104 bytes, bound=25165824, output=16777216 --- PASS: TestDownloadChunkData_AllocationBound (1.43s) === RUN TestApplyDestChecksumHeaderToCopyRequest --- PASS: TestApplyDestChecksumHeaderToCopyRequest (0.00s) === RUN TestUploadEntryHasChecksum --- PASS: TestUploadEntryHasChecksum (0.00s) === RUN TestBuildCopyPartResult === RUN TestBuildCopyPartResult/CRC32 === RUN TestBuildCopyPartResult/CRC32C === RUN TestBuildCopyPartResult/CRC64NVME === RUN TestBuildCopyPartResult/SHA1 === RUN TestBuildCopyPartResult/SHA256 === RUN TestBuildCopyPartResult/Unknown --- PASS: TestBuildCopyPartResult (0.01s) --- PASS: TestBuildCopyPartResult/CRC32 (0.00s) --- PASS: TestBuildCopyPartResult/CRC32C (0.00s) --- PASS: TestBuildCopyPartResult/CRC64NVME (0.00s) --- PASS: TestBuildCopyPartResult/SHA1 (0.00s) --- PASS: TestBuildCopyPartResult/SHA256 (0.00s) --- PASS: TestBuildCopyPartResult/Unknown (0.00s) === RUN TestNewChunkUploadOption_AvoidsBytePool === RUN TestNewChunkUploadOption_AvoidsBytePool/empty_chunk === RUN TestNewChunkUploadOption_AvoidsBytePool/small_chunk === RUN TestNewChunkUploadOption_AvoidsBytePool/typical_8_MiB_chunk === RUN TestNewChunkUploadOption_AvoidsBytePool/large_64_MiB_chunk --- PASS: TestNewChunkUploadOption_AvoidsBytePool (0.32s) --- PASS: TestNewChunkUploadOption_AvoidsBytePool/empty_chunk (0.00s) --- PASS: TestNewChunkUploadOption_AvoidsBytePool/small_chunk (0.00s) --- PASS: TestNewChunkUploadOption_AvoidsBytePool/typical_8_MiB_chunk (0.01s) --- PASS: TestNewChunkUploadOption_AvoidsBytePool/large_64_MiB_chunk (0.30s) === RUN TestNewChunkUploadOption_PerCallIsolation --- PASS: TestNewChunkUploadOption_PerCallIsolation (0.00s) === RUN TestCopyDestinationPathResolvesBucketCollection --- PASS: TestCopyDestinationPathResolvesBucketCollection (0.00s) === RUN TestMultipartStorageRuleFollowsDestinationObject --- PASS: TestMultipartStorageRuleFollowsDestinationObject (0.01s) === RUN TestCollectionForCopyPath --- PASS: TestCollectionForCopyPath (0.00s) === RUN TestApplyCopyBucketDefaultEncryptionHeaders === RUN TestApplyCopyBucketDefaultEncryptionHeaders/nil_config === RUN TestApplyCopyBucketDefaultEncryptionHeaders/kms_with_key_and_bucket_key === RUN TestApplyCopyBucketDefaultEncryptionHeaders/kms_without_key_resolves_the_aws/s3_default === RUN TestApplyCopyBucketDefaultEncryptionHeaders/aes256 --- PASS: TestApplyCopyBucketDefaultEncryptionHeaders (0.00s) --- PASS: TestApplyCopyBucketDefaultEncryptionHeaders/nil_config (0.00s) --- PASS: TestApplyCopyBucketDefaultEncryptionHeaders/kms_with_key_and_bucket_key (0.00s) --- PASS: TestApplyCopyBucketDefaultEncryptionHeaders/kms_without_key_resolves_the_aws/s3_default (0.00s) --- PASS: TestApplyCopyBucketDefaultEncryptionHeaders/aes256 (0.00s) === RUN TestCopyObjectHandlerRejectsMalformedEncryptionBeforeDefaults === RUN TestCopyObjectHandlerRejectsMalformedEncryptionBeforeDefaults/kms_key_id_without_algorithm === RUN TestCopyObjectHandlerRejectsMalformedEncryptionBeforeDefaults/repeated_algorithm_header --- PASS: TestCopyObjectHandlerRejectsMalformedEncryptionBeforeDefaults (0.03s) --- PASS: TestCopyObjectHandlerRejectsMalformedEncryptionBeforeDefaults/kms_key_id_without_algorithm (0.02s) --- PASS: TestCopyObjectHandlerRejectsMalformedEncryptionBeforeDefaults/repeated_algorithm_header (0.01s) === RUN TestCopyEntryETagPrefersStoredExtendedETag --- PASS: TestCopyEntryETagPrefersStoredExtendedETag (0.00s) === RUN TestCopyEntryETagFallsBackToFilerETag --- PASS: TestCopyEntryETagFallsBackToFilerETag (0.00s) === RUN TestValidateConditionalCopyHeadersUsesStoredExtendedETag --- PASS: TestValidateConditionalCopyHeadersUsesStoredExtendedETag (0.00s) === RUN TestQuoteETag --- PASS: TestQuoteETag (0.00s) === RUN TestBuildCopyPartResultQuotesETag --- PASS: TestBuildCopyPartResultQuotesETag (0.00s) === RUN TestCopyObjectResultXMLQuotesETag --- PASS: TestCopyObjectResultXMLQuotesETag (0.00s) === RUN TestParseRangeHeaderRejectsUnsatisfiableRange === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/whole_source === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/leading_slice === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/trailing_slice === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/single_byte === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/no_bytes_prefix === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/end_past_the_source === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/start_past_the_source === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/start_at_the_source_size === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/reversed === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/negative_start === RUN TestParseRangeHeaderRejectsUnsatisfiableRange/malformed --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange (0.01s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/whole_source (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/leading_slice (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/trailing_slice (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/single_byte (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/no_bytes_prefix (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/end_past_the_source (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/start_past_the_source (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/start_at_the_source_size (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/reversed (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/negative_start (0.00s) --- PASS: TestParseRangeHeaderRejectsUnsatisfiableRange/malformed (0.00s) === RUN TestCopyChunksForRangeCopiedETags --- PASS: TestCopyChunksForRangeCopiedETags (0.59s) === RUN TestCopyChunksForRangeSparseETags --- PASS: TestCopyChunksForRangeSparseETags (0.04s) === RUN TestCopyChunksForRangePreservesSourcePrecedence --- PASS: TestCopyChunksForRangePreservesSourcePrecedence (0.04s) === RUN TestCopyObjectPartInlineContent --- PASS: TestCopyObjectPartInlineContent (0.04s) === RUN TestCopyObjectPartHandlerInlineContent --- PASS: TestCopyObjectPartHandlerInlineContent (0.05s) === RUN TestWriteEmptyCopyPartStoresMd5 --- PASS: TestWriteEmptyCopyPartStoresMd5 (0.02s) === RUN TestCopyChunksForRangeMissingChunkETag --- PASS: TestCopyChunksForRangeMissingChunkETag (0.04s) === RUN TestResolveDestinationMime === RUN TestResolveDestinationMime/COPY_keeps_source_mime === RUN TestResolveDestinationMime/COPY_without_request_CT === RUN TestResolveDestinationMime/COPY_with_empty_source_mime === RUN TestResolveDestinationMime/REPLACE_with_request_CT_wins === RUN TestResolveDestinationMime/REPLACE_without_request_CT_uses_default === RUN TestResolveDestinationMime/REPLACE_with_request_CT_and_empty_source === RUN TestResolveDestinationMime/REPLACE_without_request_CT_and_empty_source --- PASS: TestResolveDestinationMime (0.00s) --- PASS: TestResolveDestinationMime/COPY_keeps_source_mime (0.00s) --- PASS: TestResolveDestinationMime/COPY_without_request_CT (0.00s) --- PASS: TestResolveDestinationMime/COPY_with_empty_source_mime (0.00s) --- PASS: TestResolveDestinationMime/REPLACE_with_request_CT_wins (0.00s) --- PASS: TestResolveDestinationMime/REPLACE_without_request_CT_uses_default (0.00s) --- PASS: TestResolveDestinationMime/REPLACE_with_request_CT_and_empty_source (0.00s) --- PASS: TestResolveDestinationMime/REPLACE_without_request_CT_and_empty_source (0.00s) === RUN TestIsValidDirective === RUN TestIsValidDirective/#00 === RUN TestIsValidDirective/COPY === RUN TestIsValidDirective/REPLACE === RUN TestIsValidDirective/copy === RUN TestIsValidDirective/replace === RUN TestIsValidDirective/FOO === RUN TestIsValidDirective/REPLACE_ --- PASS: TestIsValidDirective (0.00s) --- PASS: TestIsValidDirective/#00 (0.00s) --- PASS: TestIsValidDirective/COPY (0.00s) --- PASS: TestIsValidDirective/REPLACE (0.00s) --- PASS: TestIsValidDirective/copy (0.00s) --- PASS: TestIsValidDirective/replace (0.00s) --- PASS: TestIsValidDirective/FOO (0.00s) --- PASS: TestIsValidDirective/REPLACE_ (0.00s) === RUN TestProcessMetadataBytes_ReplaceSystemHeaders --- PASS: TestProcessMetadataBytes_ReplaceSystemHeaders (0.00s) === RUN TestIsManagedCopyMetadataKey_CoversSystemHeaders --- PASS: TestIsManagedCopyMetadataKey_CoversSystemHeaders (0.00s) === RUN TestIsManagedCopyMetadataKey_CaseInsensitive === RUN TestIsManagedCopyMetadataKey_CaseInsensitive/cache-control === RUN TestIsManagedCopyMetadataKey_CaseInsensitive/CACHE-CONTROL === RUN TestIsManagedCopyMetadataKey_CaseInsensitive/content-encoding === RUN TestIsManagedCopyMetadataKey_CaseInsensitive/x-amz-meta-owner === RUN TestIsManagedCopyMetadataKey_CaseInsensitive/X-AMZ-META-OWNER === RUN TestIsManagedCopyMetadataKey_CaseInsensitive/x-amz-tagging-env --- PASS: TestIsManagedCopyMetadataKey_CaseInsensitive (0.00s) --- PASS: TestIsManagedCopyMetadataKey_CaseInsensitive/cache-control (0.00s) --- PASS: TestIsManagedCopyMetadataKey_CaseInsensitive/CACHE-CONTROL (0.00s) --- PASS: TestIsManagedCopyMetadataKey_CaseInsensitive/content-encoding (0.00s) --- PASS: TestIsManagedCopyMetadataKey_CaseInsensitive/x-amz-meta-owner (0.00s) --- PASS: TestIsManagedCopyMetadataKey_CaseInsensitive/X-AMZ-META-OWNER (0.00s) --- PASS: TestIsManagedCopyMetadataKey_CaseInsensitive/x-amz-tagging-env (0.00s) === RUN TestProcessMetadataBytes_CopyAcceptsLowercaseSourceKeys --- PASS: TestProcessMetadataBytes_CopyAcceptsLowercaseSourceKeys (0.00s) === RUN TestProcessMetadataBytes_CopyCanonicalSystemHeaderWinsOverLegacy --- PASS: TestProcessMetadataBytes_CopyCanonicalSystemHeaderWinsOverLegacy (0.00s) === RUN TestProcessMetadataBytes_CopyCanonicalTagWinsOverLegacy --- PASS: TestProcessMetadataBytes_CopyCanonicalTagWinsOverLegacy (0.00s) === RUN TestProcessMetadataBytes_CopyAcceptsLowercaseTagKeys --- PASS: TestProcessMetadataBytes_CopyAcceptsLowercaseTagKeys (0.00s) === RUN TestMergeCopyMetadata_ReplaceDropsStaleSystemHeader --- PASS: TestMergeCopyMetadata_ReplaceDropsStaleSystemHeader (0.00s) === RUN TestMergeCopyMetadata_ReplaceTaggingDropsStaleTags --- PASS: TestMergeCopyMetadata_ReplaceTaggingDropsStaleTags (0.00s) === RUN TestProcessMetadataBytes_CopyInheritsSystemHeaders --- PASS: TestProcessMetadataBytes_CopyInheritsSystemHeaders (0.00s) === RUN TestProcessMetadataBytes_CopyAppliesRequestedSSES3Header --- PASS: TestProcessMetadataBytes_CopyAppliesRequestedSSES3Header (0.00s) === RUN TestProcessMetadataBytes_CopyPreservesSourceSSEWhenRequestOmitsHeader --- PASS: TestProcessMetadataBytes_CopyPreservesSourceSSEWhenRequestOmitsHeader (0.00s) === RUN TestCopyReplacesSourceEntry === RUN TestCopyReplacesSourceEntry/no_versioning_replaces_the_bare_key === RUN TestCopyReplacesSourceEntry/a_copy_to_another_key_writes_its_own_entry === RUN TestCopyReplacesSourceEntry/versioning_enabled_writes_a_new_version_file === RUN TestCopyReplacesSourceEntry/suspended_writes_the_null_version_beside_live_versions === RUN TestCopyReplacesSourceEntry/pinned_source_version_outlives_the_copy === RUN TestCopyReplacesSourceEntry/pinned_null_source_version --- PASS: TestCopyReplacesSourceEntry (0.00s) --- PASS: TestCopyReplacesSourceEntry/no_versioning_replaces_the_bare_key (0.00s) --- PASS: TestCopyReplacesSourceEntry/a_copy_to_another_key_writes_its_own_entry (0.00s) --- PASS: TestCopyReplacesSourceEntry/versioning_enabled_writes_a_new_version_file (0.00s) --- PASS: TestCopyReplacesSourceEntry/suspended_writes_the_null_version_beside_live_versions (0.00s) --- PASS: TestCopyReplacesSourceEntry/pinned_source_version_outlives_the_copy (0.00s) --- PASS: TestCopyReplacesSourceEntry/pinned_null_source_version (0.00s) === RUN TestCopyObjectToItselfChangingStorageClass === RUN TestCopyObjectToItselfChangingStorageClass/no_change === RUN TestCopyObjectToItselfChangingStorageClass/no_change_under_default_encryption === RUN TestCopyObjectToItselfChangingStorageClass/invalid_storage_class === RUN TestCopyObjectToItselfChangingStorageClass/new_storage_class === RUN TestCopyObjectToItselfChangingStorageClass/current_storage_class === RUN TestCopyObjectToItselfChangingStorageClass/STANDARD_without_a_stored_class === RUN TestCopyObjectToItselfChangingStorageClass/encryption_only === RUN TestCopyObjectToItselfChangingStorageClass/new_storage_class_and_SSE-KMS_context --- PASS: TestCopyObjectToItselfChangingStorageClass (0.17s) --- PASS: TestCopyObjectToItselfChangingStorageClass/no_change (0.02s) --- PASS: TestCopyObjectToItselfChangingStorageClass/no_change_under_default_encryption (0.02s) --- PASS: TestCopyObjectToItselfChangingStorageClass/invalid_storage_class (0.02s) --- PASS: TestCopyObjectToItselfChangingStorageClass/new_storage_class (0.02s) --- PASS: TestCopyObjectToItselfChangingStorageClass/current_storage_class (0.02s) --- PASS: TestCopyObjectToItselfChangingStorageClass/STANDARD_without_a_stored_class (0.02s) --- PASS: TestCopyObjectToItselfChangingStorageClass/encryption_only (0.01s) --- PASS: TestCopyObjectToItselfChangingStorageClass/new_storage_class_and_SSE-KMS_context (0.02s) === RUN TestStreamCopyChunkRangeFsync === RUN TestStreamCopyChunkRangeFsync/without_sync === RUN TestStreamCopyChunkRangeFsync/durable_copy === RUN TestStreamCopyChunkRangeFsync/durable_write_fails --- PASS: TestStreamCopyChunkRangeFsync (0.04s) --- PASS: TestStreamCopyChunkRangeFsync/without_sync (0.01s) --- PASS: TestStreamCopyChunkRangeFsync/durable_copy (0.01s) --- PASS: TestStreamCopyChunkRangeFsync/durable_write_fails (0.01s) === RUN TestCopyObjectReportsSourceVersionId --- PASS: TestCopyObjectReportsSourceVersionId (0.02s) === RUN TestCopyObjectReportsLatestSourceVersionId --- PASS: TestCopyObjectReportsLatestSourceVersionId (0.03s) === RUN TestCopyObjectPartReportsSourceVersionId --- PASS: TestCopyObjectPartReportsSourceVersionId (0.05s) === RUN TestCopyObjectReportsNullSourceVersionId --- PASS: TestCopyObjectReportsNullSourceVersionId (0.04s) === RUN TestCopyObjectOmitsSourceVersionIdWhenUnversioned --- PASS: TestCopyObjectOmitsSourceVersionIdWhenUnversioned (0.03s) === RUN TestValidateDeleteObjectIdentifier === RUN TestValidateDeleteObjectIdentifier/clean_key === RUN TestValidateDeleteObjectIdentifier/clean_version === RUN TestValidateDeleteObjectIdentifier/key_traversal === RUN TestValidateDeleteObjectIdentifier/encoded_traversal_already_decoded === RUN TestValidateDeleteObjectIdentifier/backslash_traversal === RUN TestValidateDeleteObjectIdentifier/version_traversal === RUN TestValidateDeleteObjectIdentifier/version_backslash --- PASS: TestValidateDeleteObjectIdentifier (0.01s) --- PASS: TestValidateDeleteObjectIdentifier/clean_key (0.00s) --- PASS: TestValidateDeleteObjectIdentifier/clean_version (0.00s) --- PASS: TestValidateDeleteObjectIdentifier/key_traversal (0.00s) --- PASS: TestValidateDeleteObjectIdentifier/encoded_traversal_already_decoded (0.00s) --- PASS: TestValidateDeleteObjectIdentifier/backslash_traversal (0.00s) --- PASS: TestValidateDeleteObjectIdentifier/version_traversal (0.00s) --- PASS: TestValidateDeleteObjectIdentifier/version_backslash (0.00s) === RUN TestGetSpecificObjectVersionRejectsUnsafeVersionID --- PASS: TestGetSpecificObjectVersionRejectsUnsafeVersionID (0.00s) === RUN TestDeleteUnversionedObjectWithClient_MetadataOnlySkipsChunkDelete --- PASS: TestDeleteUnversionedObjectWithClient_MetadataOnlySkipsChunkDelete (0.00s) === RUN TestDeleteUnversionedObjectWithClient_FullDeletePreservesIsDeleteData --- PASS: TestDeleteUnversionedObjectWithClient_FullDeletePreservesIsDeleteData (0.00s) === RUN TestDeleteUnversionedObjectWithClient_FullPathFromBucketsRoot --- PASS: TestDeleteUnversionedObjectWithClient_FullPathFromBucketsRoot (0.00s) === RUN TestDeleteUnversionedObjectWithClientRejectsTraversal --- PASS: TestDeleteUnversionedObjectWithClientRejectsTraversal (0.00s) === RUN TestDeleteUnversionedObjectWithClient_PropagatesEntryAttributesIrrelevant --- PASS: TestDeleteUnversionedObjectWithClient_PropagatesEntryAttributesIrrelevant (0.00s) === RUN TestVersionedDeleteMarkerCommitsOnOwner I1117 09:42:27.808995 s3api_object_handlers_delete.go:227 DeleteObjectHandler bucket key --- PASS: TestVersionedDeleteMarkerCommitsOnOwner (0.07s) === RUN TestVersionedConditionalDeleteRechecksUnderLock === RUN TestVersionedConditionalDeleteRechecksUnderLock/Enabled/raced=false I1117 09:42:27.831310 s3api_object_handlers_delete.go:227 DeleteObjectHandler b k === RUN TestVersionedConditionalDeleteRechecksUnderLock/Enabled/raced=true I1117 09:42:27.881023 s3api_object_handlers_delete.go:227 DeleteObjectHandler b k === RUN TestVersionedConditionalDeleteRechecksUnderLock/Suspended/raced=false I1117 09:42:27.926908 s3api_object_handlers_delete.go:227 DeleteObjectHandler b k === RUN TestVersionedConditionalDeleteRechecksUnderLock/Suspended/raced=true I1117 09:42:27.981021 s3api_object_handlers_delete.go:227 DeleteObjectHandler b k --- PASS: TestVersionedConditionalDeleteRechecksUnderLock (0.20s) --- PASS: TestVersionedConditionalDeleteRechecksUnderLock/Enabled/raced=false (0.05s) --- PASS: TestVersionedConditionalDeleteRechecksUnderLock/Enabled/raced=true (0.04s) --- PASS: TestVersionedConditionalDeleteRechecksUnderLock/Suspended/raced=false (0.05s) --- PASS: TestVersionedConditionalDeleteRechecksUnderLock/Suspended/raced=true (0.05s) === RUN TestVersionIdConditionalDeleteGuardsOnOwner === RUN TestVersionIdConditionalDeleteGuardsOnOwner/"abc123" I1117 09:42:28.036743 s3api_object_handlers_delete.go:227 DeleteObjectHandler b k === RUN TestVersionIdConditionalDeleteGuardsOnOwner/"other",_"abc123" I1117 09:42:28.067617 s3api_object_handlers_delete.go:227 DeleteObjectHandler b k --- PASS: TestVersionIdConditionalDeleteGuardsOnOwner (0.07s) --- PASS: TestVersionIdConditionalDeleteGuardsOnOwner/"abc123" (0.04s) --- PASS: TestVersionIdConditionalDeleteGuardsOnOwner/"other",_"abc123" (0.03s) === RUN TestServeDirectoryContentContentType === RUN TestServeDirectoryContentContentType/bare_directory_answers_the_directory_marker_type === RUN TestServeDirectoryContentContentType/promoted_file_with_data_keeps_octet-stream === RUN TestServeDirectoryContentContentType/stored_mime_is_echoed_verbatim --- PASS: TestServeDirectoryContentContentType (0.00s) --- PASS: TestServeDirectoryContentContentType/bare_directory_answers_the_directory_marker_type (0.00s) --- PASS: TestServeDirectoryContentContentType/promoted_file_with_data_keeps_octet-stream (0.00s) --- PASS: TestServeDirectoryContentContentType/stored_mime_is_echoed_verbatim (0.00s) === RUN TestIsBareDirectory === RUN TestIsBareDirectory/nothing_there === RUN TestIsBareDirectory/file === RUN TestIsBareDirectory/directory_a_listing_stands_for === RUN TestIsBareDirectory/promoted_file_with_data === RUN TestIsBareDirectory/empty_prefix_object --- PASS: TestIsBareDirectory (0.00s) --- PASS: TestIsBareDirectory/nothing_there (0.00s) --- PASS: TestIsBareDirectory/file (0.00s) --- PASS: TestIsBareDirectory/directory_a_listing_stands_for (0.00s) --- PASS: TestIsBareDirectory/promoted_file_with_data (0.00s) --- PASS: TestIsBareDirectory/empty_prefix_object (0.00s) === RUN TestIsExtractZip === RUN TestIsExtractZip/none === RUN TestIsExtractZip/query === RUN TestIsExtractZip/seaweed_header === RUN TestIsExtractZip/snowball_header === RUN TestIsExtractZip/snowball_false --- PASS: TestIsExtractZip (0.00s) --- PASS: TestIsExtractZip/none (0.00s) --- PASS: TestIsExtractZip/query (0.00s) --- PASS: TestIsExtractZip/seaweed_header (0.00s) --- PASS: TestIsExtractZip/snowball_header (0.00s) --- PASS: TestIsExtractZip/snowball_false (0.00s) === RUN TestExtractZipPutObject I1117 09:42:28.107921 config_loader.go:73 Using explicit credential store: memory --- PASS: TestExtractZipPutObject (0.07s) === RUN TestExtractZipPutObjectArchiveChecksum I1117 09:42:28.188209 config_loader.go:73 Using explicit credential store: memory --- PASS: TestExtractZipPutObjectArchiveChecksum (0.02s) === RUN TestExtractZipPutObjectGoodArchiveMd5 I1117 09:42:28.198501 config_loader.go:73 Using explicit credential store: memory --- PASS: TestExtractZipPutObjectGoodArchiveMd5 (0.03s) === RUN TestExtractZipPutObjectNotAZip I1117 09:42:28.229387 config_loader.go:73 Using explicit credential store: memory --- PASS: TestExtractZipPutObjectNotAZip (0.01s) === RUN TestExtractZipPutObjectRejectsExplicitSSE I1117 09:42:28.236206 config_loader.go:73 Using explicit credential store: memory --- PASS: TestExtractZipPutObjectRejectsExplicitSSE (0.01s) === RUN TestDeletedPrefixIsNotACommonPrefix --- PASS: TestDeletedPrefixIsNotACommonPrefix (0.00s) === RUN TestLivePrefixIsStillACommonPrefix --- PASS: TestLivePrefixIsStillACommonPrefix (0.01s) === RUN TestDeletedPrefixWithNullObjectIsNotACommonPrefix --- PASS: TestDeletedPrefixWithNullObjectIsNotACommonPrefix (0.00s) === RUN TestDeletedPrefixGetsNoDirectoryMarker --- PASS: TestDeletedPrefixGetsNoDirectoryMarker (0.00s) === RUN TestEmptyDirectoryStaysACommonPrefix --- PASS: TestEmptyDirectoryStaysACommonPrefix (0.00s) === RUN TestDirectoryKeyObjectListedDespiteDeletedChildren --- PASS: TestDirectoryKeyObjectListedDespiteDeletedChildren (0.00s) === RUN TestUnstampedVersionKeepsThePrefix --- PASS: TestUnstampedVersionKeepsThePrefix (0.00s) === RUN TestLiveVersionStampKeepsThePrefix --- PASS: TestLiveVersionStampKeepsThePrefix (0.00s) === RUN TestBucketWithoutVersioningSkipsTheProbe --- PASS: TestBucketWithoutVersioningSkipsTheProbe (0.00s) === RUN TestDeletedPrefixesDoNotConsumeMaxKeys --- PASS: TestDeletedPrefixesDoNotConsumeMaxKeys (0.00s) === RUN TestPerPrefixBudgetNotShared --- PASS: TestPerPrefixBudgetNotShared (0.00s) === RUN TestPerRequestProbeBudgetStillBoundsWork --- PASS: TestPerRequestProbeBudgetStillBoundsWork (0.00s) === RUN TestDeletedDirectoryMarkerIsNotListed --- PASS: TestDeletedDirectoryMarkerIsNotListed (0.00s) === RUN TestLiveDirectoryMarkerIsListed --- PASS: TestLiveDirectoryMarkerIsListed (0.00s) === RUN TestDeletedDirectoryMarkerKeepsLiveChildren --- PASS: TestDeletedDirectoryMarkerKeepsLiveChildren (0.00s) === RUN TestStaleOwnVersionsIsNotAKey --- PASS: TestStaleOwnVersionsIsNotAKey (0.00s) === RUN TestDirectoryMarkersCostNoLookups --- PASS: TestDirectoryMarkersCostNoLookups (0.00s) === RUN TestDirectoryMarkerWithBodyListsItsSize --- PASS: TestDirectoryMarkerWithBodyListsItsSize (0.00s) === RUN TestDirectoryListedAsCommonPrefix --- PASS: TestDirectoryListedAsCommonPrefix (0.00s) === RUN TestEmptyDirectoryNotListedUnderOwnPrefix --- PASS: TestEmptyDirectoryNotListedUnderOwnPrefix (0.00s) === RUN TestNonEmptyDirectoryGetsNoPhantomMarker --- PASS: TestNonEmptyDirectoryGetsNoPhantomMarker (0.00s) === RUN TestEmptyDirectoryHiddenInFlatListing --- PASS: TestEmptyDirectoryHiddenInFlatListing (0.00s) === RUN TestEmptyDirectoryHiddenInDelimitedSelfListing --- PASS: TestEmptyDirectoryHiddenInDelimitedSelfListing (0.01s) === RUN Test_markerSortsBeforePrefix === RUN Test_markerSortsBeforePrefix/marker_is_the_root_directory_the_prefix_walks_under === RUN Test_markerSortsBeforePrefix/marker_is_the_prefix_directory_without_its_slash === RUN Test_markerSortsBeforePrefix/marker_is_an_unrelated_earlier_key === RUN Test_markerSortsBeforePrefix/marker_is_an_earlier_sibling === RUN Test_markerSortsBeforePrefix/leading_slashes_are_ignored_on_both_sides === RUN Test_markerSortsBeforePrefix/empty_marker_is_not_a_cutoff === RUN Test_markerSortsBeforePrefix/empty_prefix:_every_key_is_in_scope,_marker_stands === RUN Test_markerSortsBeforePrefix/marker_under_the_prefix_resumes_inside_it === RUN Test_markerSortsBeforePrefix/marker_equal_to_the_prefix_stands === RUN Test_markerSortsBeforePrefix/marker_after_the_prefix's_subtree_stands === RUN Test_markerSortsBeforePrefix/partial_name_prefix:_a_later_match-set_marker_stands --- PASS: Test_markerSortsBeforePrefix (0.01s) --- PASS: Test_markerSortsBeforePrefix/marker_is_the_root_directory_the_prefix_walks_under (0.00s) --- PASS: Test_markerSortsBeforePrefix/marker_is_the_prefix_directory_without_its_slash (0.00s) --- PASS: Test_markerSortsBeforePrefix/marker_is_an_unrelated_earlier_key (0.00s) --- PASS: Test_markerSortsBeforePrefix/marker_is_an_earlier_sibling (0.00s) --- PASS: Test_markerSortsBeforePrefix/leading_slashes_are_ignored_on_both_sides (0.00s) --- PASS: Test_markerSortsBeforePrefix/empty_marker_is_not_a_cutoff (0.00s) --- PASS: Test_markerSortsBeforePrefix/empty_prefix:_every_key_is_in_scope,_marker_stands (0.00s) --- PASS: Test_markerSortsBeforePrefix/marker_under_the_prefix_resumes_inside_it (0.00s) --- PASS: Test_markerSortsBeforePrefix/marker_equal_to_the_prefix_stands (0.00s) --- PASS: Test_markerSortsBeforePrefix/marker_after_the_prefix's_subtree_stands (0.00s) --- PASS: Test_markerSortsBeforePrefix/partial_name_prefix:_a_later_match-set_marker_stands (0.00s) === RUN Test_markerSortsPastPrefix === RUN Test_markerSortsPastPrefix/marker_is_a_later_directory === RUN Test_markerSortsPastPrefix/marker_is_a_later_key_without_a_slash === RUN Test_markerSortsPastPrefix/marker_shares_the_parent_dir_but_sorts_past === RUN Test_markerSortsPastPrefix/marker_diverges_after_the_prefix === RUN Test_markerSortsPastPrefix/leading_slashes_are_ignored_on_both_sides === RUN Test_markerSortsPastPrefix/empty_marker_is_in_range === RUN Test_markerSortsPastPrefix/empty_prefix:_every_key_is_in_scope === RUN Test_markerSortsPastPrefix/marker_under_the_prefix_resumes_inside_it === RUN Test_markerSortsPastPrefix/marker_equal_to_the_prefix_stands === RUN Test_markerSortsPastPrefix/partial_name_prefix:_marker_under_the_match_set_stands === RUN Test_markerSortsPastPrefix/marker_before_the_prefix_is_not_past_it --- PASS: Test_markerSortsPastPrefix (0.01s) --- PASS: Test_markerSortsPastPrefix/marker_is_a_later_directory (0.00s) --- PASS: Test_markerSortsPastPrefix/marker_is_a_later_key_without_a_slash (0.00s) --- PASS: Test_markerSortsPastPrefix/marker_shares_the_parent_dir_but_sorts_past (0.00s) --- PASS: Test_markerSortsPastPrefix/marker_diverges_after_the_prefix (0.00s) --- PASS: Test_markerSortsPastPrefix/leading_slashes_are_ignored_on_both_sides (0.00s) --- PASS: Test_markerSortsPastPrefix/empty_marker_is_in_range (0.00s) --- PASS: Test_markerSortsPastPrefix/empty_prefix:_every_key_is_in_scope (0.00s) --- PASS: Test_markerSortsPastPrefix/marker_under_the_prefix_resumes_inside_it (0.00s) --- PASS: Test_markerSortsPastPrefix/marker_equal_to_the_prefix_stands (0.00s) --- PASS: Test_markerSortsPastPrefix/partial_name_prefix:_marker_under_the_match_set_stands (0.00s) --- PASS: Test_markerSortsPastPrefix/marker_before_the_prefix_is_not_past_it (0.00s) === RUN TestListWithMarkerPastPrefix === RUN TestListWithMarkerPastPrefix/marker_is_a_later_directory === RUN TestListWithMarkerPastPrefix/marker_is_a_deeper_path_in_a_later_directory === RUN TestListWithMarkerPastPrefix/marker_is_a_later_bare_key === RUN TestListWithMarkerPastPrefix/marker_inside_the_prefix_resumes_normally --- PASS: TestListWithMarkerPastPrefix (0.00s) --- PASS: TestListWithMarkerPastPrefix/marker_is_a_later_directory (0.00s) --- PASS: TestListWithMarkerPastPrefix/marker_is_a_deeper_path_in_a_later_directory (0.00s) --- PASS: TestListWithMarkerPastPrefix/marker_is_a_later_bare_key (0.00s) --- PASS: TestListWithMarkerPastPrefix/marker_inside_the_prefix_resumes_normally (0.00s) === RUN Test_excludedMarkerKey === RUN Test_excludedMarkerKey/marker_trimmed_to_a_shorter_cutoff === RUN Test_excludedMarkerKey/leading_slashes_are_dropped,_as_the_keys_carry_none === RUN Test_excludedMarkerKey/untrimmed_marker:_the_walk_already_excludes_it === RUN Test_excludedMarkerKey/no_marker --- PASS: Test_excludedMarkerKey (0.00s) --- PASS: Test_excludedMarkerKey/marker_trimmed_to_a_shorter_cutoff (0.00s) --- PASS: Test_excludedMarkerKey/leading_slashes_are_dropped,_as_the_keys_carry_none (0.00s) --- PASS: Test_excludedMarkerKey/untrimmed_marker:_the_walk_already_excludes_it (0.00s) --- PASS: Test_excludedMarkerKey/no_marker (0.00s) === RUN TestListWithMarkerBeforePrefix === RUN TestListWithMarkerBeforePrefix/start-after_is_the_root_directory_the_walk_starts_from === RUN TestListWithMarkerBeforePrefix/start-after_is_the_prefix_itself === RUN TestListWithMarkerBeforePrefix/start-after_is_the_prefix_with_a_leading_slash --- PASS: TestListWithMarkerBeforePrefix (0.00s) --- PASS: TestListWithMarkerBeforePrefix/start-after_is_the_root_directory_the_walk_starts_from (0.00s) --- PASS: TestListWithMarkerBeforePrefix/start-after_is_the_prefix_itself (0.00s) --- PASS: TestListWithMarkerBeforePrefix/start-after_is_the_prefix_with_a_leading_slash (0.00s) === RUN TestListFilerEntriesListingRegression === RUN TestListFilerEntriesListingRegression/versioning= === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=_/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=/max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=//max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=//max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=//max=1000 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=_/max=1 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=_/max=2 === RUN TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=_/max=1000 --- PASS: TestListFilerEntriesListingRegression (11.18s) --- PASS: TestListFilerEntriesListingRegression/versioning= (3.38s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false (1.70s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=/max=1 (0.17s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=/max=2 (0.09s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=//max=1 (0.07s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=//max=2 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=_/max=1 (0.13s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=_/max=2 (0.07s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=/max=1 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=/max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=//max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=//max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=_/max=1 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=_/max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=a/c//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=_/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=boo/b/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=foo_/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=logs//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=space_dir//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=false/prefix=missing//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true (1.68s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=/max=1 (0.14s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=/max=2 (0.08s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=//max=1 (0.06s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=//max=2 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=_/max=1 (0.12s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=_/max=2 (0.08s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=/max=1 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=/max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=//max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=//max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=_/max=1 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=_/max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=a/c//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=//max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=//max=1000 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=_/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=boo/b/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=foo_/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=logs//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=space_dir//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=/encoded=true/prefix=missing//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled (3.88s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false (1.92s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=/max=1 (0.17s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=/max=2 (0.10s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=//max=1 (0.08s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=//max=2 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=_/max=1 (0.15s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=_/max=2 (0.09s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=/max=1 (0.06s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=/max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=//max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=//max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=_/max=1 (0.06s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=_/max=2 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=a/c//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=/max=1 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=_/max=1 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=_/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=boo/b/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=foo_/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=logs//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=space_dir//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=false/prefix=missing//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true (1.96s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=/max=1 (0.16s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=/max=2 (0.10s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=//max=1 (0.08s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=//max=2 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=//max=1000 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=_/max=1 (0.15s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=_/max=2 (0.10s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=/max=1 (0.06s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=/max=2 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=//max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=//max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=_/max=1 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=_/max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/delimiter=_/max=1000 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=a/c//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=/max=1 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=_/max=1 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=_/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=boo/b/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=foo_/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=logs//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=space_dir//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Enabled/encoded=true/prefix=missing//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended (3.90s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false (1.95s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=/max=1 (0.16s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=/max=2 (0.10s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=//max=1 (0.08s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=//max=2 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=_/max=1 (0.14s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=_/max=2 (0.09s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=/max=1 (0.06s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=/max=2 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=//max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=//max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=_/max=1 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=_/max=2 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=a/c//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=/max=1 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=_/max=1 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=_/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=//max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=boo/b/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=_/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=foo_/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=logs//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=space_dir//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=false/prefix=missing//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true (1.94s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=/max=1 (0.16s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=/max=2 (0.10s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=//max=1 (0.09s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=//max=2 (0.05s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=//max=1000 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=_/max=1 (0.15s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=_/max=2 (0.10s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=/delimiter=_/max=1000 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=/max=1 (0.06s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=/max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=//max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=//max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=_/max=1 (0.06s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=_/max=2 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=a/c//delimiter=_/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=/max=1 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=_/max=1 (0.04s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=_/max=2 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=//max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=_/max=1 (0.03s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=//max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=boo/b/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=_/max=1 (0.02s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=foo_/delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=//max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=//max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=//max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=_/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=logs//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=/max=2 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=_/max=1 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=space_dir//delimiter=_/max=1000 (0.01s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=/max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=//max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=//max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=//max=1000 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=_/max=1 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=_/max=2 (0.00s) --- PASS: TestListFilerEntriesListingRegression/versioning=Suspended/encoded=true/prefix=missing//delimiter=_/max=1000 (0.00s) === RUN TestListObjectsHandler --- PASS: TestListObjectsHandler (0.00s) === RUN TestListObjectsV1NamespaceResponse --- PASS: TestListObjectsV1NamespaceResponse (0.00s) === RUN Test_normalizePrefixMarker === RUN Test_normalizePrefixMarker/bucket_root_listing_with_delimiter === RUN Test_normalizePrefixMarker/prefix_is_a_directory === RUN Test_normalizePrefixMarker/normal_case === RUN Test_normalizePrefixMarker/empty_prefix === RUN Test_normalizePrefixMarker/empty_directory === RUN Test_normalizePrefixMarker/partial_name_prefix,_marker_resumes_inside_a_matching_subdirectory === RUN Test_normalizePrefixMarker/partial_name_prefix,_marker_resumes_inside_a_matching_sibling_directory === RUN Test_normalizePrefixMarker/top-level_partial_name_prefix,_marker_resumes_inside_a_matching_subdirectory === RUN Test_normalizePrefixMarker/marker_sorts_before_the_prefix,_so_it_excludes_nothing_under_it === RUN Test_normalizePrefixMarker/marker_is_the_prefix_directory,_whose_own_key_it_excludes --- PASS: Test_normalizePrefixMarker (0.01s) --- PASS: Test_normalizePrefixMarker/bucket_root_listing_with_delimiter (0.00s) --- PASS: Test_normalizePrefixMarker/prefix_is_a_directory (0.00s) --- PASS: Test_normalizePrefixMarker/normal_case (0.00s) --- PASS: Test_normalizePrefixMarker/empty_prefix (0.00s) --- PASS: Test_normalizePrefixMarker/empty_directory (0.00s) --- PASS: Test_normalizePrefixMarker/partial_name_prefix,_marker_resumes_inside_a_matching_subdirectory (0.00s) --- PASS: Test_normalizePrefixMarker/partial_name_prefix,_marker_resumes_inside_a_matching_sibling_directory (0.00s) --- PASS: Test_normalizePrefixMarker/top-level_partial_name_prefix,_marker_resumes_inside_a_matching_subdirectory (0.00s) --- PASS: Test_normalizePrefixMarker/marker_sorts_before_the_prefix,_so_it_excludes_nothing_under_it (0.00s) --- PASS: Test_normalizePrefixMarker/marker_is_the_prefix_directory,_whose_own_key_it_excludes (0.00s) === RUN TestBuildTruncatedNextMarker === RUN TestBuildTruncatedNextMarker/does_not_duplicate_prefix_segment_in_next_continuation_token === RUN TestBuildTruncatedNextMarker/keeps_common_prefix_marker_trailing_slash === RUN TestBuildTruncatedNextMarker/keeps_common_prefix_marker_when_request_dir_is_empty === RUN TestBuildTruncatedNextMarker/does_not_fold_a_partial_name_prefix_into_the_common_prefix_marker --- PASS: TestBuildTruncatedNextMarker (0.00s) --- PASS: TestBuildTruncatedNextMarker/does_not_duplicate_prefix_segment_in_next_continuation_token (0.00s) --- PASS: TestBuildTruncatedNextMarker/keeps_common_prefix_marker_trailing_slash (0.00s) --- PASS: TestBuildTruncatedNextMarker/keeps_common_prefix_marker_when_request_dir_is_empty (0.00s) --- PASS: TestBuildTruncatedNextMarker/does_not_fold_a_partial_name_prefix_into_the_common_prefix_marker (0.00s) === RUN TestAllowUnorderedParameterValidation === RUN TestAllowUnorderedParameterValidation/getListObjectsV1Args_with_allow-unordered === RUN TestAllowUnorderedParameterValidation/getListObjectsV2Args_with_allow-unordered --- PASS: TestAllowUnorderedParameterValidation (0.00s) --- PASS: TestAllowUnorderedParameterValidation/getListObjectsV1Args_with_allow-unordered (0.00s) --- PASS: TestAllowUnorderedParameterValidation/getListObjectsV2Args_with_allow-unordered (0.00s) === RUN TestDoListFilerEntries_BucketRootPrefixSlashDelimiterSlash_ListsDirectories --- PASS: TestDoListFilerEntries_BucketRootPrefixSlashDelimiterSlash_ListsDirectories (0.00s) === RUN TestDoListFilerEntries_ExclusiveStartSkipsMarkerEcho --- PASS: TestDoListFilerEntries_ExclusiveStartSkipsMarkerEcho (0.00s) === RUN TestDoListFilerEntries_ExclusiveStartSkipsMarkerEchoWithSubsequentEntries --- PASS: TestDoListFilerEntries_ExclusiveStartSkipsMarkerEchoWithSubsequentEntries (0.00s) === RUN TestDoListFilerEntries_MarkerNamingDirectoryListsItsChildren --- PASS: TestDoListFilerEntries_MarkerNamingDirectoryListsItsChildren (0.00s) === RUN TestDoListFilerEntries_EmptyDirectoriesDoNotHideLaterEntries --- PASS: TestDoListFilerEntries_EmptyDirectoriesDoNotHideLaterEntries (0.00s) === RUN TestDoListFilerEntries_EmptyDirectoriesInSubdirectoryDoNotHideSiblings --- PASS: TestDoListFilerEntries_EmptyDirectoriesInSubdirectoryDoNotHideSiblings (0.00s) === RUN TestDoListFilerEntries_TruncationAcrossEmptyDirectories --- PASS: TestDoListFilerEntries_TruncationAcrossEmptyDirectories (0.00s) === RUN TestAllowUnorderedWithDelimiterValidation === RUN TestAllowUnorderedWithDelimiterValidation/should_return_error_when_allow-unordered=true_and_delimiter_are_both_present === RUN TestAllowUnorderedWithDelimiterValidation/should_allow_allow-unordered=true_without_delimiter === RUN TestAllowUnorderedWithDelimiterValidation/should_allow_delimiter_without_allow-unordered --- PASS: TestAllowUnorderedWithDelimiterValidation (0.00s) --- PASS: TestAllowUnorderedWithDelimiterValidation/should_return_error_when_allow-unordered=true_and_delimiter_are_both_present (0.00s) --- PASS: TestAllowUnorderedWithDelimiterValidation/should_allow_allow-unordered=true_without_delimiter (0.00s) --- PASS: TestAllowUnorderedWithDelimiterValidation/should_allow_delimiter_without_allow-unordered (0.00s) === RUN TestSanitizeV1MarkerEcho_NoProgressGuard --- PASS: TestSanitizeV1MarkerEcho_NoProgressGuard (0.00s) === RUN TestMaxKeysParameterValidation === RUN TestMaxKeysParameterValidation/valid_max-keys_values_should_work === RUN TestMaxKeysParameterValidation/invalid_max-keys_values_should_return_error === RUN TestMaxKeysParameterValidation/out_of_range_max-keys_values_should_return_error === RUN TestMaxKeysParameterValidation/max-keys_up_to_2147483647_is_accepted_and_capped_at_1000 === RUN TestMaxKeysParameterValidation/empty_max-keys_should_use_default --- PASS: TestMaxKeysParameterValidation (0.02s) --- PASS: TestMaxKeysParameterValidation/valid_max-keys_values_should_work (0.00s) --- PASS: TestMaxKeysParameterValidation/invalid_max-keys_values_should_return_error (0.00s) --- PASS: TestMaxKeysParameterValidation/out_of_range_max-keys_values_should_return_error (0.00s) --- PASS: TestMaxKeysParameterValidation/max-keys_up_to_2147483647_is_accepted_and_capped_at_1000 (0.01s) --- PASS: TestMaxKeysParameterValidation/empty_max-keys_should_use_default (0.00s) === RUN TestDelimiterWithDirectoryKeyObjects === RUN TestDelimiterWithDirectoryKeyObjects/directory_key_object_should_be_grouped_into_common_prefix_with_delimiter === RUN TestDelimiterWithDirectoryKeyObjects/directory_key_object_without_delimiter_should_be_individual_key --- PASS: TestDelimiterWithDirectoryKeyObjects (0.00s) --- PASS: TestDelimiterWithDirectoryKeyObjects/directory_key_object_should_be_grouped_into_common_prefix_with_delimiter (0.00s) --- PASS: TestDelimiterWithDirectoryKeyObjects/directory_key_object_without_delimiter_should_be_individual_key (0.00s) === RUN TestObjectLevelListPermissions === RUN TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions === RUN TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/allowed_prefix_exact_match === RUN TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/allowed_prefix_subdirectory === RUN TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/denied_different_prefix === RUN TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/denied_different_bucket === RUN TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/denied_root_level === RUN TestObjectLevelListPermissions/Bucket_Level_Permissions_Still_Work === RUN TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic === RUN TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic/empty_object_with_prefix === RUN TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic/slash_object_with_prefix === RUN TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic/object_already_set === RUN TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic/no_prefix_provided === RUN TestObjectLevelListPermissions/Issue_7039_Scenario === NAME TestObjectLevelListPermissions s3api_object_handlers_list_test.go:1020: This test validates the fix for issue #7039 s3api_object_handlers_list_test.go:1021: Object-level List permissions like 'List:bucket/prefix/*' now work correctly s3api_object_handlers_list_test.go:1022: Middleware properly extracts prefix for permission validation --- PASS: TestObjectLevelListPermissions (0.01s) --- PASS: TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions (0.00s) --- PASS: TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/allowed_prefix_exact_match (0.00s) --- PASS: TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/allowed_prefix_subdirectory (0.00s) --- PASS: TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/denied_different_prefix (0.00s) --- PASS: TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/denied_different_bucket (0.00s) --- PASS: TestObjectLevelListPermissions/Identity_CanDo_Object_Level_Permissions/denied_root_level (0.00s) --- PASS: TestObjectLevelListPermissions/Bucket_Level_Permissions_Still_Work (0.00s) --- PASS: TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic (0.00s) --- PASS: TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic/empty_object_with_prefix (0.00s) --- PASS: TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic/slash_object_with_prefix (0.00s) --- PASS: TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic/object_already_set (0.00s) --- PASS: TestObjectLevelListPermissions/Empty_Object_With_Prefix_Logic/no_prefix_provided (0.00s) --- PASS: TestObjectLevelListPermissions/Issue_7039_Scenario (0.00s) === RUN TestListObjectsV2_Regression --- PASS: TestListObjectsV2_Regression (0.00s) === RUN TestListObjectsV2_Regression_Sorting --- PASS: TestListObjectsV2_Regression_Sorting (0.00s) === RUN TestListObjectsV2_PrefixEndingWithSlash_DoesNotMatchSiblings --- PASS: TestListObjectsV2_PrefixEndingWithSlash_DoesNotMatchSiblings (0.00s) === RUN TestListObjectsV2_PrefixEndingWithSlash_WithDelimiter --- PASS: TestListObjectsV2_PrefixEndingWithSlash_WithDelimiter (0.00s) === RUN TestDoListFilerEntries_MarkerBetweenDirAndSlash --- PASS: TestDoListFilerEntries_MarkerBetweenDirAndSlash (0.00s) === RUN TestDoListFilerEntries_DirBlocksSortBySlashName --- PASS: TestDoListFilerEntries_DirBlocksSortBySlashName (0.00s) === RUN TestDoListFilerEntries_FullPageTruncatesWithPendingDir --- PASS: TestDoListFilerEntries_FullPageTruncatesWithPendingDir (0.00s) === RUN TestDoListFilerEntries_PrefixObjectKeepsNamePosition --- PASS: TestDoListFilerEntries_PrefixObjectKeepsNamePosition (0.00s) === RUN TestDoListFilerEntries_DelimiterSkipsResumedDirBlock --- PASS: TestDoListFilerEntries_DelimiterSkipsResumedDirBlock (0.00s) === RUN TestDoListFilerEntries_DelimitedDirResumesAtBlockBoundary --- PASS: TestDoListFilerEntries_DelimitedDirResumesAtBlockBoundary (0.00s) === RUN TestDoListFilerEntries_PrefixObjectDefersCommonPrefix --- PASS: TestDoListFilerEntries_PrefixObjectDefersCommonPrefix (0.00s) === RUN TestDoListFilerEntries_DirKeyObjectBoundaryTruncates --- PASS: TestDoListFilerEntries_DirKeyObjectBoundaryTruncates (0.00s) === RUN TestDoListFilerEntries_MarkerStartsDirectlyWithoutTruncation --- PASS: TestDoListFilerEntries_MarkerStartsDirectlyWithoutTruncation (0.00s) === RUN TestDoListFilerEntries_CandidateDirectoryPrefixPastMarker --- PASS: TestDoListFilerEntries_CandidateDirectoryPrefixPastMarker (0.00s) === RUN TestDoListFilerEntries_CandidateRespectsPrefix === RUN TestDoListFilerEntries_CandidateRespectsPrefix/delimiter= === RUN TestDoListFilerEntries_CandidateRespectsPrefix/delimiter=/ --- PASS: TestDoListFilerEntries_CandidateRespectsPrefix (0.00s) --- PASS: TestDoListFilerEntries_CandidateRespectsPrefix/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateRespectsPrefix/delimiter=/ (0.00s) === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads/delimiter=/ === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads-cutoff/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads-cutoff/delimiter=/ === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads/stored-version/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads/stored-version/delimiter=/ === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions/delimiter=/ === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions-cutoff/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions-cutoff/delimiter=/ === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions/stored-version/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions/stored-version/delimiter=/ === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions/delimiter=/ === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions-cutoff/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions-cutoff/delimiter=/ === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions/stored-version/delimiter= === RUN TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions/stored-version/delimiter=/ --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories (0.02s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads/delimiter=/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads-cutoff/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads-cutoff/delimiter=/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads/stored-version/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.uploads/stored-version/delimiter=/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions/delimiter=/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions-cutoff/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions-cutoff/delimiter=/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions/stored-version/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/.versions/stored-version/delimiter=/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions/delimiter=/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions-cutoff/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions-cutoff/delimiter=/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions/stored-version/delimiter= (0.00s) --- PASS: TestDoListFilerEntries_CandidateSkipsInternalDirectories/foo.versions/stored-version/delimiter=/ (0.00s) === RUN TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren === RUN TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren/a/ === RUN TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren/a/b === RUN TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren/a/b/ === RUN TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren/a/b/x --- PASS: TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren (0.01s) --- PASS: TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren/a/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren/a/b (0.00s) --- PASS: TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren/a/b/ (0.00s) --- PASS: TestDoListFilerEntries_CandidateOnlyLooksUpDirectChildren/a/b/x (0.00s) === RUN TestDoListFilerEntries_CandidateLookupErrors === RUN TestDoListFilerEntries_CandidateLookupErrors/empty_response === RUN TestDoListFilerEntries_CandidateLookupErrors/not_found_sentinel === RUN TestDoListFilerEntries_CandidateLookupErrors/not_found_status === RUN TestDoListFilerEntries_CandidateLookupErrors/legacy_not_found_status === RUN TestDoListFilerEntries_CandidateLookupErrors/unavailable === RUN TestDoListFilerEntries_CandidateLookupErrors/unavailable_with_not_found_text === RUN TestDoListFilerEntries_CandidateLookupErrors/deadline_exceeded === RUN TestDoListFilerEntries_CandidateLookupErrors/canceled --- PASS: TestDoListFilerEntries_CandidateLookupErrors (0.01s) --- PASS: TestDoListFilerEntries_CandidateLookupErrors/empty_response (0.00s) --- PASS: TestDoListFilerEntries_CandidateLookupErrors/not_found_sentinel (0.00s) --- PASS: TestDoListFilerEntries_CandidateLookupErrors/not_found_status (0.00s) --- PASS: TestDoListFilerEntries_CandidateLookupErrors/legacy_not_found_status (0.00s) --- PASS: TestDoListFilerEntries_CandidateLookupErrors/unavailable (0.00s) --- PASS: TestDoListFilerEntries_CandidateLookupErrors/unavailable_with_not_found_text (0.00s) --- PASS: TestDoListFilerEntries_CandidateLookupErrors/deadline_exceeded (0.00s) --- PASS: TestDoListFilerEntries_CandidateLookupErrors/canceled (0.00s) === RUN TestDoListFilerEntries_CandidateDirectoryMarkerEcho --- PASS: TestDoListFilerEntries_CandidateDirectoryMarkerEcho (0.00s) === RUN TestListObjectsV2ContinuationTokenWithXMLUnsafeKeys === RUN TestListObjectsV2ContinuationTokenWithXMLUnsafeKeys/encoding-type=url:false === RUN TestListObjectsV2ContinuationTokenWithXMLUnsafeKeys/encoding-type=url:true --- PASS: TestListObjectsV2ContinuationTokenWithXMLUnsafeKeys (0.09s) --- PASS: TestListObjectsV2ContinuationTokenWithXMLUnsafeKeys/encoding-type=url:false (0.05s) --- PASS: TestListObjectsV2ContinuationTokenWithXMLUnsafeKeys/encoding-type=url:true (0.04s) === RUN TestListObjectsV1UrlPaginationKeepsPercentEscapesLiteral --- PASS: TestListObjectsV1UrlPaginationKeepsPercentEscapesLiteral (0.10s) === RUN TestListObjectsV2StartAfterEchoStable --- PASS: TestListObjectsV2StartAfterEchoStable (0.04s) === RUN TestListObjectsV2UrlStartAfterKeepsPercentEscapesLiteral --- PASS: TestListObjectsV2UrlStartAfterKeepsPercentEscapesLiteral (0.02s) === RUN TestListObjectsV2ContinuationTokenUnchangedForNormalKeys --- PASS: TestListObjectsV2ContinuationTokenUnchangedForNormalKeys (0.02s) === RUN TestListObjectsV2ContinuationTokenRoundTrip --- PASS: TestListObjectsV2ContinuationTokenRoundTrip (0.00s) === RUN TestDecodeListContinuationTokenKeepsForeignTokensRaw --- PASS: TestDecodeListContinuationTokenKeepsForeignTokensRaw (0.00s) === RUN TestDecodeListContinuationTokenResolvesCollisionEncoded --- PASS: TestDecodeListContinuationTokenResolvesCollisionEncoded (0.00s) === RUN TestListObjectsV1MarkerWithXMLUnsafeKeys --- PASS: TestListObjectsV1MarkerWithXMLUnsafeKeys (0.04s) === RUN TestListObjectsV2UrlStartAfterEchoAndResume --- PASS: TestListObjectsV2UrlStartAfterEchoAndResume (0.04s) === RUN TestListObjectsV1UrlMarkerKeepsNonCanonicalRawKey --- PASS: TestListObjectsV1UrlMarkerKeepsNonCanonicalRawKey (0.02s) === RUN TestListObjectsV1MarkerEchoStaysXMLSafe --- PASS: TestListObjectsV1MarkerEchoStaysXMLSafe (0.03s) === RUN TestListObjectsV2ResumeXMLUnsafePrefixWithSiblingDir --- PASS: TestListObjectsV2ResumeXMLUnsafePrefixWithSiblingDir (0.02s) === RUN TestTrailingSlashPrefixLooksUpItsDirectory --- PASS: TestTrailingSlashPrefixLooksUpItsDirectory (0.01s) === RUN TestRecursiveListingReadsAhead === RUN TestRecursiveListingReadsAhead/small_entries === RUN TestRecursiveListingReadsAhead/small_entries/max=1 === RUN TestRecursiveListingReadsAhead/small_entries/max=2 === RUN TestRecursiveListingReadsAhead/small_entries/max=7 === RUN TestRecursiveListingReadsAhead/small_entries/max=30 === RUN TestRecursiveListingReadsAhead/small_entries/max=1000 === RUN TestRecursiveListingReadsAhead/large_entries === RUN TestRecursiveListingReadsAhead/large_entries/max=1 === RUN TestRecursiveListingReadsAhead/large_entries/max=2 === RUN TestRecursiveListingReadsAhead/large_entries/max=7 === RUN TestRecursiveListingReadsAhead/large_entries/max=30 === RUN TestRecursiveListingReadsAhead/large_entries/max=1000 --- PASS: TestRecursiveListingReadsAhead (0.96s) --- PASS: TestRecursiveListingReadsAhead/small_entries (0.45s) --- PASS: TestRecursiveListingReadsAhead/small_entries/max=1 (0.01s) --- PASS: TestRecursiveListingReadsAhead/small_entries/max=2 (0.01s) --- PASS: TestRecursiveListingReadsAhead/small_entries/max=7 (0.03s) --- PASS: TestRecursiveListingReadsAhead/small_entries/max=30 (0.03s) --- PASS: TestRecursiveListingReadsAhead/small_entries/max=1000 (0.36s) --- PASS: TestRecursiveListingReadsAhead/large_entries (0.50s) --- PASS: TestRecursiveListingReadsAhead/large_entries/max=1 (0.01s) --- PASS: TestRecursiveListingReadsAhead/large_entries/max=2 (0.01s) --- PASS: TestRecursiveListingReadsAhead/large_entries/max=7 (0.03s) --- PASS: TestRecursiveListingReadsAhead/large_entries/max=30 (0.03s) --- PASS: TestRecursiveListingReadsAhead/large_entries/max=1000 (0.37s) === RUN TestRecursiveListingPagesWithReadAhead === RUN TestRecursiveListingPagesWithReadAhead/prefix=/max=1 === RUN TestRecursiveListingPagesWithReadAhead/prefix=/max=3 === RUN TestRecursiveListingPagesWithReadAhead/prefix=/max=10 === RUN TestRecursiveListingPagesWithReadAhead/prefix=/max=1000 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-0/max=1 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-0/max=3 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-0/max=10 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-0/max=1000 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-03//max=1 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-03//max=3 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-03//max=10 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-03//max=1000 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-03/Contract//max=1 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-03/Contract//max=3 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-03/Contract//max=10 === RUN TestRecursiveListingPagesWithReadAhead/prefix=acct-03/Contract//max=1000 --- PASS: TestRecursiveListingPagesWithReadAhead (9.91s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=/max=1 (5.01s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=/max=3 (1.92s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=/max=10 (0.79s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=/max=1000 (0.13s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-0/max=1 (1.13s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-0/max=3 (0.45s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-0/max=10 (0.22s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-0/max=1000 (0.06s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-03//max=1 (0.04s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-03//max=3 (0.02s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-03//max=10 (0.02s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-03//max=1000 (0.01s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-03/Contract//max=1 (0.03s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-03/Contract//max=3 (0.01s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-03/Contract//max=10 (0.01s) --- PASS: TestRecursiveListingPagesWithReadAhead/prefix=acct-03/Contract//max=1000 (0.01s) === RUN TestRecursiveListingDoesNotWaitForStalledListings --- PASS: TestRecursiveListingDoesNotWaitForStalledListings (0.03s) === RUN TestRecursiveListingStreamErrors --- PASS: TestRecursiveListingStreamErrors (0.15s) === RUN TestListObjectsWithVersionedObjects === RUN TestListObjectsWithVersionedObjects/List_all_objects_including_versioned_(no_delimiter) === RUN TestListObjectsWithVersionedObjects/List_bucket_root_with_delimiter --- PASS: TestListObjectsWithVersionedObjects (0.01s) --- PASS: TestListObjectsWithVersionedObjects/List_all_objects_including_versioned_(no_delimiter) (0.00s) --- PASS: TestListObjectsWithVersionedObjects/List_bucket_root_with_delimiter (0.00s) === RUN TestVersionedObjectsNoDuplication --- PASS: TestVersionedObjectsNoDuplication (0.00s) === RUN TestVersionedObjectsWithDeleteMarker --- PASS: TestVersionedObjectsWithDeleteMarker (0.00s) === RUN TestVersionedObjectsMaxKeys --- PASS: TestVersionedObjectsMaxKeys (0.00s) === RUN TestVersionsDirectoryNotTraversed --- PASS: TestVersionsDirectoryNotTraversed (0.00s) === RUN TestListObjectVersionsResult_XMLInterleaving --- PASS: TestListObjectVersionsResult_XMLInterleaving (0.00s) === RUN TestListObjectVersionsResult_XMLInterleavingMultipleKeys --- PASS: TestListObjectVersionsResult_XMLInterleavingMultipleKeys (0.00s) === RUN TestListObjectVersionsResult_XMLCommonPrefixes --- PASS: TestListObjectVersionsResult_XMLCommonPrefixes (0.00s) === RUN TestListObjectVersions_PrefixWithLeadingSlash === RUN TestListObjectVersions_PrefixWithLeadingSlash/Prefix_without_leading_slash_matches_file === RUN TestListObjectVersions_PrefixWithLeadingSlash/Prefix_with_leading_slash_(bug_fix_test)_-_normalized_and_matches_file === RUN TestListObjectVersions_PrefixWithLeadingSlash/Normalized_prefix_matches_subdirectory_file === RUN TestListObjectVersions_PrefixWithLeadingSlash/Normalized_prefix_does_not_match_different_path === RUN TestListObjectVersions_PrefixWithLeadingSlash/Prefix_with_leading_slash_allows_descending_into_directory === RUN TestListObjectVersions_PrefixWithLeadingSlash/Prefix_with_leading_slash_matches_directory_with_trailing_slash --- PASS: TestListObjectVersions_PrefixWithLeadingSlash (0.00s) --- PASS: TestListObjectVersions_PrefixWithLeadingSlash/Prefix_without_leading_slash_matches_file (0.00s) --- PASS: TestListObjectVersions_PrefixWithLeadingSlash/Prefix_with_leading_slash_(bug_fix_test)_-_normalized_and_matches_file (0.00s) --- PASS: TestListObjectVersions_PrefixWithLeadingSlash/Normalized_prefix_matches_subdirectory_file (0.00s) --- PASS: TestListObjectVersions_PrefixWithLeadingSlash/Normalized_prefix_does_not_match_different_path (0.00s) --- PASS: TestListObjectVersions_PrefixWithLeadingSlash/Prefix_with_leading_slash_allows_descending_into_directory (0.00s) --- PASS: TestListObjectVersions_PrefixWithLeadingSlash/Prefix_with_leading_slash_matches_directory_with_trailing_slash (0.00s) === RUN TestComputeStartFrom === RUN TestComputeStartFrom/empty_marker === RUN TestComputeStartFrom/empty_marker_with_path === RUN TestComputeStartFrom/root_level_file === RUN TestComputeStartFrom/root_level_with_subpath === RUN TestComputeStartFrom/matching_subdir === RUN TestComputeStartFrom/deeper_subdir === RUN TestComputeStartFrom/at_leaf_level === RUN TestComputeStartFrom/unrelated_directory === RUN TestComputeStartFrom/marker_equals_relativePath === RUN TestComputeStartFrom/marker_before_directory === RUN TestComputeStartFrom/dir_prefix_below_slash === RUN TestComputeStartFrom/dir_prefix_below_slash_nested === RUN TestComputeStartFrom/dir_prefix_at_marker_end === RUN TestComputeStartFrom/no_qualifying_prefix === RUN TestComputeStartFrom/leading_below-slash_byte === RUN TestComputeStartFrom/leading_below-slash_byte_nested --- PASS: TestComputeStartFrom (0.01s) --- PASS: TestComputeStartFrom/empty_marker (0.00s) --- PASS: TestComputeStartFrom/empty_marker_with_path (0.00s) --- PASS: TestComputeStartFrom/root_level_file (0.00s) --- PASS: TestComputeStartFrom/root_level_with_subpath (0.00s) --- PASS: TestComputeStartFrom/matching_subdir (0.00s) --- PASS: TestComputeStartFrom/deeper_subdir (0.00s) --- PASS: TestComputeStartFrom/at_leaf_level (0.00s) --- PASS: TestComputeStartFrom/unrelated_directory (0.00s) --- PASS: TestComputeStartFrom/marker_equals_relativePath (0.00s) --- PASS: TestComputeStartFrom/marker_before_directory (0.00s) --- PASS: TestComputeStartFrom/dir_prefix_below_slash (0.00s) --- PASS: TestComputeStartFrom/dir_prefix_below_slash_nested (0.00s) --- PASS: TestComputeStartFrom/dir_prefix_at_marker_end (0.00s) --- PASS: TestComputeStartFrom/no_qualifying_prefix (0.00s) --- PASS: TestComputeStartFrom/leading_below-slash_byte (0.00s) --- PASS: TestComputeStartFrom/leading_below-slash_byte_nested (0.00s) === RUN TestProcessDirectorySkipsBeforeMarker === RUN TestProcessDirectorySkipsBeforeMarker/no_marker === RUN TestProcessDirectorySkipsBeforeMarker/dir_before_marker === RUN TestProcessDirectorySkipsBeforeMarker/marker_descends_into_dir === RUN TestProcessDirectorySkipsBeforeMarker/dir_after_marker === RUN TestProcessDirectorySkipsBeforeMarker/same_prefix_different_suffix --- PASS: TestProcessDirectorySkipsBeforeMarker (0.00s) --- PASS: TestProcessDirectorySkipsBeforeMarker/no_marker (0.00s) --- PASS: TestProcessDirectorySkipsBeforeMarker/dir_before_marker (0.00s) --- PASS: TestProcessDirectorySkipsBeforeMarker/marker_descends_into_dir (0.00s) --- PASS: TestProcessDirectorySkipsBeforeMarker/dir_after_marker (0.00s) --- PASS: TestProcessDirectorySkipsBeforeMarker/same_prefix_different_suffix (0.00s) === RUN TestVersionedListSkipsMarkerObject --- PASS: TestVersionedListSkipsMarkerObject (0.00s) === RUN TestVersionedListSkipsEchoedVersionsMarker --- PASS: TestVersionedListSkipsEchoedVersionsMarker (0.00s) === RUN TestListObjectVersionsMaxKeysZero --- PASS: TestListObjectVersionsMaxKeysZero (0.00s) === RUN TestPostPolicyBucketHandlerHonorsBucketPolicyDeny --- PASS: TestPostPolicyBucketHandlerHonorsBucketPolicyDeny (0.03s) === RUN TestAuthorizeObjectWrite --- PASS: TestAuthorizeObjectWrite (0.01s) === RUN TestPostPolicyBucketHandlerGatesAclFields --- PASS: TestPostPolicyBucketHandlerGatesAclFields (0.07s) === RUN TestPostRequestsAcl --- PASS: TestPostRequestsAcl (0.00s) === RUN TestAuthorizeObjectAclWrite --- PASS: TestAuthorizeObjectAclWrite (0.01s) === RUN TestPostPolicySignatureAllowsAttachedPolicyIdentity --- PASS: TestPostPolicySignatureAllowsAttachedPolicyIdentity (0.01s) === RUN TestPostPolicyAttachedPolicyDeny --- PASS: TestPostPolicyAttachedPolicyDeny (0.02s) === RUN TestPostPolicyBucketHandlerAutoCreatesMissingBucket --- PASS: TestPostPolicyBucketHandlerAutoCreatesMissingBucket (0.06s) === RUN TestPostPolicyBucketHandlerAutoCreateDeniedForNonAdmin W1117 09:42:51.428088 s3api_bucket_handlers.go:856 PostPolicyBucketHandler: auto-create bucket testbucket: permission denied - requires Admin permission --- PASS: TestPostPolicyBucketHandlerAutoCreateDeniedForNonAdmin (0.03s) === RUN TestPostPolicyBucketHandlerBlocksPublicAcls --- PASS: TestPostPolicyBucketHandlerBlocksPublicAcls (0.12s) === RUN TestPostPolicyBucketHandlerStoresObjectAcl === RUN TestPostPolicyBucketHandlerStoresObjectAcl/private_on_public-read_bucket === RUN TestPostPolicyBucketHandlerStoresObjectAcl/no_acl_on_public-read_bucket === RUN TestPostPolicyBucketHandlerStoresObjectAcl/public-read_on_private_bucket === RUN TestPostPolicyBucketHandlerStoresObjectAcl/grant-read_AllUsers_on_private_bucket === RUN TestPostPolicyBucketHandlerStoresObjectAcl/unsigned_acl_header === RUN TestPostPolicyBucketHandlerStoresObjectAcl/unsigned_grant_header === RUN TestPostPolicyBucketHandlerStoresObjectAcl/unsigned_header_beside_signed_acl === RUN TestPostPolicyBucketHandlerStoresObjectAcl/invalid_canned_acl === RUN TestPostPolicyBucketHandlerStoresObjectAcl/canned_and_grant_together --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl (0.30s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/private_on_public-read_bucket (0.04s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/no_acl_on_public-read_bucket (0.04s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/public-read_on_private_bucket (0.04s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/grant-read_AllUsers_on_private_bucket (0.04s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/unsigned_acl_header (0.03s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/unsigned_grant_header (0.03s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/unsigned_header_beside_signed_acl (0.04s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/invalid_canned_acl (0.02s) --- PASS: TestPostPolicyBucketHandlerStoresObjectAcl/canned_and_grant_together (0.02s) === RUN TestPostPolicyBucketHandlerCanonicalGrantCondition --- PASS: TestPostPolicyBucketHandlerCanonicalGrantCondition (0.08s) === RUN TestPostPolicyBucketHandlerAclPolicyWithAuthDisabled --- PASS: TestPostPolicyBucketHandlerAclPolicyWithAuthDisabled (0.05s) === RUN TestPostPolicyBucketHandlerAclPolicyOnColdBucket --- PASS: TestPostPolicyBucketHandlerAclPolicyOnColdBucket (0.09s) === RUN TestPostPolicyBucketHandlerStopsWhenBucketLoadFails --- PASS: TestPostPolicyBucketHandlerStopsWhenBucketLoadFails (0.02s) === RUN TestPostPolicyBucketHandlerRejectsConflictingAclFields --- PASS: TestPostPolicyBucketHandlerRejectsConflictingAclFields (0.07s) === RUN TestPostPolicyBucketHandlerIgnoresUnsignedHeaders === RUN TestPostPolicyBucketHandlerIgnoresUnsignedHeaders/request_headers === RUN TestPostPolicyBucketHandlerIgnoresUnsignedHeaders/object_lock_request_headers === RUN TestPostPolicyBucketHandlerIgnoresUnsignedHeaders/signed_form_fields --- PASS: TestPostPolicyBucketHandlerIgnoresUnsignedHeaders (0.10s) --- PASS: TestPostPolicyBucketHandlerIgnoresUnsignedHeaders/request_headers (0.03s) --- PASS: TestPostPolicyBucketHandlerIgnoresUnsignedHeaders/object_lock_request_headers (0.03s) --- PASS: TestPostPolicyBucketHandlerIgnoresUnsignedHeaders/signed_form_fields (0.03s) === RUN TestPostPolicyKeyNormalization === RUN TestPostPolicyKeyNormalization/key_without_leading_slash === RUN TestPostPolicyKeyNormalization/key_with_leading_slash === RUN TestPostPolicyKeyNormalization/key_with_path_without_leading_slash === RUN TestPostPolicyKeyNormalization/key_with_path_with_leading_slash === RUN TestPostPolicyKeyNormalization/simple_filename === RUN TestPostPolicyKeyNormalization/key_with_duplicate_slashes === RUN TestPostPolicyKeyNormalization/key_with_leading_duplicate_slashes === RUN TestPostPolicyKeyNormalization/key_with_trailing_slash --- PASS: TestPostPolicyKeyNormalization (0.01s) --- PASS: TestPostPolicyKeyNormalization/key_without_leading_slash (0.00s) --- PASS: TestPostPolicyKeyNormalization/key_with_leading_slash (0.00s) --- PASS: TestPostPolicyKeyNormalization/key_with_path_without_leading_slash (0.00s) --- PASS: TestPostPolicyKeyNormalization/key_with_path_with_leading_slash (0.00s) --- PASS: TestPostPolicyKeyNormalization/simple_filename (0.00s) --- PASS: TestPostPolicyKeyNormalization/key_with_duplicate_slashes (0.00s) --- PASS: TestPostPolicyKeyNormalization/key_with_leading_duplicate_slashes (0.00s) --- PASS: TestPostPolicyKeyNormalization/key_with_trailing_slash (0.00s) === RUN TestNormalizeObjectKey === RUN TestNormalizeObjectKey/empty_string === RUN TestNormalizeObjectKey/simple_file === RUN TestNormalizeObjectKey/with_leading_slash === RUN TestNormalizeObjectKey/path_without_slash === RUN TestNormalizeObjectKey/path_with_slash === RUN TestNormalizeObjectKey/duplicate_slashes === RUN TestNormalizeObjectKey/leading_duplicates === RUN TestNormalizeObjectKey/all_duplicates === RUN TestNormalizeObjectKey/just_slashes === RUN TestNormalizeObjectKey/trailing_slash === RUN TestNormalizeObjectKey/backslash_to_forward_slash === RUN TestNormalizeObjectKey/windows_path === RUN TestNormalizeObjectKey/mixed_slashes --- PASS: TestNormalizeObjectKey (0.01s) --- PASS: TestNormalizeObjectKey/empty_string (0.00s) --- PASS: TestNormalizeObjectKey/simple_file (0.00s) --- PASS: TestNormalizeObjectKey/with_leading_slash (0.00s) --- PASS: TestNormalizeObjectKey/path_without_slash (0.00s) --- PASS: TestNormalizeObjectKey/path_with_slash (0.00s) --- PASS: TestNormalizeObjectKey/duplicate_slashes (0.00s) --- PASS: TestNormalizeObjectKey/leading_duplicates (0.00s) --- PASS: TestNormalizeObjectKey/all_duplicates (0.00s) --- PASS: TestNormalizeObjectKey/just_slashes (0.00s) --- PASS: TestNormalizeObjectKey/trailing_slash (0.00s) --- PASS: TestNormalizeObjectKey/backslash_to_forward_slash (0.00s) --- PASS: TestNormalizeObjectKey/windows_path (0.00s) --- PASS: TestNormalizeObjectKey/mixed_slashes (0.00s) === RUN TestPostPolicyFilenameSubstitution === RUN TestPostPolicyFilenameSubstitution/filename_at_end === RUN TestPostPolicyFilenameSubstitution/filename_in_middle === RUN TestPostPolicyFilenameSubstitution/no_substitution_needed === RUN TestPostPolicyFilenameSubstitution/filename_only --- PASS: TestPostPolicyFilenameSubstitution (0.00s) --- PASS: TestPostPolicyFilenameSubstitution/filename_at_end (0.00s) --- PASS: TestPostPolicyFilenameSubstitution/filename_in_middle (0.00s) --- PASS: TestPostPolicyFilenameSubstitution/no_substitution_needed (0.00s) --- PASS: TestPostPolicyFilenameSubstitution/filename_only (0.00s) === RUN TestExtractPostPolicyFormValues === RUN TestExtractPostPolicyFormValues/basic_upload === RUN TestExtractPostPolicyFormValues/upload_with_path_key --- PASS: TestExtractPostPolicyFormValues (0.01s) --- PASS: TestExtractPostPolicyFormValues/basic_upload (0.00s) --- PASS: TestExtractPostPolicyFormValues/upload_with_path_key (0.00s) === RUN TestPostPolicyPathConstruction === RUN TestPostPolicyPathConstruction/simple_key_without_slash_-_the_bug_case === RUN TestPostPolicyPathConstruction/simple_key_with_slash === RUN TestPostPolicyPathConstruction/nested_path_without_leading_slash === RUN TestPostPolicyPathConstruction/nested_path_with_leading_slash === RUN TestPostPolicyPathConstruction/key_with_duplicate_slashes --- PASS: TestPostPolicyPathConstruction (0.00s) --- PASS: TestPostPolicyPathConstruction/simple_key_without_slash_-_the_bug_case (0.00s) --- PASS: TestPostPolicyPathConstruction/simple_key_with_slash (0.00s) --- PASS: TestPostPolicyPathConstruction/nested_path_without_leading_slash (0.00s) --- PASS: TestPostPolicyPathConstruction/nested_path_with_leading_slash (0.00s) --- PASS: TestPostPolicyPathConstruction/key_with_duplicate_slashes (0.00s) === RUN TestApplyPostPolicyFormHeaders_ForwardsAcl --- PASS: TestApplyPostPolicyFormHeaders_ForwardsAcl (0.00s) === RUN TestApplyPostPolicyFormHeaders_ForwardsContentHeaders === RUN TestApplyPostPolicyFormHeaders_ForwardsContentHeaders/Content-Encoding === RUN TestApplyPostPolicyFormHeaders_ForwardsContentHeaders/Content-Language --- PASS: TestApplyPostPolicyFormHeaders_ForwardsContentHeaders (0.00s) --- PASS: TestApplyPostPolicyFormHeaders_ForwardsContentHeaders/Content-Encoding (0.00s) --- PASS: TestApplyPostPolicyFormHeaders_ForwardsContentHeaders/Content-Language (0.00s) === RUN TestApplyPostPolicyFormHeaders_ForwardsXAmzHeaders --- PASS: TestApplyPostPolicyFormHeaders_ForwardsXAmzHeaders (0.00s) === RUN TestApplyPostPolicyFormHeaders_SkipsReserved --- PASS: TestApplyPostPolicyFormHeaders_SkipsReserved (0.00s) === RUN TestApplyPostPolicyFormHeaders_KeepsExistingCacheControl --- PASS: TestApplyPostPolicyFormHeaders_KeepsExistingCacheControl (0.00s) === RUN TestApplyPostPolicyFormHeaders_IgnoresContentType --- PASS: TestApplyPostPolicyFormHeaders_IgnoresContentType (0.00s) === RUN TestPostPolicyBucketHandlerKeyExtraction === RUN TestPostPolicyBucketHandlerKeyExtraction/key_without_leading_slash === RUN TestPostPolicyBucketHandlerKeyExtraction/key_with_leading_slash === RUN TestPostPolicyBucketHandlerKeyExtraction/key_with_duplicate_slashes --- PASS: TestPostPolicyBucketHandlerKeyExtraction (0.01s) --- PASS: TestPostPolicyBucketHandlerKeyExtraction/key_without_leading_slash (0.00s) --- PASS: TestPostPolicyBucketHandlerKeyExtraction/key_with_leading_slash (0.00s) --- PASS: TestPostPolicyBucketHandlerKeyExtraction/key_with_duplicate_slashes (0.00s) === RUN TestPostPolicyBucketHandlerRejectsTraversalKey --- PASS: TestPostPolicyBucketHandlerRejectsTraversalKey (0.00s) === RUN TestPostPolicyBucketHandler_PolicyViolationReturns403 --- PASS: TestPostPolicyBucketHandler_PolicyViolationReturns403 (0.01s) === RUN TestPostPolicyBucketHandler_AuthDisabledSkipsSignature --- PASS: TestPostPolicyBucketHandler_AuthDisabledSkipsSignature (0.00s) === RUN TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields === RUN TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields/content-type_newline === RUN TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields/content-type_crlf === RUN TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields/content-disposition_newline === RUN TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields/metadata_newline --- PASS: TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields (0.01s) --- PASS: TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields/content-type_newline (0.00s) --- PASS: TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields/content-type_crlf (0.00s) --- PASS: TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields/content-disposition_newline (0.00s) --- PASS: TestPostPolicyBucketHandler_RejectsControlCharsInHeaderFields/metadata_newline (0.00s) === RUN TestValidHeaderValues --- PASS: TestValidHeaderValues (0.00s) === RUN TestPutToFilerAmbiguousCreateKeepsChunks E1117 09:42:52.362445 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: rpc error: code = Unavailable desc = connect: connection refused E1117 09:42:52.365335 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: all filers failed, last error: CreateEntry: rpc error: code = Unavailable desc = connect: connection refused W1117 09:42:52.374318 s3api_object_handlers_put.go:1445 putToFiler: create entry for /buckets/b/o failed but the entry exists, treating the write as successful --- PASS: TestPutToFilerAmbiguousCreateKeepsChunks (0.04s) === RUN TestPutToFilerPostCommitErrorKeepsChunks E1117 09:42:52.397852 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: create parent directories of /buckets/b: i/o timeout E1117 09:42:52.398996 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: CreateEntry: create parent directories of /buckets/b: i/o timeout W1117 09:42:52.403018 s3api_object_handlers_put.go:1445 putToFiler: create entry for /buckets/b/o failed but the entry exists, treating the write as successful --- PASS: TestPutToFilerPostCommitErrorKeepsChunks (0.03s) === RUN TestPutToFilerPostCommitErrorOnFailoverFilerKeepsChunks E1117 09:42:52.427990 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: rpc error: code = Unavailable desc = connect: connection refused E1117 09:42:52.436879 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: create parent directories of /buckets/b: i/o timeout E1117 09:42:52.437650 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: CreateEntry: create parent directories of /buckets/b: i/o timeout W1117 09:42:52.447383 s3api_object_handlers_put.go:1445 putToFiler: create entry for /buckets/b/o failed but the entry exists, treating the write as successful --- PASS: TestPutToFilerPostCommitErrorOnFailoverFilerKeepsChunks (0.04s) === RUN TestPutToFilerConfirmedFailureDeletesOrphans E1117 09:42:52.468412 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: rpc error: code = Unknown desc = create refused E1117 09:42:52.469740 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: all filers failed, last error: CreateEntry: rpc error: code = Unknown desc = create refused W1117 09:42:52.472703 s3api_object_handlers_put.go:1209 putToFiler: finalization failed, attempting to cleanup 1 orphaned chunks --- PASS: TestPutToFilerConfirmedFailureDeletesOrphans (0.05s) === RUN TestPutToFilerAmbiguousCreateWithStaleEntryKeepsChunks E1117 09:42:52.517134 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: rpc error: code = Unavailable desc = connect: connection refused E1117 09:42:52.520051 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: all filers failed, last error: CreateEntry: rpc error: code = Unavailable desc = connect: connection refused --- PASS: TestPutToFilerAmbiguousCreateWithStaleEntryKeepsChunks (0.03s) === RUN TestPutToFilerUnverifiableCreateKeepsChunks E1117 09:42:52.574442 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: rpc error: code = Unavailable desc = connect: connection refused E1117 09:42:52.579894 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: all filers failed, last error: CreateEntry: rpc error: code = Unavailable desc = connect: connection refused --- PASS: TestPutToFilerUnverifiableCreateKeepsChunks (0.07s) === RUN TestPutToFilerRoutedAmbiguousKeepsNewerWrite W1117 09:42:52.630600 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = owner restarted mid-write W1117 09:42:52.639102 s3api_object_handlers_put.go:1300 putToFiler: ambiguous routed PUT for /buckets/b/o was superseded by another write; not committing stale entry --- PASS: TestPutToFilerRoutedAmbiguousKeepsNewerWrite (0.04s) === RUN TestPutToFilerRoutedRecoveryLosesRace W1117 09:42:52.667435 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = response lost E1117 09:42:52.683589 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry /buckets/b/o: precondition failed W1117 09:42:52.687197 s3api_object_handlers_put.go:1300 putToFiler: ambiguous routed PUT for /buckets/b/o was superseded by another write; not committing stale entry E1117 09:42:52.687791 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: CreateEntry /buckets/b/o: precondition failed --- PASS: TestPutToFilerRoutedRecoveryLosesRace (0.05s) === RUN TestPutToFilerRoutedAmbiguousEmptyPutKeepsNewerWrite W1117 09:42:52.712357 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = owner restarted mid-write W1117 09:42:52.719376 s3api_object_handlers_put.go:1300 putToFiler: ambiguous routed PUT for /buckets/b/o was superseded by another write; not committing stale entry --- PASS: TestPutToFilerRoutedAmbiguousEmptyPutKeepsNewerWrite (0.03s) === RUN TestPutToFilerRoutedAmbiguousEmptyPutStaleMetadata W1117 09:42:52.738686 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = response lost before commit W1117 09:42:52.746504 s3api_object_handlers_put.go:1307 putToFiler: ambiguous routed PUT for /buckets/b/o cannot prove an empty stored entry is its own; not claiming it --- PASS: TestPutToFilerRoutedAmbiguousEmptyPutStaleMetadata (0.03s) === RUN TestPutToFilerRoutedAmbiguousEmptyPutLanded W1117 09:42:52.765604 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = response lost after commit --- PASS: TestPutToFilerRoutedAmbiguousEmptyPutLanded (0.02s) === RUN TestPutToFilerRecoveryCreateNotReplayed W1117 09:42:52.796866 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = response lost E1117 09:42:52.818160 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: rpc error: code = Unavailable desc = response lost after commit E1117 09:42:52.821241 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: CreateEntry: rpc error: code = Unavailable desc = response lost after commit W1117 09:42:52.828315 s3api_object_handlers_put.go:1445 putToFiler: create entry for /buckets/b/o failed but the entry exists, treating the write as successful --- PASS: TestPutToFilerRecoveryCreateNotReplayed (0.06s) === RUN TestPutToFilerRoutedRecoveryCreateStaysOnOwner W1117 09:42:52.857062 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = response lost --- PASS: TestPutToFilerRoutedRecoveryCreateStaysOnOwner (0.05s) === RUN TestPutToFilerRoutedRecoveryOwnerDownIsUncertain W1117 09:42:52.904585 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = response lost E1117 09:42:52.925070 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: rpc error: code = Unavailable desc = connection refused E1117 09:42:52.927596 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/o: CreateEntry: rpc error: code = Unavailable desc = connection refused W1117 09:42:52.937095 s3api_object_handlers_put.go:1209 putToFiler: finalization failed, attempting to cleanup 1 orphaned chunks --- PASS: TestPutToFilerRoutedRecoveryOwnerDownIsUncertain (0.07s) === RUN TestPutToFilerRoutedAmbiguousEmptyPutAbsentNotRecreated W1117 09:42:52.969674 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = response lost after commit W1117 09:42:52.976891 s3api_object_handlers_put.go:1332 putToFiler: ambiguous routed PUT for /buckets/b/o left no entry and no chunks to verify; not re-applying entry --- PASS: TestPutToFilerRoutedAmbiguousEmptyPutAbsentNotRecreated (0.03s) === RUN TestPutToFilerRoutedAmbiguousEmptyPutForeignWriteId W1117 09:42:52.997790 s3api_object_handlers_put.go:1152 putToFiler: routed PUT to 127.0.0.1:1 failed for /buckets/b/o, falling back to lock: rpc error: code = Unavailable desc = response lost before commit W1117 09:42:53.006183 s3api_object_handlers_put.go:1307 putToFiler: ambiguous routed PUT for /buckets/b/o cannot prove an empty stored entry is its own; not claiming it --- PASS: TestPutToFilerRoutedAmbiguousEmptyPutForeignWriteId (0.03s) === RUN TestFetchChunkDataDecryptsVolumeCipher --- PASS: TestFetchChunkDataDecryptsVolumeCipher (0.03s) === RUN TestFetchChunkDataStopsAtChunkSize --- PASS: TestFetchChunkDataStopsAtChunkSize (0.02s) === RUN TestSuspendedPutIfMatchRoutesWithConditionAltKey --- PASS: TestSuspendedPutIfMatchRoutesWithConditionAltKey (0.05s) === RUN TestSuspendedPutIfNoneMatchWithDeleteMarkerLatest --- PASS: TestSuspendedPutIfNoneMatchWithDeleteMarkerLatest (0.04s) === RUN TestSuspendedPutIfMatchRecheckedWhenAltKeyIgnored W1117 09:42:53.183399 s3api_object_handlers_put.go:1146 putToFiler: routed PUT to 127.0.0.1:1 precondition-failed for /buckets/b/k; resending against /buckets/b/k.versions/v_v1 --- PASS: TestSuspendedPutIfMatchRecheckedWhenAltKeyIgnored (0.06s) === RUN TestTxnConditionHoldsQuotedStoredETag --- PASS: TestTxnConditionHoldsQuotedStoredETag (0.00s) === RUN TestDetectRequestedChecksumAlgorithm === RUN TestDetectRequestedChecksumAlgorithm/sdk_algorithm_header === RUN TestDetectRequestedChecksumAlgorithm/algorithm_header === RUN TestDetectRequestedChecksumAlgorithm/presigned_url_hoists_sdk_algorithm_to_query === RUN TestDetectRequestedChecksumAlgorithm/presigned_url_hoists_checksum-algorithm_to_query_(lowercase) === RUN TestDetectRequestedChecksumAlgorithm/presigned_url_hoists_individual_checksum_value === RUN TestDetectRequestedChecksumAlgorithm/unsupported_in_query_returns_error W1117 09:42:53.216719 s3api_object_handlers_put.go:1672 unsupported checksum algorithm in X-Amz-Sdk-Checksum-Algorithm: "MD5" === RUN TestDetectRequestedChecksumAlgorithm/no_checksum --- PASS: TestDetectRequestedChecksumAlgorithm (0.01s) --- PASS: TestDetectRequestedChecksumAlgorithm/sdk_algorithm_header (0.00s) --- PASS: TestDetectRequestedChecksumAlgorithm/algorithm_header (0.00s) --- PASS: TestDetectRequestedChecksumAlgorithm/presigned_url_hoists_sdk_algorithm_to_query (0.00s) --- PASS: TestDetectRequestedChecksumAlgorithm/presigned_url_hoists_checksum-algorithm_to_query_(lowercase) (0.00s) --- PASS: TestDetectRequestedChecksumAlgorithm/presigned_url_hoists_individual_checksum_value (0.00s) --- PASS: TestDetectRequestedChecksumAlgorithm/unsupported_in_query_returns_error (0.00s) --- PASS: TestDetectRequestedChecksumAlgorithm/no_checksum (0.00s) === RUN TestLookupHeaderOrQueryCaseInsensitive --- PASS: TestLookupHeaderOrQueryCaseInsensitive (0.00s) === RUN TestUploadChunkSizeFollowsFilerMaxMB === RUN TestUploadChunkSizeFollowsFilerMaxMB/filer_maxMB_unset === RUN TestUploadChunkSizeFollowsFilerMaxMB/filer_maxMB_negative === RUN TestUploadChunkSizeFollowsFilerMaxMB/filer_default === RUN TestUploadChunkSizeFollowsFilerMaxMB/filer_maxMB_32 === RUN TestUploadChunkSizeFollowsFilerMaxMB/clamped_to_int32_range --- PASS: TestUploadChunkSizeFollowsFilerMaxMB (0.00s) --- PASS: TestUploadChunkSizeFollowsFilerMaxMB/filer_maxMB_unset (0.00s) --- PASS: TestUploadChunkSizeFollowsFilerMaxMB/filer_maxMB_negative (0.00s) --- PASS: TestUploadChunkSizeFollowsFilerMaxMB/filer_default (0.00s) --- PASS: TestUploadChunkSizeFollowsFilerMaxMB/filer_maxMB_32 (0.00s) --- PASS: TestUploadChunkSizeFollowsFilerMaxMB/clamped_to_int32_range (0.00s) === RUN TestMapChunkedUploadErrorToS3Error === RUN TestMapChunkedUploadErrorToS3Error/truncated_source_read_maps_to_IncompleteBody === RUN TestMapChunkedUploadErrorToS3Error/volume_upload_unexpected_EOF_maps_to_InternalError === RUN TestMapChunkedUploadErrorToS3Error/payload_checksum_mismatch_maps_to_InvalidDigest === RUN TestMapChunkedUploadErrorToS3Error/other_errors_map_to_InternalError === RUN TestMapChunkedUploadErrorToS3Error/filer_read-only_verdict_maps_to_AccessDenied === RUN TestMapChunkedUploadErrorToS3Error/volume_server_read-only_write_stays_InternalError --- PASS: TestMapChunkedUploadErrorToS3Error (0.00s) --- PASS: TestMapChunkedUploadErrorToS3Error/truncated_source_read_maps_to_IncompleteBody (0.00s) --- PASS: TestMapChunkedUploadErrorToS3Error/volume_upload_unexpected_EOF_maps_to_InternalError (0.00s) --- PASS: TestMapChunkedUploadErrorToS3Error/payload_checksum_mismatch_maps_to_InvalidDigest (0.00s) --- PASS: TestMapChunkedUploadErrorToS3Error/other_errors_map_to_InternalError (0.00s) --- PASS: TestMapChunkedUploadErrorToS3Error/filer_read-only_verdict_maps_to_AccessDenied (0.00s) --- PASS: TestMapChunkedUploadErrorToS3Error/volume_server_read-only_write_stays_InternalError (0.00s) === RUN TestMapChunkedUploadErrorToS3ErrorClientDisconnect === RUN TestMapChunkedUploadErrorToS3ErrorClientDisconnect/peer_gone_maps_to_ClientDisconnected === RUN TestMapChunkedUploadErrorToS3ErrorClientDisconnect/peer_still_connected_stays_IncompleteBody === RUN TestMapChunkedUploadErrorToS3ErrorClientDisconnect/expired_deadline_stays_IncompleteBody === RUN TestMapChunkedUploadErrorToS3ErrorClientDisconnect/server_fault_under_a_canceled_context_stays_InternalError --- PASS: TestMapChunkedUploadErrorToS3ErrorClientDisconnect (0.00s) --- PASS: TestMapChunkedUploadErrorToS3ErrorClientDisconnect/peer_gone_maps_to_ClientDisconnected (0.00s) --- PASS: TestMapChunkedUploadErrorToS3ErrorClientDisconnect/peer_still_connected_stays_IncompleteBody (0.00s) --- PASS: TestMapChunkedUploadErrorToS3ErrorClientDisconnect/expired_deadline_stays_IncompleteBody (0.00s) --- PASS: TestMapChunkedUploadErrorToS3ErrorClientDisconnect/server_fault_under_a_canceled_context_stays_InternalError (0.00s) === RUN TestClientDisconnectedAPIError --- PASS: TestClientDisconnectedAPIError (0.00s) === RUN TestPutToFilerReadOnlyBucketIsAccessDenied E1117 09:42:53.246110 upload_chunked.go:283 chunked upload failed: assign volume: assign volume: assign volume: read only: /buckets/b (e.g. bucket over quota) (returning 0 partial chunks for cleanup) E1117 09:42:53.246494 s3api_object_handlers_put.go:779 putToFiler: chunked upload failed: assign volume: assign volume: assign volume: read only: /buckets/b (e.g. bucket over quota) --- PASS: TestPutToFilerReadOnlyBucketIsAccessDenied (0.02s) === RUN TestAssignNewVolumeReadOnlyKeepsSentinel --- PASS: TestAssignNewVolumeReadOnlyKeepsSentinel (0.01s) === RUN TestCopyChunksReadOnlyIsAccessDenied --- PASS: TestCopyChunksReadOnlyIsAccessDenied (0.02s) === RUN TestRenameSourceCandidates === RUN TestRenameSourceCandidates/bare_key === RUN TestRenameSourceCandidates/bare_key_with_leading_slash === RUN TestRenameSourceCandidates/bare_key_with_prefix === RUN TestRenameSourceCandidates/bucket_qualified === RUN TestRenameSourceCandidates/bucket_qualified_without_leading_slash === RUN TestRenameSourceCandidates/key_whose_first_segment_is_another_bucket === RUN TestRenameSourceCandidates/percent_encoded === RUN TestRenameSourceCandidates/plus_stays_literal === RUN TestRenameSourceCandidates/duplicate_slashes_collapse === RUN TestRenameSourceCandidates/bucket_name_alone_is_a_key === RUN TestRenameSourceCandidates/bucket_prefix_with_empty_key === RUN TestRenameSourceCandidates/missing_header === RUN TestRenameSourceCandidates/parent_traversal === RUN TestRenameSourceCandidates/encoded_parent_traversal === RUN TestRenameSourceCandidates/parent_traversal_behind_the_bucket --- PASS: TestRenameSourceCandidates (0.01s) --- PASS: TestRenameSourceCandidates/bare_key (0.00s) --- PASS: TestRenameSourceCandidates/bare_key_with_leading_slash (0.00s) --- PASS: TestRenameSourceCandidates/bare_key_with_prefix (0.00s) --- PASS: TestRenameSourceCandidates/bucket_qualified (0.00s) --- PASS: TestRenameSourceCandidates/bucket_qualified_without_leading_slash (0.00s) --- PASS: TestRenameSourceCandidates/key_whose_first_segment_is_another_bucket (0.00s) --- PASS: TestRenameSourceCandidates/percent_encoded (0.00s) --- PASS: TestRenameSourceCandidates/plus_stays_literal (0.00s) --- PASS: TestRenameSourceCandidates/duplicate_slashes_collapse (0.00s) --- PASS: TestRenameSourceCandidates/bucket_name_alone_is_a_key (0.00s) --- PASS: TestRenameSourceCandidates/bucket_prefix_with_empty_key (0.00s) --- PASS: TestRenameSourceCandidates/missing_header (0.00s) --- PASS: TestRenameSourceCandidates/parent_traversal (0.00s) --- PASS: TestRenameSourceCandidates/encoded_parent_traversal (0.00s) --- PASS: TestRenameSourceCandidates/parent_traversal_behind_the_bucket (0.00s) === RUN TestRenameSourceConditionalHeaders === RUN TestRenameSourceConditionalHeaders/if-match_hit === RUN TestRenameSourceConditionalHeaders/if-match_miss === RUN TestRenameSourceConditionalHeaders/if-match_star === RUN TestRenameSourceConditionalHeaders/if-none-match_miss === RUN TestRenameSourceConditionalHeaders/if-none-match_hit === RUN TestRenameSourceConditionalHeaders/if-none-match_star === RUN TestRenameSourceConditionalHeaders/modified_since_older === RUN TestRenameSourceConditionalHeaders/modified_since_newer === RUN TestRenameSourceConditionalHeaders/unmodified_since_newer === RUN TestRenameSourceConditionalHeaders/unmodified_since_older === RUN TestRenameSourceConditionalHeaders/unparsable_date === RUN TestRenameSourceConditionalHeaders/no_headers --- PASS: TestRenameSourceConditionalHeaders (0.01s) --- PASS: TestRenameSourceConditionalHeaders/if-match_hit (0.00s) --- PASS: TestRenameSourceConditionalHeaders/if-match_miss (0.00s) --- PASS: TestRenameSourceConditionalHeaders/if-match_star (0.00s) --- PASS: TestRenameSourceConditionalHeaders/if-none-match_miss (0.00s) --- PASS: TestRenameSourceConditionalHeaders/if-none-match_hit (0.00s) --- PASS: TestRenameSourceConditionalHeaders/if-none-match_star (0.00s) --- PASS: TestRenameSourceConditionalHeaders/modified_since_older (0.00s) --- PASS: TestRenameSourceConditionalHeaders/modified_since_newer (0.00s) --- PASS: TestRenameSourceConditionalHeaders/unmodified_since_newer (0.00s) --- PASS: TestRenameSourceConditionalHeaders/unmodified_since_older (0.00s) --- PASS: TestRenameSourceConditionalHeaders/unparsable_date (0.00s) --- PASS: TestRenameSourceConditionalHeaders/no_headers (0.00s) === RUN TestSourceConditionalHeaderPrecedence === RUN TestSourceConditionalHeaderPrecedence/X-Amz-Copy-Source-If-Match === RUN TestSourceConditionalHeaderPrecedence/X-Amz-Copy-Source-If-Match/matched_if-match_outranks_a_failing_if-unmodified-since === RUN TestSourceConditionalHeaderPrecedence/X-Amz-Copy-Source-If-Match/passed_if-none-match_outranks_a_failing_if-modified-since === RUN TestSourceConditionalHeaderPrecedence/X-Amz-Copy-Source-If-Match/a_failing_if-match_still_loses === RUN TestSourceConditionalHeaderPrecedence/X-Amz-Rename-Source-If-Match === RUN TestSourceConditionalHeaderPrecedence/X-Amz-Rename-Source-If-Match/matched_if-match_outranks_a_failing_if-unmodified-since === RUN TestSourceConditionalHeaderPrecedence/X-Amz-Rename-Source-If-Match/passed_if-none-match_outranks_a_failing_if-modified-since === RUN TestSourceConditionalHeaderPrecedence/X-Amz-Rename-Source-If-Match/a_failing_if-match_still_loses --- PASS: TestSourceConditionalHeaderPrecedence (0.01s) --- PASS: TestSourceConditionalHeaderPrecedence/X-Amz-Copy-Source-If-Match (0.00s) --- PASS: TestSourceConditionalHeaderPrecedence/X-Amz-Copy-Source-If-Match/matched_if-match_outranks_a_failing_if-unmodified-since (0.00s) --- PASS: TestSourceConditionalHeaderPrecedence/X-Amz-Copy-Source-If-Match/passed_if-none-match_outranks_a_failing_if-modified-since (0.00s) --- PASS: TestSourceConditionalHeaderPrecedence/X-Amz-Copy-Source-If-Match/a_failing_if-match_still_loses (0.00s) --- PASS: TestSourceConditionalHeaderPrecedence/X-Amz-Rename-Source-If-Match (0.00s) --- PASS: TestSourceConditionalHeaderPrecedence/X-Amz-Rename-Source-If-Match/matched_if-match_outranks_a_failing_if-unmodified-since (0.00s) --- PASS: TestSourceConditionalHeaderPrecedence/X-Amz-Rename-Source-If-Match/passed_if-none-match_outranks_a_failing_if-modified-since (0.00s) --- PASS: TestSourceConditionalHeaderPrecedence/X-Amz-Rename-Source-If-Match/a_failing_if-match_still_loses (0.00s) === RUN TestRenameTokenAnswersItsOwnRetry --- PASS: TestRenameTokenAnswersItsOwnRetry (0.00s) === RUN TestRenameTokenReuseAnswersBadRequest --- PASS: TestRenameTokenReuseAnswersBadRequest (0.00s) === RUN TestClassifyRenameToken === RUN TestClassifyRenameToken/nothing_at_the_destination === RUN TestClassifyRenameToken/request_without_a_token === RUN TestClassifyRenameToken/destination_the_rename_never_wrote === RUN TestClassifyRenameToken/another_rename's_token === RUN TestClassifyRenameToken/same_request === RUN TestClassifyRenameToken/token_reused_for_another_source === RUN TestClassifyRenameToken/token_of_a_rename_to_another_key === RUN TestClassifyRenameToken/expired_token === RUN TestClassifyRenameToken/unreadable_token W1117 09:42:53.326660 s3api_object_handlers_rename.go:301 RenameObject: unreadable rename token on dst.txt: unexpected end of JSON input --- PASS: TestClassifyRenameToken (0.01s) --- PASS: TestClassifyRenameToken/nothing_at_the_destination (0.00s) --- PASS: TestClassifyRenameToken/request_without_a_token (0.00s) --- PASS: TestClassifyRenameToken/destination_the_rename_never_wrote (0.00s) --- PASS: TestClassifyRenameToken/another_rename's_token (0.00s) --- PASS: TestClassifyRenameToken/same_request (0.00s) --- PASS: TestClassifyRenameToken/token_reused_for_another_source (0.00s) --- PASS: TestClassifyRenameToken/token_of_a_rename_to_another_key (0.00s) --- PASS: TestClassifyRenameToken/expired_token (0.00s) --- PASS: TestClassifyRenameToken/unreadable_token (0.00s) === RUN TestRetryRenameDecision === RUN TestRetryRenameDecision/same_request,_source_gone === RUN TestRetryRenameDecision/same_request,_source_present === RUN TestRetryRenameDecision/reused_token,_source_gone === RUN TestRetryRenameDecision/reused_token,_source_present === RUN TestRetryRenameDecision/unrelated,_source_gone === RUN TestRetryRenameDecision/unrelated,_source_present === RUN TestRetryRenameDecision/no_token,_destination_stamped --- PASS: TestRetryRenameDecision (0.01s) --- PASS: TestRetryRenameDecision/same_request,_source_gone (0.00s) --- PASS: TestRetryRenameDecision/same_request,_source_present (0.00s) --- PASS: TestRetryRenameDecision/reused_token,_source_gone (0.00s) --- PASS: TestRetryRenameDecision/reused_token,_source_present (0.00s) --- PASS: TestRetryRenameDecision/unrelated,_source_gone (0.00s) --- PASS: TestRetryRenameDecision/unrelated,_source_present (0.00s) --- PASS: TestRetryRenameDecision/no_token,_destination_stamped (0.00s) === RUN TestRouting_RenameObject I1117 09:42:53.335784 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_RenameObject (0.18s) === RUN TestSetResponseHeadersFiltersInternalExtendedKeys --- PASS: TestSetResponseHeadersFiltersInternalExtendedKeys (0.00s) === RUN TestPutObjectTaggingRejectsDuplicateKeys E1117 09:42:53.530681 s3api_object_handlers_tagging.go:141 PutObjectTaggingHandler duplicate tag keys /b/o?tagging --- PASS: TestPutObjectTaggingRejectsDuplicateKeys (0.02s) === RUN TestNewLifecycleTTLResolver_NilOnEmpty --- PASS: TestNewLifecycleTTLResolver_NilOnEmpty (0.00s) === RUN TestNewLifecycleTTLResolver_NilOnVersionedBucket --- PASS: TestNewLifecycleTTLResolver_NilOnVersionedBucket (0.00s) === RUN TestNewLifecycleTTLResolver_DropsTagFilteredRules --- PASS: TestNewLifecycleTTLResolver_DropsTagFilteredRules (0.00s) === RUN TestNewLifecycleTTLResolver_DropsDisabledAndNonExpirationDays --- PASS: TestNewLifecycleTTLResolver_DropsDisabledAndNonExpirationDays (0.00s) === RUN TestResolve_PrefixMatch --- PASS: TestResolve_PrefixMatch (0.00s) === RUN TestResolve_OverlappingRulesShorterExpirationWins --- PASS: TestResolve_OverlappingRulesShorterExpirationWins (0.00s) === RUN TestResolve_OverflowDefersToWorker --- PASS: TestResolve_OverflowDefersToWorker (0.00s) === RUN TestResolve_OverflowSkipsButShorterStillFires --- PASS: TestResolve_OverflowSkipsButShorterStillFires (0.00s) === RUN TestResolve_SizeFilter --- PASS: TestResolve_SizeFilter (0.00s) === RUN TestResolve_NilReceiverReturnsZero --- PASS: TestResolve_NilReceiverReturnsZero (0.00s) === RUN TestNewBucketConfigFromEntry_RefreshesLifecycleTTL --- PASS: TestNewBucketConfigFromEntry_RefreshesLifecycleTTL (0.01s) === RUN TestNewBucketConfigFromEntry_ObjectLockTreatedAsVersioned --- PASS: TestNewBucketConfigFromEntry_ObjectLockTreatedAsVersioned (0.00s) === RUN TestNewBucketConfigFromEntry_TtlFastPathOptIn --- PASS: TestNewBucketConfigFromEntry_TtlFastPathOptIn (0.00s) === RUN TestObjectLockRoutesUseDedicatedActions --- PASS: TestObjectLockRoutesUseDedicatedActions (0.18s) === RUN TestGovernanceBypassUsesDedicatedAuthorization === RUN TestGovernanceBypassUsesDedicatedAuthorization/dedicated_permission === RUN TestGovernanceBypassUsesDedicatedAuthorization/coarse_write === RUN TestGovernanceBypassUsesDedicatedAuthorization/admin --- PASS: TestGovernanceBypassUsesDedicatedAuthorization (0.03s) --- PASS: TestGovernanceBypassUsesDedicatedAuthorization/dedicated_permission (0.01s) --- PASS: TestGovernanceBypassUsesDedicatedAuthorization/coarse_write (0.00s) --- PASS: TestGovernanceBypassUsesDedicatedAuthorization/admin (0.01s) === RUN TestGovernanceBypassDoesNotInheritDeleteObjectVersion --- PASS: TestGovernanceBypassDoesNotInheritDeleteObjectVersion (0.01s) === RUN TestEvaluateGovernanceBypassRequestHeaderCase --- PASS: TestEvaluateGovernanceBypassRequestHeaderCase (0.01s) === RUN TestObjectLockHeadersRequireDedicatedActions === RUN TestObjectLockHeadersRequireDedicatedActions/writer_sets_retention === RUN TestObjectLockHeadersRequireDedicatedActions/writer_sets_legal_hold === RUN TestObjectLockHeadersRequireDedicatedActions/writer_plain_put === RUN TestObjectLockHeadersRequireDedicatedActions/locked_principal_sets_both --- PASS: TestObjectLockHeadersRequireDedicatedActions (0.01s) --- PASS: TestObjectLockHeadersRequireDedicatedActions/writer_sets_retention (0.00s) --- PASS: TestObjectLockHeadersRequireDedicatedActions/writer_sets_legal_hold (0.00s) --- PASS: TestObjectLockHeadersRequireDedicatedActions/writer_plain_put (0.00s) --- PASS: TestObjectLockHeadersRequireDedicatedActions/locked_principal_sets_both (0.00s) === RUN TestGovernanceBypassUsesBodyObjectKey --- PASS: TestGovernanceBypassUsesBodyObjectKey (0.00s) === RUN TestGovernanceBypassNormalizesBodyObjectKey --- PASS: TestGovernanceBypassNormalizesBodyObjectKey (0.00s) === RUN TestCoarseReadWriteDoNotGrantObjectLockActions --- PASS: TestCoarseReadWriteDoNotGrantObjectLockActions (0.00s) === RUN TestObjectLockActionsRoundTrip === RUN TestObjectLockActionsRoundTrip/GetObjectRetention === RUN TestObjectLockActionsRoundTrip/PutObjectRetention === RUN TestObjectLockActionsRoundTrip/GetObjectLegalHold === RUN TestObjectLockActionsRoundTrip/PutObjectLegalHold === RUN TestObjectLockActionsRoundTrip/GetBucketObjectLockConfiguration === RUN TestObjectLockActionsRoundTrip/PutBucketObjectLockConfiguration === RUN TestObjectLockActionsRoundTrip/BypassGovernanceRetention --- PASS: TestObjectLockActionsRoundTrip (0.00s) --- PASS: TestObjectLockActionsRoundTrip/GetObjectRetention (0.00s) --- PASS: TestObjectLockActionsRoundTrip/PutObjectRetention (0.00s) --- PASS: TestObjectLockActionsRoundTrip/GetObjectLegalHold (0.00s) --- PASS: TestObjectLockActionsRoundTrip/PutObjectLegalHold (0.00s) --- PASS: TestObjectLockActionsRoundTrip/GetBucketObjectLockConfiguration (0.00s) --- PASS: TestObjectLockActionsRoundTrip/PutBucketObjectLockConfiguration (0.00s) --- PASS: TestObjectLockActionsRoundTrip/BypassGovernanceRetention (0.00s) === RUN TestAnonymousBucketListAuthorization --- PASS: TestAnonymousBucketListAuthorization (0.00s) === RUN TestInternalObjectLockHeadersStrippedOnAuth --- PASS: TestInternalObjectLockHeadersStrippedOnAuth (0.00s) === RUN TestInternalHeadersStrippedWithoutAuth --- PASS: TestInternalHeadersStrippedWithoutAuth (0.00s) === RUN TestPutObjectLockConfigurationUsesDedicatedAction --- PASS: TestPutObjectLockConfigurationUsesDedicatedAction (0.12s) === RUN TestObjectWriteDoesNotAllowPutObjectLockConfiguration --- PASS: TestObjectWriteDoesNotAllowPutObjectLockConfiguration (0.00s) === RUN TestPutObjectLockConfigurationActionRoundTrips --- PASS: TestPutObjectLockConfigurationActionRoundTrips (0.00s) === RUN TestVeeamObjectLockBugFix === RUN TestVeeamObjectLockBugFix/Bug_case:_bucket_with_no_extended_attributes === RUN TestVeeamObjectLockBugFix/Fix_verification:_bucket_with_Object_Lock_enabled_via_boolean_flag === RUN TestVeeamObjectLockBugFix/Fix_verification:_bucket_with_Object_Lock_enabled_via_Enabled_constant --- PASS: TestVeeamObjectLockBugFix (0.00s) --- PASS: TestVeeamObjectLockBugFix/Bug_case:_bucket_with_no_extended_attributes (0.00s) --- PASS: TestVeeamObjectLockBugFix/Fix_verification:_bucket_with_Object_Lock_enabled_via_boolean_flag (0.00s) --- PASS: TestVeeamObjectLockBugFix/Fix_verification:_bucket_with_Object_Lock_enabled_via_Enabled_constant (0.00s) === RUN TestCopyDoesNotInheritLockKeys --- PASS: TestCopyDoesNotInheritLockKeys (0.00s) === RUN TestExtractObjectLockMetadataFromRequest === RUN TestExtractObjectLockMetadataFromRequest/Extract_COMPLIANCE_mode_and_retention_date === RUN TestExtractObjectLockMetadataFromRequest/Extract_GOVERNANCE_mode_and_retention_date === RUN TestExtractObjectLockMetadataFromRequest/Extract_legal_hold_ON === RUN TestExtractObjectLockMetadataFromRequest/Extract_legal_hold_OFF === RUN TestExtractObjectLockMetadataFromRequest/Handle_all_object_lock_headers_together === RUN TestExtractObjectLockMetadataFromRequest/Handle_no_object_lock_headers === RUN TestExtractObjectLockMetadataFromRequest/Handle_invalid_retention_date_-_should_return_error E1117 09:42:53.936830 s3api_object_handlers_put.go:2340 extractObjectLockMetadataFromRequest: failed to parse retention until date, expected format: 2006-01-02T15:04:05Z07:00, error: parsing time "invalid-date" as "2006-01-02T15:04:05Z07:00": cannot parse "invalid-date" as "2006" === RUN TestExtractObjectLockMetadataFromRequest/Handle_invalid_legal_hold_value_-_should_return_error E1117 09:42:53.938408 s3api_object_handlers_put.go:2354 extractObjectLockMetadataFromRequest: unexpected legal hold value provided, expected 'ON' or 'OFF' --- PASS: TestExtractObjectLockMetadataFromRequest (0.01s) --- PASS: TestExtractObjectLockMetadataFromRequest/Extract_COMPLIANCE_mode_and_retention_date (0.00s) --- PASS: TestExtractObjectLockMetadataFromRequest/Extract_GOVERNANCE_mode_and_retention_date (0.00s) --- PASS: TestExtractObjectLockMetadataFromRequest/Extract_legal_hold_ON (0.00s) --- PASS: TestExtractObjectLockMetadataFromRequest/Extract_legal_hold_OFF (0.00s) --- PASS: TestExtractObjectLockMetadataFromRequest/Handle_all_object_lock_headers_together (0.00s) --- PASS: TestExtractObjectLockMetadataFromRequest/Handle_no_object_lock_headers (0.00s) --- PASS: TestExtractObjectLockMetadataFromRequest/Handle_invalid_retention_date_-_should_return_error (0.00s) --- PASS: TestExtractObjectLockMetadataFromRequest/Handle_invalid_legal_hold_value_-_should_return_error (0.00s) === RUN TestAddObjectLockHeadersToResponse === RUN TestAddObjectLockHeadersToResponse/Add_COMPLIANCE_mode_and_retention_date_to_response === RUN TestAddObjectLockHeadersToResponse/Add_GOVERNANCE_mode_to_response === RUN TestAddObjectLockHeadersToResponse/Add_legal_hold_ON_to_response === RUN TestAddObjectLockHeadersToResponse/Add_legal_hold_OFF_to_response === RUN TestAddObjectLockHeadersToResponse/Add_all_object_lock_headers_to_response === RUN TestAddObjectLockHeadersToResponse/Handle_entry_with_no_object_lock_metadata === RUN TestAddObjectLockHeadersToResponse/Handle_entry_with_object_lock_mode_but_no_legal_hold_-_should_default_to_OFF === RUN TestAddObjectLockHeadersToResponse/Handle_entry_with_retention_date_but_no_legal_hold_-_should_default_to_OFF === RUN TestAddObjectLockHeadersToResponse/Handle_nil_entry_gracefully === RUN TestAddObjectLockHeadersToResponse/Handle_entry_with_nil_Extended_map_gracefully === RUN TestAddObjectLockHeadersToResponse/Handle_invalid_retention_timestamp_gracefully E1117 09:42:53.950630 s3api_object_handlers.go:2953 addObjectLockHeadersToResponse: failed to parse retention until date from stored metadata (dateStr: invalid-timestamp): strconv.ParseInt: parsing "invalid-timestamp": invalid syntax --- PASS: TestAddObjectLockHeadersToResponse (0.01s) --- PASS: TestAddObjectLockHeadersToResponse/Add_COMPLIANCE_mode_and_retention_date_to_response (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Add_GOVERNANCE_mode_to_response (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Add_legal_hold_ON_to_response (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Add_legal_hold_OFF_to_response (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Add_all_object_lock_headers_to_response (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Handle_entry_with_no_object_lock_metadata (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Handle_entry_with_object_lock_mode_but_no_legal_hold_-_should_default_to_OFF (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Handle_entry_with_retention_date_but_no_legal_hold_-_should_default_to_OFF (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Handle_nil_entry_gracefully (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Handle_entry_with_nil_Extended_map_gracefully (0.00s) --- PASS: TestAddObjectLockHeadersToResponse/Handle_invalid_retention_timestamp_gracefully (0.00s) === RUN TestObjectLockHeaderRoundTrip === RUN TestObjectLockHeaderRoundTrip/Complete_round_trip_for_COMPLIANCE_mode === RUN TestObjectLockHeaderRoundTrip/Complete_round_trip_for_GOVERNANCE_mode --- PASS: TestObjectLockHeaderRoundTrip (0.00s) --- PASS: TestObjectLockHeaderRoundTrip/Complete_round_trip_for_COMPLIANCE_mode (0.00s) --- PASS: TestObjectLockHeaderRoundTrip/Complete_round_trip_for_GOVERNANCE_mode (0.00s) === RUN TestValidateObjectLockHeaders === RUN TestValidateObjectLockHeaders/Valid_COMPLIANCE_mode_with_retention_date_on_versioned_bucket === RUN TestValidateObjectLockHeaders/Valid_GOVERNANCE_mode_with_retention_date_on_versioned_bucket === RUN TestValidateObjectLockHeaders/Valid_legal_hold_ON_on_versioned_bucket === RUN TestValidateObjectLockHeaders/Valid_legal_hold_OFF_on_versioned_bucket === RUN TestValidateObjectLockHeaders/Invalid_object_lock_mode === RUN TestValidateObjectLockHeaders/Invalid_legal_hold_status === RUN TestValidateObjectLockHeaders/Object_lock_headers_on_non-versioned_bucket === RUN TestValidateObjectLockHeaders/Invalid_retention_date_format === RUN TestValidateObjectLockHeaders/Retention_date_in_the_past === RUN TestValidateObjectLockHeaders/Mode_without_retention_date === RUN TestValidateObjectLockHeaders/Retention_date_without_mode === RUN TestValidateObjectLockHeaders/Governance_bypass_header_on_non-versioned_bucket === RUN TestValidateObjectLockHeaders/Title-case_governance_bypass_header_on_non-versioned_bucket === RUN TestValidateObjectLockHeaders/Governance_bypass_header_on_versioned_bucket_should_pass === RUN TestValidateObjectLockHeaders/No_object_lock_headers_should_pass === RUN TestValidateObjectLockHeaders/Mixed_valid_headers_should_pass --- PASS: TestValidateObjectLockHeaders (0.01s) --- PASS: TestValidateObjectLockHeaders/Valid_COMPLIANCE_mode_with_retention_date_on_versioned_bucket (0.00s) --- PASS: TestValidateObjectLockHeaders/Valid_GOVERNANCE_mode_with_retention_date_on_versioned_bucket (0.00s) --- PASS: TestValidateObjectLockHeaders/Valid_legal_hold_ON_on_versioned_bucket (0.00s) --- PASS: TestValidateObjectLockHeaders/Valid_legal_hold_OFF_on_versioned_bucket (0.00s) --- PASS: TestValidateObjectLockHeaders/Invalid_object_lock_mode (0.00s) --- PASS: TestValidateObjectLockHeaders/Invalid_legal_hold_status (0.00s) --- PASS: TestValidateObjectLockHeaders/Object_lock_headers_on_non-versioned_bucket (0.00s) --- PASS: TestValidateObjectLockHeaders/Invalid_retention_date_format (0.00s) --- PASS: TestValidateObjectLockHeaders/Retention_date_in_the_past (0.00s) --- PASS: TestValidateObjectLockHeaders/Mode_without_retention_date (0.00s) --- PASS: TestValidateObjectLockHeaders/Retention_date_without_mode (0.00s) --- PASS: TestValidateObjectLockHeaders/Governance_bypass_header_on_non-versioned_bucket (0.00s) --- PASS: TestValidateObjectLockHeaders/Title-case_governance_bypass_header_on_non-versioned_bucket (0.00s) --- PASS: TestValidateObjectLockHeaders/Governance_bypass_header_on_versioned_bucket_should_pass (0.00s) --- PASS: TestValidateObjectLockHeaders/No_object_lock_headers_should_pass (0.00s) --- PASS: TestValidateObjectLockHeaders/Mixed_valid_headers_should_pass (0.00s) === RUN TestMapValidationErrorToS3Error === RUN TestMapValidationErrorToS3Error/ErrObjectLockVersioningRequired === RUN TestMapValidationErrorToS3Error/ErrInvalidObjectLockMode === RUN TestMapValidationErrorToS3Error/ErrInvalidLegalHoldStatus === RUN TestMapValidationErrorToS3Error/ErrInvalidRetentionDateFormat === RUN TestMapValidationErrorToS3Error/ErrRetentionDateMustBeFuture === RUN TestMapValidationErrorToS3Error/ErrObjectLockModeRequiresDate === RUN TestMapValidationErrorToS3Error/ErrRetentionDateRequiresMode === RUN TestMapValidationErrorToS3Error/ErrGovernanceBypassVersioningRequired === RUN TestMapValidationErrorToS3Error/Unknown_error_defaults_to_ErrInvalidRequest --- PASS: TestMapValidationErrorToS3Error (0.01s) --- PASS: TestMapValidationErrorToS3Error/ErrObjectLockVersioningRequired (0.00s) --- PASS: TestMapValidationErrorToS3Error/ErrInvalidObjectLockMode (0.00s) --- PASS: TestMapValidationErrorToS3Error/ErrInvalidLegalHoldStatus (0.00s) --- PASS: TestMapValidationErrorToS3Error/ErrInvalidRetentionDateFormat (0.00s) --- PASS: TestMapValidationErrorToS3Error/ErrRetentionDateMustBeFuture (0.00s) --- PASS: TestMapValidationErrorToS3Error/ErrObjectLockModeRequiresDate (0.00s) --- PASS: TestMapValidationErrorToS3Error/ErrRetentionDateRequiresMode (0.00s) --- PASS: TestMapValidationErrorToS3Error/ErrGovernanceBypassVersioningRequired (0.00s) --- PASS: TestMapValidationErrorToS3Error/Unknown_error_defaults_to_ErrInvalidRequest (0.00s) === RUN TestObjectLockPermissionLogic === RUN TestObjectLockPermissionLogic/Non-versioned_bucket_PUT_operation_logic s3api_object_lock_headers_test.go:634: For non-versioned buckets: s3api_object_lock_headers_test.go:635: - PUT operations overwrite existing objects s3api_object_lock_headers_test.go:636: - Must check existing object lock protections before allowing overwrite s3api_object_lock_headers_test.go:637: - Governance bypass headers can be used to override GOVERNANCE mode retention s3api_object_lock_headers_test.go:638: - COMPLIANCE mode retention and legal holds cannot be bypassed === RUN TestObjectLockPermissionLogic/Versioned_bucket_PUT_operation_logic s3api_object_lock_headers_test.go:651: For versioned buckets: s3api_object_lock_headers_test.go:652: - PUT operations create new versions without overwriting existing objects s3api_object_lock_headers_test.go:653: - No need to check existing object lock protections s3api_object_lock_headers_test.go:654: - Only validate object lock headers for the new version being created s3api_object_lock_headers_test.go:655: - Each version has independent object lock settings === RUN TestObjectLockPermissionLogic/Governance_bypass_header_validation s3api_object_lock_headers_test.go:664: Governance bypass behavior: s3api_object_lock_headers_test.go:665: - Only valid on versioned buckets (header validation) s3api_object_lock_headers_test.go:666: - For non-versioned buckets: Allows overwriting objects under GOVERNANCE retention s3api_object_lock_headers_test.go:667: - For versioned buckets: Not typically needed for PUT operations s3api_object_lock_headers_test.go:668: - Must have s3:BypassGovernanceRetention permission --- PASS: TestObjectLockPermissionLogic (0.01s) --- PASS: TestObjectLockPermissionLogic/Non-versioned_bucket_PUT_operation_logic (0.00s) --- PASS: TestObjectLockPermissionLogic/Versioned_bucket_PUT_operation_logic (0.00s) --- PASS: TestObjectLockPermissionLogic/Governance_bypass_header_validation (0.00s) === RUN TestSetObjectOwnerFromRequest === RUN TestSetObjectOwnerFromRequest/BucketOwnerEnforced_-_use_bucket_owner === RUN TestSetObjectOwnerFromRequest/ObjectWriter_-_use_uploader === RUN TestSetObjectOwnerFromRequest/BucketOwnerPreferred_-_use_uploader === RUN TestSetObjectOwnerFromRequest/BucketOwnerEnforced_but_owner_is_nil_-_fallback_to_uploader === RUN TestSetObjectOwnerFromRequest/BucketOwnerEnforced_but_owner_ID_is_nil_-_fallback_to_uploader === RUN TestSetObjectOwnerFromRequest/Bucket_metadata_error_-_fallback_to_uploader === RUN TestSetObjectOwnerFromRequest/Bucket_registry_is_nil_-_fallback_to_uploader === RUN TestSetObjectOwnerFromRequest/Empty_uploader_account_ID_-_no_owner_set --- PASS: TestSetObjectOwnerFromRequest (0.01s) --- PASS: TestSetObjectOwnerFromRequest/BucketOwnerEnforced_-_use_bucket_owner (0.00s) --- PASS: TestSetObjectOwnerFromRequest/ObjectWriter_-_use_uploader (0.00s) --- PASS: TestSetObjectOwnerFromRequest/BucketOwnerPreferred_-_use_uploader (0.00s) --- PASS: TestSetObjectOwnerFromRequest/BucketOwnerEnforced_but_owner_is_nil_-_fallback_to_uploader (0.00s) --- PASS: TestSetObjectOwnerFromRequest/BucketOwnerEnforced_but_owner_ID_is_nil_-_fallback_to_uploader (0.00s) --- PASS: TestSetObjectOwnerFromRequest/Bucket_metadata_error_-_fallback_to_uploader (0.00s) --- PASS: TestSetObjectOwnerFromRequest/Bucket_registry_is_nil_-_fallback_to_uploader (0.00s) --- PASS: TestSetObjectOwnerFromRequest/Empty_uploader_account_ID_-_no_owner_set (0.00s) === RUN TestRequestedPartNumber --- PASS: TestRequestedPartNumber (0.00s) === RUN TestPartByteRange W1117 09:42:53.994534 s3api_object_handlers.go:3509 partByteRange: object has no part 3, it has 2 parts W1117 09:42:53.995734 s3api_object_handlers.go:3509 partByteRange: object has no part 3, it has 2 parts --- PASS: TestPartByteRange (0.00s) === RUN TestPartByteRangeSparsePartNumbers W1117 09:42:53.997788 s3api_object_handlers.go:3509 partByteRange: object has no part 2, it has 2 parts --- PASS: TestPartByteRangeSparsePartNumbers (0.00s) === RUN TestSetResponseHeadersSkipsChecksumForPart --- PASS: TestSetResponseHeadersSkipsChecksumForPart (0.00s) === RUN TestParseAndValidateRangeRejectsMalformedNumericOffsets === RUN TestParseAndValidateRangeRejectsMalformedNumericOffsets/invalid_start === RUN TestParseAndValidateRangeRejectsMalformedNumericOffsets/invalid_end === RUN TestParseAndValidateRangeRejectsMalformedNumericOffsets/invalid_open_ended_start --- PASS: TestParseAndValidateRangeRejectsMalformedNumericOffsets (0.01s) --- PASS: TestParseAndValidateRangeRejectsMalformedNumericOffsets/invalid_start (0.00s) --- PASS: TestParseAndValidateRangeRejectsMalformedNumericOffsets/invalid_end (0.00s) --- PASS: TestParseAndValidateRangeRejectsMalformedNumericOffsets/invalid_open_ended_start (0.00s) === RUN TestHeadObjectRange --- PASS: TestHeadObjectRange (0.04s) === RUN TestValidateRetention === RUN TestValidateRetention/Valid_GOVERNANCE_retention === RUN TestValidateRetention/Valid_COMPLIANCE_retention === RUN TestValidateRetention/Missing_Mode === RUN TestValidateRetention/Missing_RetainUntilDate === RUN TestValidateRetention/Invalid_Mode === RUN TestValidateRetention/Past_RetainUntilDate === RUN TestValidateRetention/Empty_retention --- PASS: TestValidateRetention (0.00s) --- PASS: TestValidateRetention/Valid_GOVERNANCE_retention (0.00s) --- PASS: TestValidateRetention/Valid_COMPLIANCE_retention (0.00s) --- PASS: TestValidateRetention/Missing_Mode (0.00s) --- PASS: TestValidateRetention/Missing_RetainUntilDate (0.00s) --- PASS: TestValidateRetention/Invalid_Mode (0.00s) --- PASS: TestValidateRetention/Past_RetainUntilDate (0.00s) --- PASS: TestValidateRetention/Empty_retention (0.00s) === RUN TestValidateLegalHold === RUN TestValidateLegalHold/Valid_ON_status === RUN TestValidateLegalHold/Valid_OFF_status === RUN TestValidateLegalHold/Invalid_status === RUN TestValidateLegalHold/Empty_status === RUN TestValidateLegalHold/Lowercase_on === RUN TestValidateLegalHold/Lowercase_off --- PASS: TestValidateLegalHold (0.00s) --- PASS: TestValidateLegalHold/Valid_ON_status (0.00s) --- PASS: TestValidateLegalHold/Valid_OFF_status (0.00s) --- PASS: TestValidateLegalHold/Invalid_status (0.00s) --- PASS: TestValidateLegalHold/Empty_status (0.00s) --- PASS: TestValidateLegalHold/Lowercase_on (0.00s) --- PASS: TestValidateLegalHold/Lowercase_off (0.00s) === RUN TestParseObjectRetention === RUN TestParseObjectRetention/Valid_retention_XML === RUN TestParseObjectRetention/Valid_compliance_retention_XML === RUN TestParseObjectRetention/Valid_retention_XML_without_namespace_(Veeam_compatibility) === RUN TestParseObjectRetention/Valid_compliance_retention_XML_without_namespace_(Veeam_compatibility) === RUN TestParseObjectRetention/Empty_XML_body === RUN TestParseObjectRetention/Invalid_XML === RUN TestParseObjectRetention/Malformed_XML === RUN TestParseObjectRetention/Missing_Mode === RUN TestParseObjectRetention/Missing_RetainUntilDate --- PASS: TestParseObjectRetention (0.02s) --- PASS: TestParseObjectRetention/Valid_retention_XML (0.00s) --- PASS: TestParseObjectRetention/Valid_compliance_retention_XML (0.00s) --- PASS: TestParseObjectRetention/Valid_retention_XML_without_namespace_(Veeam_compatibility) (0.00s) --- PASS: TestParseObjectRetention/Valid_compliance_retention_XML_without_namespace_(Veeam_compatibility) (0.00s) --- PASS: TestParseObjectRetention/Empty_XML_body (0.00s) --- PASS: TestParseObjectRetention/Invalid_XML (0.00s) --- PASS: TestParseObjectRetention/Malformed_XML (0.00s) --- PASS: TestParseObjectRetention/Missing_Mode (0.00s) --- PASS: TestParseObjectRetention/Missing_RetainUntilDate (0.00s) === RUN TestParseObjectLegalHold === RUN TestParseObjectLegalHold/Valid_legal_hold_ON === RUN TestParseObjectLegalHold/Valid_legal_hold_OFF === RUN TestParseObjectLegalHold/Valid_legal_hold_ON_without_namespace === RUN TestParseObjectLegalHold/Valid_legal_hold_OFF_without_namespace === RUN TestParseObjectLegalHold/Empty_XML_body === RUN TestParseObjectLegalHold/Invalid_XML === RUN TestParseObjectLegalHold/Missing_Status --- PASS: TestParseObjectLegalHold (0.01s) --- PASS: TestParseObjectLegalHold/Valid_legal_hold_ON (0.00s) --- PASS: TestParseObjectLegalHold/Valid_legal_hold_OFF (0.00s) --- PASS: TestParseObjectLegalHold/Valid_legal_hold_ON_without_namespace (0.00s) --- PASS: TestParseObjectLegalHold/Valid_legal_hold_OFF_without_namespace (0.00s) --- PASS: TestParseObjectLegalHold/Empty_XML_body (0.00s) --- PASS: TestParseObjectLegalHold/Invalid_XML (0.00s) --- PASS: TestParseObjectLegalHold/Missing_Status (0.00s) === RUN TestParseObjectLockConfiguration === RUN TestParseObjectLockConfiguration/Valid_object_lock_configuration === RUN TestParseObjectLockConfiguration/Valid_object_lock_configuration_with_rule === RUN TestParseObjectLockConfiguration/Valid_object_lock_configuration_without_namespace === RUN TestParseObjectLockConfiguration/Valid_object_lock_configuration_with_rule_without_namespace === RUN TestParseObjectLockConfiguration/Empty_XML_body === RUN TestParseObjectLockConfiguration/Invalid_XML --- PASS: TestParseObjectLockConfiguration (0.01s) --- PASS: TestParseObjectLockConfiguration/Valid_object_lock_configuration (0.00s) --- PASS: TestParseObjectLockConfiguration/Valid_object_lock_configuration_with_rule (0.00s) --- PASS: TestParseObjectLockConfiguration/Valid_object_lock_configuration_without_namespace (0.00s) --- PASS: TestParseObjectLockConfiguration/Valid_object_lock_configuration_with_rule_without_namespace (0.00s) --- PASS: TestParseObjectLockConfiguration/Empty_XML_body (0.00s) --- PASS: TestParseObjectLockConfiguration/Invalid_XML (0.00s) === RUN TestValidateObjectLockConfiguration === RUN TestValidateObjectLockConfiguration/Valid_config_with_ObjectLockEnabled_only === RUN TestValidateObjectLockConfiguration/Missing_ObjectLockEnabled === RUN TestValidateObjectLockConfiguration/Valid_config_with_rule_and_days === RUN TestValidateObjectLockConfiguration/Valid_config_with_rule_and_years === RUN TestValidateObjectLockConfiguration/Invalid_ObjectLockEnabled_value === RUN TestValidateObjectLockConfiguration/Invalid_rule_-_missing_mode === RUN TestValidateObjectLockConfiguration/Invalid_rule_-_both_days_and_years === RUN TestValidateObjectLockConfiguration/Invalid_rule_-_neither_days_nor_years === RUN TestValidateObjectLockConfiguration/Invalid_rule_-_invalid_mode === RUN TestValidateObjectLockConfiguration/Invalid_rule_-_days_out_of_range === RUN TestValidateObjectLockConfiguration/Invalid_rule_-_years_out_of_range === RUN TestValidateObjectLockConfiguration/Invalid_rule_-_missing_DefaultRetention --- PASS: TestValidateObjectLockConfiguration (0.01s) --- PASS: TestValidateObjectLockConfiguration/Valid_config_with_ObjectLockEnabled_only (0.00s) --- PASS: TestValidateObjectLockConfiguration/Missing_ObjectLockEnabled (0.00s) --- PASS: TestValidateObjectLockConfiguration/Valid_config_with_rule_and_days (0.00s) --- PASS: TestValidateObjectLockConfiguration/Valid_config_with_rule_and_years (0.00s) --- PASS: TestValidateObjectLockConfiguration/Invalid_ObjectLockEnabled_value (0.00s) --- PASS: TestValidateObjectLockConfiguration/Invalid_rule_-_missing_mode (0.00s) --- PASS: TestValidateObjectLockConfiguration/Invalid_rule_-_both_days_and_years (0.00s) --- PASS: TestValidateObjectLockConfiguration/Invalid_rule_-_neither_days_nor_years (0.00s) --- PASS: TestValidateObjectLockConfiguration/Invalid_rule_-_invalid_mode (0.00s) --- PASS: TestValidateObjectLockConfiguration/Invalid_rule_-_days_out_of_range (0.00s) --- PASS: TestValidateObjectLockConfiguration/Invalid_rule_-_years_out_of_range (0.00s) --- PASS: TestValidateObjectLockConfiguration/Invalid_rule_-_missing_DefaultRetention (0.00s) === RUN TestValidateDefaultRetention === RUN TestValidateDefaultRetention/Valid_retention_with_days === RUN TestValidateDefaultRetention/Valid_retention_with_years === RUN TestValidateDefaultRetention/Missing_mode === RUN TestValidateDefaultRetention/Invalid_mode === RUN TestValidateDefaultRetention/Both_days_and_years_specified === RUN TestValidateDefaultRetention/Neither_days_nor_years_specified === RUN TestValidateDefaultRetention/Zero_years --- PASS: TestValidateDefaultRetention (0.00s) --- PASS: TestValidateDefaultRetention/Valid_retention_with_days (0.00s) --- PASS: TestValidateDefaultRetention/Valid_retention_with_years (0.00s) --- PASS: TestValidateDefaultRetention/Missing_mode (0.00s) --- PASS: TestValidateDefaultRetention/Invalid_mode (0.00s) --- PASS: TestValidateDefaultRetention/Both_days_and_years_specified (0.00s) --- PASS: TestValidateDefaultRetention/Neither_days_nor_years_specified (0.00s) --- PASS: TestValidateDefaultRetention/Zero_years (0.00s) === RUN TestStoreObjectLockConfigurationClearsStaleYears --- PASS: TestStoreObjectLockConfigurationClearsStaleYears (0.00s) === RUN TestNullVersionLockWritesToPlainEntry --- PASS: TestNullVersionLockWritesToPlainEntry (0.02s) === RUN TestGetObjectEntryPreservesTransientErrors --- PASS: TestGetObjectEntryPreservesTransientErrors (0.01s) === RUN TestGetObjectEntryPreservesUnavailableWithNotFoundMessage --- PASS: TestGetObjectEntryPreservesUnavailableWithNotFoundMessage (0.01s) === RUN TestGetObjectEntryNotFoundTextStatusGate === RUN TestGetObjectEntryNotFoundTextStatusGate/unknown_keeps_sentinel_text === RUN TestGetObjectEntryNotFoundTextStatusGate/internal_with_sentinel_text === RUN TestGetObjectEntryNotFoundTextStatusGate/not-found_status --- PASS: TestGetObjectEntryNotFoundTextStatusGate (0.04s) --- PASS: TestGetObjectEntryNotFoundTextStatusGate/unknown_keeps_sentinel_text (0.01s) --- PASS: TestGetObjectEntryNotFoundTextStatusGate/internal_with_sentinel_text (0.01s) --- PASS: TestGetObjectEntryNotFoundTextStatusGate/not-found_status (0.01s) === RUN TestGetObjectEntryPreservesTransientFallbackError --- PASS: TestGetObjectEntryPreservesTransientFallbackError (0.02s) === RUN TestGetObjectEntryInvalidVersionIdStillNotFound --- PASS: TestGetObjectEntryInvalidVersionIdStillNotFound (0.00s) === RUN TestGetObjectEntryMissStillNotFound --- PASS: TestGetObjectEntryMissStillNotFound (0.01s) === RUN TestPutObjectLegalHoldMissingObjectIsNoSuchKey E1117 09:42:54.247590 s3api_object_handlers_legal_hold.go:50 PutObjectLegalHoldHandler: failed to set legal hold: failed to get latest version for object b/missing: latest version not found --- PASS: TestPutObjectLegalHoldMissingObjectIsNoSuchKey (0.02s) === RUN TestPutObjectLegalHoldFailedReadIsNotNoSuchKey E1117 09:42:54.274252 s3api_object_handlers_legal_hold.go:50 PutObjectLegalHoldHandler: failed to set legal hold: failed to get version v1 for object b/key: version v1 not found: all filers failed, last error: LookupEntry1: rpc error: code = Internal desc = disk read failed --- PASS: TestPutObjectLegalHoldFailedReadIsNotNoSuchKey (0.03s) === RUN TestLegalHoldOnDeleteMarkerIsNoSuchKey E1117 09:42:54.292945 s3api_object_handlers_legal_hold.go:50 PutObjectLegalHoldHandler: failed to set legal hold: latest version of object b/key is a delete marker: latest version not found E1117 09:42:54.297851 s3api_object_handlers_legal_hold.go:50 PutObjectLegalHoldHandler: failed to set legal hold: version m1 of object b/key is a delete marker: version not found --- PASS: TestLegalHoldOnDeleteMarkerIsNoSuchKey (0.04s) === RUN TestLockOnDeleteMarkerDoesNotBlockRemoval --- PASS: TestLockOnDeleteMarkerDoesNotBlockRemoval (0.02s) === RUN TestRoutedDeleteOfLockedDeleteMarkerSkipsWormGuard I1117 09:42:54.336374 s3api_object_handlers_delete.go:227 DeleteObjectHandler b key --- PASS: TestRoutedDeleteOfLockedDeleteMarkerSkipsWormGuard (0.02s) === RUN TestOwnerRecentlyUnreachable --- PASS: TestOwnerRecentlyUnreachable (0.00s) === RUN TestMultipartUploadOnOwnerFiler --- PASS: TestMultipartUploadOnOwnerFiler (0.83s) === RUN TestMultipartPartCreateErrorChecksUploadOwner E1117 09:42:55.209733 s3api_object_handlers_put.go:1065 putToFiler: CreateEntry returned error: CreateEntry: create parent directories: i/o timeout E1117 09:42:55.210534 s3api_object_handlers_put.go:1186 putToFiler: failed to create entry for /buckets/b/.uploads/up1/0001_x.part: CreateEntry: create parent directories: i/o timeout W1117 09:42:55.213686 s3api_object_handlers_put.go:1445 putToFiler: create entry for /buckets/b/.uploads/up1/0001_x.part failed but the entry exists, treating the write as successful --- PASS: TestMultipartPartCreateErrorChecksUploadOwner (0.03s) === RUN TestListPartsAfterOwnerChange --- PASS: TestListPartsAfterOwnerChange (0.06s) === RUN TestUploadPartAfterOwnerChange --- PASS: TestUploadPartAfterOwnerChange (0.06s) === RUN TestListPartsMergesPriorOwnerParts --- PASS: TestListPartsMergesPriorOwnerParts (0.98s) === RUN TestCompleteFailsWhenPriorOwnerListingFails E1117 09:42:56.390800 filer_multipart.go:400 completeMultipartUpload b 0fb17d4690a62965c850aca2ac98bd432bdd2331_01a1e8e35a4d72f8829f95555c3d547f error: rpc error: code = Unavailable desc = store unavailable --- PASS: TestCompleteFailsWhenPriorOwnerListingFails (0.07s) === RUN TestUploadLookupFailsWhenPriorOwnerUnreachable E1117 09:42:56.437218 filer_multipart.go:1596 listObjectParts b 0fb17d4690a62965c850aca2ac98bd432bdd2331_01a1e8e35a8f739e9f18bbb13b47a1c0 error: LookupEntry1: rpc error: code = Unavailable desc = store unavailable E1117 09:42:56.449662 filer_multipart.go:1596 listObjectParts b 0fb17d4690a62965c850aca2ac98bd432bdd2331_01a1e8e35a8f739e9f18bbb13b47a1c0 error: LookupEntry1: rpc error: code = Unavailable desc = store unavailable --- PASS: TestUploadLookupFailsWhenPriorOwnerUnreachable (0.06s) === RUN TestBuildWriteCondition === RUN TestBuildWriteCondition/no_headers_is_unconditional === RUN TestBuildWriteCondition/If-None-Match_*_to_IF_NOT_EXISTS === RUN TestBuildWriteCondition/If-Match_*_to_IF_EXISTS === RUN TestBuildWriteCondition/If-Match_strong_etag_to_IF_ETAG_MATCH === RUN TestBuildWriteCondition/If-None-Match_strong_etag_to_IF_ETAG_NOT_MATCH === RUN TestBuildWriteCondition/weak_etag_reduces_verbatim === RUN TestBuildWriteCondition/etag_list_reduces === RUN TestBuildWriteCondition/both_match_and_none-match_reduce_to_clauses === RUN TestBuildWriteCondition/time-based_reduces_to_a_unix_bound === RUN TestBuildWriteCondition/If-Match_hides_If-Unmodified-Since === RUN TestBuildWriteCondition/If-None-Match_hides_If-Modified-Since === RUN TestBuildWriteCondition/unparseable_date_falls_back --- PASS: TestBuildWriteCondition (0.01s) --- PASS: TestBuildWriteCondition/no_headers_is_unconditional (0.00s) --- PASS: TestBuildWriteCondition/If-None-Match_*_to_IF_NOT_EXISTS (0.00s) --- PASS: TestBuildWriteCondition/If-Match_*_to_IF_EXISTS (0.00s) --- PASS: TestBuildWriteCondition/If-Match_strong_etag_to_IF_ETAG_MATCH (0.00s) --- PASS: TestBuildWriteCondition/If-None-Match_strong_etag_to_IF_ETAG_NOT_MATCH (0.00s) --- PASS: TestBuildWriteCondition/weak_etag_reduces_verbatim (0.00s) --- PASS: TestBuildWriteCondition/etag_list_reduces (0.00s) --- PASS: TestBuildWriteCondition/both_match_and_none-match_reduce_to_clauses (0.00s) --- PASS: TestBuildWriteCondition/time-based_reduces_to_a_unix_bound (0.00s) --- PASS: TestBuildWriteCondition/If-Match_hides_If-Unmodified-Since (0.00s) --- PASS: TestBuildWriteCondition/If-None-Match_hides_If-Modified-Since (0.00s) --- PASS: TestBuildWriteCondition/unparseable_date_falls_back (0.00s) === RUN TestParseConditionalHeadersAcceptsHTTPDateFormats === RUN TestParseConditionalHeadersAcceptsHTTPDateFormats/If-Modified-Since_RFC850 === RUN TestParseConditionalHeadersAcceptsHTTPDateFormats/If-Unmodified-Since_ANSIC === RUN TestParseConditionalHeadersAcceptsHTTPDateFormats/If-Modified-Since_RFC1123_UTC_zone --- PASS: TestParseConditionalHeadersAcceptsHTTPDateFormats (0.00s) --- PASS: TestParseConditionalHeadersAcceptsHTTPDateFormats/If-Modified-Since_RFC850 (0.00s) --- PASS: TestParseConditionalHeadersAcceptsHTTPDateFormats/If-Unmodified-Since_ANSIC (0.00s) --- PASS: TestParseConditionalHeadersAcceptsHTTPDateFormats/If-Modified-Since_RFC1123_UTC_zone (0.00s) === RUN TestValidateConditionalCopyHeadersAcceptsHTTPDateFormats === RUN TestValidateConditionalCopyHeadersAcceptsHTTPDateFormats/X-Amz-Copy-Source-If-Modified-Since_RFC850 === RUN TestValidateConditionalCopyHeadersAcceptsHTTPDateFormats/X-Amz-Copy-Source-If-Unmodified-Since_ANSIC --- PASS: TestValidateConditionalCopyHeadersAcceptsHTTPDateFormats (0.00s) --- PASS: TestValidateConditionalCopyHeadersAcceptsHTTPDateFormats/X-Amz-Copy-Source-If-Modified-Since_RFC850 (0.00s) --- PASS: TestValidateConditionalCopyHeadersAcceptsHTTPDateFormats/X-Amz-Copy-Source-If-Unmodified-Since_ANSIC (0.00s) === RUN TestBuildDeleteCondition === RUN TestBuildDeleteCondition/no_If-Match_is_unconditional === RUN TestBuildDeleteCondition/If-Match_*_to_IF_EXISTS === RUN TestBuildDeleteCondition/If-Match_etag_to_IF_ETAG_MATCH === RUN TestBuildDeleteCondition/an_ETag_list_carries_every_candidate --- PASS: TestBuildDeleteCondition (0.00s) --- PASS: TestBuildDeleteCondition/no_If-Match_is_unconditional (0.00s) --- PASS: TestBuildDeleteCondition/If-Match_*_to_IF_EXISTS (0.00s) --- PASS: TestBuildDeleteCondition/If-Match_etag_to_IF_ETAG_MATCH (0.00s) --- PASS: TestBuildDeleteCondition/an_ETag_list_carries_every_candidate (0.00s) === RUN TestRoutedDeleteSpecificVersionUsesWormCondition --- PASS: TestRoutedDeleteSpecificVersionUsesWormCondition (0.01s) === RUN TestRoutedDeleteSpecificVersionGuardsRepoint === RUN TestRoutedDeleteSpecificVersionGuardsRepoint/one_transaction_behind_the_version's_lock_checks === RUN TestRoutedDeleteSpecificVersionGuardsRepoint/metadata-only_delete_keeps_the_data --- PASS: TestRoutedDeleteSpecificVersionGuardsRepoint (0.02s) --- PASS: TestRoutedDeleteSpecificVersionGuardsRepoint/one_transaction_behind_the_version's_lock_checks (0.01s) --- PASS: TestRoutedDeleteSpecificVersionGuardsRepoint/metadata-only_delete_keeps_the_data (0.01s) === RUN TestWormDeleteConditionForGovernanceBypass --- PASS: TestWormDeleteConditionForGovernanceBypass (0.00s) === RUN TestFakeFilerOnReusedPortIsReachable --- PASS: TestFakeFilerOnReusedPortIsReachable (0.02s) === RUN TestObjectTxnFailsOverStaleOwner --- PASS: TestObjectTxnFailsOverStaleOwner (0.02s) === RUN TestObjectTxnNoReplayAfterSend --- PASS: TestObjectTxnNoReplayAfterSend (0.01s) === RUN TestRoutedMultipartFinalize W1117 09:42:56.565606 s3api_server.go:596 getFilerAddress: no filer addresses available I1117 09:42:56.573863 filer_client.go:239 exists entry directory:"/buckets/b/.uploads" name:"up1": LookupEntry1: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp: missing address" --- PASS: TestRoutedMultipartFinalize (0.02s) === RUN TestWriteMultipartObjectRemovesUploadDir --- PASS: TestWriteMultipartObjectRemovesUploadDir (0.01s) === RUN TestRouteWriteCondition --- PASS: TestRouteWriteCondition (0.00s) === RUN TestRoutedVersionDeleteCarriesIfMatch === RUN TestRoutedVersionDeleteCarriesIfMatch/version/applied === RUN TestRoutedVersionDeleteCarriesIfMatch/null/applied === RUN TestRoutedVersionDeleteCarriesIfMatch/version/if-match_failed === RUN TestRoutedVersionDeleteCarriesIfMatch/null/if-match_failed === RUN TestRoutedVersionDeleteCarriesIfMatch/version/object_lock_denied === RUN TestRoutedVersionDeleteCarriesIfMatch/null/object_lock_denied === RUN TestRoutedVersionDeleteCarriesIfMatch/null/transport_error E1117 09:42:56.676709 s3api_object_versioned_finalize.go:287 routedDeleteNullVersion: b/obj on 127.0.0.1:1: rpc error: code = Unavailable desc = response lost W1117 09:42:56.687178 s3api_object_versioned_finalize.go:290 routedDeleteNullVersion: b/obj on 127.0.0.1:1, falling back to lock: rpc error: code = Unavailable desc = response lost === RUN TestRoutedVersionDeleteCarriesIfMatch/null/owner_error E1117 09:42:56.698092 s3api_object_versioned_finalize.go:302 routedDeleteNullVersion: b/obj on 127.0.0.1:1 returned "mutation 0: delete file /buckets/b/obj: store unavailable" W1117 09:42:56.700933 s3api_object_versioned_finalize.go:305 routedDeleteNullVersion: b/obj returned "mutation 0: delete file /buckets/b/obj: store unavailable", falling back to lock E1117 09:42:56.710016 s3api_object_versioned_finalize.go:302 routedDeleteNullVersion: b/obj on 127.0.0.1:1 returned "mutation 0: delete file /buckets/b/fail to delete non-empty folder: store unavailable" W1117 09:42:56.712174 s3api_object_versioned_finalize.go:305 routedDeleteNullVersion: b/obj returned "mutation 0: delete file /buckets/b/fail to delete non-empty folder: store unavailable", falling back to lock === RUN TestRoutedVersionDeleteCarriesIfMatch/null/nested_entry W1117 09:42:56.791939 s3api_object_versioned_finalize.go:305 routedDeleteNullVersion: b/obj returned "mutation 0: fail to delete non-empty folder: /buckets/b/obj", falling back to lock === RUN TestRoutedVersionDeleteCarriesIfMatch/null/If-Match_* --- PASS: TestRoutedVersionDeleteCarriesIfMatch (0.26s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/version/applied (0.01s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/null/applied (0.01s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/version/if-match_failed (0.01s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/null/if-match_failed (0.01s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/version/object_lock_denied (0.01s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/null/object_lock_denied (0.01s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/null/transport_error (0.02s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/null/owner_error (0.02s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/null/nested_entry (0.08s) --- PASS: TestRoutedVersionDeleteCarriesIfMatch/null/If-Match_* (0.07s) === RUN TestPutObjectUploadACL === RUN TestPutObjectUploadACL/default_private I1117 09:42:56.882780 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/explicit_private I1117 09:42:56.923926 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/public_read I1117 09:42:56.963513 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/public_read_write I1117 09:42:56.999122 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/authenticated_read I1117 09:42:57.038102 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_read I1117 09:42:57.072930 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_write I1117 09:42:57.121652 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_read_acp I1117 09:42:57.163886 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_write_acp I1117 09:42:57.204117 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_full_control I1117 09:42:57.244756 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_owner_full_control_is_not_duplicated I1117 09:42:57.285396 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_owner_email_full_control_is_not_duplicated I1117 09:42:57.327797 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_owner_read_retains_full_control I1117 09:42:57.370015 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/custom_dynamic_writer_keeps_full_control I1117 09:42:57.412426 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/unknown_grantee I1117 09:42:57.452511 config_loader.go:73 Using explicit credential store: memory W1117 09:42:57.468436 s3api_acl_helper.go:317 invalid canonical grantee! account id[unknown] is not exists === RUN TestPutObjectUploadACL/unknown_canned_acl I1117 09:42:57.473440 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/conflicting_acl_headers I1117 09:42:57.492774 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/bucket_owner_read I1117 09:42:57.515718 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/bucket_owner_full_control I1117 09:42:57.549406 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/preferred_ownership I1117 09:42:57.582785 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/preferred_default_private I1117 09:42:57.613613 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/enforced_default I1117 09:42:57.646041 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/enforced_full_control I1117 09:42:57.677030 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/enforced_rejects_private I1117 09:42:57.707314 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/enforced_rejects_public I1117 09:42:57.725550 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/enforced_rejects_grants I1117 09:42:57.744540 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/write_only_default I1117 09:42:57.765958 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/write_only_rejects_explicit_private I1117 09:42:57.795016 config_loader.go:73 Using explicit credential store: memory I1117 09:42:57.811162 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/write_only_rejects_public I1117 09:42:57.816512 config_loader.go:73 Using explicit credential store: memory I1117 09:42:57.831532 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/write_only_rejects_grants I1117 09:42:57.836658 config_loader.go:73 Using explicit credential store: memory I1117 09:42:57.851604 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/acl_permission_outside_prefix I1117 09:42:57.856284 config_loader.go:73 Using explicit credential store: memory I1117 09:42:57.870797 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/iam_allows_acl I1117 09:42:57.875836 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/iam_denies_acl I1117 09:42:57.909967 config_loader.go:73 Using explicit credential store: memory I1117 09:42:57.927705 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/bucket_allows_acl I1117 09:42:57.932416 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/bucket_denies_acl I1117 09:42:57.966491 config_loader.go:73 Using explicit credential store: memory I1117 09:42:57.986060 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/presigned_public_read I1117 09:42:57.991552 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/presigned_requires_acl_permission I1117 09:42:58.031054 config_loader.go:73 Using explicit credential store: memory I1117 09:42:58.051175 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/presigned_custom_read I1117 09:42:58.056157 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/unsigned_with_authentication_disabled I1117 09:42:58.100016 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/streaming_unsigned_payload I1117 09:42:58.128847 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/directory_marker I1117 09:42:58.170995 config_loader.go:73 Using explicit credential store: memory I1117 09:42:58.186846 s3api_object_handlers_put.go:257 PutObjectHandler: explicit directory marker acl-bucket/allowed/folder/ (contentType="text/plain", len=16) === RUN TestPutObjectUploadACL/directory_marker_rejects_acl I1117 09:42:58.197844 config_loader.go:73 Using explicit credential store: memory I1117 09:42:58.215377 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/folder/" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/suspended_version I1117 09:42:58.221455 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/enabled_version I1117 09:42:58.265180 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/overwrite_resets_private I1117 09:42:58.307701 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/rejected_overwrite_preserves_acl I1117 09:42:58.334189 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/multi_grantee_without_space I1117 09:42:58.353149 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/unknown_grantee_key I1117 09:42:58.390887 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/absent_ownership_default I1117 09:42:58.400180 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/absent_ownership_public_read I1117 09:42:58.429409 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/absent_ownership_grants I1117 09:42:58.463063 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/sigv2_ignores_unsigned_query_acl I1117 09:42:58.503177 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/external_account_uploader I1117 09:42:58.535365 config_loader.go:73 Using explicit credential store: memory W1117 09:42:58.548660 bucket_metadata.go:127 owner[id=bucket-owner] is invalid, bucket: acl-bucket === RUN TestPutObjectUploadACL/unknown_grant_type I1117 09:42:58.567131 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/mixed_unknown_grant_type I1117 09:42:58.575231 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/multiple_grants_without_spaces I1117 09:42:58.582910 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/repeated_grant_headers I1117 09:42:58.621558 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/presigned_multiple_grants I1117 09:42:58.660798 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/presigned_public_read_write I1117 09:42:58.711026 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/presigned_public_version I1117 09:42:58.747066 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/default_server_mode I1117 09:42:58.792797 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/enforced_default_server_mode I1117 09:42:58.820190 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_signed_header I1117 09:42:58.847113 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_presigned_default I1117 09:42:58.873935 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_presigned_signed_header I1117 09:42:58.901292 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_unsigned_canned_query I1117 09:42:58.930089 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_unsigned_grant_query I1117 09:42:58.958156 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_tampered_mixed_case_query I1117 09:42:58.985795 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_tampered_presigned_query I1117 09:42:59.013629 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_empty_acl_query I1117 09:42:59.041507 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_header_cannot_hide_unsigned_query I1117 09:42:59.069540 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v2_fake_v4_marker_cannot_bypass I1117 09:42:59.098571 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v4_duplicate_canned_query I1117 09:42:59.126254 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v4_case_alias_query I1117 09:42:59.137385 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v4_conflicting_header_query I1117 09:42:59.146338 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/v4_tampered_signed_query I1117 09:42:59.154109 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/dynamic_default_writer I1117 09:42:59.162249 config_loader.go:73 Using explicit credential store: memory W1117 09:42:59.174311 bucket_metadata.go:127 owner[id=bucket-owner] is invalid, bucket: acl-bucket === RUN TestPutObjectUploadACL/dynamic_public_writer I1117 09:42:59.190943 config_loader.go:73 Using explicit credential store: memory W1117 09:42:59.203048 bucket_metadata.go:127 owner[id=bucket-owner] is invalid, bucket: acl-bucket === RUN TestPutObjectUploadACL/dynamic_bucket_owner I1117 09:42:59.222036 config_loader.go:73 Using explicit credential store: memory W1117 09:42:59.233878 bucket_metadata.go:127 owner[id=bucket-owner] is invalid, bucket: acl-bucket === RUN TestPutObjectUploadACL/dynamic_preferred_owner I1117 09:42:59.253143 config_loader.go:73 Using explicit credential store: memory W1117 09:42:59.264995 bucket_metadata.go:127 owner[id=bucket-owner] is invalid, bucket: acl-bucket === RUN TestPutObjectUploadACL/dynamic_enforced_default I1117 09:42:59.283359 config_loader.go:73 Using explicit credential store: memory W1117 09:42:59.297533 bucket_metadata.go:127 owner[id=bucket-owner] is invalid, bucket: acl-bucket === RUN TestPutObjectUploadACL/dynamic_enforced_full_control I1117 09:42:59.314974 config_loader.go:73 Using explicit credential store: memory W1117 09:42:59.326657 bucket_metadata.go:127 owner[id=bucket-owner] is invalid, bucket: acl-bucket === RUN TestPutObjectUploadACL/dynamic_does_not_bypass_custom_validation I1117 09:42:59.344040 config_loader.go:73 Using explicit credential store: memory W1117 09:42:59.355730 bucket_metadata.go:127 owner[id=bucket-owner] is invalid, bucket: acl-bucket W1117 09:42:59.358560 s3api_acl_helper.go:317 invalid canonical grantee! account id[bucket-owner] is not exists === RUN TestPutObjectUploadACL/disabled_authentication_bucket_denies_acl I1117 09:42:59.364227 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/header_bucket_condition_denies_acl I1117 09:42:59.385499 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.406125 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/query_bucket_condition_denies_acl I1117 09:42:59.411051 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.437831 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/query_bucket_condition_denies_upload I1117 09:42:59.442590 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/query_iam_condition_denies_acl I1117 09:42:59.455584 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.481444 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/query_iam_condition_denies_upload I1117 09:42:59.486973 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/query_bucket_condition_allows_acl I1117 09:42:59.503455 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/query_bucket_condition_supplies_all_permissions I1117 09:42:59.547694 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/query_iam_condition_supplies_all_permissions I1117 09:42:59.596658 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/query_grant_bucket_condition_denies I1117 09:42:59.637917 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.664796 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/query_grant_iam_condition_denies I1117 09:42:59.669769 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.696236 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/disabled_authentication_query_condition_denies_acl I1117 09:42:59.701695 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/disabled_authentication_query_condition_denies_upload I1117 09:42:59.721707 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/repeated_grants_preserve_condition_deny I1117 09:42:59.738725 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.759196 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/single_line_grants_preserve_condition_deny I1117 09:42:59.765534 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.786973 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/presigned_grants_preserve_condition_deny I1117 09:42:59.791880 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.820191 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/extra_grantee_defeats_allow_condition I1117 09:42:59.825107 config_loader.go:73 Using explicit credential store: memory I1117 09:42:59.843936 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/block_public_acls_default I1117 09:42:59.849444 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_private I1117 09:42:59.877561 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_bucket_owner_full_control I1117 09:42:59.907490 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_account_grant I1117 09:42:59.937484 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_rejects_public_read I1117 09:42:59.974450 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_rejects_public_read_write I1117 09:42:59.992931 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_rejects_authenticated_read I1117 09:43:00.012265 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_rejects_presigned_public_read I1117 09:43:00.032701 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_rejects_all_users_grant I1117 09:43:00.058850 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_rejects_authenticated_users_grant I1117 09:43:00.080822 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/block_public_acls_rejected_overwrite_preserves_acl I1117 09:43:00.102011 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/routed_extra_grant_denied_bucket_upload_id_only I1117 09:43:00.130412 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/routed_extra_grant_denied_bucket_invalid_part_number I1117 09:43:00.275271 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/routed_extra_grant_denied_bucket_invalid_copy_source I1117 09:43:00.375390 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/put_action_approved_negative_deny_bucket_presigned_false I1117 09:43:00.471124 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/put_action_approved_negative_deny_bucket_presigned_true I1117 09:43:00.521299 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/routed_extra_grant_denied_iam_upload_id_only I1117 09:43:00.582792 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/routed_extra_grant_denied_iam_invalid_part_number I1117 09:43:00.693017 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/routed_extra_grant_denied_iam_invalid_copy_source I1117 09:43:00.790474 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/put_action_approved_negative_deny_iam_presigned_false I1117 09:43:00.883494 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/put_action_approved_negative_deny_iam_presigned_true I1117 09:43:00.927491 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read_bucket_presigned_false I1117 09:43:00.982378 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.003547 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read_bucket_presigned_true I1117 09:43:01.009562 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.037826 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read_iam_presigned_false I1117 09:43:01.044421 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.063545 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read_iam_presigned_true I1117 09:43:01.068350 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.093941 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write_bucket_presigned_false I1117 09:43:01.099190 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.118097 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write_bucket_presigned_true I1117 09:43:01.124330 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.152820 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write_iam_presigned_false I1117 09:43:01.158146 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.178345 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write_iam_presigned_true I1117 09:43:01.183796 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.211116 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read-Acp_bucket_presigned_false I1117 09:43:01.216079 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.234837 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read-Acp_bucket_presigned_true I1117 09:43:01.239944 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.267668 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read-Acp_iam_presigned_false I1117 09:43:01.272710 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.292850 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read-Acp_iam_presigned_true I1117 09:43:01.297866 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.323923 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write-Acp_bucket_presigned_false I1117 09:43:01.328895 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.349352 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write-Acp_bucket_presigned_true I1117 09:43:01.356978 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.384692 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write-Acp_iam_presigned_false I1117 09:43:01.389887 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.409867 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write-Acp_iam_presigned_true I1117 09:43:01.415239 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.442288 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Full-Control_bucket_presigned_false I1117 09:43:01.448521 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.468051 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Full-Control_bucket_presigned_true I1117 09:43:01.473130 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.500671 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Full-Control_iam_presigned_false I1117 09:43:01.506168 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.525910 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Full-Control_iam_presigned_true I1117 09:43:01.531202 config_loader.go:73 Using explicit credential store: memory I1117 09:43:01.557594 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/disabled_authentication_raw_deny_presigned_false I1117 09:43:01.563260 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_bucket_presigned_false_repeated_false I1117 09:43:01.583096 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_bucket_presigned_false_repeated_false I1117 09:43:01.628347 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_bucket_presigned_false_repeated_true I1117 09:43:01.639784 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_bucket_presigned_false_repeated_true I1117 09:43:01.689198 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/canonical_approved_allow_with_whitespace_bucket_presigned_false I1117 09:43:01.700655 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_iam_presigned_false_repeated_false I1117 09:43:01.744660 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_iam_presigned_false_repeated_false I1117 09:43:01.789367 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_iam_presigned_false_repeated_true I1117 09:43:01.800274 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_iam_presigned_false_repeated_true I1117 09:43:01.843613 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/canonical_approved_allow_with_whitespace_iam_presigned_false I1117 09:43:01.855049 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/disabled_authentication_raw_deny_presigned_true I1117 09:43:01.899172 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_bucket_presigned_true_repeated_false I1117 09:43:01.920390 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_bucket_presigned_true_repeated_false I1117 09:43:01.974857 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_bucket_presigned_true_repeated_true I1117 09:43:01.988743 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_bucket_presigned_true_repeated_true I1117 09:43:02.042010 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/canonical_approved_allow_with_whitespace_bucket_presigned_true I1117 09:43:02.059412 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_iam_presigned_true_repeated_false I1117 09:43:02.113220 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_iam_presigned_true_repeated_false I1117 09:43:02.165580 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_iam_presigned_true_repeated_true I1117 09:43:02.179522 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_iam_presigned_true_repeated_true I1117 09:43:02.232179 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/canonical_approved_allow_with_whitespace_iam_presigned_true I1117 09:43:02.246377 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.297320 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.316487 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.321512 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.340802 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.346937 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.365740 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.371703 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.390226 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.395148 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.414389 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.419650 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.438824 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_false_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:02.444605 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.466359 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_false_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:02.471551 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.490706 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_false_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:02.495765 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.515272 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/joined_repeated_raw_deny_bucket_presigned_false I1117 09:43:02.520440 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.539699 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/original_repeated_line_deny_bucket_presigned_false I1117 09:43:02.544747 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.563557 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEquals_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.570310 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEquals_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.614248 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.625768 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.669316 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotEquals_presigned_false I1117 09:43:02.680808 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.701928 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotLike_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.707253 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotLike_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.749622 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.761598 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.807840 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotLike_presigned_false I1117 09:43:02.824080 config_loader.go:73 Using explicit credential store: memory I1117 09:43:02.880130 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.887421 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:02.937131 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.948543 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:02.995603 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotEqualsIgnoreCase_presigned_false I1117 09:43:03.008265 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.027658 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.032850 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.059871 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.064902 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.092473 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.099006 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.129326 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.134518 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.162555 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.167618 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.195264 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.200337 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.234510 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_true_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:03.239621 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.270593 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_true_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:03.275999 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.305273 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_true_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:03.311416 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.346318 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/joined_repeated_raw_deny_bucket_presigned_true I1117 09:43:03.352452 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.383433 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/original_repeated_line_deny_bucket_presigned_true I1117 09:43:03.388931 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.420723 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEquals_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.426879 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEquals_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.484627 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.500577 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.557211 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotEquals_presigned_true I1117 09:43:03.571689 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.598918 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotLike_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.603817 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotLike_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.662606 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.682270 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.735946 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotLike_presigned_true I1117 09:43:03.751315 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.786017 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.792772 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:03.851596 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.866134 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:03.918992 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotEqualsIgnoreCase_presigned_true I1117 09:43:03.933991 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.965826 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:03.971184 config_loader.go:73 Using explicit credential store: memory I1117 09:43:03.991161 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:03.998245 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.017850 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:04.023412 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.044035 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.049113 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.069517 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.074611 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.095166 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.101260 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.122505 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_false_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:04.129002 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.151526 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_false_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:04.156940 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.177036 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_false_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:04.182146 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.201983 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/joined_repeated_raw_deny_iam_presigned_false I1117 09:43:04.207160 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.226307 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/original_repeated_line_deny_iam_presigned_false I1117 09:43:04.231127 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.251584 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEquals_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:04.256991 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEquals_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:04.304695 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.316674 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.364601 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotEquals_presigned_false I1117 09:43:04.378428 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.399109 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotLike_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:04.404898 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotLike_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:04.451946 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.463285 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.511742 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotLike_presigned_false I1117 09:43:04.523571 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.542842 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:04.547877 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" I1117 09:43:04.591779 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.603150 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.650550 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotEqualsIgnoreCase_presigned_false I1117 09:43:04.664772 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.684731 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:04.690051 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.717229 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:04.722590 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.750574 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:04.756081 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.783610 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.788687 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.815380 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.820545 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.847453 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:04.853874 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.881674 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_true_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:04.887271 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.916094 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_true_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:04.921855 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.950853 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_true_id="bucket-\u006fwner",id="upload-writer" I1117 09:43:04.955855 config_loader.go:73 Using explicit credential store: memory I1117 09:43:04.982844 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/joined_repeated_raw_deny_iam_presigned_true I1117 09:43:04.988118 config_loader.go:73 Using explicit credential store: memory I1117 09:43:05.016207 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/original_repeated_line_deny_iam_presigned_true I1117 09:43:05.021508 config_loader.go:73 Using explicit credential store: memory I1117 09:43:05.048666 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEquals_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:05.054148 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEquals_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:05.106315 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:05.121290 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:05.177072 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotEquals_presigned_true I1117 09:43:05.193298 config_loader.go:73 Using explicit credential store: memory I1117 09:43:05.223454 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotLike_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:05.229483 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotLike_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:05.286726 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:05.304665 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:05.361815 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotLike_presigned_true I1117 09:43:05.379124 config_loader.go:73 Using explicit credential store: memory I1117 09:43:05.409135 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:05.414277 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" I1117 09:43:05.465569 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:05.479557 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" I1117 09:43:05.531199 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotEqualsIgnoreCase_presigned_true I1117 09:43:05.545677 config_loader.go:73 Using explicit credential store: memory I1117 09:43:05.572565 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_allow_presigned_false I1117 09:43:05.578362 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_approved_negative_deny_presigned_false I1117 09:43:05.624712 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_positive_deny_presigned_false I1117 09:43:05.667802 config_loader.go:73 Using explicit credential store: memory I1117 09:43:05.687907 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_allow_presigned_true I1117 09:43:05.693678 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_approved_negative_deny_presigned_true I1117 09:43:05.752441 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_positive_deny_presigned_true I1117 09:43:05.808770 config_loader.go:73 Using explicit credential store: memory I1117 09:43:05.836259 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_iam_allow_presigned_false I1117 09:43:05.843371 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_iam_approved_negative_deny_presigned_false I1117 09:43:05.887275 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_iam_positive_deny_presigned_false I1117 09:43:05.933531 config_loader.go:73 Using explicit credential store: memory I1117 09:43:05.953167 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_iam_allow_presigned_true I1117 09:43:05.958037 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_iam_approved_negative_deny_presigned_true I1117 09:43:06.009773 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_a&b@example.com_iam_positive_deny_presigned_true I1117 09:43:06.067369 config_loader.go:73 Using explicit credential store: memory I1117 09:43:06.093511 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/html_grant_readeraccount_bucket_allow_presigned_false I1117 09:43:06.673377 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_reader>account_bucket_approved_negative_deny_presigned_false I1117 09:43:06.722096 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_reader>account_bucket_positive_deny_presigned_false I1117 09:43:06.768577 config_loader.go:73 Using explicit credential store: memory I1117 09:43:06.789059 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/html_grant_reader>account_bucket_allow_presigned_true I1117 09:43:06.795017 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_reader>account_bucket_approved_negative_deny_presigned_true I1117 09:43:06.855626 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_reader>account_bucket_positive_deny_presigned_true I1117 09:43:06.914843 config_loader.go:73 Using explicit credential store: memory I1117 09:43:06.946187 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/html_grant_reader>account_iam_allow_presigned_false I1117 09:43:06.951726 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_reader>account_iam_approved_negative_deny_presigned_false I1117 09:43:06.994591 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_reader>account_iam_positive_deny_presigned_false I1117 09:43:07.038272 config_loader.go:73 Using explicit credential store: memory I1117 09:43:07.058576 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check === RUN TestPutObjectUploadACL/html_grant_reader>account_iam_allow_presigned_true I1117 09:43:07.064651 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_reader>account_iam_approved_negative_deny_presigned_true I1117 09:43:07.116888 config_loader.go:73 Using explicit credential store: memory === RUN TestPutObjectUploadACL/html_grant_reader>account_iam_positive_deny_presigned_true I1117 09:43:07.171525 config_loader.go:73 Using explicit credential store: memory I1117 09:43:07.199263 s3api_object_upload_acl.go:164 denied PUT "acl-bucket/allowed/image.png" for "upload-acl-test": the request sets an ACL and failed the WriteAcp (s3:PutObjectAcl) check --- PASS: TestPutObjectUploadACL (10.34s) --- PASS: TestPutObjectUploadACL/default_private (0.04s) --- PASS: TestPutObjectUploadACL/explicit_private (0.04s) --- PASS: TestPutObjectUploadACL/public_read (0.03s) --- PASS: TestPutObjectUploadACL/public_read_write (0.04s) --- PASS: TestPutObjectUploadACL/authenticated_read (0.03s) --- PASS: TestPutObjectUploadACL/custom_read (0.05s) --- PASS: TestPutObjectUploadACL/custom_write (0.04s) --- PASS: TestPutObjectUploadACL/custom_read_acp (0.04s) --- PASS: TestPutObjectUploadACL/custom_write_acp (0.04s) --- PASS: TestPutObjectUploadACL/custom_full_control (0.04s) --- PASS: TestPutObjectUploadACL/custom_owner_full_control_is_not_duplicated (0.04s) --- PASS: TestPutObjectUploadACL/custom_owner_email_full_control_is_not_duplicated (0.04s) --- PASS: TestPutObjectUploadACL/custom_owner_read_retains_full_control (0.04s) --- PASS: TestPutObjectUploadACL/custom_dynamic_writer_keeps_full_control (0.04s) --- PASS: TestPutObjectUploadACL/unknown_grantee (0.02s) --- PASS: TestPutObjectUploadACL/unknown_canned_acl (0.02s) --- PASS: TestPutObjectUploadACL/conflicting_acl_headers (0.02s) --- PASS: TestPutObjectUploadACL/bucket_owner_read (0.03s) --- PASS: TestPutObjectUploadACL/bucket_owner_full_control (0.03s) --- PASS: TestPutObjectUploadACL/preferred_ownership (0.03s) --- PASS: TestPutObjectUploadACL/preferred_default_private (0.03s) --- PASS: TestPutObjectUploadACL/enforced_default (0.03s) --- PASS: TestPutObjectUploadACL/enforced_full_control (0.03s) --- PASS: TestPutObjectUploadACL/enforced_rejects_private (0.02s) --- PASS: TestPutObjectUploadACL/enforced_rejects_public (0.02s) --- PASS: TestPutObjectUploadACL/enforced_rejects_grants (0.02s) --- PASS: TestPutObjectUploadACL/write_only_default (0.03s) --- PASS: TestPutObjectUploadACL/write_only_rejects_explicit_private (0.02s) --- PASS: TestPutObjectUploadACL/write_only_rejects_public (0.02s) --- PASS: TestPutObjectUploadACL/write_only_rejects_grants (0.02s) --- PASS: TestPutObjectUploadACL/acl_permission_outside_prefix (0.02s) --- PASS: TestPutObjectUploadACL/iam_allows_acl (0.03s) --- PASS: TestPutObjectUploadACL/iam_denies_acl (0.02s) --- PASS: TestPutObjectUploadACL/bucket_allows_acl (0.03s) --- PASS: TestPutObjectUploadACL/bucket_denies_acl (0.02s) --- PASS: TestPutObjectUploadACL/presigned_public_read (0.04s) --- PASS: TestPutObjectUploadACL/presigned_requires_acl_permission (0.02s) --- PASS: TestPutObjectUploadACL/presigned_custom_read (0.04s) --- PASS: TestPutObjectUploadACL/unsigned_with_authentication_disabled (0.03s) --- PASS: TestPutObjectUploadACL/streaming_unsigned_payload (0.04s) --- PASS: TestPutObjectUploadACL/directory_marker (0.03s) --- PASS: TestPutObjectUploadACL/directory_marker_rejects_acl (0.02s) --- PASS: TestPutObjectUploadACL/suspended_version (0.04s) --- PASS: TestPutObjectUploadACL/enabled_version (0.04s) --- PASS: TestPutObjectUploadACL/overwrite_resets_private (0.03s) --- PASS: TestPutObjectUploadACL/rejected_overwrite_preserves_acl (0.02s) --- PASS: TestPutObjectUploadACL/multi_grantee_without_space (0.04s) --- PASS: TestPutObjectUploadACL/unknown_grantee_key (0.01s) --- PASS: TestPutObjectUploadACL/absent_ownership_default (0.03s) --- PASS: TestPutObjectUploadACL/absent_ownership_public_read (0.03s) --- PASS: TestPutObjectUploadACL/absent_ownership_grants (0.04s) --- PASS: TestPutObjectUploadACL/sigv2_ignores_unsigned_query_acl (0.03s) --- PASS: TestPutObjectUploadACL/external_account_uploader (0.03s) --- PASS: TestPutObjectUploadACL/unknown_grant_type (0.01s) --- PASS: TestPutObjectUploadACL/mixed_unknown_grant_type (0.01s) --- PASS: TestPutObjectUploadACL/multiple_grants_without_spaces (0.04s) --- PASS: TestPutObjectUploadACL/repeated_grant_headers (0.04s) --- PASS: TestPutObjectUploadACL/presigned_multiple_grants (0.05s) --- PASS: TestPutObjectUploadACL/presigned_public_read_write (0.04s) --- PASS: TestPutObjectUploadACL/presigned_public_version (0.05s) --- PASS: TestPutObjectUploadACL/default_server_mode (0.03s) --- PASS: TestPutObjectUploadACL/enforced_default_server_mode (0.03s) --- PASS: TestPutObjectUploadACL/v2_signed_header (0.03s) --- PASS: TestPutObjectUploadACL/v2_presigned_default (0.03s) --- PASS: TestPutObjectUploadACL/v2_presigned_signed_header (0.03s) --- PASS: TestPutObjectUploadACL/v2_unsigned_canned_query (0.03s) --- PASS: TestPutObjectUploadACL/v2_unsigned_grant_query (0.03s) --- PASS: TestPutObjectUploadACL/v2_tampered_mixed_case_query (0.03s) --- PASS: TestPutObjectUploadACL/v2_tampered_presigned_query (0.03s) --- PASS: TestPutObjectUploadACL/v2_empty_acl_query (0.03s) --- PASS: TestPutObjectUploadACL/v2_header_cannot_hide_unsigned_query (0.03s) --- PASS: TestPutObjectUploadACL/v2_fake_v4_marker_cannot_bypass (0.03s) --- PASS: TestPutObjectUploadACL/v4_duplicate_canned_query (0.01s) --- PASS: TestPutObjectUploadACL/v4_case_alias_query (0.01s) --- PASS: TestPutObjectUploadACL/v4_conflicting_header_query (0.01s) --- PASS: TestPutObjectUploadACL/v4_tampered_signed_query (0.01s) --- PASS: TestPutObjectUploadACL/dynamic_default_writer (0.03s) --- PASS: TestPutObjectUploadACL/dynamic_public_writer (0.03s) --- PASS: TestPutObjectUploadACL/dynamic_bucket_owner (0.03s) --- PASS: TestPutObjectUploadACL/dynamic_preferred_owner (0.03s) --- PASS: TestPutObjectUploadACL/dynamic_enforced_default (0.03s) --- PASS: TestPutObjectUploadACL/dynamic_enforced_full_control (0.03s) --- PASS: TestPutObjectUploadACL/dynamic_does_not_bypass_custom_validation (0.02s) --- PASS: TestPutObjectUploadACL/disabled_authentication_bucket_denies_acl (0.02s) --- PASS: TestPutObjectUploadACL/header_bucket_condition_denies_acl (0.03s) --- PASS: TestPutObjectUploadACL/query_bucket_condition_denies_acl (0.03s) --- PASS: TestPutObjectUploadACL/query_bucket_condition_denies_upload (0.01s) --- PASS: TestPutObjectUploadACL/query_iam_condition_denies_acl (0.03s) --- PASS: TestPutObjectUploadACL/query_iam_condition_denies_upload (0.02s) --- PASS: TestPutObjectUploadACL/query_bucket_condition_allows_acl (0.04s) --- PASS: TestPutObjectUploadACL/query_bucket_condition_supplies_all_permissions (0.05s) --- PASS: TestPutObjectUploadACL/query_iam_condition_supplies_all_permissions (0.04s) --- PASS: TestPutObjectUploadACL/query_grant_bucket_condition_denies (0.03s) --- PASS: TestPutObjectUploadACL/query_grant_iam_condition_denies (0.03s) --- PASS: TestPutObjectUploadACL/disabled_authentication_query_condition_denies_acl (0.02s) --- PASS: TestPutObjectUploadACL/disabled_authentication_query_condition_denies_upload (0.02s) --- PASS: TestPutObjectUploadACL/repeated_grants_preserve_condition_deny (0.03s) --- PASS: TestPutObjectUploadACL/single_line_grants_preserve_condition_deny (0.03s) --- PASS: TestPutObjectUploadACL/presigned_grants_preserve_condition_deny (0.03s) --- PASS: TestPutObjectUploadACL/extra_grantee_defeats_allow_condition (0.02s) --- PASS: TestPutObjectUploadACL/block_public_acls_default (0.03s) --- PASS: TestPutObjectUploadACL/block_public_acls_private (0.03s) --- PASS: TestPutObjectUploadACL/block_public_acls_bucket_owner_full_control (0.03s) --- PASS: TestPutObjectUploadACL/block_public_acls_account_grant (0.04s) --- PASS: TestPutObjectUploadACL/block_public_acls_rejects_public_read (0.02s) --- PASS: TestPutObjectUploadACL/block_public_acls_rejects_public_read_write (0.02s) --- PASS: TestPutObjectUploadACL/block_public_acls_rejects_authenticated_read (0.02s) --- PASS: TestPutObjectUploadACL/block_public_acls_rejects_presigned_public_read (0.03s) --- PASS: TestPutObjectUploadACL/block_public_acls_rejects_all_users_grant (0.02s) --- PASS: TestPutObjectUploadACL/block_public_acls_rejects_authenticated_users_grant (0.02s) --- PASS: TestPutObjectUploadACL/block_public_acls_rejected_overwrite_preserves_acl (0.02s) --- PASS: TestPutObjectUploadACL/routed_extra_grant_denied_bucket_upload_id_only (0.15s) --- PASS: TestPutObjectUploadACL/routed_extra_grant_denied_bucket_invalid_part_number (0.10s) --- PASS: TestPutObjectUploadACL/routed_extra_grant_denied_bucket_invalid_copy_source (0.10s) --- PASS: TestPutObjectUploadACL/put_action_approved_negative_deny_bucket_presigned_false (0.05s) --- PASS: TestPutObjectUploadACL/put_action_approved_negative_deny_bucket_presigned_true (0.06s) --- PASS: TestPutObjectUploadACL/routed_extra_grant_denied_iam_upload_id_only (0.11s) --- PASS: TestPutObjectUploadACL/routed_extra_grant_denied_iam_invalid_part_number (0.10s) --- PASS: TestPutObjectUploadACL/routed_extra_grant_denied_iam_invalid_copy_source (0.09s) --- PASS: TestPutObjectUploadACL/put_action_approved_negative_deny_iam_presigned_false (0.04s) --- PASS: TestPutObjectUploadACL/put_action_approved_negative_deny_iam_presigned_true (0.05s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read_bucket_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read_bucket_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read_iam_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read_iam_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write_bucket_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write_bucket_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write_iam_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write_iam_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read-Acp_bucket_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read-Acp_bucket_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read-Acp_iam_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Read-Acp_iam_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write-Acp_bucket_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write-Acp_bucket_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write-Acp_iam_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Write-Acp_iam_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Full-Control_bucket_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Full-Control_bucket_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Full-Control_iam_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_header_deny_X-Amz-Grant-Full-Control_iam_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/disabled_authentication_raw_deny_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_bucket_presigned_false_repeated_false (0.04s) --- PASS: TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_bucket_presigned_false_repeated_false (0.01s) --- PASS: TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_bucket_presigned_false_repeated_true (0.05s) --- PASS: TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_bucket_presigned_false_repeated_true (0.01s) --- PASS: TestPutObjectUploadACL/canonical_approved_allow_with_whitespace_bucket_presigned_false (0.04s) --- PASS: TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_iam_presigned_false_repeated_false (0.04s) --- PASS: TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_iam_presigned_false_repeated_false (0.01s) --- PASS: TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_iam_presigned_false_repeated_true (0.04s) --- PASS: TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_iam_presigned_false_repeated_true (0.01s) --- PASS: TestPutObjectUploadACL/canonical_approved_allow_with_whitespace_iam_presigned_false (0.04s) --- PASS: TestPutObjectUploadACL/disabled_authentication_raw_deny_presigned_true (0.02s) --- PASS: TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_bucket_presigned_true_repeated_false (0.05s) --- PASS: TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_bucket_presigned_true_repeated_false (0.01s) --- PASS: TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_bucket_presigned_true_repeated_true (0.05s) --- PASS: TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_bucket_presigned_true_repeated_true (0.02s) --- PASS: TestPutObjectUploadACL/canonical_approved_allow_with_whitespace_bucket_presigned_true (0.05s) --- PASS: TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_iam_presigned_true_repeated_false (0.05s) --- PASS: TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_iam_presigned_true_repeated_false (0.01s) --- PASS: TestPutObjectUploadACL/whole_list_deny_preserves_extra_grantee_iam_presigned_true_repeated_true (0.05s) --- PASS: TestPutObjectUploadACL/whole_list_allow_rejects_extra_grantee_iam_presigned_true_repeated_true (0.01s) --- PASS: TestPutObjectUploadACL/canonical_approved_allow_with_whitespace_iam_presigned_true (0.05s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_false_id="bucket-owner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_false_id="bucket-owner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_false_id="bucket-\u006fwner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_false_id="bucket-\u006fwner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_false_id="bucket-\u006fwner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/joined_repeated_raw_deny_bucket_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/original_repeated_line_deny_bucket_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEquals_presigned_false_id="bucket-owner",id="upload-writer" (0.04s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEquals_presigned_false_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.04s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotEquals_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotLike_presigned_false_id="bucket-owner",id="upload-writer" (0.04s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotLike_presigned_false_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotLike_presigned_false (0.07s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotEqualsIgnoreCase_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_true_id="bucket-owner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_true_id="bucket-owner",id="upload-writer" (0.04s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.04s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEquals_presigned_true_id="bucket-\u006fwner",id="upload-writer" (0.04s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringEqualsIgnoreCase_presigned_true_id="bucket-\u006fwner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_bucket_StringLike_presigned_true_id="bucket-\u006fwner",id="upload-writer" (0.04s) --- PASS: TestPutObjectUploadACL/joined_repeated_raw_deny_bucket_presigned_true (0.04s) --- PASS: TestPutObjectUploadACL/original_repeated_line_deny_bucket_presigned_true (0.04s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEquals_presigned_true_id="bucket-owner",id="upload-writer" (0.06s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEquals_presigned_true_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.06s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotEquals_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotLike_presigned_true_id="bucket-owner",id="upload-writer" (0.06s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotLike_presigned_true_id="bucket-owner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotLike_presigned_true (0.04s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" (0.06s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_bucket_StringNotEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_bucket_StringNotEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_bucket_StringNotEqualsIgnoreCase_presigned_true (0.04s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_false_id="bucket-owner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_false_id="bucket-owner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_false_id="bucket-\u006fwner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_false_id="bucket-\u006fwner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_false_id="bucket-\u006fwner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/joined_repeated_raw_deny_iam_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/original_repeated_line_deny_iam_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEquals_presigned_false_id="bucket-owner",id="upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEquals_presigned_false_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEquals_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotEquals_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotLike_presigned_false_id="bucket-owner",id="upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotLike_presigned_false_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotLike_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotLike_presigned_false (0.02s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" (0.04s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEqualsIgnoreCase_presigned_false_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEqualsIgnoreCase_presigned_false_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotEqualsIgnoreCase_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_true_id="bucket-owner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_true_id="bucket-owner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEquals_presigned_true_id="bucket-\u006fwner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringEqualsIgnoreCase_presigned_true_id="bucket-\u006fwner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/raw_grant_deny_iam_StringLike_presigned_true_id="bucket-\u006fwner",id="upload-writer" (0.03s) --- PASS: TestPutObjectUploadACL/joined_repeated_raw_deny_iam_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/original_repeated_line_deny_iam_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEquals_presigned_true_id="bucket-owner",id="upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEquals_presigned_true_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEquals_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotEquals_presigned_true (0.04s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotLike_presigned_true_id="bucket-owner",id="upload-writer" (0.06s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotLike_presigned_true_id="bucket-owner",id="upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.06s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotLike_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.02s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotLike_presigned_true (0.04s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEqualsIgnoreCase_presigned_true_id="bucket-owner",id="upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/approved_negative_deny_iam_StringNotEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.05s) --- PASS: TestPutObjectUploadACL/negative_allow_unchanged_iam_StringNotEqualsIgnoreCase_presigned_true_id_=_"bucket-owner"_,_id_=_"upload-writer" (0.01s) --- PASS: TestPutObjectUploadACL/extra_repeated_grantee_denied_iam_StringNotEqualsIgnoreCase_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_allow_presigned_false (0.05s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_approved_negative_deny_presigned_false (0.04s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_positive_deny_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_allow_presigned_true (0.06s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_approved_negative_deny_presigned_true (0.06s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_bucket_positive_deny_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_iam_allow_presigned_false (0.04s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_iam_approved_negative_deny_presigned_false (0.05s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_iam_positive_deny_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_iam_allow_presigned_true (0.05s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_iam_approved_negative_deny_presigned_true (0.06s) --- PASS: TestPutObjectUploadACL/html_grant_a&b@example.com_iam_positive_deny_presigned_true (0.03s) --- PASS: TestPutObjectUploadACL/html_grant_readeraccount_bucket_allow_presigned_false (0.05s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_bucket_approved_negative_deny_presigned_false (0.05s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_bucket_positive_deny_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_bucket_allow_presigned_true (0.06s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_bucket_approved_negative_deny_presigned_true (0.06s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_bucket_positive_deny_presigned_true (0.04s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_iam_allow_presigned_false (0.04s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_iam_approved_negative_deny_presigned_false (0.04s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_iam_positive_deny_presigned_false (0.03s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_iam_allow_presigned_true (0.05s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_iam_approved_negative_deny_presigned_true (0.05s) --- PASS: TestPutObjectUploadACL/html_grant_reader>account_iam_positive_deny_presigned_true (0.03s) === RUN TestPutObjectACLPolicyScope === RUN TestPutObjectACLPolicyScope/upload === RUN TestPutObjectACLPolicyScope/upload_acl_authorization === RUN TestPutObjectACLPolicyScope/bucket === RUN TestPutObjectACLPolicyScope/post_form === RUN TestPutObjectACLPolicyScope/copy === RUN TestPutObjectACLPolicyScope/copy_acl_authorization === RUN TestPutObjectACLPolicyScope/repeated_copy_source === RUN TestPutObjectACLPolicyScope/multipart_part_copy === RUN TestPutObjectACLPolicyScope/multipart_part === RUN TestPutObjectACLPolicyScope/multipart_leading_zero === RUN TestPutObjectACLPolicyScope/upload_id_only === RUN TestPutObjectACLPolicyScope/invalid_part_number === RUN TestPutObjectACLPolicyScope/standalone_acl === RUN TestPutObjectACLPolicyScope/tagging === RUN TestPutObjectACLPolicyScope/retention === RUN TestPutObjectACLPolicyScope/other_service --- PASS: TestPutObjectACLPolicyScope (0.02s) --- PASS: TestPutObjectACLPolicyScope/upload (0.00s) --- PASS: TestPutObjectACLPolicyScope/upload_acl_authorization (0.00s) --- PASS: TestPutObjectACLPolicyScope/bucket (0.00s) --- PASS: TestPutObjectACLPolicyScope/post_form (0.00s) --- PASS: TestPutObjectACLPolicyScope/copy (0.00s) --- PASS: TestPutObjectACLPolicyScope/copy_acl_authorization (0.00s) --- PASS: TestPutObjectACLPolicyScope/repeated_copy_source (0.00s) --- PASS: TestPutObjectACLPolicyScope/multipart_part_copy (0.00s) --- PASS: TestPutObjectACLPolicyScope/multipart_part (0.00s) --- PASS: TestPutObjectACLPolicyScope/multipart_leading_zero (0.00s) --- PASS: TestPutObjectACLPolicyScope/upload_id_only (0.00s) --- PASS: TestPutObjectACLPolicyScope/invalid_part_number (0.00s) --- PASS: TestPutObjectACLPolicyScope/standalone_acl (0.00s) --- PASS: TestPutObjectACLPolicyScope/tagging (0.00s) --- PASS: TestPutObjectACLPolicyScope/retention (0.00s) --- PASS: TestPutObjectACLPolicyScope/other_service (0.00s) === RUN TestVersionedConditionalPutAfterLockWaitBecomesLatest --- PASS: TestVersionedConditionalPutAfterLockWaitBecomesLatest (0.06s) === RUN TestVersionedRoutedPutAfterConcurrentDeleteBecomesLatest --- PASS: TestVersionedRoutedPutAfterConcurrentDeleteBecomesLatest (0.03s) === RUN TestDeleteSpecificObjectVersionRetriesTransientLookup === RUN TestDeleteSpecificObjectVersionRetriesTransientLookup/null === RUN TestDeleteSpecificObjectVersionRetriesTransientLookup/672a75d526ef29c79fe6b5680cad4a0d --- PASS: TestDeleteSpecificObjectVersionRetriesTransientLookup (0.25s) --- PASS: TestDeleteSpecificObjectVersionRetriesTransientLookup/null (0.13s) --- PASS: TestDeleteSpecificObjectVersionRetriesTransientLookup/672a75d526ef29c79fe6b5680cad4a0d (0.12s) === RUN TestDeleteSpecificObjectVersionRecheckDoesNotRetry --- PASS: TestDeleteSpecificObjectVersionRecheckDoesNotRetry (0.02s) === RUN TestDeleteSpecificObjectVersionLookupErrors === RUN TestDeleteSpecificObjectVersionLookupErrors/null_version_lookup_fails === RUN TestDeleteSpecificObjectVersionLookupErrors/null_version_is_absent === RUN TestDeleteSpecificObjectVersionLookupErrors/null_version_is_deleted === RUN TestDeleteSpecificObjectVersionLookupErrors/null_version_delete_fails_and_the_recheck_fails === RUN TestDeleteSpecificObjectVersionLookupErrors/null_version_delete_fails_and_the_recheck_finds_it_gone === RUN TestDeleteSpecificObjectVersionLookupErrors/null_version_delete_fails_and_the_recheck_finds_it_still_there === RUN TestDeleteSpecificObjectVersionLookupErrors/versions_directory_lookup_fails === RUN TestDeleteSpecificObjectVersionLookupErrors/versions_directory_is_absent === RUN TestDeleteSpecificObjectVersionLookupErrors/version_delete_fails_and_the_recheck_fails === RUN TestDeleteSpecificObjectVersionLookupErrors/version_is_already_gone === RUN TestDeleteSpecificObjectVersionLookupErrors/version_delete_fails_and_the_recheck_finds_it_gone --- PASS: TestDeleteSpecificObjectVersionLookupErrors (0.15s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/null_version_lookup_fails (0.01s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/null_version_is_absent (0.01s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/null_version_is_deleted (0.01s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/null_version_delete_fails_and_the_recheck_fails (0.02s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/null_version_delete_fails_and_the_recheck_finds_it_gone (0.01s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/null_version_delete_fails_and_the_recheck_finds_it_still_there (0.01s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/versions_directory_lookup_fails (0.01s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/versions_directory_is_absent (0.01s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/version_delete_fails_and_the_recheck_fails (0.02s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/version_is_already_gone (0.02s) --- PASS: TestDeleteSpecificObjectVersionLookupErrors/version_delete_fails_and_the_recheck_finds_it_gone (0.01s) === RUN TestAnonymousObjectACLHealPointerConcurrentWriter === RUN TestAnonymousObjectACLHealPointerConcurrentWriter/idle_key_persists_the_rescanned_pointer W1117 09:43:07.750277 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:43:07.760447 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder/ mode=pointer_repaired new_version=v1 file=v_v1 delete_marker=false === RUN TestAnonymousObjectACLHealPointerConcurrentWriter/concurrent_writer_during_scan_keeps_its_promotion W1117 09:43:07.781879 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:43:07.787864 s3api_versioning_reconciler.go:46 [versioning-heal] event=abandoned bucket=b key=folder/ mode=pointer_moved observed_id= live_id=v2 === RUN TestAnonymousObjectACLHealPointerConcurrentWriter/concurrent_writer_during_persist_keeps_its_promotion W1117 09:43:07.807487 s3api_versioning_reconciler.go:50 [versioning-heal] event=surfaced bucket=b key=folder/ missing_file= rescanning=/buckets/b/folder/.versions I1117 09:43:07.816661 s3api_versioning_reconciler.go:46 [versioning-heal] event=abandoned bucket=b key=folder/ mode=entry_changed err="rpc error: code = FailedPrecondition desc = entry changed" --- PASS: TestAnonymousObjectACLHealPointerConcurrentWriter (0.09s) --- PASS: TestAnonymousObjectACLHealPointerConcurrentWriter/idle_key_persists_the_rescanned_pointer (0.03s) --- PASS: TestAnonymousObjectACLHealPointerConcurrentWriter/concurrent_writer_during_scan_keeps_its_promotion (0.03s) --- PASS: TestAnonymousObjectACLHealPointerConcurrentWriter/concurrent_writer_during_persist_keeps_its_promotion (0.03s) === RUN TestClearStaleLatestVersionPointerConcurrentWriter === RUN TestClearStaleLatestVersionPointerConcurrentWriter/idle_key_clears_the_stale_pointer I1117 09:43:07.837383 s3api_versioning_reconciler.go:46 [versioning-heal] event=healed bucket=b key=folder mode=pointer_cleared caller=test (orphan entries remain in .versions directory) === RUN TestClearStaleLatestVersionPointerConcurrentWriter/concurrent_writer_during_persist_keeps_its_promotion === RUN TestClearStaleLatestVersionPointerConcurrentWriter/pointerless_snapshot_keeps_a_post-rescan_promotion === RUN TestClearStaleLatestVersionPointerConcurrentWriter/pointerless_snapshot_on_an_idle_key_is_already_clear --- PASS: TestClearStaleLatestVersionPointerConcurrentWriter (0.06s) --- PASS: TestClearStaleLatestVersionPointerConcurrentWriter/idle_key_clears_the_stale_pointer (0.02s) --- PASS: TestClearStaleLatestVersionPointerConcurrentWriter/concurrent_writer_during_persist_keeps_its_promotion (0.02s) --- PASS: TestClearStaleLatestVersionPointerConcurrentWriter/pointerless_snapshot_keeps_a_post-rescan_promotion (0.01s) --- PASS: TestClearStaleLatestVersionPointerConcurrentWriter/pointerless_snapshot_on_an_idle_key_is_already_clear (0.01s) === RUN TestComputeListPrefix --- PASS: TestComputeListPrefix (0.00s) === RUN TestLookupVersionsEntryTerminalErrorsSkipTheLadder --- PASS: TestLookupVersionsEntryTerminalErrorsSkipTheLadder (0.00s) === RUN TestLookupVersionsEntryTransientErrorsStillRetry --- PASS: TestLookupVersionsEntryTransientErrorsStillRetry (0.30s) === RUN TestLookupVersionsEntryTransientExhaustionReturnsLastErr --- PASS: TestLookupVersionsEntryTransientExhaustionReturnsLastErr (0.10s) === RUN TestListObjectVersionsPagination --- PASS: TestListObjectVersionsPagination (0.06s) === RUN TestSelectLatestVersion_MixedFormats --- PASS: TestSelectLatestVersion_MixedFormats (0.00s) === RUN TestSelectLatestVersion_PromotesNewestDeleteMarker --- PASS: TestSelectLatestVersion_PromotesNewestDeleteMarker (0.00s) === RUN TestSelectLatestVersion_ContentWinsWhenNewer --- PASS: TestSelectLatestVersion_ContentWinsWhenNewer (0.00s) === RUN TestSelectLatestVersion_OnlyDeleteMarkers --- PASS: TestSelectLatestVersion_OnlyDeleteMarkers (0.00s) === RUN TestSelectLatestVersion_EmptyOrUntagged --- PASS: TestSelectLatestVersion_EmptyOrUntagged (0.00s) === RUN TestVersionIdFromEntry --- PASS: TestVersionIdFromEntry (0.00s) === RUN TestSelectLatestVersion_FilenameFallback --- PASS: TestSelectLatestVersion_FilenameFallback (0.00s) === RUN TestSelectLatestVersion_FilenameFallbackMixedWithTagged --- PASS: TestSelectLatestVersion_FilenameFallbackMixedWithTagged (0.00s) === RUN TestSelectLatestVersion_FilenameFallbackDeleteMarker --- PASS: TestSelectLatestVersion_FilenameFallbackDeleteMarker (0.00s) === RUN TestPartBoundaryJsonCompatibility --- PASS: TestPartBoundaryJsonCompatibility (0.00s) === RUN TestBuildObjectAttributesPartsPrefersOffsets --- PASS: TestBuildObjectAttributesPartsPrefersOffsets (0.00s) === RUN TestBuildObjectAttributesPartsLegacyChunkIndexes --- PASS: TestBuildObjectAttributesPartsLegacyChunkIndexes (0.00s) === RUN TestValidateRequestPath_RejectsTraversal === RUN TestValidateRequestPath_RejectsTraversal/clean_path_passes === RUN TestValidateRequestPath_RejectsTraversal/bucket_only_passes === RUN TestValidateRequestPath_RejectsTraversal/trailing_slash_passes === RUN TestValidateRequestPath_RejectsTraversal/leading_dotdot_rejected === RUN TestValidateRequestPath_RejectsTraversal/nested_dotdot_rejected === RUN TestValidateRequestPath_RejectsTraversal/backslash_dotdot_rejected === RUN TestValidateRequestPath_RejectsTraversal/percent-encoded_dotdot_rejected === RUN TestValidateRequestPath_RejectsTraversal/bare_dot_object_rejected === RUN TestValidateRequestPath_RejectsTraversal/dotdot_bucket_rejected --- PASS: TestValidateRequestPath_RejectsTraversal (0.03s) --- PASS: TestValidateRequestPath_RejectsTraversal/clean_path_passes (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/bucket_only_passes (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/trailing_slash_passes (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/leading_dotdot_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/nested_dotdot_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/backslash_dotdot_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/percent-encoded_dotdot_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/bare_dot_object_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/dotdot_bucket_rejected (0.00s) === RUN TestValidateRequestPath_RejectsEmptyCapturedVars === RUN TestValidateRequestPath_RejectsEmptyCapturedVars/empty_bucket === RUN TestValidateRequestPath_RejectsEmptyCapturedVars/empty_object --- PASS: TestValidateRequestPath_RejectsEmptyCapturedVars (0.00s) --- PASS: TestValidateRequestPath_RejectsEmptyCapturedVars/empty_bucket (0.00s) --- PASS: TestValidateRequestPath_RejectsEmptyCapturedVars/empty_object (0.00s) === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/clean_version_ID === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/clean_upload_ID === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/empty_values === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/version_ID_encoded_slash === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/version_ID_backslash === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/upload_ID_traversal === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/unsafe_repeated_value === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/encoded_version_ID_name === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/encoded_upload_ID_name === RUN TestValidateRequestPath_RejectsUnsafePathQueryValues/unrelated_query --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues (0.01s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/clean_version_ID (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/clean_upload_ID (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/empty_values (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/version_ID_encoded_slash (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/version_ID_backslash (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/upload_ID_traversal (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/unsafe_repeated_value (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/encoded_version_ID_name (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/encoded_upload_ID_name (0.00s) --- PASS: TestValidateRequestPath_RejectsUnsafePathQueryValues/unrelated_query (0.00s) === RUN TestHasPathSegmentQuery_CommonPathDoesNotAllocate --- PASS: TestHasPathSegmentQuery_CommonPathDoesNotAllocate (0.02s) === RUN TestPutPublicAccessBlockStoresConfiguration I1117 09:43:08.462220 config_loader.go:73 Using explicit credential store: memory --- PASS: TestPutPublicAccessBlockStoresConfiguration (0.05s) === RUN TestUnreadablePublicAccessBlockBlocksPublicAccess I1117 09:43:08.512895 config_loader.go:73 Using explicit credential store: memory E1117 09:43:08.514471 s3api_bucket_config.go:439 newBucketConfigFromEntry: bucket b public access block, blocking all public access: XML syntax error on line 1: unexpected EOF --- PASS: TestUnreadablePublicAccessBlockBlocksPublicAccess (0.01s) === RUN TestBucketUpdateKeepsStoredPublicAccessBlock I1117 09:43:08.522285 config_loader.go:73 Using explicit credential store: memory E1117 09:43:08.531537 s3api_bucket_config.go:439 newBucketConfigFromEntry: bucket pab-keep public access block, blocking all public access: XML syntax error on line 1: unexpected EOF I1117 09:43:08.540544 config_loader.go:73 Using explicit credential store: memory I1117 09:43:08.554635 config_loader.go:73 Using explicit credential store: memory E1117 09:43:08.563503 s3api_bucket_config.go:439 newBucketConfigFromEntry: bucket pab-keep public access block, blocking all public access: XML syntax error on line 1: unexpected EOF E1117 09:43:08.567055 s3api_bucket_config.go:439 newBucketConfigFromEntry: bucket pab-keep public access block, blocking all public access: XML syntax error on line 1: unexpected EOF --- PASS: TestBucketUpdateKeepsStoredPublicAccessBlock (0.06s) === RUN TestPutPublicAccessBlockRejectsMalformedXML I1117 09:43:08.577831 config_loader.go:73 Using explicit credential store: memory --- PASS: TestPutPublicAccessBlockRejectsMalformedXML (0.02s) === RUN TestGetPublicAccessBlock I1117 09:43:08.606229 config_loader.go:73 Using explicit credential store: memory I1117 09:43:08.635787 config_loader.go:73 Using explicit credential store: memory --- PASS: TestGetPublicAccessBlock (0.05s) === RUN TestDeletePublicAccessBlockRemovesConfiguration I1117 09:43:08.652654 config_loader.go:73 Using explicit credential store: memory --- PASS: TestDeletePublicAccessBlockRemovesConfiguration (0.02s) === RUN TestPublicAccessBlockMissingBucket I1117 09:43:08.670513 config_loader.go:73 Using explicit credential store: memory --- PASS: TestPublicAccessBlockMissingBucket (0.02s) === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_private I1117 09:43:08.689835 config_loader.go:73 Using explicit credential store: memory === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/object_private I1117 09:43:08.763095 config_loader.go:73 Using explicit credential store: memory === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_public-read I1117 09:43:08.784556 config_loader.go:73 Using explicit credential store: memory === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/object_public-read I1117 09:43:08.799473 config_loader.go:73 Using explicit credential store: memory === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_public-read-write I1117 09:43:08.818824 config_loader.go:73 Using explicit credential store: memory === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/object_public-read-write I1117 09:43:08.832561 config_loader.go:73 Using explicit credential store: memory === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_authenticated-read I1117 09:43:08.851781 config_loader.go:73 Using explicit credential store: memory === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/object_authenticated-read I1117 09:43:08.865843 config_loader.go:73 Using explicit credential store: memory === RUN TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_xml_all_users_grant I1117 09:43:08.884468 config_loader.go:73 Using explicit credential store: memory --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls (0.21s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_private (0.07s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/object_private (0.02s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_public-read (0.01s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/object_public-read (0.02s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_public-read-write (0.01s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/object_public-read-write (0.02s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_authenticated-read (0.01s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/object_authenticated-read (0.02s) --- PASS: TestBlockPublicAclsRejectsPublicBucketAndObjectAcls/bucket_xml_all_users_grant (0.02s) === RUN TestGetRequestDataReader_ChunkedEncodingWithoutIAM I1117 09:43:08.900208 config_loader.go:73 Using explicit credential store: memory === RUN TestGetRequestDataReader_ChunkedEncodingWithoutIAM/RegularRequest s3api_put_object_helper_test.go:88: Test case: RegularRequest - Regular requests without chunked encoding should pass through unchanged === RUN TestGetRequestDataReader_ChunkedEncodingWithoutIAM/StreamingSignedWithoutIAM s3api_put_object_helper_test.go:88: Test case: StreamingSignedWithoutIAM - Streaming signed requests are decoded when IAM is disabled; signatures are skipped since there is nothing to verify them against === RUN TestGetRequestDataReader_ChunkedEncodingWithoutIAM/StreamingUnsignedWithoutIAM s3api_put_object_helper_test.go:88: Test case: StreamingUnsignedWithoutIAM - Streaming unsigned requests should be processed even when IAM is disabled --- PASS: TestGetRequestDataReader_ChunkedEncodingWithoutIAM (0.01s) --- PASS: TestGetRequestDataReader_ChunkedEncodingWithoutIAM/RegularRequest (0.00s) --- PASS: TestGetRequestDataReader_ChunkedEncodingWithoutIAM/StreamingSignedWithoutIAM (0.00s) --- PASS: TestGetRequestDataReader_ChunkedEncodingWithoutIAM/StreamingUnsignedWithoutIAM (0.00s) === RUN TestGetRequestDataReader_AuthTypeDetection I1117 09:43:08.907225 config_loader.go:73 Using explicit credential store: memory === RUN TestGetRequestDataReader_AuthTypeDetection/ChunkedDataWithChecksum --- PASS: TestGetRequestDataReader_AuthTypeDetection (0.00s) --- PASS: TestGetRequestDataReader_AuthTypeDetection/ChunkedDataWithChecksum (0.00s) === RUN TestGetRequestDataReader_IAMEnabled I1117 09:43:08.909571 config_loader.go:73 Using explicit credential store: memory === RUN TestGetRequestDataReader_IAMEnabled/StreamingUnsignedWithIAMEnabled --- PASS: TestGetRequestDataReader_IAMEnabled (0.00s) --- PASS: TestGetRequestDataReader_IAMEnabled/StreamingUnsignedWithIAMEnabled (0.00s) === RUN TestAuthTypeDetection === RUN TestAuthTypeDetection/StreamingUnsigned === RUN TestAuthTypeDetection/StreamingSigned === RUN TestAuthTypeDetection/Regular --- PASS: TestAuthTypeDetection (0.00s) --- PASS: TestAuthTypeDetection/StreamingUnsigned (0.00s) --- PASS: TestAuthTypeDetection/StreamingSigned (0.00s) --- PASS: TestAuthTypeDetection/Regular (0.00s) === RUN TestExpectedContentSha256 === RUN TestExpectedContentSha256/absent === RUN TestExpectedContentSha256/unsigned === RUN TestExpectedContentSha256/streaming_signed === RUN TestExpectedContentSha256/streaming_trailer === RUN TestExpectedContentSha256/streaming_unsigned === RUN TestExpectedContentSha256/hex === RUN TestExpectedContentSha256/not_hex === RUN TestExpectedContentSha256/short_hex === RUN TestExpectedContentSha256/base64_decodes_to_sha256 --- PASS: TestExpectedContentSha256 (0.01s) --- PASS: TestExpectedContentSha256/absent (0.00s) --- PASS: TestExpectedContentSha256/unsigned (0.00s) --- PASS: TestExpectedContentSha256/streaming_signed (0.00s) --- PASS: TestExpectedContentSha256/streaming_trailer (0.00s) --- PASS: TestExpectedContentSha256/streaming_unsigned (0.00s) --- PASS: TestExpectedContentSha256/hex (0.00s) --- PASS: TestExpectedContentSha256/not_hex (0.00s) --- PASS: TestExpectedContentSha256/short_hex (0.00s) --- PASS: TestExpectedContentSha256/base64_decodes_to_sha256 (0.00s) === RUN TestContentSha256VerifierMatch --- PASS: TestContentSha256VerifierMatch (0.00s) === RUN TestContentSha256VerifierMismatch --- PASS: TestContentSha256VerifierMismatch (0.00s) === RUN TestContentSha256VerifierSurvivesDroppedError --- PASS: TestContentSha256VerifierSurvivesDroppedError (0.00s) === RUN TestGetRequestDataReaderEmptyBodyHash I1117 09:43:08.925573 config_loader.go:73 Using explicit credential store: memory --- PASS: TestGetRequestDataReaderEmptyBodyHash (0.00s) === RUN TestIsInRemoteOnly === RUN TestIsInRemoteOnly/remote-only_entry_with_no_chunks === RUN TestIsInRemoteOnly/remote_entry_with_chunks_(cached) === RUN TestIsInRemoteOnly/local_file_with_chunks_(not_remote) === RUN TestIsInRemoteOnly/empty_remote_entry_(size_0) === RUN TestIsInRemoteOnly/no_chunks_but_nil_RemoteEntry --- PASS: TestIsInRemoteOnly (0.00s) --- PASS: TestIsInRemoteOnly/remote-only_entry_with_no_chunks (0.00s) --- PASS: TestIsInRemoteOnly/remote_entry_with_chunks_(cached) (0.00s) --- PASS: TestIsInRemoteOnly/local_file_with_chunks_(not_remote) (0.00s) --- PASS: TestIsInRemoteOnly/empty_remote_entry_(size_0) (0.00s) --- PASS: TestIsInRemoteOnly/no_chunks_but_nil_RemoteEntry (0.00s) === RUN TestRemoteOnlyEntryDetection === RUN TestRemoteOnlyEntryDetection/remote-only_entry_(no_chunks,_has_remote_entry) === RUN TestRemoteOnlyEntryDetection/data_integrity_error_(no_chunks,_no_remote,_has_size) === RUN TestRemoteOnlyEntryDetection/empty_local_file_(no_chunks,_no_remote,_size_0) === RUN TestRemoteOnlyEntryDetection/normal_file_with_chunks --- PASS: TestRemoteOnlyEntryDetection (0.00s) --- PASS: TestRemoteOnlyEntryDetection/remote-only_entry_(no_chunks,_has_remote_entry) (0.00s) --- PASS: TestRemoteOnlyEntryDetection/data_integrity_error_(no_chunks,_no_remote,_has_size) (0.00s) --- PASS: TestRemoteOnlyEntryDetection/empty_local_file_(no_chunks,_no_remote,_size_0) (0.00s) --- PASS: TestRemoteOnlyEntryDetection/normal_file_with_chunks (0.00s) === RUN TestVersionedRemoteObjectPathBuilding === RUN TestVersionedRemoteObjectPathBuilding/non-versioned_object_(empty_versionId) === RUN TestVersionedRemoteObjectPathBuilding/null_version === RUN TestVersionedRemoteObjectPathBuilding/specific_version === RUN TestVersionedRemoteObjectPathBuilding/nested_object_with_version === RUN TestVersionedRemoteObjectPathBuilding/object_with_leading_slash_and_version --- PASS: TestVersionedRemoteObjectPathBuilding (0.00s) --- PASS: TestVersionedRemoteObjectPathBuilding/non-versioned_object_(empty_versionId) (0.00s) --- PASS: TestVersionedRemoteObjectPathBuilding/null_version (0.00s) --- PASS: TestVersionedRemoteObjectPathBuilding/specific_version (0.00s) --- PASS: TestVersionedRemoteObjectPathBuilding/nested_object_with_version (0.00s) --- PASS: TestVersionedRemoteObjectPathBuilding/object_with_leading_slash_and_version (0.00s) === RUN TestResolvedSourceVersionId === RUN TestResolvedSourceVersionId/explicit_request_versionId_wins === RUN TestResolvedSourceVersionId/empty_request_falls_back_to_entry_version_(latest_in_versioned_bucket) === RUN TestResolvedSourceVersionId/empty_request_and_pre-versioning_entry_stays_empty === RUN TestResolvedSourceVersionId/empty_request_and_nil_Extended_stays_empty === RUN TestResolvedSourceVersionId/nil_entry_tolerated_when_no_request_version --- PASS: TestResolvedSourceVersionId (0.00s) --- PASS: TestResolvedSourceVersionId/explicit_request_versionId_wins (0.00s) --- PASS: TestResolvedSourceVersionId/empty_request_falls_back_to_entry_version_(latest_in_versioned_bucket) (0.00s) --- PASS: TestResolvedSourceVersionId/empty_request_and_pre-versioning_entry_stays_empty (0.00s) --- PASS: TestResolvedSourceVersionId/empty_request_and_nil_Extended_stays_empty (0.00s) --- PASS: TestResolvedSourceVersionId/nil_entry_tolerated_when_no_request_version (0.00s) === RUN TestCachedEntryHasLocalData === RUN TestCachedEntryHasLocalData/nil_entry_is_not_a_hit === RUN TestCachedEntryHasLocalData/entry_with_chunks_is_a_hit === RUN TestCachedEntryHasLocalData/entry_with_inline_content_is_a_hit === RUN TestCachedEntryHasLocalData/entry_with_neither_chunks_nor_content_is_not_a_hit --- PASS: TestCachedEntryHasLocalData (0.00s) --- PASS: TestCachedEntryHasLocalData/nil_entry_is_not_a_hit (0.00s) --- PASS: TestCachedEntryHasLocalData/entry_with_chunks_is_a_hit (0.00s) --- PASS: TestCachedEntryHasLocalData/entry_with_inline_content_is_a_hit (0.00s) --- PASS: TestCachedEntryHasLocalData/entry_with_neither_chunks_nor_content_is_not_a_hit (0.00s) === RUN TestCopyObjectRemoteOnlySourceDetection === RUN TestCopyObjectRemoteOnlySourceDetection/remote-only_object_with_size_and_no_chunks/content === RUN TestCopyObjectRemoteOnlySourceDetection/local_file_with_chunks_-_copy_works_fine,_fix_does_not_engage === RUN TestCopyObjectRemoteOnlySourceDetection/small_inline_file_(no_chunks,_has_Content)_-_hits_inline_branch_but_not_broken === RUN TestCopyObjectRemoteOnlySourceDetection/remote_entry_already_cached_(has_chunks)_-_fix_does_not_engage === RUN TestCopyObjectRemoteOnlySourceDetection/zero-byte_remote_object_-_fix_does_not_engage,_inline_branch_handles_it --- PASS: TestCopyObjectRemoteOnlySourceDetection (0.00s) --- PASS: TestCopyObjectRemoteOnlySourceDetection/remote-only_object_with_size_and_no_chunks/content (0.00s) --- PASS: TestCopyObjectRemoteOnlySourceDetection/local_file_with_chunks_-_copy_works_fine,_fix_does_not_engage (0.00s) --- PASS: TestCopyObjectRemoteOnlySourceDetection/small_inline_file_(no_chunks,_has_Content)_-_hits_inline_branch_but_not_broken (0.00s) --- PASS: TestCopyObjectRemoteOnlySourceDetection/remote_entry_already_cached_(has_chunks)_-_fix_does_not_engage (0.00s) --- PASS: TestCopyObjectRemoteOnlySourceDetection/zero-byte_remote_object_-_fix_does_not_engage,_inline_branch_handles_it (0.00s) === RUN TestCacheRemoteObjectForStreamingTimeout --- PASS: TestCacheRemoteObjectForStreamingTimeout (0.21s) === RUN TestCacheRemoteObjectForStreamingCached --- PASS: TestCacheRemoteObjectForStreamingCached (0.01s) === RUN TestCacheRemoteObjectForCopyStaleGeneration --- PASS: TestCacheRemoteObjectForCopyStaleGeneration (0.01s) === RUN TestS3VersionedReadRejectsStaleCacheFill --- PASS: TestS3VersionedReadRejectsStaleCacheFill (0.02s) === RUN TestS3ColdReadStreamsFromOrigin === RUN TestS3ColdReadStreamsFromOrigin/full_read === RUN TestS3ColdReadStreamsFromOrigin/range_read === RUN TestS3ColdReadStreamsFromOrigin/short_origin_read_fails_instead_of_silently_truncating === RUN TestS3ColdReadStreamsFromOrigin/version-specific_read_keeps_503_retry === RUN TestS3ColdReadStreamsFromOrigin/latest_read_of_a_versioned_entry_keeps_503_retry === RUN TestS3ColdReadStreamsFromOrigin/local_cache_failure_falls_back_to_origin === RUN TestS3ColdReadStreamsFromOrigin/mount_with_a_zero_cache_wait_never_asks_the_cache === RUN TestS3ColdReadStreamsFromOrigin/zero_cache_wait_still_caches_a_version-specific_read === RUN TestS3ColdReadStreamsFromOrigin/entry_not_found_stays_404 === RUN TestS3ColdReadStreamsFromOrigin/entry_not_found_stays_404/canonical_status === RUN TestS3ColdReadStreamsFromOrigin/entry_not_found_stays_404/raw_sentinel --- PASS: TestS3ColdReadStreamsFromOrigin (0.21s) --- PASS: TestS3ColdReadStreamsFromOrigin/full_read (0.02s) --- PASS: TestS3ColdReadStreamsFromOrigin/range_read (0.02s) --- PASS: TestS3ColdReadStreamsFromOrigin/short_origin_read_fails_instead_of_silently_truncating (0.02s) --- PASS: TestS3ColdReadStreamsFromOrigin/version-specific_read_keeps_503_retry (0.02s) --- PASS: TestS3ColdReadStreamsFromOrigin/latest_read_of_a_versioned_entry_keeps_503_retry (0.02s) --- PASS: TestS3ColdReadStreamsFromOrigin/local_cache_failure_falls_back_to_origin (0.03s) --- PASS: TestS3ColdReadStreamsFromOrigin/mount_with_a_zero_cache_wait_never_asks_the_cache (0.02s) --- PASS: TestS3ColdReadStreamsFromOrigin/zero_cache_wait_still_caches_a_version-specific_read (0.02s) --- PASS: TestS3ColdReadStreamsFromOrigin/entry_not_found_stays_404 (0.04s) --- PASS: TestS3ColdReadStreamsFromOrigin/entry_not_found_stays_404/canonical_status (0.02s) --- PASS: TestS3ColdReadStreamsFromOrigin/entry_not_found_stays_404/raw_sentinel (0.02s) === RUN TestS3ReadOfObjectGoneFromRemote === RUN TestS3ReadOfObjectGoneFromRemote/cache_reports_it_gone === RUN TestS3ReadOfObjectGoneFromRemote/cache_still_filling,_origin_reports_it_gone W1117 09:43:09.446933 s3api_object_handlers.go:1514 streamFromVolumeServers: origin stream mybucket/dir/obj.bin: remote object not found === RUN TestS3ReadOfObjectGoneFromRemote/zero_cache_wait,_origin_reports_it_gone W1117 09:43:09.465603 s3api_object_handlers.go:1514 streamFromVolumeServers: origin stream mybucket/dir/obj.bin: remote object not found === RUN TestS3ReadOfObjectGoneFromRemote/origin_denied W1117 09:43:09.500828 s3api_object_handlers.go:1514 streamFromVolumeServers: origin stream mybucket/dir/obj.bin: googleapi: Error 403: forbidden E1117 09:43:09.501417 s3api_object_handlers.go:1298 streamFromVolumeServers: permanent cache error for mybucket/dir/obj.bin: rpc error: code = Internal desc = assign: no free volumes --- PASS: TestS3ReadOfObjectGoneFromRemote (0.09s) --- PASS: TestS3ReadOfObjectGoneFromRemote/cache_reports_it_gone (0.02s) --- PASS: TestS3ReadOfObjectGoneFromRemote/cache_still_filling,_origin_reports_it_gone (0.02s) --- PASS: TestS3ReadOfObjectGoneFromRemote/zero_cache_wait,_origin_reports_it_gone (0.02s) --- PASS: TestS3ReadOfObjectGoneFromRemote/origin_denied (0.04s) === RUN TestBuildVersionedRemoteObjectPathRejectsTraversal === RUN TestBuildVersionedRemoteObjectPathRejectsTraversal/valid_version === RUN TestBuildVersionedRemoteObjectPathRejectsTraversal/traversal_drops_to_unversioned === RUN TestBuildVersionedRemoteObjectPathRejectsTraversal/backslash_drops_to_unversioned === RUN TestBuildVersionedRemoteObjectPathRejectsTraversal/empty_is_unversioned === RUN TestBuildVersionedRemoteObjectPathRejectsTraversal/null_is_unversioned --- PASS: TestBuildVersionedRemoteObjectPathRejectsTraversal (0.00s) --- PASS: TestBuildVersionedRemoteObjectPathRejectsTraversal/valid_version (0.00s) --- PASS: TestBuildVersionedRemoteObjectPathRejectsTraversal/traversal_drops_to_unversioned (0.00s) --- PASS: TestBuildVersionedRemoteObjectPathRejectsTraversal/backslash_drops_to_unversioned (0.00s) --- PASS: TestBuildVersionedRemoteObjectPathRejectsTraversal/empty_is_unversioned (0.00s) --- PASS: TestBuildVersionedRemoteObjectPathRejectsTraversal/null_is_unversioned (0.00s) === RUN TestAdvertisedHost === RUN TestAdvertisedHost/advertised_ip_wins_over_wildcard_bind === RUN TestAdvertisedHost/advertised_ip_wins_over_specific_bind === RUN TestAdvertisedHost/bind_ip_used_when_no_advertised_ip === RUN TestAdvertisedHost/ipv6_bind_ip_used_when_no_advertised_ip === RUN TestAdvertisedHost/wildcard_bind_falls_back_to_detected === RUN TestAdvertisedHost/ipv6_wildcard_bind_falls_back_to_detected === RUN TestAdvertisedHost/bracketed_ipv6_wildcard_bind_falls_back_to_detected === RUN TestAdvertisedHost/expanded_ipv6_wildcard_bind_falls_back_to_detected === RUN TestAdvertisedHost/wildcard_advertised_ip_falls_back_to_bind_ip === RUN TestAdvertisedHost/wildcard_advertised_ip_and_bind_fall_back_to_detected === RUN TestAdvertisedHost/empty_falls_back_to_detected --- PASS: TestAdvertisedHost (0.03s) --- PASS: TestAdvertisedHost/advertised_ip_wins_over_wildcard_bind (0.00s) --- PASS: TestAdvertisedHost/advertised_ip_wins_over_specific_bind (0.00s) --- PASS: TestAdvertisedHost/bind_ip_used_when_no_advertised_ip (0.00s) --- PASS: TestAdvertisedHost/ipv6_bind_ip_used_when_no_advertised_ip (0.00s) --- PASS: TestAdvertisedHost/wildcard_bind_falls_back_to_detected (0.00s) --- PASS: TestAdvertisedHost/ipv6_wildcard_bind_falls_back_to_detected (0.00s) --- PASS: TestAdvertisedHost/bracketed_ipv6_wildcard_bind_falls_back_to_detected (0.00s) --- PASS: TestAdvertisedHost/expanded_ipv6_wildcard_bind_falls_back_to_detected (0.00s) --- PASS: TestAdvertisedHost/wildcard_advertised_ip_falls_back_to_bind_ip (0.00s) --- PASS: TestAdvertisedHost/wildcard_advertised_ip_and_bind_fall_back_to_detected (0.00s) --- PASS: TestAdvertisedHost/empty_falls_back_to_detected (0.00s) === RUN TestS3IamCache_NoMetadata_Unauthenticated --- PASS: TestS3IamCache_NoMetadata_Unauthenticated (0.00s) === RUN TestS3IamCache_MissingAuthorizationHeader_Unauthenticated --- PASS: TestS3IamCache_MissingAuthorizationHeader_Unauthenticated (0.00s) === RUN TestS3IamCache_NonBearerAuthorization_Unauthenticated --- PASS: TestS3IamCache_NonBearerAuthorization_Unauthenticated (0.00s) === RUN TestS3IamCache_InvalidToken_Unauthenticated --- PASS: TestS3IamCache_InvalidToken_Unauthenticated (0.01s) === RUN TestS3IamCache_GarbageToken_Unauthenticated --- PASS: TestS3IamCache_GarbageToken_Unauthenticated (0.00s) === RUN TestS3IamCache_ExpiredToken_Unauthenticated --- PASS: TestS3IamCache_ExpiredToken_Unauthenticated (0.00s) === RUN TestS3IamCache_ValidToken_WritesIdentity --- PASS: TestS3IamCache_ValidToken_WritesIdentity (0.01s) === RUN TestS3IamCache_ValidTokenFollowingStaleToken_Succeeds --- PASS: TestS3IamCache_ValidTokenFollowingStaleToken_Succeeds (0.01s) === RUN TestS3IamCache_NoSigningKey_RemotePeer_Unauthenticated --- PASS: TestS3IamCache_NoSigningKey_RemotePeer_Unauthenticated (0.00s) === RUN TestS3IamCache_NoSigningKey_LocalPeer_Allowed --- PASS: TestS3IamCache_NoSigningKey_LocalPeer_Allowed (0.01s) === RUN TestS3IamCache_WithKey_LocalPeerStillNeedsToken --- PASS: TestS3IamCache_WithKey_LocalPeerStillNeedsToken (0.00s) === RUN TestS3IamCache_RemoveIdentity_RequiresAuth --- PASS: TestS3IamCache_RemoveIdentity_RequiresAuth (0.00s) === RUN TestS3IamCache_PutPolicy_RequiresAuth --- PASS: TestS3IamCache_PutPolicy_RequiresAuth (0.00s) === RUN TestS3IamCache_DeletePolicy_RequiresAuth --- PASS: TestS3IamCache_DeletePolicy_RequiresAuth (0.00s) === RUN TestS3IamCache_GetPolicy_RequiresAuth --- PASS: TestS3IamCache_GetPolicy_RequiresAuth (0.00s) === RUN TestS3IamCache_ListPolicies_RequiresAuth --- PASS: TestS3IamCache_ListPolicies_RequiresAuth (0.00s) === RUN TestS3IamCache_PutGroup_RequiresAuth --- PASS: TestS3IamCache_PutGroup_RequiresAuth (0.00s) === RUN TestS3IamCache_RemoveGroup_RequiresAuth --- PASS: TestS3IamCache_RemoveGroup_RequiresAuth (0.00s) === RUN TestRouting_STSWithQueryParams I1117 09:43:09.603952 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_STSWithQueryParams (0.11s) === RUN TestRouting_STSWithBodyParams I1117 09:43:09.715305 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_STSWithBodyParams (0.11s) === RUN TestRouting_GetFederationTokenWithQueryParams I1117 09:43:09.826593 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_GetFederationTokenWithQueryParams (0.11s) === RUN TestRouting_GetFederationTokenAuthenticatedBody I1117 09:43:09.938181 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_GetFederationTokenAuthenticatedBody (0.12s) === RUN TestRouting_AuthenticatedIAM I1117 09:43:10.057458 config_loader.go:73 Using explicit credential store: memory E1117 09:43:10.170158 s3api_embedded_iam.go:363 IAM Response The authorization header is malformed. --- PASS: TestRouting_AuthenticatedIAM (0.12s) === RUN TestRouting_CreateServiceAccountParentUserScopedByPolicy I1117 09:43:10.173756 config_loader.go:73 Using explicit credential store: memory E1117 09:43:10.360993 s3api_embedded_iam.go:363 IAM Response Access Denied. E1117 09:43:10.367483 s3api_embedded_iam.go:363 IAM Response Access Denied. --- PASS: TestRouting_CreateServiceAccountParentUserScopedByPolicy (0.19s) === RUN TestRouting_IAMMatcherLogic === RUN TestRouting_IAMMatcherLogic/No_auth_-_anonymous I1117 09:43:10.369978 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_IAMMatcherLogic/AWS4_signature I1117 09:43:10.482167 config_loader.go:73 Using explicit credential store: memory E1117 09:43:10.591282 s3api_embedded_iam.go:363 IAM Response The authorization header is malformed. === RUN TestRouting_IAMMatcherLogic/AWS2_signature I1117 09:43:10.593533 config_loader.go:73 Using explicit credential store: memory W1117 09:43:10.700805 auth_signature_v2.go:161 InvalidAccessKeyId (V2 signed): attempted key 'AKIA...' not found. Available keys: 3, Auth enabled: true E1117 09:43:10.701921 s3api_embedded_iam.go:363 IAM Response The access key ID you provided does not exist in our records. === RUN TestRouting_IAMMatcherLogic/Presigned_V4 I1117 09:43:10.703815 config_loader.go:73 Using explicit credential store: memory E1117 09:43:10.849309 s3api_embedded_iam.go:363 IAM Response The authorization mechanism you have provided is not supported. Please use AWS4-HMAC-SHA256. === RUN TestRouting_IAMMatcherLogic/Presigned_V2 I1117 09:43:10.850906 config_loader.go:73 Using explicit credential store: memory E1117 09:43:10.936561 s3api_embedded_iam.go:363 IAM Response Missing fields in request. === RUN TestRouting_IAMMatcherLogic/AWS4_signature_with_STS_action_in_body I1117 09:43:10.938428 config_loader.go:73 Using explicit credential store: memory E1117 09:43:11.028584 s3api_embedded_iam.go:363 IAM Response The authorization header is malformed. --- PASS: TestRouting_IAMMatcherLogic (0.66s) --- PASS: TestRouting_IAMMatcherLogic/No_auth_-_anonymous (0.11s) --- PASS: TestRouting_IAMMatcherLogic/AWS4_signature (0.11s) --- PASS: TestRouting_IAMMatcherLogic/AWS2_signature (0.11s) --- PASS: TestRouting_IAMMatcherLogic/Presigned_V4 (0.15s) --- PASS: TestRouting_IAMMatcherLogic/Presigned_V2 (0.09s) --- PASS: TestRouting_IAMMatcherLogic/AWS4_signature_with_STS_action_in_body (0.09s) === RUN TestRouting_BucketRouteMatchesAnyHost === RUN TestRouting_BucketRouteMatchesAnyHost/virtual-host_domain_configured,_request_via_IP I1117 09:43:11.031275 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_BucketRouteMatchesAnyHost/virtual-host_domain_configured,_request_via_unrelated_host I1117 09:43:11.158567 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_BucketRouteMatchesAnyHost/path-style_+_virtual-host_configured,_request_via_IP I1117 09:43:11.287111 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_BucketRouteMatchesAnyHost/domain_configured,_request_via_the_bare_configured_host_(no_bucket_subdomain) I1117 09:43:11.464012 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_BucketRouteMatchesAnyHost (0.56s) --- PASS: TestRouting_BucketRouteMatchesAnyHost/virtual-host_domain_configured,_request_via_IP (0.13s) --- PASS: TestRouting_BucketRouteMatchesAnyHost/virtual-host_domain_configured,_request_via_unrelated_host (0.13s) --- PASS: TestRouting_BucketRouteMatchesAnyHost/path-style_+_virtual-host_configured,_request_via_IP (0.18s) --- PASS: TestRouting_BucketRouteMatchesAnyHost/domain_configured,_request_via_the_bare_configured_host_(no_bucket_subdomain) (0.12s) === RUN TestRouting_BucketRootPreflightUsesBucketCORS === RUN TestRouting_BucketRootPreflightUsesBucketCORS/path-style I1117 09:43:11.588731 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_BucketRootPreflightUsesBucketCORS/path-style_domain I1117 09:43:11.689528 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_BucketRootPreflightUsesBucketCORS/virtual-host_domain I1117 09:43:11.864857 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_BucketRootPreflightUsesBucketCORS (0.45s) --- PASS: TestRouting_BucketRootPreflightUsesBucketCORS/path-style (0.10s) --- PASS: TestRouting_BucketRootPreflightUsesBucketCORS/path-style_domain (0.17s) --- PASS: TestRouting_BucketRootPreflightUsesBucketCORS/virtual-host_domain (0.17s) === RUN TestRouting_BucketLifecycleWritesNeedAdmin I1117 09:43:12.039759 config_loader.go:73 Using explicit credential store: memory I1117 09:43:12.043496 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_BucketLifecycleWritesNeedAdmin (0.15s) === RUN TestRouting_BucketCorsAndVersioningWritesNeedTheirActions I1117 09:43:12.188830 config_loader.go:73 Using explicit credential store: memory I1117 09:43:12.192501 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_BucketCorsAndVersioningWritesNeedTheirActions (0.21s) === RUN TestSSECDecryptChunkView_NoOffsetAdjustment s3api_sse_decrypt_test.go:63: ✓ Correct decryption (using stored IV directly) successful s3api_sse_decrypt_test.go:91: ✓ Verified: Offset-adjusted IV produces corrupted data (as expected for SSE-C) s3api_sse_decrypt_test.go:96: Plaintext: "This is a test messa" s3api_sse_decrypt_test.go:101: Corrupted: "\xf3\xc0\x0e\x83\x96\xd1oeT\xd6q\xa7\x16_\b\xf1;\x1c\xaa\x84" --- PASS: TestSSECDecryptChunkView_NoOffsetAdjustment (0.01s) === RUN TestSSEKMSDecryptChunkView_RequiresOffsetAdjustment s3api_sse_decrypt_test.go:161: ✓ SSE-KMS decryption with offset adjustment successful s3api_sse_decrypt_test.go:182: ✓ Verified: double-adjusted IV produces corrupted data (range path must not pre-adjust) s3api_sse_decrypt_test.go:199: ✓ Verified: Base IV without offset produces corrupted data (as expected for SSE-KMS) --- PASS: TestSSEKMSDecryptChunkView_RequiresOffsetAdjustment (0.01s) === RUN TestSSEDecryptionDifferences s3api_sse_decrypt_test.go:205: SSE-C: Random IV per part → Use stored IV DIRECTLY (no offset) s3api_sse_decrypt_test.go:206: SSE-KMS: Base IV + offset → MUST call calculateIVWithOffset(baseIV, offset) s3api_sse_decrypt_test.go:207: SSE-S3: Base IV + offset → Stores ADJUSTED IV, use directly --- PASS: TestSSEDecryptionDifferences (0.00s) === RUN TestSSES3MultipartUploadStoresDerivedIV === RUN TestSSES3MultipartUploadStoresDerivedIV/Part_1_at_offset_0 s3api_sse_s3_upload_test.go:103: ✓ Derived IV decryption successful for offset 0 === RUN TestSSES3MultipartUploadStoresDerivedIV/Part_2_at_offset_1MB s3api_sse_s3_upload_test.go:103: ✓ Derived IV decryption successful for offset 1048576 s3api_sse_s3_upload_test.go:127: ✓ Verified: Base IV produces corrupted data at offset 1048576 (bug would cause this) === RUN TestSSES3MultipartUploadStoresDerivedIV/Part_3_at_offset_5MB s3api_sse_s3_upload_test.go:103: ✓ Derived IV decryption successful for offset 5242880 s3api_sse_s3_upload_test.go:127: ✓ Verified: Base IV produces corrupted data at offset 5242880 (bug would cause this) --- PASS: TestSSES3MultipartUploadStoresDerivedIV (0.01s) --- PASS: TestSSES3MultipartUploadStoresDerivedIV/Part_1_at_offset_0 (0.00s) --- PASS: TestSSES3MultipartUploadStoresDerivedIV/Part_2_at_offset_1MB (0.00s) --- PASS: TestSSES3MultipartUploadStoresDerivedIV/Part_3_at_offset_5MB (0.00s) === RUN TestHandleSSES3MultipartEncryptionFlow s3api_sse_s3_upload_test.go:203: ✓ Key.IV correctly updated with derived IV s3api_sse_s3_upload_test.go:225: ✓ Full encrypt-update_key-decrypt cycle successful --- PASS: TestHandleSSES3MultipartEncryptionFlow (0.01s) === RUN TestSSES3HeaderEncoding --- PASS: TestSSES3HeaderEncoding (0.00s) === RUN TestS3SSEStreamCommitsStatusOnFirstWrite === RUN TestS3SSEStreamCommitsStatusOnFirstWrite/readable_SSE-C_object_still_streams_a_200_with_the_plaintext === RUN TestS3SSEStreamCommitsStatusOnFirstWrite/unreadable_SSE-C_object_leaves_the_response_uncommitted === RUN TestS3SSEStreamCommitsStatusOnFirstWrite/unreadable_SSE-C_range_leaves_the_response_uncommitted --- PASS: TestS3SSEStreamCommitsStatusOnFirstWrite (2.62s) --- PASS: TestS3SSEStreamCommitsStatusOnFirstWrite/readable_SSE-C_object_still_streams_a_200_with_the_plaintext (0.02s) --- PASS: TestS3SSEStreamCommitsStatusOnFirstWrite/unreadable_SSE-C_object_leaves_the_response_uncommitted (2.58s) --- PASS: TestS3SSEStreamCommitsStatusOnFirstWrite/unreadable_SSE-C_range_leaves_the_response_uncommitted (0.02s) === RUN TestPutToFilerStorageClass === RUN TestPutToFilerStorageClass/invalid === RUN TestPutToFilerStorageClass/invalid_on_a_part === RUN TestPutToFilerStorageClass/valid === RUN TestPutToFilerStorageClass/absent --- PASS: TestPutToFilerStorageClass (0.05s) --- PASS: TestPutToFilerStorageClass/invalid (0.00s) --- PASS: TestPutToFilerStorageClass/invalid_on_a_part (0.00s) --- PASS: TestPutToFilerStorageClass/valid (0.02s) --- PASS: TestPutToFilerStorageClass/absent (0.02s) === RUN TestPutObjectRejectsInvalidHeadersBeforeReadingBody === RUN TestPutObjectRejectsInvalidHeadersBeforeReadingBody/unversioned/storage_class === RUN TestPutObjectRejectsInvalidHeadersBeforeReadingBody/unversioned/11_tags === RUN TestPutObjectRejectsInvalidHeadersBeforeReadingBody/versioning_enabled/storage_class === RUN TestPutObjectRejectsInvalidHeadersBeforeReadingBody/versioning_enabled/11_tags === RUN TestPutObjectRejectsInvalidHeadersBeforeReadingBody/versioning_suspended/storage_class === RUN TestPutObjectRejectsInvalidHeadersBeforeReadingBody/versioning_suspended/11_tags --- PASS: TestPutObjectRejectsInvalidHeadersBeforeReadingBody (0.08s) --- PASS: TestPutObjectRejectsInvalidHeadersBeforeReadingBody/unversioned/storage_class (0.01s) --- PASS: TestPutObjectRejectsInvalidHeadersBeforeReadingBody/unversioned/11_tags (0.01s) --- PASS: TestPutObjectRejectsInvalidHeadersBeforeReadingBody/versioning_enabled/storage_class (0.01s) --- PASS: TestPutObjectRejectsInvalidHeadersBeforeReadingBody/versioning_enabled/11_tags (0.01s) --- PASS: TestPutObjectRejectsInvalidHeadersBeforeReadingBody/versioning_suspended/storage_class (0.01s) --- PASS: TestPutObjectRejectsInvalidHeadersBeforeReadingBody/versioning_suspended/11_tags (0.01s) === RUN TestPutObjectPartRejectsInvalidHeadersBeforeReadingBody === RUN TestPutObjectPartRejectsInvalidHeadersBeforeReadingBody/storage_class === RUN TestPutObjectPartRejectsInvalidHeadersBeforeReadingBody/11_tags --- PASS: TestPutObjectPartRejectsInvalidHeadersBeforeReadingBody (0.01s) --- PASS: TestPutObjectPartRejectsInvalidHeadersBeforeReadingBody/storage_class (0.01s) --- PASS: TestPutObjectPartRejectsInvalidHeadersBeforeReadingBody/11_tags (0.01s) === RUN TestPutObjectDirectoryMarkerRejectsInvalidHeaders === RUN TestPutObjectDirectoryMarkerRejectsInvalidHeaders/storage_class === RUN TestPutObjectDirectoryMarkerRejectsInvalidHeaders/11_tags --- PASS: TestPutObjectDirectoryMarkerRejectsInvalidHeaders (0.03s) --- PASS: TestPutObjectDirectoryMarkerRejectsInvalidHeaders/storage_class (0.01s) --- PASS: TestPutObjectDirectoryMarkerRejectsInvalidHeaders/11_tags (0.01s) === RUN TestPutObjectDirectoryMarkerStoresHeaders I1117 09:43:15.242037 s3api_object_handlers_put.go:257 PutObjectHandler: explicit directory marker b/dir/ (contentType="", len=0) --- PASS: TestPutObjectDirectoryMarkerStoresHeaders (0.03s) === RUN TestPutObjectDirectoryMarkerChecksContentMd5 I1117 09:43:15.272379 s3api_object_handlers_put.go:257 PutObjectHandler: explicit directory marker b/dir/ (contentType="", len=6) --- PASS: TestPutObjectDirectoryMarkerChecksContentMd5 (0.02s) === RUN TestPutObjectValidStorageClassSniffsContentType --- PASS: TestPutObjectValidStorageClassSniffsContentType (0.03s) === RUN TestParseS3MetadataRejectsInvalidStorageClass W1117 09:43:15.304132 s3_metadata_util.go:29 Invalid storage class "BOGUS" --- PASS: TestParseS3MetadataRejectsInvalidStorageClass (0.00s) === RUN TestWriteStreamErrorResponse === RUN TestWriteStreamErrorResponse/context_canceled === RUN TestWriteStreamErrorResponse/wrapped_context_canceled === RUN TestWriteStreamErrorResponse/grpc_canceled === RUN TestWriteStreamErrorResponse/deadline_exceeded === RUN TestWriteStreamErrorResponse/unwritten_stream_error === RUN TestWriteStreamErrorResponse/too_many_requests === RUN TestWriteStreamErrorResponse/response_already_written --- PASS: TestWriteStreamErrorResponse (0.01s) --- PASS: TestWriteStreamErrorResponse/context_canceled (0.00s) --- PASS: TestWriteStreamErrorResponse/wrapped_context_canceled (0.00s) --- PASS: TestWriteStreamErrorResponse/grpc_canceled (0.00s) --- PASS: TestWriteStreamErrorResponse/deadline_exceeded (0.00s) --- PASS: TestWriteStreamErrorResponse/unwritten_stream_error (0.00s) --- PASS: TestWriteStreamErrorResponse/too_many_requests (0.00s) --- PASS: TestWriteStreamErrorResponse/response_already_written (0.00s) === RUN TestIdleTimeoutCancelStillAnswersConnectedClient --- PASS: TestIdleTimeoutCancelStillAnswersConnectedClient (0.25s) === RUN TestGetObjectAnswersRequestCanceledBeforeFirstByte E1117 09:43:15.834451 reader_at.go:270 fetching chunk {FileId:3,01637037d6 OffsetInChunk:0 ViewSize:11 ViewOffset:0 ChunkSize:11 IsGzipped:false ModifiedTsNs:1}: context canceled --- PASS: TestGetObjectAnswersRequestCanceledBeforeFirstByte (0.28s) === RUN TestAssumeRole_AdminCallerScopedToRolePolicies --- PASS: TestAssumeRole_AdminCallerScopedToRolePolicies (0.15s) === RUN TestAssumeRole_SelfAssumptionWithoutPrincipalArn --- PASS: TestAssumeRole_SelfAssumptionWithoutPrincipalArn (0.03s) === RUN TestAssumeRole_RejectsNonRoleArn === RUN TestAssumeRole_RejectsNonRoleArn/arn:aws:iam:::user/test-user === RUN TestAssumeRole_RejectsNonRoleArn/arn:aws:iam::123456789012:user/test-user === RUN TestAssumeRole_RejectsNonRoleArn/arn:aws:iam::123456789012:group/test-team === RUN TestAssumeRole_RejectsNonRoleArn/test-user --- PASS: TestAssumeRole_RejectsNonRoleArn (0.06s) --- PASS: TestAssumeRole_RejectsNonRoleArn/arn:aws:iam:::user/test-user (0.03s) --- PASS: TestAssumeRole_RejectsNonRoleArn/arn:aws:iam::123456789012:user/test-user (0.01s) --- PASS: TestAssumeRole_RejectsNonRoleArn/arn:aws:iam::123456789012:group/test-team (0.01s) --- PASS: TestAssumeRole_RejectsNonRoleArn/test-user (0.00s) === RUN TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy === RUN TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/trust_policy_admits_the_caller === RUN TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/trust_policy_admits_a_specific_principal === RUN TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/trust_policy_rejects_the_caller === RUN TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/identity_policy_explicit_deny_wins_over_trust_policy === RUN TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/session_policy_explicit_deny_blocks_role_chaining === RUN TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/revoked_chained_session_cannot_assume W1117 09:43:16.219693 auth_credentials.go:2850 AssumeRole explicit-deny check failed for 7c1dc34f5a2d3c617046ffe004a58cfc, denying: session has been revoked --- PASS: TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy (0.10s) --- PASS: TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/trust_policy_admits_the_caller (0.02s) --- PASS: TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/trust_policy_admits_a_specific_principal (0.01s) --- PASS: TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/trust_policy_rejects_the_caller (0.01s) --- PASS: TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/identity_policy_explicit_deny_wins_over_trust_policy (0.00s) --- PASS: TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/session_policy_explicit_deny_blocks_role_chaining (0.03s) --- PASS: TestAssumeRole_NonAdminCallerAuthorizedByTrustPolicy/revoked_chained_session_cannot_assume (0.03s) === RUN TestCallerPrincipalArn --- PASS: TestCallerPrincipalArn (0.00s) === RUN TestAssumeRoleWithWebIdentity_DispatchesThroughIAMManager === RUN TestAssumeRoleWithWebIdentity_DispatchesThroughIAMManager/with_IAMManager_wired === RUN TestAssumeRoleWithWebIdentity_DispatchesThroughIAMManager/without_IAM_integration --- PASS: TestAssumeRoleWithWebIdentity_DispatchesThroughIAMManager (0.00s) --- PASS: TestAssumeRoleWithWebIdentity_DispatchesThroughIAMManager/with_IAMManager_wired (0.00s) --- PASS: TestAssumeRoleWithWebIdentity_DispatchesThroughIAMManager/without_IAM_integration (0.00s) === RUN TestAssumeRoleWithWebIdentity_AllowsEmptyRoleArn --- PASS: TestAssumeRoleWithWebIdentity_AllowsEmptyRoleArn (0.00s) === RUN TestAssumeRole_CallerIdentityFallback === RUN TestAssumeRole_CallerIdentityFallback/Caller_is_IAM_User,_No_RoleArn === RUN TestAssumeRole_CallerIdentityFallback/Caller_is_STS_Assumed_Role,_No_RoleArn === RUN TestAssumeRole_CallerIdentityFallback/Explicit_RoleArn_Provided === RUN TestAssumeRole_CallerIdentityFallback/Malformed_ARN --- PASS: TestAssumeRole_CallerIdentityFallback (0.03s) --- PASS: TestAssumeRole_CallerIdentityFallback/Caller_is_IAM_User,_No_RoleArn (0.01s) --- PASS: TestAssumeRole_CallerIdentityFallback/Caller_is_STS_Assumed_Role,_No_RoleArn (0.00s) --- PASS: TestAssumeRole_CallerIdentityFallback/Explicit_RoleArn_Provided (0.00s) --- PASS: TestAssumeRole_CallerIdentityFallback/Malformed_ARN (0.01s) === RUN TestAssumeRole_EmbedsRolePolicies === RUN TestAssumeRole_EmbedsRolePolicies/RoleWithAttachedPolicies === RUN TestAssumeRole_EmbedsRolePolicies/RoleWithoutAttachedPolicies --- PASS: TestAssumeRole_EmbedsRolePolicies (0.01s) --- PASS: TestAssumeRole_EmbedsRolePolicies/RoleWithAttachedPolicies (0.01s) --- PASS: TestAssumeRole_EmbedsRolePolicies/RoleWithoutAttachedPolicies (0.00s) === RUN TestPrepareSTSCredentialsHonorsConfiguredDurations --- PASS: TestPrepareSTSCredentialsHonorsConfiguredDurations (0.00s) === RUN TestPrepareSTSCredentialsCapsAtRoleMaxDuration --- PASS: TestPrepareSTSCredentialsCapsAtRoleMaxDuration (0.00s) === RUN TestPrepareSTSCredentialsChecksTrustOnTheRoleItBinds --- PASS: TestPrepareSTSCredentialsChecksTrustOnTheRoleItBinds (0.01s) === RUN TestSTSRoutesEmitAuditEntries I1117 09:43:16.288412 config_loader.go:73 Using explicit credential store: memory === RUN TestSTSRoutesEmitAuditEntries/AssumeRole === RUN TestSTSRoutesEmitAuditEntries/GetCallerIdentity === RUN TestSTSRoutesEmitAuditEntries/GetFederationToken === RUN TestSTSRoutesEmitAuditEntries/AssumeRoleWithWebIdentity === RUN TestSTSRoutesEmitAuditEntries/AssumeRoleWithLDAPIdentity === RUN TestSTSRoutesEmitAuditEntries/AssumeRole_via_POST_body --- PASS: TestSTSRoutesEmitAuditEntries (0.34s) --- PASS: TestSTSRoutesEmitAuditEntries/AssumeRole (0.03s) --- PASS: TestSTSRoutesEmitAuditEntries/GetCallerIdentity (0.01s) --- PASS: TestSTSRoutesEmitAuditEntries/GetFederationToken (0.01s) --- PASS: TestSTSRoutesEmitAuditEntries/AssumeRoleWithWebIdentity (0.01s) --- PASS: TestSTSRoutesEmitAuditEntries/AssumeRoleWithLDAPIdentity (0.00s) --- PASS: TestSTSRoutesEmitAuditEntries/AssumeRole_via_POST_body (0.01s) === RUN TestParseDurationSeconds_RespectsConfiguredMaxSessionLength --- PASS: TestParseDurationSeconds_RespectsConfiguredMaxSessionLength (0.00s) === RUN TestParseDurationSeconds_RejectsAboveConfiguredMaxSessionLength --- PASS: TestParseDurationSeconds_RejectsAboveConfiguredMaxSessionLength (0.00s) === RUN TestParseDurationSeconds_FallsBackToDefaultWhenUnset --- PASS: TestParseDurationSeconds_FallsBackToDefaultWhenUnset (0.00s) === RUN TestParseDurationSeconds_EnforcesMinimum --- PASS: TestParseDurationSeconds_EnforcesMinimum (0.00s) === RUN TestParseDurationSeconds_EmptyReturnsNil --- PASS: TestParseDurationSeconds_EmptyReturnsNil (0.00s) === RUN TestParseDurationSeconds_SubMinimumMaxSessionLengthKeepsCapping --- PASS: TestParseDurationSeconds_SubMinimumMaxSessionLengthKeepsCapping (0.00s) === RUN TestGetCallerIdentityHandler === RUN TestGetCallerIdentityHandler/static_credentials_report_the_user_ARN === RUN TestGetCallerIdentityHandler/session_credentials_report_the_assumed_role,_not_the_minting_user === RUN TestGetCallerIdentityHandler/bad_signature_is_denied === RUN TestGetCallerIdentityHandler/unsigned_request_is_denied --- PASS: TestGetCallerIdentityHandler (0.03s) --- PASS: TestGetCallerIdentityHandler/static_credentials_report_the_user_ARN (0.00s) --- PASS: TestGetCallerIdentityHandler/session_credentials_report_the_assumed_role,_not_the_minting_user (0.01s) --- PASS: TestGetCallerIdentityHandler/bad_signature_is_denied (0.00s) --- PASS: TestGetCallerIdentityHandler/unsigned_request_is_denied (0.00s) === RUN TestGetCallerIdentityResponse_XMLMarshal --- PASS: TestGetCallerIdentityResponse_XMLMarshal (0.00s) === RUN TestGetFederationToken_BasicFlow --- PASS: TestGetFederationToken_BasicFlow (0.01s) === RUN TestGetFederationToken_WithSessionPolicy --- PASS: TestGetFederationToken_WithSessionPolicy (0.01s) === RUN TestGetFederationToken_RejectTemporaryCredentials === RUN TestGetFederationToken_RejectTemporaryCredentials/SessionTokenInHeader === RUN TestGetFederationToken_RejectTemporaryCredentials/SessionTokenInQuery --- PASS: TestGetFederationToken_RejectTemporaryCredentials (0.01s) --- PASS: TestGetFederationToken_RejectTemporaryCredentials/SessionTokenInHeader (0.00s) --- PASS: TestGetFederationToken_RejectTemporaryCredentials/SessionTokenInQuery (0.00s) === RUN TestGetFederationToken_VendedStaticCredential --- PASS: TestGetFederationToken_VendedStaticCredential (0.01s) === RUN TestGetFederationToken_MissingName --- PASS: TestGetFederationToken_MissingName (0.00s) === RUN TestGetFederationToken_NameValidation === RUN TestGetFederationToken_NameValidation/TooShort === RUN TestGetFederationToken_NameValidation/TooLong === RUN TestGetFederationToken_NameValidation/MinLength === RUN TestGetFederationToken_NameValidation/MaxLength === RUN TestGetFederationToken_NameValidation/ValidSpecialChars === RUN TestGetFederationToken_NameValidation/InvalidChars_Space === RUN TestGetFederationToken_NameValidation/InvalidChars_Slash --- PASS: TestGetFederationToken_NameValidation (0.01s) --- PASS: TestGetFederationToken_NameValidation/TooShort (0.00s) --- PASS: TestGetFederationToken_NameValidation/TooLong (0.00s) --- PASS: TestGetFederationToken_NameValidation/MinLength (0.00s) --- PASS: TestGetFederationToken_NameValidation/MaxLength (0.00s) --- PASS: TestGetFederationToken_NameValidation/ValidSpecialChars (0.00s) --- PASS: TestGetFederationToken_NameValidation/InvalidChars_Space (0.00s) --- PASS: TestGetFederationToken_NameValidation/InvalidChars_Slash (0.00s) === RUN TestGetFederationToken_DurationValidation === RUN TestGetFederationToken_DurationValidation/BelowMinimum === RUN TestGetFederationToken_DurationValidation/AboveMaximum === RUN TestGetFederationToken_DurationValidation/InvalidFormat === RUN TestGetFederationToken_DurationValidation/MinimumValid === RUN TestGetFederationToken_DurationValidation/MaximumValid_36Hours === RUN TestGetFederationToken_DurationValidation/Default12Hours --- PASS: TestGetFederationToken_DurationValidation (0.01s) --- PASS: TestGetFederationToken_DurationValidation/BelowMinimum (0.00s) --- PASS: TestGetFederationToken_DurationValidation/AboveMaximum (0.00s) --- PASS: TestGetFederationToken_DurationValidation/InvalidFormat (0.00s) --- PASS: TestGetFederationToken_DurationValidation/MinimumValid (0.00s) --- PASS: TestGetFederationToken_DurationValidation/MaximumValid_36Hours (0.00s) --- PASS: TestGetFederationToken_DurationValidation/Default12Hours (0.00s) === RUN TestGetFederationToken_ResponseFormat --- PASS: TestGetFederationToken_ResponseFormat (0.00s) === RUN TestGetFederationToken_PolicyEmbedding --- PASS: TestGetFederationToken_PolicyEmbedding (0.00s) === RUN TestGetFederationToken_PolicyIntersection --- PASS: TestGetFederationToken_PolicyIntersection (0.01s) === RUN TestGetFederationToken_MalformedPolicy === RUN TestGetFederationToken_MalformedPolicy/InvalidJSON === RUN TestGetFederationToken_MalformedPolicy/EmptyObject === RUN TestGetFederationToken_MalformedPolicy/TooLarge === RUN TestGetFederationToken_MalformedPolicy/ValidPolicy === RUN TestGetFederationToken_MalformedPolicy/EmptyString --- PASS: TestGetFederationToken_MalformedPolicy (0.01s) --- PASS: TestGetFederationToken_MalformedPolicy/InvalidJSON (0.00s) --- PASS: TestGetFederationToken_MalformedPolicy/EmptyObject (0.00s) --- PASS: TestGetFederationToken_MalformedPolicy/TooLarge (0.00s) --- PASS: TestGetFederationToken_MalformedPolicy/ValidPolicy (0.00s) --- PASS: TestGetFederationToken_MalformedPolicy/EmptyString (0.00s) === RUN TestGetFederationToken_STSNotReady --- PASS: TestGetFederationToken_STSNotReady (0.00s) === RUN TestGetFederationToken_DefaultDuration --- PASS: TestGetFederationToken_DefaultDuration (0.00s) === RUN TestGetFederationToken_GetPoliciesForUser === RUN TestGetFederationToken_GetPoliciesForUser/NoUserStore === RUN TestGetFederationToken_GetPoliciesForUser/UserNotFound === RUN TestGetFederationToken_GetPoliciesForUser/UserWithPolicies === RUN TestGetFederationToken_GetPoliciesForUser/UserWithNoPolicies --- PASS: TestGetFederationToken_GetPoliciesForUser (0.00s) --- PASS: TestGetFederationToken_GetPoliciesForUser/NoUserStore (0.00s) --- PASS: TestGetFederationToken_GetPoliciesForUser/UserNotFound (0.00s) --- PASS: TestGetFederationToken_GetPoliciesForUser/UserWithPolicies (0.00s) --- PASS: TestGetFederationToken_GetPoliciesForUser/UserWithNoPolicies (0.00s) === RUN TestGetFederationToken_PolicyMergeAndDedup --- PASS: TestGetFederationToken_PolicyMergeAndDedup (0.01s) === RUN TestGetFederationToken_PolicyMergeNoManager --- PASS: TestGetFederationToken_PolicyMergeNoManager (0.00s) === RUN TestAssumeRole_SessionNameIsNotTheUsername --- PASS: TestAssumeRole_SessionNameIsNotTheUsername (0.04s) === RUN TestAssumeRole_ChainedSessionKeepsTheUser --- PASS: TestAssumeRole_ChainedSessionKeepsTheUser (0.02s) === RUN TestAssumeRoleWithWebIdentityOverHTTP === RUN TestAssumeRoleWithWebIdentityOverHTTP/succeeds_with_parameters_in_the_query === RUN TestAssumeRoleWithWebIdentityOverHTTP/succeeds_with_parameters_in_the_body === RUN TestAssumeRoleWithWebIdentityOverHTTP/the_same_token_exchanges_twice === RUN TestAssumeRoleWithWebIdentityOverHTTP/inline_session_policy_is_reported_in_PackedPolicySize === RUN TestAssumeRoleWithWebIdentityOverHTTP/role_whose_trust_policy_rejects_the_provider_is_denied === RUN TestAssumeRoleWithWebIdentityOverHTTP/token_signed_by_a_key_we_do_not_publish_is_rejected === RUN TestAssumeRoleWithWebIdentityOverHTTP/token_naming_an_unknown_key_id_is_rejected --- PASS: TestAssumeRoleWithWebIdentityOverHTTP (21.33s) --- PASS: TestAssumeRoleWithWebIdentityOverHTTP/succeeds_with_parameters_in_the_query (0.18s) --- PASS: TestAssumeRoleWithWebIdentityOverHTTP/succeeds_with_parameters_in_the_body (0.12s) --- PASS: TestAssumeRoleWithWebIdentityOverHTTP/the_same_token_exchanges_twice (0.12s) --- PASS: TestAssumeRoleWithWebIdentityOverHTTP/inline_session_policy_is_reported_in_PackedPolicySize (0.13s) --- PASS: TestAssumeRoleWithWebIdentityOverHTTP/role_whose_trust_policy_rejects_the_provider_is_denied (0.09s) --- PASS: TestAssumeRoleWithWebIdentityOverHTTP/token_signed_by_a_key_we_do_not_publish_is_rejected (14.40s) --- PASS: TestAssumeRoleWithWebIdentityOverHTTP/token_naming_an_unknown_key_id_is_rejected (1.23s) === RUN TestRejectAmbiguousSubresource --- PASS: TestRejectAmbiguousSubresource (0.02s) === RUN TestS3TablesAuthRejectsFailedSignature I1117 09:43:38.172647 config_loader.go:73 Using explicit credential store: memory W1117 09:43:38.183941 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background E1117 09:43:38.186609 s3api_tables.go:795 S3Tables: AuthSignatureOnly failed: 67 --- PASS: TestS3TablesAuthRejectsFailedSignature (0.02s) === RUN TestS3TablesAuthControlDataPlane I1117 09:43:38.189934 config_loader.go:73 Using explicit credential store: memory W1117 09:43:38.198113 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestS3TablesAuthControlDataPlane (0.01s) === RUN TestS3TablesAuthOpenWhenAuthDisabled I1117 09:43:38.201246 config_loader.go:73 Using explicit credential store: memory W1117 09:43:38.208298 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestS3TablesAuthOpenWhenAuthDisabled (0.01s) === RUN TestS3TablesAuthSignedRequestPassess I1117 09:43:38.209864 config_loader.go:73 Using explicit credential store: memory W1117 09:43:38.219526 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestS3TablesAuthSignedRequestPassess (0.01s) === RUN TestSignedAccountHeaderDoesNotReachHandler I1117 09:43:38.225071 config_loader.go:73 Using explicit credential store: memory W1117 09:43:38.230476 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestSignedAccountHeaderDoesNotReachHandler (0.01s) === RUN TestIcebergAuthRejectsFailedSignature I1117 09:43:38.235216 config_loader.go:73 Using explicit credential store: memory W1117 09:43:38.243269 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestIcebergAuthRejectsFailedSignature (0.02s) === RUN TestLanceAuthRejectsFailedSignature I1117 09:43:38.256468 config_loader.go:73 Using explicit credential store: memory W1117 09:43:38.260998 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestLanceAuthRejectsFailedSignature (0.01s) === RUN TestLanceAuthTakesAnyKeyOnlyWhileS3AuthIsOff --- PASS: TestLanceAuthTakesAnyKeyOnlyWhileS3AuthIsOff (0.01s) === RUN TestAuthSignatureOnlyScrubsAccountHeader I1117 09:43:38.274498 config_loader.go:73 Using explicit credential store: memory W1117 09:43:38.279711 iam_manager.go:766 load OIDC providers from the store at startup: list OIDC providers: getOrCreateConnection localhost:18888: fail to dial localhost:18888: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials); retrying in the background --- PASS: TestAuthSignatureOnlyScrubsAccountHeader (0.01s) === RUN TestMaintenanceRestPathsMatchAWSBindings === RUN TestMaintenanceRestPathsMatchAWSBindings/PutTableBucketMaintenanceConfiguration === RUN TestMaintenanceRestPathsMatchAWSBindings/GetTableBucketMaintenanceConfiguration === RUN TestMaintenanceRestPathsMatchAWSBindings/PutTableMaintenanceConfiguration === RUN TestMaintenanceRestPathsMatchAWSBindings/GetTableMaintenanceConfiguration === RUN TestMaintenanceRestPathsMatchAWSBindings/GetTableMaintenanceJobStatus --- PASS: TestMaintenanceRestPathsMatchAWSBindings (0.02s) --- PASS: TestMaintenanceRestPathsMatchAWSBindings/PutTableBucketMaintenanceConfiguration (0.00s) --- PASS: TestMaintenanceRestPathsMatchAWSBindings/GetTableBucketMaintenanceConfiguration (0.00s) --- PASS: TestMaintenanceRestPathsMatchAWSBindings/PutTableMaintenanceConfiguration (0.00s) --- PASS: TestMaintenanceRestPathsMatchAWSBindings/GetTableMaintenanceConfiguration (0.00s) --- PASS: TestMaintenanceRestPathsMatchAWSBindings/GetTableMaintenanceJobStatus (0.00s) === RUN TestBuildPutTableMaintenanceConfigurationRequest --- PASS: TestBuildPutTableMaintenanceConfigurationRequest (0.01s) === RUN TestBuildPutTableBucketMaintenanceConfigurationRequest --- PASS: TestBuildPutTableBucketMaintenanceConfigurationRequest (0.00s) === RUN TestBuildMaintenanceRequestsRejectBadNamespace --- PASS: TestBuildMaintenanceRequestsRejectBadNamespace (0.00s) === RUN TestBuildRenameTableRequest === RUN TestBuildRenameTableRequest/newName_only_keeps_the_namespace === RUN TestBuildRenameTableRequest/newNamespaceName_only_keeps_the_name === RUN TestBuildRenameTableRequest/both_destination_fields === RUN TestBuildRenameTableRequest/percent-encoded_ARN_is_decoded === RUN TestBuildRenameTableRequest/versionToken_is_passed_through === RUN TestBuildRenameTableRequest/empty_body === RUN TestBuildRenameTableRequest/empty_object === RUN TestBuildRenameTableRequest/SeaweedFS-shaped_body === RUN TestBuildRenameTableRequest/invalid_newName === RUN TestBuildRenameTableRequest/invalid_newNamespaceName === RUN TestBuildRenameTableRequest/empty_newName_beside_a_valid_newNamespaceName === RUN TestBuildRenameTableRequest/empty_newNamespaceName_beside_a_valid_newName === RUN TestBuildRenameTableRequest/source_namespace_with_.. === RUN TestBuildRenameTableRequest/invalid_source_name === RUN TestBuildRenameTableRequest/malformed_body --- PASS: TestBuildRenameTableRequest (0.02s) --- PASS: TestBuildRenameTableRequest/newName_only_keeps_the_namespace (0.00s) --- PASS: TestBuildRenameTableRequest/newNamespaceName_only_keeps_the_name (0.00s) --- PASS: TestBuildRenameTableRequest/both_destination_fields (0.00s) --- PASS: TestBuildRenameTableRequest/percent-encoded_ARN_is_decoded (0.00s) --- PASS: TestBuildRenameTableRequest/versionToken_is_passed_through (0.00s) --- PASS: TestBuildRenameTableRequest/empty_body (0.00s) --- PASS: TestBuildRenameTableRequest/empty_object (0.00s) --- PASS: TestBuildRenameTableRequest/SeaweedFS-shaped_body (0.00s) --- PASS: TestBuildRenameTableRequest/invalid_newName (0.00s) --- PASS: TestBuildRenameTableRequest/invalid_newNamespaceName (0.00s) --- PASS: TestBuildRenameTableRequest/empty_newName_beside_a_valid_newNamespaceName (0.00s) --- PASS: TestBuildRenameTableRequest/empty_newNamespaceName_beside_a_valid_newName (0.00s) --- PASS: TestBuildRenameTableRequest/source_namespace_with_.. (0.00s) --- PASS: TestBuildRenameTableRequest/invalid_source_name (0.00s) --- PASS: TestBuildRenameTableRequest/malformed_body (0.00s) === RUN TestBuildListTablesRequestRejectsInvalidNamespaceQuery === RUN TestBuildListTablesRequestRejectsInvalidNamespaceQuery/uppercase === RUN TestBuildListTablesRequestRejectsInvalidNamespaceQuery/leading_hyphen === RUN TestBuildListTablesRequestRejectsInvalidNamespaceQuery/slash --- PASS: TestBuildListTablesRequestRejectsInvalidNamespaceQuery (0.00s) --- PASS: TestBuildListTablesRequestRejectsInvalidNamespaceQuery/uppercase (0.00s) --- PASS: TestBuildListTablesRequestRejectsInvalidNamespaceQuery/leading_hyphen (0.00s) --- PASS: TestBuildListTablesRequestRejectsInvalidNamespaceQuery/slash (0.00s) === RUN TestBuildGetTableRequestRejectsInvalidNamespaceQuery === RUN TestBuildGetTableRequestRejectsInvalidNamespaceQuery/uppercase === RUN TestBuildGetTableRequestRejectsInvalidNamespaceQuery/leading_hyphen === RUN TestBuildGetTableRequestRejectsInvalidNamespaceQuery/slash --- PASS: TestBuildGetTableRequestRejectsInvalidNamespaceQuery (0.00s) --- PASS: TestBuildGetTableRequestRejectsInvalidNamespaceQuery/uppercase (0.00s) --- PASS: TestBuildGetTableRequestRejectsInvalidNamespaceQuery/leading_hyphen (0.00s) --- PASS: TestBuildGetTableRequestRejectsInvalidNamespaceQuery/slash (0.00s) === RUN TestHandleRestOperationReturnsBadRequestForInvalidNamespaceQuery === RUN TestHandleRestOperationReturnsBadRequestForInvalidNamespaceQuery/uppercase === RUN TestHandleRestOperationReturnsBadRequestForInvalidNamespaceQuery/leading_hyphen === RUN TestHandleRestOperationReturnsBadRequestForInvalidNamespaceQuery/slash --- PASS: TestHandleRestOperationReturnsBadRequestForInvalidNamespaceQuery (0.01s) --- PASS: TestHandleRestOperationReturnsBadRequestForInvalidNamespaceQuery/uppercase (0.00s) --- PASS: TestHandleRestOperationReturnsBadRequestForInvalidNamespaceQuery/leading_hyphen (0.00s) --- PASS: TestHandleRestOperationReturnsBadRequestForInvalidNamespaceQuery/slash (0.00s) === RUN TestIsS3TablesSignedRequest === RUN TestIsS3TablesSignedRequest/regular_S3_auth_header === RUN TestIsS3TablesSignedRequest/S3_Tables_auth_header === RUN TestIsS3TablesSignedRequest/S3_Tables_presigned_query === RUN TestIsS3TablesSignedRequest/regular_S3_presigned_query === RUN TestIsS3TablesSignedRequest/unsigned_request === RUN TestIsS3TablesSignedRequest/malformed_credential === RUN TestIsS3TablesSignedRequest/service_substring_in_access_key_must_not_match === RUN TestIsS3TablesSignedRequest/region_named_s3tables_on_a_regular_S3_request === RUN TestIsS3TablesSignedRequest/region_named_s3tables_on_a_presigned_S3_request --- PASS: TestIsS3TablesSignedRequest (0.01s) --- PASS: TestIsS3TablesSignedRequest/regular_S3_auth_header (0.00s) --- PASS: TestIsS3TablesSignedRequest/S3_Tables_auth_header (0.00s) --- PASS: TestIsS3TablesSignedRequest/S3_Tables_presigned_query (0.00s) --- PASS: TestIsS3TablesSignedRequest/regular_S3_presigned_query (0.00s) --- PASS: TestIsS3TablesSignedRequest/unsigned_request (0.00s) --- PASS: TestIsS3TablesSignedRequest/malformed_credential (0.00s) --- PASS: TestIsS3TablesSignedRequest/service_substring_in_access_key_must_not_match (0.00s) --- PASS: TestIsS3TablesSignedRequest/region_named_s3tables_on_a_regular_S3_request (0.00s) --- PASS: TestIsS3TablesSignedRequest/region_named_s3tables_on_a_presigned_S3_request (0.00s) === RUN TestRouting_ListObjectsV2OnBucketNamedBuckets I1117 09:43:38.349730 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_ListObjectsV2OnBucketNamedBuckets (0.10s) === RUN TestRouting_S3TablesListTableBucketsStillReachable I1117 09:43:38.447581 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_S3TablesListTableBucketsStillReachable (0.09s) === RUN TestRouting_CreateBucketNamedBuckets I1117 09:43:38.541326 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_CreateBucketNamedBuckets (0.09s) === RUN TestRouting_GetObjectOnBucketNamedGetTable I1117 09:43:38.632697 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_GetObjectOnBucketNamedGetTable (0.09s) === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain I1117 09:43:38.728511 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/UpdateTableMetadataLocation === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/GetTableMetadataLocation === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/PutTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/GetTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/DeleteTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/GetTableEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/table_policy_under_POST === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/bucket_policy_under_POST === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/rename_under_GET === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain I1117 09:43:38.883747 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/UpdateTableMetadataLocation === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/GetTableMetadataLocation === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/PutTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/GetTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/DeleteTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/GetTableEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/table_policy_under_POST === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/bucket_policy_under_POST === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/rename_under_GET === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain I1117 09:43:39.118706 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/UpdateTableMetadataLocation === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/GetTableMetadataLocation === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/PutTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/GetTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/DeleteTableBucketEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/GetTableEncryption === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/table_policy_under_POST === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/bucket_policy_under_POST === RUN TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/rename_under_GET --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers (0.62s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain (0.15s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/UpdateTableMetadataLocation (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/GetTableMetadataLocation (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/PutTableBucketEncryption (0.00s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/GetTableBucketEncryption (0.00s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/DeleteTableBucketEncryption (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/GetTableEncryption (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/table_policy_under_POST (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/bucket_policy_under_POST (0.00s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/no_domain/rename_under_GET (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain (0.23s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/UpdateTableMetadataLocation (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/GetTableMetadataLocation (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/PutTableBucketEncryption (0.00s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/GetTableBucketEncryption (0.00s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/DeleteTableBucketEncryption (0.00s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/GetTableEncryption (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/table_policy_under_POST (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/bucket_policy_under_POST (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/path-style_domain/rename_under_GET (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain (0.22s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/UpdateTableMetadataLocation (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/GetTableMetadataLocation (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/PutTableBucketEncryption (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/GetTableBucketEncryption (0.00s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/DeleteTableBucketEncryption (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/GetTableEncryption (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/table_policy_under_POST (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/bucket_policy_under_POST (0.01s) --- PASS: TestRouting_UnroutedS3TablesOperationsNeverReachS3Handlers/virtual-host_domain/rename_under_GET (0.01s) === RUN TestRouting_S3SignedArnShapedKeysStayObjectRequests I1117 09:43:39.343774 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_S3SignedArnShapedKeysStayObjectRequests/UpdateTableMetadataLocation === RUN TestRouting_S3SignedArnShapedKeysStayObjectRequests/GetTableMetadataLocation === RUN TestRouting_S3SignedArnShapedKeysStayObjectRequests/PutTableBucketEncryption === RUN TestRouting_S3SignedArnShapedKeysStayObjectRequests/GetTableBucketEncryption === RUN TestRouting_S3SignedArnShapedKeysStayObjectRequests/DeleteTableBucketEncryption === RUN TestRouting_S3SignedArnShapedKeysStayObjectRequests/GetTableEncryption === RUN TestRouting_S3SignedArnShapedKeysStayObjectRequests/rename_under_GET --- PASS: TestRouting_S3SignedArnShapedKeysStayObjectRequests (0.21s) --- PASS: TestRouting_S3SignedArnShapedKeysStayObjectRequests/UpdateTableMetadataLocation (0.01s) --- PASS: TestRouting_S3SignedArnShapedKeysStayObjectRequests/GetTableMetadataLocation (0.01s) --- PASS: TestRouting_S3SignedArnShapedKeysStayObjectRequests/PutTableBucketEncryption (0.01s) --- PASS: TestRouting_S3SignedArnShapedKeysStayObjectRequests/GetTableBucketEncryption (0.01s) --- PASS: TestRouting_S3SignedArnShapedKeysStayObjectRequests/DeleteTableBucketEncryption (0.01s) --- PASS: TestRouting_S3SignedArnShapedKeysStayObjectRequests/GetTableEncryption (0.01s) --- PASS: TestRouting_S3SignedArnShapedKeysStayObjectRequests/rename_under_GET (0.00s) === RUN TestRouting_S3RegionNamedS3TablesStaysObjectRequest I1117 09:43:39.550664 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_S3RegionNamedS3TablesStaysObjectRequest (0.10s) === RUN TestRouting_RenameTableRESTReachesS3Tables I1117 09:43:39.651809 config_loader.go:73 Using explicit credential store: memory --- PASS: TestRouting_RenameTableRESTReachesS3Tables (0.14s) === RUN TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes I1117 09:43:39.790141 config_loader.go:73 Using explicit credential store: memory === RUN TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/bucket_CORS_preflight === RUN TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/health_probe_preflight === RUN TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/health_probe === RUN TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/STS === RUN TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/served_S3_Tables_operation --- PASS: TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes (0.10s) --- PASS: TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/bucket_CORS_preflight (0.00s) --- PASS: TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/health_probe_preflight (0.00s) --- PASS: TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/health_probe (0.00s) --- PASS: TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/STS (0.00s) --- PASS: TestRouting_S3TablesFallbackDoesNotShadowOtherRoutes/served_S3_Tables_operation (0.00s) === RUN TestCopyObjectResponse 123456782026-11-17T09:43:39.892Z --- PASS: TestCopyObjectResponse (0.00s) === RUN TestCopyPartResponse 123456782026-11-17T09:43:39.895Z --- PASS: TestCopyPartResponse (0.00s) === RUN TestVectorIAMPolicies === RUN TestVectorIAMPolicies/s3vectors:QueryVectors === RUN TestVectorIAMPolicies/s3vectors:* --- PASS: TestVectorIAMPolicies (0.03s) --- PASS: TestVectorIAMPolicies/s3vectors:QueryVectors (0.02s) --- PASS: TestVectorIAMPolicies/s3vectors:* (0.01s) === RUN TestEmbeddedIAMAcceptsVectorPoliciesWithoutFlattening --- PASS: TestEmbeddedIAMAcceptsVectorPoliciesWithoutFlattening (0.00s) === RUN TestVectorIAMBucketTagDeny --- PASS: TestVectorIAMBucketTagDeny (0.00s) === RUN TestVersionIdFormatDetection === RUN TestVersionIdFormatDetection/new_format_-_inverted_timestamp === RUN TestVersionIdFormatDetection/new_format_-_high_value === RUN TestVersionIdFormatDetection/old_format_-_raw_timestamp === RUN TestVersionIdFormatDetection/old_format_-_low_value === RUN TestVersionIdFormatDetection/null_version === RUN TestVersionIdFormatDetection/short_version_ID === RUN TestVersionIdFormatDetection/empty_version_ID --- PASS: TestVersionIdFormatDetection (0.00s) --- PASS: TestVersionIdFormatDetection/new_format_-_inverted_timestamp (0.00s) --- PASS: TestVersionIdFormatDetection/new_format_-_high_value (0.00s) --- PASS: TestVersionIdFormatDetection/old_format_-_raw_timestamp (0.00s) --- PASS: TestVersionIdFormatDetection/old_format_-_low_value (0.00s) --- PASS: TestVersionIdFormatDetection/null_version (0.00s) --- PASS: TestVersionIdFormatDetection/short_version_ID (0.00s) --- PASS: TestVersionIdFormatDetection/empty_version_ID (0.00s) === RUN TestIsValidVersionID === RUN TestIsValidVersionID/#00 === RUN TestIsValidVersionID/null === RUN TestIsValidVersionID/opaque-version_123 === RUN TestIsValidVersionID/v1/../../../victim === RUN TestIsValidVersionID/v1\..\victim === RUN TestIsValidVersionID/bad\x00version --- PASS: TestIsValidVersionID (0.00s) --- PASS: TestIsValidVersionID/#00 (0.00s) --- PASS: TestIsValidVersionID/null (0.00s) --- PASS: TestIsValidVersionID/opaque-version_123 (0.00s) --- PASS: TestIsValidVersionID/v1/../../../victim (0.00s) --- PASS: TestIsValidVersionID/v1\..\victim (0.00s) --- PASS: TestIsValidVersionID/bad\x00version (0.00s) === RUN TestGenerateVersionIdFormats --- PASS: TestGenerateVersionIdFormats (0.00s) === RUN TestGetVersionTimestamp --- PASS: TestGetVersionTimestamp (0.00s) === RUN TestCompareVersionIdsSameFormatOld --- PASS: TestCompareVersionIdsSameFormatOld (0.00s) === RUN TestCompareVersionIdsSameFormatNew --- PASS: TestCompareVersionIdsSameFormatNew (0.00s) === RUN TestCompareVersionIdsMixedFormats --- PASS: TestCompareVersionIdsMixedFormats (0.00s) === RUN TestCompareVersionIdsNullHandling --- PASS: TestCompareVersionIdsNullHandling (0.00s) === RUN TestOldFormatBackwardCompatibility --- PASS: TestOldFormatBackwardCompatibility (0.00s) === RUN TestNewFormatSorting --- PASS: TestNewFormatSorting (0.00s) === RUN TestMixedFormatTransition --- PASS: TestMixedFormatTransition (0.00s) === RUN TestVersioningHealLogPrefix --- PASS: TestVersioningHealLogPrefix (0.00s) === RUN TestVersioningHealInfof_FormatStringSafe I1117 09:43:39.948200 s3api_versioning_reconciler.go:46 [versioning-heal] event=smoke bucket=a-bucket key=obj-with-%s-percent err=100% --- PASS: TestVersioningHealInfof_FormatStringSafe (0.00s) === RUN TestSanitizeHealArg === RUN TestSanitizeHealArg/plain_string === RUN TestSanitizeHealArg/underscored === RUN TestSanitizeHealArg/slashed_key === RUN TestSanitizeHealArg/space === RUN TestSanitizeHealArg/newline === RUN TestSanitizeHealArg/carriage_return === RUN TestSanitizeHealArg/tab === RUN TestSanitizeHealArg/quote === RUN TestSanitizeHealArg/backslash === RUN TestSanitizeHealArg/control_char_(DEL) === RUN TestSanitizeHealArg/event=_injection_attempt === RUN TestSanitizeHealArg/error_with_newline === RUN TestSanitizeHealArg/error_plain === RUN TestSanitizeHealArg/nil_arg === RUN TestSanitizeHealArg/int_arg === RUN TestSanitizeHealArg/bool_arg --- PASS: TestSanitizeHealArg (0.01s) --- PASS: TestSanitizeHealArg/plain_string (0.00s) --- PASS: TestSanitizeHealArg/underscored (0.00s) --- PASS: TestSanitizeHealArg/slashed_key (0.00s) --- PASS: TestSanitizeHealArg/space (0.00s) --- PASS: TestSanitizeHealArg/newline (0.00s) --- PASS: TestSanitizeHealArg/carriage_return (0.00s) --- PASS: TestSanitizeHealArg/tab (0.00s) --- PASS: TestSanitizeHealArg/quote (0.00s) --- PASS: TestSanitizeHealArg/backslash (0.00s) --- PASS: TestSanitizeHealArg/control_char_(DEL) (0.00s) --- PASS: TestSanitizeHealArg/event=_injection_attempt (0.00s) --- PASS: TestSanitizeHealArg/error_with_newline (0.00s) --- PASS: TestSanitizeHealArg/error_plain (0.00s) --- PASS: TestSanitizeHealArg/nil_arg (0.00s) --- PASS: TestSanitizeHealArg/int_arg (0.00s) --- PASS: TestSanitizeHealArg/bool_arg (0.00s) === RUN TestVersioningHealInfof_KeyWithWhitespaceStaysOneField --- PASS: TestVersioningHealInfof_KeyWithWhitespaceStaysOneField (0.00s) === RUN TestVersioningHealEventVocabulary --- PASS: TestVersioningHealEventVocabulary (0.00s) === RUN TestVersionsHealQueue_DedupOnEnqueue I1117 09:43:39.961516 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=obj queue_depth=1 --- PASS: TestVersionsHealQueue_DedupOnEnqueue (0.00s) === RUN TestVersionsHealQueue_CapacityCap I1117 09:43:39.962689 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x00" queue_depth=1 I1117 09:43:39.962860 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x01" queue_depth=2 I1117 09:43:39.963010 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x02" queue_depth=3 I1117 09:43:39.963172 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x03" queue_depth=4 I1117 09:43:39.963318 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x04" queue_depth=5 I1117 09:43:39.963461 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x05" queue_depth=6 I1117 09:43:39.963603 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x06" queue_depth=7 I1117 09:43:39.963788 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\a" queue_depth=8 I1117 09:43:39.964051 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\b" queue_depth=9 I1117 09:43:39.964236 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\t" queue_depth=10 I1117 09:43:39.964406 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\n" queue_depth=11 I1117 09:43:39.964604 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\v" queue_depth=12 I1117 09:43:39.964802 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\f" queue_depth=13 I1117 09:43:39.964976 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\r" queue_depth=14 I1117 09:43:39.965177 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x0e" queue_depth=15 I1117 09:43:39.965316 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x0f" queue_depth=16 I1117 09:43:39.965457 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x10" queue_depth=17 I1117 09:43:39.965600 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x11" queue_depth=18 I1117 09:43:39.965758 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x12" queue_depth=19 I1117 09:43:39.965900 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x13" queue_depth=20 I1117 09:43:39.966039 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x14" queue_depth=21 I1117 09:43:39.966183 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x15" queue_depth=22 I1117 09:43:39.966324 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x16" queue_depth=23 I1117 09:43:39.966479 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x17" queue_depth=24 I1117 09:43:39.966624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x18" queue_depth=25 I1117 09:43:39.966764 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x19" queue_depth=26 I1117 09:43:39.966966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x1a" queue_depth=27 I1117 09:43:39.967122 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x1b" queue_depth=28 I1117 09:43:39.967340 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x1c" queue_depth=29 I1117 09:43:39.967486 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x1d" queue_depth=30 I1117 09:43:39.967630 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x1e" queue_depth=31 I1117 09:43:39.967769 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x1f" queue_depth=32 I1117 09:43:39.967912 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=" " queue_depth=33 I1117 09:43:39.968049 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=! queue_depth=34 I1117 09:43:39.968215 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\"" queue_depth=35 I1117 09:43:39.968357 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=# queue_depth=36 I1117 09:43:39.968491 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=$ queue_depth=37 I1117 09:43:39.968624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=% queue_depth=38 I1117 09:43:39.968757 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=& queue_depth=39 I1117 09:43:39.968890 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=' queue_depth=40 I1117 09:43:39.969023 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=( queue_depth=41 I1117 09:43:39.969161 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=) queue_depth=42 I1117 09:43:39.969294 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=* queue_depth=43 I1117 09:43:39.969428 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=+ queue_depth=44 I1117 09:43:39.969561 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=, queue_depth=45 I1117 09:43:39.969695 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=- queue_depth=46 I1117 09:43:39.969837 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=. queue_depth=47 I1117 09:43:39.969974 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=/ queue_depth=48 I1117 09:43:39.970122 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=0 queue_depth=49 I1117 09:43:39.970259 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=1 queue_depth=50 I1117 09:43:39.970401 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=2 queue_depth=51 I1117 09:43:39.970538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=3 queue_depth=52 I1117 09:43:39.970672 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=4 queue_depth=53 I1117 09:43:39.970807 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=5 queue_depth=54 I1117 09:43:39.970944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=6 queue_depth=55 I1117 09:43:39.971079 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=7 queue_depth=56 I1117 09:43:39.971325 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=8 queue_depth=57 I1117 09:43:39.971460 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=9 queue_depth=58 I1117 09:43:39.971618 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=: queue_depth=59 I1117 09:43:39.971757 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=; queue_depth=60 I1117 09:43:39.971893 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=< queue_depth=61 I1117 09:43:39.972027 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key== queue_depth=62 I1117 09:43:39.972166 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=> queue_depth=63 I1117 09:43:39.972302 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=? queue_depth=64 I1117 09:43:39.972439 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=@ queue_depth=65 I1117 09:43:39.972572 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=A queue_depth=66 I1117 09:43:39.972708 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=B queue_depth=67 I1117 09:43:39.972845 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=C queue_depth=68 I1117 09:43:39.972985 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=D queue_depth=69 I1117 09:43:39.973127 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=E queue_depth=70 I1117 09:43:39.973276 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=F queue_depth=71 I1117 09:43:39.973413 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=G queue_depth=72 I1117 09:43:39.973549 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=H queue_depth=73 I1117 09:43:39.973685 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=I queue_depth=74 I1117 09:43:39.973819 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=J queue_depth=75 I1117 09:43:39.973955 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=K queue_depth=76 I1117 09:43:39.974091 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=L queue_depth=77 I1117 09:43:39.974240 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=M queue_depth=78 I1117 09:43:39.974373 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=N queue_depth=79 I1117 09:43:39.974509 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=O queue_depth=80 I1117 09:43:39.974645 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=P queue_depth=81 I1117 09:43:39.974781 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Q queue_depth=82 I1117 09:43:39.974915 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=R queue_depth=83 I1117 09:43:39.975052 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=S queue_depth=84 I1117 09:43:39.975184 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=T queue_depth=85 I1117 09:43:39.975322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=U queue_depth=86 I1117 09:43:39.975458 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=V queue_depth=87 I1117 09:43:39.975594 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=W queue_depth=88 I1117 09:43:39.975726 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=X queue_depth=89 I1117 09:43:39.975859 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Y queue_depth=90 I1117 09:43:39.975999 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Z queue_depth=91 I1117 09:43:39.976159 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=[ queue_depth=92 I1117 09:43:39.976303 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\\" queue_depth=93 I1117 09:43:39.976444 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=] queue_depth=94 I1117 09:43:39.976581 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=^ queue_depth=95 I1117 09:43:39.976715 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=_ queue_depth=96 I1117 09:43:39.976847 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=` queue_depth=97 I1117 09:43:39.976980 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=a queue_depth=98 I1117 09:43:39.977115 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=b queue_depth=99 I1117 09:43:39.977250 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=c queue_depth=100 I1117 09:43:39.977386 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=d queue_depth=101 I1117 09:43:39.977525 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=e queue_depth=102 I1117 09:43:39.977670 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=f queue_depth=103 I1117 09:43:39.977807 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=g queue_depth=104 I1117 09:43:39.977941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=h queue_depth=105 I1117 09:43:39.978078 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=i queue_depth=106 I1117 09:43:39.978214 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=j queue_depth=107 I1117 09:43:39.978354 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=k queue_depth=108 I1117 09:43:39.978489 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=l queue_depth=109 I1117 09:43:39.978622 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=m queue_depth=110 I1117 09:43:39.978756 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=n queue_depth=111 I1117 09:43:39.978895 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=o queue_depth=112 I1117 09:43:39.979243 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=p queue_depth=113 I1117 09:43:39.979378 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=q queue_depth=114 I1117 09:43:39.979514 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=r queue_depth=115 I1117 09:43:39.979649 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=s queue_depth=116 I1117 09:43:39.979790 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=t queue_depth=117 I1117 09:43:39.979926 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=u queue_depth=118 I1117 09:43:39.980062 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=v queue_depth=119 I1117 09:43:39.980196 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=w queue_depth=120 I1117 09:43:39.980330 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=x queue_depth=121 I1117 09:43:39.980465 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=y queue_depth=122 I1117 09:43:39.980602 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=z queue_depth=123 I1117 09:43:39.980736 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key={ queue_depth=124 I1117 09:43:39.980892 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=| queue_depth=125 I1117 09:43:39.981031 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=} queue_depth=126 I1117 09:43:39.981165 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=~ queue_depth=127 I1117 09:43:39.981310 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key="\x7f" queue_depth=128 I1117 09:43:39.981572 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=€ queue_depth=129 I1117 09:43:39.981710 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key= queue_depth=130 I1117 09:43:39.981845 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=‚ queue_depth=131 I1117 09:43:39.981979 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƒ queue_depth=132 I1117 09:43:39.982113 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=„ queue_depth=133 I1117 09:43:39.982250 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=… queue_depth=134 I1117 09:43:39.982381 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=† queue_depth=135 I1117 09:43:39.982513 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=‡ queue_depth=136 I1117 09:43:39.982648 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˆ queue_depth=137 I1117 09:43:39.982780 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=‰ queue_depth=138 I1117 09:43:39.982915 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Š queue_depth=139 I1117 09:43:39.983067 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=‹ queue_depth=140 I1117 09:43:39.983205 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Œ queue_depth=141 I1117 09:43:39.983344 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key= queue_depth=142 I1117 09:43:39.983489 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ž queue_depth=143 I1117 09:43:39.983630 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key= queue_depth=144 I1117 09:43:39.983768 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key= queue_depth=145 I1117 09:43:39.983907 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=‘ queue_depth=146 I1117 09:43:39.984056 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=’ queue_depth=147 I1117 09:43:39.984206 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=“ queue_depth=148 I1117 09:43:39.984344 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=” queue_depth=149 I1117 09:43:39.984481 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=• queue_depth=150 I1117 09:43:39.984621 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=– queue_depth=151 I1117 09:43:39.984779 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=— queue_depth=152 I1117 09:43:39.984918 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˜ queue_depth=153 I1117 09:43:39.985055 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=™ queue_depth=154 I1117 09:43:39.985192 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=š queue_depth=155 I1117 09:43:39.985328 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=› queue_depth=156 I1117 09:43:39.985461 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=œ queue_depth=157 I1117 09:43:39.985620 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key= queue_depth=158 I1117 09:43:39.985762 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ž queue_depth=159 I1117 09:43:39.985903 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ÿ queue_depth=160 I1117 09:43:39.986042 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=  queue_depth=161 I1117 09:43:39.986181 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¡ queue_depth=162 I1117 09:43:39.986335 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¢ queue_depth=163 I1117 09:43:39.986482 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=£ queue_depth=164 I1117 09:43:39.986622 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¤ queue_depth=165 I1117 09:43:39.986756 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¥ queue_depth=166 I1117 09:43:39.986903 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¦ queue_depth=167 I1117 09:43:39.987134 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=§ queue_depth=168 I1117 09:43:39.987276 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¨ queue_depth=169 I1117 09:43:39.987411 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=© queue_depth=170 I1117 09:43:39.987545 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ª queue_depth=171 I1117 09:43:39.987679 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=« queue_depth=172 I1117 09:43:39.987813 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¬ queue_depth=173 I1117 09:43:39.987947 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=­ queue_depth=174 I1117 09:43:39.988078 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=® queue_depth=175 I1117 09:43:39.988214 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¯ queue_depth=176 I1117 09:43:39.988346 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=° queue_depth=177 I1117 09:43:39.988478 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=± queue_depth=178 I1117 09:43:39.988614 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=² queue_depth=179 I1117 09:43:39.988749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=³ queue_depth=180 I1117 09:43:39.988881 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=´ queue_depth=181 I1117 09:43:39.989028 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=µ queue_depth=182 I1117 09:43:39.989163 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¶ queue_depth=183 I1117 09:43:39.989296 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=· queue_depth=184 I1117 09:43:39.989427 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¸ queue_depth=185 I1117 09:43:39.989561 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¹ queue_depth=186 I1117 09:43:39.989696 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=º queue_depth=187 I1117 09:43:39.989838 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=» queue_depth=188 I1117 09:43:39.989975 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¼ queue_depth=189 I1117 09:43:39.990120 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=½ queue_depth=190 I1117 09:43:39.990294 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¾ queue_depth=191 I1117 09:43:39.990433 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=¿ queue_depth=192 I1117 09:43:39.990564 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=À queue_depth=193 I1117 09:43:39.990697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Á queue_depth=194 I1117 09:43:39.990831 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key= queue_depth=195 I1117 09:43:39.990966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=à queue_depth=196 I1117 09:43:39.991103 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ä queue_depth=197 I1117 09:43:39.991240 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Å queue_depth=198 I1117 09:43:39.991373 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Æ queue_depth=199 I1117 09:43:39.991505 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ç queue_depth=200 I1117 09:43:39.991636 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=È queue_depth=201 I1117 09:43:39.991768 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=É queue_depth=202 I1117 09:43:39.991900 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ê queue_depth=203 I1117 09:43:39.992037 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ë queue_depth=204 I1117 09:43:39.992172 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ì queue_depth=205 I1117 09:43:39.992303 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Í queue_depth=206 I1117 09:43:39.992439 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Î queue_depth=207 I1117 09:43:39.992573 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ï queue_depth=208 I1117 09:43:39.992716 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ð queue_depth=209 I1117 09:43:39.992850 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ñ queue_depth=210 I1117 09:43:39.992984 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ò queue_depth=211 I1117 09:43:39.993128 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ó queue_depth=212 I1117 09:43:39.993261 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ô queue_depth=213 I1117 09:43:39.993395 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Õ queue_depth=214 I1117 09:43:39.993539 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ö queue_depth=215 I1117 09:43:39.993671 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=× queue_depth=216 I1117 09:43:39.993810 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ø queue_depth=217 I1117 09:43:39.993947 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ù queue_depth=218 I1117 09:43:39.994083 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ú queue_depth=219 I1117 09:43:39.994215 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Û queue_depth=220 I1117 09:43:39.994347 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ü queue_depth=221 I1117 09:43:39.994481 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ý queue_depth=222 I1117 09:43:39.994614 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Þ queue_depth=223 I1117 09:43:39.994769 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ß queue_depth=224 I1117 09:43:39.995405 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=à queue_depth=225 I1117 09:43:39.995544 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=á queue_depth=226 I1117 09:43:39.995676 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=â queue_depth=227 I1117 09:43:39.995810 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ã queue_depth=228 I1117 09:43:39.995946 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ä queue_depth=229 I1117 09:43:39.996079 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=å queue_depth=230 I1117 09:43:39.996212 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=æ queue_depth=231 I1117 09:43:39.996346 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ç queue_depth=232 I1117 09:43:39.996487 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=è queue_depth=233 I1117 09:43:39.996621 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=é queue_depth=234 I1117 09:43:39.996755 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ê queue_depth=235 I1117 09:43:39.996887 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ë queue_depth=236 I1117 09:43:39.997017 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ì queue_depth=237 I1117 09:43:39.997155 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=í queue_depth=238 I1117 09:43:39.997290 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=î queue_depth=239 I1117 09:43:39.997424 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ï queue_depth=240 I1117 09:43:39.997557 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ð queue_depth=241 I1117 09:43:39.997693 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ñ queue_depth=242 I1117 09:43:39.997827 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ò queue_depth=243 I1117 09:43:39.997959 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ó queue_depth=244 I1117 09:43:39.998091 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ô queue_depth=245 I1117 09:43:39.998227 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=õ queue_depth=246 I1117 09:43:39.998359 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ö queue_depth=247 I1117 09:43:39.998492 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=÷ queue_depth=248 I1117 09:43:39.998622 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ø queue_depth=249 I1117 09:43:39.998755 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ù queue_depth=250 I1117 09:43:39.998887 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ú queue_depth=251 I1117 09:43:39.999018 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=û queue_depth=252 I1117 09:43:39.999151 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ü queue_depth=253 I1117 09:43:39.999284 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ý queue_depth=254 I1117 09:43:39.999421 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=þ queue_depth=255 I1117 09:43:39.999570 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ÿ queue_depth=256 I1117 09:43:39.999727 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ā queue_depth=257 I1117 09:43:39.999868 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ā queue_depth=258 I1117 09:43:40.000001 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ă queue_depth=259 I1117 09:43:40.000167 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ă queue_depth=260 I1117 09:43:40.000301 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ą queue_depth=261 I1117 09:43:40.000435 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ą queue_depth=262 I1117 09:43:40.000569 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ć queue_depth=263 I1117 09:43:40.000702 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ć queue_depth=264 I1117 09:43:40.000838 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ĉ queue_depth=265 I1117 09:43:40.000973 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĉ queue_depth=266 I1117 09:43:40.001108 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ċ queue_depth=267 I1117 09:43:40.001241 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ċ queue_depth=268 I1117 09:43:40.001375 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Č queue_depth=269 I1117 09:43:40.001509 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=č queue_depth=270 I1117 09:43:40.001641 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ď queue_depth=271 I1117 09:43:40.001777 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ď queue_depth=272 I1117 09:43:40.001909 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Đ queue_depth=273 I1117 09:43:40.002043 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=đ queue_depth=274 I1117 09:43:40.002179 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ē queue_depth=275 I1117 09:43:40.002314 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ē queue_depth=276 I1117 09:43:40.002459 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ĕ queue_depth=277 I1117 09:43:40.002596 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĕ queue_depth=278 I1117 09:43:40.002727 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ė queue_depth=279 I1117 09:43:40.002860 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ė queue_depth=280 I1117 09:43:40.002993 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ę queue_depth=281 I1117 09:43:40.003137 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ę queue_depth=282 I1117 09:43:40.003273 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ě queue_depth=283 I1117 09:43:40.003407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ě queue_depth=284 I1117 09:43:40.003539 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ĝ queue_depth=285 I1117 09:43:40.003675 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĝ queue_depth=286 I1117 09:43:40.003810 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ğ queue_depth=287 I1117 09:43:40.003944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ğ queue_depth=288 I1117 09:43:40.004081 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ġ queue_depth=289 I1117 09:43:40.004236 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ġ queue_depth=290 I1117 09:43:40.004371 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ģ queue_depth=291 I1117 09:43:40.004507 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ģ queue_depth=292 I1117 09:43:40.004656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ĥ queue_depth=293 I1117 09:43:40.004791 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĥ queue_depth=294 I1117 09:43:40.004924 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ħ queue_depth=295 I1117 09:43:40.005057 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ħ queue_depth=296 I1117 09:43:40.005191 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ĩ queue_depth=297 I1117 09:43:40.005330 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĩ queue_depth=298 I1117 09:43:40.005466 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ī queue_depth=299 I1117 09:43:40.005615 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ī queue_depth=300 I1117 09:43:40.005748 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ĭ queue_depth=301 I1117 09:43:40.005883 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĭ queue_depth=302 I1117 09:43:40.006015 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Į queue_depth=303 I1117 09:43:40.006153 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=į queue_depth=304 I1117 09:43:40.006289 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=İ queue_depth=305 I1117 09:43:40.006437 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ı queue_depth=306 I1117 09:43:40.006574 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=IJ queue_depth=307 I1117 09:43:40.006720 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ij queue_depth=308 I1117 09:43:40.006853 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ĵ queue_depth=309 I1117 09:43:40.006985 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĵ queue_depth=310 I1117 09:43:40.007121 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ķ queue_depth=311 I1117 09:43:40.007350 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ķ queue_depth=312 I1117 09:43:40.007488 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĸ queue_depth=313 I1117 09:43:40.007625 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ĺ queue_depth=314 I1117 09:43:40.007759 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ĺ queue_depth=315 I1117 09:43:40.007894 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ļ queue_depth=316 I1117 09:43:40.008025 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ļ queue_depth=317 I1117 09:43:40.008160 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ľ queue_depth=318 I1117 09:43:40.008295 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ľ queue_depth=319 I1117 09:43:40.008426 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŀ queue_depth=320 I1117 09:43:40.008559 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŀ queue_depth=321 I1117 09:43:40.008692 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ł queue_depth=322 I1117 09:43:40.008845 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ł queue_depth=323 I1117 09:43:40.008984 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ń queue_depth=324 I1117 09:43:40.009132 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ń queue_depth=325 I1117 09:43:40.009269 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ņ queue_depth=326 I1117 09:43:40.009400 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ņ queue_depth=327 I1117 09:43:40.009536 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ň queue_depth=328 I1117 09:43:40.009668 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ň queue_depth=329 I1117 09:43:40.009813 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʼn queue_depth=330 I1117 09:43:40.009949 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŋ queue_depth=331 I1117 09:43:40.010085 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŋ queue_depth=332 I1117 09:43:40.010222 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ō queue_depth=333 I1117 09:43:40.010355 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ō queue_depth=334 I1117 09:43:40.010490 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŏ queue_depth=335 I1117 09:43:40.010624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŏ queue_depth=336 I1117 09:43:40.010757 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ő queue_depth=337 I1117 09:43:40.010894 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ő queue_depth=338 I1117 09:43:40.011027 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Œ queue_depth=339 I1117 09:43:40.011164 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=œ queue_depth=340 I1117 09:43:40.011312 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŕ queue_depth=341 I1117 09:43:40.011450 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŕ queue_depth=342 I1117 09:43:40.011583 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŗ queue_depth=343 I1117 09:43:40.011715 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŗ queue_depth=344 I1117 09:43:40.011853 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ř queue_depth=345 I1117 09:43:40.012003 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ř queue_depth=346 I1117 09:43:40.012139 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ś queue_depth=347 I1117 09:43:40.012273 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ś queue_depth=348 I1117 09:43:40.012408 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŝ queue_depth=349 I1117 09:43:40.012541 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŝ queue_depth=350 I1117 09:43:40.012677 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ş queue_depth=351 I1117 09:43:40.012809 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ş queue_depth=352 I1117 09:43:40.012945 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Š queue_depth=353 I1117 09:43:40.013084 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=š queue_depth=354 I1117 09:43:40.013218 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ţ queue_depth=355 I1117 09:43:40.013378 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ţ queue_depth=356 I1117 09:43:40.013518 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ť queue_depth=357 I1117 09:43:40.013651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ť queue_depth=358 I1117 09:43:40.013785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŧ queue_depth=359 I1117 09:43:40.013919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŧ queue_depth=360 I1117 09:43:40.014051 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ũ queue_depth=361 I1117 09:43:40.014188 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ũ queue_depth=362 I1117 09:43:40.014319 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ū queue_depth=363 I1117 09:43:40.014457 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ū queue_depth=364 I1117 09:43:40.014589 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŭ queue_depth=365 I1117 09:43:40.014728 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŭ queue_depth=366 I1117 09:43:40.014864 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ů queue_depth=367 I1117 09:43:40.015011 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ů queue_depth=368 I1117 09:43:40.015155 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ű queue_depth=369 I1117 09:43:40.015291 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ű queue_depth=370 I1117 09:43:40.015422 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ų queue_depth=371 I1117 09:43:40.015554 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ų queue_depth=372 I1117 09:43:40.015687 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŵ queue_depth=373 I1117 09:43:40.015820 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŵ queue_depth=374 I1117 09:43:40.015951 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ŷ queue_depth=375 I1117 09:43:40.016083 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ŷ queue_depth=376 I1117 09:43:40.016221 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ÿ queue_depth=377 I1117 09:43:40.016354 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ź queue_depth=378 I1117 09:43:40.016496 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ź queue_depth=379 I1117 09:43:40.016633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ż queue_depth=380 I1117 09:43:40.016766 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ż queue_depth=381 I1117 09:43:40.016901 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ž queue_depth=382 I1117 09:43:40.017035 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ž queue_depth=383 I1117 09:43:40.017167 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ſ queue_depth=384 I1117 09:43:40.017301 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƀ queue_depth=385 I1117 09:43:40.017435 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɓ queue_depth=386 I1117 09:43:40.017570 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƃ queue_depth=387 I1117 09:43:40.017709 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƃ queue_depth=388 I1117 09:43:40.017865 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƅ queue_depth=389 I1117 09:43:40.018014 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƅ queue_depth=390 I1117 09:43:40.018157 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɔ queue_depth=391 I1117 09:43:40.018295 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƈ queue_depth=392 I1117 09:43:40.018435 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƈ queue_depth=393 I1117 09:43:40.018575 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɖ queue_depth=394 I1117 09:43:40.018708 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɗ queue_depth=395 I1117 09:43:40.018840 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƌ queue_depth=396 I1117 09:43:40.018975 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƌ queue_depth=397 I1117 09:43:40.019111 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƍ queue_depth=398 I1117 09:43:40.019246 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǝ queue_depth=399 I1117 09:43:40.019381 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ə queue_depth=400 I1117 09:43:40.019515 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɛ queue_depth=401 I1117 09:43:40.019651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƒ queue_depth=402 I1117 09:43:40.019798 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƒ queue_depth=403 I1117 09:43:40.019932 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɠ queue_depth=404 I1117 09:43:40.020067 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɣ queue_depth=405 I1117 09:43:40.020203 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƕ queue_depth=406 I1117 09:43:40.020352 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɩ queue_depth=407 I1117 09:43:40.020487 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɨ queue_depth=408 I1117 09:43:40.020619 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƙ queue_depth=409 I1117 09:43:40.020755 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƙ queue_depth=410 I1117 09:43:40.020891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƚ queue_depth=411 I1117 09:43:40.021027 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƛ queue_depth=412 I1117 09:43:40.021163 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɯ queue_depth=413 I1117 09:43:40.021323 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɲ queue_depth=414 I1117 09:43:40.021459 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƞ queue_depth=415 I1117 09:43:40.021597 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɵ queue_depth=416 I1117 09:43:40.021732 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ơ queue_depth=417 I1117 09:43:40.021865 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ơ queue_depth=418 I1117 09:43:40.021998 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƣ queue_depth=419 I1117 09:43:40.022134 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƣ queue_depth=420 I1117 09:43:40.022280 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƥ queue_depth=421 I1117 09:43:40.022434 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƥ queue_depth=422 I1117 09:43:40.022572 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ʀ queue_depth=423 I1117 09:43:40.022706 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƨ queue_depth=424 I1117 09:43:40.022839 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƨ queue_depth=425 I1117 09:43:40.022974 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ʃ queue_depth=426 I1117 09:43:40.023119 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƪ queue_depth=427 I1117 09:43:40.023254 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƫ queue_depth=428 I1117 09:43:40.023391 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƭ queue_depth=429 I1117 09:43:40.023529 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƭ queue_depth=430 I1117 09:43:40.023661 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ʈ queue_depth=431 I1117 09:43:40.023800 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ư queue_depth=432 I1117 09:43:40.023939 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ư queue_depth=433 I1117 09:43:40.024075 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ʊ queue_depth=434 I1117 09:43:40.024209 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ʋ queue_depth=435 I1117 09:43:40.024344 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƴ queue_depth=436 I1117 09:43:40.024481 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƴ queue_depth=437 I1117 09:43:40.024613 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƶ queue_depth=438 I1117 09:43:40.024749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƶ queue_depth=439 I1117 09:43:40.024884 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ʒ queue_depth=440 I1117 09:43:40.025016 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƹ queue_depth=441 I1117 09:43:40.025155 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƹ queue_depth=442 I1117 09:43:40.025293 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƺ queue_depth=443 I1117 09:43:40.025429 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƻ queue_depth=444 I1117 09:43:40.025561 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƽ queue_depth=445 I1117 09:43:40.025698 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƽ queue_depth=446 I1117 09:43:40.025832 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƾ queue_depth=447 I1117 09:43:40.025966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ƿ queue_depth=448 I1117 09:43:40.026956 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǀ queue_depth=449 I1117 09:43:40.027096 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǁ queue_depth=450 I1117 09:43:40.027229 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǂ queue_depth=451 I1117 09:43:40.027429 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǃ queue_depth=452 I1117 09:43:40.027567 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=DŽ queue_depth=453 I1117 09:43:40.027700 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Dž queue_depth=454 I1117 09:43:40.027855 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=dž queue_depth=455 I1117 09:43:40.027992 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=LJ queue_depth=456 I1117 09:43:40.028125 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Lj queue_depth=457 I1117 09:43:40.028261 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=lj queue_depth=458 I1117 09:43:40.028395 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=NJ queue_depth=459 I1117 09:43:40.028528 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Nj queue_depth=460 I1117 09:43:40.028664 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=nj queue_depth=461 I1117 09:43:40.028801 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǎ queue_depth=462 I1117 09:43:40.028932 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǎ queue_depth=463 I1117 09:43:40.029077 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǐ queue_depth=464 I1117 09:43:40.029213 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǐ queue_depth=465 I1117 09:43:40.029348 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǒ queue_depth=466 I1117 09:43:40.029484 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǒ queue_depth=467 I1117 09:43:40.029634 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǔ queue_depth=468 I1117 09:43:40.029782 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǔ queue_depth=469 I1117 09:43:40.029920 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǖ queue_depth=470 I1117 09:43:40.030052 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǖ queue_depth=471 I1117 09:43:40.030184 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǘ queue_depth=472 I1117 09:43:40.030320 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǘ queue_depth=473 I1117 09:43:40.030456 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǚ queue_depth=474 I1117 09:43:40.030592 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǚ queue_depth=475 I1117 09:43:40.030726 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǜ queue_depth=476 I1117 09:43:40.030863 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǜ queue_depth=477 I1117 09:43:40.031000 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǝ queue_depth=478 I1117 09:43:40.031134 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǟ queue_depth=479 I1117 09:43:40.031269 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǟ queue_depth=480 I1117 09:43:40.031403 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǡ queue_depth=481 I1117 09:43:40.031540 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǡ queue_depth=482 I1117 09:43:40.031675 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǣ queue_depth=483 I1117 09:43:40.031812 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǣ queue_depth=484 I1117 09:43:40.031943 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǥ queue_depth=485 I1117 09:43:40.032076 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǥ queue_depth=486 I1117 09:43:40.032224 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǧ queue_depth=487 I1117 09:43:40.032381 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǧ queue_depth=488 I1117 09:43:40.032518 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǩ queue_depth=489 I1117 09:43:40.032654 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǩ queue_depth=490 I1117 09:43:40.032789 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǫ queue_depth=491 I1117 09:43:40.032924 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǫ queue_depth=492 I1117 09:43:40.033062 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǭ queue_depth=493 I1117 09:43:40.033198 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǭ queue_depth=494 I1117 09:43:40.033331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǯ queue_depth=495 I1117 09:43:40.033464 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǯ queue_depth=496 I1117 09:43:40.033599 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǰ queue_depth=497 I1117 09:43:40.033735 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=DZ queue_depth=498 I1117 09:43:40.033872 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Dz queue_depth=499 I1117 09:43:40.034006 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=dz queue_depth=500 I1117 09:43:40.034141 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǵ queue_depth=501 I1117 09:43:40.034274 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǵ queue_depth=502 I1117 09:43:40.034406 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƕ queue_depth=503 I1117 09:43:40.034538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƿ queue_depth=504 I1117 09:43:40.034672 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǹ queue_depth=505 I1117 09:43:40.034807 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǹ queue_depth=506 I1117 09:43:40.034939 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǻ queue_depth=507 I1117 09:43:40.035075 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǻ queue_depth=508 I1117 09:43:40.035228 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǽ queue_depth=509 I1117 09:43:40.035367 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǽ queue_depth=510 I1117 09:43:40.035499 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ǿ queue_depth=511 I1117 09:43:40.035633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ǿ queue_depth=512 I1117 09:43:40.035766 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȁ queue_depth=513 I1117 09:43:40.035898 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȁ queue_depth=514 I1117 09:43:40.036031 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȃ queue_depth=515 I1117 09:43:40.036169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȃ queue_depth=516 I1117 09:43:40.036304 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȅ queue_depth=517 I1117 09:43:40.036445 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȅ queue_depth=518 I1117 09:43:40.036579 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȇ queue_depth=519 I1117 09:43:40.036711 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȇ queue_depth=520 I1117 09:43:40.036879 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȉ queue_depth=521 I1117 09:43:40.037029 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȉ queue_depth=522 I1117 09:43:40.037166 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȋ queue_depth=523 I1117 09:43:40.037299 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȋ queue_depth=524 I1117 09:43:40.037435 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȍ queue_depth=525 I1117 09:43:40.037583 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȍ queue_depth=526 I1117 09:43:40.037722 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȏ queue_depth=527 I1117 09:43:40.037857 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȏ queue_depth=528 I1117 09:43:40.037991 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȑ queue_depth=529 I1117 09:43:40.038126 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȑ queue_depth=530 I1117 09:43:40.038257 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȓ queue_depth=531 I1117 09:43:40.038388 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȓ queue_depth=532 I1117 09:43:40.038523 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȕ queue_depth=533 I1117 09:43:40.038657 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȕ queue_depth=534 I1117 09:43:40.038790 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȗ queue_depth=535 I1117 09:43:40.038920 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȗ queue_depth=536 I1117 09:43:40.039054 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ș queue_depth=537 I1117 09:43:40.039190 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ș queue_depth=538 I1117 09:43:40.039327 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ț queue_depth=539 I1117 09:43:40.039461 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ț queue_depth=540 I1117 09:43:40.039594 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȝ queue_depth=541 I1117 09:43:40.039732 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȝ queue_depth=542 I1117 09:43:40.039865 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȟ queue_depth=543 I1117 09:43:40.040002 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȟ queue_depth=544 I1117 09:43:40.040139 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƞ queue_depth=545 I1117 09:43:40.040274 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȡ queue_depth=546 I1117 09:43:40.040411 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȣ queue_depth=547 I1117 09:43:40.040551 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȣ queue_depth=548 I1117 09:43:40.040689 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȥ queue_depth=549 I1117 09:43:40.040821 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȥ queue_depth=550 I1117 09:43:40.040966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȧ queue_depth=551 I1117 09:43:40.041101 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȧ queue_depth=552 I1117 09:43:40.041233 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȩ queue_depth=553 I1117 09:43:40.041389 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȩ queue_depth=554 I1117 09:43:40.041524 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȫ queue_depth=555 I1117 09:43:40.041656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȫ queue_depth=556 I1117 09:43:40.041791 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȭ queue_depth=557 I1117 09:43:40.041931 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȭ queue_depth=558 I1117 09:43:40.042066 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȯ queue_depth=559 I1117 09:43:40.042202 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȯ queue_depth=560 I1117 09:43:40.042334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȱ queue_depth=561 I1117 09:43:40.042465 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȱ queue_depth=562 I1117 09:43:40.042600 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȳ queue_depth=563 I1117 09:43:40.042737 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȳ queue_depth=564 I1117 09:43:40.042871 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȴ queue_depth=565 I1117 09:43:40.043017 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȵ queue_depth=566 I1117 09:43:40.043159 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȶ queue_depth=567 I1117 09:43:40.043292 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȷ queue_depth=568 I1117 09:43:40.043428 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȸ queue_depth=569 I1117 09:43:40.043562 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȹ queue_depth=570 I1117 09:43:40.043694 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ⱥ queue_depth=571 I1117 09:43:40.043828 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ȼ queue_depth=572 I1117 09:43:40.043964 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȼ queue_depth=573 I1117 09:43:40.044096 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƚ queue_depth=574 I1117 09:43:40.044230 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ⱦ queue_depth=575 I1117 09:43:40.044364 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ȿ queue_depth=576 I1117 09:43:40.044498 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɀ queue_depth=577 I1117 09:43:40.044633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɂ queue_depth=578 I1117 09:43:40.044766 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɂ queue_depth=579 I1117 09:43:40.044899 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ƀ queue_depth=580 I1117 09:43:40.045031 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ʉ queue_depth=581 I1117 09:43:40.045164 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ʌ queue_depth=582 I1117 09:43:40.045298 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɇ queue_depth=583 I1117 09:43:40.045433 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɇ queue_depth=584 I1117 09:43:40.045566 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɉ queue_depth=585 I1117 09:43:40.045701 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɉ queue_depth=586 I1117 09:43:40.045854 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɋ queue_depth=587 I1117 09:43:40.045989 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɋ queue_depth=588 I1117 09:43:40.046124 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɍ queue_depth=589 I1117 09:43:40.046274 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɍ queue_depth=590 I1117 09:43:40.046418 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ɏ queue_depth=591 I1117 09:43:40.046555 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɏ queue_depth=592 I1117 09:43:40.046688 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɐ queue_depth=593 I1117 09:43:40.046824 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɑ queue_depth=594 I1117 09:43:40.046958 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɒ queue_depth=595 I1117 09:43:40.047096 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɓ queue_depth=596 I1117 09:43:40.047232 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɔ queue_depth=597 I1117 09:43:40.047366 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɕ queue_depth=598 I1117 09:43:40.047548 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɖ queue_depth=599 I1117 09:43:40.047686 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɗ queue_depth=600 I1117 09:43:40.047821 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɘ queue_depth=601 I1117 09:43:40.047957 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ə queue_depth=602 I1117 09:43:40.048095 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɚ queue_depth=603 I1117 09:43:40.048227 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɛ queue_depth=604 I1117 09:43:40.048373 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɜ queue_depth=605 I1117 09:43:40.048510 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɝ queue_depth=606 I1117 09:43:40.048641 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɞ queue_depth=607 I1117 09:43:40.048776 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɟ queue_depth=608 I1117 09:43:40.048911 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɠ queue_depth=609 I1117 09:43:40.049045 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɡ queue_depth=610 I1117 09:43:40.049178 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɢ queue_depth=611 I1117 09:43:40.049310 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɣ queue_depth=612 I1117 09:43:40.049446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɤ queue_depth=613 I1117 09:43:40.049579 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɥ queue_depth=614 I1117 09:43:40.049710 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɦ queue_depth=615 I1117 09:43:40.049852 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɧ queue_depth=616 I1117 09:43:40.049988 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɨ queue_depth=617 I1117 09:43:40.050123 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɩ queue_depth=618 I1117 09:43:40.050254 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɪ queue_depth=619 I1117 09:43:40.050412 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɫ queue_depth=620 I1117 09:43:40.050548 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɬ queue_depth=621 I1117 09:43:40.050686 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɭ queue_depth=622 I1117 09:43:40.050821 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɮ queue_depth=623 I1117 09:43:40.050953 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɯ queue_depth=624 I1117 09:43:40.051085 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɰ queue_depth=625 I1117 09:43:40.051222 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɱ queue_depth=626 I1117 09:43:40.051359 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɲ queue_depth=627 I1117 09:43:40.051497 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɳ queue_depth=628 I1117 09:43:40.051628 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɴ queue_depth=629 I1117 09:43:40.051763 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɵ queue_depth=630 I1117 09:43:40.051899 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɶ queue_depth=631 I1117 09:43:40.052033 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɷ queue_depth=632 I1117 09:43:40.052168 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɸ queue_depth=633 I1117 09:43:40.052305 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɹ queue_depth=634 I1117 09:43:40.052452 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɺ queue_depth=635 I1117 09:43:40.052589 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɻ queue_depth=636 I1117 09:43:40.052725 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɼ queue_depth=637 I1117 09:43:40.052861 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɽ queue_depth=638 I1117 09:43:40.052992 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɾ queue_depth=639 I1117 09:43:40.053134 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ɿ queue_depth=640 I1117 09:43:40.053268 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʀ queue_depth=641 I1117 09:43:40.053402 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʁ queue_depth=642 I1117 09:43:40.053536 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʂ queue_depth=643 I1117 09:43:40.053688 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʃ queue_depth=644 I1117 09:43:40.053825 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʄ queue_depth=645 I1117 09:43:40.053960 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʅ queue_depth=646 I1117 09:43:40.054093 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʆ queue_depth=647 I1117 09:43:40.054228 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʇ queue_depth=648 I1117 09:43:40.054363 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʈ queue_depth=649 I1117 09:43:40.054499 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʉ queue_depth=650 I1117 09:43:40.054633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʊ queue_depth=651 I1117 09:43:40.054765 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʋ queue_depth=652 I1117 09:43:40.054919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʌ queue_depth=653 I1117 09:43:40.055059 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʍ queue_depth=654 I1117 09:43:40.055194 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʎ queue_depth=655 I1117 09:43:40.055341 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʏ queue_depth=656 I1117 09:43:40.055479 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʐ queue_depth=657 I1117 09:43:40.055613 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʑ queue_depth=658 I1117 09:43:40.055745 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʒ queue_depth=659 I1117 09:43:40.055877 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʓ queue_depth=660 I1117 09:43:40.056010 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʔ queue_depth=661 I1117 09:43:40.056142 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʕ queue_depth=662 I1117 09:43:40.056280 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʖ queue_depth=663 I1117 09:43:40.056426 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʗ queue_depth=664 I1117 09:43:40.056562 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʘ queue_depth=665 I1117 09:43:40.056709 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʙ queue_depth=666 I1117 09:43:40.056844 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʚ queue_depth=667 I1117 09:43:40.056977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʛ queue_depth=668 I1117 09:43:40.057113 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʜ queue_depth=669 I1117 09:43:40.057245 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʝ queue_depth=670 I1117 09:43:40.057379 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʞ queue_depth=671 I1117 09:43:40.057514 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʟ queue_depth=672 I1117 09:43:40.057650 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʠ queue_depth=673 I1117 09:43:40.057782 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʡ queue_depth=674 I1117 09:43:40.057917 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʢ queue_depth=675 I1117 09:43:40.058057 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʣ queue_depth=676 I1117 09:43:40.058190 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʤ queue_depth=677 I1117 09:43:40.058322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʥ queue_depth=678 I1117 09:43:40.058455 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʦ queue_depth=679 I1117 09:43:40.058590 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʧ queue_depth=680 I1117 09:43:40.058722 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʨ queue_depth=681 I1117 09:43:40.058855 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʩ queue_depth=682 I1117 09:43:40.058986 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʪ queue_depth=683 I1117 09:43:40.059120 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʫ queue_depth=684 I1117 09:43:40.059251 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʬ queue_depth=685 I1117 09:43:40.059407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʭ queue_depth=686 I1117 09:43:40.059544 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʮ queue_depth=687 I1117 09:43:40.059681 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʯ queue_depth=688 I1117 09:43:40.059820 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʰ queue_depth=689 I1117 09:43:40.059952 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʱ queue_depth=690 I1117 09:43:40.060084 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʲ queue_depth=691 I1117 09:43:40.060229 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʳ queue_depth=692 I1117 09:43:40.060364 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʴ queue_depth=693 I1117 09:43:40.060499 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʵ queue_depth=694 I1117 09:43:40.060635 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʶ queue_depth=695 I1117 09:43:40.060768 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʷ queue_depth=696 I1117 09:43:40.060904 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʸ queue_depth=697 I1117 09:43:40.061037 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʹ queue_depth=698 I1117 09:43:40.061169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʺ queue_depth=699 I1117 09:43:40.061303 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʻ queue_depth=700 I1117 09:43:40.061435 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʼ queue_depth=701 I1117 09:43:40.061567 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʽ queue_depth=702 I1117 09:43:40.061700 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʾ queue_depth=703 I1117 09:43:40.061834 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʿ queue_depth=704 I1117 09:43:40.061967 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˀ queue_depth=705 I1117 09:43:40.062102 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˁ queue_depth=706 I1117 09:43:40.062236 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˂ queue_depth=707 I1117 09:43:40.062375 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˃ queue_depth=708 I1117 09:43:40.062511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˄ queue_depth=709 I1117 09:43:40.062650 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˅ queue_depth=710 I1117 09:43:40.062784 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˆ queue_depth=711 I1117 09:43:40.062928 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˇ queue_depth=712 I1117 09:43:40.063069 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˈ queue_depth=713 I1117 09:43:40.063207 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˉ queue_depth=714 I1117 09:43:40.063340 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˊ queue_depth=715 I1117 09:43:40.063488 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˋ queue_depth=716 I1117 09:43:40.063625 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˌ queue_depth=717 I1117 09:43:40.063761 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˍ queue_depth=718 I1117 09:43:40.063915 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˎ queue_depth=719 I1117 09:43:40.064051 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˏ queue_depth=720 I1117 09:43:40.064187 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ː queue_depth=721 I1117 09:43:40.064334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˑ queue_depth=722 I1117 09:43:40.064481 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˒ queue_depth=723 I1117 09:43:40.064616 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˓ queue_depth=724 I1117 09:43:40.064748 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˔ queue_depth=725 I1117 09:43:40.064882 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˕ queue_depth=726 I1117 09:43:40.065018 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˖ queue_depth=727 I1117 09:43:40.065152 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˗ queue_depth=728 I1117 09:43:40.065284 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˘ queue_depth=729 I1117 09:43:40.065417 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˙ queue_depth=730 I1117 09:43:40.065551 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˚ queue_depth=731 I1117 09:43:40.065686 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˛ queue_depth=732 I1117 09:43:40.065831 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˜ queue_depth=733 I1117 09:43:40.065964 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˝ queue_depth=734 I1117 09:43:40.066097 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˞ queue_depth=735 I1117 09:43:40.066231 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˟ queue_depth=736 I1117 09:43:40.066364 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˠ queue_depth=737 I1117 09:43:40.066505 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˡ queue_depth=738 I1117 09:43:40.066639 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˢ queue_depth=739 I1117 09:43:40.066771 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˣ queue_depth=740 I1117 09:43:40.066903 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˤ queue_depth=741 I1117 09:43:40.067039 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˥ queue_depth=742 I1117 09:43:40.067172 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˦ queue_depth=743 I1117 09:43:40.067306 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˧ queue_depth=744 I1117 09:43:40.067441 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˨ queue_depth=745 I1117 09:43:40.067578 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˩ queue_depth=746 I1117 09:43:40.067810 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˪ queue_depth=747 I1117 09:43:40.067952 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˫ queue_depth=748 I1117 09:43:40.068086 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˬ queue_depth=749 I1117 09:43:40.068224 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˭ queue_depth=750 I1117 09:43:40.068359 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ˮ queue_depth=751 I1117 09:43:40.068513 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˯ queue_depth=752 I1117 09:43:40.068650 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˰ queue_depth=753 I1117 09:43:40.068781 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˱ queue_depth=754 I1117 09:43:40.068914 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˲ queue_depth=755 I1117 09:43:40.069048 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˳ queue_depth=756 I1117 09:43:40.069179 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˴ queue_depth=757 I1117 09:43:40.069312 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˵ queue_depth=758 I1117 09:43:40.069446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˶ queue_depth=759 I1117 09:43:40.069583 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˷ queue_depth=760 I1117 09:43:40.069723 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˸ queue_depth=761 I1117 09:43:40.069862 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˹ queue_depth=762 I1117 09:43:40.069993 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˺ queue_depth=763 I1117 09:43:40.070127 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˻ queue_depth=764 I1117 09:43:40.070265 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˼ queue_depth=765 I1117 09:43:40.070398 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˽ queue_depth=766 I1117 09:43:40.070545 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˾ queue_depth=767 I1117 09:43:40.070679 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=˿ queue_depth=768 I1117 09:43:40.070812 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̀ queue_depth=769 I1117 09:43:40.070946 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=́ queue_depth=770 I1117 09:43:40.071079 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̂ queue_depth=771 I1117 09:43:40.071211 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̃ queue_depth=772 I1117 09:43:40.071344 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̄ queue_depth=773 I1117 09:43:40.071479 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̅ queue_depth=774 I1117 09:43:40.071614 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̆ queue_depth=775 I1117 09:43:40.071746 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̇ queue_depth=776 I1117 09:43:40.071880 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̈ queue_depth=777 I1117 09:43:40.072014 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̉ queue_depth=778 I1117 09:43:40.072146 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̊ queue_depth=779 I1117 09:43:40.072280 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̋ queue_depth=780 I1117 09:43:40.072416 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̌ queue_depth=781 I1117 09:43:40.072551 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̍ queue_depth=782 I1117 09:43:40.072683 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̎ queue_depth=783 I1117 09:43:40.072815 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̏ queue_depth=784 I1117 09:43:40.072969 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̐ queue_depth=785 I1117 09:43:40.073112 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̑ queue_depth=786 I1117 09:43:40.073248 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̒ queue_depth=787 I1117 09:43:40.073383 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̓ queue_depth=788 I1117 09:43:40.073519 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̔ queue_depth=789 I1117 09:43:40.073651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̕ queue_depth=790 I1117 09:43:40.073785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̖ queue_depth=791 I1117 09:43:40.073920 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̗ queue_depth=792 I1117 09:43:40.074052 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̘ queue_depth=793 I1117 09:43:40.074186 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̙ queue_depth=794 I1117 09:43:40.074322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̚ queue_depth=795 I1117 09:43:40.074456 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̛ queue_depth=796 I1117 09:43:40.074601 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̜ queue_depth=797 I1117 09:43:40.074737 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̝ queue_depth=798 I1117 09:43:40.074870 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̞ queue_depth=799 I1117 09:43:40.075006 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̟ queue_depth=800 I1117 09:43:40.075141 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̠ queue_depth=801 I1117 09:43:40.075272 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̡ queue_depth=802 I1117 09:43:40.075408 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̢ queue_depth=803 I1117 09:43:40.075541 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̣ queue_depth=804 I1117 09:43:40.075676 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̤ queue_depth=805 I1117 09:43:40.075812 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̥ queue_depth=806 I1117 09:43:40.075945 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̦ queue_depth=807 I1117 09:43:40.076080 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̧ queue_depth=808 I1117 09:43:40.076220 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̨ queue_depth=809 I1117 09:43:40.076351 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̩ queue_depth=810 I1117 09:43:40.076491 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̪ queue_depth=811 I1117 09:43:40.076626 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̫ queue_depth=812 I1117 09:43:40.076759 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̬ queue_depth=813 I1117 09:43:40.076893 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̭ queue_depth=814 I1117 09:43:40.077027 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̮ queue_depth=815 I1117 09:43:40.077164 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̯ queue_depth=816 I1117 09:43:40.077296 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̰ queue_depth=817 I1117 09:43:40.077471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̱ queue_depth=818 I1117 09:43:40.077605 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̲ queue_depth=819 I1117 09:43:40.077738 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̳ queue_depth=820 I1117 09:43:40.077872 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̴ queue_depth=821 I1117 09:43:40.078008 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̵ queue_depth=822 I1117 09:43:40.078141 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̶ queue_depth=823 I1117 09:43:40.078272 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̷ queue_depth=824 I1117 09:43:40.078404 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key≠ queue_depth=825 I1117 09:43:40.078538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̹ queue_depth=826 I1117 09:43:40.078673 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̺ queue_depth=827 I1117 09:43:40.078807 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̻ queue_depth=828 I1117 09:43:40.078944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̼ queue_depth=829 I1117 09:43:40.079078 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̽ queue_depth=830 I1117 09:43:40.079215 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̾ queue_depth=831 I1117 09:43:40.079348 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̿ queue_depth=832 I1117 09:43:40.079481 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̀ queue_depth=833 I1117 09:43:40.079616 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=́ queue_depth=834 I1117 09:43:40.079760 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͂ queue_depth=835 I1117 09:43:40.079895 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̓ queue_depth=836 I1117 09:43:40.080029 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=̈́ queue_depth=837 I1117 09:43:40.080178 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͅ queue_depth=838 I1117 09:43:40.080316 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͆ queue_depth=839 I1117 09:43:40.080448 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͇ queue_depth=840 I1117 09:43:40.080598 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͈ queue_depth=841 I1117 09:43:40.080734 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͉ queue_depth=842 I1117 09:43:40.080870 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͊ queue_depth=843 I1117 09:43:40.081005 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͋ queue_depth=844 I1117 09:43:40.081136 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͌ queue_depth=845 I1117 09:43:40.081270 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͍ queue_depth=846 I1117 09:43:40.081403 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͎ queue_depth=847 I1117 09:43:40.081540 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͏ queue_depth=848 I1117 09:43:40.081674 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͐ queue_depth=849 I1117 09:43:40.081811 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͑ queue_depth=850 I1117 09:43:40.081965 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͒ queue_depth=851 I1117 09:43:40.082104 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͓ queue_depth=852 I1117 09:43:40.082240 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͔ queue_depth=853 I1117 09:43:40.082377 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͕ queue_depth=854 I1117 09:43:40.082512 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͖ queue_depth=855 I1117 09:43:40.082646 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͗ queue_depth=856 I1117 09:43:40.082784 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͘ queue_depth=857 I1117 09:43:40.082922 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͙ queue_depth=858 I1117 09:43:40.083063 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͚ queue_depth=859 I1117 09:43:40.083203 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͛ queue_depth=860 I1117 09:43:40.083335 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͜ queue_depth=861 I1117 09:43:40.083466 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͝ queue_depth=862 I1117 09:43:40.083602 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͞ queue_depth=863 I1117 09:43:40.083736 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͟ queue_depth=864 I1117 09:43:40.083881 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͠ queue_depth=865 I1117 09:43:40.084023 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͡ queue_depth=866 I1117 09:43:40.084155 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͢ queue_depth=867 I1117 09:43:40.084302 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͣ queue_depth=868 I1117 09:43:40.084436 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͤ queue_depth=869 I1117 09:43:40.084571 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͥ queue_depth=870 I1117 09:43:40.084705 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͦ queue_depth=871 I1117 09:43:40.084841 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͧ queue_depth=872 I1117 09:43:40.084976 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͨ queue_depth=873 I1117 09:43:40.085111 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͩ queue_depth=874 I1117 09:43:40.085248 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͪ queue_depth=875 I1117 09:43:40.085383 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͫ queue_depth=876 I1117 09:43:40.085528 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͬ queue_depth=877 I1117 09:43:40.085670 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͭ queue_depth=878 I1117 09:43:40.085826 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͮ queue_depth=879 I1117 09:43:40.085969 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͯ queue_depth=880 I1117 09:43:40.086110 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ͱ queue_depth=881 I1117 09:43:40.086251 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͱ queue_depth=882 I1117 09:43:40.086396 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ͳ queue_depth=883 I1117 09:43:40.086561 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͳ queue_depth=884 I1117 09:43:40.086700 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ʹ queue_depth=885 I1117 09:43:40.086839 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͵ queue_depth=886 I1117 09:43:40.086981 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ͷ queue_depth=887 I1117 09:43:40.087120 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͷ queue_depth=888 I1117 09:43:40.087252 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͸ queue_depth=889 I1117 09:43:40.087386 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=͹ queue_depth=890 I1117 09:43:40.087531 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͺ queue_depth=891 I1117 09:43:40.087669 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͻ queue_depth=892 I1117 09:43:40.087843 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͼ queue_depth=893 I1117 09:43:40.087985 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ͽ queue_depth=894 I1117 09:43:40.088118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=; queue_depth=895 I1117 09:43:40.088251 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϳ queue_depth=896 I1117 09:43:40.090655 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΀ queue_depth=897 I1117 09:43:40.090799 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΁ queue_depth=898 I1117 09:43:40.090939 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΂ queue_depth=899 I1117 09:43:40.091077 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΃ queue_depth=900 I1117 09:43:40.091213 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΄ queue_depth=901 I1117 09:43:40.091345 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΅ queue_depth=902 I1117 09:43:40.091477 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ά queue_depth=903 I1117 09:43:40.091611 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=· queue_depth=904 I1117 09:43:40.091758 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Έ queue_depth=905 I1117 09:43:40.091891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ή queue_depth=906 I1117 09:43:40.092022 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ί queue_depth=907 I1117 09:43:40.092153 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΋ queue_depth=908 I1117 09:43:40.092286 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ό queue_depth=909 I1117 09:43:40.092420 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΍ queue_depth=910 I1117 09:43:40.092553 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ύ queue_depth=911 I1117 09:43:40.092688 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ώ queue_depth=912 I1117 09:43:40.092820 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ΐ queue_depth=913 I1117 09:43:40.092950 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Α queue_depth=914 I1117 09:43:40.093086 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Β queue_depth=915 I1117 09:43:40.093223 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Γ queue_depth=916 I1117 09:43:40.093381 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Δ queue_depth=917 I1117 09:43:40.093519 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ε queue_depth=918 I1117 09:43:40.093652 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ζ queue_depth=919 I1117 09:43:40.093786 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Η queue_depth=920 I1117 09:43:40.093919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Θ queue_depth=921 I1117 09:43:40.094055 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ι queue_depth=922 I1117 09:43:40.094186 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Κ queue_depth=923 I1117 09:43:40.094322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Λ queue_depth=924 I1117 09:43:40.094455 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Μ queue_depth=925 I1117 09:43:40.094586 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ν queue_depth=926 I1117 09:43:40.094721 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ξ queue_depth=927 I1117 09:43:40.094853 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ο queue_depth=928 I1117 09:43:40.094984 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Π queue_depth=929 I1117 09:43:40.095118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ρ queue_depth=930 I1117 09:43:40.095253 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=΢ queue_depth=931 I1117 09:43:40.095384 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Σ queue_depth=932 I1117 09:43:40.095515 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Τ queue_depth=933 I1117 09:43:40.095648 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Υ queue_depth=934 I1117 09:43:40.095781 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Φ queue_depth=935 I1117 09:43:40.095914 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Χ queue_depth=936 I1117 09:43:40.096049 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ψ queue_depth=937 I1117 09:43:40.096186 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ω queue_depth=938 I1117 09:43:40.096318 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϊ queue_depth=939 I1117 09:43:40.096461 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϋ queue_depth=940 I1117 09:43:40.096594 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ά queue_depth=941 I1117 09:43:40.096727 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=έ queue_depth=942 I1117 09:43:40.096864 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ή queue_depth=943 I1117 09:43:40.097000 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ί queue_depth=944 I1117 09:43:40.097133 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ΰ queue_depth=945 I1117 09:43:40.097270 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=α queue_depth=946 I1117 09:43:40.097406 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=β queue_depth=947 I1117 09:43:40.097540 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=γ queue_depth=948 I1117 09:43:40.097688 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=δ queue_depth=949 I1117 09:43:40.097876 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ε queue_depth=950 I1117 09:43:40.098015 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ζ queue_depth=951 I1117 09:43:40.098152 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=η queue_depth=952 I1117 09:43:40.098286 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=θ queue_depth=953 I1117 09:43:40.098431 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ι queue_depth=954 I1117 09:43:40.098568 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=κ queue_depth=955 I1117 09:43:40.098703 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=λ queue_depth=956 I1117 09:43:40.098851 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=μ queue_depth=957 I1117 09:43:40.098984 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ν queue_depth=958 I1117 09:43:40.099121 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ξ queue_depth=959 I1117 09:43:40.099259 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ο queue_depth=960 I1117 09:43:40.099396 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=π queue_depth=961 I1117 09:43:40.099529 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ρ queue_depth=962 I1117 09:43:40.099662 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ς queue_depth=963 I1117 09:43:40.099802 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=σ queue_depth=964 I1117 09:43:40.099950 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=τ queue_depth=965 I1117 09:43:40.100086 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=υ queue_depth=966 I1117 09:43:40.100219 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=φ queue_depth=967 I1117 09:43:40.100355 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=χ queue_depth=968 I1117 09:43:40.100488 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ψ queue_depth=969 I1117 09:43:40.100624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ω queue_depth=970 I1117 09:43:40.100756 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϊ queue_depth=971 I1117 09:43:40.100895 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϋ queue_depth=972 I1117 09:43:40.101030 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ό queue_depth=973 I1117 09:43:40.101167 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ύ queue_depth=974 I1117 09:43:40.101308 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ώ queue_depth=975 I1117 09:43:40.101440 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϗ queue_depth=976 I1117 09:43:40.101575 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϐ queue_depth=977 I1117 09:43:40.101711 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϑ queue_depth=978 I1117 09:43:40.101843 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϒ queue_depth=979 I1117 09:43:40.101980 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϓ queue_depth=980 I1117 09:43:40.102114 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϔ queue_depth=981 I1117 09:43:40.102250 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϕ queue_depth=982 I1117 09:43:40.102416 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϖ queue_depth=983 I1117 09:43:40.102552 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϗ queue_depth=984 I1117 09:43:40.102685 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϙ queue_depth=985 I1117 09:43:40.102821 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϙ queue_depth=986 I1117 09:43:40.102953 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϛ queue_depth=987 I1117 09:43:40.103092 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϛ queue_depth=988 I1117 09:43:40.103232 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϝ queue_depth=989 I1117 09:43:40.103366 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϝ queue_depth=990 I1117 09:43:40.103502 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϟ queue_depth=991 I1117 09:43:40.103637 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϟ queue_depth=992 I1117 09:43:40.103769 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϡ queue_depth=993 I1117 09:43:40.103906 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϡ queue_depth=994 I1117 09:43:40.104040 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϣ queue_depth=995 I1117 09:43:40.104179 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϣ queue_depth=996 I1117 09:43:40.104310 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϥ queue_depth=997 I1117 09:43:40.104446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϥ queue_depth=998 I1117 09:43:40.104579 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϧ queue_depth=999 I1117 09:43:40.104712 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϧ queue_depth=1000 I1117 09:43:40.104844 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϩ queue_depth=1001 I1117 09:43:40.104983 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϩ queue_depth=1002 I1117 09:43:40.105120 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϫ queue_depth=1003 I1117 09:43:40.105255 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϫ queue_depth=1004 I1117 09:43:40.105392 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϭ queue_depth=1005 I1117 09:43:40.105527 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϭ queue_depth=1006 I1117 09:43:40.105671 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϯ queue_depth=1007 I1117 09:43:40.105820 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϯ queue_depth=1008 I1117 09:43:40.105951 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϰ queue_depth=1009 I1117 09:43:40.106088 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϱ queue_depth=1010 I1117 09:43:40.106223 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϲ queue_depth=1011 I1117 09:43:40.106357 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϳ queue_depth=1012 I1117 09:43:40.106504 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϴ queue_depth=1013 I1117 09:43:40.106644 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϵ queue_depth=1014 I1117 09:43:40.106779 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=϶ queue_depth=1015 I1117 09:43:40.106936 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϸ queue_depth=1016 I1117 09:43:40.107073 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϸ queue_depth=1017 I1117 09:43:40.107206 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϲ queue_depth=1018 I1117 09:43:40.107340 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ϻ queue_depth=1019 I1117 09:43:40.107473 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϻ queue_depth=1020 I1117 09:43:40.107608 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ϼ queue_depth=1021 I1117 09:43:40.107759 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ͻ queue_depth=1022 I1117 09:43:40.107895 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ͼ queue_depth=1023 I1117 09:43:40.108126 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ͽ queue_depth=1024 I1117 09:43:40.108262 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѐ queue_depth=1025 I1117 09:43:40.108402 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ё queue_depth=1026 I1117 09:43:40.108538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ђ queue_depth=1027 I1117 09:43:40.108672 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѓ queue_depth=1028 I1117 09:43:40.108805 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Є queue_depth=1029 I1117 09:43:40.108944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѕ queue_depth=1030 I1117 09:43:40.109082 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=І queue_depth=1031 I1117 09:43:40.109227 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ї queue_depth=1032 I1117 09:43:40.109362 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ј queue_depth=1033 I1117 09:43:40.109498 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Љ queue_depth=1034 I1117 09:43:40.109632 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Њ queue_depth=1035 I1117 09:43:40.109779 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ћ queue_depth=1036 I1117 09:43:40.109918 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ќ queue_depth=1037 I1117 09:43:40.110051 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѝ queue_depth=1038 I1117 09:43:40.110186 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ў queue_depth=1039 I1117 09:43:40.110325 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Џ queue_depth=1040 I1117 09:43:40.110455 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=А queue_depth=1041 I1117 09:43:40.110592 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Б queue_depth=1042 I1117 09:43:40.110728 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=В queue_depth=1043 I1117 09:43:40.110864 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Г queue_depth=1044 I1117 09:43:40.110998 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Д queue_depth=1045 I1117 09:43:40.111137 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Е queue_depth=1046 I1117 09:43:40.111274 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ж queue_depth=1047 I1117 09:43:40.111407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=З queue_depth=1048 I1117 09:43:40.111561 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=И queue_depth=1049 I1117 09:43:40.111699 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Й queue_depth=1050 I1117 09:43:40.111835 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=К queue_depth=1051 I1117 09:43:40.111988 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Л queue_depth=1052 I1117 09:43:40.112124 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=М queue_depth=1053 I1117 09:43:40.112260 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Н queue_depth=1054 I1117 09:43:40.112393 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=О queue_depth=1055 I1117 09:43:40.112529 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=П queue_depth=1056 I1117 09:43:40.112675 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Р queue_depth=1057 I1117 09:43:40.112812 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=С queue_depth=1058 I1117 09:43:40.112949 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Т queue_depth=1059 I1117 09:43:40.113089 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=У queue_depth=1060 I1117 09:43:40.113230 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ф queue_depth=1061 I1117 09:43:40.113367 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Х queue_depth=1062 I1117 09:43:40.113502 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ц queue_depth=1063 I1117 09:43:40.113635 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ч queue_depth=1064 I1117 09:43:40.113766 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ш queue_depth=1065 I1117 09:43:40.113903 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Щ queue_depth=1066 I1117 09:43:40.114039 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ъ queue_depth=1067 I1117 09:43:40.114173 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ы queue_depth=1068 I1117 09:43:40.114309 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ь queue_depth=1069 I1117 09:43:40.114448 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Э queue_depth=1070 I1117 09:43:40.114583 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ю queue_depth=1071 I1117 09:43:40.114716 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Я queue_depth=1072 I1117 09:43:40.114846 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=а queue_depth=1073 I1117 09:43:40.114982 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=б queue_depth=1074 I1117 09:43:40.115129 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=в queue_depth=1075 I1117 09:43:40.115278 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=г queue_depth=1076 I1117 09:43:40.115414 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=д queue_depth=1077 I1117 09:43:40.115551 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=е queue_depth=1078 I1117 09:43:40.115685 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ж queue_depth=1079 I1117 09:43:40.115823 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=з queue_depth=1080 I1117 09:43:40.115954 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=и queue_depth=1081 I1117 09:43:40.116110 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=й queue_depth=1082 I1117 09:43:40.116250 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=к queue_depth=1083 I1117 09:43:40.116392 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=л queue_depth=1084 I1117 09:43:40.116528 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=м queue_depth=1085 I1117 09:43:40.116666 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=н queue_depth=1086 I1117 09:43:40.116801 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=о queue_depth=1087 I1117 09:43:40.116934 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=п queue_depth=1088 I1117 09:43:40.117065 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=р queue_depth=1089 I1117 09:43:40.117200 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=с queue_depth=1090 I1117 09:43:40.117339 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=т queue_depth=1091 I1117 09:43:40.117477 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=у queue_depth=1092 I1117 09:43:40.117610 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ф queue_depth=1093 I1117 09:43:40.117748 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=х queue_depth=1094 I1117 09:43:40.117881 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ц queue_depth=1095 I1117 09:43:40.118015 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ч queue_depth=1096 I1117 09:43:40.118145 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ш queue_depth=1097 I1117 09:43:40.118286 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=щ queue_depth=1098 I1117 09:43:40.118421 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ъ queue_depth=1099 I1117 09:43:40.118556 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ы queue_depth=1100 I1117 09:43:40.118700 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ь queue_depth=1101 I1117 09:43:40.118836 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=э queue_depth=1102 I1117 09:43:40.118972 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ю queue_depth=1103 I1117 09:43:40.119109 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=я queue_depth=1104 I1117 09:43:40.119242 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѐ queue_depth=1105 I1117 09:43:40.119384 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ё queue_depth=1106 I1117 09:43:40.119517 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ђ queue_depth=1107 I1117 09:43:40.119652 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѓ queue_depth=1108 I1117 09:43:40.119817 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=є queue_depth=1109 I1117 09:43:40.119953 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѕ queue_depth=1110 I1117 09:43:40.120089 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=і queue_depth=1111 I1117 09:43:40.120223 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ї queue_depth=1112 I1117 09:43:40.120359 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ј queue_depth=1113 I1117 09:43:40.120495 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=љ queue_depth=1114 I1117 09:43:40.120648 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=њ queue_depth=1115 I1117 09:43:40.120789 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ћ queue_depth=1116 I1117 09:43:40.120921 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ќ queue_depth=1117 I1117 09:43:40.121057 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѝ queue_depth=1118 I1117 09:43:40.121195 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ў queue_depth=1119 I1117 09:43:40.121334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=џ queue_depth=1120 I1117 09:43:40.121470 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѡ queue_depth=1121 I1117 09:43:40.121607 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѡ queue_depth=1122 I1117 09:43:40.121749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѣ queue_depth=1123 I1117 09:43:40.121887 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѣ queue_depth=1124 I1117 09:43:40.122019 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѥ queue_depth=1125 I1117 09:43:40.122152 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѥ queue_depth=1126 I1117 09:43:40.122300 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѧ queue_depth=1127 I1117 09:43:40.122434 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѧ queue_depth=1128 I1117 09:43:40.122566 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѩ queue_depth=1129 I1117 09:43:40.122702 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѩ queue_depth=1130 I1117 09:43:40.122836 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѫ queue_depth=1131 I1117 09:43:40.122969 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѫ queue_depth=1132 I1117 09:43:40.123112 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѭ queue_depth=1133 I1117 09:43:40.123248 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѭ queue_depth=1134 I1117 09:43:40.123383 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѯ queue_depth=1135 I1117 09:43:40.123519 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѯ queue_depth=1136 I1117 09:43:40.123655 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѱ queue_depth=1137 I1117 09:43:40.123790 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѱ queue_depth=1138 I1117 09:43:40.123933 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѳ queue_depth=1139 I1117 09:43:40.124067 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѳ queue_depth=1140 I1117 09:43:40.124201 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѵ queue_depth=1141 I1117 09:43:40.124335 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѵ queue_depth=1142 I1117 09:43:40.124469 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѷ queue_depth=1143 I1117 09:43:40.124606 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѷ queue_depth=1144 I1117 09:43:40.124739 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѹ queue_depth=1145 I1117 09:43:40.124873 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѹ queue_depth=1146 I1117 09:43:40.125009 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѻ queue_depth=1147 I1117 09:43:40.125168 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѻ queue_depth=1148 I1117 09:43:40.125303 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѽ queue_depth=1149 I1117 09:43:40.125441 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѽ queue_depth=1150 I1117 09:43:40.125576 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ѿ queue_depth=1151 I1117 09:43:40.125714 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ѿ queue_depth=1152 I1117 09:43:40.125845 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҁ queue_depth=1153 I1117 09:43:40.125983 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҁ queue_depth=1154 I1117 09:43:40.126115 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=҂ queue_depth=1155 I1117 09:43:40.126254 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=҃ queue_depth=1156 I1117 09:43:40.126395 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=҄ queue_depth=1157 I1117 09:43:40.126537 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=҅ queue_depth=1158 I1117 09:43:40.126670 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=҆ queue_depth=1159 I1117 09:43:40.126811 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=҇ queue_depth=1160 I1117 09:43:40.126945 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=҈ queue_depth=1161 I1117 09:43:40.127082 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=҉ queue_depth=1162 I1117 09:43:40.127228 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҋ queue_depth=1163 I1117 09:43:40.127366 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҋ queue_depth=1164 I1117 09:43:40.127502 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҍ queue_depth=1165 I1117 09:43:40.127637 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҍ queue_depth=1166 I1117 09:43:40.127774 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҏ queue_depth=1167 I1117 09:43:40.127910 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҏ queue_depth=1168 I1117 09:43:40.128043 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ґ queue_depth=1169 I1117 09:43:40.128988 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ґ queue_depth=1170 I1117 09:43:40.129126 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ғ queue_depth=1171 I1117 09:43:40.129267 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ғ queue_depth=1172 I1117 09:43:40.129404 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҕ queue_depth=1173 I1117 09:43:40.129538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҕ queue_depth=1174 I1117 09:43:40.129688 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Җ queue_depth=1175 I1117 09:43:40.129836 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=җ queue_depth=1176 I1117 09:43:40.129972 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҙ queue_depth=1177 I1117 09:43:40.130109 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҙ queue_depth=1178 I1117 09:43:40.130247 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Қ queue_depth=1179 I1117 09:43:40.130384 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=қ queue_depth=1180 I1117 09:43:40.130531 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҝ queue_depth=1181 I1117 09:43:40.130667 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҝ queue_depth=1182 I1117 09:43:40.130802 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҟ queue_depth=1183 I1117 09:43:40.130937 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҟ queue_depth=1184 I1117 09:43:40.131071 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҡ queue_depth=1185 I1117 09:43:40.131207 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҡ queue_depth=1186 I1117 09:43:40.131340 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ң queue_depth=1187 I1117 09:43:40.131478 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ң queue_depth=1188 I1117 09:43:40.131615 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҥ queue_depth=1189 I1117 09:43:40.131751 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҥ queue_depth=1190 I1117 09:43:40.131888 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҧ queue_depth=1191 I1117 09:43:40.132021 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҧ queue_depth=1192 I1117 09:43:40.132156 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҩ queue_depth=1193 I1117 09:43:40.132292 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҩ queue_depth=1194 I1117 09:43:40.132458 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҫ queue_depth=1195 I1117 09:43:40.132596 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҫ queue_depth=1196 I1117 09:43:40.132735 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҭ queue_depth=1197 I1117 09:43:40.132874 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҭ queue_depth=1198 I1117 09:43:40.133011 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ү queue_depth=1199 I1117 09:43:40.133154 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ү queue_depth=1200 I1117 09:43:40.133287 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ұ queue_depth=1201 I1117 09:43:40.133424 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ұ queue_depth=1202 I1117 09:43:40.133709 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҳ queue_depth=1203 I1117 09:43:40.133847 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҳ queue_depth=1204 I1117 09:43:40.133980 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҵ queue_depth=1205 I1117 09:43:40.134118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҵ queue_depth=1206 I1117 09:43:40.134252 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҷ queue_depth=1207 I1117 09:43:40.134390 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҷ queue_depth=1208 I1117 09:43:40.134522 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҹ queue_depth=1209 I1117 09:43:40.134655 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҹ queue_depth=1210 I1117 09:43:40.134790 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Һ queue_depth=1211 I1117 09:43:40.134929 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=һ queue_depth=1212 I1117 09:43:40.135062 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҽ queue_depth=1213 I1117 09:43:40.135195 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҽ queue_depth=1214 I1117 09:43:40.135332 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ҿ queue_depth=1215 I1117 09:43:40.135483 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ҿ queue_depth=1216 I1117 09:43:40.135617 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӏ queue_depth=1217 I1117 09:43:40.135752 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӂ queue_depth=1218 I1117 09:43:40.135905 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӂ queue_depth=1219 I1117 09:43:40.136059 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӄ queue_depth=1220 I1117 09:43:40.136197 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӄ queue_depth=1221 I1117 09:43:40.136334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӆ queue_depth=1222 I1117 09:43:40.136479 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӆ queue_depth=1223 I1117 09:43:40.136617 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӈ queue_depth=1224 I1117 09:43:40.136749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӈ queue_depth=1225 I1117 09:43:40.136885 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӊ queue_depth=1226 I1117 09:43:40.137022 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӊ queue_depth=1227 I1117 09:43:40.137178 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӌ queue_depth=1228 I1117 09:43:40.137320 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӌ queue_depth=1229 I1117 09:43:40.137459 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӎ queue_depth=1230 I1117 09:43:40.137595 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӎ queue_depth=1231 I1117 09:43:40.137729 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӏ queue_depth=1232 I1117 09:43:40.137863 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӑ queue_depth=1233 I1117 09:43:40.137998 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӑ queue_depth=1234 I1117 09:43:40.138135 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӓ queue_depth=1235 I1117 09:43:40.138275 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӓ queue_depth=1236 I1117 09:43:40.138409 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӕ queue_depth=1237 I1117 09:43:40.138546 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӕ queue_depth=1238 I1117 09:43:40.138684 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӗ queue_depth=1239 I1117 09:43:40.138900 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӗ queue_depth=1240 I1117 09:43:40.139039 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ә queue_depth=1241 I1117 09:43:40.139174 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ә queue_depth=1242 I1117 09:43:40.139310 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӛ queue_depth=1243 I1117 09:43:40.139444 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӛ queue_depth=1244 I1117 09:43:40.139576 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӝ queue_depth=1245 I1117 09:43:40.139723 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӝ queue_depth=1246 I1117 09:43:40.139861 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӟ queue_depth=1247 I1117 09:43:40.139999 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӟ queue_depth=1248 I1117 09:43:40.140130 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӡ queue_depth=1249 I1117 09:43:40.140269 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӡ queue_depth=1250 I1117 09:43:40.140405 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӣ queue_depth=1251 I1117 09:43:40.140539 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӣ queue_depth=1252 I1117 09:43:40.140678 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӥ queue_depth=1253 I1117 09:43:40.140828 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӥ queue_depth=1254 I1117 09:43:40.140967 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӧ queue_depth=1255 I1117 09:43:40.141101 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӧ queue_depth=1256 I1117 09:43:40.141232 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ө queue_depth=1257 I1117 09:43:40.141364 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ө queue_depth=1258 I1117 09:43:40.141501 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӫ queue_depth=1259 I1117 09:43:40.141635 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӫ queue_depth=1260 I1117 09:43:40.141802 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӭ queue_depth=1261 I1117 09:43:40.141942 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӭ queue_depth=1262 I1117 09:43:40.142079 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӯ queue_depth=1263 I1117 09:43:40.142226 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӯ queue_depth=1264 I1117 09:43:40.142362 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӱ queue_depth=1265 I1117 09:43:40.142500 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӱ queue_depth=1266 I1117 09:43:40.142636 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӳ queue_depth=1267 I1117 09:43:40.142772 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӳ queue_depth=1268 I1117 09:43:40.142906 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӵ queue_depth=1269 I1117 09:43:40.143042 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӵ queue_depth=1270 I1117 09:43:40.143187 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӷ queue_depth=1271 I1117 09:43:40.143323 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӷ queue_depth=1272 I1117 09:43:40.143458 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӹ queue_depth=1273 I1117 09:43:40.143598 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӹ queue_depth=1274 I1117 09:43:40.143736 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӻ queue_depth=1275 I1117 09:43:40.143877 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӻ queue_depth=1276 I1117 09:43:40.144011 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӽ queue_depth=1277 I1117 09:43:40.144145 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӽ queue_depth=1278 I1117 09:43:40.144282 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ӿ queue_depth=1279 I1117 09:43:40.144419 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ӿ queue_depth=1280 I1117 09:43:40.144555 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԁ queue_depth=1281 I1117 09:43:40.144693 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԁ queue_depth=1282 I1117 09:43:40.144831 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԃ queue_depth=1283 I1117 09:43:40.144967 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԃ queue_depth=1284 I1117 09:43:40.145102 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԅ queue_depth=1285 I1117 09:43:40.145238 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԅ queue_depth=1286 I1117 09:43:40.145387 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԇ queue_depth=1287 I1117 09:43:40.145521 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԇ queue_depth=1288 I1117 09:43:40.145655 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԉ queue_depth=1289 I1117 09:43:40.145791 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԉ queue_depth=1290 I1117 09:43:40.145929 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԋ queue_depth=1291 I1117 09:43:40.146064 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԋ queue_depth=1292 I1117 09:43:40.146199 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԍ queue_depth=1293 I1117 09:43:40.146357 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԍ queue_depth=1294 I1117 09:43:40.146512 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԏ queue_depth=1295 I1117 09:43:40.146651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԏ queue_depth=1296 I1117 09:43:40.146785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԑ queue_depth=1297 I1117 09:43:40.146922 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԑ queue_depth=1298 I1117 09:43:40.147061 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԓ queue_depth=1299 I1117 09:43:40.147200 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԓ queue_depth=1300 I1117 09:43:40.147334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԕ queue_depth=1301 I1117 09:43:40.147476 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԕ queue_depth=1302 I1117 09:43:40.147610 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԗ queue_depth=1303 I1117 09:43:40.147748 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԗ queue_depth=1304 I1117 09:43:40.147886 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԙ queue_depth=1305 I1117 09:43:40.148021 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԙ queue_depth=1306 I1117 09:43:40.148159 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԛ queue_depth=1307 I1117 09:43:40.148294 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԛ queue_depth=1308 I1117 09:43:40.148434 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԝ queue_depth=1309 I1117 09:43:40.148570 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԝ queue_depth=1310 I1117 09:43:40.148707 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԟ queue_depth=1311 I1117 09:43:40.148844 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԟ queue_depth=1312 I1117 09:43:40.148977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԡ queue_depth=1313 I1117 09:43:40.149113 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԡ queue_depth=1314 I1117 09:43:40.149251 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԣ queue_depth=1315 I1117 09:43:40.149400 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԣ queue_depth=1316 I1117 09:43:40.149540 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԥ queue_depth=1317 I1117 09:43:40.149678 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԥ queue_depth=1318 I1117 09:43:40.149821 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԧ queue_depth=1319 I1117 09:43:40.149956 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԧ queue_depth=1320 I1117 09:43:40.150095 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԩ queue_depth=1321 I1117 09:43:40.150231 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԩ queue_depth=1322 I1117 09:43:40.150367 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԫ queue_depth=1323 I1117 09:43:40.150502 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԫ queue_depth=1324 I1117 09:43:40.150635 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԭ queue_depth=1325 I1117 09:43:40.150785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԭ queue_depth=1326 I1117 09:43:40.150944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ԯ queue_depth=1327 I1117 09:43:40.151081 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ԯ queue_depth=1328 I1117 09:43:40.151217 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=԰ queue_depth=1329 I1117 09:43:40.151352 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ա queue_depth=1330 I1117 09:43:40.151488 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Բ queue_depth=1331 I1117 09:43:40.151624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Գ queue_depth=1332 I1117 09:43:40.151759 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Դ queue_depth=1333 I1117 09:43:40.151897 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ե queue_depth=1334 I1117 09:43:40.152035 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Զ queue_depth=1335 I1117 09:43:40.152174 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Է queue_depth=1336 I1117 09:43:40.152304 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ը queue_depth=1337 I1117 09:43:40.152439 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Թ queue_depth=1338 I1117 09:43:40.152575 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ժ queue_depth=1339 I1117 09:43:40.152710 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ի queue_depth=1340 I1117 09:43:40.152844 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Լ queue_depth=1341 I1117 09:43:40.152977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Խ queue_depth=1342 I1117 09:43:40.153117 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ծ queue_depth=1343 I1117 09:43:40.153256 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Կ queue_depth=1344 I1117 09:43:40.153391 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Հ queue_depth=1345 I1117 09:43:40.153526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ձ queue_depth=1346 I1117 09:43:40.153662 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ղ queue_depth=1347 I1117 09:43:40.153799 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ճ queue_depth=1348 I1117 09:43:40.153931 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Մ queue_depth=1349 I1117 09:43:40.154141 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Յ queue_depth=1350 I1117 09:43:40.154283 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ն queue_depth=1351 I1117 09:43:40.154422 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Շ queue_depth=1352 I1117 09:43:40.154557 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ո queue_depth=1353 I1117 09:43:40.154693 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Չ queue_depth=1354 I1117 09:43:40.154830 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Պ queue_depth=1355 I1117 09:43:40.154966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ջ queue_depth=1356 I1117 09:43:40.155103 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ռ queue_depth=1357 I1117 09:43:40.155239 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ս queue_depth=1358 I1117 09:43:40.155374 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Վ queue_depth=1359 I1117 09:43:40.155538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Տ queue_depth=1360 I1117 09:43:40.155672 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ր queue_depth=1361 I1117 09:43:40.155822 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ց queue_depth=1362 I1117 09:43:40.155961 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ւ queue_depth=1363 I1117 09:43:40.156119 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Փ queue_depth=1364 I1117 09:43:40.156259 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ք queue_depth=1365 I1117 09:43:40.156404 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Օ queue_depth=1366 I1117 09:43:40.156541 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=Ֆ queue_depth=1367 I1117 09:43:40.156676 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=՗ queue_depth=1368 I1117 09:43:40.156813 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=՘ queue_depth=1369 I1117 09:43:40.156950 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ՙ queue_depth=1370 I1117 09:43:40.157083 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=՚ queue_depth=1371 I1117 09:43:40.157219 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=՛ queue_depth=1372 I1117 09:43:40.157355 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=՜ queue_depth=1373 I1117 09:43:40.157504 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=՝ queue_depth=1374 I1117 09:43:40.157652 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=՞ queue_depth=1375 I1117 09:43:40.157786 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=՟ queue_depth=1376 I1117 09:43:40.157919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ՠ queue_depth=1377 I1117 09:43:40.158055 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ա queue_depth=1378 I1117 09:43:40.158193 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=բ queue_depth=1379 I1117 09:43:40.158331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=գ queue_depth=1380 I1117 09:43:40.158469 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=դ queue_depth=1381 I1117 09:43:40.158607 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ե queue_depth=1382 I1117 09:43:40.158742 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=զ queue_depth=1383 I1117 09:43:40.158881 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=է queue_depth=1384 I1117 09:43:40.159016 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ը queue_depth=1385 I1117 09:43:40.159153 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=թ queue_depth=1386 I1117 09:43:40.159289 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ժ queue_depth=1387 I1117 09:43:40.159424 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ի queue_depth=1388 I1117 09:43:40.159561 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=լ queue_depth=1389 I1117 09:43:40.159698 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=խ queue_depth=1390 I1117 09:43:40.159840 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ծ queue_depth=1391 I1117 09:43:40.159975 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=կ queue_depth=1392 I1117 09:43:40.160131 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=հ queue_depth=1393 I1117 09:43:40.160267 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ձ queue_depth=1394 I1117 09:43:40.160403 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ղ queue_depth=1395 I1117 09:43:40.160538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ճ queue_depth=1396 I1117 09:43:40.160677 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=մ queue_depth=1397 I1117 09:43:40.160813 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=յ queue_depth=1398 I1117 09:43:40.160953 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ն queue_depth=1399 I1117 09:43:40.161091 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=շ queue_depth=1400 I1117 09:43:40.161225 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ո queue_depth=1401 I1117 09:43:40.161363 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=չ queue_depth=1402 I1117 09:43:40.161498 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=պ queue_depth=1403 I1117 09:43:40.161634 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ջ queue_depth=1404 I1117 09:43:40.161769 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ռ queue_depth=1405 I1117 09:43:40.161904 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ս queue_depth=1406 I1117 09:43:40.162039 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=վ queue_depth=1407 I1117 09:43:40.162175 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=տ queue_depth=1408 I1117 09:43:40.162308 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ր queue_depth=1409 I1117 09:43:40.162446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ց queue_depth=1410 I1117 09:43:40.162583 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ւ queue_depth=1411 I1117 09:43:40.162717 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=փ queue_depth=1412 I1117 09:43:40.162868 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ք queue_depth=1413 I1117 09:43:40.163017 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=օ queue_depth=1414 I1117 09:43:40.163160 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֆ queue_depth=1415 I1117 09:43:40.163296 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=և queue_depth=1416 I1117 09:43:40.163429 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֈ queue_depth=1417 I1117 09:43:40.163566 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=։ queue_depth=1418 I1117 09:43:40.163700 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֊ queue_depth=1419 I1117 09:43:40.163836 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֋ queue_depth=1420 I1117 09:43:40.163971 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֌ queue_depth=1421 I1117 09:43:40.164106 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֍ queue_depth=1422 I1117 09:43:40.164241 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֎ queue_depth=1423 I1117 09:43:40.164377 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֏ queue_depth=1424 I1117 09:43:40.164513 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֐ queue_depth=1425 I1117 09:43:40.164671 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֑ queue_depth=1426 I1117 09:43:40.164809 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֒ queue_depth=1427 I1117 09:43:40.164948 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֓ queue_depth=1428 I1117 09:43:40.165086 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֔ queue_depth=1429 I1117 09:43:40.165222 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֕ queue_depth=1430 I1117 09:43:40.165357 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֖ queue_depth=1431 I1117 09:43:40.165490 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֗ queue_depth=1432 I1117 09:43:40.165624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֘ queue_depth=1433 I1117 09:43:40.165761 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֙ queue_depth=1434 I1117 09:43:40.165895 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֚ queue_depth=1435 I1117 09:43:40.166030 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֛ queue_depth=1436 I1117 09:43:40.166165 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֜ queue_depth=1437 I1117 09:43:40.166313 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֝ queue_depth=1438 I1117 09:43:40.166456 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֞ queue_depth=1439 I1117 09:43:40.166593 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֟ queue_depth=1440 I1117 09:43:40.166726 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֠ queue_depth=1441 I1117 09:43:40.166867 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֡ queue_depth=1442 I1117 09:43:40.167001 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֢ queue_depth=1443 I1117 09:43:40.167137 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֣ queue_depth=1444 I1117 09:43:40.167272 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֤ queue_depth=1445 I1117 09:43:40.167408 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֥ queue_depth=1446 I1117 09:43:40.167545 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֦ queue_depth=1447 I1117 09:43:40.167680 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֧ queue_depth=1448 I1117 09:43:40.167815 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֨ queue_depth=1449 I1117 09:43:40.167950 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֩ queue_depth=1450 I1117 09:43:40.168086 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֪ queue_depth=1451 I1117 09:43:40.168225 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֫ queue_depth=1452 I1117 09:43:40.168361 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֬ queue_depth=1453 I1117 09:43:40.168511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֭ queue_depth=1454 I1117 09:43:40.168650 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֮ queue_depth=1455 I1117 09:43:40.168786 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=֯ queue_depth=1456 I1117 09:43:40.168918 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ְ queue_depth=1457 I1117 09:43:40.169054 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֱ queue_depth=1458 I1117 09:43:40.169216 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֲ queue_depth=1459 I1117 09:43:40.169365 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֳ queue_depth=1460 I1117 09:43:40.169505 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ִ queue_depth=1461 I1117 09:43:40.169646 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֵ queue_depth=1462 I1117 09:43:40.169811 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֶ queue_depth=1463 I1117 09:43:40.169952 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ַ queue_depth=1464 I1117 09:43:40.170083 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ָ queue_depth=1465 I1117 09:43:40.170216 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֹ queue_depth=1466 I1117 09:43:40.170353 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֺ queue_depth=1467 I1117 09:43:40.170489 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֻ queue_depth=1468 I1117 09:43:40.170625 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ּ queue_depth=1469 I1117 09:43:40.170760 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֽ queue_depth=1470 I1117 09:43:40.170895 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=־ queue_depth=1471 I1117 09:43:40.171034 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ֿ queue_depth=1472 I1117 09:43:40.171169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׀ queue_depth=1473 I1117 09:43:40.171303 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ׁ queue_depth=1474 I1117 09:43:40.171437 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ׂ queue_depth=1475 I1117 09:43:40.171571 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׃ queue_depth=1476 I1117 09:43:40.171707 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ׄ queue_depth=1477 I1117 09:43:40.171842 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ׅ queue_depth=1478 I1117 09:43:40.171977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׆ queue_depth=1479 I1117 09:43:40.172127 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ׇ queue_depth=1480 I1117 09:43:40.172258 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׈ queue_depth=1481 I1117 09:43:40.172395 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׉ queue_depth=1482 I1117 09:43:40.172529 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׊ queue_depth=1483 I1117 09:43:40.172668 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׋ queue_depth=1484 I1117 09:43:40.172802 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׌ queue_depth=1485 I1117 09:43:40.172941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׍ queue_depth=1486 I1117 09:43:40.173081 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׎ queue_depth=1487 I1117 09:43:40.173221 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׏ queue_depth=1488 I1117 09:43:40.173370 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=א queue_depth=1489 I1117 09:43:40.173509 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ב queue_depth=1490 I1117 09:43:40.173642 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ג queue_depth=1491 I1117 09:43:40.173800 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ד queue_depth=1492 I1117 09:43:40.173940 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ה queue_depth=1493 I1117 09:43:40.174075 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ו queue_depth=1494 I1117 09:43:40.174297 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ז queue_depth=1495 I1117 09:43:40.174439 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ח queue_depth=1496 I1117 09:43:40.174576 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ט queue_depth=1497 I1117 09:43:40.174713 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=י queue_depth=1498 I1117 09:43:40.174850 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ך queue_depth=1499 I1117 09:43:40.174998 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=כ queue_depth=1500 I1117 09:43:40.175134 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ל queue_depth=1501 I1117 09:43:40.175270 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ם queue_depth=1502 I1117 09:43:40.175405 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=מ queue_depth=1503 I1117 09:43:40.175539 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ן queue_depth=1504 I1117 09:43:40.175673 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=נ queue_depth=1505 I1117 09:43:40.175810 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ס queue_depth=1506 I1117 09:43:40.175945 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ע queue_depth=1507 I1117 09:43:40.176081 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ף queue_depth=1508 I1117 09:43:40.176217 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=פ queue_depth=1509 I1117 09:43:40.176356 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ץ queue_depth=1510 I1117 09:43:40.176497 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=צ queue_depth=1511 I1117 09:43:40.176633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ק queue_depth=1512 I1117 09:43:40.176768 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ר queue_depth=1513 I1117 09:43:40.176906 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ש queue_depth=1514 I1117 09:43:40.177043 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ת queue_depth=1515 I1117 09:43:40.177182 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׫ queue_depth=1516 I1117 09:43:40.177317 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׬ queue_depth=1517 I1117 09:43:40.177454 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׭ queue_depth=1518 I1117 09:43:40.177594 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׮ queue_depth=1519 I1117 09:43:40.177731 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ׯ queue_depth=1520 I1117 09:43:40.177866 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=װ queue_depth=1521 I1117 09:43:40.178002 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ױ queue_depth=1522 I1117 09:43:40.178440 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ײ queue_depth=1523 I1117 09:43:40.178599 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׳ queue_depth=1524 I1117 09:43:40.178760 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=״ queue_depth=1525 I1117 09:43:40.178895 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׵ queue_depth=1526 I1117 09:43:40.179047 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׶ queue_depth=1527 I1117 09:43:40.179182 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׷ queue_depth=1528 I1117 09:43:40.179314 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׸ queue_depth=1529 I1117 09:43:40.179449 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׹ queue_depth=1530 I1117 09:43:40.179581 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׺ queue_depth=1531 I1117 09:43:40.179714 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׻ queue_depth=1532 I1117 09:43:40.179853 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׼ queue_depth=1533 I1117 09:43:40.179985 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׽ queue_depth=1534 I1117 09:43:40.180121 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׾ queue_depth=1535 I1117 09:43:40.180260 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=׿ queue_depth=1536 I1117 09:43:40.180392 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؀ queue_depth=1537 I1117 09:43:40.180526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؁ queue_depth=1538 I1117 09:43:40.180660 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؂ queue_depth=1539 I1117 09:43:40.180792 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؃ queue_depth=1540 I1117 09:43:40.180931 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؄ queue_depth=1541 I1117 09:43:40.181066 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؅ queue_depth=1542 I1117 09:43:40.181201 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؆ queue_depth=1543 I1117 09:43:40.181334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؇ queue_depth=1544 I1117 09:43:40.181479 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؈ queue_depth=1545 I1117 09:43:40.181617 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؉ queue_depth=1546 I1117 09:43:40.181750 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؊ queue_depth=1547 I1117 09:43:40.181883 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؋ queue_depth=1548 I1117 09:43:40.182016 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=، queue_depth=1549 I1117 09:43:40.182150 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؍ queue_depth=1550 I1117 09:43:40.182281 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؎ queue_depth=1551 I1117 09:43:40.182417 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؏ queue_depth=1552 I1117 09:43:40.182547 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؐ queue_depth=1553 I1117 09:43:40.182682 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؑ queue_depth=1554 I1117 09:43:40.182817 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؒ queue_depth=1555 I1117 09:43:40.182953 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؓ queue_depth=1556 I1117 09:43:40.183094 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؔ queue_depth=1557 I1117 09:43:40.183255 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؕ queue_depth=1558 I1117 09:43:40.183390 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؖ queue_depth=1559 I1117 09:43:40.183526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؗ queue_depth=1560 I1117 09:43:40.183655 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؘ queue_depth=1561 I1117 09:43:40.183790 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؙ queue_depth=1562 I1117 09:43:40.183923 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؚ queue_depth=1563 I1117 09:43:40.184057 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؛ queue_depth=1564 I1117 09:43:40.184188 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؜ queue_depth=1565 I1117 09:43:40.184325 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؝ queue_depth=1566 I1117 09:43:40.184459 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؞ queue_depth=1567 I1117 09:43:40.184594 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=؟ queue_depth=1568 I1117 09:43:40.184727 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؠ queue_depth=1569 I1117 09:43:40.184858 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ء queue_depth=1570 I1117 09:43:40.184990 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=آ queue_depth=1571 I1117 09:43:40.185125 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=أ queue_depth=1572 I1117 09:43:40.185255 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؤ queue_depth=1573 I1117 09:43:40.185388 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=إ queue_depth=1574 I1117 09:43:40.185525 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ئ queue_depth=1575 I1117 09:43:40.185658 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ا queue_depth=1576 I1117 09:43:40.185787 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ب queue_depth=1577 I1117 09:43:40.185926 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ة queue_depth=1578 I1117 09:43:40.186062 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ت queue_depth=1579 I1117 09:43:40.186203 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ث queue_depth=1580 I1117 09:43:40.186347 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ج queue_depth=1581 I1117 09:43:40.186491 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ح queue_depth=1582 I1117 09:43:40.186625 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=خ queue_depth=1583 I1117 09:43:40.186758 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=د queue_depth=1584 I1117 09:43:40.186888 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ذ queue_depth=1585 I1117 09:43:40.187025 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ر queue_depth=1586 I1117 09:43:40.187161 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ز queue_depth=1587 I1117 09:43:40.187295 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=س queue_depth=1588 I1117 09:43:40.187426 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ش queue_depth=1589 I1117 09:43:40.187560 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ص queue_depth=1590 I1117 09:43:40.187717 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ض queue_depth=1591 I1117 09:43:40.187856 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ط queue_depth=1592 I1117 09:43:40.187987 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ظ queue_depth=1593 I1117 09:43:40.188123 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ع queue_depth=1594 I1117 09:43:40.188260 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=غ queue_depth=1595 I1117 09:43:40.188392 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ػ queue_depth=1596 I1117 09:43:40.188537 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؼ queue_depth=1597 I1117 09:43:40.188672 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؽ queue_depth=1598 I1117 09:43:40.188806 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؾ queue_depth=1599 I1117 09:43:40.188949 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ؿ queue_depth=1600 I1117 09:43:40.189080 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ـ queue_depth=1601 I1117 09:43:40.189215 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ف queue_depth=1602 I1117 09:43:40.189350 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ق queue_depth=1603 I1117 09:43:40.189484 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ك queue_depth=1604 I1117 09:43:40.189615 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ل queue_depth=1605 I1117 09:43:40.189756 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=م queue_depth=1606 I1117 09:43:40.189891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ن queue_depth=1607 I1117 09:43:40.190026 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ه queue_depth=1608 I1117 09:43:40.190159 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=و queue_depth=1609 I1117 09:43:40.190294 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ى queue_depth=1610 I1117 09:43:40.190428 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ي queue_depth=1611 I1117 09:43:40.190559 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ً queue_depth=1612 I1117 09:43:40.190691 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٌ queue_depth=1613 I1117 09:43:40.190824 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٍ queue_depth=1614 I1117 09:43:40.190958 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=َ queue_depth=1615 I1117 09:43:40.191092 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ُ queue_depth=1616 I1117 09:43:40.191227 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ِ queue_depth=1617 I1117 09:43:40.191363 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ّ queue_depth=1618 I1117 09:43:40.191509 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ْ queue_depth=1619 I1117 09:43:40.191643 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٓ queue_depth=1620 I1117 09:43:40.191777 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٔ queue_depth=1621 I1117 09:43:40.191922 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٕ queue_depth=1622 I1117 09:43:40.192058 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٖ queue_depth=1623 I1117 09:43:40.192210 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٗ queue_depth=1624 I1117 09:43:40.192344 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٘ queue_depth=1625 I1117 09:43:40.192477 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٙ queue_depth=1626 I1117 09:43:40.192612 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٚ queue_depth=1627 I1117 09:43:40.192760 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٛ queue_depth=1628 I1117 09:43:40.192892 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٜ queue_depth=1629 I1117 09:43:40.193026 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٝ queue_depth=1630 I1117 09:43:40.193169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٞ queue_depth=1631 I1117 09:43:40.193305 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٟ queue_depth=1632 I1117 09:43:40.193438 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٠ queue_depth=1633 I1117 09:43:40.193568 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=١ queue_depth=1634 I1117 09:43:40.193705 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٢ queue_depth=1635 I1117 09:43:40.193837 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٣ queue_depth=1636 I1117 09:43:40.193968 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٤ queue_depth=1637 I1117 09:43:40.194103 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٥ queue_depth=1638 I1117 09:43:40.194234 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٦ queue_depth=1639 I1117 09:43:40.194446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٧ queue_depth=1640 I1117 09:43:40.194579 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٨ queue_depth=1641 I1117 09:43:40.194713 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٩ queue_depth=1642 I1117 09:43:40.194849 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٪ queue_depth=1643 I1117 09:43:40.194980 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٫ queue_depth=1644 I1117 09:43:40.195114 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٬ queue_depth=1645 I1117 09:43:40.195245 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=٭ queue_depth=1646 I1117 09:43:40.195377 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٮ queue_depth=1647 I1117 09:43:40.195515 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٯ queue_depth=1648 I1117 09:43:40.195645 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٰ queue_depth=1649 I1117 09:43:40.195791 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٱ queue_depth=1650 I1117 09:43:40.195926 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٲ queue_depth=1651 I1117 09:43:40.196058 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٳ queue_depth=1652 I1117 09:43:40.196195 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٴ queue_depth=1653 I1117 09:43:40.196328 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٵ queue_depth=1654 I1117 09:43:40.196467 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٶ queue_depth=1655 I1117 09:43:40.196613 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٷ queue_depth=1656 I1117 09:43:40.196782 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٸ queue_depth=1657 I1117 09:43:40.196919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٹ queue_depth=1658 I1117 09:43:40.197053 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٺ queue_depth=1659 I1117 09:43:40.197188 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٻ queue_depth=1660 I1117 09:43:40.197322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ټ queue_depth=1661 I1117 09:43:40.197456 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٽ queue_depth=1662 I1117 09:43:40.197588 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=پ queue_depth=1663 I1117 09:43:40.197723 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ٿ queue_depth=1664 I1117 09:43:40.197856 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڀ queue_depth=1665 I1117 09:43:40.197990 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ځ queue_depth=1666 I1117 09:43:40.198122 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڂ queue_depth=1667 I1117 09:43:40.198255 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڃ queue_depth=1668 I1117 09:43:40.198385 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڄ queue_depth=1669 I1117 09:43:40.198520 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=څ queue_depth=1670 I1117 09:43:40.198652 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=چ queue_depth=1671 I1117 09:43:40.198789 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڇ queue_depth=1672 I1117 09:43:40.198920 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڈ queue_depth=1673 I1117 09:43:40.199057 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ډ queue_depth=1674 I1117 09:43:40.199190 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڊ queue_depth=1675 I1117 09:43:40.199322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڋ queue_depth=1676 I1117 09:43:40.199454 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڌ queue_depth=1677 I1117 09:43:40.199590 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڍ queue_depth=1678 I1117 09:43:40.199728 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڎ queue_depth=1679 I1117 09:43:40.199863 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڏ queue_depth=1680 I1117 09:43:40.199996 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڐ queue_depth=1681 I1117 09:43:40.200141 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڑ queue_depth=1682 I1117 09:43:40.200276 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڒ queue_depth=1683 I1117 09:43:40.200412 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ړ queue_depth=1684 I1117 09:43:40.200557 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڔ queue_depth=1685 I1117 09:43:40.200689 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڕ queue_depth=1686 I1117 09:43:40.200823 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ږ queue_depth=1687 I1117 09:43:40.200957 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڗ queue_depth=1688 I1117 09:43:40.201089 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ژ queue_depth=1689 I1117 09:43:40.201245 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڙ queue_depth=1690 I1117 09:43:40.201379 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ښ queue_depth=1691 I1117 09:43:40.201512 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڛ queue_depth=1692 I1117 09:43:40.201644 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڜ queue_depth=1693 I1117 09:43:40.201778 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڝ queue_depth=1694 I1117 09:43:40.201912 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڞ queue_depth=1695 I1117 09:43:40.202046 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڟ queue_depth=1696 I1117 09:43:40.202175 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڠ queue_depth=1697 I1117 09:43:40.202308 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڡ queue_depth=1698 I1117 09:43:40.202440 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڢ queue_depth=1699 I1117 09:43:40.202578 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڣ queue_depth=1700 I1117 09:43:40.202713 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڤ queue_depth=1701 I1117 09:43:40.202846 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڥ queue_depth=1702 I1117 09:43:40.202980 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڦ queue_depth=1703 I1117 09:43:40.203118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڧ queue_depth=1704 I1117 09:43:40.203249 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڨ queue_depth=1705 I1117 09:43:40.203383 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ک queue_depth=1706 I1117 09:43:40.203518 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڪ queue_depth=1707 I1117 09:43:40.203651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ګ queue_depth=1708 I1117 09:43:40.203788 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڬ queue_depth=1709 I1117 09:43:40.203921 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڭ queue_depth=1710 I1117 09:43:40.204071 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڮ queue_depth=1711 I1117 09:43:40.204209 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=گ queue_depth=1712 I1117 09:43:40.204341 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڰ queue_depth=1713 I1117 09:43:40.204473 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڱ queue_depth=1714 I1117 09:43:40.204606 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڲ queue_depth=1715 I1117 09:43:40.204739 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڳ queue_depth=1716 I1117 09:43:40.204873 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڴ queue_depth=1717 I1117 09:43:40.205006 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڵ queue_depth=1718 I1117 09:43:40.205140 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڶ queue_depth=1719 I1117 09:43:40.205274 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڷ queue_depth=1720 I1117 09:43:40.205408 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڸ queue_depth=1721 I1117 09:43:40.205542 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڹ queue_depth=1722 I1117 09:43:40.205695 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ں queue_depth=1723 I1117 09:43:40.205834 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڻ queue_depth=1724 I1117 09:43:40.205967 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڼ queue_depth=1725 I1117 09:43:40.206098 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڽ queue_depth=1726 I1117 09:43:40.206231 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ھ queue_depth=1727 I1117 09:43:40.206375 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ڿ queue_depth=1728 I1117 09:43:40.206526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۀ queue_depth=1729 I1117 09:43:40.206666 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ہ queue_depth=1730 I1117 09:43:40.206803 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۂ queue_depth=1731 I1117 09:43:40.206941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۃ queue_depth=1732 I1117 09:43:40.207075 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۄ queue_depth=1733 I1117 09:43:40.207207 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۅ queue_depth=1734 I1117 09:43:40.207338 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۆ queue_depth=1735 I1117 09:43:40.207472 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۇ queue_depth=1736 I1117 09:43:40.207607 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۈ queue_depth=1737 I1117 09:43:40.207739 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۉ queue_depth=1738 I1117 09:43:40.207870 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۊ queue_depth=1739 I1117 09:43:40.208009 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۋ queue_depth=1740 I1117 09:43:40.208145 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ی queue_depth=1741 I1117 09:43:40.208281 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۍ queue_depth=1742 I1117 09:43:40.208412 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ێ queue_depth=1743 I1117 09:43:40.208550 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۏ queue_depth=1744 I1117 09:43:40.208680 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ې queue_depth=1745 I1117 09:43:40.208817 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۑ queue_depth=1746 I1117 09:43:40.208951 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ے queue_depth=1747 I1117 09:43:40.209087 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۓ queue_depth=1748 I1117 09:43:40.209221 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۔ queue_depth=1749 I1117 09:43:40.209355 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ە queue_depth=1750 I1117 09:43:40.209491 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۖ queue_depth=1751 I1117 09:43:40.209633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۗ queue_depth=1752 I1117 09:43:40.209772 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۘ queue_depth=1753 I1117 09:43:40.209906 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۙ queue_depth=1754 I1117 09:43:40.210042 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۚ queue_depth=1755 I1117 09:43:40.210198 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۛ queue_depth=1756 I1117 09:43:40.210347 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۜ queue_depth=1757 I1117 09:43:40.210494 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۝ queue_depth=1758 I1117 09:43:40.210630 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۞ queue_depth=1759 I1117 09:43:40.210776 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۟ queue_depth=1760 I1117 09:43:40.210908 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۠ queue_depth=1761 I1117 09:43:40.211040 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۡ queue_depth=1762 I1117 09:43:40.212820 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۢ queue_depth=1763 I1117 09:43:40.212959 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۣ queue_depth=1764 I1117 09:43:40.213096 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۤ queue_depth=1765 I1117 09:43:40.213229 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۥ queue_depth=1766 I1117 09:43:40.213361 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۦ queue_depth=1767 I1117 09:43:40.213497 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۧ queue_depth=1768 I1117 09:43:40.213632 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۨ queue_depth=1769 I1117 09:43:40.213766 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۩ queue_depth=1770 I1117 09:43:40.213900 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۪ queue_depth=1771 I1117 09:43:40.214032 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۫ queue_depth=1772 I1117 09:43:40.214166 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۬ queue_depth=1773 I1117 09:43:40.214300 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۭ queue_depth=1774 I1117 09:43:40.214431 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۮ queue_depth=1775 I1117 09:43:40.214646 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۯ queue_depth=1776 I1117 09:43:40.214784 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۰ queue_depth=1777 I1117 09:43:40.214920 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۱ queue_depth=1778 I1117 09:43:40.215053 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۲ queue_depth=1779 I1117 09:43:40.215187 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۳ queue_depth=1780 I1117 09:43:40.215320 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۴ queue_depth=1781 I1117 09:43:40.215451 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۵ queue_depth=1782 I1117 09:43:40.215584 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۶ queue_depth=1783 I1117 09:43:40.215721 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۷ queue_depth=1784 I1117 09:43:40.215853 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۸ queue_depth=1785 I1117 09:43:40.215986 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۹ queue_depth=1786 I1117 09:43:40.216118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۺ queue_depth=1787 I1117 09:43:40.216253 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۻ queue_depth=1788 I1117 09:43:40.216416 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۼ queue_depth=1789 I1117 09:43:40.216553 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۽ queue_depth=1790 I1117 09:43:40.216688 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=۾ queue_depth=1791 I1117 09:43:40.216820 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ۿ queue_depth=1792 I1117 09:43:40.216953 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܀ queue_depth=1793 I1117 09:43:40.217091 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܁ queue_depth=1794 I1117 09:43:40.217231 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܂ queue_depth=1795 I1117 09:43:40.217362 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܃ queue_depth=1796 I1117 09:43:40.217499 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܄ queue_depth=1797 I1117 09:43:40.217635 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܅ queue_depth=1798 I1117 09:43:40.217771 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܆ queue_depth=1799 I1117 09:43:40.217918 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܇ queue_depth=1800 I1117 09:43:40.218049 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܈ queue_depth=1801 I1117 09:43:40.218180 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܉ queue_depth=1802 I1117 09:43:40.218311 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܊ queue_depth=1803 I1117 09:43:40.218451 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܋ queue_depth=1804 I1117 09:43:40.218586 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܌ queue_depth=1805 I1117 09:43:40.218725 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܍ queue_depth=1806 I1117 09:43:40.218858 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܎ queue_depth=1807 I1117 09:43:40.218993 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=܏ queue_depth=1808 I1117 09:43:40.219125 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܐ queue_depth=1809 I1117 09:43:40.219262 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܑ queue_depth=1810 I1117 09:43:40.219393 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܒ queue_depth=1811 I1117 09:43:40.219532 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܓ queue_depth=1812 I1117 09:43:40.219663 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܔ queue_depth=1813 I1117 09:43:40.219808 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܕ queue_depth=1814 I1117 09:43:40.219943 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܖ queue_depth=1815 I1117 09:43:40.220075 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܗ queue_depth=1816 I1117 09:43:40.220206 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܘ queue_depth=1817 I1117 09:43:40.220341 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܙ queue_depth=1818 I1117 09:43:40.220476 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܚ queue_depth=1819 I1117 09:43:40.220607 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܛ queue_depth=1820 I1117 09:43:40.220740 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܜ queue_depth=1821 I1117 09:43:40.220894 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܝ queue_depth=1822 I1117 09:43:40.221033 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܞ queue_depth=1823 I1117 09:43:40.221168 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܟ queue_depth=1824 I1117 09:43:40.221301 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܠ queue_depth=1825 I1117 09:43:40.221434 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܡ queue_depth=1826 I1117 09:43:40.221568 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܢ queue_depth=1827 I1117 09:43:40.221704 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܣ queue_depth=1828 I1117 09:43:40.221836 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܤ queue_depth=1829 I1117 09:43:40.221968 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܥ queue_depth=1830 I1117 09:43:40.222103 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܦ queue_depth=1831 I1117 09:43:40.222235 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܧ queue_depth=1832 I1117 09:43:40.222367 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܨ queue_depth=1833 I1117 09:43:40.222498 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܩ queue_depth=1834 I1117 09:43:40.222637 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܪ queue_depth=1835 I1117 09:43:40.224419 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܫ queue_depth=1836 I1117 09:43:40.224555 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܬ queue_depth=1837 I1117 09:43:40.224689 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܭ queue_depth=1838 I1117 09:43:40.224825 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܮ queue_depth=1839 I1117 09:43:40.224971 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܯ queue_depth=1840 I1117 09:43:40.225105 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܰ queue_depth=1841 I1117 09:43:40.225238 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܱ queue_depth=1842 I1117 09:43:40.225372 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܲ queue_depth=1843 I1117 09:43:40.225507 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܳ queue_depth=1844 I1117 09:43:40.225639 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܴ queue_depth=1845 I1117 09:43:40.225777 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܵ queue_depth=1846 I1117 09:43:40.225908 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܶ queue_depth=1847 I1117 09:43:40.226043 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܷ queue_depth=1848 I1117 09:43:40.226172 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܸ queue_depth=1849 I1117 09:43:40.226306 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܹ queue_depth=1850 I1117 09:43:40.226448 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܺ queue_depth=1851 I1117 09:43:40.226598 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܻ queue_depth=1852 I1117 09:43:40.226737 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܼ queue_depth=1853 I1117 09:43:40.226885 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܽ queue_depth=1854 I1117 09:43:40.227039 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܾ queue_depth=1855 I1117 09:43:40.227178 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ܿ queue_depth=1856 I1117 09:43:40.227307 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݀ queue_depth=1857 I1117 09:43:40.227452 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݁ queue_depth=1858 I1117 09:43:40.227587 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݂ queue_depth=1859 I1117 09:43:40.227719 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݃ queue_depth=1860 I1117 09:43:40.227852 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݄ queue_depth=1861 I1117 09:43:40.227984 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݅ queue_depth=1862 I1117 09:43:40.228118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݆ queue_depth=1863 I1117 09:43:40.228252 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݇ queue_depth=1864 I1117 09:43:40.228383 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݈ queue_depth=1865 I1117 09:43:40.228516 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݉ queue_depth=1866 I1117 09:43:40.228651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݊ queue_depth=1867 I1117 09:43:40.228785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݋ queue_depth=1868 I1117 09:43:40.228920 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=݌ queue_depth=1869 I1117 09:43:40.229054 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݍ queue_depth=1870 I1117 09:43:40.229188 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݎ queue_depth=1871 I1117 09:43:40.229320 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݏ queue_depth=1872 I1117 09:43:40.229453 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݐ queue_depth=1873 I1117 09:43:40.229585 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݑ queue_depth=1874 I1117 09:43:40.229726 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݒ queue_depth=1875 I1117 09:43:40.229865 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݓ queue_depth=1876 I1117 09:43:40.229997 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݔ queue_depth=1877 I1117 09:43:40.230130 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݕ queue_depth=1878 I1117 09:43:40.230263 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݖ queue_depth=1879 I1117 09:43:40.230398 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݗ queue_depth=1880 I1117 09:43:40.230530 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݘ queue_depth=1881 I1117 09:43:40.230676 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݙ queue_depth=1882 I1117 09:43:40.230814 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݚ queue_depth=1883 I1117 09:43:40.230947 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݛ queue_depth=1884 I1117 09:43:40.231079 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݜ queue_depth=1885 I1117 09:43:40.231213 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݝ queue_depth=1886 I1117 09:43:40.231345 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݞ queue_depth=1887 I1117 09:43:40.231499 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݟ queue_depth=1888 I1117 09:43:40.231633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݠ queue_depth=1889 I1117 09:43:40.231765 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݡ queue_depth=1890 I1117 09:43:40.231898 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݢ queue_depth=1891 I1117 09:43:40.232036 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݣ queue_depth=1892 I1117 09:43:40.232169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݤ queue_depth=1893 I1117 09:43:40.232304 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݥ queue_depth=1894 I1117 09:43:40.232440 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݦ queue_depth=1895 I1117 09:43:40.232576 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݧ queue_depth=1896 I1117 09:43:40.232712 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݨ queue_depth=1897 I1117 09:43:40.232848 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݩ queue_depth=1898 I1117 09:43:40.232984 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݪ queue_depth=1899 I1117 09:43:40.233122 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݫ queue_depth=1900 I1117 09:43:40.233258 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݬ queue_depth=1901 I1117 09:43:40.233405 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݭ queue_depth=1902 I1117 09:43:40.233539 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݮ queue_depth=1903 I1117 09:43:40.233674 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݯ queue_depth=1904 I1117 09:43:40.233804 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݰ queue_depth=1905 I1117 09:43:40.233941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݱ queue_depth=1906 I1117 09:43:40.234074 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݲ queue_depth=1907 I1117 09:43:40.234206 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݳ queue_depth=1908 I1117 09:43:40.234341 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݴ queue_depth=1909 I1117 09:43:40.234472 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݵ queue_depth=1910 I1117 09:43:40.234648 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݶ queue_depth=1911 I1117 09:43:40.234785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݷ queue_depth=1912 I1117 09:43:40.234930 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݸ queue_depth=1913 I1117 09:43:40.235064 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݹ queue_depth=1914 I1117 09:43:40.235199 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݺ queue_depth=1915 I1117 09:43:40.235331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݻ queue_depth=1916 I1117 09:43:40.235464 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݼ queue_depth=1917 I1117 09:43:40.235600 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݽ queue_depth=1918 I1117 09:43:40.235734 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݾ queue_depth=1919 I1117 09:43:40.235865 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ݿ queue_depth=1920 I1117 09:43:40.236024 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ހ queue_depth=1921 I1117 09:43:40.236163 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ށ queue_depth=1922 I1117 09:43:40.236297 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ނ queue_depth=1923 I1117 09:43:40.236435 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ރ queue_depth=1924 I1117 09:43:40.236570 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ބ queue_depth=1925 I1117 09:43:40.236705 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޅ queue_depth=1926 I1117 09:43:40.236840 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ކ queue_depth=1927 I1117 09:43:40.236972 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=އ queue_depth=1928 I1117 09:43:40.237105 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ވ queue_depth=1929 I1117 09:43:40.237237 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=މ queue_depth=1930 I1117 09:43:40.237370 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ފ queue_depth=1931 I1117 09:43:40.237506 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ދ queue_depth=1932 I1117 09:43:40.237641 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ތ queue_depth=1933 I1117 09:43:40.237774 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ލ queue_depth=1934 I1117 09:43:40.237907 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ގ queue_depth=1935 I1117 09:43:40.238040 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޏ queue_depth=1936 I1117 09:43:40.238173 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ސ queue_depth=1937 I1117 09:43:40.238305 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޑ queue_depth=1938 I1117 09:43:40.238440 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޒ queue_depth=1939 I1117 09:43:40.238574 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޓ queue_depth=1940 I1117 09:43:40.238708 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޔ queue_depth=1941 I1117 09:43:40.238844 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޕ queue_depth=1942 I1117 09:43:40.238981 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޖ queue_depth=1943 I1117 09:43:40.239126 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޗ queue_depth=1944 I1117 09:43:40.239259 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޘ queue_depth=1945 I1117 09:43:40.239391 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޙ queue_depth=1946 I1117 09:43:40.239524 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޚ queue_depth=1947 I1117 09:43:40.239657 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޛ queue_depth=1948 I1117 09:43:40.239797 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޜ queue_depth=1949 I1117 09:43:40.239941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޝ queue_depth=1950 I1117 09:43:40.240078 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޞ queue_depth=1951 I1117 09:43:40.240216 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޟ queue_depth=1952 I1117 09:43:40.240351 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޠ queue_depth=1953 I1117 09:43:40.240508 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޡ queue_depth=1954 I1117 09:43:40.240644 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޢ queue_depth=1955 I1117 09:43:40.240776 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޣ queue_depth=1956 I1117 09:43:40.240909 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޤ queue_depth=1957 I1117 09:43:40.241046 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޥ queue_depth=1958 I1117 09:43:40.241178 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ަ queue_depth=1959 I1117 09:43:40.241313 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ާ queue_depth=1960 I1117 09:43:40.241442 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ި queue_depth=1961 I1117 09:43:40.241577 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ީ queue_depth=1962 I1117 09:43:40.241712 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ު queue_depth=1963 I1117 09:43:40.241844 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޫ queue_depth=1964 I1117 09:43:40.241976 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ެ queue_depth=1965 I1117 09:43:40.242110 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޭ queue_depth=1966 I1117 09:43:40.242242 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޮ queue_depth=1967 I1117 09:43:40.242375 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޯ queue_depth=1968 I1117 09:43:40.242510 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ް queue_depth=1969 I1117 09:43:40.242641 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ޱ queue_depth=1970 I1117 09:43:40.242772 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޲ queue_depth=1971 I1117 09:43:40.242909 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޳ queue_depth=1972 I1117 09:43:40.243043 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޴ queue_depth=1973 I1117 09:43:40.243182 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޵ queue_depth=1974 I1117 09:43:40.243314 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޶ queue_depth=1975 I1117 09:43:40.243446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޷ queue_depth=1976 I1117 09:43:40.243578 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޸ queue_depth=1977 I1117 09:43:40.243723 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޹ queue_depth=1978 I1117 09:43:40.243857 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޺ queue_depth=1979 I1117 09:43:40.243993 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޻ queue_depth=1980 I1117 09:43:40.244124 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޼ queue_depth=1981 I1117 09:43:40.244262 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޽ queue_depth=1982 I1117 09:43:40.244394 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޾ queue_depth=1983 I1117 09:43:40.244525 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=޿ queue_depth=1984 I1117 09:43:40.244656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߀ queue_depth=1985 I1117 09:43:40.244792 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߁ queue_depth=1986 I1117 09:43:40.244957 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߂ queue_depth=1987 I1117 09:43:40.245092 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߃ queue_depth=1988 I1117 09:43:40.245223 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߄ queue_depth=1989 I1117 09:43:40.245371 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߅ queue_depth=1990 I1117 09:43:40.245508 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߆ queue_depth=1991 I1117 09:43:40.245644 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߇ queue_depth=1992 I1117 09:43:40.245779 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߈ queue_depth=1993 I1117 09:43:40.245915 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߉ queue_depth=1994 I1117 09:43:40.246047 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߊ queue_depth=1995 I1117 09:43:40.246183 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߋ queue_depth=1996 I1117 09:43:40.246320 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߌ queue_depth=1997 I1117 09:43:40.246459 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߍ queue_depth=1998 I1117 09:43:40.246595 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߎ queue_depth=1999 I1117 09:43:40.246747 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߏ queue_depth=2000 I1117 09:43:40.246878 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߐ queue_depth=2001 I1117 09:43:40.247010 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߑ queue_depth=2002 I1117 09:43:40.247145 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߒ queue_depth=2003 I1117 09:43:40.247278 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߓ queue_depth=2004 I1117 09:43:40.247413 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߔ queue_depth=2005 I1117 09:43:40.247550 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߕ queue_depth=2006 I1117 09:43:40.247684 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߖ queue_depth=2007 I1117 09:43:40.247816 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߗ queue_depth=2008 I1117 09:43:40.247949 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߘ queue_depth=2009 I1117 09:43:40.248081 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߙ queue_depth=2010 I1117 09:43:40.248228 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߚ queue_depth=2011 I1117 09:43:40.248364 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߛ queue_depth=2012 I1117 09:43:40.248496 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߜ queue_depth=2013 I1117 09:43:40.248627 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߝ queue_depth=2014 I1117 09:43:40.248758 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߞ queue_depth=2015 I1117 09:43:40.248890 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߟ queue_depth=2016 I1117 09:43:40.249018 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߠ queue_depth=2017 I1117 09:43:40.249152 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߡ queue_depth=2018 I1117 09:43:40.249284 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߢ queue_depth=2019 I1117 09:43:40.249441 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߣ queue_depth=2020 I1117 09:43:40.249578 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߤ queue_depth=2021 I1117 09:43:40.249723 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߥ queue_depth=2022 I1117 09:43:40.249862 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߦ queue_depth=2023 I1117 09:43:40.249995 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߧ queue_depth=2024 I1117 09:43:40.250127 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߨ queue_depth=2025 I1117 09:43:40.250259 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߩ queue_depth=2026 I1117 09:43:40.250394 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߪ queue_depth=2027 I1117 09:43:40.250529 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߫ queue_depth=2028 I1117 09:43:40.250661 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߬ queue_depth=2029 I1117 09:43:40.250800 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߭ queue_depth=2030 I1117 09:43:40.250931 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߮ queue_depth=2031 I1117 09:43:40.251063 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߯ queue_depth=2032 I1117 09:43:40.251195 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߰ queue_depth=2033 I1117 09:43:40.251326 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߱ queue_depth=2034 I1117 09:43:40.251459 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߲ queue_depth=2035 I1117 09:43:40.251591 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߳ queue_depth=2036 I1117 09:43:40.251724 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߴ queue_depth=2037 I1117 09:43:40.251859 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߵ queue_depth=2038 I1117 09:43:40.251990 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߶ queue_depth=2039 I1117 09:43:40.252126 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߷ queue_depth=2040 I1117 09:43:40.252257 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߸ queue_depth=2041 I1117 09:43:40.252394 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߹ queue_depth=2042 I1117 09:43:40.252525 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ߺ queue_depth=2043 I1117 09:43:40.252660 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߻ queue_depth=2044 I1117 09:43:40.252792 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߼ queue_depth=2045 I1117 09:43:40.252923 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߽ queue_depth=2046 I1117 09:43:40.253063 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߾ queue_depth=2047 I1117 09:43:40.253196 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=߿ queue_depth=2048 I1117 09:43:40.253468 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠀ queue_depth=2049 I1117 09:43:40.253607 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠁ queue_depth=2050 I1117 09:43:40.253740 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠂ queue_depth=2051 I1117 09:43:40.253875 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠃ queue_depth=2052 I1117 09:43:40.254030 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠄ queue_depth=2053 I1117 09:43:40.254169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠅ queue_depth=2054 I1117 09:43:40.254305 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠆ queue_depth=2055 I1117 09:43:40.254439 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠇ queue_depth=2056 I1117 09:43:40.254571 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠈ queue_depth=2057 I1117 09:43:40.254705 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠉ queue_depth=2058 I1117 09:43:40.254891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠊ queue_depth=2059 I1117 09:43:40.255025 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠋ queue_depth=2060 I1117 09:43:40.255171 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠌ queue_depth=2061 I1117 09:43:40.255312 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠍ queue_depth=2062 I1117 09:43:40.255447 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠎ queue_depth=2063 I1117 09:43:40.255582 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠏ queue_depth=2064 I1117 09:43:40.255717 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠐ queue_depth=2065 I1117 09:43:40.255851 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠑ queue_depth=2066 I1117 09:43:40.255986 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠒ queue_depth=2067 I1117 09:43:40.256121 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠓ queue_depth=2068 I1117 09:43:40.256253 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠔ queue_depth=2069 I1117 09:43:40.256410 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠕ queue_depth=2070 I1117 09:43:40.256546 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠖ queue_depth=2071 I1117 09:43:40.256681 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠗ queue_depth=2072 I1117 09:43:40.256814 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠘ queue_depth=2073 I1117 09:43:40.256947 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠙ queue_depth=2074 I1117 09:43:40.257084 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠚ queue_depth=2075 I1117 09:43:40.257217 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠛ queue_depth=2076 I1117 09:43:40.257351 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠜ queue_depth=2077 I1117 09:43:40.257483 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠝ queue_depth=2078 I1117 09:43:40.257622 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠞ queue_depth=2079 I1117 09:43:40.257761 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠟ queue_depth=2080 I1117 09:43:40.257894 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠠ queue_depth=2081 I1117 09:43:40.258031 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠡ queue_depth=2082 I1117 09:43:40.258165 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠢ queue_depth=2083 I1117 09:43:40.258298 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠣ queue_depth=2084 I1117 09:43:40.258433 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠤ queue_depth=2085 I1117 09:43:40.258587 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠥ queue_depth=2086 I1117 09:43:40.258723 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠦ queue_depth=2087 I1117 09:43:40.258858 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠧ queue_depth=2088 I1117 09:43:40.258994 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠨ queue_depth=2089 I1117 09:43:40.259132 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠩ queue_depth=2090 I1117 09:43:40.259281 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠪ queue_depth=2091 I1117 09:43:40.259416 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠫ queue_depth=2092 I1117 09:43:40.259551 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࠬ queue_depth=2093 I1117 09:43:40.259687 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠭ queue_depth=2094 I1117 09:43:40.259828 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠮ queue_depth=2095 I1117 09:43:40.259964 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠯ queue_depth=2096 I1117 09:43:40.260096 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠰ queue_depth=2097 I1117 09:43:40.260229 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠱ queue_depth=2098 I1117 09:43:40.260363 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠲ queue_depth=2099 I1117 09:43:40.260496 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠳ queue_depth=2100 I1117 09:43:40.260633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠴ queue_depth=2101 I1117 09:43:40.260766 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠵ queue_depth=2102 I1117 09:43:40.260901 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠶ queue_depth=2103 I1117 09:43:40.261045 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠷ queue_depth=2104 I1117 09:43:40.261180 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠸ queue_depth=2105 I1117 09:43:40.261314 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠹ queue_depth=2106 I1117 09:43:40.261448 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠺ queue_depth=2107 I1117 09:43:40.261582 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠻ queue_depth=2108 I1117 09:43:40.261713 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠼ queue_depth=2109 I1117 09:43:40.261846 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠽ queue_depth=2110 I1117 09:43:40.261993 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠾ queue_depth=2111 I1117 09:43:40.262129 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࠿ queue_depth=2112 I1117 09:43:40.262261 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡀ queue_depth=2113 I1117 09:43:40.262394 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡁ queue_depth=2114 I1117 09:43:40.262527 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡂ queue_depth=2115 I1117 09:43:40.262661 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡃ queue_depth=2116 I1117 09:43:40.262795 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡄ queue_depth=2117 I1117 09:43:40.262931 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡅ queue_depth=2118 I1117 09:43:40.263093 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡆ queue_depth=2119 I1117 09:43:40.263233 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡇ queue_depth=2120 I1117 09:43:40.263367 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡈ queue_depth=2121 I1117 09:43:40.263502 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡉ queue_depth=2122 I1117 09:43:40.263636 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡊ queue_depth=2123 I1117 09:43:40.263772 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡋ queue_depth=2124 I1117 09:43:40.263906 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡌ queue_depth=2125 I1117 09:43:40.264041 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡍ queue_depth=2126 I1117 09:43:40.264185 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡎ queue_depth=2127 I1117 09:43:40.264318 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡏ queue_depth=2128 I1117 09:43:40.264452 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡐ queue_depth=2129 I1117 09:43:40.264585 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡑ queue_depth=2130 I1117 09:43:40.264721 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡒ queue_depth=2131 I1117 09:43:40.264857 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡓ queue_depth=2132 I1117 09:43:40.264990 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡔ queue_depth=2133 I1117 09:43:40.265124 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡕ queue_depth=2134 I1117 09:43:40.265257 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡖ queue_depth=2135 I1117 09:43:40.265389 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡗ queue_depth=2136 I1117 09:43:40.265524 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡘ queue_depth=2137 I1117 09:43:40.265658 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡙ queue_depth=2138 I1117 09:43:40.266066 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡚ queue_depth=2139 I1117 09:43:40.266201 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡛ queue_depth=2140 I1117 09:43:40.266336 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡜ queue_depth=2141 I1117 09:43:40.266479 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡝ queue_depth=2142 I1117 09:43:40.266613 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡞ queue_depth=2143 I1117 09:43:40.266746 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡟ queue_depth=2144 I1117 09:43:40.266897 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡠ queue_depth=2145 I1117 09:43:40.267035 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡡ queue_depth=2146 I1117 09:43:40.267168 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡢ queue_depth=2147 I1117 09:43:40.267302 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡣ queue_depth=2148 I1117 09:43:40.267447 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡤ queue_depth=2149 I1117 09:43:40.267585 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡥ queue_depth=2150 I1117 09:43:40.267718 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡦ queue_depth=2151 I1117 09:43:40.267877 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡧ queue_depth=2152 I1117 09:43:40.268015 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡨ queue_depth=2153 I1117 09:43:40.268149 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡩ queue_depth=2154 I1117 09:43:40.268281 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡪ queue_depth=2155 I1117 09:43:40.268416 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡫ queue_depth=2156 I1117 09:43:40.268549 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡬ queue_depth=2157 I1117 09:43:40.268683 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡭ queue_depth=2158 I1117 09:43:40.268821 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡮ queue_depth=2159 I1117 09:43:40.268956 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࡯ queue_depth=2160 I1117 09:43:40.269089 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡰ queue_depth=2161 I1117 09:43:40.269223 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡱ queue_depth=2162 I1117 09:43:40.269359 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡲ queue_depth=2163 I1117 09:43:40.269493 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡳ queue_depth=2164 I1117 09:43:40.269625 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡴ queue_depth=2165 I1117 09:43:40.269765 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡵ queue_depth=2166 I1117 09:43:40.269902 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡶ queue_depth=2167 I1117 09:43:40.270053 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡷ queue_depth=2168 I1117 09:43:40.270189 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡸ queue_depth=2169 I1117 09:43:40.270322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡹ queue_depth=2170 I1117 09:43:40.270458 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡺ queue_depth=2171 I1117 09:43:40.270593 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡻ queue_depth=2172 I1117 09:43:40.270731 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡼ queue_depth=2173 I1117 09:43:40.270864 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡽ queue_depth=2174 I1117 09:43:40.271000 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡾ queue_depth=2175 I1117 09:43:40.271134 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࡿ queue_depth=2176 I1117 09:43:40.271268 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢀ queue_depth=2177 I1117 09:43:40.271404 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢁ queue_depth=2178 I1117 09:43:40.271538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢂ queue_depth=2179 I1117 09:43:40.271672 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢃ queue_depth=2180 I1117 09:43:40.271805 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢄ queue_depth=2181 I1117 09:43:40.271938 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢅ queue_depth=2182 I1117 09:43:40.272070 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢆ queue_depth=2183 I1117 09:43:40.272204 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢇ queue_depth=2184 I1117 09:43:40.272360 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢈ queue_depth=2185 I1117 09:43:40.272497 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢉ queue_depth=2186 I1117 09:43:40.272633 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢊ queue_depth=2187 I1117 09:43:40.272770 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢋ queue_depth=2188 I1117 09:43:40.272906 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢌ queue_depth=2189 I1117 09:43:40.273060 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢍ queue_depth=2190 I1117 09:43:40.273196 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢎ queue_depth=2191 I1117 09:43:40.273328 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢏ queue_depth=2192 I1117 09:43:40.273461 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢐ queue_depth=2193 I1117 09:43:40.273596 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢑ queue_depth=2194 I1117 09:43:40.273730 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢒ queue_depth=2195 I1117 09:43:40.273867 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢓ queue_depth=2196 I1117 09:43:40.273999 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢔ queue_depth=2197 I1117 09:43:40.274135 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢕ queue_depth=2198 I1117 09:43:40.274270 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢖ queue_depth=2199 I1117 09:43:40.274404 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢗ queue_depth=2200 I1117 09:43:40.274542 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢘ queue_depth=2201 I1117 09:43:40.274676 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢙ queue_depth=2202 I1117 09:43:40.274812 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢚ queue_depth=2203 I1117 09:43:40.274990 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢛ queue_depth=2204 I1117 09:43:40.275124 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢜ queue_depth=2205 I1117 09:43:40.275258 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢝ queue_depth=2206 I1117 09:43:40.275393 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢞ queue_depth=2207 I1117 09:43:40.275524 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࢟ queue_depth=2208 I1117 09:43:40.275661 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢠ queue_depth=2209 I1117 09:43:40.275797 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢡ queue_depth=2210 I1117 09:43:40.275929 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢢ queue_depth=2211 I1117 09:43:40.276063 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢣ queue_depth=2212 I1117 09:43:40.276197 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢤ queue_depth=2213 I1117 09:43:40.276336 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢥ queue_depth=2214 I1117 09:43:40.276480 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢦ queue_depth=2215 I1117 09:43:40.276629 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢧ queue_depth=2216 I1117 09:43:40.276762 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢨ queue_depth=2217 I1117 09:43:40.276919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢩ queue_depth=2218 I1117 09:43:40.277058 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢪ queue_depth=2219 I1117 09:43:40.277194 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢫ queue_depth=2220 I1117 09:43:40.277331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢬ queue_depth=2221 I1117 09:43:40.277464 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢭ queue_depth=2222 I1117 09:43:40.277598 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢮ queue_depth=2223 I1117 09:43:40.277731 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢯ queue_depth=2224 I1117 09:43:40.277866 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢰ queue_depth=2225 I1117 09:43:40.277999 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢱ queue_depth=2226 I1117 09:43:40.278146 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢲ queue_depth=2227 I1117 09:43:40.278282 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢳ queue_depth=2228 I1117 09:43:40.278413 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢴ queue_depth=2229 I1117 09:43:40.278546 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢵ queue_depth=2230 I1117 09:43:40.278681 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢶ queue_depth=2231 I1117 09:43:40.278814 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢷ queue_depth=2232 I1117 09:43:40.278949 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢸ queue_depth=2233 I1117 09:43:40.279081 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢹ queue_depth=2234 I1117 09:43:40.279214 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢺ queue_depth=2235 I1117 09:43:40.279348 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢻ queue_depth=2236 I1117 09:43:40.279486 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢼ queue_depth=2237 I1117 09:43:40.279618 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢽ queue_depth=2238 I1117 09:43:40.279757 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢾ queue_depth=2239 I1117 09:43:40.279897 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࢿ queue_depth=2240 I1117 09:43:40.280029 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣀ queue_depth=2241 I1117 09:43:40.280162 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣁ queue_depth=2242 I1117 09:43:40.280296 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣂ queue_depth=2243 I1117 09:43:40.280430 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣃ queue_depth=2244 I1117 09:43:40.280562 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣄ queue_depth=2245 I1117 09:43:40.280697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣅ queue_depth=2246 I1117 09:43:40.280832 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣆ queue_depth=2247 I1117 09:43:40.280963 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣇ queue_depth=2248 I1117 09:43:40.281107 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣈ queue_depth=2249 I1117 09:43:40.281241 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣉ queue_depth=2250 I1117 09:43:40.281412 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣊ queue_depth=2251 I1117 09:43:40.281559 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣋ queue_depth=2252 I1117 09:43:40.281693 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣌ queue_depth=2253 I1117 09:43:40.281824 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣍ queue_depth=2254 I1117 09:43:40.281958 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣎ queue_depth=2255 I1117 09:43:40.282093 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣏ queue_depth=2256 I1117 09:43:40.282227 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣐ queue_depth=2257 I1117 09:43:40.282362 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣑ queue_depth=2258 I1117 09:43:40.282494 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣒ queue_depth=2259 I1117 09:43:40.282628 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣓ queue_depth=2260 I1117 09:43:40.282763 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣔ queue_depth=2261 I1117 09:43:40.282898 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣕ queue_depth=2262 I1117 09:43:40.283030 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣖ queue_depth=2263 I1117 09:43:40.283173 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣗ queue_depth=2264 I1117 09:43:40.283308 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣘ queue_depth=2265 I1117 09:43:40.283443 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣙ queue_depth=2266 I1117 09:43:40.283579 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣚ queue_depth=2267 I1117 09:43:40.283716 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣛ queue_depth=2268 I1117 09:43:40.283849 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣜ queue_depth=2269 I1117 09:43:40.283982 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣝ queue_depth=2270 I1117 09:43:40.284113 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣞ queue_depth=2271 I1117 09:43:40.284250 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣟ queue_depth=2272 I1117 09:43:40.284394 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣠ queue_depth=2273 I1117 09:43:40.284528 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣡ queue_depth=2274 I1117 09:43:40.284663 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣢ queue_depth=2275 I1117 09:43:40.284797 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣣ queue_depth=2276 I1117 09:43:40.284935 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣤ queue_depth=2277 I1117 09:43:40.285068 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣥ queue_depth=2278 I1117 09:43:40.285203 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣦ queue_depth=2279 I1117 09:43:40.285334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣧ queue_depth=2280 I1117 09:43:40.285471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣨ queue_depth=2281 I1117 09:43:40.285605 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣩ queue_depth=2282 I1117 09:43:40.285743 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣪ queue_depth=2283 I1117 09:43:40.285898 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣫ queue_depth=2284 I1117 09:43:40.286040 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣬ queue_depth=2285 I1117 09:43:40.286177 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣭ queue_depth=2286 I1117 09:43:40.286314 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣮ queue_depth=2287 I1117 09:43:40.286457 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࣯ queue_depth=2288 I1117 09:43:40.286593 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣰ queue_depth=2289 I1117 09:43:40.286727 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣱ queue_depth=2290 I1117 09:43:40.286859 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣲ queue_depth=2291 I1117 09:43:40.286991 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣳ queue_depth=2292 I1117 09:43:40.287127 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣴ queue_depth=2293 I1117 09:43:40.287261 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣵ queue_depth=2294 I1117 09:43:40.287399 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣶ queue_depth=2295 I1117 09:43:40.287534 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣷ queue_depth=2296 I1117 09:43:40.287669 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣸ queue_depth=2297 I1117 09:43:40.287802 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣹ queue_depth=2298 I1117 09:43:40.287933 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣺ queue_depth=2299 I1117 09:43:40.288067 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣻ queue_depth=2300 I1117 09:43:40.288199 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣼ queue_depth=2301 I1117 09:43:40.288334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣽ queue_depth=2302 I1117 09:43:40.288469 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣾ queue_depth=2303 I1117 09:43:40.288601 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ࣿ queue_depth=2304 I1117 09:43:40.288749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऀ queue_depth=2305 I1117 09:43:40.288888 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ँ queue_depth=2306 I1117 09:43:40.289023 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ं queue_depth=2307 I1117 09:43:40.289155 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ः queue_depth=2308 I1117 09:43:40.289286 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऄ queue_depth=2309 I1117 09:43:40.289421 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=अ queue_depth=2310 I1117 09:43:40.289556 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=आ queue_depth=2311 I1117 09:43:40.289688 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=इ queue_depth=2312 I1117 09:43:40.289841 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ई queue_depth=2313 I1117 09:43:40.289978 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=उ queue_depth=2314 I1117 09:43:40.290113 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऊ queue_depth=2315 I1117 09:43:40.290247 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऋ queue_depth=2316 I1117 09:43:40.290404 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऌ queue_depth=2317 I1117 09:43:40.290542 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऍ queue_depth=2318 I1117 09:43:40.290675 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऎ queue_depth=2319 I1117 09:43:40.290808 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ए queue_depth=2320 I1117 09:43:40.290940 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऐ queue_depth=2321 I1117 09:43:40.291085 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऑ queue_depth=2322 I1117 09:43:40.291232 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऒ queue_depth=2323 I1117 09:43:40.291365 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ओ queue_depth=2324 I1117 09:43:40.291501 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=औ queue_depth=2325 I1117 09:43:40.291637 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=क queue_depth=2326 I1117 09:43:40.291774 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ख queue_depth=2327 I1117 09:43:40.291908 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ग queue_depth=2328 I1117 09:43:40.292040 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=घ queue_depth=2329 I1117 09:43:40.292176 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ङ queue_depth=2330 I1117 09:43:40.292312 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=च queue_depth=2331 I1117 09:43:40.292446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=छ queue_depth=2332 I1117 09:43:40.292580 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ज queue_depth=2333 I1117 09:43:40.292714 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=झ queue_depth=2334 I1117 09:43:40.292850 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ञ queue_depth=2335 I1117 09:43:40.292983 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ट queue_depth=2336 I1117 09:43:40.293124 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ठ queue_depth=2337 I1117 09:43:40.293260 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ड queue_depth=2338 I1117 09:43:40.293393 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ढ queue_depth=2339 I1117 09:43:40.293530 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ण queue_depth=2340 I1117 09:43:40.293668 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=त queue_depth=2341 I1117 09:43:40.293800 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=थ queue_depth=2342 I1117 09:43:40.293934 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=द queue_depth=2343 I1117 09:43:40.294066 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ध queue_depth=2344 I1117 09:43:40.294202 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=न queue_depth=2345 I1117 09:43:40.294352 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऩ queue_depth=2346 I1117 09:43:40.294488 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=प queue_depth=2347 I1117 09:43:40.294622 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=फ queue_depth=2348 I1117 09:43:40.294753 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ब queue_depth=2349 I1117 09:43:40.294908 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=भ queue_depth=2350 I1117 09:43:40.295087 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=म queue_depth=2351 I1117 09:43:40.295223 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=य queue_depth=2352 I1117 09:43:40.295356 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=र queue_depth=2353 I1117 09:43:40.295488 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऱ queue_depth=2354 I1117 09:43:40.295621 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ल queue_depth=2355 I1117 09:43:40.295758 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ळ queue_depth=2356 I1117 09:43:40.295891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऴ queue_depth=2357 I1117 09:43:40.296024 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=व queue_depth=2358 I1117 09:43:40.296157 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=श queue_depth=2359 I1117 09:43:40.296291 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ष queue_depth=2360 I1117 09:43:40.296434 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=स queue_depth=2361 I1117 09:43:40.296572 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ह queue_depth=2362 I1117 09:43:40.296706 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऺ queue_depth=2363 I1117 09:43:40.296844 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऻ queue_depth=2364 I1117 09:43:40.296984 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=़ queue_depth=2365 I1117 09:43:40.297135 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ऽ queue_depth=2366 I1117 09:43:40.297273 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ा queue_depth=2367 I1117 09:43:40.297407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ि queue_depth=2368 I1117 09:43:40.297540 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ी queue_depth=2369 I1117 09:43:40.297673 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ु queue_depth=2370 I1117 09:43:40.297809 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ू queue_depth=2371 I1117 09:43:40.297940 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ृ queue_depth=2372 I1117 09:43:40.298073 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॄ queue_depth=2373 I1117 09:43:40.298207 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॅ queue_depth=2374 I1117 09:43:40.298340 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॆ queue_depth=2375 I1117 09:43:40.298471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=े queue_depth=2376 I1117 09:43:40.298607 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ै queue_depth=2377 I1117 09:43:40.298738 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॉ queue_depth=2378 I1117 09:43:40.298874 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॊ queue_depth=2379 I1117 09:43:40.299008 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ो queue_depth=2380 I1117 09:43:40.299139 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ौ queue_depth=2381 I1117 09:43:40.299271 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=् queue_depth=2382 I1117 09:43:40.299429 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॎ queue_depth=2383 I1117 09:43:40.299577 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॏ queue_depth=2384 I1117 09:43:40.299712 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॐ queue_depth=2385 I1117 09:43:40.299856 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=॑ queue_depth=2386 I1117 09:43:40.299989 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=॒ queue_depth=2387 I1117 09:43:40.300138 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=॓ queue_depth=2388 I1117 09:43:40.300282 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=॔ queue_depth=2389 I1117 09:43:40.300418 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॕ queue_depth=2390 I1117 09:43:40.300550 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॖ queue_depth=2391 I1117 09:43:40.300683 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॗ queue_depth=2392 I1117 09:43:40.300817 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=क़ queue_depth=2393 I1117 09:43:40.300953 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ख़ queue_depth=2394 I1117 09:43:40.301087 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ग़ queue_depth=2395 I1117 09:43:40.301220 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ज़ queue_depth=2396 I1117 09:43:40.301353 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ड़ queue_depth=2397 I1117 09:43:40.301486 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ढ़ queue_depth=2398 I1117 09:43:40.301619 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=फ़ queue_depth=2399 I1117 09:43:40.301752 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=य़ queue_depth=2400 I1117 09:43:40.301886 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॠ queue_depth=2401 I1117 09:43:40.302018 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॡ queue_depth=2402 I1117 09:43:40.302151 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॢ queue_depth=2403 I1117 09:43:40.302287 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॣ queue_depth=2404 I1117 09:43:40.302421 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=। queue_depth=2405 I1117 09:43:40.302555 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=॥ queue_depth=2406 I1117 09:43:40.302688 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=० queue_depth=2407 I1117 09:43:40.302824 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=१ queue_depth=2408 I1117 09:43:40.302957 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=२ queue_depth=2409 I1117 09:43:40.303097 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=३ queue_depth=2410 I1117 09:43:40.303237 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=४ queue_depth=2411 I1117 09:43:40.303375 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=५ queue_depth=2412 I1117 09:43:40.303507 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=६ queue_depth=2413 I1117 09:43:40.303639 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=७ queue_depth=2414 I1117 09:43:40.303771 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=८ queue_depth=2415 I1117 09:43:40.303927 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=९ queue_depth=2416 I1117 09:43:40.304062 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=॰ queue_depth=2417 I1117 09:43:40.304196 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॱ queue_depth=2418 I1117 09:43:40.304329 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॲ queue_depth=2419 I1117 09:43:40.304464 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॳ queue_depth=2420 I1117 09:43:40.304603 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॴ queue_depth=2421 I1117 09:43:40.304739 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॵ queue_depth=2422 I1117 09:43:40.304872 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॶ queue_depth=2423 I1117 09:43:40.305004 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॷ queue_depth=2424 I1117 09:43:40.305136 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॸ queue_depth=2425 I1117 09:43:40.305275 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॹ queue_depth=2426 I1117 09:43:40.305407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॺ queue_depth=2427 I1117 09:43:40.305543 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॻ queue_depth=2428 I1117 09:43:40.305682 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॼ queue_depth=2429 I1117 09:43:40.305815 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॽ queue_depth=2430 I1117 09:43:40.305948 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॾ queue_depth=2431 I1117 09:43:40.306083 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ॿ queue_depth=2432 I1117 09:43:40.306229 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঀ queue_depth=2433 I1117 09:43:40.306363 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঁ queue_depth=2434 I1117 09:43:40.306515 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ং queue_depth=2435 I1117 09:43:40.306648 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঃ queue_depth=2436 I1117 09:43:40.306783 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঄ queue_depth=2437 I1117 09:43:40.306919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=অ queue_depth=2438 I1117 09:43:40.307053 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=আ queue_depth=2439 I1117 09:43:40.307185 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ই queue_depth=2440 I1117 09:43:40.307323 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঈ queue_depth=2441 I1117 09:43:40.307455 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=উ queue_depth=2442 I1117 09:43:40.307595 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঊ queue_depth=2443 I1117 09:43:40.307731 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঋ queue_depth=2444 I1117 09:43:40.307863 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঌ queue_depth=2445 I1117 09:43:40.307999 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঍ queue_depth=2446 I1117 09:43:40.308135 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঎ queue_depth=2447 I1117 09:43:40.308268 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=এ queue_depth=2448 I1117 09:43:40.308423 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঐ queue_depth=2449 I1117 09:43:40.308566 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঑ queue_depth=2450 I1117 09:43:40.308699 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঒ queue_depth=2451 I1117 09:43:40.308832 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ও queue_depth=2452 I1117 09:43:40.308964 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঔ queue_depth=2453 I1117 09:43:40.309097 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ক queue_depth=2454 I1117 09:43:40.309245 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=খ queue_depth=2455 I1117 09:43:40.309378 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=গ queue_depth=2456 I1117 09:43:40.309515 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঘ queue_depth=2457 I1117 09:43:40.309647 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঙ queue_depth=2458 I1117 09:43:40.309786 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=চ queue_depth=2459 I1117 09:43:40.309919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ছ queue_depth=2460 I1117 09:43:40.310064 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=জ queue_depth=2461 I1117 09:43:40.310200 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঝ queue_depth=2462 I1117 09:43:40.310331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঞ queue_depth=2463 I1117 09:43:40.310467 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ট queue_depth=2464 I1117 09:43:40.310598 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঠ queue_depth=2465 I1117 09:43:40.310730 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ড queue_depth=2466 I1117 09:43:40.310865 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঢ queue_depth=2467 I1117 09:43:40.311003 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ণ queue_depth=2468 I1117 09:43:40.311137 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ত queue_depth=2469 I1117 09:43:40.311271 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=থ queue_depth=2470 I1117 09:43:40.311406 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=দ queue_depth=2471 I1117 09:43:40.311538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ধ queue_depth=2472 I1117 09:43:40.311675 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ন queue_depth=2473 I1117 09:43:40.311806 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঩ queue_depth=2474 I1117 09:43:40.311941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=প queue_depth=2475 I1117 09:43:40.312074 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ফ queue_depth=2476 I1117 09:43:40.312207 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ব queue_depth=2477 I1117 09:43:40.312345 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ভ queue_depth=2478 I1117 09:43:40.312478 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ম queue_depth=2479 I1117 09:43:40.312611 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=য queue_depth=2480 I1117 09:43:40.312756 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=র queue_depth=2481 I1117 09:43:40.312915 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঱ queue_depth=2482 I1117 09:43:40.313057 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ল queue_depth=2483 I1117 09:43:40.313193 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঳ queue_depth=2484 I1117 09:43:40.313328 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঴ queue_depth=2485 I1117 09:43:40.313461 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঵ queue_depth=2486 I1117 09:43:40.313594 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=শ queue_depth=2487 I1117 09:43:40.313729 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ষ queue_depth=2488 I1117 09:43:40.313866 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=স queue_depth=2489 I1117 09:43:40.314000 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=হ queue_depth=2490 I1117 09:43:40.314134 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঺ queue_depth=2491 I1117 09:43:40.314271 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=঻ queue_depth=2492 I1117 09:43:40.314405 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=় queue_depth=2493 I1117 09:43:40.314539 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঽ queue_depth=2494 I1117 09:43:40.314672 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=া queue_depth=2495 I1117 09:43:40.314806 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ি queue_depth=2496 I1117 09:43:40.314942 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ী queue_depth=2497 I1117 09:43:40.315075 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ু queue_depth=2498 I1117 09:43:40.315252 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ূ queue_depth=2499 I1117 09:43:40.315388 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৃ queue_depth=2500 I1117 09:43:40.315522 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৄ queue_depth=2501 I1117 09:43:40.315656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৅ queue_depth=2502 I1117 09:43:40.315790 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৆ queue_depth=2503 I1117 09:43:40.315925 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ে queue_depth=2504 I1117 09:43:40.316061 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৈ queue_depth=2505 I1117 09:43:40.316195 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৉ queue_depth=2506 I1117 09:43:40.316329 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৊ queue_depth=2507 I1117 09:43:40.316471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ো queue_depth=2508 I1117 09:43:40.316604 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৌ queue_depth=2509 I1117 09:43:40.316736 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=্ queue_depth=2510 I1117 09:43:40.316867 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৎ queue_depth=2511 I1117 09:43:40.317002 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৏ queue_depth=2512 I1117 09:43:40.317136 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৐ queue_depth=2513 I1117 09:43:40.317268 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৑ queue_depth=2514 I1117 09:43:40.317425 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৒ queue_depth=2515 I1117 09:43:40.317562 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৓ queue_depth=2516 I1117 09:43:40.317696 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৔ queue_depth=2517 I1117 09:43:40.317831 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৕ queue_depth=2518 I1117 09:43:40.317962 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৖ queue_depth=2519 I1117 09:43:40.318094 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৗ queue_depth=2520 I1117 09:43:40.318239 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৘ queue_depth=2521 I1117 09:43:40.318377 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৙ queue_depth=2522 I1117 09:43:40.318517 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৚ queue_depth=2523 I1117 09:43:40.318653 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৛ queue_depth=2524 I1117 09:43:40.318788 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ড় queue_depth=2525 I1117 09:43:40.318926 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ঢ় queue_depth=2526 I1117 09:43:40.319064 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৞ queue_depth=2527 I1117 09:43:40.319198 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=য় queue_depth=2528 I1117 09:43:40.319333 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৠ queue_depth=2529 I1117 09:43:40.319481 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৡ queue_depth=2530 I1117 09:43:40.319614 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৢ queue_depth=2531 I1117 09:43:40.319769 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৣ queue_depth=2532 I1117 09:43:40.319910 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৤ queue_depth=2533 I1117 09:43:40.320046 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৥ queue_depth=2534 I1117 09:43:40.320180 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=০ queue_depth=2535 I1117 09:43:40.320314 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=১ queue_depth=2536 I1117 09:43:40.320446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=২ queue_depth=2537 I1117 09:43:40.320577 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৩ queue_depth=2538 I1117 09:43:40.320711 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৪ queue_depth=2539 I1117 09:43:40.320843 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৫ queue_depth=2540 I1117 09:43:40.320983 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৬ queue_depth=2541 I1117 09:43:40.321116 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৭ queue_depth=2542 I1117 09:43:40.321249 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৮ queue_depth=2543 I1117 09:43:40.321383 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৯ queue_depth=2544 I1117 09:43:40.321516 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৰ queue_depth=2545 I1117 09:43:40.321652 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৱ queue_depth=2546 I1117 09:43:40.321801 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৲ queue_depth=2547 I1117 09:43:40.321955 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৳ queue_depth=2548 I1117 09:43:40.322093 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৴ queue_depth=2549 I1117 09:43:40.322226 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৵ queue_depth=2550 I1117 09:43:40.322359 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৶ queue_depth=2551 I1117 09:43:40.322496 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৷ queue_depth=2552 I1117 09:43:40.322631 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৸ queue_depth=2553 I1117 09:43:40.322767 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৹ queue_depth=2554 I1117 09:43:40.322901 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৺ queue_depth=2555 I1117 09:43:40.323034 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৻ queue_depth=2556 I1117 09:43:40.323176 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ৼ queue_depth=2557 I1117 09:43:40.323307 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৽ queue_depth=2558 I1117 09:43:40.323443 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৾ queue_depth=2559 I1117 09:43:40.323574 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=৿ queue_depth=2560 I1117 09:43:40.323710 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਀ queue_depth=2561 I1117 09:43:40.323844 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਁ queue_depth=2562 I1117 09:43:40.323977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਂ queue_depth=2563 I1117 09:43:40.324110 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਃ queue_depth=2564 I1117 09:43:40.324242 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਄ queue_depth=2565 I1117 09:43:40.324374 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਅ queue_depth=2566 I1117 09:43:40.324511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਆ queue_depth=2567 I1117 09:43:40.324644 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਇ queue_depth=2568 I1117 09:43:40.324778 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਈ queue_depth=2569 I1117 09:43:40.324910 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਉ queue_depth=2570 I1117 09:43:40.325044 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਊ queue_depth=2571 I1117 09:43:40.325177 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਋ queue_depth=2572 I1117 09:43:40.325310 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਌ queue_depth=2573 I1117 09:43:40.325444 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਍ queue_depth=2574 I1117 09:43:40.325579 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਎ queue_depth=2575 I1117 09:43:40.325712 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਏ queue_depth=2576 I1117 09:43:40.325845 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਐ queue_depth=2577 I1117 09:43:40.325977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਑ queue_depth=2578 I1117 09:43:40.326111 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਒ queue_depth=2579 I1117 09:43:40.326245 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਓ queue_depth=2580 I1117 09:43:40.326407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਔ queue_depth=2581 I1117 09:43:40.326543 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਕ queue_depth=2582 I1117 09:43:40.326679 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਖ queue_depth=2583 I1117 09:43:40.326812 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਗ queue_depth=2584 I1117 09:43:40.326944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਘ queue_depth=2585 I1117 09:43:40.327076 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਙ queue_depth=2586 I1117 09:43:40.327215 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਚ queue_depth=2587 I1117 09:43:40.327364 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਛ queue_depth=2588 I1117 09:43:40.327512 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਜ queue_depth=2589 I1117 09:43:40.327646 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਝ queue_depth=2590 I1117 09:43:40.327781 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਞ queue_depth=2591 I1117 09:43:40.327918 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਟ queue_depth=2592 I1117 09:43:40.328064 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਠ queue_depth=2593 I1117 09:43:40.328209 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਡ queue_depth=2594 I1117 09:43:40.328344 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਢ queue_depth=2595 I1117 09:43:40.328476 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਣ queue_depth=2596 I1117 09:43:40.328608 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਤ queue_depth=2597 I1117 09:43:40.328741 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਥ queue_depth=2598 I1117 09:43:40.328876 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਦ queue_depth=2599 I1117 09:43:40.329011 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਧ queue_depth=2600 I1117 09:43:40.329143 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਨ queue_depth=2601 I1117 09:43:40.329279 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਩ queue_depth=2602 I1117 09:43:40.329411 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਪ queue_depth=2603 I1117 09:43:40.329545 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਫ queue_depth=2604 I1117 09:43:40.329681 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਬ queue_depth=2605 I1117 09:43:40.329833 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਭ queue_depth=2606 I1117 09:43:40.329966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਮ queue_depth=2607 I1117 09:43:40.330096 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਯ queue_depth=2608 I1117 09:43:40.330229 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਰ queue_depth=2609 I1117 09:43:40.330362 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਱ queue_depth=2610 I1117 09:43:40.330497 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਲ queue_depth=2611 I1117 09:43:40.330629 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਲ਼ queue_depth=2612 I1117 09:43:40.330767 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਴ queue_depth=2613 I1117 09:43:40.330954 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਵ queue_depth=2614 I1117 09:43:40.331089 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਸ਼ queue_depth=2615 I1117 09:43:40.331228 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਷ queue_depth=2616 I1117 09:43:40.331362 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਸ queue_depth=2617 I1117 09:43:40.331498 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਹ queue_depth=2618 I1117 09:43:40.331630 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਺ queue_depth=2619 I1117 09:43:40.331765 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਻ queue_depth=2620 I1117 09:43:40.331900 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਼ queue_depth=2621 I1117 09:43:40.332034 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=਽ queue_depth=2622 I1117 09:43:40.332165 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਾ queue_depth=2623 I1117 09:43:40.332298 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਿ queue_depth=2624 I1117 09:43:40.332446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੀ queue_depth=2625 I1117 09:43:40.332585 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੁ queue_depth=2626 I1117 09:43:40.332720 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੂ queue_depth=2627 I1117 09:43:40.332855 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੃ queue_depth=2628 I1117 09:43:40.332988 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੄ queue_depth=2629 I1117 09:43:40.333131 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੅ queue_depth=2630 I1117 09:43:40.333268 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੆ queue_depth=2631 I1117 09:43:40.333401 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੇ queue_depth=2632 I1117 09:43:40.333534 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੈ queue_depth=2633 I1117 09:43:40.333671 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੉ queue_depth=2634 I1117 09:43:40.333803 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੊ queue_depth=2635 I1117 09:43:40.333951 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੋ queue_depth=2636 I1117 09:43:40.334083 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੌ queue_depth=2637 I1117 09:43:40.334217 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੍ queue_depth=2638 I1117 09:43:40.334353 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੎ queue_depth=2639 I1117 09:43:40.334484 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੏ queue_depth=2640 I1117 09:43:40.334619 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੐ queue_depth=2641 I1117 09:43:40.334754 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੑ queue_depth=2642 I1117 09:43:40.334888 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੒ queue_depth=2643 I1117 09:43:40.335023 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੓ queue_depth=2644 I1117 09:43:40.335156 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੔ queue_depth=2645 I1117 09:43:40.335389 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੕ queue_depth=2646 I1117 09:43:40.335561 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੖ queue_depth=2647 I1117 09:43:40.335697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੗ queue_depth=2648 I1117 09:43:40.335833 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੘ queue_depth=2649 I1117 09:43:40.335967 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਖ਼ queue_depth=2650 I1117 09:43:40.336100 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਗ਼ queue_depth=2651 I1117 09:43:40.336233 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਜ਼ queue_depth=2652 I1117 09:43:40.336370 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੜ queue_depth=2653 I1117 09:43:40.336511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੝ queue_depth=2654 I1117 09:43:40.336647 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ਫ਼ queue_depth=2655 I1117 09:43:40.336780 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੟ queue_depth=2656 I1117 09:43:40.336918 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੠ queue_depth=2657 I1117 09:43:40.337053 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੡ queue_depth=2658 I1117 09:43:40.337190 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੢ queue_depth=2659 I1117 09:43:40.337323 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੣ queue_depth=2660 I1117 09:43:40.337460 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੤ queue_depth=2661 I1117 09:43:40.337595 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੥ queue_depth=2662 I1117 09:43:40.337728 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੦ queue_depth=2663 I1117 09:43:40.337860 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੧ queue_depth=2664 I1117 09:43:40.337998 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੨ queue_depth=2665 I1117 09:43:40.338132 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੩ queue_depth=2666 I1117 09:43:40.338265 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੪ queue_depth=2667 I1117 09:43:40.338398 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੫ queue_depth=2668 I1117 09:43:40.338535 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੬ queue_depth=2669 I1117 09:43:40.338667 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੭ queue_depth=2670 I1117 09:43:40.338801 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੮ queue_depth=2671 I1117 09:43:40.338935 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੯ queue_depth=2672 I1117 09:43:40.339067 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੰ queue_depth=2673 I1117 09:43:40.339203 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੱ queue_depth=2674 I1117 09:43:40.339336 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੲ queue_depth=2675 I1117 09:43:40.339480 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੳ queue_depth=2676 I1117 09:43:40.339615 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੴ queue_depth=2677 I1117 09:43:40.339754 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ੵ queue_depth=2678 I1117 09:43:40.339890 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੶ queue_depth=2679 I1117 09:43:40.340047 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੷ queue_depth=2680 I1117 09:43:40.340184 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੸ queue_depth=2681 I1117 09:43:40.340333 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੹ queue_depth=2682 I1117 09:43:40.340468 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੺ queue_depth=2683 I1117 09:43:40.340608 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੻ queue_depth=2684 I1117 09:43:40.340743 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੼ queue_depth=2685 I1117 09:43:40.340890 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੽ queue_depth=2686 I1117 09:43:40.341035 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੾ queue_depth=2687 I1117 09:43:40.341169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=੿ queue_depth=2688 I1117 09:43:40.341301 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઀ queue_depth=2689 I1117 09:43:40.341435 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઁ queue_depth=2690 I1117 09:43:40.341569 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ં queue_depth=2691 I1117 09:43:40.341702 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઃ queue_depth=2692 I1117 09:43:40.341837 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઄ queue_depth=2693 I1117 09:43:40.341970 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=અ queue_depth=2694 I1117 09:43:40.342104 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=આ queue_depth=2695 I1117 09:43:40.342237 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઇ queue_depth=2696 I1117 09:43:40.342376 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઈ queue_depth=2697 I1117 09:43:40.342511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઉ queue_depth=2698 I1117 09:43:40.342657 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઊ queue_depth=2699 I1117 09:43:40.342790 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઋ queue_depth=2700 I1117 09:43:40.342927 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઌ queue_depth=2701 I1117 09:43:40.343070 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઍ queue_depth=2702 I1117 09:43:40.343206 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઎ queue_depth=2703 I1117 09:43:40.343339 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=એ queue_depth=2704 I1117 09:43:40.343471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઐ queue_depth=2705 I1117 09:43:40.343602 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઑ queue_depth=2706 I1117 09:43:40.343739 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઒ queue_depth=2707 I1117 09:43:40.343873 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઓ queue_depth=2708 I1117 09:43:40.344006 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઔ queue_depth=2709 I1117 09:43:40.344141 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ક queue_depth=2710 I1117 09:43:40.344276 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ખ queue_depth=2711 I1117 09:43:40.344407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ગ queue_depth=2712 I1117 09:43:40.344565 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઘ queue_depth=2713 I1117 09:43:40.344699 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઙ queue_depth=2714 I1117 09:43:40.344833 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ચ queue_depth=2715 I1117 09:43:40.344965 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=છ queue_depth=2716 I1117 09:43:40.345102 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=જ queue_depth=2717 I1117 09:43:40.345236 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઝ queue_depth=2718 I1117 09:43:40.345371 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઞ queue_depth=2719 I1117 09:43:40.345506 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ટ queue_depth=2720 I1117 09:43:40.345641 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઠ queue_depth=2721 I1117 09:43:40.345776 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ડ queue_depth=2722 I1117 09:43:40.345914 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઢ queue_depth=2723 I1117 09:43:40.346047 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ણ queue_depth=2724 I1117 09:43:40.346178 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ત queue_depth=2725 I1117 09:43:40.346312 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=થ queue_depth=2726 I1117 09:43:40.346463 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=દ queue_depth=2727 I1117 09:43:40.346600 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ધ queue_depth=2728 I1117 09:43:40.346733 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ન queue_depth=2729 I1117 09:43:40.346864 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઩ queue_depth=2730 I1117 09:43:40.346997 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=પ queue_depth=2731 I1117 09:43:40.347133 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ફ queue_depth=2732 I1117 09:43:40.347277 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=બ queue_depth=2733 I1117 09:43:40.347428 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ભ queue_depth=2734 I1117 09:43:40.347565 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=મ queue_depth=2735 I1117 09:43:40.347701 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ય queue_depth=2736 I1117 09:43:40.347835 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ર queue_depth=2737 I1117 09:43:40.347979 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઱ queue_depth=2738 I1117 09:43:40.348120 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=લ queue_depth=2739 I1117 09:43:40.348255 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ળ queue_depth=2740 I1117 09:43:40.348392 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઴ queue_depth=2741 I1117 09:43:40.348526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=વ queue_depth=2742 I1117 09:43:40.348658 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=શ queue_depth=2743 I1117 09:43:40.348789 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ષ queue_depth=2744 I1117 09:43:40.348921 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=સ queue_depth=2745 I1117 09:43:40.349078 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=હ queue_depth=2746 I1117 09:43:40.349214 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઺ queue_depth=2747 I1117 09:43:40.349346 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઻ queue_depth=2748 I1117 09:43:40.349478 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=઼ queue_depth=2749 I1117 09:43:40.349611 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ઽ queue_depth=2750 I1117 09:43:40.349765 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ા queue_depth=2751 I1117 09:43:40.349901 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=િ queue_depth=2752 I1117 09:43:40.350035 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ી queue_depth=2753 I1117 09:43:40.350174 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ુ queue_depth=2754 I1117 09:43:40.350312 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૂ queue_depth=2755 I1117 09:43:40.350445 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૃ queue_depth=2756 I1117 09:43:40.350580 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૄ queue_depth=2757 I1117 09:43:40.350717 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૅ queue_depth=2758 I1117 09:43:40.350849 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૆ queue_depth=2759 I1117 09:43:40.350985 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ે queue_depth=2760 I1117 09:43:40.351118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૈ queue_depth=2761 I1117 09:43:40.351255 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૉ queue_depth=2762 I1117 09:43:40.351400 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૊ queue_depth=2763 I1117 09:43:40.351533 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ો queue_depth=2764 I1117 09:43:40.351667 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૌ queue_depth=2765 I1117 09:43:40.351803 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=્ queue_depth=2766 I1117 09:43:40.351936 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૎ queue_depth=2767 I1117 09:43:40.352074 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૏ queue_depth=2768 I1117 09:43:40.352220 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૐ queue_depth=2769 I1117 09:43:40.352352 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૑ queue_depth=2770 I1117 09:43:40.352488 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૒ queue_depth=2771 I1117 09:43:40.352622 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૓ queue_depth=2772 I1117 09:43:40.352758 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૔ queue_depth=2773 I1117 09:43:40.352890 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૕ queue_depth=2774 I1117 09:43:40.353025 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૖ queue_depth=2775 I1117 09:43:40.353168 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૗ queue_depth=2776 I1117 09:43:40.353304 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૘ queue_depth=2777 I1117 09:43:40.353436 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૙ queue_depth=2778 I1117 09:43:40.353590 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૚ queue_depth=2779 I1117 09:43:40.353728 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૛ queue_depth=2780 I1117 09:43:40.353861 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૜ queue_depth=2781 I1117 09:43:40.353996 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૝ queue_depth=2782 I1117 09:43:40.354130 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૞ queue_depth=2783 I1117 09:43:40.354265 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૟ queue_depth=2784 I1117 09:43:40.354400 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૠ queue_depth=2785 I1117 09:43:40.354536 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૡ queue_depth=2786 I1117 09:43:40.354669 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૢ queue_depth=2787 I1117 09:43:40.354806 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૣ queue_depth=2788 I1117 09:43:40.354942 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૤ queue_depth=2789 I1117 09:43:40.355077 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૥ queue_depth=2790 I1117 09:43:40.355210 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૦ queue_depth=2791 I1117 09:43:40.355341 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૧ queue_depth=2792 I1117 09:43:40.355518 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૨ queue_depth=2793 I1117 09:43:40.355657 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૩ queue_depth=2794 I1117 09:43:40.355796 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૪ queue_depth=2795 I1117 09:43:40.355928 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૫ queue_depth=2796 I1117 09:43:40.356061 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૬ queue_depth=2797 I1117 09:43:40.356199 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૭ queue_depth=2798 I1117 09:43:40.356331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૮ queue_depth=2799 I1117 09:43:40.356475 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૯ queue_depth=2800 I1117 09:43:40.356608 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૰ queue_depth=2801 I1117 09:43:40.356741 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૱ queue_depth=2802 I1117 09:43:40.356876 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૲ queue_depth=2803 I1117 09:43:40.357007 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૳ queue_depth=2804 I1117 09:43:40.357139 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૴ queue_depth=2805 I1117 09:43:40.357272 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૵ queue_depth=2806 I1117 09:43:40.357405 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૶ queue_depth=2807 I1117 09:43:40.357551 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૷ queue_depth=2808 I1117 09:43:40.357685 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૸ queue_depth=2809 I1117 09:43:40.357817 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૹ queue_depth=2810 I1117 09:43:40.357954 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૺ queue_depth=2811 I1117 09:43:40.358110 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૻ queue_depth=2812 I1117 09:43:40.358249 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ૼ queue_depth=2813 I1117 09:43:40.358385 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૽ queue_depth=2814 I1117 09:43:40.358520 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૾ queue_depth=2815 I1117 09:43:40.358656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=૿ queue_depth=2816 I1117 09:43:40.358793 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଀ queue_depth=2817 I1117 09:43:40.358927 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଁ queue_depth=2818 I1117 09:43:40.359061 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଂ queue_depth=2819 I1117 09:43:40.359194 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଃ queue_depth=2820 I1117 09:43:40.359326 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଄ queue_depth=2821 I1117 09:43:40.359459 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଅ queue_depth=2822 I1117 09:43:40.359592 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଆ queue_depth=2823 I1117 09:43:40.359730 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଇ queue_depth=2824 I1117 09:43:40.359879 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଈ queue_depth=2825 I1117 09:43:40.360013 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଉ queue_depth=2826 I1117 09:43:40.360148 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଊ queue_depth=2827 I1117 09:43:40.360280 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଋ queue_depth=2828 I1117 09:43:40.360413 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଌ queue_depth=2829 I1117 09:43:40.360545 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଍ queue_depth=2830 I1117 09:43:40.360679 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଎ queue_depth=2831 I1117 09:43:40.360815 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଏ queue_depth=2832 I1117 09:43:40.360947 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଐ queue_depth=2833 I1117 09:43:40.361078 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଑ queue_depth=2834 I1117 09:43:40.361215 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଒ queue_depth=2835 I1117 09:43:40.361349 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଓ queue_depth=2836 I1117 09:43:40.361497 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଔ queue_depth=2837 I1117 09:43:40.361632 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=କ queue_depth=2838 I1117 09:43:40.361771 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଖ queue_depth=2839 I1117 09:43:40.361903 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଗ queue_depth=2840 I1117 09:43:40.362038 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଘ queue_depth=2841 I1117 09:43:40.362171 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଙ queue_depth=2842 I1117 09:43:40.362304 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଚ queue_depth=2843 I1117 09:43:40.362439 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଛ queue_depth=2844 I1117 09:43:40.362598 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଜ queue_depth=2845 I1117 09:43:40.362739 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଝ queue_depth=2846 I1117 09:43:40.362873 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଞ queue_depth=2847 I1117 09:43:40.363006 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଟ queue_depth=2848 I1117 09:43:40.363148 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଠ queue_depth=2849 I1117 09:43:40.363285 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଡ queue_depth=2850 I1117 09:43:40.363417 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଢ queue_depth=2851 I1117 09:43:40.363550 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଣ queue_depth=2852 I1117 09:43:40.363697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ତ queue_depth=2853 I1117 09:43:40.363843 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଥ queue_depth=2854 I1117 09:43:40.363978 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଦ queue_depth=2855 I1117 09:43:40.364113 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଧ queue_depth=2856 I1117 09:43:40.364250 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ନ queue_depth=2857 I1117 09:43:40.364382 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଩ queue_depth=2858 I1117 09:43:40.364515 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ପ queue_depth=2859 I1117 09:43:40.364651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଫ queue_depth=2860 I1117 09:43:40.364788 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ବ queue_depth=2861 I1117 09:43:40.364923 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଭ queue_depth=2862 I1117 09:43:40.365059 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ମ queue_depth=2863 I1117 09:43:40.365191 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଯ queue_depth=2864 I1117 09:43:40.365324 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ର queue_depth=2865 I1117 09:43:40.365455 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଱ queue_depth=2866 I1117 09:43:40.365589 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଲ queue_depth=2867 I1117 09:43:40.365723 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଳ queue_depth=2868 I1117 09:43:40.365859 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଴ queue_depth=2869 I1117 09:43:40.365994 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଵ queue_depth=2870 I1117 09:43:40.366129 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଶ queue_depth=2871 I1117 09:43:40.366261 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଷ queue_depth=2872 I1117 09:43:40.366398 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ସ queue_depth=2873 I1117 09:43:40.366534 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ହ queue_depth=2874 I1117 09:43:40.366667 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଺ queue_depth=2875 I1117 09:43:40.366797 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଻ queue_depth=2876 I1117 09:43:40.366932 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=଼ queue_depth=2877 I1117 09:43:40.367087 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଽ queue_depth=2878 I1117 09:43:40.367224 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ା queue_depth=2879 I1117 09:43:40.367369 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ି queue_depth=2880 I1117 09:43:40.367505 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୀ queue_depth=2881 I1117 09:43:40.367658 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୁ queue_depth=2882 I1117 09:43:40.367792 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୂ queue_depth=2883 I1117 09:43:40.367926 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୃ queue_depth=2884 I1117 09:43:40.368059 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୄ queue_depth=2885 I1117 09:43:40.368192 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୅ queue_depth=2886 I1117 09:43:40.368328 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୆ queue_depth=2887 I1117 09:43:40.368463 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=େ queue_depth=2888 I1117 09:43:40.368610 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୈ queue_depth=2889 I1117 09:43:40.368748 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୉ queue_depth=2890 I1117 09:43:40.368884 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୊ queue_depth=2891 I1117 09:43:40.369016 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୋ queue_depth=2892 I1117 09:43:40.369151 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୌ queue_depth=2893 I1117 09:43:40.369283 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୍ queue_depth=2894 I1117 09:43:40.369418 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୎ queue_depth=2895 I1117 09:43:40.369550 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୏ queue_depth=2896 I1117 09:43:40.369697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୐ queue_depth=2897 I1117 09:43:40.369841 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୑ queue_depth=2898 I1117 09:43:40.369977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୒ queue_depth=2899 I1117 09:43:40.370110 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୓ queue_depth=2900 I1117 09:43:40.370247 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୔ queue_depth=2901 I1117 09:43:40.370381 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୕ queue_depth=2902 I1117 09:43:40.370515 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୖ queue_depth=2903 I1117 09:43:40.370649 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୗ queue_depth=2904 I1117 09:43:40.370784 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୘ queue_depth=2905 I1117 09:43:40.370915 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୙ queue_depth=2906 I1117 09:43:40.371063 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୚ queue_depth=2907 I1117 09:43:40.371346 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୛ queue_depth=2908 I1117 09:43:40.371487 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଡ଼ queue_depth=2909 I1117 09:43:40.371629 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ଢ଼ queue_depth=2910 I1117 09:43:40.371791 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୞ queue_depth=2911 I1117 09:43:40.371929 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୟ queue_depth=2912 I1117 09:43:40.372064 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୠ queue_depth=2913 I1117 09:43:40.372203 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୡ queue_depth=2914 I1117 09:43:40.372339 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୢ queue_depth=2915 I1117 09:43:40.372471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୣ queue_depth=2916 I1117 09:43:40.372620 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୤ queue_depth=2917 I1117 09:43:40.372753 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୥ queue_depth=2918 I1117 09:43:40.372888 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୦ queue_depth=2919 I1117 09:43:40.373036 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୧ queue_depth=2920 I1117 09:43:40.373175 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୨ queue_depth=2921 I1117 09:43:40.373307 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୩ queue_depth=2922 I1117 09:43:40.373445 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୪ queue_depth=2923 I1117 09:43:40.373582 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୫ queue_depth=2924 I1117 09:43:40.373716 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୬ queue_depth=2925 I1117 09:43:40.373851 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୭ queue_depth=2926 I1117 09:43:40.373986 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୮ queue_depth=2927 I1117 09:43:40.374119 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୯ queue_depth=2928 I1117 09:43:40.374257 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୰ queue_depth=2929 I1117 09:43:40.374392 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ୱ queue_depth=2930 I1117 09:43:40.374526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୲ queue_depth=2931 I1117 09:43:40.374660 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୳ queue_depth=2932 I1117 09:43:40.374794 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୴ queue_depth=2933 I1117 09:43:40.374927 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୵ queue_depth=2934 I1117 09:43:40.375062 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୶ queue_depth=2935 I1117 09:43:40.375195 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୷ queue_depth=2936 I1117 09:43:40.375327 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୸ queue_depth=2937 I1117 09:43:40.375458 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୹ queue_depth=2938 I1117 09:43:40.375634 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୺ queue_depth=2939 I1117 09:43:40.375773 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୻ queue_depth=2940 I1117 09:43:40.375908 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୼ queue_depth=2941 I1117 09:43:40.376040 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୽ queue_depth=2942 I1117 09:43:40.376177 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୾ queue_depth=2943 I1117 09:43:40.376333 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=୿ queue_depth=2944 I1117 09:43:40.376479 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஀ queue_depth=2945 I1117 09:43:40.376621 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஁ queue_depth=2946 I1117 09:43:40.376758 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஂ queue_depth=2947 I1117 09:43:40.376891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஃ queue_depth=2948 I1117 09:43:40.377023 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஄ queue_depth=2949 I1117 09:43:40.377157 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=அ queue_depth=2950 I1117 09:43:40.377291 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஆ queue_depth=2951 I1117 09:43:40.377424 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=இ queue_depth=2952 I1117 09:43:40.377558 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஈ queue_depth=2953 I1117 09:43:40.377690 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=உ queue_depth=2954 I1117 09:43:40.377823 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஊ queue_depth=2955 I1117 09:43:40.377957 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஋ queue_depth=2956 I1117 09:43:40.378098 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஌ queue_depth=2957 I1117 09:43:40.378234 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஍ queue_depth=2958 I1117 09:43:40.378378 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=எ queue_depth=2959 I1117 09:43:40.378511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஏ queue_depth=2960 I1117 09:43:40.378645 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஐ queue_depth=2961 I1117 09:43:40.378779 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஑ queue_depth=2962 I1117 09:43:40.378915 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஒ queue_depth=2963 I1117 09:43:40.379047 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஓ queue_depth=2964 I1117 09:43:40.379181 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஔ queue_depth=2965 I1117 09:43:40.379315 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=க queue_depth=2966 I1117 09:43:40.379472 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஖ queue_depth=2967 I1117 09:43:40.379608 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஗ queue_depth=2968 I1117 09:43:40.379749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஘ queue_depth=2969 I1117 09:43:40.379885 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ங queue_depth=2970 I1117 09:43:40.380020 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ச queue_depth=2971 I1117 09:43:40.380152 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஛ queue_depth=2972 I1117 09:43:40.380286 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஜ queue_depth=2973 I1117 09:43:40.380419 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஝ queue_depth=2974 I1117 09:43:40.380550 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஞ queue_depth=2975 I1117 09:43:40.380684 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ட queue_depth=2976 I1117 09:43:40.380841 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஠ queue_depth=2977 I1117 09:43:40.380976 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஡ queue_depth=2978 I1117 09:43:40.381114 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஢ queue_depth=2979 I1117 09:43:40.381248 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ண queue_depth=2980 I1117 09:43:40.381383 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=த queue_depth=2981 I1117 09:43:40.381516 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஥ queue_depth=2982 I1117 09:43:40.381661 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஦ queue_depth=2983 I1117 09:43:40.381795 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஧ queue_depth=2984 I1117 09:43:40.381929 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ந queue_depth=2985 I1117 09:43:40.382062 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ன queue_depth=2986 I1117 09:43:40.382199 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ப queue_depth=2987 I1117 09:43:40.382331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஫ queue_depth=2988 I1117 09:43:40.382464 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஬ queue_depth=2989 I1117 09:43:40.382598 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஭ queue_depth=2990 I1117 09:43:40.382730 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ம queue_depth=2991 I1117 09:43:40.382865 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ய queue_depth=2992 I1117 09:43:40.383003 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ர queue_depth=2993 I1117 09:43:40.383147 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ற queue_depth=2994 I1117 09:43:40.383294 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ல queue_depth=2995 I1117 09:43:40.383430 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ள queue_depth=2996 I1117 09:43:40.383563 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ழ queue_depth=2997 I1117 09:43:40.383707 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=வ queue_depth=2998 I1117 09:43:40.383842 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஶ queue_depth=2999 I1117 09:43:40.383979 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஷ queue_depth=3000 I1117 09:43:40.384112 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஸ queue_depth=3001 I1117 09:43:40.384243 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ஹ queue_depth=3002 I1117 09:43:40.384378 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஺ queue_depth=3003 I1117 09:43:40.384517 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஻ queue_depth=3004 I1117 09:43:40.384649 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஼ queue_depth=3005 I1117 09:43:40.384783 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=஽ queue_depth=3006 I1117 09:43:40.384926 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ா queue_depth=3007 I1117 09:43:40.385072 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ி queue_depth=3008 I1117 09:43:40.385207 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ீ queue_depth=3009 I1117 09:43:40.385360 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ு queue_depth=3010 I1117 09:43:40.385502 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ூ queue_depth=3011 I1117 09:43:40.385636 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௃ queue_depth=3012 I1117 09:43:40.385771 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௄ queue_depth=3013 I1117 09:43:40.385904 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௅ queue_depth=3014 I1117 09:43:40.386038 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ெ queue_depth=3015 I1117 09:43:40.386171 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ே queue_depth=3016 I1117 09:43:40.386303 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ை queue_depth=3017 I1117 09:43:40.386447 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௉ queue_depth=3018 I1117 09:43:40.386584 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ொ queue_depth=3019 I1117 09:43:40.386718 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ோ queue_depth=3020 I1117 09:43:40.386850 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ௌ queue_depth=3021 I1117 09:43:40.386986 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=் queue_depth=3022 I1117 09:43:40.387122 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௎ queue_depth=3023 I1117 09:43:40.387259 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௏ queue_depth=3024 I1117 09:43:40.387393 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ௐ queue_depth=3025 I1117 09:43:40.387526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௑ queue_depth=3026 I1117 09:43:40.387666 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௒ queue_depth=3027 I1117 09:43:40.387812 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௓ queue_depth=3028 I1117 09:43:40.387946 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௔ queue_depth=3029 I1117 09:43:40.388082 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௕ queue_depth=3030 I1117 09:43:40.388217 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௖ queue_depth=3031 I1117 09:43:40.388353 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ௗ queue_depth=3032 I1117 09:43:40.388491 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௘ queue_depth=3033 I1117 09:43:40.388624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௙ queue_depth=3034 I1117 09:43:40.388759 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௚ queue_depth=3035 I1117 09:43:40.388891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௛ queue_depth=3036 I1117 09:43:40.389026 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௜ queue_depth=3037 I1117 09:43:40.389160 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௝ queue_depth=3038 I1117 09:43:40.389293 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௞ queue_depth=3039 I1117 09:43:40.389427 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௟ queue_depth=3040 I1117 09:43:40.389559 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௠ queue_depth=3041 I1117 09:43:40.389697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௡ queue_depth=3042 I1117 09:43:40.389861 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௢ queue_depth=3043 I1117 09:43:40.389999 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௣ queue_depth=3044 I1117 09:43:40.390136 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௤ queue_depth=3045 I1117 09:43:40.390272 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௥ queue_depth=3046 I1117 09:43:40.390407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௦ queue_depth=3047 I1117 09:43:40.390539 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௧ queue_depth=3048 I1117 09:43:40.390671 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௨ queue_depth=3049 I1117 09:43:40.390803 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௩ queue_depth=3050 I1117 09:43:40.390941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௪ queue_depth=3051 I1117 09:43:40.391073 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௫ queue_depth=3052 I1117 09:43:40.391210 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௬ queue_depth=3053 I1117 09:43:40.391347 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௭ queue_depth=3054 I1117 09:43:40.391479 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௮ queue_depth=3055 I1117 09:43:40.391613 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௯ queue_depth=3056 I1117 09:43:40.391752 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௰ queue_depth=3057 I1117 09:43:40.391884 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௱ queue_depth=3058 I1117 09:43:40.392018 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௲ queue_depth=3059 I1117 09:43:40.392167 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௳ queue_depth=3060 I1117 09:43:40.392305 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௴ queue_depth=3061 I1117 09:43:40.392446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௵ queue_depth=3062 I1117 09:43:40.392593 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௶ queue_depth=3063 I1117 09:43:40.392729 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௷ queue_depth=3064 I1117 09:43:40.392864 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௸ queue_depth=3065 I1117 09:43:40.393000 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௹ queue_depth=3066 I1117 09:43:40.393140 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௺ queue_depth=3067 I1117 09:43:40.393273 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௻ queue_depth=3068 I1117 09:43:40.393409 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௼ queue_depth=3069 I1117 09:43:40.393541 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௽ queue_depth=3070 I1117 09:43:40.393676 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௾ queue_depth=3071 I1117 09:43:40.393811 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=௿ queue_depth=3072 I1117 09:43:40.393946 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఀ queue_depth=3073 I1117 09:43:40.394083 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఁ queue_depth=3074 I1117 09:43:40.394214 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ం queue_depth=3075 I1117 09:43:40.394369 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ః queue_depth=3076 I1117 09:43:40.394505 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఄ queue_depth=3077 I1117 09:43:40.394641 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=అ queue_depth=3078 I1117 09:43:40.394791 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఆ queue_depth=3079 I1117 09:43:40.394927 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఇ queue_depth=3080 I1117 09:43:40.395061 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఈ queue_depth=3081 I1117 09:43:40.395196 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఉ queue_depth=3082 I1117 09:43:40.395332 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఊ queue_depth=3083 I1117 09:43:40.395467 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఋ queue_depth=3084 I1117 09:43:40.395617 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఌ queue_depth=3085 I1117 09:43:40.395819 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=఍ queue_depth=3086 I1117 09:43:40.395962 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఎ queue_depth=3087 I1117 09:43:40.396095 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఏ queue_depth=3088 I1117 09:43:40.396230 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఐ queue_depth=3089 I1117 09:43:40.396364 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=఑ queue_depth=3090 I1117 09:43:40.396505 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఒ queue_depth=3091 I1117 09:43:40.396642 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఓ queue_depth=3092 I1117 09:43:40.396775 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఔ queue_depth=3093 I1117 09:43:40.396912 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=క queue_depth=3094 I1117 09:43:40.397045 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఖ queue_depth=3095 I1117 09:43:40.397179 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=గ queue_depth=3096 I1117 09:43:40.397312 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఘ queue_depth=3097 I1117 09:43:40.397447 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఙ queue_depth=3098 I1117 09:43:40.397580 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=చ queue_depth=3099 I1117 09:43:40.397715 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఛ queue_depth=3100 I1117 09:43:40.397849 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=జ queue_depth=3101 I1117 09:43:40.397985 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఝ queue_depth=3102 I1117 09:43:40.398118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఞ queue_depth=3103 I1117 09:43:40.398254 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ట queue_depth=3104 I1117 09:43:40.398391 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఠ queue_depth=3105 I1117 09:43:40.398524 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=డ queue_depth=3106 I1117 09:43:40.398662 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఢ queue_depth=3107 I1117 09:43:40.398798 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ణ queue_depth=3108 I1117 09:43:40.398956 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=త queue_depth=3109 I1117 09:43:40.399095 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=థ queue_depth=3110 I1117 09:43:40.399234 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ద queue_depth=3111 I1117 09:43:40.399366 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ధ queue_depth=3112 I1117 09:43:40.399501 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=న queue_depth=3113 I1117 09:43:40.399638 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=఩ queue_depth=3114 I1117 09:43:40.399784 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ప queue_depth=3115 I1117 09:43:40.399917 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఫ queue_depth=3116 I1117 09:43:40.400054 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=బ queue_depth=3117 I1117 09:43:40.400187 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=భ queue_depth=3118 I1117 09:43:40.400322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=మ queue_depth=3119 I1117 09:43:40.400460 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=య queue_depth=3120 I1117 09:43:40.400592 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ర queue_depth=3121 I1117 09:43:40.400731 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఱ queue_depth=3122 I1117 09:43:40.400886 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ల queue_depth=3123 I1117 09:43:40.401021 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ళ queue_depth=3124 I1117 09:43:40.401156 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఴ queue_depth=3125 I1117 09:43:40.401289 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=వ queue_depth=3126 I1117 09:43:40.401422 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=శ queue_depth=3127 I1117 09:43:40.401555 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ష queue_depth=3128 I1117 09:43:40.401690 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=స queue_depth=3129 I1117 09:43:40.401825 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=హ queue_depth=3130 I1117 09:43:40.401957 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=఺ queue_depth=3131 I1117 09:43:40.402092 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=఻ queue_depth=3132 I1117 09:43:40.402229 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=఼ queue_depth=3133 I1117 09:43:40.402365 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ఽ queue_depth=3134 I1117 09:43:40.402500 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ా queue_depth=3135 I1117 09:43:40.402636 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ి queue_depth=3136 I1117 09:43:40.402769 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ీ queue_depth=3137 I1117 09:43:40.402904 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ు queue_depth=3138 I1117 09:43:40.403037 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ూ queue_depth=3139 I1117 09:43:40.403188 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ృ queue_depth=3140 I1117 09:43:40.403323 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౄ queue_depth=3141 I1117 09:43:40.403484 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౅ queue_depth=3142 I1117 09:43:40.403621 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ె queue_depth=3143 I1117 09:43:40.403755 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ే queue_depth=3144 I1117 09:43:40.403889 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ై queue_depth=3145 I1117 09:43:40.404025 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౉ queue_depth=3146 I1117 09:43:40.404157 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ొ queue_depth=3147 I1117 09:43:40.404291 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ో queue_depth=3148 I1117 09:43:40.404424 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౌ queue_depth=3149 I1117 09:43:40.404559 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=్ queue_depth=3150 I1117 09:43:40.404705 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౎ queue_depth=3151 I1117 09:43:40.404838 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౏ queue_depth=3152 I1117 09:43:40.404972 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౐ queue_depth=3153 I1117 09:43:40.405106 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౑ queue_depth=3154 I1117 09:43:40.405240 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౒ queue_depth=3155 I1117 09:43:40.405376 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౓ queue_depth=3156 I1117 09:43:40.405511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౔ queue_depth=3157 I1117 09:43:40.405645 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౕ queue_depth=3158 I1117 09:43:40.405781 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౖ queue_depth=3159 I1117 09:43:40.405913 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౗ queue_depth=3160 I1117 09:43:40.406046 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౘ queue_depth=3161 I1117 09:43:40.406180 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౙ queue_depth=3162 I1117 09:43:40.406318 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౚ queue_depth=3163 I1117 09:43:40.406456 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౛ queue_depth=3164 I1117 09:43:40.406591 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౜ queue_depth=3165 I1117 09:43:40.406724 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౝ queue_depth=3166 I1117 09:43:40.406859 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౞ queue_depth=3167 I1117 09:43:40.406991 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౟ queue_depth=3168 I1117 09:43:40.407122 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౠ queue_depth=3169 I1117 09:43:40.407259 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౡ queue_depth=3170 I1117 09:43:40.407394 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౢ queue_depth=3171 I1117 09:43:40.407526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ౣ queue_depth=3172 I1117 09:43:40.407660 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౤ queue_depth=3173 I1117 09:43:40.407797 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౥ queue_depth=3174 I1117 09:43:40.407967 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౦ queue_depth=3175 I1117 09:43:40.408105 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౧ queue_depth=3176 I1117 09:43:40.408239 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౨ queue_depth=3177 I1117 09:43:40.408372 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౩ queue_depth=3178 I1117 09:43:40.408511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౪ queue_depth=3179 I1117 09:43:40.408645 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౫ queue_depth=3180 I1117 09:43:40.408781 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౬ queue_depth=3181 I1117 09:43:40.408913 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౭ queue_depth=3182 I1117 09:43:40.409047 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౮ queue_depth=3183 I1117 09:43:40.409181 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౯ queue_depth=3184 I1117 09:43:40.409318 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౰ queue_depth=3185 I1117 09:43:40.409453 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౱ queue_depth=3186 I1117 09:43:40.409597 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౲ queue_depth=3187 I1117 09:43:40.409749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౳ queue_depth=3188 I1117 09:43:40.409887 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౴ queue_depth=3189 I1117 09:43:40.410019 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౵ queue_depth=3190 I1117 09:43:40.410152 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౶ queue_depth=3191 I1117 09:43:40.410302 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౷ queue_depth=3192 I1117 09:43:40.410437 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౸ queue_depth=3193 I1117 09:43:40.410569 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౹ queue_depth=3194 I1117 09:43:40.410701 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౺ queue_depth=3195 I1117 09:43:40.410834 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౻ queue_depth=3196 I1117 09:43:40.410974 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౼ queue_depth=3197 I1117 09:43:40.411108 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౽ queue_depth=3198 I1117 09:43:40.411241 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౾ queue_depth=3199 I1117 09:43:40.411386 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=౿ queue_depth=3200 I1117 09:43:40.411523 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಀ queue_depth=3201 I1117 09:43:40.411658 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಁ queue_depth=3202 I1117 09:43:40.411789 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಂ queue_depth=3203 I1117 09:43:40.411921 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಃ queue_depth=3204 I1117 09:43:40.412054 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=಄ queue_depth=3205 I1117 09:43:40.412190 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಅ queue_depth=3206 I1117 09:43:40.412330 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಆ queue_depth=3207 I1117 09:43:40.412484 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಇ queue_depth=3208 I1117 09:43:40.412619 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಈ queue_depth=3209 I1117 09:43:40.412755 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಉ queue_depth=3210 I1117 09:43:40.412891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಊ queue_depth=3211 I1117 09:43:40.413025 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಋ queue_depth=3212 I1117 09:43:40.413169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಌ queue_depth=3213 I1117 09:43:40.413304 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=಍ queue_depth=3214 I1117 09:43:40.413440 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಎ queue_depth=3215 I1117 09:43:40.413575 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಏ queue_depth=3216 I1117 09:43:40.413711 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಐ queue_depth=3217 I1117 09:43:40.413845 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=಑ queue_depth=3218 I1117 09:43:40.413983 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಒ queue_depth=3219 I1117 09:43:40.414116 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಓ queue_depth=3220 I1117 09:43:40.414250 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಔ queue_depth=3221 I1117 09:43:40.414388 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಕ queue_depth=3222 I1117 09:43:40.414522 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಖ queue_depth=3223 I1117 09:43:40.414656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಗ queue_depth=3224 I1117 09:43:40.414793 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಘ queue_depth=3225 I1117 09:43:40.414927 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಙ queue_depth=3226 I1117 09:43:40.415061 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಚ queue_depth=3227 I1117 09:43:40.415195 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಛ queue_depth=3228 I1117 09:43:40.415328 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಜ queue_depth=3229 I1117 09:43:40.415463 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಝ queue_depth=3230 I1117 09:43:40.415600 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಞ queue_depth=3231 I1117 09:43:40.415735 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಟ queue_depth=3232 I1117 09:43:40.415913 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಠ queue_depth=3233 I1117 09:43:40.416056 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಡ queue_depth=3234 I1117 09:43:40.416191 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಢ queue_depth=3235 I1117 09:43:40.416327 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಣ queue_depth=3236 I1117 09:43:40.416471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ತ queue_depth=3237 I1117 09:43:40.416604 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಥ queue_depth=3238 I1117 09:43:40.416737 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ದ queue_depth=3239 I1117 09:43:40.416870 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಧ queue_depth=3240 I1117 09:43:40.417024 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ನ queue_depth=3241 I1117 09:43:40.417167 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=಩ queue_depth=3242 I1117 09:43:40.417306 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಪ queue_depth=3243 I1117 09:43:40.417442 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಫ queue_depth=3244 I1117 09:43:40.417574 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಬ queue_depth=3245 I1117 09:43:40.417709 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಭ queue_depth=3246 I1117 09:43:40.417842 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಮ queue_depth=3247 I1117 09:43:40.417975 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಯ queue_depth=3248 I1117 09:43:40.418122 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ರ queue_depth=3249 I1117 09:43:40.418255 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಱ queue_depth=3250 I1117 09:43:40.418385 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಲ queue_depth=3251 I1117 09:43:40.418523 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಳ queue_depth=3252 I1117 09:43:40.418663 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=಴ queue_depth=3253 I1117 09:43:40.418795 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ವ queue_depth=3254 I1117 09:43:40.418932 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಶ queue_depth=3255 I1117 09:43:40.419067 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಷ queue_depth=3256 I1117 09:43:40.419214 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಸ queue_depth=3257 I1117 09:43:40.419352 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಹ queue_depth=3258 I1117 09:43:40.419489 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=಺ queue_depth=3259 I1117 09:43:40.419623 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=಻ queue_depth=3260 I1117 09:43:40.419767 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=಼ queue_depth=3261 I1117 09:43:40.419909 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಽ queue_depth=3262 I1117 09:43:40.420043 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಾ queue_depth=3263 I1117 09:43:40.420179 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ಿ queue_depth=3264 I1117 09:43:40.420312 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೀ queue_depth=3265 I1117 09:43:40.420459 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ು queue_depth=3266 I1117 09:43:40.420592 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೂ queue_depth=3267 I1117 09:43:40.420724 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೃ queue_depth=3268 I1117 09:43:40.420857 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೄ queue_depth=3269 I1117 09:43:40.420990 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೅ queue_depth=3270 I1117 09:43:40.421122 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೆ queue_depth=3271 I1117 09:43:40.421257 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೇ queue_depth=3272 I1117 09:43:40.421395 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೈ queue_depth=3273 I1117 09:43:40.421549 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೉ queue_depth=3274 I1117 09:43:40.421697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೊ queue_depth=3275 I1117 09:43:40.421830 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೋ queue_depth=3276 I1117 09:43:40.421965 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೌ queue_depth=3277 I1117 09:43:40.422101 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=್ queue_depth=3278 I1117 09:43:40.422238 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೎ queue_depth=3279 I1117 09:43:40.422381 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೏ queue_depth=3280 I1117 09:43:40.422516 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೐ queue_depth=3281 I1117 09:43:40.422650 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೑ queue_depth=3282 I1117 09:43:40.422784 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೒ queue_depth=3283 I1117 09:43:40.422924 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೓ queue_depth=3284 I1117 09:43:40.423060 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೔ queue_depth=3285 I1117 09:43:40.423197 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೕ queue_depth=3286 I1117 09:43:40.423333 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೖ queue_depth=3287 I1117 09:43:40.423480 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೗ queue_depth=3288 I1117 09:43:40.423613 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೘ queue_depth=3289 I1117 09:43:40.423750 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೙ queue_depth=3290 I1117 09:43:40.423887 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೚ queue_depth=3291 I1117 09:43:40.424022 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೛ queue_depth=3292 I1117 09:43:40.424154 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೜ queue_depth=3293 I1117 09:43:40.424286 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೝ queue_depth=3294 I1117 09:43:40.424420 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೞ queue_depth=3295 I1117 09:43:40.424553 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೟ queue_depth=3296 I1117 09:43:40.424687 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೠ queue_depth=3297 I1117 09:43:40.424826 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೡ queue_depth=3298 I1117 09:43:40.424973 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೢ queue_depth=3299 I1117 09:43:40.425109 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೣ queue_depth=3300 I1117 09:43:40.425244 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೤ queue_depth=3301 I1117 09:43:40.425381 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೥ queue_depth=3302 I1117 09:43:40.425516 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೦ queue_depth=3303 I1117 09:43:40.425649 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೧ queue_depth=3304 I1117 09:43:40.425785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೨ queue_depth=3305 I1117 09:43:40.425919 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೩ queue_depth=3306 I1117 09:43:40.426076 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೪ queue_depth=3307 I1117 09:43:40.426216 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೫ queue_depth=3308 I1117 09:43:40.426349 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೬ queue_depth=3309 I1117 09:43:40.426490 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೭ queue_depth=3310 I1117 09:43:40.426626 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೮ queue_depth=3311 I1117 09:43:40.426760 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೯ queue_depth=3312 I1117 09:43:40.426907 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೰ queue_depth=3313 I1117 09:43:40.427041 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೱ queue_depth=3314 I1117 09:43:40.427176 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೲ queue_depth=3315 I1117 09:43:40.427313 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ೳ queue_depth=3316 I1117 09:43:40.427449 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೴ queue_depth=3317 I1117 09:43:40.427582 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೵ queue_depth=3318 I1117 09:43:40.427718 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೶ queue_depth=3319 I1117 09:43:40.427851 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೷ queue_depth=3320 I1117 09:43:40.427998 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೸ queue_depth=3321 I1117 09:43:40.428142 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೹ queue_depth=3322 I1117 09:43:40.428277 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೺ queue_depth=3323 I1117 09:43:40.428411 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೻ queue_depth=3324 I1117 09:43:40.428543 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೼ queue_depth=3325 I1117 09:43:40.428677 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೽ queue_depth=3326 I1117 09:43:40.428815 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೾ queue_depth=3327 I1117 09:43:40.428966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=೿ queue_depth=3328 I1117 09:43:40.429101 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഀ queue_depth=3329 I1117 09:43:40.429234 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഁ queue_depth=3330 I1117 09:43:40.429367 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ം queue_depth=3331 I1117 09:43:40.429499 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഃ queue_depth=3332 I1117 09:43:40.429635 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഄ queue_depth=3333 I1117 09:43:40.429778 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=അ queue_depth=3334 I1117 09:43:40.429915 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ആ queue_depth=3335 I1117 09:43:40.430047 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഇ queue_depth=3336 I1117 09:43:40.430182 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഈ queue_depth=3337 I1117 09:43:40.430314 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഉ queue_depth=3338 I1117 09:43:40.430446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഊ queue_depth=3339 I1117 09:43:40.430602 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഋ queue_depth=3340 I1117 09:43:40.430737 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഌ queue_depth=3341 I1117 09:43:40.430875 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=഍ queue_depth=3342 I1117 09:43:40.431008 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=എ queue_depth=3343 I1117 09:43:40.431147 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഏ queue_depth=3344 I1117 09:43:40.431281 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഐ queue_depth=3345 I1117 09:43:40.431415 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=഑ queue_depth=3346 I1117 09:43:40.431561 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഒ queue_depth=3347 I1117 09:43:40.431699 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഓ queue_depth=3348 I1117 09:43:40.431836 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഔ queue_depth=3349 I1117 09:43:40.431970 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ക queue_depth=3350 I1117 09:43:40.432102 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഖ queue_depth=3351 I1117 09:43:40.432236 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഗ queue_depth=3352 I1117 09:43:40.432369 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഘ queue_depth=3353 I1117 09:43:40.432504 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ങ queue_depth=3354 I1117 09:43:40.432643 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ച queue_depth=3355 I1117 09:43:40.432779 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഛ queue_depth=3356 I1117 09:43:40.432917 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ജ queue_depth=3357 I1117 09:43:40.433056 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഝ queue_depth=3358 I1117 09:43:40.433192 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഞ queue_depth=3359 I1117 09:43:40.433328 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ട queue_depth=3360 I1117 09:43:40.433467 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഠ queue_depth=3361 I1117 09:43:40.433602 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഡ queue_depth=3362 I1117 09:43:40.433735 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഢ queue_depth=3363 I1117 09:43:40.433869 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ണ queue_depth=3364 I1117 09:43:40.434004 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ത queue_depth=3365 I1117 09:43:40.434137 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഥ queue_depth=3366 I1117 09:43:40.435941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ദ queue_depth=3367 I1117 09:43:40.436166 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ധ queue_depth=3368 I1117 09:43:40.436301 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ന queue_depth=3369 I1117 09:43:40.436443 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഩ queue_depth=3370 I1117 09:43:40.436581 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=പ queue_depth=3371 I1117 09:43:40.436715 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഫ queue_depth=3372 I1117 09:43:40.436881 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ബ queue_depth=3373 I1117 09:43:40.437018 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഭ queue_depth=3374 I1117 09:43:40.437154 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=മ queue_depth=3375 I1117 09:43:40.437286 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=യ queue_depth=3376 I1117 09:43:40.437419 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ര queue_depth=3377 I1117 09:43:40.437553 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=റ queue_depth=3378 I1117 09:43:40.437687 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ല queue_depth=3379 I1117 09:43:40.437834 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ള queue_depth=3380 I1117 09:43:40.437970 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഴ queue_depth=3381 I1117 09:43:40.438106 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=വ queue_depth=3382 I1117 09:43:40.438240 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ശ queue_depth=3383 I1117 09:43:40.438374 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഷ queue_depth=3384 I1117 09:43:40.438506 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=സ queue_depth=3385 I1117 09:43:40.438651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഹ queue_depth=3386 I1117 09:43:40.438785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഺ queue_depth=3387 I1117 09:43:40.438918 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=഻ queue_depth=3388 I1117 09:43:40.439063 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=഼ queue_depth=3389 I1117 09:43:40.439197 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ഽ queue_depth=3390 I1117 09:43:40.439329 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ാ queue_depth=3391 I1117 09:43:40.439475 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ി queue_depth=3392 I1117 09:43:40.439615 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ീ queue_depth=3393 I1117 09:43:40.439759 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ു queue_depth=3394 I1117 09:43:40.439892 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൂ queue_depth=3395 I1117 09:43:40.440025 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൃ queue_depth=3396 I1117 09:43:40.440157 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൄ queue_depth=3397 I1117 09:43:40.440293 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൅ queue_depth=3398 I1117 09:43:40.440427 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=െ queue_depth=3399 I1117 09:43:40.440559 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=േ queue_depth=3400 I1117 09:43:40.440698 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൈ queue_depth=3401 I1117 09:43:40.440835 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൉ queue_depth=3402 I1117 09:43:40.440967 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൊ queue_depth=3403 I1117 09:43:40.441099 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ോ queue_depth=3404 I1117 09:43:40.441236 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൌ queue_depth=3405 I1117 09:43:40.441390 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=് queue_depth=3406 I1117 09:43:40.441532 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൎ queue_depth=3407 I1117 09:43:40.441670 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൏ queue_depth=3408 I1117 09:43:40.441808 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൐ queue_depth=3409 I1117 09:43:40.441946 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൑ queue_depth=3410 I1117 09:43:40.442082 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൒ queue_depth=3411 I1117 09:43:40.442214 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൓ queue_depth=3412 I1117 09:43:40.442348 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൔ queue_depth=3413 I1117 09:43:40.442483 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൕ queue_depth=3414 I1117 09:43:40.442618 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൖ queue_depth=3415 I1117 09:43:40.442752 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൗ queue_depth=3416 I1117 09:43:40.442884 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൘ queue_depth=3417 I1117 09:43:40.443017 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൙ queue_depth=3418 I1117 09:43:40.443155 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൚ queue_depth=3419 I1117 09:43:40.443292 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൛ queue_depth=3420 I1117 09:43:40.443443 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൜ queue_depth=3421 I1117 09:43:40.443580 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൝ queue_depth=3422 I1117 09:43:40.443718 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൞ queue_depth=3423 I1117 09:43:40.443851 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൟ queue_depth=3424 I1117 09:43:40.443982 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൠ queue_depth=3425 I1117 09:43:40.444115 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൡ queue_depth=3426 I1117 09:43:40.444249 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൢ queue_depth=3427 I1117 09:43:40.444381 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൣ queue_depth=3428 I1117 09:43:40.444516 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൤ queue_depth=3429 I1117 09:43:40.444650 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൥ queue_depth=3430 I1117 09:43:40.444786 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൦ queue_depth=3431 I1117 09:43:40.444923 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൧ queue_depth=3432 I1117 09:43:40.445057 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൨ queue_depth=3433 I1117 09:43:40.445189 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൩ queue_depth=3434 I1117 09:43:40.445327 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൪ queue_depth=3435 I1117 09:43:40.445473 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൫ queue_depth=3436 I1117 09:43:40.445609 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൬ queue_depth=3437 I1117 09:43:40.445751 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൭ queue_depth=3438 I1117 09:43:40.445908 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൮ queue_depth=3439 I1117 09:43:40.446049 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൯ queue_depth=3440 I1117 09:43:40.446196 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൰ queue_depth=3441 I1117 09:43:40.446331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൱ queue_depth=3442 I1117 09:43:40.446471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൲ queue_depth=3443 I1117 09:43:40.446614 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൳ queue_depth=3444 I1117 09:43:40.446752 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൴ queue_depth=3445 I1117 09:43:40.446884 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൵ queue_depth=3446 I1117 09:43:40.447016 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൶ queue_depth=3447 I1117 09:43:40.447151 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൷ queue_depth=3448 I1117 09:43:40.447288 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൸ queue_depth=3449 I1117 09:43:40.447424 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=൹ queue_depth=3450 I1117 09:43:40.447557 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൺ queue_depth=3451 I1117 09:43:40.447692 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൻ queue_depth=3452 I1117 09:43:40.447826 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ർ queue_depth=3453 I1117 09:43:40.447958 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൽ queue_depth=3454 I1117 09:43:40.448096 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൾ queue_depth=3455 I1117 09:43:40.448244 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ൿ queue_depth=3456 I1117 09:43:40.448379 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඀ queue_depth=3457 I1117 09:43:40.448512 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඁ queue_depth=3458 I1117 09:43:40.448647 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ං queue_depth=3459 I1117 09:43:40.448782 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඃ queue_depth=3460 I1117 09:43:40.448916 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඄ queue_depth=3461 I1117 09:43:40.449061 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=අ queue_depth=3462 I1117 09:43:40.449194 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ආ queue_depth=3463 I1117 09:43:40.449329 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඇ queue_depth=3464 I1117 09:43:40.449466 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඈ queue_depth=3465 I1117 09:43:40.449601 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඉ queue_depth=3466 I1117 09:43:40.449745 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඊ queue_depth=3467 I1117 09:43:40.449880 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=උ queue_depth=3468 I1117 09:43:40.450017 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඌ queue_depth=3469 I1117 09:43:40.450155 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඍ queue_depth=3470 I1117 09:43:40.450292 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඎ queue_depth=3471 I1117 09:43:40.450446 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඏ queue_depth=3472 I1117 09:43:40.450589 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඐ queue_depth=3473 I1117 09:43:40.450724 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=එ queue_depth=3474 I1117 09:43:40.450858 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඒ queue_depth=3475 I1117 09:43:40.450995 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඓ queue_depth=3476 I1117 09:43:40.451130 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඔ queue_depth=3477 I1117 09:43:40.451265 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඕ queue_depth=3478 I1117 09:43:40.451405 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඖ queue_depth=3479 I1117 09:43:40.451536 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඗ queue_depth=3480 I1117 09:43:40.451671 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඘ queue_depth=3481 I1117 09:43:40.451818 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඙ queue_depth=3482 I1117 09:43:40.451951 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ක queue_depth=3483 I1117 09:43:40.452087 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඛ queue_depth=3484 I1117 09:43:40.452220 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ග queue_depth=3485 I1117 09:43:40.452353 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඝ queue_depth=3486 I1117 09:43:40.452486 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඞ queue_depth=3487 I1117 09:43:40.452619 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඟ queue_depth=3488 I1117 09:43:40.452754 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ච queue_depth=3489 I1117 09:43:40.452889 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඡ queue_depth=3490 I1117 09:43:40.453022 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ජ queue_depth=3491 I1117 09:43:40.453164 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඣ queue_depth=3492 I1117 09:43:40.453296 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඤ queue_depth=3493 I1117 09:43:40.453433 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඥ queue_depth=3494 I1117 09:43:40.453569 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඦ queue_depth=3495 I1117 09:43:40.453702 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ට queue_depth=3496 I1117 09:43:40.453839 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඨ queue_depth=3497 I1117 09:43:40.453971 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඩ queue_depth=3498 I1117 09:43:40.454103 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඪ queue_depth=3499 I1117 09:43:40.454239 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ණ queue_depth=3500 I1117 09:43:40.454390 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඬ queue_depth=3501 I1117 09:43:40.454523 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ත queue_depth=3502 I1117 09:43:40.454656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ථ queue_depth=3503 I1117 09:43:40.454792 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ද queue_depth=3504 I1117 09:43:40.454946 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ධ queue_depth=3505 I1117 09:43:40.455081 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=න queue_depth=3506 I1117 09:43:40.455220 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඲ queue_depth=3507 I1117 09:43:40.455358 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඳ queue_depth=3508 I1117 09:43:40.455493 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ප queue_depth=3509 I1117 09:43:40.455628 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඵ queue_depth=3510 I1117 09:43:40.455763 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=බ queue_depth=3511 I1117 09:43:40.455898 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=භ queue_depth=3512 I1117 09:43:40.456032 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ම queue_depth=3513 I1117 09:43:40.456209 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ඹ queue_depth=3514 I1117 09:43:40.456349 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ය queue_depth=3515 I1117 09:43:40.456491 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ර queue_depth=3516 I1117 09:43:40.456626 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඼ queue_depth=3517 I1117 09:43:40.456763 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ල queue_depth=3518 I1117 09:43:40.456901 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඾ queue_depth=3519 I1117 09:43:40.457039 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=඿ queue_depth=3520 I1117 09:43:40.457177 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ව queue_depth=3521 I1117 09:43:40.457310 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ශ queue_depth=3522 I1117 09:43:40.457445 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෂ queue_depth=3523 I1117 09:43:40.457576 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ස queue_depth=3524 I1117 09:43:40.457881 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=හ queue_depth=3525 I1117 09:43:40.458022 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ළ queue_depth=3526 I1117 09:43:40.458159 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෆ queue_depth=3527 I1117 09:43:40.458294 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෇ queue_depth=3528 I1117 09:43:40.458429 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෈ queue_depth=3529 I1117 09:43:40.458567 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෉ queue_depth=3530 I1117 09:43:40.458698 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=් queue_depth=3531 I1117 09:43:40.458834 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෋ queue_depth=3532 I1117 09:43:40.458970 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෌ queue_depth=3533 I1117 09:43:40.459102 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෍ queue_depth=3534 I1117 09:43:40.459256 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෎ queue_depth=3535 I1117 09:43:40.459391 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ා queue_depth=3536 I1117 09:43:40.459526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ැ queue_depth=3537 I1117 09:43:40.459680 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෑ queue_depth=3538 I1117 09:43:40.459825 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ි queue_depth=3539 I1117 09:43:40.459961 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ී queue_depth=3540 I1117 09:43:40.460099 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ු queue_depth=3541 I1117 09:43:40.460233 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෕ queue_depth=3542 I1117 09:43:40.460366 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ූ queue_depth=3543 I1117 09:43:40.460500 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෗ queue_depth=3544 I1117 09:43:40.460650 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෘ queue_depth=3545 I1117 09:43:40.460800 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෙ queue_depth=3546 I1117 09:43:40.460936 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ේ queue_depth=3547 I1117 09:43:40.461071 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෛ queue_depth=3548 I1117 09:43:40.461218 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ො queue_depth=3549 I1117 09:43:40.461351 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෝ queue_depth=3550 I1117 09:43:40.461486 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෞ queue_depth=3551 I1117 09:43:40.461624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෟ queue_depth=3552 I1117 09:43:40.461758 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෠ queue_depth=3553 I1117 09:43:40.461892 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෡ queue_depth=3554 I1117 09:43:40.462028 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෢ queue_depth=3555 I1117 09:43:40.462165 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෣ queue_depth=3556 I1117 09:43:40.462309 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෤ queue_depth=3557 I1117 09:43:40.462444 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෥ queue_depth=3558 I1117 09:43:40.462580 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෦ queue_depth=3559 I1117 09:43:40.462713 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෧ queue_depth=3560 I1117 09:43:40.462846 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෨ queue_depth=3561 I1117 09:43:40.462976 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෩ queue_depth=3562 I1117 09:43:40.463125 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෪ queue_depth=3563 I1117 09:43:40.463265 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෫ queue_depth=3564 I1117 09:43:40.463398 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෬ queue_depth=3565 I1117 09:43:40.463533 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෭ queue_depth=3566 I1117 09:43:40.463666 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෮ queue_depth=3567 I1117 09:43:40.463806 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෯ queue_depth=3568 I1117 09:43:40.463941 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෰ queue_depth=3569 I1117 09:43:40.464080 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෱ queue_depth=3570 I1117 09:43:40.464233 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෲ queue_depth=3571 I1117 09:43:40.464372 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ෳ queue_depth=3572 I1117 09:43:40.464504 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෴ queue_depth=3573 I1117 09:43:40.464641 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෵ queue_depth=3574 I1117 09:43:40.464779 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෶ queue_depth=3575 I1117 09:43:40.464916 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෷ queue_depth=3576 I1117 09:43:40.465048 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෸ queue_depth=3577 I1117 09:43:40.465183 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෹ queue_depth=3578 I1117 09:43:40.465320 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෺ queue_depth=3579 I1117 09:43:40.465452 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෻ queue_depth=3580 I1117 09:43:40.465593 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෼ queue_depth=3581 I1117 09:43:40.467403 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෽ queue_depth=3582 I1117 09:43:40.467541 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෾ queue_depth=3583 I1117 09:43:40.467676 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=෿ queue_depth=3584 I1117 09:43:40.467808 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=฀ queue_depth=3585 I1117 09:43:40.467942 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ก queue_depth=3586 I1117 09:43:40.468081 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ข queue_depth=3587 I1117 09:43:40.468224 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฃ queue_depth=3588 I1117 09:43:40.468385 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ค queue_depth=3589 I1117 09:43:40.468524 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฅ queue_depth=3590 I1117 09:43:40.468656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฆ queue_depth=3591 I1117 09:43:40.468789 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ง queue_depth=3592 I1117 09:43:40.468927 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=จ queue_depth=3593 I1117 09:43:40.469065 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฉ queue_depth=3594 I1117 09:43:40.469201 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ช queue_depth=3595 I1117 09:43:40.469337 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ซ queue_depth=3596 I1117 09:43:40.469471 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฌ queue_depth=3597 I1117 09:43:40.469605 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ญ queue_depth=3598 I1117 09:43:40.469745 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฎ queue_depth=3599 I1117 09:43:40.469884 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฏ queue_depth=3600 I1117 09:43:40.470016 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฐ queue_depth=3601 I1117 09:43:40.470151 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฑ queue_depth=3602 I1117 09:43:40.470285 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฒ queue_depth=3603 I1117 09:43:40.470442 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ณ queue_depth=3604 I1117 09:43:40.470581 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ด queue_depth=3605 I1117 09:43:40.470714 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ต queue_depth=3606 I1117 09:43:40.470848 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ถ queue_depth=3607 I1117 09:43:40.470982 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ท queue_depth=3608 I1117 09:43:40.471132 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ธ queue_depth=3609 I1117 09:43:40.471280 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=น queue_depth=3610 I1117 09:43:40.471443 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=บ queue_depth=3611 I1117 09:43:40.471614 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ป queue_depth=3612 I1117 09:43:40.471819 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ผ queue_depth=3613 I1117 09:43:40.471986 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฝ queue_depth=3614 I1117 09:43:40.472148 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=พ queue_depth=3615 I1117 09:43:40.472313 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฟ queue_depth=3616 I1117 09:43:40.472480 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ภ queue_depth=3617 I1117 09:43:40.472624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ม queue_depth=3618 I1117 09:43:40.472776 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ย queue_depth=3619 I1117 09:43:40.472943 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ร queue_depth=3620 I1117 09:43:40.473102 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฤ queue_depth=3621 I1117 09:43:40.473261 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ล queue_depth=3622 I1117 09:43:40.473402 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฦ queue_depth=3623 I1117 09:43:40.473535 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ว queue_depth=3624 I1117 09:43:40.473669 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ศ queue_depth=3625 I1117 09:43:40.473803 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ษ queue_depth=3626 I1117 09:43:40.473943 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ส queue_depth=3627 I1117 09:43:40.474079 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ห queue_depth=3628 I1117 09:43:40.474216 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฬ queue_depth=3629 I1117 09:43:40.474349 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=อ queue_depth=3630 I1117 09:43:40.474491 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฮ queue_depth=3631 I1117 09:43:40.474654 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฯ queue_depth=3632 I1117 09:43:40.474820 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ะ queue_depth=3633 I1117 09:43:40.474990 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ั queue_depth=3634 I1117 09:43:40.475160 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=า queue_depth=3635 I1117 09:43:40.475320 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ำ queue_depth=3636 I1117 09:43:40.475515 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ิ queue_depth=3637 I1117 09:43:40.475663 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ี queue_depth=3638 I1117 09:43:40.475800 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ึ queue_depth=3639 I1117 09:43:40.475948 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ื queue_depth=3640 I1117 09:43:40.476083 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ุ queue_depth=3641 I1117 09:43:40.476220 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ู queue_depth=3642 I1117 09:43:40.476421 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ฺ queue_depth=3643 I1117 09:43:40.476566 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=฻ queue_depth=3644 I1117 09:43:40.478475 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=฼ queue_depth=3645 I1117 09:43:40.478615 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=฽ queue_depth=3646 I1117 09:43:40.478749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=฾ queue_depth=3647 I1117 09:43:40.478890 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=฿ queue_depth=3648 I1117 09:43:40.479029 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=เ queue_depth=3649 I1117 09:43:40.479167 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=แ queue_depth=3650 I1117 09:43:40.479303 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=โ queue_depth=3651 I1117 09:43:40.479438 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ใ queue_depth=3652 I1117 09:43:40.479576 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ไ queue_depth=3653 I1117 09:43:40.479720 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ๅ queue_depth=3654 I1117 09:43:40.479859 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ๆ queue_depth=3655 I1117 09:43:40.479998 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=็ queue_depth=3656 I1117 09:43:40.480130 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=่ queue_depth=3657 I1117 09:43:40.480263 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=้ queue_depth=3658 I1117 09:43:40.480403 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๊ queue_depth=3659 I1117 09:43:40.480538 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๋ queue_depth=3660 I1117 09:43:40.480680 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=์ queue_depth=3661 I1117 09:43:40.480816 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ํ queue_depth=3662 I1117 09:43:40.480966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๎ queue_depth=3663 I1117 09:43:40.481100 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๏ queue_depth=3664 I1117 09:43:40.481233 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๐ queue_depth=3665 I1117 09:43:40.481369 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๑ queue_depth=3666 I1117 09:43:40.481512 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๒ queue_depth=3667 I1117 09:43:40.481646 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๓ queue_depth=3668 I1117 09:43:40.483398 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๔ queue_depth=3669 I1117 09:43:40.483559 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๕ queue_depth=3670 I1117 09:43:40.483697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๖ queue_depth=3671 I1117 09:43:40.483834 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๗ queue_depth=3672 I1117 09:43:40.483972 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๘ queue_depth=3673 I1117 09:43:40.484112 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๙ queue_depth=3674 I1117 09:43:40.484275 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๚ queue_depth=3675 I1117 09:43:40.484437 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๛ queue_depth=3676 I1117 09:43:40.484571 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๜ queue_depth=3677 I1117 09:43:40.484708 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๝ queue_depth=3678 I1117 09:43:40.484856 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๞ queue_depth=3679 I1117 09:43:40.484997 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๟ queue_depth=3680 I1117 09:43:40.485145 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๠ queue_depth=3681 I1117 09:43:40.485282 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๡ queue_depth=3682 I1117 09:43:40.485415 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๢ queue_depth=3683 I1117 09:43:40.485548 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๣ queue_depth=3684 I1117 09:43:40.485685 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๤ queue_depth=3685 I1117 09:43:40.485822 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๥ queue_depth=3686 I1117 09:43:40.485958 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๦ queue_depth=3687 I1117 09:43:40.486093 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๧ queue_depth=3688 I1117 09:43:40.486227 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๨ queue_depth=3689 I1117 09:43:40.486377 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๩ queue_depth=3690 I1117 09:43:40.486526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๪ queue_depth=3691 I1117 09:43:40.486666 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๫ queue_depth=3692 I1117 09:43:40.486813 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๬ queue_depth=3693 I1117 09:43:40.486954 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๭ queue_depth=3694 I1117 09:43:40.487089 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๮ queue_depth=3695 I1117 09:43:40.487222 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๯ queue_depth=3696 I1117 09:43:40.487356 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๰ queue_depth=3697 I1117 09:43:40.487491 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๱ queue_depth=3698 I1117 09:43:40.487624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๲ queue_depth=3699 I1117 09:43:40.487760 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๳ queue_depth=3700 I1117 09:43:40.487894 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๴ queue_depth=3701 I1117 09:43:40.488029 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๵ queue_depth=3702 I1117 09:43:40.488183 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๶ queue_depth=3703 I1117 09:43:40.488324 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๷ queue_depth=3704 I1117 09:43:40.488461 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๸ queue_depth=3705 I1117 09:43:40.488601 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๹ queue_depth=3706 I1117 09:43:40.488741 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๺ queue_depth=3707 I1117 09:43:40.488878 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๻ queue_depth=3708 I1117 09:43:40.489011 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๼ queue_depth=3709 I1117 09:43:40.489144 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๽ queue_depth=3710 I1117 09:43:40.489283 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๾ queue_depth=3711 I1117 09:43:40.489417 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=๿ queue_depth=3712 I1117 09:43:40.489560 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຀ queue_depth=3713 I1117 09:43:40.489698 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ກ queue_depth=3714 I1117 09:43:40.489838 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຂ queue_depth=3715 I1117 09:43:40.489977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຃ queue_depth=3716 I1117 09:43:40.490113 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຄ queue_depth=3717 I1117 09:43:40.490251 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຅ queue_depth=3718 I1117 09:43:40.490384 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຆ queue_depth=3719 I1117 09:43:40.490522 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ງ queue_depth=3720 I1117 09:43:40.490660 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຈ queue_depth=3721 I1117 09:43:40.490808 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຉ queue_depth=3722 I1117 09:43:40.490942 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຊ queue_depth=3723 I1117 09:43:40.491079 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຋ queue_depth=3724 I1117 09:43:40.491216 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຌ queue_depth=3725 I1117 09:43:40.491354 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຍ queue_depth=3726 I1117 09:43:40.491487 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຎ queue_depth=3727 I1117 09:43:40.491625 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຏ queue_depth=3728 I1117 09:43:40.491760 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຐ queue_depth=3729 I1117 09:43:40.491895 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຑ queue_depth=3730 I1117 09:43:40.492028 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຒ queue_depth=3731 I1117 09:43:40.492166 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຓ queue_depth=3732 I1117 09:43:40.492302 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ດ queue_depth=3733 I1117 09:43:40.492435 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຕ queue_depth=3734 I1117 09:43:40.492572 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຖ queue_depth=3735 I1117 09:43:40.492726 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ທ queue_depth=3736 I1117 09:43:40.492876 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຘ queue_depth=3737 I1117 09:43:40.493016 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ນ queue_depth=3738 I1117 09:43:40.493156 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ບ queue_depth=3739 I1117 09:43:40.493293 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ປ queue_depth=3740 I1117 09:43:40.493429 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຜ queue_depth=3741 I1117 09:43:40.493564 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຝ queue_depth=3742 I1117 09:43:40.493697 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ພ queue_depth=3743 I1117 09:43:40.493833 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຟ queue_depth=3744 I1117 09:43:40.493967 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຠ queue_depth=3745 I1117 09:43:40.494101 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ມ queue_depth=3746 I1117 09:43:40.494240 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຢ queue_depth=3747 I1117 09:43:40.494379 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຣ queue_depth=3748 I1117 09:43:40.494514 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຤ queue_depth=3749 I1117 09:43:40.494651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ລ queue_depth=3750 I1117 09:43:40.494785 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຦ queue_depth=3751 I1117 09:43:40.494922 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ວ queue_depth=3752 I1117 09:43:40.495061 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຨ queue_depth=3753 I1117 09:43:40.495197 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຩ queue_depth=3754 I1117 09:43:40.495330 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ສ queue_depth=3755 I1117 09:43:40.495463 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຫ queue_depth=3756 I1117 09:43:40.495600 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຬ queue_depth=3757 I1117 09:43:40.495743 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ອ queue_depth=3758 I1117 09:43:40.495881 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຮ queue_depth=3759 I1117 09:43:40.496013 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຯ queue_depth=3760 I1117 09:43:40.496147 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ະ queue_depth=3761 I1117 09:43:40.496285 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ັ queue_depth=3762 I1117 09:43:40.496429 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=າ queue_depth=3763 I1117 09:43:40.496683 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຳ queue_depth=3764 I1117 09:43:40.496824 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ິ queue_depth=3765 I1117 09:43:40.496966 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ີ queue_depth=3766 I1117 09:43:40.497104 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຶ queue_depth=3767 I1117 09:43:40.497242 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ື queue_depth=3768 I1117 09:43:40.497399 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຸ queue_depth=3769 I1117 09:43:40.497541 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ູ queue_depth=3770 I1117 09:43:40.497681 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຺ queue_depth=3771 I1117 09:43:40.497817 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ົ queue_depth=3772 I1117 09:43:40.497964 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຼ queue_depth=3773 I1117 09:43:40.498099 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ຽ queue_depth=3774 I1117 09:43:40.498249 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຾ queue_depth=3775 I1117 09:43:40.498389 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=຿ queue_depth=3776 I1117 09:43:40.498526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ເ queue_depth=3777 I1117 09:43:40.498658 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ແ queue_depth=3778 I1117 09:43:40.498791 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໂ queue_depth=3779 I1117 09:43:40.498927 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໃ queue_depth=3780 I1117 09:43:40.499066 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໄ queue_depth=3781 I1117 09:43:40.499202 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໅ queue_depth=3782 I1117 09:43:40.499337 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໆ queue_depth=3783 I1117 09:43:40.499469 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໇ queue_depth=3784 I1117 09:43:40.499606 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=່ queue_depth=3785 I1117 09:43:40.499751 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=້ queue_depth=3786 I1117 09:43:40.499890 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໊ queue_depth=3787 I1117 09:43:40.500027 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໋ queue_depth=3788 I1117 09:43:40.500162 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໌ queue_depth=3789 I1117 09:43:40.500300 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໍ queue_depth=3790 I1117 09:43:40.500447 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໎ queue_depth=3791 I1117 09:43:40.500584 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໏ queue_depth=3792 I1117 09:43:40.500718 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໐ queue_depth=3793 I1117 09:43:40.500865 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໑ queue_depth=3794 I1117 09:43:40.501004 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໒ queue_depth=3795 I1117 09:43:40.501138 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໓ queue_depth=3796 I1117 09:43:40.501270 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໔ queue_depth=3797 I1117 09:43:40.501407 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໕ queue_depth=3798 I1117 09:43:40.501543 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໖ queue_depth=3799 I1117 09:43:40.501677 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໗ queue_depth=3800 I1117 09:43:40.501810 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໘ queue_depth=3801 I1117 09:43:40.501969 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໙ queue_depth=3802 I1117 09:43:40.502108 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໚ queue_depth=3803 I1117 09:43:40.502254 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໛ queue_depth=3804 I1117 09:43:40.502388 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໜ queue_depth=3805 I1117 09:43:40.502524 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໝ queue_depth=3806 I1117 09:43:40.502660 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໞ queue_depth=3807 I1117 09:43:40.502799 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ໟ queue_depth=3808 I1117 09:43:40.502933 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໠ queue_depth=3809 I1117 09:43:40.503074 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໡ queue_depth=3810 I1117 09:43:40.503210 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໢ queue_depth=3811 I1117 09:43:40.503347 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໣ queue_depth=3812 I1117 09:43:40.503482 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໤ queue_depth=3813 I1117 09:43:40.503621 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໥ queue_depth=3814 I1117 09:43:40.503759 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໦ queue_depth=3815 I1117 09:43:40.503894 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໧ queue_depth=3816 I1117 09:43:40.504030 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໨ queue_depth=3817 I1117 09:43:40.504166 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໩ queue_depth=3818 I1117 09:43:40.504299 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໪ queue_depth=3819 I1117 09:43:40.504434 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໫ queue_depth=3820 I1117 09:43:40.504572 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໬ queue_depth=3821 I1117 09:43:40.504711 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໭ queue_depth=3822 I1117 09:43:40.504845 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໮ queue_depth=3823 I1117 09:43:40.504981 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໯ queue_depth=3824 I1117 09:43:40.505116 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໰ queue_depth=3825 I1117 09:43:40.505252 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໱ queue_depth=3826 I1117 09:43:40.505391 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໲ queue_depth=3827 I1117 09:43:40.505526 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໳ queue_depth=3828 I1117 09:43:40.505659 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໴ queue_depth=3829 I1117 09:43:40.505794 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໵ queue_depth=3830 I1117 09:43:40.505933 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໶ queue_depth=3831 I1117 09:43:40.506070 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໷ queue_depth=3832 I1117 09:43:40.506207 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໸ queue_depth=3833 I1117 09:43:40.506342 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໹ queue_depth=3834 I1117 09:43:40.506505 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໺ queue_depth=3835 I1117 09:43:40.506643 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໻ queue_depth=3836 I1117 09:43:40.506778 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໼ queue_depth=3837 I1117 09:43:40.506912 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໽ queue_depth=3838 I1117 09:43:40.507048 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໾ queue_depth=3839 I1117 09:43:40.507195 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=໿ queue_depth=3840 I1117 09:43:40.507334 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ༀ queue_depth=3841 I1117 09:43:40.507470 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༁ queue_depth=3842 I1117 09:43:40.507604 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༂ queue_depth=3843 I1117 09:43:40.507737 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༃ queue_depth=3844 I1117 09:43:40.507870 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༄ queue_depth=3845 I1117 09:43:40.508009 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༅ queue_depth=3846 I1117 09:43:40.508157 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༆ queue_depth=3847 I1117 09:43:40.508294 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༇ queue_depth=3848 I1117 09:43:40.508430 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༈ queue_depth=3849 I1117 09:43:40.508569 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༉ queue_depth=3850 I1117 09:43:40.508702 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༊ queue_depth=3851 I1117 09:43:40.508838 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=་ queue_depth=3852 I1117 09:43:40.508973 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༌ queue_depth=3853 I1117 09:43:40.509110 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=། queue_depth=3854 I1117 09:43:40.509245 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༎ queue_depth=3855 I1117 09:43:40.509383 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༏ queue_depth=3856 I1117 09:43:40.509521 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༐ queue_depth=3857 I1117 09:43:40.509659 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༑ queue_depth=3858 I1117 09:43:40.509803 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༒ queue_depth=3859 I1117 09:43:40.509957 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༓ queue_depth=3860 I1117 09:43:40.510096 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༔ queue_depth=3861 I1117 09:43:40.510233 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༕ queue_depth=3862 I1117 09:43:40.510371 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༖ queue_depth=3863 I1117 09:43:40.510516 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༗ queue_depth=3864 I1117 09:43:40.510651 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༘ queue_depth=3865 I1117 09:43:40.510788 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༙ queue_depth=3866 I1117 09:43:40.510921 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༚ queue_depth=3867 I1117 09:43:40.511080 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༛ queue_depth=3868 I1117 09:43:40.511220 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༜ queue_depth=3869 I1117 09:43:40.511355 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༝ queue_depth=3870 I1117 09:43:40.511490 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༞ queue_depth=3871 I1117 09:43:40.511644 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༟ queue_depth=3872 I1117 09:43:40.511809 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༠ queue_depth=3873 I1117 09:43:40.511977 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༡ queue_depth=3874 I1117 09:43:40.512141 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༢ queue_depth=3875 I1117 09:43:40.512306 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༣ queue_depth=3876 I1117 09:43:40.512472 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༤ queue_depth=3877 I1117 09:43:40.512640 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༥ queue_depth=3878 I1117 09:43:40.512807 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༦ queue_depth=3879 I1117 09:43:40.512974 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༧ queue_depth=3880 I1117 09:43:40.513149 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༨ queue_depth=3881 I1117 09:43:40.513313 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༩ queue_depth=3882 I1117 09:43:40.513482 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༪ queue_depth=3883 I1117 09:43:40.513650 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༫ queue_depth=3884 I1117 09:43:40.513819 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༬ queue_depth=3885 I1117 09:43:40.513987 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༭ queue_depth=3886 I1117 09:43:40.514153 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༮ queue_depth=3887 I1117 09:43:40.514318 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༯ queue_depth=3888 I1117 09:43:40.514490 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༰ queue_depth=3889 I1117 09:43:40.514657 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༱ queue_depth=3890 I1117 09:43:40.514828 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༲ queue_depth=3891 I1117 09:43:40.515003 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༳ queue_depth=3892 I1117 09:43:40.515173 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༴ queue_depth=3893 I1117 09:43:40.515338 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༵ queue_depth=3894 I1117 09:43:40.515502 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༶ queue_depth=3895 I1117 09:43:40.515665 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༷ queue_depth=3896 I1117 09:43:40.515831 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༸ queue_depth=3897 I1117 09:43:40.515996 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༹ queue_depth=3898 I1117 09:43:40.516165 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༺ queue_depth=3899 I1117 09:43:40.516332 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༻ queue_depth=3900 I1117 09:43:40.516537 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༼ queue_depth=3901 I1117 09:43:40.516784 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༽ queue_depth=3902 I1117 09:43:40.516951 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༾ queue_depth=3903 I1117 09:43:40.517118 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=༿ queue_depth=3904 I1117 09:43:40.517260 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཀ queue_depth=3905 I1117 09:43:40.517397 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཁ queue_depth=3906 I1117 09:43:40.517533 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ག queue_depth=3907 I1117 09:43:40.517681 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=གྷ queue_depth=3908 I1117 09:43:40.517820 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ང queue_depth=3909 I1117 09:43:40.517955 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཅ queue_depth=3910 I1117 09:43:40.518107 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཆ queue_depth=3911 I1117 09:43:40.518245 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཇ queue_depth=3912 I1117 09:43:40.518380 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=཈ queue_depth=3913 I1117 09:43:40.518514 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཉ queue_depth=3914 I1117 09:43:40.518652 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཊ queue_depth=3915 I1117 09:43:40.518808 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཋ queue_depth=3916 I1117 09:43:40.518944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཌ queue_depth=3917 I1117 09:43:40.519095 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཌྷ queue_depth=3918 I1117 09:43:40.519228 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཎ queue_depth=3919 I1117 09:43:40.519363 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཏ queue_depth=3920 I1117 09:43:40.519498 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཐ queue_depth=3921 I1117 09:43:40.519636 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ད queue_depth=3922 I1117 09:43:40.519787 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=དྷ queue_depth=3923 I1117 09:43:40.519931 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ན queue_depth=3924 I1117 09:43:40.520064 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=པ queue_depth=3925 I1117 09:43:40.520200 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཕ queue_depth=3926 I1117 09:43:40.520337 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=བ queue_depth=3927 I1117 09:43:40.520473 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=བྷ queue_depth=3928 I1117 09:43:40.520623 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=མ queue_depth=3929 I1117 09:43:40.520763 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཙ queue_depth=3930 I1117 09:43:40.520899 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཚ queue_depth=3931 I1117 09:43:40.521049 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཛ queue_depth=3932 I1117 09:43:40.521184 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཛྷ queue_depth=3933 I1117 09:43:40.521342 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཝ queue_depth=3934 I1117 09:43:40.521477 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཞ queue_depth=3935 I1117 09:43:40.521612 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཟ queue_depth=3936 I1117 09:43:40.521749 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=འ queue_depth=3937 I1117 09:43:40.521891 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཡ queue_depth=3938 I1117 09:43:40.522026 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ར queue_depth=3939 I1117 09:43:40.522165 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ལ queue_depth=3940 I1117 09:43:40.522301 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཤ queue_depth=3941 I1117 09:43:40.522439 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཥ queue_depth=3942 I1117 09:43:40.522574 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ས queue_depth=3943 I1117 09:43:40.522711 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཧ queue_depth=3944 I1117 09:43:40.522846 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཨ queue_depth=3945 I1117 09:43:40.522978 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཀྵ queue_depth=3946 I1117 09:43:40.523124 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཪ queue_depth=3947 I1117 09:43:40.523260 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཫ queue_depth=3948 I1117 09:43:40.523392 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཬ queue_depth=3949 I1117 09:43:40.523524 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=཭ queue_depth=3950 I1117 09:43:40.523656 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=཮ queue_depth=3951 I1117 09:43:40.523794 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=཯ queue_depth=3952 I1117 09:43:40.523944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=཰ queue_depth=3953 I1117 09:43:40.524082 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཱ queue_depth=3954 I1117 09:43:40.524217 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ི queue_depth=3955 I1117 09:43:40.524357 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཱི queue_depth=3956 I1117 09:43:40.524494 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ུ queue_depth=3957 I1117 09:43:40.524640 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཱུ queue_depth=3958 I1117 09:43:40.524773 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྲྀ queue_depth=3959 I1117 09:43:40.524907 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཷ queue_depth=3960 I1117 09:43:40.525042 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ླྀ queue_depth=3961 I1117 09:43:40.525175 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཹ queue_depth=3962 I1117 09:43:40.525311 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ེ queue_depth=3963 I1117 09:43:40.525443 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཻ queue_depth=3964 I1117 09:43:40.525578 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ོ queue_depth=3965 I1117 09:43:40.525714 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཽ queue_depth=3966 I1117 09:43:40.525867 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཾ queue_depth=3967 I1117 09:43:40.526004 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཿ queue_depth=3968 I1117 09:43:40.526141 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྀ queue_depth=3969 I1117 09:43:40.526277 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ཱྀ queue_depth=3970 I1117 09:43:40.526423 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྂ queue_depth=3971 I1117 09:43:40.526560 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྃ queue_depth=3972 I1117 09:43:40.526698 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=྄ queue_depth=3973 I1117 09:43:40.526833 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=྅ queue_depth=3974 I1117 09:43:40.526970 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=྆ queue_depth=3975 I1117 09:43:40.527102 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=྇ queue_depth=3976 I1117 09:43:40.527238 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྈ queue_depth=3977 I1117 09:43:40.527377 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྉ queue_depth=3978 I1117 09:43:40.527525 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྊ queue_depth=3979 I1117 09:43:40.527664 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྋ queue_depth=3980 I1117 09:43:40.527798 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྌ queue_depth=3981 I1117 09:43:40.527934 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྍ queue_depth=3982 I1117 09:43:40.528068 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྎ queue_depth=3983 I1117 09:43:40.528202 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྏ queue_depth=3984 I1117 09:43:40.528340 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྐ queue_depth=3985 I1117 09:43:40.528489 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྑ queue_depth=3986 I1117 09:43:40.528624 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྒ queue_depth=3987 I1117 09:43:40.528759 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྒྷ queue_depth=3988 I1117 09:43:40.528899 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྔ queue_depth=3989 I1117 09:43:40.529034 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྕ queue_depth=3990 I1117 09:43:40.529169 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྖ queue_depth=3991 I1117 09:43:40.529302 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྗ queue_depth=3992 I1117 09:43:40.529453 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=྘ queue_depth=3993 I1117 09:43:40.529589 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྙ queue_depth=3994 I1117 09:43:40.529731 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྚ queue_depth=3995 I1117 09:43:40.529867 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྛ queue_depth=3996 I1117 09:43:40.530004 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྜ queue_depth=3997 I1117 09:43:40.530142 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྜྷ queue_depth=3998 I1117 09:43:40.530289 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྞ queue_depth=3999 I1117 09:43:40.530447 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྟ queue_depth=4000 I1117 09:43:40.530583 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྠ queue_depth=4001 I1117 09:43:40.530717 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྡ queue_depth=4002 I1117 09:43:40.530856 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྡྷ queue_depth=4003 I1117 09:43:40.530996 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྣ queue_depth=4004 I1117 09:43:40.531131 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྤ queue_depth=4005 I1117 09:43:40.531266 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྥ queue_depth=4006 I1117 09:43:40.531401 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྦ queue_depth=4007 I1117 09:43:40.531534 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྦྷ queue_depth=4008 I1117 09:43:40.531672 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྨ queue_depth=4009 I1117 09:43:40.531808 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྩ queue_depth=4010 I1117 09:43:40.531944 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྪ queue_depth=4011 I1117 09:43:40.532078 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྫ queue_depth=4012 I1117 09:43:40.532212 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྫྷ queue_depth=4013 I1117 09:43:40.532349 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྭ queue_depth=4014 I1117 09:43:40.532483 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྮ queue_depth=4015 I1117 09:43:40.532621 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྯ queue_depth=4016 I1117 09:43:40.532754 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྰ queue_depth=4017 I1117 09:43:40.532890 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྱ queue_depth=4018 I1117 09:43:40.533030 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྲ queue_depth=4019 I1117 09:43:40.533170 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ླ queue_depth=4020 I1117 09:43:40.533304 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྴ queue_depth=4021 I1117 09:43:40.533439 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྵ queue_depth=4022 I1117 09:43:40.533575 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྶ queue_depth=4023 I1117 09:43:40.533724 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྷ queue_depth=4024 I1117 09:43:40.533860 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྸ queue_depth=4025 I1117 09:43:40.533996 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྐྵ queue_depth=4026 I1117 09:43:40.534128 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྺ queue_depth=4027 I1117 09:43:40.534263 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྻ queue_depth=4028 I1117 09:43:40.534400 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=ྼ queue_depth=4029 I1117 09:43:40.534535 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=྽ queue_depth=4030 I1117 09:43:40.534667 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=྾ queue_depth=4031 I1117 09:43:40.534801 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=྿ queue_depth=4032 I1117 09:43:40.534960 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿀ queue_depth=4033 I1117 09:43:40.535099 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿁ queue_depth=4034 I1117 09:43:40.535233 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿂ queue_depth=4035 I1117 09:43:40.535369 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿃ queue_depth=4036 I1117 09:43:40.535502 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿄ queue_depth=4037 I1117 09:43:40.535635 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿅ queue_depth=4038 I1117 09:43:40.535771 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿆ queue_depth=4039 I1117 09:43:40.535913 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿇ queue_depth=4040 I1117 09:43:40.536049 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿈ queue_depth=4041 I1117 09:43:40.536186 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿉ queue_depth=4042 I1117 09:43:40.536331 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿊ queue_depth=4043 I1117 09:43:40.536474 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿋ queue_depth=4044 I1117 09:43:40.536610 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿌ queue_depth=4045 I1117 09:43:40.536996 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿍ queue_depth=4046 I1117 09:43:40.537144 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿎ queue_depth=4047 I1117 09:43:40.537282 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿏ queue_depth=4048 I1117 09:43:40.537416 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿐ queue_depth=4049 I1117 09:43:40.537549 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿑ queue_depth=4050 I1117 09:43:40.537686 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿒ queue_depth=4051 I1117 09:43:40.537821 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿓ queue_depth=4052 I1117 09:43:40.537956 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿔ queue_depth=4053 I1117 09:43:40.538092 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿕ queue_depth=4054 I1117 09:43:40.538229 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿖ queue_depth=4055 I1117 09:43:40.538364 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿗ queue_depth=4056 I1117 09:43:40.538511 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿘ queue_depth=4057 I1117 09:43:40.538646 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿙ queue_depth=4058 I1117 09:43:40.538781 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿚ queue_depth=4059 I1117 09:43:40.538916 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿛ queue_depth=4060 I1117 09:43:40.539052 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿜ queue_depth=4061 I1117 09:43:40.539187 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿝ queue_depth=4062 I1117 09:43:40.539322 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿞ queue_depth=4063 I1117 09:43:40.539460 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿟ queue_depth=4064 I1117 09:43:40.539595 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿠ queue_depth=4065 I1117 09:43:40.539756 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿡ queue_depth=4066 I1117 09:43:40.539894 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿢ queue_depth=4067 I1117 09:43:40.540027 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿣ queue_depth=4068 I1117 09:43:40.540162 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿤ queue_depth=4069 I1117 09:43:40.540298 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿥ queue_depth=4070 I1117 09:43:40.540432 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿦ queue_depth=4071 I1117 09:43:40.540573 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿧ queue_depth=4072 I1117 09:43:40.540710 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿨ queue_depth=4073 I1117 09:43:40.540848 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿩ queue_depth=4074 I1117 09:43:40.540988 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿪ queue_depth=4075 I1117 09:43:40.541126 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿫ queue_depth=4076 I1117 09:43:40.541261 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿬ queue_depth=4077 I1117 09:43:40.541401 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿭ queue_depth=4078 I1117 09:43:40.541536 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿮ queue_depth=4079 I1117 09:43:40.541671 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿯ queue_depth=4080 I1117 09:43:40.541805 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿰ queue_depth=4081 I1117 09:43:40.541938 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿱ queue_depth=4082 I1117 09:43:40.542075 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿲ queue_depth=4083 I1117 09:43:40.542211 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿳ queue_depth=4084 I1117 09:43:40.542344 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿴ queue_depth=4085 I1117 09:43:40.542481 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿵ queue_depth=4086 I1117 09:43:40.542615 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿶ queue_depth=4087 I1117 09:43:40.542763 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿷ queue_depth=4088 I1117 09:43:40.542899 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿸ queue_depth=4089 I1117 09:43:40.543044 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿹ queue_depth=4090 I1117 09:43:40.543186 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿺ queue_depth=4091 I1117 09:43:40.543323 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿻ queue_depth=4092 I1117 09:43:40.543460 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿼ queue_depth=4093 I1117 09:43:40.543609 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿽ queue_depth=4094 I1117 09:43:40.543745 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿾ queue_depth=4095 I1117 09:43:40.543881 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=࿿ queue_depth=4096 W1117 09:43:40.544168 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=က capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.544343 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ခ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.544498 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဂ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.544636 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဃ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.544769 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=င capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.544901 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=စ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.545033 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဆ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.545165 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဇ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.545296 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဈ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.545430 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဉ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.545562 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ည capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.545694 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဋ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.545827 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဌ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.545958 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဍ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.546091 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဎ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.546238 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဏ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.546374 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=တ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.546515 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ထ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.546650 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဒ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.546787 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဓ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.546922 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=န capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.547053 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ပ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.547187 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဖ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.547319 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဗ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.547450 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဘ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.547586 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=မ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.547717 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ယ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.547849 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ရ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.547981 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=လ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.548114 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဝ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.548246 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=သ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.548381 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဟ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.548514 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဠ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.548646 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=အ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.548781 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဢ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.548942 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဣ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.549077 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဤ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.549208 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဥ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.549344 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဦ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.549476 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဧ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.549610 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဨ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.549749 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဩ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.549882 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ဪ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.550014 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ါ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.550148 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ာ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.550280 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ိ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.550411 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ီ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.550544 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ု capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.550676 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ူ capacity=4096 (candidate dropped; read-path heal still covers it) W1117 09:43:40.550808 s3api_versioning_reconciler.go:50 [versioning-heal] event=queue_full bucket=b key=ေ capacity=4096 (candidate dropped; read-path heal still covers it) --- PASS: TestVersionsHealQueue_CapacityCap (0.59s) === RUN TestVersionsHealQueue_PopReadyOnlyDueItems I1117 09:43:40.551826 s3api_versioning_reconciler.go:46 [versioning-heal] event=enqueue bucket=b key=due queue_depth=1 --- PASS: TestVersionsHealQueue_PopReadyOnlyDueItems (0.00s) === RUN TestVersionsHealQueue_RequeueWithBackoff --- PASS: TestVersionsHealQueue_RequeueWithBackoff (0.00s) === RUN TestVersionsHealQueue_GiveUpAfterMaxAttempts W1117 09:43:40.554831 s3api_versioning_reconciler.go:50 [versioning-heal] event=gave_up bucket=b key=obj attempts=6 (read-path heal will still recover) --- PASS: TestVersionsHealQueue_GiveUpAfterMaxAttempts (0.00s) === RUN TestRetryFilerOp_SucceedsBeforeExhaustion --- PASS: TestRetryFilerOp_SucceedsBeforeExhaustion (0.30s) === RUN TestRetryFilerOp_PropagatesAfterExhaustion --- PASS: TestRetryFilerOp_PropagatesAfterExhaustion (3.10s) === RUN TestRetryFilerOp_ContextCancelInterruptsBackoff --- PASS: TestRetryFilerOp_ContextCancelInterruptsBackoff (0.03s) === RUN TestRetryFilerOp_TerminalErrorsShortCircuit === RUN TestRetryFilerOp_TerminalErrorsShortCircuit/filer_pb.ErrNotFound === RUN TestRetryFilerOp_TerminalErrorsShortCircuit/wrapped_filer_pb.ErrNotFound === RUN TestRetryFilerOp_TerminalErrorsShortCircuit/grpc_NotFound_status === RUN TestRetryFilerOp_TerminalErrorsShortCircuit/context_canceled === RUN TestRetryFilerOp_TerminalErrorsShortCircuit/context_deadline_exceeded --- PASS: TestRetryFilerOp_TerminalErrorsShortCircuit (0.00s) --- PASS: TestRetryFilerOp_TerminalErrorsShortCircuit/filer_pb.ErrNotFound (0.00s) --- PASS: TestRetryFilerOp_TerminalErrorsShortCircuit/wrapped_filer_pb.ErrNotFound (0.00s) --- PASS: TestRetryFilerOp_TerminalErrorsShortCircuit/grpc_NotFound_status (0.00s) --- PASS: TestRetryFilerOp_TerminalErrorsShortCircuit/context_canceled (0.00s) --- PASS: TestRetryFilerOp_TerminalErrorsShortCircuit/context_deadline_exceeded (0.00s) === RUN TestFilerRetryBudget_ClampsToWhatIsLeft --- PASS: TestFilerRetryBudget_ClampsToWhatIsLeft (0.00s) === RUN TestFilerRetryRequestBudget_MatchesOneOpWorstCase --- PASS: TestFilerRetryRequestBudget_MatchesOneOpWorstCase (0.00s) === RUN TestRetryFilerOp_SharedBudgetAcrossBatch --- PASS: TestRetryFilerOp_SharedBudgetAcrossBatch (0.27s) === RUN TestRetryFilerOp_SpentBudgetStopsAfterFirstAttempt --- PASS: TestRetryFilerOp_SpentBudgetStopsAfterFirstAttempt (0.00s) === RUN TestXMLTimestampsHaveFixedMilliseconds --- PASS: TestXMLTimestampsHaveFixedMilliseconds (0.01s) === RUN TestXMLTimestampRoundTrip --- PASS: TestXMLTimestampRoundTrip (0.00s) === RUN TestMultipartSSES3RealisticEndToEnd --- PASS: TestMultipartSSES3RealisticEndToEnd (29.43s) === RUN TestBuildMultipartSSES3Reader_LazyChunkFetch --- PASS: TestBuildMultipartSSES3Reader_LazyChunkFetch (0.03s) === RUN TestTrackAuditFallbackForDirectWriteHeader --- PASS: TestTrackAuditFallbackForDirectWriteHeader (0.00s) === RUN TestTrackAuditSkipsFallbackWhenHandlerEmits --- PASS: TestTrackAuditSkipsFallbackWhenHandlerEmits (0.00s) === RUN TestComputePackedPolicySize === RUN TestComputePackedPolicySize/empty_->_nil === RUN TestComputePackedPolicySize/tiny_policy_->_0% === RUN TestComputePackedPolicySize/half_budget_->_50% === RUN TestComputePackedPolicySize/full_budget_->_100% === RUN TestComputePackedPolicySize/oversized_->_capped_at_100 --- PASS: TestComputePackedPolicySize (0.00s) --- PASS: TestComputePackedPolicySize/empty_->_nil (0.00s) --- PASS: TestComputePackedPolicySize/tiny_policy_->_0% (0.00s) --- PASS: TestComputePackedPolicySize/half_budget_->_50% (0.00s) --- PASS: TestComputePackedPolicySize/full_budget_->_100% (0.00s) --- PASS: TestComputePackedPolicySize/oversized_->_capped_at_100 (0.00s) === RUN TestSTSAssumeRolePostBody === RUN TestSTSAssumeRolePostBody/ActionInQuery === RUN TestSTSAssumeRolePostBody/ActionInBody === RUN TestSTSAssumeRolePostBody/ActionInBodyWithSigV4Style E1117 09:44:13.893749 s3api_embedded_iam.go:363 IAM Response The difference between the request time and the server's time is too large. --- PASS: TestSTSAssumeRolePostBody (0.14s) --- PASS: TestSTSAssumeRolePostBody/ActionInQuery (0.00s) --- PASS: TestSTSAssumeRolePostBody/ActionInBody (0.01s) --- PASS: TestSTSAssumeRolePostBody/ActionInBodyWithSigV4Style (0.01s) === RUN TestValidateRoleSessionName === RUN TestValidateRoleSessionName/empty_rejected === RUN TestValidateRoleSessionName/single_char_rejected_(below_min_len_2) === RUN TestValidateRoleSessionName/min_length_2_accepted === RUN TestValidateRoleSessionName/plain_ascii_accepted === RUN TestValidateRoleSessionName/all_special_chars_allowed === RUN TestValidateRoleSessionName/email-style_accepted === RUN TestValidateRoleSessionName/max_length_64_accepted === RUN TestValidateRoleSessionName/max_length_64_valid_charset_accepted === RUN TestValidateRoleSessionName/length_65_rejected === RUN TestValidateRoleSessionName/space_rejected === RUN TestValidateRoleSessionName/slash_rejected === RUN TestValidateRoleSessionName/colon_rejected === RUN TestValidateRoleSessionName/unicode_rejected --- PASS: TestValidateRoleSessionName (0.01s) --- PASS: TestValidateRoleSessionName/empty_rejected (0.00s) --- PASS: TestValidateRoleSessionName/single_char_rejected_(below_min_len_2) (0.00s) --- PASS: TestValidateRoleSessionName/min_length_2_accepted (0.00s) --- PASS: TestValidateRoleSessionName/plain_ascii_accepted (0.00s) --- PASS: TestValidateRoleSessionName/all_special_chars_allowed (0.00s) --- PASS: TestValidateRoleSessionName/email-style_accepted (0.00s) --- PASS: TestValidateRoleSessionName/max_length_64_accepted (0.00s) --- PASS: TestValidateRoleSessionName/max_length_64_valid_charset_accepted (0.00s) --- PASS: TestValidateRoleSessionName/length_65_rejected (0.00s) --- PASS: TestValidateRoleSessionName/space_rejected (0.00s) --- PASS: TestValidateRoleSessionName/slash_rejected (0.00s) --- PASS: TestValidateRoleSessionName/colon_rejected (0.00s) --- PASS: TestValidateRoleSessionName/unicode_rejected (0.00s) === RUN TestTableBucketAcceptsExternalVolumeVerifyKey --- PASS: TestTableBucketAcceptsExternalVolumeVerifyKey (0.00s) === RUN TestTableBucketRefusesVerifyKeyLookalikes --- PASS: TestTableBucketRefusesVerifyKeyLookalikes (0.00s) === RUN TestTableBucketVerifyKeyPutLimits --- PASS: TestTableBucketVerifyKeyPutLimits (0.02s) === RUN TestTableBucketVerifyKeyNamingDirectoryIsRefused --- PASS: TestTableBucketVerifyKeyNamingDirectoryIsRefused (0.00s) === RUN TestParseTagsHeader === RUN TestParseTagsHeader/simple_tags === RUN TestParseTagsHeader/URL_encoded_timestamp_-_issue_#7040_scenario === RUN TestParseTagsHeader/URL_encoded_key_and_value === RUN TestParseTagsHeader/empty_value === RUN TestParseTagsHeader/special_characters_encoded === RUN TestParseTagsHeader/invalid_URL_encoding === RUN TestParseTagsHeader/duplicate_key === RUN TestParseTagsHeader/encoded_duplicate_key === RUN TestParseTagsHeader/plus_signs_and_equals_in_values === RUN TestParseTagsHeader/empty_segments_add_no_tag === RUN TestParseTagsHeader/unescaped_equals_in_value --- PASS: TestParseTagsHeader (0.01s) --- PASS: TestParseTagsHeader/simple_tags (0.00s) --- PASS: TestParseTagsHeader/URL_encoded_timestamp_-_issue_#7040_scenario (0.00s) --- PASS: TestParseTagsHeader/URL_encoded_key_and_value (0.00s) --- PASS: TestParseTagsHeader/empty_value (0.00s) --- PASS: TestParseTagsHeader/special_characters_encoded (0.00s) --- PASS: TestParseTagsHeader/invalid_URL_encoding (0.00s) --- PASS: TestParseTagsHeader/duplicate_key (0.00s) --- PASS: TestParseTagsHeader/encoded_duplicate_key (0.00s) --- PASS: TestParseTagsHeader/plus_signs_and_equals_in_values (0.00s) --- PASS: TestParseTagsHeader/empty_segments_add_no_tag (0.00s) --- PASS: TestParseTagsHeader/unescaped_equals_in_value (0.00s) === RUN TestValidateTagsUnicodeLength --- PASS: TestValidateTagsUnicodeLength (0.00s) FAIL FAIL github.com/seaweedfs/seaweedfs/weed/s3api 223.107s === RUN TestValidateConfiguration === RUN TestValidateConfiguration/nil_config === RUN TestValidateConfiguration/empty_rules === RUN TestValidateConfiguration/valid_single_rule === RUN TestValidateConfiguration/too_many_rules === RUN TestValidateConfiguration/invalid_method === RUN TestValidateConfiguration/empty_origins === RUN TestValidateConfiguration/invalid_origin_with_multiple_wildcards === RUN TestValidateConfiguration/negative_MaxAgeSeconds --- PASS: TestValidateConfiguration (0.18s) --- PASS: TestValidateConfiguration/nil_config (0.00s) --- PASS: TestValidateConfiguration/empty_rules (0.00s) --- PASS: TestValidateConfiguration/valid_single_rule (0.00s) --- PASS: TestValidateConfiguration/too_many_rules (0.00s) --- PASS: TestValidateConfiguration/invalid_method (0.00s) --- PASS: TestValidateConfiguration/empty_origins (0.00s) --- PASS: TestValidateConfiguration/invalid_origin_with_multiple_wildcards (0.00s) --- PASS: TestValidateConfiguration/negative_MaxAgeSeconds (0.00s) === RUN TestValidateOrigin === RUN TestValidateOrigin/empty_origin === RUN TestValidateOrigin/valid_origin === RUN TestValidateOrigin/wildcard_origin === RUN TestValidateOrigin/valid_wildcard_origin === RUN TestValidateOrigin/https_wildcard_origin === RUN TestValidateOrigin/invalid_wildcard_origin === RUN TestValidateOrigin/multiple_wildcards --- PASS: TestValidateOrigin (0.01s) --- PASS: TestValidateOrigin/empty_origin (0.00s) --- PASS: TestValidateOrigin/valid_origin (0.00s) --- PASS: TestValidateOrigin/wildcard_origin (0.00s) --- PASS: TestValidateOrigin/valid_wildcard_origin (0.00s) --- PASS: TestValidateOrigin/https_wildcard_origin (0.00s) --- PASS: TestValidateOrigin/invalid_wildcard_origin (0.00s) --- PASS: TestValidateOrigin/multiple_wildcards (0.00s) === RUN TestParseRequest === RUN TestParseRequest/simple_GET_request === RUN TestParseRequest/OPTIONS_preflight_request === RUN TestParseRequest/request_without_origin --- PASS: TestParseRequest (0.01s) --- PASS: TestParseRequest/simple_GET_request (0.00s) --- PASS: TestParseRequest/OPTIONS_preflight_request (0.00s) --- PASS: TestParseRequest/request_without_origin (0.00s) === RUN TestMatchesOrigin === RUN TestMatchesOrigin/wildcard_match === RUN TestMatchesOrigin/exact_match === RUN TestMatchesOrigin/no_match === RUN TestMatchesOrigin/wildcard_subdomain_match === RUN TestMatchesOrigin/wildcard_subdomain_no_match === RUN TestMatchesOrigin/multiple_origins_with_match === RUN TestMatchesOrigin/https_exact_match === RUN TestMatchesOrigin/https_no_match === RUN TestMatchesOrigin/https_wildcard_subdomain_match === RUN TestMatchesOrigin/https_wildcard_subdomain_no_match_-_base_domain === RUN TestMatchesOrigin/https_wildcard_subdomain_no_match_-_different_domain === RUN TestMatchesOrigin/protocol_mismatch_-_http_pattern_https_origin === RUN TestMatchesOrigin/protocol_mismatch_-_https_pattern_http_origin --- PASS: TestMatchesOrigin (0.01s) --- PASS: TestMatchesOrigin/wildcard_match (0.00s) --- PASS: TestMatchesOrigin/exact_match (0.00s) --- PASS: TestMatchesOrigin/no_match (0.00s) --- PASS: TestMatchesOrigin/wildcard_subdomain_match (0.00s) --- PASS: TestMatchesOrigin/wildcard_subdomain_no_match (0.00s) --- PASS: TestMatchesOrigin/multiple_origins_with_match (0.00s) --- PASS: TestMatchesOrigin/https_exact_match (0.00s) --- PASS: TestMatchesOrigin/https_no_match (0.00s) --- PASS: TestMatchesOrigin/https_wildcard_subdomain_match (0.00s) --- PASS: TestMatchesOrigin/https_wildcard_subdomain_no_match_-_base_domain (0.00s) --- PASS: TestMatchesOrigin/https_wildcard_subdomain_no_match_-_different_domain (0.00s) --- PASS: TestMatchesOrigin/protocol_mismatch_-_http_pattern_https_origin (0.00s) --- PASS: TestMatchesOrigin/protocol_mismatch_-_https_pattern_http_origin (0.00s) === RUN TestMatchesHeader === RUN TestMatchesHeader/empty_allowed_headers === RUN TestMatchesHeader/wildcard_match === RUN TestMatchesHeader/exact_match === RUN TestMatchesHeader/case_insensitive_match === RUN TestMatchesHeader/no_match === RUN TestMatchesHeader/wildcard_prefix_match --- PASS: TestMatchesHeader (0.01s) --- PASS: TestMatchesHeader/empty_allowed_headers (0.00s) --- PASS: TestMatchesHeader/wildcard_match (0.00s) --- PASS: TestMatchesHeader/exact_match (0.00s) --- PASS: TestMatchesHeader/case_insensitive_match (0.00s) --- PASS: TestMatchesHeader/no_match (0.00s) --- PASS: TestMatchesHeader/wildcard_prefix_match (0.00s) === RUN TestEvaluateRequest === RUN TestEvaluateRequest/matching_first_rule === RUN TestEvaluateRequest/matching_second_rule === RUN TestEvaluateRequest/no_matching_rule === RUN TestEvaluateRequest/preflight_request === RUN TestEvaluateRequest/preflight_request_with_forbidden_header === RUN TestEvaluateRequest/wildcard_expose_headers_expands_for_credentialed_responses === RUN TestEvaluateRequest/request_without_origin --- PASS: TestEvaluateRequest (0.01s) --- PASS: TestEvaluateRequest/matching_first_rule (0.00s) --- PASS: TestEvaluateRequest/matching_second_rule (0.00s) --- PASS: TestEvaluateRequest/no_matching_rule (0.00s) --- PASS: TestEvaluateRequest/preflight_request (0.00s) --- PASS: TestEvaluateRequest/preflight_request_with_forbidden_header (0.00s) --- PASS: TestEvaluateRequest/wildcard_expose_headers_expands_for_credentialed_responses (0.00s) --- PASS: TestEvaluateRequest/request_without_origin (0.00s) === RUN TestApplyHeaders === RUN TestApplyHeaders/nil_response === RUN TestApplyHeaders/complete_response === RUN TestApplyHeaders/with_credentials --- PASS: TestApplyHeaders (0.01s) --- PASS: TestApplyHeaders/nil_response (0.00s) --- PASS: TestApplyHeaders/complete_response (0.00s) --- PASS: TestApplyHeaders/with_credentials (0.00s) === RUN TestMiddlewareNonExistentBucket === RUN TestMiddlewareNonExistentBucket/Preflight_request_to_non-existent_bucket_with_global_CORS_config === RUN TestMiddlewareNonExistentBucket/Actual_request_to_non-existent_bucket_with_global_CORS_config === RUN TestMiddlewareNonExistentBucket/Preflight_to_non-existent_bucket_with_specific_origin === RUN TestMiddlewareNonExistentBucket/Preflight_to_non-existent_bucket_with_non-matching_origin === RUN TestMiddlewareNonExistentBucket/Preflight_to_non-existent_bucket_without_CORS_config === RUN TestMiddlewareNonExistentBucket/Bucket_listing_request_to_non-existent_bucket_with_CORS --- PASS: TestMiddlewareNonExistentBucket (0.08s) --- PASS: TestMiddlewareNonExistentBucket/Preflight_request_to_non-existent_bucket_with_global_CORS_config (0.01s) --- PASS: TestMiddlewareNonExistentBucket/Actual_request_to_non-existent_bucket_with_global_CORS_config (0.00s) --- PASS: TestMiddlewareNonExistentBucket/Preflight_to_non-existent_bucket_with_specific_origin (0.01s) --- PASS: TestMiddlewareNonExistentBucket/Preflight_to_non-existent_bucket_with_non-matching_origin (0.03s) --- PASS: TestMiddlewareNonExistentBucket/Preflight_to_non-existent_bucket_without_CORS_config (0.01s) --- PASS: TestMiddlewareNonExistentBucket/Bucket_listing_request_to_non-existent_bucket_with_CORS (0.00s) === RUN TestMiddlewareConsistentBehavior === RUN TestMiddlewareConsistentBehavior/existing_bucket === RUN TestMiddlewareConsistentBehavior/non-existent_bucket --- PASS: TestMiddlewareConsistentBehavior (0.01s) --- PASS: TestMiddlewareConsistentBehavior/existing_bucket (0.00s) --- PASS: TestMiddlewareConsistentBehavior/non-existent_bucket (0.00s) === RUN TestMiddlewareFallbackConfig === RUN TestMiddlewareFallbackConfig/No_bucket_config,_fallback_to_global_config_with_wildcard === RUN TestMiddlewareFallbackConfig/No_bucket_config,_fallback_to_global_config_with_specific_origin === RUN TestMiddlewareFallbackConfig/No_bucket_config,_fallback_rejects_non-matching_origin === RUN TestMiddlewareFallbackConfig/Bucket_config_takes_precedence_over_fallback === RUN TestMiddlewareFallbackConfig/Bucket_config_rejects,_even_though_fallback_would_allow === RUN TestMiddlewareFallbackConfig/No_config_at_all,_no_CORS_headers === RUN TestMiddlewareFallbackConfig/OPTIONS_preflight_with_fallback_config === RUN TestMiddlewareFallbackConfig/OPTIONS_preflight_without_any_config_should_fail --- PASS: TestMiddlewareFallbackConfig (0.02s) --- PASS: TestMiddlewareFallbackConfig/No_bucket_config,_fallback_to_global_config_with_wildcard (0.00s) --- PASS: TestMiddlewareFallbackConfig/No_bucket_config,_fallback_to_global_config_with_specific_origin (0.00s) --- PASS: TestMiddlewareFallbackConfig/No_bucket_config,_fallback_rejects_non-matching_origin (0.00s) --- PASS: TestMiddlewareFallbackConfig/Bucket_config_takes_precedence_over_fallback (0.00s) --- PASS: TestMiddlewareFallbackConfig/Bucket_config_rejects,_even_though_fallback_would_allow (0.00s) --- PASS: TestMiddlewareFallbackConfig/No_config_at_all,_no_CORS_headers (0.00s) --- PASS: TestMiddlewareFallbackConfig/OPTIONS_preflight_with_fallback_config (0.00s) --- PASS: TestMiddlewareFallbackConfig/OPTIONS_preflight_without_any_config_should_fail (0.00s) === RUN TestMiddlewareFallbackConfigWithMultipleOrigins === RUN TestMiddlewareFallbackConfigWithMultipleOrigins/First_allowed_origin_should_match === RUN TestMiddlewareFallbackConfigWithMultipleOrigins/Second_allowed_origin_should_match === RUN TestMiddlewareFallbackConfigWithMultipleOrigins/Non-allowed_origin_should_not_match --- PASS: TestMiddlewareFallbackConfigWithMultipleOrigins (0.01s) --- PASS: TestMiddlewareFallbackConfigWithMultipleOrigins/First_allowed_origin_should_match (0.00s) --- PASS: TestMiddlewareFallbackConfigWithMultipleOrigins/Second_allowed_origin_should_match (0.00s) --- PASS: TestMiddlewareFallbackConfigWithMultipleOrigins/Non-allowed_origin_should_not_match (0.00s) === RUN TestMiddlewareFallbackWithError === RUN TestMiddlewareFallbackWithError/ErrAccessDenied_should_not_trigger_fallback === RUN TestMiddlewareFallbackWithError/ErrInternalError_should_not_trigger_fallback === RUN TestMiddlewareFallbackWithError/ErrNoSuchBucket_should_trigger_fallback === RUN TestMiddlewareFallbackWithError/ErrNoSuchCORSConfiguration_should_trigger_fallback --- PASS: TestMiddlewareFallbackWithError (0.02s) --- PASS: TestMiddlewareFallbackWithError/ErrAccessDenied_should_not_trigger_fallback (0.00s) --- PASS: TestMiddlewareFallbackWithError/ErrInternalError_should_not_trigger_fallback (0.00s) --- PASS: TestMiddlewareFallbackWithError/ErrNoSuchBucket_should_trigger_fallback (0.00s) --- PASS: TestMiddlewareFallbackWithError/ErrNoSuchCORSConfiguration_should_trigger_fallback (0.00s) === RUN TestMiddlewareVaryHeader === RUN TestMiddlewareVaryHeader/Specific_allowed_origin === RUN TestMiddlewareVaryHeader/Wildcard_allowed_origin === RUN TestMiddlewareVaryHeader/No_CORS_configuration --- PASS: TestMiddlewareVaryHeader (0.02s) --- PASS: TestMiddlewareVaryHeader/Specific_allowed_origin (0.00s) --- PASS: TestMiddlewareVaryHeader/Wildcard_allowed_origin (0.01s) --- PASS: TestMiddlewareVaryHeader/No_CORS_configuration (0.00s) === RUN TestHandleOptionsRequestVaryHeader --- PASS: TestHandleOptionsRequestVaryHeader (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/cors 2.055s === RUN TestHandleReportMetricsAcceptsScanReport --- PASS: TestHandleReportMetricsAcceptsScanReport (0.01s) === RUN TestHandleReportMetricsRejectsGarbage --- PASS: TestHandleReportMetricsRejectsGarbage (0.01s) === RUN TestHandleReportMetricsRequiresReportType --- PASS: TestHandleReportMetricsRequiresReportType (0.01s) === RUN TestHandleReportMetricsAcceptsOversizedReport --- PASS: TestHandleReportMetricsAcceptsOversizedReport (0.19s) === RUN TestHandleReportMetricsRequiresTable --- PASS: TestHandleReportMetricsRequiresTable (0.00s) === RUN TestHandleOAuthTokens_Success --- PASS: TestHandleOAuthTokens_Success (0.04s) === RUN TestHandleOAuthTokens_InvalidCredentials --- PASS: TestHandleOAuthTokens_InvalidCredentials (0.00s) === RUN TestHandleOAuthTokens_UnsupportedGrantType --- PASS: TestHandleOAuthTokens_UnsupportedGrantType (0.00s) === RUN TestBearerTokenRoundTrip --- PASS: TestBearerTokenRoundTrip (0.02s) === RUN TestBearerTokenInvalid --- PASS: TestBearerTokenInvalid (0.00s) === RUN TestBearerTokenNone --- PASS: TestBearerTokenNone (0.00s) === RUN TestOauthExpirySecondsEnvOverride --- PASS: TestOauthExpirySecondsEnvOverride (0.03s) === RUN TestTokenExchangeLiveSubject --- PASS: TestTokenExchangeLiveSubject (0.02s) === RUN TestTokenExchangeExpiredWithinGrace --- PASS: TestTokenExchangeExpiredWithinGrace (0.01s) === RUN TestTokenExchangeAuthenticatedLiveSubjectFullTTL --- PASS: TestTokenExchangeAuthenticatedLiveSubjectFullTTL (0.01s) === RUN TestTokenExchangeSubjectNearlyExpired --- PASS: TestTokenExchangeSubjectNearlyExpired (0.01s) === RUN TestTokenExchangeExpiredWithoutClientAuth --- PASS: TestTokenExchangeExpiredWithoutClientAuth (0.01s) === RUN TestTokenExchangeExpiredBeyondGrace --- PASS: TestTokenExchangeExpiredBeyondGrace (0.01s) === RUN TestTokenExchangeGarbageSubject --- PASS: TestTokenExchangeGarbageSubject (0.00s) === RUN TestTokenExchangeWrongClientCredentials --- PASS: TestTokenExchangeWrongClientCredentials (0.01s) === RUN TestTokenExchangeSubjectWithoutExpiry --- PASS: TestTokenExchangeSubjectWithoutExpiry (0.01s) === RUN TestWantsVendedCredentials === RUN TestWantsVendedCredentials/no_header === RUN TestWantsVendedCredentials/vended_credentials === RUN TestWantsVendedCredentials/mechanism_list === RUN TestWantsVendedCredentials/spaced_and_mixed_case === RUN TestWantsVendedCredentials/repeated_header === RUN TestWantsVendedCredentials/remote_signing_only --- PASS: TestWantsVendedCredentials (0.01s) --- PASS: TestWantsVendedCredentials/no_header (0.00s) --- PASS: TestWantsVendedCredentials/vended_credentials (0.00s) --- PASS: TestWantsVendedCredentials/mechanism_list (0.00s) --- PASS: TestWantsVendedCredentials/spaced_and_mixed_case (0.00s) --- PASS: TestWantsVendedCredentials/repeated_header (0.00s) --- PASS: TestWantsVendedCredentials/remote_signing_only (0.00s) === RUN TestBuildFileIOConfigWithholdsEndpointFromCredentialVendingClients --- PASS: TestBuildFileIOConfigWithholdsEndpointFromCredentialVendingClients (0.00s) === RUN TestWriteLoadResultVariesOnTheDelegationHeader --- PASS: TestWriteLoadResultVariesOnTheDelegationHeader (0.01s) === RUN TestLoadTableResultOmitsConfigForCredentialVendingClients --- PASS: TestLoadTableResultOmitsConfigForCredentialVendingClients (0.06s) === RUN TestCommitDeniedBeforeStagingMetadata === RUN TestCommitDeniedBeforeStagingMetadata/commit-table === RUN TestCommitDeniedBeforeStagingMetadata/commit-transaction === RUN TestCommitDeniedBeforeStagingMetadata/commit-view --- PASS: TestCommitDeniedBeforeStagingMetadata (0.17s) --- PASS: TestCommitDeniedBeforeStagingMetadata/commit-table (0.10s) --- PASS: TestCommitDeniedBeforeStagingMetadata/commit-transaction (0.04s) --- PASS: TestCommitDeniedBeforeStagingMetadata/commit-view (0.03s) === RUN TestCommitAllowedStagesMetadata === RUN TestCommitAllowedStagesMetadata/owner === RUN TestCommitAllowedStagesMetadata/identity-actions --- PASS: TestCommitAllowedStagesMetadata (0.17s) --- PASS: TestCommitAllowedStagesMetadata/owner (0.13s) --- PASS: TestCommitAllowedStagesMetadata/identity-actions (0.04s) === RUN TestViewCommitAllowedStagesMetadata === RUN TestViewCommitAllowedStagesMetadata/owner === RUN TestViewCommitAllowedStagesMetadata/identity-actions --- PASS: TestViewCommitAllowedStagesMetadata (0.10s) --- PASS: TestViewCommitAllowedStagesMetadata/owner (0.05s) --- PASS: TestViewCommitAllowedStagesMetadata/identity-actions (0.04s) === RUN TestCommitTableRejectsStoredTraversalLocation --- PASS: TestCommitTableRejectsStoredTraversalLocation (0.01s) === RUN TestCommitTransactionRejectsStoredTraversalLocation --- PASS: TestCommitTransactionRejectsStoredTraversalLocation (0.01s) === RUN TestParseCommitUpdatesSeparatesStatistics --- PASS: TestParseCommitUpdatesSeparatesStatistics (0.00s) === RUN TestParseCommitUpdatesRejectsIncompleteSetStatistics --- PASS: TestParseCommitUpdatesRejectsIncompleteSetStatistics (0.00s) === RUN TestApplyStatisticsUpdatesUpsertAndRemove --- PASS: TestApplyStatisticsUpdatesUpsertAndRemove (0.01s) === RUN TestIsS3TablesConflict --- PASS: TestIsS3TablesConflict (0.00s) === RUN TestCreateOnCommitDeniedBeforeAnyWrite --- PASS: TestCreateOnCommitDeniedBeforeAnyWrite (0.02s) === RUN TestCreateTableOnExistingTableIsConflict I1117 09:40:42.129104 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateTableOnExistingTableIsConflict (1.23s) === RUN TestStageCreateOnExistingTableIsConflict I1117 09:40:42.997473 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestStageCreateOnExistingTableIsConflict (0.55s) === RUN TestCreateTableKeepsUnregisteredMetadataFile I1117 09:40:43.547284 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateTableKeepsUnregisteredMetadataFile (0.50s) === RUN TestConcurrentCreateTableHasOneWinner I1117 09:40:43.957713 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:44.461597 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:44.483245 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:44.488513 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:44.514299 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:44.524449 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders --- PASS: TestConcurrentCreateTableHasOneWinner (0.77s) === RUN TestOverlappingCreatesStageApart I1117 09:40:44.743207 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestOverlappingCreatesStageApart (0.62s) === RUN TestCreateTableDiscardsFileWhenNameWasTakenMidFlight === RUN TestCreateTableDiscardsFileWhenNameWasTakenMidFlight/winner_has_a_location I1117 09:40:45.353567 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestCreateTableDiscardsFileWhenNameWasTakenMidFlight/winner_has_none I1117 09:40:45.824693 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateTableDiscardsFileWhenNameWasTakenMidFlight (0.91s) --- PASS: TestCreateTableDiscardsFileWhenNameWasTakenMidFlight/winner_has_a_location (0.47s) --- PASS: TestCreateTableDiscardsFileWhenNameWasTakenMidFlight/winner_has_none (0.44s) === RUN TestLosingCreateKeepsReplacementAtReusedPath === RUN TestLosingCreateKeepsReplacementAtReusedPath/create_table I1117 09:40:46.274190 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestLosingCreateKeepsReplacementAtReusedPath/create_on_commit I1117 09:40:46.747084 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestLosingCreateKeepsReplacementAtReusedPath (0.87s) --- PASS: TestLosingCreateKeepsReplacementAtReusedPath/create_table (0.45s) --- PASS: TestLosingCreateKeepsReplacementAtReusedPath/create_on_commit (0.42s) === RUN TestCreateTableStagedFileOnRegistrationFailure === RUN TestCreateTableStagedFileOnRegistrationFailure/transport_failure_keeps_the_file I1117 09:40:47.136981 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] E1117 09:40:47.345294 handler.go:287 S3Tables: error handling CreateTable: rpc error: code = Unavailable desc = filer unavailable === RUN TestCreateTableStagedFileOnRegistrationFailure/refusal_removes_the_file I1117 09:40:47.543119 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateTableStagedFileOnRegistrationFailure (0.75s) --- PASS: TestCreateTableStagedFileOnRegistrationFailure/transport_failure_keeps_the_file (0.33s) --- PASS: TestCreateTableStagedFileOnRegistrationFailure/refusal_removes_the_file (0.42s) === RUN TestCreateKeepsFileOfRecordThatSurvivedConflict === RUN TestCreateKeepsFileOfRecordThatSurvivedConflict/create_on_commit/updated I1117 09:40:47.894030 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:48.141107 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders === RUN TestCreateKeepsFileOfRecordThatSurvivedConflict/create_on_commit/renamed I1117 09:40:48.347031 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:48.802710 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.entryType changed on /buckets/warehouse/ns/orders === RUN TestCreateKeepsFileOfRecordThatSurvivedConflict/create_table/updated I1117 09:40:48.959228 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:49.234024 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders === RUN TestCreateKeepsFileOfRecordThatSurvivedConflict/create_table/renamed I1117 09:40:49.383359 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:49.816085 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders --- PASS: TestCreateKeepsFileOfRecordThatSurvivedConflict (2.07s) --- PASS: TestCreateKeepsFileOfRecordThatSurvivedConflict/create_on_commit/updated (0.41s) --- PASS: TestCreateKeepsFileOfRecordThatSurvivedConflict/create_on_commit/renamed (0.65s) --- PASS: TestCreateKeepsFileOfRecordThatSurvivedConflict/create_table/updated (0.42s) --- PASS: TestCreateKeepsFileOfRecordThatSurvivedConflict/create_table/renamed (0.59s) === RUN TestCreateFailingToUnmarkRecordAnotherAdopted === RUN TestCreateFailingToUnmarkRecordAnotherAdopted/lookup_fails_before_the_write I1117 09:40:49.962852 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:50.208410 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders === RUN TestCreateFailingToUnmarkRecordAnotherAdopted/write_fails_without_a_refusal I1117 09:40:50.329860 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:50.558010 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders --- PASS: TestCreateFailingToUnmarkRecordAnotherAdopted (0.73s) --- PASS: TestCreateFailingToUnmarkRecordAnotherAdopted/lookup_fails_before_the_write (0.38s) --- PASS: TestCreateFailingToUnmarkRecordAnotherAdopted/write_fails_without_a_refusal (0.34s) === RUN TestRegistrationRefused === RUN TestRegistrationRefused/conflict === RUN TestRegistrationRefused/no_such_namespace === RUN TestRegistrationRefused/transport_error === RUN TestRegistrationRefused/untyped_name_taken === RUN TestRegistrationRefused/name_taken === RUN TestRegistrationRefused/invalid_request === RUN TestRegistrationRefused/wrapped_server_fault_naming_an_entry === RUN TestRegistrationRefused/version_mismatch === RUN TestRegistrationRefused/published_then_changed === RUN TestRegistrationRefused/wrapped_name_taken === RUN TestRegistrationRefused/server_fault_naming_an_existing_entry === RUN TestRegistrationRefused/wrapped_published_then_changed === RUN TestRegistrationRefused/access_denied === RUN TestRegistrationRefused/internal_error === RUN TestRegistrationRefused/wrapped_server_fault --- PASS: TestRegistrationRefused (0.01s) --- PASS: TestRegistrationRefused/conflict (0.00s) --- PASS: TestRegistrationRefused/no_such_namespace (0.00s) --- PASS: TestRegistrationRefused/transport_error (0.00s) --- PASS: TestRegistrationRefused/untyped_name_taken (0.00s) --- PASS: TestRegistrationRefused/name_taken (0.00s) --- PASS: TestRegistrationRefused/invalid_request (0.00s) --- PASS: TestRegistrationRefused/wrapped_server_fault_naming_an_entry (0.00s) --- PASS: TestRegistrationRefused/version_mismatch (0.00s) --- PASS: TestRegistrationRefused/published_then_changed (0.00s) --- PASS: TestRegistrationRefused/wrapped_name_taken (0.00s) --- PASS: TestRegistrationRefused/server_fault_naming_an_existing_entry (0.00s) --- PASS: TestRegistrationRefused/wrapped_published_then_changed (0.00s) --- PASS: TestRegistrationRefused/access_denied (0.00s) --- PASS: TestRegistrationRefused/internal_error (0.00s) --- PASS: TestRegistrationRefused/wrapped_server_fault (0.00s) === RUN TestFinalizeCreateOnCommitLosesToExistingTable I1117 09:40:50.684220 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestFinalizeCreateOnCommitLosesToExistingTable (0.36s) === RUN TestFinalizeCreateOnCommitLosesToTableWithoutLocation I1117 09:40:51.089389 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestFinalizeCreateOnCommitLosesToTableWithoutLocation (0.28s) === RUN TestSaveMetadataBlobKeepsATableDirectoryCreatedSinceTheLookup I1117 09:40:51.321768 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestSaveMetadataBlobKeepsATableDirectoryCreatedSinceTheLookup (0.11s) === RUN TestStageCreateMarkerKeepsADirectoryCreatedSinceTheLookup I1117 09:40:51.434182 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestStageCreateMarkerKeepsADirectoryCreatedSinceTheLookup (0.13s) === RUN TestConcurrentFinalizeCreateOnCommitHasOneWinner I1117 09:40:51.565459 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:51.772567 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:51.784101 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:51.789646 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:51.806661 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:51.809593 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders W1117 09:40:51.809738 filer_ops.go:865 back out /buckets/warehouse/ns/orders: attribute changed concurrently: s3tables.metadata changed on /buckets/warehouse/ns/orders --- PASS: TestConcurrentFinalizeCreateOnCommitHasOneWinner (0.37s) === RUN TestIsS3TablesAlreadyExistsTrustsTypedCode === RUN TestIsS3TablesAlreadyExistsTrustsTypedCode/nil === RUN TestIsS3TablesAlreadyExistsTrustsTypedCode/table_taken === RUN TestIsS3TablesAlreadyExistsTrustsTypedCode/namespace_taken === RUN TestIsS3TablesAlreadyExistsTrustsTypedCode/internal_error_mentions_it === RUN TestIsS3TablesAlreadyExistsTrustsTypedCode/conflict_mentions_it === RUN TestIsS3TablesAlreadyExistsTrustsTypedCode/untyped === RUN TestIsS3TablesAlreadyExistsTrustsTypedCode/untyped_other --- PASS: TestIsS3TablesAlreadyExistsTrustsTypedCode (0.01s) --- PASS: TestIsS3TablesAlreadyExistsTrustsTypedCode/nil (0.00s) --- PASS: TestIsS3TablesAlreadyExistsTrustsTypedCode/table_taken (0.00s) --- PASS: TestIsS3TablesAlreadyExistsTrustsTypedCode/namespace_taken (0.00s) --- PASS: TestIsS3TablesAlreadyExistsTrustsTypedCode/internal_error_mentions_it (0.00s) --- PASS: TestIsS3TablesAlreadyExistsTrustsTypedCode/conflict_mentions_it (0.00s) --- PASS: TestIsS3TablesAlreadyExistsTrustsTypedCode/untyped (0.00s) --- PASS: TestIsS3TablesAlreadyExistsTrustsTypedCode/untyped_other (0.00s) === RUN TestValidateCreateTableRequestRequiresName --- PASS: TestValidateCreateTableRequestRequiresName (0.00s) === RUN TestValidateCreateTableRequestAcceptsWithName --- PASS: TestValidateCreateTableRequestAcceptsWithName (0.00s) === RUN TestIsStageCreateEnabledDefaultsToTrue --- PASS: TestIsStageCreateEnabledDefaultsToTrue (0.00s) === RUN TestIsStageCreateEnabledFalseValues --- PASS: TestIsStageCreateEnabledFalseValues (0.00s) === RUN TestNewTableMetadataRejectsV3TypeBelowV3 --- PASS: TestNewTableMetadataRejectsV3TypeBelowV3 (0.01s) === RUN TestNewTableMetadataAcceptsV3TypeAtV3 --- PASS: TestNewTableMetadataAcceptsV3TypeAtV3 (0.02s) === RUN TestBuildLoadTableResultNeverReturnsNilMetadata === RUN TestBuildLoadTableResultNeverReturnsNilMetadata/no_stored_metadata === RUN TestBuildLoadTableResultNeverReturnsNilMetadata/empty_full_metadata === RUN TestBuildLoadTableResultNeverReturnsNilMetadata/unparseable_metadata W1117 09:40:51.907020 handlers_table.go:572 Iceberg: Failed to parse persisted metadata for t: invalid metadata: unexpected end of JSON input --- PASS: TestBuildLoadTableResultNeverReturnsNilMetadata (0.01s) --- PASS: TestBuildLoadTableResultNeverReturnsNilMetadata/no_stored_metadata (0.00s) --- PASS: TestBuildLoadTableResultNeverReturnsNilMetadata/empty_full_metadata (0.00s) --- PASS: TestBuildLoadTableResultNeverReturnsNilMetadata/unparseable_metadata (0.00s) === RUN TestCreateTableDeniedBeforeAnyWrite === RUN TestCreateTableDeniedBeforeAnyWrite/create === RUN TestCreateTableDeniedBeforeAnyWrite/stage-create --- PASS: TestCreateTableDeniedBeforeAnyWrite (0.02s) --- PASS: TestCreateTableDeniedBeforeAnyWrite/create (0.01s) --- PASS: TestCreateTableDeniedBeforeAnyWrite/stage-create (0.01s) === RUN TestStageCreateWritesStagedFilesForOwner --- PASS: TestStageCreateWritesStagedFilesForOwner (0.01s) === RUN TestCreateTableAllowedByIdentityActions --- PASS: TestCreateTableAllowedByIdentityActions (0.01s) === RUN TestNewTableMetadataResolvesZeroBasedSourceIDs === RUN TestNewTableMetadataResolvesZeroBasedSourceIDs/bucket_on_the_first_column === RUN TestNewTableMetadataResolvesZeroBasedSourceIDs/identity_on_the_first_column_and_day_on_another === RUN TestNewTableMetadataResolvesZeroBasedSourceIDs/write_order_on_the_first_column --- PASS: TestNewTableMetadataResolvesZeroBasedSourceIDs (0.10s) --- PASS: TestNewTableMetadataResolvesZeroBasedSourceIDs/bucket_on_the_first_column (0.04s) --- PASS: TestNewTableMetadataResolvesZeroBasedSourceIDs/identity_on_the_first_column_and_day_on_another (0.03s) --- PASS: TestNewTableMetadataResolvesZeroBasedSourceIDs/write_order_on_the_first_column (0.03s) === RUN TestCreateTablePartitionedByFirstColumn --- PASS: TestCreateTablePartitionedByFirstColumn (0.03s) === RUN TestCreateTableRejectsUnresolvableSourceID === RUN TestCreateTableRejectsUnresolvableSourceID/partition_spec === RUN TestCreateTableRejectsUnresolvableSourceID/write_order --- PASS: TestCreateTableRejectsUnresolvableSourceID (0.01s) --- PASS: TestCreateTableRejectsUnresolvableSourceID/partition_spec (0.01s) --- PASS: TestCreateTableRejectsUnresolvableSourceID/write_order (0.00s) === RUN TestCreateViewMissingNamespaceReturns404 --- PASS: TestCreateViewMissingNamespaceReturns404 (0.02s) === RUN TestCreateViewTagsEntryAsView --- PASS: TestCreateViewTagsEntryAsView (0.02s) === RUN TestCreateViewDuplicateDoesNotClobberMetadata --- PASS: TestCreateViewDuplicateDoesNotClobberMetadata (0.02s) === RUN TestCreateViewThatLosesTheRaceReturnsTheRegisteredView --- PASS: TestCreateViewThatLosesTheRaceReturnsTheRegisteredView (0.03s) === RUN TestCreateViewRollsBackEntryWhenMetadataWriteFails --- PASS: TestCreateViewRollsBackEntryWhenMetadataWriteFails (0.02s) === RUN TestBuildFileIOConfigVendingVendsScopedCredentials --- PASS: TestBuildFileIOConfigVendingVendsScopedCredentials (0.00s) === RUN TestBuildFileIOConfigVendingWithoutVendorSaysNothing --- PASS: TestBuildFileIOConfigVendingWithoutVendorSaysNothing (0.00s) === RUN TestBuildFileIOConfigVendingFallsBackWhenVendingFails W1117 09:40:52.199256 handlers_table.go:702 Iceberg: failed to vend credentials for s3://warehouse/ns/t: no role configured --- PASS: TestBuildFileIOConfigVendingFallsBackWhenVendingFails (0.00s) === RUN TestBuildFileIOConfigVendingReadOnlyUnlessCanWrite --- PASS: TestBuildFileIOConfigVendingReadOnlyUnlessCanWrite (0.00s) === RUN TestBuildFileIOConfigVendingWithoutDelegationHeader --- PASS: TestBuildFileIOConfigVendingWithoutDelegationHeader (0.00s) === RUN TestDropViewKeepsAnotherRecordsFiles --- PASS: TestDropViewKeepsAnotherRecordsFiles (0.02s) === RUN TestNameValidationError --- PASS: TestNameValidationError (0.00s) === RUN TestWriteManagerError === RUN TestWriteManagerError/invalid_name_is_a_client_error === RUN TestWriteManagerError/rejected_schema_is_a_client_error === RUN TestWriteManagerError/bad_format_version_is_a_client_error === RUN TestWriteManagerError/missing_table_bucket_is_a_client_error === RUN TestWriteManagerError/denied_catalog_write_is_forbidden,_not_a_server_fault === RUN TestWriteManagerError/everything_else_is_a_server_fault --- PASS: TestWriteManagerError (0.01s) --- PASS: TestWriteManagerError/invalid_name_is_a_client_error (0.00s) --- PASS: TestWriteManagerError/rejected_schema_is_a_client_error (0.00s) --- PASS: TestWriteManagerError/bad_format_version_is_a_client_error (0.00s) --- PASS: TestWriteManagerError/missing_table_bucket_is_a_client_error (0.00s) --- PASS: TestWriteManagerError/denied_catalog_write_is_forbidden,_not_a_server_fault (0.00s) --- PASS: TestWriteManagerError/everything_else_is_a_server_fault (0.00s) === RUN TestGetBucketFromPrefix_WarehouseQueryFallback === RUN TestGetBucketFromPrefix_WarehouseQueryFallback/warehouse_query_routes_to_its_bucket_when_no_prefix_in_path === RUN TestGetBucketFromPrefix_WarehouseQueryFallback/warehouse_query_with_sub-path_still_picks_the_bucket === RUN TestGetBucketFromPrefix_WarehouseQueryFallback/bare_bucket_name_is_taken_as_the_table_bucket === RUN TestGetBucketFromPrefix_WarehouseQueryFallback/table_bucket_ARN_routes_to_its_bucket === RUN TestGetBucketFromPrefix_WarehouseQueryFallback/unusable_warehouse_value_falls_through_to_default === RUN TestGetBucketFromPrefix_WarehouseQueryFallback/no_warehouse_and_no_prefix_returns_default --- PASS: TestGetBucketFromPrefix_WarehouseQueryFallback (0.01s) --- PASS: TestGetBucketFromPrefix_WarehouseQueryFallback/warehouse_query_routes_to_its_bucket_when_no_prefix_in_path (0.00s) --- PASS: TestGetBucketFromPrefix_WarehouseQueryFallback/warehouse_query_with_sub-path_still_picks_the_bucket (0.00s) --- PASS: TestGetBucketFromPrefix_WarehouseQueryFallback/bare_bucket_name_is_taken_as_the_table_bucket (0.00s) --- PASS: TestGetBucketFromPrefix_WarehouseQueryFallback/table_bucket_ARN_routes_to_its_bucket (0.00s) --- PASS: TestGetBucketFromPrefix_WarehouseQueryFallback/unusable_warehouse_value_falls_through_to_default (0.00s) --- PASS: TestGetBucketFromPrefix_WarehouseQueryFallback/no_warehouse_and_no_prefix_returns_default (0.00s) === RUN TestBuildFileIOConfig === RUN TestBuildFileIOConfig/no_endpoint_configured_yields_empty_config === RUN TestBuildFileIOConfig/endpoint_is_advertised_with_path-style-access_and_region --- PASS: TestBuildFileIOConfig (0.00s) --- PASS: TestBuildFileIOConfig/no_endpoint_configured_yields_empty_config (0.00s) --- PASS: TestBuildFileIOConfig/endpoint_is_advertised_with_path-style-access_and_region (0.00s) === RUN TestGetBucketFromPrefix_TableBucketEnvFallback --- PASS: TestGetBucketFromPrefix_TableBucketEnvFallback (0.01s) === RUN TestCreatePathsRefuseAnotherTablesLocation === RUN TestCreatePathsRefuseAnotherTablesLocation/register === RUN TestCreatePathsRefuseAnotherTablesLocation/create === RUN TestCreatePathsRefuseAnotherTablesLocation/stage-create === RUN TestCreatePathsRefuseAnotherTablesLocation/create-view --- PASS: TestCreatePathsRefuseAnotherTablesLocation (0.05s) --- PASS: TestCreatePathsRefuseAnotherTablesLocation/register (0.01s) --- PASS: TestCreatePathsRefuseAnotherTablesLocation/create (0.01s) --- PASS: TestCreatePathsRefuseAnotherTablesLocation/stage-create (0.01s) --- PASS: TestCreatePathsRefuseAnotherTablesLocation/create-view (0.01s) === RUN TestRegisterTableAuthorizedBeforeRead --- PASS: TestRegisterTableAuthorizedBeforeRead (0.01s) === RUN TestNormalizeNamespacePropertiesNil --- PASS: TestNormalizeNamespacePropertiesNil (0.00s) === RUN TestNormalizeNamespacePropertiesReturnsInputWhenSet --- PASS: TestNormalizeNamespacePropertiesReturnsInputWhenSet (0.00s) === RUN TestParsePaginationDefaultValues --- PASS: TestParsePaginationDefaultValues (0.00s) === RUN TestParsePaginationUsesCamelCaseParameters --- PASS: TestParsePaginationUsesCamelCaseParameters (0.00s) === RUN TestParsePaginationSupportsHyphenatedFallback --- PASS: TestParsePaginationSupportsHyphenatedFallback (0.00s) === RUN TestParsePaginationRejectsInvalidPageSize === RUN TestParsePaginationRejectsInvalidPageSize//v1/namespaces?pageSize=0 === RUN TestParsePaginationRejectsInvalidPageSize//v1/namespaces?pageSize=-1 === RUN TestParsePaginationRejectsInvalidPageSize//v1/namespaces?pageSize=foo === RUN TestParsePaginationRejectsInvalidPageSize//v1/namespaces?pageSize=1001 --- PASS: TestParsePaginationRejectsInvalidPageSize (0.01s) --- PASS: TestParsePaginationRejectsInvalidPageSize//v1/namespaces?pageSize=0 (0.00s) --- PASS: TestParsePaginationRejectsInvalidPageSize//v1/namespaces?pageSize=-1 (0.00s) --- PASS: TestParsePaginationRejectsInvalidPageSize//v1/namespaces?pageSize=foo (0.00s) --- PASS: TestParsePaginationRejectsInvalidPageSize//v1/namespaces?pageSize=1001 (0.00s) === RUN TestRegisterTableRequestWireShape --- PASS: TestRegisterTableRequestWireShape (0.00s) === RUN TestRegisterTableRejectsOutOfBoundsLocation === RUN TestRegisterTableRejectsOutOfBoundsLocation/cross_bucket === RUN TestRegisterTableRejectsOutOfBoundsLocation/traversal --- PASS: TestRegisterTableRejectsOutOfBoundsLocation (0.01s) --- PASS: TestRegisterTableRejectsOutOfBoundsLocation/cross_bucket (0.00s) --- PASS: TestRegisterTableRejectsOutOfBoundsLocation/traversal (0.00s) === RUN TestRegisterTableServesRegisteredMetadata --- PASS: TestRegisterTableServesRegisteredMetadata (0.12s) === RUN TestLoadTableReadsMetadataFileOfOlderRegistration --- PASS: TestLoadTableReadsMetadataFileOfOlderRegistration (0.08s) === RUN TestRegisterTableKeepsOversizedMetadataByLocation --- PASS: TestRegisterTableKeepsOversizedMetadataByLocation (30.30s) === RUN TestCommitTableOnOversizedRegistration --- PASS: TestCommitTableOnOversizedRegistration (45.03s) === RUN TestRegisterTableRejectsInvalidMetadata === RUN TestRegisterTableRejectsInvalidMetadata/empty_file === RUN TestRegisterTableRejectsInvalidMetadata/truncated --- PASS: TestRegisterTableRejectsInvalidMetadata (0.01s) --- PASS: TestRegisterTableRejectsInvalidMetadata/empty_file (0.01s) --- PASS: TestRegisterTableRejectsInvalidMetadata/truncated (0.00s) === RUN TestHandleRenameTableRejectsIncompleteIdentifiers === RUN TestHandleRenameTableRejectsIncompleteIdentifiers/missing_source_name === RUN TestHandleRenameTableRejectsIncompleteIdentifiers/missing_source_namespace === RUN TestHandleRenameTableRejectsIncompleteIdentifiers/missing_destination_name === RUN TestHandleRenameTableRejectsIncompleteIdentifiers/missing_destination_namespace === RUN TestHandleRenameTableRejectsIncompleteIdentifiers/empty_body === RUN TestHandleRenameTableRejectsIncompleteIdentifiers/malformed_json --- PASS: TestHandleRenameTableRejectsIncompleteIdentifiers (0.01s) --- PASS: TestHandleRenameTableRejectsIncompleteIdentifiers/missing_source_name (0.00s) --- PASS: TestHandleRenameTableRejectsIncompleteIdentifiers/missing_source_namespace (0.00s) --- PASS: TestHandleRenameTableRejectsIncompleteIdentifiers/missing_destination_name (0.00s) --- PASS: TestHandleRenameTableRejectsIncompleteIdentifiers/missing_destination_namespace (0.00s) --- PASS: TestHandleRenameTableRejectsIncompleteIdentifiers/empty_body (0.00s) --- PASS: TestHandleRenameTableRejectsIncompleteIdentifiers/malformed_json (0.00s) === RUN TestApplySnapshotsParamRefsKeepsOnlyReferenced --- PASS: TestApplySnapshotsParamRefsKeepsOnlyReferenced (0.01s) === RUN TestApplySnapshotsParamDefaultsToAll --- PASS: TestApplySnapshotsParamDefaultsToAll (0.00s) === RUN TestCreateTableWithoutLocationUsesItsOwnDirectory --- PASS: TestCreateTableWithoutLocationUsesItsOwnDirectory (0.03s) === RUN TestTableLocation --- PASS: TestTableLocation (0.00s) === RUN TestCreateTableThatLosesTheRaceIsConflict --- PASS: TestCreateTableThatLosesTheRaceIsConflict (0.05s) === RUN TestStagedCommitThatLosesTheRaceFails --- PASS: TestStagedCommitThatLosesTheRaceFails (0.02s) === RUN TestStagedCommitKeepsItsOwnLocation --- PASS: TestStagedCommitKeepsItsOwnLocation (0.09s) === RUN TestDecodeCommitTransactionRequest --- PASS: TestDecodeCommitTransactionRequest (0.00s) === RUN TestParseTableChangeSeparatesStatistics --- PASS: TestParseTableChangeSeparatesStatistics (0.00s) === RUN TestParseTableChangeRejectsInvalidRequirements --- PASS: TestParseTableChangeRejectsInvalidRequirements (0.00s) === RUN TestCloneTableMetadataIsIndependent --- PASS: TestCloneTableMetadataIsIndependent (0.00s) === RUN TestBuildTableRestoreRequestCarriesPriorState --- PASS: TestBuildTableRestoreRequestCarriesPriorState (0.00s) === RUN TestRollbackRevertsEveryFlippedField --- PASS: TestRollbackRevertsEveryFlippedField (0.00s) === RUN TestCleanupSafeMetadataKeepsFailedRollback --- PASS: TestCleanupSafeMetadataKeepsFailedRollback (0.00s) === RUN TestCleanupSafeMetadataFirstFlipFails --- PASS: TestCleanupSafeMetadataFirstFlipFails (0.00s) === RUN TestCleanupSafeMetadataAllRolledBack --- PASS: TestCleanupSafeMetadataAllRolledBack (0.00s) === RUN TestCommitTransactionReadsMetadataFileOfOlderRegistration --- PASS: TestCommitTransactionReadsMetadataFileOfOlderRegistration (0.05s) === RUN TestCommitTransactionRefreshesNameMapping --- PASS: TestCommitTransactionRefreshesNameMapping (0.04s) === RUN TestCommitTransactionRollbackRestoresOlderRegistration E1117 09:42:08.263889 handler.go:287 S3Tables: error handling UpdateTable: injected update failure E1117 09:42:08.270228 utils.go:239 Iceberg: CommitTransaction UpdateTable error: failed to update metadata --- PASS: TestCommitTransactionRollbackRestoresOlderRegistration (0.07s) === RUN TestCommitTransactionOnOversizedRegistration --- PASS: TestCommitTransactionOnOversizedRegistration (18.57s) === RUN TestApplyNamespacePropertyUpdates --- PASS: TestApplyNamespacePropertyUpdates (0.01s) === RUN TestApplyNamespacePropertyUpdatesRemoveExisting --- PASS: TestApplyNamespacePropertyUpdatesRemoveExisting (0.00s) === RUN TestApplyNamespacePropertyUpdatesDuplicateRemovals --- PASS: TestApplyNamespacePropertyUpdatesDuplicateRemovals (0.00s) === RUN TestHandleUpdateNamespacePropertiesConflict --- PASS: TestHandleUpdateNamespacePropertiesConflict (0.00s) === RUN TestIsViewNotFound --- PASS: TestIsViewNotFound (0.00s) === RUN TestIsViewAlreadyExists --- PASS: TestIsViewAlreadyExists (0.00s) === RUN TestViewPropertiesCopiesAndIsNonNil --- PASS: TestViewPropertiesCopiesAndIsNonNil (0.00s) === RUN TestViewResponseRoundTrip --- PASS: TestViewResponseRoundTrip (0.01s) === RUN TestHandleConfigWarehouseSpellings === RUN TestHandleConfigWarehouseSpellings/s3_location === RUN TestHandleConfigWarehouseSpellings/bare_bucket_name === RUN TestHandleConfigWarehouseSpellings/table_bucket_ARN === RUN TestHandleConfigWarehouseSpellings/no_warehouse === RUN TestHandleConfigWarehouseSpellings/unusable_value --- PASS: TestHandleConfigWarehouseSpellings (0.01s) --- PASS: TestHandleConfigWarehouseSpellings/s3_location (0.00s) --- PASS: TestHandleConfigWarehouseSpellings/bare_bucket_name (0.00s) --- PASS: TestHandleConfigWarehouseSpellings/table_bucket_ARN (0.00s) --- PASS: TestHandleConfigWarehouseSpellings/no_warehouse (0.00s) --- PASS: TestHandleConfigWarehouseSpellings/unusable_value (0.00s) === RUN TestLogManagerErrorRefusalsAreNotErrors --- PASS: TestLogManagerErrorRefusalsAreNotErrors (0.00s) === RUN TestRepairClickHouseRelativeManifests --- PASS: TestRepairClickHouseRelativeManifests (0.14s) === RUN TestRepairClickHouseAbsoluteManifests --- PASS: TestRepairClickHouseAbsoluteManifests (0.11s) === RUN TestRepairedManifestsAreLeftAlone --- PASS: TestRepairedManifestsAreLeftAlone (0.28s) === RUN TestRepairKeepsDeleteManifestContent --- PASS: TestRepairKeepsDeleteManifestContent (0.22s) === RUN TestManifestContentValue --- PASS: TestManifestContentValue (0.00s) === RUN TestRepairSkipsLocationsOutsideMetadataDir --- PASS: TestRepairSkipsLocationsOutsideMetadataDir (0.01s) === RUN TestRepairLeavesUnreadableListAlone W1117 09:42:27.695146 manifest_repair.go:503 Iceberg: manifest repair for s3://iceberg-tables/wprobe/target_rel/metadata/junk.avro skipped: open avro: cannot create OCFReader: cannot read OCF header with invalid magic bytes: `not ` --- PASS: TestRepairLeavesUnreadableListAlone (0.01s) === RUN TestEnsureMetadataSpecCompliance_BackfillsMissingFields --- PASS: TestEnsureMetadataSpecCompliance_BackfillsMissingFields (0.00s) === RUN TestEnsureMetadataSpecCompliance_PreservesExistingFields --- PASS: TestEnsureMetadataSpecCompliance_PreservesExistingFields (0.00s) === RUN TestEnsureMetadataSpecCompliance_ReplacesExplicitNullsWithSentinels --- PASS: TestEnsureMetadataSpecCompliance_ReplacesExplicitNullsWithSentinels (0.01s) === RUN TestEnsureMetadataSpecCompliance_InvalidJSONReturnedUnchanged --- PASS: TestEnsureMetadataSpecCompliance_InvalidJSONReturnedUnchanged (0.00s) === RUN TestEnsureMetadataSpecCompliance_EmptyInputReturnedUnchanged --- PASS: TestEnsureMetadataSpecCompliance_EmptyInputReturnedUnchanged (0.00s) === RUN TestEnsureMetadataSpecCompliance_PreservesOriginalKeyOrder --- PASS: TestEnsureMetadataSpecCompliance_PreservesOriginalKeyOrder (0.00s) === RUN TestEnsureMetadataSpecCompliance_EmptyObjectBackfilled --- PASS: TestEnsureMetadataSpecCompliance_EmptyObjectBackfilled (0.00s) === RUN TestEnsureMetadataSpecCompliance_AllPresentReturnsSameBytes --- PASS: TestEnsureMetadataSpecCompliance_AllPresentReturnsSameBytes (0.00s) === RUN TestSaveMetadataFileExclusiveRefusesToOverwrite --- PASS: TestSaveMetadataFileExclusiveRefusesToOverwrite (0.01s) === RUN TestStageCommitMetadataFallsBackToAUniqueName --- PASS: TestStageCommitMetadataFallsBackToAUniqueName (0.01s) === RUN TestSaveMetadataFileOverwrites --- PASS: TestSaveMetadataFileOverwrites (0.00s) === RUN TestNameMappingFromSchema --- PASS: TestNameMappingFromSchema (0.01s) === RUN TestRefreshDefaultNameMappingDropsReassignedNames --- PASS: TestRefreshDefaultNameMappingDropsReassignedNames (0.07s) === RUN TestRefreshDefaultNameMappingOnSchemaEvolution --- PASS: TestRefreshDefaultNameMappingOnSchemaEvolution (0.02s) === RUN TestRefreshDefaultNameMappingKeepsUserNames --- PASS: TestRefreshDefaultNameMappingKeepsUserNames (0.02s) === RUN TestCreateTableSetsDefaultNameMapping --- PASS: TestCreateTableSetsDefaultNameMapping (0.01s) === RUN TestIsValidTablePath --- PASS: TestIsValidTablePath (0.00s) === RUN TestValidateRequestPath_RejectsTraversal === RUN TestValidateRequestPath_RejectsTraversal/clean_namespace+table_passes === RUN TestValidateRequestPath_RejectsTraversal/clean_prefixed_passes === RUN TestValidateRequestPath_RejectsTraversal/clean_namespace_only_passes === RUN TestValidateRequestPath_RejectsTraversal/dotdot_as_prefix_var_rejected === RUN TestValidateRequestPath_RejectsTraversal/dotdot_as_namespace_var_rejected === RUN TestValidateRequestPath_RejectsTraversal/dotdot_as_namespace_var_prefixed_rejected === RUN TestValidateRequestPath_RejectsTraversal/dotdot_as_table_var_rejected === RUN TestValidateRequestPath_RejectsTraversal/dot_as_table_var_rejected === RUN TestValidateRequestPath_RejectsTraversal/unit-sep_namespace_with_dotdot_part_rejected === RUN TestValidateRequestPath_RejectsTraversal/leading_unit-sep_namespace_rejected === RUN TestValidateRequestPath_RejectsTraversal/trailing_unit-sep_namespace_rejected === RUN TestValidateRequestPath_RejectsTraversal/consecutive_unit-sep_namespace_rejected --- PASS: TestValidateRequestPath_RejectsTraversal (0.12s) --- PASS: TestValidateRequestPath_RejectsTraversal/clean_namespace+table_passes (0.04s) --- PASS: TestValidateRequestPath_RejectsTraversal/clean_prefixed_passes (0.01s) --- PASS: TestValidateRequestPath_RejectsTraversal/clean_namespace_only_passes (0.01s) --- PASS: TestValidateRequestPath_RejectsTraversal/dotdot_as_prefix_var_rejected (0.01s) --- PASS: TestValidateRequestPath_RejectsTraversal/dotdot_as_namespace_var_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/dotdot_as_namespace_var_prefixed_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/dotdot_as_table_var_rejected (0.01s) --- PASS: TestValidateRequestPath_RejectsTraversal/dot_as_table_var_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/unit-sep_namespace_with_dotdot_part_rejected (0.01s) --- PASS: TestValidateRequestPath_RejectsTraversal/leading_unit-sep_namespace_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/trailing_unit-sep_namespace_rejected (0.00s) --- PASS: TestValidateRequestPath_RejectsTraversal/consecutive_unit-sep_namespace_rejected (0.00s) === RUN TestValidateRequestPath_RejectsEmptyCapturedVars === RUN TestValidateRequestPath_RejectsEmptyCapturedVars/empty_prefix === RUN TestValidateRequestPath_RejectsEmptyCapturedVars/empty_table === RUN TestValidateRequestPath_RejectsEmptyCapturedVars/empty_namespace --- PASS: TestValidateRequestPath_RejectsEmptyCapturedVars (0.01s) --- PASS: TestValidateRequestPath_RejectsEmptyCapturedVars/empty_prefix (0.00s) --- PASS: TestValidateRequestPath_RejectsEmptyCapturedVars/empty_table (0.00s) --- PASS: TestValidateRequestPath_RejectsEmptyCapturedVars/empty_namespace (0.00s) === RUN TestIsValidNameSegment === RUN TestIsValidNameSegment/empty_ok === RUN TestIsValidNameSegment/plain === RUN TestIsValidNameSegment/with_dot_inside === RUN TestIsValidNameSegment/hidden === RUN TestIsValidNameSegment/bare_dot === RUN TestIsValidNameSegment/bare_dotdot === RUN TestIsValidNameSegment/contains_slash === RUN TestIsValidNameSegment/contains_backslash === RUN TestIsValidNameSegment/contains_nul --- PASS: TestIsValidNameSegment (0.01s) --- PASS: TestIsValidNameSegment/empty_ok (0.00s) --- PASS: TestIsValidNameSegment/plain (0.00s) --- PASS: TestIsValidNameSegment/with_dot_inside (0.00s) --- PASS: TestIsValidNameSegment/hidden (0.00s) --- PASS: TestIsValidNameSegment/bare_dot (0.00s) --- PASS: TestIsValidNameSegment/bare_dotdot (0.00s) --- PASS: TestIsValidNameSegment/contains_slash (0.00s) --- PASS: TestIsValidNameSegment/contains_backslash (0.00s) --- PASS: TestIsValidNameSegment/contains_nul (0.00s) === RUN TestNormalizeRequirementsAddsNullSnapshotID --- PASS: TestNormalizeRequirementsAddsNullSnapshotID (0.01s) === RUN TestNormalizeRequirementsPreservesPresentSnapshotID --- PASS: TestNormalizeRequirementsPreservesPresentSnapshotID (0.00s) === RUN TestNormalizeRequirementsPreservesExplicitNullSnapshotID --- PASS: TestNormalizeRequirementsPreservesExplicitNullSnapshotID (0.00s) === RUN TestNormalizeRequirementsLeavesOtherTypesUnchanged --- PASS: TestNormalizeRequirementsLeavesOtherTypesUnchanged (0.00s) === RUN TestNormalizeRequirementsEmptyInput --- PASS: TestNormalizeRequirementsEmptyInput (0.00s) === RUN TestAuthBearerRecordsTheTokensAccessKey --- PASS: TestAuthBearerRecordsTheTokensAccessKey (0.02s) === RUN TestAuthSigV4RecordsTheAuthenticatorsAccessKey --- PASS: TestAuthSigV4RecordsTheAuthenticatorsAccessKey (0.00s) === RUN TestAuthSigV4WithoutKeyAuthenticatorRecordsNoKey --- PASS: TestAuthSigV4WithoutKeyAuthenticatorRecordsNoKey (0.00s) === RUN TestAuthExpiredBearerReturns401 --- PASS: TestAuthExpiredBearerReturns401 (0.01s) === RUN TestAuthCaseInsensitiveBearerScheme --- PASS: TestAuthCaseInsensitiveBearerScheme (0.01s) === RUN TestAuthGarbageBearerReturns401 --- PASS: TestAuthGarbageBearerReturns401 (0.00s) === RUN TestAuthFreshBearerRunsHandler --- PASS: TestAuthFreshBearerRunsHandler (0.01s) === RUN TestAuthNoBearerStillUsesS3Authenticator --- PASS: TestAuthNoBearerStillUsesS3Authenticator (0.00s) === RUN TestAuthNonBearerAuthorizationHeaderUsesS3Authenticator --- PASS: TestAuthNonBearerAuthorizationHeaderUsesS3Authenticator (0.00s) === RUN TestRegisteredRoutesReachAHandler --- PASS: TestRegisteredRoutesReachAHandler (0.05s) === RUN TestDoubledV1PrefixIsCollapsed --- PASS: TestDoubledV1PrefixIsCollapsed (0.04s) === RUN TestDoubledV1CollapsePreservesOriginalPath --- PASS: TestDoubledV1CollapsePreservesOriginalPath (0.00s) === RUN TestVectorIndexIsReadOnlyOverIceberg I1117 09:42:28.508526 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:42:28.656756 handlers_table.go:572 Iceberg: Failed to parse persisted metadata for idx: invalid or missing format-version in table metadata --- PASS: TestVectorIndexIsReadOnlyOverIceberg (0.54s) === RUN TestStageCreateCannotReachVectorIndex I1117 09:42:28.801555 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:42:28.825499 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestStageCreateCannotReachVectorIndex/vector_namespace === RUN TestStageCreateCannotReachVectorIndex/index_location_from_another_namespace --- PASS: TestStageCreateCannotReachVectorIndex (0.25s) --- PASS: TestStageCreateCannotReachVectorIndex/vector_namespace (0.04s) --- PASS: TestStageCreateCannotReachVectorIndex/index_location_from_another_namespace (0.03s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/iceberg 118.120s === RUN TestClusterTokenMarksTheCallerTrusted === RUN TestClusterTokenMarksTheCallerTrusted/no_token === RUN TestClusterTokenMarksTheCallerTrusted/signed_with_the_derived_key === RUN TestClusterTokenMarksTheCallerTrusted/signed_with_the_cluster_key_itself === RUN TestClusterTokenMarksTheCallerTrusted/signed_with_another_key === RUN TestClusterTokenMarksTheCallerTrusted/expired === RUN TestClusterTokenMarksTheCallerTrusted/session_token === RUN TestClusterTokenMarksTheCallerTrusted/garbage --- PASS: TestClusterTokenMarksTheCallerTrusted (0.13s) --- PASS: TestClusterTokenMarksTheCallerTrusted/no_token (0.01s) --- PASS: TestClusterTokenMarksTheCallerTrusted/signed_with_the_derived_key (0.03s) --- PASS: TestClusterTokenMarksTheCallerTrusted/signed_with_the_cluster_key_itself (0.00s) --- PASS: TestClusterTokenMarksTheCallerTrusted/signed_with_another_key (0.00s) --- PASS: TestClusterTokenMarksTheCallerTrusted/expired (0.00s) --- PASS: TestClusterTokenMarksTheCallerTrusted/session_token (0.00s) --- PASS: TestClusterTokenMarksTheCallerTrusted/garbage (0.00s) === RUN TestClusterTokenAloneAuthenticatesAClusterProcess I1117 09:40:34.587366 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:35.210465 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:35.259349 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestClusterTokenAloneAuthenticatesAClusterProcess (2.20s) === RUN TestClusterTokenKeyDerivation --- PASS: TestClusterTokenKeyDerivation (0.00s) === RUN TestHandleOAuthTokens_Success --- PASS: TestHandleOAuthTokens_Success (0.01s) === RUN TestHandleOAuthTokens_InvalidCredentials --- PASS: TestHandleOAuthTokens_InvalidCredentials (0.00s) === RUN TestHandleOAuthTokens_OversizedBody --- PASS: TestHandleOAuthTokens_OversizedBody (0.34s) === RUN TestHandleOAuthTokens_UnsupportedGrantType --- PASS: TestHandleOAuthTokens_UnsupportedGrantType (0.00s) === RUN TestBearerTokenRoundTrip --- PASS: TestBearerTokenRoundTrip (0.02s) === RUN TestBearerTokenInvalid --- PASS: TestBearerTokenInvalid (0.00s) === RUN TestAuthBearerRunsHandler --- PASS: TestAuthBearerRunsHandler (0.02s) === RUN TestAuthExpiredBearerReturns401 --- PASS: TestAuthExpiredBearerReturns401 (0.03s) === RUN TestAuthApiKeyRunsHandler --- PASS: TestAuthApiKeyRunsHandler (0.00s) === RUN TestAuthApiKeyInvalid --- PASS: TestAuthApiKeyInvalid (0.00s) === RUN TestAuthTakesAnyKeyWhenS3AuthIsOff --- PASS: TestAuthTakesAnyKeyWhenS3AuthIsOff (0.00s) === RUN TestAuthNoBearerStillUsesS3Authenticator --- PASS: TestAuthNoBearerStillUsesS3Authenticator (0.00s) === RUN TestStorageOptionsSkipSignatureOnlyWhileS3AuthIsOff I1117 09:40:36.619082 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestStorageOptionsSkipSignatureOnlyWhileS3AuthIsOff (0.52s) === RUN TestTableLifecycle I1117 09:40:37.075208 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestTableLifecycle (1.12s) === RUN TestRegisterOverwriteKeepsTheOldDataset I1117 09:40:38.204639 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestRegisterOverwriteKeepsTheOldDataset (1.03s) === RUN TestListAllTablesIsNeverNull --- PASS: TestListAllTablesIsNeverNull (0.23s) === RUN TestNamespaceListing I1117 09:40:39.409402 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:39.484429 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestNamespaceListing (0.38s) === RUN TestCreateNamespaceRequiresItsParent I1117 09:40:39.826887 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:39.925330 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceRequiresItsParent (0.35s) === RUN TestCreateNamespaceModes I1117 09:40:40.211276 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceModes (0.32s) === RUN TestIcebergTablesAreInvisible I1117 09:40:40.696776 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestIcebergTablesAreInvisible (0.92s) === RUN TestRouteAndBodyMustAgree I1117 09:40:41.400210 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestRouteAndBodyMustAgree (0.17s) === RUN TestLocationOutsideBucketIsRejected === RUN TestLocationOutsideBucketIsRejected/another_bucket === RUN TestLocationOutsideBucketIsRejected/another_bucket/declare I1117 09:40:41.559158 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestLocationOutsideBucketIsRejected/another_bucket/register I1117 09:40:41.814194 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestLocationOutsideBucketIsRejected/traversal_into_another_bucket === RUN TestLocationOutsideBucketIsRejected/traversal_into_another_bucket/declare I1117 09:40:41.982307 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestLocationOutsideBucketIsRejected/traversal_into_another_bucket/register I1117 09:40:42.160295 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestLocationOutsideBucketIsRejected/traversal_above_the_buckets_root === RUN TestLocationOutsideBucketIsRejected/traversal_above_the_buckets_root/declare I1117 09:40:42.334666 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestLocationOutsideBucketIsRejected/traversal_above_the_buckets_root/register I1117 09:40:42.511752 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestLocationOutsideBucketIsRejected/not_an_s3_uri === RUN TestLocationOutsideBucketIsRejected/not_an_s3_uri/declare I1117 09:40:42.688794 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestLocationOutsideBucketIsRejected/not_an_s3_uri/register I1117 09:40:42.841536 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestLocationOutsideBucketIsRejected (1.43s) --- PASS: TestLocationOutsideBucketIsRejected/another_bucket (0.41s) --- PASS: TestLocationOutsideBucketIsRejected/another_bucket/declare (0.15s) --- PASS: TestLocationOutsideBucketIsRejected/another_bucket/register (0.25s) --- PASS: TestLocationOutsideBucketIsRejected/traversal_into_another_bucket (0.35s) --- PASS: TestLocationOutsideBucketIsRejected/traversal_into_another_bucket/declare (0.19s) --- PASS: TestLocationOutsideBucketIsRejected/traversal_into_another_bucket/register (0.16s) --- PASS: TestLocationOutsideBucketIsRejected/traversal_above_the_buckets_root (0.38s) --- PASS: TestLocationOutsideBucketIsRejected/traversal_above_the_buckets_root/declare (0.16s) --- PASS: TestLocationOutsideBucketIsRejected/traversal_above_the_buckets_root/register (0.21s) --- PASS: TestLocationOutsideBucketIsRejected/not_an_s3_uri (0.29s) --- PASS: TestLocationOutsideBucketIsRejected/not_an_s3_uri/declare (0.14s) --- PASS: TestLocationOutsideBucketIsRejected/not_an_s3_uri/register (0.15s) === RUN TestDataPlaneIsUnsupported --- PASS: TestDataPlaneIsUnsupported (0.05s) === RUN TestDeclareVendsWriteOnlyForATableItCreates I1117 09:40:43.044377 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestDeclareVendsWriteOnlyForATableItCreates/theirs === RUN TestDeclareVendsWriteOnlyForATableItCreates/mine --- PASS: TestDeclareVendsWriteOnlyForATableItCreates (0.64s) --- PASS: TestDeclareVendsWriteOnlyForATableItCreates/theirs (0.10s) --- PASS: TestDeclareVendsWriteOnlyForATableItCreates/mine (0.16s) === RUN TestDeregisterAndReregisterNeedUpdateTable I1117 09:40:43.675714 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDeregisterAndReregisterNeedUpdateTable (0.87s) === RUN TestDescribeTableInternalIgnoresCatalogGrants I1117 09:40:44.576036 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDescribeTableInternalIgnoresCatalogGrants (0.55s) === RUN TestDescribeTableInternalVendsWriteForTheVectorNamespace I1117 09:40:45.164812 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:45.225559 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:45.436234 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDescribeTableInternalVendsWriteForTheVectorNamespace (0.69s) === RUN TestParseIdentifier === RUN TestParseIdentifier/root_is_the_delimiter === RUN TestParseIdentifier/empty_is_the_root === RUN TestParseIdentifier/bucket === RUN TestParseIdentifier/namespace === RUN TestParseIdentifier/table === RUN TestParseIdentifier/custom_delimiter === RUN TestParseIdentifier/empty_part_is_rejected === RUN TestParseIdentifier/trailing_delimiter_is_rejected --- PASS: TestParseIdentifier (0.01s) --- PASS: TestParseIdentifier/root_is_the_delimiter (0.00s) --- PASS: TestParseIdentifier/empty_is_the_root (0.00s) --- PASS: TestParseIdentifier/bucket (0.00s) --- PASS: TestParseIdentifier/namespace (0.00s) --- PASS: TestParseIdentifier/table (0.00s) --- PASS: TestParseIdentifier/custom_delimiter (0.00s) --- PASS: TestParseIdentifier/empty_part_is_rejected (0.00s) --- PASS: TestParseIdentifier/trailing_delimiter_is_rejected (0.00s) === RUN TestIdentifierNamespace --- PASS: TestIdentifierNamespace (0.00s) === RUN TestIdentifierTable --- PASS: TestIdentifierTable (0.00s) === RUN TestIdentifierMatchesBody --- PASS: TestIdentifierMatchesBody (0.00s) === RUN TestIdentifierString --- PASS: TestIdentifierString (0.00s) === RUN TestAuthRecordsTheCallersAccessKey --- PASS: TestAuthRecordsTheCallersAccessKey (0.01s) === RUN TestVectorNamespaceIsReadOnlyOverLance I1117 09:40:45.833104 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:45.867562 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestVectorNamespaceIsReadOnlyOverLance/declare_a_new_index === RUN TestVectorNamespaceIsReadOnlyOverLance/register_a_new_index === RUN TestVectorNamespaceIsReadOnlyOverLance/register_over_the_index === RUN TestVectorNamespaceIsReadOnlyOverLance/repoint_the_index === RUN TestVectorNamespaceIsReadOnlyOverLance/deregister === RUN TestVectorNamespaceIsReadOnlyOverLance/drop === RUN TestVectorNamespaceIsReadOnlyOverLance/rename_out === RUN TestVectorNamespaceIsReadOnlyOverLance/drop_the_namespace === RUN TestVectorNamespaceIsReadOnlyOverLance/overwrite_the_namespace I1117 09:40:46.908273 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestVectorNamespaceIsReadOnlyOverLance (1.22s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/declare_a_new_index (0.08s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/register_a_new_index (0.09s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/register_over_the_index (0.04s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/repoint_the_index (0.05s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/deregister (0.04s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/drop (0.13s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/rename_out (0.17s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/drop_the_namespace (0.04s) --- PASS: TestVectorNamespaceIsReadOnlyOverLance/overwrite_the_namespace (0.06s) === RUN TestVectorNamespaceOfUndeclaredBucketIsWritableOverLance I1117 09:40:47.091084 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:47.135974 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestVectorNamespaceOfUndeclaredBucketIsWritableOverLance (0.69s) === RUN TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers I1117 09:40:47.711359 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:47.761139 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:48.109447 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:48.161562 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/describe_the_index === RUN TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/declare_the_index === RUN TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/describe_with_an_admin_token === RUN TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/trusted_describe === RUN TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/trusted_declare === RUN TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/another_namespace === RUN TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/bucket_from_before_formats --- PASS: TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers (1.31s) --- PASS: TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/describe_the_index (0.04s) --- PASS: TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/declare_the_index (0.07s) --- PASS: TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/describe_with_an_admin_token (0.07s) --- PASS: TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/trusted_describe (0.04s) --- PASS: TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/trusted_declare (0.16s) --- PASS: TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/another_namespace (0.06s) --- PASS: TestVectorNamespaceVendsWriteCredentialsOnlyToTrustedCallers/bucket_from_before_formats (0.07s) === RUN TestDeclareOfAnExistingTableKeepsItsLocation I1117 09:40:49.029122 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:49.071302 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDeclareOfAnExistingTableKeepsItsLocation (0.49s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/lance 18.569s === RUN TestLifecycleToCanonical_TopLevelPrefix --- PASS: TestLifecycleToCanonical_TopLevelPrefix (0.02s) === RUN TestLifecycleToCanonical_FilterPrefix --- PASS: TestLifecycleToCanonical_FilterPrefix (0.01s) === RUN TestLifecycleToCanonical_FilterTagAndSize --- PASS: TestLifecycleToCanonical_FilterTagAndSize (0.01s) === RUN TestLifecycleToCanonical_SingleTagFilter --- PASS: TestLifecycleToCanonical_SingleTagFilter (0.01s) === RUN TestLifecycleToCanonical_MultipleActions --- PASS: TestLifecycleToCanonical_MultipleActions (0.00s) === RUN TestLifecycleToCanonical_ExpirationDate --- PASS: TestLifecycleToCanonical_ExpirationDate (0.00s) === RUN TestLifecycleToCanonical_ExpiredObjectDeleteMarker --- PASS: TestLifecycleToCanonical_ExpiredObjectDeleteMarker (0.00s) === RUN TestLifecycleToCanonical_DisabledRulePreserved --- PASS: TestLifecycleToCanonical_DisabledRulePreserved (0.00s) === RUN TestLifecycleToCanonical_NilSafe --- PASS: TestLifecycleToCanonical_NilSafe (0.00s) === RUN TestLifecycleToCanonical_EmptyRules --- PASS: TestLifecycleToCanonical_EmptyRules (0.00s) === RUN TestLifecycleXMLRoundTrip_NoncurrentVersionExpiration --- PASS: TestLifecycleXMLRoundTrip_NoncurrentVersionExpiration (0.03s) === RUN TestLifecycleXMLRoundTrip_AbortIncompleteMultipartUpload --- PASS: TestLifecycleXMLRoundTrip_AbortIncompleteMultipartUpload (0.00s) === RUN TestLifecycleXMLRoundTrip_FilterWithTag --- PASS: TestLifecycleXMLRoundTrip_FilterWithTag (0.00s) === RUN TestLifecycleXMLRoundTrip_FilterWithAnd --- PASS: TestLifecycleXMLRoundTrip_FilterWithAnd (0.01s) === RUN TestLifecycleXMLRoundTrip_FilterWithSizeOnly --- PASS: TestLifecycleXMLRoundTrip_FilterWithSizeOnly (0.00s) === RUN TestLifecycleXML_TransitionSetFlag --- PASS: TestLifecycleXML_TransitionSetFlag (0.00s) === RUN TestLifecycleXML_NoncurrentVersionTransitionSetFlag --- PASS: TestLifecycleXML_NoncurrentVersionTransitionSetFlag (0.01s) === RUN TestLifecycleXMLRoundTrip_CompleteRule --- PASS: TestLifecycleXMLRoundTrip_CompleteRule (0.01s) === RUN TestCanonicalRoundTrip_WholeBucket --- PASS: TestCanonicalRoundTrip_WholeBucket (0.02s) === RUN TestCanonicalRoundTrip_PrefixOnly --- PASS: TestCanonicalRoundTrip_PrefixOnly (0.00s) === RUN TestCanonicalRoundTrip_TagOnly --- PASS: TestCanonicalRoundTrip_TagOnly (0.00s) === RUN TestCanonicalRoundTrip_PrefixAndTags --- PASS: TestCanonicalRoundTrip_PrefixAndTags (0.01s) === RUN TestCanonicalRoundTrip_SizeBounds --- PASS: TestCanonicalRoundTrip_SizeBounds (0.04s) === RUN TestCanonicalRoundTrip_PrefixAndTagsWithSizeBounds --- PASS: TestCanonicalRoundTrip_PrefixAndTagsWithSizeBounds (0.02s) === RUN TestCanonicalRoundTrip_ExpirationDate --- PASS: TestCanonicalRoundTrip_ExpirationDate (0.02s) === RUN TestCanonicalRoundTrip_ExpiredObjectDeleteMarker --- PASS: TestCanonicalRoundTrip_ExpiredObjectDeleteMarker (0.01s) === RUN TestCanonicalRoundTrip_NoncurrentVersionExpiration --- PASS: TestCanonicalRoundTrip_NoncurrentVersionExpiration (0.01s) === RUN TestCanonicalRoundTrip_AbortMultipartUpload --- PASS: TestCanonicalRoundTrip_AbortMultipartUpload (0.01s) === RUN TestCanonicalRoundTrip_Disabled --- PASS: TestCanonicalRoundTrip_Disabled (0.01s) === RUN TestCanonicalRoundTrip_TagOrderIsStable --- PASS: TestCanonicalRoundTrip_TagOrderIsStable (0.01s) === RUN TestCanonicalRoundTrip_PrefixWithSizeBoundsUsesAnd --- PASS: TestCanonicalRoundTrip_PrefixWithSizeBoundsUsesAnd (0.00s) === RUN TestCanonicalRoundTrip_TagWithSizeBoundsUsesAnd --- PASS: TestCanonicalRoundTrip_TagWithSizeBoundsUsesAnd (0.00s) === RUN TestCanonicalRoundTrip_SizeOnlyOmitsPrefixElement --- PASS: TestCanonicalRoundTrip_SizeOnlyOmitsPrefixElement (0.01s) === RUN TestCanonicalRoundTrip_SizeRangeUsesAnd --- PASS: TestCanonicalRoundTrip_SizeRangeUsesAnd (0.01s) === RUN TestMarshalCanonical_CarriesTheS3Namespace --- PASS: TestMarshalCanonical_CarriesTheS3Namespace (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/lifecycle_xml 2.394s === RUN TestCheckPostPolicy_RejectsUnknownConditionKey --- PASS: TestCheckPostPolicy_RejectsUnknownConditionKey (0.06s) === RUN TestCheckPostPolicy_RejectsExtraXAmzFormField --- PASS: TestCheckPostPolicy_RejectsExtraXAmzFormField (0.00s) === RUN TestCheckPostPolicy_AllowsXAmzAuthFields --- PASS: TestCheckPostPolicy_AllowsXAmzAuthFields (0.00s) === RUN TestCheckPostPolicy_AllowsMatchingXAmzField --- PASS: TestCheckPostPolicy_AllowsMatchingXAmzField (0.00s) === RUN TestCheckPostPolicy_ExistingXAmzMetaCheckStillWorks --- PASS: TestCheckPostPolicy_ExistingXAmzMetaCheckStillWorks (0.00s) === RUN TestCheckPostPolicy_AllowsStartsWithPrefixStem --- PASS: TestCheckPostPolicy_AllowsStartsWithPrefixStem (0.00s) === RUN TestCheckPostPolicy_PrefixStemDoesNotCoverOtherPrefixes --- PASS: TestCheckPostPolicy_PrefixStemDoesNotCoverOtherPrefixes (0.01s) === RUN TestCheckPostPolicy_PrefixStemEnforcesValuePrefix --- PASS: TestCheckPostPolicy_PrefixStemEnforcesValuePrefix (0.00s) === RUN TestCheckPostPolicy_ExactAndPrefixBothEnforced --- PASS: TestCheckPostPolicy_ExactAndPrefixBothEnforced (0.00s) === RUN TestCheckPostPolicy_MultiplePrefixStemsAllEnforced --- PASS: TestCheckPostPolicy_MultiplePrefixStemsAllEnforced (0.01s) === RUN TestCheckPostPolicy_UnknownKeyErrorIncludesPolicyValue --- PASS: TestCheckPostPolicy_UnknownKeyErrorIncludesPolicyValue (0.00s) === RUN TestCheckPostPolicy_AclFieldNeedsCondition --- PASS: TestCheckPostPolicy_AclFieldNeedsCondition (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/policy 0.561s === RUN TestResourceMatchesBucket === RUN TestResourceMatchesBucket/bare_bucket_name === RUN TestResourceMatchesBucket/bare_wildcard === RUN TestResourceMatchesBucket/bare_object_key === RUN TestResourceMatchesBucket/arn_bucket === RUN TestResourceMatchesBucket/arn_wildcard === RUN TestResourceMatchesBucket/arn_object_key === RUN TestResourceMatchesBucket/wrong_bucket === RUN TestResourceMatchesBucket/wrong_bucket_arn === RUN TestResourceMatchesBucket/prefix_collision === RUN TestResourceMatchesBucket/prefix_collision_arn === RUN TestResourceMatchesBucket/empty_resource --- PASS: TestResourceMatchesBucket (0.03s) --- PASS: TestResourceMatchesBucket/bare_bucket_name (0.00s) --- PASS: TestResourceMatchesBucket/bare_wildcard (0.00s) --- PASS: TestResourceMatchesBucket/bare_object_key (0.00s) --- PASS: TestResourceMatchesBucket/arn_bucket (0.00s) --- PASS: TestResourceMatchesBucket/arn_wildcard (0.00s) --- PASS: TestResourceMatchesBucket/arn_object_key (0.00s) --- PASS: TestResourceMatchesBucket/wrong_bucket (0.00s) --- PASS: TestResourceMatchesBucket/wrong_bucket_arn (0.00s) --- PASS: TestResourceMatchesBucket/prefix_collision (0.00s) --- PASS: TestResourceMatchesBucket/prefix_collision_arn (0.00s) --- PASS: TestResourceMatchesBucket/empty_resource (0.00s) === RUN TestValidateBucketPolicy === RUN TestValidateBucketPolicy/valid_policy === RUN TestValidateBucketPolicy/bad_version === RUN TestValidateBucketPolicy/zero_statements === RUN TestValidateBucketPolicy/missing_principal === RUN TestValidateBucketPolicy/foreign_resource === RUN TestValidateBucketPolicy/foreign_not-resource === RUN TestValidateBucketPolicy/non-s3_action --- PASS: TestValidateBucketPolicy (0.01s) --- PASS: TestValidateBucketPolicy/valid_policy (0.00s) --- PASS: TestValidateBucketPolicy/bad_version (0.00s) --- PASS: TestValidateBucketPolicy/zero_statements (0.00s) --- PASS: TestValidateBucketPolicy/missing_principal (0.00s) --- PASS: TestValidateBucketPolicy/foreign_resource (0.00s) --- PASS: TestValidateBucketPolicy/foreign_not-resource (0.00s) --- PASS: TestValidateBucketPolicy/non-s3_action (0.00s) === RUN TestConditionValuesLookingAlikeStayDistinct --- PASS: TestConditionValuesLookingAlikeStayDistinct (0.01s) === RUN TestBucketPolicyConditionValuesDoNotLeakAcrossBuckets --- PASS: TestBucketPolicyConditionValuesDoNotLeakAcrossBuckets (0.14s) === RUN TestEvaluateConditionsFailsClosedOnUnsupportedOperator W1117 09:40:32.737492 conditions.go:689 Unsupported condition operator: StringEqualsBogus --- PASS: TestEvaluateConditionsFailsClosedOnUnsupportedOperator (0.04s) === RUN TestConditionEvaluatorsTolerateNilValue --- PASS: TestConditionEvaluatorsTolerateNilValue (0.00s) === RUN TestConditionEvaluatorsIgnoreCase === RUN TestConditionEvaluatorsIgnoreCase/StringEqualsIgnoreCase_-_match === RUN TestConditionEvaluatorsIgnoreCase/StringEqualsIgnoreCase_-_no_match === RUN TestConditionEvaluatorsIgnoreCase/StringNotEqualsIgnoreCase_-_match === RUN TestConditionEvaluatorsIgnoreCase/StringNotEqualsIgnoreCase_-_no_match --- PASS: TestConditionEvaluatorsIgnoreCase (0.01s) --- PASS: TestConditionEvaluatorsIgnoreCase/StringEqualsIgnoreCase_-_match (0.00s) --- PASS: TestConditionEvaluatorsIgnoreCase/StringEqualsIgnoreCase_-_no_match (0.00s) --- PASS: TestConditionEvaluatorsIgnoreCase/StringNotEqualsIgnoreCase_-_match (0.00s) --- PASS: TestConditionEvaluatorsIgnoreCase/StringNotEqualsIgnoreCase_-_no_match (0.00s) === RUN TestGetConditionEvaluatorRejectsNonAWSIgnoreCaseOperators --- PASS: TestGetConditionEvaluatorRejectsNonAWSIgnoreCaseOperators (0.00s) === RUN TestConditionSetOperators === RUN TestConditionSetOperators/ForAllValues_all_match === RUN TestConditionSetOperators/ForAllValues_subset_matches === RUN TestConditionSetOperators/ForAllValues_one_outsider_fails === RUN TestConditionSetOperators/ForAllValues_empty_set_matches === RUN TestConditionSetOperators/ForAllValues_nil_set_matches === RUN TestConditionSetOperators/ForAllValues_is_case_sensitive === RUN TestConditionSetOperators/ForAllValues_StringLike_all_match === RUN TestConditionSetOperators/ForAllValues_StringLike_one_outsider_fails === RUN TestConditionSetOperators/ForAllValues_StringNotEquals_none_listed === RUN TestConditionSetOperators/ForAllValues_StringNotEquals_one_listed_fails === RUN TestConditionSetOperators/ForAnyValue_one_match === RUN TestConditionSetOperators/ForAnyValue_no_match === RUN TestConditionSetOperators/ForAnyValue_empty_set_fails === RUN TestConditionSetOperators/ForAnyValue_nil_set_fails === RUN TestConditionSetOperators/ForAnyValue_StringLike_one_match === RUN TestConditionSetOperators/ForAnyValue_StringLike_no_match === RUN TestConditionSetOperators/ForAnyValue_StringNotEquals_one_unlisted === RUN TestConditionSetOperators/ForAnyValue_StringNotEquals_all_listed_fails === RUN TestConditionSetOperators/ForAnyValue_StringEqualsIgnoreCase --- PASS: TestConditionSetOperators (0.02s) --- PASS: TestConditionSetOperators/ForAllValues_all_match (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_subset_matches (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_one_outsider_fails (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_empty_set_matches (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_nil_set_matches (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_is_case_sensitive (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_StringLike_all_match (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_StringLike_one_outsider_fails (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_StringNotEquals_none_listed (0.00s) --- PASS: TestConditionSetOperators/ForAllValues_StringNotEquals_one_listed_fails (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_one_match (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_no_match (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_empty_set_fails (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_nil_set_fails (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_StringLike_one_match (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_StringLike_no_match (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_StringNotEquals_one_unlisted (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_StringNotEquals_all_listed_fails (0.00s) --- PASS: TestConditionSetOperators/ForAnyValue_StringEqualsIgnoreCase (0.00s) === RUN TestGetConditionEvaluatorRejectsUnknownSetOperators --- PASS: TestGetConditionEvaluatorRejectsUnknownSetOperators (0.00s) === RUN TestValidateBucketPolicyAcceptsSetOperators --- PASS: TestValidateBucketPolicyAcceptsSetOperators (0.01s) === RUN TestOriginalGrantsSupplementOnlyForAnyValue --- PASS: TestOriginalGrantsSupplementOnlyForAnyValue (0.00s) === RUN TestValidateBucketPolicyRejectsUnsupportedConditionOperator === RUN TestValidateBucketPolicyRejectsUnsupportedConditionOperator/upload_rejects_unsupported_operator === RUN TestValidateBucketPolicyRejectsUnsupportedConditionOperator/upload_accepts_supported_IgnoreCase_operator === RUN TestValidateBucketPolicyRejectsUnsupportedConditionOperator/upload_accepts_supported_StringEquals_operator === RUN TestValidateBucketPolicyRejectsUnsupportedConditionOperator/load_tolerates_legacy_unsupported_operator --- PASS: TestValidateBucketPolicyRejectsUnsupportedConditionOperator (0.01s) --- PASS: TestValidateBucketPolicyRejectsUnsupportedConditionOperator/upload_rejects_unsupported_operator (0.00s) --- PASS: TestValidateBucketPolicyRejectsUnsupportedConditionOperator/upload_accepts_supported_IgnoreCase_operator (0.00s) --- PASS: TestValidateBucketPolicyRejectsUnsupportedConditionOperator/upload_accepts_supported_StringEquals_operator (0.00s) --- PASS: TestValidateBucketPolicyRejectsUnsupportedConditionOperator/load_tolerates_legacy_unsupported_operator (0.00s) === RUN TestBucketsAllowedForAction === RUN TestBucketsAllowedForAction/multipart_inherits_put === RUN TestBucketsAllowedForAction/multipart_inherits_put_in_any_case === RUN TestBucketsAllowedForAction/unrelated_action_names_nothing === RUN TestBucketsAllowedForAction/mixed_case_grant_is_read === RUN TestBucketsAllowedForAction/wildcard_bucket_is_incomplete === RUN TestBucketsAllowedForAction/unknown_policy_is_incomplete --- PASS: TestBucketsAllowedForAction (0.02s) --- PASS: TestBucketsAllowedForAction/multipart_inherits_put (0.00s) --- PASS: TestBucketsAllowedForAction/multipart_inherits_put_in_any_case (0.00s) --- PASS: TestBucketsAllowedForAction/unrelated_action_names_nothing (0.00s) --- PASS: TestBucketsAllowedForAction/mixed_case_grant_is_read (0.00s) --- PASS: TestBucketsAllowedForAction/wildcard_bucket_is_incomplete (0.00s) --- PASS: TestBucketsAllowedForAction/unknown_policy_is_incomplete (0.00s) === RUN TestExtractPrincipalVariables === RUN TestExtractPrincipalVariables/IAM_User_ARN === RUN TestExtractPrincipalVariables/Assumed_Role_ARN === RUN TestExtractPrincipalVariables/IAM_Role_ARN === RUN TestExtractPrincipalVariables/Non-ARN_principal === RUN TestExtractPrincipalVariables/Wildcard_principal --- PASS: TestExtractPrincipalVariables (0.01s) --- PASS: TestExtractPrincipalVariables/IAM_User_ARN (0.00s) --- PASS: TestExtractPrincipalVariables/Assumed_Role_ARN (0.00s) --- PASS: TestExtractPrincipalVariables/IAM_Role_ARN (0.00s) --- PASS: TestExtractPrincipalVariables/Non-ARN_principal (0.00s) --- PASS: TestExtractPrincipalVariables/Wildcard_principal (0.00s) === RUN TestSubstituteVariablesWithClaims === RUN TestSubstituteVariablesWithClaims/Standard_context_variable === RUN TestSubstituteVariablesWithClaims/JWT_claim_substitution === RUN TestSubstituteVariablesWithClaims/Mixed_variables === RUN TestSubstituteVariablesWithClaims/Variable_not_found --- PASS: TestSubstituteVariablesWithClaims (0.01s) --- PASS: TestSubstituteVariablesWithClaims/Standard_context_variable (0.00s) --- PASS: TestSubstituteVariablesWithClaims/JWT_claim_substitution (0.00s) --- PASS: TestSubstituteVariablesWithClaims/Mixed_variables (0.00s) --- PASS: TestSubstituteVariablesWithClaims/Variable_not_found (0.00s) === RUN TestPolicyVariablesWithPrincipalType --- PASS: TestPolicyVariablesWithPrincipalType (0.01s) === RUN TestPolicyVariablesWithJWTClaims --- PASS: TestPolicyVariablesWithJWTClaims (0.00s) === RUN TestExtractPrincipalVariablesWithAccount --- PASS: TestExtractPrincipalVariablesWithAccount (0.00s) === RUN TestSubstituteVariablesWithLDAP --- PASS: TestSubstituteVariablesWithLDAP (0.00s) === RUN TestSubstituteVariablesSpecialChars === RUN TestSubstituteVariablesSpecialChars/Comparison_operators_in_claims/vars === RUN TestSubstituteVariablesSpecialChars/Path_traversal_attempt_(should_just_substitute_text) --- PASS: TestSubstituteVariablesSpecialChars (0.00s) --- PASS: TestSubstituteVariablesSpecialChars/Comparison_operators_in_claims/vars (0.00s) --- PASS: TestSubstituteVariablesSpecialChars/Path_traversal_attempt_(should_just_substitute_text) (0.00s) === RUN TestIsolationPolicy --- PASS: TestIsolationPolicy (0.01s) === RUN TestNotResourceWithVariables --- PASS: TestNotResourceWithVariables (0.00s) === RUN TestExtractPrincipalVariablesWithPaths === RUN TestExtractPrincipalVariablesWithPaths/IAM_User_with_path === RUN TestExtractPrincipalVariablesWithPaths/IAM_Role_with_path === RUN TestExtractPrincipalVariablesWithPaths/Assumed_Role_with_path --- PASS: TestExtractPrincipalVariablesWithPaths (0.00s) --- PASS: TestExtractPrincipalVariablesWithPaths/IAM_User_with_path (0.00s) --- PASS: TestExtractPrincipalVariablesWithPaths/IAM_Role_with_path (0.00s) --- PASS: TestExtractPrincipalVariablesWithPaths/Assumed_Role_with_path (0.00s) === RUN TestPolicyEngine --- PASS: TestPolicyEngine (0.01s) === RUN TestConditionEvaluators === RUN TestConditionEvaluators/StringEquals_-_match === RUN TestConditionEvaluators/StringEquals_-_no_match === RUN TestConditionEvaluators/StringLike_-_wildcard_match === RUN TestConditionEvaluators/StringLike_-_wildcard_no_match === RUN TestConditionEvaluators/NumericEquals_-_match === RUN TestConditionEvaluators/NumericLessThan_-_match === RUN TestConditionEvaluators/NumericLessThan_-_no_match === RUN TestConditionEvaluators/IpAddress_-_CIDR_match === RUN TestConditionEvaluators/IpAddress_-_CIDR_no_match === RUN TestConditionEvaluators/Bool_-_true_match === RUN TestConditionEvaluators/Bool_-_false_match === RUN TestConditionEvaluators/Bool_-_no_match --- PASS: TestConditionEvaluators (0.01s) --- PASS: TestConditionEvaluators/StringEquals_-_match (0.00s) --- PASS: TestConditionEvaluators/StringEquals_-_no_match (0.00s) --- PASS: TestConditionEvaluators/StringLike_-_wildcard_match (0.00s) --- PASS: TestConditionEvaluators/StringLike_-_wildcard_no_match (0.00s) --- PASS: TestConditionEvaluators/NumericEquals_-_match (0.00s) --- PASS: TestConditionEvaluators/NumericLessThan_-_match (0.00s) --- PASS: TestConditionEvaluators/NumericLessThan_-_no_match (0.00s) --- PASS: TestConditionEvaluators/IpAddress_-_CIDR_match (0.00s) --- PASS: TestConditionEvaluators/IpAddress_-_CIDR_no_match (0.00s) --- PASS: TestConditionEvaluators/Bool_-_true_match (0.00s) --- PASS: TestConditionEvaluators/Bool_-_false_match (0.00s) --- PASS: TestConditionEvaluators/Bool_-_no_match (0.00s) === RUN TestPolicyValidation === RUN TestPolicyValidation/Valid_policy === RUN TestPolicyValidation/Valid_policy_with_single_statement_object === RUN TestPolicyValidation/Invalid_version === RUN TestPolicyValidation/Missing_action === RUN TestPolicyValidation/Invalid_JSON --- PASS: TestPolicyValidation (0.02s) --- PASS: TestPolicyValidation/Valid_policy (0.01s) --- PASS: TestPolicyValidation/Valid_policy_with_single_statement_object (0.00s) --- PASS: TestPolicyValidation/Invalid_version (0.00s) --- PASS: TestPolicyValidation/Missing_action (0.00s) --- PASS: TestPolicyValidation/Invalid_JSON (0.00s) === RUN TestPatternMatching === RUN TestPatternMatching/Exact_match === RUN TestPatternMatching/Wildcard_match === RUN TestPatternMatching/Wildcard_no_match === RUN TestPatternMatching/Full_wildcard === RUN TestPatternMatching/Question_mark_wildcard --- PASS: TestPatternMatching (0.01s) --- PASS: TestPatternMatching/Exact_match (0.00s) --- PASS: TestPatternMatching/Wildcard_match (0.00s) --- PASS: TestPatternMatching/Wildcard_no_match (0.00s) --- PASS: TestPatternMatching/Full_wildcard (0.00s) --- PASS: TestPatternMatching/Question_mark_wildcard (0.00s) === RUN TestExtractConditionValuesFromRequest --- PASS: TestExtractConditionValuesFromRequest (0.00s) === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence/ignores_X-Forwarded-For_and_uses_RemoteAddr === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence/ignores_X-Real-Ip_and_uses_RemoteAddr === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence/uses_RemoteAddr_ip_when_no_forwarding_headers === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence/keeps_unix_socket_marker_when_RemoteAddr_is_not_an_ip === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence/ignores_IPv6_X-Forwarded-For_entry_and_uses_RemoteAddr === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence/ignores_spoofed_X-Forwarded-For_behind_private_peer === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence/handles_bracketed_IPv6_remote_address === RUN TestExtractConditionValuesFromRequestSourceIPPrecedence/avoids_returning_DNS_host_names --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence (0.01s) --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence/ignores_X-Forwarded-For_and_uses_RemoteAddr (0.00s) --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence/ignores_X-Real-Ip_and_uses_RemoteAddr (0.00s) --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence/uses_RemoteAddr_ip_when_no_forwarding_headers (0.00s) --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence/keeps_unix_socket_marker_when_RemoteAddr_is_not_an_ip (0.00s) --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence/ignores_IPv6_X-Forwarded-For_entry_and_uses_RemoteAddr (0.00s) --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence/ignores_spoofed_X-Forwarded-For_behind_private_peer (0.00s) --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence/handles_bracketed_IPv6_remote_address (0.00s) --- PASS: TestExtractConditionValuesFromRequestSourceIPPrecedence/avoids_returning_DNS_host_names (0.00s) === RUN TestExtractSourceIP_IgnoresForwardedHeaders --- PASS: TestExtractSourceIP_IgnoresForwardedHeaders (0.00s) === RUN TestExtractSourceIP_EnforcesIPRestrictionPolicy --- PASS: TestExtractSourceIP_EnforcesIPRestrictionPolicy (0.01s) === RUN TestExtractSourceIP_TrustedProxyHonorsForwardedHeader --- PASS: TestExtractSourceIP_TrustedProxyHonorsForwardedHeader (0.00s) === RUN TestPolicyEvaluationWithConditions --- PASS: TestPolicyEvaluationWithConditions (0.00s) === RUN TestResourceArn === RUN TestResourceArn/Bucket_only === RUN TestResourceArn/Bucket_and_object === RUN TestResourceArn/Bucket_and_nested_object --- PASS: TestResourceArn (0.01s) --- PASS: TestResourceArn/Bucket_only (0.00s) --- PASS: TestResourceArn/Bucket_and_object (0.00s) --- PASS: TestResourceArn/Bucket_and_nested_object (0.00s) === RUN TestActionConversion === RUN TestActionConversion/Already_has_s3_prefix === RUN TestActionConversion/Add_s3_prefix --- PASS: TestActionConversion (0.00s) --- PASS: TestActionConversion/Already_has_s3_prefix (0.00s) --- PASS: TestActionConversion/Add_s3_prefix (0.00s) === RUN TestPolicyEngineForRequest --- PASS: TestPolicyEngineForRequest (0.00s) === RUN TestWildcardMatching === RUN TestWildcardMatching/Exact_match === RUN TestWildcardMatching/Single_wildcard === RUN TestWildcardMatching/Prefix_wildcard === RUN TestWildcardMatching/Suffix_wildcard === RUN TestWildcardMatching/Middle_wildcard === RUN TestWildcardMatching/No_match === RUN TestWildcardMatching/Multiple_wildcards --- PASS: TestWildcardMatching (0.01s) --- PASS: TestWildcardMatching/Exact_match (0.00s) --- PASS: TestWildcardMatching/Single_wildcard (0.00s) --- PASS: TestWildcardMatching/Prefix_wildcard (0.00s) --- PASS: TestWildcardMatching/Suffix_wildcard (0.00s) --- PASS: TestWildcardMatching/Middle_wildcard (0.00s) --- PASS: TestWildcardMatching/No_match (0.00s) --- PASS: TestWildcardMatching/Multiple_wildcards (0.00s) === RUN TestCompilePolicy --- PASS: TestCompilePolicy (0.00s) === RUN TestExistingObjectTagCondition === RUN TestExistingObjectTagCondition/Matching_tag_value_-_should_allow === RUN TestExistingObjectTagCondition/Non-matching_tag_value_-_should_be_indeterminate === RUN TestExistingObjectTagCondition/Missing_tag_-_should_be_indeterminate === RUN TestExistingObjectTagCondition/No_tags_-_should_be_indeterminate === RUN TestExistingObjectTagCondition/Empty_tags_-_should_be_indeterminate === RUN TestExistingObjectTagCondition/Multiple_tags_with_matching_one_-_should_allow --- PASS: TestExistingObjectTagCondition (0.12s) --- PASS: TestExistingObjectTagCondition/Matching_tag_value_-_should_allow (0.00s) --- PASS: TestExistingObjectTagCondition/Non-matching_tag_value_-_should_be_indeterminate (0.01s) --- PASS: TestExistingObjectTagCondition/Missing_tag_-_should_be_indeterminate (0.00s) --- PASS: TestExistingObjectTagCondition/No_tags_-_should_be_indeterminate (0.00s) --- PASS: TestExistingObjectTagCondition/Empty_tags_-_should_be_indeterminate (0.00s) --- PASS: TestExistingObjectTagCondition/Multiple_tags_with_matching_one_-_should_allow (0.00s) === RUN TestRequestObjectTagCondition === RUN TestRequestObjectTagCondition/matching_tag_allows === RUN TestRequestObjectTagCondition/matching_tag_among_others_allows === RUN TestRequestObjectTagCondition/url-encoded_value_is_decoded === RUN TestRequestObjectTagCondition/other_value_is_not_allowed === RUN TestRequestObjectTagCondition/missing_tag_is_not_allowed === RUN TestRequestObjectTagCondition/no_tagging_header_is_not_allowed === RUN TestRequestObjectTagCondition/malformed_header_is_not_allowed === RUN TestRequestObjectTagCondition/last_value_of_a_repeated_key_counts === RUN TestRequestObjectTagCondition/earlier_value_of_a_repeated_key_is_ignored === RUN TestRequestObjectTagCondition/header_is_ignored_on_PutObjectTagging === RUN TestRequestObjectTagCondition/header_counts_with_an_unrelated_query_parameter === RUN TestRequestObjectTagCondition/header_counts_on_a_Signature_V2_presigned_PUT === RUN TestRequestObjectTagCondition/header_is_ignored_on_a_renameObject_subresource === RUN TestRequestObjectTagCondition/header_is_ignored_on_a_copy_that_keeps_source_tags === RUN TestRequestObjectTagCondition/header_counts_on_a_copy_that_replaces_tags === RUN TestRequestObjectTagCondition/header_is_ignored_on_a_multipart_copy_that_replaces_tags === RUN TestRequestObjectTagCondition/header_counts_on_a_copy_with_a_lone_partNumber === RUN TestRequestObjectTagCondition/header_counts_on_a_multipart_create === RUN TestRequestObjectTagCondition/header_is_ignored_on_a_part_upload === RUN TestRequestObjectTagCondition/header_is_ignored_on_multipart_completion === RUN TestRequestObjectTagCondition/header_is_ignored_on_a_directory_marker === RUN TestRequestObjectTagCondition/header_is_ignored_on_an_acl_subresource === RUN TestRequestObjectTagCondition/header_is_ignored_on_a_GET === RUN TestRequestObjectTagCondition/header_is_ignored_on_a_DELETE --- PASS: TestRequestObjectTagCondition (0.08s) --- PASS: TestRequestObjectTagCondition/matching_tag_allows (0.00s) --- PASS: TestRequestObjectTagCondition/matching_tag_among_others_allows (0.00s) --- PASS: TestRequestObjectTagCondition/url-encoded_value_is_decoded (0.00s) --- PASS: TestRequestObjectTagCondition/other_value_is_not_allowed (0.00s) --- PASS: TestRequestObjectTagCondition/missing_tag_is_not_allowed (0.01s) --- PASS: TestRequestObjectTagCondition/no_tagging_header_is_not_allowed (0.00s) --- PASS: TestRequestObjectTagCondition/malformed_header_is_not_allowed (0.00s) --- PASS: TestRequestObjectTagCondition/last_value_of_a_repeated_key_counts (0.00s) --- PASS: TestRequestObjectTagCondition/earlier_value_of_a_repeated_key_is_ignored (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_PutObjectTagging (0.00s) --- PASS: TestRequestObjectTagCondition/header_counts_with_an_unrelated_query_parameter (0.00s) --- PASS: TestRequestObjectTagCondition/header_counts_on_a_Signature_V2_presigned_PUT (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_a_renameObject_subresource (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_a_copy_that_keeps_source_tags (0.00s) --- PASS: TestRequestObjectTagCondition/header_counts_on_a_copy_that_replaces_tags (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_a_multipart_copy_that_replaces_tags (0.00s) --- PASS: TestRequestObjectTagCondition/header_counts_on_a_copy_with_a_lone_partNumber (0.00s) --- PASS: TestRequestObjectTagCondition/header_counts_on_a_multipart_create (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_a_part_upload (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_multipart_completion (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_a_directory_marker (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_an_acl_subresource (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_a_GET (0.00s) --- PASS: TestRequestObjectTagCondition/header_is_ignored_on_a_DELETE (0.00s) === RUN TestRequestObjectTagConditionDeny === RUN TestRequestObjectTagConditionDeny/required_tag_passes === RUN TestRequestObjectTagConditionDeny/other_value_is_denied === RUN TestRequestObjectTagConditionDeny/missing_tag_is_denied === RUN TestRequestObjectTagConditionDeny/repeated_key_ending_in_another_value_is_denied === RUN TestRequestObjectTagConditionDeny/malformed_header_is_denied === RUN TestRequestObjectTagConditionDeny/unrelated_query_parameter_does_not_hide_the_tag --- PASS: TestRequestObjectTagConditionDeny (0.02s) --- PASS: TestRequestObjectTagConditionDeny/required_tag_passes (0.00s) --- PASS: TestRequestObjectTagConditionDeny/other_value_is_denied (0.00s) --- PASS: TestRequestObjectTagConditionDeny/missing_tag_is_denied (0.00s) --- PASS: TestRequestObjectTagConditionDeny/repeated_key_ending_in_another_value_is_denied (0.00s) --- PASS: TestRequestObjectTagConditionDeny/malformed_header_is_denied (0.00s) --- PASS: TestRequestObjectTagConditionDeny/unrelated_query_parameter_does_not_hide_the_tag (0.00s) === RUN TestRequestObjectTagKeysCondition === RUN TestRequestObjectTagKeysCondition/listed_key_allows === RUN TestRequestObjectTagKeysCondition/all_listed_keys_allow === RUN TestRequestObjectTagKeysCondition/unlisted_key_is_not_allowed === RUN TestRequestObjectTagKeysCondition/no_tagging_header_is_not_allowed === RUN TestRequestObjectTagKeysCondition/repeated_key_counts_once === RUN TestRequestObjectTagKeysCondition/url-encoded_key_is_decoded === RUN TestRequestObjectTagKeysCondition/empty_segments_add_no_key === RUN TestRequestObjectTagKeysCondition/empty_key_is_not_allowed === RUN TestRequestObjectTagKeysCondition/key_case_is_preserved === RUN TestRequestObjectTagKeysCondition/malformed_header_is_not_allowed === RUN TestRequestObjectTagKeysCondition/secret_key_is_denied === RUN TestRequestObjectTagKeysCondition/secret_key_behind_a_padded_header_is_denied === RUN TestRequestObjectTagKeysCondition/secret_key_among_listed_keys_is_denied === RUN TestRequestObjectTagKeysCondition/url-encoded_secret_key_is_denied === RUN TestRequestObjectTagKeysCondition/secret_key_on_a_copy_that_replaces_tags_is_denied === RUN TestRequestObjectTagKeysCondition/secret_key_on_a_multipart_create_is_denied === RUN TestRequestObjectTagKeysCondition/header_is_ignored_on_a_copy_that_keeps_source_tags === RUN TestRequestObjectTagKeysCondition/header_is_ignored_on_PutObjectTagging === RUN TestRequestObjectTagKeysCondition/header_is_ignored_on_a_part_upload --- PASS: TestRequestObjectTagKeysCondition (0.07s) --- PASS: TestRequestObjectTagKeysCondition/listed_key_allows (0.00s) --- PASS: TestRequestObjectTagKeysCondition/all_listed_keys_allow (0.00s) --- PASS: TestRequestObjectTagKeysCondition/unlisted_key_is_not_allowed (0.00s) --- PASS: TestRequestObjectTagKeysCondition/no_tagging_header_is_not_allowed (0.00s) --- PASS: TestRequestObjectTagKeysCondition/repeated_key_counts_once (0.00s) --- PASS: TestRequestObjectTagKeysCondition/url-encoded_key_is_decoded (0.00s) --- PASS: TestRequestObjectTagKeysCondition/empty_segments_add_no_key (0.00s) --- PASS: TestRequestObjectTagKeysCondition/empty_key_is_not_allowed (0.00s) --- PASS: TestRequestObjectTagKeysCondition/key_case_is_preserved (0.00s) --- PASS: TestRequestObjectTagKeysCondition/malformed_header_is_not_allowed (0.00s) --- PASS: TestRequestObjectTagKeysCondition/secret_key_is_denied (0.00s) --- PASS: TestRequestObjectTagKeysCondition/secret_key_behind_a_padded_header_is_denied (0.01s) --- PASS: TestRequestObjectTagKeysCondition/secret_key_among_listed_keys_is_denied (0.00s) --- PASS: TestRequestObjectTagKeysCondition/url-encoded_secret_key_is_denied (0.00s) --- PASS: TestRequestObjectTagKeysCondition/secret_key_on_a_copy_that_replaces_tags_is_denied (0.00s) --- PASS: TestRequestObjectTagKeysCondition/secret_key_on_a_multipart_create_is_denied (0.00s) --- PASS: TestRequestObjectTagKeysCondition/header_is_ignored_on_a_copy_that_keeps_source_tags (0.00s) --- PASS: TestRequestObjectTagKeysCondition/header_is_ignored_on_PutObjectTagging (0.00s) --- PASS: TestRequestObjectTagKeysCondition/header_is_ignored_on_a_part_upload (0.00s) === RUN TestRequestObjectTagKeysRequiredTagDeny === RUN TestRequestObjectTagKeysRequiredTagDeny/required_key_passes === RUN TestRequestObjectTagKeysRequiredTagDeny/required_key_with_another_key_passes === RUN TestRequestObjectTagKeysRequiredTagDeny/only_other_keys_are_denied === RUN TestRequestObjectTagKeysRequiredTagDeny/no_tagging_header_is_denied === RUN TestRequestObjectTagKeysRequiredTagDeny/malformed_header_is_denied --- PASS: TestRequestObjectTagKeysRequiredTagDeny (0.02s) --- PASS: TestRequestObjectTagKeysRequiredTagDeny/required_key_passes (0.00s) --- PASS: TestRequestObjectTagKeysRequiredTagDeny/required_key_with_another_key_passes (0.00s) --- PASS: TestRequestObjectTagKeysRequiredTagDeny/only_other_keys_are_denied (0.00s) --- PASS: TestRequestObjectTagKeysRequiredTagDeny/no_tagging_header_is_denied (0.00s) --- PASS: TestRequestObjectTagKeysRequiredTagDeny/malformed_header_is_denied (0.00s) === RUN TestExistingObjectTagConditionMultipleTags === RUN TestExistingObjectTagConditionMultipleTags/Both_tags_match_-_should_allow === RUN TestExistingObjectTagConditionMultipleTags/Both_tags_match_(premium_tier)_-_should_allow === RUN TestExistingObjectTagConditionMultipleTags/Only_status_matches_-_should_be_indeterminate === RUN TestExistingObjectTagConditionMultipleTags/Only_tier_matches_-_should_be_indeterminate === RUN TestExistingObjectTagConditionMultipleTags/Neither_tag_matches_-_should_be_indeterminate --- PASS: TestExistingObjectTagConditionMultipleTags (0.01s) --- PASS: TestExistingObjectTagConditionMultipleTags/Both_tags_match_-_should_allow (0.00s) --- PASS: TestExistingObjectTagConditionMultipleTags/Both_tags_match_(premium_tier)_-_should_allow (0.00s) --- PASS: TestExistingObjectTagConditionMultipleTags/Only_status_matches_-_should_be_indeterminate (0.00s) --- PASS: TestExistingObjectTagConditionMultipleTags/Only_tier_matches_-_should_be_indeterminate (0.00s) --- PASS: TestExistingObjectTagConditionMultipleTags/Neither_tag_matches_-_should_be_indeterminate (0.00s) === RUN TestExistingObjectTagDenyPolicy === RUN TestExistingObjectTagDenyPolicy/No_tags_-_allow_by_default_statement === RUN TestExistingObjectTagDenyPolicy/Non-confidential_tag_-_allow === RUN TestExistingObjectTagDenyPolicy/Confidential_tag_-_deny --- PASS: TestExistingObjectTagDenyPolicy (0.01s) --- PASS: TestExistingObjectTagDenyPolicy/No_tags_-_allow_by_default_statement (0.00s) --- PASS: TestExistingObjectTagDenyPolicy/Non-confidential_tag_-_allow (0.00s) --- PASS: TestExistingObjectTagDenyPolicy/Confidential_tag_-_deny (0.00s) === RUN TestMultipartUploadInheritsPutObjectPermission === RUN TestMultipartUploadInheritsPutObjectPermission/s3:CreateMultipartUpload === RUN TestMultipartUploadInheritsPutObjectPermission/s3:UploadPart === RUN TestMultipartUploadInheritsPutObjectPermission/s3:UploadPartCopy === RUN TestMultipartUploadInheritsPutObjectPermission/s3:CompleteMultipartUpload === RUN TestMultipartUploadInheritsPutObjectPermission/s3:AbortMultipartUpload === RUN TestMultipartUploadInheritsPutObjectPermission/s3:ListMultipartUploadParts === RUN TestMultipartUploadInheritsPutObjectPermission/s3:ListBucketMultipartUploads === RUN TestMultipartUploadInheritsPutObjectPermission/s3:ListBucketMultipartUploads_bucket_ARN === RUN TestMultipartUploadInheritsPutObjectPermission/s3:DeleteObject_not_inherited --- PASS: TestMultipartUploadInheritsPutObjectPermission (0.02s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:CreateMultipartUpload (0.00s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:UploadPart (0.00s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:UploadPartCopy (0.00s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:CompleteMultipartUpload (0.00s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:AbortMultipartUpload (0.00s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:ListMultipartUploadParts (0.00s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:ListBucketMultipartUploads (0.00s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:ListBucketMultipartUploads_bucket_ARN (0.00s) --- PASS: TestMultipartUploadInheritsPutObjectPermission/s3:DeleteObject_not_inherited (0.00s) === RUN TestPolicyVariables --- PASS: TestPolicyVariables (0.03s) === RUN TestEvaluatePolicyForRequestVariables --- PASS: TestEvaluatePolicyForRequestVariables (0.00s) === RUN TestPolicyPrincipalUnmarshal === RUN TestPolicyPrincipalUnmarshal/bare_wildcard === RUN TestPolicyPrincipalUnmarshal/bare_arn === RUN TestPolicyPrincipalUnmarshal/bare_array === RUN TestPolicyPrincipalUnmarshal/AWS_single === RUN TestPolicyPrincipalUnmarshal/AWS_array === RUN TestPolicyPrincipalUnmarshal/AWS_wildcard === RUN TestPolicyPrincipalUnmarshal/AWS_array_wildcard_(public_read) === RUN TestPolicyPrincipalUnmarshal/service === RUN TestPolicyPrincipalUnmarshal/canonical_user === RUN TestPolicyPrincipalUnmarshal/mixed_keys --- PASS: TestPolicyPrincipalUnmarshal (0.02s) --- PASS: TestPolicyPrincipalUnmarshal/bare_wildcard (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/bare_arn (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/bare_array (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/AWS_single (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/AWS_array (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/AWS_wildcard (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/AWS_array_wildcard_(public_read) (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/service (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/canonical_user (0.00s) --- PASS: TestPolicyPrincipalUnmarshal/mixed_keys (0.00s) === RUN TestPolicyPrincipalUnmarshalInvalid --- PASS: TestPolicyPrincipalUnmarshalInvalid (0.00s) === RUN TestNotPrincipalDynamicCompiledPath --- PASS: TestNotPrincipalDynamicCompiledPath (0.01s) === RUN TestPolicyPrincipalRoundTrip --- PASS: TestPolicyPrincipalRoundTrip (0.04s) === RUN TestBucketPolicyAWSObjectPrincipalEndToEnd --- PASS: TestBucketPolicyAWSObjectPrincipalEndToEnd (0.00s) === RUN TestBucketPolicySpecificAWSPrincipal --- PASS: TestBucketPolicySpecificAWSPrincipal (0.00s) === RUN TestBucketPolicyNotPrincipalDeny --- PASS: TestBucketPolicyNotPrincipalDeny (0.01s) === RUN TestBucketPolicyNotPrincipalCompiledPath --- PASS: TestBucketPolicyNotPrincipalCompiledPath (0.01s) === RUN TestPolicyBothPrincipalAndNotPrincipalRejected --- PASS: TestPolicyBothPrincipalAndNotPrincipalRejected (0.00s) === RUN TestOriginalGrantConditionsDeny === RUN TestOriginalGrantConditionsDeny/original_exact_deny === RUN TestOriginalGrantConditionsDeny/original_wildcard_deny === RUN TestOriginalGrantConditionsDeny/canonical_deny_unchanged === RUN TestOriginalGrantConditionsDeny/approved_negative_condition_not_denied === RUN TestOriginalGrantConditionsDeny/negative_deny_unchanged === RUN TestOriginalGrantConditionsDeny/original_value_cannot_allow === RUN TestOriginalGrantConditionsDeny/negative_allow_not_expanded === RUN TestOriginalGrantConditionsDeny/complete_list_allow_unchanged === RUN TestOriginalGrantConditionsDeny/positive_and_negative_conditions_evaluated_separately === RUN TestOriginalGrantConditionsDeny/other_conditions_must_still_match === RUN TestOriginalGrantConditionsDeny/variables_remain_canonical --- PASS: TestOriginalGrantConditionsDeny (0.08s) --- PASS: TestOriginalGrantConditionsDeny/original_exact_deny (0.01s) --- PASS: TestOriginalGrantConditionsDeny/original_wildcard_deny (0.01s) --- PASS: TestOriginalGrantConditionsDeny/canonical_deny_unchanged (0.00s) --- PASS: TestOriginalGrantConditionsDeny/approved_negative_condition_not_denied (0.01s) --- PASS: TestOriginalGrantConditionsDeny/negative_deny_unchanged (0.00s) --- PASS: TestOriginalGrantConditionsDeny/original_value_cannot_allow (0.00s) --- PASS: TestOriginalGrantConditionsDeny/negative_allow_not_expanded (0.00s) --- PASS: TestOriginalGrantConditionsDeny/complete_list_allow_unchanged (0.00s) --- PASS: TestOriginalGrantConditionsDeny/positive_and_negative_conditions_evaluated_separately (0.01s) --- PASS: TestOriginalGrantConditionsDeny/other_conditions_must_still_match (0.01s) --- PASS: TestOriginalGrantConditionsDeny/variables_remain_canonical (0.01s) === RUN TestOriginalGrantConditionsSnapshot --- PASS: TestOriginalGrantConditionsSnapshot (0.00s) === RUN TestSSEStringEqualsPresent --- PASS: TestSSEStringEqualsPresent (0.00s) === RUN TestSSEStringEqualsWrongValue --- PASS: TestSSEStringEqualsWrongValue (0.00s) === RUN TestSSENullConditionAbsent --- PASS: TestSSENullConditionAbsent (0.00s) === RUN TestSSENullConditionPresent --- PASS: TestSSENullConditionPresent (0.00s) === RUN TestSSECaseInsensitiveNormalizationAES256 --- PASS: TestSSECaseInsensitiveNormalizationAES256 (0.00s) === RUN TestSSECaseInsensitiveNormalizationKMS --- PASS: TestSSECaseInsensitiveNormalizationKMS (0.00s) === RUN TestSSEMultipartAES256Exempt --- PASS: TestSSEMultipartAES256Exempt (0.00s) === RUN TestSSEMultipartKMSExempt --- PASS: TestSSEMultipartKMSExempt (0.01s) === RUN TestSSEMultipartNoSSEDenied --- PASS: TestSSEMultipartNoSSEDenied (0.05s) === RUN TestSSEUploadPartCopyKMSExempt --- PASS: TestSSEUploadPartCopyKMSExempt (0.02s) === RUN TestSSEPutObjectStillBlockedWithoutHeader --- PASS: TestSSEPutObjectStillBlockedWithoutHeader (0.01s) === RUN TestTrustedProxies_IsTrusted --- PASS: TestTrustedProxies_IsTrusted (0.00s) === RUN TestTrustedProxies_CanonicalizesBareIPv6 --- PASS: TestTrustedProxies_CanonicalizesBareIPv6 (0.00s) === RUN TestTrustedProxies_InvalidBareIPSkipped E1117 09:40:33.788391 trusted_proxies.go:36 Parse IP not-an-ip in s3 trusted_proxies failed --- PASS: TestTrustedProxies_InvalidBareIPSkipped (0.02s) === RUN TestTrustedProxies_IsTrustedPeer --- PASS: TestTrustedProxies_IsTrustedPeer (0.00s) === RUN TestTrustedProxies_NilNotTrusted --- PASS: TestTrustedProxies_NilNotTrusted (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_DirectPeerWhenUntrusted --- PASS: TestTrustedProxies_ExtractSourceIP_DirectPeerWhenUntrusted (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_XForwardedFor --- PASS: TestTrustedProxies_ExtractSourceIP_XForwardedFor (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_AllTrustedReturnsLeftmost --- PASS: TestTrustedProxies_ExtractSourceIP_AllTrustedReturnsLeftmost (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_MalformedXFFFallsBackToPeer --- PASS: TestTrustedProxies_ExtractSourceIP_MalformedXFFFallsBackToPeer (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_XRealIP --- PASS: TestTrustedProxies_ExtractSourceIP_XRealIP (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_XForwardedForPreferredOverXRealIP --- PASS: TestTrustedProxies_ExtractSourceIP_XForwardedForPreferredOverXRealIP (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_NoTrustedProxiesUsesPeer --- PASS: TestTrustedProxies_ExtractSourceIP_NoTrustedProxiesUsesPeer (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_NilRequest --- PASS: TestTrustedProxies_ExtractSourceIP_NilRequest (0.00s) === RUN TestTrustedProxies_ExtractSourceIP_UnixSocket --- PASS: TestTrustedProxies_ExtractSourceIP_UnixSocket (0.00s) === RUN TestCloneStringOrStringSliceCopiesBackingSlice --- PASS: TestCloneStringOrStringSliceCopiesBackingSlice (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/policy_engine 2.980s === RUN TestEffectiveOwnership === RUN TestEffectiveOwnership/unset === RUN TestEffectiveOwnership/invalid === RUN TestEffectiveOwnership/object_writer === RUN TestEffectiveOwnership/bucket_owner_preferred === RUN TestEffectiveOwnership/bucket_owner_enforced --- PASS: TestEffectiveOwnership (0.14s) --- PASS: TestEffectiveOwnership/unset (0.00s) --- PASS: TestEffectiveOwnership/invalid (0.00s) --- PASS: TestEffectiveOwnership/object_writer (0.00s) --- PASS: TestEffectiveOwnership/bucket_owner_preferred (0.00s) --- PASS: TestEffectiveOwnership/bucket_owner_enforced (0.00s) === RUN TestNormalizeObjectKey === RUN TestNormalizeObjectKey/simple_key === RUN TestNormalizeObjectKey/key_with_leading_slash === RUN TestNormalizeObjectKey/key_with_directory === RUN TestNormalizeObjectKey/key_with_leading_slash_and_directory === RUN TestNormalizeObjectKey/key_with_duplicate_slashes === RUN TestNormalizeObjectKey/Windows_backslash_-_simple === RUN TestNormalizeObjectKey/Windows_backslash_-_nested === RUN TestNormalizeObjectKey/Windows_backslash_-_with_leading_slash === RUN TestNormalizeObjectKey/mixed_slashes === RUN TestNormalizeObjectKey/Windows_full_path_style_(edge_case) === RUN TestNormalizeObjectKey/empty_string === RUN TestNormalizeObjectKey/just_a_slash === RUN TestNormalizeObjectKey/just_a_backslash --- PASS: TestNormalizeObjectKey (0.08s) --- PASS: TestNormalizeObjectKey/simple_key (0.00s) --- PASS: TestNormalizeObjectKey/key_with_leading_slash (0.00s) --- PASS: TestNormalizeObjectKey/key_with_directory (0.00s) --- PASS: TestNormalizeObjectKey/key_with_leading_slash_and_directory (0.00s) --- PASS: TestNormalizeObjectKey/key_with_duplicate_slashes (0.00s) --- PASS: TestNormalizeObjectKey/Windows_backslash_-_simple (0.00s) --- PASS: TestNormalizeObjectKey/Windows_backslash_-_nested (0.00s) --- PASS: TestNormalizeObjectKey/Windows_backslash_-_with_leading_slash (0.00s) --- PASS: TestNormalizeObjectKey/mixed_slashes (0.00s) --- PASS: TestNormalizeObjectKey/Windows_full_path_style_(edge_case) (0.00s) --- PASS: TestNormalizeObjectKey/empty_string (0.00s) --- PASS: TestNormalizeObjectKey/just_a_slash (0.00s) --- PASS: TestNormalizeObjectKey/just_a_backslash (0.00s) === RUN TestIsValidObjectKey === RUN TestIsValidObjectKey/empty === RUN TestIsValidObjectKey/plain === RUN TestIsValidObjectKey/leading_slash === RUN TestIsValidObjectKey/trailing_slash === RUN TestIsValidObjectKey/hidden_file_ok === RUN TestIsValidObjectKey/dotdot_in_name_ok === RUN TestIsValidObjectKey/double_dots_inside_name === RUN TestIsValidObjectKey/bare_dotdot === RUN TestIsValidObjectKey/bare_dot === RUN TestIsValidObjectKey/leading_dotdot_segment === RUN TestIsValidObjectKey/leading_dot-slash === RUN TestIsValidObjectKey/nested_dotdot_segment === RUN TestIsValidObjectKey/trailing_dotdot_segment === RUN TestIsValidObjectKey/backslash_dotdot === RUN TestIsValidObjectKey/mixed-slash_dotdot === RUN TestIsValidObjectKey/dotdot_after_duplicate_slash === RUN TestIsValidObjectKey/nul_byte --- PASS: TestIsValidObjectKey (0.02s) --- PASS: TestIsValidObjectKey/empty (0.00s) --- PASS: TestIsValidObjectKey/plain (0.00s) --- PASS: TestIsValidObjectKey/leading_slash (0.00s) --- PASS: TestIsValidObjectKey/trailing_slash (0.00s) --- PASS: TestIsValidObjectKey/hidden_file_ok (0.00s) --- PASS: TestIsValidObjectKey/dotdot_in_name_ok (0.00s) --- PASS: TestIsValidObjectKey/double_dots_inside_name (0.00s) --- PASS: TestIsValidObjectKey/bare_dotdot (0.00s) --- PASS: TestIsValidObjectKey/bare_dot (0.00s) --- PASS: TestIsValidObjectKey/leading_dotdot_segment (0.00s) --- PASS: TestIsValidObjectKey/leading_dot-slash (0.00s) --- PASS: TestIsValidObjectKey/nested_dotdot_segment (0.00s) --- PASS: TestIsValidObjectKey/trailing_dotdot_segment (0.00s) --- PASS: TestIsValidObjectKey/backslash_dotdot (0.00s) --- PASS: TestIsValidObjectKey/mixed-slash_dotdot (0.00s) --- PASS: TestIsValidObjectKey/dotdot_after_duplicate_slash (0.00s) --- PASS: TestIsValidObjectKey/nul_byte (0.00s) === RUN TestNormalizeObjectKeyAllowBackslash === RUN TestNormalizeObjectKeyAllowBackslash/backslash_kept_verbatim === RUN TestNormalizeObjectKeyAllowBackslash/nested_backslash_kept === RUN TestNormalizeObjectKeyAllowBackslash/trailing_backslash_kept === RUN TestNormalizeObjectKeyAllowBackslash/lone_backslash_kept === RUN TestNormalizeObjectKeyAllowBackslash/double_backslash_kept === RUN TestNormalizeObjectKeyAllowBackslash/mixed_separators === RUN TestNormalizeObjectKeyAllowBackslash/duplicate_slashes_still_collapse === RUN TestNormalizeObjectKeyAllowBackslash/leading_slash_still_trimmed === RUN TestNormalizeObjectKeyAllowBackslash/trailing_slash_preserved === RUN TestNormalizeObjectKeyAllowBackslash/windows_path_style === RUN TestNormalizeObjectKeyAllowBackslash/backslash_dotdot_is_one_segment === RUN TestNormalizeObjectKeyAllowBackslash/backslash_dotdot_inside === RUN TestNormalizeObjectKeyAllowBackslash/nested_dotdot_still_rejected === RUN TestNormalizeObjectKeyAllowBackslash/leading_dotdot_still_rejected === RUN TestNormalizeObjectKeyAllowBackslash/plain_backslash_key --- PASS: TestNormalizeObjectKeyAllowBackslash (0.02s) --- PASS: TestNormalizeObjectKeyAllowBackslash/backslash_kept_verbatim (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/nested_backslash_kept (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/trailing_backslash_kept (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/lone_backslash_kept (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/double_backslash_kept (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/mixed_separators (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/duplicate_slashes_still_collapse (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/leading_slash_still_trimmed (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/trailing_slash_preserved (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/windows_path_style (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/backslash_dotdot_is_one_segment (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/backslash_dotdot_inside (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/nested_dotdot_still_rejected (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/leading_dotdot_still_rejected (0.00s) --- PASS: TestNormalizeObjectKeyAllowBackslash/plain_backslash_key (0.00s) === RUN TestIsValidBucketName === RUN TestIsValidBucketName/empty_ok === RUN TestIsValidBucketName/plain === RUN TestIsValidBucketName/name_containing_dots === RUN TestIsValidBucketName/bare_dot === RUN TestIsValidBucketName/bare_dotdot === RUN TestIsValidBucketName/with_slash === RUN TestIsValidBucketName/with_backslash === RUN TestIsValidBucketName/with_nul --- PASS: TestIsValidBucketName (0.01s) --- PASS: TestIsValidBucketName/empty_ok (0.01s) --- PASS: TestIsValidBucketName/plain (0.00s) --- PASS: TestIsValidBucketName/name_containing_dots (0.00s) --- PASS: TestIsValidBucketName/bare_dot (0.00s) --- PASS: TestIsValidBucketName/bare_dotdot (0.00s) --- PASS: TestIsValidBucketName/with_slash (0.00s) --- PASS: TestIsValidBucketName/with_backslash (0.00s) --- PASS: TestIsValidBucketName/with_nul (0.00s) === RUN TestIsValidPathSegment === RUN TestIsValidPathSegment/opaque-id_123 === RUN TestIsValidPathSegment/..hidden === RUN TestIsValidPathSegment/#00 === RUN TestIsValidPathSegment/. === RUN TestIsValidPathSegment/.. === RUN TestIsValidPathSegment/dir/value === RUN TestIsValidPathSegment/dir\value === RUN TestIsValidPathSegment/nul\x00value --- PASS: TestIsValidPathSegment (0.02s) --- PASS: TestIsValidPathSegment/opaque-id_123 (0.00s) --- PASS: TestIsValidPathSegment/..hidden (0.00s) --- PASS: TestIsValidPathSegment/#00 (0.00s) --- PASS: TestIsValidPathSegment/. (0.00s) --- PASS: TestIsValidPathSegment/.. (0.00s) --- PASS: TestIsValidPathSegment/dir/value (0.00s) --- PASS: TestIsValidPathSegment/dir\value (0.00s) --- PASS: TestIsValidPathSegment/nul\x00value (0.00s) === RUN TestRemoveDuplicateSlashes === RUN TestRemoveDuplicateSlashes/no_duplicates === RUN TestRemoveDuplicateSlashes/double_slash === RUN TestRemoveDuplicateSlashes/triple_slash === RUN TestRemoveDuplicateSlashes/multiple_duplicate_locations === RUN TestRemoveDuplicateSlashes/empty_string --- PASS: TestRemoveDuplicateSlashes (0.01s) --- PASS: TestRemoveDuplicateSlashes/no_duplicates (0.00s) --- PASS: TestRemoveDuplicateSlashes/double_slash (0.00s) --- PASS: TestRemoveDuplicateSlashes/triple_slash (0.00s) --- PASS: TestRemoveDuplicateSlashes/multiple_duplicate_locations (0.00s) --- PASS: TestRemoveDuplicateSlashes/empty_string (0.00s) === RUN TestIdentityHolderPropagation --- PASS: TestIdentityHolderPropagation (0.02s) === RUN TestEnsureIdentityHolderIdempotent --- PASS: TestEnsureIdentityHolderIdempotent (0.01s) === RUN TestGetIdentityNameFromContextWithoutHolder --- PASS: TestGetIdentityNameFromContextWithoutHolder (0.00s) === RUN TestStoredCredentialFingerprintIsKeyed --- PASS: TestStoredCredentialFingerprintIsKeyed (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3_constants 1.974s === RUN TestHasObjectsWithActiveLocksDirectoryMarker --- PASS: TestHasObjectsWithActiveLocksDirectoryMarker (0.01s) === RUN TestHasObjectsWithActiveLocksUnlockedDirectory --- PASS: TestHasObjectsWithActiveLocksUnlockedDirectory (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3_objectlock 2.321s === RUN Test_verifyBucketName --- PASS: Test_verifyBucketName (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3bucket 0.561s === RUN TestGetAccessLogUsesAmzRequestID --- PASS: TestGetAccessLogUsesAmzRequestID (0.02s) === RUN TestGetAccessLogRemoteIP === RUN TestGetAccessLogRemoteIP/falls_back_to_RemoteAddr_(port_stripped)_when_no_headers_set === RUN TestGetAccessLogRemoteIP/preserves_IPv6_host_from_RemoteAddr === RUN TestGetAccessLogRemoteIP/returns_RemoteAddr_unchanged_when_no_port_present === RUN TestGetAccessLogRemoteIP/uses_X-Real-IP_when_X-Forwarded-For_is_absent === RUN TestGetAccessLogRemoteIP/prefers_X-Forwarded-For_over_X-Real-IP === RUN TestGetAccessLogRemoteIP/uses_first_hop_in_X-Forwarded-For_chain === RUN TestGetAccessLogRemoteIP/skips_empty_leading_entries_in_X-Forwarded-For --- PASS: TestGetAccessLogRemoteIP (0.03s) --- PASS: TestGetAccessLogRemoteIP/falls_back_to_RemoteAddr_(port_stripped)_when_no_headers_set (0.00s) --- PASS: TestGetAccessLogRemoteIP/preserves_IPv6_host_from_RemoteAddr (0.00s) --- PASS: TestGetAccessLogRemoteIP/returns_RemoteAddr_unchanged_when_no_port_present (0.00s) --- PASS: TestGetAccessLogRemoteIP/uses_X-Real-IP_when_X-Forwarded-For_is_absent (0.00s) --- PASS: TestGetAccessLogRemoteIP/prefers_X-Forwarded-For_over_X-Real-IP (0.00s) --- PASS: TestGetAccessLogRemoteIP/uses_first_hop_in_X-Forwarded-For_chain (0.00s) --- PASS: TestGetAccessLogRemoteIP/skips_empty_leading_entries_in_X-Forwarded-For (0.00s) === RUN TestGetAccessLogRequesterFromFallback --- PASS: TestGetAccessLogRequesterFromFallback (0.00s) === RUN TestGetAccessLogRequesterAnonymous --- PASS: TestGetAccessLogRequesterAnonymous (0.00s) === RUN TestGetAccessLogRequesterArnForAssumedRole --- PASS: TestGetAccessLogRequesterArnForAssumedRole (0.00s) === RUN TestGetAccessLogRequesterIdentityFromFallback --- PASS: TestGetAccessLogRequesterIdentityFromFallback (0.00s) === RUN TestAuditTrackingFlag --- PASS: TestAuditTrackingFlag (0.01s) === RUN TestGetAccessLogLabelsBucketLevelOperations --- PASS: TestGetAccessLogLabelsBucketLevelOperations (0.02s) === RUN TestWriteErrorResponseReusesRequestID --- PASS: TestWriteErrorResponseReusesRequestID (0.02s) === RUN TestWriteErrorResponseDrainsRequestBodyBeforeWriting --- PASS: TestWriteErrorResponseDrainsRequestBodyBeforeWriting (0.01s) === RUN TestWriteResponseOmitsBodyWhenNotAllowed === RUN TestWriteResponseOmitsBodyWhenNotAllowed/head_request === RUN TestWriteResponseOmitsBodyWhenNotAllowed/no_content === RUN TestWriteResponseOmitsBodyWhenNotAllowed/not_modified --- PASS: TestWriteResponseOmitsBodyWhenNotAllowed (0.02s) --- PASS: TestWriteResponseOmitsBodyWhenNotAllowed/head_request (0.00s) --- PASS: TestWriteResponseOmitsBodyWhenNotAllowed/no_content (0.00s) --- PASS: TestWriteResponseOmitsBodyWhenNotAllowed/not_modified (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3err 2.031s === RUN TestRuleActionKinds_SingleAction === RUN TestRuleActionKinds_SingleAction/expiration_days === RUN TestRuleActionKinds_SingleAction/expiration_date === RUN TestRuleActionKinds_SingleAction/expired_delete_marker === RUN TestRuleActionKinds_SingleAction/noncurrent_days === RUN TestRuleActionKinds_SingleAction/newer_noncurrent_alone === RUN TestRuleActionKinds_SingleAction/abort_mpu --- PASS: TestRuleActionKinds_SingleAction (0.02s) --- PASS: TestRuleActionKinds_SingleAction/expiration_days (0.00s) --- PASS: TestRuleActionKinds_SingleAction/expiration_date (0.00s) --- PASS: TestRuleActionKinds_SingleAction/expired_delete_marker (0.00s) --- PASS: TestRuleActionKinds_SingleAction/noncurrent_days (0.00s) --- PASS: TestRuleActionKinds_SingleAction/newer_noncurrent_alone (0.00s) --- PASS: TestRuleActionKinds_SingleAction/abort_mpu (0.00s) === RUN TestRuleActionKinds_MultiAction --- PASS: TestRuleActionKinds_MultiAction (0.00s) === RUN TestRuleActionKinds_NoncurrentDaysSubsumesNewerNoncurrent --- PASS: TestRuleActionKinds_NoncurrentDaysSubsumesNewerNoncurrent (0.00s) === RUN TestRuleActionKinds_Empty --- PASS: TestRuleActionKinds_Empty (0.00s) === RUN TestActionKind_StringIsStable --- PASS: TestActionKind_StringIsStable (0.00s) === RUN TestComputeDueAt_ExpirationDays --- PASS: TestComputeDueAt_ExpirationDays (0.00s) === RUN TestComputeDueAt_ExpirationDate --- PASS: TestComputeDueAt_ExpirationDate (0.00s) === RUN TestComputeDueAt_DeleteMarker_NotSoleSurvivor --- PASS: TestComputeDueAt_DeleteMarker_NotSoleSurvivor (0.00s) === RUN TestComputeDueAt_KindNotDeclared --- PASS: TestComputeDueAt_KindNotDeclared (0.00s) === RUN TestComputeDueAt_WrongShapeForKind --- PASS: TestComputeDueAt_WrongShapeForKind (0.00s) === RUN TestComputeDueAt_NoncurrentDeleteMarkerHonorsNoncurrentDays --- PASS: TestComputeDueAt_NoncurrentDeleteMarkerHonorsNoncurrentDays (0.00s) === RUN TestComputeDueAt_NoncurrentSuccessorMtime --- PASS: TestComputeDueAt_NoncurrentSuccessorMtime (0.00s) === RUN TestComputeDueAt_FilterRejects --- PASS: TestComputeDueAt_FilterRejects (0.00s) === RUN TestComputeDueAt_DisabledRule --- PASS: TestComputeDueAt_DisabledRule (0.00s) === RUN TestComputeDueAt_MPUInit --- PASS: TestComputeDueAt_MPUInit (0.00s) === RUN TestEvaluateAction_DisabledRuleNeverFires --- PASS: TestEvaluateAction_DisabledRuleNeverFires (0.00s) === RUN TestEvaluateAction_NilInputs --- PASS: TestEvaluateAction_NilInputs (0.00s) === RUN TestEvaluateAction_ExpirationDaysBoundary --- PASS: TestEvaluateAction_ExpirationDaysBoundary (0.00s) === RUN TestEvaluateAction_KindFiltersByDeclaredAction --- PASS: TestEvaluateAction_KindFiltersByDeclaredAction (0.00s) === RUN TestEvaluateAction_MultiActionRule_SiblingsIndependent --- PASS: TestEvaluateAction_MultiActionRule_SiblingsIndependent (0.00s) === RUN TestEvaluateAction_ExpirationDate --- PASS: TestEvaluateAction_ExpirationDate (0.00s) === RUN TestEvaluateAction_ExpiredObjectDeleteMarker --- PASS: TestEvaluateAction_ExpiredObjectDeleteMarker (0.00s) === RUN TestEvaluateAction_NoncurrentDeleteMarkerExpiresViaNoncurrentDays --- PASS: TestEvaluateAction_NoncurrentDeleteMarkerExpiresViaNoncurrentDays (0.00s) === RUN TestEvaluateAction_NoncurrentVersionDays --- PASS: TestEvaluateAction_NoncurrentVersionDays (0.00s) === RUN TestEvaluateAction_NoncurrentDaysFallsBackToModTime --- PASS: TestEvaluateAction_NoncurrentDaysFallsBackToModTime (0.00s) === RUN TestEvaluateAction_NoncurrentDays_WithKeepN_NilIndexIsNoOp --- PASS: TestEvaluateAction_NoncurrentDays_WithKeepN_NilIndexIsNoOp (0.00s) === RUN TestEvaluateAction_NewerNoncurrent_NilIndexIsNoOp --- PASS: TestEvaluateAction_NewerNoncurrent_NilIndexIsNoOp (0.00s) === RUN TestEvaluateAction_NewerNoncurrentCountOnly --- PASS: TestEvaluateAction_NewerNoncurrentCountOnly (0.00s) === RUN TestEvaluateAction_NoncurrentDaysAndCount --- PASS: TestEvaluateAction_NoncurrentDaysAndCount (0.00s) === RUN TestEvaluateAction_AbortMultipartUpload --- PASS: TestEvaluateAction_AbortMultipartUpload (0.00s) === RUN TestEvaluateAction_PrefixFilter --- PASS: TestEvaluateAction_PrefixFilter (0.00s) === RUN TestEvaluateAction_TagFilter --- PASS: TestEvaluateAction_TagFilter (0.00s) === RUN TestEvaluateAction_SizeFilter --- PASS: TestEvaluateAction_SizeFilter (0.00s) === RUN TestEvaluateAction_EmptyPrefixMatchesAll --- PASS: TestEvaluateAction_EmptyPrefixMatchesAll (0.00s) === RUN TestEvaluateAction_MPUInitDoesNotFireNoncurrent --- PASS: TestEvaluateAction_MPUInitDoesNotFireNoncurrent (0.00s) === RUN TestEventLogHorizon_PerActionIsIndependent === RUN TestEventLogHorizon_PerActionIsIndependent/expiration_days === RUN TestEventLogHorizon_PerActionIsIndependent/abort_mpu === RUN TestEventLogHorizon_PerActionIsIndependent/noncurrent_days === RUN TestEventLogHorizon_PerActionIsIndependent/expiration_date --- PASS: TestEventLogHorizon_PerActionIsIndependent (0.00s) --- PASS: TestEventLogHorizon_PerActionIsIndependent/expiration_days (0.00s) --- PASS: TestEventLogHorizon_PerActionIsIndependent/abort_mpu (0.00s) --- PASS: TestEventLogHorizon_PerActionIsIndependent/noncurrent_days (0.00s) --- PASS: TestEventLogHorizon_PerActionIsIndependent/expiration_date (0.00s) === RUN TestEventLogHorizon_NewerNoncurrentCountOnlyIsSmallDelay --- PASS: TestEventLogHorizon_NewerNoncurrentCountOnlyIsSmallDelay (0.00s) === RUN TestEventLogHorizon_NewerNoncurrentWithDaysIsZero --- PASS: TestEventLogHorizon_NewerNoncurrentWithDaysIsZero (0.00s) === RUN TestEventLogHorizon_ExpiredDeleteMarkerIsSmallDelay --- PASS: TestEventLogHorizon_ExpiredDeleteMarkerIsSmallDelay (0.00s) === RUN TestEventLogHorizon_DateKindReturnsZero --- PASS: TestEventLogHorizon_DateKindReturnsZero (0.00s) === RUN TestEventLogHorizon_NilRule --- PASS: TestEventLogHorizon_NilRule (0.00s) === RUN TestEventLogHorizon_KindNotDeclaredReturnsZero --- PASS: TestEventLogHorizon_KindNotDeclaredReturnsZero (0.00s) === RUN TestActionKind_StringUnspecifiedDefault --- PASS: TestActionKind_StringUnspecifiedDefault (0.00s) === RUN TestHashExtended_DirectFromLifecyclePackage --- PASS: TestHashExtended_DirectFromLifecyclePackage (0.01s) === RUN TestMinTriggerAge_PerKind === RUN TestMinTriggerAge_PerKind/expiration_days === RUN TestMinTriggerAge_PerKind/noncurrent_days === RUN TestMinTriggerAge_PerKind/abort_mpu === RUN TestMinTriggerAge_PerKind/expiration_date === RUN TestMinTriggerAge_PerKind/newer_noncurrent === RUN TestMinTriggerAge_PerKind/expired_delete_marker --- PASS: TestMinTriggerAge_PerKind (0.00s) --- PASS: TestMinTriggerAge_PerKind/expiration_days (0.00s) --- PASS: TestMinTriggerAge_PerKind/noncurrent_days (0.00s) --- PASS: TestMinTriggerAge_PerKind/abort_mpu (0.00s) --- PASS: TestMinTriggerAge_PerKind/expiration_date (0.00s) --- PASS: TestMinTriggerAge_PerKind/newer_noncurrent (0.00s) --- PASS: TestMinTriggerAge_PerKind/expired_delete_marker (0.00s) === RUN TestMinTriggerAge_KindNotSetReturnsZero --- PASS: TestMinTriggerAge_KindNotSetReturnsZero (0.00s) === RUN TestMinTriggerAge_DateOnlyReturnsZero --- PASS: TestMinTriggerAge_DateOnlyReturnsZero (0.00s) === RUN TestMinTriggerAge_NilRule --- PASS: TestMinTriggerAge_NilRule (0.00s) === RUN TestSuccessorFromEntryStamp_NilOrMissingReturnsZero --- PASS: TestSuccessorFromEntryStamp_NilOrMissingReturnsZero (0.00s) === RUN TestSuccessorFromEntryStamp_EmptyOrInvalidReturnsZero --- PASS: TestSuccessorFromEntryStamp_EmptyOrInvalidReturnsZero (0.00s) === RUN TestSuccessorFromEntryStamp_NonPositiveReturnsZero --- PASS: TestSuccessorFromEntryStamp_NonPositiveReturnsZero (0.00s) === RUN TestSuccessorFromEntryStamp_PositiveNanosRoundTrip --- PASS: TestSuccessorFromEntryStamp_PositiveNanosRoundTrip (0.00s) === RUN TestSuccessorFromEntryStamp_OrderedNanosStayOrdered --- PASS: TestSuccessorFromEntryStamp_OrderedNanosStayOrdered (0.00s) === RUN TestRuleHash_Stable --- PASS: TestRuleHash_Stable (0.01s) === RUN TestRuleHash_TagOrderInvariant --- PASS: TestRuleHash_TagOrderInvariant (0.00s) === RUN TestRuleHash_PrefixTrailingSlashMattersToHash --- PASS: TestRuleHash_PrefixTrailingSlashMattersToHash (0.00s) === RUN TestRuleHash_IDIgnored --- PASS: TestRuleHash_IDIgnored (0.00s) === RUN TestRuleHash_StatusIgnored --- PASS: TestRuleHash_StatusIgnored (0.00s) === RUN TestRuleHash_DifferentDaysHashDifferent --- PASS: TestRuleHash_DifferentDaysHashDifferent (0.00s) === RUN TestRuleHash_DifferentActionTypesHashDifferent --- PASS: TestRuleHash_DifferentActionTypesHashDifferent (0.00s) === RUN TestRuleHash_FilterMatters --- PASS: TestRuleHash_FilterMatters (0.00s) === RUN TestRuleHash_NilSafe --- PASS: TestRuleHash_NilSafe (0.00s) === RUN TestRuleHash_TagDelimiterCollisionResistant --- PASS: TestRuleHash_TagDelimiterCollisionResistant (0.00s) === RUN TestRuleHash_TagNewlineCollisionResistant --- PASS: TestRuleHash_TagNewlineCollisionResistant (0.00s) === RUN TestRuleHash_PrefixSeparatorIsolation --- PASS: TestRuleHash_PrefixSeparatorIsolation (0.00s) === RUN TestShardIDInRange --- PASS: TestShardIDInRange (0.00s) === RUN TestShardIDDeterministic --- PASS: TestShardIDDeterministic (0.00s) === RUN TestShardIDDistinctFromBucket --- PASS: TestShardIDDistinctFromBucket (0.00s) === RUN TestCompareVersionIds_EqualReturnsZero --- PASS: TestCompareVersionIds_EqualReturnsZero (0.00s) === RUN TestCompareVersionIds_NullSortsLast --- PASS: TestCompareVersionIds_NullSortsLast (0.00s) === RUN TestCompareVersionIds_BothNewFormatSmallerIsNewer --- PASS: TestCompareVersionIds_BothNewFormatSmallerIsNewer (0.00s) === RUN TestCompareVersionIds_BothOldFormatLargerIsNewer --- PASS: TestCompareVersionIds_BothOldFormatLargerIsNewer (0.00s) === RUN TestCompareVersionIds_MixedFormatComparesByTimestamp --- PASS: TestCompareVersionIds_MixedFormatComparesByTimestamp (0.00s) === RUN TestCompareVersionIds_MixedFormatEqualTimestampReturnsZero --- PASS: TestCompareVersionIds_MixedFormatEqualTimestampReturnsZero (0.00s) === RUN TestIsNewFormatVersionId_TooShortRejected --- PASS: TestIsNewFormatVersionId_TooShortRejected (0.00s) === RUN TestIsNewFormatVersionId_NullRejected --- PASS: TestIsNewFormatVersionId_NullRejected (0.00s) === RUN TestIsNewFormatVersionId_NonHexRejected --- PASS: TestIsNewFormatVersionId_NonHexRejected (0.00s) === RUN TestIsNewFormatVersionId_ThresholdBoundary --- PASS: TestIsNewFormatVersionId_ThresholdBoundary (0.00s) === RUN TestGetVersionTimestamp_ReturnsZeroOnMalformed --- PASS: TestGetVersionTimestamp_ReturnsZeroOnMalformed (0.00s) === RUN TestGetVersionTimestamp_OldFormatReturnsRawValue --- PASS: TestGetVersionTimestamp_OldFormatReturnsRawValue (0.00s) === RUN TestGetVersionTimestamp_NewFormatReturnsInvertedValue --- PASS: TestGetVersionTimestamp_NewFormatReturnsInvertedValue (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle 2.372s === RUN TestHasPrefix === RUN TestHasPrefix/matching_prefix === RUN TestHasPrefix/exact_match === RUN TestHasPrefix/non-matching_prefix === RUN TestHasPrefix/shorter_than_prefix === RUN TestHasPrefix/empty_prefix_matches_all === RUN TestHasPrefix/both_empty === RUN TestHasPrefix/empty_input_non-empty_prefix --- PASS: TestHasPrefix (0.02s) --- PASS: TestHasPrefix/matching_prefix (0.00s) --- PASS: TestHasPrefix/exact_match (0.00s) --- PASS: TestHasPrefix/non-matching_prefix (0.00s) --- PASS: TestHasPrefix/shorter_than_prefix (0.00s) --- PASS: TestHasPrefix/empty_prefix_matches_all (0.00s) --- PASS: TestHasPrefix/both_empty (0.00s) --- PASS: TestHasPrefix/empty_input_non-empty_prefix (0.00s) === RUN TestWalk_DispatchesDueActions --- PASS: TestWalk_DispatchesDueActions (0.02s) === RUN TestWalk_MultiActionRule_AllDueDispatched --- PASS: TestWalk_MultiActionRule_AllDueDispatched (0.01s) === RUN TestWalk_NotYetDueSkipped --- PASS: TestWalk_NotYetDueSkipped (0.01s) === RUN TestWalk_DateActionFiresAfterDate --- PASS: TestWalk_DateActionFiresAfterDate (0.00s) === RUN TestWalk_DateActionSkippedBeforeDate --- PASS: TestWalk_DateActionSkippedBeforeDate (0.01s) === RUN TestWalk_DirectoryEntriesSkipped --- PASS: TestWalk_DirectoryEntriesSkipped (0.00s) === RUN TestWalk_DisabledModeSkipped --- PASS: TestWalk_DisabledModeSkipped (0.00s) === RUN TestWalk_PendingBootstrapNotDispatched --- PASS: TestWalk_PendingBootstrapNotDispatched (0.00s) === RUN TestWalk_DispatchErrorHaltsAtCheckpoint W1117 09:40:33.106163 walker.go:183 lifecycle bootstrap: dispatch bk/a kind=expiration_days: dispatch boom --- PASS: TestWalk_DispatchErrorHaltsAtCheckpoint (0.08s) === RUN TestWalk_ResumeFromCheckpoint --- PASS: TestWalk_ResumeFromCheckpoint (0.01s) === RUN TestWalk_MPUInitDirMatchesByDestKey --- PASS: TestWalk_MPUInitDirMatchesByDestKey (0.00s) === RUN TestWalk_NonMPUDirectorySkipped --- PASS: TestWalk_NonMPUDirectorySkipped (0.00s) === RUN TestWalk_MPUInitDoesNotFireNoncurrent --- PASS: TestWalk_MPUInitDoesNotFireNoncurrent (0.02s) === RUN TestWalk_CheckpointStaysBeforeUnfinishedVersionGroup W1117 09:40:33.249326 walker.go:183 lifecycle bootstrap: dispatch bk/obj kind=expiration_days: dispatch boom --- PASS: TestWalk_CheckpointStaysBeforeUnfinishedVersionGroup (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle/bootstrap 2.364s === RUN TestSummarizeShardCursorLag_AllColdStart --- PASS: TestSummarizeShardCursorLag_AllColdStart (0.01s) === RUN TestSummarizeShardCursorLag_PicksMaxAcrossShards --- PASS: TestSummarizeShardCursorLag_PicksMaxAcrossShards (0.01s) === RUN TestSummarizeShardCursorLag_PartialFill --- PASS: TestSummarizeShardCursorLag_PartialFill (0.01s) === RUN TestFilerCursorPersister_EmptyLoadReturnsNotFound --- PASS: TestFilerCursorPersister_EmptyLoadReturnsNotFound (0.01s) === RUN TestFilerCursorPersister_SaveLoadRoundTrip --- PASS: TestFilerCursorPersister_SaveLoadRoundTrip (0.03s) === RUN TestFilerCursorPersister_IsolatesShards --- PASS: TestFilerCursorPersister_IsolatesShards (0.02s) === RUN TestFilerCursorPersister_CorruptDataReturnsError --- PASS: TestFilerCursorPersister_CorruptDataReturnsError (0.05s) === RUN TestFilerCursorPersister_EmptyFileReturnsError --- PASS: TestFilerCursorPersister_EmptyFileReturnsError (0.00s) === RUN TestFilerCursorPersister_WrongVersionReturnsError --- PASS: TestFilerCursorPersister_WrongVersionReturnsError (0.00s) === RUN TestFilerCursorPersister_ShardIDMismatchReturnsError --- PASS: TestFilerCursorPersister_ShardIDMismatchReturnsError (0.00s) === RUN TestFilerCursorPersister_HashLengthMismatchReturnsError --- PASS: TestFilerCursorPersister_HashLengthMismatchReturnsError (0.00s) === RUN TestFilerCursorPersister_NilStoreErrors --- PASS: TestFilerCursorPersister_NilStoreErrors (0.00s) === RUN TestFilerCursorPersister_FullPassRoundTrip --- PASS: TestFilerCursorPersister_FullPassRoundTrip (0.01s) === RUN TestFilerCursorPersister_FullPassRejectsUnknownVersion --- PASS: TestFilerCursorPersister_FullPassRejectsUnknownVersion (0.00s) === RUN TestDispatch_UnavailableThenSuccess --- PASS: TestDispatch_UnavailableThenSuccess (0.20s) === RUN TestDispatch_ServerDeadlineIsRetried --- PASS: TestDispatch_ServerDeadlineIsRetried (0.13s) === RUN TestDispatch_PermanentErrorsAreNotRetried === RUN TestDispatch_PermanentErrorsAreNotRetried/Unauthenticated === RUN TestDispatch_PermanentErrorsAreNotRetried/PermissionDenied === RUN TestDispatch_PermanentErrorsAreNotRetried/InvalidArgument === RUN TestDispatch_PermanentErrorsAreNotRetried/Unimplemented --- PASS: TestDispatch_PermanentErrorsAreNotRetried (0.01s) --- PASS: TestDispatch_PermanentErrorsAreNotRetried/Unauthenticated (0.00s) --- PASS: TestDispatch_PermanentErrorsAreNotRetried/PermissionDenied (0.00s) --- PASS: TestDispatch_PermanentErrorsAreNotRetried/InvalidArgument (0.00s) --- PASS: TestDispatch_PermanentErrorsAreNotRetried/Unimplemented (0.00s) === RUN TestDispatch_NilResponseIsAnErrorNotAPanic --- PASS: TestDispatch_NilResponseIsAnErrorNotAPanic (0.00s) === RUN TestDispatch_EveryAttemptWaitsOnLimiter --- PASS: TestDispatch_EveryAttemptWaitsOnLimiter (0.40s) === RUN TestProcessMatches_RetryExhaustionHoldsCursorBeforeTheMatch --- PASS: TestProcessMatches_RetryExhaustionHoldsCursorBeforeTheMatch (0.61s) === RUN TestWalkerDispatcher_TransientErrorIsRetried --- PASS: TestWalkerDispatcher_TransientErrorIsRetried (0.14s) === RUN TestWalkerDispatcher_AuthErrorSurfacesAtOnce --- PASS: TestWalkerDispatcher_AuthErrorSurfacesAtOnce (0.07s) === RUN TestWalkerDispatcher_ParentCancelDuringBackoffStops --- PASS: TestWalkerDispatcher_ParentCancelDuringBackoffStops (0.01s) === RUN TestDispatch_StalledAttemptsTimeOutAndFail --- PASS: TestDispatch_StalledAttemptsTimeOutAndFail (0.52s) === RUN TestDispatch_SlowAttemptWithinTimeoutSucceeds --- PASS: TestDispatch_SlowAttemptWithinTimeoutSucceeds (0.03s) === RUN TestDispatch_RetryAfterTimeoutResendsSameRequest --- PASS: TestDispatch_RetryAfterTimeoutResendsSameRequest (0.19s) === RUN TestDispatch_ParentCancelInterruptsActiveAttempt --- PASS: TestDispatch_ParentCancelInterruptsActiveAttempt (0.03s) === RUN TestDispatch_ParentCancelInterruptsBackoff --- PASS: TestDispatch_ParentCancelInterruptsBackoff (0.01s) === RUN TestProcessMatches_AttemptTimeoutFailsShard --- PASS: TestProcessMatches_AttemptTimeoutFailsShard (0.60s) === RUN TestProcessMatches_LimiterWaitDoesNotSpendDeleteTimeout --- PASS: TestProcessMatches_LimiterWaitDoesNotSpendDeleteTimeout (0.18s) === RUN TestWalkerDispatcher_AttemptTimeoutHaltsWalk --- PASS: TestWalkerDispatcher_AttemptTimeoutHaltsWalk (0.36s) === RUN TestWalkerDispatcher_LimiterWaitDoesNotSpendDeleteTimeout --- PASS: TestWalkerDispatcher_LimiterWaitDoesNotSpendDeleteTimeout (0.18s) === RUN TestDispatch_FirstAttemptSucceeds --- PASS: TestDispatch_FirstAttemptSucceeds (0.00s) === RUN TestDispatch_TransportRetryThenSucceed --- PASS: TestDispatch_TransportRetryThenSucceed (0.39s) === RUN TestDispatch_ExhaustsRetriesReturnsError --- PASS: TestDispatch_ExhaustsRetriesReturnsError (0.35s) === RUN TestDispatch_ServerOutcomeRetryLaterIsNotRetried --- PASS: TestDispatch_ServerOutcomeRetryLaterIsNotRetried (0.00s) === RUN TestDispatch_ServerOutcomeBlockedNotRetried --- PASS: TestDispatch_ServerOutcomeBlockedNotRetried (0.00s) === RUN TestDispatch_ContextCancelledShortCircuits --- PASS: TestDispatch_ContextCancelledShortCircuits (0.00s) === RUN TestBuildDeleteRequest_RuleHashAndIdentity --- PASS: TestBuildDeleteRequest_RuleHashAndIdentity (0.00s) === RUN TestFilerListFunc_EmitsFlatFiles --- PASS: TestFilerListFunc_EmitsFlatFiles (0.01s) === RUN TestFilerListFunc_PropagatesTagsOnFlatFiles --- PASS: TestFilerListFunc_PropagatesTagsOnFlatFiles (0.01s) === RUN TestFilerListFunc_RecursesIntoSubdirs --- PASS: TestFilerListFunc_RecursesIntoSubdirs (0.00s) === RUN TestFilerListFunc_MPUInitEmitsWithDestKey --- PASS: TestFilerListFunc_MPUInitEmitsWithDestKey (0.00s) === RUN TestFilerListFunc_MPUInitWithoutDestKeyIsSkipped --- PASS: TestFilerListFunc_MPUInitWithoutDestKeyIsSkipped (0.00s) === RUN TestFilerListFunc_VersionedExpansionMarksLatestByPointer --- PASS: TestFilerListFunc_VersionedExpansionMarksLatestByPointer (0.01s) === RUN TestFilerListFunc_VersionedExpansionStalePointerFallsBackToNewestSibling --- PASS: TestFilerListFunc_VersionedExpansionStalePointerFallsBackToNewestSibling (0.00s) === RUN TestFilerListFunc_VersionedExpansionNoPointerNewestSiblingWins --- PASS: TestFilerListFunc_VersionedExpansionNoPointerNewestSiblingWins (0.00s) === RUN TestFilerListFunc_VersionedExpansionExplicitNullIsLatestWhenPointerMissing --- PASS: TestFilerListFunc_VersionedExpansionExplicitNullIsLatestWhenPointerMissing (0.01s) === RUN TestFilerListFunc_VersionedExpansionExplicitNullBeatsNewerSiblingWhenPointerMissing --- PASS: TestFilerListFunc_VersionedExpansionExplicitNullBeatsNewerSiblingWhenPointerMissing (0.00s) === RUN TestFilerListFunc_VersionsDirWithoutMarkersRecursesAsRegular --- PASS: TestFilerListFunc_VersionsDirWithoutMarkersRecursesAsRegular (0.01s) === RUN TestFilerListFunc_VersionedDeleteMarkerPropagates --- PASS: TestFilerListFunc_VersionedDeleteMarkerPropagates (0.00s) === RUN TestFilerListFunc_HonorsStart W1117 09:40:38.045774 filer_list_func.go:66 lifecycle walk bkt: bad walk position "a"; walking the whole bucket --- PASS: TestFilerListFunc_HonorsStart (0.04s) === RUN TestFilerListFunc_ResumeFollowsTraversalOrder --- PASS: TestFilerListFunc_ResumeFollowsTraversalOrder (0.02s) === RUN TestFilerListFunc_NilClient --- PASS: TestFilerListFunc_NilClient (0.00s) === RUN TestFilerListFunc_SkipsVersionsPrePassOnNonVersionedBucket --- PASS: TestFilerListFunc_SkipsVersionsPrePassOnNonVersionedBucket (0.01s) === RUN TestFilerListFunc_VersionsNamedUserDirOnNonVersionedBucket --- PASS: TestFilerListFunc_VersionsNamedUserDirOnNonVersionedBucket (0.01s) === RUN TestFilerListFunc_AttributesPropagate --- PASS: TestFilerListFunc_AttributesPropagate (0.00s) === RUN TestFilerListFunc_EntriesCarryListedIdentity --- PASS: TestFilerListFunc_EntriesCarryListedIdentity (0.01s) === RUN TestDirInRuleScope --- PASS: TestDirInRuleScope (0.00s) === RUN TestFilerListFunc_PrunesDirsOutsideRulePrefixes --- PASS: TestFilerListFunc_PrunesDirsOutsideRulePrefixes (0.01s) === RUN TestFilerListFunc_NoActiveActionsSkipsWalk --- PASS: TestFilerListFunc_NoActiveActionsSkipsWalk (0.00s) === RUN TestFilerListFunc_UploadsDirExemptFromPruning --- PASS: TestFilerListFunc_UploadsDirExemptFromPruning (0.00s) === RUN TestFilerListFunc_PrunesVersionsDirsOutsidePrefixes --- PASS: TestFilerListFunc_PrunesVersionsDirsOutsidePrefixes (0.00s) === RUN TestJitterBounds --- PASS: TestJitterBounds (0.00s) === RUN TestJitterZeroAndNegative --- PASS: TestJitterZeroAndNegative (0.00s) === RUN TestJitterTinyDuration --- PASS: TestJitterTinyDuration (0.00s) === RUN TestProcessMatches_NotYetDueDoesNotSuppressDueOnSameRule --- PASS: TestProcessMatches_NotYetDueDoesNotSuppressDueOnSameRule (0.00s) === RUN TestProcessMatches_OrderingDoesNotMatter --- PASS: TestProcessMatches_OrderingDoesNotMatter (0.00s) === RUN TestProcessMatches_HaltOnServerOutcomeStopsRemaining --- PASS: TestProcessMatches_HaltOnServerOutcomeStopsRemaining (0.00s) === RUN TestProcessMatches_EmptyMatchesIsNoop --- PASS: TestProcessMatches_EmptyMatchesIsNoop (0.00s) === RUN TestProcessMatches_AllDueNoSkippedFlag --- PASS: TestProcessMatches_AllDueNoSkippedFlag (0.00s) === RUN TestProcessMatches_DispatchCounterIncrements --- PASS: TestProcessMatches_DispatchCounterIncrements (0.00s) === RUN TestRunShard_WalkBoundRuleDoesNotPinCursor --- PASS: TestRunShard_WalkBoundRuleDoesNotPinCursor (0.02s) === RUN TestRun_EndsOnIdleSubscription I1117 09:40:38.224542 run.go:262 daily_run: status=ok shards=3 errors=0 duration=21ms cursor_lag_max=0s walked_max_age=cold --- PASS: TestRun_EndsOnIdleSubscription (0.03s) === RUN TestRun_ReaderFailureFailsThePass W1117 09:40:38.240970 run.go:232 daily_run: shared meta-log subscription: subscribe: rpc error: code = Unavailable desc = filer down I1117 09:40:38.242052 run.go:262 daily_run: status=error shards=2 errors=1 duration=11ms cursor_lag_max=0s walked_max_age=cold --- PASS: TestRun_ReaderFailureFailsThePass (0.01s) === RUN TestRun_CappedPassIsNotAFailure I1117 09:40:38.453309 run.go:262 daily_run: status=ok shards=2 errors=0 duration=207ms cursor_lag_max=0s walked_max_age=cold --- PASS: TestRun_CappedPassIsNotAFailure (0.21s) === RUN TestRun_StalledSubscriptionTimesOutThePass W1117 09:40:38.511988 run.go:232 daily_run: shared meta-log subscription: reader: metadata receive timeout after 50ms I1117 09:40:38.514984 run.go:262 daily_run: status=error shards=2 errors=1 duration=57ms cursor_lag_max=0s walked_max_age=cold --- PASS: TestRun_StalledSubscriptionTimesOutThePass (0.06s) === RUN TestValidate_RejectsNegativeSubscriptionReceiveTimeout --- PASS: TestValidate_RejectsNegativeSubscriptionReceiveTimeout (0.00s) === RUN TestValidate_RejectsRetentionWindowWithoutWalker --- PASS: TestValidate_RejectsRetentionWindowWithoutWalker (0.00s) === RUN TestRun_LateDeadlineDoesNotMaskReaderFailure W1117 09:40:38.829730 run.go:232 daily_run: shared meta-log subscription: subscribe: rpc error: code = Unavailable desc = filer down I1117 09:40:38.830339 run.go:262 daily_run: status=error shards=2 errors=1 duration=305ms cursor_lag_max=0s walked_max_age=cold --- PASS: TestRun_LateDeadlineDoesNotMaskReaderFailure (0.31s) === RUN TestRun_ServerSideCancelFailsThePass W1117 09:40:38.837672 run.go:232 daily_run: shared meta-log subscription: subscribe: rpc error: code = Canceled desc = context canceled I1117 09:40:38.838453 run.go:262 daily_run: status=error shards=2 errors=1 duration=4ms cursor_lag_max=0s walked_max_age=cold --- PASS: TestRun_ServerSideCancelFailsThePass (0.01s) === RUN TestRun_HaltedShardDoesNotStarveOthers I1117 09:40:38.943579 run.go:262 daily_run: status=ok shards=2 errors=0 duration=91ms cursor_lag_max=72h0m0s walked_max_age=cold --- PASS: TestRun_HaltedShardDoesNotStarveOthers (0.11s) === RUN TestRun_ColdStartResumedWalkReplaysOlderEventNextPass I1117 09:40:38.975102 run.go:262 daily_run: status=ok shards=1 errors=0 duration=20ms cursor_lag_max=96h0m0s walked_max_age=0s I1117 09:40:39.004940 run.go:262 daily_run: status=ok shards=1 errors=0 duration=17ms cursor_lag_max=12h1m0s walked_max_age=1m0s --- PASS: TestRun_ColdStartResumedWalkReplaysOlderEventNextPass (0.06s) === RUN TestWalkBuckets_RecordsEveryBucketFailure --- PASS: TestWalkBuckets_RecordsEveryBucketFailure (0.01s) === RUN TestWalkBuckets_CancelMarksRemainingBucketsSkipped --- PASS: TestWalkBuckets_CancelMarksRemainingBucketsSkipped (0.00s) === RUN TestRunStats_FailedWalkWinsAcrossWalksOfOneBucket --- PASS: TestRunStats_FailedWalkWinsAcrossWalksOfOneBucket (0.00s) === RUN TestRunStats_BoundsReportedFailures --- PASS: TestRunStats_BoundsReportedFailures (0.00s) === RUN TestWalkBuckets_CountsEntriesAndObjects --- PASS: TestWalkBuckets_CountsEntriesAndObjects (0.01s) === RUN TestWalkerDispatcher_CountsOutcomes --- PASS: TestWalkerDispatcher_CountsOutcomes (0.56s) === RUN TestProcessMatches_CountsOutcomes --- PASS: TestProcessMatches_CountsOutcomes (0.01s) === RUN TestRunStats_NilIsANoOp --- PASS: TestRunStats_NilIsANoOp (0.00s) === RUN TestRunStats_CountListedCountsSkippedEntries --- PASS: TestRunStats_CountListedCountsSkippedEntries (0.01s) === RUN TestWalkBuckets_DispatchesOnlyShardMatchingEntries --- PASS: TestWalkBuckets_DispatchesOnlyShardMatchingEntries (0.01s) === RUN TestWalkBuckets_NilGuards --- PASS: TestWalkBuckets_NilGuards (0.00s) === RUN TestWalkBuckets_OneBucketErrorDoesNotStopOthers --- PASS: TestWalkBuckets_OneBucketErrorDoesNotStopOthers (0.00s) === RUN TestWalkBuckets_HonorsContextCancellationBetweenBuckets --- PASS: TestWalkBuckets_HonorsContextCancellationBetweenBuckets (0.00s) === RUN TestEntryShardID_MPUUsesDestKey --- PASS: TestEntryShardID_MPUUsesDestKey (0.00s) === RUN TestWalkBuckets_ResumedWalkCountsEarlierBucketsAsWalked W1117 09:40:39.655051 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed I1117 09:40:39.690733 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 1 partly walked --- PASS: TestWalkBuckets_ResumedWalkCountsEarlierBucketsAsWalked (0.08s) === RUN TestWalkBuckets_ResumesAfterFailureInsideVersionGroup W1117 09:40:39.734732 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed I1117 09:40:39.747989 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 1 partly walked --- PASS: TestWalkBuckets_ResumesAfterFailureInsideVersionGroup (0.03s) === RUN TestWalkBuckets_ResumedWalkReportsTheRecordStart W1117 09:40:39.764191 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed I1117 09:40:39.778780 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 1 partly walked W1117 09:40:39.797341 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed --- PASS: TestWalkBuckets_ResumedWalkReportsTheRecordStart (0.05s) === RUN TestWalkBuckets_CheckpointBoundToViewAndShards W1117 09:40:39.810948 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed W1117 09:40:39.826763 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed --- PASS: TestWalkBuckets_CheckpointBoundToViewAndShards (0.03s) === RUN TestWalkBuckets_StuckResumeStartsOver W1117 09:40:39.845865 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed I1117 09:40:39.849963 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 1 partly walked W1117 09:40:39.851348 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed I1117 09:40:39.855833 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 1 partly walked W1117 09:40:39.861259 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed W1117 09:40:39.862338 walk_checkpoint.go:261 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] made no progress since 2026-11-16T08:40:39Z; the next walk starts over W1117 09:40:39.872379 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed --- PASS: TestWalkBuckets_StuckResumeStartsOver (0.03s) === RUN TestWalkBuckets_CanceledResumeKeepsCheckpoint W1117 09:40:39.881569 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed W1117 09:40:39.886132 walk_checkpoint.go:157 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15]: walk checkpoint read: context canceled; walking every bucket --- PASS: TestWalkBuckets_CanceledResumeKeepsCheckpoint (0.01s) === RUN TestWalkBuckets_ClearFailureFailsTheWalk W1117 09:40:39.898369 walker.go:183 lifecycle bootstrap: dispatch b/obj kind=noncurrent_days: delete failed I1117 09:40:39.906371 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 1 partly walked I1117 09:40:39.919223 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 1 partly walked --- PASS: TestWalkBuckets_ClearFailureFailsTheWalk (0.04s) === RUN TestWalkBuckets_ResumesFromPeriodicSave I1117 09:40:39.945067 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 0 bucket(s) done and 1 partly walked I1117 09:40:39.958917 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 0 bucket(s) done and 1 partly walked I1117 09:40:39.967589 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 1 bucket(s) done and 0 partly walked I1117 09:40:39.976288 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 1 bucket(s) done and 1 partly walked I1117 09:40:39.984167 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 1 bucket(s) done and 1 partly walked I1117 09:40:39.992097 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 1 bucket(s) done and 1 partly walked I1117 09:40:39.997382 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 1 bucket(s) done and 1 partly walked I1117 09:40:40.001565 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 0 partly walked I1117 09:40:40.007490 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 2 bucket(s) done and 1 partly walked I1117 09:40:40.011604 walk_checkpoint.go:186 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15] resume with 3 bucket(s) done and 0 partly walked --- PASS: TestWalkBuckets_ResumesFromPeriodicSave (0.09s) === RUN TestWalkProgress_FailedPeriodicSaveWaitsForTheInterval W1117 09:40:40.018077 walk_checkpoint.go:225 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15]: walk checkpoint save: filer down --- PASS: TestWalkProgress_FailedPeriodicSaveWaitsForTheInterval (0.00s) === RUN TestWalkProgress_SaveWithLostReplyIsClearedOnCompletion W1117 09:40:40.024032 walk_checkpoint.go:225 walker: shards [0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15]: walk checkpoint save: response lost --- PASS: TestWalkProgress_SaveWithLostReplyIsClearedOnCompletion (0.01s) === RUN TestRun_SharesBucketWalkAcrossShards I1117 09:40:40.084141 run.go:262 daily_run: status=ok shards=16 errors=0 duration=52ms cursor_lag_max=cold walked_max_age=0s --- PASS: TestRun_SharesBucketWalkAcrossShards (0.07s) === RUN TestRun_RecoveryAndSteadyGroupsWalkSeparately I1117 09:40:40.131954 run.go:262 daily_run: status=ok shards=3 errors=0 duration=24ms cursor_lag_max=498585h40m40s walked_max_age=0s --- PASS: TestRun_RecoveryAndSteadyGroupsWalkSeparately (0.03s) === RUN TestRun_SharedWalkErrorFailsCoveredShards I1117 09:40:40.137347 run.go:262 daily_run: status=error shards=2 errors=2 duration=2ms cursor_lag_max=cold walked_max_age=cold --- PASS: TestRun_SharedWalkErrorFailsCoveredShards (0.00s) === RUN TestRun_JoinsPlannedWalkWhenShardExitsEarly I1117 09:40:40.350555 run.go:262 daily_run: status=error shards=1 errors=1 duration=210ms cursor_lag_max=cold walked_max_age=cold --- PASS: TestRun_JoinsPlannedWalkWhenShardExitsEarly (0.21s) === RUN TestWalkerDispatcher_NonVersionedSendsExpectedRequest --- PASS: TestWalkerDispatcher_NonVersionedSendsExpectedRequest (0.00s) === RUN TestWalkerDispatcher_VersionedPassesVersionID --- PASS: TestWalkerDispatcher_VersionedPassesVersionID (0.00s) === RUN TestWalkerDispatcher_MPUInitUsesUploadsPath --- PASS: TestWalkerDispatcher_MPUInitUsesUploadsPath (0.00s) === RUN TestWalkerDispatcher_MPUInitEmptyDestKeyErrors --- PASS: TestWalkerDispatcher_MPUInitEmptyDestKeyErrors (0.00s) === RUN TestWalkerDispatcher_AcceptsAllResolvedOutcomes --- PASS: TestWalkerDispatcher_AcceptsAllResolvedOutcomes (0.00s) === RUN TestWalkerDispatcher_UnresolvedOutcomeReturnsError --- PASS: TestWalkerDispatcher_UnresolvedOutcomeReturnsError (0.01s) === RUN TestWalkerDispatcher_TransportErrorReturnsWrappedError --- PASS: TestWalkerDispatcher_TransportErrorReturnsWrappedError (0.52s) === RUN TestWalkerDispatcher_NilResponseReturnsError --- PASS: TestWalkerDispatcher_NilResponseReturnsError (0.00s) === RUN TestWalkerDispatcher_LimiterWaitsBeforeDispatch --- PASS: TestWalkerDispatcher_LimiterWaitsBeforeDispatch (0.05s) === RUN TestWalkerDispatcher_LimiterContextCancelHaltsWalker --- PASS: TestWalkerDispatcher_LimiterContextCancelHaltsWalker (0.00s) === RUN TestWalkerDispatcher_NilGuardsReturnError --- PASS: TestWalkerDispatcher_NilGuardsReturnError (0.00s) === RUN TestWalkerDue === RUN TestWalkerDue/interval_zero_always_due === RUN TestWalkerDue/never_walked_is_due === RUN TestWalkerDue/interval_elapsed === RUN TestWalkerDue/interval_exactly_elapsed === RUN TestWalkerDue/interval_not_yet_elapsed === RUN TestWalkerDue/future_lastWalked --- PASS: TestWalkerDue (0.02s) --- PASS: TestWalkerDue/interval_zero_always_due (0.00s) --- PASS: TestWalkerDue/never_walked_is_due (0.00s) --- PASS: TestWalkerDue/interval_elapsed (0.01s) --- PASS: TestWalkerDue/interval_exactly_elapsed (0.00s) --- PASS: TestWalkerDue/interval_not_yet_elapsed (0.00s) --- PASS: TestWalkerDue/future_lastWalked (0.00s) === RUN TestRunShard_WalkerThrottle === RUN TestRunShard_WalkerThrottle/interval=0_fires_every_pass === RUN TestRunShard_WalkerThrottle/throttled:_second_pass_within_interval === RUN TestRunShard_WalkerThrottle/throttled:_second_pass_past_interval --- PASS: TestRunShard_WalkerThrottle (0.02s) --- PASS: TestRunShard_WalkerThrottle/interval=0_fires_every_pass (0.01s) --- PASS: TestRunShard_WalkerThrottle/throttled:_second_pass_within_interval (0.00s) --- PASS: TestRunShard_WalkerThrottle/throttled:_second_pass_past_interval (0.00s) === RUN TestValidate_RejectsNegativeWalkerInterval --- PASS: TestValidate_RejectsNegativeWalkerInterval (0.00s) === RUN TestRunShard_ColdStartDoesNotDoubleWalk --- PASS: TestRunShard_ColdStartDoesNotDoubleWalk (0.00s) === RUN TestRunShard_RecoveryWalkerSetsLastWalkedAnchor --- PASS: TestRunShard_RecoveryWalkerSetsLastWalkedAnchor (0.00s) === RUN TestRunShard_WalkerInvokedOnRecoveryBranch --- PASS: TestRunShard_WalkerInvokedOnRecoveryBranch (0.00s) === RUN TestRunShard_RecoveryReplaysFromResumedWalkStart --- PASS: TestRunShard_RecoveryReplaysFromResumedWalkStart (0.00s) === RUN TestRunShard_ColdStartWithResumedWalkReplaysNextPass --- PASS: TestRunShard_ColdStartWithResumedWalkReplaysNextPass (0.00s) === RUN TestComputeGlobalStartTsNs_SavedCursorBelowTheFloor --- PASS: TestComputeGlobalStartTsNs_SavedCursorBelowTheFloor (0.00s) === RUN TestRunShard_NilWalkerOnRecoveryIsNoop --- PASS: TestRunShard_NilWalkerOnRecoveryIsNoop (0.00s) === RUN TestRunShard_WalkerErrorPropagates --- PASS: TestRunShard_WalkerErrorPropagates (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle/dailyrun 10.098s === RUN TestSurvivors_NoVersionsNoNullReturnsZero --- PASS: TestSurvivors_NoVersionsNoNullReturnsZero (0.01s) === RUN TestSurvivors_OneVersionPopulatesLoneEntry --- PASS: TestSurvivors_OneVersionPopulatesLoneEntry (0.00s) === RUN TestSurvivors_MoreThanOneClearsLoneEntry --- PASS: TestSurvivors_MoreThanOneClearsLoneEntry (0.00s) === RUN TestSurvivors_NullVersionDetectedFromBareRegularFile --- PASS: TestSurvivors_NullVersionDetectedFromBareRegularFile (0.00s) === RUN TestSurvivors_DirectoryKeyMarkerCountsAsNull --- PASS: TestSurvivors_DirectoryKeyMarkerCountsAsNull (0.00s) === RUN TestSurvivors_PlainDirectoryDoesNotCount --- PASS: TestSurvivors_PlainDirectoryDoesNotCount (0.00s) === RUN TestSurvivors_VersionsListingErrorPropagates --- PASS: TestSurvivors_VersionsListingErrorPropagates (0.01s) === RUN TestSurvivors_NullLookupErrorPropagates --- PASS: TestSurvivors_NullLookupErrorPropagates (0.06s) === RUN TestListVersions_NotFoundReturnsNil --- PASS: TestListVersions_NotFoundReturnsNil (0.00s) === RUN TestListVersions_FiltersOutDirectoriesAndMissingVersionId --- PASS: TestListVersions_FiltersOutDirectoriesAndMissingVersionId (0.01s) === RUN TestListVersions_PaginatesAcrossPages --- PASS: TestListVersions_PaginatesAcrossPages (0.10s) === RUN TestListVersions_ErrorPropagates --- PASS: TestListVersions_ErrorPropagates (0.00s) === RUN TestLookupNullVersion_RegularFileExplicitFalse --- PASS: TestLookupNullVersion_RegularFileExplicitFalse (0.00s) === RUN TestLookupNullVersion_ExplicitNullFlag --- PASS: TestLookupNullVersion_ExplicitNullFlag (0.00s) === RUN TestLookupNullVersion_DirectoryKeyMarkerQualifies --- PASS: TestLookupNullVersion_DirectoryKeyMarkerQualifies (0.00s) === RUN TestLookupNullVersion_PlainDirectoryRejected --- PASS: TestLookupNullVersion_PlainDirectoryRejected (0.00s) === RUN TestLookupNullVersion_NotFoundCollapses --- PASS: TestLookupNullVersion_NotFoundCollapses (0.00s) === RUN TestLookupNullVersion_TransportErrorPropagates --- PASS: TestLookupNullVersion_TransportErrorPropagates (0.00s) === RUN TestLookupVersion_EmptyVersionIdReturnsNil --- PASS: TestLookupVersion_EmptyVersionIdReturnsNil (0.00s) === RUN TestLookupVersion_AppliesVPrefix --- PASS: TestLookupVersion_AppliesVPrefix (0.00s) === RUN TestLookupVersion_NotFoundCollapses --- PASS: TestLookupVersion_NotFoundCollapses (0.00s) === RUN TestLookupVersion_TransportErrorPropagates --- PASS: TestLookupVersion_TransportErrorPropagates (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle/dispatcher 2.747s === RUN TestRulePredicateSensitive_NilRuleReturnsFalse --- PASS: TestRulePredicateSensitive_NilRuleReturnsFalse (0.00s) === RUN TestRulePredicateSensitive_NoFilterTagsReturnsFalse --- PASS: TestRulePredicateSensitive_NoFilterTagsReturnsFalse (0.00s) === RUN TestRulePredicateSensitive_EmptyFilterTagsReturnsFalse --- PASS: TestRulePredicateSensitive_EmptyFilterTagsReturnsFalse (0.00s) === RUN TestRulePredicateSensitive_PopulatedFilterTagsReturnsTrue --- PASS: TestRulePredicateSensitive_PopulatedFilterTagsReturnsTrue (0.00s) === RUN TestCompile_SingleRuleSingleAction --- PASS: TestCompile_SingleRuleSingleAction (0.01s) === RUN TestCompile_MultiAction_SiblingsHaveOwnEntries --- PASS: TestCompile_MultiAction_SiblingsHaveOwnEntries (0.00s) === RUN TestCompile_BootstrapPendingIndexedButInactive --- PASS: TestCompile_BootstrapPendingIndexedButInactive (0.00s) === RUN TestCompile_RetentionGate --- PASS: TestCompile_RetentionGate (0.00s) === RUN TestCompile_RetentionUnboundedNeverGates --- PASS: TestCompile_RetentionUnboundedNeverGates (0.00s) === RUN TestCompile_SiblingsDegradeIndependently --- PASS: TestCompile_SiblingsDegradeIndependently (0.00s) === RUN TestCompile_PriorModePreservedOverDecideMode --- PASS: TestCompile_PriorModePreservedOverDecideMode (0.01s) === RUN TestCompile_ExpirationDateScansAtDate --- PASS: TestCompile_ExpirationDateScansAtDate (0.00s) === RUN TestCompile_DisabledRuleNeverActivates --- PASS: TestCompile_DisabledRuleNeverActivates (0.00s) === RUN TestSnapshot_MarkActiveFlipsRoutingFilter --- PASS: TestSnapshot_MarkActiveFlipsRoutingFilter (0.00s) === RUN TestCompile_CrossBucketIdenticalRulesDoNotCollide --- PASS: TestCompile_CrossBucketIdenticalRulesDoNotCollide (0.00s) === RUN TestEngine_SnapshotAtomicSwap --- PASS: TestEngine_SnapshotAtomicSwap (0.00s) === RUN TestCompile_DelayGroupsDedupeAcrossBuckets --- PASS: TestCompile_DelayGroupsDedupeAcrossBuckets (0.26s) === RUN TestReplayContentHash_EmptyWhenNoReplayActions --- PASS: TestReplayContentHash_EmptyWhenNoReplayActions (0.01s) === RUN TestReplayContentHash_PartitionIndependent --- PASS: TestReplayContentHash_PartitionIndependent (0.01s) === RUN TestReplayContentHash_ChangesOnRuleContentEdit --- PASS: TestReplayContentHash_ChangesOnRuleContentEdit (0.00s) === RUN TestReplayContentHash_StableAcrossRuleReorder --- PASS: TestReplayContentHash_StableAcrossRuleReorder (0.01s) === RUN TestReplayContentHash_ExcludesWalkerOnlyAndDisabled --- PASS: TestReplayContentHash_ExcludesWalkerOnlyAndDisabled (0.00s) === RUN TestPromotedHash_EmptyWhenNoneAreInWalk --- PASS: TestPromotedHash_EmptyWhenNoneAreInWalk (0.00s) === RUN TestPromotedHash_ChangesOnReplayToWalkPromotion --- PASS: TestPromotedHash_ChangesOnReplayToWalkPromotion (0.00s) === RUN TestPromotedHash_ChangesOnWalkToReplayDemotion --- PASS: TestPromotedHash_ChangesOnWalkToReplayDemotion (0.00s) === RUN TestPromotedHash_StableWhenContentUnchangedAndPartitionStays --- PASS: TestPromotedHash_StableWhenContentUnchangedAndPartitionStays (0.00s) === RUN TestPromotedHash_MatchesRulesForShardWalkMembership --- PASS: TestPromotedHash_MatchesRulesForShardWalkMembership (0.00s) === RUN TestMaxEffectiveTTL_NilAndEmpty --- PASS: TestMaxEffectiveTTL_NilAndEmpty (0.01s) === RUN TestMaxEffectiveTTL_ReturnsMaxAcrossActiveReplay --- PASS: TestMaxEffectiveTTL_ReturnsMaxAcrossActiveReplay (0.00s) === RUN TestMaxEffectiveTTL_OperatesOnReplayView --- PASS: TestMaxEffectiveTTL_OperatesOnReplayView (0.00s) === RUN TestMaxEffectiveTTL_IgnoresInactiveActions --- PASS: TestMaxEffectiveTTL_IgnoresInactiveActions (0.00s) === RUN TestWalkContentHash_SeparatesWalksAndEdits --- PASS: TestWalkContentHash_SeparatesWalksAndEdits (0.01s) === RUN TestPrefixMatches_EmptyPrefixAllowsEverything --- PASS: TestPrefixMatches_EmptyPrefixAllowsEverything (0.00s) === RUN TestPrefixMatches_HonorsExactPrefix --- PASS: TestPrefixMatches_HonorsExactPrefix (0.00s) === RUN TestPrefixMatches_RejectsNonMatchingPath --- PASS: TestPrefixMatches_RejectsNonMatchingPath (0.00s) === RUN TestPrefixMatches_PathShorterThanPrefixIsReject --- PASS: TestPrefixMatches_PathShorterThanPrefixIsReject (0.00s) === RUN TestFilterAllows_NoFiltersAcceptsAnything --- PASS: TestFilterAllows_NoFiltersAcceptsAnything (0.00s) === RUN TestFilterAllows_SizeGreaterThanGate --- PASS: TestFilterAllows_SizeGreaterThanGate (0.00s) === RUN TestFilterAllows_SizeLessThanGate --- PASS: TestFilterAllows_SizeLessThanGate (0.00s) === RUN TestFilterAllows_ZeroSizeFilterIsDisabled --- PASS: TestFilterAllows_ZeroSizeFilterIsDisabled (0.00s) === RUN TestFilterAllows_RequiredTagPresent --- PASS: TestFilterAllows_RequiredTagPresent (0.00s) === RUN TestFilterAllows_RequiredTagMissingOrWrong --- PASS: TestFilterAllows_RequiredTagMissingOrWrong (0.00s) === RUN TestFilterAllows_AllRequiredTagsMustMatch --- PASS: TestFilterAllows_AllRequiredTagsMustMatch (0.00s) === RUN TestFilterAllows_SizeAndTagAreANDed --- PASS: TestFilterAllows_SizeAndTagAreANDed (0.00s) === RUN TestMatchOriginalWrite_NilEventReturnsNil --- PASS: TestMatchOriginalWrite_NilEventReturnsNil (0.00s) === RUN TestMatchOriginalWrite_WrongShapeReturnsNil --- PASS: TestMatchOriginalWrite_WrongShapeReturnsNil (0.00s) === RUN TestMatchOriginalWrite_DelayMismatchReturnsNil --- PASS: TestMatchOriginalWrite_DelayMismatchReturnsNil (0.00s) === RUN TestMatchPredicateChange_NilEventReturnsNil --- PASS: TestMatchPredicateChange_NilEventReturnsNil (0.00s) === RUN TestMatchPredicateChange_WrongShapeReturnsNil --- PASS: TestMatchPredicateChange_WrongShapeReturnsNil (0.00s) === RUN TestMatchPredicateChange_NoTagSensitiveActionsReturnsNil --- PASS: TestMatchPredicateChange_NoTagSensitiveActionsReturnsNil (0.00s) === RUN TestMatchPath_UnknownBucketReturnsNil --- PASS: TestMatchPath_UnknownBucketReturnsNil (0.00s) === RUN TestMatchPath_NilEventStillAppliesPrefix --- PASS: TestMatchPath_NilEventStillAppliesPrefix (0.00s) === RUN TestMatchPath_FilterRespectedWhenEventProvided --- PASS: TestMatchPath_FilterRespectedWhenEventProvided (0.00s) === RUN TestFilterMatching_BucketScoping --- PASS: TestFilterMatching_BucketScoping (0.00s) === RUN TestFilterMatching_AbortMPURequiresMPUInit --- PASS: TestFilterMatching_AbortMPURequiresMPUInit (0.00s) === RUN TestFilterMatching_ExpiredDeleteMarkerRequiresMarkerLatest --- PASS: TestFilterMatching_ExpiredDeleteMarkerRequiresMarkerLatest (0.00s) === RUN TestMatchOriginalWrite_DelayGroupRoutes --- PASS: TestMatchOriginalWrite_DelayGroupRoutes (0.00s) === RUN TestMatchOriginalWrite_PrefixFilter --- PASS: TestMatchOriginalWrite_PrefixFilter (0.00s) === RUN TestMatchOriginalWrite_MarkActiveBecomesRoutable --- PASS: TestMatchOriginalWrite_MarkActiveBecomesRoutable (0.00s) === RUN TestMatchOriginalWrite_AbortMPUOnlyOnMPUInit --- PASS: TestMatchOriginalWrite_AbortMPUOnlyOnMPUInit (0.00s) === RUN TestMatchPredicateChange_OnlyTagSensitiveActions --- PASS: TestMatchPredicateChange_OnlyTagSensitiveActions (0.00s) === RUN TestMatchPath_BootstrapWalkerSeesAllActiveActions --- PASS: TestMatchPath_BootstrapWalkerSeesAllActiveActions (0.00s) === RUN TestMatchPath_PrefixMismatchExcludes --- PASS: TestMatchPath_PrefixMismatchExcludes (0.00s) === RUN TestMatchPath_FilterRejectsByTag --- PASS: TestMatchPath_FilterRejectsByTag (0.00s) === RUN TestDecideMode_NilRuleIsDisabled --- PASS: TestDecideMode_NilRuleIsDisabled (0.00s) === RUN TestDecideMode_DisabledStatusIsDisabled --- PASS: TestDecideMode_DisabledStatusIsDisabled (0.00s) === RUN TestDecideMode_ExpirationDateIsScanAtDate --- PASS: TestDecideMode_ExpirationDateIsScanAtDate (0.00s) === RUN TestDecideMode_UnboundedRetentionIsEventDriven --- PASS: TestDecideMode_UnboundedRetentionIsEventDriven (0.00s) === RUN TestDecideMode_HorizonWithinRetentionIsEventDriven --- PASS: TestDecideMode_HorizonWithinRetentionIsEventDriven (0.00s) === RUN TestDecideMode_HorizonExceedsRetentionIsScanOnly --- PASS: TestDecideMode_HorizonExceedsRetentionIsScanOnly (0.00s) === RUN TestDecideMode_LookbackPushesAcrossThreshold --- PASS: TestDecideMode_LookbackPushesAcrossThreshold (0.00s) === RUN TestDecideMode_ZeroHorizonNeverGates --- PASS: TestDecideMode_ZeroHorizonNeverGates (0.00s) === RUN TestRuleMode_StringRendersDocumentedNames === RUN TestRuleMode_StringRendersDocumentedNames/unspecified === RUN TestRuleMode_StringRendersDocumentedNames/event_driven === RUN TestRuleMode_StringRendersDocumentedNames/scan_at_date === RUN TestRuleMode_StringRendersDocumentedNames/scan_only === RUN TestRuleMode_StringRendersDocumentedNames/disabled === RUN TestRuleMode_StringRendersDocumentedNames/pending_bootstrap --- PASS: TestRuleMode_StringRendersDocumentedNames (0.02s) --- PASS: TestRuleMode_StringRendersDocumentedNames/unspecified (0.00s) --- PASS: TestRuleMode_StringRendersDocumentedNames/event_driven (0.00s) --- PASS: TestRuleMode_StringRendersDocumentedNames/scan_at_date (0.00s) --- PASS: TestRuleMode_StringRendersDocumentedNames/scan_only (0.00s) --- PASS: TestRuleMode_StringRendersDocumentedNames/disabled (0.00s) --- PASS: TestRuleMode_StringRendersDocumentedNames/pending_bootstrap (0.00s) === RUN TestRuleMode_StringFallsToUnspecifiedForUnknown --- PASS: TestRuleMode_StringFallsToUnspecifiedForUnknown (0.00s) === RUN TestSnapshot_OriginalDelayGroupsExposesCompiledGroups --- PASS: TestSnapshot_OriginalDelayGroupsExposesCompiledGroups (0.00s) === RUN TestSnapshot_OriginalDelayGroupsScanOnlyExcluded --- PASS: TestSnapshot_OriginalDelayGroupsScanOnlyExcluded (0.00s) === RUN TestSnapshot_PredicateActionsContainsTagSensitive --- PASS: TestSnapshot_PredicateActionsContainsTagSensitive (0.00s) === RUN TestSnapshot_PredicateActionsEmptyForNonTagSensitiveRule --- PASS: TestSnapshot_PredicateActionsEmptyForNonTagSensitiveRule (0.00s) === RUN TestSnapshot_DateActionsContainsExpirationDate --- PASS: TestSnapshot_DateActionsContainsExpirationDate (0.00s) === RUN TestSnapshot_DateActionsEmptyForNonDateRule --- PASS: TestSnapshot_DateActionsEmptyForNonDateRule (0.00s) === RUN TestSnapshot_MarkActiveUnknownKeyIsNoOp --- PASS: TestSnapshot_MarkActiveUnknownKeyIsNoOp (0.00s) === RUN TestSnapshot_MarkActiveFlipsCompiledActionToActive --- PASS: TestSnapshot_MarkActiveFlipsCompiledActionToActive (0.00s) === RUN TestSnapshot_BucketIndexedActionKeysCoverAllKinds --- PASS: TestSnapshot_BucketIndexedActionKeysCoverAllKinds (0.00s) === RUN TestCurrentSnapshot_NilWhenNoEngineRegistered --- PASS: TestCurrentSnapshot_NilWhenNoEngineRegistered (0.00s) === RUN TestCurrentSnapshot_ReturnsRegisteredEngineSnapshot --- PASS: TestCurrentSnapshot_ReturnsRegisteredEngineSnapshot (0.00s) === RUN TestRulesForShard_NilSnapshot --- PASS: TestRulesForShard_NilSnapshot (0.00s) === RUN TestRulesForShard_ReplayPartitionMembership --- PASS: TestRulesForShard_ReplayPartitionMembership (0.00s) === RUN TestRulesForShard_WalkOnlyKindsRouteToWalk --- PASS: TestRulesForShard_WalkOnlyKindsRouteToWalk (0.00s) === RUN TestRulesForShard_MultiActionXMLRuleSplits --- PASS: TestRulesForShard_MultiActionXMLRuleSplits (0.00s) === RUN TestRulesForShard_ScanOnlyPromotionRoutesToWalk --- PASS: TestRulesForShard_ScanOnlyPromotionRoutesToWalk (0.00s) === RUN TestRulesForShard_ReplayRewritesScanOnlyMode --- PASS: TestRulesForShard_ReplayRewritesScanOnlyMode (0.00s) === RUN TestRulesForShard_DisabledRuleExcludedFromBothViews --- PASS: TestRulesForShard_DisabledRuleExcludedFromBothViews (0.00s) === RUN TestRulesForShard_ClonesAreIndependentOfBase --- PASS: TestRulesForShard_ClonesAreIndependentOfBase (0.00s) === RUN TestRulesForShard_ZeroRetentionRoutesAllReplayKindsToWalk --- PASS: TestRulesForShard_ZeroRetentionRoutesAllReplayKindsToWalk (0.00s) === RUN TestReplayView_PartitionAndScanOnlyRehabilitation --- PASS: TestReplayView_PartitionAndScanOnlyRehabilitation (0.01s) === RUN TestReplayView_AllPromotedReturnsNil --- PASS: TestReplayView_AllPromotedReturnsNil (0.00s) === RUN TestReplayView_NilSnapshot --- PASS: TestReplayView_NilSnapshot (0.00s) === RUN TestRecoveryView_ActivatesEveryNonDisabledAction --- PASS: TestRecoveryView_ActivatesEveryNonDisabledAction (0.00s) === RUN TestRecoveryView_PreservesBaseModeForScanAtDate --- PASS: TestRecoveryView_PreservesBaseModeForScanAtDate (0.00s) === RUN TestRecoveryView_ExcludesDisabledRules --- PASS: TestRecoveryView_ExcludesDisabledRules (0.00s) === RUN TestRecoveryView_ClonesAreIndependentOfBase --- PASS: TestRecoveryView_ClonesAreIndependentOfBase (0.00s) === RUN TestRecoveryView_NilSnapshot --- PASS: TestRecoveryView_NilSnapshot (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle/engine 2.889s === RUN TestEventOption_WithModTime_AppliesToOldEntryOnDelete --- PASS: TestEventOption_WithModTime_AppliesToOldEntryOnDelete (0.01s) === RUN TestEventOption_WithTtlSec_AppliesToOldEntryOnDelete --- PASS: TestEventOption_WithTtlSec_AppliesToOldEntryOnDelete (0.00s) === RUN TestEventOption_WithVersionID_AppliesToOldEntryOnDelete --- PASS: TestEventOption_WithVersionID_AppliesToOldEntryOnDelete (0.00s) === RUN TestEventOption_WithExtended_AppliesToOldEntryOnDelete --- PASS: TestEventOption_WithExtended_AppliesToOldEntryOnDelete (0.00s) === RUN TestEventOption_WithChunks_AppliesToOldEntryOnDelete --- PASS: TestEventOption_WithChunks_AppliesToOldEntryOnDelete (0.00s) === RUN TestEventOption_WithBootstrapVersion --- PASS: TestEventOption_WithBootstrapVersion (0.00s) === RUN TestEventOption_NoPanicOnEmptyEvent --- PASS: TestEventOption_NoPanicOnEmptyEvent (0.00s) === RUN TestNewCreate_PopulatesNewEntryOnly --- PASS: TestNewCreate_PopulatesNewEntryOnly (0.00s) === RUN TestNewDelete_PopulatesOldEntryOnly --- PASS: TestNewDelete_PopulatesOldEntryOnly (0.00s) === RUN TestNewUpdate_PopulatesBothEntries --- PASS: TestNewUpdate_PopulatesBothEntries (0.00s) === RUN TestNewCreate_NestedKeyUsesLeafName --- PASS: TestNewCreate_NestedKeyUsesLeafName (0.00s) === RUN TestNewCreate_DirectoryKeyUsesSlashlessLeaf --- PASS: TestNewCreate_DirectoryKeyUsesSlashlessLeaf (0.00s) === RUN TestNewCreate_ShardIDDerivedFromKey --- PASS: TestNewCreate_ShardIDDerivedFromKey (0.00s) === RUN TestEventOption_WithSize --- PASS: TestEventOption_WithSize (0.00s) === RUN TestEventOption_WithSizeAppliesToOldEntryOnDelete --- PASS: TestEventOption_WithSizeAppliesToOldEntryOnDelete (0.00s) === RUN TestEventOption_WithModTimeOverridesDefault --- PASS: TestEventOption_WithModTimeOverridesDefault (0.00s) === RUN TestEventOption_WithTtlSec --- PASS: TestEventOption_WithTtlSec (0.00s) === RUN TestEventOption_WithVersionID --- PASS: TestEventOption_WithVersionID (0.00s) === RUN TestEventOption_WithExtendedKeyValue --- PASS: TestEventOption_WithExtendedKeyValue (0.00s) === RUN TestEventOption_WithChunks --- PASS: TestEventOption_WithChunks (0.00s) === RUN TestEventOption_WithShardIDOverrides --- PASS: TestEventOption_WithShardIDOverrides (0.00s) === RUN TestEventOption_WithOldSizeTargetsOldEntryOnUpdate --- PASS: TestEventOption_WithOldSizeTargetsOldEntryOnUpdate (0.00s) === RUN TestEventOption_WithOldChunksTargetsOldEntryOnUpdate --- PASS: TestEventOption_WithOldChunksTargetsOldEntryOnUpdate (0.00s) === RUN TestEventOption_WithOldModTimeTargetsOldEntryOnUpdate --- PASS: TestEventOption_WithOldModTimeTargetsOldEntryOnUpdate (0.00s) === RUN TestEventOption_WithOldOptionsAreNoOpsOnCreate --- PASS: TestEventOption_WithOldOptionsAreNoOpsOnCreate (0.00s) === RUN TestEventOption_LaterOverridesEarlier --- PASS: TestEventOption_LaterOverridesEarlier (0.00s) === RUN TestMetaLogClock_DefaultStepIsOneSecond --- PASS: TestMetaLogClock_DefaultStepIsOneSecond (0.00s) === RUN TestMetaLogClock_CustomStep --- PASS: TestMetaLogClock_CustomStep (0.00s) === RUN TestMetaLogClock_PeekDoesNotAdvance --- PASS: TestMetaLogClock_PeekDoesNotAdvance (0.00s) === RUN TestMetaLogClock_ConcurrentNextNoRace --- PASS: TestMetaLogClock_ConcurrentNextNoRace (0.01s) === RUN TestFake_DefaultIsDoneOutOfTheBox --- PASS: TestFake_DefaultIsDoneOutOfTheBox (0.04s) === RUN TestFake_QueuedOutcomesPopFIFO --- PASS: TestFake_QueuedOutcomesPopFIFO (0.00s) === RUN TestFake_QueuesIsolatedByKey --- PASS: TestFake_QueuesIsolatedByKey (0.00s) === RUN TestFake_VersionIDPartOfKey --- PASS: TestFake_VersionIDPartOfKey (0.00s) === RUN TestFake_KeyComponentsWithDelimitersDoNotCollide --- PASS: TestFake_KeyComponentsWithDelimitersDoNotCollide (0.00s) === RUN TestFake_ErrShortCircuitsBeforeRecording --- PASS: TestFake_ErrShortCircuitsBeforeRecording (0.00s) === RUN TestFake_RecordsRequestsInOrder --- PASS: TestFake_RecordsRequestsInOrder (0.00s) === RUN TestFake_RecordedIsSnapshot --- PASS: TestFake_RecordedIsSnapshot (0.00s) === RUN TestFake_RecordedRequestsAreDeepCopies --- PASS: TestFake_RecordedRequestsAreDeepCopies (0.00s) === RUN TestFake_NilRequestUsesDefault --- PASS: TestFake_NilRequestUsesDefault (0.00s) === RUN TestFake_ConcurrentCallsSerializeWithoutDeadlock --- PASS: TestFake_ConcurrentCallsSerializeWithoutDeadlock (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle/lifecycletest 2.393s === RUN TestCursorMinTsNsWithFrozenKeysIncluded --- PASS: TestCursorMinTsNsWithFrozenKeysIncluded (0.01s) === RUN TestCursorSnapshotIsDeepCopy --- PASS: TestCursorSnapshotIsDeepCopy (0.00s) === RUN TestCursorRestoreReplacesNotMerges --- PASS: TestCursorRestoreReplacesNotMerges (0.01s) === RUN TestReaderRunValidatesInputsBeforeSubscribing === RUN TestReaderRunValidatesInputsBeforeSubscribing/shard_id_below_zero === RUN TestReaderRunValidatesInputsBeforeSubscribing/shard_id_at_or_above_ShardCount === RUN TestReaderRunValidatesInputsBeforeSubscribing/nil_events_channel === RUN TestReaderRunValidatesInputsBeforeSubscribing/empty_buckets_path --- PASS: TestReaderRunValidatesInputsBeforeSubscribing (0.03s) --- PASS: TestReaderRunValidatesInputsBeforeSubscribing/shard_id_below_zero (0.01s) --- PASS: TestReaderRunValidatesInputsBeforeSubscribing/shard_id_at_or_above_ShardCount (0.00s) --- PASS: TestReaderRunValidatesInputsBeforeSubscribing/nil_events_channel (0.00s) --- PASS: TestReaderRunValidatesInputsBeforeSubscribing/empty_buckets_path (0.00s) === RUN TestCursorMinTsNsEmpty --- PASS: TestCursorMinTsNsEmpty (0.00s) === RUN TestCursorAdvanceMonotonic --- PASS: TestCursorAdvanceMonotonic (0.00s) === RUN TestCursorAdvanceIgnoresZero --- PASS: TestCursorAdvanceIgnoresZero (0.00s) === RUN TestCursorMinTsNsAcrossKeys --- PASS: TestCursorMinTsNsAcrossKeys (0.00s) === RUN TestCursorFreeze --- PASS: TestCursorFreeze (0.00s) === RUN TestCursorFreezeOnUnsetKeySeedsPosition --- PASS: TestCursorFreezeOnUnsetKeySeedsPosition (0.00s) === RUN TestCursorSnapshotRestore --- PASS: TestCursorSnapshotRestore (0.00s) === RUN TestEventIsCreate_PopulatedNewEntryNoOldEntry --- PASS: TestEventIsCreate_PopulatedNewEntryNoOldEntry (0.00s) === RUN TestEventIsDelete_PopulatedOldEntryNoNewEntry --- PASS: TestEventIsDelete_PopulatedOldEntryNoNewEntry (0.00s) === RUN TestEventBothEntries_NeitherCreateNorDelete --- PASS: TestEventBothEntries_NeitherCreateNorDelete (0.00s) === RUN TestEventNoEntries_NeitherCreateNorDelete --- PASS: TestEventNoEntries_NeitherCreateNorDelete (0.00s) === RUN TestLogStartup_ShardIDOnly --- PASS: TestLogStartup_ShardIDOnly (0.00s) === RUN TestLogStartup_ShardPredicate --- PASS: TestLogStartup_ShardPredicate (0.00s) === RUN TestLogStartup_StartTsNsOverridesCursor --- PASS: TestLogStartup_StartTsNsOverridesCursor (0.00s) === RUN TestLogStartup_CursorMinFallback --- PASS: TestLogStartup_CursorMinFallback (0.00s) === RUN TestInMemoryPersister_LoadOnUnknownShardReturnsEmptyMap --- PASS: TestInMemoryPersister_LoadOnUnknownShardReturnsEmptyMap (0.01s) === RUN TestInMemoryPersister_SaveLoadRoundTrip --- PASS: TestInMemoryPersister_SaveLoadRoundTrip (0.01s) === RUN TestInMemoryPersister_SaveCopiesInput --- PASS: TestInMemoryPersister_SaveCopiesInput (0.00s) === RUN TestInMemoryPersister_LoadReturnsACopy --- PASS: TestInMemoryPersister_LoadReturnsACopy (0.00s) === RUN TestInMemoryPersister_SaveReplacesNotMerges --- PASS: TestInMemoryPersister_SaveReplacesNotMerges (0.00s) === RUN TestInMemoryPersister_DifferentShardsIsolated --- PASS: TestInMemoryPersister_DifferentShardsIsolated (0.01s) === RUN TestInMemoryPersister_SaveEmptyMapClearsState --- PASS: TestInMemoryPersister_SaveEmptyMapClearsState (0.00s) === RUN TestInMemoryPersister_ConcurrentSaveLoadDoesNotRace --- PASS: TestInMemoryPersister_ConcurrentSaveLoadDoesNotRace (0.01s) === RUN TestExtractBucketKeyCreate --- PASS: TestExtractBucketKeyCreate (0.00s) === RUN TestExtractBucketKeyTopLevelObject --- PASS: TestExtractBucketKeyTopLevelObject (0.00s) === RUN TestExtractBucketKeyDeleteUsesOldEntry --- PASS: TestExtractBucketKeyDeleteUsesOldEntry (0.00s) === RUN TestExtractBucketKeyDeleteWithEmptyParent --- PASS: TestExtractBucketKeyDeleteWithEmptyParent (0.00s) === RUN TestExtractBucketKeyOutsideBucketsSkipped --- PASS: TestExtractBucketKeyOutsideBucketsSkipped (0.00s) === RUN TestExtractBucketKeyBucketCreateAtRoot --- PASS: TestExtractBucketKeyBucketCreateAtRoot (0.00s) === RUN TestExtractBucketKeyBucketCreateBareRoot --- PASS: TestExtractBucketKeyBucketCreateBareRoot (0.00s) === RUN TestDispatchOneFiltersByShard --- PASS: TestDispatchOneFiltersByShard (0.01s) === RUN TestDispatchOneRespectsCtxCancel --- PASS: TestDispatchOneRespectsCtxCancel (0.00s) === RUN TestRun_ReceiveTimeoutOnStalledStream --- PASS: TestRun_ReceiveTimeoutOnStalledStream (0.06s) === RUN TestRun_HeartbeatsHoldTheStreamOpen --- PASS: TestRun_HeartbeatsHoldTheStreamOpen (0.21s) === RUN TestRun_RejectsNegativeReceiveTimeout --- PASS: TestRun_RejectsNegativeReceiveTimeout (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle/reader 2.641s === RUN TestSuccessorModTimeFromContainer_MissingExtReturnsZero --- PASS: TestSuccessorModTimeFromContainer_MissingExtReturnsZero (0.00s) === RUN TestSuccessorModTimeFromContainer_EmptyValueReturnsZero --- PASS: TestSuccessorModTimeFromContainer_EmptyValueReturnsZero (0.00s) === RUN TestSuccessorModTimeFromContainer_NonNumericReturnsZero --- PASS: TestSuccessorModTimeFromContainer_NonNumericReturnsZero (0.00s) === RUN TestSuccessorModTimeFromContainer_NonPositiveReturnsZero === RUN TestSuccessorModTimeFromContainer_NonPositiveReturnsZero/0 === RUN TestSuccessorModTimeFromContainer_NonPositiveReturnsZero/-1 === RUN TestSuccessorModTimeFromContainer_NonPositiveReturnsZero/-1000 --- PASS: TestSuccessorModTimeFromContainer_NonPositiveReturnsZero (0.01s) --- PASS: TestSuccessorModTimeFromContainer_NonPositiveReturnsZero/0 (0.00s) --- PASS: TestSuccessorModTimeFromContainer_NonPositiveReturnsZero/-1 (0.00s) --- PASS: TestSuccessorModTimeFromContainer_NonPositiveReturnsZero/-1000 (0.00s) === RUN TestSuccessorModTimeFromContainer_PositiveSecondsRoundTrip --- PASS: TestSuccessorModTimeFromContainer_PositiveSecondsRoundTrip (0.00s) === RUN TestLogicalKeyFromVersionPath_ExtractsLogicalKey --- PASS: TestLogicalKeyFromVersionPath_ExtractsLogicalKey (0.00s) === RUN TestLogicalKeyFromVersionPath_RejectsPathWithoutVersionsParent --- PASS: TestLogicalKeyFromVersionPath_RejectsPathWithoutVersionsParent (0.00s) === RUN TestLogicalKeyFromVersionPath_RejectsRootLevelPath --- PASS: TestLogicalKeyFromVersionPath_RejectsRootLevelPath (0.00s) === RUN TestLogicalKeyFromVersionPath_RejectsNoSlashes --- PASS: TestLogicalKeyFromVersionPath_RejectsNoSlashes (0.00s) === RUN TestLogicalKeyFromVersionPath_RejectsBareVersionsContainer --- PASS: TestLogicalKeyFromVersionPath_RejectsBareVersionsContainer (0.00s) === RUN TestIsVersionsContainerKey === RUN TestIsVersionsContainerKey/obj.versions === RUN TestIsVersionsContainerKey/a/b/obj.versions === RUN TestIsVersionsContainerKey/.versions === RUN TestIsVersionsContainerKey/obj.versions/v_x === RUN TestIsVersionsContainerKey/obj === RUN TestIsVersionsContainerKey/#00 --- PASS: TestIsVersionsContainerKey (0.01s) --- PASS: TestIsVersionsContainerKey/obj.versions (0.00s) --- PASS: TestIsVersionsContainerKey/a/b/obj.versions (0.00s) --- PASS: TestIsVersionsContainerKey/.versions (0.00s) --- PASS: TestIsVersionsContainerKey/obj.versions/v_x (0.00s) --- PASS: TestIsVersionsContainerKey/obj (0.00s) --- PASS: TestIsVersionsContainerKey/#00 (0.00s) === RUN TestIsVersionFolderPath === RUN TestIsVersionFolderPath/obj.versions/v_aaa === RUN TestIsVersionFolderPath/a/b/obj.versions/v_aaa === RUN TestIsVersionFolderPath/obj/v_aaa === RUN TestIsVersionFolderPath/obj.versions === RUN TestIsVersionFolderPath/obj.versions/ === RUN TestIsVersionFolderPath/v_aaa === RUN TestIsVersionFolderPath/#00 --- PASS: TestIsVersionFolderPath (0.00s) --- PASS: TestIsVersionFolderPath/obj.versions/v_aaa (0.00s) --- PASS: TestIsVersionFolderPath/a/b/obj.versions/v_aaa (0.00s) --- PASS: TestIsVersionFolderPath/obj/v_aaa (0.00s) --- PASS: TestIsVersionFolderPath/obj.versions (0.00s) --- PASS: TestIsVersionFolderPath/obj.versions/ (0.00s) --- PASS: TestIsVersionFolderPath/v_aaa (0.00s) --- PASS: TestIsVersionFolderPath/#00 (0.00s) === RUN TestIsDeleteMarkerEntry_NilOrEmptyExtendedReturnsFalse --- PASS: TestIsDeleteMarkerEntry_NilOrEmptyExtendedReturnsFalse (0.00s) === RUN TestIsDeleteMarkerEntry_TrueOnlyForLiteralTrue --- PASS: TestIsDeleteMarkerEntry_TrueOnlyForLiteralTrue (0.00s) === RUN TestExtractTags_NilOrEmptyReturnsNil --- PASS: TestExtractTags_NilOrEmptyReturnsNil (0.00s) === RUN TestExtractTags_OnlyKeysWithObjectTaggingPrefix --- PASS: TestExtractTags_OnlyKeysWithObjectTaggingPrefix (0.00s) === RUN TestExtractTags_ReturnsNilWhenNoTaggingPrefixedKeys --- PASS: TestExtractTags_ReturnsNilWhenNoTaggingPrefixedKeys (0.00s) === RUN TestHasActiveEventDrivenAction --- PASS: TestHasActiveEventDrivenAction (0.02s) === RUN TestHasActiveEventDrivenAction_NilActionSkipped --- PASS: TestHasActiveEventDrivenAction_NilActionSkipped (0.00s) === RUN TestSnapshot_BucketVersionedReportsCompiledFlag --- PASS: TestSnapshot_BucketVersionedReportsCompiledFlag (0.00s) === RUN TestSnapshot_BucketActionKeysReturnsCompiledList --- PASS: TestSnapshot_BucketActionKeysReturnsCompiledList (0.01s) === RUN TestSnapshot_BucketActionKeysUnknownBucketReturnsNil --- PASS: TestSnapshot_BucketActionKeysUnknownBucketReturnsNil (0.00s) === RUN TestSnapshot_ActionUnknownKeyReturnsNil --- PASS: TestSnapshot_ActionUnknownKeyReturnsNil (0.00s) === RUN TestSnapshot_AllActionsCoversEveryCompiledKind --- PASS: TestSnapshot_AllActionsCoversEveryCompiledKind (0.00s) === RUN TestSnapshot_SnapshotIDIsMonotonicAcrossRecompiles --- PASS: TestSnapshot_SnapshotIDIsMonotonicAcrossRecompiles (0.00s) === RUN TestRouteNoSnapshotNoMatches --- PASS: TestRouteNoSnapshotNoMatches (0.00s) === RUN TestRouteMissingBucketNoMatches --- PASS: TestRouteMissingBucketNoMatches (0.00s) === RUN TestRouteInactiveSkipped --- PASS: TestRouteInactiveSkipped (0.00s) === RUN TestRouteExpirationDaysFires --- PASS: TestRouteExpirationDaysFires (0.00s) === RUN TestRouteFreshObjectSchedulesInFuture --- PASS: TestRouteFreshObjectSchedulesInFuture (0.00s) === RUN TestRouteRespectsPrefixFilter --- PASS: TestRouteRespectsPrefixFilter (0.00s) === RUN TestRouteSkipsHardDelete --- PASS: TestRouteSkipsHardDelete (0.00s) === RUN TestRouteSkipsMissingAttributes --- PASS: TestRouteSkipsMissingAttributes (0.00s) === RUN TestRouteIdentityCapturedForNewEntry --- PASS: TestRouteIdentityCapturedForNewEntry (0.00s) === RUN TestRouteIdentityHashesExtended --- PASS: TestRouteIdentityHashesExtended (0.00s) === RUN TestRouteMPUInitFiresAbortAfterDelay --- PASS: TestRouteMPUInitFiresAbortAfterDelay (0.01s) === RUN TestRouteMPUInitFilteredOutByPrefix --- PASS: TestRouteMPUInitFilteredOutByPrefix (0.00s) === RUN TestRouteMPUInitMissingDestKeySkipped --- PASS: TestRouteMPUInitMissingDestKeySkipped (0.00s) === RUN TestRouteMPUPartEventSkipped --- PASS: TestRouteMPUPartEventSkipped (0.02s) === RUN TestRouteMPUInitDoesNotFireNoncurrent --- PASS: TestRouteMPUInitDoesNotFireNoncurrent (0.00s) === RUN TestRouteRegularObjectUnderDualRuleSkipsAbortMPU --- PASS: TestRouteRegularObjectUnderDualRuleSkipsAbortMPU (0.00s) === RUN TestRouteVersionedNoncurrentEventDoesNotFireFromRouter --- PASS: TestRouteVersionedNoncurrentEventDoesNotFireFromRouter (0.00s) === RUN TestRouteVersionedCurrentEventStaysLatest --- PASS: TestRouteVersionedCurrentEventStaysLatest (0.01s) === RUN TestRouteVersionedVersionFileWriteSchedulesExpiration --- PASS: TestRouteVersionedVersionFileWriteSchedulesExpiration (0.00s) === RUN TestRouteVersionedMarkerCreateDoesNotFireExpiration --- PASS: TestRouteVersionedMarkerCreateDoesNotFireExpiration (0.00s) === RUN TestRouteNonVersionedBucketIgnoresVersionsSuffix --- PASS: TestRouteNonVersionedBucketIgnoresVersionsSuffix (0.00s) === RUN TestRouteVersionedExpiredDeleteMarkerNilListerSuppresses --- PASS: TestRouteVersionedExpiredDeleteMarkerNilListerSuppresses (0.00s) === RUN TestRouteVersionedExpiredDeleteMarkerSoleSurvivorFires --- PASS: TestRouteVersionedExpiredDeleteMarkerSoleSurvivorFires (0.01s) === RUN TestRouteVersionedExpiredDeleteMarkerSiblingsRemainSuppressed --- PASS: TestRouteVersionedExpiredDeleteMarkerSiblingsRemainSuppressed (0.00s) === RUN TestRouteVersionedExpiredDeleteMarkerNullVersionSuppresses --- PASS: TestRouteVersionedExpiredDeleteMarkerNullVersionSuppresses (0.00s) === RUN TestRouteVersionedExpiredDeleteMarkerHardDeleteLeavesLoneMarkerFires --- PASS: TestRouteVersionedExpiredDeleteMarkerHardDeleteLeavesLoneMarkerFires (0.01s) === RUN TestRouteVersionedExpiredDeleteMarkerHardDeleteLoneNonMarkerNoFire --- PASS: TestRouteVersionedExpiredDeleteMarkerHardDeleteLoneNonMarkerNoFire (0.00s) === RUN TestRouteVersionedExpiredDeleteMarkerListerErrorSuppressed --- PASS: TestRouteVersionedExpiredDeleteMarkerListerErrorSuppressed (0.00s) === RUN TestRouteVersionedExpiredDeleteMarkerInactiveActionSkipsListing --- PASS: TestRouteVersionedExpiredDeleteMarkerInactiveActionSkipsListing (0.00s) === RUN TestRouteVersionedRegularVersionCreateSkipsListing --- PASS: TestRouteVersionedRegularVersionCreateSkipsListing (0.00s) === RUN TestRouteVersionedDeleteMarkerNoExpDMRuleSkipsListing --- PASS: TestRouteVersionedDeleteMarkerNoExpDMRuleSkipsListing (0.00s) === RUN TestRouteVersionedAllVersionFolderPathsSkipped === RUN TestRouteVersionedAllVersionFolderPathsSkipped/delete_marker === RUN TestRouteVersionedAllVersionFolderPathsSkipped/literal-key_collision === RUN TestRouteVersionedAllVersionFolderPathsSkipped/bucket-root_.versions === RUN TestRouteVersionedAllVersionFolderPathsSkipped/versions_dir_itself --- PASS: TestRouteVersionedAllVersionFolderPathsSkipped (0.01s) --- PASS: TestRouteVersionedAllVersionFolderPathsSkipped/delete_marker (0.00s) --- PASS: TestRouteVersionedAllVersionFolderPathsSkipped/literal-key_collision (0.00s) --- PASS: TestRouteVersionedAllVersionFolderPathsSkipped/bucket-root_.versions (0.00s) --- PASS: TestRouteVersionedAllVersionFolderPathsSkipped/versions_dir_itself (0.00s) === RUN TestRouteBootstrapVersionLatestExpirationDaysFires --- PASS: TestRouteBootstrapVersionLatestExpirationDaysFires (0.00s) === RUN TestRouteBootstrapVersionNoncurrentDaysFires --- PASS: TestRouteBootstrapVersionNoncurrentDaysFires (0.00s) === RUN TestRouteBootstrapVersionNoncurrentRespectsNewerNoncurrentVersions --- PASS: TestRouteBootstrapVersionNoncurrentRespectsNewerNoncurrentVersions (0.00s) === RUN TestRouteBootstrapVersionAbortMPUNeverEmittedForVersion --- PASS: TestRouteBootstrapVersionAbortMPUNeverEmittedForVersion (0.00s) === RUN TestRoutePointerTransitionFiresNoncurrentDays --- PASS: TestRoutePointerTransitionFiresNoncurrentDays (0.01s) === RUN TestRoutePointerTransitionPointerUnchangedSkipped --- PASS: TestRoutePointerTransitionPointerUnchangedSkipped (0.00s) === RUN TestRoutePointerTransitionEmptyOldPointerNoNullSkipped --- PASS: TestRoutePointerTransitionEmptyOldPointerNoNullSkipped (0.00s) === RUN TestRoutePointerTransitionEmptyOldPointerWithNullSchedules --- PASS: TestRoutePointerTransitionEmptyOldPointerWithNullSchedules (0.00s) === RUN TestRoutePointerTransitionExpansionIncludesNullVersion --- PASS: TestRoutePointerTransitionExpansionIncludesNullVersion (0.01s) === RUN TestRoutePointerTransitionDisplacedVersionMissingSuppressed --- PASS: TestRoutePointerTransitionDisplacedVersionMissingSuppressed (0.00s) === RUN TestRoutePointerTransitionNoNoncurrentRuleSkipsLookup --- PASS: TestRoutePointerTransitionNoNoncurrentRuleSkipsLookup (0.00s) === RUN TestRoutePointerTransitionNewerNoncurrentNewestNoncurrentRetained --- PASS: TestRoutePointerTransitionNewerNoncurrentNewestNoncurrentRetained (0.00s) === RUN TestRoutePointerTransitionExpansionMissingNewIDSuppressed --- PASS: TestRoutePointerTransitionExpansionMissingNewIDSuppressed (0.00s) === RUN TestRoutePointerTransitionUnversionedBucketSkipped --- PASS: TestRoutePointerTransitionUnversionedBucketSkipped (0.00s) === RUN TestRoutePointerTransitionMissingCachedMtimeSuppressed --- PASS: TestRoutePointerTransitionMissingCachedMtimeSuppressed (0.00s) === RUN TestRoutePointerTransitionUsesCachedMtimeNotStaleDirMtime --- PASS: TestRoutePointerTransitionUsesCachedMtimeNotStaleDirMtime (0.00s) === RUN TestRoutePointerTransitionNewerNoncurrentExpansionFiresOnCrossingThreshold --- PASS: TestRoutePointerTransitionNewerNoncurrentExpansionFiresOnCrossingThreshold (0.00s) === RUN TestRoutePointerTransitionExpansionEmitsOnlyThresholdCrossing --- PASS: TestRoutePointerTransitionExpansionEmitsOnlyThresholdCrossing (0.00s) === RUN TestRoutePointerTransitionSuspendedClearsPointerUsesNullMtime --- PASS: TestRoutePointerTransitionSuspendedClearsPointerUsesNullMtime (0.00s) === RUN TestRoutePointerTransitionSuspendedClearsPointerExpansionLatestPosIsNull --- PASS: TestRoutePointerTransitionSuspendedClearsPointerExpansionLatestPosIsNull (0.00s) === RUN TestScheduleEmpty --- PASS: TestScheduleEmpty (0.00s) === RUN TestScheduleOrderedByDueTime --- PASS: TestScheduleOrderedByDueTime (0.00s) === RUN TestScheduleDrainBoundaryInclusive --- PASS: TestScheduleDrainBoundaryInclusive (0.00s) === RUN TestScheduleAllowsDuplicates --- PASS: TestScheduleAllowsDuplicates (0.00s) === RUN TestScheduleDrainBeforeAnyDueReturnsNothing --- PASS: TestScheduleDrainBeforeAnyDueReturnsNothing (0.00s) === RUN TestScheduleNextDueAfterPartialDrain --- PASS: TestScheduleNextDueAfterPartialDrain (0.00s) === RUN TestScheduleAddAfterDrainKeepsOrder --- PASS: TestScheduleAddAfterDrainKeepsOrder (0.00s) === RUN TestScheduleDrainOrderIsAscendingDueTime --- PASS: TestScheduleDrainOrderIsAscendingDueTime (0.00s) === RUN TestScheduleConcurrentAddDrainNoRace --- PASS: TestScheduleConcurrentAddDrainNoRace (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle/router 2.690s === RUN TestIsBucketVersioned_MissingExtendedReturnsFalse --- PASS: TestIsBucketVersioned_MissingExtendedReturnsFalse (0.00s) === RUN TestIsBucketVersioned_AcceptsEnabledAndSuspended === RUN TestIsBucketVersioned_AcceptsEnabledAndSuspended/Enabled === RUN TestIsBucketVersioned_AcceptsEnabledAndSuspended/ENABLED === RUN TestIsBucketVersioned_AcceptsEnabledAndSuspended/enabled === RUN TestIsBucketVersioned_AcceptsEnabledAndSuspended/__enabled__ === RUN TestIsBucketVersioned_AcceptsEnabledAndSuspended/Suspended === RUN TestIsBucketVersioned_AcceptsEnabledAndSuspended/suspended --- PASS: TestIsBucketVersioned_AcceptsEnabledAndSuspended (0.01s) --- PASS: TestIsBucketVersioned_AcceptsEnabledAndSuspended/Enabled (0.00s) --- PASS: TestIsBucketVersioned_AcceptsEnabledAndSuspended/ENABLED (0.00s) --- PASS: TestIsBucketVersioned_AcceptsEnabledAndSuspended/enabled (0.00s) --- PASS: TestIsBucketVersioned_AcceptsEnabledAndSuspended/__enabled__ (0.00s) --- PASS: TestIsBucketVersioned_AcceptsEnabledAndSuspended/Suspended (0.00s) --- PASS: TestIsBucketVersioned_AcceptsEnabledAndSuspended/suspended (0.00s) === RUN TestIsBucketVersioned_RejectsOtherValues === RUN TestIsBucketVersioned_RejectsOtherValues/#00 === RUN TestIsBucketVersioned_RejectsOtherValues/Disabled === RUN TestIsBucketVersioned_RejectsOtherValues/Off === RUN TestIsBucketVersioned_RejectsOtherValues/true === RUN TestIsBucketVersioned_RejectsOtherValues/1 === RUN TestIsBucketVersioned_RejectsOtherValues/garbage --- PASS: TestIsBucketVersioned_RejectsOtherValues (0.01s) --- PASS: TestIsBucketVersioned_RejectsOtherValues/#00 (0.00s) --- PASS: TestIsBucketVersioned_RejectsOtherValues/Disabled (0.00s) --- PASS: TestIsBucketVersioned_RejectsOtherValues/Off (0.00s) --- PASS: TestIsBucketVersioned_RejectsOtherValues/true (0.00s) --- PASS: TestIsBucketVersioned_RejectsOtherValues/1 (0.00s) --- PASS: TestIsBucketVersioned_RejectsOtherValues/garbage (0.00s) === RUN TestIsBucketVersioned_ObjectLockImpliesVersioned --- PASS: TestIsBucketVersioned_ObjectLockImpliesVersioned (0.00s) === RUN TestAllActivePriorStates_EmptyInputs --- PASS: TestAllActivePriorStates_EmptyInputs (0.00s) === RUN TestAllActivePriorStates_SeedsAllActionsAsActive --- PASS: TestAllActivePriorStates_SeedsAllActionsAsActive (0.01s) === RUN TestAllActivePriorStates_KeysSeparatedByBucket --- PASS: TestAllActivePriorStates_KeysSeparatedByBucket (0.00s) === RUN TestLoadCompileInputs_EmptyBucketDir --- PASS: TestLoadCompileInputs_EmptyBucketDir (0.00s) === RUN TestLoadCompileInputs_FilesAtBucketLevelSkipped --- PASS: TestLoadCompileInputs_FilesAtBucketLevelSkipped (0.00s) === RUN TestLoadCompileInputs_BucketWithoutLifecycleConfigSkipped --- PASS: TestLoadCompileInputs_BucketWithoutLifecycleConfigSkipped (0.00s) === RUN TestLoadCompileInputs_BucketWithEmptyLifecycleXMLSkipped --- PASS: TestLoadCompileInputs_BucketWithEmptyLifecycleXMLSkipped (0.00s) === RUN TestLoadCompileInputs_ValidConfigBecomesInput --- PASS: TestLoadCompileInputs_ValidConfigBecomesInput (0.03s) === RUN TestLoadCompileInputs_VersioningAttrPropagates --- PASS: TestLoadCompileInputs_VersioningAttrPropagates (0.01s) === RUN TestLoadCompileInputs_MalformedXMLBecomesParseError --- PASS: TestLoadCompileInputs_MalformedXMLBecomesParseError (0.00s) === RUN TestLoadCompileInputs_PaginatesAcrossPages --- PASS: TestLoadCompileInputs_PaginatesAcrossPages (1.40s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3lifecycle/scheduler 3.729s === RUN TestCreateTableBucketLostRaceKeepsTheFirstCreate --- PASS: TestCreateTableBucketLostRaceKeepsTheFirstCreate (0.72s) === RUN TestCreateNamespaceLostRaceKeepsTheFirstCreate I1117 09:40:36.498848 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceLostRaceKeepsTheFirstCreate (0.19s) === RUN TestEnsureDirectoryKeepsADirectoryCreatedSinceTheLookup --- PASS: TestEnsureDirectoryKeepsADirectoryCreatedSinceTheLookup (0.07s) === RUN TestDeleteDirectoryReportsRejectedDelete --- PASS: TestDeleteDirectoryReportsRejectedDelete (0.00s) === RUN TestDeleteDirectoryToleratesMissingEntry === RUN TestDeleteDirectoryToleratesMissingEntry/reported_in_the_response === RUN TestDeleteDirectoryToleratesMissingEntry/reported_as_a_transport_error --- PASS: TestDeleteDirectoryToleratesMissingEntry (0.01s) --- PASS: TestDeleteDirectoryToleratesMissingEntry/reported_in_the_response (0.00s) --- PASS: TestDeleteDirectoryToleratesMissingEntry/reported_as_a_transport_error (0.00s) === RUN TestDeleteDirectoryPropagatesTransportError --- PASS: TestDeleteDirectoryPropagatesTransportError (0.00s) === RUN TestDeleteDirectoryDeletesTheSubtree --- PASS: TestDeleteDirectoryDeletesTheSubtree (0.00s) === RUN TestDeleteDirectoryIfMatchesReportsAVanishedEntry --- PASS: TestDeleteDirectoryIfMatchesReportsAVanishedEntry (0.00s) === RUN TestDeleteDirectoryIfMatchesReportsResponseError --- PASS: TestDeleteDirectoryIfMatchesReportsResponseError (0.00s) === RUN TestDeleteTableBucketReportsRejectedDirectoryDelete --- PASS: TestDeleteTableBucketReportsRejectedDirectoryDelete (0.17s) === RUN TestCreateInNamespaceTreatsARecreatedNamespaceAsGone === RUN TestCreateInNamespaceTreatsARecreatedNamespaceAsGone/CreateTable I1117 09:40:36.919983 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateInNamespaceTreatsARecreatedNamespaceAsGone/RegisterTable I1117 09:40:37.268766 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateInNamespaceTreatsARecreatedNamespaceAsGone/CreateView I1117 09:40:37.532749 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateInNamespaceTreatsARecreatedNamespaceAsGone (0.89s) --- PASS: TestCreateInNamespaceTreatsARecreatedNamespaceAsGone/CreateTable (0.34s) --- PASS: TestCreateInNamespaceTreatsARecreatedNamespaceAsGone/RegisterTable (0.26s) --- PASS: TestCreateInNamespaceTreatsARecreatedNamespaceAsGone/CreateView (0.28s) === RUN TestRenameTableTreatsARecreatedDestinationAsGone I1117 09:40:37.795349 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestRenameTableTreatsARecreatedDestinationAsGone (0.20s) === RUN TestUpdateViewSparesARecreatedView I1117 09:40:37.986912 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestUpdateViewSparesARecreatedView (0.28s) === RUN TestUpdateViewRejectsLostUpdate I1117 09:40:38.289548 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestUpdateViewRejectsLostUpdate (0.51s) === RUN TestUpdateViewRejectsWhenTheAuthorizingPolicyChanges I1117 09:40:38.779696 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestUpdateViewRejectsWhenTheAuthorizingPolicyChanges (0.25s) === RUN TestTableWritesSpareARecreatedTable === RUN TestTableWritesSpareARecreatedTable/PutTablePolicy === RUN TestTableWritesSpareARecreatedTable/DeleteTablePolicy === RUN TestTableWritesSpareARecreatedTable/TagResource === RUN TestTableWritesSpareARecreatedTable/UntagResource === RUN TestTableWritesSpareARecreatedTable/PutTableMaintenanceConfiguration --- PASS: TestTableWritesSpareARecreatedTable (0.54s) --- PASS: TestTableWritesSpareARecreatedTable/PutTablePolicy (0.14s) --- PASS: TestTableWritesSpareARecreatedTable/DeleteTablePolicy (0.12s) --- PASS: TestTableWritesSpareARecreatedTable/TagResource (0.08s) --- PASS: TestTableWritesSpareARecreatedTable/UntagResource (0.10s) --- PASS: TestTableWritesSpareARecreatedTable/PutTableMaintenanceConfiguration (0.09s) === RUN TestTableWritesTolerateACommitInBetween === RUN TestTableWritesTolerateACommitInBetween/PutTablePolicy === RUN TestTableWritesTolerateACommitInBetween/DeleteTablePolicy === RUN TestTableWritesTolerateACommitInBetween/TagResource === RUN TestTableWritesTolerateACommitInBetween/UntagResource === RUN TestTableWritesTolerateACommitInBetween/PutTableMaintenanceConfiguration --- PASS: TestTableWritesTolerateACommitInBetween (0.68s) --- PASS: TestTableWritesTolerateACommitInBetween/PutTablePolicy (0.14s) --- PASS: TestTableWritesTolerateACommitInBetween/DeleteTablePolicy (0.13s) --- PASS: TestTableWritesTolerateACommitInBetween/TagResource (0.14s) --- PASS: TestTableWritesTolerateACommitInBetween/UntagResource (0.14s) --- PASS: TestTableWritesTolerateACommitInBetween/PutTableMaintenanceConfiguration (0.12s) === RUN TestCreateAuthorizedBeforeANamespaceUpdateSucceeds === RUN TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/CreateTable I1117 09:40:40.262459 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/RegisterTable I1117 09:40:40.614387 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/CreateView I1117 09:40:40.898059 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/RenameTable I1117 09:40:41.120782 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/RenameView I1117 09:40:41.462161 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateAuthorizedBeforeANamespaceUpdateSucceeds (1.53s) --- PASS: TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/CreateTable (0.35s) --- PASS: TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/RegisterTable (0.28s) --- PASS: TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/CreateView (0.24s) --- PASS: TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/RenameTable (0.33s) --- PASS: TestCreateAuthorizedBeforeANamespaceUpdateSucceeds/RenameView (0.32s) === RUN TestCreateRefusedBeforeWritingIntoAReplacedNamespace === RUN TestCreateRefusedBeforeWritingIntoAReplacedNamespace/CreateTable I1117 09:40:41.781639 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateRefusedBeforeWritingIntoAReplacedNamespace/RegisterTable I1117 09:40:41.894160 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateRefusedBeforeWritingIntoAReplacedNamespace/CreateView I1117 09:40:42.048350 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateRefusedBeforeWritingIntoAReplacedNamespace/RenameTable I1117 09:40:42.191422 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestCreateRefusedBeforeWritingIntoAReplacedNamespace/RenameView I1117 09:40:42.382674 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateRefusedBeforeWritingIntoAReplacedNamespace (0.74s) --- PASS: TestCreateRefusedBeforeWritingIntoAReplacedNamespace/CreateTable (0.10s) --- PASS: TestCreateRefusedBeforeWritingIntoAReplacedNamespace/RegisterTable (0.15s) --- PASS: TestCreateRefusedBeforeWritingIntoAReplacedNamespace/CreateView (0.15s) --- PASS: TestCreateRefusedBeforeWritingIntoAReplacedNamespace/RenameTable (0.20s) --- PASS: TestCreateRefusedBeforeWritingIntoAReplacedNamespace/RenameView (0.14s) === RUN TestUpdateNamespaceSparesARecreatedNamespace I1117 09:40:42.519638 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestUpdateNamespaceSparesARecreatedNamespace (0.10s) === RUN TestDeleteNamespaceSparesARecreatedNamespace I1117 09:40:42.618543 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceSparesARecreatedNamespace (0.09s) === RUN TestBucketWritesSpareARecreatedBucket === RUN TestBucketWritesSpareARecreatedBucket/PutTableBucketPolicy === RUN TestBucketWritesSpareARecreatedBucket/DeleteTableBucketPolicy === RUN TestBucketWritesSpareARecreatedBucket/TagResource === RUN TestBucketWritesSpareARecreatedBucket/UntagResource === RUN TestBucketWritesSpareARecreatedBucket/PutTableBucketMaintenanceConfiguration --- PASS: TestBucketWritesSpareARecreatedBucket (0.31s) --- PASS: TestBucketWritesSpareARecreatedBucket/PutTableBucketPolicy (0.05s) --- PASS: TestBucketWritesSpareARecreatedBucket/DeleteTableBucketPolicy (0.08s) --- PASS: TestBucketWritesSpareARecreatedBucket/TagResource (0.07s) --- PASS: TestBucketWritesSpareARecreatedBucket/UntagResource (0.05s) --- PASS: TestBucketWritesSpareARecreatedBucket/PutTableBucketMaintenanceConfiguration (0.05s) === RUN TestBucketWritesLandOnTheAuthorizedBucket === RUN TestBucketWritesLandOnTheAuthorizedBucket/PutTableBucketPolicy === RUN TestBucketWritesLandOnTheAuthorizedBucket/DeleteTableBucketPolicy === RUN TestBucketWritesLandOnTheAuthorizedBucket/TagResource === RUN TestBucketWritesLandOnTheAuthorizedBucket/UntagResource === RUN TestBucketWritesLandOnTheAuthorizedBucket/PutTableBucketMaintenanceConfiguration --- PASS: TestBucketWritesLandOnTheAuthorizedBucket (0.23s) --- PASS: TestBucketWritesLandOnTheAuthorizedBucket/PutTableBucketPolicy (0.05s) --- PASS: TestBucketWritesLandOnTheAuthorizedBucket/DeleteTableBucketPolicy (0.04s) --- PASS: TestBucketWritesLandOnTheAuthorizedBucket/TagResource (0.04s) --- PASS: TestBucketWritesLandOnTheAuthorizedBucket/UntagResource (0.05s) --- PASS: TestBucketWritesLandOnTheAuthorizedBucket/PutTableBucketMaintenanceConfiguration (0.04s) === RUN TestTagOperationsKeepToTheBoundBucket --- PASS: TestTagOperationsKeepToTheBoundBucket (0.34s) === RUN TestTagWritesKeepAConcurrentTagWrite === RUN TestTagWritesKeepAConcurrentTagWrite/TagResource === RUN TestTagWritesKeepAConcurrentTagWrite/UntagResource --- PASS: TestTagWritesKeepAConcurrentTagWrite (0.11s) --- PASS: TestTagWritesKeepAConcurrentTagWrite/TagResource (0.06s) --- PASS: TestTagWritesKeepAConcurrentTagWrite/UntagResource (0.05s) === RUN TestTagResourceKeepsToItsLimit --- PASS: TestTagResourceKeepsToItsLimit (0.09s) === RUN TestCreateTableRefusesAForeignFormat --- PASS: TestCreateTableRefusesAForeignFormat (0.18s) === RUN TestCreateTableRefusesLanceInAnIcebergBucket --- PASS: TestCreateTableRefusesLanceInAnIcebergBucket (0.05s) === RUN TestUndeclaredBucketAcceptsEitherFormat --- PASS: TestUndeclaredBucketAcceptsEitherFormat (0.28s) === RUN TestCreateViewRefusedInALanceBucket --- PASS: TestCreateViewRefusedInALanceBucket (0.06s) === RUN TestNormalizeFormat --- PASS: TestNormalizeFormat (0.00s) === RUN TestDeclaredBucketEncryption --- PASS: TestDeclaredBucketEncryption (0.01s) === RUN TestCreateTableBucketNeedsSSES3ForADeclaredLanceBucket --- PASS: TestCreateTableBucketNeedsSSES3ForADeclaredLanceBucket (0.08s) === RUN TestDeleteTableBucketRemovesEmptyLeftovers I1117 09:40:44.479391 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteTableBucketRemovesEmptyLeftovers (0.58s) === RUN TestDeleteTableBucketRefusesOrphanData --- PASS: TestDeleteTableBucketRefusesOrphanData (0.09s) === RUN TestDeleteTableBucketKeepsDataUnderAHiddenDirectory === RUN TestDeleteTableBucketKeepsDataUnderAHiddenDirectory/files_under_a_hidden_directory === RUN TestDeleteTableBucketKeepsDataUnderAHiddenDirectory/only_empty_hidden_directories === RUN TestDeleteTableBucketKeepsDataUnderAHiddenDirectory/a_hidden_file === RUN TestDeleteTableBucketKeepsDataUnderAHiddenDirectory/a_hidden_directory_stored_as_an_object --- PASS: TestDeleteTableBucketKeepsDataUnderAHiddenDirectory (0.40s) --- PASS: TestDeleteTableBucketKeepsDataUnderAHiddenDirectory/files_under_a_hidden_directory (0.09s) --- PASS: TestDeleteTableBucketKeepsDataUnderAHiddenDirectory/only_empty_hidden_directories (0.11s) --- PASS: TestDeleteTableBucketKeepsDataUnderAHiddenDirectory/a_hidden_file (0.09s) --- PASS: TestDeleteTableBucketKeepsDataUnderAHiddenDirectory/a_hidden_directory_stored_as_an_object (0.10s) === RUN TestDeleteTableBucketTurnsAwayATakeBackAfterTheScan I1117 09:40:45.607997 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteTableBucketTurnsAwayATakeBackAfterTheScan (0.16s) === RUN TestCreateNamespaceRefusedInClaimedBucket I1117 09:40:45.681548 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceRefusedInClaimedBucket (0.03s) === RUN TestCreateNamespaceTreatsARecreatedBucketAsGone I1117 09:40:45.715963 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceTreatsARecreatedBucketAsGone (0.09s) === RUN TestDeleteTableBucketTreatsARecreatedBucketAsGone --- PASS: TestDeleteTableBucketTreatsARecreatedBucketAsGone (0.04s) === RUN TestCreateNamespaceStopsAtAFailedBucketCheck === RUN TestCreateNamespaceStopsAtAFailedBucketCheck/the_bucket_could_not_be_read I1117 09:40:45.851443 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] E1117 09:40:45.853611 handler.go:287 S3Tables: error handling CreateNamespace: LookupEntry1: rpc error: code = Unavailable desc = filer unavailable === RUN TestCreateNamespaceStopsAtAFailedBucketCheck/the_bucket_is_still_being_created I1117 09:40:45.906670 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceStopsAtAFailedBucketCheck (0.09s) --- PASS: TestCreateNamespaceStopsAtAFailedBucketCheck/the_bucket_could_not_be_read (0.05s) --- PASS: TestCreateNamespaceStopsAtAFailedBucketCheck/the_bucket_is_still_being_created (0.04s) === RUN TestDeleteTableBucketTurnsAwayACreateAfterTheScan I1117 09:40:45.959709 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteTableBucketTurnsAwayACreateAfterTheScan (0.06s) === RUN TestCreateNamespaceWrittenAfterTheScanBacksOut I1117 09:40:46.008364 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceWrittenAfterTheScanBacksOut (0.11s) === RUN TestDeleteTableBucketRefusesAfterItsClaimIsLifted I1117 09:40:46.205260 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteTableBucketRefusesAfterItsClaimIsLifted (0.18s) === RUN TestDeleteTableBucketKeepsAFileUploadedAfterTheWalk === RUN TestDeleteTableBucketKeepsAFileUploadedAfterTheWalk/into_a_leftover_directory === RUN TestDeleteTableBucketKeepsAFileUploadedAfterTheWalk/into_the_bucket --- PASS: TestDeleteTableBucketKeepsAFileUploadedAfterTheWalk (0.18s) --- PASS: TestDeleteTableBucketKeepsAFileUploadedAfterTheWalk/into_a_leftover_directory (0.09s) --- PASS: TestDeleteTableBucketKeepsAFileUploadedAfterTheWalk/into_the_bucket (0.10s) === RUN TestDeleteTableBucketKeepsALeftoverTakenBackAfterItsClaimIsLifted I1117 09:40:46.561947 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteTableBucketKeepsALeftoverTakenBackAfterItsClaimIsLifted (0.29s) === RUN TestDeleteTableBucketRefusesACatalogRecordInALeftover --- PASS: TestDeleteTableBucketRefusesACatalogRecordInALeftover (0.17s) === RUN TestCreateNamespaceAdoptsAnUnfinishedNamespace I1117 09:40:46.947477 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] I1117 09:40:47.005836 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceAdoptsAnUnfinishedNamespace (0.26s) === RUN TestCreateTableRefusedInNamespaceStillBeingCreated I1117 09:40:47.210472 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateTableRefusedInNamespaceStillBeingCreated (0.24s) === RUN TestDeleteNamespaceLeavesAnUnfinishedNamespaceAlone I1117 09:40:47.460946 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceLeavesAnUnfinishedNamespaceAlone (0.15s) === RUN TestDeleteNamespaceDoesNotClaimAnUnfinishedNamespace I1117 09:40:47.594135 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceDoesNotClaimAnUnfinishedNamespace (0.10s) === RUN TestDeleteTableBucketCountsANamespaceStillBeingCreated I1117 09:40:47.705870 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteTableBucketCountsANamespaceStillBeingCreated (0.15s) === RUN TestDeleteTableBucketClaimOnTheBucket === RUN TestDeleteTableBucketClaimOnTheBucket/lifted_when_a_namespace_is_found I1117 09:40:47.839382 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] I1117 09:40:47.923132 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestDeleteTableBucketClaimOnTheBucket/lifted_when_a_directory_holds_files I1117 09:40:48.073266 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestDeleteTableBucketClaimOnTheBucket/replaces_the_claim_of_a_delete_that_died --- PASS: TestDeleteTableBucketClaimOnTheBucket (0.37s) --- PASS: TestDeleteTableBucketClaimOnTheBucket/lifted_when_a_namespace_is_found (0.15s) --- PASS: TestDeleteTableBucketClaimOnTheBucket/lifted_when_a_directory_holds_files (0.14s) --- PASS: TestDeleteTableBucketClaimOnTheBucket/replaces_the_claim_of_a_delete_that_died (0.07s) === RUN TestDeleteTableBucketKeepsADirectoryBackedObject === RUN TestDeleteTableBucketKeepsADirectoryBackedObject/an_empty_object_in_the_bucket === RUN TestDeleteTableBucketKeepsADirectoryBackedObject/an_object_under_a_leftover_directory === RUN TestDeleteTableBucketKeepsADirectoryBackedObject/a_leftover_stored_as_an_object_after_the_scan === RUN TestDeleteTableBucketKeepsADirectoryBackedObject/a_leftover_stored_as_an_object_between_the_read_and_the_write_of_its_claim === RUN TestDeleteTableBucketKeepsADirectoryBackedObject/a_leftover_marked_as_an_empty_object_after_the_walk --- PASS: TestDeleteTableBucketKeepsADirectoryBackedObject (0.49s) --- PASS: TestDeleteTableBucketKeepsADirectoryBackedObject/an_empty_object_in_the_bucket (0.07s) --- PASS: TestDeleteTableBucketKeepsADirectoryBackedObject/an_object_under_a_leftover_directory (0.12s) --- PASS: TestDeleteTableBucketKeepsADirectoryBackedObject/a_leftover_stored_as_an_object_after_the_scan (0.07s) --- PASS: TestDeleteTableBucketKeepsADirectoryBackedObject/a_leftover_stored_as_an_object_between_the_read_and_the_write_of_its_claim (0.12s) --- PASS: TestDeleteTableBucketKeepsADirectoryBackedObject/a_leftover_marked_as_an_empty_object_after_the_walk (0.10s) === RUN TestDeleteTableBucketKeepsAFileThatReplacedADirectory === RUN TestDeleteTableBucketKeepsAFileThatReplacedADirectory/the_leftover,_after_the_scan === RUN TestDeleteTableBucketKeepsAFileThatReplacedADirectory/a_directory_under_it,_after_the_walk_listed_it === RUN TestDeleteTableBucketKeepsAFileThatReplacedADirectory/a_directory_under_it,_between_the_read_and_the_write_of_its_claim === RUN TestDeleteTableBucketKeepsAFileThatReplacedADirectory/a_directory_under_it,_after_its_claim --- PASS: TestDeleteTableBucketKeepsAFileThatReplacedADirectory (0.52s) --- PASS: TestDeleteTableBucketKeepsAFileThatReplacedADirectory/the_leftover,_after_the_scan (0.08s) --- PASS: TestDeleteTableBucketKeepsAFileThatReplacedADirectory/a_directory_under_it,_after_the_walk_listed_it (0.16s) --- PASS: TestDeleteTableBucketKeepsAFileThatReplacedADirectory/a_directory_under_it,_between_the_read_and_the_write_of_its_claim (0.13s) --- PASS: TestDeleteTableBucketKeepsAFileThatReplacedADirectory/a_directory_under_it,_after_its_claim (0.14s) === RUN TestDeleteTableBucketRetriesTheClaimRelease I1117 09:40:49.373402 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteTableBucketRetriesTheClaimRelease (0.23s) === RUN TestDeleteTableBucketRetriesLeftoverClaimReleases === RUN TestDeleteTableBucketRetriesLeftoverClaimReleases/on_the_leftover I1117 09:40:49.627629 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestDeleteTableBucketRetriesLeftoverClaimReleases/on_a_directory_under_it --- PASS: TestDeleteTableBucketRetriesLeftoverClaimReleases (0.48s) --- PASS: TestDeleteTableBucketRetriesLeftoverClaimReleases/on_the_leftover (0.27s) --- PASS: TestDeleteTableBucketRetriesLeftoverClaimReleases/on_a_directory_under_it (0.20s) === RUN TestDeleteTableBucketFindsANamespacePastLeftovers I1117 09:40:49.917227 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteTableBucketFindsANamespacePastLeftovers (0.09s) === RUN TestCreatesRefusedInClaimedNamespace === RUN TestCreatesRefusedInClaimedNamespace/CreateTable === RUN TestCreatesRefusedInClaimedNamespace/RegisterTable === RUN TestCreatesRefusedInClaimedNamespace/CreateView --- PASS: TestCreatesRefusedInClaimedNamespace (0.12s) --- PASS: TestCreatesRefusedInClaimedNamespace/CreateTable (0.04s) --- PASS: TestCreatesRefusedInClaimedNamespace/RegisterTable (0.04s) --- PASS: TestCreatesRefusedInClaimedNamespace/CreateView (0.04s) === RUN TestCreateBetweenNamespaceScanAndDeleteBacksOut === RUN TestCreateBetweenNamespaceScanAndDeleteBacksOut/CreateTable === RUN TestCreateBetweenNamespaceScanAndDeleteBacksOut/RegisterTable === RUN TestCreateBetweenNamespaceScanAndDeleteBacksOut/CreateView --- PASS: TestCreateBetweenNamespaceScanAndDeleteBacksOut (0.53s) --- PASS: TestCreateBetweenNamespaceScanAndDeleteBacksOut/CreateTable (0.19s) --- PASS: TestCreateBetweenNamespaceScanAndDeleteBacksOut/RegisterTable (0.16s) --- PASS: TestCreateBetweenNamespaceScanAndDeleteBacksOut/CreateView (0.18s) === RUN TestCreateConfirmingUnderANamespaceClaimBacksOut === RUN TestCreateConfirmingUnderANamespaceClaimBacksOut/CreateTable === RUN TestCreateConfirmingUnderANamespaceClaimBacksOut/RegisterTable === RUN TestCreateConfirmingUnderANamespaceClaimBacksOut/CreateView --- PASS: TestCreateConfirmingUnderANamespaceClaimBacksOut (0.47s) --- PASS: TestCreateConfirmingUnderANamespaceClaimBacksOut/CreateTable (0.17s) --- PASS: TestCreateConfirmingUnderANamespaceClaimBacksOut/RegisterTable (0.15s) --- PASS: TestCreateConfirmingUnderANamespaceClaimBacksOut/CreateView (0.15s) === RUN TestCreateConfirmingAcrossANamespaceUpdateSucceeds === RUN TestCreateConfirmingAcrossANamespaceUpdateSucceeds/CreateTable === RUN TestCreateConfirmingAcrossANamespaceUpdateSucceeds/RegisterTable === RUN TestCreateConfirmingAcrossANamespaceUpdateSucceeds/CreateView --- PASS: TestCreateConfirmingAcrossANamespaceUpdateSucceeds (0.34s) --- PASS: TestCreateConfirmingAcrossANamespaceUpdateSucceeds/CreateTable (0.11s) --- PASS: TestCreateConfirmingAcrossANamespaceUpdateSucceeds/RegisterTable (0.11s) --- PASS: TestCreateConfirmingAcrossANamespaceUpdateSucceeds/CreateView (0.11s) === RUN TestCreateAfterNamespaceDeleteBacksOut === RUN TestCreateAfterNamespaceDeleteBacksOut/CreateTable === RUN TestCreateAfterNamespaceDeleteBacksOut/RegisterTable === RUN TestCreateAfterNamespaceDeleteBacksOut/CreateView --- PASS: TestCreateAfterNamespaceDeleteBacksOut (0.54s) --- PASS: TestCreateAfterNamespaceDeleteBacksOut/CreateTable (0.18s) --- PASS: TestCreateAfterNamespaceDeleteBacksOut/RegisterTable (0.21s) --- PASS: TestCreateAfterNamespaceDeleteBacksOut/CreateView (0.14s) === RUN TestUnfinishedCreateIsNotReportedAsExisting === RUN TestUnfinishedCreateIsNotReportedAsExisting/CreateTable W1117 09:40:52.150630 filer_ops.go:865 back out /buckets/renamebkt/ns/late: attribute changed concurrently: s3tables.metadata changed on /buckets/renamebkt/ns/late === RUN TestUnfinishedCreateIsNotReportedAsExisting/RegisterTable W1117 09:40:52.357688 filer_ops.go:865 back out /buckets/renamebkt/ns/late: attribute changed concurrently: s3tables.metadata changed on /buckets/renamebkt/ns/late === RUN TestUnfinishedCreateIsNotReportedAsExisting/CreateView W1117 09:40:52.724561 filer_ops.go:865 back out /buckets/renamebkt/ns/late: attribute changed concurrently: s3tables.metadata changed on /buckets/renamebkt/ns/late --- PASS: TestUnfinishedCreateIsNotReportedAsExisting (0.78s) --- PASS: TestUnfinishedCreateIsNotReportedAsExisting/CreateTable (0.19s) --- PASS: TestUnfinishedCreateIsNotReportedAsExisting/RegisterTable (0.22s) --- PASS: TestUnfinishedCreateIsNotReportedAsExisting/CreateView (0.37s) === RUN TestDeniedCreatesDoNotSeeADeleteClaim === RUN TestDeniedCreatesDoNotSeeADeleteClaim/CreateTable === RUN TestDeniedCreatesDoNotSeeADeleteClaim/RegisterTable === RUN TestDeniedCreatesDoNotSeeADeleteClaim/CreateView --- PASS: TestDeniedCreatesDoNotSeeADeleteClaim (0.24s) --- PASS: TestDeniedCreatesDoNotSeeADeleteClaim/CreateTable (0.08s) --- PASS: TestDeniedCreatesDoNotSeeADeleteClaim/RegisterTable (0.08s) --- PASS: TestDeniedCreatesDoNotSeeADeleteClaim/CreateView (0.07s) === RUN TestListingsSkipAnUnfinishedCreate === RUN TestListingsSkipAnUnfinishedCreate/CreateTable === RUN TestListingsSkipAnUnfinishedCreate/RegisterTable === RUN TestListingsSkipAnUnfinishedCreate/CreateView --- PASS: TestListingsSkipAnUnfinishedCreate (0.63s) --- PASS: TestListingsSkipAnUnfinishedCreate/CreateTable (0.22s) --- PASS: TestListingsSkipAnUnfinishedCreate/RegisterTable (0.22s) --- PASS: TestListingsSkipAnUnfinishedCreate/CreateView (0.18s) === RUN TestUpdateRefusedOnAMarkedRecord --- PASS: TestUpdateRefusedOnAMarkedRecord (0.09s) === RUN TestDeleteTablePolicyRefusedOnAMarkedRecord --- PASS: TestDeleteTablePolicyRefusedOnAMarkedRecord (0.08s) === RUN TestRenameIntoClaimedNamespaceIsRefused --- PASS: TestRenameIntoClaimedNamespaceIsRefused (0.07s) === RUN TestRenameClearsTheDestinationMark --- PASS: TestRenameClearsTheDestinationMark (0.17s) === RUN TestCreateCannotAdoptARenameDestination === RUN TestCreateCannotAdoptARenameDestination/CreateTable === RUN TestCreateCannotAdoptARenameDestination/RegisterTable === RUN TestCreateCannotAdoptARenameDestination/CreateView --- PASS: TestCreateCannotAdoptARenameDestination (0.46s) --- PASS: TestCreateCannotAdoptARenameDestination/CreateTable (0.22s) --- PASS: TestCreateCannotAdoptARenameDestination/RegisterTable (0.11s) --- PASS: TestCreateCannotAdoptARenameDestination/CreateView (0.13s) === RUN TestRenameCommittingUnderAClaimedNamespaceRestoresSource --- PASS: TestRenameCommittingUnderAClaimedNamespaceRestoresSource (0.19s) === RUN TestDeleteNamespaceWithTableLiftsItsClaim === RUN TestDeleteNamespaceWithTableLiftsItsClaim/CreateTable --- PASS: TestDeleteNamespaceWithTableLiftsItsClaim (0.13s) --- PASS: TestDeleteNamespaceWithTableLiftsItsClaim/CreateTable (0.13s) === RUN TestDeleteNamespaceRetriesTheClaimRelease --- PASS: TestDeleteNamespaceRetriesTheClaimRelease (0.17s) === RUN TestCreateAdoptsAnOrphanedMark === RUN TestCreateAdoptsAnOrphanedMark/CreateTable === RUN TestCreateAdoptsAnOrphanedMark/RegisterTable === RUN TestCreateAdoptsAnOrphanedMark/CreateView --- PASS: TestCreateAdoptsAnOrphanedMark (0.35s) --- PASS: TestCreateAdoptsAnOrphanedMark/CreateTable (0.12s) --- PASS: TestCreateAdoptsAnOrphanedMark/RegisterTable (0.13s) --- PASS: TestCreateAdoptsAnOrphanedMark/CreateView (0.10s) === RUN TestRenameAdoptsAMarkedDestination --- PASS: TestRenameAdoptsAMarkedDestination (0.17s) === RUN TestDeleteNamespaceSkipsAnUnfinishedCreate --- PASS: TestDeleteNamespaceSkipsAnUnfinishedCreate (0.10s) === RUN TestDeleteNamespaceScansPastASkippedPage --- PASS: TestDeleteNamespaceScansPastASkippedPage (0.14s) === RUN TestDeleteNamespacePagesToTheEnd --- PASS: TestDeleteNamespacePagesToTheEnd (0.11s) === RUN TestDeleteTableTokenDeleteLosesToConcurrentUpdate --- PASS: TestDeleteTableTokenDeleteLosesToConcurrentUpdate (0.05s) === RUN TestCreateTableLosesToRestoredMarkers --- PASS: TestCreateTableLosesToRestoredMarkers (0.06s) === RUN TestDeleteTableDecoupledKeepsReusedNamePath --- PASS: TestDeleteTableDecoupledKeepsReusedNamePath (0.07s) === RUN TestDeleteTableDecoupledClearsLeftoverClaim --- PASS: TestDeleteTableDecoupledClearsLeftoverClaim (0.13s) === RUN TestDeleteTableDecoupledLosesToMovedLocation --- PASS: TestDeleteTableDecoupledLosesToMovedLocation (0.06s) === RUN TestDeleteTableRefusesAncestorDataPath --- PASS: TestDeleteTableRefusesAncestorDataPath (0.04s) === RUN TestDeleteTableColocatedRemovesData --- PASS: TestDeleteTableColocatedRemovesData (0.06s) === RUN TestDeleteTableRefusesLiveSiblingDataPath --- PASS: TestDeleteTableRefusesLiveSiblingDataPath (0.07s) === RUN TestDeleteTableRefusesNestedSiblingDataPath --- PASS: TestDeleteTableRefusesNestedSiblingDataPath (0.06s) === RUN TestDeleteTableTokenDeleteLosesToCompletedRename --- PASS: TestDeleteTableTokenDeleteLosesToCompletedRename (0.06s) === RUN TestRenameTableLosesToDeleteClaim --- PASS: TestRenameTableLosesToDeleteClaim (0.08s) === RUN TestDeleteTableLosesToRenameClaim --- PASS: TestDeleteTableLosesToRenameClaim (0.05s) === RUN TestDeleteTableTokenLosesToRenameClaim --- PASS: TestDeleteTableTokenLosesToRenameClaim (0.05s) === RUN TestDeleteViewSparesAReplacement === RUN TestDeleteViewSparesAReplacement/table_without_token === RUN TestDeleteViewSparesAReplacement/view_with_the_old_token === RUN TestDeleteViewSparesAReplacement/view_without_token --- PASS: TestDeleteViewSparesAReplacement (0.65s) --- PASS: TestDeleteViewSparesAReplacement/table_without_token (0.24s) --- PASS: TestDeleteViewSparesAReplacement/view_with_the_old_token (0.20s) --- PASS: TestDeleteViewSparesAReplacement/view_without_token (0.21s) === RUN TestDeleteTableSparesAReplacementView === RUN TestDeleteTableSparesAReplacementView/colocated === RUN TestDeleteTableSparesAReplacementView/decoupled --- PASS: TestDeleteTableSparesAReplacementView (0.25s) --- PASS: TestDeleteTableSparesAReplacementView/colocated (0.13s) --- PASS: TestDeleteTableSparesAReplacementView/decoupled (0.12s) === RUN TestTableBucketAuthorizationDenialMatchesMissing === RUN TestTableBucketAuthorizationDenialMatchesMissing/GetTableBucket === RUN TestTableBucketAuthorizationDenialMatchesMissing/DeleteTableBucket --- PASS: TestTableBucketAuthorizationDenialMatchesMissing (0.06s) --- PASS: TestTableBucketAuthorizationDenialMatchesMissing/GetTableBucket (0.02s) --- PASS: TestTableBucketAuthorizationDenialMatchesMissing/DeleteTableBucket (0.01s) === RUN TestNamespaceAuthorizationDenialMatchesMissing === RUN TestNamespaceAuthorizationDenialMatchesMissing/GetNamespace === RUN TestNamespaceAuthorizationDenialMatchesMissing/UpdateNamespace === RUN TestNamespaceAuthorizationDenialMatchesMissing/DeleteNamespace --- PASS: TestNamespaceAuthorizationDenialMatchesMissing (0.08s) --- PASS: TestNamespaceAuthorizationDenialMatchesMissing/GetNamespace (0.02s) --- PASS: TestNamespaceAuthorizationDenialMatchesMissing/UpdateNamespace (0.01s) --- PASS: TestNamespaceAuthorizationDenialMatchesMissing/DeleteNamespace (0.02s) === RUN TestTableAuthorizationDenialMatchesMissing === RUN TestTableAuthorizationDenialMatchesMissing/GetTable === RUN TestTableAuthorizationDenialMatchesMissing/UpdateTable === RUN TestTableAuthorizationDenialMatchesMissing/DeleteTable === RUN TestTableAuthorizationDenialMatchesMissing/RenameTable --- PASS: TestTableAuthorizationDenialMatchesMissing (0.15s) --- PASS: TestTableAuthorizationDenialMatchesMissing/GetTable (0.02s) --- PASS: TestTableAuthorizationDenialMatchesMissing/UpdateTable (0.03s) --- PASS: TestTableAuthorizationDenialMatchesMissing/DeleteTable (0.03s) --- PASS: TestTableAuthorizationDenialMatchesMissing/RenameTable (0.04s) === RUN TestDeleteTableAuthorizedVersionMismatchStillConflicts --- PASS: TestDeleteTableAuthorizedVersionMismatchStillConflicts (0.03s) === RUN TestDeniedWritesReportForbiddenToReaders === RUN TestDeniedWritesReportForbiddenToReaders/UpdateTable === RUN TestDeniedWritesReportForbiddenToReaders/DeleteTable === RUN TestDeniedWritesReportForbiddenToReaders/RenameTable --- PASS: TestDeniedWritesReportForbiddenToReaders (0.12s) --- PASS: TestDeniedWritesReportForbiddenToReaders/UpdateTable (0.02s) --- PASS: TestDeniedWritesReportForbiddenToReaders/DeleteTable (0.03s) --- PASS: TestDeniedWritesReportForbiddenToReaders/RenameTable (0.03s) === RUN TestDeniedTableWritesDoNotRevealViews === RUN TestDeniedTableWritesDoNotRevealViews/GetTable === RUN TestDeniedTableWritesDoNotRevealViews/UpdateTable === RUN TestDeniedTableWritesDoNotRevealViews/DeleteTable --- PASS: TestDeniedTableWritesDoNotRevealViews (0.03s) --- PASS: TestDeniedTableWritesDoNotRevealViews/GetTable (0.00s) --- PASS: TestDeniedTableWritesDoNotRevealViews/UpdateTable (0.01s) --- PASS: TestDeniedTableWritesDoNotRevealViews/DeleteTable (0.00s) === RUN TestAbsentListTargetsMatchDeniedAnswers === RUN TestAbsentListTargetsMatchDeniedAnswers/ListTables_missing_namespace === RUN TestAbsentListTargetsMatchDeniedAnswers/ListTables_missing_bucket === RUN TestAbsentListTargetsMatchDeniedAnswers/ListTables_missing_bucket,_all_namespaces === RUN TestAbsentListTargetsMatchDeniedAnswers/ListViews_missing_namespace === RUN TestAbsentListTargetsMatchDeniedAnswers/CreateNamespace_missing_bucket I1117 09:40:58.273479 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=attacker, owner=000000000000, actions=[Read] I1117 09:40:58.274252 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=attacker, owner=000000000000 --- PASS: TestAbsentListTargetsMatchDeniedAnswers (0.21s) --- PASS: TestAbsentListTargetsMatchDeniedAnswers/ListTables_missing_namespace (0.05s) --- PASS: TestAbsentListTargetsMatchDeniedAnswers/ListTables_missing_bucket (0.04s) --- PASS: TestAbsentListTargetsMatchDeniedAnswers/ListTables_missing_bucket,_all_namespaces (0.03s) --- PASS: TestAbsentListTargetsMatchDeniedAnswers/ListViews_missing_namespace (0.04s) --- PASS: TestAbsentListTargetsMatchDeniedAnswers/CreateNamespace_missing_bucket (0.03s) === RUN TestAbsentTagTargetsMatchDeniedAnswers === RUN TestAbsentTagTargetsMatchDeniedAnswers/TagResource === RUN TestAbsentTagTargetsMatchDeniedAnswers/ListTagsForResource === RUN TestAbsentTagTargetsMatchDeniedAnswers/UntagResource --- PASS: TestAbsentTagTargetsMatchDeniedAnswers (0.14s) --- PASS: TestAbsentTagTargetsMatchDeniedAnswers/TagResource (0.04s) --- PASS: TestAbsentTagTargetsMatchDeniedAnswers/ListTagsForResource (0.04s) --- PASS: TestAbsentTagTargetsMatchDeniedAnswers/UntagResource (0.04s) === RUN TestPlainBucketReadsAsAbsent === RUN TestPlainBucketReadsAsAbsent/GetTableBucket === RUN TestPlainBucketReadsAsAbsent/ListNamespaces --- PASS: TestPlainBucketReadsAsAbsent (0.03s) --- PASS: TestPlainBucketReadsAsAbsent/GetTableBucket (0.01s) --- PASS: TestPlainBucketReadsAsAbsent/ListNamespaces (0.01s) === RUN TestGrantedCallerLearnsAbsence --- PASS: TestGrantedCallerLearnsAbsence (0.05s) === RUN TestAbsentTagTargetDenySurvivesForeignAccountARN === RUN TestAbsentTagTargetDenySurvivesForeignAccountARN/TagResource === RUN TestAbsentTagTargetDenySurvivesForeignAccountARN/ListTagsForResource === RUN TestAbsentTagTargetDenySurvivesForeignAccountARN/UntagResource --- PASS: TestAbsentTagTargetDenySurvivesForeignAccountARN (0.16s) --- PASS: TestAbsentTagTargetDenySurvivesForeignAccountARN/TagResource (0.04s) --- PASS: TestAbsentTagTargetDenySurvivesForeignAccountARN/ListTagsForResource (0.04s) --- PASS: TestAbsentTagTargetDenySurvivesForeignAccountARN/UntagResource (0.06s) === RUN TestCreateTableDenialMatchesMissingNamespace === RUN TestCreateTableDenialMatchesMissingNamespace/CreateTable === RUN TestCreateTableDenialMatchesMissingNamespace/RegisterTable --- PASS: TestCreateTableDenialMatchesMissingNamespace (0.18s) --- PASS: TestCreateTableDenialMatchesMissingNamespace/CreateTable (0.08s) --- PASS: TestCreateTableDenialMatchesMissingNamespace/RegisterTable (0.07s) === RUN TestGetAccountIDPrefersClaimsOverAccountID --- PASS: TestGetAccountIDPrefersClaimsOverAccountID (0.00s) === RUN TestGetAccountIDUsesSubWhenPreferredUsernameMissing --- PASS: TestGetAccountIDUsesSubWhenPreferredUsernameMissing (0.00s) === RUN TestGetAccountIDFallsBackToHandlerDefaultAccount --- PASS: TestGetAccountIDFallsBackToHandlerDefaultAccount (0.00s) === RUN TestGetAccountIDIgnoresEmptyClaimValues --- PASS: TestGetAccountIDIgnoresEmptyClaimValues (0.00s) === RUN TestGetAccountIDFallsBackToIdentityName --- PASS: TestGetAccountIDFallsBackToIdentityName (0.00s) === RUN TestGetAccountIDFallsBackToARNColonSegment --- PASS: TestGetAccountIDFallsBackToARNColonSegment (0.00s) === RUN TestGetAccountIDFallsBackToAmzAccountIdHeader --- PASS: TestGetAccountIDFallsBackToAmzAccountIdHeader (0.00s) === RUN TestGetAccountIDFallsBackToAccountID --- PASS: TestGetAccountIDFallsBackToAccountID (0.00s) === RUN TestGetAccountIDNonAdminDoesNotInheritAdminAccount --- PASS: TestGetAccountIDNonAdminDoesNotInheritAdminAccount (0.00s) === RUN TestGetAccountIDAdminActionKeepsAdminAccount --- PASS: TestGetAccountIDAdminActionKeepsAdminAccount (0.00s) === RUN TestDefaultAllowForOnlyAppliesWithoutResolvedIdentity --- PASS: TestDefaultAllowForOnlyAppliesWithoutResolvedIdentity (0.00s) === RUN TestGetAccountIDNormalizesAccountIDARN --- PASS: TestGetAccountIDNormalizesAccountIDARN (0.00s) === RUN TestGetAccountIDPrefersIssuerScopedUserID --- PASS: TestGetAccountIDPrefersIssuerScopedUserID (0.00s) === RUN TestLocationOwnedByOneRecord I1117 09:40:58.897039 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestLocationOwnedByOneRecord/live_table === RUN TestLocationOwnedByOneRecord/renamed_table === RUN TestLocationOwnedByOneRecord/free_locations --- PASS: TestLocationOwnedByOneRecord (1.36s) --- PASS: TestLocationOwnedByOneRecord/live_table (0.45s) --- PASS: TestLocationOwnedByOneRecord/renamed_table (0.48s) --- PASS: TestLocationOwnedByOneRecord/free_locations (0.19s) === RUN TestDeleteTableKeepsSharedFiles --- PASS: TestDeleteTableKeepsSharedFiles (0.08s) === RUN TestLocationRaceBacksOut === RUN TestLocationRaceBacksOut/create === RUN TestLocationRaceBacksOut/update === RUN TestLocationRaceBacksOut/UpdateTable_keeps_its_old_root_while_moving === RUN TestLocationRaceBacksOut/UpdateView_keeps_its_old_root_while_moving === RUN TestLocationRaceBacksOut/update_moving_under_an_update_to_ns/shared/metadata/v2.metadata.json === RUN TestLocationRaceBacksOut/update_moving_under_an_update_to_ns/old/metadata/v2.metadata.json === RUN TestLocationRaceBacksOut/update_with_a_failed_check E1117 09:41:01.295708 handler.go:287 S3Tables: error handling UpdateTable: listing unavailable === RUN TestLocationRaceBacksOut/rename --- PASS: TestLocationRaceBacksOut (1.19s) --- PASS: TestLocationRaceBacksOut/create (0.11s) --- PASS: TestLocationRaceBacksOut/update (0.08s) --- PASS: TestLocationRaceBacksOut/UpdateTable_keeps_its_old_root_while_moving (0.16s) --- PASS: TestLocationRaceBacksOut/UpdateView_keeps_its_old_root_while_moving (0.19s) --- PASS: TestLocationRaceBacksOut/update_moving_under_an_update_to_ns/shared/metadata/v2.metadata.json (0.19s) --- PASS: TestLocationRaceBacksOut/update_moving_under_an_update_to_ns/old/metadata/v2.metadata.json (0.20s) --- PASS: TestLocationRaceBacksOut/update_with_a_failed_check (0.06s) --- PASS: TestLocationRaceBacksOut/rename (0.20s) === RUN TestMoveReservationLeftBehind --- PASS: TestMoveReservationLeftBehind (0.18s) === RUN TestLocationRefusesAnotherRecordsEntry --- PASS: TestLocationRefusesAnotherRecordsEntry (0.13s) === RUN TestRecordGoneDropsItsMoveReservation === RUN TestRecordGoneDropsItsMoveReservation/rename === RUN TestRecordGoneDropsItsMoveReservation/delete --- PASS: TestRecordGoneDropsItsMoveReservation (0.48s) --- PASS: TestRecordGoneDropsItsMoveReservation/rename (0.27s) --- PASS: TestRecordGoneDropsItsMoveReservation/delete (0.21s) === RUN TestRequestRefusedWith4xxIsNotLoggedAsError --- PASS: TestRequestRefusedWith4xxIsNotLoggedAsError (0.00s) === RUN TestLogRequestErrorByStatus --- PASS: TestLogRequestErrorByStatus (0.00s) === RUN TestStatusRecorderKeepsTheFirstStatus --- PASS: TestStatusRecorderKeepsTheFirstStatus (0.00s) === RUN TestStatusRecorderUnwrapsForResponseController --- PASS: TestStatusRecorderUnwrapsForResponseController (0.00s) === RUN TestMalformedCreateNamespaceIsNotLoggedAsError E1117 09:41:02.299353 handler_log_level_test.go:89 S3Tables test: positive control for the ERROR line counter --- PASS: TestMalformedCreateNamespaceIsNotLoggedAsError (0.00s) === RUN TestStatusRecorderFlushFollowsTheWrappedWriter --- PASS: TestStatusRecorderFlushFollowsTheWrappedWriter (0.00s) === RUN TestValidateMaintenanceValueAcceptsScopedTypes --- PASS: TestValidateMaintenanceValueAcceptsScopedTypes (0.00s) === RUN TestValidateMaintenanceValueRejectsWrongScope --- PASS: TestValidateMaintenanceValueRejectsWrongScope (0.00s) === RUN TestValidateMaintenanceValueRejectsBadInput === RUN TestValidateMaintenanceValueRejectsBadInput/no_status === RUN TestValidateMaintenanceValueRejectsBadInput/bad_status === RUN TestValidateMaintenanceValueRejectsBadInput/settings_for_another_type === RUN TestValidateMaintenanceValueRejectsBadInput/nil_value === RUN TestValidateMaintenanceValueRejectsBadInput/empty_type === RUN TestValidateMaintenanceValueRejectsBadInput/unknown_type --- PASS: TestValidateMaintenanceValueRejectsBadInput (0.00s) --- PASS: TestValidateMaintenanceValueRejectsBadInput/no_status (0.00s) --- PASS: TestValidateMaintenanceValueRejectsBadInput/bad_status (0.00s) --- PASS: TestValidateMaintenanceValueRejectsBadInput/settings_for_another_type (0.00s) --- PASS: TestValidateMaintenanceValueRejectsBadInput/nil_value (0.00s) --- PASS: TestValidateMaintenanceValueRejectsBadInput/empty_type (0.00s) --- PASS: TestValidateMaintenanceValueRejectsBadInput/unknown_type (0.00s) === RUN TestMaintenanceConfigurationRoundTrip --- PASS: TestMaintenanceConfigurationRoundTrip (0.00s) === RUN TestMaintenanceConfigurationMergeKeepsOtherTypes --- PASS: TestMaintenanceConfigurationMergeKeepsOtherTypes (0.00s) === RUN TestParseTableTarget === RUN TestParseTableTarget/missing_arn === RUN TestParseTableTarget/missing_namespace === RUN TestParseTableTarget/missing_name === RUN TestParseTableTarget/bad_arn --- PASS: TestParseTableTarget (0.00s) --- PASS: TestParseTableTarget/missing_arn (0.00s) --- PASS: TestParseTableTarget/missing_namespace (0.00s) --- PASS: TestParseTableTarget/missing_name (0.00s) --- PASS: TestParseTableTarget/bad_arn (0.00s) === RUN TestBuildJobStatusResponseReportsEveryType --- PASS: TestBuildJobStatusResponseReportsEveryType (0.00s) === RUN TestBuildJobStatusResponseDisabledBeatsRecorded --- PASS: TestBuildJobStatusResponseDisabledBeatsRecorded (0.00s) === RUN TestValidateMaintenanceValueCompactionStrategy --- PASS: TestValidateMaintenanceValueCompactionStrategy (0.00s) === RUN TestMaintenanceConfigurationPreservesStrategy --- PASS: TestMaintenanceConfigurationPreservesStrategy (0.00s) === RUN TestBuildJobStatusResponseHonoursBucketDisable --- PASS: TestBuildJobStatusResponseHonoursBucketDisable (0.00s) === RUN TestMergeMaintenanceConfiguration --- PASS: TestMergeMaintenanceConfiguration (0.00s) === RUN TestSnapshotExtendedCoversEveryAttribute --- PASS: TestSnapshotExtendedCoversEveryAttribute (0.00s) === RUN TestSnapshotExtendedAssertsAbsentMaintenanceKey --- PASS: TestSnapshotExtendedAssertsAbsentMaintenanceKey (0.00s) === RUN TestValidateMaintenanceSettingRange --- PASS: TestValidateMaintenanceSettingRange (0.00s) === RUN TestValidateMaintenanceSettingRangeCoversEveryField === RUN TestValidateMaintenanceSettingRangeCoversEveryField/minSnapshotsToKeep === RUN TestValidateMaintenanceSettingRangeCoversEveryField/maxSnapshotAgeHours === RUN TestValidateMaintenanceSettingRangeCoversEveryField/unreferencedDays === RUN TestValidateMaintenanceSettingRangeCoversEveryField/nonCurrentDays --- PASS: TestValidateMaintenanceSettingRangeCoversEveryField (0.00s) --- PASS: TestValidateMaintenanceSettingRangeCoversEveryField/minSnapshotsToKeep (0.00s) --- PASS: TestValidateMaintenanceSettingRangeCoversEveryField/maxSnapshotAgeHours (0.00s) --- PASS: TestValidateMaintenanceSettingRangeCoversEveryField/unreferencedDays (0.00s) --- PASS: TestValidateMaintenanceSettingRangeCoversEveryField/nonCurrentDays (0.00s) === RUN TestMaintenanceSettingsDistinguishZeroFromUnset --- PASS: TestMaintenanceSettingsDistinguishZeroFromUnset (0.00s) === RUN TestARNPartitionsBeyondCommercial --- PASS: TestARNPartitionsBeyondCommercial (0.00s) === RUN TestARNPartitionForRegion --- PASS: TestARNPartitionForRegion (0.00s) === RUN TestGeneratedARNsUseTheRegionPartition --- PASS: TestGeneratedARNsUseTheRegionPartition (0.00s) === RUN TestNameValidationAllowsHyphens --- PASS: TestNameValidationAllowsHyphens (0.00s) === RUN TestParseTableFromARNAllowsHyphens --- PASS: TestParseTableFromARNAllowsHyphens (0.00s) === RUN TestDeleteNamespaceKeepsRenamedTableData I1117 09:41:02.362434 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceKeepsRenamedTableData (0.28s) === RUN TestKeptDirectoryIsNoSuchNamespace I1117 09:41:02.645912 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestKeptDirectoryIsNoSuchNamespace/GetNamespace === RUN TestKeptDirectoryIsNoSuchNamespace/UpdateNamespace === RUN TestKeptDirectoryIsNoSuchNamespace/DeleteNamespace --- PASS: TestKeptDirectoryIsNoSuchNamespace (0.23s) --- PASS: TestKeptDirectoryIsNoSuchNamespace/GetNamespace (0.01s) --- PASS: TestKeptDirectoryIsNoSuchNamespace/UpdateNamespace (0.01s) --- PASS: TestKeptDirectoryIsNoSuchNamespace/DeleteNamespace (0.00s) === RUN TestDeleteNamespaceRemovesEmptyLeftovers I1117 09:41:02.883849 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceRemovesEmptyLeftovers (0.21s) === RUN TestDeleteNamespaceKeepsDeeplyNestedData I1117 09:41:03.095553 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceKeepsDeeplyNestedData (0.21s) === RUN TestDeleteNamespaceKeepsDataUnderAHiddenDirectory === RUN TestDeleteNamespaceKeepsDataUnderAHiddenDirectory/files_under_a_hidden_directory I1117 09:41:03.324102 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestDeleteNamespaceKeepsDataUnderAHiddenDirectory/only_empty_hidden_directories I1117 09:41:03.559125 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestDeleteNamespaceKeepsDataUnderAHiddenDirectory/a_hidden_file I1117 09:41:03.824713 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceKeepsDataUnderAHiddenDirectory (0.78s) --- PASS: TestDeleteNamespaceKeepsDataUnderAHiddenDirectory/files_under_a_hidden_directory (0.25s) --- PASS: TestDeleteNamespaceKeepsDataUnderAHiddenDirectory/only_empty_hidden_directories (0.27s) --- PASS: TestDeleteNamespaceKeepsDataUnderAHiddenDirectory/a_hidden_file (0.27s) === RUN TestDeleteNamespaceKeepsDataPastTheFirstListingPage === RUN TestDeleteNamespaceKeepsDataPastTheFirstListingPage/file_on_the_second_page I1117 09:41:04.123798 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestDeleteNamespaceKeepsDataPastTheFirstListingPage/file_under_a_directory_on_the_second_page I1117 09:41:04.563692 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceKeepsDataPastTheFirstListingPage (3.01s) --- PASS: TestDeleteNamespaceKeepsDataPastTheFirstListingPage/file_on_the_second_page (0.47s) --- PASS: TestDeleteNamespaceKeepsDataPastTheFirstListingPage/file_under_a_directory_on_the_second_page (2.53s) === RUN TestDirHoldsFilesEndsItsListings --- PASS: TestDirHoldsFilesEndsItsListings (0.02s) === RUN TestDeleteNamespaceWithTableIsStillNotEmpty --- PASS: TestDeleteNamespaceWithTableIsStillNotEmpty (0.04s) === RUN TestCreateNamespaceTakesBackAKeptDirectory I1117 09:41:07.149653 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] I1117 09:41:07.304876 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] I1117 09:41:07.431842 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceTakesBackAKeptDirectory (0.31s) === RUN TestCreateNamespaceDoesNotTagAFileThatReplacesTheDirectory I1117 09:41:07.459171 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] I1117 09:41:07.620188 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceDoesNotTagAFileThatReplacesTheDirectory (0.20s) === RUN TestDeleteNamespaceConflictsWhenTheKeptDirectoryVanishes I1117 09:41:07.661943 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceConflictsWhenTheKeptDirectoryVanishes (0.18s) === RUN TestDeleteNamespaceConflictsWhenItVanishesBeforeTheDelete I1117 09:41:07.842069 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestDeleteNamespaceConflictsWhenItVanishesBeforeTheDelete (0.20s) === RUN TestCreateNamespaceRefusesAFileInTheWay I1117 09:41:08.041411 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestCreateNamespaceRefusesAFileInTheWay (0.05s) === RUN TestLoadNamespaceMetadataTreatsMissingAttributeAsAbsent --- PASS: TestLoadNamespaceMetadataTreatsMissingAttributeAsAbsent (0.04s) === RUN TestNoTraceLoggedAtErrorLevel --- PASS: TestNoTraceLoggedAtErrorLevel (0.04s) === RUN TestCreateNamespaceOnAnOwnerlessBucket === RUN TestCreateNamespaceOnAnOwnerlessBucket/an_outsider_gets_the_denial_and_writes_nothing === RUN TestCreateNamespaceOnAnOwnerlessBucket/a_trusted_handler_repairs_it_and_owns_it I1117 09:41:08.207044 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=svc, owner=svc, actions=[Read] === RUN TestCreateNamespaceOnAnOwnerlessBucket/an_untrusted_admin_repairs_it_too I1117 09:41:08.255763 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=admin, actions=[Admin] --- PASS: TestCreateNamespaceOnAnOwnerlessBucket (0.12s) --- PASS: TestCreateNamespaceOnAnOwnerlessBucket/an_outsider_gets_the_denial_and_writes_nothing (0.02s) --- PASS: TestCreateNamespaceOnAnOwnerlessBucket/a_trusted_handler_repairs_it_and_owns_it (0.05s) --- PASS: TestCreateNamespaceOnAnOwnerlessBucket/an_untrusted_admin_repairs_it_too (0.04s) === RUN TestPutPolicyRejectsUnusableCondition --- PASS: TestPutPolicyRejectsUnusableCondition (0.04s) === RUN TestPutPolicyRejectsNullAllowCondition --- PASS: TestPutPolicyRejectsNullAllowCondition (0.02s) === RUN TestStoredKeylessAllowDoesNotGrant --- PASS: TestStoredKeylessAllowDoesNotGrant (0.05s) === RUN TestStoredUnusableConditionPolicyIsRecoverable W1117 09:41:08.413422 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:000000000000:bucket/denybkt" has a Deny condition that cannot be evaluated; denying s3tables:GetTableBucket for 000000000000 until the policy is replaced W1117 09:41:08.435083 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:000000000000:bucket/denybkt" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for 000000000000 until the policy is replaced W1117 09:41:08.443783 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:000000000000:bucket/denybkt" has a Deny condition that cannot be evaluated; denying s3tables:DeleteTableBucketPolicy for 000000000000 until the policy is replaced --- PASS: TestStoredUnusableConditionPolicyIsRecoverable (0.09s) === RUN TestTablePolicyDenyProtectsPolicyOps --- PASS: TestTablePolicyDenyProtectsPolicyOps (0.11s) === RUN TestTablePolicyDenyCoversTagAndMaintenanceOps --- PASS: TestTablePolicyDenyCoversTagAndMaintenanceOps (0.12s) === RUN TestTablePolicyDenyHonorsTagCondition === RUN TestTablePolicyDenyHonorsTagCondition/matching_tag === RUN TestTablePolicyDenyHonorsTagCondition/other_tag_value --- PASS: TestTablePolicyDenyHonorsTagCondition (0.13s) --- PASS: TestTablePolicyDenyHonorsTagCondition/matching_tag (0.06s) --- PASS: TestTablePolicyDenyHonorsTagCondition/other_tag_value (0.07s) === RUN TestBucketPolicyDenyVetoesPolicyReplacement --- PASS: TestBucketPolicyDenyVetoesPolicyReplacement (0.02s) === RUN TestGetAccountIDRejectsHeaderAdmin --- PASS: TestGetAccountIDRejectsHeaderAdmin (0.00s) === RUN TestGetAccountIDHeaderBranchResolvesCaller --- PASS: TestGetAccountIDHeaderBranchResolvesCaller (0.00s) === RUN TestPrincipalForMirrorsGetAccountID --- PASS: TestPrincipalForMirrorsGetAccountID (0.01s) === RUN TestCheckPermissionDenyPolicyBindsNonAdmin --- PASS: TestCheckPermissionDenyPolicyBindsNonAdmin (0.00s) === RUN TestRenameTablePreservesData --- PASS: TestRenameTablePreservesData (0.14s) === RUN TestRenameTableSourceMissing --- PASS: TestRenameTableSourceMissing (0.02s) === RUN TestRenameTableDestExists --- PASS: TestRenameTableDestExists (0.05s) === RUN TestRenameTableDestNamespaceMissing --- PASS: TestRenameTableDestNamespaceMissing (0.04s) === RUN TestRenameTableSourceDeletedMidRename --- PASS: TestRenameTableSourceDeletedMidRename (0.07s) === RUN TestRenameTableBacksOutConfirmedDest W1117 09:41:09.302027 handler_table.go:1767 rename /buckets/renamebkt/ns/t: release claim: filer: no entry is found in filer store --- PASS: TestRenameTableBacksOutConfirmedDest (0.10s) === RUN TestRenameTableDestNamespaceUnauthorized --- PASS: TestRenameTableDestNamespaceUnauthorized (0.05s) === RUN TestRenameTableInvalidName --- PASS: TestRenameTableInvalidName (0.02s) === RUN TestRenameTableCarriesMaintenanceConfiguration --- PASS: TestRenameTableCarriesMaintenanceConfiguration (0.10s) === RUN TestRenameTableRejectsConcurrentMaintenanceWrite --- PASS: TestRenameTableRejectsConcurrentMaintenanceWrite (0.01s) === RUN TestRenameTableVersionTokenMatches --- PASS: TestRenameTableVersionTokenMatches (0.11s) === RUN TestRenameTableVersionTokenMismatch --- PASS: TestRenameTableVersionTokenMismatch (0.07s) === RUN TestRenameTableVersionTokenCheckedAgainstClaimedSnapshot --- PASS: TestRenameTableVersionTokenCheckedAgainstClaimedSnapshot (0.10s) === RUN TestRenameTableRefusesSourceChangedBetweenReads --- PASS: TestRenameTableRefusesSourceChangedBetweenReads (0.12s) === RUN TestRenameReadsMatchSnapshot === RUN TestRenameReadsMatchSnapshot/unchanged === RUN TestRenameReadsMatchSnapshot/policy_changed === RUN TestRenameReadsMatchSnapshot/policy_removed === RUN TestRenameReadsMatchSnapshot/tag_value_changed === RUN TestRenameReadsMatchSnapshot/tags_removed --- PASS: TestRenameReadsMatchSnapshot (0.01s) --- PASS: TestRenameReadsMatchSnapshot/unchanged (0.00s) --- PASS: TestRenameReadsMatchSnapshot/policy_changed (0.00s) --- PASS: TestRenameReadsMatchSnapshot/policy_removed (0.00s) --- PASS: TestRenameReadsMatchSnapshot/tag_value_changed (0.00s) --- PASS: TestRenameReadsMatchSnapshot/tags_removed (0.00s) === RUN TestRenamedAwayNameIsNoSuchTable I1117 09:41:09.922688 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] === RUN TestRenamedAwayNameIsNoSuchTable/UpdateTable === RUN TestRenamedAwayNameIsNoSuchTable/DeleteTable === RUN TestRenamedAwayNameIsNoSuchTable/PutTablePolicy === RUN TestRenamedAwayNameIsNoSuchTable/GetTablePolicy === RUN TestRenamedAwayNameIsNoSuchTable/DeleteTablePolicy === RUN TestRenamedAwayNameIsNoSuchTable/PutTableMaintenanceConfiguration === RUN TestRenamedAwayNameIsNoSuchTable/GetTableMaintenanceConfiguration === RUN TestRenamedAwayNameIsNoSuchTable/GetTableMaintenanceJobStatus --- PASS: TestRenamedAwayNameIsNoSuchTable (0.19s) --- PASS: TestRenamedAwayNameIsNoSuchTable/UpdateTable (0.00s) --- PASS: TestRenamedAwayNameIsNoSuchTable/DeleteTable (0.00s) --- PASS: TestRenamedAwayNameIsNoSuchTable/PutTablePolicy (0.01s) --- PASS: TestRenamedAwayNameIsNoSuchTable/GetTablePolicy (0.00s) --- PASS: TestRenamedAwayNameIsNoSuchTable/DeleteTablePolicy (0.00s) --- PASS: TestRenamedAwayNameIsNoSuchTable/PutTableMaintenanceConfiguration (0.00s) --- PASS: TestRenamedAwayNameIsNoSuchTable/GetTableMaintenanceConfiguration (0.00s) --- PASS: TestRenamedAwayNameIsNoSuchTable/GetTableMaintenanceJobStatus (0.00s) === RUN TestRenamedAwayViewNameIsNoSuchView === RUN TestRenamedAwayViewNameIsNoSuchView/GetView === RUN TestRenamedAwayViewNameIsNoSuchView/UpdateView === RUN TestRenamedAwayViewNameIsNoSuchView/DeleteView --- PASS: TestRenamedAwayViewNameIsNoSuchView (0.12s) --- PASS: TestRenamedAwayViewNameIsNoSuchView/GetView (0.00s) --- PASS: TestRenamedAwayViewNameIsNoSuchView/UpdateView (0.00s) --- PASS: TestRenamedAwayViewNameIsNoSuchView/DeleteView (0.00s) === RUN TestViewRecordWithoutMetadataIsNoSuchView === RUN TestViewRecordWithoutMetadataIsNoSuchView/GetView === RUN TestViewRecordWithoutMetadataIsNoSuchView/UpdateView === RUN TestViewRecordWithoutMetadataIsNoSuchView/DeleteView --- PASS: TestViewRecordWithoutMetadataIsNoSuchView (0.03s) --- PASS: TestViewRecordWithoutMetadataIsNoSuchView/GetView (0.00s) --- PASS: TestViewRecordWithoutMetadataIsNoSuchView/UpdateView (0.00s) --- PASS: TestViewRecordWithoutMetadataIsNoSuchView/DeleteView (0.01s) === RUN TestMutateCatalogRecordRefusesClearedRecord --- PASS: TestMutateCatalogRecordRefusesClearedRecord (0.02s) === RUN TestSTSSessionKeepsLegacySubjectOwnedBucket I1117 09:41:10.292623 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=project_path:dev/infra/datalake/normalisation:ref_type:branch:ref:main, actions=[] I1117 09:41:10.329278 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=project_path:dev/infra/datalake/normalisation:ref_type:branch:ref:main, actions=[] I1117 09:41:10.329695 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=project_path:dev/infra/datalake/normalisation:ref_type:branch:ref:main I1117 09:41:10.354513 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=project_path:dev/infra/datalake/normalisation:ref_type:branch:ref:main, actions=[] I1117 09:41:10.354882 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=project_path:dev/infra/datalake/normalisation:ref_type:branch:ref:main I1117 09:41:10.375006 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=Srp4Ll98rmzaw07tH-YrKdWR7cDD34OOpeXKmWmkCwA, owner=project_path:dev/infra/datalake/normalisation:ref_type:branch:ref:main, actions=[] I1117 09:41:10.375483 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=Srp4Ll98rmzaw07tH-YrKdWR7cDD34OOpeXKmWmkCwA, owner=project_path:dev/infra/datalake/normalisation:ref_type:branch:ref:main --- PASS: TestSTSSessionKeepsLegacySubjectOwnedBucket (0.12s) === RUN TestTrustedIssuersSourceOnlyForFederatedSessions --- PASS: TestTrustedIssuersSourceOnlyForFederatedSessions (0.00s) === RUN TestSTSSessionMatchesLegacySubjectPatternPrincipal I1117 09:41:10.410335 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=admin, actions=[] I1117 09:41:10.452962 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=admin, actions=[] I1117 09:41:10.500385 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=admin, actions=[] I1117 09:41:10.503522 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=admin I1117 09:41:10.525703 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=admin, actions=[] I1117 09:41:10.528580 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=admin I1117 09:41:10.549092 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=Srp4Ll98rmzaw07tH-YrKdWR7cDD34OOpeXKmWmkCwA, owner=admin, actions=[] I1117 09:41:10.552100 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=Srp4Ll98rmzaw07tH-YrKdWR7cDD34OOpeXKmWmkCwA, owner=admin I1117 09:41:10.573878 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=wTlM99JbdBhrsRsj4EKMFL2J4OA9pYjrw-_JeUZqdfE, owner=admin, actions=[] I1117 09:41:10.577163 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=wTlM99JbdBhrsRsj4EKMFL2J4OA9pYjrw-_JeUZqdfE, owner=admin I1117 09:41:10.597317 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=admin, actions=[] I1117 09:41:10.600850 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=F_PRIw5aOLKFfH6RIVH1fig7HwB5bQN4XM9vhIdC7Fg, owner=admin --- PASS: TestSTSSessionMatchesLegacySubjectPatternPrincipal (0.23s) === RUN TestMetadataVersionFromLocation --- PASS: TestMetadataVersionFromLocation (0.00s) === RUN TestRegisterTableStoresMetadata --- PASS: TestRegisterTableStoresMetadata (0.11s) === RUN TestUpdateTableClearsFullMetadata --- PASS: TestUpdateTableClearsFullMetadata (0.15s) === RUN TestUpdateAfterRenameAcrossNamespacesKeepsItsDirectory --- PASS: TestUpdateAfterRenameAcrossNamespacesKeepsItsDirectory (0.18s) === RUN TestUpdateAfterRenameAcrossNamespacesRefusesOtherDirectoriesOfTheOldNamespace --- PASS: TestUpdateAfterRenameAcrossNamespacesRefusesOtherDirectoriesOfTheOldNamespace (0.13s) === RUN TestUpdateAfterRenameAcrossNamespacesRefusesAnotherTablesDirectory --- PASS: TestUpdateAfterRenameAcrossNamespacesRefusesAnotherTablesDirectory (0.29s) === RUN TestUpdateAfterRenameAcrossNamespacesKeepsItsDirectoryUnderANewTableOfTheOldName --- PASS: TestUpdateAfterRenameAcrossNamespacesKeepsItsDirectoryUnderANewTableOfTheOldName (0.17s) === RUN TestUpdateRefusesADirectoryOutsideTheNamespaceThatAnotherTableShares --- PASS: TestUpdateRefusesADirectoryOutsideTheNamespaceThatAnotherTableShares (0.06s) === RUN TestUpdateAfterRenameAcrossNamespacesMayMoveIntoItsNamespace --- PASS: TestUpdateAfterRenameAcrossNamespacesMayMoveIntoItsNamespace (0.18s) === RUN TestUpdateStillConfinesAMoveToTheTablesNamespace --- PASS: TestUpdateStillConfinesAMoveToTheTablesNamespace (0.04s) === RUN TestUpdateLocationIsCheckedAfterAuthorization --- PASS: TestUpdateLocationIsCheckedAfterAuthorization (0.13s) === RUN TestUpdateViewAfterRenameAcrossNamespacesKeepsItsDirectory --- PASS: TestUpdateViewAfterRenameAcrossNamespacesKeepsItsDirectory (0.16s) === RUN TestUpdateViewAfterRenameAcrossNamespacesRefusesOtherDirectories --- PASS: TestUpdateViewAfterRenameAcrossNamespacesRefusesOtherDirectories (0.13s) === RUN TestUpdateRefusesAMetadataDirectoryAtTheBucketRoot === RUN TestUpdateRefusesAMetadataDirectoryAtTheBucketRoot/table_created_without_a_location === RUN TestUpdateRefusesAMetadataDirectoryAtTheBucketRoot/table_stored_at_its_name_path === RUN TestUpdateRefusesAMetadataDirectoryAtTheBucketRoot/view --- PASS: TestUpdateRefusesAMetadataDirectoryAtTheBucketRoot (0.15s) --- PASS: TestUpdateRefusesAMetadataDirectoryAtTheBucketRoot/table_created_without_a_location (0.09s) --- PASS: TestUpdateRefusesAMetadataDirectoryAtTheBucketRoot/table_stored_at_its_name_path (0.03s) --- PASS: TestUpdateRefusesAMetadataDirectoryAtTheBucketRoot/view (0.03s) === RUN TestUpdateOfATableCreatedWithoutALocationWritesItsWarehouse --- PASS: TestUpdateOfATableCreatedWithoutALocationWritesItsWarehouse (0.24s) === RUN TestUpdateTableRejectsLostUpdate --- PASS: TestUpdateTableRejectsLostUpdate (0.05s) === RUN TestUpdateTableRejectsWhenTheAuthorizingPolicyChanges --- PASS: TestUpdateTableRejectsWhenTheAuthorizingPolicyChanges (0.04s) === RUN TestUpdateTableAppliesWithoutContention --- PASS: TestUpdateTableAppliesWithoutContention (0.05s) === RUN TestUpdateViewClaimedRecordConflicts --- PASS: TestUpdateViewClaimedRecordConflicts (0.03s) === RUN TestTagResourceClaimedRecordConflicts --- PASS: TestTagResourceClaimedRecordConflicts (0.03s) === RUN TestUntagResourceClaimedRecordConflicts --- PASS: TestUntagResourceClaimedRecordConflicts (0.03s) === RUN TestDeleteTablePolicyClaimedRecordConflicts --- PASS: TestDeleteTablePolicyClaimedRecordConflicts (0.04s) === RUN TestRenameViewMovesCatalogPointer --- PASS: TestRenameViewMovesCatalogPointer (0.11s) === RUN TestRenameViewSourceDeletedMidRename --- PASS: TestRenameViewSourceDeletedMidRename (0.07s) === RUN TestRenameViewRejectsTable --- PASS: TestRenameViewRejectsTable (0.05s) === RUN TestRenameTableRejectsView --- PASS: TestRenameTableRejectsView (0.05s) === RUN TestRenameViewAuthorizesAgainstTheViewARN --- PASS: TestRenameViewAuthorizesAgainstTheViewARN (0.15s) === RUN TestEntryType === RUN TestEntryType/nil_extended_is_table === RUN TestEntryType/absent_marker_is_table === RUN TestEntryType/empty_marker_is_table === RUN TestEntryType/table_marker === RUN TestEntryType/view_marker --- PASS: TestEntryType (0.00s) --- PASS: TestEntryType/nil_extended_is_table (0.00s) --- PASS: TestEntryType/absent_marker_is_table (0.00s) --- PASS: TestEntryType/empty_marker_is_table (0.00s) --- PASS: TestEntryType/table_marker (0.00s) --- PASS: TestEntryType/view_marker (0.00s) === RUN TestGenerateViewARN --- PASS: TestGenerateViewARN (0.00s) === RUN TestCreateTableWithoutLocationGetsItsOwnDirectory --- PASS: TestCreateTableWithoutLocationGetsItsOwnDirectory (0.33s) === RUN TestCreateLanceTableWithoutLocationKeepsItsPath --- PASS: TestCreateLanceTableWithoutLocationKeepsItsPath (0.10s) === RUN TestRecordWithoutWarehouseLocationKeepsItsPath --- PASS: TestRecordWithoutWarehouseLocationKeepsItsPath (0.11s) === RUN TestFirstCommitIntoWarehouseLocationKeepsTheRoot --- PASS: TestFirstCommitIntoWarehouseLocationKeepsTheRoot (0.12s) === RUN TestBackedOutCreateRemovesItsDirectory I1117 09:41:14.155944 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=000000000000, actions=[] --- PASS: TestBackedOutCreateRemovesItsDirectory (0.13s) === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/flink-style_manifest_(job-id_+_checkpoint_+_operator-id_+_counter) === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/spark-style_manifest_with_two_uuids_and_-m_suffix === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/snapshot_manifest_list_with_iceberg-internal_naming === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/versioned_table_metadata === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/uuid-named_metadata_json_(newer_iceberg) === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/flink-style_metadata_json_with_dashes_and_digits === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/version_hint === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/trino/iceberg_stats_file === RUN TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/puffin_statistics_file --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames (0.01s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/flink-style_manifest_(job-id_+_checkpoint_+_operator-id_+_counter) (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/spark-style_manifest_with_two_uuids_and_-m_suffix (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/snapshot_manifest_list_with_iceberg-internal_naming (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/versioned_table_metadata (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/uuid-named_metadata_json_(newer_iceberg) (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/flink-style_metadata_json_with_dashes_and_digits (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/version_hint (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/trino/iceberg_stats_file (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldManifestNames/puffin_statistics_file (0.00s) === RUN TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames === RUN TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/random_extension === RUN TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/executable_masquerading_as_avro_path === RUN TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/subdirectory_under_metadata_is_not_allowed === RUN TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/top-level_dir_other_than_metadata_or_data === RUN TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/catch-all_anchors_must_reject_trailing_extension === RUN TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/puffin_with_a_trailing_extension === RUN TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/puffin_in_a_subdirectory_under_metadata --- PASS: TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames (0.00s) --- PASS: TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/random_extension (0.00s) --- PASS: TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/executable_masquerading_as_avro_path (0.00s) --- PASS: TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/subdirectory_under_metadata_is_not_allowed (0.00s) --- PASS: TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/top-level_dir_other_than_metadata_or_data (0.00s) --- PASS: TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/catch-all_anchors_must_reject_trailing_extension (0.00s) --- PASS: TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/puffin_with_a_trailing_extension (0.00s) --- PASS: TestIcebergLayoutValidator_RejectsClearlyBadMetadataNames/puffin_in_a_subdirectory_under_metadata (0.00s) === RUN TestIcebergLayoutValidator_AcceptsRealWorldDataFiles === RUN TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/00000-0-ede83b82-08e1-40cd-af8a-6d83680a5194-00001.parquet === RUN TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/part-00000.parquet === RUN TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/some-file.orc === RUN TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/year=2026/month=05/00000-0-uuid.parquet === RUN TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/00000-2-c56b1e21-828c-40ad-8f7b-739c6cb82dcf-00001-deletes.puffin === RUN TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/82e3eec4-3aee-414f-a444-94c03c641d20-deletes.puffin === RUN TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/year=2026/month=05/00000-2-c56b1e21-828c-40ad-8f7b-739c6cb82dcf-00001-deletes.puffin --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldDataFiles (0.01s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/00000-0-ede83b82-08e1-40cd-af8a-6d83680a5194-00001.parquet (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/part-00000.parquet (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/some-file.orc (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/year=2026/month=05/00000-0-uuid.parquet (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/00000-2-c56b1e21-828c-40ad-8f7b-739c6cb82dcf-00001-deletes.puffin (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/82e3eec4-3aee-414f-a444-94c03c641d20-deletes.puffin (0.00s) --- PASS: TestIcebergLayoutValidator_AcceptsRealWorldDataFiles/data/year=2026/month=05/00000-2-c56b1e21-828c-40ad-8f7b-739c6cb82dcf-00001-deletes.puffin (0.00s) === RUN TestValidateFilePathAcceptsLanceLayout --- PASS: TestValidateFilePathAcceptsLanceLayout (0.00s) === RUN TestTableBucketFileValidator_PuffinStatisticsOnlyInTableMetadata --- PASS: TestTableBucketFileValidator_PuffinStatisticsOnlyInTableMetadata (0.00s) === RUN TestReadManifestListWithoutFormatVersion --- PASS: TestReadManifestListWithoutFormatVersion (0.06s) === RUN TestReadManifestListKeepsWrittenFormatVersion --- PASS: TestReadManifestListKeepsWrittenFormatVersion (0.05s) === RUN TestReadManifestListWithoutFormatVersionStaysV1 --- PASS: TestReadManifestListWithoutFormatVersionStaysV1 (0.04s) === RUN TestReadManifestListRejectsNonAvro --- PASS: TestReadManifestListRejectsNonAvro (0.01s) === RUN TestManifestListFormatVersion === RUN TestManifestListFormatVersion/v1_fields === RUN TestManifestListFormatVersion/v2_adds_content === RUN TestManifestListFormatVersion/v2_adds_sequence_numbers === RUN TestManifestListFormatVersion/v3_adds_first_row_id === RUN TestManifestListFormatVersion/v3_field_ordering === RUN TestManifestListFormatVersion/unparseable_schema === RUN TestManifestListFormatVersion/missing_schema --- PASS: TestManifestListFormatVersion (0.01s) --- PASS: TestManifestListFormatVersion/v1_fields (0.00s) --- PASS: TestManifestListFormatVersion/v2_adds_content (0.00s) --- PASS: TestManifestListFormatVersion/v2_adds_sequence_numbers (0.00s) --- PASS: TestManifestListFormatVersion/v3_adds_first_row_id (0.00s) --- PASS: TestManifestListFormatVersion/v3_field_ordering (0.00s) --- PASS: TestManifestListFormatVersion/unparseable_schema (0.00s) --- PASS: TestManifestListFormatVersion/missing_schema (0.00s) === RUN TestReadManifestNormalizesForeignPartitions === RUN TestReadManifestNormalizesForeignPartitions/day_transform_written_null-first_converts_on_read === RUN TestReadManifestNormalizesForeignPartitions/day_transform_on_a_timestamp_column === RUN TestReadManifestNormalizesForeignPartitions/identity_transform_on_a_date_column === RUN TestReadManifestNormalizesForeignPartitions/identity_transform_on_a_timestamp_column === RUN TestReadManifestNormalizesForeignPartitions/identity_transform_on_a_time_column --- PASS: TestReadManifestNormalizesForeignPartitions (0.96s) --- PASS: TestReadManifestNormalizesForeignPartitions/day_transform_written_null-first_converts_on_read (0.20s) --- PASS: TestReadManifestNormalizesForeignPartitions/day_transform_on_a_timestamp_column (0.20s) --- PASS: TestReadManifestNormalizesForeignPartitions/identity_transform_on_a_date_column (0.19s) --- PASS: TestReadManifestNormalizesForeignPartitions/identity_transform_on_a_timestamp_column (0.18s) --- PASS: TestReadManifestNormalizesForeignPartitions/identity_transform_on_a_time_column (0.19s) === RUN TestReadManifestUnknownSpec --- PASS: TestReadManifestUnknownSpec (0.11s) === RUN TestReadManifestConvertsBeforeTheWriterRebindsLogicalTypes --- PASS: TestReadManifestConvertsBeforeTheWriterRebindsLogicalTypes (0.24s) === RUN TestReadManifestRebuiltEntryPreservesV1BlockSizeDefault --- PASS: TestReadManifestRebuiltEntryPreservesV1BlockSizeDefault (0.19s) === RUN TestManagerCreateTableBucketAuthorization === RUN TestManagerCreateTableBucketAuthorization/authenticated_identity_struct_is_enforced === RUN TestManagerCreateTableBucketAuthorization/secured_manager_denies_a_name_without_struct === RUN TestManagerCreateTableBucketAuthorization/untrusted_name_without_struct_is_enforced === RUN TestManagerCreateTableBucketAuthorization/trusted_manager_allows_a_name_without_struct E1117 09:41:15.994809 handler_bucket_create.go:125 S3Tables: failed to check bucket existence: filer reached E1117 09:41:15.995683 handler.go:287 S3Tables: error handling CreateTableBucket: filer reached === RUN TestManagerCreateTableBucketAuthorization/admin_principal_is_allowed E1117 09:41:15.999265 handler_bucket_create.go:125 S3Tables: failed to check bucket existence: filer reached E1117 09:41:16.000016 handler.go:287 S3Tables: error handling CreateTableBucket: filer reached --- PASS: TestManagerCreateTableBucketAuthorization (0.02s) --- PASS: TestManagerCreateTableBucketAuthorization/authenticated_identity_struct_is_enforced (0.00s) --- PASS: TestManagerCreateTableBucketAuthorization/secured_manager_denies_a_name_without_struct (0.01s) --- PASS: TestManagerCreateTableBucketAuthorization/untrusted_name_without_struct_is_enforced (0.00s) --- PASS: TestManagerCreateTableBucketAuthorization/trusted_manager_allows_a_name_without_struct (0.00s) --- PASS: TestManagerCreateTableBucketAuthorization/admin_principal_is_allowed (0.00s) === RUN TestManagerCreateTableBucketRejectsCustomerKeys === RUN TestManagerCreateTableBucketRejectsCustomerKeys/no_configuration E1117 09:41:16.003617 handler_bucket_create.go:125 S3Tables: failed to check bucket existence: filer reached E1117 09:41:16.004230 handler.go:287 S3Tables: error handling CreateTableBucket: filer reached === RUN TestManagerCreateTableBucketRejectsCustomerKeys/tables_default_sse E1117 09:41:16.006671 handler_bucket_create.go:125 S3Tables: failed to check bucket existence: filer reached E1117 09:41:16.007218 handler.go:287 S3Tables: error handling CreateTableBucket: filer reached === RUN TestManagerCreateTableBucketRejectsCustomerKeys/vector_wire_name === RUN TestManagerCreateTableBucketRejectsCustomerKeys/unknown_sse === RUN TestManagerCreateTableBucketRejectsCustomerKeys/tables_kms === RUN TestManagerCreateTableBucketRejectsCustomerKeys/conflicting_types === RUN TestManagerCreateTableBucketRejectsCustomerKeys/missing_algorithm === RUN TestManagerCreateTableBucketRejectsCustomerKeys/customer_key === RUN TestManagerCreateTableBucketRejectsCustomerKeys/key_without_a_type === RUN TestManagerCreateTableBucketRejectsCustomerKeys/key_on_default_sse --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys (0.02s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/no_configuration (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/tables_default_sse (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/vector_wire_name (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/unknown_sse (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/tables_kms (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/conflicting_types (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/missing_algorithm (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/customer_key (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/key_without_a_type (0.00s) --- PASS: TestManagerCreateTableBucketRejectsCustomerKeys/key_on_default_sse (0.00s) === RUN TestMatchesActionPattern === RUN TestMatchesActionPattern/exact_match === RUN TestMatchesActionPattern/no_match === RUN TestMatchesActionPattern/universal_wildcard === RUN TestMatchesActionPattern/suffix_wildcard_match === RUN TestMatchesActionPattern/suffix_wildcard_no_match === RUN TestMatchesActionPattern/middle_wildcard_Get*Table === RUN TestMatchesActionPattern/middle_wildcard_Get*Table_no_match_GetTableBucket === RUN TestMatchesActionPattern/middle_wildcard_Get*Table_no_match_DeleteTable === RUN TestMatchesActionPattern/middle_wildcard_*Table* === RUN TestMatchesActionPattern/middle_wildcard_*Table*_match_CreateTable === RUN TestMatchesActionPattern/question_mark_single_char === RUN TestMatchesActionPattern/question_mark_no_match === RUN TestMatchesActionPattern/combined_*_and_?_singular === RUN TestMatchesActionPattern/combined_*_and_?_plural === RUN TestMatchesActionPattern/combined_no_match_-_?_needs_1_char --- PASS: TestMatchesActionPattern (0.01s) --- PASS: TestMatchesActionPattern/exact_match (0.00s) --- PASS: TestMatchesActionPattern/no_match (0.00s) --- PASS: TestMatchesActionPattern/universal_wildcard (0.00s) --- PASS: TestMatchesActionPattern/suffix_wildcard_match (0.00s) --- PASS: TestMatchesActionPattern/suffix_wildcard_no_match (0.00s) --- PASS: TestMatchesActionPattern/middle_wildcard_Get*Table (0.00s) --- PASS: TestMatchesActionPattern/middle_wildcard_Get*Table_no_match_GetTableBucket (0.00s) --- PASS: TestMatchesActionPattern/middle_wildcard_Get*Table_no_match_DeleteTable (0.00s) --- PASS: TestMatchesActionPattern/middle_wildcard_*Table* (0.00s) --- PASS: TestMatchesActionPattern/middle_wildcard_*Table*_match_CreateTable (0.00s) --- PASS: TestMatchesActionPattern/question_mark_single_char (0.00s) --- PASS: TestMatchesActionPattern/question_mark_no_match (0.00s) --- PASS: TestMatchesActionPattern/combined_*_and_?_singular (0.00s) --- PASS: TestMatchesActionPattern/combined_*_and_?_plural (0.00s) --- PASS: TestMatchesActionPattern/combined_no_match_-_?_needs_1_char (0.00s) === RUN TestMatchesPrincipal === RUN TestMatchesPrincipal/exact_match === RUN TestMatchesPrincipal/no_match === RUN TestMatchesPrincipal/universal_wildcard === RUN TestMatchesPrincipal/prefix_wildcard === RUN TestMatchesPrincipal/prefix_wildcard_no_match === RUN TestMatchesPrincipal/middle_wildcard === RUN TestMatchesPrincipal/array_match_first === RUN TestMatchesPrincipal/array_match_second === RUN TestMatchesPrincipal/array_no_match === RUN TestMatchesPrincipal/array_wildcard === RUN TestMatchesPrincipal/AWS_map_exact === RUN TestMatchesPrincipal/AWS_map_wildcard === RUN TestMatchesPrincipal/AWS_map_array === RUN TestMatchesPrincipal/arn_spec_exact_caller === RUN TestMatchesPrincipal/arn_spec_wildcard_caller === RUN TestMatchesPrincipal/arn_spec_no_match === RUN TestMatchesPrincipal/nil_principal --- PASS: TestMatchesPrincipal (0.01s) --- PASS: TestMatchesPrincipal/exact_match (0.00s) --- PASS: TestMatchesPrincipal/no_match (0.00s) --- PASS: TestMatchesPrincipal/universal_wildcard (0.00s) --- PASS: TestMatchesPrincipal/prefix_wildcard (0.00s) --- PASS: TestMatchesPrincipal/prefix_wildcard_no_match (0.00s) --- PASS: TestMatchesPrincipal/middle_wildcard (0.00s) --- PASS: TestMatchesPrincipal/array_match_first (0.00s) --- PASS: TestMatchesPrincipal/array_match_second (0.00s) --- PASS: TestMatchesPrincipal/array_no_match (0.00s) --- PASS: TestMatchesPrincipal/array_wildcard (0.00s) --- PASS: TestMatchesPrincipal/AWS_map_exact (0.00s) --- PASS: TestMatchesPrincipal/AWS_map_wildcard (0.00s) --- PASS: TestMatchesPrincipal/AWS_map_array (0.00s) --- PASS: TestMatchesPrincipal/arn_spec_exact_caller (0.00s) --- PASS: TestMatchesPrincipal/arn_spec_wildcard_caller (0.00s) --- PASS: TestMatchesPrincipal/arn_spec_no_match (0.00s) --- PASS: TestMatchesPrincipal/nil_principal (0.00s) === RUN TestEvaluatePolicyWithConditions === RUN TestEvaluatePolicyWithConditions/all_conditions_match === RUN TestEvaluatePolicyWithConditions/namespace_mismatch === RUN TestEvaluatePolicyWithConditions/table_name_mismatch === RUN TestEvaluatePolicyWithConditions/numeric_condition_failure === RUN TestEvaluatePolicyWithConditions/bool_condition_failure --- PASS: TestEvaluatePolicyWithConditions (0.03s) --- PASS: TestEvaluatePolicyWithConditions/all_conditions_match (0.00s) --- PASS: TestEvaluatePolicyWithConditions/namespace_mismatch (0.00s) --- PASS: TestEvaluatePolicyWithConditions/table_name_mismatch (0.00s) --- PASS: TestEvaluatePolicyWithConditions/numeric_condition_failure (0.00s) --- PASS: TestEvaluatePolicyWithConditions/bool_condition_failure (0.00s) === RUN TestCheckPermissionWithDefaultAllow === RUN TestCheckPermissionWithDefaultAllow/default_deny_(no_policy,_DefaultAllow=false) === RUN TestCheckPermissionWithDefaultAllow/default_allow_(no_policy,_DefaultAllow=true) === RUN TestCheckPermissionWithDefaultAllow/explicit_deny_overrides_DefaultAllow=true === RUN TestCheckPermissionWithDefaultAllow/explicit_allow_works_with_DefaultAllow=false --- PASS: TestCheckPermissionWithDefaultAllow (0.00s) --- PASS: TestCheckPermissionWithDefaultAllow/default_deny_(no_policy,_DefaultAllow=false) (0.00s) --- PASS: TestCheckPermissionWithDefaultAllow/default_allow_(no_policy,_DefaultAllow=true) (0.00s) --- PASS: TestCheckPermissionWithDefaultAllow/explicit_deny_overrides_DefaultAllow=true (0.00s) --- PASS: TestCheckPermissionWithDefaultAllow/explicit_allow_works_with_DefaultAllow=false (0.00s) === RUN TestCheckTableOrBucketPermissionDenyVeto --- PASS: TestCheckTableOrBucketPermissionDenyVeto (0.01s) === RUN TestCheckPermissionAdminRequiresAdminAction --- PASS: TestCheckPermissionAdminRequiresAdminAction (0.00s) === RUN TestCheckTableOrBucketPermissionOwnerlessFailsClosed --- PASS: TestCheckTableOrBucketPermissionOwnerlessFailsClosed (0.00s) === RUN TestCheckPermissionLegacyOwnerScopedToIssuer --- PASS: TestCheckPermissionLegacyOwnerScopedToIssuer (0.00s) === RUN TestCheckPermissionLegacyOwnerExcludesLocalAndScoped --- PASS: TestCheckPermissionLegacyOwnerExcludesLocalAndScoped (0.00s) === RUN TestCheckPermissionLegacyPolicyPrincipalShapes --- PASS: TestCheckPermissionLegacyPolicyPrincipalShapes (0.00s) === RUN TestValidatePolicyDocument --- PASS: TestValidatePolicyDocument (0.08s) === RUN TestConditionValue --- PASS: TestConditionValue (0.01s) === RUN TestConditionValueCoversEveryOperator --- PASS: TestConditionValueCoversEveryOperator (0.09s) === RUN TestUnreadableConditionDenyApplies W1117 09:41:16.286312 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:acct:bucket/b" has a Deny condition that cannot be evaluated; denying s3tables:GetTableBucket for owner until the policy is replaced W1117 09:41:16.288734 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:acct:bucket/b" has a Deny condition that cannot be evaluated; denying s3tables:GetTableBucket for owner until the policy is replaced W1117 09:41:16.290389 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:acct:bucket/b" has a Deny condition that cannot be evaluated; denying s3tables:GetTableBucket for owner until the policy is replaced W1117 09:41:16.292295 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:acct:bucket/b" has a Deny condition that cannot be evaluated; denying s3tables:GetTableBucket for owner until the policy is replaced --- PASS: TestUnreadableConditionDenyApplies (0.01s) === RUN TestNullConditionDoesNotPanic W1117 09:41:16.294916 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:acct:bucket/b" has a Deny condition that cannot be evaluated; denying s3tables:GetTableBucket for owner until the policy is replaced W1117 09:41:16.296424 permissions.go:394 S3Tables: policy on "arn:aws:s3tables:us-east-1:acct:bucket/b" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced --- PASS: TestNullConditionDoesNotPanic (0.00s) === RUN TestUnusableConditionAllowNeverGrants --- PASS: TestUnusableConditionAllowNeverGrants (0.02s) === RUN TestStoredNullConditionAllowNeverGrants --- PASS: TestStoredNullConditionAllowNeverGrants (0.01s) === RUN TestConditionSplitAcrossSpellings W1117 09:41:16.339556 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.346645 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.352637 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.358974 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.365350 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.371589 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.377098 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.382437 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced --- PASS: TestConditionSplitAcrossSpellings (0.06s) === RUN TestStatementFieldSpellingsDecodeAsBefore --- PASS: TestStatementFieldSpellingsDecodeAsBefore (0.00s) === RUN TestUnsupportedOperatorDenyApplies W1117 09:41:16.392240 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced --- PASS: TestUnsupportedOperatorDenyApplies (0.00s) === RUN TestUnusableConditionIgnoresMapOrder W1117 09:41:16.394717 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.396347 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.397842 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.399038 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.400203 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.401426 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.402653 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.403819 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.404984 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.406127 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.407295 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.408423 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.409727 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.410997 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.412192 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.413356 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.414609 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.415809 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.417133 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.418323 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.419571 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.420800 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.422065 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.423264 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.424469 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.425663 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.426936 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.428142 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.429376 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.430596 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.431834 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.433022 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.434463 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.435806 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.437832 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.439297 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.440769 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.442201 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.443574 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.444940 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.446304 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.447611 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.449018 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.450515 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.451880 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.453324 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.454708 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.456060 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.457534 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.458953 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.460350 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.461686 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.463153 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.464569 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.465994 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.467316 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.468757 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.470231 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.471602 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.472949 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.474376 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.475806 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.477410 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced W1117 09:41:16.478735 permissions.go:394 S3Tables: policy on "" has a Deny condition that cannot be evaluated; denying s3tables:GetTable for owner until the policy is replaced --- PASS: TestUnusableConditionIgnoresMapOrder (0.09s) === RUN TestArnScopedPrincipalMatchesOnlyForDeny --- PASS: TestArnScopedPrincipalMatchesOnlyForDeny (0.00s) === RUN TestServiceWildcardScopesToOwnService --- PASS: TestServiceWildcardScopesToOwnService (0.00s) === RUN TestBucketTagConditionKeys --- PASS: TestBucketTagConditionKeys (0.00s) === RUN TestValidatePolicyDocumentRejectsVectorServiceInAnyCase --- PASS: TestValidatePolicyDocumentRejectsVectorServiceInAnyCase (0.00s) === RUN TestTableDataDirFromMetadataLocation --- PASS: TestTableDataDirFromMetadataLocation (0.00s) === RUN TestMetadataVersionFromLocationUniqueSuffix --- PASS: TestMetadataVersionFromLocationUniqueSuffix (0.00s) === RUN TestValidateMetadataLocation === RUN TestValidateMetadataLocation/empty_allowed === RUN TestValidateMetadataLocation/own_namespace === RUN TestValidateMetadataLocation/own_namespace_arbitrary_layout === RUN TestValidateMetadataLocation/cross_bucket_rejected === RUN TestValidateMetadataLocation/cross_namespace_rejected === RUN TestValidateMetadataLocation/cross_namespace_data_dir_rejected === RUN TestValidateMetadataLocation/namespace_prefix_rejected === RUN TestValidateMetadataLocation/outside_namespace_tree_rejected === RUN TestValidateMetadataLocation/namespace_dir_without_table_path_rejected === RUN TestValidateMetadataLocation/bucket_only_rejected === RUN TestValidateMetadataLocation/bucket_with_trailing_slash_rejected === RUN TestValidateMetadataLocation/slash-only_path_rejected === RUN TestValidateMetadataLocation/dotdot_in_path_rejected === RUN TestValidateMetadataLocation/dotdot_mid_path_rejected === RUN TestValidateMetadataLocation/dot_segment_rejected === RUN TestValidateMetadataLocation/backslash_segment_rejected === RUN TestValidateMetadataLocation/non-s3_scheme_rejected === RUN TestValidateMetadataLocation/empty_location_string --- PASS: TestValidateMetadataLocation (0.02s) --- PASS: TestValidateMetadataLocation/empty_allowed (0.00s) --- PASS: TestValidateMetadataLocation/own_namespace (0.00s) --- PASS: TestValidateMetadataLocation/own_namespace_arbitrary_layout (0.00s) --- PASS: TestValidateMetadataLocation/cross_bucket_rejected (0.00s) --- PASS: TestValidateMetadataLocation/cross_namespace_rejected (0.00s) --- PASS: TestValidateMetadataLocation/cross_namespace_data_dir_rejected (0.00s) --- PASS: TestValidateMetadataLocation/namespace_prefix_rejected (0.00s) --- PASS: TestValidateMetadataLocation/outside_namespace_tree_rejected (0.00s) --- PASS: TestValidateMetadataLocation/namespace_dir_without_table_path_rejected (0.00s) --- PASS: TestValidateMetadataLocation/bucket_only_rejected (0.00s) --- PASS: TestValidateMetadataLocation/bucket_with_trailing_slash_rejected (0.00s) --- PASS: TestValidateMetadataLocation/slash-only_path_rejected (0.00s) --- PASS: TestValidateMetadataLocation/dotdot_in_path_rejected (0.00s) --- PASS: TestValidateMetadataLocation/dotdot_mid_path_rejected (0.00s) --- PASS: TestValidateMetadataLocation/dot_segment_rejected (0.00s) --- PASS: TestValidateMetadataLocation/backslash_segment_rejected (0.00s) --- PASS: TestValidateMetadataLocation/non-s3_scheme_rejected (0.00s) --- PASS: TestValidateMetadataLocation/empty_location_string (0.00s) === RUN TestValidateNamespaceSupportsMultiLevel --- PASS: TestValidateNamespaceSupportsMultiLevel (0.00s) === RUN TestValidateNamespaceSupportsDottedInput --- PASS: TestValidateNamespaceSupportsDottedInput (0.00s) === RUN TestValidateNamespaceRejectsEmptyDottedSegment --- PASS: TestValidateNamespaceRejectsEmptyDottedSegment (0.00s) === RUN TestParseNamespace === RUN TestParseNamespace/single_level === RUN TestParseNamespace/multi_level_dotted === RUN TestParseNamespace/invalid_reserved_prefix === RUN TestParseNamespace/invalid_empty_segment --- PASS: TestParseNamespace (0.00s) --- PASS: TestParseNamespace/single_level (0.00s) --- PASS: TestParseNamespace/multi_level_dotted (0.00s) --- PASS: TestParseNamespace/invalid_reserved_prefix (0.00s) --- PASS: TestParseNamespace/invalid_empty_segment (0.00s) === RUN TestParseTableFromARNWithMultiLevelNamespace --- PASS: TestParseTableFromARNWithMultiLevelNamespace (0.00s) === RUN TestBuildTableARNWithDottedNamespace --- PASS: TestBuildTableARNWithDottedNamespace (0.00s) === RUN TestExpandNamespace --- PASS: TestExpandNamespace (0.00s) === RUN TestNamespaceMetadataPropertiesRoundTrip === RUN TestNamespaceMetadataPropertiesRoundTrip/with_properties === RUN TestNamespaceMetadataPropertiesRoundTrip/nil_properties === RUN TestNamespaceMetadataPropertiesRoundTrip/empty_properties --- PASS: TestNamespaceMetadataPropertiesRoundTrip (0.00s) --- PASS: TestNamespaceMetadataPropertiesRoundTrip/with_properties (0.00s) --- PASS: TestNamespaceMetadataPropertiesRoundTrip/nil_properties (0.00s) --- PASS: TestNamespaceMetadataPropertiesRoundTrip/empty_properties (0.00s) === RUN TestVectorNamespaceRefusesUntrustedWrites I1117 09:41:16.550773 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:16.573116 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestVectorNamespaceRefusesUntrustedWrites/UpdateNamespace === RUN TestVectorNamespaceRefusesUntrustedWrites/CreateTable === RUN TestVectorNamespaceRefusesUntrustedWrites/RegisterTable === RUN TestVectorNamespaceRefusesUntrustedWrites/UpdateTable === RUN TestVectorNamespaceRefusesUntrustedWrites/DeleteTable === RUN TestVectorNamespaceRefusesUntrustedWrites/RenameTable_out === RUN TestVectorNamespaceRefusesUntrustedWrites/RenameTable_in === RUN TestVectorNamespaceRefusesUntrustedWrites/PutTablePolicy === RUN TestVectorNamespaceRefusesUntrustedWrites/DeleteTablePolicy === RUN TestVectorNamespaceRefusesUntrustedWrites/TagResource === RUN TestVectorNamespaceRefusesUntrustedWrites/UntagResource === RUN TestVectorNamespaceRefusesUntrustedWrites/PutTableMaintenanceConfiguration --- PASS: TestVectorNamespaceRefusesUntrustedWrites (0.82s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/UpdateNamespace (0.02s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/CreateTable (0.04s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/RegisterTable (0.04s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/UpdateTable (0.05s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/DeleteTable (0.05s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/RenameTable_out (0.08s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/RenameTable_in (0.06s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/PutTablePolicy (0.03s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/DeleteTablePolicy (0.02s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/TagResource (0.02s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/UntagResource (0.02s) --- PASS: TestVectorNamespaceRefusesUntrustedWrites/PutTableMaintenanceConfiguration (0.03s) === RUN TestVectorNamespaceCannotBeCreatedOrDeleted I1117 09:41:17.378672 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=reader, owner=000000000000, actions=[s3tables:*] I1117 09:41:17.391799 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:17.441500 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=reader, owner=000000000000, actions=[s3tables:*] --- PASS: TestVectorNamespaceCannotBeCreatedOrDeleted (0.12s) === RUN TestVectorNamespaceAllowsReadsAndExistingCreate I1117 09:41:17.494634 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:17.517423 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestVectorNamespaceAllowsReadsAndExistingCreate/CreateTable === RUN TestVectorNamespaceAllowsReadsAndExistingCreate/GetTable === RUN TestVectorNamespaceAllowsReadsAndExistingCreate/ListTables === RUN TestVectorNamespaceAllowsReadsAndExistingCreate/GetNamespace === RUN TestVectorNamespaceAllowsReadsAndExistingCreate/GetTablePolicy === RUN TestVectorNamespaceAllowsReadsAndExistingCreate/ListTagsForResource --- PASS: TestVectorNamespaceAllowsReadsAndExistingCreate (0.45s) --- PASS: TestVectorNamespaceAllowsReadsAndExistingCreate/CreateTable (0.02s) --- PASS: TestVectorNamespaceAllowsReadsAndExistingCreate/GetTable (0.02s) --- PASS: TestVectorNamespaceAllowsReadsAndExistingCreate/ListTables (0.02s) --- PASS: TestVectorNamespaceAllowsReadsAndExistingCreate/GetNamespace (0.01s) --- PASS: TestVectorNamespaceAllowsReadsAndExistingCreate/GetTablePolicy (0.02s) --- PASS: TestVectorNamespaceAllowsReadsAndExistingCreate/ListTagsForResource (0.02s) === RUN TestVectorNamespaceOfIcebergBucketIsWritable I1117 09:41:17.952423 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:17.975075 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestVectorNamespaceOfIcebergBucketIsWritable/UpdateNamespace === RUN TestVectorNamespaceOfIcebergBucketIsWritable/RegisterTable === RUN TestVectorNamespaceOfIcebergBucketIsWritable/RenameTable_in === RUN TestVectorNamespaceOfIcebergBucketIsWritable/PutTablePolicy === RUN TestVectorNamespaceOfIcebergBucketIsWritable/DeleteTablePolicy === RUN TestVectorNamespaceOfIcebergBucketIsWritable/TagResource === RUN TestVectorNamespaceOfIcebergBucketIsWritable/UntagResource === RUN TestVectorNamespaceOfIcebergBucketIsWritable/PutTableMaintenanceConfiguration --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable (0.69s) --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable/UpdateNamespace (0.02s) --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable/RegisterTable (0.07s) --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable/RenameTable_in (0.07s) --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable/PutTablePolicy (0.02s) --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable/DeleteTablePolicy (0.02s) --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable/TagResource (0.02s) --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable/UntagResource (0.03s) --- PASS: TestVectorNamespaceOfIcebergBucketIsWritable/PutTableMaintenanceConfiguration (0.02s) === RUN TestVectorNamespaceDenialHidesBucketFormat I1117 09:41:18.628397 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:18.653542 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:18.898644 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:18.921050 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] === RUN TestVectorNamespaceDenialHidesBucketFormat/UpdateNamespace === RUN TestVectorNamespaceDenialHidesBucketFormat/CreateTable === RUN TestVectorNamespaceDenialHidesBucketFormat/RegisterTable === RUN TestVectorNamespaceDenialHidesBucketFormat/UpdateTable === RUN TestVectorNamespaceDenialHidesBucketFormat/DeleteTable === RUN TestVectorNamespaceDenialHidesBucketFormat/RenameTable_out === RUN TestVectorNamespaceDenialHidesBucketFormat/RenameTable_in === RUN TestVectorNamespaceDenialHidesBucketFormat/PutTablePolicy === RUN TestVectorNamespaceDenialHidesBucketFormat/DeleteTablePolicy === RUN TestVectorNamespaceDenialHidesBucketFormat/TagResource === RUN TestVectorNamespaceDenialHidesBucketFormat/UntagResource === RUN TestVectorNamespaceDenialHidesBucketFormat/PutTableMaintenanceConfiguration === RUN TestVectorNamespaceDenialHidesBucketFormat/CreateNamespace I1117 09:41:19.634970 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=attacker, owner=000000000000, actions=[Read] I1117 09:41:19.635388 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=attacker, owner=000000000000 I1117 09:41:19.645561 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=attacker, owner=000000000000, actions=[Read] I1117 09:41:19.645976 handler_namespace.go:173 S3Tables: Permission denied for CreateNamespace - principal=attacker, owner=000000000000 === RUN TestVectorNamespaceDenialHidesBucketFormat/DeleteNamespace --- PASS: TestVectorNamespaceDenialHidesBucketFormat (1.07s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/UpdateNamespace (0.02s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/CreateTable (0.03s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/RegisterTable (0.03s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/UpdateTable (0.05s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/DeleteTable (0.05s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/RenameTable_out (0.07s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/RenameTable_in (0.05s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/PutTablePolicy (0.04s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/DeleteTablePolicy (0.04s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/TagResource (0.03s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/UntagResource (0.03s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/PutTableMaintenanceConfiguration (0.03s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/CreateNamespace (0.02s) --- PASS: TestVectorNamespaceDenialHidesBucketFormat/DeleteNamespace (0.02s) === RUN TestAuthorizeCreateTableRefusesVectorNamespace I1117 09:41:19.719063 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:19.741381 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:19.969419 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:19.988783 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestAuthorizeCreateTableRefusesVectorNamespace (0.52s) === RUN TestVectorNamespaceFencePassesOnlyNoOpUpdates I1117 09:41:20.229152 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:41:20.251017 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestVectorNamespaceFencePassesOnlyNoOpUpdates (0.26s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3tables 47.578s ? github.com/seaweedfs/seaweedfs/weed/s3api/s3tables/s3tablestest [no test files] === RUN TestVectorAuditRecordsIdentityResourceAndErrors === RUN TestVectorAuditRecordsIdentityResourceAndErrors/OK === RUN TestVectorAuditRecordsIdentityResourceAndErrors/Forbidden === RUN TestVectorAuditRecordsIdentityResourceAndErrors/Service_Unavailable --- PASS: TestVectorAuditRecordsIdentityResourceAndErrors (0.08s) --- PASS: TestVectorAuditRecordsIdentityResourceAndErrors/OK (0.04s) --- PASS: TestVectorAuditRecordsIdentityResourceAndErrors/Forbidden (0.02s) --- PASS: TestVectorAuditRecordsIdentityResourceAndErrors/Service_Unavailable (0.00s) === RUN TestVectorBucketAuditHasNoObjectKey --- PASS: TestVectorBucketAuditHasNoObjectKey (0.00s) === RUN TestCreateVectorBucketChecksVectorAction --- PASS: TestCreateVectorBucketChecksVectorAction (0.69s) === RUN TestDeleteIndexKeepsReplacedRecord I1117 09:40:38.105907 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDeleteIndexKeepsReplacedRecord (0.91s) === RUN TestAuthKeepsIdentityObject --- PASS: TestAuthKeepsIdentityObject (0.00s) === RUN TestAuthAnswersOversizedBodyWithValidationException === RUN TestAuthAnswersOversizedBodyWithValidationException/declared_length_over_the_limit === RUN TestAuthAnswersOversizedBodyWithValidationException/streamed_body_over_the_limit === RUN TestAuthAnswersOversizedBodyWithValidationException/bad_signature === RUN TestAuthAnswersOversizedBodyWithValidationException/declared_length_at_the_limit --- PASS: TestAuthAnswersOversizedBodyWithValidationException (0.01s) --- PASS: TestAuthAnswersOversizedBodyWithValidationException/declared_length_over_the_limit (0.00s) --- PASS: TestAuthAnswersOversizedBodyWithValidationException/streamed_body_over_the_limit (0.00s) --- PASS: TestAuthAnswersOversizedBodyWithValidationException/bad_signature (0.00s) --- PASS: TestAuthAnswersOversizedBodyWithValidationException/declared_length_at_the_limit (0.00s) === RUN TestReadJSONRefusesBodyOverTheLimit --- PASS: TestReadJSONRefusesBodyOverTheLimit (1.70s) === RUN TestVectorBucketPolicyWritesKeepToAuthorizedBucket === RUN TestVectorBucketPolicyWritesKeepToAuthorizedBucket/put === RUN TestVectorBucketPolicyWritesKeepToAuthorizedBucket/delete --- PASS: TestVectorBucketPolicyWritesKeepToAuthorizedBucket (0.50s) --- PASS: TestVectorBucketPolicyWritesKeepToAuthorizedBucket/put (0.31s) --- PASS: TestVectorBucketPolicyWritesKeepToAuthorizedBucket/delete (0.18s) === RUN TestDeleteVectorBucketKeepsReplacingBucket --- PASS: TestDeleteVectorBucketKeepsReplacingBucket (0.13s) === RUN TestIndexWritesKeepToAuthorizedBucket === RUN TestIndexWritesKeepToAuthorizedBucket/create === RUN TestIndexWritesKeepToAuthorizedBucket/delete I1117 09:40:41.449590 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestIndexWritesKeepToAuthorizedBucket (0.68s) --- PASS: TestIndexWritesKeepToAuthorizedBucket/create (0.15s) --- PASS: TestIndexWritesKeepToAuthorizedBucket/delete (0.53s) === RUN TestDeleteVectorBucketCleanupKeepsReplacingBucket I1117 09:40:41.996357 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDeleteVectorBucketCleanupKeepsReplacingBucket (0.63s) === RUN TestVectorBucketPolicyEndToEnd I1117 09:40:42.666011 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestVectorBucketPolicyEndToEnd (0.89s) === RUN TestCreateIndexPreservesAnUnknownOutcome === RUN TestCreateIndexPreservesAnUnknownOutcome/Unavailable I1117 09:40:43.473679 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:43.627396 handlers.go:226 S3 Vectors: vec-bucket/idx: rpc error: code = Unavailable desc = response lost === RUN TestCreateIndexPreservesAnUnknownOutcome/DeadlineExceeded I1117 09:40:43.768229 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] E1117 09:40:43.929018 handlers.go:229 S3 Vectors: vec-bucket/idx: rpc error: code = DeadlineExceeded desc = response lost === RUN TestCreateIndexPreservesAnUnknownOutcome/Canceled I1117 09:40:44.084376 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] E1117 09:40:44.281443 handlers.go:229 S3 Vectors: vec-bucket/idx: rpc error: code = Canceled desc = response lost === RUN TestCreateIndexPreservesAnUnknownOutcome/Internal I1117 09:40:44.472753 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] E1117 09:40:44.763986 handlers.go:229 S3 Vectors: vec-bucket/idx: rpc error: code = Internal desc = response lost === RUN TestCreateIndexPreservesAnUnknownOutcome/InvalidArgument I1117 09:40:44.940262 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateIndexPreservesAnUnknownOutcome (1.88s) --- PASS: TestCreateIndexPreservesAnUnknownOutcome/Unavailable (0.30s) --- PASS: TestCreateIndexPreservesAnUnknownOutcome/DeadlineExceeded (0.29s) --- PASS: TestCreateIndexPreservesAnUnknownOutcome/Canceled (0.36s) --- PASS: TestCreateIndexPreservesAnUnknownOutcome/Internal (0.49s) --- PASS: TestCreateIndexPreservesAnUnknownOutcome/InvalidArgument (0.44s) === RUN TestCreateIndexRetainsTheWriteErrorIfRediscoveryFails --- PASS: TestCreateIndexRetainsTheWriteErrorIfRediscoveryFails (0.00s) === RUN TestCreateIndexResumesAnUnknownOutcome I1117 09:40:45.400871 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:45.613284 handlers.go:226 S3 Vectors: vec-bucket/idx: rpc error: code = Unavailable desc = request lost --- PASS: TestCreateIndexResumesAnUnknownOutcome (1.17s) === RUN TestCreateIndexRollbackPreservesACompletedRetry I1117 09:40:46.552590 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateIndexRollbackPreservesACompletedRetry (0.57s) === RUN TestCreateIndexRetainsAnUnknownOutcomeAfterARefusedRetry === RUN TestCreateIndexRetainsAnUnknownOutcomeAfterARefusedRetry/PermissionDenied I1117 09:40:47.127970 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:47.368164 handlers.go:226 S3 Vectors: vec-bucket/idx: rpc error: code = Unavailable desc = response lost after commit === RUN TestCreateIndexRetainsAnUnknownOutcomeAfterARefusedRetry/FailedPrecondition I1117 09:40:47.512376 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:47.708190 handlers.go:226 S3 Vectors: vec-bucket/idx: rpc error: code = Unavailable desc = response lost after commit --- PASS: TestCreateIndexRetainsAnUnknownOutcomeAfterARefusedRetry (0.72s) --- PASS: TestCreateIndexRetainsAnUnknownOutcomeAfterARefusedRetry/PermissionDenied (0.39s) --- PASS: TestCreateIndexRetainsAnUnknownOutcomeAfterARefusedRetry/FailedPrecondition (0.33s) === RUN TestCreateIndexRollbackPreservesAnActiveRetry I1117 09:40:47.820567 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateIndexRollbackPreservesAnActiveRetry (0.52s) === RUN TestCreateIndexResumesWithTheDefaultMetric I1117 09:40:48.363982 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:48.539963 handlers.go:226 S3 Vectors: vec-bucket/idx: rpc error: code = Unavailable desc = request lost --- PASS: TestCreateIndexResumesWithTheDefaultMetric (0.45s) === RUN TestCreateIndexRetryPreservesDuplicateMetadataKeys I1117 09:40:48.794190 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:48.958426 handlers.go:226 S3 Vectors: vec-bucket/idx: rpc error: code = Unavailable desc = response lost --- PASS: TestCreateIndexRetryPreservesDuplicateMetadataKeys (0.40s) === RUN TestCreateIndexDoesNotInitializeAConcurrentCatalogCreate I1117 09:40:49.193411 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateIndexDoesNotInitializeAConcurrentCatalogCreate (0.46s) === RUN TestDescribeFillsTableLocation I1117 09:40:49.650927 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDescribeFillsTableLocation (0.36s) === RUN TestDescribeCarriesTheBucketsEncryption I1117 09:40:49.995804 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDescribeCarriesTheBucketsEncryption (0.23s) === RUN TestDescribeErrorsReachTheCaller I1117 09:40:50.228771 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] E1117 09:40:50.701528 handlers.go:229 S3 Vectors: vec-bucket/idx: rpc error: code = Internal desc = lance catalog is not running --- PASS: TestDescribeErrorsReachTheCaller (0.54s) === RUN TestVectorDiscoveryRechecksRegistration --- PASS: TestVectorDiscoveryRechecksRegistration (0.01s) === RUN TestVectorDiscoveryThrottlesFromLookupEnd --- PASS: TestVectorDiscoveryThrottlesFromLookupEnd (1.81s) === RUN TestVectorDiscoveryLookupDoesNotBlockCachedClient --- PASS: TestVectorDiscoveryLookupDoesNotBlockCachedClient (0.01s) === RUN TestVectorDiscoveryUncachedCallersShareLookup --- PASS: TestVectorDiscoveryUncachedCallersShareLookup (0.06s) === RUN TestVectorDiscoveryKeepsConnOnDialError W1117 09:40:52.606680 discovery.go:127 S3 Vectors: dial weed-vector 127.0.0.1:9302: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) --- PASS: TestVectorDiscoveryKeepsConnOnDialError (0.01s) === RUN TestVectorDiscoveryDrainsRetiredConnections --- PASS: TestVectorDiscoveryDrainsRetiredConnections (0.02s) === RUN TestVectorDiscoveryWaitingRespectsCancellation --- PASS: TestVectorDiscoveryWaitingRespectsCancellation (0.00s) === RUN TestVectorDiscoveryRetriesAnotherServer --- PASS: TestVectorDiscoveryRetriesAnotherServer (0.02s) === RUN TestVectorDiscoveryCloseDuringLookup --- PASS: TestVectorDiscoveryCloseDuringLookup (0.00s) === RUN TestVectorDiscoveryRefreshesMasterSnapshot --- PASS: TestVectorDiscoveryRefreshesMasterSnapshot (0.01s) === RUN TestCreateIndexStoresLowercaseMetric I1117 09:40:52.776799 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCreateIndexStoresLowercaseMetric (0.47s) === RUN TestIndexFromRecordLowercasesMetric --- PASS: TestIndexFromRecordLowercasesMetric (0.00s) === RUN TestQueryVectorsReportsEuclideanDistance I1117 09:40:53.232504 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:53.577495 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:53.939475 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestQueryVectorsReportsEuclideanDistance (1.06s) === RUN TestExecuteRunsOperationsAsTheIdentity --- PASS: TestExecuteRunsOperationsAsTheIdentity (0.15s) === RUN TestExecuteChecksTheIdentitysGrants --- PASS: TestExecuteChecksTheIdentitysGrants (0.04s) === RUN TestListSegmentVectorsCoversEveryRowOnce --- PASS: TestListSegmentVectorsCoversEveryRowOnce (0.07s) === RUN TestListSegmentVectorsStopsInsideEnginePage --- PASS: TestListSegmentVectorsStopsInsideEnginePage (0.00s) === RUN TestListSegmentVectorsEndsOnLastRow --- PASS: TestListSegmentVectorsEndsOnLastRow (0.00s) === RUN TestListSegmentVectorsPageLimits --- PASS: TestListSegmentVectorsPageLimits (0.02s) === RUN TestListRequestMaxResultsBounds I1117 09:40:54.569098 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestListRequestMaxResultsBounds (0.28s) === RUN TestArnParts --- PASS: TestArnParts (0.00s) === RUN TestBucketARNs --- PASS: TestBucketARNs (0.00s) === RUN TestResolveIndexARNs --- PASS: TestResolveIndexARNs (0.00s) === RUN TestTranslateFilter --- PASS: TestTranslateFilter (0.02s) === RUN TestIndexFromRecordNonFilterableKeys --- PASS: TestIndexFromRecordNonFilterableKeys (0.01s) === RUN TestFilterFieldsNestedOperators --- PASS: TestFilterFieldsNestedOperators (0.00s) === RUN TestToPutVectorDimensionCheck === RUN TestToPutVectorDimensionCheck/matching === RUN TestToPutVectorDimensionCheck/mismatched === RUN TestToPutVectorDimensionCheck/missing_data === RUN TestToPutVectorDimensionCheck/empty_data === RUN TestToPutVectorDimensionCheck/null_element === RUN TestToPutVectorDimensionCheck/empty_key --- PASS: TestToPutVectorDimensionCheck (0.01s) --- PASS: TestToPutVectorDimensionCheck/matching (0.00s) --- PASS: TestToPutVectorDimensionCheck/mismatched (0.00s) --- PASS: TestToPutVectorDimensionCheck/missing_data (0.00s) --- PASS: TestToPutVectorDimensionCheck/empty_data (0.00s) --- PASS: TestToPutVectorDimensionCheck/null_element (0.00s) --- PASS: TestToPutVectorDimensionCheck/empty_key (0.00s) === RUN TestPutVectorsRejectsBadBatchSizes --- PASS: TestPutVectorsRejectsBadBatchSizes (0.05s) === RUN TestPutVectorsUsesCatalogDimension I1117 09:40:54.941088 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestPutVectorsUsesCatalogDimension (0.41s) === RUN TestQueryVectorsTopKBounds === RUN TestQueryVectorsTopKBounds/zero === RUN TestQueryVectorsTopKBounds/negative === RUN TestQueryVectorsTopKBounds/over_the_limit === RUN TestQueryVectorsTopKBounds/one === RUN TestQueryVectorsTopKBounds/at_the_limit --- PASS: TestQueryVectorsTopKBounds (0.01s) --- PASS: TestQueryVectorsTopKBounds/zero (0.00s) --- PASS: TestQueryVectorsTopKBounds/negative (0.00s) --- PASS: TestQueryVectorsTopKBounds/over_the_limit (0.00s) --- PASS: TestQueryVectorsTopKBounds/one (0.00s) --- PASS: TestQueryVectorsTopKBounds/at_the_limit (0.00s) === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/empty === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/default_sse === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/tables_wire_name === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/both_wire_names === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/customer_key === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/tables_kms === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/unknown_sse === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/missing_algorithm === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/key_without_a_type === RUN TestValidateEncryptionConfigurationRejectsCustomerKeys/key_on_default_sse --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys (0.01s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/empty (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/default_sse (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/tables_wire_name (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/both_wire_names (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/customer_key (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/tables_kms (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/unknown_sse (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/missing_algorithm (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/key_without_a_type (0.00s) --- PASS: TestValidateEncryptionConfigurationRejectsCustomerKeys/key_on_default_sse (0.00s) === RUN TestCreateVectorBucketNeedsSSES3ForAES256 --- PASS: TestCreateVectorBucketNeedsSSES3ForAES256 (0.08s) === RUN TestDeleteIndexRemovesDatasetDirectory I1117 09:40:55.435863 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestDeleteIndexRemovesDatasetDirectory (0.23s) === RUN TestValidateVectorPolicy --- PASS: TestValidateVectorPolicy (0.03s) === RUN TestVectorBucketPolicyGatesVectorActions I1117 09:40:55.721088 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestVectorBucketPolicyGatesVectorActions (0.52s) === RUN TestDeleteVectorBucketPolicyRemovesLegacyDoc --- PASS: TestDeleteVectorBucketPolicyRemovesLegacyDoc (0.16s) === RUN TestVectorKeysBounds --- PASS: TestVectorKeysBounds (0.00s) === RUN TestVectorKeysBoundsRejectsBeforeEngine --- PASS: TestVectorKeysBoundsRejectsBeforeEngine (0.01s) === RUN TestCreateIndexSurvivesAConcurrentNamespaceCreate I1117 09:40:56.404643 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:56.439950 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] W1117 09:40:56.587038 filer_ops.go:865 back out /buckets/vec-bucket/vector: attribute changed concurrently: s3tables.metadata changed on /buckets/vec-bucket/vector --- PASS: TestCreateIndexSurvivesAConcurrentNamespaceCreate (0.44s) === RUN TestVectorErrKeepsEngineDetailsOutOfTheResponse E1117 09:40:56.789301 handlers.go:229 S3 Vectors: PutVectors media/movies: rpc error: code = Internal desc = declare: 500 from http://10.0.0.5:8888/lance/v1/table/media$vector$movies/declare W1117 09:40:56.791056 handlers.go:226 S3 Vectors: PutVectors media/movies: rpc error: code = Unavailable desc = no weed-vector registered on master --- PASS: TestVectorErrKeepsEngineDetailsOutOfTheResponse (0.00s) === RUN TestIAMGrantRespectsVectorResourceDenies --- PASS: TestIAMGrantRespectsVectorResourceDenies (0.00s) === RUN TestIAMCreateBucketReceivesRequestTags --- PASS: TestIAMCreateBucketReceivesRequestTags (0.02s) === RUN TestVectorLimitsResolveResourcesAndPreserveBodies === RUN TestVectorLimitsResolveResourcesAndPreserveBodies/PutVectors === RUN TestVectorLimitsResolveResourcesAndPreserveBodies/QueryVectors === RUN TestVectorLimitsResolveResourcesAndPreserveBodies/GetVectorBucket --- PASS: TestVectorLimitsResolveResourcesAndPreserveBodies (0.01s) --- PASS: TestVectorLimitsResolveResourcesAndPreserveBodies/PutVectors (0.00s) --- PASS: TestVectorLimitsResolveResourcesAndPreserveBodies/QueryVectors (0.00s) --- PASS: TestVectorLimitsResolveResourcesAndPreserveBodies/GetVectorBucket (0.00s) === RUN TestVectorLimitsReturnJSONWithoutCallingHandler --- PASS: TestVectorLimitsReturnJSONWithoutCallingHandler (0.02s) === RUN TestVectorLimitsIgnoreUnrelatedResourceFields === RUN TestVectorLimitsIgnoreUnrelatedResourceFields/PutVectors{"vectorBucketName":"bucket-a","indexName":"idx","resourceArn":"arn:aws:s3vectors:r:a:bucket/bucket-b"} === RUN TestVectorLimitsIgnoreUnrelatedResourceFields/PutVectors{"vectorBucketName":"bucket-a","indexName":"idx","resourceArn":{"ignored":true}} === RUN TestVectorLimitsIgnoreUnrelatedResourceFields/GetVectorBucket{"vectorBucketName":"bucket-a","indexArn":"invalid","indexName":42} === RUN TestVectorLimitsIgnoreUnrelatedResourceFields/CreateIndex{"vectorBucketName":"bucket-a","indexName":"idx","resourceArn":"ignored"} === RUN TestVectorLimitsIgnoreUnrelatedResourceFields/ListVectorBuckets{"vectorBucketName":"ignored","resourceArn":"ignored"} --- PASS: TestVectorLimitsIgnoreUnrelatedResourceFields (0.01s) --- PASS: TestVectorLimitsIgnoreUnrelatedResourceFields/PutVectors{"vectorBucketName":"bucket-a","indexName":"idx","resourceArn":"arn:aws:s3vectors:r:a:bucket/bucket-b"} (0.00s) --- PASS: TestVectorLimitsIgnoreUnrelatedResourceFields/PutVectors{"vectorBucketName":"bucket-a","indexName":"idx","resourceArn":{"ignored":true}} (0.00s) --- PASS: TestVectorLimitsIgnoreUnrelatedResourceFields/GetVectorBucket{"vectorBucketName":"bucket-a","indexArn":"invalid","indexName":42} (0.00s) --- PASS: TestVectorLimitsIgnoreUnrelatedResourceFields/CreateIndex{"vectorBucketName":"bucket-a","indexName":"idx","resourceArn":"ignored"} (0.00s) --- PASS: TestVectorLimitsIgnoreUnrelatedResourceFields/ListVectorBuckets{"vectorBucketName":"ignored","resourceArn":"ignored"} (0.00s) === RUN TestVectorLimitsCountChunkedBodyBytes --- PASS: TestVectorLimitsCountChunkedBodyBytes (0.00s) === RUN TestVectorAdmissionBoundsBufferingBeforeAuthentication === RUN TestVectorAdmissionBoundsBufferingBeforeAuthentication/request_count === RUN TestVectorAdmissionBoundsBufferingBeforeAuthentication/byte_count === RUN TestVectorAdmissionBoundsBufferingBeforeAuthentication/chunked_body --- PASS: TestVectorAdmissionBoundsBufferingBeforeAuthentication (0.17s) --- PASS: TestVectorAdmissionBoundsBufferingBeforeAuthentication/request_count (0.06s) --- PASS: TestVectorAdmissionBoundsBufferingBeforeAuthentication/byte_count (0.05s) --- PASS: TestVectorAdmissionBoundsBufferingBeforeAuthentication/chunked_body (0.05s) === RUN TestVectorErrorResponsesEscapeHTML --- PASS: TestVectorErrorResponsesEscapeHTML (0.02s) === RUN TestListVectorsBoundsRejectBeforeEngine --- PASS: TestListVectorsBoundsRejectBeforeEngine (0.47s) === RUN TestListVectorsBoundsAccepted I1117 09:40:58.038537 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestListVectorsBoundsAccepted (0.94s) === RUN TestListVectorsSegmentsFromTheEngine I1117 09:40:58.571366 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] I1117 09:40:59.823305 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestListVectorsSegmentsFromTheEngine (2.56s) === RUN TestVectorMetricsAttributeAuthorizedBuckets --- PASS: TestVectorMetricsAttributeAuthorizedBuckets (0.11s) === RUN TestAdminNamedIdentityReachesOwnBucket I1117 09:41:01.198586 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=admin, actions=[] --- PASS: TestAdminNamedIdentityReachesOwnBucket (0.21s) === RUN TestVectorPrincipalMatchesTableBuckets === RUN TestVectorPrincipalMatchesTableBuckets/admin === RUN TestVectorPrincipalMatchesTableBuckets/admin-action === RUN TestVectorPrincipalMatchesTableBuckets/account === RUN TestVectorPrincipalMatchesTableBuckets/federated --- PASS: TestVectorPrincipalMatchesTableBuckets (0.52s) --- PASS: TestVectorPrincipalMatchesTableBuckets/admin (0.13s) --- PASS: TestVectorPrincipalMatchesTableBuckets/admin-action (0.12s) --- PASS: TestVectorPrincipalMatchesTableBuckets/account (0.14s) --- PASS: TestVectorPrincipalMatchesTableBuckets/federated (0.12s) === RUN TestBucketScopedIdentityActions I1117 09:41:01.930414 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=admin, actions=[Admin] I1117 09:41:02.119997 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=admin, owner=admin, actions=[Admin] --- PASS: TestBucketScopedIdentityActions (0.62s) === RUN TestResourceTagReadsTheTargetsOwnTags I1117 09:41:02.570919 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestResourceTagReadsTheTargetsOwnTags (0.74s) === RUN TestVectorBucketTagReachesIndexes I1117 09:41:03.297438 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestVectorBucketTagReachesIndexes (0.48s) === RUN TestResourceTagDenyProtectsTaggedIndexes I1117 09:41:03.773186 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestResourceTagDenyProtectsTaggedIndexes (0.67s) === RUN TestRequestTagsAndTagKeysGateTagging --- PASS: TestRequestTagsAndTagKeysGateTagging (0.40s) === RUN TestRequestTagGatesCreateIndex I1117 09:41:04.920702 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=reader, owner=000000000000, actions=[] --- PASS: TestRequestTagGatesCreateIndex (0.33s) === RUN TestResourceTagFiltersVectorBucketListing --- PASS: TestResourceTagFiltersVectorBucketListing (0.18s) === RUN TestResourceTagGatesPolicyDelete --- PASS: TestResourceTagGatesPolicyDelete (0.16s) === RUN TestReadsResourceTags --- PASS: TestReadsResourceTags (0.01s) === RUN TestValidateVectorPolicyConditions --- PASS: TestValidateVectorPolicyConditions (0.06s) === RUN TestPutVectorBucketPolicyWithTagConditions I1117 09:41:05.584680 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestPutVectorBucketPolicyWithTagConditions (0.49s) === RUN TestTagVectorBucketsAndIndexes I1117 09:41:06.072953 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestTagVectorBucketsAndIndexes (0.59s) === RUN TestTagResourceValidation --- PASS: TestTagResourceValidation (0.29s) === RUN TestTaggingNeedsItsOwnGrant --- PASS: TestTaggingNeedsItsOwnGrant (0.23s) === RUN TestCreateWithTagsNeedsTagResource I1117 09:41:07.241195 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=creator, owner=admin, actions=[s3vectors:CreateVectorBucket s3vectors:CreateIndex] --- PASS: TestCreateWithTagsNeedsTagResource (0.52s) === RUN TestTaggingRefusesTablesThatAreNotIndexes I1117 09:41:07.699830 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestTaggingRefusesTablesThatAreNotIndexes (0.37s) === RUN TestUntagManyKeysAllocatesLikeDecoding --- PASS: TestUntagManyKeysAllocatesLikeDecoding (3.77s) === RUN TestCatalogCannotBypassVectorPolicy I1117 09:41:11.833826 handler_namespace.go:162 S3Tables: CreateNamespace permission check - principal=000000000000, owner=000000000000, actions=[] --- PASS: TestCatalogCannotBypassVectorPolicy (0.64s) PASS ok github.com/seaweedfs/seaweedfs/weed/s3api/s3vectors 39.505s === RUN TestCheckGrpcAdminPeer --- PASS: TestCheckGrpcAdminPeer (0.05s) === RUN TestGrpcAdminPeerCredentials --- PASS: TestGrpcAdminPeerCredentials (0.02s) === RUN TestCheckGrpcAdminToken --- PASS: TestCheckGrpcAdminToken (0.10s) === RUN TestUpdateSigningKeysRotates --- PASS: TestUpdateSigningKeysRotates (0.01s) === RUN TestUpdateSigningKeysConcurrent --- PASS: TestUpdateSigningKeysConcurrent (2.99s) === RUN TestUpdateSigningKeysTogglesWriteActive --- PASS: TestUpdateSigningKeysTogglesWriteActive (0.00s) === RUN TestIsWhiteListedEmptyConfigAllowsEverything --- PASS: TestIsWhiteListedEmptyConfigAllowsEverything (0.00s) === RUN TestIsWhiteListedWithListRejectsUnknown --- PASS: TestIsWhiteListedWithListRejectsUnknown (0.00s) === RUN TestIsWhiteListedWithSigningKeyButNoWhitelistAllowsAll --- PASS: TestIsWhiteListedWithSigningKeyButNoWhitelistAllowsAll (0.00s) === RUN TestLoadFilerJwtFromFile === RUN TestLoadFilerJwtFromFile/read === RUN TestLoadFilerJwtFromFile/write --- PASS: TestLoadFilerJwtFromFile (0.05s) --- PASS: TestLoadFilerJwtFromFile/read (0.00s) --- PASS: TestLoadFilerJwtFromFile/write (0.00s) === RUN TestLoadFilerJwtFromFileWithoutKeys --- PASS: TestLoadFilerJwtFromFileWithoutKeys (0.01s) === RUN TestLoadFilerJwtFromFileMissing --- PASS: TestLoadFilerJwtFromFileMissing (0.00s) === RUN TestLoadFilerJwtFromFilePartialKeys --- PASS: TestLoadFilerJwtFromFilePartialKeys (0.01s) === RUN TestLoadFilerJwtFromFileEnvOverride --- PASS: TestLoadFilerJwtFromFileEnvOverride (0.02s) === RUN TestLoadClientTLSPrefersClientCert --- PASS: TestLoadClientTLSPrefersClientCert (0.95s) === RUN TestLoadClientTLSFallsBackToServingCert --- PASS: TestLoadClientTLSFallsBackToServingCert (0.38s) === RUN TestLoadClientTLSVerifyServerHost --- PASS: TestLoadClientTLSVerifyServerHost (1.11s) === RUN TestLoadClientTLSServerOnlyEkuRejected --- PASS: TestLoadClientTLSServerOnlyEkuRejected (0.26s) === RUN TestLoadServerTLSUnconfiguredIsPlaintext --- PASS: TestLoadServerTLSUnconfiguredIsPlaintext (0.00s) === RUN TestLoadServerTLSPartialCertKeyFails --- PASS: TestLoadServerTLSPartialCertKeyFails (0.04s) === RUN TestLoadServerTLSBadVersionNameFails --- PASS: TestLoadServerTLSBadVersionNameFails (0.07s) === RUN TestLoadClientTLSUnconfiguredIsPlaintext --- PASS: TestLoadClientTLSUnconfiguredIsPlaintext (0.00s) === RUN TestLoadClientTLSPartialClientPairFails --- PASS: TestLoadClientTLSPartialClientPairFails (0.06s) === RUN TestLoadClientTLSMissingCaFails --- PASS: TestLoadClientTLSMissingCaFails (0.04s) === RUN TestLoadClientTLSBadCaPathFails --- PASS: TestLoadClientTLSBadCaPathFails (0.05s) === RUN TestLoadClientTLSAllowsListedServerName --- PASS: TestLoadClientTLSAllowsListedServerName (0.29s) === RUN TestLoadClientTLSRejectsUnlistedServerName E1117 09:40:40.773358 tls.go:483 AuthenticateServer: untrusted server identity [seaweed-filer localhost] --- PASS: TestLoadClientTLSRejectsUnlistedServerName (0.33s) === RUN TestLoadClientTLSMatchesServerURISAN --- PASS: TestLoadClientTLSMatchesServerURISAN (0.25s) === RUN TestLoadClientTLSMatchesServerWildcardDomain --- PASS: TestLoadClientTLSMatchesServerWildcardDomain (0.24s) === RUN TestMatchesWildcardDomain --- PASS: TestMatchesWildcardDomain (0.00s) === RUN TestLoadClientTLSRejectsInvalidWildcardName E1117 09:40:41.567910 tls.go:483 AuthenticateServer: untrusted server identity [.example.com .example.com] --- PASS: TestLoadClientTLSRejectsInvalidWildcardName (0.24s) === RUN TestLoadClientTLSURIPathDoesNotMatchWildcardDomain E1117 09:40:41.782197 tls.go:483 AuthenticateServer: untrusted server identity [server spiffe://other.invalid/workload.example.com] --- PASS: TestLoadClientTLSURIPathDoesNotMatchWildcardDomain (0.21s) === RUN TestLoadClientTLSGlobalServerNamesFallback --- PASS: TestLoadClientTLSGlobalServerNamesFallback (0.32s) === RUN TestLoadClientTLSForTargetUsesClientScopedAllowlist --- PASS: TestLoadClientTLSForTargetUsesClientScopedAllowlist (0.24s) === RUN TestLoadClientTLSForTargetIgnoresTargetOutboundAllowlist --- PASS: TestLoadClientTLSForTargetIgnoresTargetOutboundAllowlist (0.25s) === RUN TestLoadClientTLSForTargetFallsBackToClientAllowlist --- PASS: TestLoadClientTLSForTargetFallsBackToClientAllowlist (0.20s) === RUN TestLoadClientTLSRejectsUnappliedTargetAllowlist --- PASS: TestLoadClientTLSRejectsUnappliedTargetAllowlist (0.06s) === RUN TestLoadClientTLSRejectsUnappliedTargetAllowlistFromEnv --- PASS: TestLoadClientTLSRejectsUnappliedTargetAllowlistFromEnv (0.08s) === RUN TestLoadClientTLSFilerKeepsTargetAllowlists E1117 09:40:43.094298 tls.go:483 AuthenticateServer: untrusted server identity [seaweed-volume localhost] --- PASS: TestLoadClientTLSFilerKeepsTargetAllowlists (0.14s) === RUN TestSNI_HostnameStripsPort --- PASS: TestSNI_HostnameStripsPort (0.12s) === RUN TestSNI_IPAddressEmptySNI --- PASS: TestSNI_IPAddressEmptySNI (0.09s) === RUN TestSNI_IPv6AddressEmptySNI --- PASS: TestSNI_IPv6AddressEmptySNI (0.09s) PASS ok github.com/seaweedfs/seaweedfs/weed/security 10.447s === RUN TestServerGetCertificatePicksUpNewFile --- PASS: TestServerGetCertificatePicksUpNewFile (1.53s) PASS ok github.com/seaweedfs/seaweedfs/weed/security/certreload 1.986s === RUN TestSequencer I1117 09:40:34.188489 snowflake_sequencer.go:24 use snowflake seq id generator, nodeid:for_test hex_of_nodeid: 1 1d75150ad9c01000 1d75150ada001000 1d75150ada001001 1d75150ada401000 1d75150ada401001 1d75150ada401002 1d75150ada401003 1d75150ada401004 1d75150ada401005 1d75150ada401006 1d75150ada401007 1d75150ada401008 1d75150ada401009 1d75150ada40100a 1d75150ada40100b 1d75150ada40100c 1d75150ada40100d 1d75150ada40100e 1d75150ada40100f 1d75150ada401010 1d75150ada401011 1d75150ada401012 1d75150ada401013 1d75150ada401014 1d75150ada401015 1d75150ada401016 1d75150ada401017 1d75150ada401018 1d75150ada401019 1d75150ada40101a 1d75150ada40101b 1d75150ada40101c 1d75150ada40101d 1d75150ada40101e 1d75150ada40101f 1d75150ada401020 1d75150ada401021 1d75150ada401022 1d75150ada401023 1d75150ada401024 1d75150ada401025 1d75150ada401026 1d75150ada401027 1d75150ada401028 1d75150ada401029 1d75150ada40102a 1d75150ada40102b 1d75150ada40102c 1d75150ada40102d 1d75150ada40102e 1d75150ada40102f 1d75150ada401030 1d75150ada401031 1d75150ada401032 1d75150ada401033 1d75150ada401034 1d75150ada401035 1d75150ada401036 1d75150ada401037 1d75150ada401038 1d75150ada401039 1d75150ada40103a 1d75150ada40103b 1d75150ada40103c 1d75150ada40103d 1d75150ada40103e 1d75150ada40103f 1d75150ada401040 1d75150ada401041 1d75150ada401042 1d75150ada401043 1d75150ada401044 1d75150ada401045 1d75150ada401046 1d75150ada401047 1d75150ada401048 1d75150ada401049 1d75150ada40104a 1d75150ada40104b 1d75150ada40104c 1d75150ada40104d 1d75150ada40104e 1d75150ada40104f 1d75150ada401050 1d75150ada401051 1d75150ada401052 1d75150ada401053 1d75150ada801000 1d75150ada801001 1d75150ada801002 1d75150ada801003 1d75150ada801004 1d75150ada801005 1d75150ada801006 1d75150ada801007 1d75150ada801008 1d75150ada801009 1d75150ada80100a 1d75150ada80100b 1d75150ada80100c --- PASS: TestSequencer (0.03s) PASS ok github.com/seaweedfs/seaweedfs/weed/sequence 0.911s === RUN TestParseURL --- PASS: TestParseURL (0.00s) === RUN TestWriteJsonNoJSONP === RUN TestWriteJsonNoJSONP/callback= === RUN TestWriteJsonNoJSONP/callback=myCb === RUN TestWriteJsonNoJSONP/callback= --- PASS: TestWriteJsonNoJSONP (0.03s) --- PASS: TestWriteJsonNoJSONP/callback= (0.01s) --- PASS: TestWriteJsonNoJSONP/callback=myCb (0.01s) --- PASS: TestWriteJsonNoJSONP/callback= (0.00s) === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect/double_slash_before_non-ascii_segments === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect/already_percent-encoded_by_the_client === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect/trailing_slash_marks_a_directory_and_is_kept === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect/dot_segments_are_resolved === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect/dot_segments_crossing_a_bucket_move_RequestURI_to_the_written_bucket,_query_kept === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect/canonical_path_is_passed_through_untouched === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect/encoded_slash_is_not_a_separator_and_is_preserved === RUN TestCleanPathHandlerServesCleanedPathWithoutRedirect/root --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect (0.03s) --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect/double_slash_before_non-ascii_segments (0.01s) --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect/already_percent-encoded_by_the_client (0.00s) --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect/trailing_slash_marks_a_directory_and_is_kept (0.00s) --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect/dot_segments_are_resolved (0.01s) --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect/dot_segments_crossing_a_bucket_move_RequestURI_to_the_written_bucket,_query_kept (0.00s) --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect/canonical_path_is_passed_through_untouched (0.00s) --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect/encoded_slash_is_not_a_separator_and_is_preserved (0.00s) --- PASS: TestCleanPathHandlerServesCleanedPathWithoutRedirect/root (0.00s) === RUN TestWriteJsonPrettyDoesNotReadMultipartBody I1117 09:40:37.517168 common.go:111 response method:POST URL:/x with httpStatus:429 and JSON:{"error":"busy"} --- PASS: TestWriteJsonPrettyDoesNotReadMultipartBody (0.03s) === RUN TestProcessRangeRequestWriteErrorAfterBodyStarted E1117 09:40:37.633475 common.go:364 ProcessRangeRequest: ReadNeedleData checksum mismatch --- PASS: TestProcessRangeRequestWriteErrorAfterBodyStarted (0.15s) === RUN TestProcessRangeRequestWriteErrorBeforeBody E1117 09:40:37.697339 common.go:364 ProcessRangeRequest: ReadNeedleData checksum mismatch --- PASS: TestProcessRangeRequestWriteErrorBeforeBody (0.01s) === RUN TestProcessRangeRequestLargeBody --- PASS: TestProcessRangeRequestLargeBody (0.01s) === RUN TestProcessRangeRequestRanges E1117 09:40:37.719979 common.go:383 ProcessRangeRequest headers: map[] err: invalid range: failed to overlap E1117 09:40:37.722717 common.go:383 ProcessRangeRequest headers: map[] err: invalid range: failed to overlap E1117 09:40:37.727225 common.go:383 ProcessRangeRequest headers: map[] err: invalid range E1117 09:40:37.728102 common.go:383 ProcessRangeRequest headers: map[] err: invalid range: failed to overlap --- PASS: TestProcessRangeRequestRanges (0.02s) === RUN TestProcessRangeRequestIfRange --- PASS: TestProcessRangeRequestIfRange (0.02s) === RUN TestSubmitForClientHandlerFileSizeLimit === RUN TestSubmitForClientHandlerFileSizeLimit/over_the_limit I1117 09:40:38.021309 common.go:111 response method:POST URL:/submit with httpStatus:400 and JSON:{"error":"file over the limited 1048576 bytes"} === RUN TestSubmitForClientHandlerFileSizeLimit/under_the_limit I1117 09:40:38.308832 common.go:111 response method:POST URL:/submit with httpStatus:500 and JSON:{"error":"context canceled"} --- PASS: TestSubmitForClientHandlerFileSizeLimit (0.56s) --- PASS: TestSubmitForClientHandlerFileSizeLimit/over_the_limit (0.27s) --- PASS: TestSubmitForClientHandlerFileSizeLimit/under_the_limit (0.28s) === RUN TestRedactedURLDropsTheJwt --- PASS: TestRedactedURLDropsTheJwt (0.00s) === RUN TestLookupDirectoryEntriesRejectsInvalidRequests === RUN TestLookupDirectoryEntriesRejectsInvalidRequests/nil_request === RUN TestLookupDirectoryEntriesRejectsInvalidRequests/empty_batch === RUN TestLookupDirectoryEntriesRejectsInvalidRequests/oversized === RUN TestLookupDirectoryEntriesRejectsInvalidRequests/nil_item === RUN TestLookupDirectoryEntriesRejectsInvalidRequests/relative_directory === RUN TestLookupDirectoryEntriesRejectsInvalidRequests/empty_name === RUN TestLookupDirectoryEntriesRejectsInvalidRequests/nested_name --- PASS: TestLookupDirectoryEntriesRejectsInvalidRequests (0.02s) --- PASS: TestLookupDirectoryEntriesRejectsInvalidRequests/nil_request (0.00s) --- PASS: TestLookupDirectoryEntriesRejectsInvalidRequests/empty_batch (0.00s) --- PASS: TestLookupDirectoryEntriesRejectsInvalidRequests/oversized (0.00s) --- PASS: TestLookupDirectoryEntriesRejectsInvalidRequests/nil_item (0.00s) --- PASS: TestLookupDirectoryEntriesRejectsInvalidRequests/relative_directory (0.00s) --- PASS: TestLookupDirectoryEntriesRejectsInvalidRequests/empty_name (0.00s) --- PASS: TestLookupDirectoryEntriesRejectsInvalidRequests/nested_name (0.00s) === RUN TestLookupDirectoryEntriesAcceptsMaximumBatch --- PASS: TestLookupDirectoryEntriesAcceptsMaximumBatch (0.33s) === RUN TestLookupDirectoryEntriesUsesFilerSignatureForFoundAndMiss --- PASS: TestLookupDirectoryEntriesUsesFilerSignatureForFoundAndMiss (0.19s) === RUN TestPopulateBatchReadAuthMintsExactFidCapabilities --- PASS: TestPopulateBatchReadAuthMintsExactFidCapabilities (0.00s) === RUN TestPopulateBatchReadAuthDoesNotInventCapabilitiesWhenSigningIsDisabled --- PASS: TestPopulateBatchReadAuthDoesNotInventCapabilitiesWhenSigningIsDisabled (0.00s) === RUN TestLookupDirectoryEntriesPreservesOrderBoundsParallelismAndDeduplicatesVolumes --- PASS: TestLookupDirectoryEntriesPreservesOrderBoundsParallelismAndDeduplicatesVolumes (0.06s) === RUN TestLookupDirectoryEntriesMarksEntriesWithUnavailableVolumes --- PASS: TestLookupDirectoryEntriesMarksEntriesWithUnavailableVolumes (0.02s) === RUN TestLookupDirectoryEntriesKeepsMalformedEntryError --- PASS: TestLookupDirectoryEntriesKeepsMalformedEntryError (0.01s) === RUN TestLookupDirectoryEntriesCanTreatRetiredCacheVolumeAsMiss --- PASS: TestLookupDirectoryEntriesCanTreatRetiredCacheVolumeAsMiss (0.02s) === RUN TestLookupDirectoryEntriesKeepsCacheEntryWhenMasterIsUnreachable --- PASS: TestLookupDirectoryEntriesKeepsCacheEntryWhenMasterIsUnreachable (0.00s) === RUN TestLookupDirectoryEntriesKeepsMalformedEntryErrorInCacheMode --- PASS: TestLookupDirectoryEntriesKeepsMalformedEntryErrorInCacheMode (0.02s) === RUN TestCacheBatchLookupSelectsAuthoritativeVolumeLocations --- PASS: TestCacheBatchLookupSelectsAuthoritativeVolumeLocations (0.01s) === RUN TestChunkFidsEqualClause --- PASS: TestChunkFidsEqualClause (0.00s) === RUN TestUpdateEntryChunkConditionPreventsStrand === RUN TestUpdateEntryChunkConditionPreventsStrand/unconditional-resurrects === RUN TestUpdateEntryChunkConditionPreventsStrand/condition-rejects-stale === RUN TestUpdateEntryChunkConditionPreventsStrand/condition-passes-fresh === RUN TestUpdateEntryChunkConditionPreventsStrand/empty-expectation-rejects --- PASS: TestUpdateEntryChunkConditionPreventsStrand (0.73s) --- PASS: TestUpdateEntryChunkConditionPreventsStrand/unconditional-resurrects (0.51s) --- PASS: TestUpdateEntryChunkConditionPreventsStrand/condition-rejects-stale (0.03s) --- PASS: TestUpdateEntryChunkConditionPreventsStrand/condition-passes-fresh (0.17s) --- PASS: TestUpdateEntryChunkConditionPreventsStrand/empty-expectation-rejects (0.01s) === RUN TestDeleteEntryWaitsForPathLock --- PASS: TestDeleteEntryWaitsForPathLock (0.29s) === RUN TestCreateEntryCancelledContextFailsRequest --- PASS: TestCreateEntryCancelledContextFailsRequest (0.21s) === RUN TestWriteConditionSatisfied --- PASS: TestWriteConditionSatisfied (0.00s) === RUN TestWriteConditionClauses --- PASS: TestWriteConditionClauses (0.00s) === RUN TestWriteConditionObjectLockGuards --- PASS: TestWriteConditionObjectLockGuards (0.01s) === RUN TestWriteConditionUnknownKindFailsClosed --- PASS: TestWriteConditionUnknownKindFailsClosed (0.00s) === RUN TestIfEntryEqualNormalizesExpected --- PASS: TestIfEntryEqualNormalizesExpected (0.02s) === RUN TestIfEntryEqualSerializedExpected --- PASS: TestIfEntryEqualSerializedExpected (0.00s) === RUN TestStoredEntryETag --- PASS: TestStoredEntryETag (0.00s) === RUN TestCreateEntryConditionEnforced --- PASS: TestCreateEntryConditionEnforced (0.21s) === RUN TestCreateEntryReusesProvidedExisting --- PASS: TestCreateEntryReusesProvidedExisting (0.35s) === RUN TestUpdateEntryConditionEnforced --- PASS: TestUpdateEntryConditionEnforced (0.19s) === RUN TestDeleteCutoff --- PASS: TestDeleteCutoff (0.00s) === RUN TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff === RUN TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff/ns_cutoff,_unchanged === RUN TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff/ns_cutoff,_modified_since === RUN TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff/seconds_cutoff,_same_second === RUN TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff/seconds_cutoff,_modified_since --- PASS: TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff (0.62s) --- PASS: TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff/ns_cutoff,_unchanged (0.15s) --- PASS: TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff/ns_cutoff,_modified_since (0.13s) --- PASS: TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff/seconds_cutoff,_same_second (0.16s) --- PASS: TestDeleteEntryKeepsAnEntryModifiedAfterTheCutoff/seconds_cutoff,_modified_since (0.17s) === RUN TestCreateEntryOExclSerialized --- PASS: TestCreateEntryOExclSerialized (0.19s) === RUN TestCreateEntryExclusiveLeavesNonOwner --- PASS: TestCreateEntryExclusiveLeavesNonOwner (0.30s) === RUN TestCreateEntryPlainStaysLocal --- PASS: TestCreateEntryPlainStaysLocal (0.29s) === RUN TestCreateEntryMovedAppliesLocally --- PASS: TestCreateEntryMovedAppliesLocally (0.19s) === RUN TestCreateEntryMovedFromClientIsNotTrusted --- PASS: TestCreateEntryMovedFromClientIsNotTrusted (0.18s) === RUN TestDistributedUnlockFailedForwardReturnsError --- PASS: TestDistributedUnlockFailedForwardReturnsError (0.19s) === RUN TestCreateEntryExclusiveAppliedByOwner --- PASS: TestCreateEntryExclusiveAppliedByOwner (0.15s) === RUN TestCreateEntryFailsWhenPriorOwnerIsUnreachable --- PASS: TestCreateEntryFailsWhenPriorOwnerIsUnreachable (0.09s) === RUN TestCreateEntryRejectsDotSegments --- PASS: TestCreateEntryRejectsDotSegments (0.11s) === RUN TestFindLockOwnerExpiredLockReturnsNotFound I1117 09:40:43.417257 filer_grpc_server_dlm.go:138 find lock expired-lock moved to : lock not found --- PASS: TestFindLockOwnerExpiredLockReturnsNotFound (0.02s) === RUN TestForwardedLockAcquired === RUN TestForwardedLockAcquired/nil_response === RUN TestForwardedLockAcquired/empty_token === RUN TestForwardedLockAcquired/application_error === RUN TestForwardedLockAcquired/acquired --- PASS: TestForwardedLockAcquired (0.01s) --- PASS: TestForwardedLockAcquired/nil_response (0.00s) --- PASS: TestForwardedLockAcquired/empty_token (0.00s) --- PASS: TestForwardedLockAcquired/application_error (0.00s) --- PASS: TestForwardedLockAcquired/acquired (0.00s) === RUN TestListEntriesSnapshotBelowUnfinishedAndLaterStamps --- PASS: TestListEntriesSnapshotBelowUnfinishedAndLaterStamps (0.02s) === RUN TestMountRegister_EnabledStoresAndLists --- PASS: TestMountRegister_EnabledStoresAndLists (0.00s) === RUN TestMountRegister_RenewIsIdempotent --- PASS: TestMountRegister_RenewIsIdempotent (0.00s) === RUN TestObjectTransactionMultiEntry --- PASS: TestObjectTransactionMultiEntry (0.13s) === RUN TestObjectTransactionPatchNotifies --- PASS: TestObjectTransactionPatchNotifies (0.12s) === RUN TestObjectTransactionPatchContent --- PASS: TestObjectTransactionPatchContent (0.12s) === RUN TestObjectTransactionPreconditionAborts --- PASS: TestObjectTransactionPreconditionAborts (0.11s) === RUN TestObjectTransactionMutationCondition --- PASS: TestObjectTransactionMutationCondition (0.13s) === RUN TestObjectTransactionMutationConditionVsRequest --- PASS: TestObjectTransactionMutationConditionVsRequest (0.14s) === RUN TestObjectTransactionRecomputeLatest --- PASS: TestObjectTransactionRecomputeLatest (0.11s) === RUN TestObjectTransactionRecomputeAscending --- PASS: TestObjectTransactionRecomputeAscending (0.15s) === RUN TestObjectTransactionBatchIndependent --- PASS: TestObjectTransactionBatchIndependent (0.16s) === RUN TestObjectTransactionBatchNilTransaction --- PASS: TestObjectTransactionBatchNilTransaction (0.08s) === RUN TestObjectTransactionIdempotentNoops --- PASS: TestObjectTransactionIdempotentNoops (0.01s) === RUN TestObjectTransactionRecomputeDemoteAndAttrs --- PASS: TestObjectTransactionRecomputeDemoteAndAttrs (0.05s) === RUN TestObjectTransactionPutThenRecomputeLatest --- PASS: TestObjectTransactionPutThenRecomputeLatest (0.02s) === RUN TestObjectTransactionVersionDeleteWithWorm --- PASS: TestObjectTransactionVersionDeleteWithWorm (0.22s) === RUN TestObjectTransactionDeleteRemovesEmptyParent --- PASS: TestObjectTransactionDeleteRemovesEmptyParent (0.06s) === RUN TestObjectTransactionPatchTouchMtime --- PASS: TestObjectTransactionPatchTouchMtime (0.02s) === RUN TestObjectTransactionRouteKeyOwnerAppliesLocally --- PASS: TestObjectTransactionRouteKeyOwnerAppliesLocally (0.02s) === RUN TestObjectTransactionIsMovedSkipsForward --- PASS: TestObjectTransactionIsMovedSkipsForward (0.20s) === RUN TestObjectTransactionForwardsToOwner --- PASS: TestObjectTransactionForwardsToOwner (0.35s) === RUN TestObjectTransactionRequestIdDedupesReplay --- PASS: TestObjectTransactionRequestIdDedupesReplay (0.14s) === RUN TestObjectTransactionRequestIdReplaysRecordedError --- PASS: TestObjectTransactionRequestIdReplaysRecordedError (0.11s) === RUN TestObjectTransactionReplayCacheDropsNewAtCap --- PASS: TestObjectTransactionReplayCacheDropsNewAtCap (0.38s) === RUN TestObjectTransactionConditionFallbackResolvesLatestPointer --- PASS: TestObjectTransactionConditionFallbackResolvesLatestPointer (0.14s) === RUN TestObjectTransactionConditionIgnoresDirectory --- PASS: TestObjectTransactionConditionIgnoresDirectory (0.27s) === RUN TestObjectTransactionConditionPreferAltHonorsNullIsLatest --- PASS: TestObjectTransactionConditionPreferAltHonorsNullIsLatest (0.04s) === RUN TestObjectTransactionPutAppliesConfiguredTTLAndExpires --- PASS: TestObjectTransactionPutAppliesConfiguredTTLAndExpires (0.05s) === RUN TestObjectTransactionPutPreservesExplicitTTL --- PASS: TestObjectTransactionPutPreservesExplicitTTL (0.12s) === RUN TestObjectTransactionPutClearsTTLForRemoteEntry --- PASS: TestObjectTransactionPutClearsTTLForRemoteEntry (0.16s) === RUN TestObjectTransactionPutHonorsMaxFileNameLengthRule --- PASS: TestObjectTransactionPutHonorsMaxFileNameLengthRule (0.10s) === RUN TestObjectTransactionPutFailsOnReadOnlyStorageConfig --- PASS: TestObjectTransactionPutFailsOnReadOnlyStorageConfig (0.01s) === RUN TestPosixLockGrantAndConflict --- PASS: TestPosixLockGrantAndConflict (0.14s) === RUN TestPosixLockUnlockThenReacquire --- PASS: TestPosixLockUnlockThenReacquire (0.11s) === RUN TestPosixLockGetLk --- PASS: TestPosixLockGetLk (0.11s) === RUN TestPosixLockReleasePosixOwnerKeepsFlock --- PASS: TestPosixLockReleasePosixOwnerKeepsFlock (0.04s) === RUN TestPosixLockKeepAlive --- PASS: TestPosixLockKeepAlive (0.00s) === RUN TestPosixLockForwardsToOwner --- PASS: TestPosixLockForwardsToOwner (0.09s) === RUN TestPosixLockWarmupDefersGrants --- PASS: TestPosixLockWarmupDefersGrants (0.12s) === RUN TestRecomputeLatestEmitsPointerUpdateEvent --- PASS: TestRecomputeLatestEmitsPointerUpdateEvent (0.15s) === RUN TestRecomputeLatestDemoteEmitsEvent --- PASS: TestRecomputeLatestDemoteEmitsEvent (0.18s) === RUN TestRecomputeLatestOnlyIfCurrentName === RUN TestRecomputeLatestOnlyIfCurrentName/pointer_names_the_deleted_version === RUN TestRecomputeLatestOnlyIfCurrentName/pointer_names_another_version --- PASS: TestRecomputeLatestOnlyIfCurrentName (0.26s) --- PASS: TestRecomputeLatestOnlyIfCurrentName/pointer_names_the_deleted_version (0.13s) --- PASS: TestRecomputeLatestOnlyIfCurrentName/pointer_names_another_version (0.12s) === RUN TestRemoteNotFoundCrossesTheVolumeServerHop === RUN TestRemoteNotFoundCrossesTheVolumeServerHop/remote_object_gone === RUN TestRemoteNotFoundCrossesTheVolumeServerHop/remote_read_failure === RUN TestRemoteNotFoundCrossesTheVolumeServerHop/not_found_for_other_uses === RUN TestRemoteNotFoundCrossesTheVolumeServerHop/deadline === RUN TestRemoteNotFoundCrossesTheVolumeServerHop/unavailable --- PASS: TestRemoteNotFoundCrossesTheVolumeServerHop (0.02s) --- PASS: TestRemoteNotFoundCrossesTheVolumeServerHop/remote_object_gone (0.00s) --- PASS: TestRemoteNotFoundCrossesTheVolumeServerHop/remote_read_failure (0.00s) --- PASS: TestRemoteNotFoundCrossesTheVolumeServerHop/not_found_for_other_uses (0.00s) --- PASS: TestRemoteNotFoundCrossesTheVolumeServerHop/deadline (0.00s) --- PASS: TestRemoteNotFoundCrossesTheVolumeServerHop/unavailable (0.00s) === RUN TestPruneEntryMissingFromRemote === RUN TestPruneEntryMissingFromRemote/remote_confirms_the_object_gone I1117 09:40:48.681197 filer_grpc_server_remote.go:462 pruned /buckets/b/obj.bin: its remote object no longer exists === RUN TestPruneEntryMissingFromRemote/expired_retention I1117 09:40:48.876289 filer_grpc_server_remote.go:462 pruned /buckets/b/obj.bin: its remote object no longer exists === RUN TestPruneEntryMissingFromRemote/deadline === RUN TestPruneEntryMissingFromRemote/unavailable === RUN TestPruneEntryMissingFromRemote/permission_denied === RUN TestPruneEntryMissingFromRemote/entry_vanished === RUN TestPruneEntryMissingFromRemote/cached_locally === RUN TestPruneEntryMissingFromRemote/inline_content === RUN TestPruneEntryMissingFromRemote/hard_link === RUN TestPruneEntryMissingFromRemote/directory === RUN TestPruneEntryMissingFromRemote/object_version === RUN TestPruneEntryMissingFromRemote/active_retention === RUN TestPruneEntryMissingFromRemote/legal_hold === RUN TestPruneEntryMissingFromRemote/entry_rewritten_since_the_fetch --- PASS: TestPruneEntryMissingFromRemote (1.21s) --- PASS: TestPruneEntryMissingFromRemote/remote_confirms_the_object_gone (0.18s) --- PASS: TestPruneEntryMissingFromRemote/expired_retention (0.19s) --- PASS: TestPruneEntryMissingFromRemote/deadline (0.15s) --- PASS: TestPruneEntryMissingFromRemote/unavailable (0.12s) --- PASS: TestPruneEntryMissingFromRemote/permission_denied (0.14s) --- PASS: TestPruneEntryMissingFromRemote/entry_vanished (0.11s) --- PASS: TestPruneEntryMissingFromRemote/cached_locally (0.01s) --- PASS: TestPruneEntryMissingFromRemote/inline_content (0.01s) --- PASS: TestPruneEntryMissingFromRemote/hard_link (0.11s) --- PASS: TestPruneEntryMissingFromRemote/directory (0.10s) --- PASS: TestPruneEntryMissingFromRemote/object_version (0.02s) --- PASS: TestPruneEntryMissingFromRemote/active_retention (0.01s) --- PASS: TestPruneEntryMissingFromRemote/legal_hold (0.01s) --- PASS: TestPruneEntryMissingFromRemote/entry_rewritten_since_the_fetch (0.01s) === RUN TestPruneLeavesTheRemoteAlone I1117 09:40:49.730523 filer_grpc_server_remote.go:462 pruned /buckets/b/pruned.bin: its remote object no longer exists --- PASS: TestPruneLeavesTheRemoteAlone (0.02s) === RUN TestReplicatedMetadataOnlyDeleteStaysMarked === RUN TestReplicatedMetadataOnlyDeleteStaysMarked/keep_remote_object=true === RUN TestReplicatedMetadataOnlyDeleteStaysMarked/keep_remote_object=false --- PASS: TestReplicatedMetadataOnlyDeleteStaysMarked (0.21s) --- PASS: TestReplicatedMetadataOnlyDeleteStaysMarked/keep_remote_object=true (0.10s) --- PASS: TestReplicatedMetadataOnlyDeleteStaysMarked/keep_remote_object=false (0.10s) === RUN TestPruneOnANonOwnerLeavesTheDeleteToTheOwner W1117 09:40:50.069427 filer_grpc_server_remote.go:453 prune /buckets/b/obj-2.bin missing from remote: rpc error: code = Unavailable desc = connection error: desc = "error reading server preface: connection reset by peer" --- PASS: TestPruneOnANonOwnerLeavesTheDeleteToTheOwner (0.12s) === RUN TestCacheBoundAppliesToTheDownloadedEntry --- PASS: TestCacheBoundAppliesToTheDownloadedEntry (2.15s) === RUN TestRenameRemoteOnlyEntryCopiesBeforeDeletingTheOldObject --- PASS: TestRenameRemoteOnlyEntryCopiesBeforeDeletingTheOldObject (0.14s) === RUN TestRenameRemoteOnlyEntryOverTargetKeepsTheCopy --- PASS: TestRenameRemoteOnlyEntryOverTargetKeepsTheCopy (0.11s) === RUN TestRenameRemoteOnlyEntryCopyFailureKeepsTheOldObject W1117 09:40:52.485449 filer_grpc_server_rename.go:215 remote rename copy of /buckets/b/dst/a.jpg: copy remote r1/origin/src/a.jpg to r1/origin/dst/a.jpg: copy refused --- PASS: TestRenameRemoteOnlyEntryCopyFailureKeepsTheOldObject (0.03s) === RUN TestRenameRemoteOnlyEntryWithoutCopierIsRefused --- PASS: TestRenameRemoteOnlyEntryWithoutCopierIsRefused (0.12s) === RUN TestRenameRemoteOnlyEntryOutOfItsMountIsRefused === RUN TestRenameRemoteOnlyEntryOutOfItsMountIsRefused//buckets/c/a.jpg === RUN TestRenameRemoteOnlyEntryOutOfItsMountIsRefused//data/a.jpg --- PASS: TestRenameRemoteOnlyEntryOutOfItsMountIsRefused (0.19s) --- PASS: TestRenameRemoteOnlyEntryOutOfItsMountIsRefused//buckets/c/a.jpg (0.17s) --- PASS: TestRenameRemoteOnlyEntryOutOfItsMountIsRefused//data/a.jpg (0.01s) === RUN TestRenameEmptyRemoteEntryDoesNotCopy --- PASS: TestRenameEmptyRemoteEntryDoesNotCopy (0.12s) === RUN TestRenameRemoteOnlyEntryFailingAfterTheCopyKeepsTheSource === RUN TestRenameRemoteOnlyEntryFailingAfterTheCopyKeepsTheSource//buckets/b/src/a.jpg === RUN TestRenameRemoteOnlyEntryFailingAfterTheCopyKeepsTheSource//buckets/b/src --- PASS: TestRenameRemoteOnlyEntryFailingAfterTheCopyKeepsTheSource (0.32s) --- PASS: TestRenameRemoteOnlyEntryFailingAfterTheCopyKeepsTheSource//buckets/b/src/a.jpg (0.19s) --- PASS: TestRenameRemoteOnlyEntryFailingAfterTheCopyKeepsTheSource//buckets/b/src (0.12s) === RUN TestRenameEntryWithLocalDataDoesNotCopy --- PASS: TestRenameEntryWithLocalDataDoesNotCopy (0.09s) === RUN TestRenameDirectoryCopiesRemoteOnlyChildren --- PASS: TestRenameDirectoryCopiesRemoteOnlyChildren (0.12s) === RUN TestDeferredOldKeyDeleteKeepsAKeyRetakenSince I1117 09:40:53.606791 filer_grpc_server_rename.go:279 keep remote object of renamed /buckets/b/src/a.jpg: a remote-only entry has taken its path W1117 09:40:53.608533 filer_grpc_server_rename.go:277 keep remote object of renamed /buckets/b/src/a.jpg: look up its old path: store unavailable --- PASS: TestDeferredOldKeyDeleteKeepsAKeyRetakenSince (0.15s) === RUN TestRenameRemoteOnlyEntryFinishesAfterTheCommitOnASQLStore === RUN TestRenameRemoteOnlyEntryFinishesAfterTheCommitOnASQLStore/new_path === RUN TestRenameRemoteOnlyEntryFinishesAfterTheCommitOnASQLStore/over_a_remote-only_target --- PASS: TestRenameRemoteOnlyEntryFinishesAfterTheCommitOnASQLStore (0.20s) --- PASS: TestRenameRemoteOnlyEntryFinishesAfterTheCommitOnASQLStore/new_path (0.09s) --- PASS: TestRenameRemoteOnlyEntryFinishesAfterTheCommitOnASQLStore/over_a_remote-only_target (0.11s) === RUN TestRenamePendingEntryAgainCopiesFromItsSource W1117 09:40:53.954128 filer_grpc_server_rename.go:215 remote rename copy of /buckets/b/dst/a.jpg: copy remote r1/origin/src/a.jpg to r1/origin/dst/a.jpg: copy refused W1117 09:40:53.959209 filer_grpc_server_rename.go:215 remote rename copy of /buckets/b/dst/d.jpg: copy remote r1/origin/src/a.jpg to r1/origin/dst/d.jpg: copy refused --- PASS: TestRenamePendingEntryAgainCopiesFromItsSource (0.15s) === RUN TestRemoteSourcePathStaysInTheMount --- PASS: TestRemoteSourcePathStaysInTheMount (0.22s) === RUN TestTaggingCannotSetThePendingSourceMarker --- PASS: TestTaggingCannotSetThePendingSourceMarker (0.10s) === RUN TestDeletingTagsKeepsThePendingSourceMarker --- PASS: TestDeletingTagsKeepsThePendingSourceMarker (0.06s) === RUN TestAtomicRenameEntryEmitsLogicalRenameEvent --- PASS: TestAtomicRenameEntryEmitsLogicalRenameEvent (0.12s) === RUN TestAtomicRenameEntryOverwriteEmitsDeleteThenRename --- PASS: TestAtomicRenameEntryOverwriteEmitsDeleteThenRename (0.02s) === RUN TestAtomicRenameEntryDoesNotEmitEventOnDeleteFailure --- PASS: TestAtomicRenameEntryDoesNotEmitEventOnDeleteFailure (0.01s) === RUN TestAtomicRenameEntryDoesNotEmitEventOnCommitFailure --- PASS: TestAtomicRenameEntryDoesNotEmitEventOnCommitFailure (0.01s) === RUN TestAtomicRenameEntrySkipsDescendantTargetLookups --- PASS: TestAtomicRenameEntrySkipsDescendantTargetLookups (0.01s) === RUN TestAtomicRenameReleasesQueuedStampsOnCommitFailure --- PASS: TestAtomicRenameReleasesQueuedStampsOnCommitFailure (0.01s) === RUN TestAtomicRenameEntryRejectsDotSegmentTarget --- PASS: TestAtomicRenameEntryRejectsDotSegmentTarget (0.01s) === RUN TestWriteOwnerNoRing --- PASS: TestWriteOwnerNoRing (0.00s) === RUN TestWriteOwnerStableKeyUsesPrimary --- PASS: TestWriteOwnerStableKeyUsesPrimary (0.01s) === RUN TestWriteOwnerMovedKeyUsesPriorOwner --- PASS: TestWriteOwnerMovedKeyUsesPriorOwner (0.01s) === RUN TestForwardToWriteOwnerAppliesLocallyWhenOwned --- PASS: TestForwardToWriteOwnerAppliesLocallyWhenOwned (0.00s) === RUN TestForwardToWriteOwnerNeverTriesASecondFiler --- PASS: TestForwardToWriteOwnerNeverTriesASecondFiler (0.01s) === RUN TestSelfCopyEntryCondition === RUN TestSelfCopyEntryCondition/unchanged_control === RUN TestSelfCopyEntryCondition/mode === RUN TestSelfCopyEntryCondition/mime === RUN TestSelfCopyEntryCondition/legal_hold === RUN TestSelfCopyEntryCondition/content --- PASS: TestSelfCopyEntryCondition (0.36s) --- PASS: TestSelfCopyEntryCondition/unchanged_control (0.11s) --- PASS: TestSelfCopyEntryCondition/mode (0.11s) --- PASS: TestSelfCopyEntryCondition/mime (0.11s) --- PASS: TestSelfCopyEntryCondition/legal_hold (0.01s) --- PASS: TestSelfCopyEntryCondition/content (0.01s) === RUN TestStatisticsReplication --- PASS: TestStatisticsReplication (0.00s) === RUN TestReproStreamSerializationCeiling filer_grpc_server_stream_mutate_bench_test.go:550: service delay: 2ms filer_grpc_server_stream_mutate_bench_test.go:551: concurrency: 12 filer_grpc_server_stream_mutate_bench_test.go:552: ops per run: 1200 filer_grpc_server_stream_mutate_bench_test.go:553: unary : 1200 calls in 610.090223ms -> 1967 QPS filer_grpc_server_stream_mutate_bench_test.go:554: stream : 1200 calls in 3.460955842s -> 347 QPS filer_grpc_server_stream_mutate_bench_test.go:555: unary / stream ratio: 5.67x --- PASS: TestReproStreamSerializationCeiling (4.13s) === RUN TestServerSerialVsConcurrentHandler filer_grpc_server_stream_mutate_bench_test.go:617: service delay: 2ms filer_grpc_server_stream_mutate_bench_test.go:618: server-side concurrency cap: 64 filer_grpc_server_stream_mutate_bench_test.go:619: theoretical serial ceiling: 500 QPS filer_grpc_server_stream_mutate_bench_test.go:620: theoretical concurrent cap: 32000 QPS filer_grpc_server_stream_mutate_bench_test.go:621: ops per run: 2400 filer_grpc_server_stream_mutate_bench_test.go:622: filer_grpc_server_stream_mutate_bench_test.go:623: client workers serial QPS concurrent QPS lift filer_grpc_server_stream_mutate_bench_test.go:637: 1 254 270 1.06x filer_grpc_server_stream_mutate_bench_test.go:637: 12 356 3305 9.29x filer_grpc_server_stream_mutate_bench_test.go:637: 64 343 5645 16.44x filer_grpc_server_stream_mutate_bench_test.go:637: 256 340 5923 17.44x --- PASS: TestServerSerialVsConcurrentHandler (40.75s) === RUN TestSchedulerOrderedParallelism filer_grpc_server_stream_mutate_bench_test.go:698: service delay: 2ms filer_grpc_server_stream_mutate_bench_test.go:699: server concurrency: 64 filer_grpc_server_stream_mutate_bench_test.go:700: client workers: 12 filer_grpc_server_stream_mutate_bench_test.go:701: ops per run: 2400 filer_grpc_server_stream_mutate_bench_test.go:702: serial ceiling: 500 QPS filer_grpc_server_stream_mutate_bench_test.go:703: concurrent ceiling: 32000 QPS (64 x 500) filer_grpc_server_stream_mutate_bench_test.go:704: filer_grpc_server_stream_mutate_bench_test.go:714: workload serial QPS sem QPS sched QPS sched peak-conc filer_grpc_server_stream_mutate_bench_test.go:732: distinct paths 333 3378 3397 11 filer_grpc_server_stream_mutate_bench_test.go:732: same path 338 3448 293 1 --- PASS: TestSchedulerOrderedParallelism (24.67s) === RUN TestStreamSyncVsAsyncClient filer_grpc_server_stream_mutate_bench_test.go:772: service delay: 2ms (theoretical serial ceiling = 500 QPS) filer_grpc_server_stream_mutate_bench_test.go:774: ops per run: 2400 filer_grpc_server_stream_mutate_bench_test.go:775: filer_grpc_server_stream_mutate_bench_test.go:776: concurrency sync QPS async QPS ratio filer_grpc_server_stream_mutate_bench_test.go:789: 1 264 306 1.16 x filer_grpc_server_stream_mutate_bench_test.go:789: 12 323 339 1.05 x filer_grpc_server_stream_mutate_bench_test.go:789: 64 350 338 0.97 x filer_grpc_server_stream_mutate_bench_test.go:789: 256 337 341 1.01 x --- PASS: TestStreamSyncVsAsyncClient (63.61s) === RUN TestMutatePathAncestors --- PASS: TestMutatePathAncestors (0.00s) === RUN TestClassifyMutation === RUN TestClassifyMutation/create_file === RUN TestClassifyMutation/create_directory_(barrier) === RUN TestClassifyMutation/update_file === RUN TestClassifyMutation/update_directory_(non-barrier_attr_bump) === RUN TestClassifyMutation/delete_non-recursive_(barrier:_target_type_unknown) === RUN TestClassifyMutation/delete_recursive_(barrier) === RUN TestClassifyMutation/malformed_create_(nil_Entry) === RUN TestClassifyMutation/malformed_update_(nil_Entry) === RUN TestClassifyMutation/empty_oneof === RUN TestClassifyMutation/rename --- PASS: TestClassifyMutation (0.01s) --- PASS: TestClassifyMutation/create_file (0.00s) --- PASS: TestClassifyMutation/create_directory_(barrier) (0.00s) --- PASS: TestClassifyMutation/update_file (0.00s) --- PASS: TestClassifyMutation/update_directory_(non-barrier_attr_bump) (0.00s) --- PASS: TestClassifyMutation/delete_non-recursive_(barrier:_target_type_unknown) (0.00s) --- PASS: TestClassifyMutation/delete_recursive_(barrier) (0.00s) --- PASS: TestClassifyMutation/malformed_create_(nil_Entry) (0.00s) --- PASS: TestClassifyMutation/malformed_update_(nil_Entry) (0.00s) --- PASS: TestClassifyMutation/empty_oneof (0.00s) --- PASS: TestClassifyMutation/rename (0.00s) === RUN TestPathConflictSamePathFile --- PASS: TestPathConflictSamePathFile (0.00s) === RUN TestPathConflictBarrierBlocksSamePath --- PASS: TestPathConflictBarrierBlocksSamePath (0.00s) === RUN TestPathConflictBarrierBlocksDescendants --- PASS: TestPathConflictBarrierBlocksDescendants (0.00s) === RUN TestPathConflictIncomingBarrierWaitsForDescendants --- PASS: TestPathConflictIncomingBarrierWaitsForDescendants (0.00s) === RUN TestPathConflictNonBarrierDirAllowsDescendants --- PASS: TestPathConflictNonBarrierDirAllowsDescendants (0.00s) === RUN TestPathConflictIncomingBarrierWaitsForSamePathNonBarrier --- PASS: TestPathConflictIncomingBarrierWaitsForSamePathNonBarrier (0.00s) === RUN TestAdmitDoneLifecycle --- PASS: TestAdmitDoneLifecycle (0.05s) === RUN TestAdmitParallelDistinctPaths --- PASS: TestAdmitParallelDistinctPaths (0.00s) === RUN TestAdmitConcurrencyCap --- PASS: TestAdmitConcurrencyCap (0.05s) === RUN TestAdmitRenameTwoPathConflict --- PASS: TestAdmitRenameTwoPathConflict (0.05s) === RUN TestAdmitSamePathFIFO --- PASS: TestAdmitSamePathFIFO (0.05s) === RUN TestAdmitSamePathNonBarrierSerializes --- PASS: TestAdmitSamePathNonBarrierSerializes (0.03s) === RUN TestAdmitPressureFromManyWaiters --- PASS: TestAdmitPressureFromManyWaiters (0.13s) === RUN TestResolveGapResume === RUN TestResolveGapResume/gap_the_ring_dropped_must_NOT_skip === RUN TestResolveGapResume/ancient_cursor_below_the_watermark_must_NOT_skip === RUN TestResolveGapResume/watermark_behind_earliest_must_NOT_skip_(may_be_unflushed) === RUN TestResolveGapResume/flush_watermark_at_earliest_proves_the_gap_and_skips === RUN TestResolveGapResume/flush_watermark_past_earliest_skips === RUN TestResolveGapResume/nothing_evicted_skips_despite_a_stale_flush_watermark === RUN TestResolveGapResume/cursor_on_the_eviction_watermark_skips_with_a_stalled_flush === RUN TestResolveGapResume/memory_not_ahead_of_current_must_NOT_skip === RUN TestResolveGapResume/no_in-memory_data_must_NOT_skip === RUN TestResolveGapResume/exclusive_cursor_adjacent_to_earliest_re-arms_to_a_sentinel === RUN TestResolveGapResume/sentinel_cursor_adjacent_to_earliest_must_NOT_re-arm --- PASS: TestResolveGapResume (0.01s) --- PASS: TestResolveGapResume/gap_the_ring_dropped_must_NOT_skip (0.00s) --- PASS: TestResolveGapResume/ancient_cursor_below_the_watermark_must_NOT_skip (0.00s) --- PASS: TestResolveGapResume/watermark_behind_earliest_must_NOT_skip_(may_be_unflushed) (0.00s) --- PASS: TestResolveGapResume/flush_watermark_at_earliest_proves_the_gap_and_skips (0.00s) --- PASS: TestResolveGapResume/flush_watermark_past_earliest_skips (0.00s) --- PASS: TestResolveGapResume/nothing_evicted_skips_despite_a_stale_flush_watermark (0.00s) --- PASS: TestResolveGapResume/cursor_on_the_eviction_watermark_skips_with_a_stalled_flush (0.00s) --- PASS: TestResolveGapResume/memory_not_ahead_of_current_must_NOT_skip (0.00s) --- PASS: TestResolveGapResume/no_in-memory_data_must_NOT_skip (0.00s) --- PASS: TestResolveGapResume/exclusive_cursor_adjacent_to_earliest_re-arms_to_a_sentinel (0.00s) --- PASS: TestResolveGapResume/sentinel_cursor_adjacent_to_earliest_must_NOT_re-arm (0.00s) === RUN TestGapPassProvenEmptyCrossing --- PASS: TestGapPassProvenEmptyCrossing (0.00s) === RUN TestChunkRefsStopTsNs --- PASS: TestChunkRefsStopTsNs (0.00s) === RUN TestInclusiveDiskCursorOnWatermarkStillAdvances --- PASS: TestInclusiveDiskCursorOnWatermarkStillAdvances (0.00s) === RUN TestParkOnGapExits === RUN TestParkOnGapExits/retries_on_the_timer_with_no_notification_channel === RUN TestParkOnGapExits/a_replaced_client_ends_the_stream_without_parking === RUN TestParkOnGapExits/a_bounded_subscription_past_its_window_ends_without_parking === RUN TestParkOnGapExits/a_bounded_subscription_exactly_at_its_window_ends_without_parking === RUN TestParkOnGapExits/a_cancelled_stream_ends_promptly === RUN TestParkOnGapExits/a_closed_notification_channel_does_not_spin === RUN TestParkOnGapExits/a_notification_wakes_it_early --- PASS: TestParkOnGapExits (4.01s) --- PASS: TestParkOnGapExits/retries_on_the_timer_with_no_notification_channel (2.00s) --- PASS: TestParkOnGapExits/a_replaced_client_ends_the_stream_without_parking (0.00s) --- PASS: TestParkOnGapExits/a_bounded_subscription_past_its_window_ends_without_parking (0.00s) --- PASS: TestParkOnGapExits/a_bounded_subscription_exactly_at_its_window_ends_without_parking (0.00s) --- PASS: TestParkOnGapExits/a_cancelled_stream_ends_promptly (0.00s) --- PASS: TestParkOnGapExits/a_closed_notification_channel_does_not_spin (2.00s) --- PASS: TestParkOnGapExits/a_notification_wakes_it_early (0.00s) === RUN TestGapResumeCursorOffsetIsSentinel --- PASS: TestGapResumeCursorOffsetIsSentinel (0.00s) === RUN TestDiskReadAdvancedRequiresForwardProgress --- PASS: TestDiskReadAdvancedRequiresForwardProgress (0.00s) === RUN TestReportUnprovenAggregatedCrossing W1117 09:43:12.520464 filer_grpc_server_sub_meta.go:274 aggregated subscriber c / crossed an evicted range (1970-01-01 00:00:00.00000001 +0000 UTC..1970-01-01 00:00:00.00000002 +0000 UTC] on peer disk reads; a peer that flushes into it later will not be re-read --- PASS: TestReportUnprovenAggregatedCrossing (0.00s) === RUN TestParkOnGapStallOutcomes === RUN TestParkOnGapStallOutcomes/a_stalled_park_below_the_watermark_skips_to_it W1117 09:43:12.643416 filer_grpc_server_sub_meta.go:390 aggregated subscriber c / parked 15m0s at 2026-11-17 08:42:12 +0000 UTC: test E1117 09:43:12.644278 filer_grpc_server_sub_meta.go:413 aggregated subscriber c / skipping the gap (2026-11-17 08:42:12 +0000 UTC..2026-11-17 08:43:12 +0000 UTC] after 15m0s parked: test; events a peer flushes into that range later will not be delivered === RUN TestParkOnGapStallOutcomes/a_stalled_park_with_nothing_to_skip_to_keeps_waiting W1117 09:43:12.645862 filer_grpc_server_sub_meta.go:390 aggregated subscriber c / parked 15m0s at 2026-11-17 08:43:12 +0000 UTC: test E1117 09:43:12.646214 filer_grpc_server_sub_meta.go:423 aggregated subscriber c / still parked after 15m0s at 2026-11-17 08:43:12 +0000 UTC with nothing to skip to: test W1117 09:43:14.647483 filer_grpc_server_sub_meta.go:434 aggregated subscriber c / disconnected after 2s parked, still behind --- PASS: TestParkOnGapStallOutcomes (2.13s) --- PASS: TestParkOnGapStallOutcomes/a_stalled_park_below_the_watermark_skips_to_it (0.00s) --- PASS: TestParkOnGapStallOutcomes/a_stalled_park_with_nothing_to_skip_to_keeps_waiting (2.00s) === RUN TestDeltaLogFileRefs --- PASS: TestDeltaLogFileRefs (0.00s) === RUN TestRefNeedsReship === RUN TestRefNeedsReship/file_above_the_answer_re-ships === RUN TestRefNeedsReship/complete_answering_file_stays_sent === RUN TestRefNeedsReship/prefix-limited_answering_file_re-ships_its_suffix === RUN TestRefNeedsReship/file_below_a_complete_answer_stays_sent === RUN TestRefNeedsReship/file_below_an_incomplete_answer_stays_sent_(client_moved_past) === RUN TestRefNeedsReship/everything_re-ships_when_nothing_answered --- PASS: TestRefNeedsReship (0.00s) --- PASS: TestRefNeedsReship/file_above_the_answer_re-ships (0.00s) --- PASS: TestRefNeedsReship/complete_answering_file_stays_sent (0.00s) --- PASS: TestRefNeedsReship/prefix-limited_answering_file_re-ships_its_suffix (0.00s) --- PASS: TestRefNeedsReship/file_below_a_complete_answer_stays_sent (0.00s) --- PASS: TestRefNeedsReship/file_below_an_incomplete_answer_stays_sent_(client_moved_past) (0.00s) --- PASS: TestRefNeedsReship/everything_re-ships_when_nothing_answered (0.00s) === RUN TestEachLogEntryFnPrefilterSkipsDecode --- PASS: TestEachLogEntryFnPrefilterSkipsDecode (0.17s) === RUN TestEachLogEntryFnNoFilterDecodesEverything --- PASS: TestEachLogEntryFnNoFilterDecodesEverything (0.00s) === RUN TestEachLogEntryFnDeliversStreamPositionTs --- PASS: TestEachLogEntryFnDeliversStreamPositionTs (0.00s) === RUN TestEachLogEntryFnFilteredHeartbeatUsesStreamPosition --- PASS: TestEachLogEntryFnFilteredHeartbeatUsesStreamPosition (0.00s) === RUN TestEachLogEntryFnPrefilterKeepsMovesIntoPrefix --- PASS: TestEachLogEntryFnPrefilterKeepsMovesIntoPrefix (0.00s) === RUN TestPipelinedSenderThroughput === RUN TestPipelinedSenderThroughput/direct_send filer_grpc_server_sub_meta_test.go:128: direct: 2100 events 2100 sends 2.45s 857 events/sec === RUN TestPipelinedSenderThroughput/pipelined_batched_send filer_grpc_server_sub_meta_test.go:153: pipelined+batch: 2100 events 17 sends 56ms 37501 events/sec === NAME TestPipelinedSenderThroughput filer_grpc_server_sub_meta_test.go:158: Speedup: 43.7x (pipelined+batched vs direct) --- PASS: TestPipelinedSenderThroughput (2.55s) --- PASS: TestPipelinedSenderThroughput/direct_send (2.45s) --- PASS: TestPipelinedSenderThroughput/pipelined_batched_send (0.06s) === RUN TestEachEventNotificationFnMatchesRenameTargetsForAllWatchTypes === RUN TestEachEventNotificationFnMatchesRenameTargetsForAllWatchTypes/additional_path_prefix === RUN TestEachEventNotificationFnMatchesRenameTargetsForAllWatchTypes/directory_watch --- PASS: TestEachEventNotificationFnMatchesRenameTargetsForAllWatchTypes (0.00s) --- PASS: TestEachEventNotificationFnMatchesRenameTargetsForAllWatchTypes/additional_path_prefix (0.00s) --- PASS: TestEachEventNotificationFnMatchesRenameTargetsForAllWatchTypes/directory_watch (0.00s) === RUN TestBatchingAdaptive === RUN TestBatchingAdaptive/old_events_are_batched filer_grpc_server_sub_meta_test.go:233: old events: 500 events in 12 sends (avg batch size: 41.7) === RUN TestBatchingAdaptive/recent_events_sent_individually filer_grpc_server_sub_meta_test.go:252: recent events: 500 events in 500 sends (avg batch size: 1.0) --- PASS: TestBatchingAdaptive (0.31s) --- PASS: TestBatchingAdaptive/old_events_are_batched (0.01s) --- PASS: TestBatchingAdaptive/recent_events_sent_individually (0.30s) === RUN TestPipelinedSenderErrorPropagation === RUN TestPipelinedSenderErrorPropagation/send_returns_error filer_grpc_server_sub_meta_test.go:301: Send returned error after stream failure: connection reset === RUN TestPipelinedSenderErrorPropagation/close_returns_error_if_not_consumed filer_grpc_server_sub_meta_test.go:318: Close returned error: connection reset --- PASS: TestPipelinedSenderErrorPropagation (0.00s) --- PASS: TestPipelinedSenderErrorPropagation/send_returns_error (0.00s) --- PASS: TestPipelinedSenderErrorPropagation/close_returns_error_if_not_consumed (0.00s) === RUN TestPipelinedSingleVsParallelStreams === RUN TestPipelinedSingleVsParallelStreams/1_pipelined_stream filer_grpc_server_sub_meta_test.go:386: 1 stream: 21000 events 192 sends 545ms 38554 events/sec === RUN TestPipelinedSingleVsParallelStreams/10_pipelined_streams filer_grpc_server_sub_meta_test.go:413: 10 streams: 21000 events 205 sends 56ms 376241 events/sec === NAME TestPipelinedSingleVsParallelStreams filer_grpc_server_sub_meta_test.go:418: Speedup: 9.8x (10 parallel pipelined streams vs 1) --- PASS: TestPipelinedSingleVsParallelStreams (0.93s) --- PASS: TestPipelinedSingleVsParallelStreams/1_pipelined_stream (0.55s) --- PASS: TestPipelinedSingleVsParallelStreams/10_pipelined_streams (0.06s) === RUN TestMaybeSendIdleHeartbeat === RUN TestMaybeSendIdleHeartbeat/not_opted_in === RUN TestMaybeSendIdleHeartbeat/behind_buffer_head === RUN TestMaybeSendIdleHeartbeat/caught_up_via_lastSeen === RUN TestMaybeSendIdleHeartbeat/caught_up_via_read_position_floor === RUN TestMaybeSendIdleHeartbeat/throttled_within_interval === RUN TestMaybeSendIdleHeartbeat/send_error_keeps_prior_heartbeat_time I1117 09:43:18.730277 filer_grpc_server_sub_meta.go:1465 => idle heartbeat to : broken stream --- PASS: TestMaybeSendIdleHeartbeat (0.10s) --- PASS: TestMaybeSendIdleHeartbeat/not_opted_in (0.00s) --- PASS: TestMaybeSendIdleHeartbeat/behind_buffer_head (0.00s) --- PASS: TestMaybeSendIdleHeartbeat/caught_up_via_lastSeen (0.00s) --- PASS: TestMaybeSendIdleHeartbeat/caught_up_via_read_position_floor (0.00s) --- PASS: TestMaybeSendIdleHeartbeat/throttled_within_interval (0.00s) --- PASS: TestMaybeSendIdleHeartbeat/send_error_keeps_prior_heartbeat_time (0.00s) === RUN TestFilteredEventsEmitMaxUnsyncedMarker filer_grpc_server_sub_meta_test.go:546: source emits marker{EventNotification:&{}, TsNs:1794908598731688346} after 1001 filtered events --- PASS: TestFilteredEventsEmitMaxUnsyncedMarker (0.05s) === RUN TestPipelinedSenderControlMessagesNeverNested --- PASS: TestPipelinedSenderControlMessagesNeverNested (0.00s) === RUN TestIdleHeartbeatCappedByInflightStamp --- PASS: TestIdleHeartbeatCappedByInflightStamp (0.12s) === RUN TestResolveAggReadHoldTsNs === RUN TestResolveAggReadHoldTsNs/healthy_watermark_ahead_of_horizon === RUN TestResolveAggReadHoldTsNs/stalled_watermark_falls_back_to_horizon === RUN TestResolveAggReadHoldTsNs/unknown_watermark_falls_back_to_horizon === RUN TestResolveAggReadHoldTsNs/watermark_exactly_at_horizon --- PASS: TestResolveAggReadHoldTsNs (0.00s) --- PASS: TestResolveAggReadHoldTsNs/healthy_watermark_ahead_of_horizon (0.00s) --- PASS: TestResolveAggReadHoldTsNs/stalled_watermark_falls_back_to_horizon (0.00s) --- PASS: TestResolveAggReadHoldTsNs/unknown_watermark_falls_back_to_horizon (0.00s) --- PASS: TestResolveAggReadHoldTsNs/watermark_exactly_at_horizon (0.00s) === RUN TestPreviousMinuteEndTsNs --- PASS: TestPreviousMinuteEndTsNs (0.00s) === RUN TestAggWatermarkHoldRewindRedelivers --- PASS: TestAggWatermarkHoldRewindRedelivers (0.15s) === RUN TestResolveAssignStorageOptionUsesBucketRuleBeforeFilerDiskDefault --- PASS: TestResolveAssignStorageOptionUsesBucketRuleBeforeFilerDiskDefault (0.00s) === RUN TestResolveAssignStorageOptionFallsBackToFilerDiskDefault --- PASS: TestResolveAssignStorageOptionFallsBackToFilerDiskDefault (0.00s) === RUN TestAssignVolumeReadOnlyReturnsErrorCode --- PASS: TestAssignVolumeReadOnlyReturnsErrorCode (0.00s) === RUN TestPtrie matched1 /topics/abc matched1 /topics/abc/d matched2 /topics/abc matched2 /topics/abc/d --- PASS: TestPtrie (0.00s) === RUN TestTraverseBfsMetadata I1117 09:43:19.192648 filer_grpc_server_traverse_meta.go:25 TraverseBfsMetadata directory:"/" excluded_prefixes:"/.system" --- PASS: TestTraverseBfsMetadata (0.15s) === RUN TestTraverseBfsMetadataSnapshotMode I1117 09:43:19.380206 filer_grpc_server_traverse_meta.go:25 TraverseBfsMetadata directory:"/" excluded_prefixes:"/.system" --- PASS: TestTraverseBfsMetadataSnapshotMode (0.18s) === RUN TestTraverseBfsMetadataDefaultStillWalks I1117 09:43:19.410407 filer_grpc_server_traverse_meta.go:25 TraverseBfsMetadata directory:"/" --- PASS: TestTraverseBfsMetadataDefaultStillWalks (0.03s) === RUN TestTraverseBfsMetadataSnapshotRequestedButUnsupported I1117 09:43:19.535480 filer_grpc_server_traverse_meta.go:25 TraverseBfsMetadata directory:"/a" --- PASS: TestTraverseBfsMetadataSnapshotRequestedButUnsupported (0.11s) === RUN TestTraverseFromSnapshotLateUnsupportedIsAnError I1117 09:43:19.539781 filer_grpc_server_traverse_meta.go:173 TraverseBfsMetadata /ckpt: snapshot scan failed: entry scan not supported by this filer store --- PASS: TestTraverseFromSnapshotLateUnsupportedIsAnError (0.00s) === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/no_restrictions === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/allowed_prefix_match === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/allowed_prefix_mismatch === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/allowed_method_match === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/allowed_method_mismatch === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/both_match === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/prefix_match,_method_mismatch === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/multiple_prefixes_match === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/write_operation_with_method_restriction === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/root_listing_denied_to_a_prefix_restricted_token === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/root_listing_denied_without_token === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/root_listing_allowed_with_an_unrestricted_token === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/exact_prefix_match === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/tenant_prefix_does_not_match_sibling_tenant === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/tenant_prefix_does_not_match_dashed_sibling === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/tenant_prefix_matches_own_subtree === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/tenant_prefix_with_trailing_slash_matches_own_subtree === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/root_prefix_matches_anywhere === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/dot-dot_cannot_escape_allowed_subtree === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/copy_source_within_subtree_allowed === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/copy_source_outside_subtree_denied === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/copy_source_dot-dot_escape_denied === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/move_source_outside_subtree_denied === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/write_at_the_prefix_itself_allowed === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_into_the_prefix_directory_allowed === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_beside_an_archive_inside_the_prefix_allowed === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_at_the_prefix_itself_writes_to_its_parent,_denied === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_header_at_the_prefix_itself_denied === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_at_a_nested_prefix_into_the_sibling_parent_denied === RUN TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_with_a_root_prefix_allowed --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped (0.10s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/no_restrictions (0.01s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/allowed_prefix_match (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/allowed_prefix_mismatch (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/allowed_method_match (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/allowed_method_mismatch (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/both_match (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/prefix_match,_method_mismatch (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/multiple_prefixes_match (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/write_operation_with_method_restriction (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/root_listing_denied_to_a_prefix_restricted_token (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/root_listing_denied_without_token (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/root_listing_allowed_with_an_unrestricted_token (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/exact_prefix_match (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/tenant_prefix_does_not_match_sibling_tenant (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/tenant_prefix_does_not_match_dashed_sibling (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/tenant_prefix_matches_own_subtree (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/tenant_prefix_with_trailing_slash_matches_own_subtree (0.01s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/root_prefix_matches_anywhere (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/dot-dot_cannot_escape_allowed_subtree (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/copy_source_within_subtree_allowed (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/copy_source_outside_subtree_denied (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/copy_source_dot-dot_escape_denied (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/move_source_outside_subtree_denied (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/write_at_the_prefix_itself_allowed (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_into_the_prefix_directory_allowed (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_beside_an_archive_inside_the_prefix_allowed (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_at_the_prefix_itself_writes_to_its_parent,_denied (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_header_at_the_prefix_itself_denied (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_at_a_nested_prefix_into_the_sibling_parent_denied (0.00s) --- PASS: TestFilerServer_maybeCheckJwtAuthorization_Scoped/extract_with_a_root_prefix_allowed (0.00s) === RUN TestPathHasComponentPrefix === RUN TestPathHasComponentPrefix/exact_match === RUN TestPathHasComponentPrefix/subtree_match === RUN TestPathHasComponentPrefix/trailing_slash_prefix === RUN TestPathHasComponentPrefix/sibling_numeric_suffix === RUN TestPathHasComponentPrefix/sibling_dash_suffix === RUN TestPathHasComponentPrefix/sibling_dot_suffix === RUN TestPathHasComponentPrefix/unrelated_tree === RUN TestPathHasComponentPrefix/root_prefix_matches_root === RUN TestPathHasComponentPrefix/root_prefix_matches_any === RUN TestPathHasComponentPrefix/empty_prefix_denies === RUN TestPathHasComponentPrefix/dot-dot_does_not_escape === RUN TestPathHasComponentPrefix/dot-dot_stays_inside === RUN TestPathHasComponentPrefix/double_slashes_normalised --- PASS: TestPathHasComponentPrefix (0.01s) --- PASS: TestPathHasComponentPrefix/exact_match (0.00s) --- PASS: TestPathHasComponentPrefix/subtree_match (0.00s) --- PASS: TestPathHasComponentPrefix/trailing_slash_prefix (0.00s) --- PASS: TestPathHasComponentPrefix/sibling_numeric_suffix (0.00s) --- PASS: TestPathHasComponentPrefix/sibling_dash_suffix (0.00s) --- PASS: TestPathHasComponentPrefix/sibling_dot_suffix (0.00s) --- PASS: TestPathHasComponentPrefix/unrelated_tree (0.00s) --- PASS: TestPathHasComponentPrefix/root_prefix_matches_root (0.00s) --- PASS: TestPathHasComponentPrefix/root_prefix_matches_any (0.00s) --- PASS: TestPathHasComponentPrefix/empty_prefix_denies (0.00s) --- PASS: TestPathHasComponentPrefix/dot-dot_does_not_escape (0.00s) --- PASS: TestPathHasComponentPrefix/dot-dot_stays_inside (0.00s) --- PASS: TestPathHasComponentPrefix/double_slashes_normalised (0.00s) === RUN TestPipelinedSenderRefsNeverBatched --- PASS: TestPipelinedSenderRefsNeverBatched (0.02s) === RUN TestPipelinedSenderUnblocksOnCancel --- PASS: TestPipelinedSenderUnblocksOnCancel (0.00s) === RUN TestPipelinedSenderStopsSendingOnCancel --- PASS: TestPipelinedSenderStopsSendingOnCancel (0.00s) === RUN TestBucketDefaultCollection === RUN TestBucketDefaultCollection/filer_group_prefixes_bucket === RUN TestBucketDefaultCollection/no_filer_group_keeps_bucket_name === RUN TestBucketDefaultCollection/bucket_root_still_resolves === RUN TestBucketDefaultCollection/unrelated_path_has_no_bucket_collection === RUN TestBucketDefaultCollection/buckets_folder_itself_has_no_bucket --- PASS: TestBucketDefaultCollection (0.00s) --- PASS: TestBucketDefaultCollection/filer_group_prefixes_bucket (0.00s) --- PASS: TestBucketDefaultCollection/no_filer_group_keeps_bucket_name (0.00s) --- PASS: TestBucketDefaultCollection/bucket_root_still_resolves (0.00s) --- PASS: TestBucketDefaultCollection/unrelated_path_has_no_bucket_collection (0.00s) --- PASS: TestBucketDefaultCollection/buckets_folder_itself_has_no_bucket (0.00s) === RUN TestDetectStorageOptionUsesFilerGroupBucketCollection --- PASS: TestDetectStorageOptionUsesFilerGroupBucketCollection (0.00s) === RUN TestDetectStorageOptionPreservesRuleForDirectWrites --- PASS: TestDetectStorageOptionPreservesRuleForDirectWrites (0.00s) === RUN TestDetectStorageOptionExplicitCollectionWins --- PASS: TestDetectStorageOptionExplicitCollectionWins (0.00s) === RUN TestDetectStorageOptionRuleWinsWithoutFilerGroup --- PASS: TestDetectStorageOptionRuleWinsWithoutFilerGroup (0.00s) === RUN TestCopyEntryRefreshesDestinationTimestamps --- PASS: TestCopyEntryRefreshesDestinationTimestamps (0.00s) === RUN TestPreserveDestinationMetadataForDataCopy --- PASS: TestPreserveDestinationMetadataForDataCopy (0.00s) === RUN TestValidateCopySourcePreconditions --- PASS: TestValidateCopySourcePreconditions (0.00s) === RUN TestValidateCopyDestinationPreconditions --- PASS: TestValidateCopyDestinationPreconditions (0.00s) === RUN TestRecentCopyRequestDeduplicatesByRequestID --- PASS: TestRecentCopyRequestDeduplicatesByRequestID (0.00s) === RUN TestExtractZipArchivePut --- PASS: TestExtractZipArchivePut (0.13s) === RUN TestExtractZipArchiveKeep --- PASS: TestExtractZipArchiveKeep (0.13s) === RUN TestExtractZipArchiveKeepSkipsParentName --- PASS: TestExtractZipArchiveKeepSkipsParentName (0.03s) === RUN TestExtractZipArchiveNotAZip I1117 09:43:20.062093 common.go:111 response method:PUT URL:/dst/notzip.bin?extract=zip with httpStatus:400 and JSON:{"error":"extract zip: zip: not a valid zip file"} --- PASS: TestExtractZipArchiveNotAZip (0.08s) === RUN TestExtractZipArchiveMemberLargerThanChunk --- PASS: TestExtractZipArchiveMemberLargerThanChunk (0.63s) === RUN TestExtractZipArchiveRawPost --- PASS: TestExtractZipArchiveRawPost (0.13s) === RUN TestExtractZipArchiveCleansDotSegments --- PASS: TestExtractZipArchiveCleansDotSegments (0.07s) === RUN TestExtractZipArchiveMultipartPost --- PASS: TestExtractZipArchiveMultipartPost (0.09s) === RUN TestIamGrpc_OIDCProviderPutGetListDelete --- PASS: TestIamGrpc_OIDCProviderPutGetListDelete (0.02s) === RUN TestIamGrpc_PutOIDCProviderKeepsWhatTheRequestCannotCarry --- PASS: TestIamGrpc_PutOIDCProviderKeepsWhatTheRequestCannotCarry (0.00s) === RUN TestIamGrpc_RolePutGetListDelete --- PASS: TestIamGrpc_RolePutGetListDelete (0.03s) === RUN TestIamGrpc_STSRefusals === RUN TestIamGrpc_STSRefusals/provider_without_client_IDs === RUN TestIamGrpc_STSRefusals/provider_with_bad_thumbprint === RUN TestIamGrpc_STSRefusals/role_without_trust_policy === RUN TestIamGrpc_STSRefusals/role_with_malformed_trust_policy === RUN TestIamGrpc_STSRefusals/role_with_session_out_of_bounds === RUN TestIamGrpc_STSRefusals/role_name_leaving_the_role_store === RUN TestIamGrpc_STSRefusals/role_over_the_policy_quota === RUN TestIamGrpc_STSRefusals/role_whose_ARN_names_another_role === RUN TestIamGrpc_STSRefusals/role_whose_ARN_is_not_a_role_ARN === RUN TestIamGrpc_STSRefusals/role_attaching_a_missing_policy --- PASS: TestIamGrpc_STSRefusals (0.17s) --- PASS: TestIamGrpc_STSRefusals/provider_without_client_IDs (0.00s) --- PASS: TestIamGrpc_STSRefusals/provider_with_bad_thumbprint (0.06s) --- PASS: TestIamGrpc_STSRefusals/role_without_trust_policy (0.03s) --- PASS: TestIamGrpc_STSRefusals/role_with_malformed_trust_policy (0.02s) --- PASS: TestIamGrpc_STSRefusals/role_with_session_out_of_bounds (0.01s) --- PASS: TestIamGrpc_STSRefusals/role_name_leaving_the_role_store (0.00s) --- PASS: TestIamGrpc_STSRefusals/role_over_the_policy_quota (0.00s) --- PASS: TestIamGrpc_STSRefusals/role_whose_ARN_names_another_role (0.00s) --- PASS: TestIamGrpc_STSRefusals/role_whose_ARN_is_not_a_role_ARN (0.00s) --- PASS: TestIamGrpc_STSRefusals/role_attaching_a_missing_policy (0.00s) === RUN TestIamGrpc_UnreadableStoreIsUnavailableNotAbsent --- PASS: TestIamGrpc_UnreadableStoreIsUnavailableNotAbsent (0.02s) === RUN TestIamGrpc_STSRPCsWithoutStoresAreFailedPrecondition --- PASS: TestIamGrpc_STSRPCsWithoutStoresAreFailedPrecondition (0.00s) === RUN TestIamGrpc_STSRPCsRequireAuth === RUN TestIamGrpc_STSRPCsRequireAuth/PutOIDCProvider === RUN TestIamGrpc_STSRPCsRequireAuth/GetOIDCProvider === RUN TestIamGrpc_STSRPCsRequireAuth/DeleteOIDCProvider === RUN TestIamGrpc_STSRPCsRequireAuth/ListOIDCProviders === RUN TestIamGrpc_STSRPCsRequireAuth/PutRole === RUN TestIamGrpc_STSRPCsRequireAuth/GetRole === RUN TestIamGrpc_STSRPCsRequireAuth/DeleteRole === RUN TestIamGrpc_STSRPCsRequireAuth/ListRoles --- PASS: TestIamGrpc_STSRPCsRequireAuth (0.02s) --- PASS: TestIamGrpc_STSRPCsRequireAuth/PutOIDCProvider (0.00s) --- PASS: TestIamGrpc_STSRPCsRequireAuth/GetOIDCProvider (0.01s) --- PASS: TestIamGrpc_STSRPCsRequireAuth/DeleteOIDCProvider (0.00s) --- PASS: TestIamGrpc_STSRPCsRequireAuth/ListOIDCProviders (0.00s) --- PASS: TestIamGrpc_STSRPCsRequireAuth/PutRole (0.00s) --- PASS: TestIamGrpc_STSRPCsRequireAuth/GetRole (0.00s) --- PASS: TestIamGrpc_STSRPCsRequireAuth/DeleteRole (0.00s) --- PASS: TestIamGrpc_STSRPCsRequireAuth/ListRoles (0.00s) === RUN TestIamGrpc_DeletePolicyAttachedToARoleIsRefused --- PASS: TestIamGrpc_DeletePolicyAttachedToARoleIsRefused (0.05s) === RUN TestIamGrpc_PutOIDCProviderRequiresHTTPSExceptOnLoopback --- PASS: TestIamGrpc_PutOIDCProviderRequiresHTTPSExceptOnLoopback (0.02s) === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/GetOIDCProvider === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/DeleteOIDCProvider === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/ListOIDCProviders === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/PutRole === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/GetRole === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/DeleteRole === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/ListRoles === RUN TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/PutOIDCProvider --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService (0.01s) --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/GetOIDCProvider (0.00s) --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/DeleteOIDCProvider (0.00s) --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/ListOIDCProviders (0.00s) --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/PutRole (0.00s) --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/GetRole (0.00s) --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/DeleteRole (0.00s) --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/ListRoles (0.00s) --- PASS: TestIamGrpc_STSRPCsRefuseAnUnauthenticatedService/PutOIDCProvider (0.00s) === RUN TestIamGrpc_PutRoleRacingADeleteDoesNotReviveTheOldRoleID --- PASS: TestIamGrpc_PutRoleRacingADeleteDoesNotReviveTheOldRoleID (0.00s) === RUN TestIamGrpc_DeleteRoleDoesNotDeleteARoleReplacedMeanwhile --- PASS: TestIamGrpc_DeleteRoleDoesNotDeleteARoleReplacedMeanwhile (0.00s) === RUN TestIamGrpc_PutOIDCProviderRacingADeleteKeepsNoOldFields --- PASS: TestIamGrpc_PutOIDCProviderRacingADeleteKeepsNoOldFields (0.00s) === RUN TestIamGrpc_DeleteOIDCProviderDoesNotDeleteAProviderReplacedMeanwhile --- PASS: TestIamGrpc_DeleteOIDCProviderDoesNotDeleteAProviderReplacedMeanwhile (0.01s) === RUN TestIamGrpc_NoMetadata_Unauthenticated --- PASS: TestIamGrpc_NoMetadata_Unauthenticated (0.00s) === RUN TestIamGrpc_MissingAuthorizationHeader_Unauthenticated --- PASS: TestIamGrpc_MissingAuthorizationHeader_Unauthenticated (0.00s) === RUN TestIamGrpc_NonBearerAuthorization_Unauthenticated --- PASS: TestIamGrpc_NonBearerAuthorization_Unauthenticated (0.00s) === RUN TestIamGrpc_InvalidToken_Unauthenticated --- PASS: TestIamGrpc_InvalidToken_Unauthenticated (0.00s) === RUN TestIamGrpc_GarbageToken_Unauthenticated --- PASS: TestIamGrpc_GarbageToken_Unauthenticated (0.00s) === RUN TestIamGrpc_ExpiredToken_Unauthenticated --- PASS: TestIamGrpc_ExpiredToken_Unauthenticated (0.00s) === RUN TestIamGrpc_ValidToken_ReachesHandler --- PASS: TestIamGrpc_ValidToken_ReachesHandler (0.00s) === RUN TestIamGrpc_ValidTokenAfterStaleToken_ReachesHandler --- PASS: TestIamGrpc_ValidTokenAfterStaleToken_ReachesHandler (0.00s) === RUN TestIamGrpc_AllInvalidTokens_Unauthenticated --- PASS: TestIamGrpc_AllInvalidTokens_Unauthenticated (0.00s) === RUN TestIamGrpc_NoSigningKey_Unauthenticated_Allowed --- PASS: TestIamGrpc_NoSigningKey_Unauthenticated_Allowed (0.00s) === RUN TestIamGrpc_CreateUser_RequiresAuth --- PASS: TestIamGrpc_CreateUser_RequiresAuth (0.00s) === RUN TestProxyReadDropsCallerJwtQueryParam === RUN TestProxyReadDropsCallerJwtQueryParam/GET === RUN TestProxyReadDropsCallerJwtQueryParam/HEAD --- PASS: TestProxyReadDropsCallerJwtQueryParam (0.15s) --- PASS: TestProxyReadDropsCallerJwtQueryParam/GET (0.12s) --- PASS: TestProxyReadDropsCallerJwtQueryParam/HEAD (0.03s) === RUN TestProxyWriteDropsCallerJwtQueryParam --- PASS: TestProxyWriteDropsCallerJwtQueryParam (0.01s) === RUN TestProxyMintsNothingWithoutKey === RUN TestProxyMintsNothingWithoutKey/read_with_only_a_write_key === RUN TestProxyMintsNothingWithoutKey/write_with_only_a_read_key --- PASS: TestProxyMintsNothingWithoutKey (0.00s) --- PASS: TestProxyMintsNothingWithoutKey/read_with_only_a_write_key (0.00s) --- PASS: TestProxyMintsNothingWithoutKey/write_with_only_a_read_key (0.00s) === RUN TestProxyReadTokenIsReadOnly --- PASS: TestProxyReadTokenIsReadOnly (0.00s) === RUN TestProxyWriteCarriesMintedWriteToken === RUN TestProxyWriteCarriesMintedWriteToken/POST === RUN TestProxyWriteCarriesMintedWriteToken/PUT === RUN TestProxyWriteCarriesMintedWriteToken/DELETE --- PASS: TestProxyWriteCarriesMintedWriteToken (0.03s) --- PASS: TestProxyWriteCarriesMintedWriteToken/POST (0.01s) --- PASS: TestProxyWriteCarriesMintedWriteToken/PUT (0.01s) --- PASS: TestProxyWriteCarriesMintedWriteToken/DELETE (0.01s) === RUN TestProxyReadReplacesCallerCredential --- PASS: TestProxyReadReplacesCallerCredential (0.01s) === RUN TestProxyDropsCallerCredentialWhenNothingMinted === RUN TestProxyDropsCallerCredentialWhenNothingMinted/GET === RUN TestProxyDropsCallerCredentialWhenNothingMinted/HEAD === RUN TestProxyDropsCallerCredentialWhenNothingMinted/POST === RUN TestProxyDropsCallerCredentialWhenNothingMinted/DELETE --- PASS: TestProxyDropsCallerCredentialWhenNothingMinted (0.03s) --- PASS: TestProxyDropsCallerCredentialWhenNothingMinted/GET (0.01s) --- PASS: TestProxyDropsCallerCredentialWhenNothingMinted/HEAD (0.00s) --- PASS: TestProxyDropsCallerCredentialWhenNothingMinted/POST (0.02s) --- PASS: TestProxyDropsCallerCredentialWhenNothingMinted/DELETE (0.00s) === RUN TestProxyWriteBypassesReadSemaphore --- PASS: TestProxyWriteBypassesReadSemaphore (0.01s) === RUN TestProxyReadTokenMatchesDeltaFid --- PASS: TestProxyReadTokenMatchesDeltaFid (0.00s) === RUN TestValidateProxyChunkId --- PASS: TestValidateProxyChunkId (0.00s) === RUN TestProxyRejectsTraversalBeforeLookup --- PASS: TestProxyRejectsTraversalBeforeLookup (0.00s) === RUN TestFilerHandlerGatesChunkProxy === RUN TestFilerHandlerGatesChunkProxy/GET I1117 09:43:21.665064 common.go:111 response method:GET URL:http://filer:8888/?proxyChunkId=3,01637037d6 with httpStatus:401 and JSON:{"error":"wrong jwt"} === RUN TestFilerHandlerGatesChunkProxy/HEAD I1117 09:43:21.670970 common.go:111 response method:HEAD URL:http://filer:8888/?proxyChunkId=3,01637037d6 with httpStatus:401 and JSON:{"error":"wrong jwt"} === RUN TestFilerHandlerGatesChunkProxy/PUT I1117 09:43:21.677847 common.go:111 response method:PUT URL:http://filer:8888/?proxyChunkId=3,01637037d6 with httpStatus:401 and JSON:{"error":"wrong jwt"} === RUN TestFilerHandlerGatesChunkProxy/POST I1117 09:43:21.679255 common.go:111 response method:POST URL:http://filer:8888/?proxyChunkId=3,01637037d6 with httpStatus:401 and JSON:{"error":"wrong jwt"} === RUN TestFilerHandlerGatesChunkProxy/DELETE I1117 09:43:21.680721 common.go:111 response method:DELETE URL:http://filer:8888/?proxyChunkId=3,01637037d6 with httpStatus:401 and JSON:{"error":"wrong jwt"} --- PASS: TestFilerHandlerGatesChunkProxy (0.02s) --- PASS: TestFilerHandlerGatesChunkProxy/GET (0.01s) --- PASS: TestFilerHandlerGatesChunkProxy/HEAD (0.01s) --- PASS: TestFilerHandlerGatesChunkProxy/PUT (0.00s) --- PASS: TestFilerHandlerGatesChunkProxy/POST (0.00s) --- PASS: TestFilerHandlerGatesChunkProxy/DELETE (0.00s) === RUN TestFilerHandlerProxiesChunkForAuthorizedCaller --- PASS: TestFilerHandlerProxiesChunkForAuthorizedCaller (0.00s) === RUN TestProxySemaphore_LimitsConcurrency --- PASS: TestProxySemaphore_LimitsConcurrency (0.01s) === RUN TestProxySemaphore_ContextCancellation --- PASS: TestProxySemaphore_ContextCancellation (0.00s) === RUN TestProxySemaphore_PerHostIsolation --- PASS: TestProxySemaphore_PerHostIsolation (0.00s) === RUN TestListDirectoryWriteControlsFollowPort --- PASS: TestListDirectoryWriteControlsFollowPort (0.35s) === RUN TestCheckPreconditionsETagLists --- PASS: TestCheckPreconditionsETagLists (0.01s) === RUN TestCheckPreconditionsPresentButEmptyHeaders --- PASS: TestCheckPreconditionsPresentButEmptyHeaders (0.00s) === RUN TestCheckPreconditionsIgnoresEmptyETagListElements --- PASS: TestCheckPreconditionsIgnoresEmptyETagListElements (0.00s) === RUN TestFilerWaitForUploadSlot === RUN TestFilerWaitForUploadSlot/times_out_with_429 I1117 09:43:22.166011 common.go:111 response method:PUT URL:/dir/file with httpStatus:429 and JSON:{"error":"reject because no upload slot freed within 100ms"} === RUN TestFilerWaitForUploadSlot/stalled_body_still_gets_the_429 I1117 09:43:22.278194 common.go:111 response method:PUT URL:/dir/file with httpStatus:429 and JSON:{"error":"reject because no upload slot freed within 100ms"} === RUN TestFilerWaitForUploadSlot/cancelled_request_stops_waiting I1117 09:43:22.840142 common.go:111 response method:PUT URL:/dir/file with httpStatus:499 and JSON:{"error":"context canceled"} --- PASS: TestFilerWaitForUploadSlot (0.78s) --- PASS: TestFilerWaitForUploadSlot/times_out_with_429 (0.11s) --- PASS: TestFilerWaitForUploadSlot/stalled_body_still_gets_the_429 (0.62s) --- PASS: TestFilerWaitForUploadSlot/cancelled_request_stops_waiting (0.05s) === RUN TestFilerInlineAppendStaysInlineBelowLimit --- PASS: TestFilerInlineAppendStaysInlineBelowLimit (0.06s) === RUN TestFilerInlineAppendEmptyKeepsInlineContent --- PASS: TestFilerInlineAppendEmptyKeepsInlineContent (0.11s) === RUN TestFilerInlineAppendRejectsPromotionWithoutChunkSize --- PASS: TestFilerInlineAppendRejectsPromotionWithoutChunkSize (0.10s) === RUN TestFilerInlineAppendMultipartPostStaysInline --- PASS: TestFilerInlineAppendMultipartPostStaysInline (0.13s) === RUN TestFilerSaveInsideMultipartPostRecordsSize --- PASS: TestFilerSaveInsideMultipartPostRecordsSize (0.08s) === RUN TestFilerSaveInsideMultipartPostRejectsBadDigest --- PASS: TestFilerSaveInsideMultipartPostRejectsBadDigest (0.11s) === RUN TestFilerSaveInsideMultipartAppendRejected === RUN TestFilerSaveInsideMultipartAppendRejected/chunk_backed_target I1117 09:43:23.519610 common.go:111 response method:POST URL:/append-target.txt?op=append with httpStatus:400 and JSON:{"error":"append saved inside the entry to a chunked file is not supported"} === RUN TestFilerSaveInsideMultipartAppendRejected/inline_target I1117 09:43:23.639421 common.go:111 response method:POST URL:/append-target.txt?op=append with httpStatus:400 and JSON:{"error":"append to inline content with this storage mode is not supported"} --- PASS: TestFilerSaveInsideMultipartAppendRejected (0.22s) --- PASS: TestFilerSaveInsideMultipartAppendRejected/chunk_backed_target (0.10s) --- PASS: TestFilerSaveInsideMultipartAppendRejected/inline_target (0.12s) === RUN TestFilerInlineOffsetWriteRemainsUnsupported --- PASS: TestFilerInlineOffsetWriteRemainsUnsupported (0.10s) === RUN TestFilerInlineAppendReadErrorKeepsOriginalEntry --- PASS: TestFilerInlineAppendReadErrorKeepsOriginalEntry (0.12s) === RUN TestFilerInlineAppendBadDigestKeepsOriginalEntry --- PASS: TestFilerInlineAppendBadDigestKeepsOriginalEntry (0.10s) === RUN TestFilerChunkAppendStillOffsetsNewChunks --- PASS: TestFilerChunkAppendStillOffsetsNewChunks (0.09s) === RUN TestFilerInlineAppendPromotesAtLimit === RUN TestFilerInlineAppendPromotesAtLimit/exactly_reaches_limit === RUN TestFilerInlineAppendPromotesAtLimit/crosses_limit === RUN TestFilerInlineAppendPromotesAtLimit/metadata_write_fails E1117 09:43:25.069402 filer.go:621 update entry /append.txt: injected metadata update failure I1117 09:43:25.070640 filer_server_handlers_write_autochunk.go:534 failing to write /append.txt to filer server : update entry /append.txt: injected metadata update failure === RUN TestFilerInlineAppendPromotesAtLimit/metadata_result_cannot_be_verified E1117 09:43:25.262524 filer.go:621 update entry /append.txt: injected ambiguous metadata update failure I1117 09:43:25.263106 filer_server_handlers_write_autochunk.go:534 failing to write /append.txt to filer server : update entry /append.txt: injected ambiguous metadata update failure I1117 09:43:25.263725 filer_server_handlers_write_autochunk.go:566 cannot verify inline append chunks for /append.txt after metadata write failure: injected verification lookup failure; retaining them --- PASS: TestFilerInlineAppendPromotesAtLimit (1.22s) --- PASS: TestFilerInlineAppendPromotesAtLimit/exactly_reaches_limit (0.42s) --- PASS: TestFilerInlineAppendPromotesAtLimit/crosses_limit (0.23s) --- PASS: TestFilerInlineAppendPromotesAtLimit/metadata_write_fails (0.37s) --- PASS: TestFilerInlineAppendPromotesAtLimit/metadata_result_cannot_be_verified (0.19s) === RUN TestFilerInlineAppendRealThresholdBoundaries === RUN TestFilerInlineAppendRealThresholdBoundaries/final_size_65535 === RUN TestFilerInlineAppendRealThresholdBoundaries/final_size_65536 === RUN TestFilerInlineAppendRealThresholdBoundaries/final_size_65537 --- PASS: TestFilerInlineAppendRealThresholdBoundaries (0.80s) --- PASS: TestFilerInlineAppendRealThresholdBoundaries/final_size_65535 (0.21s) --- PASS: TestFilerInlineAppendRealThresholdBoundaries/final_size_65536 (0.30s) --- PASS: TestFilerInlineAppendRealThresholdBoundaries/final_size_65537 (0.28s) === RUN TestFilerInlineAppendEmptyFileStaysInline --- PASS: TestFilerInlineAppendEmptyFileStaysInline (0.13s) === RUN TestFilerInlineAppendKeepsETag --- PASS: TestFilerInlineAppendKeepsETag (0.11s) === RUN TestFilerInlineAppendConcurrentKeepsAllData --- PASS: TestFilerInlineAppendConcurrentKeepsAllData (0.20s) === RUN TestFilerInlineAppendRejectsEntryChangedMidWrite --- PASS: TestFilerInlineAppendRejectsEntryChangedMidWrite (0.07s) === RUN TestFilerChunkAppendWithExtendedHeaders --- PASS: TestFilerChunkAppendWithExtendedHeaders (0.11s) === RUN TestLeaveLockRingWaitsForRemovalThenPriorOwnerWindow I1117 09:43:26.848070 filer_server.go:750 LockRing: filer1:18888 left, serving prior-owner requests until 2026-11-17 09:43:28.09813308 +0000 UTC m=+174.459151328 --- PASS: TestLeaveLockRingWaitsForRemovalThenPriorOwnerWindow (1.41s) === RUN TestLeaveLockRingGivesUpWhenTheMasterKeepsTheFiler W1117 09:43:28.305836 filer_server.go:744 LockRing: filer1:18888 still in the ring after 200ms, shutting down anyway --- PASS: TestLeaveLockRingGivesUpWhenTheMasterKeepsTheFiler (0.21s) === RUN TestLeaveLockRingSkipsALoneFiler --- PASS: TestLeaveLockRingSkipsALoneFiler (0.00s) === RUN TestLeaveLockRingIsBoundedBySlowLockTransfers W1117 09:43:28.613471 filer_server.go:531 LockRing: filer1:18888 did not finish leaving within 300ms, shutting down anyway --- PASS: TestLeaveLockRingIsBoundedBySlowLockTransfers (0.31s) === RUN TestNativeCacheWriteUsesOneTtlForAllocationAndEntry --- PASS: TestNativeCacheWriteUsesOneTtlForAllocationAndEntry (0.08s) === RUN TestObjectTransactionPutAppliesRuleTtl --- PASS: TestObjectTransactionPutAppliesRuleTtl (0.10s) === RUN TestCopyAppliesRuleTtl === RUN TestCopyAppliesRuleTtl/source_ttl_0 === RUN TestCopyAppliesRuleTtl/source_ttl_600 --- PASS: TestCopyAppliesRuleTtl (0.24s) --- PASS: TestCopyAppliesRuleTtl/source_ttl_0 (0.11s) --- PASS: TestCopyAppliesRuleTtl/source_ttl_600 (0.12s) === RUN TestCopyKeepsRemoteEntryUnexpiring --- PASS: TestCopyKeepsRemoteEntryUnexpiring (0.07s) === RUN TestPostHandlerMatchesStorageRuleOnDecodedPath I1117 09:43:29.225731 common.go:111 response method:POST URL:/data/%E5%8F%AA%E8%AF%BB/dst.txt?cp.from=/src.txt with httpStatus:507 and JSON:{"error":"read only: /data/只读/ (e.g. bucket over quota)"} --- PASS: TestPostHandlerMatchesStorageRuleOnDecodedPath (0.12s) === RUN TestCompleteTusUploadAppliesRuleTtl --- PASS: TestCompleteTusUploadAppliesRuleTtl (0.11s) === RUN TestStopSubscriptionsEndsOpenSubscriptions --- PASS: TestStopSubscriptionsEndsOpenSubscriptions (0.00s) === RUN TestSubscriptionStartedAfterStopEndsAtOnce --- PASS: TestSubscriptionStartedAfterStopEndsAtOnce (0.00s) === RUN TestSubscriptionStillEndsWithItsStream --- PASS: TestSubscriptionStillEndsWithItsStream (0.00s) === RUN TestSubscriptionContextWithoutStopSignal --- PASS: TestSubscriptionContextWithoutStopSignal (0.00s) === RUN TestStoppedSubscriptionEndsUnavailable --- PASS: TestStoppedSubscriptionEndsUnavailable (0.00s) === RUN TestSubscriptionEndsCleanlyWithoutStop --- PASS: TestSubscriptionEndsCleanlyWithoutStop (0.00s) === RUN TestSubscriptionErrorPassesThroughStop --- PASS: TestSubscriptionErrorPassesThroughStop (0.00s) === RUN TestClosedStreamEndsCleanlyDuringStop --- PASS: TestClosedStreamEndsCleanlyDuringStop (0.00s) === RUN TestCanceledReadEndsUnavailableDuringStop --- PASS: TestCanceledReadEndsUnavailableDuringStop (0.00s) === RUN TestCanceledReadPassesThroughWithoutStop --- PASS: TestCanceledReadPassesThroughWithoutStop (0.00s) === RUN TestEachLogEntryFnEndsOnCancel --- PASS: TestEachLogEntryFnEndsOnCancel (0.00s) === RUN TestFilerServer_completeTusUpload_OverlappingRecords === RUN TestFilerServer_completeTusUpload_OverlappingRecords/exact_duplicate_dropped === RUN TestFilerServer_completeTusUpload_OverlappingRecords/partial_overlap_kept === RUN TestFilerServer_completeTusUpload_OverlappingRecords/duplicate_sharing_a_kept_file_id --- PASS: TestFilerServer_completeTusUpload_OverlappingRecords (0.38s) --- PASS: TestFilerServer_completeTusUpload_OverlappingRecords/exact_duplicate_dropped (0.13s) --- PASS: TestFilerServer_completeTusUpload_OverlappingRecords/partial_overlap_kept (0.12s) --- PASS: TestFilerServer_completeTusUpload_OverlappingRecords/duplicate_sharing_a_kept_file_id (0.13s) === RUN TestFilerServer_completeTusUpload_GapRejected --- PASS: TestFilerServer_completeTusUpload_GapRejected (0.10s) === RUN TestFilerServer_completeTusUpload_ReadOnlyTarget --- PASS: TestFilerServer_completeTusUpload_ReadOnlyTarget (0.11s) === RUN TestFilerServer_tusPatchHandler_PartialSkipsCompletion === RUN TestFilerServer_tusPatchHandler_PartialSkipsCompletion/plain_upload_completes === RUN TestFilerServer_tusPatchHandler_PartialSkipsCompletion/partial_upload_retained --- PASS: TestFilerServer_tusPatchHandler_PartialSkipsCompletion (0.14s) --- PASS: TestFilerServer_tusPatchHandler_PartialSkipsCompletion/plain_upload_completes (0.07s) --- PASS: TestFilerServer_tusPatchHandler_PartialSkipsCompletion/partial_upload_retained (0.07s) === RUN TestFilerServer_tusHeadHandler_EchoesUploadConcat --- PASS: TestFilerServer_tusHeadHandler_EchoesUploadConcat (0.09s) === RUN TestFilerServer_tusConcatFinal_AssemblesPartials --- PASS: TestFilerServer_tusConcatFinal_AssemblesPartials (0.14s) === RUN TestFilerServer_tusConcatFinal_Validation === RUN TestFilerServer_tusConcatFinal_Validation/upload_length_rejected === RUN TestFilerServer_tusConcatFinal_Validation/body_rejected === RUN TestFilerServer_tusConcatFinal_Validation/reference_outside_uploads_prefix === RUN TestFilerServer_tusConcatFinal_Validation/duplicate_reference === RUN TestFilerServer_tusConcatFinal_Validation/empty_reference_list === RUN TestFilerServer_tusConcatFinal_Validation/missing_partial === RUN TestFilerServer_tusConcatFinal_Validation/non-partial_session_rejected === RUN TestFilerServer_tusConcatFinal_Validation/unfinished_partial_rejected === RUN TestFilerServer_tusConcatFinal_Validation/cross-prefix_partial_denied I1117 09:43:31.220663 common.go:111 response method:POST URL:/.tus/buckets/data/final.bin with httpStatus:401 and JSON:{"error":"wrong jwt"} === RUN TestFilerServer_tusConcatFinal_Validation/combined_size_over_maximum --- PASS: TestFilerServer_tusConcatFinal_Validation (1.02s) --- PASS: TestFilerServer_tusConcatFinal_Validation/upload_length_rejected (0.11s) --- PASS: TestFilerServer_tusConcatFinal_Validation/body_rejected (0.11s) --- PASS: TestFilerServer_tusConcatFinal_Validation/reference_outside_uploads_prefix (0.06s) --- PASS: TestFilerServer_tusConcatFinal_Validation/duplicate_reference (0.10s) --- PASS: TestFilerServer_tusConcatFinal_Validation/empty_reference_list (0.10s) --- PASS: TestFilerServer_tusConcatFinal_Validation/missing_partial (0.11s) --- PASS: TestFilerServer_tusConcatFinal_Validation/non-partial_session_rejected (0.11s) --- PASS: TestFilerServer_tusConcatFinal_Validation/unfinished_partial_rejected (0.11s) --- PASS: TestFilerServer_tusConcatFinal_Validation/cross-prefix_partial_denied (0.09s) --- PASS: TestFilerServer_tusConcatFinal_Validation/combined_size_over_maximum (0.12s) === RUN TestFilerServer_tusConcatFinal_ClaimedPartialRejected --- PASS: TestFilerServer_tusConcatFinal_ClaimedPartialRejected (0.05s) === RUN TestFilerServer_tusDeleteHandler_ConsumedSessionKeepsChunks --- PASS: TestFilerServer_tusDeleteHandler_ConsumedSessionKeepsChunks (0.10s) === RUN TestFilerServer_tusPatchHandler_FinalRejected --- PASS: TestFilerServer_tusPatchHandler_FinalRejected (0.06s) === RUN TestFilerServer_tusHandler_CrossPrefixSessionHijack === RUN TestFilerServer_tusHandler_CrossPrefixSessionHijack/cross-prefix_HEAD_denied I1117 09:43:31.650985 common.go:111 response method:HEAD URL:/.tus/.uploads/9f6f0d4b-6556-48f6-b953-0d8fca1966f1 with httpStatus:401 and JSON:{"error":"wrong jwt"} === RUN TestFilerServer_tusHandler_CrossPrefixSessionHijack/matching-prefix_HEAD_allowed === RUN TestFilerServer_tusHandler_CrossPrefixSessionHijack/cross-prefix_PATCH_denied I1117 09:43:31.872573 common.go:111 response method:PATCH URL:/.tus/.uploads/9f6f0d4b-6556-48f6-b953-0d8fca1966f1 with httpStatus:401 and JSON:{"error":"wrong jwt"} === RUN TestFilerServer_tusHandler_CrossPrefixSessionHijack/matching-prefix_PATCH_allowed === RUN TestFilerServer_tusHandler_CrossPrefixSessionHijack/cross-prefix_DELETE_denied I1117 09:43:32.091522 common.go:111 response method:DELETE URL:/.tus/.uploads/9f6f0d4b-6556-48f6-b953-0d8fca1966f1 with httpStatus:401 and JSON:{"error":"wrong jwt"} === RUN TestFilerServer_tusHandler_CrossPrefixSessionHijack/matching-prefix_DELETE_allowed --- PASS: TestFilerServer_tusHandler_CrossPrefixSessionHijack (0.65s) --- PASS: TestFilerServer_tusHandler_CrossPrefixSessionHijack/cross-prefix_HEAD_denied (0.11s) --- PASS: TestFilerServer_tusHandler_CrossPrefixSessionHijack/matching-prefix_HEAD_allowed (0.11s) --- PASS: TestFilerServer_tusHandler_CrossPrefixSessionHijack/cross-prefix_PATCH_denied (0.11s) --- PASS: TestFilerServer_tusHandler_CrossPrefixSessionHijack/matching-prefix_PATCH_allowed (0.12s) --- PASS: TestFilerServer_tusHandler_CrossPrefixSessionHijack/cross-prefix_DELETE_denied (0.10s) --- PASS: TestFilerServer_tusHandler_CrossPrefixSessionHijack/matching-prefix_DELETE_allowed (0.11s) === RUN TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata === RUN TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/trailing_path_alias === RUN TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/non-canonical_route_id === RUN TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/stored_id_mismatch === RUN TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/empty_stored_target === RUN TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/root_stored_target === RUN TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/relative_stored_target === RUN TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/oversize_stored_size --- PASS: TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata (0.74s) --- PASS: TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/trailing_path_alias (0.11s) --- PASS: TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/non-canonical_route_id (0.11s) --- PASS: TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/stored_id_mismatch (0.11s) --- PASS: TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/empty_stored_target (0.11s) --- PASS: TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/root_stored_target (0.11s) --- PASS: TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/relative_stored_target (0.11s) --- PASS: TestFilerServer_tusHandler_RejectsAliasesAndInvalidMetadata/oversize_stored_size (0.08s) === RUN TestFilerServer_checkJwtAuthorization === RUN TestFilerServer_checkJwtAuthorization/post_without_token_denied === RUN TestFilerServer_checkJwtAuthorization/patch_without_token_denied === RUN TestFilerServer_checkJwtAuthorization/head_without_token_denied === RUN TestFilerServer_checkJwtAuthorization/post_write_token_allowed === RUN TestFilerServer_checkJwtAuthorization/head_read_token_allowed === RUN TestFilerServer_checkJwtAuthorization/head_write_token_denied === RUN TestFilerServer_checkJwtAuthorization/post_read_token_denied === RUN TestFilerServer_checkJwtAuthorization/within_allowed_prefix === RUN TestFilerServer_checkJwtAuthorization/outside_allowed_prefix_denied === RUN TestFilerServer_checkJwtAuthorization/restricted_token_without_resource_denied === RUN TestFilerServer_checkJwtAuthorization/matching_method_allowed === RUN TestFilerServer_checkJwtAuthorization/method_not_allowed_denied --- PASS: TestFilerServer_checkJwtAuthorization (0.02s) --- PASS: TestFilerServer_checkJwtAuthorization/post_without_token_denied (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/patch_without_token_denied (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/head_without_token_denied (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/post_write_token_allowed (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/head_read_token_allowed (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/head_write_token_denied (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/post_read_token_denied (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/within_allowed_prefix (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/outside_allowed_prefix_denied (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/restricted_token_without_resource_denied (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/matching_method_allowed (0.00s) --- PASS: TestFilerServer_checkJwtAuthorization/method_not_allowed_denied (0.00s) === RUN TestFilerServer_tusHandler_UnauthenticatedRejected I1117 09:43:33.039844 common.go:111 response method:POST URL:/.tus/buckets/secret/owned.txt with httpStatus:401 and JSON:{"error":"wrong jwt"} I1117 09:43:33.040890 common.go:111 response method:HEAD URL:/.tus/.uploads/9f6f0d4b-6556-48f6-b953-0d8fca1966f1 with httpStatus:401 and JSON:{"error":"wrong jwt"} --- PASS: TestFilerServer_tusHandler_UnauthenticatedRejected (0.08s) === RUN TestFilerServer_refreshTusSessionChunks_RevalidatesPinnedSession === RUN TestFilerServer_refreshTusSessionChunks_RevalidatesPinnedSession/deleted_before_completion === RUN TestFilerServer_refreshTusSessionChunks_RevalidatesPinnedSession/replaced_before_completion --- PASS: TestFilerServer_refreshTusSessionChunks_RevalidatesPinnedSession (0.17s) --- PASS: TestFilerServer_refreshTusSessionChunks_RevalidatesPinnedSession/deleted_before_completion (0.06s) --- PASS: TestFilerServer_refreshTusSessionChunks_RevalidatesPinnedSession/replaced_before_completion (0.11s) === RUN TestFilerServer_tusHandler_ConcurrentMutationLocked --- PASS: TestFilerServer_tusHandler_ConcurrentMutationLocked (0.10s) === RUN TestFilerServer_tusHandler_TransientChunkLoadFailure === RUN TestFilerServer_tusHandler_TransientChunkLoadFailure/HEAD E1117 09:43:33.422016 filer_server_tus_handlers.go:102 Failed to load TUS session 9f6f0d4b-6556-48f6-b953-0d8fca1966f1 chunks: list session directory: context canceled === RUN TestFilerServer_tusHandler_TransientChunkLoadFailure/PATCH E1117 09:43:33.486767 filer_server_tus_handlers.go:102 Failed to load TUS session 9f6f0d4b-6556-48f6-b953-0d8fca1966f1 chunks: list session directory: context canceled === RUN TestFilerServer_tusHandler_TransientChunkLoadFailure/DELETE E1117 09:43:33.588372 filer_server_tus_handlers.go:102 Failed to load TUS session 9f6f0d4b-6556-48f6-b953-0d8fca1966f1 chunks: list session directory: context canceled --- PASS: TestFilerServer_tusHandler_TransientChunkLoadFailure (0.28s) --- PASS: TestFilerServer_tusHandler_TransientChunkLoadFailure/HEAD (0.11s) --- PASS: TestFilerServer_tusHandler_TransientChunkLoadFailure/PATCH (0.06s) --- PASS: TestFilerServer_tusHandler_TransientChunkLoadFailure/DELETE (0.10s) === RUN TestFilerServer_tusHandler_ChunkLoadNotFoundStillNotFound E1117 09:43:33.691223 filer_server_tus_handlers.go:102 Failed to load TUS session 9f6f0d4b-6556-48f6-b953-0d8fca1966f1 chunks: list session directory: filer: no entry is found in filer store E1117 09:43:33.694592 filer_server_tus_handlers.go:102 Failed to load TUS session 9f6f0d4b-6556-48f6-b953-0d8fca1966f1 chunks: list session directory: filer: no entry is found in filer store --- PASS: TestFilerServer_tusHandler_ChunkLoadNotFoundStillNotFound (0.11s) === RUN TestSubscribeLoop_AggregatedHoldIsQuiet I1117 09:43:33.808856 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_AggregatedHoldIsQuiet662017659/001 I1117 09:43:33.809909 file_util.go:29 Folder /tmp/TestSubscribeLoop_AggregatedHoldIsQuiet662017659/001 Permission: -rwxr-xr-x I1117 09:43:33.890617 filer.go:435 create filer.store.id to -1509016505 I1117 09:43:34.100071 filer_grpc_server_sub_meta.go:1725 + listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:34.101379 filer_grpc_server_sub_meta.go:659 agg-loop-test@127.0.0.1:12345 starts to subscribe from {Time:2026-11-17 09:43:33.597229237 +0000 UTC Offset:-7 IsOffsetBased:false} filer_subscribe_agg_test.go:178: 403 writes over 1.002369503s produced 0 ERROR lines I1117 09:43:35.105472 filer_grpc_server_sub_meta.go:654 disconnect agg-loop-test@127.0.0.1:12345 subscriber clientId:11 I1117 09:43:35.105877 filer_grpc_server_sub_meta.go:1753 - listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:35.107542 filer_deletion.go:317 deletion processor shutting down I1117 09:43:35.107548 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_AggregatedHoldIsQuiet (1.42s) === RUN TestSubscribeLoop_AggregatedHoldIsPaced I1117 09:43:35.161135 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_AggregatedHoldIsPaced4210657598/001 I1117 09:43:35.161428 file_util.go:29 Folder /tmp/TestSubscribeLoop_AggregatedHoldIsPaced4210657598/001 Permission: -rwxr-xr-x I1117 09:43:35.180652 filer.go:435 create filer.store.id to -1901405441 I1117 09:43:35.395143 filer_grpc_server_sub_meta.go:1725 + listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:35.395570 filer_grpc_server_sub_meta.go:659 agg-loop-test@127.0.0.1:12345 starts to subscribe from {Time:2026-11-17 09:43:34.89258195 +0000 UTC Offset:-7 IsOffsetBased:false} filer_subscribe_agg_test.go:204: 404 writes over 1.001711371s produced 5 holds I1117 09:43:36.399850 filer_grpc_server_sub_meta.go:654 disconnect agg-loop-test@127.0.0.1:12345 subscriber clientId:11 I1117 09:43:36.400013 filer_grpc_server_sub_meta.go:1753 - listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:36.400891 filer_deletion.go:317 deletion processor shutting down I1117 09:43:36.400926 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_AggregatedHoldIsPaced (1.29s) === RUN TestSubscribeLoop_AggregatedHoldReleasesOnPeerProgress I1117 09:43:36.515660 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_AggregatedHoldReleasesOnPeerProgress3190899723/001 I1117 09:43:36.515988 file_util.go:29 Folder /tmp/TestSubscribeLoop_AggregatedHoldReleasesOnPeerProgress3190899723/001 Permission: -rwxr-xr-x I1117 09:43:36.566191 filer.go:435 create filer.store.id to -1814200082 I1117 09:43:36.722527 filer_grpc_server_sub_meta.go:1725 + listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:36.722821 filer_grpc_server_sub_meta.go:659 agg-loop-test@127.0.0.1:12345 starts to subscribe from {Time:2026-11-17 09:43:36.221341316 +0000 UTC Offset:-7 IsOffsetBased:false} I1117 09:43:37.180975 filer_grpc_server_sub_meta.go:654 disconnect agg-loop-test@127.0.0.1:12345 subscriber clientId:11 I1117 09:43:37.181219 filer_grpc_server_sub_meta.go:1753 - listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:37.182145 filer_deletion.go:317 deletion processor shutting down I1117 09:43:37.182154 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_AggregatedHoldReleasesOnPeerProgress (0.78s) === RUN TestSubscribeLoop_AggregatedHoldCoalescesPeerProgress I1117 09:43:37.296068 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_AggregatedHoldCoalescesPeerProgress2429688650/001 I1117 09:43:37.296489 file_util.go:29 Folder /tmp/TestSubscribeLoop_AggregatedHoldCoalescesPeerProgress2429688650/001 Permission: -rwxr-xr-x I1117 09:43:37.343022 filer.go:435 create filer.store.id to 289252841 I1117 09:43:37.543610 filer_grpc_server_sub_meta.go:1725 + listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:37.543915 filer_grpc_server_sub_meta.go:659 agg-loop-test@127.0.0.1:12345 starts to subscribe from {Time:2026-11-17 09:43:37.042602514 +0000 UTC Offset:-7 IsOffsetBased:false} filer_subscribe_agg_test.go:243: 396 writes over 1.000631768s produced 42 holds I1117 09:43:38.801891 filer_grpc_server_sub_meta.go:654 disconnect agg-loop-test@127.0.0.1:12345 subscriber clientId:11 I1117 09:43:38.802191 filer_grpc_server_sub_meta.go:1753 - listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:38.803060 filer_deletion.go:317 deletion processor shutting down I1117 09:43:38.803097 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_AggregatedHoldCoalescesPeerProgress (1.62s) === RUN TestPeerDeliveryClaimPacing I1117 09:43:38.909266 leveldb_store.go:48 filer store dir: /tmp/TestPeerDeliveryClaimPacing4133160447/001 I1117 09:43:38.909525 file_util.go:29 Folder /tmp/TestPeerDeliveryClaimPacing4133160447/001 Permission: -rwxr-xr-x I1117 09:43:38.959664 filer.go:435 create filer.store.id to -1292369214 I1117 09:43:39.168638 filer_deletion.go:317 deletion processor shutting down I1117 09:43:39.168783 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestPeerDeliveryClaimPacing (0.37s) === RUN TestSubscribeLoop_AggregatedDiskHoldIgnoresDeliveryProgress I1117 09:43:39.277304 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_AggregatedDiskHoldIgnoresDeliveryProgress3139003468/001 I1117 09:43:39.277573 file_util.go:29 Folder /tmp/TestSubscribeLoop_AggregatedDiskHoldIgnoresDeliveryProgress3139003468/001 Permission: -rwxr-xr-x I1117 09:43:39.324998 filer.go:435 create filer.store.id to -1754283783 I1117 09:43:39.499867 filer_grpc_server_sub_meta.go:1725 + listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:39.500325 filer_grpc_server_sub_meta.go:659 agg-loop-test@127.0.0.1:12345 starts to subscribe from {Time:2026-11-17 09:43:04.373860347 +0000 UTC Offset:-7 IsOffsetBased:false} filer_subscribe_agg_test.go:309: 1.002570299s of delivery-only progress produced 2 disk holds I1117 09:43:40.958148 filer_grpc_server_sub_meta.go:654 disconnect agg-loop-test@127.0.0.1:12345 subscriber clientId:11 I1117 09:43:40.958357 filer_grpc_server_sub_meta.go:1753 - listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:40.959062 filer_deletion.go:317 deletion processor shutting down I1117 09:43:40.959152 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_AggregatedDiskHoldIgnoresDeliveryProgress (1.79s) === RUN TestSubscribeLoop_EvictedUnflushedGapWaitsThenDelivers I1117 09:43:41.061682 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_EvictedUnflushedGapWaitsThenDelivers3561735937/001 I1117 09:43:41.061936 file_util.go:29 Folder /tmp/TestSubscribeLoop_EvictedUnflushedGapWaitsThenDelivers3561735937/001 Permission: -rwxr-xr-x I1117 09:43:41.104099 filer.go:435 create filer.store.id to -262131910 E1117 09:43:41.189533 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:41.190108 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:41.190482 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 W1117 09:43:41.447807 filer_grpc_server_sub_meta.go:390 local subscriber loop-test@ parked 0s at 1970-01-01 00:00:00 +0000 UTC: gap is not flushed yet (earliest memory 2026-11-17 08:47:41 +0000 UTC, flushed through 1970-01-01 00:00:00 +0000 UTC) W1117 09:43:41.501130 filer_grpc_server_sub_meta.go:401 local subscriber loop-test@ resumed after 0s parked I1117 09:43:41.779587 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:41.779884 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:41.780650 filer_deletion.go:317 deletion processor shutting down I1117 09:43:41.780655 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_EvictedUnflushedGapWaitsThenDelivers (0.82s) === RUN TestSubscribeLoop_NothingEvictedServesFromMemory I1117 09:43:41.886464 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_NothingEvictedServesFromMemory1028131316/001 I1117 09:43:41.886722 file_util.go:29 Folder /tmp/TestSubscribeLoop_NothingEvictedServesFromMemory1028131316/001 Permission: -rwxr-xr-x I1117 09:43:41.942387 filer.go:435 create filer.store.id to -1471042009 E1117 09:43:42.035746 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:42.036187 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:42.036407 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 I1117 09:43:42.321490 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:42.321823 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:42.322500 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:43:42.322515 filer_deletion.go:317 deletion processor shutting down --- PASS: TestSubscribeLoop_NothingEvictedServesFromMemory (0.54s) === RUN TestSubscribeLoop_BacklogThenLiveExactlyOnce I1117 09:43:42.438542 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_BacklogThenLiveExactlyOnce2805462026/001 I1117 09:43:42.438841 file_util.go:29 Folder /tmp/TestSubscribeLoop_BacklogThenLiveExactlyOnce2805462026/001 Permission: -rwxr-xr-x I1117 09:43:42.498770 filer.go:435 create filer.store.id to 243291772 E1117 09:43:42.612395 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:42.612849 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:42.613105 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 I1117 09:43:42.910157 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:42.910422 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:42.911046 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:43:42.911066 filer_deletion.go:317 deletion processor shutting down --- PASS: TestSubscribeLoop_BacklogThenLiveExactlyOnce (0.59s) === RUN TestSubscribeLoop_BoundedSubscriptionTerminates I1117 09:43:43.027791 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_BoundedSubscriptionTerminates1582948438/001 I1117 09:43:43.028127 file_util.go:29 Folder /tmp/TestSubscribeLoop_BoundedSubscriptionTerminates1582948438/001 Permission: -rwxr-xr-x I1117 09:43:43.083171 filer.go:435 create filer.store.id to 1441660844 E1117 09:43:43.180569 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:43.180949 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:43.181120 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 I1117 09:43:43.185131 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:43.185267 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:43.186079 filer_deletion.go:317 deletion processor shutting down I1117 09:43:43.186170 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_BoundedSubscriptionTerminates (0.27s) === RUN TestSubscribeLoop_BoundedEmptyFilerTerminates I1117 09:43:43.307016 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_BoundedEmptyFilerTerminates3880862160/001 I1117 09:43:43.307338 file_util.go:29 Folder /tmp/TestSubscribeLoop_BoundedEmptyFilerTerminates3880862160/001 Permission: -rwxr-xr-x I1117 09:43:43.354213 filer.go:435 create filer.store.id to 921849885 E1117 09:43:43.454435 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:43.454769 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:43.454980 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:2026-11-17 08:43:43 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 I1117 09:43:43.456980 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:43.457102 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:43.457834 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:43:43.457842 filer_deletion.go:317 deletion processor shutting down --- PASS: TestSubscribeLoop_BoundedEmptyFilerTerminates (0.27s) === RUN TestSubscribeLoop_FlushProvenGapSkipsToRetained I1117 09:43:43.555527 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_FlushProvenGapSkipsToRetained472360997/001 I1117 09:43:43.555770 file_util.go:29 Folder /tmp/TestSubscribeLoop_FlushProvenGapSkipsToRetained472360997/001 Permission: -rwxr-xr-x I1117 09:43:43.606954 filer.go:435 create filer.store.id to -1494219467 E1117 09:43:43.731818 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:43.732338 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:43.732582 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 I1117 09:43:44.017895 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:44.018149 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:44.018786 filer_deletion.go:317 deletion processor shutting down I1117 09:43:44.018790 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_FlushProvenGapSkipsToRetained (0.56s) === RUN TestSubscribeLoop_GiveUpSkipsAndKeepsStreaming I1117 09:43:44.117127 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_GiveUpSkipsAndKeepsStreaming928556729/001 I1117 09:43:44.117361 file_util.go:29 Folder /tmp/TestSubscribeLoop_GiveUpSkipsAndKeepsStreaming928556729/001 Permission: -rwxr-xr-x I1117 09:43:44.176154 filer.go:435 create filer.store.id to -1812620928 E1117 09:43:44.272236 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:44.272613 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:44.272844 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 W1117 09:43:44.529517 filer_grpc_server_sub_meta.go:390 local subscriber loop-test@ parked 0s at 1970-01-01 00:00:00 +0000 UTC: gap is not flushed yet (earliest memory 2026-11-17 08:47:44 +0000 UTC, flushed through 1970-01-01 00:00:00 +0000 UTC) E1117 09:43:44.530272 filer_grpc_server_sub_meta.go:413 local subscriber loop-test@ skipping the gap (1970-01-01 00:00:00 +0000 UTC..2026-11-17 08:45:44 +0000 UTC] after 0s parked: gap is not flushed yet (earliest memory 2026-11-17 08:47:44 +0000 UTC, flushed through 1970-01-01 00:00:00 +0000 UTC); events a peer flushes into that range later will not be delivered I1117 09:43:44.809624 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:44.809885 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:44.810676 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:43:44.810700 filer_deletion.go:317 deletion processor shutting down --- PASS: TestSubscribeLoop_GiveUpSkipsAndKeepsStreaming (0.79s) === RUN TestSubscribeLoop_ChunkModeMarkerMatchesClientReplay I1117 09:43:44.916976 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_ChunkModeMarkerMatchesClientReplay373429814/001 I1117 09:43:44.917267 file_util.go:29 Folder /tmp/TestSubscribeLoop_ChunkModeMarkerMatchesClientReplay373429814/001 Permission: -rwxr-xr-x I1117 09:43:44.971649 filer.go:435 create filer.store.id to 692397715 E1117 09:43:45.076280 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:45.076750 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:45.076954 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 I1117 09:43:45.370000 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:45.370255 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:45.370837 filer_deletion.go:317 deletion processor shutting down I1117 09:43:45.370845 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_ChunkModeMarkerMatchesClientReplay (0.56s) === RUN TestSubscribeLoop_ChunkModeDeadVolumeAgreesWithClient I1117 09:43:45.474291 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_ChunkModeDeadVolumeAgreesWithClient3024007719/001 I1117 09:43:45.474532 file_util.go:29 Folder /tmp/TestSubscribeLoop_ChunkModeDeadVolumeAgreesWithClient3024007719/001 Permission: -rwxr-xr-x I1117 09:43:45.531218 filer.go:435 create filer.store.id to 1217391682 E1117 09:43:45.633636 master_grpc_server.go:762 failed to get peer from ctx I1117 09:43:45.633966 filer_grpc_server_sub_meta.go:1725 + local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:45.634591 filer_grpc_server_sub_meta.go:1117 + loop-test@ local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-7 I1117 09:43:45.645363 filer_pb_direct_read.go:260 skip log file filer=0000abcd ts=1794905100000000000 after 0 entries: read t,2: volume 42 not found I1117 09:43:45.887587 filer_grpc_server_sub_meta.go:1112 disconnect loop-test@ local subscriber clientId:-7 I1117 09:43:45.887787 filer_grpc_server_sub_meta.go:1753 - local listener loop-test@ clientId -7 clientEpoch 1 I1117 09:43:45.888616 filer_deletion.go:317 deletion processor shutting down I1117 09:43:45.888628 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_ChunkModeDeadVolumeAgreesWithClient (0.52s) === RUN TestSubscribeLoop_AggregatedNoPersistedEntryAfterStart I1117 09:43:45.996864 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeLoop_AggregatedNoPersistedEntryAfterStart3709915484/001 I1117 09:43:45.997151 file_util.go:29 Folder /tmp/TestSubscribeLoop_AggregatedNoPersistedEntryAfterStart3709915484/001 Permission: -rwxr-xr-x I1117 09:43:46.049009 filer.go:435 create filer.store.id to 1855548466 I1117 09:43:46.151798 filer.go:439 existing filer.store.id = 1855548466 I1117 09:43:46.265026 filer_grpc_server_sub_meta.go:1725 + listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:46.265326 filer_grpc_server_sub_meta.go:659 agg-loop-test@127.0.0.1:12345 starts to subscribe from {Time:2026-11-17 08:43:46.002 +0000 UTC Offset:-7 IsOffsetBased:false} I1117 09:43:47.172765 filer_grpc_server_sub_meta.go:654 disconnect agg-loop-test@127.0.0.1:12345 subscriber clientId:11 I1117 09:43:47.173047 filer_grpc_server_sub_meta.go:1753 - listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:47.173717 filer_deletion.go:317 deletion processor shutting down I1117 09:43:47.173776 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeLoop_AggregatedNoPersistedEntryAfterStart (1.29s) === RUN TestSubscribeMetadataLocalStreamEndsWhenRemotePeerAppears I1117 09:43:47.220819 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeMetadataLocalStreamEndsWhenRemotePeerAppears2653167437/001 I1117 09:43:47.221028 file_util.go:29 Folder /tmp/TestSubscribeMetadataLocalStreamEndsWhenRemotePeerAppears2653167437/001 Permission: -rwxr-xr-x I1117 09:43:47.231459 filer.go:435 create filer.store.id to -392929385 I1117 09:43:47.454031 filer_grpc_server_sub_meta.go:1725 + local listener agg-loop-test@127.0.0.1:12345 clientId -11 clientEpoch 1 I1117 09:43:47.454392 filer_grpc_server_sub_meta.go:1117 + agg-loop-test@127.0.0.1:12345 local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-11 I1117 09:43:47.729909 filer_grpc_server_sub_meta.go:1282 remote peer discovered after local subscribe agg-loop-test@127.0.0.1:12345 started: ending stream so the client reconnects to the aggregated stream I1117 09:43:47.730383 filer_grpc_server_sub_meta.go:1112 disconnect agg-loop-test@127.0.0.1:12345 local subscriber clientId:-11 I1117 09:43:47.730521 filer_grpc_server_sub_meta.go:1753 - local listener agg-loop-test@127.0.0.1:12345 clientId -11 clientEpoch 1 I1117 09:43:47.731487 filer_deletion.go:317 deletion processor shutting down I1117 09:43:47.731469 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeMetadataLocalStreamEndsWhenRemotePeerAppears (0.56s) === RUN TestSubscribeMetadataAggregatedPathAfterPeerArrival I1117 09:43:47.839980 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeMetadataAggregatedPathAfterPeerArrival2324896914/001 I1117 09:43:47.840218 file_util.go:29 Folder /tmp/TestSubscribeMetadataAggregatedPathAfterPeerArrival2324896914/001 Permission: -rwxr-xr-x I1117 09:43:47.879947 filer.go:435 create filer.store.id to 466364856 I1117 09:43:47.941188 filer_grpc_server_sub_meta.go:1725 + local listener agg-loop-test@127.0.0.1:12345 clientId -11 clientEpoch 1 I1117 09:43:47.941629 filer_grpc_server_sub_meta.go:1117 + agg-loop-test@127.0.0.1:12345 local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-11 I1117 09:43:48.216876 filer_grpc_server_sub_meta.go:1282 remote peer discovered after local subscribe agg-loop-test@127.0.0.1:12345 started: ending stream so the client reconnects to the aggregated stream I1117 09:43:48.217333 filer_grpc_server_sub_meta.go:1112 disconnect agg-loop-test@127.0.0.1:12345 local subscriber clientId:-11 I1117 09:43:48.217502 filer_grpc_server_sub_meta.go:1753 - local listener agg-loop-test@127.0.0.1:12345 clientId -11 clientEpoch 1 I1117 09:43:48.219369 filer_grpc_server_sub_meta.go:1725 + listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:48.219569 filer_grpc_server_sub_meta.go:659 agg-loop-test@127.0.0.1:12345 starts to subscribe from {Time:2026-11-17 09:43:47.937932066 +0000 UTC Offset:-7 IsOffsetBased:false} I1117 09:43:48.490718 filer_grpc_server_sub_meta.go:654 disconnect agg-loop-test@127.0.0.1:12345 subscriber clientId:11 I1117 09:43:48.490918 filer_grpc_server_sub_meta.go:1753 - listener agg-loop-test@127.0.0.1:12345 clientId 11 clientEpoch 1 I1117 09:43:48.491709 filer_deletion.go:317 deletion processor shutting down I1117 09:43:48.491727 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue --- PASS: TestSubscribeMetadataAggregatedPathAfterPeerArrival (0.76s) === RUN TestSubscribeMetadataLocalStreamPersistsWithoutPeers I1117 09:43:48.593136 leveldb_store.go:48 filer store dir: /tmp/TestSubscribeMetadataLocalStreamPersistsWithoutPeers3573292346/001 I1117 09:43:48.593385 file_util.go:29 Folder /tmp/TestSubscribeMetadataLocalStreamPersistsWithoutPeers3573292346/001 Permission: -rwxr-xr-x I1117 09:43:48.640827 filer.go:435 create filer.store.id to 700404273 I1117 09:43:48.766645 filer_grpc_server_sub_meta.go:1725 + local listener agg-loop-test@127.0.0.1:12345 clientId -11 clientEpoch 1 I1117 09:43:48.766948 filer_grpc_server_sub_meta.go:1117 + agg-loop-test@127.0.0.1:12345 local subscribe from {Time:1970-01-01 00:00:00 +0000 UTC Offset:-7 IsOffsetBased:false} clientId:-11 I1117 09:43:49.048403 filer_grpc_server_sub_meta.go:1112 disconnect agg-loop-test@127.0.0.1:12345 local subscriber clientId:-11 I1117 09:43:49.048599 filer_grpc_server_sub_meta.go:1753 - local listener agg-loop-test@127.0.0.1:12345 clientId -11 clientEpoch 1 I1117 09:43:49.049271 filer_deletion.go:543 retry processor shutting down, 0 items remaining in queue I1117 09:43:49.049268 filer_deletion.go:317 deletion processor shutting down --- PASS: TestSubscribeMetadataLocalStreamPersistsWithoutPeers (0.56s) === RUN TestAdminLockLeaseRenewRelease --- PASS: TestAdminLockLeaseRenewRelease (0.00s) === RUN TestAdminLockReleaseUnknownLock --- PASS: TestAdminLockReleaseUnknownLock (0.00s) === RUN TestAdminLockConcurrentReleaseOfSameToken --- PASS: TestAdminLockConcurrentReleaseOfSameToken (2.33s) === RUN TestAdminLockConcurrentLeaseGrantsOnce --- PASS: TestAdminLockConcurrentLeaseGrantsOnce (1.20s) === RUN TestAdminLockConcurrentRenewalOfSameToken --- PASS: TestAdminLockConcurrentRenewalOfSameToken (1.60s) === RUN TestMasterIsKnownPingTarget I1117 09:43:54.194797 node.go:539 test adds child dc1 I1117 09:43:54.195400 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.196251 node.go:539 test:dc1:rack1 adds child vol1 === RUN TestMasterIsKnownPingTarget/known_filer === RUN TestMasterIsKnownPingTarget/known_volume_server === RUN TestMasterIsKnownPingTarget/known_volume_server_http_addr === RUN TestMasterIsKnownPingTarget/known_self_master === RUN TestMasterIsKnownPingTarget/unknown_localhost_low_port === RUN TestMasterIsKnownPingTarget/unknown_localhost_high_port === RUN TestMasterIsKnownPingTarget/unrelated_host === RUN TestMasterIsKnownPingTarget/unknown_target_type === RUN TestMasterIsKnownPingTarget/filer_address_checked_as_volume_server --- PASS: TestMasterIsKnownPingTarget (0.01s) --- PASS: TestMasterIsKnownPingTarget/known_filer (0.00s) --- PASS: TestMasterIsKnownPingTarget/known_volume_server (0.00s) --- PASS: TestMasterIsKnownPingTarget/known_volume_server_http_addr (0.00s) --- PASS: TestMasterIsKnownPingTarget/known_self_master (0.00s) --- PASS: TestMasterIsKnownPingTarget/unknown_localhost_low_port (0.00s) --- PASS: TestMasterIsKnownPingTarget/unknown_localhost_high_port (0.00s) --- PASS: TestMasterIsKnownPingTarget/unrelated_host (0.00s) --- PASS: TestMasterIsKnownPingTarget/unknown_target_type (0.00s) --- PASS: TestMasterIsKnownPingTarget/filer_address_checked_as_volume_server (0.00s) === RUN TestMasterIsKnownPingTargetFollowerEmptyTopology --- PASS: TestMasterIsKnownPingTargetFollowerEmptyTopology (0.00s) === RUN TestVolumeServerIsKnownPingTarget === RUN TestVolumeServerIsKnownPingTarget/seed_master === RUN TestVolumeServerIsKnownPingTarget/current_master === RUN TestVolumeServerIsKnownPingTarget/other_volume_server === RUN TestVolumeServerIsKnownPingTarget/random_filer === RUN TestVolumeServerIsKnownPingTarget/unknown_low_port === RUN TestVolumeServerIsKnownPingTarget/unknown_high_port === RUN TestVolumeServerIsKnownPingTarget/unrelated_host --- PASS: TestVolumeServerIsKnownPingTarget (0.00s) --- PASS: TestVolumeServerIsKnownPingTarget/seed_master (0.00s) --- PASS: TestVolumeServerIsKnownPingTarget/current_master (0.00s) --- PASS: TestVolumeServerIsKnownPingTarget/other_volume_server (0.00s) --- PASS: TestVolumeServerIsKnownPingTarget/random_filer (0.00s) --- PASS: TestVolumeServerIsKnownPingTarget/unknown_low_port (0.00s) --- PASS: TestVolumeServerIsKnownPingTarget/unknown_high_port (0.00s) --- PASS: TestVolumeServerIsKnownPingTarget/unrelated_host (0.00s) === RUN TestAssignShedsLoadWhenGrowthInFlight I1117 09:43:54.211169 node.go:539 test adds child dc1 I1117 09:43:54.211627 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.212341 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.213084 node.go:539 test:dc1:rack1:dn1 adds child --- PASS: TestAssignShedsLoadWhenGrowthInFlight (0.02s) === RUN TestAssignInitiatorWaitsForItsOwnGrowth I1117 09:43:54.227222 node.go:539 test adds child dc1 I1117 09:43:54.227395 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.227666 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.228255 node.go:539 test:dc1:rack1:dn1 adds child I1117 09:43:54.432347 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:54.432885 volume_layout.go:542 Volume 1 reaches full capacity (effective=1048576, limit=1048576). --- PASS: TestAssignInitiatorWaitsForItsOwnGrowth (0.21s) === RUN TestAssignInitiatorShedsWhenGrowthConcludesUnfulfilled I1117 09:43:54.436724 node.go:539 test adds child dc1 I1117 09:43:54.437065 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.437374 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.437559 node.go:539 test:dc1:rack1:dn1 adds child --- PASS: TestAssignInitiatorShedsWhenGrowthConcludesUnfulfilled (0.00s) === RUN TestAssignConstrainedInitiatorWaitsForGrowth I1117 09:43:54.440618 node.go:539 test adds child dc1 I1117 09:43:54.440788 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.441054 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.441223 node.go:539 test:dc1:rack1:dn1 adds child I1117 09:43:54.446820 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:54.446979 volume_layout.go:542 Volume 1 reaches full capacity (effective=1048576, limit=1048576). --- PASS: TestAssignConstrainedInitiatorWaitsForGrowth (0.01s) === RUN TestAssignConstrainedShedsWhileGrowthPending I1117 09:43:54.448124 node.go:539 test adds child dc1 I1117 09:43:54.448291 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.448562 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.448781 node.go:539 test:dc1:rack1:dn1 adds child --- PASS: TestAssignConstrainedShedsWhileGrowthPending (0.00s) === RUN TestAssignConstrainedShedsWhenGrowthConcludesUnfulfilled I1117 09:43:54.452476 node.go:539 test adds child dc1 I1117 09:43:54.452643 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.452927 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.453361 node.go:539 test:dc1:rack1:dn1 adds child --- PASS: TestAssignConstrainedShedsWhenGrowthConcludesUnfulfilled (0.00s) === RUN TestAssignConstrainedFailsFastWithoutRoom === RUN TestAssignConstrainedFailsFastWithoutRoom/location_full I1117 09:43:54.458032 node.go:539 test adds child dc1 I1117 09:43:54.458205 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.458477 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.458878 node.go:539 test:dc1:rack1:dn1 adds child I1117 09:43:54.459118 node.go:539 test adds child dc2 I1117 09:43:54.459266 node.go:539 test:dc2 adds child rack2 I1117 09:43:54.459522 node.go:539 test:dc2:rack2 adds child dn2 I1117 09:43:54.459692 node.go:539 test:dc2:rack2:dn2 adds child I1117 09:43:54.666283 master_grpc_server_assign.go:169 assign count:1 replication:"000" collection:"fresh" data_center:"dc2" {"collection":"fresh","replication":{},"ttl":{"Count":0,"Unit":0},"dataCenter":"dc2","version":3}: failed to find writable volumes for collection:fresh replication:000 ttl: error: No writable volumes === RUN TestAssignConstrainedFailsFastWithoutRoom/growth_disabled I1117 09:43:54.671592 node.go:539 test adds child dc2 I1117 09:43:54.671788 node.go:539 test:dc2 adds child rack2 I1117 09:43:54.672101 node.go:539 test:dc2:rack2 adds child dn2 I1117 09:43:54.672373 node.go:539 test:dc2:rack2:dn2 adds child I1117 09:43:54.673242 master_grpc_server_assign.go:169 assign count:1 replication:"000" collection:"fresh" data_center:"dc2" {"collection":"fresh","replication":{},"ttl":{"Count":0,"Unit":0},"dataCenter":"dc2","version":3}: failed to find writable volumes for collection:fresh replication:000 ttl: error: No writable volumes --- PASS: TestAssignConstrainedFailsFastWithoutRoom (0.22s) --- PASS: TestAssignConstrainedFailsFastWithoutRoom/location_full (0.21s) --- PASS: TestAssignConstrainedFailsFastWithoutRoom/growth_disabled (0.00s) === RUN TestAssignAbortsOnCancel I1117 09:43:54.675164 node.go:539 test adds child dc1 I1117 09:43:54.675350 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.675619 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.675806 node.go:539 test:dc1:rack1:dn1 adds child --- PASS: TestAssignAbortsOnCancel (0.30s) === RUN TestAssignFailsFastWhenOutOfSpace I1117 09:43:54.978675 node.go:539 test adds child dc1 I1117 09:43:54.979036 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.979426 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.979663 node.go:539 test:dc1:rack1:dn1 adds child I1117 09:43:54.983671 master_grpc_server_assign.go:249 assign count:1 replication:"000" collection:"fresh" {"collection":"fresh","replication":{},"ttl":{"Count":0,"Unit":0},"version":3}: failed to find writable volumes for collection:fresh replication:000 ttl: error: No writable volumes and no free volumes left for {"collection":"fresh","replication":{},"ttl":{"Count":0,"Unit":0},"version":3} --- PASS: TestAssignFailsFastWhenOutOfSpace (0.01s) === RUN TestAssignShedsRetryablyBeforeCapacityRegisters --- PASS: TestAssignShedsRetryablyBeforeCapacityRegisters (0.00s) === RUN TestAssignFailsFastWhenDiskTypeUnserved === RUN TestAssignFailsFastWhenDiskTypeUnserved/initiator I1117 09:43:54.988812 node.go:539 test adds child dc1 I1117 09:43:54.989033 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.990282 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.990572 node.go:539 test:dc1:rack1:dn1 adds child ssd W1117 09:43:54.992111 master_grpc_server_assign.go:333 assign requests for {"collection":"fresh","replication":{},"ttl":{"Count":0,"Unit":0},"version":3} will keep failing until a volume server registers that disk layout or clients change their assignment disk type: failed to find writable volumes for collection:fresh replication:000 ttl: error: No writable volumes and no volume server carries the default (unlabeled) disk layout for {"collection":"fresh","replication":{},"ttl":{"Count":0,"Unit":0},"version":3} === RUN TestAssignFailsFastWhenDiskTypeUnserved/follower_joins_growth_in_flight I1117 09:43:54.993916 node.go:539 test adds child dc1 I1117 09:43:54.994119 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.994351 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.994618 node.go:539 test:dc1:rack1:dn1 adds child ssd === RUN TestAssignFailsFastWhenDiskTypeUnserved/growth_disabled I1117 09:43:54.998047 node.go:539 test adds child dc1 I1117 09:43:54.998225 node.go:539 test:dc1 adds child rack1 I1117 09:43:54.998448 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:54.998701 node.go:539 test:dc1:rack1:dn1 adds child ssd --- PASS: TestAssignFailsFastWhenDiskTypeUnserved (0.01s) --- PASS: TestAssignFailsFastWhenDiskTypeUnserved/initiator (0.00s) --- PASS: TestAssignFailsFastWhenDiskTypeUnserved/follower_joins_growth_in_flight (0.00s) --- PASS: TestAssignFailsFastWhenDiskTypeUnserved/growth_disabled (0.00s) === RUN TestAssignFailsFastNamesExplicitHdd I1117 09:43:55.001198 node.go:539 test adds child dc1 I1117 09:43:55.001390 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.001869 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:55.002097 node.go:539 test:dc1:rack1:dn1 adds child ssd --- PASS: TestAssignFailsFastNamesExplicitHdd (0.00s) === RUN TestUnservedLayoutWarningBoundedAndExpiring W1117 09:43:55.004938 master_grpc_server_assign.go:333 assign requests for opt will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e1 W1117 09:43:55.005439 master_grpc_server_assign.go:333 assign requests for opt will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e3 W1117 09:43:55.005976 master_grpc_server_assign.go:333 assign requests for opt-0 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.006160 master_grpc_server_assign.go:333 assign requests for opt-1 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.006321 master_grpc_server_assign.go:333 assign requests for opt-2 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.006483 master_grpc_server_assign.go:333 assign requests for opt-3 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.006763 master_grpc_server_assign.go:333 assign requests for opt-4 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.006916 master_grpc_server_assign.go:333 assign requests for opt-5 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.007066 master_grpc_server_assign.go:333 assign requests for opt-6 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.007211 master_grpc_server_assign.go:333 assign requests for opt-7 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.007422 master_grpc_server_assign.go:333 assign requests for opt-8 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.007570 master_grpc_server_assign.go:333 assign requests for opt-9 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.007720 master_grpc_server_assign.go:333 assign requests for opt-10 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.007866 master_grpc_server_assign.go:333 assign requests for opt-11 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.008014 master_grpc_server_assign.go:333 assign requests for opt-12 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.008163 master_grpc_server_assign.go:333 assign requests for opt-13 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.008376 master_grpc_server_assign.go:333 assign requests for opt-14 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.008529 master_grpc_server_assign.go:333 assign requests for opt-15 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.008678 master_grpc_server_assign.go:333 assign requests for opt-16 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.008824 master_grpc_server_assign.go:333 assign requests for opt-17 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.008972 master_grpc_server_assign.go:333 assign requests for opt-18 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.009120 master_grpc_server_assign.go:333 assign requests for opt-19 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.009268 master_grpc_server_assign.go:333 assign requests for opt-20 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.009415 master_grpc_server_assign.go:333 assign requests for opt-21 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.009559 master_grpc_server_assign.go:333 assign requests for opt-22 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.009705 master_grpc_server_assign.go:333 assign requests for opt-23 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.009855 master_grpc_server_assign.go:333 assign requests for opt-24 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.009993 master_grpc_server_assign.go:333 assign requests for opt-25 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.010137 master_grpc_server_assign.go:333 assign requests for opt-26 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.010373 master_grpc_server_assign.go:333 assign requests for opt-27 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.010608 master_grpc_server_assign.go:333 assign requests for opt-28 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.010753 master_grpc_server_assign.go:333 assign requests for opt-29 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.010896 master_grpc_server_assign.go:333 assign requests for opt-30 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.011078 master_grpc_server_assign.go:333 assign requests for opt-31 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.011227 master_grpc_server_assign.go:333 assign requests for opt-32 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.011371 master_grpc_server_assign.go:333 assign requests for opt-33 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.011518 master_grpc_server_assign.go:333 assign requests for opt-34 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.011662 master_grpc_server_assign.go:333 assign requests for opt-35 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.011810 master_grpc_server_assign.go:333 assign requests for opt-36 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.011957 master_grpc_server_assign.go:333 assign requests for opt-37 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.012108 master_grpc_server_assign.go:333 assign requests for opt-38 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.012260 master_grpc_server_assign.go:333 assign requests for opt-39 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.012410 master_grpc_server_assign.go:333 assign requests for opt-40 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.012555 master_grpc_server_assign.go:333 assign requests for opt-41 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.012703 master_grpc_server_assign.go:333 assign requests for opt-42 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.012846 master_grpc_server_assign.go:333 assign requests for opt-43 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.012993 master_grpc_server_assign.go:333 assign requests for opt-44 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.013152 master_grpc_server_assign.go:333 assign requests for opt-45 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.013300 master_grpc_server_assign.go:333 assign requests for opt-46 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.013448 master_grpc_server_assign.go:333 assign requests for opt-47 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.013596 master_grpc_server_assign.go:333 assign requests for opt-48 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.013739 master_grpc_server_assign.go:333 assign requests for opt-49 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.013886 master_grpc_server_assign.go:333 assign requests for opt-50 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.014031 master_grpc_server_assign.go:333 assign requests for opt-51 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.014180 master_grpc_server_assign.go:333 assign requests for opt-52 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.014328 master_grpc_server_assign.go:333 assign requests for opt-53 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.014477 master_grpc_server_assign.go:333 assign requests for opt-54 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.014625 master_grpc_server_assign.go:333 assign requests for opt-55 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.014918 master_grpc_server_assign.go:333 assign requests for opt-56 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.015066 master_grpc_server_assign.go:333 assign requests for opt-57 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.015217 master_grpc_server_assign.go:333 assign requests for opt-58 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.015364 master_grpc_server_assign.go:333 assign requests for opt-59 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.015511 master_grpc_server_assign.go:333 assign requests for opt-60 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.015657 master_grpc_server_assign.go:333 assign requests for opt-61 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.015802 master_grpc_server_assign.go:333 assign requests for opt-62 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.015948 master_grpc_server_assign.go:333 assign requests for opt-63 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.016128 master_grpc_server_assign.go:333 assign requests for opt-64 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.016272 master_grpc_server_assign.go:333 assign requests for opt-65 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.016424 master_grpc_server_assign.go:333 assign requests for opt-66 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.016567 master_grpc_server_assign.go:333 assign requests for opt-67 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.016713 master_grpc_server_assign.go:333 assign requests for opt-68 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.016858 master_grpc_server_assign.go:333 assign requests for opt-69 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.017003 master_grpc_server_assign.go:333 assign requests for opt-70 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.017148 master_grpc_server_assign.go:333 assign requests for opt-71 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.017293 master_grpc_server_assign.go:333 assign requests for opt-72 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.017434 master_grpc_server_assign.go:333 assign requests for opt-73 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.017578 master_grpc_server_assign.go:333 assign requests for opt-74 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.017718 master_grpc_server_assign.go:333 assign requests for opt-75 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.017861 master_grpc_server_assign.go:333 assign requests for opt-76 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.018009 master_grpc_server_assign.go:333 assign requests for opt-77 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.018158 master_grpc_server_assign.go:333 assign requests for opt-78 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.018309 master_grpc_server_assign.go:333 assign requests for opt-79 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.018457 master_grpc_server_assign.go:333 assign requests for opt-80 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.018602 master_grpc_server_assign.go:333 assign requests for opt-81 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.018751 master_grpc_server_assign.go:333 assign requests for opt-82 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.018896 master_grpc_server_assign.go:333 assign requests for opt-83 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.019045 master_grpc_server_assign.go:333 assign requests for opt-84 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.019194 master_grpc_server_assign.go:333 assign requests for opt-85 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.019342 master_grpc_server_assign.go:333 assign requests for opt-86 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.019490 master_grpc_server_assign.go:333 assign requests for opt-87 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.019639 master_grpc_server_assign.go:333 assign requests for opt-88 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.019791 master_grpc_server_assign.go:333 assign requests for opt-89 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.019945 master_grpc_server_assign.go:333 assign requests for opt-90 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.020089 master_grpc_server_assign.go:333 assign requests for opt-91 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.020238 master_grpc_server_assign.go:333 assign requests for opt-92 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.020386 master_grpc_server_assign.go:333 assign requests for opt-93 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.020536 master_grpc_server_assign.go:333 assign requests for opt-94 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.020723 master_grpc_server_assign.go:333 assign requests for opt-95 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.020876 master_grpc_server_assign.go:333 assign requests for opt-96 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.021053 master_grpc_server_assign.go:333 assign requests for opt-97 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.021206 master_grpc_server_assign.go:333 assign requests for opt-98 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.021351 master_grpc_server_assign.go:333 assign requests for opt-99 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.021501 master_grpc_server_assign.go:333 assign requests for opt-100 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.021649 master_grpc_server_assign.go:333 assign requests for opt-101 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.021794 master_grpc_server_assign.go:333 assign requests for opt-102 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.021940 master_grpc_server_assign.go:333 assign requests for opt-103 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.022091 master_grpc_server_assign.go:333 assign requests for opt-104 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.022240 master_grpc_server_assign.go:333 assign requests for opt-105 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.022387 master_grpc_server_assign.go:333 assign requests for opt-106 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.022528 master_grpc_server_assign.go:333 assign requests for opt-107 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.022672 master_grpc_server_assign.go:333 assign requests for opt-108 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.022816 master_grpc_server_assign.go:333 assign requests for opt-109 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.022956 master_grpc_server_assign.go:333 assign requests for opt-110 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.023108 master_grpc_server_assign.go:333 assign requests for opt-111 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.023799 master_grpc_server_assign.go:333 assign requests for opt-112 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.023979 master_grpc_server_assign.go:333 assign requests for opt-113 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.024128 master_grpc_server_assign.go:333 assign requests for opt-114 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.024276 master_grpc_server_assign.go:333 assign requests for opt-115 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.024426 master_grpc_server_assign.go:333 assign requests for opt-116 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.024574 master_grpc_server_assign.go:333 assign requests for opt-117 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.024721 master_grpc_server_assign.go:333 assign requests for opt-118 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.024867 master_grpc_server_assign.go:333 assign requests for opt-119 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.025017 master_grpc_server_assign.go:333 assign requests for opt-120 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.025168 master_grpc_server_assign.go:333 assign requests for opt-121 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.025314 master_grpc_server_assign.go:333 assign requests for opt-122 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.025461 master_grpc_server_assign.go:333 assign requests for opt-123 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.025611 master_grpc_server_assign.go:333 assign requests for opt-124 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.025761 master_grpc_server_assign.go:333 assign requests for opt-125 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.025907 master_grpc_server_assign.go:333 assign requests for opt-126 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.026054 master_grpc_server_assign.go:333 assign requests for opt-127 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.026204 master_grpc_server_assign.go:333 assign requests for opt-128 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.026354 master_grpc_server_assign.go:333 assign requests for opt-129 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.026548 master_grpc_server_assign.go:333 assign requests for opt-130 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.026760 master_grpc_server_assign.go:333 assign requests for opt-131 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.026913 master_grpc_server_assign.go:333 assign requests for opt-132 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.027063 master_grpc_server_assign.go:333 assign requests for opt-133 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.027209 master_grpc_server_assign.go:333 assign requests for opt-134 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.027356 master_grpc_server_assign.go:333 assign requests for opt-135 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.027508 master_grpc_server_assign.go:333 assign requests for opt-136 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.027659 master_grpc_server_assign.go:333 assign requests for opt-137 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.027804 master_grpc_server_assign.go:333 assign requests for opt-138 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.027951 master_grpc_server_assign.go:333 assign requests for opt-139 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.028100 master_grpc_server_assign.go:333 assign requests for opt-140 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.028250 master_grpc_server_assign.go:333 assign requests for opt-141 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.028396 master_grpc_server_assign.go:333 assign requests for opt-142 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.028544 master_grpc_server_assign.go:333 assign requests for opt-143 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.028694 master_grpc_server_assign.go:333 assign requests for opt-144 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.028844 master_grpc_server_assign.go:333 assign requests for opt-145 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.028991 master_grpc_server_assign.go:333 assign requests for opt-146 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.029137 master_grpc_server_assign.go:333 assign requests for opt-147 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.029286 master_grpc_server_assign.go:333 assign requests for opt-148 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.029435 master_grpc_server_assign.go:333 assign requests for opt-149 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.029581 master_grpc_server_assign.go:333 assign requests for opt-150 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.029736 master_grpc_server_assign.go:333 assign requests for opt-151 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.029888 master_grpc_server_assign.go:333 assign requests for opt-152 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.030037 master_grpc_server_assign.go:333 assign requests for opt-153 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.030186 master_grpc_server_assign.go:333 assign requests for opt-154 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.030332 master_grpc_server_assign.go:333 assign requests for opt-155 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.030482 master_grpc_server_assign.go:333 assign requests for opt-156 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.030632 master_grpc_server_assign.go:333 assign requests for opt-157 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.030781 master_grpc_server_assign.go:333 assign requests for opt-158 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.030929 master_grpc_server_assign.go:333 assign requests for opt-159 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.031081 master_grpc_server_assign.go:333 assign requests for opt-160 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.031232 master_grpc_server_assign.go:333 assign requests for opt-161 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.031380 master_grpc_server_assign.go:333 assign requests for opt-162 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.031562 master_grpc_server_assign.go:333 assign requests for opt-163 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.031717 master_grpc_server_assign.go:333 assign requests for opt-164 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.031871 master_grpc_server_assign.go:333 assign requests for opt-165 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.032019 master_grpc_server_assign.go:333 assign requests for opt-166 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.032163 master_grpc_server_assign.go:333 assign requests for opt-167 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.032309 master_grpc_server_assign.go:333 assign requests for opt-168 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.032457 master_grpc_server_assign.go:333 assign requests for opt-169 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.032600 master_grpc_server_assign.go:333 assign requests for opt-170 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.032742 master_grpc_server_assign.go:333 assign requests for opt-171 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.032889 master_grpc_server_assign.go:333 assign requests for opt-172 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.033036 master_grpc_server_assign.go:333 assign requests for opt-173 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.033187 master_grpc_server_assign.go:333 assign requests for opt-174 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.033334 master_grpc_server_assign.go:333 assign requests for opt-175 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.033484 master_grpc_server_assign.go:333 assign requests for opt-176 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.033638 master_grpc_server_assign.go:333 assign requests for opt-177 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.033782 master_grpc_server_assign.go:333 assign requests for opt-178 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.033932 master_grpc_server_assign.go:333 assign requests for opt-179 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.034086 master_grpc_server_assign.go:333 assign requests for opt-180 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.034233 master_grpc_server_assign.go:333 assign requests for opt-181 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.034379 master_grpc_server_assign.go:333 assign requests for opt-182 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.034526 master_grpc_server_assign.go:333 assign requests for opt-183 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.034677 master_grpc_server_assign.go:333 assign requests for opt-184 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.034826 master_grpc_server_assign.go:333 assign requests for opt-185 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.034971 master_grpc_server_assign.go:333 assign requests for opt-186 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.035116 master_grpc_server_assign.go:333 assign requests for opt-187 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.035270 master_grpc_server_assign.go:333 assign requests for opt-188 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.035423 master_grpc_server_assign.go:333 assign requests for opt-189 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.035570 master_grpc_server_assign.go:333 assign requests for opt-190 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.035714 master_grpc_server_assign.go:333 assign requests for opt-191 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.035862 master_grpc_server_assign.go:333 assign requests for opt-192 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.036016 master_grpc_server_assign.go:333 assign requests for opt-193 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.036162 master_grpc_server_assign.go:333 assign requests for opt-194 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.036307 master_grpc_server_assign.go:333 assign requests for opt-195 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.036498 master_grpc_server_assign.go:333 assign requests for opt-196 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.036652 master_grpc_server_assign.go:333 assign requests for opt-197 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.036804 master_grpc_server_assign.go:333 assign requests for opt-198 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.036952 master_grpc_server_assign.go:333 assign requests for opt-199 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.037101 master_grpc_server_assign.go:333 assign requests for opt-200 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.037250 master_grpc_server_assign.go:333 assign requests for opt-201 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.037396 master_grpc_server_assign.go:333 assign requests for opt-202 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.037545 master_grpc_server_assign.go:333 assign requests for opt-203 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.037701 master_grpc_server_assign.go:333 assign requests for opt-204 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.037850 master_grpc_server_assign.go:333 assign requests for opt-205 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.037996 master_grpc_server_assign.go:333 assign requests for opt-206 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.038139 master_grpc_server_assign.go:333 assign requests for opt-207 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.038284 master_grpc_server_assign.go:333 assign requests for opt-208 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.038430 master_grpc_server_assign.go:333 assign requests for opt-209 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.038575 master_grpc_server_assign.go:333 assign requests for opt-210 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.038718 master_grpc_server_assign.go:333 assign requests for opt-211 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.038867 master_grpc_server_assign.go:333 assign requests for opt-212 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.039016 master_grpc_server_assign.go:333 assign requests for opt-213 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.039161 master_grpc_server_assign.go:333 assign requests for opt-214 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.039309 master_grpc_server_assign.go:333 assign requests for opt-215 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.039466 master_grpc_server_assign.go:333 assign requests for opt-216 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.039616 master_grpc_server_assign.go:333 assign requests for opt-217 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.039767 master_grpc_server_assign.go:333 assign requests for opt-218 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.039912 master_grpc_server_assign.go:333 assign requests for opt-219 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.040061 master_grpc_server_assign.go:333 assign requests for opt-220 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.040208 master_grpc_server_assign.go:333 assign requests for opt-221 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.040358 master_grpc_server_assign.go:333 assign requests for opt-222 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.040507 master_grpc_server_assign.go:333 assign requests for opt-223 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.041166 master_grpc_server_assign.go:333 assign requests for opt-224 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.041318 master_grpc_server_assign.go:333 assign requests for opt-225 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.041463 master_grpc_server_assign.go:333 assign requests for opt-226 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.041606 master_grpc_server_assign.go:333 assign requests for opt-227 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.041756 master_grpc_server_assign.go:333 assign requests for opt-228 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.041944 master_grpc_server_assign.go:333 assign requests for opt-229 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.042091 master_grpc_server_assign.go:333 assign requests for opt-230 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.042237 master_grpc_server_assign.go:333 assign requests for opt-231 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.042420 master_grpc_server_assign.go:333 assign requests for opt-232 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.042570 master_grpc_server_assign.go:333 assign requests for opt-233 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.042713 master_grpc_server_assign.go:333 assign requests for opt-234 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.042859 master_grpc_server_assign.go:333 assign requests for opt-235 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.043013 master_grpc_server_assign.go:333 assign requests for opt-236 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.043175 master_grpc_server_assign.go:333 assign requests for opt-237 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.043323 master_grpc_server_assign.go:333 assign requests for opt-238 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.043472 master_grpc_server_assign.go:333 assign requests for opt-239 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.043625 master_grpc_server_assign.go:333 assign requests for opt-240 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.043780 master_grpc_server_assign.go:333 assign requests for opt-241 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.043925 master_grpc_server_assign.go:333 assign requests for opt-242 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.044069 master_grpc_server_assign.go:333 assign requests for opt-243 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.044216 master_grpc_server_assign.go:333 assign requests for opt-244 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.044358 master_grpc_server_assign.go:333 assign requests for opt-245 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.044501 master_grpc_server_assign.go:333 assign requests for opt-246 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.044640 master_grpc_server_assign.go:333 assign requests for opt-247 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.044784 master_grpc_server_assign.go:333 assign requests for opt-248 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.044927 master_grpc_server_assign.go:333 assign requests for opt-249 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.045068 master_grpc_server_assign.go:333 assign requests for opt-250 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.045208 master_grpc_server_assign.go:333 assign requests for opt-251 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.045352 master_grpc_server_assign.go:333 assign requests for opt-252 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.045495 master_grpc_server_assign.go:333 assign requests for opt-253 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.045637 master_grpc_server_assign.go:333 assign requests for opt-254 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.045778 master_grpc_server_assign.go:333 assign requests for opt-255 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.045922 master_grpc_server_assign.go:333 assign requests for opt-256 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.046068 master_grpc_server_assign.go:333 assign requests for opt-257 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.046209 master_grpc_server_assign.go:333 assign requests for opt-258 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.046348 master_grpc_server_assign.go:333 assign requests for opt-259 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.046504 master_grpc_server_assign.go:333 assign requests for opt-260 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.046650 master_grpc_server_assign.go:333 assign requests for opt-261 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.046910 master_grpc_server_assign.go:333 assign requests for opt-262 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.047063 master_grpc_server_assign.go:333 assign requests for opt-263 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.047211 master_grpc_server_assign.go:333 assign requests for opt-264 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.047359 master_grpc_server_assign.go:333 assign requests for opt-265 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.047500 master_grpc_server_assign.go:333 assign requests for opt-266 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.047640 master_grpc_server_assign.go:333 assign requests for opt-267 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.047784 master_grpc_server_assign.go:333 assign requests for opt-268 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.047928 master_grpc_server_assign.go:333 assign requests for opt-269 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.048068 master_grpc_server_assign.go:333 assign requests for opt-270 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.048208 master_grpc_server_assign.go:333 assign requests for opt-271 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.048353 master_grpc_server_assign.go:333 assign requests for opt-272 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.048497 master_grpc_server_assign.go:333 assign requests for opt-273 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.048636 master_grpc_server_assign.go:333 assign requests for opt-274 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.048776 master_grpc_server_assign.go:333 assign requests for opt-275 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.048930 master_grpc_server_assign.go:333 assign requests for opt-276 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.049085 master_grpc_server_assign.go:333 assign requests for opt-277 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.049231 master_grpc_server_assign.go:333 assign requests for opt-278 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.049379 master_grpc_server_assign.go:333 assign requests for opt-279 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.049532 master_grpc_server_assign.go:333 assign requests for opt-280 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.049683 master_grpc_server_assign.go:333 assign requests for opt-281 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.049839 master_grpc_server_assign.go:333 assign requests for opt-282 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.049988 master_grpc_server_assign.go:333 assign requests for opt-283 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.050142 master_grpc_server_assign.go:333 assign requests for opt-284 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.050288 master_grpc_server_assign.go:333 assign requests for opt-285 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.050433 master_grpc_server_assign.go:333 assign requests for opt-286 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.050582 master_grpc_server_assign.go:333 assign requests for opt-287 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.050731 master_grpc_server_assign.go:333 assign requests for opt-288 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.050884 master_grpc_server_assign.go:333 assign requests for opt-289 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.051031 master_grpc_server_assign.go:333 assign requests for opt-290 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.051176 master_grpc_server_assign.go:333 assign requests for opt-291 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.051327 master_grpc_server_assign.go:333 assign requests for opt-292 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.051479 master_grpc_server_assign.go:333 assign requests for opt-293 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.051624 master_grpc_server_assign.go:333 assign requests for opt-294 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.051811 master_grpc_server_assign.go:333 assign requests for opt-295 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.051961 master_grpc_server_assign.go:333 assign requests for opt-296 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.052108 master_grpc_server_assign.go:333 assign requests for opt-297 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.052252 master_grpc_server_assign.go:333 assign requests for opt-298 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.052397 master_grpc_server_assign.go:333 assign requests for opt-299 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.052547 master_grpc_server_assign.go:333 assign requests for opt-300 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.052695 master_grpc_server_assign.go:333 assign requests for opt-301 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.052840 master_grpc_server_assign.go:333 assign requests for opt-302 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.052985 master_grpc_server_assign.go:333 assign requests for opt-303 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.053139 master_grpc_server_assign.go:333 assign requests for opt-304 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.053289 master_grpc_server_assign.go:333 assign requests for opt-305 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.053432 master_grpc_server_assign.go:333 assign requests for opt-306 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.053580 master_grpc_server_assign.go:333 assign requests for opt-307 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.053729 master_grpc_server_assign.go:333 assign requests for opt-308 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.053878 master_grpc_server_assign.go:333 assign requests for opt-309 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.054020 master_grpc_server_assign.go:333 assign requests for opt-310 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.054164 master_grpc_server_assign.go:333 assign requests for opt-311 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.054311 master_grpc_server_assign.go:333 assign requests for opt-312 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.054458 master_grpc_server_assign.go:333 assign requests for opt-313 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.054601 master_grpc_server_assign.go:333 assign requests for opt-314 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.054743 master_grpc_server_assign.go:333 assign requests for opt-315 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.054890 master_grpc_server_assign.go:333 assign requests for opt-316 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.055036 master_grpc_server_assign.go:333 assign requests for opt-317 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.055178 master_grpc_server_assign.go:333 assign requests for opt-318 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.055322 master_grpc_server_assign.go:333 assign requests for opt-319 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.055467 master_grpc_server_assign.go:333 assign requests for opt-320 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.055617 master_grpc_server_assign.go:333 assign requests for opt-321 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.055760 master_grpc_server_assign.go:333 assign requests for opt-322 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.055907 master_grpc_server_assign.go:333 assign requests for opt-323 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.056057 master_grpc_server_assign.go:333 assign requests for opt-324 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.056209 master_grpc_server_assign.go:333 assign requests for opt-325 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.056364 master_grpc_server_assign.go:333 assign requests for opt-326 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.056523 master_grpc_server_assign.go:333 assign requests for opt-327 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.056711 master_grpc_server_assign.go:333 assign requests for opt-328 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.056866 master_grpc_server_assign.go:333 assign requests for opt-329 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.057016 master_grpc_server_assign.go:333 assign requests for opt-330 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.057164 master_grpc_server_assign.go:333 assign requests for opt-331 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.057316 master_grpc_server_assign.go:333 assign requests for opt-332 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.057468 master_grpc_server_assign.go:333 assign requests for opt-333 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.057618 master_grpc_server_assign.go:333 assign requests for opt-334 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.057766 master_grpc_server_assign.go:333 assign requests for opt-335 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.057919 master_grpc_server_assign.go:333 assign requests for opt-336 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.058072 master_grpc_server_assign.go:333 assign requests for opt-337 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.058220 master_grpc_server_assign.go:333 assign requests for opt-338 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.058373 master_grpc_server_assign.go:333 assign requests for opt-339 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.058525 master_grpc_server_assign.go:333 assign requests for opt-340 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.058677 master_grpc_server_assign.go:333 assign requests for opt-341 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.058827 master_grpc_server_assign.go:333 assign requests for opt-342 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.058974 master_grpc_server_assign.go:333 assign requests for opt-343 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.059126 master_grpc_server_assign.go:333 assign requests for opt-344 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.059279 master_grpc_server_assign.go:333 assign requests for opt-345 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.059429 master_grpc_server_assign.go:333 assign requests for opt-346 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.059577 master_grpc_server_assign.go:333 assign requests for opt-347 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.059734 master_grpc_server_assign.go:333 assign requests for opt-348 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.059889 master_grpc_server_assign.go:333 assign requests for opt-349 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.060038 master_grpc_server_assign.go:333 assign requests for opt-350 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.060185 master_grpc_server_assign.go:333 assign requests for opt-351 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.060336 master_grpc_server_assign.go:333 assign requests for opt-352 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.060489 master_grpc_server_assign.go:333 assign requests for opt-353 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.060638 master_grpc_server_assign.go:333 assign requests for opt-354 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.060790 master_grpc_server_assign.go:333 assign requests for opt-355 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.060944 master_grpc_server_assign.go:333 assign requests for opt-356 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.061094 master_grpc_server_assign.go:333 assign requests for opt-357 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.061242 master_grpc_server_assign.go:333 assign requests for opt-358 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.061397 master_grpc_server_assign.go:333 assign requests for opt-359 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.061548 master_grpc_server_assign.go:333 assign requests for opt-360 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.061733 master_grpc_server_assign.go:333 assign requests for opt-361 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.061881 master_grpc_server_assign.go:333 assign requests for opt-362 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.062029 master_grpc_server_assign.go:333 assign requests for opt-363 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.062180 master_grpc_server_assign.go:333 assign requests for opt-364 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.062334 master_grpc_server_assign.go:333 assign requests for opt-365 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.062490 master_grpc_server_assign.go:333 assign requests for opt-366 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.062640 master_grpc_server_assign.go:333 assign requests for opt-367 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.062794 master_grpc_server_assign.go:333 assign requests for opt-368 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.062948 master_grpc_server_assign.go:333 assign requests for opt-369 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.063100 master_grpc_server_assign.go:333 assign requests for opt-370 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.063249 master_grpc_server_assign.go:333 assign requests for opt-371 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.063398 master_grpc_server_assign.go:333 assign requests for opt-372 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.063552 master_grpc_server_assign.go:333 assign requests for opt-373 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.063703 master_grpc_server_assign.go:333 assign requests for opt-374 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.063852 master_grpc_server_assign.go:333 assign requests for opt-375 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.064004 master_grpc_server_assign.go:333 assign requests for opt-376 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.064156 master_grpc_server_assign.go:333 assign requests for opt-377 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.064302 master_grpc_server_assign.go:333 assign requests for opt-378 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.064451 master_grpc_server_assign.go:333 assign requests for opt-379 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.064603 master_grpc_server_assign.go:333 assign requests for opt-380 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.064756 master_grpc_server_assign.go:333 assign requests for opt-381 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.064904 master_grpc_server_assign.go:333 assign requests for opt-382 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.065050 master_grpc_server_assign.go:333 assign requests for opt-383 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.065201 master_grpc_server_assign.go:333 assign requests for opt-384 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.065353 master_grpc_server_assign.go:333 assign requests for opt-385 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.065500 master_grpc_server_assign.go:333 assign requests for opt-386 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.065651 master_grpc_server_assign.go:333 assign requests for opt-387 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.065811 master_grpc_server_assign.go:333 assign requests for opt-388 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.065967 master_grpc_server_assign.go:333 assign requests for opt-389 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.066123 master_grpc_server_assign.go:333 assign requests for opt-390 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.066279 master_grpc_server_assign.go:333 assign requests for opt-391 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.066441 master_grpc_server_assign.go:333 assign requests for opt-392 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.066599 master_grpc_server_assign.go:333 assign requests for opt-393 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.066793 master_grpc_server_assign.go:333 assign requests for opt-394 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.066952 master_grpc_server_assign.go:333 assign requests for opt-395 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.067222 master_grpc_server_assign.go:333 assign requests for opt-396 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.067380 master_grpc_server_assign.go:333 assign requests for opt-397 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.067533 master_grpc_server_assign.go:333 assign requests for opt-398 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.067686 master_grpc_server_assign.go:333 assign requests for opt-399 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.067847 master_grpc_server_assign.go:333 assign requests for opt-400 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.068005 master_grpc_server_assign.go:333 assign requests for opt-401 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.068157 master_grpc_server_assign.go:333 assign requests for opt-402 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.068310 master_grpc_server_assign.go:333 assign requests for opt-403 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.068468 master_grpc_server_assign.go:333 assign requests for opt-404 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.068626 master_grpc_server_assign.go:333 assign requests for opt-405 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.068780 master_grpc_server_assign.go:333 assign requests for opt-406 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.068932 master_grpc_server_assign.go:333 assign requests for opt-407 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.069083 master_grpc_server_assign.go:333 assign requests for opt-408 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.069237 master_grpc_server_assign.go:333 assign requests for opt-409 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.069390 master_grpc_server_assign.go:333 assign requests for opt-410 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.069543 master_grpc_server_assign.go:333 assign requests for opt-411 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.069695 master_grpc_server_assign.go:333 assign requests for opt-412 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.069858 master_grpc_server_assign.go:333 assign requests for opt-413 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.070010 master_grpc_server_assign.go:333 assign requests for opt-414 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.070161 master_grpc_server_assign.go:333 assign requests for opt-415 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.070311 master_grpc_server_assign.go:333 assign requests for opt-416 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.070464 master_grpc_server_assign.go:333 assign requests for opt-417 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.070612 master_grpc_server_assign.go:333 assign requests for opt-418 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.070764 master_grpc_server_assign.go:333 assign requests for opt-419 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.070915 master_grpc_server_assign.go:333 assign requests for opt-420 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.071069 master_grpc_server_assign.go:333 assign requests for opt-421 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.071217 master_grpc_server_assign.go:333 assign requests for opt-422 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.071366 master_grpc_server_assign.go:333 assign requests for opt-423 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.071517 master_grpc_server_assign.go:333 assign requests for opt-424 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.071668 master_grpc_server_assign.go:333 assign requests for opt-425 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.071815 master_grpc_server_assign.go:333 assign requests for opt-426 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.072001 master_grpc_server_assign.go:333 assign requests for opt-427 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.072153 master_grpc_server_assign.go:333 assign requests for opt-428 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.072300 master_grpc_server_assign.go:333 assign requests for opt-429 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.072443 master_grpc_server_assign.go:333 assign requests for opt-430 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.072589 master_grpc_server_assign.go:333 assign requests for opt-431 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.072747 master_grpc_server_assign.go:333 assign requests for opt-432 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.072898 master_grpc_server_assign.go:333 assign requests for opt-433 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.073045 master_grpc_server_assign.go:333 assign requests for opt-434 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.073197 master_grpc_server_assign.go:333 assign requests for opt-435 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.073345 master_grpc_server_assign.go:333 assign requests for opt-436 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.073494 master_grpc_server_assign.go:333 assign requests for opt-437 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.073644 master_grpc_server_assign.go:333 assign requests for opt-438 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.073794 master_grpc_server_assign.go:333 assign requests for opt-439 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.073945 master_grpc_server_assign.go:333 assign requests for opt-440 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.074094 master_grpc_server_assign.go:333 assign requests for opt-441 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.074237 master_grpc_server_assign.go:333 assign requests for opt-442 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.074392 master_grpc_server_assign.go:333 assign requests for opt-443 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.074549 master_grpc_server_assign.go:333 assign requests for opt-444 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.074708 master_grpc_server_assign.go:333 assign requests for opt-445 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.074861 master_grpc_server_assign.go:333 assign requests for opt-446 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.075016 master_grpc_server_assign.go:333 assign requests for opt-447 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.076427 master_grpc_server_assign.go:333 assign requests for opt-448 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.076604 master_grpc_server_assign.go:333 assign requests for opt-449 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.076772 master_grpc_server_assign.go:333 assign requests for opt-450 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.076923 master_grpc_server_assign.go:333 assign requests for opt-451 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.077078 master_grpc_server_assign.go:333 assign requests for opt-452 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.077235 master_grpc_server_assign.go:333 assign requests for opt-453 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.077389 master_grpc_server_assign.go:333 assign requests for opt-454 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.077544 master_grpc_server_assign.go:333 assign requests for opt-455 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.077701 master_grpc_server_assign.go:333 assign requests for opt-456 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.077858 master_grpc_server_assign.go:333 assign requests for opt-457 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.078010 master_grpc_server_assign.go:333 assign requests for opt-458 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.078161 master_grpc_server_assign.go:333 assign requests for opt-459 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.078349 master_grpc_server_assign.go:333 assign requests for opt-460 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.078504 master_grpc_server_assign.go:333 assign requests for opt-461 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.078654 master_grpc_server_assign.go:333 assign requests for opt-462 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.078803 master_grpc_server_assign.go:333 assign requests for opt-463 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.078959 master_grpc_server_assign.go:333 assign requests for opt-464 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.079113 master_grpc_server_assign.go:333 assign requests for opt-465 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.079263 master_grpc_server_assign.go:333 assign requests for opt-466 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.079415 master_grpc_server_assign.go:333 assign requests for opt-467 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.079569 master_grpc_server_assign.go:333 assign requests for opt-468 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.079729 master_grpc_server_assign.go:333 assign requests for opt-469 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.079883 master_grpc_server_assign.go:333 assign requests for opt-470 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.080035 master_grpc_server_assign.go:333 assign requests for opt-471 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.080190 master_grpc_server_assign.go:333 assign requests for opt-472 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.080346 master_grpc_server_assign.go:333 assign requests for opt-473 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.080496 master_grpc_server_assign.go:333 assign requests for opt-474 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.080646 master_grpc_server_assign.go:333 assign requests for opt-475 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.080802 master_grpc_server_assign.go:333 assign requests for opt-476 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.080959 master_grpc_server_assign.go:333 assign requests for opt-477 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.081110 master_grpc_server_assign.go:333 assign requests for opt-478 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.081262 master_grpc_server_assign.go:333 assign requests for opt-479 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.081456 master_grpc_server_assign.go:333 assign requests for opt-480 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.081614 master_grpc_server_assign.go:333 assign requests for opt-481 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.081765 master_grpc_server_assign.go:333 assign requests for opt-482 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.081918 master_grpc_server_assign.go:333 assign requests for opt-483 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.082073 master_grpc_server_assign.go:333 assign requests for opt-484 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.082270 master_grpc_server_assign.go:333 assign requests for opt-485 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.082424 master_grpc_server_assign.go:333 assign requests for opt-486 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.082578 master_grpc_server_assign.go:333 assign requests for opt-487 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.082735 master_grpc_server_assign.go:333 assign requests for opt-488 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.082891 master_grpc_server_assign.go:333 assign requests for opt-489 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.083044 master_grpc_server_assign.go:333 assign requests for opt-490 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.083204 master_grpc_server_assign.go:333 assign requests for opt-491 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.083360 master_grpc_server_assign.go:333 assign requests for opt-492 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.083552 master_grpc_server_assign.go:333 assign requests for opt-493 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.083706 master_grpc_server_assign.go:333 assign requests for opt-494 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.083858 master_grpc_server_assign.go:333 assign requests for opt-495 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.084014 master_grpc_server_assign.go:333 assign requests for opt-496 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.084169 master_grpc_server_assign.go:333 assign requests for opt-497 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.084319 master_grpc_server_assign.go:333 assign requests for opt-498 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.084469 master_grpc_server_assign.go:333 assign requests for opt-499 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.084622 master_grpc_server_assign.go:333 assign requests for opt-500 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.084776 master_grpc_server_assign.go:333 assign requests for opt-501 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.084927 master_grpc_server_assign.go:333 assign requests for opt-502 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.085078 master_grpc_server_assign.go:333 assign requests for opt-503 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.085330 master_grpc_server_assign.go:333 assign requests for opt-504 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.085486 master_grpc_server_assign.go:333 assign requests for opt-505 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.085640 master_grpc_server_assign.go:333 assign requests for opt-506 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.085791 master_grpc_server_assign.go:333 assign requests for opt-507 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.085946 master_grpc_server_assign.go:333 assign requests for opt-508 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.086101 master_grpc_server_assign.go:333 assign requests for opt-509 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.086251 master_grpc_server_assign.go:333 assign requests for opt-510 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.086411 master_grpc_server_assign.go:333 assign requests for opt-511 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.086566 master_grpc_server_assign.go:333 assign requests for opt-512 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.086722 master_grpc_server_assign.go:333 assign requests for opt-513 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.086873 master_grpc_server_assign.go:333 assign requests for opt-514 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.087024 master_grpc_server_assign.go:333 assign requests for opt-515 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.087235 master_grpc_server_assign.go:333 assign requests for opt-516 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.087391 master_grpc_server_assign.go:333 assign requests for opt-517 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.087542 master_grpc_server_assign.go:333 assign requests for opt-518 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.087694 master_grpc_server_assign.go:333 assign requests for opt-519 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.087849 master_grpc_server_assign.go:333 assign requests for opt-520 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.088005 master_grpc_server_assign.go:333 assign requests for opt-521 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.088155 master_grpc_server_assign.go:333 assign requests for opt-522 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.088307 master_grpc_server_assign.go:333 assign requests for opt-523 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.088462 master_grpc_server_assign.go:333 assign requests for opt-524 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.088617 master_grpc_server_assign.go:333 assign requests for opt-525 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.088805 master_grpc_server_assign.go:333 assign requests for opt-526 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.088960 master_grpc_server_assign.go:333 assign requests for opt-527 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.089116 master_grpc_server_assign.go:333 assign requests for opt-528 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.089275 master_grpc_server_assign.go:333 assign requests for opt-529 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.089426 master_grpc_server_assign.go:333 assign requests for opt-530 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.089578 master_grpc_server_assign.go:333 assign requests for opt-531 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.089741 master_grpc_server_assign.go:333 assign requests for opt-532 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.089899 master_grpc_server_assign.go:333 assign requests for opt-533 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.090051 master_grpc_server_assign.go:333 assign requests for opt-534 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.090202 master_grpc_server_assign.go:333 assign requests for opt-535 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.090357 master_grpc_server_assign.go:333 assign requests for opt-536 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.090510 master_grpc_server_assign.go:333 assign requests for opt-537 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.090661 master_grpc_server_assign.go:333 assign requests for opt-538 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.090813 master_grpc_server_assign.go:333 assign requests for opt-539 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.090968 master_grpc_server_assign.go:333 assign requests for opt-540 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.091124 master_grpc_server_assign.go:333 assign requests for opt-541 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.091275 master_grpc_server_assign.go:333 assign requests for opt-542 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.091430 master_grpc_server_assign.go:333 assign requests for opt-543 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.091586 master_grpc_server_assign.go:333 assign requests for opt-544 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.091740 master_grpc_server_assign.go:333 assign requests for opt-545 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.091891 master_grpc_server_assign.go:333 assign requests for opt-546 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.092044 master_grpc_server_assign.go:333 assign requests for opt-547 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.092198 master_grpc_server_assign.go:333 assign requests for opt-548 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.092353 master_grpc_server_assign.go:333 assign requests for opt-549 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.092504 master_grpc_server_assign.go:333 assign requests for opt-550 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.092657 master_grpc_server_assign.go:333 assign requests for opt-551 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.092812 master_grpc_server_assign.go:333 assign requests for opt-552 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.092967 master_grpc_server_assign.go:333 assign requests for opt-553 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.093125 master_grpc_server_assign.go:333 assign requests for opt-554 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.093278 master_grpc_server_assign.go:333 assign requests for opt-555 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.093431 master_grpc_server_assign.go:333 assign requests for opt-556 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.093584 master_grpc_server_assign.go:333 assign requests for opt-557 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.093736 master_grpc_server_assign.go:333 assign requests for opt-558 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.093922 master_grpc_server_assign.go:333 assign requests for opt-559 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.094079 master_grpc_server_assign.go:333 assign requests for opt-560 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.094233 master_grpc_server_assign.go:333 assign requests for opt-561 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.094384 master_grpc_server_assign.go:333 assign requests for opt-562 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.094534 master_grpc_server_assign.go:333 assign requests for opt-563 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.094687 master_grpc_server_assign.go:333 assign requests for opt-564 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.094842 master_grpc_server_assign.go:333 assign requests for opt-565 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.094992 master_grpc_server_assign.go:333 assign requests for opt-566 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.095143 master_grpc_server_assign.go:333 assign requests for opt-567 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.095298 master_grpc_server_assign.go:333 assign requests for opt-568 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.095456 master_grpc_server_assign.go:333 assign requests for opt-569 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.095608 master_grpc_server_assign.go:333 assign requests for opt-570 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.095759 master_grpc_server_assign.go:333 assign requests for opt-571 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.095913 master_grpc_server_assign.go:333 assign requests for opt-572 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.096069 master_grpc_server_assign.go:333 assign requests for opt-573 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.096221 master_grpc_server_assign.go:333 assign requests for opt-574 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.096374 master_grpc_server_assign.go:333 assign requests for opt-575 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.096535 master_grpc_server_assign.go:333 assign requests for opt-576 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.096691 master_grpc_server_assign.go:333 assign requests for opt-577 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.096843 master_grpc_server_assign.go:333 assign requests for opt-578 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.096994 master_grpc_server_assign.go:333 assign requests for opt-579 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.097147 master_grpc_server_assign.go:333 assign requests for opt-580 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.097299 master_grpc_server_assign.go:333 assign requests for opt-581 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.097448 master_grpc_server_assign.go:333 assign requests for opt-582 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.097596 master_grpc_server_assign.go:333 assign requests for opt-583 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.097749 master_grpc_server_assign.go:333 assign requests for opt-584 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.097903 master_grpc_server_assign.go:333 assign requests for opt-585 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.098051 master_grpc_server_assign.go:333 assign requests for opt-586 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.098201 master_grpc_server_assign.go:333 assign requests for opt-587 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.098355 master_grpc_server_assign.go:333 assign requests for opt-588 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.098510 master_grpc_server_assign.go:333 assign requests for opt-589 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.098657 master_grpc_server_assign.go:333 assign requests for opt-590 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.098808 master_grpc_server_assign.go:333 assign requests for opt-591 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.098998 master_grpc_server_assign.go:333 assign requests for opt-592 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.099154 master_grpc_server_assign.go:333 assign requests for opt-593 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.099302 master_grpc_server_assign.go:333 assign requests for opt-594 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.099452 master_grpc_server_assign.go:333 assign requests for opt-595 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.099604 master_grpc_server_assign.go:333 assign requests for opt-596 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.099764 master_grpc_server_assign.go:333 assign requests for opt-597 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.099914 master_grpc_server_assign.go:333 assign requests for opt-598 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.100063 master_grpc_server_assign.go:333 assign requests for opt-599 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.100216 master_grpc_server_assign.go:333 assign requests for opt-600 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.100369 master_grpc_server_assign.go:333 assign requests for opt-601 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.100519 master_grpc_server_assign.go:333 assign requests for opt-602 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.100667 master_grpc_server_assign.go:333 assign requests for opt-603 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.100819 master_grpc_server_assign.go:333 assign requests for opt-604 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.100973 master_grpc_server_assign.go:333 assign requests for opt-605 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.101124 master_grpc_server_assign.go:333 assign requests for opt-606 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.101274 master_grpc_server_assign.go:333 assign requests for opt-607 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.101426 master_grpc_server_assign.go:333 assign requests for opt-608 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.101579 master_grpc_server_assign.go:333 assign requests for opt-609 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.101729 master_grpc_server_assign.go:333 assign requests for opt-610 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.101879 master_grpc_server_assign.go:333 assign requests for opt-611 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.102033 master_grpc_server_assign.go:333 assign requests for opt-612 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.102188 master_grpc_server_assign.go:333 assign requests for opt-613 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.102338 master_grpc_server_assign.go:333 assign requests for opt-614 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.102489 master_grpc_server_assign.go:333 assign requests for opt-615 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.102642 master_grpc_server_assign.go:333 assign requests for opt-616 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.102795 master_grpc_server_assign.go:333 assign requests for opt-617 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.102946 master_grpc_server_assign.go:333 assign requests for opt-618 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.103104 master_grpc_server_assign.go:333 assign requests for opt-619 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.103257 master_grpc_server_assign.go:333 assign requests for opt-620 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.103410 master_grpc_server_assign.go:333 assign requests for opt-621 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.103561 master_grpc_server_assign.go:333 assign requests for opt-622 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.103712 master_grpc_server_assign.go:333 assign requests for opt-623 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.103865 master_grpc_server_assign.go:333 assign requests for opt-624 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.104051 master_grpc_server_assign.go:333 assign requests for opt-625 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.104204 master_grpc_server_assign.go:333 assign requests for opt-626 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.104355 master_grpc_server_assign.go:333 assign requests for opt-627 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.104507 master_grpc_server_assign.go:333 assign requests for opt-628 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.104657 master_grpc_server_assign.go:333 assign requests for opt-629 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.104804 master_grpc_server_assign.go:333 assign requests for opt-630 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.104952 master_grpc_server_assign.go:333 assign requests for opt-631 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.105105 master_grpc_server_assign.go:333 assign requests for opt-632 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.105263 master_grpc_server_assign.go:333 assign requests for opt-633 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.105412 master_grpc_server_assign.go:333 assign requests for opt-634 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.105562 master_grpc_server_assign.go:333 assign requests for opt-635 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.105714 master_grpc_server_assign.go:333 assign requests for opt-636 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.105868 master_grpc_server_assign.go:333 assign requests for opt-637 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.106018 master_grpc_server_assign.go:333 assign requests for opt-638 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.106168 master_grpc_server_assign.go:333 assign requests for opt-639 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.106321 master_grpc_server_assign.go:333 assign requests for opt-640 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.106482 master_grpc_server_assign.go:333 assign requests for opt-641 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.106633 master_grpc_server_assign.go:333 assign requests for opt-642 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.106782 master_grpc_server_assign.go:333 assign requests for opt-643 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.106935 master_grpc_server_assign.go:333 assign requests for opt-644 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.107088 master_grpc_server_assign.go:333 assign requests for opt-645 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.107239 master_grpc_server_assign.go:333 assign requests for opt-646 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.107439 master_grpc_server_assign.go:333 assign requests for opt-647 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.107595 master_grpc_server_assign.go:333 assign requests for opt-648 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.107749 master_grpc_server_assign.go:333 assign requests for opt-649 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.107902 master_grpc_server_assign.go:333 assign requests for opt-650 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.108052 master_grpc_server_assign.go:333 assign requests for opt-651 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.108204 master_grpc_server_assign.go:333 assign requests for opt-652 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.108356 master_grpc_server_assign.go:333 assign requests for opt-653 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.108505 master_grpc_server_assign.go:333 assign requests for opt-654 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.108658 master_grpc_server_assign.go:333 assign requests for opt-655 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.108811 master_grpc_server_assign.go:333 assign requests for opt-656 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.108964 master_grpc_server_assign.go:333 assign requests for opt-657 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.109149 master_grpc_server_assign.go:333 assign requests for opt-658 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.109302 master_grpc_server_assign.go:333 assign requests for opt-659 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.109456 master_grpc_server_assign.go:333 assign requests for opt-660 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.109609 master_grpc_server_assign.go:333 assign requests for opt-661 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.109765 master_grpc_server_assign.go:333 assign requests for opt-662 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.109917 master_grpc_server_assign.go:333 assign requests for opt-663 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.110072 master_grpc_server_assign.go:333 assign requests for opt-664 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.110227 master_grpc_server_assign.go:333 assign requests for opt-665 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.110382 master_grpc_server_assign.go:333 assign requests for opt-666 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.110533 master_grpc_server_assign.go:333 assign requests for opt-667 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.110688 master_grpc_server_assign.go:333 assign requests for opt-668 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.110843 master_grpc_server_assign.go:333 assign requests for opt-669 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.110995 master_grpc_server_assign.go:333 assign requests for opt-670 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.111150 master_grpc_server_assign.go:333 assign requests for opt-671 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.111304 master_grpc_server_assign.go:333 assign requests for opt-672 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.111460 master_grpc_server_assign.go:333 assign requests for opt-673 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.111612 master_grpc_server_assign.go:333 assign requests for opt-674 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.111765 master_grpc_server_assign.go:333 assign requests for opt-675 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.111919 master_grpc_server_assign.go:333 assign requests for opt-676 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.112073 master_grpc_server_assign.go:333 assign requests for opt-677 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.112221 master_grpc_server_assign.go:333 assign requests for opt-678 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.112372 master_grpc_server_assign.go:333 assign requests for opt-679 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.112530 master_grpc_server_assign.go:333 assign requests for opt-680 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.112685 master_grpc_server_assign.go:333 assign requests for opt-681 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.112833 master_grpc_server_assign.go:333 assign requests for opt-682 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.112982 master_grpc_server_assign.go:333 assign requests for opt-683 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.113141 master_grpc_server_assign.go:333 assign requests for opt-684 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.113294 master_grpc_server_assign.go:333 assign requests for opt-685 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.113443 master_grpc_server_assign.go:333 assign requests for opt-686 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.113592 master_grpc_server_assign.go:333 assign requests for opt-687 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.113745 master_grpc_server_assign.go:333 assign requests for opt-688 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.113897 master_grpc_server_assign.go:333 assign requests for opt-689 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.114046 master_grpc_server_assign.go:333 assign requests for opt-690 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.114232 master_grpc_server_assign.go:333 assign requests for opt-691 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.114386 master_grpc_server_assign.go:333 assign requests for opt-692 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.114539 master_grpc_server_assign.go:333 assign requests for opt-693 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.114689 master_grpc_server_assign.go:333 assign requests for opt-694 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.114839 master_grpc_server_assign.go:333 assign requests for opt-695 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.114993 master_grpc_server_assign.go:333 assign requests for opt-696 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.115149 master_grpc_server_assign.go:333 assign requests for opt-697 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.115299 master_grpc_server_assign.go:333 assign requests for opt-698 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.115449 master_grpc_server_assign.go:333 assign requests for opt-699 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.115603 master_grpc_server_assign.go:333 assign requests for opt-700 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.115758 master_grpc_server_assign.go:333 assign requests for opt-701 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.115910 master_grpc_server_assign.go:333 assign requests for opt-702 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.116064 master_grpc_server_assign.go:333 assign requests for opt-703 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.116220 master_grpc_server_assign.go:333 assign requests for opt-704 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.116375 master_grpc_server_assign.go:333 assign requests for opt-705 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.116534 master_grpc_server_assign.go:333 assign requests for opt-706 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.116685 master_grpc_server_assign.go:333 assign requests for opt-707 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.116840 master_grpc_server_assign.go:333 assign requests for opt-708 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.116996 master_grpc_server_assign.go:333 assign requests for opt-709 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.117146 master_grpc_server_assign.go:333 assign requests for opt-710 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.117301 master_grpc_server_assign.go:333 assign requests for opt-711 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.117456 master_grpc_server_assign.go:333 assign requests for opt-712 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.117611 master_grpc_server_assign.go:333 assign requests for opt-713 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.117762 master_grpc_server_assign.go:333 assign requests for opt-714 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.117912 master_grpc_server_assign.go:333 assign requests for opt-715 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.118066 master_grpc_server_assign.go:333 assign requests for opt-716 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.118222 master_grpc_server_assign.go:333 assign requests for opt-717 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.118373 master_grpc_server_assign.go:333 assign requests for opt-718 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.118525 master_grpc_server_assign.go:333 assign requests for opt-719 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.118679 master_grpc_server_assign.go:333 assign requests for opt-720 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.118833 master_grpc_server_assign.go:333 assign requests for opt-721 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.118984 master_grpc_server_assign.go:333 assign requests for opt-722 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.119134 master_grpc_server_assign.go:333 assign requests for opt-723 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.119324 master_grpc_server_assign.go:333 assign requests for opt-724 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.119480 master_grpc_server_assign.go:333 assign requests for opt-725 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.119632 master_grpc_server_assign.go:333 assign requests for opt-726 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.119790 master_grpc_server_assign.go:333 assign requests for opt-727 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.119981 master_grpc_server_assign.go:333 assign requests for opt-728 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.120135 master_grpc_server_assign.go:333 assign requests for opt-729 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.120287 master_grpc_server_assign.go:333 assign requests for opt-730 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.120437 master_grpc_server_assign.go:333 assign requests for opt-731 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.120593 master_grpc_server_assign.go:333 assign requests for opt-732 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.120749 master_grpc_server_assign.go:333 assign requests for opt-733 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.120899 master_grpc_server_assign.go:333 assign requests for opt-734 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.121049 master_grpc_server_assign.go:333 assign requests for opt-735 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.121203 master_grpc_server_assign.go:333 assign requests for opt-736 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.121356 master_grpc_server_assign.go:333 assign requests for opt-737 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.121508 master_grpc_server_assign.go:333 assign requests for opt-738 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.121658 master_grpc_server_assign.go:333 assign requests for opt-739 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.121814 master_grpc_server_assign.go:333 assign requests for opt-740 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.121968 master_grpc_server_assign.go:333 assign requests for opt-741 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.122118 master_grpc_server_assign.go:333 assign requests for opt-742 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.122269 master_grpc_server_assign.go:333 assign requests for opt-743 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.122422 master_grpc_server_assign.go:333 assign requests for opt-744 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.122576 master_grpc_server_assign.go:333 assign requests for opt-745 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.122725 master_grpc_server_assign.go:333 assign requests for opt-746 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.122873 master_grpc_server_assign.go:333 assign requests for opt-747 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.123025 master_grpc_server_assign.go:333 assign requests for opt-748 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.123185 master_grpc_server_assign.go:333 assign requests for opt-749 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.123333 master_grpc_server_assign.go:333 assign requests for opt-750 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.123483 master_grpc_server_assign.go:333 assign requests for opt-751 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.123638 master_grpc_server_assign.go:333 assign requests for opt-752 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.123791 master_grpc_server_assign.go:333 assign requests for opt-753 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.123941 master_grpc_server_assign.go:333 assign requests for opt-754 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.124091 master_grpc_server_assign.go:333 assign requests for opt-755 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.124246 master_grpc_server_assign.go:333 assign requests for opt-756 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.124435 master_grpc_server_assign.go:333 assign requests for opt-757 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.124588 master_grpc_server_assign.go:333 assign requests for opt-758 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.124742 master_grpc_server_assign.go:333 assign requests for opt-759 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.124896 master_grpc_server_assign.go:333 assign requests for opt-760 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.125056 master_grpc_server_assign.go:333 assign requests for opt-761 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.125208 master_grpc_server_assign.go:333 assign requests for opt-762 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.125358 master_grpc_server_assign.go:333 assign requests for opt-763 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.125513 master_grpc_server_assign.go:333 assign requests for opt-764 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.125669 master_grpc_server_assign.go:333 assign requests for opt-765 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.125820 master_grpc_server_assign.go:333 assign requests for opt-766 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.125971 master_grpc_server_assign.go:333 assign requests for opt-767 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.126124 master_grpc_server_assign.go:333 assign requests for opt-768 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.126279 master_grpc_server_assign.go:333 assign requests for opt-769 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.126435 master_grpc_server_assign.go:333 assign requests for opt-770 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.126587 master_grpc_server_assign.go:333 assign requests for opt-771 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.126742 master_grpc_server_assign.go:333 assign requests for opt-772 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.126897 master_grpc_server_assign.go:333 assign requests for opt-773 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.127047 master_grpc_server_assign.go:333 assign requests for opt-774 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.127198 master_grpc_server_assign.go:333 assign requests for opt-775 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.127352 master_grpc_server_assign.go:333 assign requests for opt-776 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.127629 master_grpc_server_assign.go:333 assign requests for opt-777 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.127783 master_grpc_server_assign.go:333 assign requests for opt-778 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.127936 master_grpc_server_assign.go:333 assign requests for opt-779 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.128090 master_grpc_server_assign.go:333 assign requests for opt-780 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.128246 master_grpc_server_assign.go:333 assign requests for opt-781 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.128398 master_grpc_server_assign.go:333 assign requests for opt-782 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.128552 master_grpc_server_assign.go:333 assign requests for opt-783 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.128714 master_grpc_server_assign.go:333 assign requests for opt-784 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.128869 master_grpc_server_assign.go:333 assign requests for opt-785 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.129019 master_grpc_server_assign.go:333 assign requests for opt-786 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.129174 master_grpc_server_assign.go:333 assign requests for opt-787 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.129329 master_grpc_server_assign.go:333 assign requests for opt-788 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.129484 master_grpc_server_assign.go:333 assign requests for opt-789 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.129674 master_grpc_server_assign.go:333 assign requests for opt-790 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.129835 master_grpc_server_assign.go:333 assign requests for opt-791 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.129990 master_grpc_server_assign.go:333 assign requests for opt-792 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.130144 master_grpc_server_assign.go:333 assign requests for opt-793 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.130295 master_grpc_server_assign.go:333 assign requests for opt-794 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.130447 master_grpc_server_assign.go:333 assign requests for opt-795 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.130601 master_grpc_server_assign.go:333 assign requests for opt-796 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.130756 master_grpc_server_assign.go:333 assign requests for opt-797 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.130906 master_grpc_server_assign.go:333 assign requests for opt-798 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.131060 master_grpc_server_assign.go:333 assign requests for opt-799 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.131215 master_grpc_server_assign.go:333 assign requests for opt-800 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.131374 master_grpc_server_assign.go:333 assign requests for opt-801 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.131526 master_grpc_server_assign.go:333 assign requests for opt-802 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.131680 master_grpc_server_assign.go:333 assign requests for opt-803 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.131835 master_grpc_server_assign.go:333 assign requests for opt-804 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.131990 master_grpc_server_assign.go:333 assign requests for opt-805 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.132142 master_grpc_server_assign.go:333 assign requests for opt-806 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.132293 master_grpc_server_assign.go:333 assign requests for opt-807 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.132447 master_grpc_server_assign.go:333 assign requests for opt-808 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.132602 master_grpc_server_assign.go:333 assign requests for opt-809 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.132754 master_grpc_server_assign.go:333 assign requests for opt-810 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.132903 master_grpc_server_assign.go:333 assign requests for opt-811 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.133063 master_grpc_server_assign.go:333 assign requests for opt-812 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.133218 master_grpc_server_assign.go:333 assign requests for opt-813 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.133369 master_grpc_server_assign.go:333 assign requests for opt-814 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.133519 master_grpc_server_assign.go:333 assign requests for opt-815 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.133674 master_grpc_server_assign.go:333 assign requests for opt-816 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.133830 master_grpc_server_assign.go:333 assign requests for opt-817 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.133981 master_grpc_server_assign.go:333 assign requests for opt-818 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.134132 master_grpc_server_assign.go:333 assign requests for opt-819 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.134288 master_grpc_server_assign.go:333 assign requests for opt-820 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.134481 master_grpc_server_assign.go:333 assign requests for opt-821 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.134632 master_grpc_server_assign.go:333 assign requests for opt-822 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.134821 master_grpc_server_assign.go:333 assign requests for opt-823 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.134977 master_grpc_server_assign.go:333 assign requests for opt-824 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.135131 master_grpc_server_assign.go:333 assign requests for opt-825 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.135281 master_grpc_server_assign.go:333 assign requests for opt-826 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.135431 master_grpc_server_assign.go:333 assign requests for opt-827 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.135585 master_grpc_server_assign.go:333 assign requests for opt-828 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.135739 master_grpc_server_assign.go:333 assign requests for opt-829 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.135889 master_grpc_server_assign.go:333 assign requests for opt-830 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.136040 master_grpc_server_assign.go:333 assign requests for opt-831 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.136194 master_grpc_server_assign.go:333 assign requests for opt-832 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.136348 master_grpc_server_assign.go:333 assign requests for opt-833 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.136505 master_grpc_server_assign.go:333 assign requests for opt-834 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.136656 master_grpc_server_assign.go:333 assign requests for opt-835 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.136812 master_grpc_server_assign.go:333 assign requests for opt-836 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.136965 master_grpc_server_assign.go:333 assign requests for opt-837 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.137116 master_grpc_server_assign.go:333 assign requests for opt-838 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.137268 master_grpc_server_assign.go:333 assign requests for opt-839 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.137424 master_grpc_server_assign.go:333 assign requests for opt-840 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.137580 master_grpc_server_assign.go:333 assign requests for opt-841 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.137729 master_grpc_server_assign.go:333 assign requests for opt-842 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.137878 master_grpc_server_assign.go:333 assign requests for opt-843 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.138029 master_grpc_server_assign.go:333 assign requests for opt-844 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.138183 master_grpc_server_assign.go:333 assign requests for opt-845 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.138334 master_grpc_server_assign.go:333 assign requests for opt-846 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.138485 master_grpc_server_assign.go:333 assign requests for opt-847 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.138639 master_grpc_server_assign.go:333 assign requests for opt-848 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.138794 master_grpc_server_assign.go:333 assign requests for opt-849 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.138946 master_grpc_server_assign.go:333 assign requests for opt-850 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.139096 master_grpc_server_assign.go:333 assign requests for opt-851 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.139251 master_grpc_server_assign.go:333 assign requests for opt-852 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.139405 master_grpc_server_assign.go:333 assign requests for opt-853 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.139557 master_grpc_server_assign.go:333 assign requests for opt-854 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.139712 master_grpc_server_assign.go:333 assign requests for opt-855 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.139908 master_grpc_server_assign.go:333 assign requests for opt-856 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.140064 master_grpc_server_assign.go:333 assign requests for opt-857 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.140217 master_grpc_server_assign.go:333 assign requests for opt-858 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.140374 master_grpc_server_assign.go:333 assign requests for opt-859 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.140528 master_grpc_server_assign.go:333 assign requests for opt-860 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.140688 master_grpc_server_assign.go:333 assign requests for opt-861 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.140839 master_grpc_server_assign.go:333 assign requests for opt-862 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.140992 master_grpc_server_assign.go:333 assign requests for opt-863 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.141145 master_grpc_server_assign.go:333 assign requests for opt-864 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.141301 master_grpc_server_assign.go:333 assign requests for opt-865 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.141452 master_grpc_server_assign.go:333 assign requests for opt-866 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.141602 master_grpc_server_assign.go:333 assign requests for opt-867 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.141757 master_grpc_server_assign.go:333 assign requests for opt-868 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.141910 master_grpc_server_assign.go:333 assign requests for opt-869 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.142060 master_grpc_server_assign.go:333 assign requests for opt-870 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.142212 master_grpc_server_assign.go:333 assign requests for opt-871 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.142366 master_grpc_server_assign.go:333 assign requests for opt-872 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.142521 master_grpc_server_assign.go:333 assign requests for opt-873 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.142670 master_grpc_server_assign.go:333 assign requests for opt-874 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.142821 master_grpc_server_assign.go:333 assign requests for opt-875 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.142977 master_grpc_server_assign.go:333 assign requests for opt-876 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.143139 master_grpc_server_assign.go:333 assign requests for opt-877 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.143289 master_grpc_server_assign.go:333 assign requests for opt-878 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.143441 master_grpc_server_assign.go:333 assign requests for opt-879 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.143595 master_grpc_server_assign.go:333 assign requests for opt-880 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.143748 master_grpc_server_assign.go:333 assign requests for opt-881 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.143899 master_grpc_server_assign.go:333 assign requests for opt-882 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.144050 master_grpc_server_assign.go:333 assign requests for opt-883 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.144209 master_grpc_server_assign.go:333 assign requests for opt-884 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.144366 master_grpc_server_assign.go:333 assign requests for opt-885 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.144516 master_grpc_server_assign.go:333 assign requests for opt-886 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.144673 master_grpc_server_assign.go:333 assign requests for opt-887 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.144826 master_grpc_server_assign.go:333 assign requests for opt-888 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.145029 master_grpc_server_assign.go:333 assign requests for opt-889 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.145181 master_grpc_server_assign.go:333 assign requests for opt-890 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.145335 master_grpc_server_assign.go:333 assign requests for opt-891 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.145489 master_grpc_server_assign.go:333 assign requests for opt-892 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.145644 master_grpc_server_assign.go:333 assign requests for opt-893 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.145795 master_grpc_server_assign.go:333 assign requests for opt-894 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.145947 master_grpc_server_assign.go:333 assign requests for opt-895 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.148981 master_grpc_server_assign.go:333 assign requests for opt-896 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.149187 master_grpc_server_assign.go:333 assign requests for opt-897 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.149345 master_grpc_server_assign.go:333 assign requests for opt-898 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.149498 master_grpc_server_assign.go:333 assign requests for opt-899 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.149653 master_grpc_server_assign.go:333 assign requests for opt-900 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.149815 master_grpc_server_assign.go:333 assign requests for opt-901 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.149967 master_grpc_server_assign.go:333 assign requests for opt-902 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.150120 master_grpc_server_assign.go:333 assign requests for opt-903 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.150275 master_grpc_server_assign.go:333 assign requests for opt-904 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.150432 master_grpc_server_assign.go:333 assign requests for opt-905 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.150584 master_grpc_server_assign.go:333 assign requests for opt-906 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.150735 master_grpc_server_assign.go:333 assign requests for opt-907 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.150891 master_grpc_server_assign.go:333 assign requests for opt-908 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.151046 master_grpc_server_assign.go:333 assign requests for opt-909 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.151198 master_grpc_server_assign.go:333 assign requests for opt-910 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.151348 master_grpc_server_assign.go:333 assign requests for opt-911 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.151500 master_grpc_server_assign.go:333 assign requests for opt-912 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.151653 master_grpc_server_assign.go:333 assign requests for opt-913 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.151801 master_grpc_server_assign.go:333 assign requests for opt-914 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.151950 master_grpc_server_assign.go:333 assign requests for opt-915 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.152103 master_grpc_server_assign.go:333 assign requests for opt-916 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.152257 master_grpc_server_assign.go:333 assign requests for opt-917 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.152408 master_grpc_server_assign.go:333 assign requests for opt-918 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.152562 master_grpc_server_assign.go:333 assign requests for opt-919 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.152717 master_grpc_server_assign.go:333 assign requests for opt-920 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.152871 master_grpc_server_assign.go:333 assign requests for opt-921 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.153065 master_grpc_server_assign.go:333 assign requests for opt-922 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.153217 master_grpc_server_assign.go:333 assign requests for opt-923 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.153371 master_grpc_server_assign.go:333 assign requests for opt-924 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.153526 master_grpc_server_assign.go:333 assign requests for opt-925 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.153678 master_grpc_server_assign.go:333 assign requests for opt-926 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.153830 master_grpc_server_assign.go:333 assign requests for opt-927 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.153984 master_grpc_server_assign.go:333 assign requests for opt-928 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.154141 master_grpc_server_assign.go:333 assign requests for opt-929 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.154292 master_grpc_server_assign.go:333 assign requests for opt-930 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.154442 master_grpc_server_assign.go:333 assign requests for opt-931 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.154597 master_grpc_server_assign.go:333 assign requests for opt-932 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.154751 master_grpc_server_assign.go:333 assign requests for opt-933 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.154901 master_grpc_server_assign.go:333 assign requests for opt-934 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.155051 master_grpc_server_assign.go:333 assign requests for opt-935 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.155204 master_grpc_server_assign.go:333 assign requests for opt-936 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.155357 master_grpc_server_assign.go:333 assign requests for opt-937 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.155507 master_grpc_server_assign.go:333 assign requests for opt-938 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.155657 master_grpc_server_assign.go:333 assign requests for opt-939 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.155812 master_grpc_server_assign.go:333 assign requests for opt-940 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.155967 master_grpc_server_assign.go:333 assign requests for opt-941 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.156116 master_grpc_server_assign.go:333 assign requests for opt-942 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.156267 master_grpc_server_assign.go:333 assign requests for opt-943 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.156427 master_grpc_server_assign.go:333 assign requests for opt-944 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.156582 master_grpc_server_assign.go:333 assign requests for opt-945 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.156732 master_grpc_server_assign.go:333 assign requests for opt-946 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.156885 master_grpc_server_assign.go:333 assign requests for opt-947 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.157041 master_grpc_server_assign.go:333 assign requests for opt-948 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.157195 master_grpc_server_assign.go:333 assign requests for opt-949 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.157346 master_grpc_server_assign.go:333 assign requests for opt-950 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.157499 master_grpc_server_assign.go:333 assign requests for opt-951 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.157653 master_grpc_server_assign.go:333 assign requests for opt-952 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.157808 master_grpc_server_assign.go:333 assign requests for opt-953 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.157956 master_grpc_server_assign.go:333 assign requests for opt-954 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.158141 master_grpc_server_assign.go:333 assign requests for opt-955 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.158295 master_grpc_server_assign.go:333 assign requests for opt-956 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.158447 master_grpc_server_assign.go:333 assign requests for opt-957 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.158596 master_grpc_server_assign.go:333 assign requests for opt-958 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.158747 master_grpc_server_assign.go:333 assign requests for opt-959 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.158903 master_grpc_server_assign.go:333 assign requests for opt-960 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.159059 master_grpc_server_assign.go:333 assign requests for opt-961 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.159212 master_grpc_server_assign.go:333 assign requests for opt-962 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.159365 master_grpc_server_assign.go:333 assign requests for opt-963 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.159519 master_grpc_server_assign.go:333 assign requests for opt-964 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.159675 master_grpc_server_assign.go:333 assign requests for opt-965 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.159833 master_grpc_server_assign.go:333 assign requests for opt-966 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.159985 master_grpc_server_assign.go:333 assign requests for opt-967 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.160140 master_grpc_server_assign.go:333 assign requests for opt-968 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.160296 master_grpc_server_assign.go:333 assign requests for opt-969 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.160447 master_grpc_server_assign.go:333 assign requests for opt-970 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.160599 master_grpc_server_assign.go:333 assign requests for opt-971 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.160753 master_grpc_server_assign.go:333 assign requests for opt-972 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.160907 master_grpc_server_assign.go:333 assign requests for opt-973 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.161057 master_grpc_server_assign.go:333 assign requests for opt-974 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.161258 master_grpc_server_assign.go:333 assign requests for opt-975 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.161414 master_grpc_server_assign.go:333 assign requests for opt-976 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.161569 master_grpc_server_assign.go:333 assign requests for opt-977 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.161721 master_grpc_server_assign.go:333 assign requests for opt-978 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.161872 master_grpc_server_assign.go:333 assign requests for opt-979 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.162028 master_grpc_server_assign.go:333 assign requests for opt-980 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.162183 master_grpc_server_assign.go:333 assign requests for opt-981 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.162335 master_grpc_server_assign.go:333 assign requests for opt-982 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.162486 master_grpc_server_assign.go:333 assign requests for opt-983 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.162641 master_grpc_server_assign.go:333 assign requests for opt-984 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.162800 master_grpc_server_assign.go:333 assign requests for opt-985 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.162951 master_grpc_server_assign.go:333 assign requests for opt-986 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.163109 master_grpc_server_assign.go:333 assign requests for opt-987 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.163305 master_grpc_server_assign.go:333 assign requests for opt-988 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.163462 master_grpc_server_assign.go:333 assign requests for opt-989 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.163614 master_grpc_server_assign.go:333 assign requests for opt-990 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.163768 master_grpc_server_assign.go:333 assign requests for opt-991 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.163923 master_grpc_server_assign.go:333 assign requests for opt-992 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.164079 master_grpc_server_assign.go:333 assign requests for opt-993 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.164230 master_grpc_server_assign.go:333 assign requests for opt-994 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.164382 master_grpc_server_assign.go:333 assign requests for opt-995 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.164536 master_grpc_server_assign.go:333 assign requests for opt-996 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.164691 master_grpc_server_assign.go:333 assign requests for opt-997 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.164842 master_grpc_server_assign.go:333 assign requests for opt-998 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.164994 master_grpc_server_assign.go:333 assign requests for opt-999 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.165150 master_grpc_server_assign.go:333 assign requests for opt-1000 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.165307 master_grpc_server_assign.go:333 assign requests for opt-1001 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.165462 master_grpc_server_assign.go:333 assign requests for opt-1002 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.165613 master_grpc_server_assign.go:333 assign requests for opt-1003 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.165768 master_grpc_server_assign.go:333 assign requests for opt-1004 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.165920 master_grpc_server_assign.go:333 assign requests for opt-1005 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.166075 master_grpc_server_assign.go:333 assign requests for opt-1006 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.166232 master_grpc_server_assign.go:333 assign requests for opt-1007 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.166392 master_grpc_server_assign.go:333 assign requests for opt-1008 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.166547 master_grpc_server_assign.go:333 assign requests for opt-1009 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.166699 master_grpc_server_assign.go:333 assign requests for opt-1010 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.166848 master_grpc_server_assign.go:333 assign requests for opt-1011 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.167000 master_grpc_server_assign.go:333 assign requests for opt-1012 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.167149 master_grpc_server_assign.go:333 assign requests for opt-1013 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.167302 master_grpc_server_assign.go:333 assign requests for opt-1014 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.167457 master_grpc_server_assign.go:333 assign requests for opt-1015 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.167609 master_grpc_server_assign.go:333 assign requests for opt-1016 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.167879 master_grpc_server_assign.go:333 assign requests for opt-1017 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.168036 master_grpc_server_assign.go:333 assign requests for opt-1018 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.168186 master_grpc_server_assign.go:333 assign requests for opt-1019 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.168340 master_grpc_server_assign.go:333 assign requests for opt-1020 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.168523 master_grpc_server_assign.go:333 assign requests for opt-1021 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.168675 master_grpc_server_assign.go:333 assign requests for opt-1022 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.168825 master_grpc_server_assign.go:333 assign requests for opt-1023 will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e W1117 09:43:55.169127 master_grpc_server_assign.go:333 assign requests for opt-flood will keep failing until a volume server registers that disk layout or clients change their assignment disk type: e --- PASS: TestUnservedLayoutWarningBoundedAndExpiring (0.16s) === RUN TestAssignDuringWarmupCarriesRemainingWarmup I1117 09:43:55.170466 node.go:539 test adds child dc1 I1117 09:43:55.170700 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.171067 node.go:539 test:dc1:rack1 adds child node1 I1117 09:43:55.171303 node.go:539 test:dc1:rack1:node1 adds child --- PASS: TestAssignDuringWarmupCarriesRemainingWarmup (0.04s) === RUN TestWarmingUpErrorWithoutRemainingHasNoHint --- PASS: TestWarmingUpErrorWithoutRemainingHasNoHint (0.00s) === RUN TestChangedVolumesBringTheMasterCurrent I1117 09:43:55.210191 node.go:539 test adds child dc1 I1117 09:43:55.210644 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.211041 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.211320 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.216332 node.go:539 test adds child dc1 I1117 09:43:55.216567 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.216832 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.217103 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestChangedVolumesBringTheMasterCurrent (0.01s) === RUN TestChangedVolumesDoNotRemoveUnmentionedVolumes I1117 09:43:55.219366 node.go:539 test adds child dc1 I1117 09:43:55.219561 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.219804 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.220262 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestChangedVolumesDoNotRemoveUnmentionedVolumes (0.00s) === RUN TestChangedVolumesRegisterUnknownVolumes I1117 09:43:55.223635 node.go:539 test adds child dc1 I1117 09:43:55.223828 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.224063 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.224264 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestChangedVolumesRegisterUnknownVolumes (0.00s) === RUN TestChangedVolumesAnnounceOnlyArrivals I1117 09:43:55.226861 node.go:539 test adds child dc1 I1117 09:43:55.227291 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.227559 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.227765 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestChangedVolumesAnnounceOnlyArrivals (0.00s) === RUN TestRepairedLookupEntryIsAnnounced === RUN TestRepairedLookupEntryIsAnnounced/ViaChanges I1117 09:43:55.231152 node.go:539 test adds child dc1 I1117 09:43:55.231341 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.231575 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.231909 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.233429 volume_layout.go:1244 Volume 1 has 0 replica, less than required 1 I1117 09:43:55.233604 volume_layout.go:1149 Volume 1 becomes unwritable === RUN TestRepairedLookupEntryIsAnnounced/ViaFullList I1117 09:43:55.235228 node.go:539 test adds child dc1 I1117 09:43:55.235404 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.235633 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.235939 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.236730 volume_layout.go:1244 Volume 1 has 0 replica, less than required 1 I1117 09:43:55.236882 volume_layout.go:1149 Volume 1 becomes unwritable --- PASS: TestRepairedLookupEntryIsAnnounced (0.01s) --- PASS: TestRepairedLookupEntryIsAnnounced/ViaChanges (0.00s) --- PASS: TestRepairedLookupEntryIsAnnounced/ViaFullList (0.00s) === RUN TestDeletedCollectionReleasesTheLookupIndex I1117 09:43:55.240195 node.go:539 test adds child dc1 I1117 09:43:55.240402 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.240663 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.240881 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.244680 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:43:55.246980 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 --- PASS: TestDeletedCollectionReleasesTheLookupIndex (0.01s) === RUN TestStaleFullListDoesNotEraseAFreshGrow I1117 09:43:55.248181 node.go:539 test adds child dc1 I1117 09:43:55.248514 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.248767 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.249020 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.252202 data_node.go:159 Deleting volume id: 2 I1117 09:43:55.252690 topology.go:1124 removing volume info: Id:2, Size:8, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:1, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:43:55.253067 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:43:55.253313 volume_layout.go:477 volume 2 does not have enough copies --- PASS: TestStaleFullListDoesNotEraseAFreshGrow (0.01s) === RUN TestRegistrationRacingCollectionDeleteDoesNotLeak I1117 09:43:55.254705 node.go:539 test adds child dc1 I1117 09:43:55.254875 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.255225 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.255713 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.258878 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 --- PASS: TestRegistrationRacingCollectionDeleteDoesNotLeak (0.00s) === RUN TestChangedVolumesAnnounceLocalToRemoteTierTransition I1117 09:43:55.260099 node.go:539 test adds child dc1 I1117 09:43:55.260299 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.260538 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.260756 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.262587 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.262825 volume_layout.go:480 volume 1 is not fully writable --- PASS: TestChangedVolumesAnnounceLocalToRemoteTierTransition (0.00s) === RUN TestChangedVolumesAnnounceRemoteToLocalTierTransition I1117 09:43:55.264036 node.go:539 test adds child dc1 I1117 09:43:55.264215 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.264492 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.264720 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestChangedVolumesAnnounceRemoteToLocalTierTransition (0.00s) === RUN TestChangedVolumesSuppressNoOpTierReport I1117 09:43:55.267172 node.go:539 test adds child dc1 I1117 09:43:55.267345 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.267586 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.267879 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestChangedVolumesSuppressNoOpTierReport (0.00s) === RUN TestChangedVolumesAnnounceSameTierReadOnlyTransition I1117 09:43:55.269817 node.go:539 test adds child dc1 I1117 09:43:55.270023 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.270261 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.270743 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.271516 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.271694 volume_layout.go:480 volume 1 is not fully writable --- PASS: TestChangedVolumesAnnounceSameTierReadOnlyTransition (0.00s) === RUN TestChangedVolumesAnnounceReadOnlyDeleteCapabilityTransition I1117 09:43:55.273028 node.go:539 test adds child dc1 I1117 09:43:55.273242 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.273524 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.273735 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestChangedVolumesAnnounceReadOnlyDeleteCapabilityTransition (0.00s) === RUN TestChangedVolumesAnnounceOnlyTierTransitions I1117 09:43:55.275770 node.go:539 test adds child dc1 I1117 09:43:55.276158 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.276416 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.276667 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestChangedVolumesAnnounceOnlyTierTransitions (0.00s) === RUN TestFullReconciliationAnnouncesTierTransition I1117 09:43:55.278834 node.go:539 test adds child dc1 I1117 09:43:55.279015 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.279291 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.279533 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.281567 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.281765 volume_layout.go:480 volume 1 is not fully writable --- PASS: TestFullReconciliationAnnouncesTierTransition (0.00s) === RUN TestFullReconciliationAnnounceSameTierReadOnlyTransition I1117 09:43:55.283076 node.go:539 test adds child dc1 I1117 09:43:55.283281 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.283517 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.284083 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.285182 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.285362 volume_layout.go:480 volume 1 is not fully writable --- PASS: TestFullReconciliationAnnounceSameTierReadOnlyTransition (0.00s) === RUN TestFullReconciliationAnnounceReadOnlyDeleteCapabilityTransition I1117 09:43:55.287058 node.go:539 test adds child dc1 I1117 09:43:55.287230 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.287504 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.287742 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestFullReconciliationAnnounceReadOnlyDeleteCapabilityTransition (0.00s) === RUN TestDoDeleteNormalCollectionBoundsEachVolumeServerRPC I1117 09:43:55.293102 node.go:539 test adds child dc1 I1117 09:43:55.293307 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.293661 node.go:539 test:dc1:rack1 adds child vs1 I1117 09:43:55.293873 node.go:539 test:dc1:rack1:vs1 adds child --- PASS: TestDoDeleteNormalCollectionBoundsEachVolumeServerRPC (0.03s) === RUN TestDeleteCollectionOutlivesTheCallersCancellation I1117 09:43:55.325615 node.go:539 test adds child dc1 I1117 09:43:55.325823 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.326041 node.go:539 test:dc1:rack1 adds child vs-normal I1117 09:43:55.326247 node.go:539 test:dc1:rack1:vs-normal adds child I1117 09:43:55.328178 node.go:539 test:dc1:rack1 adds child vs-ec I1117 09:43:55.328423 node.go:539 test:dc1:rack1:vs-ec adds child --- PASS: TestDeleteCollectionOutlivesTheCallersCancellation (0.03s) === RUN TestDoDeleteNormalCollectionSendsOneRPCPerVolumeServer I1117 09:43:55.351179 node.go:539 test adds child dc1 I1117 09:43:55.351340 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.351531 node.go:539 test:dc1:rack1 adds child vs1 I1117 09:43:55.351740 node.go:539 test:dc1:rack1:vs1 adds child --- PASS: TestDoDeleteNormalCollectionSendsOneRPCPerVolumeServer (0.01s) === RUN TestDoDeleteNormalCollectionKeepsGoingPastAFailingServer I1117 09:43:55.363155 node.go:539 test adds child dc1 I1117 09:43:55.363318 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.363508 node.go:539 test:dc1:rack1 adds child vs-failing I1117 09:43:55.363729 node.go:539 test:dc1:rack1:vs-failing adds child I1117 09:43:55.365334 node.go:539 test:dc1:rack1 adds child vs-healthy I1117 09:43:55.365520 node.go:539 test:dc1:rack1:vs-healthy adds child I1117 09:43:55.366335 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.366504 volume_layout.go:477 volume 1 does not have enough copies E1117 09:43:55.375170 master_grpc_server_collection.go:135 delete collection bucket-d on 127.0.0.1:30593: rpc error: code = Unknown desc = volume server is out of disk --- PASS: TestDoDeleteNormalCollectionKeepsGoingPastAFailingServer (0.02s) === RUN TestDeleteCollectionRunsTheEcPassWhenTheNormalPassFails I1117 09:43:55.386590 node.go:539 test adds child dc1 I1117 09:43:55.386780 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.386996 node.go:539 test:dc1:rack1 adds child vs-normal I1117 09:43:55.387232 node.go:539 test:dc1:rack1:vs-normal adds child I1117 09:43:55.388972 node.go:539 test:dc1:rack1 adds child vs-ec I1117 09:43:55.389192 node.go:539 test:dc1:rack1:vs-ec adds child E1117 09:43:55.399224 master_grpc_server_collection.go:135 delete collection bucket-e on 127.0.0.1:24841: rpc error: code = Unknown desc = volume server is out of disk --- PASS: TestDeleteCollectionRunsTheEcPassWhenTheNormalPassFails (0.02s) === RUN TestDigestCheckIgnoresServersThatReportNone I1117 09:43:55.408321 node.go:539 test adds child dc1 I1117 09:43:55.408525 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.408799 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.409207 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestDigestCheckIgnoresServersThatReportNone (0.00s) === RUN TestDigestCheckAcceptsAMatchingReport I1117 09:43:55.410463 node.go:539 test adds child dc1 I1117 09:43:55.410696 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.410895 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.411244 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestDigestCheckAcceptsAMatchingReport (0.00s) === RUN TestDigestCheckDoesNotReaskAfterAFullList I1117 09:43:55.412797 node.go:539 test adds child dc1 I1117 09:43:55.412950 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.413178 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.413544 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child W1117 09:43:55.414321 master_grpc_server.go:488 volume server 127.0.0.1:8080 still disagrees after a full volume list: reported digest 15521999559454932142, master holds 15521999559454932143 --- PASS: TestDigestCheckDoesNotReaskAfterAFullList (0.00s) === RUN TestDigestCheckAsksForTheListWhenADeltaDisagrees I1117 09:43:55.415009 node.go:539 test adds child dc1 I1117 09:43:55.415144 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.415427 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.415813 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.416514 master_grpc_server.go:493 volume server 127.0.0.1:8080: reported digest 15521999559454932142, master holds 15521999559454932143, requesting the full volume list --- PASS: TestDigestCheckAsksForTheListWhenADeltaDisagrees (0.00s) === RUN TestDigestCheckKeepsDuplicateNodesOnFullLists I1117 09:43:55.417314 node.go:539 test adds child dc1 I1117 09:43:55.417464 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.417742 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.417924 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestDigestCheckKeepsDuplicateNodesOnFullLists (0.00s) === RUN TestDigestCheckAsksForTheListWhenTheLookupIndexDrifts I1117 09:43:55.419975 node.go:539 test adds child dc1 I1117 09:43:55.420126 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.420316 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.420511 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.422129 volume_layout.go:1244 Volume 1 has 0 replica, less than required 1 I1117 09:43:55.422268 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.422604 master_grpc_server.go:493 volume server 127.0.0.1:8080: lookup index disagrees with the volumes held, requesting the full volume list --- PASS: TestDigestCheckAsksForTheListWhenTheLookupIndexDrifts (0.00s) === RUN TestHeartbeatResponsesCarryTheVolumeOptions --- PASS: TestHeartbeatResponsesCarryTheVolumeOptions (0.00s) === RUN TestSendHeartbeatRejectsForeignReporterBeforeApplyingState W1117 09:43:55.425021 master_grpc_server.go:244 SendHeartbeat: volume server 10.0.0.2:8080 rejected: this master admits a single volume-server reporter --- PASS: TestSendHeartbeatRejectsForeignReporterBeforeApplyingState (0.00s) === RUN TestSendHeartbeatAdmittedReporterStillFreezesOnMismatch E1117 09:43:55.428102 topology.go:1638 volume growth frozen: a volume server reports topology id cluster-a but this cluster is cluster-b; the master state was rebuilt. Verify the cluster inventory, then run: volume.growth.resume I1117 09:43:55.428898 node.go:539 test adds child DefaultDataCenter I1117 09:43:55.429066 node.go:539 test:DefaultDataCenter adds child DefaultRack I1117 09:43:55.429287 node.go:539 test:DefaultDataCenter:DefaultRack adds child 10.0.0.1:8080 I1117 09:43:55.429608 master_grpc_server.go:269 added volume server 0: 10.0.0.1:8080 (id=, ip=10.0.0.1:8080) [] I1117 09:43:55.430111 master_grpc_server.go:77 found new uuid:10.0.0.1:8080 [] , map[10.0.0.1:8080:[]] I1117 09:43:55.452595 node.go:539 test:DefaultDataCenter:DefaultRack:10.0.0.1:8080 adds child W1117 09:43:55.453879 master_grpc_server.go:204 SendHeartbeat.Recv server 10.0.0.1:8080 : EOF I1117 09:43:55.455348 topology_event_handling.go:117 Removing Volume 3 from the dead volume server 10.0.0.1:8080 I1117 09:43:55.455553 volume_layout.go:1244 Volume 3 has 0 replica, less than required 1 I1117 09:43:55.455678 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:43:55.457566 node.go:560 test:DefaultDataCenter:DefaultRack removes 10.0.0.1:8080 I1117 09:43:55.457898 master_grpc_server.go:182 unregister disconnected volume server 10.0.0.1:8080 I1117 09:43:55.458187 master_grpc_server.go:86 remove volume server 10.0.0.1:8080, online volume server: map[] --- PASS: TestSendHeartbeatAdmittedReporterStillFreezesOnMismatch (0.03s) === RUN TestSendHeartbeatRejectsAddresslessFirstHeartbeat W1117 09:43:55.459477 master_grpc_server.go:244 SendHeartbeat: volume server rejected: this master admits a single volume-server reporter --- PASS: TestSendHeartbeatRejectsAddresslessFirstHeartbeat (0.00s) === RUN TestReportsPriorClusterState --- PASS: TestReportsPriorClusterState (0.00s) === RUN TestRaftMembershipRPCs_RejectUnwhitelisted I1117 09:43:55.463509 master_grpc_server_raft.go:45 gRPC raft admin auth failed: 10.13.37.66 is not whitelisted (remote: 10.13.37.66:40000) I1117 09:43:55.463902 master_grpc_server_raft.go:45 gRPC raft admin auth failed: 10.13.37.66 is not whitelisted (remote: 10.13.37.66:40000) I1117 09:43:55.464166 master_grpc_server_raft.go:45 gRPC raft admin auth failed: 10.13.37.66 is not whitelisted (remote: 10.13.37.66:40000) --- PASS: TestRaftMembershipRPCs_RejectUnwhitelisted (0.00s) === RUN TestRaftMembershipRPCs_AllowWhitelisted --- PASS: TestRaftMembershipRPCs_AllowWhitelisted (0.00s) === RUN TestRaftMembershipRPCs_NoWhitelistFailsOpen --- PASS: TestRaftMembershipRPCs_NoWhitelistFailsOpen (0.00s) === RUN TestRaftLeadershipTransfer_NoRaft --- PASS: TestRaftLeadershipTransfer_NoRaft (0.00s) === RUN TestRaftListClusterServers_NoRaft --- PASS: TestRaftListClusterServers_NoRaft (0.00s) === RUN TestRaftAddServer_NoRaft --- PASS: TestRaftAddServer_NoRaft (0.00s) === RUN TestRaftRemoveServer_NoRaft --- PASS: TestRaftRemoveServer_NoRaft (0.00s) === RUN TestStatisticsLogicalSizes I1117 09:43:55.470819 node.go:539 test adds child dc1 I1117 09:43:55.470993 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.471341 node.go:539 test:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:43:55.471739 node.go:539 test:dc1:rack1:127.0.0.1:34534 adds child I1117 09:43:55.472371 node.go:539 test:dc1:rack1 adds child 127.0.0.2:34534 I1117 09:43:55.472545 node.go:539 test:dc1:rack1:127.0.0.2:34534 adds child I1117 09:43:55.473100 node.go:539 test:dc1:rack1 adds child 127.0.0.3:34534 I1117 09:43:55.473276 node.go:539 test:dc1:rack1:127.0.0.3:34534 adds child I1117 09:43:55.473917 node.go:539 test:dc1:rack1 adds child 127.0.0.4:34534 I1117 09:43:55.474077 node.go:539 test:dc1:rack1:127.0.0.4:34534 adds child --- PASS: TestStatisticsLogicalSizes (0.01s) === RUN TestStatisticsReplicaCopyCount I1117 09:43:55.478685 node.go:539 test adds child dc1 I1117 09:43:55.478847 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.479046 node.go:539 test:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:43:55.479406 node.go:539 test:dc1:rack1:127.0.0.1:34534 adds child I1117 09:43:55.479869 node.go:539 test:dc1:rack1 adds child 127.0.0.2:34534 I1117 09:43:55.480119 node.go:539 test:dc1:rack1:127.0.0.2:34534 adds child I1117 09:43:55.480579 node.go:539 test:dc1:rack1 adds child 127.0.0.3:34534 I1117 09:43:55.480757 node.go:539 test:dc1:rack1:127.0.0.3:34534 adds child I1117 09:43:55.481207 node.go:539 test:dc1:rack1 adds child 127.0.0.4:34534 I1117 09:43:55.481402 node.go:539 test:dc1:rack1:127.0.0.4:34534 adds child === RUN TestStatisticsReplicaCopyCount/requested === RUN TestStatisticsReplicaCopyCount/empty_falls_back_to_the_master_default === RUN TestStatisticsReplicaCopyCount/unparsable_falls_back_to_the_master_default --- PASS: TestStatisticsReplicaCopyCount (0.01s) --- PASS: TestStatisticsReplicaCopyCount/requested (0.00s) --- PASS: TestStatisticsReplicaCopyCount/empty_falls_back_to_the_master_default (0.00s) --- PASS: TestStatisticsReplicaCopyCount/unparsable_falls_back_to_the_master_default (0.00s) === RUN TestStatisticsPhysicalCapacity I1117 09:43:55.485761 node.go:539 test adds child dc1 I1117 09:43:55.485916 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.486097 node.go:539 test:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:43:55.486475 node.go:539 test:dc1:rack1:127.0.0.1:34534 adds child I1117 09:43:55.486953 node.go:539 test:dc1:rack1 adds child 127.0.0.2:34534 I1117 09:43:55.487113 node.go:539 test:dc1:rack1:127.0.0.2:34534 adds child I1117 09:43:55.487557 node.go:539 test:dc1:rack1 adds child 127.0.0.3:34534 I1117 09:43:55.487742 node.go:539 test:dc1:rack1:127.0.0.3:34534 adds child I1117 09:43:55.488288 node.go:539 test:dc1:rack1 adds child 127.0.0.4:34534 I1117 09:43:55.488464 node.go:539 test:dc1:rack1:127.0.0.4:34534 adds child --- PASS: TestStatisticsPhysicalCapacity (0.01s) === RUN TestInitialLockRingUpdateReturnsLastBroadcastForFilers I1117 09:43:55.492703 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635492016450: [filer1:8888 filer2:8888] --- PASS: TestInitialLockRingUpdateReturnsLastBroadcastForFilers (0.01s) === RUN TestLeaveLockRingDropsOnlyTheLeavingFiler I1117 09:43:55.500645 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635500527248: [filer1:8888 filer2:8888] I1117 09:43:55.502188 master_grpc_server.go:661 LockRing: filer filer1:8888 leaving group 'group-a' I1117 09:43:55.502583 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635502459978: [filer2:8888] --- PASS: TestLeaveLockRingDropsOnlyTheLeavingFiler (0.00s) === RUN TestOverlappedFilerRegistrationStaysInLockRing I1117 09:43:55.506199 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635505577247: [filer0:8888 filer1:8888] I1117 09:43:55.507254 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635507138637: [filer1:8888] --- PASS: TestOverlappedFilerRegistrationStaysInLockRing (0.00s) === RUN TestLeavingFilerReconnectLeavesLockRing I1117 09:43:55.508849 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635508721216: [filer1:8888] I1117 09:43:55.509504 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635509387248: [filer1:8888] --- PASS: TestLeavingFilerReconnectLeavesLockRing (0.00s) === RUN TestLeftFilerStreamEndKeepsReplacementInLockRing I1117 09:43:55.511426 master_grpc_server.go:661 LockRing: filer filer0:8888 leaving group 'group-a' I1117 09:43:55.511656 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635511548072: [filer1:8888] I1117 09:43:55.512105 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635512002480: [filer0:8888 filer1:8888] --- PASS: TestLeftFilerStreamEndKeepsReplacementInLockRing (0.00s) === RUN TestInitialLockRingUpdateSkipsNonFilers I1117 09:43:55.513166 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635512911087: [filer1:8888] --- PASS: TestInitialLockRingUpdateSkipsNonFilers (0.00s) === RUN TestInitialLockRingUpdateReachesLockClients I1117 09:43:55.514142 lock_ring_manager.go:158 LockRing: broadcasting ring update for group "group-a" version 1794908635514023418: [filer1:8888] --- PASS: TestInitialLockRingUpdateReachesLockClients (0.00s) === RUN TestReconnectedClientSurvivesOldHandlerCleanup I1117 09:43:55.515714 master_grpc_server.go:729 + client .master@peer:19333 I1117 09:43:55.516013 master_grpc_server.go:729 + client .master@peer:19333 I1117 09:43:55.516281 master_grpc_server.go:744 - client .master@peer:19333 I1117 09:43:55.516928 master_grpc_server.go:744 - client .master@peer:19333 --- PASS: TestReconnectedClientSurvivesOldHandlerCleanup (0.00s) === RUN TestBroadcastVolumeLocationsToClients --- PASS: TestBroadcastVolumeLocationsToClients (0.00s) === RUN TestVolumeMovedBetweenDisksIsNotBroadcastAsRemoved I1117 09:43:55.519784 node.go:539 test adds child dc1 I1117 09:43:55.520001 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.520371 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.520605 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:43:55.521025 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.522066 data_node.go:159 Deleting volume id: 1 I1117 09:43:55.522500 topology.go:1124 removing volume info: Id:1, Size:1024, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:43:55.522794 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.522936 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestVolumeMovedBetweenDisksIsNotBroadcastAsRemoved (0.00s) === RUN TestVolumeGoneFromTheNodeIsBroadcastAsRemoved I1117 09:43:55.523872 node.go:539 test adds child dc1 I1117 09:43:55.524035 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.524220 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.524388 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.524555 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:43:55.525349 data_node.go:159 Deleting volume id: 1 I1117 09:43:55.525515 topology.go:1124 removing volume info: Id:1, Size:1024, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:43:55.525733 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.525873 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestVolumeGoneFromTheNodeIsBroadcastAsRemoved (0.00s) === RUN TestVolumeRemountedOnAnotherDiskIsNotBroadcastAsRemoved I1117 09:43:55.526726 node.go:539 test adds child dc1 I1117 09:43:55.526893 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.527086 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.527254 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.527531 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:43:55.529025 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:43:55.529248 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.529387 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestVolumeRemountedOnAnotherDiskIsNotBroadcastAsRemoved (0.00s) === RUN TestVolumeUnmountedViaDeltaIsBroadcastAsRemoved I1117 09:43:55.530176 node.go:539 test adds child dc1 I1117 09:43:55.530320 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.531348 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.531546 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.531717 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:43:55.532488 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:43:55.532705 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.532843 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestVolumeUnmountedViaDeltaIsBroadcastAsRemoved (0.00s) === RUN TestVolumeReplacedByEcShardsIsBroadcastAsRemoved I1117 09:43:55.533615 node.go:539 test adds child dc1 I1117 09:43:55.533795 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.534018 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.534182 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child I1117 09:43:55.534564 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:43:55.535317 data_node.go:159 Deleting volume id: 1 I1117 09:43:55.535471 topology.go:1124 removing volume info: Id:1, Size:1024, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:43:55.535679 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.535820 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestVolumeReplacedByEcShardsIsBroadcastAsRemoved (0.00s) === RUN TestLookupVolumeDuringWarmupRefusesPartialNotFound I1117 09:43:55.537249 node.go:539 test adds child dc1 I1117 09:43:55.537386 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.537604 node.go:539 test:dc1:rack1 adds child node1 I1117 09:43:55.537804 node.go:539 test:dc1:rack1:node1 adds child I1117 09:43:55.540459 master_grpc_server_volume.go:230 lookup volume warming up: topology is still loading (1 of 2 not found) --- PASS: TestLookupVolumeDuringWarmupRefusesPartialNotFound (0.00s) === RUN TestLookupVolumeDuringWarmupAnswersFullyKnownBatch I1117 09:43:55.541703 node.go:539 test adds child dc1 I1117 09:43:55.541864 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.542083 node.go:539 test:dc1:rack1 adds child node1 I1117 09:43:55.542271 node.go:539 test:dc1:rack1:node1 adds child --- PASS: TestLookupVolumeDuringWarmupAnswersFullyKnownBatch (0.00s) === RUN TestLookupVolumeAfterWarmupReportsNotFoundPerVolume I1117 09:43:55.543615 node.go:539 test adds child dc1 I1117 09:43:55.543760 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.544135 node.go:539 test:dc1:rack1 adds child node1 I1117 09:43:55.544338 node.go:539 test:dc1:rack1:node1 adds child --- PASS: TestLookupVolumeAfterWarmupReportsNotFoundPerVolume (0.00s) === RUN TestLookupVolumeDuringWarmupCarriesRemainingWarmup I1117 09:43:55.545899 node.go:539 test adds child dc1 I1117 09:43:55.546050 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.546284 node.go:539 test:dc1:rack1 adds child node1 I1117 09:43:55.546489 node.go:539 test:dc1:rack1:node1 adds child I1117 09:43:55.547350 master_grpc_server_volume.go:230 lookup volume warming up: topology is still loading (1 of 2 not found) --- PASS: TestLookupVolumeDuringWarmupCarriesRemainingWarmup (0.00s) === RUN TestSingleMasterNeverAdmitsRaftPeers --- PASS: TestSingleMasterNeverAdmitsRaftPeers (0.00s) === RUN TestClusteredLeaderAdmitsMissingPeer 2026-11-17T09:43:55.552Z [INFO] raft: initial configuration: index=0 servers=[] 2026-11-17T09:43:55.555Z [INFO] raft: entering follower state: follower="Node at localhost:9333 [Follower]" leader-address= leader-id= 2026-11-17T09:43:55.613Z [WARN] raft: heartbeat timeout reached, starting election: last-leader-addr= last-leader-id= 2026-11-17T09:43:55.614Z [INFO] raft: entering candidate state: node="Node at localhost:9333 [Candidate]" term=2 2026-11-17T09:43:55.616Z [DEBUG] raft: pre-voting for self: term=2 id=localhost:9333 2026-11-17T09:43:55.616Z [DEBUG] raft: calculated votes needed: needed=1 term=2 2026-11-17T09:43:55.617Z [DEBUG] raft: pre-vote received: from=localhost:9333 term=2 tally=0 2026-11-17T09:43:55.617Z [DEBUG] raft: pre-vote granted: from=localhost:9333 term=2 tally=1 2026-11-17T09:43:55.617Z [INFO] raft: pre-vote successful, starting election: term=2 tally=1 refused=0 votesNeeded=1 2026-11-17T09:43:55.618Z [DEBUG] raft: voting for self: term=2 id=localhost:9333 2026-11-17T09:43:55.618Z [DEBUG] raft: vote granted: from=localhost:9333 term=2 tally=1 2026-11-17T09:43:55.618Z [INFO] raft: election won: term=2 tally=1 2026-11-17T09:43:55.619Z [INFO] raft: entering leader state: leader="Node at localhost:9333 [Leader]" 2026-11-17T09:43:55.626Z [INFO] raft: initial configuration: index=0 servers=[] 2026-11-17T09:43:55.626Z [INFO] raft: entering follower state: follower="Node at 10.0.0.1:19333 [Follower]" leader-address= leader-id= I1117 09:43:55.627136 master_server.go:647 adding new raft server: 10.0.0.1:9333 2026-11-17T09:43:55.628Z [INFO] raft: updating configuration: command=AddVoter server-id=10.0.0.1:9333 server-addr=10.0.0.1:19333 servers="[{Suffrage:Voter ID:localhost:9333 Address:localhost:9333} {Suffrage:Voter ID:10.0.0.1:9333 Address:10.0.0.1:19333}]" 2026-11-17T09:43:55.632Z [INFO] raft: added peer, starting replication: peer=10.0.0.1:9333 2026-11-17T09:43:55.639Z [WARN] raft: failed to get previous log: previous-index=3 last-index=0 error="log not found" 2026-11-17T09:43:55.641Z [WARN] raft: appendEntries rejected, sending older logs: peer="{Voter 10.0.0.1:9333 10.0.0.1:19333}" next=1 --- PASS: TestClusteredLeaderAdmitsMissingPeer (0.10s) 2026-11-17T09:43:55.650Z [INFO] raft: pipelining replication: peer="{Voter 10.0.0.1:9333 10.0.0.1:19333}" === RUN TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign 2026-11-17T09:43:55.651Z [INFO] raft: aborting pipeline replication: peer="{Voter 10.0.0.1:9333 10.0.0.1:19333}" === RUN TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign/sent I1117 09:43:55.653202 node.go:539 test adds child dc1 I1117 09:43:55.653500 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.653891 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.654388 node.go:539 test:dc1:rack0:dn0 adds child I1117 09:43:55.662460 node.go:539 test adds child dc1 I1117 09:43:55.662678 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.662908 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.663159 node.go:539 test:dc1:rack0:dn0 adds child === RUN TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign/not_sent I1117 09:43:55.665247 node.go:539 test adds child dc1 I1117 09:43:55.665444 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.665680 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.665886 node.go:539 test:dc1:rack0:dn0 adds child I1117 09:43:55.667828 node.go:539 test adds child dc1 I1117 09:43:55.668021 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.668240 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.668466 node.go:539 test:dc1:rack0:dn0 adds child === RUN TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign/later_assign_without_it_keeps_the_last_value I1117 09:43:55.669977 node.go:539 test adds child dc1 I1117 09:43:55.670271 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.670492 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.670688 node.go:539 test:dc1:rack0:dn0 adds child I1117 09:43:55.672918 node.go:539 test adds child dc1 I1117 09:43:55.673122 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.673363 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.673588 node.go:539 test:dc1:rack0:dn0 adds child === RUN TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign/latest_value_wins I1117 09:43:55.676612 node.go:539 test adds child dc1 I1117 09:43:55.676824 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.677078 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.677315 node.go:539 test:dc1:rack0:dn0 adds child I1117 09:43:55.679294 node.go:539 test adds child dc1 I1117 09:43:55.679493 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.679712 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.679953 node.go:539 test:dc1:rack0:dn0 adds child --- PASS: TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign (0.03s) --- PASS: TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign/sent (0.01s) --- PASS: TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign/not_sent (0.00s) --- PASS: TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign/later_assign_without_it_keeps_the_last_value (0.01s) --- PASS: TestDirAssignRecordsWritableVolumeCountLikeGrpcAssign/latest_value_wins (0.00s) === RUN TestDirAssignRejectsUnknownPlacementBeforeGrowCount I1117 09:43:55.681712 node.go:539 test adds child dc1 I1117 09:43:55.681911 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.682139 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.682602 node.go:539 test:dc1:rack0:dn0 adds child I1117 09:43:55.683102 node.go:539 test adds child dc2 I1117 09:43:55.683290 node.go:539 test:dc2 adds child rackX I1117 09:43:55.683590 node.go:539 test:dc2:rackX adds child dnX I1117 09:43:55.683962 node.go:539 test:dc2:rackX:dnX adds child I1117 09:43:55.685100 common.go:111 response method:GET URL:/dir/assign?collection=c&replication=000&writableVolumeCount=30&rack=missing with httpStatus:400 and JSON:{"error":"rack missing not found in topology"} I1117 09:43:55.686309 common.go:111 response method:GET URL:/dir/assign?collection=c&replication=000&writableVolumeCount=30&dataNode=missing with httpStatus:400 and JSON:{"error":"data node missing not found in topology"} I1117 09:43:55.687559 common.go:111 response method:GET URL:/dir/assign?collection=c&replication=000&writableVolumeCount=30&dataCenter=dc1&rack=rackX with httpStatus:400 and JSON:{"error":"rack rackX not found in topology"} I1117 09:43:55.688308 common.go:111 response method:GET URL:/dir/assign?collection=c&replication=000&writableVolumeCount=30&dataCenter=dc1&dataNode=dnX with httpStatus:400 and JSON:{"error":"data node dnX not found in topology"} I1117 09:43:55.689144 common.go:111 response method:GET URL:/dir/assign?collection=c&replication=000&writableVolumeCount=30&dataCenter=dc1&rack=rack0&dataNode=dnX with httpStatus:400 and JSON:{"error":"data node dnX not found in topology"} --- PASS: TestDirAssignRejectsUnknownPlacementBeforeGrowCount (0.01s) === RUN TestPeriodicGrowthKeepsHTTPAssignLayoutWritable I1117 09:43:55.691944 node.go:539 test adds child dc1 I1117 09:43:55.692125 node.go:539 test:dc1 adds child rack0 I1117 09:43:55.692327 node.go:539 test:dc1:rack0 adds child dn0 I1117 09:43:55.692503 node.go:539 test:dc1:rack0:dn0 adds child I1117 09:43:55.692697 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.692889 node.go:539 test:dc1:rack1 adds child dn1 I1117 09:43:55.693085 node.go:539 test:dc1:rack1:dn1 adds child I1117 09:43:55.693245 node.go:539 test:dc1 adds child rack2 I1117 09:43:55.693421 node.go:539 test:dc1:rack2 adds child dn2 I1117 09:43:55.693601 node.go:539 test:dc1:rack2:dn2 adds child I1117 09:43:55.693771 node.go:539 test:dc1 adds child rack3 I1117 09:43:55.693957 node.go:539 test:dc1:rack3 adds child dn3 I1117 09:43:55.694117 node.go:539 test:dc1:rack3:dn3 adds child I1117 09:43:55.694295 node.go:539 test:dc1 adds child rack4 I1117 09:43:55.694517 node.go:539 test:dc1:rack4 adds child dn4 I1117 09:43:55.694688 node.go:539 test:dc1:rack4:dn4 adds child I1117 09:43:55.705676 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:43:55.705997 volume_layout.go:1348 Volume 2 becomes crowded I1117 09:43:55.706115 volume_layout.go:1348 Volume 3 becomes crowded I1117 09:43:55.706231 volume_layout.go:1348 Volume 4 becomes crowded I1117 09:43:55.706346 volume_layout.go:1348 Volume 5 becomes crowded I1117 09:43:55.706471 volume_layout.go:1348 Volume 6 becomes crowded I1117 09:43:55.706586 volume_layout.go:1348 Volume 7 becomes crowded I1117 09:43:55.706705 volume_layout.go:1348 Volume 8 becomes crowded I1117 09:43:55.706851 volume_layout.go:1348 Volume 9 becomes crowded I1117 09:43:55.706967 volume_layout.go:1348 Volume 10 becomes crowded I1117 09:43:55.707115 volume_layout.go:1348 Volume 11 becomes crowded I1117 09:43:55.707230 volume_layout.go:1348 Volume 12 becomes crowded I1117 09:43:55.707341 volume_layout.go:1348 Volume 13 becomes crowded I1117 09:43:55.707451 volume_layout.go:1348 Volume 14 becomes crowded I1117 09:43:55.707601 volume_layout.go:1348 Volume 15 becomes crowded I1117 09:43:55.707716 volume_layout.go:1348 Volume 16 becomes crowded I1117 09:43:55.707833 volume_layout.go:1348 Volume 17 becomes crowded I1117 09:43:55.707948 volume_layout.go:1348 Volume 18 becomes crowded I1117 09:43:55.708061 volume_layout.go:1348 Volume 19 becomes crowded I1117 09:43:55.708174 volume_layout.go:1348 Volume 20 becomes crowded I1117 09:43:55.708287 volume_layout.go:1348 Volume 21 becomes crowded I1117 09:43:55.708404 volume_layout.go:1348 Volume 22 becomes crowded I1117 09:43:55.708516 volume_layout.go:1348 Volume 23 becomes crowded I1117 09:43:55.708632 volume_layout.go:1348 Volume 24 becomes crowded I1117 09:43:55.708790 volume_layout.go:1348 Volume 25 becomes crowded I1117 09:43:55.708907 volume_layout.go:1348 Volume 26 becomes crowded I1117 09:43:55.709021 volume_layout.go:1348 Volume 27 becomes crowded I1117 09:43:55.709133 volume_layout.go:1348 Volume 28 becomes crowded I1117 09:43:55.709311 volume_layout.go:1348 Volume 29 becomes crowded I1117 09:43:55.709425 volume_layout.go:1348 Volume 30 becomes crowded I1117 09:43:55.715540 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:43:55.715923 volume_layout.go:542 Volume 1 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.716107 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:43:55.716274 volume_layout.go:542 Volume 2 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.716406 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:43:55.716537 volume_layout.go:542 Volume 3 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.716660 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:43:55.716789 volume_layout.go:542 Volume 4 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.716914 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:43:55.717044 volume_layout.go:542 Volume 5 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.717163 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:43:55.717301 volume_layout.go:542 Volume 6 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.717427 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:43:55.717560 volume_layout.go:542 Volume 7 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.717680 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:43:55.717811 volume_layout.go:542 Volume 8 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.717937 volume_layout.go:1149 Volume 9 becomes unwritable I1117 09:43:55.718068 volume_layout.go:542 Volume 9 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.718190 volume_layout.go:1149 Volume 10 becomes unwritable I1117 09:43:55.718323 volume_layout.go:542 Volume 10 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.718446 volume_layout.go:1149 Volume 11 becomes unwritable I1117 09:43:55.718574 volume_layout.go:542 Volume 11 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.718696 volume_layout.go:1149 Volume 12 becomes unwritable I1117 09:43:55.718822 volume_layout.go:542 Volume 12 reaches full capacity (effective=2094845132, limit=1073741824). I1117 09:43:55.718945 volume_layout.go:1149 Volume 13 becomes unwritable I1117 09:43:55.719069 volume_layout.go:542 Volume 13 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.719192 volume_layout.go:1149 Volume 14 becomes unwritable I1117 09:43:55.719370 volume_layout.go:542 Volume 14 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.719897 volume_layout.go:1149 Volume 15 becomes unwritable I1117 09:43:55.720029 volume_layout.go:542 Volume 15 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.720150 volume_layout.go:1149 Volume 16 becomes unwritable I1117 09:43:55.720270 volume_layout.go:542 Volume 16 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.720394 volume_layout.go:1149 Volume 17 becomes unwritable I1117 09:43:55.720531 volume_layout.go:542 Volume 17 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.720649 volume_layout.go:1149 Volume 18 becomes unwritable I1117 09:43:55.720780 volume_layout.go:542 Volume 18 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.720901 volume_layout.go:1149 Volume 19 becomes unwritable I1117 09:43:55.721030 volume_layout.go:542 Volume 19 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.721151 volume_layout.go:1149 Volume 20 becomes unwritable I1117 09:43:55.721287 volume_layout.go:542 Volume 20 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.721414 volume_layout.go:1149 Volume 21 becomes unwritable I1117 09:43:55.721538 volume_layout.go:542 Volume 21 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.721663 volume_layout.go:1149 Volume 22 becomes unwritable I1117 09:43:55.721786 volume_layout.go:542 Volume 22 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.721906 volume_layout.go:1149 Volume 23 becomes unwritable I1117 09:43:55.722032 volume_layout.go:542 Volume 23 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.722154 volume_layout.go:1149 Volume 24 becomes unwritable I1117 09:43:55.722279 volume_layout.go:542 Volume 24 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.722400 volume_layout.go:1149 Volume 25 becomes unwritable I1117 09:43:55.722531 volume_layout.go:542 Volume 25 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.722649 volume_layout.go:1149 Volume 26 becomes unwritable I1117 09:43:55.722774 volume_layout.go:542 Volume 26 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.722889 volume_layout.go:1149 Volume 27 becomes unwritable I1117 09:43:55.723010 volume_layout.go:542 Volume 27 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.723134 volume_layout.go:1149 Volume 28 becomes unwritable I1117 09:43:55.723265 volume_layout.go:542 Volume 28 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.723387 volume_layout.go:1149 Volume 29 becomes unwritable I1117 09:43:55.723509 volume_layout.go:542 Volume 29 reaches full capacity (effective=2093796556, limit=1073741824). I1117 09:43:55.723634 volume_layout.go:1149 Volume 30 becomes unwritable I1117 09:43:55.723761 volume_layout.go:542 Volume 30 reaches full capacity (effective=2093796556, limit=1073741824). --- PASS: TestPeriodicGrowthKeepsHTTPAssignLayoutWritable (0.04s) === RUN TestEcVolumeLocationsSurviveTheLookup I1117 09:43:55.735411 node.go:539 test adds child dc1 I1117 09:43:55.735597 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.735822 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.736018 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestEcVolumeLocationsSurviveTheLookup (0.00s) === RUN TestVolumeLocationCarriesTheRemoteTier I1117 09:43:55.738215 node.go:539 test adds child dc1 I1117 09:43:55.738383 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.738601 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.739122 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestVolumeLocationCarriesTheRemoteTier (0.00s) === RUN TestVolumeLocationCarriesReadOnly I1117 09:43:55.740946 node.go:539 test adds child dc1 I1117 09:43:55.741105 node.go:539 test:dc1 adds child rack1 I1117 09:43:55.741320 node.go:539 test:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:43:55.741548 node.go:539 test:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestVolumeLocationCarriesReadOnly (0.00s) === RUN TestParseReservationTimeout === RUN TestParseReservationTimeout/unset_defaults_to_5_minutes === RUN TestParseReservationTimeout/duration_string_10m === RUN TestParseReservationTimeout/duration_string_30s === RUN TestParseReservationTimeout/integer_seconds_300 === RUN TestParseReservationTimeout/large_integer_stays_seconds_not_nanoseconds === RUN TestParseReservationTimeout/non-positive_zero_defaults_to_5_minutes === RUN TestParseReservationTimeout/negative_seconds_defaults_to_5_minutes === RUN TestParseReservationTimeout/invalid_string_defaults_to_5_minutes --- PASS: TestParseReservationTimeout (0.01s) --- PASS: TestParseReservationTimeout/unset_defaults_to_5_minutes (0.00s) --- PASS: TestParseReservationTimeout/duration_string_10m (0.00s) --- PASS: TestParseReservationTimeout/duration_string_30s (0.00s) --- PASS: TestParseReservationTimeout/integer_seconds_300 (0.00s) --- PASS: TestParseReservationTimeout/large_integer_stays_seconds_not_nanoseconds (0.00s) --- PASS: TestParseReservationTimeout/non-positive_zero_defaults_to_5_minutes (0.00s) --- PASS: TestParseReservationTimeout/negative_seconds_defaults_to_5_minutes (0.00s) --- PASS: TestParseReservationTimeout/invalid_string_defaults_to_5_minutes (0.00s) === RUN TestRaftServerID === RUN TestRaftServerID/without_grpc_suffix === RUN TestRaftServerID/with_grpc_suffix --- PASS: TestRaftServerID (0.00s) --- PASS: TestRaftServerID/without_grpc_suffix (0.00s) --- PASS: TestRaftServerID/with_grpc_suffix (0.00s) === RUN TestAddPeersConfigurationUsesCanonicalIDs --- PASS: TestAddPeersConfigurationUsesCanonicalIDs (0.00s) === RUN TestRaftMetricsReachPrometheus --- PASS: TestRaftMetricsReachPrometheus (0.01s) === RUN TestVolumeServerAdminAuthCoverage --- PASS: TestVolumeServerAdminAuthCoverage (1.71s) === RUN TestVolumeStatusErrorDistinguishesAbsentFromTransportFailure --- PASS: TestVolumeStatusErrorDistinguishesAbsentFromTransportFailure (0.00s) === RUN TestVolumeDeleteMapsAbsentStoreVolumeToNotFound E1117 09:43:57.500491 volume_grpc_admin.go:249 volume delete volume_id:17: delete volume 17 not found on disk: volume not found --- PASS: TestVolumeDeleteMapsAbsentStoreVolumeToNotFound (0.02s) === RUN TestVolumeDeleteSkipsCancelledRPC I1117 09:43:57.508989 store.go:431 In dir /tmp/TestVolumeDeleteSkipsCancelledRPC1558868061/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:43:57.524943 store.go:436 add volume 1 on disk ID 0 W1117 09:43:57.532390 volume_grpc_admin.go:242 volume delete volume_id:1 not started: context canceled W1117 09:43:57.533415 volume_grpc_admin.go:242 volume delete volume_id:1 not started: context deadline exceeded I1117 09:43:57.536339 volume_write.go:138 removed volume file /tmp/TestVolumeDeleteSkipsCancelledRPC1558868061/001/1.dat (size=176) I1117 09:43:57.536669 volume_write.go:138 removed volume file /tmp/TestVolumeDeleteSkipsCancelledRPC1558868061/001/1.idx (size=48) I1117 09:43:57.538800 store.go:1315 DeleteVolume 1 disk_id:0 I1117 09:43:57.539116 volume_grpc_admin.go:253 volume delete volume_id:1 --- PASS: TestVolumeDeleteSkipsCancelledRPC (0.04s) === RUN TestVolumeDeleteCancelledWhileQueuedBehindGuard I1117 09:43:57.544610 store.go:431 In dir /tmp/TestVolumeDeleteCancelledWhileQueuedBehindGuard632399138/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:43:57.546393 store.go:436 add volume 1 on disk ID 0 W1117 09:43:57.588821 volume_grpc_admin.go:242 volume delete volume_id:1 not started: context canceled --- PASS: TestVolumeDeleteCancelledWhileQueuedBehindGuard (0.05s) === RUN TestBatchDelete_AlreadyDeletedEcNeedleIsNotAnError W1117 09:43:57.599647 volume_info.go:47 empty volume info file /tmp/TestBatchDelete_AlreadyDeletedEcNeedleIsNotAnError1686982834/001/7.vif, treating as non-existent W1117 09:43:57.600551 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestBatchDelete_AlreadyDeletedEcNeedleIsNotAnError1686982834/001/7.vif --- PASS: TestBatchDelete_AlreadyDeletedEcNeedleIsNotAnError (0.01s) === RUN TestDeleteHandler_AlreadyDeletedEcNeedleIsNotAWriteFailure W1117 09:43:57.610685 volume_info.go:47 empty volume info file /tmp/TestDeleteHandler_AlreadyDeletedEcNeedleIsNotAWriteFailure2755519701/001/8.vif, treating as non-existent W1117 09:43:57.611135 ec_volume.go:425 vif file not found, using defaults, volumeId:8, filename:/tmp/TestDeleteHandler_AlreadyDeletedEcNeedleIsNotAWriteFailure2755519701/001/8.vif I1117 09:43:57.613511 common.go:111 response method:DELETE URL:/8,0100000000 with httpStatus:404 and JSON:{"size":0} --- PASS: TestDeleteHandler_AlreadyDeletedEcNeedleIsNotAWriteFailure (0.01s) === RUN TestBatchDelete_DeniesNonWhitelistedPeer I1117 09:43:57.615663 volume_grpc_admin.go:67 gRPC admin auth failed: 127.0.0.1 is not whitelisted (remote: 127.0.0.1:12345) --- PASS: TestBatchDelete_DeniesNonWhitelistedPeer (0.00s) === RUN TestLookupRaftLeaderMasterDoesNotUpdateCurrentMaster --- PASS: TestLookupRaftLeaderMasterDoesNotUpdateCurrentMaster (0.02s) === RUN TestHeartbeatToFollowerPublishesNamedLeaderOnly I1117 09:43:57.643833 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:44089 I1117 09:43:57.658802 volume_grpc_client_to_master.go:321 Volume Server found a new master newLeader: leader.example.com:9333 instead of 127.0.0.1:44089 --- PASS: TestHeartbeatToFollowerPublishesNamedLeaderOnly (0.03s) === RUN TestHeartbeatToLeaderPublishesItAndResendsFromSendLoop I1117 09:43:57.677041 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:38997 --- PASS: TestHeartbeatToLeaderPublishesItAndResendsFromSendLoop (0.03s) === RUN TestHeartbeatPublishesLeaderBeforeDuplicateUuidError I1117 09:43:57.701845 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:33759 E1117 09:43:57.705369 volume_grpc_client_to_master.go:348 Master reported duplicate volume directories: [] (retry 1/3) E1117 09:43:57.705669 volume_grpc_client_to_master.go:349 This might be due to a race condition during reconnection. Waiting 2s before retrying... --- PASS: TestHeartbeatPublishesLeaderBeforeDuplicateUuidError (0.02s) === RUN TestRefreshLeaderFromPeersPublishesReportedLeader --- PASS: TestRefreshLeaderFromPeersPublishesReportedLeader (0.01s) === RUN TestRefreshLeaderFromPeersClearsLeaderWithoutAnswer I1117 09:43:57.728926 volume_grpc_client_to_master.go:51 volume server 127.0.0.1:8080: raft leader lookup: lookup raft leader from 1 master peer(s): master 127.0.0.1:38487 returned empty leader --- PASS: TestRefreshLeaderFromPeersClearsLeaderWithoutAnswer (0.01s) === RUN TestRefreshLeaderFromPeersAsksLostMasterLast --- PASS: TestRefreshLeaderFromPeersAsksLostMasterLast (0.01s) === RUN TestMastersAskingLast --- PASS: TestMastersAskingLast (0.00s) === RUN TestHeartbeatAfterLosingLeaderDialsTheNewLeader I1117 09:43:57.748249 volume_grpc_client_to_master.go:154 Volume server start with seed master nodes: [127.0.0.1:43857 127.0.0.1:42241 127.0.0.1:39265] I1117 09:43:57.756092 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:43857 I1117 09:43:57.759369 volume_grpc_client_to_master.go:321 Volume Server found a new master newLeader: 127.0.0.1:39265 instead of 127.0.0.1:43857 I1117 09:44:00.768124 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:39265 I1117 09:44:00.778600 volume_grpc_client_to_master.go:495 Volume Server Failed to talk with master 127.0.0.1:39265: EOF I1117 09:44:00.780113 volume_grpc_client_to_master.go:219 heartbeat to 127.0.0.1:39265 error: EOF I1117 09:44:01.786565 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:42241 --- PASS: TestHeartbeatAfterLosingLeaderDialsTheNewLeader (4.05s) === RUN TestHeartbeatKeepsUntriedHintOverStaleSeedAnswer I1117 09:44:01.801466 volume_grpc_client_to_master.go:154 Volume server start with seed master nodes: [127.0.0.1:34155] I1117 09:44:01.807203 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:34155 I1117 09:44:01.810190 volume_grpc_client_to_master.go:321 Volume Server found a new master newLeader: 127.0.0.1:46037 instead of 127.0.0.1:34155 I1117 09:44:04.818700 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:46037 I1117 09:44:04.821832 volume_grpc_client_to_master.go:321 Volume Server found a new master newLeader: 127.0.0.1:46109 instead of 127.0.0.1:46037 I1117 09:44:04.829315 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:34155 I1117 09:44:04.832049 volume_grpc_client_to_master.go:321 Volume Server found a new master newLeader: 127.0.0.1:46037 instead of 127.0.0.1:34155 I1117 09:44:07.841170 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:46109 --- PASS: TestHeartbeatKeepsUntriedHintOverStaleSeedAnswer (6.05s) === RUN TestHeartbeatOnceRedialsPromptlyAfterLosingRegisteredStream I1117 09:44:07.858418 volume_grpc_client_to_master.go:286 Heartbeat to: 127.0.0.1:46405 I1117 09:44:07.862273 volume_grpc_client_to_master.go:495 Volume Server Failed to talk with master 127.0.0.1:46405: EOF I1117 09:44:07.864182 volume_grpc_client_to_master.go:219 heartbeat to 127.0.0.1:46405 error: EOF I1117 09:44:07.872854 volume_grpc_client_to_master.go:51 volume server 127.0.0.1:8080: raft leader lookup: lookup raft leader from 1 master peer(s): rpc error: code = Unimplemented desc = method GetMasterConfiguration not implemented --- PASS: TestHeartbeatOnceRedialsPromptlyAfterLosingRegisteredStream (1.03s) === RUN TestHeartbeatOnceKeepsPulseBackoffOnceLossIsOld I1117 09:44:08.887576 volume_grpc_client_to_master.go:283 SendHeartbeat to 127.0.0.1:39735: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:39735: connect: connection refused" I1117 09:44:08.888968 volume_grpc_client_to_master.go:219 heartbeat to 127.0.0.1:39735 error: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:39735: connect: connection refused" I1117 09:44:08.896334 volume_grpc_client_to_master.go:51 volume server 127.0.0.1:8080: raft leader lookup: lookup raft leader from 1 master peer(s): rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:39735: connect: connection refused" --- PASS: TestHeartbeatOnceKeepsPulseBackoffOnceLossIsOld (3.01s) === RUN TestCheckCopyCounts === RUN TestCheckCopyCounts/empty_volume_counts_match === RUN TestCheckCopyCounts/file_and_deleted_counts_match === RUN TestCheckCopyCounts/file_count_differs === RUN TestCheckCopyCounts/deleted_count_differs W1117 09:44:11.895595 volume_grpc_copy.go:753 copied volume 1 deleted count [2] differs from origin deleted count [3] (counter drift, copy kept) === RUN TestCheckCopyCounts/deleted_count_differs_and_file_count_differs --- PASS: TestCheckCopyCounts (0.00s) --- PASS: TestCheckCopyCounts/empty_volume_counts_match (0.00s) --- PASS: TestCheckCopyCounts/file_and_deleted_counts_match (0.00s) --- PASS: TestCheckCopyCounts/file_count_differs (0.00s) --- PASS: TestCheckCopyCounts/deleted_count_differs (0.00s) --- PASS: TestCheckCopyCounts/deleted_count_differs_and_file_count_differs (0.00s) === RUN TestCopyCountsStable === RUN TestCopyCountsStable/empty_volume_is_stable === RUN TestCopyCountsStable/matching_file_and_deleted_counts_are_stable === RUN TestCopyCountsStable/read-only_state_changes_without_count_changes_are_stable === RUN TestCopyCountsStable/changed_file_count_is_not_stable === RUN TestCopyCountsStable/changed_deleted_count_alone_is_stable === RUN TestCopyCountsStable/missing_before_status_is_not_stable === RUN TestCopyCountsStable/missing_after_status_is_not_stable --- PASS: TestCopyCountsStable (0.00s) --- PASS: TestCopyCountsStable/empty_volume_is_stable (0.00s) --- PASS: TestCopyCountsStable/matching_file_and_deleted_counts_are_stable (0.00s) --- PASS: TestCopyCountsStable/read-only_state_changes_without_count_changes_are_stable (0.00s) --- PASS: TestCopyCountsStable/changed_file_count_is_not_stable (0.00s) --- PASS: TestCopyCountsStable/changed_deleted_count_alone_is_stable (0.00s) --- PASS: TestCopyCountsStable/missing_before_status_is_not_stable (0.00s) --- PASS: TestCopyCountsStable/missing_after_status_is_not_stable (0.00s) === RUN TestIncrementalCopyCarriesRemoteTierTombstone I1117 09:44:11.905371 store.go:431 In dir /tmp/TestIncrementalCopyCarriesRemoteTierTombstone113991024/002 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:11.907186 store.go:436 add volume 1 on disk ID 0 I1117 09:44:11.951180 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestIncrementalCopyCarriesRemoteTierTombstone113991024/003/1.idx I1117 09:44:12.003172 needle_map_memory.go:122 loading idx from offset 11 for file: /tmp/TestIncrementalCopyCarriesRemoteTierTombstone113991024/003/1.idx --- PASS: TestIncrementalCopyCarriesRemoteTierTombstone (0.11s) === RUN TestVolumeMountRefusesAVolumeBeingCopied E1117 09:44:12.012337 volume_grpc_admin.go:159 volume mount volume_id:17: volume 17 not found on disk --- PASS: TestVolumeMountRefusesAVolumeBeingCopied (0.01s) === RUN TestVolumeConfigureRefusesAVolumeBeingCopied --- PASS: TestVolumeConfigureRefusesAVolumeBeingCopied (0.00s) === RUN TestAllocateVolumeRefusesAVolumeBeingCopied --- PASS: TestAllocateVolumeRefusesAVolumeBeingCopied (0.00s) === RUN TestVolumeUnmountRefusesAVolumeBeingCopied --- PASS: TestVolumeUnmountRefusesAVolumeBeingCopied (0.00s) === RUN TestVolumeDeleteRefusesAVolumeBeingCopied --- PASS: TestVolumeDeleteRefusesAVolumeBeingCopied (0.00s) === RUN TestAdoptStagedVolumeRefusesAVolumeBeingCopied --- PASS: TestAdoptStagedVolumeRefusesAVolumeBeingCopied (0.00s) === RUN TestVolumeMountSucceedsWhileHoldingTheGuard I1117 09:44:12.043401 store.go:1149 mount volume 17 --- PASS: TestVolumeMountSucceedsWhileHoldingTheGuard (0.01s) === RUN TestVolumeLoadGuardSkipsACopyInFlight --- PASS: TestVolumeLoadGuardSkipsACopyInFlight (0.00s) === RUN TestLinkReplacedVolumeFilesPreservesPresentFiles --- PASS: TestLinkReplacedVolumeFilesPreservesPresentFiles (0.00s) === RUN TestLinkReplacedVolumeFilesReportsUnpreservedFile W1117 09:44:12.052614 volume_grpc_copy.go:627 preserve replaced file /tmp/TestLinkReplacedVolumeFilesReportsUnpreservedFile1402154810/001/vol_1.dat: mkdir /tmp/TestLinkReplacedVolumeFilesReportsUnpreservedFile1402154810/001/copying: not a directory --- PASS: TestLinkReplacedVolumeFilesReportsUnpreservedFile (0.00s) === RUN TestRestoreReplacedVolumeFilesPutsLinksBack --- PASS: TestRestoreReplacedVolumeFilesPutsLinksBack (0.00s) === RUN TestRestoreReplacedVolumeFilesRestoresRepeatedPathOnce --- PASS: TestRestoreReplacedVolumeFilesRestoresRepeatedPathOnce (0.00s) === RUN TestRestoreReplacedVolumeFilesReplacesSurvivingPartial --- PASS: TestRestoreReplacedVolumeFilesReplacesSurvivingPartial (0.00s) === RUN TestReceiveFile_RejectsTraversalExt E1117 09:44:12.063406 volume_grpc_copy.go:1171 ReceiveFile: invalid file extension "/../../pwned.ec00" --- PASS: TestReceiveFile_RejectsTraversalExt (0.01s) === RUN TestReceiveFile_RejectsTraversalCollection E1117 09:44:12.069353 volume_grpc_copy.go:1177 ReceiveFile: invalid collection "../../pwned" --- PASS: TestReceiveFile_RejectsTraversalCollection (0.00s) === RUN TestReceiveFile_AcceptsNormalExt --- PASS: TestReceiveFile_AcceptsNormalExt (0.00s) === RUN TestCopyFile_RejectsTraversalExt --- PASS: TestCopyFile_RejectsTraversalExt (0.00s) === RUN TestVolumeCopyContinuesWhenInitialStatusUnavailable I1117 09:44:12.083133 store.go:431 In dir /tmp/TestVolumeCopyContinuesWhenInitialStatusUnavailable1434989076/001 (disk ID 0) adds volume:43 collection: replicaPlacement:000 ttl: I1117 09:44:12.084960 store.go:436 add volume 43 on disk ID 0 W1117 09:44:12.097349 volume_grpc_copy.go:122 failed to read source volume 43 status before copy; skip record count validation: rpc error: code = Unknown desc = source volume status unavailable I1117 09:44:12.111410 volume_grpc_copy.go:151 connect to : get master configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp: missing address" I1117 09:44:12.154237 store.go:1149 mount volume 43 --- PASS: TestVolumeCopyContinuesWhenInitialStatusUnavailable (0.08s) === RUN TestVolumeCopyFailsWhenFinalStatusUnavailable I1117 09:44:12.160667 store.go:431 In dir /tmp/TestVolumeCopyFailsWhenFinalStatusUnavailable1927737280/001 (disk ID 0) adds volume:43 collection: replicaPlacement:000 ttl: I1117 09:44:12.162527 store.go:436 add volume 43 on disk ID 0 I1117 09:44:12.179938 volume_grpc_copy.go:151 connect to : get master configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp: missing address" --- PASS: TestVolumeCopyFailsWhenFinalStatusUnavailable (0.05s) === RUN TestVolumeCopyKeepsExistingReplicaWhenDestinationFull I1117 09:44:12.213767 store.go:431 In dir /tmp/TestVolumeCopyKeepsExistingReplicaWhenDestinationFull2049930759/001 (disk ID 0) adds volume:44 collection: replicaPlacement:000 ttl: I1117 09:44:12.215538 store.go:436 add volume 44 on disk ID 0 I1117 09:44:12.219129 store.go:431 In dir /tmp/TestVolumeCopyKeepsExistingReplicaWhenDestinationFull2049930759/002 (disk ID 0) adds volume:44 collection: replicaPlacement:000 ttl: I1117 09:44:12.220624 store.go:436 add volume 44 on disk ID 0 W1117 09:44:12.229418 volume_grpc_copy.go:122 failed to read source volume 44 status before copy; skip record count validation: rpc error: code = Unknown desc = source volume status unavailable I1117 09:44:12.242309 volume_grpc_copy.go:151 connect to : get master configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp: missing address" --- PASS: TestVolumeCopyKeepsExistingReplicaWhenDestinationFull (0.04s) === RUN TestVolumeCopyReplacesReplicaAtSlotLimit I1117 09:44:12.249554 store.go:431 In dir /tmp/TestVolumeCopyReplacesReplicaAtSlotLimit4261558583/001 (disk ID 0) adds volume:45 collection: replicaPlacement:000 ttl: I1117 09:44:12.251426 store.go:436 add volume 45 on disk ID 0 I1117 09:44:12.255361 store.go:431 In dir /tmp/TestVolumeCopyReplacesReplicaAtSlotLimit4261558583/002 (disk ID 0) adds volume:45 collection: replicaPlacement:000 ttl: I1117 09:44:12.256899 store.go:436 add volume 45 on disk ID 0 W1117 09:44:12.265150 volume_grpc_copy.go:122 failed to read source volume 45 status before copy; skip record count validation: rpc error: code = Unknown desc = source volume status unavailable I1117 09:44:12.273083 volume_grpc_copy.go:151 connect to : get master configuration: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp: missing address" I1117 09:44:12.303206 volume_grpc_copy.go:471 volume 45 already exists. deleting before copying from 127.0.0.1:23771.33771... I1117 09:44:12.305183 volume_write.go:138 removed volume file /tmp/TestVolumeCopyReplacesReplicaAtSlotLimit4261558583/002/45.dat (size=8) I1117 09:44:12.305349 volume_write.go:138 removed volume file /tmp/TestVolumeCopyReplacesReplicaAtSlotLimit4261558583/002/45.idx (size=0) I1117 09:44:12.306505 store.go:1315 DeleteVolume 45 disk_id:0 I1117 09:44:12.306864 volume_grpc_copy.go:495 deleted existing volume 45 before copying. I1117 09:44:12.310065 store.go:1149 mount volume 45 --- PASS: TestVolumeCopyReplacesReplicaAtSlotLimit (0.07s) === RUN TestVolumeCopy_KeepsExistingReplicaWhenSourceUnreachable I1117 09:44:12.316403 store.go:431 In dir /tmp/TestVolumeCopy_KeepsExistingReplicaWhenSourceUnreachable2864214831/001 (disk ID 0) adds volume:42 collection: replicaPlacement:000 ttl: I1117 09:44:12.318420 store.go:436 add volume 42 on disk ID 0 W1117 09:44:12.323690 volume_grpc_copy.go:122 failed to read source volume 42 status before copy; skip record count validation: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:10001: connect: connection refused" --- PASS: TestVolumeCopy_KeepsExistingReplicaWhenSourceUnreachable (0.01s) === RUN TestCopyTailHandlersRejectUntrustedSources --- PASS: TestCopyTailHandlersRejectUntrustedSources (0.00s) === RUN TestWriteToFile_RemovesPartialFileOnStreamError --- PASS: TestWriteToFile_RemovesPartialFileOnStreamError (0.00s) === RUN TestWriteToFile_RemovesEmptyFileOnImmediateStreamError --- PASS: TestWriteToFile_RemovesEmptyFileOnImmediateStreamError (0.00s) === RUN TestWriteToFile_PreservesAppendModeOnError --- PASS: TestWriteToFile_PreservesAppendModeOnError (0.00s) === RUN TestWriteToFile_SucceedsOnCleanStream --- PASS: TestWriteToFile_SucceedsOnCleanStream (0.00s) === RUN TestWriteToFile_PreservesDestinationWhenOptionalSourceMissing --- PASS: TestWriteToFile_PreservesDestinationWhenOptionalSourceMissing (0.00s) === RUN TestWriteToFile_CommitsOptionalCopyWhenSourcePresent --- PASS: TestWriteToFile_CommitsOptionalCopyWhenSourcePresent (0.00s) === RUN TestFullTeardownFencedByGeneration === RUN TestFullTeardownFencedByGeneration/older_disk_wiped I1117 09:44:12.351782 store_ec.go:261 MountEcShards 55.0 on disk ID 0 I1117 09:44:12.353733 store_ec.go:261 MountEcShards 55.1 on disk ID 0 I1117 09:44:12.354279 volume_grpc_erasure_coding.go:634 ec volume ec-fence_55 full teardown fenced at generation 200 === RUN TestFullTeardownFencedByGeneration/newer_disk_preserved I1117 09:44:12.367723 store_ec.go:261 MountEcShards 55.0 on disk ID 0 I1117 09:44:12.368533 store_ec.go:261 MountEcShards 55.1 on disk ID 0 I1117 09:44:12.368820 volume_grpc_erasure_coding.go:634 ec volume ec-fence_55 full teardown fenced at generation 100 === RUN TestFullTeardownFencedByGeneration/zero_gen_preserved I1117 09:44:12.377658 store_ec.go:261 MountEcShards 55.0 on disk ID 0 I1117 09:44:12.378493 store_ec.go:261 MountEcShards 55.1 on disk ID 0 I1117 09:44:12.378798 volume_grpc_erasure_coding.go:634 ec volume ec-fence_55 full teardown fenced at generation 200 === RUN TestFullTeardownFencedByGeneration/zero_request_blanket_wipe I1117 09:44:12.387614 store_ec.go:261 MountEcShards 55.0 on disk ID 0 I1117 09:44:12.388401 store_ec.go:261 MountEcShards 55.1 on disk ID 0 I1117 09:44:12.388711 volume_grpc_erasure_coding.go:618 ec volume ec-fence_55 full teardown --- PASS: TestFullTeardownFencedByGeneration (0.05s) --- PASS: TestFullTeardownFencedByGeneration/older_disk_wiped (0.02s) --- PASS: TestFullTeardownFencedByGeneration/newer_disk_preserved (0.01s) --- PASS: TestFullTeardownFencedByGeneration/zero_gen_preserved (0.01s) --- PASS: TestFullTeardownFencedByGeneration/zero_request_blanket_wipe (0.01s) === RUN TestUnmountEcShardsFencedByGeneration I1117 09:44:12.398158 store_ec.go:261 MountEcShards 56.0 on disk ID 0 I1117 09:44:12.398988 store_ec.go:261 MountEcShards 56.1 on disk ID 0 I1117 09:44:12.399865 volume_grpc_erasure_coding.go:1487 VolumeEcShardsInfo: volume 56 I1117 09:44:12.401392 store_ec.go:415 UnmountEcShards 56.1 disk_id:0 I1117 09:44:12.401643 volume_grpc_erasure_coding.go:1487 VolumeEcShardsInfo: volume 56 --- PASS: TestUnmountEcShardsFencedByGeneration (0.01s) === RUN TestTeardownRemovesStagedGenerations I1117 09:44:12.409375 store_ec.go:261 MountEcShards 57.0 on disk ID 0 I1117 09:44:12.410178 store_ec.go:261 MountEcShards 57.1 on disk ID 0 I1117 09:44:12.411466 volume_grpc_erasure_coding.go:634 ec volume ec-gen-leak_57 full teardown fenced at generation 200 --- PASS: TestTeardownRemovesStagedGenerations (0.01s) === RUN TestDeleteGenerationsOlderThan I1117 09:44:12.422530 store_ec.go:261 MountEcShards 58.0 on disk ID 0 I1117 09:44:12.423397 store_ec.go:261 MountEcShards 58.1 on disk ID 0 I1117 09:44:12.426007 volume_grpc_erasure_coding.go:1487 VolumeEcShardsInfo: volume 58 --- PASS: TestDeleteGenerationsOlderThan (0.01s) === RUN TestShardDeleteRemovesStagedGenerations I1117 09:44:12.433367 store_ec.go:261 MountEcShards 59.0 on disk ID 0 I1117 09:44:12.434701 store_ec.go:261 MountEcShards 59.5 on disk ID 0 I1117 09:44:12.436576 store_ec.go:415 UnmountEcShards 59.5 disk_id:0 I1117 09:44:12.436919 volume_grpc_erasure_coding.go:672 ec volume ec-shard-gen_59 shard delete [5] --- PASS: TestShardDeleteRemovesStagedGenerations (0.01s) === RUN TestReadEcGenerationTsNs W1117 09:44:12.446733 volume_info.go:55 unmarshal error: proto: syntax error (line 1:1): invalid value not-a-valid-vif oldFormat: failed to unmarshal old version volume info: proto: syntax error (line 1:1): invalid value not-a-valid-vif --- PASS: TestReadEcGenerationTsNs (0.01s) === RUN TestVolumeEcShardsRebuild_ReopensMountedCorruptShard I1117 09:44:12.452727 ec_encoder.go:225 encodeDatFile /tmp/TestVolumeEcShardsRebuild_ReopensMountedCorruptShard2287936518/001/data/col_42.dat size:7000 with EC context 10+4 (total: 14) I1117 09:44:13.722573 ec_volume.go:419 ec volume 42: .vif missing; took EC config from the bitrot sidecar: 10+4 (total: 14) I1117 09:44:13.723758 store_ec.go:261 MountEcShards 42.0 on disk ID 0 I1117 09:44:13.732438 volume_grpc_erasure_coding.go:211 VolumeEcShardsRebuild: volume_id:42 collection:"col" I1117 09:44:13.735851 ec_encoder.go:177 Rebuilding EC files for /tmp/TestVolumeEcShardsRebuild_ReopensMountedCorruptShard2287936518/001/data/col_42 with config from the bitrot sidecar: 10+4 (total: 14) W1117 09:44:14.680619 ec_encoder.go:343 bitrot: present shard 0 for /tmp/TestVolumeEcShardsRebuild_ReopensMountedCorruptShard2287936518/001/data/col_42 fails checksum; excluding from rebuild inputs and regenerating I1117 09:44:14.681392 ec_encoder.go:359 rebuilding /tmp/TestVolumeEcShardsRebuild_ReopensMountedCorruptShard2287936518/001/data/col_42: 13 shards present, 1 missing [0], config 10+4 (total: 14) --- PASS: TestVolumeEcShardsRebuild_ReopensMountedCorruptShard (2.33s) === RUN TestVolumeEcShardsRebuild_RelocatesMountedShardAcrossDisks I1117 09:44:14.784445 ec_encoder.go:225 encodeDatFile /tmp/TestVolumeEcShardsRebuild_RelocatesMountedShardAcrossDisks1460387537/001/a/col_42.dat size:7000 with EC context 10+4 (total: 14) I1117 09:44:15.468471 ec_volume.go:419 ec volume 42: .vif missing; took EC config from the bitrot sidecar: 10+4 (total: 14) I1117 09:44:15.469310 store_ec.go:261 MountEcShards 42.0 on disk ID 1 I1117 09:44:15.470922 volume_grpc_erasure_coding.go:211 VolumeEcShardsRebuild: volume_id:42 collection:"col" I1117 09:44:15.472836 ec_encoder.go:177 Rebuilding EC files for /tmp/TestVolumeEcShardsRebuild_RelocatesMountedShardAcrossDisks1460387537/001/a/col_42 with config from the bitrot sidecar: 10+4 (total: 14) I1117 09:44:16.292708 ec_encoder.go:359 rebuilding /tmp/TestVolumeEcShardsRebuild_RelocatesMountedShardAcrossDisks1460387537/001/a/col_42: 13 shards present, 1 missing [0], config 10+4 (total: 14) I1117 09:44:16.410052 ec_volume.go:419 ec volume 42: .vif missing; took EC config from the bitrot sidecar: 10+4 (total: 14) --- PASS: TestVolumeEcShardsRebuild_RelocatesMountedShardAcrossDisks (1.65s) === RUN TestVolumeEcShardRead_RefusesQuarantinedShard W1117 09:44:16.431361 volume_info.go:47 empty volume info file /tmp/TestVolumeEcShardRead_RefusesQuarantinedShard3027525336/001/7.vif, treating as non-existent W1117 09:44:16.431839 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestVolumeEcShardRead_RefusesQuarantinedShard3027525336/001/7.vif --- PASS: TestVolumeEcShardRead_RefusesQuarantinedShard (0.01s) === RUN TestVolumeEcShardRead_EcxReadErrorIsNotADelete W1117 09:44:16.436535 volume_info.go:47 empty volume info file /tmp/TestVolumeEcShardRead_EcxReadErrorIsNotADelete2468850381/001/7.vif, treating as non-existent W1117 09:44:16.436982 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestVolumeEcShardRead_EcxReadErrorIsNotADelete2468850381/001/7.vif --- PASS: TestVolumeEcShardRead_EcxReadErrorIsNotADelete (0.00s) === RUN TestEcShardDeleteKeepsSharedIndexWhileSiblingHasShards I1117 09:44:16.445804 volume_grpc_erasure_coding.go:672 ec volume ec-shared-index_77 shard delete [0 5] I1117 09:44:16.448505 volume_grpc_erasure_coding.go:672 ec volume ec-shared-index_77 shard delete [7 12] --- PASS: TestEcShardDeleteKeepsSharedIndexWhileSiblingHasShards (0.01s) === RUN TestEcShardDeleteKeepsSharedIdxSidecarWhileSiblingHasShards I1117 09:44:16.458859 volume_grpc_erasure_coding.go:672 ec volume ec-shared-idx-sidecar_78 shard delete [0] I1117 09:44:16.461441 volume_grpc_erasure_coding.go:672 ec volume ec-shared-idx-sidecar_78 shard delete [7] --- PASS: TestEcShardDeleteKeepsSharedIdxSidecarWhileSiblingHasShards (0.01s) === RUN TestRebuildSearchDirs === RUN TestRebuildSearchDirs/the_rebuild's_own_index_directory_is_searched === RUN TestRebuildSearchDirs/an_unsplit_rebuild_location_contributes_nothing === RUN TestRebuildSearchDirs/a_sibling's_index_directory_is_searched,_not_just_its_data_directory === RUN TestRebuildSearchDirs/shared_index_directories_are_listed_once === RUN TestRebuildSearchDirs/the_rebuild's_data_directory_is_never_repeated === RUN TestRebuildSearchDirs/empty_directories_are_dropped --- PASS: TestRebuildSearchDirs (0.00s) --- PASS: TestRebuildSearchDirs/the_rebuild's_own_index_directory_is_searched (0.00s) --- PASS: TestRebuildSearchDirs/an_unsplit_rebuild_location_contributes_nothing (0.00s) --- PASS: TestRebuildSearchDirs/a_sibling's_index_directory_is_searched,_not_just_its_data_directory (0.00s) --- PASS: TestRebuildSearchDirs/shared_index_directories_are_listed_once (0.00s) --- PASS: TestRebuildSearchDirs/the_rebuild's_data_directory_is_never_repeated (0.00s) --- PASS: TestRebuildSearchDirs/empty_directories_are_dropped (0.00s) === RUN TestReceiveEcjIds === RUN TestReceiveEcjIds/source_has_no_journal === RUN TestReceiveEcjIds/empty_journal_still_carries_its_modified_time === RUN TestReceiveEcjIds/bytes_without_a_modified_time === RUN TestReceiveEcjIds/records_split_across_chunks --- PASS: TestReceiveEcjIds (0.00s) --- PASS: TestReceiveEcjIds/source_has_no_journal (0.00s) --- PASS: TestReceiveEcjIds/empty_journal_still_carries_its_modified_time (0.00s) --- PASS: TestReceiveEcjIds/bytes_without_a_modified_time (0.00s) --- PASS: TestReceiveEcjIds/records_split_across_chunks (0.00s) === RUN TestReceiveEcjIds_StreamError --- PASS: TestReceiveEcjIds_StreamError (0.00s) === RUN TestFetchEcIndexFromPeers_CopiesIndexOverGrpc I1117 09:44:16.521791 volume_grpc_erasure_coding_recover.go:164 ec volume 6190: fetched missing .ecx from 127.0.0.1:36303 into /tmp/TestFetchEcIndexFromPeers_CopiesIndexOverGrpc2582022557/002/dst --- PASS: TestFetchEcIndexFromPeers_CopiesIndexOverGrpc (0.05s) === RUN TestFetchEcIndexFromPeers_SkipsPeerWithoutIndex --- PASS: TestFetchEcIndexFromPeers_SkipsPeerWithoutIndex (0.02s) === RUN TestVolumeEcShardsMount_RecoverMissingIndex I1117 09:44:16.554883 volume_grpc_erasure_coding.go:1009 VolumeEcShardsMount: recover_missing_index:true I1117 09:44:16.600386 volume_grpc_erasure_coding_recover.go:164 ec volume 6190: fetched missing .ecx from 127.0.0.1:1 into /tmp/TestVolumeEcShardsMount_RecoverMissingIndex511322920/002/dst I1117 09:44:16.604517 volume_grpc_erasure_coding_recover.go:75 recovered missing EC index for 1 volume(s) from peers and mounted their shards --- PASS: TestVolumeEcShardsMount_RecoverMissingIndex (0.06s) === RUN TestCheckEcVolumeStatusCountOnlyDataShards --- PASS: TestCheckEcVolumeStatusCountOnlyDataShards (0.00s) === RUN TestRemoveStaleEcArtifacts --- PASS: TestRemoveStaleEcArtifacts (0.01s) === RUN TestDeleteEcShardsWithoutLocalEcx --- PASS: TestDeleteEcShardsWithoutLocalEcx (0.00s) === RUN TestVolumeEcShardsInfo_AggregatesAcrossDisks I1117 09:44:16.628353 store_ec.go:261 MountEcShards 42.0 on disk ID 0 I1117 09:44:16.629460 store_ec.go:261 MountEcShards 42.5 on disk ID 0 I1117 09:44:16.632060 store_ec.go:261 MountEcShards 42.7 on disk ID 1 I1117 09:44:16.632610 store_ec.go:261 MountEcShards 42.12 on disk ID 1 I1117 09:44:16.632856 volume_grpc_erasure_coding.go:1487 VolumeEcShardsInfo: volume 42 --- PASS: TestVolumeEcShardsInfo_AggregatesAcrossDisks (0.01s) === RUN TestMaintenanceModeAllowsVolumeMarkReadonly I1117 09:44:16.638155 store.go:431 In dir /tmp/TestMaintenanceModeAllowsVolumeMarkReadonly790168441/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:16.639992 store.go:436 add volume 1 on disk ID 0 --- PASS: TestMaintenanceModeAllowsVolumeMarkReadonly (0.02s) === RUN TestMaintenanceModeAllowsVolumeDelete I1117 09:44:16.659464 store.go:431 In dir /tmp/TestMaintenanceModeAllowsVolumeDelete4289076887/001 (disk ID 0) adds volume:2 collection: replicaPlacement:000 ttl: I1117 09:44:16.661299 store.go:436 add volume 2 on disk ID 0 I1117 09:44:16.662113 volume_write.go:138 removed volume file /tmp/TestMaintenanceModeAllowsVolumeDelete4289076887/001/2.dat (size=8) I1117 09:44:16.662299 volume_write.go:138 removed volume file /tmp/TestMaintenanceModeAllowsVolumeDelete4289076887/001/2.idx (size=0) I1117 09:44:16.663735 store.go:1315 DeleteVolume 2 disk_id:0 I1117 09:44:16.663922 volume_grpc_admin.go:253 volume delete volume_id:2 --- PASS: TestMaintenanceModeAllowsVolumeDelete (0.01s) === RUN TestMaintenanceModeAllowsVolumeEcShardsDelete I1117 09:44:16.667923 store.go:431 In dir /tmp/TestMaintenanceModeAllowsVolumeEcShardsDelete111847365/001 (disk ID 0) adds volume:99 collection: replicaPlacement:000 ttl: I1117 09:44:16.669545 store.go:436 add volume 99 on disk ID 0 I1117 09:44:16.670671 volume_grpc_erasure_coding.go:672 ec volume ec-maint_3 shard delete [0 1] --- PASS: TestMaintenanceModeAllowsVolumeEcShardsDelete (0.01s) === RUN TestMaintenanceModeStillBlocksWrites I1117 09:44:16.676194 store.go:431 In dir /tmp/TestMaintenanceModeStillBlocksWrites2593899254/001 (disk ID 0) adds volume:4 collection: replicaPlacement:000 ttl: I1117 09:44:16.677757 store.go:436 add volume 4 on disk ID 0 --- PASS: TestMaintenanceModeStillBlocksWrites (0.01s) === RUN TestReceiveFile_EcjStreamBlocksMountCompaction W1117 09:44:16.993401 volume_info.go:47 empty volume info file /tmp/TestReceiveFile_EcjStreamBlocksMountCompaction1628927093/001/4.vif, treating as non-existent W1117 09:44:16.994005 ec_volume.go:425 vif file not found, using defaults, volumeId:4, filename:/tmp/TestReceiveFile_EcjStreamBlocksMountCompaction1628927093/001/4.vif --- PASS: TestReceiveFile_EcjStreamBlocksMountCompaction (0.37s) === RUN TestValidateRemoteEndpoint === RUN TestValidateRemoteEndpoint/empty === RUN TestValidateRemoteEndpoint/loopback_literal === RUN TestValidateRemoteEndpoint/ipv6_loopback === RUN TestValidateRemoteEndpoint/imds_ipv4 === RUN TestValidateRemoteEndpoint/unspecified_ipv4 === RUN TestValidateRemoteEndpoint/link-local_ipv6 === RUN TestValidateRemoteEndpoint/ftp_scheme === RUN TestValidateRemoteEndpoint/missing_scheme === RUN TestValidateRemoteEndpoint/imds_hostname === RUN TestValidateRemoteEndpoint/imds_short_hostname === RUN TestValidateRemoteEndpoint/host_resolves_to_loopback === RUN TestValidateRemoteEndpoint/host_resolves_to_link-local === RUN TestValidateRemoteEndpoint/rfc1918_10/8_literal === RUN TestValidateRemoteEndpoint/rfc1918_172.16/12_literal === RUN TestValidateRemoteEndpoint/rfc1918_192.168/16_literal === RUN TestValidateRemoteEndpoint/cgnat_literal === RUN TestValidateRemoteEndpoint/host_resolves_to_rfc1918_10/8 === RUN TestValidateRemoteEndpoint/host_resolves_to_rfc1918_172/12 === RUN TestValidateRemoteEndpoint/host_resolves_to_rfc1918_192.168/16 === RUN TestValidateRemoteEndpoint/host_resolves_to_cgnat === RUN TestValidateRemoteEndpoint/nat64_imds === RUN TestValidateRemoteEndpoint/nat64_loopback === RUN TestValidateRemoteEndpoint/6to4_private === RUN TestValidateRemoteEndpoint/teredo_loopback === RUN TestValidateRemoteEndpoint/ipv4-compatible_loopback === RUN TestValidateRemoteEndpoint/nat64_public_passes === RUN TestValidateRemoteEndpoint/6to4_public_passes === RUN TestValidateRemoteEndpoint/teredo_public_passes === RUN TestValidateRemoteEndpoint/ipv4-compatible_public_passes === RUN TestValidateRemoteEndpoint/nat64_non-wellknown-prefix_not_decoded === RUN TestValidateRemoteEndpoint/public_s3 --- PASS: TestValidateRemoteEndpoint (0.03s) --- PASS: TestValidateRemoteEndpoint/empty (0.00s) --- PASS: TestValidateRemoteEndpoint/loopback_literal (0.00s) --- PASS: TestValidateRemoteEndpoint/ipv6_loopback (0.00s) --- PASS: TestValidateRemoteEndpoint/imds_ipv4 (0.00s) --- PASS: TestValidateRemoteEndpoint/unspecified_ipv4 (0.00s) --- PASS: TestValidateRemoteEndpoint/link-local_ipv6 (0.00s) --- PASS: TestValidateRemoteEndpoint/ftp_scheme (0.00s) --- PASS: TestValidateRemoteEndpoint/missing_scheme (0.00s) --- PASS: TestValidateRemoteEndpoint/imds_hostname (0.00s) --- PASS: TestValidateRemoteEndpoint/imds_short_hostname (0.00s) --- PASS: TestValidateRemoteEndpoint/host_resolves_to_loopback (0.00s) --- PASS: TestValidateRemoteEndpoint/host_resolves_to_link-local (0.00s) --- PASS: TestValidateRemoteEndpoint/rfc1918_10/8_literal (0.00s) --- PASS: TestValidateRemoteEndpoint/rfc1918_172.16/12_literal (0.00s) --- PASS: TestValidateRemoteEndpoint/rfc1918_192.168/16_literal (0.00s) --- PASS: TestValidateRemoteEndpoint/cgnat_literal (0.00s) --- PASS: TestValidateRemoteEndpoint/host_resolves_to_rfc1918_10/8 (0.00s) --- PASS: TestValidateRemoteEndpoint/host_resolves_to_rfc1918_172/12 (0.00s) --- PASS: TestValidateRemoteEndpoint/host_resolves_to_rfc1918_192.168/16 (0.00s) --- PASS: TestValidateRemoteEndpoint/host_resolves_to_cgnat (0.00s) --- PASS: TestValidateRemoteEndpoint/nat64_imds (0.00s) --- PASS: TestValidateRemoteEndpoint/nat64_loopback (0.00s) --- PASS: TestValidateRemoteEndpoint/6to4_private (0.00s) --- PASS: TestValidateRemoteEndpoint/teredo_loopback (0.00s) --- PASS: TestValidateRemoteEndpoint/ipv4-compatible_loopback (0.00s) --- PASS: TestValidateRemoteEndpoint/nat64_public_passes (0.00s) --- PASS: TestValidateRemoteEndpoint/6to4_public_passes (0.00s) --- PASS: TestValidateRemoteEndpoint/teredo_public_passes (0.00s) --- PASS: TestValidateRemoteEndpoint/ipv4-compatible_public_passes (0.00s) --- PASS: TestValidateRemoteEndpoint/nat64_non-wellknown-prefix_not_decoded (0.00s) --- PASS: TestValidateRemoteEndpoint/public_s3 (0.00s) === RUN TestValidateRemoteEndpointResolverFailure --- PASS: TestValidateRemoteEndpointResolverFailure (0.00s) === RUN TestGuardedDialerRebind --- PASS: TestGuardedDialerRebind (0.00s) === RUN TestRemoteEndpointGuardCoversS3CompatibleSiblings --- PASS: TestRemoteEndpointGuardCoversS3CompatibleSiblings (0.00s) === RUN TestRemoteEndpointGuardCoversAzure === RUN TestRemoteEndpointGuardCoversAzure/imds === RUN TestRemoteEndpointGuardCoversAzure/loopback === RUN TestRemoteEndpointGuardCoversAzure/private --- PASS: TestRemoteEndpointGuardCoversAzure (0.00s) --- PASS: TestRemoteEndpointGuardCoversAzure/imds (0.00s) --- PASS: TestRemoteEndpointGuardCoversAzure/loopback (0.00s) --- PASS: TestRemoteEndpointGuardCoversAzure/private (0.00s) === RUN TestValidateReplicaTarget === RUN TestValidateReplicaTarget/embedded_path_and_query === RUN TestValidateReplicaTarget/loopback_literal === RUN TestValidateReplicaTarget/ipv6_loopback === RUN TestValidateReplicaTarget/metadata_literal === RUN TestValidateReplicaTarget/unspecified === RUN TestValidateReplicaTarget/metadata_hostname === RUN TestValidateReplicaTarget/scheme_rejected === RUN TestValidateReplicaTarget/path_rejected === RUN TestValidateReplicaTarget/query_rejected === RUN TestValidateReplicaTarget/userinfo_rejected === RUN TestValidateReplicaTarget/missing_port_literal === RUN TestValidateReplicaTarget/missing_port_hostname === RUN TestValidateReplicaTarget/empty === RUN TestValidateReplicaTarget/resolves_to_loopback === RUN TestValidateReplicaTarget/resolves_to_link-local === RUN TestValidateReplicaTarget/private_peer_literal === RUN TestValidateReplicaTarget/private_192_peer === RUN TestValidateReplicaTarget/private_peer_hostname --- PASS: TestValidateReplicaTarget (0.01s) --- PASS: TestValidateReplicaTarget/embedded_path_and_query (0.00s) --- PASS: TestValidateReplicaTarget/loopback_literal (0.00s) --- PASS: TestValidateReplicaTarget/ipv6_loopback (0.00s) --- PASS: TestValidateReplicaTarget/metadata_literal (0.00s) --- PASS: TestValidateReplicaTarget/unspecified (0.00s) --- PASS: TestValidateReplicaTarget/metadata_hostname (0.00s) --- PASS: TestValidateReplicaTarget/scheme_rejected (0.00s) --- PASS: TestValidateReplicaTarget/path_rejected (0.00s) --- PASS: TestValidateReplicaTarget/query_rejected (0.00s) --- PASS: TestValidateReplicaTarget/userinfo_rejected (0.00s) --- PASS: TestValidateReplicaTarget/missing_port_literal (0.00s) --- PASS: TestValidateReplicaTarget/missing_port_hostname (0.00s) --- PASS: TestValidateReplicaTarget/empty (0.00s) --- PASS: TestValidateReplicaTarget/resolves_to_loopback (0.00s) --- PASS: TestValidateReplicaTarget/resolves_to_link-local (0.00s) --- PASS: TestValidateReplicaTarget/private_peer_literal (0.00s) --- PASS: TestValidateReplicaTarget/private_192_peer (0.00s) --- PASS: TestValidateReplicaTarget/private_peer_hostname (0.00s) === RUN TestGuardedRemoteClientSkipsFixedHostBackends --- PASS: TestGuardedRemoteClientSkipsFixedHostBackends (0.00s) === RUN TestGuardedRemoteClientAzureBuildsGuardedClient --- PASS: TestGuardedRemoteClientAzureBuildsGuardedClient (0.01s) === RUN TestGuardedRemoteClientGuardsGcsTokenURL --- PASS: TestGuardedRemoteClientGuardsGcsTokenURL (0.00s) === RUN TestCheckGcsCredentials --- PASS: TestCheckGcsCredentials (0.00s) === RUN TestGuardedDialerLiteralBlocked --- PASS: TestGuardedDialerLiteralBlocked (0.00s) === RUN TestGuardedReplicaDialerRebind --- PASS: TestGuardedReplicaDialerRebind (0.00s) === RUN TestBuildGuardedRemoteStorageClient W1117 09:44:17.522411 gcs_storage_client.go:103 need to specify GOOGLE_CLOUD_PROJECT env variable --- PASS: TestBuildGuardedRemoteStorageClient (0.42s) === RUN TestValidateRemoteConfForLoad --- PASS: TestValidateRemoteConfForLoad (0.01s) === RUN TestGuardedPeerHTTPClientCarriesClusterTLS --- PASS: TestGuardedPeerHTTPClientCarriesClusterTLS (0.00s) === RUN TestGuardedPeerHTTPClientUploadsOverTLS --- PASS: TestGuardedPeerHTTPClientUploadsOverTLS (0.25s) === RUN TestFetchAndWriteReplicaBoundsASilentPeer --- PASS: TestFetchAndWriteReplicaBoundsASilentPeer (1.01s) === RUN TestFetchAndWriteReplicaBoundGrowsWithTheChunk --- PASS: TestFetchAndWriteReplicaBoundGrowsWithTheChunk (0.00s) === RUN TestGuardedPeerHTTPClientRejectsHTTPSDowngrade E1117 09:44:18.932447 upload_content.go:696 unmarshal https://172.24.5.35:34289/1,01637037d6?type=replicate: W1117 09:44:18.933225 upload_content.go:377 uploading 0 to https://172.24.5.35:34289/1,01637037d6?type=replicate: unmarshal https://172.24.5.35:34289/1,01637037d6?type=replicate: unexpected end of JSON input --- PASS: TestGuardedPeerHTTPClientRejectsHTTPSDowngrade (0.13s) === RUN TestBuildGuardedRemoteStorageClientReusesOneClientPerConf --- PASS: TestBuildGuardedRemoteStorageClientReusesOneClientPerConf (0.02s) === RUN TestBuildGuardedRemoteStorageClientResolvesOnlyOnAMiss --- PASS: TestBuildGuardedRemoteStorageClientResolvesOnlyOnAMiss (0.00s) === RUN TestGuardedHTTPClientBoundsConnectionsPerHost --- PASS: TestGuardedHTTPClientBoundsConnectionsPerHost (0.00s) === RUN TestBuildGuardedRemoteStorageClientGcsFileCredentialsByContent W1117 09:44:18.977325 gcs_storage_client.go:103 need to specify GOOGLE_CLOUD_PROJECT env variable W1117 09:44:18.981044 gcs_storage_client.go:103 need to specify GOOGLE_CLOUD_PROJECT env variable --- PASS: TestBuildGuardedRemoteStorageClientGcsFileCredentialsByContent (0.01s) === RUN TestBuildGuardedRemoteStorageClientS3DefaultChainByCredentials --- PASS: TestBuildGuardedRemoteStorageClientS3DefaultChainByCredentials (0.06s) === RUN TestBuildGuardedRemoteStorageClientS3EnvironmentCredentials --- PASS: TestBuildGuardedRemoteStorageClientS3EnvironmentCredentials (0.01s) === RUN TestNewGuardedHTTPClientHasDeadlines --- PASS: TestNewGuardedHTTPClientHasDeadlines (0.00s) === RUN TestSharedTransportHungRequestsFreeTheirSlots --- PASS: TestSharedTransportHungRequestsFreeTheirSlots (0.32s) === RUN TestSharedTransportStalledBodyFreesItsSlot --- PASS: TestSharedTransportStalledBodyFreesItsSlot (0.31s) === RUN TestScrubEcVolume_DedupesSplitDiskVolume I1117 09:44:19.689310 store_ec.go:261 MountEcShards 900.0 on disk ID 0 I1117 09:44:19.693149 store_ec.go:261 MountEcShards 900.1 on disk ID 1 --- PASS: TestScrubEcVolume_DedupesSplitDiskVolume (0.02s) === RUN TestScrubEcVolume_FencesOnEncodeGeneration I1117 09:44:19.707079 store_ec.go:261 MountEcShards 901.0 on disk ID 0 I1117 09:44:19.711361 store_ec.go:261 MountEcShards 901.1 on disk ID 1 --- PASS: TestScrubEcVolume_FencesOnEncodeGeneration (0.02s) === RUN TestScrubEcVolume_FencesOnGeometry I1117 09:44:19.723314 store_ec.go:261 MountEcShards 902.0 on disk ID 0 I1117 09:44:19.727310 store_ec.go:261 MountEcShards 902.1 on disk ID 1 --- PASS: TestScrubEcVolume_FencesOnGeometry (0.01s) === RUN TestScrubEcVolume_LocalReachesSiblingDisk I1117 09:44:19.739312 store_ec.go:261 MountEcShards 903.0 on disk ID 0 I1117 09:44:19.743519 store_ec.go:261 MountEcShards 903.1 on disk ID 1 --- PASS: TestScrubEcVolume_LocalReachesSiblingDisk (0.02s) === RUN TestMergeEcRuntimes_ReportsAnchorGeneration I1117 09:44:19.754781 store_ec.go:261 MountEcShards 904.0 on disk ID 0 --- PASS: TestMergeEcRuntimes_ReportsAnchorGeneration (0.01s) === RUN TestMergeEcRuntimes_NilForEmptyInput --- PASS: TestMergeEcRuntimes_NilForEmptyInput (0.00s) === RUN TestScrubVolumeSkipsVanishedVolumeAndScrubsTheRest I1117 09:44:19.762433 store.go:431 In dir /tmp/TestScrubVolumeSkipsVanishedVolumeAndScrubsTheRest982430829/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:19.764201 store.go:436 add volume 1 on disk ID 0 I1117 09:44:19.764845 volume_grpc_scrub.go:60 scrub: volume 17 is no longer mounted, skipping --- PASS: TestScrubVolumeSkipsVanishedVolumeAndScrubsTheRest (0.01s) === RUN TestScrubVolumeFailsOnExplicitlyRequestedMissingVolume I1117 09:44:19.771170 store.go:431 In dir /tmp/TestScrubVolumeFailsOnExplicitlyRequestedMissingVolume419985733/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:19.772910 store.go:436 add volume 1 on disk ID 0 --- PASS: TestScrubVolumeFailsOnExplicitlyRequestedMissingVolume (0.01s) === RUN TestScrubEcVolumeSkipsVanishedVolumeAndScrubsTheRest W1117 09:44:19.778673 ec_volume.go:425 vif file not found, using defaults, volumeId:77, filename:/tmp/TestScrubEcVolumeSkipsVanishedVolumeAndScrubsTheRest2705081964/001/ec-scrub_77.vif I1117 09:44:19.779029 store_ec.go:261 MountEcShards 77.0 on disk ID 0 I1117 09:44:19.779811 volume_grpc_scrub.go:172 ec scrub: volume 17 is no longer mounted, skipping --- PASS: TestScrubEcVolumeSkipsVanishedVolumeAndScrubsTheRest (0.01s) === RUN TestScrubEcVolumeFailsOnExplicitlyRequestedMissingVolume W1117 09:44:19.785247 ec_volume.go:425 vif file not found, using defaults, volumeId:77, filename:/tmp/TestScrubEcVolumeFailsOnExplicitlyRequestedMissingVolume2644838495/001/ec-scrub_77.vif I1117 09:44:19.785617 store_ec.go:261 MountEcShards 77.0 on disk ID 0 --- PASS: TestScrubEcVolumeFailsOnExplicitlyRequestedMissingVolume (0.01s) === RUN TestTierMoveDatFromRemote_KeepRemote_LeavesReplicaLocal I1117 09:44:19.790887 store.go:431 In dir /tmp/TestTierMoveDatFromRemote_KeepRemote_LeavesReplicaLocal2026306734/002 (disk ID 0) adds volume:71 collection: replicaPlacement:000 ttl: I1117 09:44:19.792410 store.go:436 add volume 71 on disk ID 0 I1117 09:44:19.797316 store.go:1217 UnmountVolume 71 disk_id:0 I1117 09:44:19.802641 volume_tier.go:32 volume 71 is tiered to tier_test_local_dir.default as obj-1794908659793786563 and read only I1117 09:44:19.802946 volume_loading.go:175 loading volume 71 from remote files:{backend_type:"tier_test_local_dir" backend_id:"default" key:"obj-1794908659793786563" file_size:288 modified_time:1794908659 extension:".dat"} version:3 bytes_offset:4 I1117 09:44:19.807453 needle_map_sorted_file.go:40 Start to Generate /tmp/TestTierMoveDatFromRemote_KeepRemote_LeavesReplicaLocal2026306734/002/71.sdx from /tmp/TestTierMoveDatFromRemote_KeepRemote_LeavesReplicaLocal2026306734/002/71.idx I1117 09:44:19.826426 needle_map_sorted_file.go:42 Finished Generating /tmp/TestTierMoveDatFromRemote_KeepRemote_LeavesReplicaLocal2026306734/002/71.sdx from /tmp/TestTierMoveDatFromRemote_KeepRemote_LeavesReplicaLocal2026306734/002/71.idx I1117 09:44:19.833465 store.go:1217 UnmountVolume 71 disk_id:0 I1117 09:44:19.836016 store.go:1149 mount volume 71 --- PASS: TestTierMoveDatFromRemote_KeepRemote_LeavesReplicaLocal (0.05s) === RUN TestTierMoveConcurrencyPlumbing I1117 09:44:19.841191 store.go:431 In dir /tmp/TestTierMoveConcurrencyPlumbing3129633891/002 (disk ID 0) adds volume:72 collection: replicaPlacement:000 ttl: I1117 09:44:19.842665 store.go:436 add volume 72 on disk ID 0 I1117 09:44:19.844904 store.go:1217 UnmountVolume 72 disk_id:0 I1117 09:44:19.848437 volume_tier.go:32 volume 72 is tiered to tier_test_local_dir.default as obj-1794908659843544591 and read only I1117 09:44:19.848603 volume_loading.go:175 loading volume 72 from remote files:{backend_type:"tier_test_local_dir" backend_id:"default" key:"obj-1794908659843544591" file_size:288 modified_time:1794908659 extension:".dat"} version:3 bytes_offset:4 I1117 09:44:19.849859 needle_map_sorted_file.go:40 Start to Generate /tmp/TestTierMoveConcurrencyPlumbing3129633891/002/72.sdx from /tmp/TestTierMoveConcurrencyPlumbing3129633891/002/72.idx I1117 09:44:19.861711 needle_map_sorted_file.go:42 Finished Generating /tmp/TestTierMoveConcurrencyPlumbing3129633891/002/72.sdx from /tmp/TestTierMoveConcurrencyPlumbing3129633891/002/72.idx --- PASS: TestTierMoveConcurrencyPlumbing (0.03s) === RUN TestVolumeTierMoveDatPreservesModifiedTime I1117 09:44:19.871565 store.go:431 In dir /tmp/TestVolumeTierMoveDatPreservesModifiedTime3886412225/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:19.873375 store.go:436 add volume 1 on disk ID 0 --- PASS: TestVolumeTierMoveDatPreservesModifiedTime (0.01s) === RUN TestTierUploadRefusesADatWrittenDuringTheCopy I1117 09:44:19.882850 store.go:431 In dir /tmp/TestTierUploadRefusesADatWrittenDuringTheCopy2089688868/002 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:19.884339 store.go:436 add volume 1 on disk ID 0 --- PASS: TestTierUploadRefusesADatWrittenDuringTheCopy (0.02s) === RUN TestTierUploadRefusesADatReplacedByACompactionCommit I1117 09:44:19.898974 store.go:431 In dir /tmp/TestTierUploadRefusesADatReplacedByACompactionCommit1726318779/002 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:19.900652 store.go:436 add volume 1 on disk ID 0 I1117 09:44:19.929395 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestTierUploadRefusesADatReplacedByACompactionCommit1726318779/002/1.cpx I1117 09:44:19.933216 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:44:19.939859 volume_loading.go:312 open to read file /tmp/TestTierUploadRefusesADatReplacedByACompactionCommit1726318779/002/1.idx I1117 09:44:19.940592 needle_map_sorted_file.go:40 Start to Generate /tmp/TestTierUploadRefusesADatReplacedByACompactionCommit1726318779/002/1.sdx from /tmp/TestTierUploadRefusesADatReplacedByACompactionCommit1726318779/002/1.idx I1117 09:44:19.960217 needle_map_sorted_file.go:42 Finished Generating /tmp/TestTierUploadRefusesADatReplacedByACompactionCommit1726318779/002/1.sdx from /tmp/TestTierUploadRefusesADatReplacedByACompactionCommit1726318779/002/1.idx --- PASS: TestTierUploadRefusesADatReplacedByACompactionCommit (0.07s) === RUN TestTierUploadAcceptsDeletesOnASingleCopyVolume I1117 09:44:19.968888 store.go:431 In dir /tmp/TestTierUploadAcceptsDeletesOnASingleCopyVolume3078365091/002 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:19.970589 store.go:436 add volume 1 on disk ID 0 --- PASS: TestTierUploadAcceptsDeletesOnASingleCopyVolume (0.01s) === RUN TestTierUploadKeepsRefusingDeletesOnAReplicatedVolume I1117 09:44:19.978566 store.go:431 In dir /tmp/TestTierUploadKeepsRefusingDeletesOnAReplicatedVolume1226317513/002 (disk ID 0) adds volume:1 collection: replicaPlacement:001 ttl: I1117 09:44:19.980057 store.go:436 add volume 1 on disk ID 0 --- PASS: TestTierUploadKeepsRefusingDeletesOnAReplicatedVolume (0.01s) === RUN TestVacuumCommitSlotsBoundConcurrentCommits --- PASS: TestVacuumCommitSlotsBoundConcurrentCommits (0.06s) === RUN TestVacuumCommitSlotsUnlimitedByDefault --- PASS: TestVacuumCommitSlotsUnlimitedByDefault (0.00s) === RUN TestVacuumCommitSlotNotGrantedToExpiredContext --- PASS: TestVacuumCommitSlotNotGrantedToExpiredContext (0.01s) === RUN TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone I1117 09:44:20.056947 store.go:431 In dir /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:20.058970 store.go:436 add volume 1 on disk ID 0 I1117 09:44:20.060238 store.go:431 In dir /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/001 (disk ID 0) adds volume:2 collection: replicaPlacement:000 ttl: I1117 09:44:20.061735 store.go:436 add volume 2 on disk ID 0 I1117 09:44:20.063057 store.go:431 In dir /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/001 (disk ID 0) adds volume:3 collection: replicaPlacement:000 ttl: I1117 09:44:20.064610 store.go:436 add volume 3 on disk ID 0 I1117 09:44:20.065602 store.go:431 In dir /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/001 (disk ID 0) adds volume:4 collection: replicaPlacement:000 ttl: I1117 09:44:20.067092 store.go:436 add volume 4 on disk ID 0 I1117 09:44:20.071068 store.go:431 In dir /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/002 (disk ID 0) adds volume:9 collection: replicaPlacement:000 ttl: I1117 09:44:20.074074 store.go:436 add volume 9 on disk ID 0 I1117 09:44:20.104997 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/001/2.cpx I1117 09:44:20.105022 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/001/3.cpx I1117 09:44:20.105185 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/001/4.cpx I1117 09:44:20.106268 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/001/1.cpx I1117 09:44:20.141832 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone3653599206/002/9.cpx I1117 09:44:20.144491 volume_vacuum.go:184 Committing volume 9 vacuuming... --- PASS: TestVacuumCommitLimitLeavesCompactionAndOtherServersAlone (0.10s) === RUN TestQueuedVacuumCommitHoldsNoVolumeLockAndHonoursDeadline I1117 09:44:20.158097 store.go:431 In dir /tmp/TestQueuedVacuumCommitHoldsNoVolumeLockAndHonoursDeadline1130325192/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:20.161514 store.go:436 add volume 1 on disk ID 0 I1117 09:44:20.184610 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestQueuedVacuumCommitHoldsNoVolumeLockAndHonoursDeadline1130325192/001/1.cpx W1117 09:44:20.207745 volume_grpc_vacuum.go:102 commit volume 1 not started: context deadline exceeded I1117 09:44:20.208336 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestQueuedVacuumCommitHoldsNoVolumeLockAndHonoursDeadline (0.06s) === RUN TestVacuumCommitReleasesSlotOnError E1117 09:44:20.216902 volume_grpc_vacuum.go:123 failed commit volume 42: volume id 42 is not found during commit compact: volume not found --- PASS: TestVacuumCommitReleasesSlotOnError (0.00s) === RUN TestQueuedVacuumCommitDoesNotStartInMaintenanceMode I1117 09:44:20.221686 store.go:431 In dir /tmp/TestQueuedVacuumCommitDoesNotStartInMaintenanceMode4166214854/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:20.223613 store.go:436 add volume 1 on disk ID 0 I1117 09:44:20.252577 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestQueuedVacuumCommitDoesNotStartInMaintenanceMode4166214854/001/1.cpx --- PASS: TestQueuedVacuumCommitDoesNotStartInMaintenanceMode (0.04s) === RUN TestParseRange === RUN TestParseRange/start_within_bounds === RUN TestParseRange/start_at_last_valid_byte === RUN TestParseRange/start_equal_to_size_is_not_satisfiable === RUN TestParseRange/start_past_size_is_not_satisfiable === RUN TestParseRange/start_with_explicit_end_within_bounds === RUN TestParseRange/end_clamped_to_the_last_byte === RUN TestParseRange/suffix_range_within_bounds === RUN TestParseRange/zero-length_suffix_range_is_not_satisfiable === RUN TestParseRange/zero-length_suffix_beside_a_satisfiable_range_is_skipped === RUN TestParseRange/suffix_range_larger_than_size_is_clamped,_not_rejected === RUN TestParseRange/negative_suffix_length_is_invalid === RUN TestParseRange/negative_zero_suffix_length_is_invalid === RUN TestParseRange/empty_suffix_length_is_invalid --- PASS: TestParseRange (0.01s) --- PASS: TestParseRange/start_within_bounds (0.00s) --- PASS: TestParseRange/start_at_last_valid_byte (0.00s) --- PASS: TestParseRange/start_equal_to_size_is_not_satisfiable (0.00s) --- PASS: TestParseRange/start_past_size_is_not_satisfiable (0.00s) --- PASS: TestParseRange/start_with_explicit_end_within_bounds (0.00s) --- PASS: TestParseRange/end_clamped_to_the_last_byte (0.00s) --- PASS: TestParseRange/suffix_range_within_bounds (0.00s) --- PASS: TestParseRange/zero-length_suffix_range_is_not_satisfiable (0.00s) --- PASS: TestParseRange/zero-length_suffix_beside_a_satisfiable_range_is_skipped (0.00s) --- PASS: TestParseRange/suffix_range_larger_than_size_is_clamped,_not_rejected (0.00s) --- PASS: TestParseRange/negative_suffix_length_is_invalid (0.00s) --- PASS: TestParseRange/negative_zero_suffix_length_is_invalid (0.00s) --- PASS: TestParseRange/empty_suffix_length_is_invalid (0.00s) === RUN TestParseRangeOnEmptyFile --- PASS: TestParseRangeOnEmptyFile (0.00s) === RUN TestInternalErrorWritesTheReadError I1117 09:44:20.267766 common.go:111 response method:GET URL:/1,abc with httpStatus:500 and JSON:{"error":"invalid CRC for needle 2a (got 0a1b2c3d, want 4e5f6071), data on disk corrupted: needle data corrupted"} I1117 09:44:20.268867 volume_server_handlers_read.go:52 response method:HEAD URL:/1,abc with httpStatus:500 and error:invalid CRC for needle 2a (got 0a1b2c3d, want 4e5f6071), data on disk corrupted: needle data corrupted --- PASS: TestInternalErrorWritesTheReadError (0.00s) === RUN TestShouldAttemptStreamWrite --- PASS: TestShouldAttemptStreamWrite (0.00s) === RUN TestNotModifiedChecksIfNoneMatchFirst === RUN TestNotModifiedChecksIfNoneMatchFirst/matching_etag === RUN TestNotModifiedChecksIfNoneMatchFirst/weak_etag === RUN TestNotModifiedChecksIfNoneMatchFirst/etag_in_a_list === RUN TestNotModifiedChecksIfNoneMatchFirst/star === RUN TestNotModifiedChecksIfNoneMatchFirst/other_etag === RUN TestNotModifiedChecksIfNoneMatchFirst/etag_across_repeated_lines === RUN TestNotModifiedChecksIfNoneMatchFirst/comma_inside_quotes === RUN TestNotModifiedChecksIfNoneMatchFirst/other_etag_ignores_If-Modified-Since === RUN TestNotModifiedChecksIfNoneMatchFirst/empty_If-None-Match_ignores_If-Modified-Since === RUN TestNotModifiedChecksIfNoneMatchFirst/not_modified_since === RUN TestNotModifiedChecksIfNoneMatchFirst/modified_since --- PASS: TestNotModifiedChecksIfNoneMatchFirst (0.01s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/matching_etag (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/weak_etag (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/etag_in_a_list (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/star (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/other_etag (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/etag_across_repeated_lines (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/comma_inside_quotes (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/other_etag_ignores_If-Modified-Since (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/empty_If-None-Match_ignores_If-Modified-Since (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/not_modified_since (0.00s) --- PASS: TestNotModifiedChecksIfNoneMatchFirst/modified_since (0.00s) === RUN TestProxyReqToTargetServerPreservesMethodAndResponse === RUN TestProxyReqToTargetServerPreservesMethodAndResponse/GET === RUN TestProxyReqToTargetServerPreservesMethodAndResponse/HEAD --- PASS: TestProxyReqToTargetServerPreservesMethodAndResponse (0.04s) --- PASS: TestProxyReqToTargetServerPreservesMethodAndResponse/GET (0.02s) --- PASS: TestProxyReqToTargetServerPreservesMethodAndResponse/HEAD (0.01s) === RUN TestProxyReqToTargetServerCancelsUpstreamWithInboundRequest --- PASS: TestProxyReqToTargetServerCancelsUpstreamWithInboundRequest (0.02s) === RUN TestProxyReqToTargetServerCancelsUpstreamBodyReadWithInboundRequest --- PASS: TestProxyReqToTargetServerCancelsUpstreamBodyReadWithInboundRequest (0.02s) === RUN TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation === RUN TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation/cancelled_request_skips_the_lookup_error_response === RUN TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation/master_lookup_failure_is_internal_error I1117 09:44:20.373140 volume_server_handlers_read.go:94 lookup error: rpc error: code = Unavailable desc = master unavailable /849300103,abcdef === RUN TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation/lookup_returned_no_replica_locations I1117 09:44:20.383313 volume_server_handlers_read.go:99 lookup error: /849300104,abcdef === RUN TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation/only_local_replica_is_not_a_usable_proxy_target E1117 09:44:20.394468 volume_server_handlers_read.go:124 failed lookup target host is empty locations: [{Url:192.0.2.10:8080 PublicUrl: DataCenter: GrpcPort:0 DataInRemote:false ReadOnly:false ReadOnlyCanDelete:false}], 192.0.2.10:8080 --- PASS: TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation (0.04s) --- PASS: TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation/cancelled_request_skips_the_lookup_error_response (0.01s) --- PASS: TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation/master_lookup_failure_is_internal_error (0.01s) --- PASS: TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation/lookup_returned_no_replica_locations (0.01s) --- PASS: TestProxyReqToTargetServerDistinguishesLookupFailureFromNoLocation/only_local_replica_is_not_a_usable_proxy_target (0.01s) === RUN TestGetOrHeadHandlerDoesNotReproxyAProxiedRequest I1117 09:44:20.400892 volume_server_handlers_read.go:237 volume is not local: /849300106,01637037d6 --- PASS: TestGetOrHeadHandlerDoesNotReproxyAProxiedRequest (0.00s) === RUN TestDeleteHandlerCancelsAWriteInItsFsyncWindow === RUN TestDeleteHandlerCancelsAWriteInItsFsyncWindow/?type=replicate I1117 09:44:20.407651 store.go:431 In dir /tmp/TestDeleteHandlerCancelsAWriteInItsFsyncWindowtype=replicate365801868/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:20.410491 store.go:436 add volume 1 on disk ID 0 I1117 09:44:20.416137 common.go:111 response method:DELETE URL:/1,0100001234?type=replicate with httpStatus:404 and JSON:{"size":0} === RUN TestDeleteHandlerCancelsAWriteInItsFsyncWindow/#00 I1117 09:44:20.422247 store.go:431 In dir /tmp/TestDeleteHandlerCancelsAWriteInItsFsyncWindow#001215288998/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:20.424048 store.go:436 add volume 1 on disk ID 0 I1117 09:44:20.426839 common.go:111 response method:DELETE URL:/1,0100001234 with httpStatus:404 and JSON:{"size":0} --- PASS: TestDeleteHandlerCancelsAWriteInItsFsyncWindow (0.03s) --- PASS: TestDeleteHandlerCancelsAWriteInItsFsyncWindow/?type=replicate (0.02s) --- PASS: TestDeleteHandlerCancelsAWriteInItsFsyncWindow/#00 (0.01s) === RUN TestBatchDeleteCancelsAWriteInItsFsyncWindow === RUN TestBatchDeleteCancelsAWriteInItsFsyncWindow/#00 I1117 09:44:20.432188 store.go:431 In dir /tmp/TestBatchDeleteCancelsAWriteInItsFsyncWindow#001137535658/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:20.433909 store.go:436 add volume 1 on disk ID 0 === RUN TestBatchDeleteCancelsAWriteInItsFsyncWindow/00004321 I1117 09:44:20.536069 store.go:431 In dir /tmp/TestBatchDeleteCancelsAWriteInItsFsyncWindow000043214117723958/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:44:20.537876 store.go:436 add volume 1 on disk ID 0 --- PASS: TestBatchDeleteCancelsAWriteInItsFsyncWindow (0.16s) --- PASS: TestBatchDeleteCancelsAWriteInItsFsyncWindow/#00 (0.10s) --- PASS: TestBatchDeleteCancelsAWriteInItsFsyncWindow/00004321 (0.06s) === RUN TestPostHandlerForwardsAContentMd5TheReplicaAccepts I1117 09:44:20.595402 store.go:431 In dir /tmp/TestPostHandlerForwardsAContentMd5TheReplicaAccepts595638794/001 (disk ID 0) adds volume:849300201 collection: replicaPlacement:001 ttl: I1117 09:44:20.597120 store.go:436 add volume 849300201 on disk ID 0 I1117 09:44:20.601815 store.go:431 In dir /tmp/TestPostHandlerForwardsAContentMd5TheReplicaAccepts595638794/002 (disk ID 0) adds volume:849300201 collection: replicaPlacement:001 ttl: I1117 09:44:20.603866 store.go:436 add volume 849300201 on disk ID 0 === RUN TestPostHandlerForwardsAContentMd5TheReplicaAccepts/rotated === RUN TestPostHandlerForwardsAContentMd5TheReplicaAccepts/unchanged_jpeg === RUN TestPostHandlerForwardsAContentMd5TheReplicaAccepts/not_a_jpeg === RUN TestPostHandlerForwardsAContentMd5TheReplicaAccepts/fix_off --- PASS: TestPostHandlerForwardsAContentMd5TheReplicaAccepts (0.10s) --- PASS: TestPostHandlerForwardsAContentMd5TheReplicaAccepts/rotated (0.04s) --- PASS: TestPostHandlerForwardsAContentMd5TheReplicaAccepts/unchanged_jpeg (0.01s) --- PASS: TestPostHandlerForwardsAContentMd5TheReplicaAccepts/not_a_jpeg (0.01s) --- PASS: TestPostHandlerForwardsAContentMd5TheReplicaAccepts/fix_off (0.01s) === RUN TestDeleteHandlerRejectsOverflowingNeedleDelta I1117 09:44:20.688576 common.go:111 response method:DELETE URL:/1,ffffffffffffffff00000000_1 with httpStatus:400 and JSON:{"error":"delta 1 overflows needle id 66666666666666666666666666666666"} --- PASS: TestDeleteHandlerRejectsOverflowingNeedleDelta (0.00s) === RUN TestBatchDeleteRejectsOverflowingNeedleDelta --- PASS: TestBatchDeleteRejectsOverflowingNeedleDelta (0.00s) === RUN TestQueryRejectsOverflowingNeedleDelta I1117 09:44:20.690509 volume_grpc_query.go:25 volume query failed to parse fid 1,ffffffffffffffff00000000_1: delta 1 overflows needle id 66666666666666666666666666666666 --- PASS: TestQueryRejectsOverflowingNeedleDelta (0.00s) === RUN TestListedEntriesTrailingSlash --- PASS: TestListedEntriesTrailingSlash (0.00s) === RUN TestListedEntriesWithoutCache --- PASS: TestListedEntriesWithoutCache (0.00s) === RUN TestListedEntriesCap --- PASS: TestListedEntriesCap (0.67s) === RUN TestListedEntriesPerRequest --- PASS: TestListedEntriesPerRequest (0.00s) === RUN TestToFileInfoName --- PASS: TestToFileInfoName (0.00s) === RUN TestToFileInfoRootIsDirectory --- PASS: TestToFileInfoRootIsDirectory (0.00s) === RUN TestFileInfoETag --- PASS: TestFileInfoETag (0.00s) === RUN TestWebDavFile_Read_ManifestResolveFailure E1117 09:44:21.381880 filechunk_manifest.go:384 operation LookupFileId 1,1679011dc64abd40 failed, err: volume 1 not found for fileId 1,1679011dc64abd40: volume 1 not found --- PASS: TestWebDavFile_Read_ManifestResolveFailure (0.02s) === RUN TestWebDavFile_Read_InlineContent --- PASS: TestWebDavFile_Read_InlineContent (0.00s) === RUN TestWebDavFileSystem_Mkdir_EntryName --- PASS: TestWebDavFileSystem_Mkdir_EntryName (0.02s) === RUN TestWebDavFileSystem_MissingParent --- PASS: TestWebDavFileSystem_MissingParent (0.02s) === RUN TestWebDavFileSystem_OverwriteKeepsTargetOnParentFailure --- PASS: TestWebDavFileSystem_OverwriteKeepsTargetOnParentFailure (0.01s) === RUN TestWebDavFileSystem_RemoveAll_Recursive --- PASS: TestWebDavFileSystem_RemoveAll_Recursive (0.02s) === RUN TestCopyMoveGuardHandler --- PASS: TestCopyMoveGuardHandler (0.01s) === RUN TestCopyMoveGuardHandler_MissingDestParent --- PASS: TestCopyMoveGuardHandler_MissingDestParent (0.00s) === RUN TestCopyMoveGuardHandler_FileOntoCollectionURL --- PASS: TestCopyMoveGuardHandler_FileOntoCollectionURL (0.00s) === RUN TestCopyMoveGuardHandler_FileOntoCollection_EndToEnd --- PASS: TestCopyMoveGuardHandler_FileOntoCollection_EndToEnd (0.01s) === RUN TestCopyMoveGuardHandler_MoveWithoutOverwriteHeader --- PASS: TestCopyMoveGuardHandler_MoveWithoutOverwriteHeader (0.00s) === RUN TestCopyMoveGuardHandler_MoveEmptyOverwriteValue --- PASS: TestCopyMoveGuardHandler_MoveEmptyOverwriteValue (0.00s) === RUN TestCopyMoveGuardHandler_MoveDirOntoNonEmptyDir --- PASS: TestCopyMoveGuardHandler_MoveDirOntoNonEmptyDir (0.00s) === RUN TestCopyMoveGuardHandler_MoveDirOntoEmptyDirKeepsDestinationOnFailure --- PASS: TestCopyMoveGuardHandler_MoveDirOntoEmptyDirKeepsDestinationOnFailure (0.00s) === RUN TestCopyMoveGuardHandler_MoveDirOntoNonEmptyDirRestoresOnRenameFailure --- PASS: TestCopyMoveGuardHandler_MoveDirOntoNonEmptyDirRestoresOnRenameFailure (0.00s) === RUN TestDeferredDeleteFS_RestoreSurvivesCanceledContext --- PASS: TestDeferredDeleteFS_RestoreSurvivesCanceledContext (0.00s) === RUN TestCopyMoveGuardHandler_MoveKeepsDestinationOnRenameFailure --- PASS: TestCopyMoveGuardHandler_MoveKeepsDestinationOnRenameFailure (0.00s) === RUN TestWebDavFileSystem_OpenFile_DoesNotReplaceFolder --- PASS: TestWebDavFileSystem_OpenFile_DoesNotReplaceFolder (0.01s) === RUN TestCopyMoveGuardHandler_PutStatus --- PASS: TestCopyMoveGuardHandler_PutStatus (0.00s) === RUN TestWebDavFileSystem_OpenFile_PutOutcomeFlag --- PASS: TestWebDavFileSystem_OpenFile_PutOutcomeFlag (0.01s) === RUN TestWebDavFileSystem_Rename_FileOntoSlashedPath --- PASS: TestWebDavFileSystem_Rename_FileOntoSlashedPath (0.02s) === RUN TestWebDavFileSystem_Rename_MissingDestParent --- PASS: TestWebDavFileSystem_Rename_MissingDestParent (0.02s) === RUN TestWrappedFsConfine --- PASS: TestWrappedFsConfine (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/server 228.264s ? github.com/seaweedfs/seaweedfs/weed/server/constants [no test files] === RUN TestToBreadcrumb === RUN TestToBreadcrumb/empty === RUN TestToBreadcrumb/test1 === RUN TestToBreadcrumb/test2 === RUN TestToBreadcrumb/test3 --- PASS: TestToBreadcrumb (0.02s) --- PASS: TestToBreadcrumb/empty (0.01s) --- PASS: TestToBreadcrumb/test1 (0.00s) --- PASS: TestToBreadcrumb/test2 (0.00s) --- PASS: TestToBreadcrumb/test3 (0.00s) === RUN TestPrintPathPreservesPathSafeTimestampChars --- PASS: TestPrintPathPreservesPathSafeTimestampChars (0.00s) === RUN TestQueryEscapePreservesPlusInLoadMoreCursor --- PASS: TestQueryEscapePreservesPlusInLoadMoreCursor (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/server/filer_ui 0.906s ? github.com/seaweedfs/seaweedfs/weed/server/master_ui [no test files] === RUN TestStartupRejectsFailedAuthentication === RUN TestStartupRejectsFailedAuthentication/password_wrong === RUN TestStartupRejectsFailedAuthentication/password_unknown_user === RUN TestStartupRejectsFailedAuthentication/md5_wrong === RUN TestStartupRejectsFailedAuthentication/md5_unknown_user --- PASS: TestStartupRejectsFailedAuthentication (0.08s) --- PASS: TestStartupRejectsFailedAuthentication/password_wrong (0.02s) --- PASS: TestStartupRejectsFailedAuthentication/password_unknown_user (0.01s) --- PASS: TestStartupRejectsFailedAuthentication/md5_wrong (0.01s) --- PASS: TestStartupRejectsFailedAuthentication/md5_unknown_user (0.01s) === RUN TestStartupAcceptsValidPassword --- PASS: TestStartupAcceptsValidPassword (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/server/postgres 3.462s === RUN TestStatusTpl --- PASS: TestStatusTpl (0.10s) PASS ok github.com/seaweedfs/seaweedfs/weed/server/volume_server_ui 0.994s === RUN TestCopyExistingContentFillsSparseGaps --- PASS: TestCopyExistingContentFillsSparseGaps (0.47s) === RUN TestCopyExistingContentRejectsUnreadableEntry --- PASS: TestCopyExistingContentRejectsUnreadableEntry (0.08s) === RUN TestCopyExistingContentIgnoresStaleRemoteSize --- PASS: TestCopyExistingContentIgnoresStaleRemoteSize (0.17s) === RUN TestCopyExistingContentAllHoles --- PASS: TestCopyExistingContentAllHoles (0.05s) === RUN TestCopyExistingContentInlineAndMissing --- PASS: TestCopyExistingContentInlineAndMissing (0.07s) === RUN TestCopyExistingContentTrailingGap --- PASS: TestCopyExistingContentTrailingGap (0.06s) === RUN TestRequireParentDir --- PASS: TestRequireParentDir (0.06s) === RUN TestRequireEntry --- PASS: TestRequireEntry (0.04s) === RUN TestPutFileEscapesQueryInjection --- PASS: TestPutFileEscapesQueryInjection (0.07s) === RUN TestListAllPagesReturnsStreamError I1117 09:40:38.811221 sftp_permissions.go:116 permission denied for user alice on path /d/f00000 for permission list --- PASS: TestListAllPagesReturnsStreamError (0.13s) === RUN TestListAllPagesContinuesPastHiddenEntries I1117 09:40:39.033151 sftp_permissions.go:116 permission denied for user alice on path /d/f00000 for permission list --- PASS: TestListAllPagesContinuesPastHiddenEntries (8.22s) === RUN TestListAllPagesContinuesPastFullyHiddenPage I1117 09:40:47.188352 sftp_permissions.go:116 permission denied for user alice on path /d/f00000 for permission list I1117 09:40:47.207303 sftp_permissions.go:116 permission denied for user alice on path /d/f00001 for permission list I1117 09:40:47.250722 sftp_permissions.go:116 permission denied for user alice on path /d/f00002 for permission list I1117 09:40:47.280751 sftp_permissions.go:116 permission denied for user alice on path /d/f00003 for permission list I1117 09:40:47.329713 sftp_permissions.go:116 permission denied for user alice on path /d/f00004 for permission list I1117 09:40:47.343761 sftp_permissions.go:116 permission denied for user alice on path /d/f00005 for permission list I1117 09:40:47.371057 sftp_permissions.go:116 permission denied for user alice on path /d/f00006 for permission list I1117 09:40:47.396749 sftp_permissions.go:116 permission denied for user alice on path /d/f00007 for permission list I1117 09:40:47.424658 sftp_permissions.go:116 permission denied for user alice on path /d/f00008 for permission list I1117 09:40:47.440730 sftp_permissions.go:116 permission denied for user alice on path /d/f00009 for permission list I1117 09:40:47.457147 sftp_permissions.go:116 permission denied for user alice on path /d/f00010 for permission list I1117 09:40:47.470671 sftp_permissions.go:116 permission denied for user alice on path /d/f00011 for permission list I1117 09:40:47.483834 sftp_permissions.go:116 permission denied for user alice on path /d/f00012 for permission list I1117 09:40:47.498435 sftp_permissions.go:116 permission denied for user alice on path /d/f00013 for permission list I1117 09:40:47.513184 sftp_permissions.go:116 permission denied for user alice on path /d/f00014 for permission list I1117 09:40:47.533432 sftp_permissions.go:116 permission denied for user alice on path /d/f00015 for permission list I1117 09:40:47.549291 sftp_permissions.go:116 permission denied for user alice on path /d/f00016 for permission list I1117 09:40:47.563688 sftp_permissions.go:116 permission denied for user alice on path /d/f00017 for permission list I1117 09:40:47.577825 sftp_permissions.go:116 permission denied for user alice on path /d/f00018 for permission list I1117 09:40:47.593398 sftp_permissions.go:116 permission denied for user alice on path /d/f00019 for permission list I1117 09:40:47.610574 sftp_permissions.go:116 permission denied for user alice on path /d/f00020 for permission list I1117 09:40:47.629560 sftp_permissions.go:116 permission denied for user alice on path /d/f00021 for permission list I1117 09:40:47.645630 sftp_permissions.go:116 permission denied for user alice on path /d/f00022 for permission list I1117 09:40:47.661113 sftp_permissions.go:116 permission denied for user alice on path /d/f00023 for permission list I1117 09:40:47.681492 sftp_permissions.go:116 permission denied for user alice on path /d/f00024 for permission list I1117 09:40:47.699718 sftp_permissions.go:116 permission denied for user alice on path /d/f00025 for permission list I1117 09:40:47.716086 sftp_permissions.go:116 permission denied for user alice on path /d/f00026 for permission list I1117 09:40:47.733190 sftp_permissions.go:116 permission denied for user alice on path /d/f00027 for permission list I1117 09:40:47.757197 sftp_permissions.go:116 permission denied for user alice on path /d/f00028 for permission list I1117 09:40:47.778065 sftp_permissions.go:116 permission denied for user alice on path /d/f00029 for permission list I1117 09:40:47.795197 sftp_permissions.go:116 permission denied for user alice on path /d/f00030 for permission list I1117 09:40:47.812002 sftp_permissions.go:116 permission denied for user alice on path /d/f00031 for permission list I1117 09:40:47.828707 sftp_permissions.go:116 permission denied for user alice on path /d/f00032 for permission list I1117 09:40:47.844651 sftp_permissions.go:116 permission denied for user alice on path /d/f00033 for permission list I1117 09:40:47.863803 sftp_permissions.go:116 permission denied for user alice on path /d/f00034 for permission list I1117 09:40:47.880979 sftp_permissions.go:116 permission denied for user alice on path /d/f00035 for permission list I1117 09:40:47.899862 sftp_permissions.go:116 permission denied for user alice on path /d/f00036 for permission list I1117 09:40:47.918437 sftp_permissions.go:116 permission denied for user alice on path /d/f00037 for permission list I1117 09:40:47.938093 sftp_permissions.go:116 permission denied for user alice on path /d/f00038 for permission list I1117 09:40:47.954160 sftp_permissions.go:116 permission denied for user alice on path /d/f00039 for permission list I1117 09:40:47.971177 sftp_permissions.go:116 permission denied for user alice on path /d/f00040 for permission list I1117 09:40:47.989015 sftp_permissions.go:116 permission denied for user alice on path /d/f00041 for permission list I1117 09:40:48.004109 sftp_permissions.go:116 permission denied for user alice on path /d/f00042 for permission list I1117 09:40:48.020060 sftp_permissions.go:116 permission denied for user alice on path /d/f00043 for permission list I1117 09:40:48.036229 sftp_permissions.go:116 permission denied for user alice on path /d/f00044 for permission list I1117 09:40:48.049920 sftp_permissions.go:116 permission denied for user alice on path /d/f00045 for permission list I1117 09:40:48.065014 sftp_permissions.go:116 permission denied for user alice on path /d/f00046 for permission list I1117 09:40:48.079018 sftp_permissions.go:116 permission denied for user alice on path /d/f00047 for permission list I1117 09:40:48.094384 sftp_permissions.go:116 permission denied for user alice on path /d/f00048 for permission list I1117 09:40:48.107827 sftp_permissions.go:116 permission denied for user alice on path /d/f00049 for permission list I1117 09:40:48.121529 sftp_permissions.go:116 permission denied for user alice on path /d/f00050 for permission list I1117 09:40:48.134702 sftp_permissions.go:116 permission denied for user alice on path /d/f00051 for permission list I1117 09:40:48.148940 sftp_permissions.go:116 permission denied for user alice on path /d/f00052 for permission list I1117 09:40:48.164020 sftp_permissions.go:116 permission denied for user alice on path /d/f00053 for permission list I1117 09:40:48.184381 sftp_permissions.go:116 permission denied for user alice on path /d/f00054 for permission list I1117 09:40:48.203673 sftp_permissions.go:116 permission denied for user alice on path /d/f00055 for permission list I1117 09:40:48.224255 sftp_permissions.go:116 permission denied for user alice on path /d/f00056 for permission list I1117 09:40:48.248124 sftp_permissions.go:116 permission denied for user alice on path /d/f00057 for permission list I1117 09:40:48.268990 sftp_permissions.go:116 permission denied for user alice on path /d/f00058 for permission list I1117 09:40:48.288290 sftp_permissions.go:116 permission denied for user alice on path /d/f00059 for permission list I1117 09:40:48.302386 sftp_permissions.go:116 permission denied for user alice on path /d/f00060 for permission list I1117 09:40:48.318944 sftp_permissions.go:116 permission denied for user alice on path /d/f00061 for permission list I1117 09:40:48.334687 sftp_permissions.go:116 permission denied for user alice on path /d/f00062 for permission list I1117 09:40:48.349995 sftp_permissions.go:116 permission denied for user alice on path /d/f00063 for permission list I1117 09:40:48.365816 sftp_permissions.go:116 permission denied for user alice on path /d/f00064 for permission list I1117 09:40:48.380862 sftp_permissions.go:116 permission denied for user alice on path /d/f00065 for permission list I1117 09:40:48.395840 sftp_permissions.go:116 permission denied for user alice on path /d/f00066 for permission list I1117 09:40:48.409823 sftp_permissions.go:116 permission denied for user alice on path /d/f00067 for permission list I1117 09:40:48.427339 sftp_permissions.go:116 permission denied for user alice on path /d/f00068 for permission list I1117 09:40:48.441793 sftp_permissions.go:116 permission denied for user alice on path /d/f00069 for permission list I1117 09:40:48.456260 sftp_permissions.go:116 permission denied for user alice on path /d/f00070 for permission list I1117 09:40:48.471852 sftp_permissions.go:116 permission denied for user alice on path /d/f00071 for permission list I1117 09:40:48.487084 sftp_permissions.go:116 permission denied for user alice on path /d/f00072 for permission list I1117 09:40:48.500923 sftp_permissions.go:116 permission denied for user alice on path /d/f00073 for permission list I1117 09:40:48.517434 sftp_permissions.go:116 permission denied for user alice on path /d/f00074 for permission list I1117 09:40:48.532868 sftp_permissions.go:116 permission denied for user alice on path /d/f00075 for permission list I1117 09:40:48.548601 sftp_permissions.go:116 permission denied for user alice on path /d/f00076 for permission list I1117 09:40:48.562606 sftp_permissions.go:116 permission denied for user alice on path /d/f00077 for permission list I1117 09:40:48.576882 sftp_permissions.go:116 permission denied for user alice on path /d/f00078 for permission list I1117 09:40:48.591540 sftp_permissions.go:116 permission denied for user alice on path /d/f00079 for permission list I1117 09:40:48.607389 sftp_permissions.go:116 permission denied for user alice on path /d/f00080 for permission list I1117 09:40:48.624229 sftp_permissions.go:116 permission denied for user alice on path /d/f00081 for permission list I1117 09:40:48.640619 sftp_permissions.go:116 permission denied for user alice on path /d/f00082 for permission list I1117 09:40:48.655932 sftp_permissions.go:116 permission denied for user alice on path /d/f00083 for permission list I1117 09:40:48.673720 sftp_permissions.go:116 permission denied for user alice on path /d/f00084 for permission list I1117 09:40:48.689432 sftp_permissions.go:116 permission denied for user alice on path /d/f00085 for permission list I1117 09:40:48.704914 sftp_permissions.go:116 permission denied for user alice on path /d/f00086 for permission list I1117 09:40:48.722133 sftp_permissions.go:116 permission denied for user alice on path /d/f00087 for permission list I1117 09:40:48.736840 sftp_permissions.go:116 permission denied for user alice on path /d/f00088 for permission list I1117 09:40:48.749876 sftp_permissions.go:116 permission denied for user alice on path /d/f00089 for permission list I1117 09:40:48.763546 sftp_permissions.go:116 permission denied for user alice on path /d/f00090 for permission list I1117 09:40:48.778577 sftp_permissions.go:116 permission denied for user alice on path /d/f00091 for permission list I1117 09:40:48.798619 sftp_permissions.go:116 permission denied for user alice on path /d/f00092 for permission list I1117 09:40:48.818825 sftp_permissions.go:116 permission denied for user alice on path /d/f00093 for permission list I1117 09:40:48.836770 sftp_permissions.go:116 permission denied for user alice on path /d/f00094 for permission list I1117 09:40:48.850462 sftp_permissions.go:116 permission denied for user alice on path /d/f00095 for permission list I1117 09:40:48.865550 sftp_permissions.go:116 permission denied for user alice on path /d/f00096 for permission list I1117 09:40:48.880383 sftp_permissions.go:116 permission denied for user alice on path /d/f00097 for permission list I1117 09:40:48.892938 sftp_permissions.go:116 permission denied for user alice on path /d/f00098 for permission list I1117 09:40:48.906552 sftp_permissions.go:116 permission denied for user alice on path /d/f00099 for permission list I1117 09:40:48.920643 sftp_permissions.go:116 permission denied for user alice on path /d/f00100 for permission list I1117 09:40:48.952422 sftp_permissions.go:116 permission denied for user alice on path /d/f00101 for permission list I1117 09:40:48.966281 sftp_permissions.go:116 permission denied for user alice on path /d/f00102 for permission list I1117 09:40:48.986132 sftp_permissions.go:116 permission denied for user alice on path /d/f00103 for permission list I1117 09:40:49.025099 sftp_permissions.go:116 permission denied for user alice on path /d/f00104 for permission list I1117 09:40:49.039165 sftp_permissions.go:116 permission denied for user alice on path /d/f00105 for permission list I1117 09:40:49.053673 sftp_permissions.go:116 permission denied for user alice on path /d/f00106 for permission list I1117 09:40:49.067694 sftp_permissions.go:116 permission denied for user alice on path /d/f00107 for permission list I1117 09:40:49.081197 sftp_permissions.go:116 permission denied for user alice on path /d/f00108 for permission list I1117 09:40:49.096294 sftp_permissions.go:116 permission denied for user alice on path /d/f00109 for permission list I1117 09:40:49.110561 sftp_permissions.go:116 permission denied for user alice on path /d/f00110 for permission list I1117 09:40:49.129105 sftp_permissions.go:116 permission denied for user alice on path /d/f00111 for permission list I1117 09:40:49.141820 sftp_permissions.go:116 permission denied for user alice on path /d/f00112 for permission list I1117 09:40:49.156788 sftp_permissions.go:116 permission denied for user alice on path /d/f00113 for permission list I1117 09:40:49.173733 sftp_permissions.go:116 permission denied for user alice on path /d/f00114 for permission list I1117 09:40:49.188386 sftp_permissions.go:116 permission denied for user alice on path /d/f00115 for permission list I1117 09:40:49.211181 sftp_permissions.go:116 permission denied for user alice on path /d/f00116 for permission list I1117 09:40:49.224136 sftp_permissions.go:116 permission denied for user alice on path /d/f00117 for permission list I1117 09:40:49.238101 sftp_permissions.go:116 permission denied for user alice on path /d/f00118 for permission list I1117 09:40:49.253717 sftp_permissions.go:116 permission denied for user alice on path /d/f00119 for permission list I1117 09:40:49.268068 sftp_permissions.go:116 permission denied for user alice on path /d/f00120 for permission list I1117 09:40:49.285184 sftp_permissions.go:116 permission denied for user alice on path /d/f00121 for permission list I1117 09:40:49.304828 sftp_permissions.go:116 permission denied for user alice on path /d/f00122 for permission list I1117 09:40:49.318343 sftp_permissions.go:116 permission denied for user alice on path /d/f00123 for permission list I1117 09:40:49.332861 sftp_permissions.go:116 permission denied for user alice on path /d/f00124 for permission list I1117 09:40:49.346902 sftp_permissions.go:116 permission denied for user alice on path /d/f00125 for permission list I1117 09:40:49.362110 sftp_permissions.go:116 permission denied for user alice on path /d/f00126 for permission list I1117 09:40:49.382771 sftp_permissions.go:116 permission denied for user alice on path /d/f00127 for permission list I1117 09:40:49.397086 sftp_permissions.go:116 permission denied for user alice on path /d/f00128 for permission list I1117 09:40:49.409371 sftp_permissions.go:116 permission denied for user alice on path /d/f00129 for permission list I1117 09:40:49.426873 sftp_permissions.go:116 permission denied for user alice on path /d/f00130 for permission list I1117 09:40:49.442226 sftp_permissions.go:116 permission denied for user alice on path /d/f00131 for permission list I1117 09:40:49.455225 sftp_permissions.go:116 permission denied for user alice on path /d/f00132 for permission list I1117 09:40:49.476880 sftp_permissions.go:116 permission denied for user alice on path /d/f00133 for permission list I1117 09:40:49.490587 sftp_permissions.go:116 permission denied for user alice on path /d/f00134 for permission list I1117 09:40:49.504401 sftp_permissions.go:116 permission denied for user alice on path /d/f00135 for permission list I1117 09:40:49.519075 sftp_permissions.go:116 permission denied for user alice on path /d/f00136 for permission list I1117 09:40:49.536377 sftp_permissions.go:116 permission denied for user alice on path /d/f00137 for permission list I1117 09:40:49.548516 sftp_permissions.go:116 permission denied for user alice on path /d/f00138 for permission list I1117 09:40:49.561450 sftp_permissions.go:116 permission denied for user alice on path /d/f00139 for permission list I1117 09:40:49.575924 sftp_permissions.go:116 permission denied for user alice on path /d/f00140 for permission list I1117 09:40:49.592183 sftp_permissions.go:116 permission denied for user alice on path /d/f00141 for permission list I1117 09:40:49.608601 sftp_permissions.go:116 permission denied for user alice on path /d/f00142 for permission list I1117 09:40:49.623957 sftp_permissions.go:116 permission denied for user alice on path /d/f00143 for permission list I1117 09:40:49.640720 sftp_permissions.go:116 permission denied for user alice on path /d/f00144 for permission list I1117 09:40:49.656563 sftp_permissions.go:116 permission denied for user alice on path /d/f00145 for permission list I1117 09:40:49.672309 sftp_permissions.go:116 permission denied for user alice on path /d/f00146 for permission list I1117 09:40:49.686114 sftp_permissions.go:116 permission denied for user alice on path /d/f00147 for permission list I1117 09:40:49.700894 sftp_permissions.go:116 permission denied for user alice on path /d/f00148 for permission list I1117 09:40:49.714992 sftp_permissions.go:116 permission denied for user alice on path /d/f00149 for permission list I1117 09:40:49.727313 sftp_permissions.go:116 permission denied for user alice on path /d/f00150 for permission list I1117 09:40:49.739847 sftp_permissions.go:116 permission denied for user alice on path /d/f00151 for permission list I1117 09:40:49.752905 sftp_permissions.go:116 permission denied for user alice on path /d/f00152 for permission list I1117 09:40:49.766819 sftp_permissions.go:116 permission denied for user alice on path /d/f00153 for permission list I1117 09:40:49.779667 sftp_permissions.go:116 permission denied for user alice on path /d/f00154 for permission list I1117 09:40:49.791503 sftp_permissions.go:116 permission denied for user alice on path /d/f00155 for permission list I1117 09:40:49.804445 sftp_permissions.go:116 permission denied for user alice on path /d/f00156 for permission list I1117 09:40:49.817349 sftp_permissions.go:116 permission denied for user alice on path /d/f00157 for permission list I1117 09:40:49.831694 sftp_permissions.go:116 permission denied for user alice on path /d/f00158 for permission list I1117 09:40:49.843757 sftp_permissions.go:116 permission denied for user alice on path /d/f00159 for permission list I1117 09:40:49.856689 sftp_permissions.go:116 permission denied for user alice on path /d/f00160 for permission list I1117 09:40:49.869450 sftp_permissions.go:116 permission denied for user alice on path /d/f00161 for permission list I1117 09:40:49.883526 sftp_permissions.go:116 permission denied for user alice on path /d/f00162 for permission list I1117 09:40:49.897041 sftp_permissions.go:116 permission denied for user alice on path /d/f00163 for permission list I1117 09:40:49.910848 sftp_permissions.go:116 permission denied for user alice on path /d/f00164 for permission list I1117 09:40:49.924944 sftp_permissions.go:116 permission denied for user alice on path /d/f00165 for permission list I1117 09:40:49.938000 sftp_permissions.go:116 permission denied for user alice on path /d/f00166 for permission list I1117 09:40:49.951256 sftp_permissions.go:116 permission denied for user alice on path /d/f00167 for permission list I1117 09:40:49.964782 sftp_permissions.go:116 permission denied for user alice on path /d/f00168 for permission list I1117 09:40:49.978495 sftp_permissions.go:116 permission denied for user alice on path /d/f00169 for permission list I1117 09:40:49.990883 sftp_permissions.go:116 permission denied for user alice on path /d/f00170 for permission list I1117 09:40:50.004058 sftp_permissions.go:116 permission denied for user alice on path /d/f00171 for permission list I1117 09:40:50.017064 sftp_permissions.go:116 permission denied for user alice on path /d/f00172 for permission list I1117 09:40:50.031160 sftp_permissions.go:116 permission denied for user alice on path /d/f00173 for permission list I1117 09:40:50.046282 sftp_permissions.go:116 permission denied for user alice on path /d/f00174 for permission list I1117 09:40:50.058930 sftp_permissions.go:116 permission denied for user alice on path /d/f00175 for permission list I1117 09:40:50.070740 sftp_permissions.go:116 permission denied for user alice on path /d/f00176 for permission list I1117 09:40:50.083376 sftp_permissions.go:116 permission denied for user alice on path /d/f00177 for permission list I1117 09:40:50.096016 sftp_permissions.go:116 permission denied for user alice on path /d/f00178 for permission list I1117 09:40:50.108785 sftp_permissions.go:116 permission denied for user alice on path /d/f00179 for permission list I1117 09:40:50.121309 sftp_permissions.go:116 permission denied for user alice on path /d/f00180 for permission list I1117 09:40:50.132606 sftp_permissions.go:116 permission denied for user alice on path /d/f00181 for permission list I1117 09:40:50.144689 sftp_permissions.go:116 permission denied for user alice on path /d/f00182 for permission list I1117 09:40:50.156840 sftp_permissions.go:116 permission denied for user alice on path /d/f00183 for permission list I1117 09:40:50.171840 sftp_permissions.go:116 permission denied for user alice on path /d/f00184 for permission list I1117 09:40:50.192355 sftp_permissions.go:116 permission denied for user alice on path /d/f00185 for permission list I1117 09:40:50.205982 sftp_permissions.go:116 permission denied for user alice on path /d/f00186 for permission list I1117 09:40:50.218488 sftp_permissions.go:116 permission denied for user alice on path /d/f00187 for permission list I1117 09:40:50.231851 sftp_permissions.go:116 permission denied for user alice on path /d/f00188 for permission list I1117 09:40:50.244095 sftp_permissions.go:116 permission denied for user alice on path /d/f00189 for permission list I1117 09:40:50.257326 sftp_permissions.go:116 permission denied for user alice on path /d/f00190 for permission list I1117 09:40:50.269504 sftp_permissions.go:116 permission denied for user alice on path /d/f00191 for permission list I1117 09:40:50.281483 sftp_permissions.go:116 permission denied for user alice on path /d/f00192 for permission list I1117 09:40:50.294765 sftp_permissions.go:116 permission denied for user alice on path /d/f00193 for permission list I1117 09:40:50.307463 sftp_permissions.go:116 permission denied for user alice on path /d/f00194 for permission list I1117 09:40:50.319599 sftp_permissions.go:116 permission denied for user alice on path /d/f00195 for permission list I1117 09:40:50.332524 sftp_permissions.go:116 permission denied for user alice on path /d/f00196 for permission list I1117 09:40:50.344972 sftp_permissions.go:116 permission denied for user alice on path /d/f00197 for permission list I1117 09:40:50.356642 sftp_permissions.go:116 permission denied for user alice on path /d/f00198 for permission list I1117 09:40:50.368228 sftp_permissions.go:116 permission denied for user alice on path /d/f00199 for permission list I1117 09:40:50.380468 sftp_permissions.go:116 permission denied for user alice on path /d/f00200 for permission list I1117 09:40:50.392116 sftp_permissions.go:116 permission denied for user alice on path /d/f00201 for permission list I1117 09:40:50.403528 sftp_permissions.go:116 permission denied for user alice on path /d/f00202 for permission list I1117 09:40:50.415910 sftp_permissions.go:116 permission denied for user alice on path /d/f00203 for permission list I1117 09:40:50.430854 sftp_permissions.go:116 permission denied for user alice on path /d/f00204 for permission list I1117 09:40:50.443351 sftp_permissions.go:116 permission denied for user alice on path /d/f00205 for permission list I1117 09:40:50.456204 sftp_permissions.go:116 permission denied for user alice on path /d/f00206 for permission list I1117 09:40:50.467670 sftp_permissions.go:116 permission denied for user alice on path /d/f00207 for permission list I1117 09:40:50.479996 sftp_permissions.go:116 permission denied for user alice on path /d/f00208 for permission list I1117 09:40:50.493392 sftp_permissions.go:116 permission denied for user alice on path /d/f00209 for permission list I1117 09:40:50.506610 sftp_permissions.go:116 permission denied for user alice on path /d/f00210 for permission list I1117 09:40:50.519329 sftp_permissions.go:116 permission denied for user alice on path /d/f00211 for permission list I1117 09:40:50.531931 sftp_permissions.go:116 permission denied for user alice on path /d/f00212 for permission list I1117 09:40:50.551824 sftp_permissions.go:116 permission denied for user alice on path /d/f00213 for permission list I1117 09:40:50.564394 sftp_permissions.go:116 permission denied for user alice on path /d/f00214 for permission list I1117 09:40:50.576837 sftp_permissions.go:116 permission denied for user alice on path /d/f00215 for permission list I1117 09:40:50.588810 sftp_permissions.go:116 permission denied for user alice on path /d/f00216 for permission list I1117 09:40:50.600735 sftp_permissions.go:116 permission denied for user alice on path /d/f00217 for permission list I1117 09:40:50.612498 sftp_permissions.go:116 permission denied for user alice on path /d/f00218 for permission list I1117 09:40:50.624430 sftp_permissions.go:116 permission denied for user alice on path /d/f00219 for permission list I1117 09:40:50.636833 sftp_permissions.go:116 permission denied for user alice on path /d/f00220 for permission list I1117 09:40:50.655148 sftp_permissions.go:116 permission denied for user alice on path /d/f00221 for permission list I1117 09:40:50.667277 sftp_permissions.go:116 permission denied for user alice on path /d/f00222 for permission list I1117 09:40:50.679341 sftp_permissions.go:116 permission denied for user alice on path /d/f00223 for permission list I1117 09:40:50.692000 sftp_permissions.go:116 permission denied for user alice on path /d/f00224 for permission list I1117 09:40:50.703410 sftp_permissions.go:116 permission denied for user alice on path /d/f00225 for permission list I1117 09:40:50.714506 sftp_permissions.go:116 permission denied for user alice on path /d/f00226 for permission list I1117 09:40:50.726080 sftp_permissions.go:116 permission denied for user alice on path /d/f00227 for permission list I1117 09:40:50.736822 sftp_permissions.go:116 permission denied for user alice on path /d/f00228 for permission list I1117 09:40:50.747526 sftp_permissions.go:116 permission denied for user alice on path /d/f00229 for permission list I1117 09:40:50.758225 sftp_permissions.go:116 permission denied for user alice on path /d/f00230 for permission list I1117 09:40:50.770244 sftp_permissions.go:116 permission denied for user alice on path /d/f00231 for permission list I1117 09:40:50.781809 sftp_permissions.go:116 permission denied for user alice on path /d/f00232 for permission list I1117 09:40:50.792214 sftp_permissions.go:116 permission denied for user alice on path /d/f00233 for permission list I1117 09:40:50.802804 sftp_permissions.go:116 permission denied for user alice on path /d/f00234 for permission list I1117 09:40:50.813377 sftp_permissions.go:116 permission denied for user alice on path /d/f00235 for permission list I1117 09:40:50.824069 sftp_permissions.go:116 permission denied for user alice on path /d/f00236 for permission list I1117 09:40:50.835020 sftp_permissions.go:116 permission denied for user alice on path /d/f00237 for permission list I1117 09:40:50.845946 sftp_permissions.go:116 permission denied for user alice on path /d/f00238 for permission list I1117 09:40:50.856407 sftp_permissions.go:116 permission denied for user alice on path /d/f00239 for permission list I1117 09:40:50.867064 sftp_permissions.go:116 permission denied for user alice on path /d/f00240 for permission list I1117 09:40:50.878379 sftp_permissions.go:116 permission denied for user alice on path /d/f00241 for permission list I1117 09:40:50.891234 sftp_permissions.go:116 permission denied for user alice on path /d/f00242 for permission list I1117 09:40:50.904256 sftp_permissions.go:116 permission denied for user alice on path /d/f00243 for permission list I1117 09:40:50.916660 sftp_permissions.go:116 permission denied for user alice on path /d/f00244 for permission list I1117 09:40:50.928918 sftp_permissions.go:116 permission denied for user alice on path /d/f00245 for permission list I1117 09:40:50.940071 sftp_permissions.go:116 permission denied for user alice on path /d/f00246 for permission list I1117 09:40:50.951387 sftp_permissions.go:116 permission denied for user alice on path /d/f00247 for permission list I1117 09:40:50.962152 sftp_permissions.go:116 permission denied for user alice on path /d/f00248 for permission list I1117 09:40:50.972597 sftp_permissions.go:116 permission denied for user alice on path /d/f00249 for permission list I1117 09:40:50.984025 sftp_permissions.go:116 permission denied for user alice on path /d/f00250 for permission list I1117 09:40:50.995666 sftp_permissions.go:116 permission denied for user alice on path /d/f00251 for permission list I1117 09:40:51.008253 sftp_permissions.go:116 permission denied for user alice on path /d/f00252 for permission list I1117 09:40:51.019998 sftp_permissions.go:116 permission denied for user alice on path /d/f00253 for permission list I1117 09:40:51.032711 sftp_permissions.go:116 permission denied for user alice on path /d/f00254 for permission list I1117 09:40:51.043777 sftp_permissions.go:116 permission denied for user alice on path /d/f00255 for permission list I1117 09:40:51.055614 sftp_permissions.go:116 permission denied for user alice on path /d/f00256 for permission list I1117 09:40:51.067336 sftp_permissions.go:116 permission denied for user alice on path /d/f00257 for permission list I1117 09:40:51.078703 sftp_permissions.go:116 permission denied for user alice on path /d/f00258 for permission list I1117 09:40:51.089422 sftp_permissions.go:116 permission denied for user alice on path /d/f00259 for permission list I1117 09:40:51.101649 sftp_permissions.go:116 permission denied for user alice on path /d/f00260 for permission list I1117 09:40:51.114237 sftp_permissions.go:116 permission denied for user alice on path /d/f00261 for permission list I1117 09:40:51.131729 sftp_permissions.go:116 permission denied for user alice on path /d/f00262 for permission list I1117 09:40:51.143965 sftp_permissions.go:116 permission denied for user alice on path /d/f00263 for permission list I1117 09:40:51.156873 sftp_permissions.go:116 permission denied for user alice on path /d/f00264 for permission list I1117 09:40:51.168767 sftp_permissions.go:116 permission denied for user alice on path /d/f00265 for permission list I1117 09:40:51.180321 sftp_permissions.go:116 permission denied for user alice on path /d/f00266 for permission list I1117 09:40:51.191471 sftp_permissions.go:116 permission denied for user alice on path /d/f00267 for permission list I1117 09:40:51.203466 sftp_permissions.go:116 permission denied for user alice on path /d/f00268 for permission list I1117 09:40:51.215600 sftp_permissions.go:116 permission denied for user alice on path /d/f00269 for permission list I1117 09:40:51.227913 sftp_permissions.go:116 permission denied for user alice on path /d/f00270 for permission list I1117 09:40:51.239155 sftp_permissions.go:116 permission denied for user alice on path /d/f00271 for permission list I1117 09:40:51.250321 sftp_permissions.go:116 permission denied for user alice on path /d/f00272 for permission list I1117 09:40:51.261202 sftp_permissions.go:116 permission denied for user alice on path /d/f00273 for permission list I1117 09:40:51.271639 sftp_permissions.go:116 permission denied for user alice on path /d/f00274 for permission list I1117 09:40:51.282231 sftp_permissions.go:116 permission denied for user alice on path /d/f00275 for permission list I1117 09:40:51.293028 sftp_permissions.go:116 permission denied for user alice on path /d/f00276 for permission list I1117 09:40:51.303271 sftp_permissions.go:116 permission denied for user alice on path /d/f00277 for permission list I1117 09:40:51.314140 sftp_permissions.go:116 permission denied for user alice on path /d/f00278 for permission list I1117 09:40:51.325057 sftp_permissions.go:116 permission denied for user alice on path /d/f00279 for permission list I1117 09:40:51.336330 sftp_permissions.go:116 permission denied for user alice on path /d/f00280 for permission list I1117 09:40:51.347373 sftp_permissions.go:116 permission denied for user alice on path /d/f00281 for permission list I1117 09:40:51.358042 sftp_permissions.go:116 permission denied for user alice on path /d/f00282 for permission list I1117 09:40:51.368516 sftp_permissions.go:116 permission denied for user alice on path /d/f00283 for permission list I1117 09:40:51.378681 sftp_permissions.go:116 permission denied for user alice on path /d/f00284 for permission list I1117 09:40:51.389469 sftp_permissions.go:116 permission denied for user alice on path /d/f00285 for permission list I1117 09:40:51.399766 sftp_permissions.go:116 permission denied for user alice on path /d/f00286 for permission list I1117 09:40:51.410257 sftp_permissions.go:116 permission denied for user alice on path /d/f00287 for permission list I1117 09:40:51.421041 sftp_permissions.go:116 permission denied for user alice on path /d/f00288 for permission list I1117 09:40:51.431914 sftp_permissions.go:116 permission denied for user alice on path /d/f00289 for permission list I1117 09:40:51.443385 sftp_permissions.go:116 permission denied for user alice on path /d/f00290 for permission list I1117 09:40:51.458382 sftp_permissions.go:116 permission denied for user alice on path /d/f00291 for permission list I1117 09:40:51.470518 sftp_permissions.go:116 permission denied for user alice on path /d/f00292 for permission list I1117 09:40:51.481451 sftp_permissions.go:116 permission denied for user alice on path /d/f00293 for permission list I1117 09:40:51.493744 sftp_permissions.go:116 permission denied for user alice on path /d/f00294 for permission list I1117 09:40:51.504472 sftp_permissions.go:116 permission denied for user alice on path /d/f00295 for permission list I1117 09:40:51.515439 sftp_permissions.go:116 permission denied for user alice on path /d/f00296 for permission list I1117 09:40:51.526749 sftp_permissions.go:116 permission denied for user alice on path /d/f00297 for permission list I1117 09:40:51.538713 sftp_permissions.go:116 permission denied for user alice on path /d/f00298 for permission list I1117 09:40:51.551192 sftp_permissions.go:116 permission denied for user alice on path /d/f00299 for permission list I1117 09:40:51.563102 sftp_permissions.go:116 permission denied for user alice on path /d/f00300 for permission list I1117 09:40:51.575895 sftp_permissions.go:116 permission denied for user alice on path /d/f00301 for permission list I1117 09:40:51.588079 sftp_permissions.go:116 permission denied for user alice on path /d/f00302 for permission list I1117 09:40:51.601616 sftp_permissions.go:116 permission denied for user alice on path /d/f00303 for permission list I1117 09:40:51.615492 sftp_permissions.go:116 permission denied for user alice on path /d/f00304 for permission list I1117 09:40:51.628686 sftp_permissions.go:116 permission denied for user alice on path /d/f00305 for permission list I1117 09:40:51.641311 sftp_permissions.go:116 permission denied for user alice on path /d/f00306 for permission list I1117 09:40:51.656169 sftp_permissions.go:116 permission denied for user alice on path /d/f00307 for permission list I1117 09:40:51.675529 sftp_permissions.go:116 permission denied for user alice on path /d/f00308 for permission list I1117 09:40:51.693436 sftp_permissions.go:116 permission denied for user alice on path /d/f00309 for permission list I1117 09:40:51.709384 sftp_permissions.go:116 permission denied for user alice on path /d/f00310 for permission list I1117 09:40:51.723278 sftp_permissions.go:116 permission denied for user alice on path /d/f00311 for permission list I1117 09:40:51.739645 sftp_permissions.go:116 permission denied for user alice on path /d/f00312 for permission list I1117 09:40:51.766757 sftp_permissions.go:116 permission denied for user alice on path /d/f00313 for permission list I1117 09:40:51.782520 sftp_permissions.go:116 permission denied for user alice on path /d/f00314 for permission list I1117 09:40:51.797732 sftp_permissions.go:116 permission denied for user alice on path /d/f00315 for permission list I1117 09:40:51.811599 sftp_permissions.go:116 permission denied for user alice on path /d/f00316 for permission list I1117 09:40:51.824972 sftp_permissions.go:116 permission denied for user alice on path /d/f00317 for permission list I1117 09:40:51.837288 sftp_permissions.go:116 permission denied for user alice on path /d/f00318 for permission list I1117 09:40:51.851669 sftp_permissions.go:116 permission denied for user alice on path /d/f00319 for permission list I1117 09:40:51.864955 sftp_permissions.go:116 permission denied for user alice on path /d/f00320 for permission list I1117 09:40:51.876173 sftp_permissions.go:116 permission denied for user alice on path /d/f00321 for permission list I1117 09:40:51.887216 sftp_permissions.go:116 permission denied for user alice on path /d/f00322 for permission list I1117 09:40:51.898028 sftp_permissions.go:116 permission denied for user alice on path /d/f00323 for permission list I1117 09:40:51.908947 sftp_permissions.go:116 permission denied for user alice on path /d/f00324 for permission list I1117 09:40:51.919446 sftp_permissions.go:116 permission denied for user alice on path /d/f00325 for permission list I1117 09:40:51.931081 sftp_permissions.go:116 permission denied for user alice on path /d/f00326 for permission list I1117 09:40:51.941896 sftp_permissions.go:116 permission denied for user alice on path /d/f00327 for permission list I1117 09:40:51.952684 sftp_permissions.go:116 permission denied for user alice on path /d/f00328 for permission list I1117 09:40:51.964451 sftp_permissions.go:116 permission denied for user alice on path /d/f00329 for permission list I1117 09:40:51.975429 sftp_permissions.go:116 permission denied for user alice on path /d/f00330 for permission list I1117 09:40:51.986591 sftp_permissions.go:116 permission denied for user alice on path /d/f00331 for permission list I1117 09:40:51.997333 sftp_permissions.go:116 permission denied for user alice on path /d/f00332 for permission list I1117 09:40:52.008482 sftp_permissions.go:116 permission denied for user alice on path /d/f00333 for permission list I1117 09:40:52.020483 sftp_permissions.go:116 permission denied for user alice on path /d/f00334 for permission list I1117 09:40:52.032676 sftp_permissions.go:116 permission denied for user alice on path /d/f00335 for permission list I1117 09:40:52.043787 sftp_permissions.go:116 permission denied for user alice on path /d/f00336 for permission list I1117 09:40:52.054717 sftp_permissions.go:116 permission denied for user alice on path /d/f00337 for permission list I1117 09:40:52.066375 sftp_permissions.go:116 permission denied for user alice on path /d/f00338 for permission list I1117 09:40:52.076934 sftp_permissions.go:116 permission denied for user alice on path /d/f00339 for permission list I1117 09:40:52.087708 sftp_permissions.go:116 permission denied for user alice on path /d/f00340 for permission list I1117 09:40:52.098832 sftp_permissions.go:116 permission denied for user alice on path /d/f00341 for permission list I1117 09:40:52.109273 sftp_permissions.go:116 permission denied for user alice on path /d/f00342 for permission list I1117 09:40:52.120260 sftp_permissions.go:116 permission denied for user alice on path /d/f00343 for permission list I1117 09:40:52.131059 sftp_permissions.go:116 permission denied for user alice on path /d/f00344 for permission list I1117 09:40:52.141570 sftp_permissions.go:116 permission denied for user alice on path /d/f00345 for permission list I1117 09:40:52.152271 sftp_permissions.go:116 permission denied for user alice on path /d/f00346 for permission list I1117 09:40:52.162931 sftp_permissions.go:116 permission denied for user alice on path /d/f00347 for permission list I1117 09:40:52.173264 sftp_permissions.go:116 permission denied for user alice on path /d/f00348 for permission list I1117 09:40:52.183925 sftp_permissions.go:116 permission denied for user alice on path /d/f00349 for permission list I1117 09:40:52.194560 sftp_permissions.go:116 permission denied for user alice on path /d/f00350 for permission list I1117 09:40:52.205981 sftp_permissions.go:116 permission denied for user alice on path /d/f00351 for permission list I1117 09:40:52.217516 sftp_permissions.go:116 permission denied for user alice on path /d/f00352 for permission list I1117 09:40:52.228826 sftp_permissions.go:116 permission denied for user alice on path /d/f00353 for permission list I1117 09:40:52.239569 sftp_permissions.go:116 permission denied for user alice on path /d/f00354 for permission list I1117 09:40:52.251281 sftp_permissions.go:116 permission denied for user alice on path /d/f00355 for permission list I1117 09:40:52.263025 sftp_permissions.go:116 permission denied for user alice on path /d/f00356 for permission list I1117 09:40:52.275815 sftp_permissions.go:116 permission denied for user alice on path /d/f00357 for permission list I1117 09:40:52.288380 sftp_permissions.go:116 permission denied for user alice on path /d/f00358 for permission list I1117 09:40:52.301159 sftp_permissions.go:116 permission denied for user alice on path /d/f00359 for permission list I1117 09:40:52.313791 sftp_permissions.go:116 permission denied for user alice on path /d/f00360 for permission list I1117 09:40:52.327556 sftp_permissions.go:116 permission denied for user alice on path /d/f00361 for permission list I1117 09:40:52.344332 sftp_permissions.go:116 permission denied for user alice on path /d/f00362 for permission list I1117 09:40:52.358688 sftp_permissions.go:116 permission denied for user alice on path /d/f00363 for permission list I1117 09:40:52.383312 sftp_permissions.go:116 permission denied for user alice on path /d/f00364 for permission list I1117 09:40:52.400211 sftp_permissions.go:116 permission denied for user alice on path /d/f00365 for permission list I1117 09:40:52.419236 sftp_permissions.go:116 permission denied for user alice on path /d/f00366 for permission list I1117 09:40:52.437094 sftp_permissions.go:116 permission denied for user alice on path /d/f00367 for permission list I1117 09:40:52.451734 sftp_permissions.go:116 permission denied for user alice on path /d/f00368 for permission list I1117 09:40:52.468083 sftp_permissions.go:116 permission denied for user alice on path /d/f00369 for permission list I1117 09:40:52.482893 sftp_permissions.go:116 permission denied for user alice on path /d/f00370 for permission list I1117 09:40:52.500318 sftp_permissions.go:116 permission denied for user alice on path /d/f00371 for permission list I1117 09:40:52.517054 sftp_permissions.go:116 permission denied for user alice on path /d/f00372 for permission list I1117 09:40:52.533800 sftp_permissions.go:116 permission denied for user alice on path /d/f00373 for permission list I1117 09:40:52.547164 sftp_permissions.go:116 permission denied for user alice on path /d/f00374 for permission list I1117 09:40:52.559884 sftp_permissions.go:116 permission denied for user alice on path /d/f00375 for permission list I1117 09:40:52.573889 sftp_permissions.go:116 permission denied for user alice on path /d/f00376 for permission list I1117 09:40:52.599700 sftp_permissions.go:116 permission denied for user alice on path /d/f00377 for permission list I1117 09:40:52.614333 sftp_permissions.go:116 permission denied for user alice on path /d/f00378 for permission list I1117 09:40:52.630231 sftp_permissions.go:116 permission denied for user alice on path /d/f00379 for permission list I1117 09:40:52.647123 sftp_permissions.go:116 permission denied for user alice on path /d/f00380 for permission list I1117 09:40:52.664692 sftp_permissions.go:116 permission denied for user alice on path /d/f00381 for permission list I1117 09:40:52.678892 sftp_permissions.go:116 permission denied for user alice on path /d/f00382 for permission list I1117 09:40:52.694803 sftp_permissions.go:116 permission denied for user alice on path /d/f00383 for permission list I1117 09:40:52.722172 sftp_permissions.go:116 permission denied for user alice on path /d/f00384 for permission list I1117 09:40:52.748173 sftp_permissions.go:116 permission denied for user alice on path /d/f00385 for permission list I1117 09:40:52.763565 sftp_permissions.go:116 permission denied for user alice on path /d/f00386 for permission list I1117 09:40:52.778689 sftp_permissions.go:116 permission denied for user alice on path /d/f00387 for permission list I1117 09:40:52.792795 sftp_permissions.go:116 permission denied for user alice on path /d/f00388 for permission list I1117 09:40:52.807640 sftp_permissions.go:116 permission denied for user alice on path /d/f00389 for permission list I1117 09:40:52.821313 sftp_permissions.go:116 permission denied for user alice on path /d/f00390 for permission list I1117 09:40:52.835409 sftp_permissions.go:116 permission denied for user alice on path /d/f00391 for permission list I1117 09:40:52.848424 sftp_permissions.go:116 permission denied for user alice on path /d/f00392 for permission list I1117 09:40:52.862409 sftp_permissions.go:116 permission denied for user alice on path /d/f00393 for permission list I1117 09:40:52.875756 sftp_permissions.go:116 permission denied for user alice on path /d/f00394 for permission list I1117 09:40:52.890275 sftp_permissions.go:116 permission denied for user alice on path /d/f00395 for permission list I1117 09:40:52.913190 sftp_permissions.go:116 permission denied for user alice on path /d/f00396 for permission list I1117 09:40:52.939322 sftp_permissions.go:116 permission denied for user alice on path /d/f00397 for permission list I1117 09:40:52.956812 sftp_permissions.go:116 permission denied for user alice on path /d/f00398 for permission list I1117 09:40:52.980669 sftp_permissions.go:116 permission denied for user alice on path /d/f00399 for permission list I1117 09:40:52.998392 sftp_permissions.go:116 permission denied for user alice on path /d/f00400 for permission list I1117 09:40:53.015756 sftp_permissions.go:116 permission denied for user alice on path /d/f00401 for permission list I1117 09:40:53.031774 sftp_permissions.go:116 permission denied for user alice on path /d/f00402 for permission list I1117 09:40:53.046526 sftp_permissions.go:116 permission denied for user alice on path /d/f00403 for permission list I1117 09:40:53.061090 sftp_permissions.go:116 permission denied for user alice on path /d/f00404 for permission list I1117 09:40:53.074619 sftp_permissions.go:116 permission denied for user alice on path /d/f00405 for permission list I1117 09:40:53.088405 sftp_permissions.go:116 permission denied for user alice on path /d/f00406 for permission list I1117 09:40:53.101160 sftp_permissions.go:116 permission denied for user alice on path /d/f00407 for permission list I1117 09:40:53.114827 sftp_permissions.go:116 permission denied for user alice on path /d/f00408 for permission list I1117 09:40:53.127153 sftp_permissions.go:116 permission denied for user alice on path /d/f00409 for permission list I1117 09:40:53.142234 sftp_permissions.go:116 permission denied for user alice on path /d/f00410 for permission list I1117 09:40:53.155861 sftp_permissions.go:116 permission denied for user alice on path /d/f00411 for permission list I1117 09:40:53.168612 sftp_permissions.go:116 permission denied for user alice on path /d/f00412 for permission list I1117 09:40:53.185056 sftp_permissions.go:116 permission denied for user alice on path /d/f00413 for permission list I1117 09:40:53.201840 sftp_permissions.go:116 permission denied for user alice on path /d/f00414 for permission list I1117 09:40:53.219125 sftp_permissions.go:116 permission denied for user alice on path /d/f00415 for permission list I1117 09:40:53.233935 sftp_permissions.go:116 permission denied for user alice on path /d/f00416 for permission list I1117 09:40:53.253538 sftp_permissions.go:116 permission denied for user alice on path /d/f00417 for permission list I1117 09:40:53.271427 sftp_permissions.go:116 permission denied for user alice on path /d/f00418 for permission list I1117 09:40:53.289961 sftp_permissions.go:116 permission denied for user alice on path /d/f00419 for permission list I1117 09:40:53.307533 sftp_permissions.go:116 permission denied for user alice on path /d/f00420 for permission list I1117 09:40:53.339782 sftp_permissions.go:116 permission denied for user alice on path /d/f00421 for permission list I1117 09:40:53.358500 sftp_permissions.go:116 permission denied for user alice on path /d/f00422 for permission list I1117 09:40:53.375840 sftp_permissions.go:116 permission denied for user alice on path /d/f00423 for permission list I1117 09:40:53.391081 sftp_permissions.go:116 permission denied for user alice on path /d/f00424 for permission list I1117 09:40:53.407578 sftp_permissions.go:116 permission denied for user alice on path /d/f00425 for permission list I1117 09:40:53.424324 sftp_permissions.go:116 permission denied for user alice on path /d/f00426 for permission list I1117 09:40:53.439683 sftp_permissions.go:116 permission denied for user alice on path /d/f00427 for permission list I1117 09:40:53.454149 sftp_permissions.go:116 permission denied for user alice on path /d/f00428 for permission list I1117 09:40:53.467205 sftp_permissions.go:116 permission denied for user alice on path /d/f00429 for permission list I1117 09:40:53.480267 sftp_permissions.go:116 permission denied for user alice on path /d/f00430 for permission list I1117 09:40:53.494511 sftp_permissions.go:116 permission denied for user alice on path /d/f00431 for permission list I1117 09:40:53.506764 sftp_permissions.go:116 permission denied for user alice on path /d/f00432 for permission list I1117 09:40:53.518473 sftp_permissions.go:116 permission denied for user alice on path /d/f00433 for permission list I1117 09:40:53.534016 sftp_permissions.go:116 permission denied for user alice on path /d/f00434 for permission list I1117 09:40:53.547382 sftp_permissions.go:116 permission denied for user alice on path /d/f00435 for permission list I1117 09:40:53.559910 sftp_permissions.go:116 permission denied for user alice on path /d/f00436 for permission list I1117 09:40:53.573624 sftp_permissions.go:116 permission denied for user alice on path /d/f00437 for permission list I1117 09:40:53.588653 sftp_permissions.go:116 permission denied for user alice on path /d/f00438 for permission list I1117 09:40:53.603515 sftp_permissions.go:116 permission denied for user alice on path /d/f00439 for permission list I1117 09:40:53.617810 sftp_permissions.go:116 permission denied for user alice on path /d/f00440 for permission list I1117 09:40:53.631884 sftp_permissions.go:116 permission denied for user alice on path /d/f00441 for permission list I1117 09:40:53.652348 sftp_permissions.go:116 permission denied for user alice on path /d/f00442 for permission list I1117 09:40:53.689593 sftp_permissions.go:116 permission denied for user alice on path /d/f00443 for permission list I1117 09:40:53.703604 sftp_permissions.go:116 permission denied for user alice on path /d/f00444 for permission list I1117 09:40:53.719840 sftp_permissions.go:116 permission denied for user alice on path /d/f00445 for permission list I1117 09:40:53.737307 sftp_permissions.go:116 permission denied for user alice on path /d/f00446 for permission list I1117 09:40:53.752567 sftp_permissions.go:116 permission denied for user alice on path /d/f00447 for permission list I1117 09:40:53.767034 sftp_permissions.go:116 permission denied for user alice on path /d/f00448 for permission list I1117 09:40:53.783737 sftp_permissions.go:116 permission denied for user alice on path /d/f00449 for permission list I1117 09:40:53.797991 sftp_permissions.go:116 permission denied for user alice on path /d/f00450 for permission list I1117 09:40:53.809607 sftp_permissions.go:116 permission denied for user alice on path /d/f00451 for permission list I1117 09:40:53.822016 sftp_permissions.go:116 permission denied for user alice on path /d/f00452 for permission list I1117 09:40:53.835278 sftp_permissions.go:116 permission denied for user alice on path /d/f00453 for permission list I1117 09:40:53.847220 sftp_permissions.go:116 permission denied for user alice on path /d/f00454 for permission list I1117 09:40:53.861089 sftp_permissions.go:116 permission denied for user alice on path /d/f00455 for permission list I1117 09:40:53.882067 sftp_permissions.go:116 permission denied for user alice on path /d/f00456 for permission list I1117 09:40:53.901380 sftp_permissions.go:116 permission denied for user alice on path /d/f00457 for permission list I1117 09:40:53.915463 sftp_permissions.go:116 permission denied for user alice on path /d/f00458 for permission list I1117 09:40:53.928941 sftp_permissions.go:116 permission denied for user alice on path /d/f00459 for permission list I1117 09:40:53.943589 sftp_permissions.go:116 permission denied for user alice on path /d/f00460 for permission list I1117 09:40:53.957763 sftp_permissions.go:116 permission denied for user alice on path /d/f00461 for permission list I1117 09:40:53.973131 sftp_permissions.go:116 permission denied for user alice on path /d/f00462 for permission list I1117 09:40:53.987641 sftp_permissions.go:116 permission denied for user alice on path /d/f00463 for permission list I1117 09:40:54.000246 sftp_permissions.go:116 permission denied for user alice on path /d/f00464 for permission list I1117 09:40:54.014948 sftp_permissions.go:116 permission denied for user alice on path /d/f00465 for permission list I1117 09:40:54.029900 sftp_permissions.go:116 permission denied for user alice on path /d/f00466 for permission list I1117 09:40:54.044990 sftp_permissions.go:116 permission denied for user alice on path /d/f00467 for permission list I1117 09:40:54.059975 sftp_permissions.go:116 permission denied for user alice on path /d/f00468 for permission list I1117 09:40:54.074665 sftp_permissions.go:116 permission denied for user alice on path /d/f00469 for permission list I1117 09:40:54.089526 sftp_permissions.go:116 permission denied for user alice on path /d/f00470 for permission list I1117 09:40:54.105357 sftp_permissions.go:116 permission denied for user alice on path /d/f00471 for permission list I1117 09:40:54.119902 sftp_permissions.go:116 permission denied for user alice on path /d/f00472 for permission list I1117 09:40:54.134095 sftp_permissions.go:116 permission denied for user alice on path /d/f00473 for permission list I1117 09:40:54.149586 sftp_permissions.go:116 permission denied for user alice on path /d/f00474 for permission list I1117 09:40:54.164035 sftp_permissions.go:116 permission denied for user alice on path /d/f00475 for permission list I1117 09:40:54.178448 sftp_permissions.go:116 permission denied for user alice on path /d/f00476 for permission list I1117 09:40:54.192957 sftp_permissions.go:116 permission denied for user alice on path /d/f00477 for permission list I1117 09:40:54.207410 sftp_permissions.go:116 permission denied for user alice on path /d/f00478 for permission list I1117 09:40:54.220534 sftp_permissions.go:116 permission denied for user alice on path /d/f00479 for permission list I1117 09:40:54.235628 sftp_permissions.go:116 permission denied for user alice on path /d/f00480 for permission list I1117 09:40:54.249192 sftp_permissions.go:116 permission denied for user alice on path /d/f00481 for permission list I1117 09:40:54.263185 sftp_permissions.go:116 permission denied for user alice on path /d/f00482 for permission list I1117 09:40:54.276825 sftp_permissions.go:116 permission denied for user alice on path /d/f00483 for permission list I1117 09:40:54.291951 sftp_permissions.go:116 permission denied for user alice on path /d/f00484 for permission list I1117 09:40:54.304911 sftp_permissions.go:116 permission denied for user alice on path /d/f00485 for permission list I1117 09:40:54.316183 sftp_permissions.go:116 permission denied for user alice on path /d/f00486 for permission list I1117 09:40:54.328740 sftp_permissions.go:116 permission denied for user alice on path /d/f00487 for permission list I1117 09:40:54.340569 sftp_permissions.go:116 permission denied for user alice on path /d/f00488 for permission list I1117 09:40:54.352586 sftp_permissions.go:116 permission denied for user alice on path /d/f00489 for permission list I1117 09:40:54.365593 sftp_permissions.go:116 permission denied for user alice on path /d/f00490 for permission list I1117 09:40:54.377647 sftp_permissions.go:116 permission denied for user alice on path /d/f00491 for permission list I1117 09:40:54.390583 sftp_permissions.go:116 permission denied for user alice on path /d/f00492 for permission list I1117 09:40:54.403117 sftp_permissions.go:116 permission denied for user alice on path /d/f00493 for permission list I1117 09:40:54.417378 sftp_permissions.go:116 permission denied for user alice on path /d/f00494 for permission list I1117 09:40:54.432991 sftp_permissions.go:116 permission denied for user alice on path /d/f00495 for permission list I1117 09:40:54.446940 sftp_permissions.go:116 permission denied for user alice on path /d/f00496 for permission list I1117 09:40:54.467889 sftp_permissions.go:116 permission denied for user alice on path /d/f00497 for permission list I1117 09:40:54.482963 sftp_permissions.go:116 permission denied for user alice on path /d/f00498 for permission list I1117 09:40:54.495812 sftp_permissions.go:116 permission denied for user alice on path /d/f00499 for permission list I1117 09:40:54.512415 sftp_permissions.go:116 permission denied for user alice on path /d/f00500 for permission list I1117 09:40:54.524287 sftp_permissions.go:116 permission denied for user alice on path /d/f00501 for permission list I1117 09:40:54.538770 sftp_permissions.go:116 permission denied for user alice on path /d/f00502 for permission list I1117 09:40:54.552383 sftp_permissions.go:116 permission denied for user alice on path /d/f00503 for permission list I1117 09:40:54.564734 sftp_permissions.go:116 permission denied for user alice on path /d/f00504 for permission list I1117 09:40:54.578603 sftp_permissions.go:116 permission denied for user alice on path /d/f00505 for permission list I1117 09:40:54.590900 sftp_permissions.go:116 permission denied for user alice on path /d/f00506 for permission list I1117 09:40:54.603252 sftp_permissions.go:116 permission denied for user alice on path /d/f00507 for permission list I1117 09:40:54.616456 sftp_permissions.go:116 permission denied for user alice on path /d/f00508 for permission list I1117 09:40:54.630361 sftp_permissions.go:116 permission denied for user alice on path /d/f00509 for permission list I1117 09:40:54.650827 sftp_permissions.go:116 permission denied for user alice on path /d/f00510 for permission list I1117 09:40:54.665540 sftp_permissions.go:116 permission denied for user alice on path /d/f00511 for permission list I1117 09:40:54.676410 sftp_permissions.go:116 permission denied for user alice on path /d/f00512 for permission list I1117 09:40:54.688213 sftp_permissions.go:116 permission denied for user alice on path /d/f00513 for permission list I1117 09:40:54.701444 sftp_permissions.go:116 permission denied for user alice on path /d/f00514 for permission list I1117 09:40:54.713878 sftp_permissions.go:116 permission denied for user alice on path /d/f00515 for permission list I1117 09:40:54.725031 sftp_permissions.go:116 permission denied for user alice on path /d/f00516 for permission list I1117 09:40:54.735626 sftp_permissions.go:116 permission denied for user alice on path /d/f00517 for permission list I1117 09:40:54.747128 sftp_permissions.go:116 permission denied for user alice on path /d/f00518 for permission list I1117 09:40:54.759146 sftp_permissions.go:116 permission denied for user alice on path /d/f00519 for permission list I1117 09:40:54.775174 sftp_permissions.go:116 permission denied for user alice on path /d/f00520 for permission list I1117 09:40:54.787077 sftp_permissions.go:116 permission denied for user alice on path /d/f00521 for permission list I1117 09:40:54.798390 sftp_permissions.go:116 permission denied for user alice on path /d/f00522 for permission list I1117 09:40:54.810644 sftp_permissions.go:116 permission denied for user alice on path /d/f00523 for permission list I1117 09:40:54.823106 sftp_permissions.go:116 permission denied for user alice on path /d/f00524 for permission list I1117 09:40:54.834760 sftp_permissions.go:116 permission denied for user alice on path /d/f00525 for permission list I1117 09:40:54.851028 sftp_permissions.go:116 permission denied for user alice on path /d/f00526 for permission list I1117 09:40:54.879371 sftp_permissions.go:116 permission denied for user alice on path /d/f00527 for permission list I1117 09:40:54.896509 sftp_permissions.go:116 permission denied for user alice on path /d/f00528 for permission list I1117 09:40:54.909982 sftp_permissions.go:116 permission denied for user alice on path /d/f00529 for permission list I1117 09:40:54.923024 sftp_permissions.go:116 permission denied for user alice on path /d/f00530 for permission list I1117 09:40:54.934877 sftp_permissions.go:116 permission denied for user alice on path /d/f00531 for permission list I1117 09:40:54.947132 sftp_permissions.go:116 permission denied for user alice on path /d/f00532 for permission list I1117 09:40:54.959084 sftp_permissions.go:116 permission denied for user alice on path /d/f00533 for permission list I1117 09:40:54.972884 sftp_permissions.go:116 permission denied for user alice on path /d/f00534 for permission list I1117 09:40:54.986056 sftp_permissions.go:116 permission denied for user alice on path /d/f00535 for permission list I1117 09:40:54.998742 sftp_permissions.go:116 permission denied for user alice on path /d/f00536 for permission list I1117 09:40:55.011431 sftp_permissions.go:116 permission denied for user alice on path /d/f00537 for permission list I1117 09:40:55.023591 sftp_permissions.go:116 permission denied for user alice on path /d/f00538 for permission list I1117 09:40:55.036705 sftp_permissions.go:116 permission denied for user alice on path /d/f00539 for permission list I1117 09:40:55.048653 sftp_permissions.go:116 permission denied for user alice on path /d/f00540 for permission list I1117 09:40:55.061667 sftp_permissions.go:116 permission denied for user alice on path /d/f00541 for permission list I1117 09:40:55.074217 sftp_permissions.go:116 permission denied for user alice on path /d/f00542 for permission list I1117 09:40:55.086172 sftp_permissions.go:116 permission denied for user alice on path /d/f00543 for permission list I1117 09:40:55.099140 sftp_permissions.go:116 permission denied for user alice on path /d/f00544 for permission list I1117 09:40:55.114851 sftp_permissions.go:116 permission denied for user alice on path /d/f00545 for permission list I1117 09:40:55.130700 sftp_permissions.go:116 permission denied for user alice on path /d/f00546 for permission list I1117 09:40:55.143525 sftp_permissions.go:116 permission denied for user alice on path /d/f00547 for permission list I1117 09:40:55.156894 sftp_permissions.go:116 permission denied for user alice on path /d/f00548 for permission list I1117 09:40:55.170444 sftp_permissions.go:116 permission denied for user alice on path /d/f00549 for permission list I1117 09:40:55.189348 sftp_permissions.go:116 permission denied for user alice on path /d/f00550 for permission list I1117 09:40:55.202540 sftp_permissions.go:116 permission denied for user alice on path /d/f00551 for permission list I1117 09:40:55.214818 sftp_permissions.go:116 permission denied for user alice on path /d/f00552 for permission list I1117 09:40:55.228217 sftp_permissions.go:116 permission denied for user alice on path /d/f00553 for permission list I1117 09:40:55.241717 sftp_permissions.go:116 permission denied for user alice on path /d/f00554 for permission list I1117 09:40:55.253659 sftp_permissions.go:116 permission denied for user alice on path /d/f00555 for permission list I1117 09:40:55.265498 sftp_permissions.go:116 permission denied for user alice on path /d/f00556 for permission list I1117 09:40:55.278420 sftp_permissions.go:116 permission denied for user alice on path /d/f00557 for permission list I1117 09:40:55.289908 sftp_permissions.go:116 permission denied for user alice on path /d/f00558 for permission list I1117 09:40:55.301864 sftp_permissions.go:116 permission denied for user alice on path /d/f00559 for permission list I1117 09:40:55.312882 sftp_permissions.go:116 permission denied for user alice on path /d/f00560 for permission list I1117 09:40:55.325965 sftp_permissions.go:116 permission denied for user alice on path /d/f00561 for permission list I1117 09:40:55.339302 sftp_permissions.go:116 permission denied for user alice on path /d/f00562 for permission list I1117 09:40:55.353000 sftp_permissions.go:116 permission denied for user alice on path /d/f00563 for permission list I1117 09:40:55.367138 sftp_permissions.go:116 permission denied for user alice on path /d/f00564 for permission list I1117 09:40:55.398306 sftp_permissions.go:116 permission denied for user alice on path /d/f00565 for permission list I1117 09:40:55.411040 sftp_permissions.go:116 permission denied for user alice on path /d/f00566 for permission list I1117 09:40:55.424949 sftp_permissions.go:116 permission denied for user alice on path /d/f00567 for permission list I1117 09:40:55.437356 sftp_permissions.go:116 permission denied for user alice on path /d/f00568 for permission list I1117 09:40:55.449400 sftp_permissions.go:116 permission denied for user alice on path /d/f00569 for permission list I1117 09:40:55.461525 sftp_permissions.go:116 permission denied for user alice on path /d/f00570 for permission list I1117 09:40:55.472999 sftp_permissions.go:116 permission denied for user alice on path /d/f00571 for permission list I1117 09:40:55.485606 sftp_permissions.go:116 permission denied for user alice on path /d/f00572 for permission list I1117 09:40:55.500309 sftp_permissions.go:116 permission denied for user alice on path /d/f00573 for permission list I1117 09:40:55.514970 sftp_permissions.go:116 permission denied for user alice on path /d/f00574 for permission list I1117 09:40:55.527361 sftp_permissions.go:116 permission denied for user alice on path /d/f00575 for permission list I1117 09:40:55.544357 sftp_permissions.go:116 permission denied for user alice on path /d/f00576 for permission list I1117 09:40:55.571204 sftp_permissions.go:116 permission denied for user alice on path /d/f00577 for permission list I1117 09:40:55.584469 sftp_permissions.go:116 permission denied for user alice on path /d/f00578 for permission list I1117 09:40:55.597399 sftp_permissions.go:116 permission denied for user alice on path /d/f00579 for permission list I1117 09:40:55.610682 sftp_permissions.go:116 permission denied for user alice on path /d/f00580 for permission list I1117 09:40:55.622270 sftp_permissions.go:116 permission denied for user alice on path /d/f00581 for permission list I1117 09:40:55.643158 sftp_permissions.go:116 permission denied for user alice on path /d/f00582 for permission list I1117 09:40:55.655572 sftp_permissions.go:116 permission denied for user alice on path /d/f00583 for permission list I1117 09:40:55.667399 sftp_permissions.go:116 permission denied for user alice on path /d/f00584 for permission list I1117 09:40:55.678570 sftp_permissions.go:116 permission denied for user alice on path /d/f00585 for permission list I1117 09:40:55.720822 sftp_permissions.go:116 permission denied for user alice on path /d/f00586 for permission list I1117 09:40:55.739447 sftp_permissions.go:116 permission denied for user alice on path /d/f00587 for permission list I1117 09:40:55.763174 sftp_permissions.go:116 permission denied for user alice on path /d/f00588 for permission list I1117 09:40:55.776864 sftp_permissions.go:116 permission denied for user alice on path /d/f00589 for permission list I1117 09:40:55.788777 sftp_permissions.go:116 permission denied for user alice on path /d/f00590 for permission list I1117 09:40:55.800694 sftp_permissions.go:116 permission denied for user alice on path /d/f00591 for permission list I1117 09:40:55.812263 sftp_permissions.go:116 permission denied for user alice on path /d/f00592 for permission list I1117 09:40:55.823878 sftp_permissions.go:116 permission denied for user alice on path /d/f00593 for permission list I1117 09:40:55.835832 sftp_permissions.go:116 permission denied for user alice on path /d/f00594 for permission list I1117 09:40:55.847504 sftp_permissions.go:116 permission denied for user alice on path /d/f00595 for permission list I1117 09:40:55.859232 sftp_permissions.go:116 permission denied for user alice on path /d/f00596 for permission list I1117 09:40:55.871293 sftp_permissions.go:116 permission denied for user alice on path /d/f00597 for permission list I1117 09:40:55.885959 sftp_permissions.go:116 permission denied for user alice on path /d/f00598 for permission list I1117 09:40:55.899078 sftp_permissions.go:116 permission denied for user alice on path /d/f00599 for permission list I1117 09:40:55.910624 sftp_permissions.go:116 permission denied for user alice on path /d/f00600 for permission list I1117 09:40:55.921790 sftp_permissions.go:116 permission denied for user alice on path /d/f00601 for permission list I1117 09:40:55.932492 sftp_permissions.go:116 permission denied for user alice on path /d/f00602 for permission list I1117 09:40:55.943331 sftp_permissions.go:116 permission denied for user alice on path /d/f00603 for permission list I1117 09:40:55.954474 sftp_permissions.go:116 permission denied for user alice on path /d/f00604 for permission list I1117 09:40:55.965899 sftp_permissions.go:116 permission denied for user alice on path /d/f00605 for permission list I1117 09:40:55.976958 sftp_permissions.go:116 permission denied for user alice on path /d/f00606 for permission list I1117 09:40:55.999100 sftp_permissions.go:116 permission denied for user alice on path /d/f00607 for permission list I1117 09:40:56.014553 sftp_permissions.go:116 permission denied for user alice on path /d/f00608 for permission list I1117 09:40:56.025664 sftp_permissions.go:116 permission denied for user alice on path /d/f00609 for permission list I1117 09:40:56.036576 sftp_permissions.go:116 permission denied for user alice on path /d/f00610 for permission list I1117 09:40:56.048618 sftp_permissions.go:116 permission denied for user alice on path /d/f00611 for permission list I1117 09:40:56.062090 sftp_permissions.go:116 permission denied for user alice on path /d/f00612 for permission list I1117 09:40:56.073819 sftp_permissions.go:116 permission denied for user alice on path /d/f00613 for permission list I1117 09:40:56.085162 sftp_permissions.go:116 permission denied for user alice on path /d/f00614 for permission list I1117 09:40:56.096415 sftp_permissions.go:116 permission denied for user alice on path /d/f00615 for permission list I1117 09:40:56.110318 sftp_permissions.go:116 permission denied for user alice on path /d/f00616 for permission list I1117 09:40:56.121911 sftp_permissions.go:116 permission denied for user alice on path /d/f00617 for permission list I1117 09:40:56.133607 sftp_permissions.go:116 permission denied for user alice on path /d/f00618 for permission list I1117 09:40:56.145187 sftp_permissions.go:116 permission denied for user alice on path /d/f00619 for permission list I1117 09:40:56.156256 sftp_permissions.go:116 permission denied for user alice on path /d/f00620 for permission list I1117 09:40:56.167145 sftp_permissions.go:116 permission denied for user alice on path /d/f00621 for permission list I1117 09:40:56.178668 sftp_permissions.go:116 permission denied for user alice on path /d/f00622 for permission list I1117 09:40:56.191520 sftp_permissions.go:116 permission denied for user alice on path /d/f00623 for permission list I1117 09:40:56.202891 sftp_permissions.go:116 permission denied for user alice on path /d/f00624 for permission list I1117 09:40:56.217593 sftp_permissions.go:116 permission denied for user alice on path /d/f00625 for permission list I1117 09:40:56.230258 sftp_permissions.go:116 permission denied for user alice on path /d/f00626 for permission list I1117 09:40:56.241167 sftp_permissions.go:116 permission denied for user alice on path /d/f00627 for permission list I1117 09:40:56.252261 sftp_permissions.go:116 permission denied for user alice on path /d/f00628 for permission list I1117 09:40:56.264591 sftp_permissions.go:116 permission denied for user alice on path /d/f00629 for permission list I1117 09:40:56.276794 sftp_permissions.go:116 permission denied for user alice on path /d/f00630 for permission list I1117 09:40:56.289425 sftp_permissions.go:116 permission denied for user alice on path /d/f00631 for permission list I1117 09:40:56.301662 sftp_permissions.go:116 permission denied for user alice on path /d/f00632 for permission list I1117 09:40:56.313298 sftp_permissions.go:116 permission denied for user alice on path /d/f00633 for permission list I1117 09:40:56.327983 sftp_permissions.go:116 permission denied for user alice on path /d/f00634 for permission list I1117 09:40:56.340090 sftp_permissions.go:116 permission denied for user alice on path /d/f00635 for permission list I1117 09:40:56.351931 sftp_permissions.go:116 permission denied for user alice on path /d/f00636 for permission list I1117 09:40:56.365015 sftp_permissions.go:116 permission denied for user alice on path /d/f00637 for permission list I1117 09:40:56.377495 sftp_permissions.go:116 permission denied for user alice on path /d/f00638 for permission list I1117 09:40:56.389806 sftp_permissions.go:116 permission denied for user alice on path /d/f00639 for permission list I1117 09:40:56.402329 sftp_permissions.go:116 permission denied for user alice on path /d/f00640 for permission list I1117 09:40:56.413598 sftp_permissions.go:116 permission denied for user alice on path /d/f00641 for permission list I1117 09:40:56.425086 sftp_permissions.go:116 permission denied for user alice on path /d/f00642 for permission list I1117 09:40:56.436881 sftp_permissions.go:116 permission denied for user alice on path /d/f00643 for permission list I1117 09:40:56.448231 sftp_permissions.go:116 permission denied for user alice on path /d/f00644 for permission list I1117 09:40:56.459522 sftp_permissions.go:116 permission denied for user alice on path /d/f00645 for permission list I1117 09:40:56.470459 sftp_permissions.go:116 permission denied for user alice on path /d/f00646 for permission list I1117 09:40:56.480860 sftp_permissions.go:116 permission denied for user alice on path /d/f00647 for permission list I1117 09:40:56.491807 sftp_permissions.go:116 permission denied for user alice on path /d/f00648 for permission list I1117 09:40:56.503227 sftp_permissions.go:116 permission denied for user alice on path /d/f00649 for permission list I1117 09:40:56.516269 sftp_permissions.go:116 permission denied for user alice on path /d/f00650 for permission list I1117 09:40:56.530054 sftp_permissions.go:116 permission denied for user alice on path /d/f00651 for permission list I1117 09:40:56.543353 sftp_permissions.go:116 permission denied for user alice on path /d/f00652 for permission list I1117 09:40:56.556164 sftp_permissions.go:116 permission denied for user alice on path /d/f00653 for permission list I1117 09:40:56.572032 sftp_permissions.go:116 permission denied for user alice on path /d/f00654 for permission list I1117 09:40:56.585342 sftp_permissions.go:116 permission denied for user alice on path /d/f00655 for permission list I1117 09:40:56.597427 sftp_permissions.go:116 permission denied for user alice on path /d/f00656 for permission list I1117 09:40:56.608391 sftp_permissions.go:116 permission denied for user alice on path /d/f00657 for permission list I1117 09:40:56.619599 sftp_permissions.go:116 permission denied for user alice on path /d/f00658 for permission list I1117 09:40:56.633025 sftp_permissions.go:116 permission denied for user alice on path /d/f00659 for permission list I1117 09:40:56.646348 sftp_permissions.go:116 permission denied for user alice on path /d/f00660 for permission list I1117 09:40:56.658071 sftp_permissions.go:116 permission denied for user alice on path /d/f00661 for permission list I1117 09:40:56.669610 sftp_permissions.go:116 permission denied for user alice on path /d/f00662 for permission list I1117 09:40:56.686060 sftp_permissions.go:116 permission denied for user alice on path /d/f00663 for permission list I1117 09:40:56.697467 sftp_permissions.go:116 permission denied for user alice on path /d/f00664 for permission list I1117 09:40:56.710005 sftp_permissions.go:116 permission denied for user alice on path /d/f00665 for permission list I1117 09:40:56.722324 sftp_permissions.go:116 permission denied for user alice on path /d/f00666 for permission list I1117 09:40:56.734760 sftp_permissions.go:116 permission denied for user alice on path /d/f00667 for permission list I1117 09:40:56.747192 sftp_permissions.go:116 permission denied for user alice on path /d/f00668 for permission list I1117 09:40:56.758954 sftp_permissions.go:116 permission denied for user alice on path /d/f00669 for permission list I1117 09:40:56.771758 sftp_permissions.go:116 permission denied for user alice on path /d/f00670 for permission list I1117 09:40:56.783094 sftp_permissions.go:116 permission denied for user alice on path /d/f00671 for permission list I1117 09:40:56.796345 sftp_permissions.go:116 permission denied for user alice on path /d/f00672 for permission list I1117 09:40:56.807551 sftp_permissions.go:116 permission denied for user alice on path /d/f00673 for permission list I1117 09:40:56.817987 sftp_permissions.go:116 permission denied for user alice on path /d/f00674 for permission list I1117 09:40:56.828924 sftp_permissions.go:116 permission denied for user alice on path /d/f00675 for permission list I1117 09:40:56.843756 sftp_permissions.go:116 permission denied for user alice on path /d/f00676 for permission list I1117 09:40:56.857139 sftp_permissions.go:116 permission denied for user alice on path /d/f00677 for permission list I1117 09:40:56.870555 sftp_permissions.go:116 permission denied for user alice on path /d/f00678 for permission list I1117 09:40:56.883143 sftp_permissions.go:116 permission denied for user alice on path /d/f00679 for permission list I1117 09:40:56.893853 sftp_permissions.go:116 permission denied for user alice on path /d/f00680 for permission list I1117 09:40:56.904714 sftp_permissions.go:116 permission denied for user alice on path /d/f00681 for permission list I1117 09:40:56.917213 sftp_permissions.go:116 permission denied for user alice on path /d/f00682 for permission list I1117 09:40:56.929099 sftp_permissions.go:116 permission denied for user alice on path /d/f00683 for permission list I1117 09:40:56.940263 sftp_permissions.go:116 permission denied for user alice on path /d/f00684 for permission list I1117 09:40:56.951181 sftp_permissions.go:116 permission denied for user alice on path /d/f00685 for permission list I1117 09:40:56.963002 sftp_permissions.go:116 permission denied for user alice on path /d/f00686 for permission list I1117 09:40:56.975422 sftp_permissions.go:116 permission denied for user alice on path /d/f00687 for permission list I1117 09:40:56.986644 sftp_permissions.go:116 permission denied for user alice on path /d/f00688 for permission list I1117 09:40:56.997638 sftp_permissions.go:116 permission denied for user alice on path /d/f00689 for permission list I1117 09:40:57.008733 sftp_permissions.go:116 permission denied for user alice on path /d/f00690 for permission list I1117 09:40:57.021412 sftp_permissions.go:116 permission denied for user alice on path /d/f00691 for permission list I1117 09:40:57.032792 sftp_permissions.go:116 permission denied for user alice on path /d/f00692 for permission list I1117 09:40:57.045373 sftp_permissions.go:116 permission denied for user alice on path /d/f00693 for permission list I1117 09:40:57.058244 sftp_permissions.go:116 permission denied for user alice on path /d/f00694 for permission list I1117 09:40:57.070264 sftp_permissions.go:116 permission denied for user alice on path /d/f00695 for permission list I1117 09:40:57.082725 sftp_permissions.go:116 permission denied for user alice on path /d/f00696 for permission list I1117 09:40:57.093463 sftp_permissions.go:116 permission denied for user alice on path /d/f00697 for permission list I1117 09:40:57.103857 sftp_permissions.go:116 permission denied for user alice on path /d/f00698 for permission list I1117 09:40:57.114250 sftp_permissions.go:116 permission denied for user alice on path /d/f00699 for permission list I1117 09:40:57.124927 sftp_permissions.go:116 permission denied for user alice on path /d/f00700 for permission list I1117 09:40:57.135549 sftp_permissions.go:116 permission denied for user alice on path /d/f00701 for permission list I1117 09:40:57.146431 sftp_permissions.go:116 permission denied for user alice on path /d/f00702 for permission list I1117 09:40:57.157096 sftp_permissions.go:116 permission denied for user alice on path /d/f00703 for permission list I1117 09:40:57.172739 sftp_permissions.go:116 permission denied for user alice on path /d/f00704 for permission list I1117 09:40:57.185013 sftp_permissions.go:116 permission denied for user alice on path /d/f00705 for permission list I1117 09:40:57.196648 sftp_permissions.go:116 permission denied for user alice on path /d/f00706 for permission list I1117 09:40:57.207173 sftp_permissions.go:116 permission denied for user alice on path /d/f00707 for permission list I1117 09:40:57.217900 sftp_permissions.go:116 permission denied for user alice on path /d/f00708 for permission list I1117 09:40:57.229115 sftp_permissions.go:116 permission denied for user alice on path /d/f00709 for permission list I1117 09:40:57.240349 sftp_permissions.go:116 permission denied for user alice on path /d/f00710 for permission list I1117 09:40:57.251100 sftp_permissions.go:116 permission denied for user alice on path /d/f00711 for permission list I1117 09:40:57.262058 sftp_permissions.go:116 permission denied for user alice on path /d/f00712 for permission list I1117 09:40:57.273501 sftp_permissions.go:116 permission denied for user alice on path /d/f00713 for permission list I1117 09:40:57.284608 sftp_permissions.go:116 permission denied for user alice on path /d/f00714 for permission list I1117 09:40:57.297731 sftp_permissions.go:116 permission denied for user alice on path /d/f00715 for permission list I1117 09:40:57.310966 sftp_permissions.go:116 permission denied for user alice on path /d/f00716 for permission list I1117 09:40:57.324213 sftp_permissions.go:116 permission denied for user alice on path /d/f00717 for permission list I1117 09:40:57.337190 sftp_permissions.go:116 permission denied for user alice on path /d/f00718 for permission list I1117 09:40:57.348986 sftp_permissions.go:116 permission denied for user alice on path /d/f00719 for permission list I1117 09:40:57.360733 sftp_permissions.go:116 permission denied for user alice on path /d/f00720 for permission list I1117 09:40:57.372299 sftp_permissions.go:116 permission denied for user alice on path /d/f00721 for permission list I1117 09:40:57.384893 sftp_permissions.go:116 permission denied for user alice on path /d/f00722 for permission list I1117 09:40:57.396748 sftp_permissions.go:116 permission denied for user alice on path /d/f00723 for permission list I1117 09:40:57.410051 sftp_permissions.go:116 permission denied for user alice on path /d/f00724 for permission list I1117 09:40:57.421151 sftp_permissions.go:116 permission denied for user alice on path /d/f00725 for permission list I1117 09:40:57.433823 sftp_permissions.go:116 permission denied for user alice on path /d/f00726 for permission list I1117 09:40:57.444522 sftp_permissions.go:116 permission denied for user alice on path /d/f00727 for permission list I1117 09:40:57.455124 sftp_permissions.go:116 permission denied for user alice on path /d/f00728 for permission list I1117 09:40:57.465882 sftp_permissions.go:116 permission denied for user alice on path /d/f00729 for permission list I1117 09:40:57.476747 sftp_permissions.go:116 permission denied for user alice on path /d/f00730 for permission list I1117 09:40:57.487489 sftp_permissions.go:116 permission denied for user alice on path /d/f00731 for permission list I1117 09:40:57.498669 sftp_permissions.go:116 permission denied for user alice on path /d/f00732 for permission list I1117 09:40:57.510445 sftp_permissions.go:116 permission denied for user alice on path /d/f00733 for permission list I1117 09:40:57.523062 sftp_permissions.go:116 permission denied for user alice on path /d/f00734 for permission list I1117 09:40:57.534642 sftp_permissions.go:116 permission denied for user alice on path /d/f00735 for permission list I1117 09:40:57.546316 sftp_permissions.go:116 permission denied for user alice on path /d/f00736 for permission list I1117 09:40:57.557374 sftp_permissions.go:116 permission denied for user alice on path /d/f00737 for permission list I1117 09:40:57.568638 sftp_permissions.go:116 permission denied for user alice on path /d/f00738 for permission list I1117 09:40:57.580172 sftp_permissions.go:116 permission denied for user alice on path /d/f00739 for permission list I1117 09:40:57.592784 sftp_permissions.go:116 permission denied for user alice on path /d/f00740 for permission list I1117 09:40:57.605484 sftp_permissions.go:116 permission denied for user alice on path /d/f00741 for permission list I1117 09:40:57.617546 sftp_permissions.go:116 permission denied for user alice on path /d/f00742 for permission list I1117 09:40:57.629590 sftp_permissions.go:116 permission denied for user alice on path /d/f00743 for permission list I1117 09:40:57.647618 sftp_permissions.go:116 permission denied for user alice on path /d/f00744 for permission list I1117 09:40:57.660277 sftp_permissions.go:116 permission denied for user alice on path /d/f00745 for permission list I1117 09:40:57.673128 sftp_permissions.go:116 permission denied for user alice on path /d/f00746 for permission list I1117 09:40:57.685677 sftp_permissions.go:116 permission denied for user alice on path /d/f00747 for permission list I1117 09:40:57.696615 sftp_permissions.go:116 permission denied for user alice on path /d/f00748 for permission list I1117 09:40:57.707811 sftp_permissions.go:116 permission denied for user alice on path /d/f00749 for permission list I1117 09:40:57.718225 sftp_permissions.go:116 permission denied for user alice on path /d/f00750 for permission list I1117 09:40:57.728759 sftp_permissions.go:116 permission denied for user alice on path /d/f00751 for permission list I1117 09:40:57.741729 sftp_permissions.go:116 permission denied for user alice on path /d/f00752 for permission list I1117 09:40:57.754029 sftp_permissions.go:116 permission denied for user alice on path /d/f00753 for permission list I1117 09:40:57.767448 sftp_permissions.go:116 permission denied for user alice on path /d/f00754 for permission list I1117 09:40:57.779997 sftp_permissions.go:116 permission denied for user alice on path /d/f00755 for permission list I1117 09:40:57.792492 sftp_permissions.go:116 permission denied for user alice on path /d/f00756 for permission list I1117 09:40:57.803089 sftp_permissions.go:116 permission denied for user alice on path /d/f00757 for permission list I1117 09:40:57.815169 sftp_permissions.go:116 permission denied for user alice on path /d/f00758 for permission list I1117 09:40:57.826677 sftp_permissions.go:116 permission denied for user alice on path /d/f00759 for permission list I1117 09:40:57.838252 sftp_permissions.go:116 permission denied for user alice on path /d/f00760 for permission list I1117 09:40:57.850324 sftp_permissions.go:116 permission denied for user alice on path /d/f00761 for permission list I1117 09:40:57.862404 sftp_permissions.go:116 permission denied for user alice on path /d/f00762 for permission list I1117 09:40:57.874371 sftp_permissions.go:116 permission denied for user alice on path /d/f00763 for permission list I1117 09:40:57.886741 sftp_permissions.go:116 permission denied for user alice on path /d/f00764 for permission list I1117 09:40:57.904917 sftp_permissions.go:116 permission denied for user alice on path /d/f00765 for permission list I1117 09:40:57.917749 sftp_permissions.go:116 permission denied for user alice on path /d/f00766 for permission list I1117 09:40:57.929567 sftp_permissions.go:116 permission denied for user alice on path /d/f00767 for permission list I1117 09:40:57.940657 sftp_permissions.go:116 permission denied for user alice on path /d/f00768 for permission list I1117 09:40:57.952580 sftp_permissions.go:116 permission denied for user alice on path /d/f00769 for permission list I1117 09:40:57.964063 sftp_permissions.go:116 permission denied for user alice on path /d/f00770 for permission list I1117 09:40:57.975857 sftp_permissions.go:116 permission denied for user alice on path /d/f00771 for permission list I1117 09:40:57.987037 sftp_permissions.go:116 permission denied for user alice on path /d/f00772 for permission list I1117 09:40:58.002498 sftp_permissions.go:116 permission denied for user alice on path /d/f00773 for permission list I1117 09:40:58.019165 sftp_permissions.go:116 permission denied for user alice on path /d/f00774 for permission list I1117 09:40:58.031803 sftp_permissions.go:116 permission denied for user alice on path /d/f00775 for permission list I1117 09:40:58.043900 sftp_permissions.go:116 permission denied for user alice on path /d/f00776 for permission list I1117 09:40:58.055674 sftp_permissions.go:116 permission denied for user alice on path /d/f00777 for permission list I1117 09:40:58.069319 sftp_permissions.go:116 permission denied for user alice on path /d/f00778 for permission list I1117 09:40:58.081561 sftp_permissions.go:116 permission denied for user alice on path /d/f00779 for permission list I1117 09:40:58.092721 sftp_permissions.go:116 permission denied for user alice on path /d/f00780 for permission list I1117 09:40:58.104449 sftp_permissions.go:116 permission denied for user alice on path /d/f00781 for permission list I1117 09:40:58.116655 sftp_permissions.go:116 permission denied for user alice on path /d/f00782 for permission list I1117 09:40:58.129098 sftp_permissions.go:116 permission denied for user alice on path /d/f00783 for permission list I1117 09:40:58.140824 sftp_permissions.go:116 permission denied for user alice on path /d/f00784 for permission list I1117 09:40:58.152957 sftp_permissions.go:116 permission denied for user alice on path /d/f00785 for permission list I1117 09:40:58.165983 sftp_permissions.go:116 permission denied for user alice on path /d/f00786 for permission list I1117 09:40:58.179534 sftp_permissions.go:116 permission denied for user alice on path /d/f00787 for permission list I1117 09:40:58.193233 sftp_permissions.go:116 permission denied for user alice on path /d/f00788 for permission list I1117 09:40:58.206174 sftp_permissions.go:116 permission denied for user alice on path /d/f00789 for permission list I1117 09:40:58.220154 sftp_permissions.go:116 permission denied for user alice on path /d/f00790 for permission list I1117 09:40:58.235841 sftp_permissions.go:116 permission denied for user alice on path /d/f00791 for permission list I1117 09:40:58.249874 sftp_permissions.go:116 permission denied for user alice on path /d/f00792 for permission list I1117 09:40:58.263088 sftp_permissions.go:116 permission denied for user alice on path /d/f00793 for permission list I1117 09:40:58.274995 sftp_permissions.go:116 permission denied for user alice on path /d/f00794 for permission list I1117 09:40:58.287066 sftp_permissions.go:116 permission denied for user alice on path /d/f00795 for permission list I1117 09:40:58.298779 sftp_permissions.go:116 permission denied for user alice on path /d/f00796 for permission list I1117 09:40:58.310627 sftp_permissions.go:116 permission denied for user alice on path /d/f00797 for permission list I1117 09:40:58.323433 sftp_permissions.go:116 permission denied for user alice on path /d/f00798 for permission list I1117 09:40:58.335058 sftp_permissions.go:116 permission denied for user alice on path /d/f00799 for permission list I1117 09:40:58.348055 sftp_permissions.go:116 permission denied for user alice on path /d/f00800 for permission list I1117 09:40:58.364636 sftp_permissions.go:116 permission denied for user alice on path /d/f00801 for permission list I1117 09:40:58.377171 sftp_permissions.go:116 permission denied for user alice on path /d/f00802 for permission list I1117 09:40:58.390005 sftp_permissions.go:116 permission denied for user alice on path /d/f00803 for permission list I1117 09:40:58.403687 sftp_permissions.go:116 permission denied for user alice on path /d/f00804 for permission list I1117 09:40:58.418003 sftp_permissions.go:116 permission denied for user alice on path /d/f00805 for permission list I1117 09:40:58.431095 sftp_permissions.go:116 permission denied for user alice on path /d/f00806 for permission list I1117 09:40:58.450718 sftp_permissions.go:116 permission denied for user alice on path /d/f00807 for permission list I1117 09:40:58.463987 sftp_permissions.go:116 permission denied for user alice on path /d/f00808 for permission list I1117 09:40:58.477921 sftp_permissions.go:116 permission denied for user alice on path /d/f00809 for permission list I1117 09:40:58.490419 sftp_permissions.go:116 permission denied for user alice on path /d/f00810 for permission list I1117 09:40:58.503136 sftp_permissions.go:116 permission denied for user alice on path /d/f00811 for permission list I1117 09:40:58.515341 sftp_permissions.go:116 permission denied for user alice on path /d/f00812 for permission list I1117 09:40:58.527128 sftp_permissions.go:116 permission denied for user alice on path /d/f00813 for permission list I1117 09:40:58.537932 sftp_permissions.go:116 permission denied for user alice on path /d/f00814 for permission list I1117 09:40:58.549801 sftp_permissions.go:116 permission denied for user alice on path /d/f00815 for permission list I1117 09:40:58.561682 sftp_permissions.go:116 permission denied for user alice on path /d/f00816 for permission list I1117 09:40:58.573610 sftp_permissions.go:116 permission denied for user alice on path /d/f00817 for permission list I1117 09:40:58.585493 sftp_permissions.go:116 permission denied for user alice on path /d/f00818 for permission list I1117 09:40:58.597489 sftp_permissions.go:116 permission denied for user alice on path /d/f00819 for permission list I1117 09:40:58.614571 sftp_permissions.go:116 permission denied for user alice on path /d/f00820 for permission list I1117 09:40:58.627432 sftp_permissions.go:116 permission denied for user alice on path /d/f00821 for permission list I1117 09:40:58.638546 sftp_permissions.go:116 permission denied for user alice on path /d/f00822 for permission list I1117 09:40:58.651206 sftp_permissions.go:116 permission denied for user alice on path /d/f00823 for permission list I1117 09:40:58.665272 sftp_permissions.go:116 permission denied for user alice on path /d/f00824 for permission list I1117 09:40:58.679409 sftp_permissions.go:116 permission denied for user alice on path /d/f00825 for permission list I1117 09:40:58.693856 sftp_permissions.go:116 permission denied for user alice on path /d/f00826 for permission list I1117 09:40:58.705980 sftp_permissions.go:116 permission denied for user alice on path /d/f00827 for permission list I1117 09:40:58.718714 sftp_permissions.go:116 permission denied for user alice on path /d/f00828 for permission list I1117 09:40:58.730308 sftp_permissions.go:116 permission denied for user alice on path /d/f00829 for permission list I1117 09:40:58.741935 sftp_permissions.go:116 permission denied for user alice on path /d/f00830 for permission list I1117 09:40:58.754216 sftp_permissions.go:116 permission denied for user alice on path /d/f00831 for permission list I1117 09:40:58.765824 sftp_permissions.go:116 permission denied for user alice on path /d/f00832 for permission list I1117 09:40:58.778027 sftp_permissions.go:116 permission denied for user alice on path /d/f00833 for permission list I1117 09:40:58.789398 sftp_permissions.go:116 permission denied for user alice on path /d/f00834 for permission list I1117 09:40:58.800755 sftp_permissions.go:116 permission denied for user alice on path /d/f00835 for permission list I1117 09:40:58.812935 sftp_permissions.go:116 permission denied for user alice on path /d/f00836 for permission list I1117 09:40:58.825432 sftp_permissions.go:116 permission denied for user alice on path /d/f00837 for permission list I1117 09:40:58.838411 sftp_permissions.go:116 permission denied for user alice on path /d/f00838 for permission list I1117 09:40:58.850330 sftp_permissions.go:116 permission denied for user alice on path /d/f00839 for permission list I1117 09:40:58.862495 sftp_permissions.go:116 permission denied for user alice on path /d/f00840 for permission list I1117 09:40:58.880956 sftp_permissions.go:116 permission denied for user alice on path /d/f00841 for permission list I1117 09:40:58.893771 sftp_permissions.go:116 permission denied for user alice on path /d/f00842 for permission list I1117 09:40:58.906335 sftp_permissions.go:116 permission denied for user alice on path /d/f00843 for permission list I1117 09:40:58.918656 sftp_permissions.go:116 permission denied for user alice on path /d/f00844 for permission list I1117 09:40:58.932357 sftp_permissions.go:116 permission denied for user alice on path /d/f00845 for permission list I1117 09:40:58.945634 sftp_permissions.go:116 permission denied for user alice on path /d/f00846 for permission list I1117 09:40:58.957408 sftp_permissions.go:116 permission denied for user alice on path /d/f00847 for permission list I1117 09:40:58.969010 sftp_permissions.go:116 permission denied for user alice on path /d/f00848 for permission list I1117 09:40:58.981061 sftp_permissions.go:116 permission denied for user alice on path /d/f00849 for permission list I1117 09:40:58.993097 sftp_permissions.go:116 permission denied for user alice on path /d/f00850 for permission list I1117 09:40:59.009787 sftp_permissions.go:116 permission denied for user alice on path /d/f00851 for permission list I1117 09:40:59.021942 sftp_permissions.go:116 permission denied for user alice on path /d/f00852 for permission list I1117 09:40:59.032906 sftp_permissions.go:116 permission denied for user alice on path /d/f00853 for permission list I1117 09:40:59.043430 sftp_permissions.go:116 permission denied for user alice on path /d/f00854 for permission list I1117 09:40:59.054771 sftp_permissions.go:116 permission denied for user alice on path /d/f00855 for permission list I1117 09:40:59.066369 sftp_permissions.go:116 permission denied for user alice on path /d/f00856 for permission list I1117 09:40:59.078852 sftp_permissions.go:116 permission denied for user alice on path /d/f00857 for permission list I1117 09:40:59.091177 sftp_permissions.go:116 permission denied for user alice on path /d/f00858 for permission list I1117 09:40:59.103364 sftp_permissions.go:116 permission denied for user alice on path /d/f00859 for permission list I1117 09:40:59.126988 sftp_permissions.go:116 permission denied for user alice on path /d/f00860 for permission list I1117 09:40:59.141511 sftp_permissions.go:116 permission denied for user alice on path /d/f00861 for permission list I1117 09:40:59.151927 sftp_permissions.go:116 permission denied for user alice on path /d/f00862 for permission list I1117 09:40:59.163720 sftp_permissions.go:116 permission denied for user alice on path /d/f00863 for permission list I1117 09:40:59.176087 sftp_permissions.go:116 permission denied for user alice on path /d/f00864 for permission list I1117 09:40:59.189104 sftp_permissions.go:116 permission denied for user alice on path /d/f00865 for permission list I1117 09:40:59.203153 sftp_permissions.go:116 permission denied for user alice on path /d/f00866 for permission list I1117 09:40:59.214675 sftp_permissions.go:116 permission denied for user alice on path /d/f00867 for permission list I1117 09:40:59.231478 sftp_permissions.go:116 permission denied for user alice on path /d/f00868 for permission list I1117 09:40:59.243816 sftp_permissions.go:116 permission denied for user alice on path /d/f00869 for permission list I1117 09:40:59.255942 sftp_permissions.go:116 permission denied for user alice on path /d/f00870 for permission list I1117 09:40:59.267875 sftp_permissions.go:116 permission denied for user alice on path /d/f00871 for permission list I1117 09:40:59.280564 sftp_permissions.go:116 permission denied for user alice on path /d/f00872 for permission list I1117 09:40:59.293253 sftp_permissions.go:116 permission denied for user alice on path /d/f00873 for permission list I1117 09:40:59.305924 sftp_permissions.go:116 permission denied for user alice on path /d/f00874 for permission list I1117 09:40:59.318601 sftp_permissions.go:116 permission denied for user alice on path /d/f00875 for permission list I1117 09:40:59.330766 sftp_permissions.go:116 permission denied for user alice on path /d/f00876 for permission list I1117 09:40:59.342656 sftp_permissions.go:116 permission denied for user alice on path /d/f00877 for permission list I1117 09:40:59.354551 sftp_permissions.go:116 permission denied for user alice on path /d/f00878 for permission list I1117 09:40:59.377222 sftp_permissions.go:116 permission denied for user alice on path /d/f00879 for permission list I1117 09:40:59.389612 sftp_permissions.go:116 permission denied for user alice on path /d/f00880 for permission list I1117 09:40:59.402015 sftp_permissions.go:116 permission denied for user alice on path /d/f00881 for permission list I1117 09:40:59.414899 sftp_permissions.go:116 permission denied for user alice on path /d/f00882 for permission list I1117 09:40:59.425935 sftp_permissions.go:116 permission denied for user alice on path /d/f00883 for permission list I1117 09:40:59.439259 sftp_permissions.go:116 permission denied for user alice on path /d/f00884 for permission list I1117 09:40:59.452913 sftp_permissions.go:116 permission denied for user alice on path /d/f00885 for permission list I1117 09:40:59.465533 sftp_permissions.go:116 permission denied for user alice on path /d/f00886 for permission list I1117 09:40:59.475995 sftp_permissions.go:116 permission denied for user alice on path /d/f00887 for permission list I1117 09:40:59.487515 sftp_permissions.go:116 permission denied for user alice on path /d/f00888 for permission list I1117 09:40:59.499532 sftp_permissions.go:116 permission denied for user alice on path /d/f00889 for permission list I1117 09:40:59.511290 sftp_permissions.go:116 permission denied for user alice on path /d/f00890 for permission list I1117 09:40:59.528581 sftp_permissions.go:116 permission denied for user alice on path /d/f00891 for permission list I1117 09:40:59.540127 sftp_permissions.go:116 permission denied for user alice on path /d/f00892 for permission list I1117 09:40:59.552659 sftp_permissions.go:116 permission denied for user alice on path /d/f00893 for permission list I1117 09:40:59.564673 sftp_permissions.go:116 permission denied for user alice on path /d/f00894 for permission list I1117 09:40:59.577610 sftp_permissions.go:116 permission denied for user alice on path /d/f00895 for permission list I1117 09:40:59.590898 sftp_permissions.go:116 permission denied for user alice on path /d/f00896 for permission list I1117 09:40:59.603143 sftp_permissions.go:116 permission denied for user alice on path /d/f00897 for permission list I1117 09:40:59.614946 sftp_permissions.go:116 permission denied for user alice on path /d/f00898 for permission list I1117 09:40:59.626652 sftp_permissions.go:116 permission denied for user alice on path /d/f00899 for permission list I1117 09:40:59.638643 sftp_permissions.go:116 permission denied for user alice on path /d/f00900 for permission list I1117 09:40:59.651122 sftp_permissions.go:116 permission denied for user alice on path /d/f00901 for permission list I1117 09:40:59.663031 sftp_permissions.go:116 permission denied for user alice on path /d/f00902 for permission list I1117 09:40:59.675324 sftp_permissions.go:116 permission denied for user alice on path /d/f00903 for permission list I1117 09:40:59.688043 sftp_permissions.go:116 permission denied for user alice on path /d/f00904 for permission list I1117 09:40:59.700197 sftp_permissions.go:116 permission denied for user alice on path /d/f00905 for permission list I1117 09:40:59.712383 sftp_permissions.go:116 permission denied for user alice on path /d/f00906 for permission list I1117 09:40:59.724338 sftp_permissions.go:116 permission denied for user alice on path /d/f00907 for permission list I1117 09:40:59.737535 sftp_permissions.go:116 permission denied for user alice on path /d/f00908 for permission list I1117 09:40:59.750233 sftp_permissions.go:116 permission denied for user alice on path /d/f00909 for permission list I1117 09:40:59.764464 sftp_permissions.go:116 permission denied for user alice on path /d/f00910 for permission list I1117 09:40:59.778614 sftp_permissions.go:116 permission denied for user alice on path /d/f00911 for permission list I1117 09:40:59.789885 sftp_permissions.go:116 permission denied for user alice on path /d/f00912 for permission list I1117 09:40:59.801243 sftp_permissions.go:116 permission denied for user alice on path /d/f00913 for permission list I1117 09:40:59.812075 sftp_permissions.go:116 permission denied for user alice on path /d/f00914 for permission list I1117 09:40:59.822775 sftp_permissions.go:116 permission denied for user alice on path /d/f00915 for permission list I1117 09:40:59.834060 sftp_permissions.go:116 permission denied for user alice on path /d/f00916 for permission list I1117 09:40:59.845323 sftp_permissions.go:116 permission denied for user alice on path /d/f00917 for permission list I1117 09:40:59.857212 sftp_permissions.go:116 permission denied for user alice on path /d/f00918 for permission list I1117 09:40:59.870288 sftp_permissions.go:116 permission denied for user alice on path /d/f00919 for permission list I1117 09:40:59.883859 sftp_permissions.go:116 permission denied for user alice on path /d/f00920 for permission list I1117 09:40:59.901201 sftp_permissions.go:116 permission denied for user alice on path /d/f00921 for permission list I1117 09:40:59.913985 sftp_permissions.go:116 permission denied for user alice on path /d/f00922 for permission list I1117 09:40:59.925708 sftp_permissions.go:116 permission denied for user alice on path /d/f00923 for permission list I1117 09:40:59.936970 sftp_permissions.go:116 permission denied for user alice on path /d/f00924 for permission list I1117 09:40:59.948960 sftp_permissions.go:116 permission denied for user alice on path /d/f00925 for permission list I1117 09:40:59.960133 sftp_permissions.go:116 permission denied for user alice on path /d/f00926 for permission list I1117 09:40:59.971994 sftp_permissions.go:116 permission denied for user alice on path /d/f00927 for permission list I1117 09:40:59.984594 sftp_permissions.go:116 permission denied for user alice on path /d/f00928 for permission list I1117 09:40:59.996674 sftp_permissions.go:116 permission denied for user alice on path /d/f00929 for permission list I1117 09:41:00.009901 sftp_permissions.go:116 permission denied for user alice on path /d/f00930 for permission list I1117 09:41:00.024698 sftp_permissions.go:116 permission denied for user alice on path /d/f00931 for permission list I1117 09:41:00.036467 sftp_permissions.go:116 permission denied for user alice on path /d/f00932 for permission list I1117 09:41:00.047702 sftp_permissions.go:116 permission denied for user alice on path /d/f00933 for permission list I1117 09:41:00.059636 sftp_permissions.go:116 permission denied for user alice on path /d/f00934 for permission list I1117 09:41:00.072585 sftp_permissions.go:116 permission denied for user alice on path /d/f00935 for permission list I1117 09:41:00.085983 sftp_permissions.go:116 permission denied for user alice on path /d/f00936 for permission list I1117 09:41:00.099005 sftp_permissions.go:116 permission denied for user alice on path /d/f00937 for permission list I1117 09:41:00.110799 sftp_permissions.go:116 permission denied for user alice on path /d/f00938 for permission list I1117 09:41:00.122571 sftp_permissions.go:116 permission denied for user alice on path /d/f00939 for permission list I1117 09:41:00.141926 sftp_permissions.go:116 permission denied for user alice on path /d/f00940 for permission list I1117 09:41:00.153965 sftp_permissions.go:116 permission denied for user alice on path /d/f00941 for permission list I1117 09:41:00.166772 sftp_permissions.go:116 permission denied for user alice on path /d/f00942 for permission list I1117 09:41:00.179513 sftp_permissions.go:116 permission denied for user alice on path /d/f00943 for permission list I1117 09:41:00.192159 sftp_permissions.go:116 permission denied for user alice on path /d/f00944 for permission list I1117 09:41:00.204755 sftp_permissions.go:116 permission denied for user alice on path /d/f00945 for permission list I1117 09:41:00.217330 sftp_permissions.go:116 permission denied for user alice on path /d/f00946 for permission list I1117 09:41:00.229855 sftp_permissions.go:116 permission denied for user alice on path /d/f00947 for permission list I1117 09:41:00.242121 sftp_permissions.go:116 permission denied for user alice on path /d/f00948 for permission list I1117 09:41:00.258599 sftp_permissions.go:116 permission denied for user alice on path /d/f00949 for permission list I1117 09:41:00.270790 sftp_permissions.go:116 permission denied for user alice on path /d/f00950 for permission list I1117 09:41:00.282641 sftp_permissions.go:116 permission denied for user alice on path /d/f00951 for permission list I1117 09:41:00.294425 sftp_permissions.go:116 permission denied for user alice on path /d/f00952 for permission list I1117 09:41:00.306596 sftp_permissions.go:116 permission denied for user alice on path /d/f00953 for permission list I1117 09:41:00.319107 sftp_permissions.go:116 permission denied for user alice on path /d/f00954 for permission list I1117 09:41:00.331382 sftp_permissions.go:116 permission denied for user alice on path /d/f00955 for permission list I1117 09:41:00.342977 sftp_permissions.go:116 permission denied for user alice on path /d/f00956 for permission list I1117 09:41:00.355127 sftp_permissions.go:116 permission denied for user alice on path /d/f00957 for permission list I1117 09:41:00.372436 sftp_permissions.go:116 permission denied for user alice on path /d/f00958 for permission list I1117 09:41:00.385591 sftp_permissions.go:116 permission denied for user alice on path /d/f00959 for permission list I1117 09:41:00.398376 sftp_permissions.go:116 permission denied for user alice on path /d/f00960 for permission list I1117 09:41:00.409955 sftp_permissions.go:116 permission denied for user alice on path /d/f00961 for permission list I1117 09:41:00.424494 sftp_permissions.go:116 permission denied for user alice on path /d/f00962 for permission list I1117 09:41:00.436381 sftp_permissions.go:116 permission denied for user alice on path /d/f00963 for permission list I1117 09:41:00.448803 sftp_permissions.go:116 permission denied for user alice on path /d/f00964 for permission list I1117 09:41:00.461448 sftp_permissions.go:116 permission denied for user alice on path /d/f00965 for permission list I1117 09:41:00.473449 sftp_permissions.go:116 permission denied for user alice on path /d/f00966 for permission list I1117 09:41:00.487717 sftp_permissions.go:116 permission denied for user alice on path /d/f00967 for permission list I1117 09:41:00.501905 sftp_permissions.go:116 permission denied for user alice on path /d/f00968 for permission list I1117 09:41:00.515416 sftp_permissions.go:116 permission denied for user alice on path /d/f00969 for permission list I1117 09:41:00.527038 sftp_permissions.go:116 permission denied for user alice on path /d/f00970 for permission list I1117 09:41:00.539400 sftp_permissions.go:116 permission denied for user alice on path /d/f00971 for permission list I1117 09:41:00.551022 sftp_permissions.go:116 permission denied for user alice on path /d/f00972 for permission list I1117 09:41:00.562473 sftp_permissions.go:116 permission denied for user alice on path /d/f00973 for permission list I1117 09:41:00.574079 sftp_permissions.go:116 permission denied for user alice on path /d/f00974 for permission list I1117 09:41:00.585939 sftp_permissions.go:116 permission denied for user alice on path /d/f00975 for permission list I1117 09:41:00.598139 sftp_permissions.go:116 permission denied for user alice on path /d/f00976 for permission list I1117 09:41:00.612845 sftp_permissions.go:116 permission denied for user alice on path /d/f00977 for permission list I1117 09:41:00.625995 sftp_permissions.go:116 permission denied for user alice on path /d/f00978 for permission list I1117 09:41:00.637872 sftp_permissions.go:116 permission denied for user alice on path /d/f00979 for permission list I1117 09:41:00.649318 sftp_permissions.go:116 permission denied for user alice on path /d/f00980 for permission list I1117 09:41:00.664709 sftp_permissions.go:116 permission denied for user alice on path /d/f00981 for permission list I1117 09:41:00.678132 sftp_permissions.go:116 permission denied for user alice on path /d/f00982 for permission list I1117 09:41:00.690258 sftp_permissions.go:116 permission denied for user alice on path /d/f00983 for permission list I1117 09:41:00.703114 sftp_permissions.go:116 permission denied for user alice on path /d/f00984 for permission list I1117 09:41:00.714837 sftp_permissions.go:116 permission denied for user alice on path /d/f00985 for permission list I1117 09:41:00.727699 sftp_permissions.go:116 permission denied for user alice on path /d/f00986 for permission list I1117 09:41:00.740059 sftp_permissions.go:116 permission denied for user alice on path /d/f00987 for permission list I1117 09:41:00.752891 sftp_permissions.go:116 permission denied for user alice on path /d/f00988 for permission list I1117 09:41:00.764676 sftp_permissions.go:116 permission denied for user alice on path /d/f00989 for permission list I1117 09:41:00.776728 sftp_permissions.go:116 permission denied for user alice on path /d/f00990 for permission list I1117 09:41:00.789388 sftp_permissions.go:116 permission denied for user alice on path /d/f00991 for permission list I1117 09:41:00.803717 sftp_permissions.go:116 permission denied for user alice on path /d/f00992 for permission list I1117 09:41:00.817919 sftp_permissions.go:116 permission denied for user alice on path /d/f00993 for permission list I1117 09:41:00.830766 sftp_permissions.go:116 permission denied for user alice on path /d/f00994 for permission list I1117 09:41:00.842681 sftp_permissions.go:116 permission denied for user alice on path /d/f00995 for permission list I1117 09:41:00.854508 sftp_permissions.go:116 permission denied for user alice on path /d/f00996 for permission list I1117 09:41:00.867960 sftp_permissions.go:116 permission denied for user alice on path /d/f00997 for permission list I1117 09:41:00.882204 sftp_permissions.go:116 permission denied for user alice on path /d/f00998 for permission list I1117 09:41:00.894355 sftp_permissions.go:116 permission denied for user alice on path /d/f00999 for permission list --- PASS: TestListAllPagesContinuesPastFullyHiddenPage (13.92s) === RUN TestPathWithin --- PASS: TestPathWithin (0.00s) === RUN TestHasExplicitPermissionSiblingPrefix --- PASS: TestHasExplicitPermissionSiblingPrefix (0.00s) === RUN TestIsPathInHomeDirectorySiblingPrefix --- PASS: TestIsPathInHomeDirectorySiblingPrefix (0.00s) === RUN TestNewFileWriterChecksTargetFile I1117 09:41:01.053080 sftp_permissions.go:116 permission denied for user alice on path /home/alice/locked.txt for permission write E1117 09:41:01.053416 sftp_filer.go:157 Permission denied for /home/alice/locked.txt --- PASS: TestNewFileWriterChecksTargetFile (0.13s) === RUN TestRequireParentDirEnforced --- PASS: TestRequireParentDirEnforced (0.12s) === RUN TestMakeDirExistingPath I1117 09:41:01.309829 filer_client.go:306 mkdir directory:"/home/alice" entry:{name:"d" is_directory:true attributes:{mtime:1794908461 file_mode:2147484096 uid:1000 gid:1000 crtime:1794908461} extended:{key:"creator" value:"alice"}} o_excl:true: CreateEntry /home/alice/d: entry already exists I1117 09:41:01.333715 filer_client.go:306 mkdir directory:"/home/alice" entry:{name:"a.t" is_directory:true attributes:{mtime:1794908461 file_mode:2147484096 uid:1000 gid:1000 crtime:1794908461} extended:{key:"creator" value:"alice"}} o_excl:true: CreateEntry /home/alice/a.t: entry already exists --- PASS: TestMakeDirExistingPath (0.06s) === RUN TestRenameEntryChecksTargetFile I1117 09:41:01.421858 sftp_permissions.go:116 permission denied for user alice on path /home/alice/locked.txt for permission delete --- PASS: TestRenameEntryChecksTargetFile (0.15s) === RUN TestRenameEntryKeepsNestedAcl I1117 09:41:01.530857 sftp_filer.go:409 permission denied for user alice: rename of /home/alice/sub to /home/alice/sub2 would drop the ACL on /home/alice/sub/ro.txt --- PASS: TestRenameEntryKeepsNestedAcl (0.07s) === RUN TestCheckFilePermissionMissingAncestorsTerminates --- PASS: TestCheckFilePermissionMissingAncestorsTerminates (0.02s) === RUN TestRenameEntryKeepsInheritedAndDestinationAcl I1117 09:41:01.612299 sftp_filer.go:409 permission denied for user alice: rename of /home/alice/restricted/sub to /home/alice/sub5 would drop the ACL on /home/alice/restricted/sub I1117 09:41:01.645779 sftp_filer.go:409 permission denied for user alice: rename of /home/alice/sub to /home/alice/sub2 would drop the ACL on /home/alice/sub/locked/secret --- PASS: TestRenameEntryKeepsInheritedAndDestinationAcl (0.10s) === RUN TestRenameEntryNewNameNeedsNoDelete I1117 09:41:01.712895 sftp_permissions.go:116 permission denied for user alice on path /home/alice for permission delete I1117 09:41:01.734832 sftp_permissions.go:116 permission denied for user alice on path /home/alice/existing.txt for permission delete I1117 09:41:01.743936 sftp_filer.go:323 permission denied for user alice: rename target /home/alice/reserved.txt carries a delete-protected ACL --- PASS: TestRenameEntryNewNameNeedsNoDelete (0.08s) === RUN TestRenameEntryFailsClosedOnLookupError I1117 09:41:01.846709 sftp_filer.go:409 permission denied for user alice: rename of /home/alice/sub to /home/alice/sub2 would drop the ACL on /home/alice/sub/ro.txt --- PASS: TestRenameEntryFailsClosedOnLookupError (0.08s) === RUN TestRenameEntryKeepsReadAndListAcl I1117 09:41:01.876764 sftp_filer.go:409 permission denied for user alice: rename of /home/alice/noread to /home/alice/visible would drop the ACL on /home/alice/noread --- PASS: TestRenameEntryKeepsReadAndListAcl (0.03s) === RUN TestRenameEntryKeepsFileChildAcl I1117 09:41:01.909699 sftp_filer.go:409 permission denied for user alice: rename of /home/alice/private to /home/alice/public would drop the ACL on /home/alice/private --- PASS: TestRenameEntryKeepsFileChildAcl (0.06s) === RUN TestRenameEntryRejectsConcurrentTarget I1117 09:41:01.963020 sftp_permissions.go:116 permission denied for user alice on path /home/alice for permission delete I1117 09:41:01.986183 sftp_permissions.go:116 permission denied for user alice on path /home/alice for permission delete --- PASS: TestRenameEntryRejectsConcurrentTarget (0.06s) === RUN TestToAbsolutePath === RUN TestToAbsolutePath/normal_path === RUN TestToAbsolutePath/root_path === RUN TestToAbsolutePath/path_with_dot === RUN TestToAbsolutePath/path_traversal_attempts === RUN TestToAbsolutePath/path_traversal_attempts_2 === RUN TestToAbsolutePath/path_traversal_attempts_3 === RUN TestToAbsolutePath/empty_path === RUN TestToAbsolutePath/multiple_slashes === RUN TestToAbsolutePath/trailing_slash === RUN TestToAbsolutePath/empty_HomeDir_passthrough === RUN TestToAbsolutePath/root_HomeDir_passthrough --- PASS: TestToAbsolutePath (0.02s) --- PASS: TestToAbsolutePath/normal_path (0.00s) --- PASS: TestToAbsolutePath/root_path (0.00s) --- PASS: TestToAbsolutePath/path_with_dot (0.00s) --- PASS: TestToAbsolutePath/path_traversal_attempts (0.00s) --- PASS: TestToAbsolutePath/path_traversal_attempts_2 (0.00s) --- PASS: TestToAbsolutePath/path_traversal_attempts_3 (0.00s) --- PASS: TestToAbsolutePath/empty_path (0.00s) --- PASS: TestToAbsolutePath/multiple_slashes (0.00s) --- PASS: TestToAbsolutePath/trailing_slash (0.00s) --- PASS: TestToAbsolutePath/empty_HomeDir_passthrough (0.00s) --- PASS: TestToAbsolutePath/root_HomeDir_passthrough (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/sftpd 28.325s === RUN TestManager_CertificateTakesOverPublicKeyChannel --- PASS: TestManager_CertificateTakesOverPublicKeyChannel (0.11s) === RUN TestManager_PublicKeyOnlyChannel --- PASS: TestManager_PublicKeyOnlyChannel (0.01s) === RUN TestManager_CertificateRequiresCAFile --- PASS: TestManager_CertificateRequiresCAFile (0.00s) === RUN TestCertificateAuthenticator_GoldenPath --- PASS: TestCertificateAuthenticator_GoldenPath (0.02s) === RUN TestCertificateAuthenticator_RejectsPlainPublicKey --- PASS: TestCertificateAuthenticator_RejectsPlainPublicKey (0.01s) === RUN TestCertificateAuthenticator_RejectsHostCert --- PASS: TestCertificateAuthenticator_RejectsHostCert (0.01s) === RUN TestCertificateAuthenticator_RejectsEmptyPrincipals --- PASS: TestCertificateAuthenticator_RejectsEmptyPrincipals (0.01s) === RUN TestCertificateAuthenticator_RejectsWrongPrincipal --- PASS: TestCertificateAuthenticator_RejectsWrongPrincipal (0.01s) === RUN TestCertificateAuthenticator_RejectsExpiredCert --- PASS: TestCertificateAuthenticator_RejectsExpiredCert (0.01s) === RUN TestCertificateAuthenticator_RejectsUnknownCA --- PASS: TestCertificateAuthenticator_RejectsUnknownCA (0.01s) === RUN TestCertificateAuthenticator_RejectsUnknownUser --- PASS: TestCertificateAuthenticator_RejectsUnknownUser (0.03s) === RUN TestCertificateAuthenticator_LoadsMultipleCAKeys --- PASS: TestCertificateAuthenticator_LoadsMultipleCAKeys (0.03s) === RUN TestNewCertificateAuthenticator_DisabledIgnoresFile --- PASS: TestNewCertificateAuthenticator_DisabledIgnoresFile (0.00s) === RUN TestNewCertificateAuthenticator_EnabledRequiresFile --- PASS: TestNewCertificateAuthenticator_EnabledRequiresFile (0.00s) === RUN TestNewCertificateAuthenticator_MissingFile --- PASS: TestNewCertificateAuthenticator_MissingFile (0.00s) === RUN TestPasswordAuthenticatorRejectsEmptyPassword --- PASS: TestPasswordAuthenticatorRejectsEmptyPassword (0.30s) === RUN TestPasswordAuthenticatorConsultsStore --- PASS: TestPasswordAuthenticatorConsultsStore (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/sftpd/auth 0.974s === RUN TestValidatePasswordRejectsEmpty --- PASS: TestValidatePasswordRejectsEmpty (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/sftpd/user 0.449s ? github.com/seaweedfs/seaweedfs/weed/sftpd/utils [no test files] === RUN TestRaftLeaderTransfer_Name --- PASS: TestRaftLeaderTransfer_Name (0.00s) === RUN TestRaftLeaderTransfer_Help --- PASS: TestRaftLeaderTransfer_Help (0.00s) === RUN TestRaftLeaderTransfer_HasTag --- PASS: TestRaftLeaderTransfer_HasTag (0.00s) === RUN TestRaftLeaderTransfer_ValidateTargetIdWithoutAddress --- PASS: TestRaftLeaderTransfer_ValidateTargetIdWithoutAddress (0.00s) === RUN TestRaftLeaderTransfer_ValidateTargetAddressWithoutId --- PASS: TestRaftLeaderTransfer_ValidateTargetAddressWithoutId (0.00s) === RUN TestRaftLeaderTransfer_UnknownFlag flag provided but not defined: -unknown-flag Usage of cluster.raft.transferLeader: -address string target server grpc address (must be used with -id) -id string target server id (must be used with -address) --- PASS: TestRaftLeaderTransfer_UnknownFlag (0.00s) === RUN TestPrintClusterInfo --- PASS: TestPrintClusterInfo (0.01s) === RUN TestPrintClusterInfo_multiDiskPerNode --- PASS: TestPrintClusterInfo_multiDiskPerNode (0.01s) === RUN TestPrintVolumeInfo --- PASS: TestPrintVolumeInfo (0.31s) === RUN TestPrintStorageInfo --- PASS: TestPrintStorageInfo (0.39s) === RUN TestPrintFilesInfo --- PASS: TestPrintFilesInfo (0.01s) === RUN TestCollectCollectionInfoEC --- PASS: TestCollectCollectionInfoEC (0.00s) === RUN TestCollectCollectionInfoMixed --- PASS: TestCollectCollectionInfoMixed (0.00s) === RUN TestCollectCollectionInfoRegularVolumeDedupesReplicas --- PASS: TestCollectCollectionInfoRegularVolumeDedupesReplicas (0.00s) === RUN TestCollectionListIncludesOfflineNamespace I1117 09:40:48.640657 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{leader:"127.0.0.1:0.41993"} --- PASS: TestCollectionListIncludesOfflineNamespace (0.45s) === RUN TestCompileCollectionPattern --- PASS: TestCompileCollectionPattern (0.01s) === RUN TestCommandsReturnFlagParseErrors === RUN TestCommandsReturnFlagParseErrors/cluster.check flag provided but not defined: -notAFlagOfAnyCommand Usage of cluster.check: === RUN TestCommandsReturnFlagParseErrors/cluster.ps flag provided but not defined: -notAFlagOfAnyCommand Usage of cluster.ps: === RUN TestCommandsReturnFlagParseErrors/cluster.raft.add flag provided but not defined: -notAFlagOfAnyCommand Usage of cluster.raft.add: -address string server grpc address -id string server id -voter assign it a vote (default true) === RUN TestCommandsReturnFlagParseErrors/cluster.raft.transferLeader flag provided but not defined: -notAFlagOfAnyCommand Usage of cluster.raft.transferLeader: -address string target server grpc address (must be used with -id) -id string target server id (must be used with -address) === RUN TestCommandsReturnFlagParseErrors/cluster.raft.ps flag provided but not defined: -notAFlagOfAnyCommand Usage of cluster.raft.ps: === RUN TestCommandsReturnFlagParseErrors/cluster.raft.remove flag provided but not defined: -notAFlagOfAnyCommand Usage of cluster.raft.remove: -id string server id === RUN TestCommandsReturnFlagParseErrors/cluster.status flag provided but not defined: -notAFlagOfAnyCommand Usage of cluster.status: -files include detailed file metrics, from all volume servers -humanize human-readable output (default true) -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) === RUN TestCommandsReturnFlagParseErrors/collection.delete flag provided but not defined: -notAFlagOfAnyCommand Usage of collection.delete: -apply apply the collection -collection string collection to delete. Use '_default' for the empty-named collection. -force apply the collection (alias for -apply) === RUN TestCommandsReturnFlagParseErrors/collection.list command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/ec.balance flag provided but not defined: -notAFlagOfAnyCommand Usage of ec.balance: -apply apply the balancing plan -collection string comma-separated collection names, wildcards, or regex patterns, "_default" for the collection with no name, or "EACH_COLLECTION" for each collection (default "EACH_COLLECTION") -dataCenter string only apply the balancing for this dataCenter -diskType string the disk type for EC shards (hdd, ssd, or empty for default hdd) -force apply the balancing plan (alias for -apply) -ioBytePerSecond int limit the speed of each shard copy; 0 falls back to the volume server's maintenance rate -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) -shardReplicaPlacement string replica placement for EC shards, or master default if empty -volumeIds string optional comma-separated list of ec volume ids to balance; defaults to all === RUN TestCommandsReturnFlagParseErrors/ec.check.replication flag provided but not defined: -notAFlagOfAnyCommand Usage of ec.check.replication: -details display result details, if available -volumeIds string comma-separated EC volume IDs to process (optional) === RUN TestCommandsReturnFlagParseErrors/ec.decode flag provided but not defined: -notAFlagOfAnyCommand Usage of ec.decode: -batchSize int decode up to this many volumes per topology refresh (0 = one snapshot for all volumes) (default 10) -checkMinFreeSpace check min free space when selecting the decode target (default true) -collection string comma-separated collection names, wildcards, or regex patterns; empty matches the collection with no name -diskType string source disk type where EC shards are stored (hdd, ssd, or empty for default hdd) -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/ec.encode flag provided but not defined: -notAFlagOfAnyCommand Usage of ec.encode: -batchSize int encode/re-balance/verify/delete up to this many volumes at a time (0 = all in one batch) (default 10) -collection string comma-separated collection names, wildcards, or regex patterns; empty matches the collection with no name -diskType string target disk type for EC shards (hdd, ssd, or empty for default hdd) -force force the encoding even if the cluster has less than recommended 4 nodes -fullPercent float the volume reaches the percentage of max volume size (default 95) -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) -quietFor duration select volumes without no writes for this period (default 1h0m0s) -rebalance re-balance EC shards after creation (default: true) (default true) -shardReplicaPlacement string replica placement for EC shards, or master default if empty -sourceDiskType string filter source volumes by disk type (hdd, ssd, or empty for all) -verbose show detailed reasons why volumes are not selected for encoding -volumeId int the volume id -volumeIds string comma-separated volume ids === RUN TestCommandsReturnFlagParseErrors/ec.rebuild flag provided but not defined: -notAFlagOfAnyCommand Usage of ec.rebuild: -apply apply the changes -checksum verify every shard against its checksum sidecar first, and rebuild the shards that fail it, also in volumes that have every shard -collection string comma-separated collection names, wildcards, or regex patterns, "_default" for the collection with no name, or "EACH_COLLECTION" for each collection (default "EACH_COLLECTION") -diskType string disk type for EC shards (hdd, ssd, or empty for default hdd) -force apply the changes (alias for -apply) -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) -volumeIds string optional comma-separated list of volume ID to process; defaults to all volumes in the collection === RUN TestCommandsReturnFlagParseErrors/ec.scrub flag provided but not defined: -notAFlagOfAnyCommand Usage of ec.scrub: -details display scrub result details, if available -forceDeletedNeedlesCheck force strict verification of deleted needles (full and reads modes only); may report false positives when EC indexes disagree -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) -mode string scrubbing mode (index/local/full/reads/checksum) (default "local") -node string comma-separated list of volume server : (optional) -volumeId string comma-separated EC volume IDs to process (optional) === RUN TestCommandsReturnFlagParseErrors/ec.shard.unmount flag provided but not defined: -notAFlagOfAnyCommand Usage of ec.shard.unmount: -apply Execute actions on the cluster. By default only lists what actions would be executed. -delete also delete the shard files after unmounting them -force Execute actions on the cluster (alias for -apply). -ignoreInvalid ignore user-provided shards that match nothing live, and try to proceed anyway -shardId string comma-separated EC shard IDs for the volume -volumeId uint volume ID for the shards to process === RUN TestCommandsReturnFlagParseErrors/fs.cat command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.cd command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.configure flag provided but not defined: -notAFlagOfAnyCommand Usage of fs.configure: -apply update and apply filer configuration -collection string assign writes to this collection -dataCenter string assign writes to this dataCenter -dataNode string assign writes to this dataNode -delete delete the configuration by locationPrefix -disk string [hdd|ssd|] hard drive or solid state drive or any tag -fsync fsync for the writes; unset inherits from the parent path -locationPrefix string path prefix, required to update the path-specific configuration -maxFileNameLength uint file name length limits in bytes for compatibility with Unix-based systems -rack string assign writes to this rack -readOnly disable writes -replication string assign writes with this replication -ttl string assign writes with this ttl (e.g., 1m, 1h, 1d, 1w, 1y) -volumeGrowthCount int the number of physical volumes to add if no writable volumes -worm write-once-read-many, written files are readonly; unset inherits from the parent path -wormGracePeriod uint grace period before worm is enforced, in seconds -wormRetentionTime uint retention time for a worm enforced file, in seconds === RUN TestCommandsReturnFlagParseErrors/fs.distributeChunks flag provided but not defined: -notAFlagOfAnyCommand Usage of fs.distributeChunks: -apply apply the redistribution -mode string distribution mode: primary, replica, round-robin (default "primary") -nodes int number of nodes to distribute across (0 = all nodes) -path string file path to redistribute chunks === RUN TestCommandsReturnFlagParseErrors/fs.du command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.log.purge flag provided but not defined: -notAFlagOfAnyCommand Usage of fs.log.purge: -daysAgo uint purge logs older than N days (default 365) -filer string comma separated filer addresses to purge (default: all filers in the cluster) -v verbose mode === RUN TestCommandsReturnFlagParseErrors/fs.ls command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.mergeVolumes flag provided but not defined: -notAFlagOfAnyCommand Usage of fs.mergeVolumes: -apply applying the metadata changes -collection string comma-separated collection names, wildcards, or regex patterns; "_default" for the collection with no name (default "*") -dir string base directory to find and update files (default "/") -fromVolumeId uint move chunks with this volume id -toVolumeId string change chunks to this volume id, or distribute across a comma-separated list of volume ids === RUN TestCommandsReturnFlagParseErrors/fs.meta.cat command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.meta.changeVolumeId flag provided but not defined: -notAFlagOfAnyCommand Usage of fs.meta.changeVolumeId: -apply apply the metadata changes -dir string fix all metadata under this folder (default "/") -force apply the metadata changes (alias for -apply) -fromVolumeId uint change metadata with this volume id -mapping string a file with multiple volume id changes, with each line as x=>y -toVolumeId uint change metadata to this volume id === RUN TestCommandsReturnFlagParseErrors/fs.meta.load flag provided but not defined: -notAFlagOfAnyCommand Usage of fs.meta.load: -concurrency int number of parallel meta load to filer (default 1) -dirPrefix string load entries only with directories matching prefix -v verbose mode (default true) === RUN TestCommandsReturnFlagParseErrors/fs.meta.notify command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.meta.save flag provided but not defined: -notAFlagOfAnyCommand Usage of fs.meta.save: -o string output the meta data to this file. If file name ends with .gz or .gzip, it will be gzip compressed -obfuscate obfuscate the file names -v print out each processed files === RUN TestCommandsReturnFlagParseErrors/fs.mkdir command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.mv command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.pwd command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.rm command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.tree command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/fs.verify flag provided but not defined: -notAFlagOfAnyCommand Usage of fs.verify: -concurrency int number of parallel verification per volume server -metadataFromLog Using filer log to get metadata -modifyTimeAgo duration only include files after this modify time to verify -pruneEntries delete filer entries whose needles are missing from all volume locations (data lost); a changed entry is never deleted -v print out each processed files === RUN TestCommandsReturnFlagParseErrors/unlock command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/lock command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/mount.configure flag provided but not defined: -notAFlagOfAnyCommand Usage of mount.configure: -dir string the mount directory same as how "weed mount -dir=" was started -quotaMB int the quota in MB === RUN TestCommandsReturnFlagParseErrors/mq.balance command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/mq.topic.compact flag provided but not defined: -notAFlagOfAnyCommand Usage of mq.topic.compact: -collection string optional collection name -dataCenter string optional data center name -disk string [hdd|ssd|] hard drive or solid state drive or any tag -maxMB int split files larger than the limit (default 4) -namespace string namespace name -replication string replication type -timeAgo duration start time before now. "300ms", "1.5h" or "2h45m". Valid time units are "ns", "us" (or "µs"), "ms", "s", "m", "h" (default 2m0s) -topic string topic name === RUN TestCommandsReturnFlagParseErrors/mq.topic.configure flag provided but not defined: -notAFlagOfAnyCommand Usage of mq.topic.configure: -namespace string namespace name -partitionCount int partition count (default 6) -retention duration retention duration (Go duration string, e.g. 168h). Mutually exclusive with -retentionSeconds. -retentionEnabled enable retention enforcement on the topic -retentionSeconds int retention duration in seconds. Mutually exclusive with -retention. -topic string topic name === RUN TestCommandsReturnFlagParseErrors/mq.topic.describe flag provided but not defined: -notAFlagOfAnyCommand Usage of mq.topic.describe: -namespace string namespace name -topic string topic name === RUN TestCommandsReturnFlagParseErrors/mq.topic.list command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/mq.topic.truncate flag provided but not defined: -notAFlagOfAnyCommand Usage of mq.topic.truncate: -namespace string namespace name -topic string topic name === RUN TestCommandsReturnFlagParseErrors/remote.cache flag provided but not defined: -notAFlagOfAnyCommand Usage of remote.cache: -cacheContent cache file content from remote (default true) -chunkConcurrency int parallel chunk downloads per file (0 = server default 8) -concurrent int concurrent file operations (default 16) -deleteLocalExtra delete local files that no longer exist on remote (default true) -dir string a directory in filer -downloadConcurrency int S3 multipart download concurrency per chunk (0 = server default 5) -dryRun show what would be done without making changes -exclude string patterns of file names, e.g., *.pdf, *.html, ab?d.txt -include string patterns of file names, e.g., *.pdf, *.html, ab?d.txt -maxAge int maximum file age in seconds (created time) (default -1) -maxSize int maximum file size in bytes (default -1) -minAge int minimum file age in seconds (created time) (default -1) -minCacheAge int minimum file cache age in seconds (last cached time) (default -1) -minSize int minimum file size in bytes (default -1) === RUN TestCommandsReturnFlagParseErrors/remote.configure flag provided but not defined: -notAFlagOfAnyCommand Usage of remote.configure: -aliyun.access_key string Aliyun access key, default to use env ALICLOUD_ACCESS_KEY_ID -aliyun.endpoint string Aliyun endpoint -aliyun.region string Aliyun region -aliyun.secret_key string Aliyun secret key, default to use env ALICLOUD_ACCESS_KEY_SECRET -azure.account_key string azure account key, default to use env AZURE_STORAGE_ACCESS_KEY. Leave empty to authenticate with Entra ID -azure.account_name string azure account name, default to use env AZURE_STORAGE_ACCOUNT -azure.client_id string azure user-assigned identity to authenticate, when no account key is given. Workload identity also reads env AZURE_TENANT_ID and AZURE_FEDERATED_TOKEN_FILE -azure.endpoint string azure blob service url, for accounts outside the public cloud, e.g. https://xxx.blob.core.usgovcloudapi.net/ -b2.application_key string backblaze applicationKey. Note that your Master Application Key will not work with the S3 Compatible API. You must create a new key that is eligible for use. For more information: https://help.backblaze.com/hc/en-us/articles/360047425453 -b2.endpoint string backblaze endpoint -b2.key_id string backblaze keyID -b2.region string backblaze region (default "us-west-002") -baidu.access_key string Baidu access key, default to use env BDCLOUD_ACCESS_KEY -baidu.endpoint string Baidu endpoint -baidu.region string Baidu region -baidu.secret_key string Baidu secret key, default to use env BDCLOUD_SECRET_KEY -delete delete one remote storage by its name -download_concurrency int concurrent part downloads per read (0 = client default: s3 5, azure 16) -filebase.access_key string Filebase access key -filebase.endpoint string Filebase endpoint, https://s3.filebase.com -filebase.secret_key string Filebase secret key -gcs.appCredentialsFile string google cloud storage credentials file, default to use env GOOGLE_APPLICATION_CREDENTIALS -gcs.projectId string google cloud storage project id, default to use env GOOGLE_CLOUD_PROJECT -name string a short name to identify the remote storage -s3.access_key string s3 access key -s3.endpoint string endpoint for s3-compatible local object store -s3.force_path_style s3 force path style (default true) -s3.region string s3 region (default "us-east-2") -s3.secret_key string s3 secret key -s3.storage_class string s3 storage class -s3.support_tagging s3 supportTagging (default true) -s3.v4_signature s3 V4 signature -storj.access_key string Storj access key -storj.endpoint string Storj endpoint -storj.secret_key string Storj secret key -tencent.endpoint string Tencent endpoint -tencent.secret_id string Tencent Secret Id, default to use env COS_SECRETID -tencent.secret_key string Tencent secret key, default to use env COS_SECRETKEY -type string [] storage type (default "s3") -upload_concurrency int concurrent part uploads per file (0 = client default: s3 1, azure 16) -wasabi.access_key string Wasabi access key -wasabi.endpoint string Wasabi endpoint, see https://wasabi.com/wp-content/themes/wasabi/docs/API_Guide/index.html#t=topics%2Fapidiff-intro.htm -wasabi.region string Wasabi region -wasabi.secret_key string Wasabi secret key === RUN TestCommandsReturnFlagParseErrors/remote.copy.local flag provided but not defined: -notAFlagOfAnyCommand Usage of remote.copy.local: -concurrent int concurrent file operations (default 16) -delete delete extraneous files from remote storage (files that do not exist locally), similar to rsync --delete -dir string a directory in filer -dryRun show what would be done without making changes -exclude string patterns of file names, e.g., *.pdf, *.html, ab?d.txt -forceUpdate force update even if remote exists -include string patterns of file names, e.g., *.pdf, *.html, ab?d.txt -maxAge int maximum file age in seconds (created time) (default -1) -maxSize int maximum file size in bytes (default -1) -minAge int minimum file age in seconds (created time) (default -1) -minCacheAge int minimum file cache age in seconds (last cached time) (default -1) -minSize int minimum file size in bytes (default -1) === RUN TestCommandsReturnFlagParseErrors/remote.meta.sync flag provided but not defined: -notAFlagOfAnyCommand Usage of remote.meta.sync: -delete remove local metadata of files and directories deleted from remote (default true) -dir string a directory in filer -statFiles stat each new or changed file when the listing does not report all metadata (S3 listings lack Content-Encoding); costs one extra remote request per file === RUN TestCommandsReturnFlagParseErrors/remote.mount flag provided but not defined: -notAFlagOfAnyCommand Usage of remote.mount: -cacheWait duration how long a read of an uncached object waits for the local cache, ex. 0 or 500ms (default: by object size) (default -1ns) -dir string a directory in filer -listingCacheTTL int seconds to cache remote directory listings (0 = disabled) -metadataStrategy string lazy: skip upfront metadata pull; eager: full metadata pull (default) (default "eager") -nonempty allows the mounting over a non-empty directory -remote string a directory in remote storage, ex. //path/to/dir === RUN TestCommandsReturnFlagParseErrors/remote.mount.buckets flag provided but not defined: -notAFlagOfAnyCommand Usage of remote.mount.buckets: -apply apply the mount for listed buckets -bucketPattern string match existing bucket name with wildcard characters '*' and '?' -remote string an already configured storage name -trimBucketSuffix remote suffix auto generated by 'weed filer.remote.sync' (default true) === RUN TestCommandsReturnFlagParseErrors/remote.uncache flag provided but not defined: -notAFlagOfAnyCommand Usage of remote.uncache: -dir string a directory in filer -exclude string patterns of file names, e.g., *.pdf, *.html, ab?d.txt -include string patterns of file names, e.g., *.pdf, *.html, ab?d.txt -maxAge int maximum file age in seconds (created time) (default -1) -maxSize int maximum file size in bytes (default -1) -minAge int minimum file age in seconds (created time) (default -1) -minCacheAge int minimum file cache age in seconds (last cached time) (default -1) -minSize int minimum file size in bytes (default -1) === RUN TestCommandsReturnFlagParseErrors/remote.unmount flag provided but not defined: -notAFlagOfAnyCommand Usage of remote.unmount: -dir string a directory in filer === RUN TestCommandsReturnFlagParseErrors/s3.accesskey.create flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.accesskey.create: -access_key string access key (generated if omitted) -secret_key string secret key (generated if omitted) -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.accesskey.delete flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.accesskey.delete: -access_key string access key to delete -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.accesskey.list flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.accesskey.list: -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.accesskey.rotate flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.accesskey.rotate: -access_key string access key to rotate -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.anonymous.get flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.anonymous.get: -bucket string bucket name === RUN TestCommandsReturnFlagParseErrors/s3.anonymous.list command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/s3.anonymous.set flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.anonymous.set: -access string comma-separated actions: Read,ReadAcp,Write,WriteAcp,List,Tagging,Admin or none -bucket string bucket name === RUN TestCommandsReturnFlagParseErrors/s3.bucket.access flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.access: -access string comma-separated actions: Read,ReadAcp,Write,WriteAcp,List,Tagging,Admin or none -name string bucket name -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.bucket.allowEmptyFolders flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.allowEmptyFolders: -disable remove empty folders asynchronously -enable keep empty folders in the bucket -name string bucket name === RUN TestCommandsReturnFlagParseErrors/s3.bucket.create flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.create: -name string bucket name -owner string bucket owner identity name (for S3 IAM authentication) -withLock enable Object Lock on the bucket (requires and enables versioning) === RUN TestCommandsReturnFlagParseErrors/s3.bucket.delete flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.delete: -name string bucket name === RUN TestCommandsReturnFlagParseErrors/s3.bucket.lifecycle.fastpath flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.lifecycle.fastpath: -disable disable the lifecycle TTL fast path -enable enable the lifecycle TTL fast path -name string bucket name === RUN TestCommandsReturnFlagParseErrors/s3.bucket.list flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.list: === RUN TestCommandsReturnFlagParseErrors/s3.bucket.lock flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.lock: -enable enable Object Lock on the bucket (irreversible) -name string bucket name === RUN TestCommandsReturnFlagParseErrors/s3.bucket.owner flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.owner: -delete remove the bucket owner (make admin-only) -name string bucket name -owner string new bucket owner identity name === RUN TestCommandsReturnFlagParseErrors/s3.bucket.quota flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.quota: -name string bucket name -op string operation name [set|get|remove|enable|disable] (default "set") -sizeMB int bucket quota size in MiB === RUN TestCommandsReturnFlagParseErrors/s3.bucket.quota.enforce flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.quota.enforce: -apply actually change the buckets readonly attribute === RUN TestCommandsReturnFlagParseErrors/s3.bucket.versioning flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.bucket.versioning: -enable enable versioning on the bucket -name string bucket name -status string versioning status: Enabled or Suspended -suspend suspend versioning on the bucket === RUN TestCommandsReturnFlagParseErrors/s3.circuitBreaker flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.circuitBreaker: -actions string comma separated actions names: Read,ReadAcp,Write,WriteAcp,List,Tagging,Admin,DeleteBucket -apply update and apply current configuration -buckets string the bucket name(s) to configure, eg: -buckets x,y,z -delete delete circuit breaker config -disable disable global or buckets circuit breaker -global configure global circuit breaker -type string 'Count' or 'MB'; Count represents the number of simultaneous requests, and MB represents the content size of all simultaneous requests -values string comma separated values === RUN TestCommandsReturnFlagParseErrors/s3.clean.uploads flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.clean.uploads: -timeAgo duration created time before now. "1.5h" or "2h45m". Valid time units are "m", "h" (default 24h0m0s) === RUN TestCommandsReturnFlagParseErrors/s3.config.show command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/s3.configure flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.configure: -access_key string specify the access key -account_display_name string specify the account display name -account_email string specify the account email address -account_id string specify the account id -actions string comma separated actions names: Read,ReadAcp,Write,WriteAcp,List,Tagging,Admin -apply update and apply s3 configuration -buckets string bucket name -delete delete users, actions, access keys or policies -policies string comma separated policy names -secret_key string specify the secret key -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.group.add-user flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.group.add-user: -group string group name -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.group.create flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.group.create: -name string group name === RUN TestCommandsReturnFlagParseErrors/s3.group.delete flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.group.delete: -name string group name === RUN TestCommandsReturnFlagParseErrors/s3.group.list command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/s3.group.remove-user flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.group.remove-user: -group string group name -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.group.show flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.group.show: -name string group name === RUN TestCommandsReturnFlagParseErrors/s3.iam.export flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.iam.export: -file string output file path (stdout if omitted) === RUN TestCommandsReturnFlagParseErrors/s3.iam.import flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.iam.import: -apply confirm overwrite of the entire IAM configuration -file string input JSON file === RUN TestCommandsReturnFlagParseErrors/s3.lifecycle.run-shard flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.lifecycle.run-shard: -bootstrap-interval duration ignored (legacy streaming flag) -checkpoint duration ignored (legacy streaming flag) -dispatch duration ignored (legacy streaming flag) -events int max in-shard events per pass (0 = drain to now) (default 1000) -refresh duration inter-pass interval; 0 = single pass, then exit -runtime duration wall-clock cap on the whole run; 0 = no timeout -s3 string s3 server gRPC endpoint, host:port -shard int single shard id in [0, 16); use -shards for a range or set (default -1) -shards string shard range "lo-hi" or comma list "a,b,c"; mutually exclusive with -shard === RUN TestCommandsReturnFlagParseErrors/s3.policy flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.policy: -delete delete a policy -file string policy file (json) -get get a policy -list list all policies -name string policy name -put create or update a policy === RUN TestCommandsReturnFlagParseErrors/s3.policy.attach flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.policy.attach: -policy string policy name -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.policy.detach flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.policy.detach: -policy string policy name -user string user name === RUN TestCommandsReturnFlagParseErrors/s3.serviceaccount.create flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.serviceaccount.create: -actions string comma-separated actions (subset of parent) -description string optional description -expiry duration expiration duration (e.g. 24h, 0 = no expiration) -user string parent user name === RUN TestCommandsReturnFlagParseErrors/s3.serviceaccount.delete flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.serviceaccount.delete: -id string service account ID === RUN TestCommandsReturnFlagParseErrors/s3.serviceaccount.list flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.serviceaccount.list: -user string filter by parent user (optional) === RUN TestCommandsReturnFlagParseErrors/s3.serviceaccount.show flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.serviceaccount.show: -id string service account ID === RUN TestCommandsReturnFlagParseErrors/s3.user.create flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.user.create: -access_key string access key (generated if omitted) -name string user name -secret_key string secret key (generated if omitted) === RUN TestCommandsReturnFlagParseErrors/s3.user.delete flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.user.delete: -name string user name === RUN TestCommandsReturnFlagParseErrors/s3.user.disable flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.user.disable: -name string user name === RUN TestCommandsReturnFlagParseErrors/s3.user.enable flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.user.enable: -name string user name === RUN TestCommandsReturnFlagParseErrors/s3.user.list command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/s3.user.provision flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.user.provision: -bucket string bucket name -name string user name -role string role: readonly, readwrite, or admin === RUN TestCommandsReturnFlagParseErrors/s3.user.show flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.user.show: -name string user name === RUN TestCommandsReturnFlagParseErrors/s3.versions.audit flag provided but not defined: -notAFlagOfAnyCommand Usage of s3.versions.audit: -heal clear the latest-version pointer on stranded directories (default: read-only) -prefix string filer path to audit recursively (e.g. /buckets/mybucket) -v print each stranded/orphan directory as it's found === RUN TestCommandsReturnFlagParseErrors/s3tables.bucket flag provided but not defined: -notAFlagOfAnyCommand Usage of s3tables.bucket: -account string owner account id -continuation string continuation token -create create table bucket -delete delete table bucket -delete-policy delete table bucket policy -file string policy file (json) -format string table format the bucket holds: ICEBERG (default) or LANCE -get get table bucket -get-policy get table bucket policy -limit int max buckets to return (default 100) -list list table buckets -name string table bucket name -prefix string bucket prefix -put-policy put table bucket policy -tags string comma separated tags key=value === RUN TestCommandsReturnFlagParseErrors/s3tables.namespace flag provided but not defined: -notAFlagOfAnyCommand Usage of s3tables.namespace: -account string owner account id -bucket string table bucket name -continuation string continuation token -create create namespace -delete delete namespace -get get namespace -limit int max namespaces to return (default 100) -list list namespaces -name string namespace name -prefix string namespace prefix === RUN TestCommandsReturnFlagParseErrors/s3tables.table flag provided but not defined: -notAFlagOfAnyCommand Usage of s3tables.table: -account string owner account id -bucket string table bucket name -continuation string continuation token -create create table -delete delete table -delete-policy delete table policy -file string policy file (json) -format string table format (default "ICEBERG") -get get table -get-policy get table policy -limit int max tables to return (default 100) -list list tables -metadata string table metadata json file -name string table name -namespace string namespace -prefix string table name prefix -put-policy put table policy -tags string comma separated tags key=value -version string version token === RUN TestCommandsReturnFlagParseErrors/s3tables.tag flag provided but not defined: -notAFlagOfAnyCommand Usage of s3tables.tag: -account string owner account id -bucket string table bucket name -delete delete tags -keys string comma separated tag keys -list list tags -name string table name -namespace string namespace -put tag resource -tags string comma separated tags key=value === RUN TestCommandsReturnFlagParseErrors/sleep command_flag_parse_test.go:25: rejects its arguments without parsing flags: sleep duration must be a positive integer, got "-notAFlagOfAnyCommand" === RUN TestCommandsReturnFlagParseErrors/volume.balance flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.balance: -apply apply the balancing plan. -byDiskUsage rank servers by reported physical disk used percent instead of slot density; falls back to sum of volume sizes for all servers when any server does not report disk bytes. Use when maxVolumeCount is set too high for the disk. -collection string comma-separated collection names, wildcards, or regex patterns, or "ALL_COLLECTIONS" across collections, "EACH_COLLECTION" for each collection (default "ALL_COLLECTIONS") -dataCenter string only apply the balancing for this dataCenter -force apply the balancing plan (alias for -apply) -ioBytePerSecond int limit volume-move copy speed in bytes per second (default 0 is unlimited) -maxDiskUsagePercent int skip a move target whose physical disk used%% is at/above this; judged per server against its own disk, so heterogeneous disk sizes are fine. 0 or >=100 disables. Auto-skipped for servers that do not report disk bytes. (default 90) -maxParallelization int run up to X volume moves in parallel, whenever possible (default 1) -noLock do not lock the admin shell at one's own risk -nodes string only apply the balancing for this nodes -racks string only apply the balancing for this racks -v verbose mode -volumeBy value only apply the balancing for ALL volumes and ACTIVE or FULL -volumesPerExec int how many volumes to move in one run (default is 0 for unlimited) === RUN TestCommandsReturnFlagParseErrors/volume.check.disk flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.check.disk: -apply apply the fix -fixReadOnly apply the fix even on readonly volumes (EXPERIMENTAL!) -force apply the fix (alias for -apply) -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) -nonRepairThreshold float repair when missing keys is not more than this limit (default 0.3) -resurrectMissingNeedles copy needles absent on one replica back from the other, only into never-vacuumed replicas (compaction revision 0) -slow slow mode checks all replicas even file counts are the same -syncDeleted sync of deletions the fix -v verbose mode -volumeId uint the volume ID (0 for all) === RUN TestCommandsReturnFlagParseErrors/volume.check.duplicate_ids command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/volume.configure.replication flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.configure.replication: -collectionPattern string comma-separated collection names, with '*' and '?' wildcards; empty matches all -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) -replication string the intended replication value -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.copy flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.copy: -noLock do not lock the admin shell at one's own risk -source string the source volume server : -target string the target volume server : -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.delete flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.delete: -node string the volume server : -timeout duration wall-clock cap on the deletion; 0 = no timeout -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.deleteEmpty flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.deleteEmpty: -apply apply to delete empty volumes -collectionPattern string comma-separated collection names, with '*' and '?' wildcards; empty matches all -force apply to delete empty volumes (alias for -apply) -quietFor duration select empty volumes with no recent writes, avoid newly created ones (default 24h0m0s) === RUN TestCommandsReturnFlagParseErrors/volume.fix.replication flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.fix.replication: -apply apply the fix -collectionPattern string comma-separated collection names, with '*' and '?' wildcards; empty matches all -doCheck Also check synchronization before deleting (default true) -doDelete Also delete over-replicated volumes besides fixing under-replication (default true) -force apply the fix (alias for -apply) -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) -maxParallelizationPerServer int run up to X volume copies onto the same destination server in parallel (default 1) -retry int how many times to retry (default 5) -verbose show volumes being checked and their statuses -volumesPerStep int how many volumes to fix in one cycle === RUN TestCommandsReturnFlagParseErrors/volume.fsck flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.fsck: -collection string comma-separated collection names, wildcards, or regex patterns; empty or "*" matches all, "_default" the collection with no name -confirmMissingVolumeDeletion with -reallyDeleteFilerEntries, confirm that the -volumeId volumes the master does not list are retired -cutoffTimeAgo duration only include entries on volume servers before this cutoff time to check orphan chunks (default 5h0m0s) -findMissingChunksInFiler see "help volume.fsck" -forcePurging delete missing data from volumes in one replica used together with applyPurging -modifyTimeAgo duration only include entries after this modify time to check orphan chunks -purgeConcurrency int parallel filer deletes for -reallyDeleteFilerEntries (default 16) -reallyDeleteFilerEntries delete missing file entries from filer if the corresponding volume is missing for any reason, please ensure all still existing/expected volumes are connected! used together with findMissingChunksInFiler -reallyDeleteFromVolume after detection, delete missing data from volumes / delete missing file entries from filer. Currently this only works with default filerGroup. -skipEcVolumes skip erasure coded volumes -tempPath string path for temporary idx files (default "/tmp") -v verbose mode -verifyNeedles check needles status from volume server -volumeId string comma separated the volume id; the filer is still read from its root, since a file under any path may reference these volumes === RUN TestCommandsReturnFlagParseErrors/volume.grow flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.grow: -collection string grow this collection; "_default" for the collection with no name -count uint (default 2) -dataCenter string grow volumes only from the specified data center -dataNode string grow volumes only from the specified data node -diskType string grow volumes only from the specified disk type -rack string grow volumes only from the specified rack === RUN TestCommandsReturnFlagParseErrors/volume.growth.resume command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/volume.list flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.list: -collectionPattern string comma-separated collection names, with '*' and '?' wildcards; empty matches all -dataCenter string show volumes only from the specified data center -dataNode string show volumes only from the specified data node -rack string show volumes only from the specified rack -readonly show only readonly volumes -v int verbose mode: 0, 1, 2, 3, 4, 5 (default 5) -volumeId uint show only volume id -writable show only writable volumes === RUN TestCommandsReturnFlagParseErrors/volume.mark flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.mark: -collection string comma-separated collection names, wildcards, or regex patterns; "_default" for the collection with no name -node string the volume server : -readonly volume mark readonly -readonlyCanDelete volume mark readonly but still accepting deletes -volumeId int the volume id -writable volume mark writable === RUN TestCommandsReturnFlagParseErrors/volume.merge flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.merge: -noLock do not lock the admin shell at one's own risk -target string optional target volume server : for temporary merge output -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.mount flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.mount: -node string the volume server : -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.move flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.move: -disk string [hdd|ssd|] hard drive or solid state drive or any tag -ioBytePerSecond int limit the speed of move -noLock do not lock the admin shell at one's own risk -source string the source volume server : -target string the target volume server : -timeout duration wall-clock cap on the whole move; 0 = no timeout -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.scrub flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.scrub: -details display scrub result details, if available -markBrokenReadonly whether to flag volumes with scrub failures as read-only -maxParallelization int run up to X tasks in parallel, whenever possible (default 10) -mode string scrubbing mode (index/local/full/reads) (default "full") -node string comma-separated list of volume server : (optional) -volumeId string comma-separated volume IDs to process (optional) === RUN TestCommandsReturnFlagParseErrors/volumeServer.evacuate flag provided but not defined: -notAFlagOfAnyCommand Usage of volumeServer.evacuate: -apply actually apply the changes -force actually apply the changes (alias for -apply) -maxParallelization int run up to X EC shard moves in parallel (default 1) -movesPerExec int how many volumes and EC shards to move in one run (default is 0 for unlimited) -noLock do not lock the admin shell at one's own risk -node string : of the volume server -rack string source rack for the volume servers -retry int how many times to retry -skipNonMoveable skip volumes that can not be moved -target string : of target volume === RUN TestCommandsReturnFlagParseErrors/volumeServer.leave flag provided but not defined: -notAFlagOfAnyCommand Usage of volumeServer.leave: -apply apply the changes -force apply the changes (alias for -apply) -node string : of the volume server === RUN TestCommandsReturnFlagParseErrors/volumeServer.state flag provided but not defined: -notAFlagOfAnyCommand Usage of volumeServer.state: -maintenanceOff disables maintenance mode on the server -maintenanceOn enables maintenance mode on the server -nodes string comma-separated list of volume servers : (optional) === RUN TestCommandsReturnFlagParseErrors/volume.tier.compact flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.tier.compact: -collection string comma-separated collection names, wildcards, or regex patterns; empty matches the collection with no name -concurrency int multipart transfer concurrency (0 = backend default) -garbageThreshold float compact when garbage ratio exceeds this value (default 0.3) -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.tier.download flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.tier.download: -collection string comma-separated collection names, wildcards, or regex patterns; empty matches the collection with no name -concurrency int multipart download concurrency (0 = backend default) -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.tier.move flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.tier.move: -apply actually apply the changes -collectionPattern string comma-separated collection names, with '*' and '?' wildcards; empty matches all -force actually apply the changes (alias for -apply) -fromDataCenter string only move volumes with a replica in this data center -fromDiskType string the source disk type -fullPercent float the volume reaches the percentage of max volume size (default 95) -ioBytePerSecond int limit the speed of move -parallelLimit int limit the number of parallel copying jobs -quietFor duration select volumes without no writes for this period (default 24h0m0s) -toDataCenter string the target data center -toDiskType string the target disk type -toReplication string the new target replication setting === RUN TestCommandsReturnFlagParseErrors/volume.tier.upload flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.tier.upload: -collection string comma-separated collection names, wildcards, or regex patterns; empty matches the collection with no name -concurrency int multipart upload concurrency (0 = backend default) -dest string the target tier name -disk string [hdd|ssd|] hard drive or solid state drive or any tag -fullPercent float the volume reaches the percentage of max volume size (default 95) -keepLocalDatFile whether keep local dat file -quietFor duration select volumes without no writes for this period (default 24h0m0s) -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.unmount flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.unmount: -node string the volume server : -volumeId int the volume id === RUN TestCommandsReturnFlagParseErrors/volume.vacuum flag provided but not defined: -notAFlagOfAnyCommand Usage of volume.vacuum: -collection string comma-separated collection names, wildcards, or regex patterns; empty or "*" matches all, "_default" the collection with no name -garbageThreshold float vacuum when garbage is more than this limit (default 0.3) -volumeId string comma-separated list of volume IDs === RUN TestCommandsReturnFlagParseErrors/volume.vacuum.disable command_flag_parse_test.go:19: uses the command environment before parsing any flags === RUN TestCommandsReturnFlagParseErrors/volume.vacuum.enable command_flag_parse_test.go:19: uses the command environment before parsing any flags --- PASS: TestCommandsReturnFlagParseErrors (0.29s) --- PASS: TestCommandsReturnFlagParseErrors/cluster.check (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/cluster.ps (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/cluster.raft.add (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/cluster.raft.transferLeader (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/cluster.raft.ps (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/cluster.raft.remove (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/cluster.status (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/collection.delete (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/collection.list (0.01s) --- PASS: TestCommandsReturnFlagParseErrors/ec.balance (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/ec.check.replication (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/ec.decode (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/ec.encode (0.01s) --- PASS: TestCommandsReturnFlagParseErrors/ec.rebuild (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/ec.scrub (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/ec.shard.unmount (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.cat (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.cd (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/fs.configure (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/fs.distributeChunks (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.du (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/fs.log.purge (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.ls (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/fs.mergeVolumes (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.meta.cat (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/fs.meta.changeVolumeId (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/fs.meta.load (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.meta.notify (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/fs.meta.save (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.mkdir (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.mv (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.pwd (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.rm (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/fs.tree (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/fs.verify (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/unlock (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/lock (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/mount.configure (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/mq.balance (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/mq.topic.compact (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/mq.topic.configure (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/mq.topic.describe (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/mq.topic.list (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/mq.topic.truncate (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/remote.cache (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/remote.configure (0.01s) --- PASS: TestCommandsReturnFlagParseErrors/remote.copy.local (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/remote.meta.sync (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/remote.mount (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/remote.mount.buckets (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/remote.uncache (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/remote.unmount (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.accesskey.create (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.accesskey.delete (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.accesskey.list (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.accesskey.rotate (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.anonymous.get (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/s3.anonymous.list (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.anonymous.set (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.access (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.allowEmptyFolders (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.create (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.delete (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.lifecycle.fastpath (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.list (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.lock (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.owner (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.quota (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.quota.enforce (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.bucket.versioning (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.circuitBreaker (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.clean.uploads (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/s3.config.show (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.configure (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.group.add-user (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.group.create (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.group.delete (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/s3.group.list (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.group.remove-user (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.group.show (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.iam.export (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.iam.import (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.lifecycle.run-shard (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.policy (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.policy.attach (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.policy.detach (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.serviceaccount.create (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.serviceaccount.delete (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.serviceaccount.list (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.serviceaccount.show (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.user.create (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.user.delete (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.user.disable (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.user.enable (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/s3.user.list (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.user.provision (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.user.show (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3.versions.audit (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3tables.bucket (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3tables.namespace (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3tables.table (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/s3tables.tag (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/sleep (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.balance (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.check.disk (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/volume.check.duplicate_ids (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.configure.replication (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.copy (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.delete (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.deleteEmpty (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.fix.replication (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.fsck (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.grow (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/volume.growth.resume (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.list (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.mark (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.merge (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.mount (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.move (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.scrub (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volumeServer.evacuate (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volumeServer.leave (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volumeServer.state (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.tier.compact (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.tier.download (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.tier.move (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.tier.upload (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.unmount (0.00s) --- PASS: TestCommandsReturnFlagParseErrors/volume.vacuum (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/volume.vacuum.disable (0.00s) --- SKIP: TestCommandsReturnFlagParseErrors/volume.vacuum.enable (0.00s) === RUN TestProcessEachCmdTreatsHelpAsSuccess --- PASS: TestProcessEachCmdTreatsHelpAsSuccess (0.00s) === RUN TestShortName --- PASS: TestShortName (0.00s) === RUN TestRelevantNodes --- PASS: TestRelevantNodes (0.00s) === RUN TestComputeOwnerTarget_EvenDivision --- PASS: TestComputeOwnerTarget_EvenDivision (0.00s) === RUN TestComputeOwnerTarget_UnevenDivision --- PASS: TestComputeOwnerTarget_UnevenDivision (0.00s) === RUN TestComputeOwnerTarget_InactiveNodesDrainToZero --- PASS: TestComputeOwnerTarget_InactiveNodesDrainToZero (0.00s) === RUN TestBuildDistributionCounts --- PASS: TestBuildDistributionCounts (0.00s) === RUN TestBuildDistributionCounts_NilFidFallback --- PASS: TestBuildDistributionCounts_NilFidFallback (0.00s) === RUN TestSelectActiveNodes_AllNodes --- PASS: TestSelectActiveNodes_AllNodes (0.00s) === RUN TestSelectActiveNodes_LimitToTwo --- PASS: TestSelectActiveNodes_LimitToTwo (0.00s) === RUN TestPlanOwnerMoves_BasicBalance --- PASS: TestPlanOwnerMoves_BasicBalance (0.00s) === RUN TestPlanOwnerMoves_AlreadyBalanced --- PASS: TestPlanOwnerMoves_AlreadyBalanced (0.00s) === RUN TestPlanDistribution_Primary_BalancesChunks --- PASS: TestPlanDistribution_Primary_BalancesChunks (0.00s) === RUN TestPlanDistribution_Primary_NoMovesWhenBalanced --- PASS: TestPlanDistribution_Primary_NoMovesWhenBalanced (0.00s) === RUN TestPlanDistribution_RoundRobin_AssignsByOffset --- PASS: TestPlanDistribution_RoundRobin_AssignsByOffset (0.00s) === RUN TestPlanDistribution_RoundRobin_OffsetOrdering --- PASS: TestPlanDistribution_RoundRobin_OffsetOrdering (0.00s) === RUN TestPlanDistribution_Replica_BalancesOwnerAndCopies --- PASS: TestPlanDistribution_Replica_BalancesOwnerAndCopies (0.00s) === RUN TestPrintRedistributionPlan_Output --- PASS: TestPrintRedistributionPlan_Output (0.00s) === RUN TestResolveLogPurgeFilersExplicitList --- PASS: TestResolveLogPurgeFilersExplicitList (0.00s) === RUN TestResolveLogPurgeFilersRejectsEmptyExplicitList --- PASS: TestResolveLogPurgeFilersRejectsEmptyExplicitList (0.00s) === RUN TestResolveLogPurgeFilersFallsBackToConnectedFiler --- PASS: TestResolveLogPurgeFilersFallsBackToConnectedFiler (0.00s) === RUN TestResolveLogPurgeFilersFromMaster I1117 09:40:49.277774 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{leader:"127.0.0.1:0.40095"} --- PASS: TestResolveLogPurgeFilersFromMaster (0.11s) === RUN TestResolveLogPurgeFilersEmptyMasterSkipsSecondLookup I1117 09:40:49.377523 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{leader:"127.0.0.1:0.39107"} --- PASS: TestResolveLogPurgeFilersEmptyMasterSkipsSecondLookup (0.23s) === RUN TestResolveLogPurgeFilersNoneFound --- PASS: TestResolveLogPurgeFilersNoneFound (0.00s) === RUN TestPurgeFilerLogsKeepsCommandEnvFiler --- PASS: TestPurgeFilerLogsKeepsCommandEnvFiler (0.00s) === RUN TestFsLogPurgeContinuesPastUnreachableFiler --- PASS: TestFsLogPurgeContinuesPastUnreachableFiler (0.12s) === RUN TestCreateMergePlan_HonorsExplicitDirection --- PASS: TestCreateMergePlan_HonorsExplicitDirection (0.00s) === RUN TestCreateMergePlan_DirectedAllowsEmptyTarget --- PASS: TestCreateMergePlan_DirectedAllowsEmptyTarget (0.00s) === RUN TestCreateMergePlan_DirectedRejectsSelfMap --- PASS: TestCreateMergePlan_DirectedRejectsSelfMap (0.00s) === RUN TestCreateMergePlan_DirectedRejectsIneligible === RUN TestCreateMergePlan_DirectedRejectsIneligible/readonly_source === RUN TestCreateMergePlan_DirectedRejectsIneligible/readonly_target === RUN TestCreateMergePlan_DirectedRejectsIneligible/empty_source === RUN TestCreateMergePlan_DirectedRejectsIneligible/wrong_collection --- PASS: TestCreateMergePlan_DirectedRejectsIneligible (0.00s) --- PASS: TestCreateMergePlan_DirectedRejectsIneligible/readonly_source (0.00s) --- PASS: TestCreateMergePlan_DirectedRejectsIneligible/readonly_target (0.00s) --- PASS: TestCreateMergePlan_DirectedRejectsIneligible/empty_source (0.00s) --- PASS: TestCreateMergePlan_DirectedRejectsIneligible/wrong_collection (0.00s) === RUN TestCreateMergePlan_DistributesAcrossMultipleTargets --- PASS: TestCreateMergePlan_DistributesAcrossMultipleTargets (0.00s) === RUN TestCreateMergePlan_MultiTargetRejectsInsufficientCapacity --- PASS: TestCreateMergePlan_MultiTargetRejectsInsufficientCapacity (0.00s) === RUN TestCreateMergePlan_TargetListRestrictsHeuristic --- PASS: TestCreateMergePlan_TargetListRestrictsHeuristic (0.00s) === RUN TestParseTargetVolumeIds --- PASS: TestParseTargetVolumeIds (0.00s) === RUN TestCreateMergePlan_CollectionFilter volume 3 is not compatible with volume 2 volume 4 is not compatible with volume 2 --- PASS: TestCreateMergePlan_CollectionFilter (0.00s) === RUN TestGetVolumeSize_ClampsDeletedOverSize --- PASS: TestGetVolumeSize_ClampsDeletedOverSize (0.00s) === RUN TestManifestMayReferencePlan --- PASS: TestManifestMayReferencePlan (0.00s) === RUN TestWarnUnreferencedSources --- PASS: TestWarnUnreferencedSources (0.00s) === RUN TestWarnUnreferencedSources_ConcurrentRecording --- PASS: TestWarnUnreferencedSources_ConcurrentRecording (0.00s) === RUN TestUpdateEntryIfUnchanged === RUN TestUpdateEntryIfUnchanged/committed === RUN TestUpdateEntryIfUnchanged/changed === RUN TestUpdateEntryIfUnchanged/deleted === RUN TestUpdateEntryIfUnchanged/outcome_unknown --- PASS: TestUpdateEntryIfUnchanged (0.01s) --- PASS: TestUpdateEntryIfUnchanged/committed (0.00s) --- PASS: TestUpdateEntryIfUnchanged/changed (0.00s) --- PASS: TestUpdateEntryIfUnchanged/deleted (0.00s) --- PASS: TestUpdateEntryIfUnchanged/outcome_unknown (0.00s) === RUN TestUnreferencedTargets === RUN TestUnreferencedTargets/another_run_committed_one_copy === RUN TestUnreferencedTargets/another_run_committed_copies_through_a_manifest === RUN TestUnreferencedTargets/manifest_unreadable E1117 09:40:49.859363 filechunk_manifest.go:384 operation LookupFileId 9,0404000007 failed, err: volume of 9,0404000007 unavailable === RUN TestUnreferencedTargets/entry_deleted === RUN TestUnreferencedTargets/entry_unreadable --- PASS: TestUnreferencedTargets (0.15s) --- PASS: TestUnreferencedTargets/another_run_committed_one_copy (0.00s) --- PASS: TestUnreferencedTargets/another_run_committed_copies_through_a_manifest (0.09s) --- PASS: TestUnreferencedTargets/manifest_unreadable (0.02s) --- PASS: TestUnreferencedTargets/entry_deleted (0.00s) --- PASS: TestUnreferencedTargets/entry_unreadable (0.00s) === RUN TestIsMultipartUploadFile --- PASS: TestIsMultipartUploadFile (0.00s) === RUN TestRecordPlanSources === RUN TestRecordPlanSources/off_plan_sources === RUN TestRecordPlanSources/on_a_plan_source === RUN TestRecordPlanSources/behind_a_manifest_off_the_source === RUN TestRecordPlanSources/manifest_outside_the_plan_collections E1117 09:40:49.922277 filechunk_manifest.go:384 operation LookupFileId 187,0100000007 failed, err: volume of 187,0100000007 unavailable E1117 09:40:49.942769 filechunk_manifest.go:384 operation LookupFileId 187,0a00000007 failed, err: volume of 187,0a00000007 unavailable --- PASS: TestRecordPlanSources (0.05s) --- PASS: TestRecordPlanSources/off_plan_sources (0.00s) --- PASS: TestRecordPlanSources/on_a_plan_source (0.00s) --- PASS: TestRecordPlanSources/behind_a_manifest_off_the_source (0.01s) --- PASS: TestRecordPlanSources/manifest_outside_the_plan_collections (0.00s) === RUN TestFsMetaLoadCreatesAllEntries --- PASS: TestFsMetaLoadCreatesAllEntries (0.01s) === RUN TestFsMetaLoadWaitsForInflightCreateAtEOF --- PASS: TestFsMetaLoadWaitsForInflightCreateAtEOF (0.10s) === RUN TestFsMetaLoadWaitsForInflightCreateOnCorruptData --- PASS: TestFsMetaLoadWaitsForInflightCreateOnCorruptData (0.10s) === RUN TestFsMetaLoadReturnsWorkerError --- PASS: TestFsMetaLoadReturnsWorkerError (0.00s) === RUN TestFsMetaLoadPrefersWorkerErrorOverReadError --- PASS: TestFsMetaLoadPrefersWorkerErrorOverReadError (0.00s) === RUN TestFsMetaLoadReturnsErrorOnCorruptData === RUN TestFsMetaLoadReturnsErrorOnCorruptData/truncated_entry_data === RUN TestFsMetaLoadReturnsErrorOnCorruptData/malformed_proto --- PASS: TestFsMetaLoadReturnsErrorOnCorruptData (0.01s) --- PASS: TestFsMetaLoadReturnsErrorOnCorruptData/truncated_entry_data (0.00s) --- PASS: TestFsMetaLoadReturnsErrorOnCorruptData/malformed_proto (0.00s) === RUN TestFsMvMovesIntoExistingDestinationDirectory --- PASS: TestFsMvMovesIntoExistingDestinationDirectory (0.04s) === RUN TestFsVerifyIsNeedleMissingError --- PASS: TestFsVerifyIsNeedleMissingError (0.00s) === RUN TestFsVerifyVerifyEntryPrunability === RUN TestFsVerifyVerifyEntryPrunability/missing_on_all_locations === RUN TestFsVerifyVerifyEntryPrunability/healthy_on_one_of_two_locations === RUN TestFsVerifyVerifyEntryPrunability/concurrent_path_matches_sequential --- PASS: TestFsVerifyVerifyEntryPrunability (0.10s) --- PASS: TestFsVerifyVerifyEntryPrunability/missing_on_all_locations (0.04s) --- PASS: TestFsVerifyVerifyEntryPrunability/healthy_on_one_of_two_locations (0.04s) --- PASS: TestFsVerifyVerifyEntryPrunability/concurrent_path_matches_sequential (0.02s) === RUN TestFsVerifyPruneEntryGuards --- PASS: TestFsVerifyPruneEntryGuards (0.05s) === RUN TestDeleteEntryCutoff --- PASS: TestDeleteEntryCutoff (0.00s) === RUN TestFsVerifyManifestResolutionFailure === RUN TestFsVerifyManifestResolutionFailure/healthy_raw_needle_but_unresolvable_manifest_is_not_verified E1117 09:40:50.403513 filechunk_manifest.go:384 operation LookupFileId 7,6400000000 failed, err: rpc error: code = Unimplemented desc = method LookupVolume not implemented === RUN TestFsVerifyManifestResolutionFailure/missing_manifest_needle_is_prunable E1117 09:40:50.436461 filechunk_manifest.go:384 operation LookupFileId 7,6400000000 failed, err: rpc error: code = Unimplemented desc = method LookupVolume not implemented --- PASS: TestFsVerifyManifestResolutionFailure (0.06s) --- PASS: TestFsVerifyManifestResolutionFailure/healthy_raw_needle_but_unresolvable_manifest_is_not_verified (0.03s) --- PASS: TestFsVerifyManifestResolutionFailure/missing_manifest_needle_is_prunable (0.03s) === RUN TestPlanLocalToRemoteSync === RUN TestPlanLocalToRemoteSync/copy_local-only_files,_no_delete_flag === RUN TestPlanLocalToRemoteSync/delete_flag_removes_remote-only_files === RUN TestPlanLocalToRemoteSync/delete_with_empty_local_storage_removes_all_remote_files === RUN TestPlanLocalToRemoteSync/delete_respects_include_pattern === RUN TestPlanLocalToRemoteSync/delete_respects_exclude_pattern === RUN TestPlanLocalToRemoteSync/delete_ignores_size/age_filters === RUN TestPlanLocalToRemoteSync/delete_removes_orphaned_files,_directory_entries_left_alone === RUN TestPlanLocalToRemoteSync/exclude_pattern_protects_remote_files_under_nested_directory === RUN TestPlanLocalToRemoteSync/remote_files_outside_-dir_are_never_deleted === RUN TestPlanLocalToRemoteSync/directory_present_locally_is_not_deleted === RUN TestPlanLocalToRemoteSync/forceUpdate_copies_files_that_exist_on_remote === RUN TestPlanLocalToRemoteSync/local_directories_are_not_copied --- PASS: TestPlanLocalToRemoteSync (0.02s) --- PASS: TestPlanLocalToRemoteSync/copy_local-only_files,_no_delete_flag (0.00s) --- PASS: TestPlanLocalToRemoteSync/delete_flag_removes_remote-only_files (0.00s) --- PASS: TestPlanLocalToRemoteSync/delete_with_empty_local_storage_removes_all_remote_files (0.00s) --- PASS: TestPlanLocalToRemoteSync/delete_respects_include_pattern (0.00s) --- PASS: TestPlanLocalToRemoteSync/delete_respects_exclude_pattern (0.00s) --- PASS: TestPlanLocalToRemoteSync/delete_ignores_size/age_filters (0.00s) --- PASS: TestPlanLocalToRemoteSync/delete_removes_orphaned_files,_directory_entries_left_alone (0.00s) --- PASS: TestPlanLocalToRemoteSync/exclude_pattern_protects_remote_files_under_nested_directory (0.00s) --- PASS: TestPlanLocalToRemoteSync/remote_files_outside_-dir_are_never_deleted (0.00s) --- PASS: TestPlanLocalToRemoteSync/directory_present_locally_is_not_deleted (0.00s) --- PASS: TestPlanLocalToRemoteSync/forceUpdate_copies_files_that_exist_on_remote (0.00s) --- PASS: TestPlanLocalToRemoteSync/local_directories_are_not_copied (0.00s) === RUN TestFileFilter_matchesName === RUN TestFileFilter_matchesName/no_filters === RUN TestFileFilter_matchesName/include_match === RUN TestFileFilter_matchesName/include_mismatch === RUN TestFileFilter_matchesName/exclude_match === RUN TestFileFilter_matchesName/exclude_mismatch --- PASS: TestFileFilter_matchesName (0.00s) --- PASS: TestFileFilter_matchesName/no_filters (0.00s) --- PASS: TestFileFilter_matchesName/include_match (0.00s) --- PASS: TestFileFilter_matchesName/include_mismatch (0.00s) --- PASS: TestFileFilter_matchesName/exclude_match (0.00s) --- PASS: TestFileFilter_matchesName/exclude_mismatch (0.00s) === RUN TestDoSaveRemoteEntryIsConditionedOnTheListedEntry === RUN TestDoSaveRemoteEntryIsConditionedOnTheListedEntry/unchanged === RUN TestDoSaveRemoteEntryIsConditionedOnTheListedEntry/written_since_listed === RUN TestDoSaveRemoteEntryIsConditionedOnTheListedEntry/deleted_since_listed --- PASS: TestDoSaveRemoteEntryIsConditionedOnTheListedEntry (0.02s) --- PASS: TestDoSaveRemoteEntryIsConditionedOnTheListedEntry/unchanged (0.01s) --- PASS: TestDoSaveRemoteEntryIsConditionedOnTheListedEntry/written_since_listed (0.00s) --- PASS: TestDoSaveRemoteEntryIsConditionedOnTheListedEntry/deleted_since_listed (0.00s) === RUN TestCreateRemoteEntryKeepsAnEntryCreatedSinceListed === RUN TestCreateRemoteEntryKeepsAnEntryCreatedSinceListed/absent === RUN TestCreateRemoteEntryKeepsAnEntryCreatedSinceListed/created_since_listed === RUN TestCreateRemoteEntryKeepsAnEntryCreatedSinceListed/refused --- PASS: TestCreateRemoteEntryKeepsAnEntryCreatedSinceListed (0.00s) --- PASS: TestCreateRemoteEntryKeepsAnEntryCreatedSinceListed/absent (0.00s) --- PASS: TestCreateRemoteEntryKeepsAnEntryCreatedSinceListed/created_since_listed (0.00s) --- PASS: TestCreateRemoteEntryKeepsAnEntryCreatedSinceListed/refused (0.00s) === RUN TestPullMetadataDirectoryDescendsOnlyIntoATakenDirectory === RUN TestPullMetadataDirectoryDescendsOnlyIntoATakenDirectory/taken_by_a_file === RUN TestPullMetadataDirectoryDescendsOnlyIntoATakenDirectory/taken_by_a_directory --- PASS: TestPullMetadataDirectoryDescendsOnlyIntoATakenDirectory (0.00s) --- PASS: TestPullMetadataDirectoryDescendsOnlyIntoATakenDirectory/taken_by_a_file (0.00s) --- PASS: TestPullMetadataDirectoryDescendsOnlyIntoATakenDirectory/taken_by_a_directory (0.00s) === RUN TestPullMetadataDirectoryDeletesOnlyTheListedFile === RUN TestPullMetadataDirectoryDeletesOnlyTheListedFile/remote_turned_it_into_a_directory === RUN TestPullMetadataDirectoryDeletesOnlyTheListedFile/gone_from_the_remote === RUN TestPullMetadataDirectoryDeletesOnlyTheListedFile/listed_without_an_mtime === RUN TestPullMetadataDirectoryDeletesOnlyTheListedFile/listed_at_the_epoch_with_nanoseconds === RUN TestPullMetadataDirectoryDeletesOnlyTheListedFile/empty_directory_gone_from_the_remote --- PASS: TestPullMetadataDirectoryDeletesOnlyTheListedFile (0.01s) --- PASS: TestPullMetadataDirectoryDeletesOnlyTheListedFile/remote_turned_it_into_a_directory (0.00s) --- PASS: TestPullMetadataDirectoryDeletesOnlyTheListedFile/gone_from_the_remote (0.00s) --- PASS: TestPullMetadataDirectoryDeletesOnlyTheListedFile/listed_without_an_mtime (0.00s) --- PASS: TestPullMetadataDirectoryDeletesOnlyTheListedFile/listed_at_the_epoch_with_nanoseconds (0.00s) --- PASS: TestPullMetadataDirectoryDeletesOnlyTheListedFile/empty_directory_gone_from_the_remote (0.00s) === RUN TestPullMetadataDirectoryReportsAKeptEntry === RUN TestPullMetadataDirectoryReportsAKeptEntry/stale_file_kept === RUN TestPullMetadataDirectoryReportsAKeptEntry/stale_file_deleted === RUN TestPullMetadataDirectoryReportsAKeptEntry/file_replaced_by_a_remote_directory_kept === RUN TestPullMetadataDirectoryReportsAKeptEntry/file_replaced_by_a_remote_directory_deleted --- PASS: TestPullMetadataDirectoryReportsAKeptEntry (0.01s) --- PASS: TestPullMetadataDirectoryReportsAKeptEntry/stale_file_kept (0.00s) --- PASS: TestPullMetadataDirectoryReportsAKeptEntry/stale_file_deleted (0.00s) --- PASS: TestPullMetadataDirectoryReportsAKeptEntry/file_replaced_by_a_remote_directory_kept (0.00s) --- PASS: TestPullMetadataDirectoryReportsAKeptEntry/file_replaced_by_a_remote_directory_deleted (0.00s) === RUN TestSaveMountSyncOffset --- PASS: TestSaveMountSyncOffset (0.00s) === RUN TestFileFilter_matches_minCacheAge === RUN TestFileFilter_matches_minCacheAge/no_minCacheAge === RUN TestFileFilter_matches_minCacheAge/recent_cache,_should_not_match === RUN TestFileFilter_matches_minCacheAge/old_cache,_should_match === RUN TestFileFilter_matches_minCacheAge/no_remote_entry,_uses_crtime_-_recent,_should_not_match === RUN TestFileFilter_matches_minCacheAge/no_remote_entry,_uses_crtime_-_old,_should_match === RUN TestFileFilter_matches_minCacheAge/remote_entry_with_0_sync_ts,_uses_crtime_-_recent,_should_not_match === RUN TestFileFilter_matches_minCacheAge/nil_attributes,_should_not_match --- PASS: TestFileFilter_matches_minCacheAge (0.01s) --- PASS: TestFileFilter_matches_minCacheAge/no_minCacheAge (0.00s) --- PASS: TestFileFilter_matches_minCacheAge/recent_cache,_should_not_match (0.00s) --- PASS: TestFileFilter_matches_minCacheAge/old_cache,_should_match (0.00s) --- PASS: TestFileFilter_matches_minCacheAge/no_remote_entry,_uses_crtime_-_recent,_should_not_match (0.00s) --- PASS: TestFileFilter_matches_minCacheAge/no_remote_entry,_uses_crtime_-_old,_should_match (0.00s) --- PASS: TestFileFilter_matches_minCacheAge/remote_entry_with_0_sync_ts,_uses_crtime_-_recent,_should_not_match (0.00s) --- PASS: TestFileFilter_matches_minCacheAge/nil_attributes,_should_not_match (0.00s) === RUN TestUncacheEntryIsConditionedOnTheReadEntry === RUN TestUncacheEntryIsConditionedOnTheReadEntry/unchanged === RUN TestUncacheEntryIsConditionedOnTheReadEntry/overwritten_since_the_walk --- PASS: TestUncacheEntryIsConditionedOnTheReadEntry (0.00s) --- PASS: TestUncacheEntryIsConditionedOnTheReadEntry/unchanged (0.00s) --- PASS: TestUncacheEntryIsConditionedOnTheReadEntry/overwritten_since_the_walk (0.00s) === RUN TestCanonicalActionsAcceptAcpActions --- PASS: TestCanonicalActionsAcceptAcpActions (0.00s) === RUN TestCanonicalActionList --- PASS: TestCanonicalActionList (0.00s) === RUN TestAnonymousSetRejectsEmptyAccess --- PASS: TestAnonymousSetRejectsEmptyAccess (0.00s) === RUN TestUpdateBucketActions_SetActions --- PASS: TestUpdateBucketActions_SetActions (0.00s) === RUN TestUpdateBucketActions_ReplaceActions --- PASS: TestUpdateBucketActions_ReplaceActions (0.00s) === RUN TestUpdateBucketActions_AcpActions --- PASS: TestUpdateBucketActions_AcpActions (0.00s) === RUN TestUpdateBucketActions_None --- PASS: TestUpdateBucketActions_None (0.00s) === RUN TestUpdateBucketActions_PreservesOtherBuckets --- PASS: TestUpdateBucketActions_PreservesOtherBuckets (0.00s) === RUN TestUpdateBucketActions_PreservesGlobalActions --- PASS: TestUpdateBucketActions_PreservesGlobalActions (0.00s) === RUN TestDisplayBucketAccess --- PASS: TestDisplayBucketAccess (0.00s) === RUN TestDisplayBucketAccess_None --- PASS: TestDisplayBucketAccess_None (0.00s) === RUN TestS3BucketCreateRequestsExclusiveCreate --- PASS: TestS3BucketCreateRequestsExclusiveCreate (0.03s) === RUN TestS3BucketCreateReturnsFlagParseError flag provided but not defined: -withlock Usage of s3.bucket.create: -name string bucket name -owner string bucket owner identity name (for S3 IAM authentication) -withLock enable Object Lock on the bucket (requires and enables versioning) --- PASS: TestS3BucketCreateReturnsFlagParseError (0.00s) === RUN TestCircuitBreakerHelpExamplesRun --- PASS: TestCircuitBreakerHelpExamplesRun (0.03s) === RUN TestCircuitBreakerInvalidActionError --- PASS: TestCircuitBreakerInvalidActionError (0.00s) === RUN TestCircuitBreakerShell --- PASS: TestCircuitBreakerShell (0.05s) === RUN TestUploadCompletedVersionPaths === RUN TestUploadCompletedVersionPaths/obj === RUN TestUploadCompletedVersionPaths/dir/obj === RUN TestUploadCompletedVersionPaths/dir/ --- PASS: TestUploadCompletedVersionPaths (0.01s) --- PASS: TestUploadCompletedVersionPaths/obj (0.00s) --- PASS: TestUploadCompletedVersionPaths/dir/obj (0.00s) --- PASS: TestUploadCompletedVersionPaths/dir/ (0.00s) === RUN TestUploadCompleted === RUN TestUploadCompleted/object_entry_carries_the_upload_id === RUN TestUploadCompleted/object_entry_has_a_different_upload_id === RUN TestUploadCompleted/a_version_file_carries_the_upload_id === RUN TestUploadCompleted/no_object_and_no_versions === RUN TestUploadCompleted/upload_dir_without_an_object_key === RUN TestUploadCompleted/lookup_error_propagates === RUN TestUploadCompleted/versions_list_not_found_means_no_completed_object === RUN TestUploadCompleted/trailing_slash_key_resolves_inside_its_directory --- PASS: TestUploadCompleted (0.01s) --- PASS: TestUploadCompleted/object_entry_carries_the_upload_id (0.00s) --- PASS: TestUploadCompleted/object_entry_has_a_different_upload_id (0.00s) --- PASS: TestUploadCompleted/a_version_file_carries_the_upload_id (0.00s) --- PASS: TestUploadCompleted/no_object_and_no_versions (0.00s) --- PASS: TestUploadCompleted/upload_dir_without_an_object_key (0.00s) --- PASS: TestUploadCompleted/lookup_error_propagates (0.00s) --- PASS: TestUploadCompleted/versions_list_not_found_means_no_completed_object (0.00s) --- PASS: TestUploadCompleted/trailing_slash_key_resolves_inside_its_directory (0.00s) === RUN TestRemoveUploadDir === RUN TestRemoveUploadDir/open_upload_is_freed_in_a_transaction_on_the_object's_lock === RUN TestRemoveUploadDir/trailing-slash_key_locks_the_entry_its_completion_writes_as_versioning_changes === RUN TestRemoveUploadDir/unreadable_bucket_deletes_nothing === RUN TestRemoveUploadDir/upload_completed_before_the_transaction_keeps_its_chunks === RUN TestRemoveUploadDir/completed_upload_goes_metadata-only_without_a_transaction === RUN TestRemoveUploadDir/undecidable_lookup_deletes_nothing === RUN TestRemoveUploadDir/lost_lock_deletes_nothing === RUN TestRemoveUploadDir/transaction_error_fails_the_purge === RUN TestRemoveUploadDir/upload_without_an_object_key_frees_its_chunks_directly --- PASS: TestRemoveUploadDir (0.02s) --- PASS: TestRemoveUploadDir/open_upload_is_freed_in_a_transaction_on_the_object's_lock (0.00s) --- PASS: TestRemoveUploadDir/trailing-slash_key_locks_the_entry_its_completion_writes_as_versioning_changes (0.00s) --- PASS: TestRemoveUploadDir/unreadable_bucket_deletes_nothing (0.00s) --- PASS: TestRemoveUploadDir/upload_completed_before_the_transaction_keeps_its_chunks (0.00s) --- PASS: TestRemoveUploadDir/completed_upload_goes_metadata-only_without_a_transaction (0.00s) --- PASS: TestRemoveUploadDir/undecidable_lookup_deletes_nothing (0.00s) --- PASS: TestRemoveUploadDir/lost_lock_deletes_nothing (0.00s) --- PASS: TestRemoveUploadDir/transaction_error_fails_the_purge (0.00s) --- PASS: TestRemoveUploadDir/upload_without_an_object_key_frees_its_chunks_directly (0.00s) === RUN TestParseShardsSpec_Range --- PASS: TestParseShardsSpec_Range (0.00s) === RUN TestParseShardsSpec_Set --- PASS: TestParseShardsSpec_Set (0.00s) === RUN TestParseShardsSpec_DedupSort --- PASS: TestParseShardsSpec_DedupSort (0.00s) === RUN TestParseShardsSpec_OutOfRange --- PASS: TestParseShardsSpec_OutOfRange (0.00s) === RUN TestParseShardsSpec_BadRange --- PASS: TestParseShardsSpec_BadRange (0.00s) === RUN TestResolveShardSelection_Mutex --- PASS: TestResolveShardSelection_Mutex (0.00s) === RUN TestResolveShardSelection_SingleShard --- PASS: TestResolveShardSelection_SingleShard (0.00s) === RUN TestFormatShardLabel --- PASS: TestFormatShardLabel (0.00s) === RUN TestHealStrandedPointerIsConditional --- PASS: TestHealStrandedPointerIsConditional (0.00s) === RUN TestIsGoodMove replication: 100 expected false name: test 100 move to wrong data centers replication: 100 expected true name: test 100 move to spread into proper data centers replication: 001 expected false name: test move to the same node replication: 001 expected false name: test move to the same rack, but existing node replication: 001 expected true name: test move to the same rack, a new node replication: 010 expected false name: test 010 move all to the same rack replication: 010 expected true name: test 010 move to spread racks replication: 010 expected true name: test 010 move to spread racks replication: 011 expected true name: test 011 switch which rack has more replicas replication: 011 expected true name: test 011 move the lonely replica to another racks replication: 011 expected false name: test 011 move to wrong racks replication: 011 expected false name: test 011 move all to the same rack replication: 001 expected false name: test 001 reject move onto a machine already holding a replica replication: 001 expected true name: test 001 allow move onto a different machine in the rack --- PASS: TestIsGoodMove (0.01s) === RUN TestBalance hdd 0.00 0.01:0.00 moving volume collection4_7 192.168.1.2:8080 => 192.168.1.6:8080 hdd 0.00 0.01:0.00 moving volume collection3_9 192.168.1.2:8080 => 192.168.1.6:8080 hdd 0.00 0.01:0.00 moving volume 4 192.168.1.2:8080 => 192.168.1.6:8080 hdd 0.00 0.01:0.00 moving volume 2 192.168.1.2:8080 => 192.168.1.6:8080 hdd 0.00 0.01:0.00 moving volume 6 192.168.1.2:8080 => 192.168.1.6:8080 hdd 0.00 0.01:0.00 moving volume 3 192.168.1.2:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume 31 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume 29 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume 30 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume 27 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume 28 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection0_25 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_80 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_69 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_84 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_63 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_74 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_85 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_54 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_97 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_174 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_105 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection0_24 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_173 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_136 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_138 192.168.1.4:8080 => 192.168.1.6:8080 hdd 0.00 0.00:0.00 moving volume collection1_116 192.168.1.4:8080 => 192.168.1.6:8080 --- PASS: TestBalance (0.28s) === RUN TestBalanceParallel hdd 0.54 2.33:0.10 hdd 0.54 1.50:0.10 hdd 0.54 1.00:0.22 moving volume 4 full => empty moving volume 1 full => empty moving volume 3 full => empty hdd 0.54 0.67:0.38 moving volume 5 full => empty --- PASS: TestBalanceParallel (0.01s) === RUN TestBalanceSkipsRemoteStorageVolumes === RUN TestBalanceSkipsRemoteStorageVolumes/maxParallelization=0 hdd 0.18 0.43:0.10 moving volume 5 full => empty hdd 0.18 0.25:0.10 moving volume 6 full => empty === RUN TestBalanceSkipsRemoteStorageVolumes/maxParallelization=2 hdd 0.18 0.43:0.10 hdd 0.18 0.25:0.10 moving volume 6 full => empty moving volume 5 full => empty --- PASS: TestBalanceSkipsRemoteStorageVolumes (0.01s) --- PASS: TestBalanceSkipsRemoteStorageVolumes/maxParallelization=0 (0.00s) --- PASS: TestBalanceSkipsRemoteStorageVolumes/maxParallelization=2 (0.00s) === RUN TestVolumeBalanceMoveOptions --- PASS: TestVolumeBalanceMoveOptions (0.00s) === RUN TestBalanceDoesNotDrainOntoOneNode hdd 0.33 1.00:0.10 moving volume 3 full => empty hdd 0.33 0.67:0.10 moving volume 1 full => empty hdd 0.33 0.43:0.22 moving volume 2 full => empty --- PASS: TestBalanceDoesNotDrainOntoOneNode (0.00s) === RUN TestBalanceByDiskUsage hdd 0.03 0.43:0.02 moving volume 103 half-full => byte-full hdd 0.03 0.36:0.02 moving volume 108 half-full => byte-full hdd 0.03 0.30:0.02 moving volume 104 half-full => byte-full hdd 0.03 0.25:0.02 moving volume 107 half-full => byte-full hdd 0.03 0.20:0.02 moving volume 105 half-full => byte-full hdd 0.03 0.15:0.02 moving volume 109 half-full => byte-full hdd 0.03 0.11:0.03 moving volume 106 half-full => byte-full hdd 0.03 0.07:0.03 moving volume 110 half-full => byte-full hdd 0.03 0.03:0.03 moving volume 101 half-full => byte-full hdd 14.00 19.00:10.00 moving volume 11 byte-full => half-full hdd 14.00 18.00:11.00 moving volume 18 byte-full => half-full hdd 14.00 17.00:12.00 moving volume 13 byte-full => half-full hdd 14.00 16.00:13.00 moving volume 17 byte-full => half-full hdd 14.00 15.00:14.00 moving volume 9 byte-full => half-full --- PASS: TestBalanceByDiskUsage (0.01s) === RUN TestBalanceByDiskUsageUsesPhysicalDiskUsageWhenReported hdd 0.52 0.99:0.10 moving volume 5 physical-full => target hdd 0.52 0.99:0.10 moving volume 3 physical-full => target hdd 0.52 0.99:0.10 moving volume 1 physical-full => target hdd 0.52 0.99:0.10 moving volume 2 physical-full => target hdd 0.52 0.99:0.10 moving volume 4 physical-full => target --- PASS: TestBalanceByDiskUsageUsesPhysicalDiskUsageWhenReported (0.00s) === RUN TestBalanceByDiskUsageMixedReportingFallsBackToDataSize hdd 6.67 19.00:1.00 moving volume 101 new-full => new-target hdd 6.67 18.00:2.00 moving volume 109 new-full => new-target hdd 6.67 17.00:2.00 moving volume 108 new-full => old-empty hdd 6.67 16.00:3.00 moving volume 104 new-full => old-empty hdd 6.67 15.00:3.00 moving volume 114 new-full => new-target hdd 6.67 14.00:4.00 moving volume 105 new-full => new-target hdd 6.67 13.00:4.00 moving volume 115 new-full => old-empty hdd 6.67 12.00:5.00 moving volume 106 new-full => old-empty hdd 6.67 11.00:5.00 moving volume 116 new-full => new-target hdd 6.67 10.00:6.00 moving volume 110 new-full => new-target hdd 6.67 9.00:6.00 moving volume 119 new-full => old-empty --- PASS: TestBalanceByDiskUsageMixedReportingFallsBackToDataSize (0.01s) === RUN TestBalanceSkipsPhysicallyFullTarget hdd 0.01 2.33:0.00 moving volume 3 source => disk-full hdd 0.01 1.50:0.00 moving volume 2 source => disk-full hdd 0.01 1.00:0.00 moving volume 1 source => disk-full hdd 0.01 0.67:0.00 moving volume 6 source => disk-full hdd 0.01 0.43:0.01 moving volume 7 source => disk-full hdd 0.01 0.25:0.01 moving volume 4 source => disk-full hdd 0.01 2.33:0.00 moving volume 1 source => disk-full hdd 0.01 1.50:0.00 moving volume 5 source => disk-full hdd 0.01 1.00:0.00 moving volume 4 source => disk-full hdd 0.01 0.67:0.00 moving volume 6 source => disk-full hdd 0.01 0.43:0.01 moving volume 8 source => disk-full hdd 0.01 0.25:0.01 moving volume 2 source => disk-full --- PASS: TestBalanceSkipsPhysicallyFullTarget (0.01s) === RUN TestBalanceGateSteersToEmptierDisk hdd 0.00 2.33:0.00 moving volume 6 source => disk-empty hdd 0.00 1.50:0.00 moving volume 7 source => disk-empty hdd 0.00 1.00:0.00 moving volume 8 source => disk-empty --- PASS: TestBalanceGateSteersToEmptierDisk (0.00s) === RUN TestBalanceVolumesPerExec hdd 0.33 1.00:0.10 moving volume 6 full => empty --- PASS: TestBalanceVolumesPerExec (0.00s) === RUN TestVolumeSelection collect volumes quiet for: 0 seconds --- PASS: TestVolumeSelection (0.26s) === RUN TestDeleteEmptySelection --- PASS: TestDeleteEmptySelection (0.25s) === RUN TestSplitCSVSet === RUN TestSplitCSVSet/empty_input_is_empty_set_(no_filter) === RUN TestSplitCSVSet/whitespace_only_is_empty_set_(no_filter) === RUN TestSplitCSVSet/commas_only_is_empty_set_(no_filter) === RUN TestSplitCSVSet/whitespace_and_commas_only_is_empty_set_(no_filter) === RUN TestSplitCSVSet/single === RUN TestSplitCSVSet/multi === RUN TestSplitCSVSet/trims_whitespace === RUN TestSplitCSVSet/skips_empty_items --- PASS: TestSplitCSVSet (0.01s) --- PASS: TestSplitCSVSet/empty_input_is_empty_set_(no_filter) (0.00s) --- PASS: TestSplitCSVSet/whitespace_only_is_empty_set_(no_filter) (0.00s) --- PASS: TestSplitCSVSet/commas_only_is_empty_set_(no_filter) (0.00s) --- PASS: TestSplitCSVSet/whitespace_and_commas_only_is_empty_set_(no_filter) (0.00s) --- PASS: TestSplitCSVSet/single (0.00s) --- PASS: TestSplitCSVSet/multi (0.00s) --- PASS: TestSplitCSVSet/trims_whitespace (0.00s) --- PASS: TestSplitCSVSet/skips_empty_items (0.00s) === RUN TestCollectVolumeServersByDcRackNode_RackFilter --- PASS: TestCollectVolumeServersByDcRackNode_RackFilter (0.00s) === RUN TestCollectVolumeServersByDcRackNode_NodeFilter --- PASS: TestCollectVolumeServersByDcRackNode_NodeFilter (0.00s) === RUN TestLiveDivergenceClassifiesOneSidedVsTwoSided --- PASS: TestLiveDivergenceClassifiesOneSidedVsTwoSided (0.20s) === RUN TestReportDivergenceVerdictEmitsCopyCommand --- PASS: TestReportDivergenceVerdictEmitsCopyCommand (0.00s) === RUN TestDoVolumeCheckDiskDoesNotResurrectAbsentNeedle --- PASS: TestDoVolumeCheckDiskDoesNotResurrectAbsentNeedle (0.01s) === RUN TestDoVolumeCheckDiskResurrectSkipsVacuumedTarget --- PASS: TestDoVolumeCheckDiskResurrectSkipsVacuumedTarget (0.01s) === RUN TestDoVolumeCheckDiskResurrectQueuesProvenMissingWrite --- PASS: TestDoVolumeCheckDiskResurrectQueuesProvenMissingWrite (0.02s) === RUN TestShouldSkipVolume === RUN TestShouldSkipVolume/identical_volumes_should_be_skipped === RUN TestShouldSkipVolume/different_file_counts_should_not_be_skipped === RUN TestShouldSkipVolume/different_delete_counts_with_syncDeletions_enabled_should_not_be_skipped === RUN TestShouldSkipVolume/different_delete_counts_with_syncDeletions_disabled_should_be_skipped_if_file_counts_match === RUN TestShouldSkipVolume/volumes_with_zero_file_counts_should_be_skipped === RUN TestShouldSkipVolume/volumes_with_zero_and_non-zero_file_counts_should_not_be_skipped === RUN TestShouldSkipVolume/recently_modified_volumes_with_same_file_counts_should_be_skipped === RUN TestShouldSkipVolume/one_volume_modified_before_pulse_cutoff_with_different_file_counts_should_not_be_skipped === RUN TestShouldSkipVolume/different_modification_times_with_same_file_counts_should_be_skipped === RUN TestShouldSkipVolume/volumes_modified_exactly_at_pulse_cutoff_boundary_with_different_counts_should_not_be_skipped === RUN TestShouldSkipVolume/volumes_modified_just_after_pulse_cutoff_boundary_with_same_counts_should_be_skipped === RUN TestShouldSkipVolume/large_file_count_difference_with_old_modification_time_should_not_be_skipped === RUN TestShouldSkipVolume/both_volumes_modified_after_pulse_cutoff_with_same_file_counts_should_be_skipped --- PASS: TestShouldSkipVolume (0.03s) --- PASS: TestShouldSkipVolume/identical_volumes_should_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/different_file_counts_should_not_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/different_delete_counts_with_syncDeletions_enabled_should_not_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/different_delete_counts_with_syncDeletions_disabled_should_be_skipped_if_file_counts_match (0.00s) --- PASS: TestShouldSkipVolume/volumes_with_zero_file_counts_should_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/volumes_with_zero_and_non-zero_file_counts_should_not_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/recently_modified_volumes_with_same_file_counts_should_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/one_volume_modified_before_pulse_cutoff_with_different_file_counts_should_not_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/different_modification_times_with_same_file_counts_should_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/volumes_modified_exactly_at_pulse_cutoff_boundary_with_different_counts_should_not_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/volumes_modified_just_after_pulse_cutoff_boundary_with_same_counts_should_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/large_file_count_difference_with_old_modification_time_should_not_be_skipped (0.00s) --- PASS: TestShouldSkipVolume/both_volumes_modified_after_pulse_cutoff_with_same_file_counts_should_be_skipped (0.00s) === RUN TestVolumeCheckDiskHelperMethods --- PASS: TestVolumeCheckDiskHelperMethods (0.00s) === RUN TestConfigureReplicationOnVolumeServersReportsEveryFailingServer === RUN TestConfigureReplicationOnVolumeServersReportsEveryFailingServer/maxParallelization=1 === RUN TestConfigureReplicationOnVolumeServersReportsEveryFailingServer/maxParallelization=10 --- PASS: TestConfigureReplicationOnVolumeServersReportsEveryFailingServer (0.10s) --- PASS: TestConfigureReplicationOnVolumeServersReportsEveryFailingServer/maxParallelization=1 (0.08s) --- PASS: TestConfigureReplicationOnVolumeServersReportsEveryFailingServer/maxParallelization=10 (0.02s) === RUN TestConfigureReplicationOnVolumeServersConfiguresReplicasOneAtATime --- PASS: TestConfigureReplicationOnVolumeServersConfiguresReplicasOneAtATime (0.11s) === RUN TestConfigureReplicationOnVolumeServersRunsServersInParallelUpToTheLimit --- PASS: TestConfigureReplicationOnVolumeServersRunsServersInParallelUpToTheLimit (0.14s) === RUN TestIsEmptyVolumeDeleteCandidate === RUN TestIsEmptyVolumeDeleteCandidate/small_.dat_is_empty === RUN TestIsEmptyVolumeDeleteCandidate/all_needles_deleted_is_empty === RUN TestIsEmptyVolumeDeleteCandidate/live_needles_keep_the_volume === RUN TestIsEmptyVolumeDeleteCandidate/overwrites_alone_are_not_empty === RUN TestIsEmptyVolumeDeleteCandidate/recent_all-deleted_volume_is_kept === RUN TestIsEmptyVolumeDeleteCandidate/never_written_volume_is_kept === RUN TestIsEmptyVolumeDeleteCandidate/remote-backed_replica_is_kept === RUN TestIsEmptyVolumeDeleteCandidate/remote-backed_garbage_is_kept === RUN TestIsEmptyVolumeDeleteCandidate/protected_read-only_volume_is_kept === RUN TestIsEmptyVolumeDeleteCandidate/deletable_read-only_volume_can_go --- PASS: TestIsEmptyVolumeDeleteCandidate (0.01s) --- PASS: TestIsEmptyVolumeDeleteCandidate/small_.dat_is_empty (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/all_needles_deleted_is_empty (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/live_needles_keep_the_volume (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/overwrites_alone_are_not_empty (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/recent_all-deleted_volume_is_kept (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/never_written_volume_is_kept (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/remote-backed_replica_is_kept (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/remote-backed_garbage_is_kept (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/protected_read-only_volume_is_kept (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/deletable_read-only_volume_can_go (0.00s) === RUN TestFixReplicationCollectionPattern === RUN TestFixReplicationCollectionPattern/empty_pattern_matches_any_collection === RUN TestFixReplicationCollectionPattern/empty_pattern_matches_empty_collection === RUN TestFixReplicationCollectionPattern/default_pattern_matches_empty_collection === RUN TestFixReplicationCollectionPattern/default_pattern_rejects_named_collection === RUN TestFixReplicationCollectionPattern/exact_match === RUN TestFixReplicationCollectionPattern/exact_mismatch === RUN TestFixReplicationCollectionPattern/prefix_wildcard_match === RUN TestFixReplicationCollectionPattern/prefix_wildcard_mismatch === RUN TestFixReplicationCollectionPattern/single_char_wildcard_match === RUN TestFixReplicationCollectionPattern/single_char_wildcard_mismatch === RUN TestFixReplicationCollectionPattern/list_matches_a_listed_collection === RUN TestFixReplicationCollectionPattern/list_rejects_an_unlisted_collection --- PASS: TestFixReplicationCollectionPattern (0.01s) --- PASS: TestFixReplicationCollectionPattern/empty_pattern_matches_any_collection (0.00s) --- PASS: TestFixReplicationCollectionPattern/empty_pattern_matches_empty_collection (0.00s) --- PASS: TestFixReplicationCollectionPattern/default_pattern_matches_empty_collection (0.00s) --- PASS: TestFixReplicationCollectionPattern/default_pattern_rejects_named_collection (0.00s) --- PASS: TestFixReplicationCollectionPattern/exact_match (0.00s) --- PASS: TestFixReplicationCollectionPattern/exact_mismatch (0.00s) --- PASS: TestFixReplicationCollectionPattern/prefix_wildcard_match (0.00s) --- PASS: TestFixReplicationCollectionPattern/prefix_wildcard_mismatch (0.00s) --- PASS: TestFixReplicationCollectionPattern/single_char_wildcard_match (0.00s) --- PASS: TestFixReplicationCollectionPattern/single_char_wildcard_mismatch (0.00s) --- PASS: TestFixReplicationCollectionPattern/list_matches_a_listed_collection (0.00s) --- PASS: TestFixReplicationCollectionPattern/list_rejects_an_unlisted_collection (0.00s) === RUN TestReserveTargetSpreadsAcrossServers --- PASS: TestReserveTargetSpreadsAcrossServers (0.11s) === RUN TestFixUnderReplicatedVolumesInParallel --- PASS: TestFixUnderReplicatedVolumesInParallel (0.01s) === RUN TestSatisfyReplicaPlacementComplicated replication: 100 expected false name: test 100 negative replication: 100 expected true name: test 100 positive replication: 022 expected true name: test 022 positive replication: 022 expected false name: test 022 negative replication: 210 expected true name: test 210 moved from 200 positive replication: 210 expected false name: test 210 moved from 200 negative extra dc replication: 210 expected false name: test 210 moved from 200 negative extra data node --- PASS: TestSatisfyReplicaPlacementComplicated (0.00s) === RUN TestSatisfyReplicaPlacement01x replication: 011 expected true name: test 011 same existing rack replication: 011 expected false name: test 011 negative replication: 011 expected true name: test 011 different existing racks replication: 011 expected false name: test 011 different existing racks negative --- PASS: TestSatisfyReplicaPlacement01x (0.00s) === RUN TestSatisfyReplicaPlacement00x replication: 001 expected true name: test 001 replication: 002 expected true name: test 002 positive replication: 002 expected false name: test 002 negative, repeat the same node replication: 002 expected false name: test 002 negative, enough node already --- PASS: TestSatisfyReplicaPlacement00x (0.00s) === RUN TestSatisfyReplicaPlacement100 replication: 100 expected true name: test 100 --- PASS: TestSatisfyReplicaPlacement100 (0.00s) === RUN TestMisplacedChecking replication: 001 expected true name: test 001 replication: 010 expected false name: test 010 replication: 011 expected false name: test 011 replication: 110 expected true name: test 110 replication: 100 expected true name: test 100 --- PASS: TestMisplacedChecking (0.01s) === RUN TestPickingMisplacedVolumeToDelete replication: 001 name: test 001 command_volume_fix_replication_test.go:443: test 001: picked dn2 001 replication: 100 name: test 100 command_volume_fix_replication_test.go:443: test 100: picked dn2 100 --- PASS: TestPickingMisplacedVolumeToDelete (0.01s) === RUN TestPickOneReplicaToDeleteSkipsReadOnlySurvivor === RUN TestPickOneReplicaToDeleteSkipsReadOnlySurvivor/refuses_to_delete_the_only_writable_replica_while_a_read-only_survivor_remains === RUN TestPickOneReplicaToDeleteSkipsReadOnlySurvivor/refuses_when_all_replicas_are_read-only === RUN TestPickOneReplicaToDeleteSkipsReadOnlySurvivor/trims_the_smallest_writable_replica_and_never_the_read-only_one --- PASS: TestPickOneReplicaToDeleteSkipsReadOnlySurvivor (0.01s) --- PASS: TestPickOneReplicaToDeleteSkipsReadOnlySurvivor/refuses_to_delete_the_only_writable_replica_while_a_read-only_survivor_remains (0.00s) --- PASS: TestPickOneReplicaToDeleteSkipsReadOnlySurvivor/refuses_when_all_replicas_are_read-only (0.00s) --- PASS: TestPickOneReplicaToDeleteSkipsReadOnlySurvivor/trims_the_smallest_writable_replica_and_never_the_read-only_one (0.00s) === RUN TestPickOneMisplacedVolumeRelocatesReadOnlyReplicas --- PASS: TestPickOneMisplacedVolumeRelocatesReadOnlyReplicas (0.00s) === RUN TestPickOneReplicaToDeletePreservesPlacement --- PASS: TestPickOneReplicaToDeletePreservesPlacement (0.00s) === RUN TestSatisfyReplicaCurrentLocation === RUN TestSatisfyReplicaCurrentLocation/test_001 === RUN TestSatisfyReplicaCurrentLocation/test_010 === RUN TestSatisfyReplicaCurrentLocation/test_011 === RUN TestSatisfyReplicaCurrentLocation/test_110 === RUN TestSatisfyReplicaCurrentLocation/test_100 --- PASS: TestSatisfyReplicaCurrentLocation (0.01s) --- PASS: TestSatisfyReplicaCurrentLocation/test_001 (0.00s) --- PASS: TestSatisfyReplicaCurrentLocation/test_010 (0.00s) --- PASS: TestSatisfyReplicaCurrentLocation/test_011 (0.00s) --- PASS: TestSatisfyReplicaCurrentLocation/test_110 (0.00s) --- PASS: TestSatisfyReplicaCurrentLocation/test_100 (0.00s) === RUN TestClassifyReplicaSet === RUN TestClassifyReplicaSet/110_misplaced_without_surplus_adds_before_trimming === RUN TestClassifyReplicaSet/110_misplaced_with_surplus_trims === RUN TestClassifyReplicaSet/010_missing_a_replica_adds === RUN TestClassifyReplicaSet/010_surplus_count_but_missing_rack_spread_adds === RUN TestClassifyReplicaSet/010_well_placed_needs_nothing === RUN TestClassifyReplicaSet/000_duplicate_copy_trims --- PASS: TestClassifyReplicaSet (0.01s) --- PASS: TestClassifyReplicaSet/110_misplaced_without_surplus_adds_before_trimming (0.00s) --- PASS: TestClassifyReplicaSet/110_misplaced_with_surplus_trims (0.00s) --- PASS: TestClassifyReplicaSet/010_missing_a_replica_adds (0.00s) --- PASS: TestClassifyReplicaSet/010_surplus_count_but_missing_rack_spread_adds (0.00s) --- PASS: TestClassifyReplicaSet/010_well_placed_needs_nothing (0.00s) --- PASS: TestClassifyReplicaSet/000_duplicate_copy_trims (0.00s) === RUN TestDeleteOneVolumeRechecksSurvivorsBeforeDelete === RUN TestDeleteOneVolumeRechecksSurvivorsBeforeDelete/survivor_stays === RUN TestDeleteOneVolumeRechecksSurvivorsBeforeDelete/survivor_gone_after_its_index_read --- PASS: TestDeleteOneVolumeRechecksSurvivorsBeforeDelete (0.21s) --- PASS: TestDeleteOneVolumeRechecksSurvivorsBeforeDelete/survivor_stays (0.13s) --- PASS: TestDeleteOneVolumeRechecksSurvivorsBeforeDelete/survivor_gone_after_its_index_read (0.08s) === RUN TestVolumeFsckFindMissingFilerEntriesForDeletedSelectedVolume --- PASS: TestVolumeFsckFindMissingFilerEntriesForDeletedSelectedVolume (0.08s) === RUN TestVolumeFsckSelectedVolumeIDValidation --- PASS: TestVolumeFsckSelectedVolumeIDValidation (0.00s) === RUN TestValidateMissingVolumeCollectionFilter --- PASS: TestValidateMissingVolumeCollectionFilter (0.00s) === RUN TestValidateMissingVolumePurgeConfirmation === RUN TestValidateMissingVolumePurgeConfirmation/read-only_scan === RUN TestValidateMissingVolumePurgeConfirmation/purge_known_volumes_only === RUN TestValidateMissingVolumePurgeConfirmation/confirmed_missing_volume_purge === RUN TestValidateMissingVolumePurgeConfirmation/unconfirmed_missing_volume_purge --- PASS: TestValidateMissingVolumePurgeConfirmation (0.00s) --- PASS: TestValidateMissingVolumePurgeConfirmation/read-only_scan (0.00s) --- PASS: TestValidateMissingVolumePurgeConfirmation/purge_known_volumes_only (0.00s) --- PASS: TestValidateMissingVolumePurgeConfirmation/confirmed_missing_volume_purge (0.00s) --- PASS: TestValidateMissingVolumePurgeConfirmation/unconfirmed_missing_volume_purge (0.00s) === RUN TestVolumeFsckPurgesEntryWhoseManifestIsOnMissingVolume E1117 09:40:52.793862 filechunk_manifest.go:384 operation LookupFileId 99,0100000001 failed, err: rpc error: code = Unimplemented desc = method LookupVolume not implemented --- PASS: TestVolumeFsckPurgesEntryWhoseManifestIsOnMissingVolume (0.09s) === RUN TestVolumeFsckCanPurgeDirectory --- PASS: TestVolumeFsckCanPurgeDirectory (0.00s) === RUN TestVolumeFsckHttpDeleteRecordsParentDirectory --- PASS: TestVolumeFsckHttpDeleteRecordsParentDirectory (0.02s) === RUN TestVolumeFsckPurgeEmptyDirectories --- PASS: TestVolumeFsckPurgeEmptyDirectories (0.06s) === RUN TestVolumeFsckPurgeEmptyDirectoriesKeepsFreshDirectory --- PASS: TestVolumeFsckPurgeEmptyDirectoriesKeepsFreshDirectory (0.03s) === RUN TestVolumeFsckPurgeEmptyDirectoriesKeepsChangedDirectory --- PASS: TestVolumeFsckPurgeEmptyDirectoriesKeepsChangedDirectory (0.03s) === RUN TestVolumeFsckPurgeWorkerLimit --- PASS: TestVolumeFsckPurgeWorkerLimit (0.02s) === RUN TestVolumeFsckPurgeWorkersAtLeastOne --- PASS: TestVolumeFsckPurgeWorkersAtLeastOne (0.00s) === RUN TestVolumeFsckPurgeHardLinksSerialized --- PASS: TestVolumeFsckPurgeHardLinksSerialized (0.06s) === RUN TestVolumeFsckCollectFilerFileIdsReachesOutsideBucket --- PASS: TestVolumeFsckCollectFilerFileIdsReachesOutsideBucket (0.32s) === RUN TestVolumeFsckCheckOneVolumeQueuesOrphansWithHardLinkId --- PASS: TestVolumeFsckCheckOneVolumeQueuesOrphansWithHardLinkId (0.08s) === RUN TestReadFilerFileIdFileRejectsTruncatedHardLinkId --- PASS: TestReadFilerFileIdFileRejectsTruncatedHardLinkId (0.00s) === RUN TestVolumeFsckPurgeBatchWorkersProcessesBatches --- PASS: TestVolumeFsckPurgeBatchWorkersProcessesBatches (0.00s) === RUN TestVolumeFsckCheckOneVolumeDeduplicatesMissingChunksForSamePath --- PASS: TestVolumeFsckCheckOneVolumeDeduplicatesMissingChunksForSamePath (0.04s) === RUN TestVolumeFsckHttpDeleteBatchDeduplicatesAndRecordsDirs --- PASS: TestVolumeFsckHttpDeleteBatchDeduplicatesAndRecordsDirs (0.03s) === RUN TestVolumeFsckCollectFilerFileIdsReportsFailedFlush --- PASS: TestVolumeFsckCollectFilerFileIdsReportsFailedFlush (0.05s) === RUN TestParsing --- PASS: TestParsing (8.97s) === RUN TestWriteDataNodeInfo_SplitsCollapsedDisksByPhysicalDiskId --- PASS: TestWriteDataNodeInfo_SplitsCollapsedDisksByPhysicalDiskId (0.01s) === RUN TestWriteTopologyInfo_PrintsParentHeadersOnce --- PASS: TestWriteTopologyInfo_PrintsParentHeadersOnce (0.01s) === RUN TestFindDuplicateVolumeIds === RUN TestFindDuplicateVolumeIds/flags_id_shared_across_collections === RUN TestFindDuplicateVolumeIds/replicas_of_one_volume_are_not_duplicates === RUN TestFindDuplicateVolumeIds/default_empty_collection_counts_as_its_own_collection === RUN TestFindDuplicateVolumeIds/normal_volume_and_ec_shard_sharing_an_id_across_collections --- PASS: TestFindDuplicateVolumeIds (0.01s) --- PASS: TestFindDuplicateVolumeIds/flags_id_shared_across_collections (0.00s) --- PASS: TestFindDuplicateVolumeIds/replicas_of_one_volume_are_not_duplicates (0.00s) --- PASS: TestFindDuplicateVolumeIds/default_empty_collection_counts_as_its_own_collection (0.00s) --- PASS: TestFindDuplicateVolumeIds/normal_volume_and_ec_shard_sharing_an_id_across_collections (0.00s) === RUN TestWriteDuplicateVolumeIdWarning --- PASS: TestWriteDuplicateVolumeIdWarning (0.00s) === RUN TestCollectVolumeMarkTargetsByCollection --- PASS: TestCollectVolumeMarkTargetsByCollection (0.00s) === RUN TestCollectVolumeMarkTargetsByCollectionMatchesDefaultCollection --- PASS: TestCollectVolumeMarkTargetsByCollectionMatchesDefaultCollection (0.00s) === RUN TestCollectVolumeMarkTargetsByCollectionRejectsEmptyCollection --- PASS: TestCollectVolumeMarkTargetsByCollectionRejectsEmptyCollection (0.00s) === RUN TestCollectVolumeMarkTargetsByCollectionReportsMissingCollection --- PASS: TestCollectVolumeMarkTargetsByCollectionReportsMissingCollection (0.00s) === RUN TestVolumeMarkRejectsCollectionWithNodeOrVolumeId --- PASS: TestVolumeMarkRejectsCollectionWithNodeOrVolumeId (0.00s) === RUN TestVolumeMarkRejectsEmptyCollectionFlag --- PASS: TestVolumeMarkRejectsEmptyCollectionFlag (0.00s) === RUN TestEvaluateMergedVolume --- PASS: TestEvaluateMergedVolume (0.00s) === RUN TestMergeNeedleStreamsOrdersByTimestamp --- PASS: TestMergeNeedleStreamsOrdersByTimestamp (0.00s) === RUN TestMergeNeedleStreamsDoesNotDeduplicateAcrossWindows --- PASS: TestMergeNeedleStreamsDoesNotDeduplicateAcrossWindows (0.00s) === RUN TestMergeNeedleStreamsSameStreamDuplicates --- PASS: TestMergeNeedleStreamsSameStreamDuplicates (0.00s) === RUN TestMergeNeedleStreamsWithEmptyStream --- PASS: TestMergeNeedleStreamsWithEmptyStream (0.00s) === RUN TestMergeNeedleStreamsComplexDuplication --- PASS: TestMergeNeedleStreamsComplexDuplication (0.00s) === RUN TestMergeNeedleStreamsTimeWindowDeduplication --- PASS: TestMergeNeedleStreamsTimeWindowDeduplication (0.00s) === RUN TestMergeNeedleStreamsSingleStream --- PASS: TestMergeNeedleStreamsSingleStream (0.00s) === RUN TestMergeNeedleStreamsLargeIDs --- PASS: TestMergeNeedleStreamsLargeIDs (0.00s) === RUN TestMergeNeedleStreamsLastModifiedFallback --- PASS: TestMergeNeedleStreamsLastModifiedFallback (0.00s) === RUN TestMergeWorkflowValidation command_volume_merge_test.go:455: Volume merge workflow validated: 9 stages command_volume_merge_test.go:457: 1_collect_replicas: Query master to find all replicas of the target volume command_volume_merge_test.go:457: 2_validate_replicas: Verify at least 2 replicas exist and are healthy command_volume_merge_test.go:457: 3_allocate_temporary: Create temporary merge volume on third location (not a current replica) command_volume_merge_test.go:457: 7_delete_temporary: Delete the temporary merge volume from the third location command_volume_merge_test.go:457: 8_restore_writable: Restore writable state for replicas that were originally writable command_volume_merge_test.go:457: 4_mark_readonly: Mark all original replicas as readonly command_volume_merge_test.go:457: 5_tail_and_merge: Tail all replica needles and merge by timestamp, deduplicating command_volume_merge_test.go:457: 6_copy_merged: Copy merged volume back to each original replica location command_volume_merge_test.go:457: 9_verify_completion: Log completion status to user --- PASS: TestMergeWorkflowValidation (0.00s) === RUN TestNeedleBlobFromNeedleRoundTrip --- PASS: TestNeedleBlobFromNeedleRoundTrip (0.00s) === RUN TestMergeEdgeCaseHandling command_volume_merge_test.go:554: ✓ Edge case handled: empty_replica_stream command_volume_merge_test.go:554: ✓ Edge case handled: merge_volume_writeend_failure command_volume_merge_test.go:554: ✓ Edge case handled: replica_already_readonly command_volume_merge_test.go:554: ✓ Edge case handled: different_needle_metadata command_volume_merge_test.go:554: ✓ Edge case handled: concurrent_writes_prevented command_volume_merge_test.go:554: ✓ Edge case handled: duplicate_needles_across_streams command_volume_merge_test.go:554: ✓ Edge case handled: large_volume_memory_efficiency command_volume_merge_test.go:554: ✓ Edge case handled: target_server_allocation_failure command_volume_merge_test.go:554: ✓ Edge case handled: network_timeout_during_tail command_volume_merge_test.go:554: ✓ Edge case handled: duplicate_needles_same_stream command_volume_merge_test.go:561: All 10 edge cases are handled --- PASS: TestMergeEdgeCaseHandling (0.00s) === RUN TestVolumeServerAddressesUseRegisteredGrpcPort --- PASS: TestVolumeServerAddressesUseRegisteredGrpcPort (0.00s) === RUN TestEveryNodeNamesGrpcPort --- PASS: TestEveryNodeNamesGrpcPort (0.00s) === RUN TestEvacuatePrefersLowerVolumeRatio moving volume 1 source => emptier --- PASS: TestEvacuatePrefersLowerVolumeRatio (0.00s) === RUN TestVolumeServerEvacuate moving volume collection0_15 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection0_21 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection0_22 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection0_23 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection0_24 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection0_25 192.168.1.4:8080 => 192.168.1.6:8080 moving volume 27 192.168.1.4:8080 => 192.168.1.6:8080 moving volume 28 192.168.1.4:8080 => 192.168.1.6:8080 moving volume 29 192.168.1.4:8080 => 192.168.1.6:8080 moving volume 30 192.168.1.4:8080 => 192.168.1.6:8080 moving volume 31 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_33 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_38 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_51 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_52 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_54 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_63 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_69 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_74 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_80 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_84 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_85 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_97 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_98 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_105 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_106 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_112 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_116 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_119 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_128 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_133 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_136 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_138 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_140 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_144 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_161 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_173 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_174 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_197 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection1_219 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection2_263 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection2_272 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection2_291 192.168.1.4:8080 => 192.168.1.5:8080 moving volume collection2_299 192.168.1.4:8080 => 192.168.1.5:8080 moving volume collection2_301 192.168.1.4:8080 => 192.168.1.5:8080 moving volume collection2_302 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection2_339 192.168.1.4:8080 => 192.168.1.6:8080 moving volume collection2_345 192.168.1.4:8080 => 192.168.1.5:8080 moving volume collection2_355 192.168.1.4:8080 => 192.168.1.5:8080 moving volume collection2_373 192.168.1.4:8080 => 192.168.1.6:8080 --- PASS: TestVolumeServerEvacuate (0.44s) === RUN TestVolumeServerEvacuateNoLockFlag --- PASS: TestVolumeServerEvacuateNoLockFlag (0.00s) === RUN TestVolumeServerEvacuateReturnsFlagParseError invalid boolean value "invalid" for -noLock: parse error Usage of volumeServer.evacuate: -apply actually apply the changes -force actually apply the changes (alias for -apply) -maxParallelization int run up to X EC shard moves in parallel (default 1) -movesPerExec int how many volumes and EC shards to move in one run (default is 0 for unlimited) -noLock do not lock the admin shell at one's own risk -node string : of the volume server -rack string source rack for the volume servers -retry int how many times to retry -skipNonMoveable skip volumes that can not be moved -target string : of target volume --- PASS: TestVolumeServerEvacuateReturnsFlagParseError (0.00s) === RUN TestVolumeServerEvacuateHelpIsNotAnError Usage of volumeServer.evacuate: -apply actually apply the changes -force actually apply the changes (alias for -apply) -maxParallelization int run up to X EC shard moves in parallel (default 1) -movesPerExec int how many volumes and EC shards to move in one run (default is 0 for unlimited) -noLock do not lock the admin shell at one's own risk -node string : of the volume server -rack string source rack for the volume servers -retry int how many times to retry -skipNonMoveable skip volumes that can not be moved -target string : of target volume --- PASS: TestVolumeServerEvacuateHelpIsNotAnError (0.00s) === RUN TestVolumeServerEvacuateEcPlansEveryShard --- PASS: TestVolumeServerEvacuateEcPlansEveryShard (0.02s) === RUN TestVolumeServerEvacuateEcMovesPerExec --- PASS: TestVolumeServerEvacuateEcMovesPerExec (0.02s) === RUN TestVolumeServerEvacuateEcMovesPerExecCutsInsideVolume --- PASS: TestVolumeServerEvacuateEcMovesPerExecCutsInsideVolume (0.08s) === RUN TestVolumeServerEvacuateEcFailedMoveFreesItsTarget --- PASS: TestVolumeServerEvacuateEcFailedMoveFreesItsTarget (0.01s) === RUN TestVolumeServerEvacuateEcEndsWhenEveryMoveFails --- PASS: TestVolumeServerEvacuateEcEndsWhenEveryMoveFails (0.01s) === RUN TestVolumeServerEvacuateEcLostLockFailsTheRun --- PASS: TestVolumeServerEvacuateEcLostLockFailsTheRun (0.01s) === RUN TestVolumeServerEvacuateEcReportsMovesPerExecWhenApplied --- PASS: TestVolumeServerEvacuateEcReportsMovesPerExecWhenApplied (0.01s) === RUN TestVolumeServerEvacuateEcPlansAgainUntilNoRoomIsLeft --- PASS: TestVolumeServerEvacuateEcPlansAgainUntilNoRoomIsLeft (0.02s) === RUN TestVolumeServerEvacuateEcFailedMoveGivesBackItsSlots --- PASS: TestVolumeServerEvacuateEcFailedMoveGivesBackItsSlots (0.01s) === RUN TestVolumeServerEvacuateEcFailedMoveOntoAnExistingShardGivesBackItsSlot --- PASS: TestVolumeServerEvacuateEcFailedMoveOntoAnExistingShardGivesBackItsSlot (0.01s) === RUN TestFindRemoteVolumeInTopology === RUN TestFindRemoteVolumeInTopology/find_existing_remote_volume === RUN TestFindRemoteVolumeInTopology/find_remote_volume_with_different_backend === RUN TestFindRemoteVolumeInTopology/find_remote_volume_on_another_server === RUN TestFindRemoteVolumeInTopology/local_volume_not_found_as_remote === RUN TestFindRemoteVolumeInTopology/non-existent_volume_not_found === RUN TestFindRemoteVolumeInTopology/filter_by_matching_collection_exact === RUN TestFindRemoteVolumeInTopology/filter_by_matching_collection_regex === RUN TestFindRemoteVolumeInTopology/filter_by_non-matching_collection --- PASS: TestFindRemoteVolumeInTopology (0.02s) --- PASS: TestFindRemoteVolumeInTopology/find_existing_remote_volume (0.00s) --- PASS: TestFindRemoteVolumeInTopology/find_remote_volume_with_different_backend (0.00s) --- PASS: TestFindRemoteVolumeInTopology/find_remote_volume_on_another_server (0.00s) --- PASS: TestFindRemoteVolumeInTopology/local_volume_not_found_as_remote (0.00s) --- PASS: TestFindRemoteVolumeInTopology/non-existent_volume_not_found (0.00s) --- PASS: TestFindRemoteVolumeInTopology/filter_by_matching_collection_exact (0.00s) --- PASS: TestFindRemoteVolumeInTopology/filter_by_matching_collection_regex (0.00s) --- PASS: TestFindRemoteVolumeInTopology/filter_by_non-matching_collection (0.00s) === RUN TestFindRemoteVolumeInTopologyInvalidPattern --- PASS: TestFindRemoteVolumeInTopologyInvalidPattern (0.00s) === RUN TestCollectRemoteVolumesWithInfo === RUN TestCollectRemoteVolumesWithInfo/empty_pattern_matches_empty_collection_only === RUN TestCollectRemoteVolumesWithInfo/match_all_collections === RUN TestCollectRemoteVolumesWithInfo/match_specific_collection === RUN TestCollectRemoteVolumesWithInfo/match_collection_prefix === RUN TestCollectRemoteVolumesWithInfo/match_bucket_collection === RUN TestCollectRemoteVolumesWithInfo/no_match --- PASS: TestCollectRemoteVolumesWithInfo (0.01s) --- PASS: TestCollectRemoteVolumesWithInfo/empty_pattern_matches_empty_collection_only (0.00s) --- PASS: TestCollectRemoteVolumesWithInfo/match_all_collections (0.00s) --- PASS: TestCollectRemoteVolumesWithInfo/match_specific_collection (0.00s) --- PASS: TestCollectRemoteVolumesWithInfo/match_collection_prefix (0.00s) --- PASS: TestCollectRemoteVolumesWithInfo/match_bucket_collection (0.00s) --- PASS: TestCollectRemoteVolumesWithInfo/no_match (0.00s) === RUN TestCollectRemoteVolumesWithInfoCaptures --- PASS: TestCollectRemoteVolumesWithInfoCaptures (0.00s) === RUN TestCollectRemoteVolumesWithInfoInvalidPattern --- PASS: TestCollectRemoteVolumesWithInfoInvalidPattern (0.00s) === RUN TestCollectVolumeTierCompactLocations --- PASS: TestCollectVolumeTierCompactLocations (0.00s) === RUN TestPlanTierCompactResync --- PASS: TestPlanTierCompactResync (0.00s) === RUN TestTierDownloadReplicatesBeforeDeletingRemoteObject --- PASS: TestTierDownloadReplicatesBeforeDeletingRemoteObject (0.11s) === RUN TestTierDownloadReplacesReplicaMissingFromFirstTopology --- PASS: TestTierDownloadReplacesReplicaMissingFromFirstTopology (0.09s) === RUN TestTierDownloadKeepsRemoteObjectWhenLastReplicaVanishes --- PASS: TestTierDownloadKeepsRemoteObjectWhenLastReplicaVanishes (0.08s) === RUN TestTierDownloadSingleReplicaDeletesRemoteObject --- PASS: TestTierDownloadSingleReplicaDeletesRemoteObject (0.02s) === RUN TestTierDownloadRerunReusesLocalReplica --- PASS: TestTierDownloadRerunReusesLocalReplica (0.07s) === RUN TestTierDownloadCopiesFromSsdSourceOntoHddReplica --- PASS: TestTierDownloadCopiesFromSsdSourceOntoHddReplica (0.08s) === RUN TestTierDownloadRestoresSourceAfterBlockingDeletes --- PASS: TestTierDownloadRestoresSourceAfterBlockingDeletes (0.14s) === RUN TestTierDownloadKeepsRemoteObjectWhileReplicasAreUnlisted --- PASS: TestTierDownloadKeepsRemoteObjectWhileReplicasAreUnlisted (0.11s) === RUN TestTierDownloadFailsWhenNoReplicaIsListed --- PASS: TestTierDownloadFailsWhenNoReplicaIsListed (0.00s) === RUN TestTierDownloadKeepsRemoteObjectForStaleTwinOnSource --- PASS: TestTierDownloadKeepsRemoteObjectForStaleTwinOnSource (0.03s) === RUN TestTierDownloadRestoresSourceWhenMarkFailsAfterApplying --- PASS: TestTierDownloadRestoresSourceWhenMarkFailsAfterApplying (0.06s) === RUN TestTierDownloadReportsSourceRestoreFailure --- PASS: TestTierDownloadReportsSourceRestoreFailure (0.08s) === RUN TestVolumeSelectionByDataCenter collect volumes quiet for: 0 seconds collect volumes quiet for: 0 seconds --- PASS: TestVolumeSelectionByDataCenter (0.26s) === RUN TestFilterLocationsByDataCenter --- PASS: TestFilterLocationsByDataCenter (0.27s) === RUN TestCollectVolumeTierUploadLocationsPrefersTieredReplica --- PASS: TestCollectVolumeTierUploadLocationsPrefersTieredReplica (0.00s) === RUN TestCollectVolumeTierUploadLocationsFiltersCollection --- PASS: TestCollectVolumeTierUploadLocationsFiltersCollection (0.00s) === RUN TestReadOnlyVolumesAboveThreshold --- PASS: TestReadOnlyVolumesAboveThreshold (0.00s) === RUN TestVacuumRequestsForPattern --- PASS: TestVacuumRequestsForPattern (0.01s) === RUN TestVacuumRequestsForVolumeIds --- PASS: TestVacuumRequestsForVolumeIds (0.00s) === RUN TestFilerDiscoveryRetriesUntilFilerAppears I1117 09:41:04.787788 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{leader:"127.0.0.1:0.42215"} --- PASS: TestFilerDiscoveryRetriesUntilFilerAppears (2.13s) === RUN TestFilerDiscoveryReturnsEmptyAtDeadline I1117 09:41:06.915127 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{leader:"127.0.0.1:0.36967"} no filer registered with master 127.0.0.1:0.36967 within 1.5s --- PASS: TestFilerDiscoveryReturnsEmptyAtDeadline (1.60s) === RUN TestFilerDiscoveryRetriesAfterEmptyResult I1117 09:41:08.514719 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{leader:"127.0.0.1:0.38937"} no filer registered with master 127.0.0.1:0.38937 within 1.5s --- PASS: TestFilerDiscoveryRetriesAfterEmptyResult (1.65s) === RUN TestFilerDiscoveryStopsOnNonTransientError I1117 09:41:10.166885 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{leader:"127.0.0.1:0.44157"} cannot list filers from master 127.0.0.1:0.44157: rpc error: code = PermissionDenied desc = denied --- PASS: TestFilerDiscoveryStopsOnNonTransientError (0.17s) === RUN TestFilerAddressConfiguredSkipsDiscovery --- PASS: TestFilerAddressConfiguredSkipsDiscovery (0.00s) === RUN TestProcessEachCmdReturnsErrors unknown command: definitely.not.a.command --- PASS: TestProcessEachCmdReturnsErrors (0.00s) === RUN TestRunShellConnectTimeout cannot connect to master 127.0.0.1:1 within 200ms --- PASS: TestRunShellConnectTimeout (0.21s) === RUN TestProcessEachCmdPreservesRegisteredCommandError error: daily_run: shard=3: recovery walk failed --- PASS: TestProcessEachCmdPreservesRegisteredCommandError (0.00s) === RUN TestNoLockDoesNotOutliveTheCommandThatSetIt --- PASS: TestNoLockDoesNotOutliveTheCommandThatSetIt (0.00s) === RUN TestNoLockResetRestoresTheRequirementForEveryInvocation --- PASS: TestNoLockResetRestoresTheRequirementForEveryInvocation (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/shell 36.670s === RUN TestSetDiskStatusSuccess --- PASS: TestSetDiskStatusSuccess (0.06s) === RUN TestSetDiskStatusReportsRepeatedFailures --- PASS: TestSetDiskStatusReportsRepeatedFailures (0.01s) === RUN TestSetDiskStatusRequiresRepeatedSuccessesToRecover --- PASS: TestSetDiskStatusRequiresRepeatedSuccessesToRecover (0.01s) === RUN TestSlowLatencyForFallsBackToDefault --- PASS: TestSlowLatencyForFallsBackToDefault (0.00s) === RUN TestRobinCounter --- PASS: TestRobinCounter (0.00s) === RUN TestUpdateBucketQuotaMetrics I1117 09:40:34.893355 metrics.go:1258 delete bucket metrics, quota-test-bucket: 2 --- PASS: TestUpdateBucketQuotaMetrics (0.04s) === RUN TestECRebuildMetricsRegistered --- PASS: TestECRebuildMetricsRegistered (0.27s) === RUN TestECRebuildCounterIncrement --- PASS: TestECRebuildCounterIncrement (0.00s) === RUN TestReplicationMetricsRegistered --- PASS: TestReplicationMetricsRegistered (0.01s) === RUN TestReplicationCounterIncrement --- PASS: TestReplicationCounterIncrement (0.00s) === RUN TestReplicationTargetsHistogram --- PASS: TestReplicationTargetsHistogram (0.04s) === RUN TestUnderReplicatedVolumesGauge --- PASS: TestUnderReplicatedVolumesGauge (0.00s) === RUN TestReplicationFailuresCounter --- PASS: TestReplicationFailuresCounter (0.00s) === RUN TestBuildInfo metrics_buildinfo_test.go:72: BuildInfo metric: version=4.54, commit=, sizelimit=30GB, goos=linux, goarch=riscv64 --- PASS: TestBuildInfo (0.11s) PASS ok github.com/seaweedfs/seaweedfs/weed/stats 1.458s === RUN TestEachDirEntrySeesEveryEntry --- PASS: TestEachDirEntrySeesEveryEntry (0.48s) === RUN TestEachDirEntryStopsWhenAsked --- PASS: TestEachDirEntryStopsWhenAsked (0.19s) === RUN TestEachDirEntryReportsAMissingDirectory --- PASS: TestEachDirEntryReportsAMissingDirectory (0.00s) === RUN TestCalculateExpectedShardSizeWithRealEncoding === RUN TestCalculateExpectedShardSizeWithRealEncoding/5MB_file I1117 09:40:37.147660 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeWithRealEncoding2155294957/001/test_volume.dat size:5242880 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:134: ✓ SUCCESS: .dat size 5242880 → actual shard size 1048576 matches calculated size (Small file that needs 1 small block per shard) === RUN TestCalculateExpectedShardSizeWithRealEncoding/10MB_file_(exactly_10_small_blocks) I1117 09:40:38.928409 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeWithRealEncoding2155294957/001/test_volume.dat size:10485760 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:134: ✓ SUCCESS: .dat size 10485760 → actual shard size 1048576 matches calculated size (Exactly fits in 1MB small blocks) === RUN TestCalculateExpectedShardSizeWithRealEncoding/15MB_file I1117 09:40:39.775391 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeWithRealEncoding2155294957/001/test_volume.dat size:15728640 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:134: ✓ SUCCESS: .dat size 15728640 → actual shard size 2097152 matches calculated size (Requires 2 small blocks per shard) === RUN TestCalculateExpectedShardSizeWithRealEncoding/50MB_file I1117 09:40:41.698597 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeWithRealEncoding2155294957/001/test_volume.dat size:52428800 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:134: ✓ SUCCESS: .dat size 52428800 → actual shard size 5242880 matches calculated size (Requires 5 small blocks per shard) === RUN TestCalculateExpectedShardSizeWithRealEncoding/100MB_file I1117 09:40:45.263843 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeWithRealEncoding2155294957/001/test_volume.dat size:104857600 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:134: ✓ SUCCESS: .dat size 104857600 → actual shard size 10485760 matches calculated size (Requires 10 small blocks per shard) === RUN TestCalculateExpectedShardSizeWithRealEncoding/512MB_file I1117 09:40:52.562416 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeWithRealEncoding2155294957/001/test_volume.dat size:536870912 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:134: ✓ SUCCESS: .dat size 536870912 → actual shard size 54525952 matches calculated size (Requires 52 small blocks per shard (rounded up)) --- PASS: TestCalculateExpectedShardSizeWithRealEncoding (41.53s) --- PASS: TestCalculateExpectedShardSizeWithRealEncoding/5MB_file (1.76s) --- PASS: TestCalculateExpectedShardSizeWithRealEncoding/10MB_file_(exactly_10_small_blocks) (0.84s) --- PASS: TestCalculateExpectedShardSizeWithRealEncoding/15MB_file (1.81s) --- PASS: TestCalculateExpectedShardSizeWithRealEncoding/50MB_file (3.44s) --- PASS: TestCalculateExpectedShardSizeWithRealEncoding/100MB_file (6.27s) --- PASS: TestCalculateExpectedShardSizeWithRealEncoding/512MB_file (27.39s) === RUN TestCalculateExpectedShardSizeEdgeCases === RUN TestCalculateExpectedShardSizeEdgeCases/1_byte_file I1117 09:41:18.656718 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeEdgeCases3600052585/001/1 byte file.dat size:1 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:204: ✓ File size 1 → shard size 1048576 (correct) === RUN TestCalculateExpectedShardSizeEdgeCases/1KB_file I1117 09:41:19.380921 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeEdgeCases3600052585/001/1KB file.dat size:1024 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:204: ✓ File size 1024 → shard size 1048576 (correct) === RUN TestCalculateExpectedShardSizeEdgeCases/10KB_file I1117 09:41:20.111569 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeEdgeCases3600052585/001/10KB file.dat size:10240 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:204: ✓ File size 10240 → shard size 1048576 (correct) === RUN TestCalculateExpectedShardSizeEdgeCases/1MB_file_(1_small_block) I1117 09:41:20.874704 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeEdgeCases3600052585/001/1MB file (1 small block).dat size:1048576 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:204: ✓ File size 1048576 → shard size 1048576 (correct) === RUN TestCalculateExpectedShardSizeEdgeCases/1MB_+_1_byte I1117 09:41:21.591274 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeEdgeCases3600052585/001/1MB + 1 byte.dat size:1048577 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:204: ✓ File size 1048577 → shard size 1048576 (correct) === RUN TestCalculateExpectedShardSizeEdgeCases/9.9MB_(almost_1_small_block_per_shard) I1117 09:41:22.575780 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeEdgeCases3600052585/001/9.9MB (almost 1 small block per shard).dat size:10358784 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:204: ✓ File size 10358784 → shard size 1048576 (correct) === RUN TestCalculateExpectedShardSizeEdgeCases/10.1MB_(just_over_1_small_block_per_shard) I1117 09:41:23.187683 ec_encoder.go:225 encodeDatFile /tmp/TestCalculateExpectedShardSizeEdgeCases3600052585/001/10.1MB (just over 1 small block per shard).dat size:10588160 with EC context 10+4 (total: 14) disk_location_ec_realworld_test.go:204: ✓ File size 10588160 → shard size 2097152 (correct) --- PASS: TestCalculateExpectedShardSizeEdgeCases (5.69s) --- PASS: TestCalculateExpectedShardSizeEdgeCases/1_byte_file (0.72s) --- PASS: TestCalculateExpectedShardSizeEdgeCases/1KB_file (0.73s) --- PASS: TestCalculateExpectedShardSizeEdgeCases/10KB_file (0.75s) --- PASS: TestCalculateExpectedShardSizeEdgeCases/1MB_file_(1_small_block) (0.72s) --- PASS: TestCalculateExpectedShardSizeEdgeCases/1MB_+_1_byte (0.80s) --- PASS: TestCalculateExpectedShardSizeEdgeCases/9.9MB_(almost_1_small_block_per_shard) (0.65s) --- PASS: TestCalculateExpectedShardSizeEdgeCases/10.1MB_(just_over_1_small_block_per_shard) (1.32s) === RUN TestCalculateExpectedShardSize === RUN TestCalculateExpectedShardSize/0_bytes_(empty_file) disk_location_ec_shard_size_test.go:138: ✓ File size: 0 → Shard size: 0 (Empty file has 0 shard size) === RUN TestCalculateExpectedShardSize/Exact_10GB_(1_large_batch) disk_location_ec_shard_size_test.go:138: ✓ File size: 10737418240 → Shard size: 1073741824 (Exactly fits in large blocks) === RUN TestCalculateExpectedShardSize/Exact_20GB_(2_large_batches) disk_location_ec_shard_size_test.go:138: ✓ File size: 21474836480 → Shard size: 2147483648 (2 complete large batches) === RUN TestCalculateExpectedShardSize/Just_under_large_batch_(10GB_-_1_byte) disk_location_ec_shard_size_test.go:138: ✓ File size: 10737418239 → Shard size: 1073741824 (Just under 10GB needs 1024 small blocks) === RUN TestCalculateExpectedShardSize/Just_over_large_batch_(10GB_+_1_byte) disk_location_ec_shard_size_test.go:138: ✓ File size: 10737418241 → Shard size: 1074790400 (Just over 10GB adds 1 small block) === RUN TestCalculateExpectedShardSize/Exact_10MB_(1_small_batch) disk_location_ec_shard_size_test.go:138: ✓ File size: 10485760 → Shard size: 1048576 (Exactly fits in 1 small batch) === RUN TestCalculateExpectedShardSize/Exact_20MB_(2_small_batches) disk_location_ec_shard_size_test.go:138: ✓ File size: 20971520 → Shard size: 2097152 (2 complete small batches) === RUN TestCalculateExpectedShardSize/Just_under_small_batch_(10MB_-_1_byte) disk_location_ec_shard_size_test.go:138: ✓ File size: 10485759 → Shard size: 1048576 (Just under 10MB rounds up to 1 small block) === RUN TestCalculateExpectedShardSize/Just_over_small_batch_(10MB_+_1_byte) disk_location_ec_shard_size_test.go:138: ✓ File size: 10485761 → Shard size: 2097152 (Just over 10MB needs 2 small blocks) === RUN TestCalculateExpectedShardSize/10GB_+_1MB disk_location_ec_shard_size_test.go:138: ✓ File size: 10738466816 → Shard size: 1074790400 (1 large batch + 1MB needs 1 small block) === RUN TestCalculateExpectedShardSize/10GB_+_5MB disk_location_ec_shard_size_test.go:138: ✓ File size: 10742661120 → Shard size: 1074790400 (1 large batch + 5MB rounds up to 1 small block) === RUN TestCalculateExpectedShardSize/10GB_+_15MB disk_location_ec_shard_size_test.go:138: ✓ File size: 10753146880 → Shard size: 1075838976 (1 large batch + 15MB needs 2 small blocks) === RUN TestCalculateExpectedShardSize/11GB_(1_large_batch_+_103_small_blocks) disk_location_ec_shard_size_test.go:138: ✓ File size: 11811160064 → Shard size: 1181745152 (1GB large + 1GB remaining needs 103 small blocks) === RUN TestCalculateExpectedShardSize/5MB_(requires_1_small_block_per_shard) disk_location_ec_shard_size_test.go:138: ✓ File size: 5242880 → Shard size: 1048576 (Small file rounds up to 1MB per shard) === RUN TestCalculateExpectedShardSize/1KB_(minimum_size) disk_location_ec_shard_size_test.go:138: ✓ File size: 1024 → Shard size: 1048576 (Tiny file needs 1 small block) === RUN TestCalculateExpectedShardSize/10.5GB_(mixed) disk_location_ec_shard_size_test.go:138: ✓ File size: 11274289152 → Shard size: 1128267776 (1GB large + 512MB remaining needs 52 small blocks) --- PASS: TestCalculateExpectedShardSize (0.01s) --- PASS: TestCalculateExpectedShardSize/0_bytes_(empty_file) (0.00s) --- PASS: TestCalculateExpectedShardSize/Exact_10GB_(1_large_batch) (0.00s) --- PASS: TestCalculateExpectedShardSize/Exact_20GB_(2_large_batches) (0.00s) --- PASS: TestCalculateExpectedShardSize/Just_under_large_batch_(10GB_-_1_byte) (0.00s) --- PASS: TestCalculateExpectedShardSize/Just_over_large_batch_(10GB_+_1_byte) (0.00s) --- PASS: TestCalculateExpectedShardSize/Exact_10MB_(1_small_batch) (0.00s) --- PASS: TestCalculateExpectedShardSize/Exact_20MB_(2_small_batches) (0.00s) --- PASS: TestCalculateExpectedShardSize/Just_under_small_batch_(10MB_-_1_byte) (0.00s) --- PASS: TestCalculateExpectedShardSize/Just_over_small_batch_(10MB_+_1_byte) (0.00s) --- PASS: TestCalculateExpectedShardSize/10GB_+_1MB (0.00s) --- PASS: TestCalculateExpectedShardSize/10GB_+_5MB (0.00s) --- PASS: TestCalculateExpectedShardSize/10GB_+_15MB (0.00s) --- PASS: TestCalculateExpectedShardSize/11GB_(1_large_batch_+_103_small_blocks) (0.00s) --- PASS: TestCalculateExpectedShardSize/5MB_(requires_1_small_block_per_shard) (0.00s) --- PASS: TestCalculateExpectedShardSize/1KB_(minimum_size) (0.00s) --- PASS: TestCalculateExpectedShardSize/10.5GB_(mixed) (0.00s) === RUN TestShardSizeValidationScenarios === RUN TestShardSizeValidationScenarios/Valid:_exact_match_for_10GB === RUN TestShardSizeValidationScenarios/Invalid:_1_byte_too_small === RUN TestShardSizeValidationScenarios/Invalid:_1_byte_too_large === RUN TestShardSizeValidationScenarios/Valid:_small_file_exact_match === RUN TestShardSizeValidationScenarios/Invalid:_wrong_size_for_small_file --- PASS: TestShardSizeValidationScenarios (0.00s) --- PASS: TestShardSizeValidationScenarios/Valid:_exact_match_for_10GB (0.00s) --- PASS: TestShardSizeValidationScenarios/Invalid:_1_byte_too_small (0.00s) --- PASS: TestShardSizeValidationScenarios/Invalid:_1_byte_too_large (0.00s) --- PASS: TestShardSizeValidationScenarios/Valid:_small_file_exact_match (0.00s) --- PASS: TestShardSizeValidationScenarios/Invalid:_wrong_size_for_small_file (0.00s) === RUN TestIncompleteEcEncodingCleanup === RUN TestIncompleteEcEncodingCleanup/Incomplete_EC:_shards_without_.ecx,_.dat_exists_-_should_cleanup W1117 09:41:24.376259 disk_location_ec.go:619 Found 14 EC shards without .ecx file for volume 100 (incomplete encoding interrupted before .ecx creation), cleaning up... === RUN TestIncompleteEcEncodingCleanup/Distributed_EC:_shards_without_.ecx,_.dat_deleted_-_should_NOT_cleanup === RUN TestIncompleteEcEncodingCleanup/Distributed_EC:_full-size_shards_with_.ecx,_<_10_of_them,_.dat_exists_-_keep W1117 09:41:24.411239 ec_volume.go:425 vif file not found, using defaults, volumeId:102, filename:/tmp/TestIncompleteEcEncodingCleanupDistributed_EC_full-size_shards2456882282/001/102.vif W1117 09:41:24.419006 ec_volume.go:425 vif file not found, using defaults, volumeId:102, filename:/tmp/TestIncompleteEcEncodingCleanupDistributed_EC_full-size_shards2456882282/001/102.vif === RUN TestIncompleteEcEncodingCleanup/Valid_local_EC:_shards_with_.ecx,_>=_10_shards,_.dat_exists_-_should_load W1117 09:41:24.430509 ec_volume.go:425 vif file not found, using defaults, volumeId:103, filename:/tmp/TestIncompleteEcEncodingCleanupValid_local_EC_shards_with_.ecx2538823159/001/103.vif W1117 09:41:24.437018 ec_volume.go:425 vif file not found, using defaults, volumeId:103, filename:/tmp/TestIncompleteEcEncodingCleanupValid_local_EC_shards_with_.ecx2538823159/001/103.vif === RUN TestIncompleteEcEncodingCleanup/Distributed_EC:_shards_with_.ecx,_.dat_deleted_-_should_load W1117 09:41:24.447116 ec_volume.go:425 vif file not found, using defaults, volumeId:104, filename:/tmp/TestIncompleteEcEncodingCleanupDistributed_EC_shards_with_.ecx729805242/001/104.vif W1117 09:41:24.450849 ec_volume.go:425 vif file not found, using defaults, volumeId:104, filename:/tmp/TestIncompleteEcEncodingCleanupDistributed_EC_shards_with_.ecx729805242/001/104.vif === RUN TestIncompleteEcEncodingCleanup/Incomplete_EC_with_collection:_shards_without_.ecx,_.dat_exists_-_should_cleanup W1117 09:41:24.458526 disk_location_ec.go:619 Found 14 EC shards without .ecx file for volume 105 (incomplete encoding interrupted before .ecx creation), cleaning up... --- PASS: TestIncompleteEcEncodingCleanup (0.10s) --- PASS: TestIncompleteEcEncodingCleanup/Incomplete_EC:_shards_without_.ecx,_.dat_exists_-_should_cleanup (0.03s) --- PASS: TestIncompleteEcEncodingCleanup/Distributed_EC:_shards_without_.ecx,_.dat_deleted_-_should_NOT_cleanup (0.00s) --- PASS: TestIncompleteEcEncodingCleanup/Distributed_EC:_full-size_shards_with_.ecx,_<_10_of_them,_.dat_exists_-_keep (0.03s) --- PASS: TestIncompleteEcEncodingCleanup/Valid_local_EC:_shards_with_.ecx,_>=_10_shards,_.dat_exists_-_should_load (0.02s) --- PASS: TestIncompleteEcEncodingCleanup/Distributed_EC:_shards_with_.ecx,_.dat_deleted_-_should_load (0.01s) --- PASS: TestIncompleteEcEncodingCleanup/Incomplete_EC_with_collection:_shards_without_.ecx,_.dat_exists_-_should_cleanup (0.01s) === RUN TestValidateEcVolume === RUN TestValidateEcVolume/Valid:_.dat_exists_with_10+_shards === RUN TestValidateEcVolume/Keep:_.dat_exists_with_<_10_full-size_shards_(possible_distributed_sole_copies) === RUN TestValidateEcVolume/Valid:_.dat_deleted_(distributed_EC)_with_any_shards === RUN TestValidateEcVolume/Valid:_.dat_deleted_(distributed_EC)_with_no_shards === RUN TestValidateEcVolume/Invalid:_zero-byte_shard_files_should_not_count === RUN TestValidateEcVolume/Keep:_.dat_exists_with_different_size_shards_(inconsistent,_not_trusted_for_deletion) W1117 09:41:24.487405 disk_location_ec.go:687 EC volume 205 shard 1 size 110 != 100; keeping EC shards --- PASS: TestValidateEcVolume (0.03s) --- PASS: TestValidateEcVolume/Valid:_.dat_exists_with_10+_shards (0.00s) --- PASS: TestValidateEcVolume/Keep:_.dat_exists_with_<_10_full-size_shards_(possible_distributed_sole_copies) (0.00s) --- PASS: TestValidateEcVolume/Valid:_.dat_deleted_(distributed_EC)_with_any_shards (0.00s) --- PASS: TestValidateEcVolume/Valid:_.dat_deleted_(distributed_EC)_with_no_shards (0.00s) --- PASS: TestValidateEcVolume/Invalid:_zero-byte_shard_files_should_not_count (0.00s) --- PASS: TestValidateEcVolume/Keep:_.dat_exists_with_different_size_shards_(inconsistent,_not_trusted_for_deletion) (0.00s) === RUN TestRemoveEcVolumeFiles === RUN TestRemoveEcVolumeFiles/Same_directory_for_data_and_index === RUN TestRemoveEcVolumeFiles/Separate_idx_directory --- PASS: TestRemoveEcVolumeFiles (0.01s) --- PASS: TestRemoveEcVolumeFiles/Same_directory_for_data_and_index (0.01s) --- PASS: TestRemoveEcVolumeFiles/Separate_idx_directory (0.01s) === RUN TestEcCleanupWithSeparateIdxDirectory W1117 09:41:24.509859 disk_location_ec.go:619 Found 14 EC shards without .ecx file for volume 400 (incomplete encoding interrupted before .ecx creation), cleaning up... --- PASS: TestEcCleanupWithSeparateIdxDirectory (0.01s) === RUN TestDistributedEcVolumeNoFileDeletion W1117 09:41:24.517384 ec_volume.go:425 vif file not found, using defaults, volumeId:500, filename:/tmp/TestDistributedEcVolumeNoFileDeletion2939683232/001/500.vif disk_location_ec_test.go:678: SUCCESS: Distributed EC volume files preserved (not deleted) --- PASS: TestDistributedEcVolumeNoFileDeletion (0.01s) === RUN TestLoadExistingVolumeSkipsVifWhenEcxPresent === RUN TestLoadExistingVolumeSkipsVifWhenEcxPresent/same-idx-dir === RUN TestLoadExistingVolumeSkipsVifWhenEcxPresent/split-idx-dir --- PASS: TestLoadExistingVolumeSkipsVifWhenEcxPresent (0.01s) --- PASS: TestLoadExistingVolumeSkipsVifWhenEcxPresent/same-idx-dir (0.00s) --- PASS: TestLoadExistingVolumeSkipsVifWhenEcxPresent/split-idx-dir (0.00s) === RUN TestLoadAllEcShardsDeletesStaleZeroSizedShards W1117 09:41:24.533009 disk_location_ec.go:443 removed zero-sized ec shard /tmp/TestLoadAllEcShardsDeletesStaleZeroSizedShards689346899/001/123.ec00 (residue of a failed operation) --- PASS: TestLoadAllEcShardsDeletesStaleZeroSizedShards (0.01s) === RUN TestLoadEcShardRefusesEmptyShardFile W1117 09:41:24.542904 ec_volume.go:425 vif file not found, using defaults, volumeId:123, filename:/tmp/TestLoadEcShardRefusesEmptyShardFile3773550712/001/123.vif --- PASS: TestLoadEcShardRefusesEmptyShardFile (0.01s) === RUN TestLoadEcShardDuplicateReleasesTheNewShard W1117 09:41:24.552146 ec_volume.go:425 vif file not found, using defaults, volumeId:124, filename:/tmp/TestLoadEcShardDuplicateReleasesTheNewShard3283366182/001/124.vif --- PASS: TestLoadEcShardDuplicateReleasesTheNewShard (0.01s) === RUN TestLoadEcShardWaitsForPendingDestroy W1117 09:41:24.659857 ec_volume.go:425 vif file not found, using defaults, volumeId:125, filename:/tmp/TestLoadEcShardWaitsForPendingDestroy3331055999/001/125.vif --- PASS: TestLoadEcShardWaitsForPendingDestroy (0.11s) === RUN TestDestroyEcVolumeClosesTombstone W1117 09:41:24.669314 ec_volume.go:425 vif file not found, using defaults, volumeId:126, filename:/tmp/TestDestroyEcVolumeClosesTombstone2083373933/001/126.vif W1117 09:41:24.675227 ec_volume.go:425 vif file not found, using defaults, volumeId:126, filename:/tmp/TestDestroyEcVolumeClosesTombstone2083373933/001/126.vif --- PASS: TestDestroyEcVolumeClosesTombstone (0.01s) === RUN TestLoadAllEcShardsSplitDirZeroSizedCleanup W1117 09:41:24.679569 disk_location_ec.go:443 removed zero-sized ec shard /tmp/TestLoadAllEcShardsSplitDirZeroSizedCleanup2720749417/002/124.ec00 (residue of a failed operation) --- PASS: TestLoadAllEcShardsSplitDirZeroSizedCleanup (0.00s) === RUN TestUnUsedSpaceCountsPreallocatedVolumesAsFull --- PASS: TestUnUsedSpaceCountsPreallocatedVolumesAsFull (0.00s) === RUN TestScanOrderDoesNotDecideWhetherAVolumeLoads W1117 09:41:24.736315 disk_location.go:301 EC volume 9 validation failed, removing incomplete EC files to allow .dat file loading I1117 09:41:24.746537 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/001/dir0/9.idx: repair unindexed .dat tail: record at 8 has id 0 size 0: not a torn tail I1117 09:41:24.747512 needle_map_sorted_file.go:40 Start to Generate /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/001/dir0/9.sdx from /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/001/dir0/9.idx I1117 09:41:24.784049 needle_map_sorted_file.go:42 Finished Generating /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/001/dir0/9.sdx from /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/001/dir0/9.idx W1117 09:41:24.794737 disk_location.go:301 EC volume 9 validation failed, removing incomplete EC files to allow .dat file loading I1117 09:41:24.799038 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/002/dir0/9.idx: repair unindexed .dat tail: record at 8 has id 0 size 0: not a torn tail I1117 09:41:24.799377 needle_map_sorted_file.go:40 Start to Generate /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/002/dir0/9.sdx from /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/002/dir0/9.idx I1117 09:41:24.827720 needle_map_sorted_file.go:42 Finished Generating /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/002/dir0/9.sdx from /tmp/TestScanOrderDoesNotDecideWhetherAVolumeLoads1185019293/002/dir0/9.idx --- PASS: TestScanOrderDoesNotDecideWhetherAVolumeLoads (0.14s) === RUN TestLoadExistingVolumeSkipsACopyInFlight --- PASS: TestLoadExistingVolumeSkipsACopyInFlight (0.01s) === RUN TestLoadVolumeIgnoresTheGuardForTheHoldersOwnMount --- PASS: TestLoadVolumeIgnoresTheGuardForTheHoldersOwnMount (0.01s) === RUN TestUnUsedSpace --- PASS: TestUnUsedSpace (0.00s) === RUN TestResolveVolumeIDs --- PASS: TestResolveVolumeIDs (0.00s) === RUN TestCheckDiskSpaceProbesWithTheDiskTypeThreshold --- PASS: TestCheckDiskSpaceProbesWithTheDiskTypeThreshold (0.00s) === RUN TestNewDiskLocation_CreatesIdxDirectory --- PASS: TestNewDiskLocation_CreatesIdxDirectory (0.00s) === RUN TestValidateEcVolume_PartialDatNextToFullShardsKeeps --- PASS: TestValidateEcVolume_PartialDatNextToFullShardsKeeps (0.00s) === RUN TestValidateEcVolume_InterruptedEncodeReclaimsDat W1117 09:41:24.872888 disk_location_ec.go:710 EC volume 71: 10 shards of 1048576 bytes are smaller than the .dat's full encode (3145728 bytes); reclaiming the complete .dat --- PASS: TestValidateEcVolume_InterruptedEncodeReclaimsDat (0.00s) === RUN TestValidateEcVolume_TransientStatErrorKeeps E1117 09:41:24.875918 file_util.go:90 check /tmp/TestValidateEcVolume_TransientStatErrorKeeps2924787063/001/locked/73.vif: stat /tmp/TestValidateEcVolume_TransientStatErrorKeeps2924787063/001/locked/73.vif: permission denied W1117 09:41:24.883981 volume_info.go:26 can not read /tmp/TestValidateEcVolume_TransientStatErrorKeeps2924787063/001/locked/73.vif W1117 09:41:24.884445 disk_location_ec.go:672 EC volume 73: cannot stat .dat /tmp/TestValidateEcVolume_TransientStatErrorKeeps2924787063/001/locked/73.dat (stat /tmp/TestValidateEcVolume_TransientStatErrorKeeps2924787063/001/locked/73.dat: permission denied); keeping EC shards --- PASS: TestValidateEcVolume_TransientStatErrorKeeps (0.01s) === RUN TestSortedFileNeedleMap_HoldsNoDescriptors === RUN TestSortedFileNeedleMap_HoldsNoDescriptors/readonly I1117 09:41:24.906013 needle_map_sorted_file.go:40 Start to Generate /tmp/TestSortedFileNeedleMap_HoldsNoDescriptorsreadonly1984671568/001/1.sdx from /tmp/TestSortedFileNeedleMap_HoldsNoDescriptorsreadonly1984671568/001/1.idx I1117 09:41:24.926172 needle_map_sorted_file.go:42 Finished Generating /tmp/TestSortedFileNeedleMap_HoldsNoDescriptorsreadonly1984671568/001/1.sdx from /tmp/TestSortedFileNeedleMap_HoldsNoDescriptorsreadonly1984671568/001/1.idx === RUN TestSortedFileNeedleMap_HoldsNoDescriptors/remote I1117 09:41:24.952501 volume_tier.go:32 volume 9 is tiered to test_local_dir.default as obj-1794908484937573707-154143 and read only I1117 09:41:24.952877 volume_loading.go:175 loading volume 9 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908484937573707-154143" file_size:2288 modified_time:1794908484 extension:".dat"} version:3 bytes_offset:4 I1117 09:41:24.960493 needle_map_sorted_file.go:40 Start to Generate /tmp/TestSortedFileNeedleMap_HoldsNoDescriptorsremote3156019429/002/9.sdx from /tmp/TestSortedFileNeedleMap_HoldsNoDescriptorsremote3156019429/002/9.idx I1117 09:41:24.973639 needle_map_sorted_file.go:42 Finished Generating /tmp/TestSortedFileNeedleMap_HoldsNoDescriptorsremote3156019429/002/9.sdx from /tmp/TestSortedFileNeedleMap_HoldsNoDescriptorsremote3156019429/002/9.idx --- PASS: TestSortedFileNeedleMap_HoldsNoDescriptors (0.09s) --- PASS: TestSortedFileNeedleMap_HoldsNoDescriptors/readonly (0.04s) --- PASS: TestSortedFileNeedleMap_HoldsNoDescriptors/remote (0.04s) === RUN TestIndexFilePool_EvictWhileBorrowed --- PASS: TestIndexFilePool_EvictWhileBorrowed (0.00s) === RUN TestIndexFilePool_DiscardClosesIdle --- PASS: TestIndexFilePool_DiscardClosesIdle (0.00s) === RUN TestGenerateLevelDbFileStaleWatermarkRebuilds W1117 09:41:25.083025 needle_map_leveldb.go:128 stale watermark 10000 for /tmp/TestGenerateLevelDbFileStaleWatermarkRebuilds802353812/001/1.ldb (filesize 48); rebuilding leveldb from start --- PASS: TestGenerateLevelDbFileStaleWatermarkRebuilds (0.15s) === RUN TestLevelDbNeedleMapWatermarkAdvances --- PASS: TestLevelDbNeedleMapWatermarkAdvances (3.47s) === RUN TestLevelDbNeedleMap_Concurrency --- PASS: TestLevelDbNeedleMap_Concurrency (0.14s) === RUN TestFastLoadingNeedleMapMetrics I1117 09:41:29.037311 needle_map_metric_test.go:30 FileCount expected 10000 actual 10000 I1117 09:41:29.037750 needle_map_metric_test.go:31 DeletedSize expected 1689 actual 1690 I1117 09:41:29.038017 needle_map_metric_test.go:32 ContentSize expected 10000 actual 10000 I1117 09:41:29.038283 needle_map_metric_test.go:33 DeletedCount expected 1689 actual 1690 I1117 09:41:29.038553 needle_map_metric_test.go:34 MaxFileKey expected 10000 actual 10000 --- PASS: TestFastLoadingNeedleMapMetrics (0.30s) === RUN TestSortedFileNeedleMap_DeleteAppendsTombstone I1117 09:41:29.042432 needle_map_sorted_file.go:40 Start to Generate /tmp/TestSortedFileNeedleMap_DeleteAppendsTombstone450013113/001/v1.sdx from /tmp/TestSortedFileNeedleMap_DeleteAppendsTombstone450013113/001/v1.idx I1117 09:41:29.064256 needle_map_sorted_file.go:42 Finished Generating /tmp/TestSortedFileNeedleMap_DeleteAppendsTombstone450013113/001/v1.sdx from /tmp/TestSortedFileNeedleMap_DeleteAppendsTombstone450013113/001/v1.idx --- PASS: TestSortedFileNeedleMap_DeleteAppendsTombstone (0.03s) === RUN TestRemoteTier_DiskScanLoadsRemoteOnlyVolume I1117 09:41:29.081770 volume_tier.go:32 volume 44 is tiered to test_local_dir.default as obj-1794908489073495507-154143 and read only I1117 09:41:29.082006 volume_loading.go:175 loading volume 44 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908489073495507-154143" file_size:3112 modified_time:1794908489 extension:".dat"} version:3 bytes_offset:4 I1117 09:41:29.084053 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanLoadsRemoteOnlyVolume784494642/002/44.sdx from /tmp/TestRemoteTier_DiskScanLoadsRemoteOnlyVolume784494642/002/44.idx I1117 09:41:29.099062 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanLoadsRemoteOnlyVolume784494642/002/44.sdx from /tmp/TestRemoteTier_DiskScanLoadsRemoteOnlyVolume784494642/002/44.idx --- PASS: TestRemoteTier_DiskScanLoadsRemoteOnlyVolume (0.03s) === RUN TestRemoteTier_LiveTierUpload_StillReportsToMaster --- PASS: TestRemoteTier_LiveTierUpload_StillReportsToMaster (0.01s) === RUN TestRemoteTier_ReloadUnderDataLock_NoDeadlock I1117 09:41:29.116501 volume_tier.go:32 volume 68 is tiered to test_local_dir.default as obj-1794908489113272633-154143 and read only I1117 09:41:29.116691 volume_loading.go:175 loading volume 68 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908489113272633-154143" file_size:1824 modified_time:1794908489 extension:".dat"} version:3 bytes_offset:4 I1117 09:41:29.118080 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_ReloadUnderDataLock_NoDeadlock3171223767/002/68.sdx from /tmp/TestRemoteTier_ReloadUnderDataLock_NoDeadlock3171223767/002/68.idx I1117 09:41:29.130898 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_ReloadUnderDataLock_NoDeadlock3171223767/002/68.sdx from /tmp/TestRemoteTier_ReloadUnderDataLock_NoDeadlock3171223767/002/68.idx --- PASS: TestRemoteTier_ReloadUnderDataLock_NoDeadlock (0.02s) === RUN TestRemoteTier_Move_KeepsRemoteObject I1117 09:41:29.138996 volume_tier.go:32 volume 31 is tiered to test_local_dir.default as obj-1794908489136553569-154143 and read only I1117 09:41:29.139169 volume_loading.go:175 loading volume 31 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908489136553569-154143" file_size:2544 modified_time:1794908489 extension:".dat"} version:3 bytes_offset:4 I1117 09:41:29.140388 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_Move_KeepsRemoteObject3762049058/002/31.sdx from /tmp/TestRemoteTier_Move_KeepsRemoteObject3762049058/002/31.idx I1117 09:41:29.153283 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_Move_KeepsRemoteObject3762049058/002/31.sdx from /tmp/TestRemoteTier_Move_KeepsRemoteObject3762049058/002/31.idx I1117 09:41:29.154972 volume_write.go:138 removed volume file /tmp/TestRemoteTier_Move_KeepsRemoteObject3762049058/002/31.idx (size=80) --- PASS: TestRemoteTier_Move_KeepsRemoteObject (0.02s) === RUN TestRemoteTier_RealDelete_RemovesRemoteObject I1117 09:41:29.163850 volume_tier.go:32 volume 32 is tiered to test_local_dir.default as obj-1794908489161546019-154143 and read only I1117 09:41:29.164014 volume_loading.go:175 loading volume 32 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908489161546019-154143" file_size:2512 modified_time:1794908489 extension:".dat"} version:3 bytes_offset:4 I1117 09:41:29.165253 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_RealDelete_RemovesRemoteObject2909277702/002/32.sdx from /tmp/TestRemoteTier_RealDelete_RemovesRemoteObject2909277702/002/32.idx I1117 09:41:29.177755 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_RealDelete_RemovesRemoteObject2909277702/002/32.sdx from /tmp/TestRemoteTier_RealDelete_RemovesRemoteObject2909277702/002/32.idx I1117 09:41:29.179014 volume_write.go:138 removed volume file /tmp/TestRemoteTier_RealDelete_RemovesRemoteObject2909277702/002/32.idx (size=80) --- PASS: TestRemoteTier_RealDelete_RemovesRemoteObject (0.02s) === RUN TestRemoteTier_FailedRemoteDelete_KeepsLocalVolume I1117 09:41:29.189212 volume_tier.go:32 volume 34 is tiered to test_local_dir.default as obj-1794908489186750295-154143 and read only I1117 09:41:29.189382 volume_loading.go:175 loading volume 34 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908489186750295-154143" file_size:1904 modified_time:1794908489 extension:".dat"} version:3 bytes_offset:4 I1117 09:41:29.190904 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_FailedRemoteDelete_KeepsLocalVolume4233378798/002/34.sdx from /tmp/TestRemoteTier_FailedRemoteDelete_KeepsLocalVolume4233378798/002/34.idx I1117 09:41:29.203651 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_FailedRemoteDelete_KeepsLocalVolume4233378798/002/34.sdx from /tmp/TestRemoteTier_FailedRemoteDelete_KeepsLocalVolume4233378798/002/34.idx I1117 09:41:29.206883 volume_write.go:138 removed volume file /tmp/TestRemoteTier_FailedRemoteDelete_KeepsLocalVolume4233378798/002/34.idx (size=80) --- PASS: TestRemoteTier_FailedRemoteDelete_KeepsLocalVolume (0.03s) === RUN TestRemoteTier_Vacuum_DoesNotDeleteRemote I1117 09:41:29.216913 volume_tier.go:32 volume 33 is tiered to test_local_dir.default as obj-1794908489213996327-154143 and read only I1117 09:41:29.217125 volume_loading.go:175 loading volume 33 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908489213996327-154143" file_size:2584 modified_time:1794908489 extension:".dat"} version:3 bytes_offset:4 I1117 09:41:29.218651 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_Vacuum_DoesNotDeleteRemote1850492412/002/33.sdx from /tmp/TestRemoteTier_Vacuum_DoesNotDeleteRemote1850492412/002/33.idx I1117 09:41:29.232262 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_Vacuum_DoesNotDeleteRemote1850492412/002/33.sdx from /tmp/TestRemoteTier_Vacuum_DoesNotDeleteRemote1850492412/002/33.idx --- PASS: TestRemoteTier_Vacuum_DoesNotDeleteRemote (0.02s) === RUN TestRemoteTier_ECEncode_RequiresLocalDat --- PASS: TestRemoteTier_ECEncode_RequiresLocalDat (0.01s) === RUN TestRemoteTier_ECEncodeDecode_AfterDownload I1117 09:41:29.269450 ec_encoder.go:225 encodeDatFile /tmp/TestRemoteTier_ECEncodeDecode_AfterDownload2316470984/002/35.dat size:2128 with EC context 10+4 (total: 14) I1117 09:41:29.972955 ec_encoder.go:180 Rebuilding EC files for /tmp/TestRemoteTier_ECEncodeDecode_AfterDownload2316470984/002/35 with default config I1117 09:41:29.976392 ec_encoder.go:359 rebuilding /tmp/TestRemoteTier_ECEncodeDecode_AfterDownload2316470984/002/35: 10 shards present, 4 missing [10 11 12 13], config 10+4 (total: 14) --- PASS: TestRemoteTier_ECEncodeDecode_AfterDownload (0.84s) === RUN TestCollectHeartbeatClearsMetricsOfDepartedCollection I1117 09:41:30.097392 store.go:1217 UnmountVolume 1 disk_id:0 --- PASS: TestCollectHeartbeatClearsMetricsOfDepartedCollection (0.03s) === RUN TestCollectHeartbeatClearsMetricsWhenTheLastVolumeExpires I1117 09:41:30.121467 volume_write.go:138 removed volume file /tmp/TestCollectHeartbeatClearsMetricsWhenTheLastVolumeExpires373959721/001/dir0/pics_1.dat (size=720) I1117 09:41:30.121758 volume_write.go:138 removed volume file /tmp/TestCollectHeartbeatClearsMetricsWhenTheLastVolumeExpires373959721/001/dir0/pics_1.idx (size=16) I1117 09:41:30.123418 store.go:721 volume 1 is deleted --- PASS: TestCollectHeartbeatClearsMetricsWhenTheLastVolumeExpires (0.02s) === RUN TestCollectHeartbeatSizesOnlySurvivingVolumes I1117 09:41:30.145198 volume_write.go:138 removed volume file /tmp/TestCollectHeartbeatSizesOnlySurvivingVolumes2787643333/001/dir1/pics_2.dat (size=1528) I1117 09:41:30.145410 volume_write.go:138 removed volume file /tmp/TestCollectHeartbeatSizesOnlySurvivingVolumes2787643333/001/dir1/pics_2.idx (size=48) I1117 09:41:30.146603 store.go:721 volume 2 is deleted --- PASS: TestCollectHeartbeatSizesOnlySurvivingVolumes (0.02s) === RUN TestCollectHeartbeatCountsPast255ReadOnlyVolumes --- PASS: TestCollectHeartbeatCountsPast255ReadOnlyVolumes (0.66s) === RUN TestCollectErasureCodingHeartbeatClearsMetricsOfDepartedCollection I1117 09:41:30.829943 store_ec.go:261 MountEcShards 4242.0 on disk ID 0 I1117 09:41:30.840417 store_ec.go:415 UnmountEcShards 4242.0 disk_id:0 --- PASS: TestCollectErasureCodingHeartbeatClearsMetricsOfDepartedCollection (0.03s) === RUN TestConfigureVolumeUpdatesSuperblock I1117 09:41:30.850063 store.go:431 In dir /tmp/TestConfigureVolumeUpdatesSuperblock2923150869/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:41:30.852689 store.go:436 add volume 1 on disk ID 0 --- PASS: TestConfigureVolumeUpdatesSuperblock (0.02s) === RUN TestRenameOrCopyFile --- PASS: TestRenameOrCopyFile (0.00s) === RUN TestConsolidateVolumeIndexMovesIdxToIdxDir I1117 09:41:30.874412 store.go:1149 mount volume 7 --- PASS: TestConsolidateVolumeIndexMovesIdxToIdxDir (0.02s) === RUN TestConsolidateVolumeIndexNoopWithoutIdxDir I1117 09:41:30.890898 store.go:1149 mount volume 8 --- PASS: TestConsolidateVolumeIndexNoopWithoutIdxDir (0.01s) === RUN TestDeleteCollectionNamesTheVolumesItDestroyed I1117 09:41:30.901180 volume_write.go:138 removed volume file /tmp/TestDeleteCollectionNamesTheVolumesItDestroyed3396182934/001/dir0/books_2.dat (size=8) I1117 09:41:30.901405 volume_write.go:138 removed volume file /tmp/TestDeleteCollectionNamesTheVolumesItDestroyed3396182934/001/dir0/books_2.idx (size=0) I1117 09:41:30.902918 volume_write.go:138 removed volume file /tmp/TestDeleteCollectionNamesTheVolumesItDestroyed3396182934/001/dir0/books_1.dat (size=8) I1117 09:41:30.903081 volume_write.go:138 removed volume file /tmp/TestDeleteCollectionNamesTheVolumesItDestroyed3396182934/001/dir0/books_1.idx (size=0) I1117 09:41:30.904963 metrics.go:1271 delete collection metrics, books: 1 --- PASS: TestDeleteCollectionNamesTheVolumesItDestroyed (0.01s) === RUN TestDeleteVolumeErrorsAreInspectable I1117 09:41:30.915275 volume_write.go:138 removed volume file /tmp/TestDeleteVolumeErrorsAreInspectable1833143617/001/dir0/5.dat (size=48) I1117 09:41:30.915449 volume_write.go:138 removed volume file /tmp/TestDeleteVolumeErrorsAreInspectable1833143617/001/dir0/5.idx (size=16) I1117 09:41:30.916625 store.go:1315 DeleteVolume 5 disk_id:0 --- PASS: TestDeleteVolumeErrorsAreInspectable (0.01s) === RUN TestDeleteVolumeOnlyGarbage I1117 09:41:30.924713 volume_write.go:138 removed volume file /tmp/TestDeleteVolumeOnlyGarbage4094087443/001/dir0/5.dat (size=80) I1117 09:41:30.924899 volume_write.go:138 removed volume file /tmp/TestDeleteVolumeOnlyGarbage4094087443/001/dir0/5.idx (size=32) I1117 09:41:30.926069 store.go:1401 DeleteVolume 5 disk_id:0 --- PASS: TestDeleteVolumeOnlyGarbage (0.01s) === RUN TestHasFreeDiskLocation === RUN TestHasFreeDiskLocation/low_disk_space_prevents_allocation === RUN TestHasFreeDiskLocation/normal_disk_space_and_available_volume_count_allows_allocation === RUN TestHasFreeDiskLocation/volume_count_at_max_prevents_allocation === RUN TestHasFreeDiskLocation/volume_count_over_max_prevents_allocation === RUN TestHasFreeDiskLocation/volume_count_just_under_max_allows_allocation === RUN TestHasFreeDiskLocation/max_volume_count_is_0_allows_allocation === RUN TestHasFreeDiskLocation/max_volume_count_is_0_but_low_disk_space_prevents_allocation --- PASS: TestHasFreeDiskLocation (0.01s) --- PASS: TestHasFreeDiskLocation/low_disk_space_prevents_allocation (0.00s) --- PASS: TestHasFreeDiskLocation/normal_disk_space_and_available_volume_count_allows_allocation (0.00s) --- PASS: TestHasFreeDiskLocation/volume_count_at_max_prevents_allocation (0.00s) --- PASS: TestHasFreeDiskLocation/volume_count_over_max_prevents_allocation (0.00s) --- PASS: TestHasFreeDiskLocation/volume_count_just_under_max_allows_allocation (0.00s) --- PASS: TestHasFreeDiskLocation/max_volume_count_is_0_allows_allocation (0.00s) --- PASS: TestHasFreeDiskLocation/max_volume_count_is_0_but_low_disk_space_prevents_allocation (0.00s) === RUN TestCollectHeartbeatRespectsLowDiskSpace === RUN TestCollectHeartbeatRespectsLowDiskSpace/low_disk_space W1117 09:41:30.936053 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master W1117 09:41:30.936314 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master W1117 09:41:30.936435 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master === RUN TestCollectHeartbeatRespectsLowDiskSpace/normal_disk_space W1117 09:41:30.937598 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master W1117 09:41:30.937765 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master W1117 09:41:30.937890 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master === RUN TestCollectHeartbeatRespectsLowDiskSpace/low_disk_space_zero_volumes === RUN TestCollectHeartbeatRespectsLowDiskSpace/low_disk_space_with_ec_shards W1117 09:41:30.940346 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master W1117 09:41:30.940519 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master W1117 09:41:30.940641 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master === RUN TestCollectHeartbeatRespectsLowDiskSpace/low_disk_space_with_multiple_ec_volumes W1117 09:41:30.943635 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master W1117 09:41:30.943822 volume.go:524 Volume 0: needle map or data file is closed - not reporting to master --- PASS: TestCollectHeartbeatRespectsLowDiskSpace (0.01s) --- PASS: TestCollectHeartbeatRespectsLowDiskSpace/low_disk_space (0.00s) --- PASS: TestCollectHeartbeatRespectsLowDiskSpace/normal_disk_space (0.00s) --- PASS: TestCollectHeartbeatRespectsLowDiskSpace/low_disk_space_zero_volumes (0.00s) --- PASS: TestCollectHeartbeatRespectsLowDiskSpace/low_disk_space_with_ec_shards (0.00s) --- PASS: TestCollectHeartbeatRespectsLowDiskSpace/low_disk_space_with_multiple_ec_volumes (0.00s) === RUN TestUnmountVolumeRemovesAllDuplicateCopies I1117 09:41:30.949506 store.go:1217 UnmountVolume 4242 disk_id:0 I1117 09:41:30.949644 store.go:1217 UnmountVolume 4242 disk_id:0 --- PASS: TestUnmountVolumeRemovesAllDuplicateCopies (0.01s) === RUN TestDeleteVolumeRemovesAllDuplicateCopies I1117 09:41:30.958023 volume_write.go:138 removed volume file /tmp/TestDeleteVolumeRemovesAllDuplicateCopies2055929467/001/dir0/4243.dat (size=8) I1117 09:41:30.958189 volume_write.go:138 removed volume file /tmp/TestDeleteVolumeRemovesAllDuplicateCopies2055929467/001/dir0/4243.idx (size=0) I1117 09:41:30.959273 store.go:1315 DeleteVolume 4243 disk_id:0 I1117 09:41:30.959847 volume_write.go:138 removed volume file /tmp/TestDeleteVolumeRemovesAllDuplicateCopies2055929467/001/dir1/4243.dat (size=8) I1117 09:41:30.960014 volume_write.go:138 removed volume file /tmp/TestDeleteVolumeRemovesAllDuplicateCopies2055929467/001/dir1/4243.idx (size=0) I1117 09:41:30.961084 store.go:1315 DeleteVolume 4243 disk_id:0 --- PASS: TestDeleteVolumeRemovesAllDuplicateCopies (0.01s) === RUN TestDeleteVolumeGuardChecksAllCopiesBeforeDeleting --- PASS: TestDeleteVolumeGuardChecksAllCopiesBeforeDeleting (0.01s) === RUN TestDeleteVolumeGuardWaitsForInFlightCopyWrite --- PASS: TestDeleteVolumeGuardWaitsForInFlightCopyWrite (0.21s) === RUN TestEc9plus3MultiDiskRebootLoadsAllShards I1117 09:41:31.207183 store_ec_mirror.go:56 ec volume 7 (collection="loki"): mirrored 3 sidecar(s) from /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk0 to /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk1 for same-disk invariant I1117 09:41:31.209851 store_ec_mirror.go:56 ec volume 7 (collection="loki"): mirrored 3 sidecar(s) from /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk0 to /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk2 for same-disk invariant I1117 09:41:31.211655 store_ec_mirror.go:56 ec volume 7 (collection="loki"): mirrored 3 sidecar(s) from /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk0 to /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk3 for same-disk invariant I1117 09:41:31.214086 store_ec_mirror.go:56 ec volume 7 (collection="loki"): mirrored 3 sidecar(s) from /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk0 to /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk4 for same-disk invariant I1117 09:41:31.215850 store_ec_mirror.go:56 ec volume 7 (collection="loki"): mirrored 3 sidecar(s) from /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk0 to /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk5 for same-disk invariant I1117 09:41:31.218385 store_ec_reconcile.go:86 ec volume 7 (collection="loki"): loading orphan shards [loki_7.ec02 loki_7.ec03] on /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk1 against locally-mirrored sidecars I1117 09:41:31.221479 store_ec_reconcile.go:86 ec volume 7 (collection="loki"): loading orphan shards [loki_7.ec04 loki_7.ec05] on /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk2 against locally-mirrored sidecars I1117 09:41:31.223944 store_ec_reconcile.go:86 ec volume 7 (collection="loki"): loading orphan shards [loki_7.ec06 loki_7.ec07] on /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk3 against locally-mirrored sidecars I1117 09:41:31.226298 store_ec_reconcile.go:86 ec volume 7 (collection="loki"): loading orphan shards [loki_7.ec08 loki_7.ec09] on /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk4 against locally-mirrored sidecars I1117 09:41:31.228559 store_ec_reconcile.go:86 ec volume 7 (collection="loki"): loading orphan shards [loki_7.ec10 loki_7.ec11] on /tmp/TestEc9plus3MultiDiskRebootLoadsAllShards1836587123/001/disk5 against locally-mirrored sidecars --- PASS: TestEc9plus3MultiDiskRebootLoadsAllShards (0.06s) === RUN TestEc9plus3ValidateKeepsVolumeWithDat --- PASS: TestEc9plus3ValidateKeepsVolumeWithDat (0.21s) === RUN TestEc9plus3PruneKeepsFullDataShardSet --- PASS: TestEc9plus3PruneKeepsFullDataShardSet (0.10s) === RUN TestMountEcShards_AppliesSourceDiskType I1117 09:41:31.559660 store_ec.go:261 MountEcShards 4242.0 on disk ID 0 --- PASS: TestMountEcShards_AppliesSourceDiskType (0.01s) === RUN TestMountEcShards_FallsBackToLocationDiskTypeWhenEmpty I1117 09:41:31.570934 store_ec.go:261 MountEcShards 4242.0 on disk ID 0 --- PASS: TestMountEcShards_FallsBackToLocationDiskTypeWhenEmpty (0.01s) === RUN TestMountEcShards_ReportsFileAndDeleteCounts I1117 09:41:31.586244 store_ec.go:261 MountEcShards 4242.0 on disk ID 0 --- PASS: TestMountEcShards_ReportsFileAndDeleteCounts (0.01s) === RUN TestNewStore_StartupEcMessageReportsFileAndDeleteCounts --- PASS: TestNewStore_StartupEcMessageReportsFileAndDeleteCounts (0.02s) === RUN TestIssue9478_PartialEcOnSiblingDiskOfHealthyDat store_ec_hybrid_repro_test.go:143: after per-disk EC load on sdf: inMemoryShards=1 newEcShardMessages=1 W1117 09:41:31.622090 store_ec_reconcile.go:333 ec volume 122 (collection="") on /tmp/TestIssue9478_PartialEcOnSiblingDiskOfHealthyDat3431609777/001/sdf has only 1 shards (need 10) while a byte-exact source .dat exists on sibling disk /tmp/TestIssue9478_PartialEcOnSiblingDiskOfHealthyDat3431609777/001/sdd; cleaning up leftover EC files store_ec_hybrid_repro_test.go:157: after Store-level cleanup: shardFileLeft=false ecxLeft=false ecjLeft=false inMemoryShards=0 deletedEcShardMessages=1 --- PASS: TestIssue9478_PartialEcOnSiblingDiskOfHealthyDat (0.02s) === RUN TestIssue9478_ZeroByteSiblingDatKeepsPartialEc W1117 09:41:31.632086 volume_info.go:47 empty volume info file /tmp/TestIssue9478_ZeroByteSiblingDatKeepsPartialEc3147848707/001/sdf/122.vif, treating as non-existent W1117 09:41:31.632885 ec_volume.go:425 vif file not found, using defaults, volumeId:122, filename:/tmp/TestIssue9478_ZeroByteSiblingDatKeepsPartialEc3147848707/001/sdf/122.vif W1117 09:41:31.634197 store_ec_reconcile.go:309 ec volume 122 (collection="") on /tmp/TestIssue9478_ZeroByteSiblingDatKeepsPartialEc3147848707/001/sdf has only 1 shards; sibling .dat on /tmp/TestIssue9478_ZeroByteSiblingDatKeepsPartialEc3147848707/001/sdd is 0 bytes but .vif recorded 0 (need byte-exact match); leaving partial EC in place --- PASS: TestIssue9478_ZeroByteSiblingDatKeepsPartialEc (0.01s) === RUN TestReadEcShardNeedleSpanningBlocks I1117 09:41:32.139071 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleSpanningBlocks2356884168/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:32.804219 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:41:32.805169 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:41:32.806091 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:41:32.806429 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:41:32.806758 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:41:32.807080 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:41:32.807400 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:41:32.807747 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:41:32.808071 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:41:32.808388 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:41:32.808707 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:41:32.809054 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:41:32.809381 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:41:32.809705 store_ec.go:261 MountEcShards 7.13 on disk ID 0 --- PASS: TestReadEcShardNeedleSpanningBlocks (1.30s) === RUN TestReadEcShardNeedleUniformLayout I1117 09:41:36.261974 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleUniformLayout38147601/001/dir0/8.dat size:27263424 with EC context 10+4 (total: 14) I1117 09:41:37.717492 store_ec.go:261 MountEcShards 8.0 on disk ID 0 I1117 09:41:37.718393 store_ec.go:261 MountEcShards 8.1 on disk ID 0 I1117 09:41:37.718771 store_ec.go:261 MountEcShards 8.2 on disk ID 0 I1117 09:41:37.719099 store_ec.go:261 MountEcShards 8.3 on disk ID 0 I1117 09:41:37.719426 store_ec.go:261 MountEcShards 8.4 on disk ID 0 I1117 09:41:37.719751 store_ec.go:261 MountEcShards 8.5 on disk ID 0 I1117 09:41:37.720073 store_ec.go:261 MountEcShards 8.6 on disk ID 0 I1117 09:41:37.720394 store_ec.go:261 MountEcShards 8.7 on disk ID 0 I1117 09:41:37.720722 store_ec.go:261 MountEcShards 8.8 on disk ID 0 I1117 09:41:37.721092 store_ec.go:261 MountEcShards 8.9 on disk ID 0 I1117 09:41:37.721428 store_ec.go:261 MountEcShards 8.10 on disk ID 0 I1117 09:41:37.721752 store_ec.go:261 MountEcShards 8.11 on disk ID 0 I1117 09:41:37.722084 store_ec.go:261 MountEcShards 8.12 on disk ID 0 I1117 09:41:37.722448 store_ec.go:261 MountEcShards 8.13 on disk ID 0 --- PASS: TestReadEcShardNeedleUniformLayout (5.78s) === RUN TestReadEcShardNeedleHealsBitRottedShard I1117 09:41:38.721882 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleHealsBitRottedShard2264273466/001/dir0/9.dat size:1072 with EC context 10+4 (total: 14) I1117 09:41:39.446922 store_ec.go:261 MountEcShards 9.0 on disk ID 0 I1117 09:41:39.447989 store_ec.go:261 MountEcShards 9.1 on disk ID 0 I1117 09:41:39.448461 store_ec.go:261 MountEcShards 9.2 on disk ID 0 I1117 09:41:39.448879 store_ec.go:261 MountEcShards 9.3 on disk ID 0 I1117 09:41:39.449295 store_ec.go:261 MountEcShards 9.4 on disk ID 0 I1117 09:41:39.449738 store_ec.go:261 MountEcShards 9.5 on disk ID 0 I1117 09:41:39.450150 store_ec.go:261 MountEcShards 9.6 on disk ID 0 I1117 09:41:39.450560 store_ec.go:261 MountEcShards 9.7 on disk ID 0 I1117 09:41:39.450975 store_ec.go:261 MountEcShards 9.8 on disk ID 0 I1117 09:41:39.451384 store_ec.go:261 MountEcShards 9.9 on disk ID 0 I1117 09:41:39.451790 store_ec.go:261 MountEcShards 9.10 on disk ID 0 I1117 09:41:39.452197 store_ec.go:261 MountEcShards 9.11 on disk ID 0 I1117 09:41:39.452612 store_ec.go:261 MountEcShards 9.12 on disk ID 0 I1117 09:41:39.453079 store_ec.go:261 MountEcShards 9.13 on disk ID 0 --- PASS: TestReadEcShardNeedleHealsBitRottedShard (0.76s) === RUN TestReadEcShardNeedleHealsBitRottedShardInSpanningNeedle I1117 09:41:39.918776 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleHealsBitRottedShardInSpanningNeedle1029536358/001/dir0/10.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:40.544534 store_ec.go:261 MountEcShards 10.0 on disk ID 0 I1117 09:41:40.545575 store_ec.go:261 MountEcShards 10.1 on disk ID 0 I1117 09:41:40.546037 store_ec.go:261 MountEcShards 10.2 on disk ID 0 I1117 09:41:40.546518 store_ec.go:261 MountEcShards 10.3 on disk ID 0 I1117 09:41:40.546917 store_ec.go:261 MountEcShards 10.4 on disk ID 0 I1117 09:41:40.547299 store_ec.go:261 MountEcShards 10.5 on disk ID 0 I1117 09:41:40.547691 store_ec.go:261 MountEcShards 10.6 on disk ID 0 I1117 09:41:40.548093 store_ec.go:261 MountEcShards 10.7 on disk ID 0 I1117 09:41:40.548499 store_ec.go:261 MountEcShards 10.8 on disk ID 0 I1117 09:41:40.548882 store_ec.go:261 MountEcShards 10.9 on disk ID 0 I1117 09:41:40.549267 store_ec.go:261 MountEcShards 10.10 on disk ID 0 I1117 09:41:40.549659 store_ec.go:261 MountEcShards 10.11 on disk ID 0 I1117 09:41:40.550139 store_ec.go:261 MountEcShards 10.12 on disk ID 0 I1117 09:41:40.550549 store_ec.go:261 MountEcShards 10.13 on disk ID 0 --- PASS: TestReadEcShardNeedleHealsBitRottedShardInSpanningNeedle (1.38s) === RUN TestReadEcShardNeedleHealsWhenRebuildInputAlsoRotted I1117 09:41:40.861236 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleHealsWhenRebuildInputAlsoRotted3557067476/001/dir0/12.dat size:1072 with EC context 10+4 (total: 14) I1117 09:41:41.582459 store_ec.go:261 MountEcShards 12.0 on disk ID 0 I1117 09:41:41.583345 store_ec.go:261 MountEcShards 12.1 on disk ID 0 I1117 09:41:41.583734 store_ec.go:261 MountEcShards 12.2 on disk ID 0 I1117 09:41:41.584112 store_ec.go:261 MountEcShards 12.3 on disk ID 0 I1117 09:41:41.584485 store_ec.go:261 MountEcShards 12.4 on disk ID 0 I1117 09:41:41.584848 store_ec.go:261 MountEcShards 12.5 on disk ID 0 I1117 09:41:41.585218 store_ec.go:261 MountEcShards 12.6 on disk ID 0 I1117 09:41:41.585580 store_ec.go:261 MountEcShards 12.7 on disk ID 0 I1117 09:41:41.585946 store_ec.go:261 MountEcShards 12.8 on disk ID 0 I1117 09:41:41.586312 store_ec.go:261 MountEcShards 12.9 on disk ID 0 I1117 09:41:41.586708 store_ec.go:261 MountEcShards 12.10 on disk ID 0 I1117 09:41:41.587073 store_ec.go:261 MountEcShards 12.11 on disk ID 0 I1117 09:41:41.587445 store_ec.go:261 MountEcShards 12.12 on disk ID 0 I1117 09:41:41.587861 store_ec.go:261 MountEcShards 12.13 on disk ID 0 --- PASS: TestReadEcShardNeedleHealsWhenRebuildInputAlsoRotted (0.75s) === RUN TestReadEcShardNeedleHealsWhenParityManyShardsRotted I1117 09:41:41.615029 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleHealsWhenParityManyShardsRotted3206809945/001/dir0/13.dat size:1072 with EC context 10+4 (total: 14) I1117 09:41:42.314769 store_ec.go:261 MountEcShards 13.0 on disk ID 0 I1117 09:41:42.315656 store_ec.go:261 MountEcShards 13.1 on disk ID 0 I1117 09:41:42.316061 store_ec.go:261 MountEcShards 13.2 on disk ID 0 I1117 09:41:42.316404 store_ec.go:261 MountEcShards 13.3 on disk ID 0 I1117 09:41:42.316743 store_ec.go:261 MountEcShards 13.4 on disk ID 0 I1117 09:41:42.317077 store_ec.go:261 MountEcShards 13.5 on disk ID 0 I1117 09:41:42.317410 store_ec.go:261 MountEcShards 13.6 on disk ID 0 I1117 09:41:42.317749 store_ec.go:261 MountEcShards 13.7 on disk ID 0 I1117 09:41:42.318087 store_ec.go:261 MountEcShards 13.8 on disk ID 0 I1117 09:41:42.318426 store_ec.go:261 MountEcShards 13.9 on disk ID 0 I1117 09:41:42.318761 store_ec.go:261 MountEcShards 13.10 on disk ID 0 I1117 09:41:42.319094 store_ec.go:261 MountEcShards 13.11 on disk ID 0 I1117 09:41:42.319675 store_ec.go:261 MountEcShards 13.12 on disk ID 0 I1117 09:41:42.320055 store_ec.go:261 MountEcShards 13.13 on disk ID 0 --- PASS: TestReadEcShardNeedleHealsWhenParityManyShardsRotted (0.77s) === RUN TestReadEcShardNeedleHealsCorruptSuspectNextToCleanOne I1117 09:41:42.509767 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleHealsCorruptSuspectNextToCleanOne739170750/001/dir0/14.dat size:1049856 with EC context 10+4 (total: 14) I1117 09:41:43.217132 store_ec.go:261 MountEcShards 14.0 on disk ID 0 I1117 09:41:43.218265 store_ec.go:261 MountEcShards 14.1 on disk ID 0 I1117 09:41:43.218741 store_ec.go:261 MountEcShards 14.2 on disk ID 0 I1117 09:41:43.219156 store_ec.go:261 MountEcShards 14.3 on disk ID 0 I1117 09:41:43.219564 store_ec.go:261 MountEcShards 14.4 on disk ID 0 I1117 09:41:43.219972 store_ec.go:261 MountEcShards 14.5 on disk ID 0 I1117 09:41:43.220373 store_ec.go:261 MountEcShards 14.6 on disk ID 0 I1117 09:41:43.220775 store_ec.go:261 MountEcShards 14.7 on disk ID 0 I1117 09:41:43.221181 store_ec.go:261 MountEcShards 14.8 on disk ID 0 I1117 09:41:43.221583 store_ec.go:261 MountEcShards 14.9 on disk ID 0 I1117 09:41:43.221986 store_ec.go:261 MountEcShards 14.10 on disk ID 0 I1117 09:41:43.222388 store_ec.go:261 MountEcShards 14.11 on disk ID 0 I1117 09:41:43.222857 store_ec.go:261 MountEcShards 14.12 on disk ID 0 I1117 09:41:43.223320 store_ec.go:261 MountEcShards 14.13 on disk ID 0 --- PASS: TestReadEcShardNeedleHealsCorruptSuspectNextToCleanOne (3.54s) === RUN TestReadEcShardNeedleCorruptSetSearchPastBudget I1117 09:41:46.746497 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleCorruptSetSearchPastBudget668842979/001/dir0/17.dat size:6292736 with EC context 10+4 (total: 14) I1117 09:41:47.359452 store_ec.go:261 MountEcShards 17.0 on disk ID 0 I1117 09:41:47.360381 store_ec.go:261 MountEcShards 17.1 on disk ID 0 I1117 09:41:47.360765 store_ec.go:261 MountEcShards 17.2 on disk ID 0 I1117 09:41:47.361103 store_ec.go:261 MountEcShards 17.3 on disk ID 0 I1117 09:41:47.361433 store_ec.go:261 MountEcShards 17.4 on disk ID 0 I1117 09:41:47.361786 store_ec.go:261 MountEcShards 17.5 on disk ID 0 I1117 09:41:47.362168 store_ec.go:261 MountEcShards 17.6 on disk ID 0 I1117 09:41:47.362494 store_ec.go:261 MountEcShards 17.7 on disk ID 0 I1117 09:41:47.362823 store_ec.go:261 MountEcShards 17.8 on disk ID 0 I1117 09:41:47.363158 store_ec.go:261 MountEcShards 17.9 on disk ID 0 I1117 09:41:47.363484 store_ec.go:261 MountEcShards 17.10 on disk ID 0 I1117 09:41:47.363809 store_ec.go:261 MountEcShards 17.11 on disk ID 0 I1117 09:41:47.364142 store_ec.go:261 MountEcShards 17.12 on disk ID 0 I1117 09:41:47.364503 store_ec.go:261 MountEcShards 17.13 on disk ID 0 I1117 09:41:48.033116 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleCorruptSetSearchPastBudget668842979/001/dir0/15.dat size:1072 with EC context 10+4 (total: 14) I1117 09:41:48.787034 store_ec.go:261 MountEcShards 15.0 on disk ID 0 I1117 09:41:48.787516 store_ec.go:261 MountEcShards 15.1 on disk ID 0 I1117 09:41:48.787867 store_ec.go:261 MountEcShards 15.2 on disk ID 0 I1117 09:41:48.788199 store_ec.go:261 MountEcShards 15.3 on disk ID 0 I1117 09:41:48.788577 store_ec.go:261 MountEcShards 15.4 on disk ID 0 I1117 09:41:48.788935 store_ec.go:261 MountEcShards 15.5 on disk ID 0 I1117 09:41:48.789282 store_ec.go:261 MountEcShards 15.6 on disk ID 0 I1117 09:41:48.789620 store_ec.go:261 MountEcShards 15.7 on disk ID 0 I1117 09:41:48.789967 store_ec.go:261 MountEcShards 15.8 on disk ID 0 I1117 09:41:48.790288 store_ec.go:261 MountEcShards 15.9 on disk ID 0 I1117 09:41:48.790612 store_ec.go:261 MountEcShards 15.10 on disk ID 0 I1117 09:41:48.790937 store_ec.go:261 MountEcShards 15.11 on disk ID 0 I1117 09:41:48.791275 store_ec.go:261 MountEcShards 15.12 on disk ID 0 I1117 09:41:48.791637 store_ec.go:261 MountEcShards 15.13 on disk ID 0 --- PASS: TestReadEcShardNeedleCorruptSetSearchPastBudget (2.90s) === RUN TestReadEcShardNeedleFailsWhenCorruptionExceedsParity I1117 09:41:48.818029 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleFailsWhenCorruptionExceedsParity454011567/001/dir0/11.dat size:1072 with EC context 10+4 (total: 14) I1117 09:41:49.529890 store_ec.go:261 MountEcShards 11.0 on disk ID 0 I1117 09:41:49.530758 store_ec.go:261 MountEcShards 11.1 on disk ID 0 I1117 09:41:49.531150 store_ec.go:261 MountEcShards 11.2 on disk ID 0 I1117 09:41:49.531485 store_ec.go:261 MountEcShards 11.3 on disk ID 0 I1117 09:41:49.531864 store_ec.go:261 MountEcShards 11.4 on disk ID 0 I1117 09:41:49.532195 store_ec.go:261 MountEcShards 11.5 on disk ID 0 I1117 09:41:49.532551 store_ec.go:261 MountEcShards 11.6 on disk ID 0 I1117 09:41:49.532883 store_ec.go:261 MountEcShards 11.7 on disk ID 0 I1117 09:41:49.533227 store_ec.go:261 MountEcShards 11.8 on disk ID 0 I1117 09:41:49.533574 store_ec.go:261 MountEcShards 11.9 on disk ID 0 I1117 09:41:49.533905 store_ec.go:261 MountEcShards 11.10 on disk ID 0 I1117 09:41:49.534281 store_ec.go:261 MountEcShards 11.11 on disk ID 0 I1117 09:41:49.534639 store_ec.go:261 MountEcShards 11.12 on disk ID 0 I1117 09:41:49.534974 store_ec.go:261 MountEcShards 11.13 on disk ID 0 --- PASS: TestReadEcShardNeedleFailsWhenCorruptionExceedsParity (0.91s) === RUN TestMergeEcJournal_MountedVolumeJournalInDataDir I1117 09:41:49.731428 store_ec.go:261 MountEcShards 9.0 on disk ID 0 --- PASS: TestMergeEcJournal_MountedVolumeJournalInDataDir (0.02s) === RUN TestMergeEcJournal_UnmountedVolumeIsIdempotent --- PASS: TestMergeEcJournal_UnmountedVolumeIsIdempotent (0.01s) === RUN TestMergeEcJournal_SharedIndexDirReachesSiblingMount --- PASS: TestMergeEcJournal_SharedIndexDirReachesSiblingMount (0.01s) === RUN TestMergeEcJournal_SharedJournalReachesEveryHolder --- PASS: TestMergeEcJournal_SharedJournalReachesEveryHolder (0.02s) === RUN TestMergeEcJournal_PublishesToActualJournalHolders --- PASS: TestMergeEcJournal_PublishesToActualJournalHolders (0.02s) === RUN TestMergeEcJournal_SiblingMountDuringReadIsMergedThrough --- PASS: TestMergeEcJournal_SiblingMountDuringReadIsMergedThrough (0.01s) === RUN TestMergeEcJournal_UnmountedSyncHoldsNoDiskLock --- PASS: TestMergeEcJournal_UnmountedSyncHoldsNoDiskLock (0.01s) === RUN TestMergeEcJournal_FailedSync === RUN TestMergeEcJournal_FailedSync/unmounted === RUN TestMergeEcJournal_FailedSync/mounted_since_the_write === RUN TestMergeEcJournal_FailedSync/two_mounted_since_the_write === RUN TestMergeEcJournal_FailedSync/mounted_and_journaled_since === RUN TestMergeEcJournal_FailedSync/another_runtime_journaled_since === RUN TestMergeEcJournal_FailedSync/resync_fails E1117 09:41:49.915509 store_ec_journal.go:220 ec volume 9: merged records in /tmp/TestMergeEcJournal_FailedSyncresync_fails1377713431/001/d0/c_9.ecj may not be durable: injected fsync failure; resync: injected resync failure --- PASS: TestMergeEcJournal_FailedSync (0.10s) --- PASS: TestMergeEcJournal_FailedSync/unmounted (0.01s) --- PASS: TestMergeEcJournal_FailedSync/mounted_since_the_write (0.02s) --- PASS: TestMergeEcJournal_FailedSync/two_mounted_since_the_write (0.02s) --- PASS: TestMergeEcJournal_FailedSync/mounted_and_journaled_since (0.02s) --- PASS: TestMergeEcJournal_FailedSync/another_runtime_journaled_since (0.02s) --- PASS: TestMergeEcJournal_FailedSync/resync_fails (0.01s) === RUN TestCachedLookupEcShardLocationsRefreshesAfterAFailedRead --- PASS: TestCachedLookupEcShardLocationsRefreshesAfterAFailedRead (0.13s) === RUN TestCachedLookupEcShardLocationsSettlesAfterRefresh --- PASS: TestCachedLookupEcShardLocationsSettlesAfterRefresh (0.05s) === RUN TestEcShardLocationsTTL === RUN TestEcShardLocationsTTL/complete === RUN TestEcShardLocationsTTL/one_shard_short === RUN TestEcShardLocationsTTL/below_the_data_shards === RUN TestEcShardLocationsTTL/complete_but_disproved_by_a_read === RUN TestEcShardLocationsTTL/one_shard_short_and_disproved --- PASS: TestEcShardLocationsTTL (0.00s) --- PASS: TestEcShardLocationsTTL/complete (0.00s) --- PASS: TestEcShardLocationsTTL/one_shard_short (0.00s) --- PASS: TestEcShardLocationsTTL/below_the_data_shards (0.00s) --- PASS: TestEcShardLocationsTTL/complete_but_disproved_by_a_read (0.00s) --- PASS: TestEcShardLocationsTTL/one_shard_short_and_disproved (0.00s) === RUN TestReadOneEcShardIntervalMarksTheMapAfterADirectReadFails I1117 09:41:50.538834 ec_encoder.go:225 encodeDatFile /tmp/TestReadOneEcShardIntervalMarksTheMapAfterADirectReadFails2090915396/001/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:51.232922 store_ec.go:695 read remote ec shard 7.3 locations: read ec shard 7.3 from 127.0.0.1:1: receiving ec shard 7.3 from 127.0.0.1:1: rpc error: code = NotFound desc = shard 3 is not here --- PASS: TestReadOneEcShardIntervalMarksTheMapAfterADirectReadFails (1.17s) === RUN TestCachedLookupEcShardLocationsKeepsAMarkRaisedDuringTheLookup --- PASS: TestCachedLookupEcShardLocationsKeepsAMarkRaisedDuringTheLookup (0.03s) === RUN TestCachedLookupEcShardLocationsKeepsTheMarkWhenTheLookupFails --- PASS: TestCachedLookupEcShardLocationsKeepsTheMarkWhenTheLookupFails (0.03s) === RUN TestMirrorEcMetadataOnStartup_PhysicallyCopiesSidecars I1117 09:41:51.346775 store_ec_mirror.go:56 ec volume 4121 (collection="video-recordings"): mirrored 3 sidecar(s) from /tmp/TestMirrorEcMetadataOnStartup_PhysicallyCopiesSidecars4095076919/001/data2 to /tmp/TestMirrorEcMetadataOnStartup_PhysicallyCopiesSidecars4095076919/001/data1 for same-disk invariant I1117 09:41:51.348026 store_ec_reconcile.go:86 ec volume 4121 (collection="video-recordings"): loading orphan shards [video-recordings_4121.ec00 video-recordings_4121.ec12] on /tmp/TestMirrorEcMetadataOnStartup_PhysicallyCopiesSidecars4095076919/001/data1 against locally-mirrored sidecars --- PASS: TestMirrorEcMetadataOnStartup_PhysicallyCopiesSidecars (0.02s) === RUN TestMirrorEcMetadataOnStartup_NoOpWhenAlreadyMirrored --- PASS: TestMirrorEcMetadataOnStartup_NoOpWhenAlreadyMirrored (0.01s) === RUN TestMountEcShards_LocatesEcxOnSiblingDisk I1117 09:41:51.382070 store_ec.go:261 MountEcShards 5.6 on disk ID 0 --- PASS: TestMountEcShards_LocatesEcxOnSiblingDisk (0.01s) === RUN TestMountEcShards_SameDiskEcxStillWorks I1117 09:41:51.394724 store_ec.go:261 MountEcShards 7.3 on disk ID 0 --- PASS: TestMountEcShards_SameDiskEcxStillWorks (0.01s) === RUN TestMountEcShards_MissingEcxOnAllDisks --- PASS: TestMountEcShards_MissingEcxOnAllDisks (0.01s) === RUN TestMountEcShards_ZeroByteEcxIsIgnored I1117 09:41:51.414210 store_ec.go:261 MountEcShards 12.7 on disk ID 0 --- PASS: TestMountEcShards_ZeroByteEcxIsIgnored (0.01s) === RUN TestMountEcShards_EmptyEcxMountsSuccessfully I1117 09:41:51.424258 store_ec.go:261 MountEcShards 13.0 on disk ID 0 --- PASS: TestMountEcShards_EmptyEcxMountsSuccessfully (0.01s) === RUN TestIndexEcxOwners_IgnoresZeroByteStub --- PASS: TestIndexEcxOwners_IgnoresZeroByteStub (0.01s) === RUN TestMultiDiskLifecycle_SpreadLayout I1117 09:41:51.447523 store_ec_mirror.go:56 ec volume 42561 (collection="pm-itatiaiucu-01"): mirrored 3 sidecar(s) from /tmp/TestMultiDiskLifecycle_SpreadLayout64175277/001/disk0 to /tmp/TestMultiDiskLifecycle_SpreadLayout64175277/001/disk1 for same-disk invariant I1117 09:41:51.449782 store_ec_mirror.go:56 ec volume 42561 (collection="pm-itatiaiucu-01"): mirrored 3 sidecar(s) from /tmp/TestMultiDiskLifecycle_SpreadLayout64175277/001/disk0 to /tmp/TestMultiDiskLifecycle_SpreadLayout64175277/001/disk2 for same-disk invariant I1117 09:41:51.451935 store_ec_reconcile.go:86 ec volume 42561 (collection="pm-itatiaiucu-01"): loading orphan shards [pm-itatiaiucu-01_42561.ec06 pm-itatiaiucu-01_42561.ec07 pm-itatiaiucu-01_42561.ec08 pm-itatiaiucu-01_42561.ec09 pm-itatiaiucu-01_42561.ec10] on /tmp/TestMultiDiskLifecycle_SpreadLayout64175277/001/disk1 against locally-mirrored sidecars I1117 09:41:51.455672 store_ec_reconcile.go:86 ec volume 42561 (collection="pm-itatiaiucu-01"): loading orphan shards [pm-itatiaiucu-01_42561.ec11 pm-itatiaiucu-01_42561.ec12 pm-itatiaiucu-01_42561.ec13] on /tmp/TestMultiDiskLifecycle_SpreadLayout64175277/001/disk2 against locally-mirrored sidecars I1117 09:41:51.462430 store_ec.go:415 UnmountEcShards 42561.0 disk_id:0 I1117 09:41:51.463571 store_ec.go:415 UnmountEcShards 42561.1 disk_id:0 I1117 09:41:51.463836 store_ec.go:415 UnmountEcShards 42561.2 disk_id:0 I1117 09:41:51.464091 store_ec.go:415 UnmountEcShards 42561.3 disk_id:0 I1117 09:41:51.464341 store_ec.go:415 UnmountEcShards 42561.4 disk_id:0 I1117 09:41:51.464702 store_ec.go:415 UnmountEcShards 42561.5 disk_id:0 I1117 09:41:51.487175 store_ec.go:261 MountEcShards 42561.0 on disk ID 2 --- PASS: TestMultiDiskLifecycle_SpreadLayout (0.06s) === RUN TestMultiDiskLifecycle_SidecarDiskLost store_ec_multidisk_lifecycle_test.go:313: files intact; shards without a reachable .ecx stay unloaded, as required --- PASS: TestMultiDiskLifecycle_SidecarDiskLost (0.01s) === RUN TestLoadEcShardsWhenIndexFilesOnDifferentDisk I1117 09:41:51.513586 store_ec_mirror.go:56 ec volume 1093 (collection="grafana-loki"): mirrored 3 sidecar(s) from /tmp/TestLoadEcShardsWhenIndexFilesOnDifferentDisk3345247856/001/data2 to /tmp/TestLoadEcShardsWhenIndexFilesOnDifferentDisk3345247856/001/data1 for same-disk invariant I1117 09:41:51.514895 store_ec_reconcile.go:86 ec volume 1093 (collection="grafana-loki"): loading orphan shards [grafana-loki_1093.ec00 grafana-loki_1093.ec12] on /tmp/TestLoadEcShardsWhenIndexFilesOnDifferentDisk3345247856/001/data1 against locally-mirrored sidecars --- PASS: TestLoadEcShardsWhenIndexFilesOnDifferentDisk (0.02s) === RUN TestLoadEcShardsOrphanWithoutSiblingEcx --- PASS: TestLoadEcShardsOrphanWithoutSiblingEcx (0.01s) === RUN TestReconcileNoOpWhenEachDiskIsSelfContained --- PASS: TestReconcileNoOpWhenEachDiskIsSelfContained (0.02s) === RUN TestLoadEcShardsWhenOwnerEcxIsInDataDir I1117 09:41:51.554285 store_ec_mirror.go:56 ec volume 4242 (collection="grafana-loki"): mirrored 3 sidecar(s) from /tmp/TestLoadEcShardsWhenOwnerEcxIsInDataDir2699809127/001/data2 to /tmp/TestLoadEcShardsWhenOwnerEcxIsInDataDir2699809127/001/data1 for same-disk invariant I1117 09:41:51.555985 store_ec_reconcile.go:86 ec volume 4242 (collection="grafana-loki"): loading orphan shards [grafana-loki_4242.ec00 grafana-loki_4242.ec12] on /tmp/TestLoadEcShardsWhenOwnerEcxIsInDataDir2699809127/001/data1 against locally-mirrored sidecars --- PASS: TestLoadEcShardsWhenOwnerEcxIsInDataDir (0.02s) === RUN TestLoneVifDoesNotCreatePhantomDat --- PASS: TestLoneVifDoesNotCreatePhantomDat (0.01s) === RUN TestEmptyEcDatStubIsSwept W1117 09:41:51.580620 disk_location.go:238 removing leftover empty .dat stub for EC volume 41 (collection="warp-cal") W1117 09:41:51.580667 disk_location.go:238 removing leftover empty .dat stub for EC volume 41 (collection="warp-cal") --- PASS: TestEmptyEcDatStubIsSwept (0.01s) === RUN TestRemoveEmptyEcDatStubFindsVifInIdxDir W1117 09:41:51.587986 disk_location.go:238 removing leftover empty .dat stub for EC volume 42 (collection="warp-cal") --- PASS: TestRemoveEmptyEcDatStubFindsVifInIdxDir (0.00s) === RUN TestEmptyDatStubNextToEcxDoesNotDeleteShards W1117 09:41:51.594874 disk_location.go:238 removing leftover empty .dat stub for EC volume 87 (collection="warp-rec") --- PASS: TestEmptyDatStubNextToEcxDoesNotDeleteShards (0.01s) === RUN TestEmptyDatWithoutVifDoesNotDeleteShards W1117 09:41:51.604284 ec_volume.go:425 vif file not found, using defaults, volumeId:88, filename:/tmp/TestEmptyDatWithoutVifDoesNotDeleteShards287017337/001/warp-rec_88.vif --- PASS: TestEmptyDatWithoutVifDoesNotDeleteShards (0.01s) === RUN TestReadEcShardNeedleSkipsQuarantinedLocalShards I1117 09:41:51.995125 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleSkipsQuarantinedLocalShards698815385/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:52.628286 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:41:52.629296 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:41:52.629803 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:41:52.630197 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:41:52.630570 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:41:52.630927 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:41:52.631326 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:41:52.631681 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:41:52.632040 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:41:52.632418 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:41:52.632774 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:41:52.633135 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:41:52.633501 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:41:52.633910 store_ec.go:261 MountEcShards 7.13 on disk ID 0 --- PASS: TestReadEcShardNeedleSkipsQuarantinedLocalShards (1.53s) === RUN TestReadEcShardNeedleFallsBackToQuarantinedShards I1117 09:41:53.603357 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleFallsBackToQuarantinedShards818431356/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:54.250232 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:41:54.251196 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:41:54.251679 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:41:54.252067 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:41:54.252413 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:41:54.252749 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:41:54.253126 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:41:54.253503 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:41:54.253905 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:41:54.254283 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:41:54.254619 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:41:54.254977 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:41:54.255374 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:41:54.255793 store_ec.go:261 MountEcShards 7.13 on disk ID 0 I1117 09:41:54.277534 store_ec.go:695 read remote ec shard 7.2 locations: read ec shard 7.2 from 127.0.0.1:1: receiving ec shard 7.2 from 127.0.0.1:1: rpc error: code = Unimplemented desc = method VolumeEcShardRead not implemented I1117 09:41:54.277535 store_ec.go:695 read remote ec shard 7.0 locations: read ec shard 7.0 from 127.0.0.1:1: receiving ec shard 7.0 from 127.0.0.1:1: rpc error: code = Unimplemented desc = method VolumeEcShardRead not implemented I1117 09:41:54.277591 store_ec.go:695 read remote ec shard 7.1 locations: read ec shard 7.1 from 127.0.0.1:1: receiving ec shard 7.1 from 127.0.0.1:1: rpc error: code = Unimplemented desc = method VolumeEcShardRead not implemented I1117 09:41:54.277537 store_ec.go:695 read remote ec shard 7.3 locations: read ec shard 7.3 from 127.0.0.1:1: receiving ec shard 7.3 from 127.0.0.1:1: rpc error: code = Unimplemented desc = method VolumeEcShardRead not implemented --- PASS: TestReadEcShardNeedleFallsBackToQuarantinedShards (1.38s) === RUN TestReadRemoteEcShardIntervalKeepsDeletionWhenTheStreamFails --- PASS: TestReadRemoteEcShardIntervalKeepsDeletionWhenTheStreamFails (0.02s) === RUN TestCollectHeartbeatReportsQuarantinedEcShardsDeletedOnce I1117 09:41:54.925524 ec_encoder.go:225 encodeDatFile /tmp/TestCollectHeartbeatReportsQuarantinedEcShardsDeletedOnce3166723129/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:55.575610 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:41:55.576849 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:41:55.577304 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:41:55.577763 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:41:55.578189 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:41:55.578575 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:41:55.578962 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:41:55.579349 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:41:55.579790 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:41:55.580181 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:41:55.580564 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:41:55.580949 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:41:55.581344 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:41:55.581749 store_ec.go:261 MountEcShards 7.13 on disk ID 0 W1117 09:41:55.583617 store.go:913 ec volume 7 quarantined after 3 consecutive IO errors: read shard: input/output error --- PASS: TestCollectHeartbeatReportsQuarantinedEcShardsDeletedOnce (1.06s) === RUN TestMountEcShardsRefusesQuarantinedEcVolume I1117 09:41:56.054087 ec_encoder.go:225 encodeDatFile /tmp/TestMountEcShardsRefusesQuarantinedEcVolume1374664980/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:56.723644 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:41:56.724595 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:41:56.725022 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:41:56.725404 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:41:56.725763 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:41:56.726116 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:41:56.726505 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:41:56.726859 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:41:56.727212 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:41:56.727563 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:41:56.727936 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:41:56.728292 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:41:56.728653 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:41:56.729169 store_ec.go:261 MountEcShards 7.13 on disk ID 0 I1117 09:41:56.729947 store_ec.go:261 MountEcShards 7.0 on disk ID 0 --- PASS: TestMountEcShardsRefusesQuarantinedEcVolume (1.14s) === RUN TestMountEcShardsBesideAQuarantinedSibling I1117 09:41:57.144590 ec_encoder.go:225 encodeDatFile /tmp/TestMountEcShardsBesideAQuarantinedSibling2596928750/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:57.793832 store_ec.go:261 MountEcShards 7.1 on disk ID 0 --- PASS: TestMountEcShardsBesideAQuarantinedSibling (1.06s) === RUN TestReadEcShardNeedleFallsBackToQuarantinedShardsWithoutLookup I1117 09:41:58.203669 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleFallsBackToQuarantinedShardsWithoutLookup2038518208/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:41:58.867084 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:41:58.868015 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:41:58.868416 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:41:58.868789 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:41:58.869168 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:41:58.869514 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:41:58.869864 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:41:58.870207 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:41:58.870553 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:41:58.870898 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:41:58.871243 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:41:58.871587 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:41:58.871958 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:41:58.872308 store_ec.go:261 MountEcShards 7.13 on disk ID 0 I1117 09:41:58.888163 store_ec.go:620 locate ec volume 7 via master grpc , using cached locations: lookup ec volume 7: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp: missing address" --- PASS: TestReadEcShardNeedleFallsBackToQuarantinedShardsWithoutLookup (1.32s) === RUN TestReadEcShardNeedleReconstructsFromQuarantinedShards I1117 09:41:59.525341 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleReconstructsFromQuarantinedShards2360518623/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:00.180811 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:42:00.181691 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:42:00.182085 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:42:00.182455 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:42:00.182804 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:42:00.183152 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:42:00.183494 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:42:00.183836 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:42:00.184179 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:42:00.184518 store_ec.go:261 MountEcShards 7.13 on disk ID 0 I1117 09:42:00.203379 store_ec.go:695 read remote ec shard 7.1 locations: read ec shard 7.1 from 127.0.0.1:1: receiving ec shard 7.1 from 127.0.0.1:1: rpc error: code = Unimplemented desc = method VolumeEcShardRead not implemented I1117 09:42:00.203401 store_ec.go:695 read remote ec shard 7.0 locations: read ec shard 7.0 from 127.0.0.1:1: receiving ec shard 7.0 from 127.0.0.1:1: rpc error: code = Unimplemented desc = method VolumeEcShardRead not implemented I1117 09:42:00.203432 store_ec.go:695 read remote ec shard 7.2 locations: read ec shard 7.2 from 127.0.0.1:1: receiving ec shard 7.2 from 127.0.0.1:1: rpc error: code = Unimplemented desc = method VolumeEcShardRead not implemented I1117 09:42:00.203400 store_ec.go:695 read remote ec shard 7.3 locations: read ec shard 7.3 from 127.0.0.1:1: receiving ec shard 7.3 from 127.0.0.1:1: rpc error: code = Unimplemented desc = method VolumeEcShardRead not implemented --- PASS: TestReadEcShardNeedleReconstructsFromQuarantinedShards (1.34s) === RUN TestReopenEcShardReadsReplacedFile I1117 09:42:00.489277 store_ec.go:261 MountEcShards 42.0 on disk ID 0 --- PASS: TestReopenEcShardReadsReplacedFile (0.08s) === RUN TestReconstructEcShardIntervalRebuildsDataShard --- PASS: TestReconstructEcShardIntervalRebuildsDataShard (0.01s) === RUN TestReconstructEcShardIntervalRejectsParityShard --- PASS: TestReconstructEcShardIntervalRejectsParityShard (0.00s) === RUN TestReconstructEcShardIntervalNeedsDataShardCount --- PASS: TestReconstructEcShardIntervalNeedsDataShardCount (0.00s) === RUN TestReconstructEcShardIntervalRebuildsOnlyTheTarget --- PASS: TestReconstructEcShardIntervalRebuildsOnlyTheTarget (0.00s) === RUN TestEcReconstructedIntervalCounter I1117 09:42:00.970700 ec_encoder.go:225 encodeDatFile /tmp/TestEcReconstructedIntervalCounter1244853619/001/dir0/17.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:01.626614 store_ec.go:261 MountEcShards 17.0 on disk ID 0 I1117 09:42:01.627672 store_ec.go:261 MountEcShards 17.1 on disk ID 0 I1117 09:42:01.628155 store_ec.go:261 MountEcShards 17.2 on disk ID 0 I1117 09:42:01.628505 store_ec.go:261 MountEcShards 17.3 on disk ID 0 I1117 09:42:01.628850 store_ec.go:261 MountEcShards 17.4 on disk ID 0 I1117 09:42:01.629186 store_ec.go:261 MountEcShards 17.5 on disk ID 0 I1117 09:42:01.629518 store_ec.go:261 MountEcShards 17.6 on disk ID 0 I1117 09:42:01.629863 store_ec.go:261 MountEcShards 17.7 on disk ID 0 I1117 09:42:01.630220 store_ec.go:261 MountEcShards 17.8 on disk ID 0 I1117 09:42:01.630604 store_ec.go:261 MountEcShards 17.9 on disk ID 0 I1117 09:42:01.631018 store_ec.go:261 MountEcShards 17.10 on disk ID 0 I1117 09:42:01.631366 store_ec.go:261 MountEcShards 17.11 on disk ID 0 I1117 09:42:01.631709 store_ec.go:261 MountEcShards 17.12 on disk ID 0 I1117 09:42:01.632163 store_ec.go:261 MountEcShards 17.13 on disk ID 0 I1117 09:42:02.140177 ec_encoder.go:225 encodeDatFile /tmp/TestEcReconstructedIntervalCounter1244853619/002/dir0/18.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:02.776862 store_ec.go:261 MountEcShards 18.1 on disk ID 0 I1117 09:42:02.777828 store_ec.go:261 MountEcShards 18.2 on disk ID 0 I1117 09:42:02.778239 store_ec.go:261 MountEcShards 18.3 on disk ID 0 I1117 09:42:02.778581 store_ec.go:261 MountEcShards 18.4 on disk ID 0 I1117 09:42:02.778920 store_ec.go:261 MountEcShards 18.5 on disk ID 0 I1117 09:42:02.779256 store_ec.go:261 MountEcShards 18.6 on disk ID 0 I1117 09:42:02.779593 store_ec.go:261 MountEcShards 18.7 on disk ID 0 I1117 09:42:02.779945 store_ec.go:261 MountEcShards 18.8 on disk ID 0 I1117 09:42:02.780290 store_ec.go:261 MountEcShards 18.9 on disk ID 0 I1117 09:42:02.780627 store_ec.go:261 MountEcShards 18.10 on disk ID 0 I1117 09:42:02.780965 store_ec.go:261 MountEcShards 18.11 on disk ID 0 I1117 09:42:02.781302 store_ec.go:261 MountEcShards 18.12 on disk ID 0 I1117 09:42:02.781646 store_ec.go:261 MountEcShards 18.13 on disk ID 0 I1117 09:42:03.324798 ec_encoder.go:225 encodeDatFile /tmp/TestEcReconstructedIntervalCounter1244853619/003/dir0/19.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:03.951051 store_ec.go:261 MountEcShards 19.1 on disk ID 0 I1117 09:42:03.951912 store_ec.go:261 MountEcShards 19.2 on disk ID 0 I1117 09:42:03.952319 store_ec.go:261 MountEcShards 19.3 on disk ID 0 I1117 09:42:03.952679 store_ec.go:261 MountEcShards 19.4 on disk ID 0 I1117 09:42:03.953091 store_ec.go:261 MountEcShards 19.5 on disk ID 0 I1117 09:42:03.958727 store_ec.go:708 recover ec shard 19.0 : cannot recover shard 19.0: only 5 shards available [1 2 3 4 5], need at least 10 (missing: [0 6 7 8 9 10 11 12 13]) I1117 09:42:04.362144 ec_encoder.go:225 encodeDatFile /tmp/TestEcReconstructedIntervalCounter1244853619/004/dir0/20.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:05.002000 store_ec.go:261 MountEcShards 20.0 on disk ID 0 I1117 09:42:05.003020 store_ec.go:261 MountEcShards 20.1 on disk ID 0 I1117 09:42:05.003415 store_ec.go:261 MountEcShards 20.2 on disk ID 0 I1117 09:42:05.003749 store_ec.go:261 MountEcShards 20.3 on disk ID 0 I1117 09:42:05.004084 store_ec.go:261 MountEcShards 20.4 on disk ID 0 I1117 09:42:05.004414 store_ec.go:261 MountEcShards 20.5 on disk ID 0 I1117 09:42:05.004740 store_ec.go:261 MountEcShards 20.6 on disk ID 0 I1117 09:42:05.005068 store_ec.go:261 MountEcShards 20.7 on disk ID 0 I1117 09:42:05.005419 store_ec.go:261 MountEcShards 20.8 on disk ID 0 I1117 09:42:05.005918 store_ec.go:261 MountEcShards 20.9 on disk ID 0 I1117 09:42:05.006309 store_ec.go:261 MountEcShards 20.10 on disk ID 0 I1117 09:42:05.006648 store_ec.go:261 MountEcShards 20.11 on disk ID 0 I1117 09:42:05.006986 store_ec.go:261 MountEcShards 20.12 on disk ID 0 I1117 09:42:05.007367 store_ec.go:261 MountEcShards 20.13 on disk ID 0 I1117 09:42:17.571655 ec_encoder.go:225 encodeDatFile /tmp/TestEcReconstructedIntervalCounter1244853619/005/dir0/21.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:18.193755 store_ec.go:261 MountEcShards 21.1 on disk ID 0 I1117 09:42:18.194675 store_ec.go:261 MountEcShards 21.2 on disk ID 0 I1117 09:42:18.195163 store_ec.go:261 MountEcShards 21.3 on disk ID 0 I1117 09:42:18.195527 store_ec.go:261 MountEcShards 21.4 on disk ID 0 I1117 09:42:18.195863 store_ec.go:261 MountEcShards 21.5 on disk ID 0 I1117 09:42:18.196231 store_ec.go:261 MountEcShards 21.6 on disk ID 0 I1117 09:42:18.196571 store_ec.go:261 MountEcShards 21.7 on disk ID 0 I1117 09:42:18.196905 store_ec.go:261 MountEcShards 21.8 on disk ID 0 I1117 09:42:18.197235 store_ec.go:261 MountEcShards 21.9 on disk ID 0 I1117 09:42:18.197564 store_ec.go:261 MountEcShards 21.10 on disk ID 0 I1117 09:42:18.197925 store_ec.go:261 MountEcShards 21.11 on disk ID 0 I1117 09:42:18.198279 store_ec.go:261 MountEcShards 21.12 on disk ID 0 I1117 09:42:18.198617 store_ec.go:261 MountEcShards 21.13 on disk ID 0 --- PASS: TestEcReconstructedIntervalCounter (28.02s) === RUN TestEcReconstructedIntervalLogLine --- PASS: TestEcReconstructedIntervalLogLine (3.63s) === RUN TestRecoverOneRemoteEcShardIntervalUsesLocalShards I1117 09:42:32.595278 ec_encoder.go:225 encodeDatFile /tmp/TestRecoverOneRemoteEcShardIntervalUsesLocalShards645467171/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:33.266438 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:42:33.267399 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:42:33.267865 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:42:33.268249 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:42:33.268632 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:42:33.269004 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:42:33.269374 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:42:33.269774 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:42:33.270149 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:42:33.270523 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:42:33.270893 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:42:33.271262 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:42:33.271640 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:42:33.272060 store_ec.go:261 MountEcShards 7.13 on disk ID 0 --- PASS: TestRecoverOneRemoteEcShardIntervalUsesLocalShards (1.13s) === RUN TestRecoverOneRemoteEcShardIntervalFetchesOnlyWhatItNeeds I1117 09:42:33.730853 ec_encoder.go:225 encodeDatFile /tmp/TestRecoverOneRemoteEcShardIntervalFetchesOnlyWhatItNeeds1978125078/001/7.dat size:3147008 with EC context 10+4 (total: 14) --- PASS: TestRecoverOneRemoteEcShardIntervalFetchesOnlyWhatItNeeds (1.07s) === RUN TestRecoverOneRemoteEcShardIntervalBoundsInFlightBytes --- PASS: TestRecoverOneRemoteEcShardIntervalBoundsInFlightBytes (0.32s) === RUN TestReadEcShardNeedleAnswersDeletedWhenRecoveryFallsShort I1117 09:42:35.130808 ec_encoder.go:225 encodeDatFile /tmp/TestReadEcShardNeedleAnswersDeletedWhenRecoveryFallsShort1119337870/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:35.783358 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:42:35.784289 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:42:35.784712 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:42:35.785085 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:42:35.785422 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:42:35.826799 store_ec.go:708 recover ec shard 7.0 : cannot recover shard 7.0: only 5 shards available [1 2 3 4 5], need at least 10 (missing: [0 6 7 8 9 10 11 12 13]) --- PASS: TestReadEcShardNeedleAnswersDeletedWhenRecoveryFallsShort (1.10s) === RUN TestEcIndexRecovery_CrossServerOrphan I1117 09:42:35.845433 store_ec_mirror.go:56 ec volume 6190 (collection="video-recordings"): mirrored 3 sidecar(s) from /tmp/TestEcIndexRecovery_CrossServerOrphan546776622/001/disk0 to /tmp/TestEcIndexRecovery_CrossServerOrphan546776622/001/disk1 for same-disk invariant --- PASS: TestEcIndexRecovery_CrossServerOrphan (0.02s) === RUN TestCollectEcVolumesMissingIndex_ExcludesCrossDiskOrphan --- PASS: TestCollectEcVolumesMissingIndex_ExcludesCrossDiskOrphan (0.01s) === RUN TestRecoverOneRemoteEcShardInterval_SufficientShards store_ec_recovery_test.go:52: Successfully identified 13 available shards (need 10) --- PASS: TestRecoverOneRemoteEcShardInterval_SufficientShards (0.00s) === RUN TestRecoverOneRemoteEcShardInterval_InsufficientShards store_ec_recovery_test.go:80: Correctly identified insufficient shards: 7 available (need 10) --- PASS: TestRecoverOneRemoteEcShardInterval_InsufficientShards (0.00s) === RUN TestRecoverOneRemoteEcShardInterval_ShardCounting === RUN TestRecoverOneRemoteEcShardInterval_ShardCounting/All_shards_available_except_one store_ec_recovery_test.go:155: Available shards: 13 [0 1 2 3 4 6 7 8 9 10 11 12 13], Missing shards: 1 [5] === RUN TestRecoverOneRemoteEcShardInterval_ShardCounting/Exactly_minimum_shards_(DataShardsCount) store_ec_recovery_test.go:155: Available shards: 10 [0 1 2 3 4 5 6 7 8 9], Missing shards: 4 [10 11 12 13] === RUN TestRecoverOneRemoteEcShardInterval_ShardCounting/One_less_than_minimum store_ec_recovery_test.go:155: Available shards: 9 [0 1 2 3 4 5 6 7 8], Missing shards: 5 [9 10 11 12 13] === RUN TestRecoverOneRemoteEcShardInterval_ShardCounting/Only_half_the_shards store_ec_recovery_test.go:155: Available shards: 7 [1 2 3 4 5 6 7], Missing shards: 7 [0 8 9 10 11 12 13] === RUN TestRecoverOneRemoteEcShardInterval_ShardCounting/All_data_shards_available store_ec_recovery_test.go:155: Available shards: 10 [0 1 2 3 4 5 6 7 8 9], Missing shards: 4 [10 11 12 13] --- PASS: TestRecoverOneRemoteEcShardInterval_ShardCounting (0.01s) --- PASS: TestRecoverOneRemoteEcShardInterval_ShardCounting/All_shards_available_except_one (0.00s) --- PASS: TestRecoverOneRemoteEcShardInterval_ShardCounting/Exactly_minimum_shards_(DataShardsCount) (0.00s) --- PASS: TestRecoverOneRemoteEcShardInterval_ShardCounting/One_less_than_minimum (0.00s) --- PASS: TestRecoverOneRemoteEcShardInterval_ShardCounting/Only_half_the_shards (0.00s) --- PASS: TestRecoverOneRemoteEcShardInterval_ShardCounting/All_data_shards_available (0.00s) === RUN TestRecoverOneRemoteEcShardInterval_ErrorMessage store_ec_recovery_test.go:190: Error message format validated: cannot recover shard 42.7: only 7 shards available [0 1 2 3 4 5 6], need at least 10 (missing: [7 8 9 10 11 12 13]) --- PASS: TestRecoverOneRemoteEcShardInterval_ErrorMessage (0.00s) === RUN TestRecoverOneRemoteEcShardInterval_ReconstructDataSlicing store_ec_recovery_test.go:248: Successfully reconstructed shard with proper buffer slicing --- PASS: TestRecoverOneRemoteEcShardInterval_ReconstructDataSlicing (0.00s) === RUN TestRecoverOneRemoteEcShardInterval_ParityShardRecovery === RUN TestRecoverOneRemoteEcShardInterval_ParityShardRecovery/RecoverParity10 === RUN TestRecoverOneRemoteEcShardInterval_ParityShardRecovery/RecoverParity11 === RUN TestRecoverOneRemoteEcShardInterval_ParityShardRecovery/RecoverParity12 === RUN TestRecoverOneRemoteEcShardInterval_ParityShardRecovery/RecoverParity13 --- PASS: TestRecoverOneRemoteEcShardInterval_ParityShardRecovery (0.01s) --- PASS: TestRecoverOneRemoteEcShardInterval_ParityShardRecovery/RecoverParity10 (0.00s) --- PASS: TestRecoverOneRemoteEcShardInterval_ParityShardRecovery/RecoverParity11 (0.00s) --- PASS: TestRecoverOneRemoteEcShardInterval_ParityShardRecovery/RecoverParity12 (0.00s) --- PASS: TestRecoverOneRemoteEcShardInterval_ParityShardRecovery/RecoverParity13 (0.00s) === RUN TestRecoverOneRemoteEcShardInterval_ConcurrentShardReading store_ec_recovery_test.go:363: Successfully simulated concurrent reading of 13 shards --- PASS: TestRecoverOneRemoteEcShardInterval_ConcurrentShardReading (0.00s) === RUN TestRecoverOneRemoteEcShardInterval_BuggyMaxShardCount store_ec_recovery_test.go:419: Corrected code: 9 shards (correct, insufficient) store_ec_recovery_test.go:420: Buggy code would have counted: 27 shards (incorrect, falsely sufficient) store_ec_recovery_test.go:421: Missing shards: [9 10 11 12 13] --- PASS: TestRecoverOneRemoteEcShardInterval_BuggyMaxShardCount (0.00s) === RUN TestScrubEcVolumeReadsMatchesFullWhenHealthy I1117 09:42:36.280993 ec_encoder.go:225 encodeDatFile /tmp/TestScrubEcVolumeReadsMatchesFullWhenHealthy925206151/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:36.937008 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:42:36.937895 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:42:36.938309 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:42:36.938651 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:42:36.938982 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:42:36.939309 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:42:36.939631 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:42:36.939960 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:42:36.940285 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:42:36.940604 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:42:36.940926 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:42:36.941247 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:42:36.941635 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:42:36.941962 store_ec.go:261 MountEcShards 7.13 on disk ID 0 --- PASS: TestScrubEcVolumeReadsMatchesFullWhenHealthy (1.25s) === RUN TestScrubEcVolumeReadsReportsTheShardItRebuilt I1117 09:42:37.527918 ec_encoder.go:225 encodeDatFile /tmp/TestScrubEcVolumeReadsReportsTheShardItRebuilt3293378540/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:38.191372 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:42:38.192383 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:42:38.192804 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:42:38.193154 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:42:38.193492 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:42:38.193846 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:42:38.194179 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:42:38.194506 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:42:38.194851 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:42:38.195207 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:42:38.195572 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:42:38.195942 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:42:38.196281 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:42:38.196651 store_ec.go:261 MountEcShards 7.13 on disk ID 0 I1117 09:42:38.197081 store_ec.go:415 UnmountEcShards 7.0 disk_id:0 --- PASS: TestScrubEcVolumeReadsReportsTheShardItRebuilt (1.22s) === RUN TestScrubEcVolumeReadsErrorsWhenParityCannotCover I1117 09:42:38.835243 ec_encoder.go:225 encodeDatFile /tmp/TestScrubEcVolumeReadsErrorsWhenParityCannotCover3987254388/001/dir0/7.dat size:3147008 with EC context 10+4 (total: 14) I1117 09:42:39.517722 store_ec.go:261 MountEcShards 7.0 on disk ID 0 I1117 09:42:39.518706 store_ec.go:261 MountEcShards 7.1 on disk ID 0 I1117 09:42:39.519093 store_ec.go:261 MountEcShards 7.2 on disk ID 0 I1117 09:42:39.519429 store_ec.go:261 MountEcShards 7.3 on disk ID 0 I1117 09:42:39.519774 store_ec.go:261 MountEcShards 7.4 on disk ID 0 I1117 09:42:39.520106 store_ec.go:261 MountEcShards 7.5 on disk ID 0 I1117 09:42:39.520434 store_ec.go:261 MountEcShards 7.6 on disk ID 0 I1117 09:42:39.520784 store_ec.go:261 MountEcShards 7.7 on disk ID 0 I1117 09:42:39.521116 store_ec.go:261 MountEcShards 7.8 on disk ID 0 I1117 09:42:39.521442 store_ec.go:261 MountEcShards 7.9 on disk ID 0 I1117 09:42:39.521823 store_ec.go:261 MountEcShards 7.10 on disk ID 0 I1117 09:42:39.522154 store_ec.go:261 MountEcShards 7.11 on disk ID 0 I1117 09:42:39.522491 store_ec.go:261 MountEcShards 7.12 on disk ID 0 I1117 09:42:39.522874 store_ec.go:261 MountEcShards 7.13 on disk ID 0 I1117 09:42:39.523310 store_ec.go:415 UnmountEcShards 7.0 disk_id:0 I1117 09:42:39.523482 store_ec.go:415 UnmountEcShards 7.1 disk_id:0 I1117 09:42:39.523627 store_ec.go:415 UnmountEcShards 7.2 disk_id:0 I1117 09:42:39.523763 store_ec.go:415 UnmountEcShards 7.3 disk_id:0 I1117 09:42:39.523899 store_ec.go:415 UnmountEcShards 7.4 disk_id:0 --- PASS: TestScrubEcVolumeReadsErrorsWhenParityCannotCover (1.20s) === RUN TestFindEcShardTargetLocation_PinsToEcxOnDisk --- PASS: TestFindEcShardTargetLocation_PinsToEcxOnDisk (0.01s) === RUN TestFindEcShardTargetLocation_PrefersMountedOverEcx --- PASS: TestFindEcShardTargetLocation_PrefersMountedOverEcx (0.01s) === RUN TestFindEcShardTargetLocation_FallsThroughToHddWhenNothingMatches --- PASS: TestFindEcShardTargetLocation_FallsThroughToHddWhenNothingMatches (0.01s) === RUN TestFindEcShardTargetLocation_HonoursUnlimitedDisk --- PASS: TestFindEcShardTargetLocation_HonoursUnlimitedDisk (0.00s) === RUN TestFindEcShardTargetLocation_TightProvisioningKeepsEcxDisk --- PASS: TestFindEcShardTargetLocation_TightProvisioningKeepsEcxDisk (0.01s) === RUN TestFindEcShardTargetLocation_PinsToTheDiskOwningTheShard --- PASS: TestFindEcShardTargetLocation_PinsToTheDiskOwningTheShard (0.01s) === RUN TestFindEcShardTargetLocation_OwningDiskWinsWhenFull --- PASS: TestFindEcShardTargetLocation_OwningDiskWinsWhenFull (0.01s) === RUN TestEcShardOwnerDisks --- PASS: TestEcShardOwnerDisks (0.01s) === RUN TestMaybeAdjustVolumeMaxIgnoresFreeSpaceInsideFloor --- PASS: TestMaybeAdjustVolumeMaxIgnoresFreeSpaceInsideFloor (0.00s) === RUN TestAddVolumeRefusesPreallocationThatCrossesFloor --- PASS: TestAddVolumeRefusesPreallocationThatCrossesFloor (0.00s) === RUN TestAddVolumeAllowsPlainVolumeAboveFloor I1117 09:42:39.630315 store.go:431 In dir /tmp/TestAddVolumeAllowsPlainVolumeAboveFloor3949767009/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.632842 store.go:436 add volume 1 on disk ID 0 --- PASS: TestAddVolumeAllowsPlainVolumeAboveFloor (0.00s) === RUN TestAddVolumeAllowsMergeVolumeBelowFloor I1117 09:42:39.635157 store.go:431 In dir /tmp/TestAddVolumeAllowsMergeVolumeBelowFloor1148676469/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.637216 store.go:436 add volume 1 on disk ID 0 --- PASS: TestAddVolumeAllowsMergeVolumeBelowFloor (0.00s) === RUN TestAddVolumeAllowsPreallocationWhereUnsupported I1117 09:42:39.639518 store.go:431 In dir /tmp/TestAddVolumeAllowsPreallocationWhereUnsupported1686685926/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.648558 store.go:436 add volume 1 on disk ID 0 --- PASS: TestAddVolumeAllowsPreallocationWhereUnsupported (0.01s) === RUN TestGrowthLoopStopsAtFloorWhenVolumesPreallocate I1117 09:42:39.652458 store.go:431 In dir /tmp/TestGrowthLoopStopsAtFloorWhenVolumesPreallocate237870963/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.655041 store.go:436 add volume 1 on disk ID 0 I1117 09:42:39.656803 store.go:431 In dir /tmp/TestGrowthLoopStopsAtFloorWhenVolumesPreallocate237870963/001 (disk ID 0) adds volume:2 collection: replicaPlacement:000 ttl: I1117 09:42:39.659180 store.go:436 add volume 2 on disk ID 0 I1117 09:42:39.659463 store.go:431 In dir /tmp/TestGrowthLoopStopsAtFloorWhenVolumesPreallocate237870963/001 (disk ID 0) adds volume:3 collection: replicaPlacement:000 ttl: I1117 09:42:39.662001 store.go:436 add volume 3 on disk ID 0 I1117 09:42:39.662295 store.go:431 In dir /tmp/TestGrowthLoopStopsAtFloorWhenVolumesPreallocate237870963/001 (disk ID 0) adds volume:4 collection: replicaPlacement:000 ttl: I1117 09:42:39.664799 store.go:436 add volume 4 on disk ID 0 --- PASS: TestGrowthLoopStopsAtFloorWhenVolumesPreallocate (0.02s) === RUN TestReserveFreeLocationChargesPickedReservation --- PASS: TestReserveFreeLocationChargesPickedReservation (0.00s) === RUN TestReserveFreeLocationRechecksLiveDisk --- PASS: TestReserveFreeLocationRechecksLiveDisk (0.00s) === RUN TestReleaseFreeLocationRestoresReservation --- PASS: TestReleaseFreeLocationRestoresReservation (0.00s) === RUN TestReleaseFreeLocationAfterProbeRefundsOnlyOwnCharge --- PASS: TestReleaseFreeLocationAfterProbeRefundsOnlyOwnCharge (0.00s) === RUN TestCommitFreeLocationSettlesLandedReservation --- PASS: TestCommitFreeLocationSettlesLandedReservation (0.00s) === RUN TestCommitFreeLocationSettlesAsBytesLand --- PASS: TestCommitFreeLocationSettlesAsBytesLand (0.00s) === RUN TestCollectHeartbeatDigestsExactlyWhatItReports --- PASS: TestCollectHeartbeatDigestsExactlyWhatItReports (0.02s) === RUN TestCollectHeartbeatDigestsAnEmptyStore --- PASS: TestCollectHeartbeatDigestsAnEmptyStore (0.00s) === RUN TestCollectHeartbeatCarriesState --- PASS: TestCollectHeartbeatCarriesState (0.01s) === RUN TestCollectHeartbeatDigestFollowsVolumeChanges --- PASS: TestCollectHeartbeatDigestFollowsVolumeChanges (0.01s) === RUN TestLoadBalancingDistribution I1117 09:42:39.726303 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir0 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.728023 store.go:436 add volume 1 on disk ID 0 I1117 09:42:39.729217 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir1 (disk ID 1) adds volume:2 collection: replicaPlacement:000 ttl: I1117 09:42:39.730645 store.go:436 add volume 2 on disk ID 1 I1117 09:42:39.731706 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir2 (disk ID 2) adds volume:3 collection: replicaPlacement:000 ttl: I1117 09:42:39.733228 store.go:436 add volume 3 on disk ID 2 I1117 09:42:39.734367 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir0 (disk ID 0) adds volume:4 collection: replicaPlacement:000 ttl: I1117 09:42:39.735861 store.go:436 add volume 4 on disk ID 0 I1117 09:42:39.737217 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir1 (disk ID 1) adds volume:5 collection: replicaPlacement:000 ttl: I1117 09:42:39.738749 store.go:436 add volume 5 on disk ID 1 I1117 09:42:39.740471 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir2 (disk ID 2) adds volume:6 collection: replicaPlacement:000 ttl: I1117 09:42:39.741933 store.go:436 add volume 6 on disk ID 2 I1117 09:42:39.742978 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir0 (disk ID 0) adds volume:7 collection: replicaPlacement:000 ttl: I1117 09:42:39.744336 store.go:436 add volume 7 on disk ID 0 I1117 09:42:39.745528 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir1 (disk ID 1) adds volume:8 collection: replicaPlacement:000 ttl: I1117 09:42:39.747068 store.go:436 add volume 8 on disk ID 1 I1117 09:42:39.748264 store.go:431 In dir /tmp/TestLoadBalancingDistribution628401720/001/dir2 (disk ID 2) adds volume:9 collection: replicaPlacement:000 ttl: I1117 09:42:39.749871 store.go:436 add volume 9 on disk ID 2 --- PASS: TestLoadBalancingDistribution (0.03s) === RUN TestLocalVolumesLen === RUN TestLocalVolumesLen/all_local_volumes === RUN TestLocalVolumesLen/all_remote_volumes === RUN TestLocalVolumesLen/mixed_local_and_remote === RUN TestLocalVolumesLen/no_volumes --- PASS: TestLocalVolumesLen (0.00s) --- PASS: TestLocalVolumesLen/all_local_volumes (0.00s) --- PASS: TestLocalVolumesLen/all_remote_volumes (0.00s) --- PASS: TestLocalVolumesLen/mixed_local_and_remote (0.00s) --- PASS: TestLocalVolumesLen/no_volumes (0.00s) === RUN TestVolumeLoadBalancing === RUN TestVolumeLoadBalancing/even_distribution_across_empty_locations I1117 09:42:39.765489 store.go:431 In dir /tmp/TestVolumeLoadBalancingeven_distribution_across_empty_locations3912253508/001/dir0 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.767881 store.go:436 add volume 1 on disk ID 0 I1117 09:42:39.769408 store.go:431 In dir /tmp/TestVolumeLoadBalancingeven_distribution_across_empty_locations3912253508/001/dir1 (disk ID 1) adds volume:2 collection: replicaPlacement:000 ttl: I1117 09:42:39.771367 store.go:436 add volume 2 on disk ID 1 I1117 09:42:39.772920 store.go:431 In dir /tmp/TestVolumeLoadBalancingeven_distribution_across_empty_locations3912253508/001/dir2 (disk ID 2) adds volume:3 collection: replicaPlacement:000 ttl: I1117 09:42:39.774821 store.go:436 add volume 3 on disk ID 2 I1117 09:42:39.776183 store.go:431 In dir /tmp/TestVolumeLoadBalancingeven_distribution_across_empty_locations3912253508/001/dir0 (disk ID 0) adds volume:4 collection: replicaPlacement:000 ttl: I1117 09:42:39.778065 store.go:436 add volume 4 on disk ID 0 I1117 09:42:39.779423 store.go:431 In dir /tmp/TestVolumeLoadBalancingeven_distribution_across_empty_locations3912253508/001/dir1 (disk ID 1) adds volume:5 collection: replicaPlacement:000 ttl: I1117 09:42:39.781365 store.go:436 add volume 5 on disk ID 1 I1117 09:42:39.782883 store.go:431 In dir /tmp/TestVolumeLoadBalancingeven_distribution_across_empty_locations3912253508/001/dir2 (disk ID 2) adds volume:6 collection: replicaPlacement:000 ttl: I1117 09:42:39.785042 store.go:436 add volume 6 on disk ID 2 === RUN TestVolumeLoadBalancing/prefers_location_with_fewer_local_volumes I1117 09:42:39.801171 store.go:431 In dir /tmp/TestVolumeLoadBalancingprefers_location_with_fewer_local_volume211922417/001/dir1 (disk ID 1) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.806665 store.go:436 add volume 1 on disk ID 1 I1117 09:42:39.807847 store.go:431 In dir /tmp/TestVolumeLoadBalancingprefers_location_with_fewer_local_volume211922417/001/dir1 (disk ID 1) adds volume:2 collection: replicaPlacement:000 ttl: I1117 09:42:39.810585 store.go:436 add volume 2 on disk ID 1 I1117 09:42:39.811716 store.go:431 In dir /tmp/TestVolumeLoadBalancingprefers_location_with_fewer_local_volume211922417/001/dir1 (disk ID 1) adds volume:3 collection: replicaPlacement:000 ttl: I1117 09:42:39.813444 store.go:436 add volume 3 on disk ID 1 === RUN TestVolumeLoadBalancing/ignores_remote_volumes_in_count I1117 09:42:39.822885 store.go:431 In dir /tmp/TestVolumeLoadBalancingignores_remote_volumes_in_count2341773223/001/dir0 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.825040 store.go:436 add volume 1 on disk ID 0 I1117 09:42:39.826275 store.go:431 In dir /tmp/TestVolumeLoadBalancingignores_remote_volumes_in_count2341773223/001/dir0 (disk ID 0) adds volume:2 collection: replicaPlacement:000 ttl: I1117 09:42:39.827818 store.go:436 add volume 2 on disk ID 0 I1117 09:42:39.829001 store.go:431 In dir /tmp/TestVolumeLoadBalancingignores_remote_volumes_in_count2341773223/001/dir2 (disk ID 2) adds volume:3 collection: replicaPlacement:000 ttl: I1117 09:42:39.830504 store.go:436 add volume 3 on disk ID 2 === RUN TestVolumeLoadBalancing/balances_when_some_locations_have_remote_volumes I1117 09:42:39.840036 store.go:431 In dir /tmp/TestVolumeLoadBalancingbalances_when_some_locations_have_remote3861776435/001/dir2 (disk ID 2) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:42:39.841777 store.go:436 add volume 1 on disk ID 2 I1117 09:42:39.842973 store.go:431 In dir /tmp/TestVolumeLoadBalancingbalances_when_some_locations_have_remote3861776435/001/dir0 (disk ID 0) adds volume:2 collection: replicaPlacement:000 ttl: I1117 09:42:39.844539 store.go:436 add volume 2 on disk ID 0 I1117 09:42:39.845652 store.go:431 In dir /tmp/TestVolumeLoadBalancingbalances_when_some_locations_have_remote3861776435/001/dir1 (disk ID 1) adds volume:3 collection: replicaPlacement:000 ttl: I1117 09:42:39.847452 store.go:436 add volume 3 on disk ID 1 --- PASS: TestVolumeLoadBalancing (0.09s) --- PASS: TestVolumeLoadBalancing/even_distribution_across_empty_locations (0.03s) --- PASS: TestVolumeLoadBalancing/prefers_location_with_fewer_local_volumes (0.03s) --- PASS: TestVolumeLoadBalancing/ignores_remote_volumes_in_count (0.02s) --- PASS: TestVolumeLoadBalancing/balances_when_some_locations_have_remote_volumes (0.02s) === RUN TestMarkVolumeReadonlyCanDelete I1117 09:42:39.853624 store.go:431 In dir /tmp/TestMarkVolumeReadonlyCanDelete2241815258/001 (disk ID 0) adds volume:11 collection: replicaPlacement:000 ttl: I1117 09:42:39.855535 store.go:436 add volume 11 on disk ID 0 I1117 09:42:39.862460 needle_map_sorted_file.go:40 Start to Generate /tmp/TestMarkVolumeReadonlyCanDelete2241815258/001/11.sdx from /tmp/TestMarkVolumeReadonlyCanDelete2241815258/001/11.idx I1117 09:42:39.875906 needle_map_sorted_file.go:42 Finished Generating /tmp/TestMarkVolumeReadonlyCanDelete2241815258/001/11.sdx from /tmp/TestMarkVolumeReadonlyCanDelete2241815258/001/11.idx --- PASS: TestMarkVolumeReadonlyCanDelete (0.03s) === RUN TestMarkVolumeReadonlyCanDelete_AfterReadonlyBoot I1117 09:42:39.887836 store.go:431 In dir /tmp/TestMarkVolumeReadonlyCanDelete_AfterReadonlyBoot1531124436/001 (disk ID 0) adds volume:12 collection: replicaPlacement:000 ttl: I1117 09:42:39.889688 store.go:436 add volume 12 on disk ID 0 I1117 09:42:39.894667 volume_loading.go:312 open to read file /tmp/TestMarkVolumeReadonlyCanDelete_AfterReadonlyBoot1531124436/001/12.idx I1117 09:42:39.895383 needle_map_sorted_file.go:40 Start to Generate /tmp/TestMarkVolumeReadonlyCanDelete_AfterReadonlyBoot1531124436/001/12.sdx from /tmp/TestMarkVolumeReadonlyCanDelete_AfterReadonlyBoot1531124436/001/12.idx I1117 09:42:39.909132 needle_map_sorted_file.go:42 Finished Generating /tmp/TestMarkVolumeReadonlyCanDelete_AfterReadonlyBoot1531124436/001/12.sdx from /tmp/TestMarkVolumeReadonlyCanDelete_AfterReadonlyBoot1531124436/001/12.idx --- PASS: TestMarkVolumeReadonlyCanDelete_AfterReadonlyBoot (0.03s) === RUN TestMountVolumeAnnouncesReadOnlyState === RUN TestMountVolumeAnnouncesReadOnlyState/plain_read-only I1117 09:42:39.918339 store.go:431 In dir /tmp/TestMountVolumeAnnouncesReadOnlyStateplain_read-only4244394753/001 (disk ID 0) adds volume:13 collection: replicaPlacement:000 ttl: I1117 09:42:39.920138 store.go:436 add volume 13 on disk ID 0 I1117 09:42:39.921537 store.go:1217 UnmountVolume 13 disk_id:0 I1117 09:42:39.924230 volume_loading.go:312 open to read file /tmp/TestMountVolumeAnnouncesReadOnlyStateplain_read-only4244394753/001/13.idx I1117 09:42:39.924567 needle_map_sorted_file.go:40 Start to Generate /tmp/TestMountVolumeAnnouncesReadOnlyStateplain_read-only4244394753/001/13.sdx from /tmp/TestMountVolumeAnnouncesReadOnlyStateplain_read-only4244394753/001/13.idx I1117 09:42:39.942840 needle_map_sorted_file.go:42 Finished Generating /tmp/TestMountVolumeAnnouncesReadOnlyStateplain_read-only4244394753/001/13.sdx from /tmp/TestMountVolumeAnnouncesReadOnlyStateplain_read-only4244394753/001/13.idx I1117 09:42:39.944675 store.go:1149 mount volume 13 === RUN TestMountVolumeAnnouncesReadOnlyState/read-only_can_delete I1117 09:42:39.958669 store.go:431 In dir /tmp/TestMountVolumeAnnouncesReadOnlyStateread-only_can_delete1170242456/001 (disk ID 0) adds volume:13 collection: replicaPlacement:000 ttl: I1117 09:42:39.960993 store.go:436 add volume 13 on disk ID 0 I1117 09:42:39.962351 store.go:1217 UnmountVolume 13 disk_id:0 I1117 09:42:39.965159 needle_map_sorted_file.go:40 Start to Generate /tmp/TestMountVolumeAnnouncesReadOnlyStateread-only_can_delete1170242456/001/13.sdx from /tmp/TestMountVolumeAnnouncesReadOnlyStateread-only_can_delete1170242456/001/13.idx I1117 09:42:39.980750 needle_map_sorted_file.go:42 Finished Generating /tmp/TestMountVolumeAnnouncesReadOnlyStateread-only_can_delete1170242456/001/13.sdx from /tmp/TestMountVolumeAnnouncesReadOnlyStateread-only_can_delete1170242456/001/13.idx I1117 09:42:39.981397 store.go:1149 mount volume 13 --- PASS: TestMountVolumeAnnouncesReadOnlyState (0.07s) --- PASS: TestMountVolumeAnnouncesReadOnlyState/plain_read-only (0.03s) --- PASS: TestMountVolumeAnnouncesReadOnlyState/read-only_can_delete (0.03s) === RUN TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart I1117 09:42:39.986746 store.go:431 In dir /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001 (disk ID 0) adds volume:13 collection: replicaPlacement:000 ttl: I1117 09:42:39.988833 store.go:436 add volume 13 on disk ID 0 I1117 09:42:39.994671 needle_map_sorted_file.go:40 Start to Generate /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001/13.sdx from /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001/13.idx I1117 09:42:40.007882 needle_map_sorted_file.go:42 Finished Generating /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001/13.sdx from /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001/13.idx I1117 09:42:40.017339 needle_map_sorted_file.go:40 Start to Generate /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001/13.sdx from /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001/13.idx I1117 09:42:40.030227 needle_map_sorted_file.go:42 Finished Generating /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001/13.sdx from /tmp/TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart2825289933/001/13.idx --- PASS: TestMarkVolumeReadonlyCanDelete_CountsDeletesAfterRestart (0.05s) === RUN TestMaybeAdjustVolumeMaxNoDeadZone === RUN TestMaybeAdjustVolumeMaxNoDeadZone/ratio=0.5 store_maxvolume_deadzone_test.go:49: free=28.4GiB limit=56.8GiB ratio≈0.50 -> MaxVolumeCount=1 (want 1) === RUN TestMaybeAdjustVolumeMaxNoDeadZone/ratio=1.5 store_maxvolume_deadzone_test.go:49: free=28.4GiB limit=18.9GiB ratio≈1.50 -> MaxVolumeCount=1 (want 1) === RUN TestMaybeAdjustVolumeMaxNoDeadZone/ratio=2.5 store_maxvolume_deadzone_test.go:49: free=28.4GiB limit=11.4GiB ratio≈2.50 -> MaxVolumeCount=2 (want 2) === RUN TestMaybeAdjustVolumeMaxNoDeadZone/ratio=3.5 store_maxvolume_deadzone_test.go:49: free=28.4GiB limit=8.1GiB ratio≈3.50 -> MaxVolumeCount=3 (want 3) --- PASS: TestMaybeAdjustVolumeMaxNoDeadZone (0.01s) --- PASS: TestMaybeAdjustVolumeMaxNoDeadZone/ratio=0.5 (0.00s) --- PASS: TestMaybeAdjustVolumeMaxNoDeadZone/ratio=1.5 (0.00s) --- PASS: TestMaybeAdjustVolumeMaxNoDeadZone/ratio=2.5 (0.00s) --- PASS: TestMaybeAdjustVolumeMaxNoDeadZone/ratio=3.5 (0.00s) === RUN TestMaybeAdjustVolumeMaxReservesPlainVolumesWhilePreallocating --- PASS: TestMaybeAdjustVolumeMaxReservesPlainVolumesWhilePreallocating (0.00s) === RUN TestMountVolumeValidatorAnnouncesOnlyAfterValidation I1117 09:42:40.051796 store.go:1149 mount volume 17 --- PASS: TestMountVolumeValidatorAnnouncesOnlyAfterValidation (0.01s) === RUN TestCollectStatForOneVolumeModifiedAtSecond --- PASS: TestCollectStatForOneVolumeModifiedAtSecond (0.00s) === RUN TestCompactionSpaceNeeded_CountsLiveBytesNotVolumeSize --- PASS: TestCompactionSpaceNeeded_CountsLiveBytesNotVolumeSize (0.50s) === RUN TestCompactionSpaceNeeded_AllGarbageNeedsAlmostNothing --- PASS: TestCompactionSpaceNeeded_AllGarbageNeedsAlmostNothing (0.47s) === RUN TestCompactionSpaceNeeded_NeverAboveCurrentVolume --- PASS: TestCompactionSpaceNeeded_NeverAboveCurrentVolume (0.04s) === RUN TestCompactionSpaceNeeded_PreallocateWinsForDataOnly --- PASS: TestCompactionSpaceNeeded_PreallocateWinsForDataOnly (0.01s) === RUN TestEnsureCompactVolumeSpace_FullDiskWithGarbage --- PASS: TestEnsureCompactVolumeSpace_FullDiskWithGarbage (0.47s) === RUN TestEnsureCompactVolumeSpace_SeparateIndexDisk --- PASS: TestEnsureCompactVolumeSpace_SeparateIndexDisk (0.02s) === RUN TestSameFilesystem --- PASS: TestSameFilesystem (0.00s) === RUN TestCompactionSpaceNeededCoversNeedleFraming --- PASS: TestCompactionSpaceNeededCoversNeedleFraming (0.03s) === RUN TestCheckCompactVolumeDiskLowSoleCauseOnly I1117 09:42:41.605335 store.go:431 In dir /tmp/TestCheckCompactVolumeDiskLowSoleCauseOnly3054291028/001 (disk ID 0) adds volume:7 collection: replicaPlacement:000 ttl: I1117 09:42:41.607568 store.go:436 add volume 7 on disk ID 0 --- PASS: TestCheckCompactVolumeDiskLowSoleCauseOnly (0.01s) === RUN TestHeartbeatSendsFullListUntilTheMasterAccepts --- PASS: TestHeartbeatSendsFullListUntilTheMasterAccepts (0.01s) === RUN TestQuietHeartbeatDoesNotLookLikeAnEmptyServer --- PASS: TestQuietHeartbeatDoesNotLookLikeAnEmptyServer (0.01s) === RUN TestQuietHeartbeatStillDigestsEverythingHeld --- PASS: TestQuietHeartbeatStillDigestsEverythingHeld (0.01s) === RUN TestHeartbeatReportsOnlyWhatChanged --- PASS: TestHeartbeatReportsOnlyWhatChanged (0.01s) === RUN TestHeartbeatReturnsToTheFullListOnRequest --- PASS: TestHeartbeatReturnsToTheFullListOnRequest (0.01s) === RUN TestReconnectingSendsTheFullListAgain --- PASS: TestReconnectingSendsTheFullListAgain (0.01s) === RUN TestRemountedVolumeIsReportedAgain --- PASS: TestRemountedVolumeIsReportedAgain (0.01s) === RUN TestFullListRequestDuringCollectionSurvives --- PASS: TestFullListRequestDuringCollectionSurvives (0.01s) === RUN TestDepartedVolumeIsNamedInTheDelta --- PASS: TestDepartedVolumeIsNamedInTheDelta (0.01s) === RUN TestDeleteReportsCarryTheReadOnlyState I1117 09:42:41.703458 volume_write.go:138 removed volume file /tmp/TestDeleteReportsCarryTheReadOnlyState3957363381/001/dir0/2.dat (size=8) I1117 09:42:41.703733 volume_write.go:138 removed volume file /tmp/TestDeleteReportsCarryTheReadOnlyState3957363381/001/dir0/2.idx (size=0) I1117 09:42:41.705075 store.go:1315 DeleteVolume 2 disk_id:0 --- PASS: TestDeleteReportsCarryTheReadOnlyState (0.01s) === RUN TestFullListCarriesNoDepartures --- PASS: TestFullListCarriesNoDepartures (0.01s) === RUN TestMovedVolumeIsNotADeparture --- PASS: TestMovedVolumeIsNotADeparture (0.01s) === RUN TestDepartureNamesTheVolumeAsItIsNow --- PASS: TestDepartureNamesTheVolumeAsItIsNow (0.01s) === RUN TestOverlappingHeartbeatsNameNoDepartures --- PASS: TestOverlappingHeartbeatsNameNoDepartures (0.01s) === RUN TestDepartureCarriesTheVolumeIdentity --- PASS: TestDepartureCarriesTheVolumeIdentity (0.01s) === RUN TestVidStampWrittenOnBoundIncrease --- PASS: TestVidStampWrittenOnBoundIncrease (0.00s) === RUN TestVidStampSurvivesRestart --- PASS: TestVidStampSurvivesRestart (0.01s) === RUN TestVidStampMonotonic --- PASS: TestVidStampMonotonic (0.00s) === RUN TestVidStampBootstrapFromVolumes I1117 09:42:41.774875 store.go:431 In dir /tmp/TestVidStampBootstrapFromVolumes458011054/001 (disk ID 0) adds volume:17 collection: replicaPlacement:000 ttl: I1117 09:42:41.776675 store.go:436 add volume 17 on disk ID 0 --- PASS: TestVidStampBootstrapFromVolumes (0.01s) === RUN TestMountingAVolumeStartsNoBatchWorker --- PASS: TestMountingAVolumeStartsNoBatchWorker (0.00s) === RUN TestDurableWriteStartsTheBatchWorkerOnce --- PASS: TestDurableWriteStartsTheBatchWorkerOnce (0.01s) === RUN TestDurableWriteAfterDestroyWritesInline I1117 09:42:41.799460 volume_write.go:138 removed volume file /tmp/TestDurableWriteAfterDestroyWritesInline1929846386/001/1.dat (size=816) I1117 09:42:41.799660 volume_write.go:138 removed volume file /tmp/TestDurableWriteAfterDestroyWritesInline1929846386/001/1.idx (size=16) --- PASS: TestDurableWriteAfterDestroyWritesInline (0.01s) === RUN TestBinarySearch --- PASS: TestBinarySearch (0.00s) === RUN TestResumeByLastEntry --- PASS: TestResumeByLastEntry (0.05s) === RUN TestDatSizeCoveredByIndex --- PASS: TestDatSizeCoveredByIndex (0.00s) === RUN TestDatSizeCoveredByIndexKeySorted --- PASS: TestDatSizeCoveredByIndexKeySorted (0.00s) === RUN TestVolumeLoadRepairsUnindexedDatTail === RUN TestVolumeLoadRepairsUnindexedDatTail/one_complete_unindexed_needle_is_re-indexed W1117 09:42:41.877485 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTailone_complete_unindexed_nee325484581/001/1.dat: re-indexed 1 needle(s), cut 0 bytes (2880 -> 2880 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/two_complete_unindexed_needles_are_re-indexed W1117 09:42:41.890298 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTailtwo_complete_unindexed_nee3729721921/001/1.dat: re-indexed 2 needle(s), cut 0 bytes (2664 -> 2664 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_delete_is_re-indexed_as_an_empty_live_needle W1117 09:42:41.900913 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTailan_unindexed_delete_is_re-2968018590/001/1.dat: re-indexed 1 needle(s), cut 0 bytes (1464 -> 1464 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_empty_write_of_a_live_id_stays_an_empty_needle W1117 09:42:41.912165 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTailan_unindexed_empty_write_o4086362851/001/1.dat: re-indexed 1 needle(s), cut 0 bytes (2152 -> 2152 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/a_partial_header_is_cut W1117 09:42:41.922639 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTaila_partial_header_is_cut3879519662/001/1.dat: re-indexed 0 needle(s), cut 7 bytes (1239 -> 1232 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/a_partial_body_is_cut W1117 09:42:41.932611 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTaila_partial_body_is_cut1021791888/001/1.dat: re-indexed 0 needle(s), cut 92 bytes (1852 -> 1760 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/a_complete_needle_is_re-indexed_and_the_partial_one_after_it_cut W1117 09:42:41.942853 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTaila_complete_needle_is_re-in797434626/001/1.dat: re-indexed 1 needle(s), cut 392 bytes (2752 -> 2360 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/a_last_needle_with_a_bad_CRC_is_cut W1117 09:42:41.953564 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTaila_last_needle_with_a_bad_C2296657928/001/1.dat: re-indexed 0 needle(s), cut 720 bytes (2496 -> 1776 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/a_last_needle_whose_data_size_field_reads_0_is_cut W1117 09:42:41.963676 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTaila_last_needle_whose_data_s3785123238/001/1.dat: re-indexed 0 needle(s), cut 400 bytes (1456 -> 1056 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_empty_write_of_a_new_id_stays_an_empty_needle W1117 09:42:41.972904 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTailan_unindexed_empty_write_o3657952574/001/1.dat: re-indexed 1 needle(s), cut 0 bytes (1640 -> 1640 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_empty_write_after_a_delete_of_the_same_id_stays_an_empty_needle W1117 09:42:41.982214 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTailan_unindexed_empty_write_a2043952850/001/1.dat: re-indexed 1 needle(s), cut 0 bytes (792 -> 792 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_write_and_delete_of_the_same_id_are_re-indexed_in_order W1117 09:42:41.990722 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTailan_unindexed_write_and_del860431882/001/1.dat: re-indexed 2 needle(s), cut 0 bytes (2136 -> 2136 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_empty_write_and_its_delete_are_re-indexed_in_order W1117 09:42:41.999070 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTailan_unindexed_empty_write_a501201568/001/1.dat: re-indexed 2 needle(s), cut 0 bytes (944 -> 944 bytes) === RUN TestVolumeLoadRepairsUnindexedDatTail/a_partial_needle_after_an_indexed_tombstone_is_cut W1117 09:42:42.007671 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsUnindexedDatTaila_partial_needle_after_an_86563939/001/1.dat: re-indexed 0 needle(s), cut 308 bytes (1556 -> 1248 bytes) --- PASS: TestVolumeLoadRepairsUnindexedDatTail (0.14s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/one_complete_unindexed_needle_is_re-indexed (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/two_complete_unindexed_needles_are_re-indexed (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_delete_is_re-indexed_as_an_empty_live_needle (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_empty_write_of_a_live_id_stays_an_empty_needle (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/a_partial_header_is_cut (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/a_partial_body_is_cut (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/a_complete_needle_is_re-indexed_and_the_partial_one_after_it_cut (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/a_last_needle_with_a_bad_CRC_is_cut (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/a_last_needle_whose_data_size_field_reads_0_is_cut (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_empty_write_of_a_new_id_stays_an_empty_needle (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_empty_write_after_a_delete_of_the_same_id_stays_an_empty_needle (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_write_and_delete_of_the_same_id_are_re-indexed_in_order (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/an_unindexed_empty_write_and_its_delete_are_re-indexed_in_order (0.01s) --- PASS: TestVolumeLoadRepairsUnindexedDatTail/a_partial_needle_after_an_indexed_tombstone_is_cut (0.01s) === RUN TestVolumeLoadRepairsTailPastEmptyIndex === RUN TestVolumeLoadRepairsTailPastEmptyIndex/the_only_write_is_re-indexed W1117 09:42:42.018309 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsTailPastEmptyIndexthe_only_write_is_re-ind720104122/001/1.dat: re-indexed 1 needle(s), cut 0 bytes (928 -> 928 bytes) === RUN TestVolumeLoadRepairsTailPastEmptyIndex/every_write_is_re-indexed W1117 09:42:42.026408 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsTailPastEmptyIndexevery_write_is_re-indexe2101946503/001/1.dat: re-indexed 3 needle(s), cut 0 bytes (1704 -> 1704 bytes) === RUN TestVolumeLoadRepairsTailPastEmptyIndex/an_unindexed_delete_is_re-indexed_as_an_empty_live_needle W1117 09:42:42.034159 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsTailPastEmptyIndexan_unindexed_delete_is_r2846650661/001/1.dat: re-indexed 4 needle(s), cut 0 bytes (1112 -> 1112 bytes) === RUN TestVolumeLoadRepairsTailPastEmptyIndex/a_complete_needle_is_re-indexed_and_the_partial_one_after_it_cut W1117 09:42:42.041414 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsTailPastEmptyIndexa_complete_needle_is_re-1853055698/001/1.dat: re-indexed 1 needle(s), cut 220 bytes (332 -> 112 bytes) === RUN TestVolumeLoadRepairsTailPastEmptyIndex/a_last_needle_with_a_bad_CRC_is_cut W1117 09:42:42.058286 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsTailPastEmptyIndexa_last_needle_with_a_bad1622300439/001/1.dat: re-indexed 1 needle(s), cut 56 bytes (1032 -> 976 bytes) --- PASS: TestVolumeLoadRepairsTailPastEmptyIndex (0.05s) --- PASS: TestVolumeLoadRepairsTailPastEmptyIndex/the_only_write_is_re-indexed (0.01s) --- PASS: TestVolumeLoadRepairsTailPastEmptyIndex/every_write_is_re-indexed (0.01s) --- PASS: TestVolumeLoadRepairsTailPastEmptyIndex/an_unindexed_delete_is_re-indexed_as_an_empty_live_needle (0.01s) --- PASS: TestVolumeLoadRepairsTailPastEmptyIndex/a_complete_needle_is_re-indexed_and_the_partial_one_after_it_cut (0.01s) --- PASS: TestVolumeLoadRepairsTailPastEmptyIndex/a_last_needle_with_a_bad_CRC_is_cut (0.01s) === RUN TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnly === RUN TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnly/zero_bytes_where_the_first_record_would_be_(id_0) I1117 09:42:42.072165 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlyzero_by834274873/001/1.idx: repair unindexed .dat tail: record at 1472 has id 0 size 0: not a torn tail I1117 09:42:42.072540 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlyzero_by834274873/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlyzero_by834274873/001/1.idx I1117 09:42:42.094561 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlyzero_by834274873/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlyzero_by834274873/001/1.idx === RUN TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnly/a_damaged_record_more_data_follows I1117 09:42:42.103850 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlya_damag4285364702/001/1.idx: repair unindexed .dat tail: record 1 at 8 is damaged and 680 bytes follow it: invalid CRC for needle 1 (got 2b8c0b91, want d831d71b), data on disk corrupted: needle data corrupted: not a torn tail I1117 09:42:42.104172 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlya_damag4285364702/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlya_damag4285364702/001/1.idx I1117 09:42:42.117295 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlya_damag4285364702/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnlya_damag4285364702/001/1.idx --- PASS: TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnly (0.05s) --- PASS: TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnly/zero_bytes_where_the_first_record_would_be_(id_0) (0.03s) --- PASS: TestVolumeLoadKeepsUnexplainedTailPastEmptyIndexReadOnly/a_damaged_record_more_data_follows (0.02s) === RUN TestVolumeLoadKeepsUnexplainedTailReadOnly === RUN TestVolumeLoadKeepsUnexplainedTailReadOnly/the_last_indexed_needle's_id_differs_from_its_entry W1117 09:42:42.126865 volume_checking.go:203 volume 1: unindexed .dat tail not repaired: needle at 752 is id ff, its index entry says id 3: not a torn tail W1117 09:42:42.127274 volume_checking.go:773 data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1002619622/001/1.dat actual 1424 bytes expected 1192 bytes! I1117 09:42:42.127994 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1002619622/001/1.idx failed: data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1002619622/001/1.dat actual 1424 bytes expected 1192 bytes I1117 09:42:42.128379 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1002619622/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1002619622/001/1.idx I1117 09:42:42.141621 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1002619622/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1002619622/001/1.idx === RUN TestVolumeLoadKeepsUnexplainedTailReadOnly/the_last_indexed_needle_fails_its_CRC W1117 09:42:42.150166 volume_checking.go:203 volume 1: unindexed .dat tail not repaired: last indexed needle 3 at 1608: invalid CRC for needle 3 (got b335d03b, want a12a0575), data on disk corrupted: needle data corrupted: not a torn tail W1117 09:42:42.150456 volume_checking.go:773 data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1991034352/001/1.dat actual 3112 bytes expected 2656 bytes! I1117 09:42:42.150929 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1991034352/001/1.idx failed: data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1991034352/001/1.dat actual 3112 bytes expected 2656 bytes I1117 09:42:42.151198 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1991034352/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1991034352/001/1.idx I1117 09:42:42.163803 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1991034352/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_last_indexed_need1991034352/001/1.idx === RUN TestVolumeLoadKeepsUnexplainedTailReadOnly/a_zeroed_data_size_field_followed_by_more_data W1117 09:42:42.172104 volume_checking.go:203 volume 1: unindexed .dat tail not repaired: record 4 at 2320 is damaged and 984 bytes follow it: needle 4 at 2320 has size 781 but no data: needle data corrupted: not a torn tail W1117 09:42:42.172369 volume_checking.go:773 data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_zeroed_data_size_fi1922789929/001/1.dat actual 4120 bytes expected 2320 bytes! I1117 09:42:42.172867 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_zeroed_data_size_fi1922789929/001/1.idx failed: data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_zeroed_data_size_fi1922789929/001/1.dat actual 4120 bytes expected 2320 bytes I1117 09:42:42.173145 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_zeroed_data_size_fi1922789929/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_zeroed_data_size_fi1922789929/001/1.idx I1117 09:42:42.185808 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_zeroed_data_size_fi1922789929/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_zeroed_data_size_fi1922789929/001/1.idx === RUN TestVolumeLoadKeepsUnexplainedTailReadOnly/a_bad_CRC_followed_by_more_data W1117 09:42:42.194584 volume_checking.go:203 volume 1: unindexed .dat tail not repaired: record 4 at 1376 is damaged and 328 bytes follow it: invalid CRC for needle 4 (got cc7da2a9, want 5c4ab626), data on disk corrupted: needle data corrupted: not a torn tail W1117 09:42:42.194918 volume_checking.go:773 data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_bad_CRC_followed_by1325035906/001/1.dat actual 2000 bytes expected 1376 bytes! I1117 09:42:42.195464 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_bad_CRC_followed_by1325035906/001/1.idx failed: data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_bad_CRC_followed_by1325035906/001/1.dat actual 2000 bytes expected 1376 bytes I1117 09:42:42.195779 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_bad_CRC_followed_by1325035906/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_bad_CRC_followed_by1325035906/001/1.idx I1117 09:42:42.200564 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_bad_CRC_followed_by1325035906/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlya_bad_CRC_followed_by1325035906/001/1.idx === RUN TestVolumeLoadKeepsUnexplainedTailReadOnly/zero_bytes_past_the_last_needle_(id_0) W1117 09:42:42.207379 volume_checking.go:203 volume 1: unindexed .dat tail not repaired: record at 1568 has id 0 size 0: not a torn tail W1117 09:42:42.207640 volume_checking.go:773 data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlyzero_bytes_past_the_l2758548994/001/1.dat actual 1632 bytes expected 1568 bytes! I1117 09:42:42.208129 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlyzero_bytes_past_the_l2758548994/001/1.idx failed: data file /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlyzero_bytes_past_the_l2758548994/001/1.dat actual 1632 bytes expected 1568 bytes I1117 09:42:42.208386 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlyzero_bytes_past_the_l2758548994/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlyzero_bytes_past_the_l2758548994/001/1.idx I1117 09:42:42.212096 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlyzero_bytes_past_the_l2758548994/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlyzero_bytes_past_the_l2758548994/001/1.idx === RUN TestVolumeLoadKeepsUnexplainedTailReadOnly/the_index_ends_past_the_data I1117 09:42:42.220748 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_index_ends_past_t4150751758/001/1.idx failed: EOF I1117 09:42:42.221054 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_index_ends_past_t4150751758/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_index_ends_past_t4150751758/001/1.idx I1117 09:42:42.235895 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_index_ends_past_t4150751758/001/1.sdx from /tmp/TestVolumeLoadKeepsUnexplainedTailReadOnlythe_index_ends_past_t4150751758/001/1.idx I1117 09:42:42.237087 volume_loading.go:444 volume 1: idx references end=1968 but .dat is 1960 bytes; marking readonly --- PASS: TestVolumeLoadKeepsUnexplainedTailReadOnly (0.12s) --- PASS: TestVolumeLoadKeepsUnexplainedTailReadOnly/the_last_indexed_needle's_id_differs_from_its_entry (0.02s) --- PASS: TestVolumeLoadKeepsUnexplainedTailReadOnly/the_last_indexed_needle_fails_its_CRC (0.02s) --- PASS: TestVolumeLoadKeepsUnexplainedTailReadOnly/a_zeroed_data_size_field_followed_by_more_data (0.02s) --- PASS: TestVolumeLoadKeepsUnexplainedTailReadOnly/a_bad_CRC_followed_by_more_data (0.01s) --- PASS: TestVolumeLoadKeepsUnexplainedTailReadOnly/zero_bytes_past_the_last_needle_(id_0) (0.01s) --- PASS: TestVolumeLoadKeepsUnexplainedTailReadOnly/the_index_ends_past_the_data (0.02s) === RUN TestVolumeLoadLeavesCleanVolumeUntouched --- PASS: TestVolumeLoadLeavesCleanVolumeUntouched (0.01s) === RUN TestVolumeLoadLeavesReadOnlyVolumeTailAlone I1117 09:42:42.253083 volume_loading.go:312 open to read file /tmp/TestVolumeLoadLeavesReadOnlyVolumeTailAlone750788984/001/1.idx W1117 09:42:42.253637 volume_checking.go:773 data file /tmp/TestVolumeLoadLeavesReadOnlyVolumeTailAlone750788984/001/1.dat actual 1352 bytes expected 1056 bytes! I1117 09:42:42.254176 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestVolumeLoadLeavesReadOnlyVolumeTailAlone750788984/001/1.idx failed: data file /tmp/TestVolumeLoadLeavesReadOnlyVolumeTailAlone750788984/001/1.dat actual 1352 bytes expected 1056 bytes I1117 09:42:42.254457 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadLeavesReadOnlyVolumeTailAlone750788984/001/1.sdx from /tmp/TestVolumeLoadLeavesReadOnlyVolumeTailAlone750788984/001/1.idx I1117 09:42:42.274243 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadLeavesReadOnlyVolumeTailAlone750788984/001/1.sdx from /tmp/TestVolumeLoadLeavesReadOnlyVolumeTailAlone750788984/001/1.idx --- PASS: TestVolumeLoadLeavesReadOnlyVolumeTailAlone (0.03s) === RUN TestVolumeLoadRepairsTailOnCanDeleteVolume W1117 09:42:42.289141 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadRepairsTailOnCanDeleteVolume3708891525/001/1.dat: re-indexed 1 needle(s), cut 0 bytes (920 -> 920 bytes) I1117 09:42:42.289648 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadRepairsTailOnCanDeleteVolume3708891525/001/1.sdx from /tmp/TestVolumeLoadRepairsTailOnCanDeleteVolume3708891525/001/1.idx I1117 09:42:42.306356 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadRepairsTailOnCanDeleteVolume3708891525/001/1.sdx from /tmp/TestVolumeLoadRepairsTailOnCanDeleteVolume3708891525/001/1.idx --- PASS: TestVolumeLoadRepairsTailOnCanDeleteVolume (0.03s) === RUN TestVolumeLoadCutsDamagedSmallSizeTailOnCanDeleteVolume W1117 09:42:42.316579 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestVolumeLoadCutsDamagedSmallSizeTailOnCanDeleteVolume1950570612/001/1.dat: re-indexed 1 needle(s), cut 32 bytes (1224 -> 1192 bytes) I1117 09:42:42.317076 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadCutsDamagedSmallSizeTailOnCanDeleteVolume1950570612/001/1.sdx from /tmp/TestVolumeLoadCutsDamagedSmallSizeTailOnCanDeleteVolume1950570612/001/1.idx I1117 09:42:42.330873 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadCutsDamagedSmallSizeTailOnCanDeleteVolume1950570612/001/1.sdx from /tmp/TestVolumeLoadCutsDamagedSmallSizeTailOnCanDeleteVolume1950570612/001/1.idx --- PASS: TestVolumeLoadCutsDamagedSmallSizeTailOnCanDeleteVolume (0.02s) === RUN TestVolumeLoadLeavesPartialIdxEntryAlone I1117 09:42:42.338899 volume_loading.go:331 volumeDataIntegrityChecking failed verifyIndexFileIntegrity /tmp/TestVolumeLoadLeavesPartialIdxEntryAlone787357837/001/1.idx failed: index file's size is 40 bytes, maybe corrupted I1117 09:42:42.339174 needle_map_sorted_file.go:40 Start to Generate /tmp/TestVolumeLoadLeavesPartialIdxEntryAlone787357837/001/1.sdx from /tmp/TestVolumeLoadLeavesPartialIdxEntryAlone787357837/001/1.idx I1117 09:42:42.352890 needle_map_sorted_file.go:42 Finished Generating /tmp/TestVolumeLoadLeavesPartialIdxEntryAlone787357837/001/1.sdx from /tmp/TestVolumeLoadLeavesPartialIdxEntryAlone787357837/001/1.idx I1117 09:42:42.353588 volume_loading.go:358 loading sorted db /tmp/TestVolumeLoadLeavesPartialIdxEntryAlone787357837/001/1.sdx error: unexpected file /tmp/TestVolumeLoadLeavesPartialIdxEntryAlone787357837/001/1.idx size: 40 volume_checking_tail_repair_test.go:653: partial .idx: volume not loaded: unexpected file /tmp/TestVolumeLoadLeavesPartialIdxEntryAlone787357837/001/1.idx size: 40 --- PASS: TestVolumeLoadLeavesPartialIdxEntryAlone (0.02s) === RUN TestWalkUnindexedDatTailKeepsRecordOnReadError E1117 09:42:42.359906 needle_read.go:55 /tmp/TestWalkUnindexedDatTailKeepsRecordOnReadError2476375342/001/1.dat read 0 dataSize 1032 offset 2456 fileSize 3488: input/output error --- PASS: TestWalkUnindexedDatTailKeepsRecordOnReadError (0.01s) === RUN TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair I1117 09:42:42.367228 volume_loading.go:312 open to read file /tmp/TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair2025210850/001/1.idx W1117 09:42:42.367675 volume_checking.go:773 data file /tmp/TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair2025210850/001/1.dat actual 2784 bytes expected 2288 bytes! I1117 09:42:42.368192 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair2025210850/001/1.idx failed: data file /tmp/TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair2025210850/001/1.dat actual 2784 bytes expected 2288 bytes I1117 09:42:42.368442 needle_map_sorted_file.go:40 Start to Generate /tmp/TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair2025210850/001/1.sdx from /tmp/TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair2025210850/001/1.idx I1117 09:42:42.381160 needle_map_sorted_file.go:42 Finished Generating /tmp/TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair2025210850/001/1.sdx from /tmp/TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair2025210850/001/1.idx --- PASS: TestCheckVolumeDataIntegrityFailsOnUnsyncedRepair (0.02s) === RUN TestAppendIndexEntriesRemovesPartialWrite --- PASS: TestAppendIndexEntriesRemovesPartialWrite (0.00s) === RUN TestScrubVolumeData === RUN TestScrubVolumeData/healthy_volume === RUN TestScrubVolumeData/zero-size_volume_without_index === RUN TestScrubVolumeData/zero-size_volume_with_index E1117 09:42:42.418837 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 75688 offset 8 fileSize 8: EOF E1117 09:42:42.419505 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 4448 offset 75696 fileSize 8: EOF E1117 09:42:42.419978 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 83640 offset 80144 fileSize 8: EOF E1117 09:42:42.420365 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 65472 offset 163784 fileSize 8: EOF E1117 09:42:42.420801 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 79928 offset 229256 fileSize 8: EOF E1117 09:42:42.421321 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 86696 offset 309184 fileSize 8: EOF E1117 09:42:42.421643 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32984 offset 395880 fileSize 8: EOF E1117 09:42:42.422041 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 74648 offset 428864 fileSize 8: EOF E1117 09:42:42.422404 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 60400 offset 503512 fileSize 8: EOF E1117 09:42:42.422607 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 12328 offset 563912 fileSize 8: EOF E1117 09:42:42.423048 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 81992 offset 576240 fileSize 8: EOF E1117 09:42:42.423394 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 46544 offset 658232 fileSize 8: EOF E1117 09:42:42.423805 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 88080 offset 704776 fileSize 8: EOF E1117 09:42:42.424024 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 5512 offset 792856 fileSize 8: EOF E1117 09:42:42.424419 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 81648 offset 798368 fileSize 8: EOF E1117 09:42:42.424729 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 33200 offset 880016 fileSize 8: EOF E1117 09:42:42.425054 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 29320 offset 913216 fileSize 8: EOF E1117 09:42:42.425270 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942536 fileSize 8: EOF E1117 09:42:42.425479 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942568 fileSize 8: EOF E1117 09:42:42.425671 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942600 fileSize 8: EOF E1117 09:42:42.425862 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942632 fileSize 8: EOF E1117 09:42:42.426052 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942664 fileSize 8: EOF E1117 09:42:42.426241 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942696 fileSize 8: EOF E1117 09:42:42.426438 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942728 fileSize 8: EOF E1117 09:42:42.426630 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942760 fileSize 8: EOF E1117 09:42:42.426824 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942792 fileSize 8: EOF E1117 09:42:42.427016 needle_read.go:55 ./test_files/empty_volume.dat read 0 dataSize 32 offset 942824 fileSize 8: EOF === RUN TestScrubVolumeData/volume_without_index === RUN TestScrubVolumeData/bitrot_volume --- PASS: TestScrubVolumeData (0.08s) --- PASS: TestScrubVolumeData/healthy_volume (0.03s) --- PASS: TestScrubVolumeData/zero-size_volume_without_index (0.00s) --- PASS: TestScrubVolumeData/zero-size_volume_with_index (0.01s) --- PASS: TestScrubVolumeData/volume_without_index (0.00s) --- PASS: TestScrubVolumeData/bitrot_volume (0.04s) === RUN TestScrubVolumeData_IgnoresOffset0Tombstone --- PASS: TestScrubVolumeData_IgnoresOffset0Tombstone (0.00s) === RUN TestScrubVolumeDataChecksLocalDeletionTombstone --- PASS: TestScrubVolumeDataChecksLocalDeletionTombstone (0.01s) === RUN TestScrubVolumeDataChecksLiveNeedleId --- PASS: TestScrubVolumeDataChecksLiveNeedleId (0.00s) === RUN TestScrubVolumeDataReportsTruncatedLocalDeletionTombstone E1117 09:42:42.488567 needle_read.go:55 /tmp/TestScrubVolumeDataReportsTruncatedLocalDeletionTombstone1720115127/001/1.dat read 16 dataSize 32 offset 144 fileSize 160: EOF --- PASS: TestScrubVolumeDataReportsTruncatedLocalDeletionTombstone (0.00s) === RUN TestCheckVolumeDataIntegrityWithDeletionTombstone --- PASS: TestCheckVolumeDataIntegrityWithDeletionTombstone (0.00s) === RUN TestCheckVolumeDataIntegritySortedIndex --- PASS: TestCheckVolumeDataIntegritySortedIndex (0.01s) === RUN TestCheckVolumeDataIntegrityVerifiesDeletionTail W1117 09:42:42.504115 volume_checking.go:812 data file /tmp/TestCheckVolumeDataIntegrityVerifiesDeletionTail47286446/001/1.dat actual 1928 bytes expected 1864 bytes! W1117 09:42:42.505565 volume_checking.go:203 volume 1: unindexed .dat tail not repaired: record at 1864 has id 0 size 0: not a torn tail W1117 09:42:42.505855 volume_checking.go:812 data file /tmp/TestCheckVolumeDataIntegrityVerifiesDeletionTail47286446/001/1.dat actual 1928 bytes expected 1864 bytes! --- PASS: TestCheckVolumeDataIntegrityVerifiesDeletionTail (0.01s) === RUN TestVolumeLoadStaysWritableWithKeySortedIndex --- PASS: TestVolumeLoadStaysWritableWithKeySortedIndex (0.01s) === RUN TestMaxNeedleEnd --- PASS: TestMaxNeedleEnd (0.00s) === RUN TestDestroyKeepsVifWhenEcCoexists I1117 09:42:42.524605 volume_write.go:138 removed volume file /tmp/TestDestroyKeepsVifWhenEcCoexists1711532897/001/1.dat (size=728) I1117 09:42:42.524825 volume_write.go:138 removed volume file /tmp/TestDestroyKeepsVifWhenEcCoexists1711532897/001/1.idx (size=16) --- PASS: TestDestroyKeepsVifWhenEcCoexists (0.01s) === RUN TestDestroyRemovesVifWhenNoEc I1117 09:42:42.531471 volume_write.go:138 removed volume file /tmp/TestDestroyRemovesVifWhenNoEc2759757609/001/1.dat (size=440) I1117 09:42:42.531651 volume_write.go:138 removed volume file /tmp/TestDestroyRemovesVifWhenNoEc2759757609/001/1.idx (size=16) --- PASS: TestDestroyRemovesVifWhenNoEc (0.01s) === RUN TestLoad_MovedIdxDirectory_RebuildsIdx I1117 09:42:42.542179 volume_loading.go:292 volume 1: rebuilt /tmp/TestLoad_MovedIdxDirectory_RebuildsIdx2298695274/001/idxB/1.idx from /tmp/TestLoad_MovedIdxDirectory_RebuildsIdx2298695274/001/data/1.dat --- PASS: TestLoad_MovedIdxDirectory_RebuildsIdx (0.01s) === RUN TestRebuildIdx_StopsAtZeroPaddedDatTail I1117 09:42:42.549798 volume_loading.go:292 volume 1: rebuilt /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.idx from /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.dat W1117 09:42:42.550767 volume_checking.go:203 volume 1: unindexed .dat tail not repaired: record at 544 has id 0 size 0: not a torn tail W1117 09:42:42.551071 volume_checking.go:773 data file /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.dat actual 4640 bytes expected 544 bytes! I1117 09:42:42.551664 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.idx failed: data file /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.dat actual 4640 bytes expected 544 bytes I1117 09:42:42.551948 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.sdx from /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.idx I1117 09:42:42.564683 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.sdx from /tmp/TestRebuildIdx_StopsAtZeroPaddedDatTail2434213134/001/1.idx --- PASS: TestRebuildIdx_StopsAtZeroPaddedDatTail (0.02s) === RUN TestRebuildIdx_SkipsTruncatedDatTail I1117 09:42:42.572081 volume_loading.go:292 volume 1: rebuilt /tmp/TestRebuildIdx_SkipsTruncatedDatTail4279928429/001/1.idx from /tmp/TestRebuildIdx_SkipsTruncatedDatTail4279928429/001/1.dat W1117 09:42:42.572933 volume_checking.go:399 volume 1: repaired the unindexed tail of /tmp/TestRebuildIdx_SkipsTruncatedDatTail4279928429/001/1.dat: re-indexed 0 needle(s), cut 320 bytes (1144 -> 824 bytes) --- PASS: TestRebuildIdx_SkipsTruncatedDatTail (0.01s) === RUN TestRebuildIdx_StopsAtNegativeSizeHeader I1117 09:42:42.579475 volume_loading.go:292 volume 1: rebuilt /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.idx from /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.dat W1117 09:42:42.580370 volume_checking.go:203 volume 1: unindexed .dat tail not repaired: record at 952 has id 2 size -4096: not a torn tail W1117 09:42:42.580599 volume_checking.go:773 data file /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.dat actual 1616 bytes expected 952 bytes! I1117 09:42:42.581150 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.idx failed: data file /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.dat actual 1616 bytes expected 952 bytes I1117 09:42:42.581415 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.sdx from /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.idx I1117 09:42:42.593998 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.sdx from /tmp/TestRebuildIdx_StopsAtNegativeSizeHeader2352819328/001/1.idx --- PASS: TestRebuildIdx_StopsAtNegativeSizeHeader (0.02s) === RUN TestRebuildIdx_UnwritableIdxDirSkipsOnlyThisVolume E1117 09:42:42.601386 volume_loading.go:278 skip volume 1 (idx: /tmp/TestRebuildIdx_UnwritableIdxDirSkipsOnlyThisVolume57698837/001/idx/1.idx): create /tmp/TestRebuildIdx_UnwritableIdxDirSkipsOnlyThisVolume57698837/001/idx/1.idx.tmp: open /tmp/TestRebuildIdx_UnwritableIdxDirSkipsOnlyThisVolume57698837/001/idx/1.idx.tmp: permission denied --- PASS: TestRebuildIdx_UnwritableIdxDirSkipsOnlyThisVolume (0.01s) === RUN TestRepairIdxHeadTombstones_RestoresClobberedRows I1117 09:42:42.609868 volume_idx_repair.go:65 volume 1: /tmp/TestRepairIdxHeadTombstones_RestoresClobberedRows2934788401/001/1.idx starts with 4 offset-0 tombstones, recovering the .idx rows they overwrote from /tmp/TestRepairIdxHeadTombstones_RestoresClobberedRows2934788401/001/1.dat I1117 09:42:42.612837 volume_loading.go:303 volume 1: recovered 4 overwritten /tmp/TestRepairIdxHeadTombstones_RestoresClobberedRows2934788401/001/1.idx rows from /tmp/TestRepairIdxHeadTombstones_RestoresClobberedRows2934788401/001/1.dat --- PASS: TestRepairIdxHeadTombstones_RestoresClobberedRows (0.01s) === RUN TestRepairIdxHeadTombstones_ReadOnlyVolume I1117 09:42:42.624581 volume_idx_repair.go:65 volume 1: /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.idx starts with 2 offset-0 tombstones, recovering the .idx rows they overwrote from /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.dat I1117 09:42:42.625845 volume_loading.go:303 volume 1: recovered 2 overwritten /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.idx rows from /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.dat I1117 09:42:42.626438 volume_loading.go:312 open to read file /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.idx I1117 09:42:42.626823 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.sdx from /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.idx I1117 09:42:42.640513 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.sdx from /tmp/TestRepairIdxHeadTombstones_ReadOnlyVolume2671852128/001/1.idx --- PASS: TestRepairIdxHeadTombstones_ReadOnlyVolume (0.02s) === RUN TestRepairIdxHeadTombstones_LeavesHealthyIdxAlone --- PASS: TestRepairIdxHeadTombstones_LeavesHealthyIdxAlone (0.01s) === RUN TestRepairIdxHeadTombstones_KeepsDeletedNeedlesDeleted I1117 09:42:42.660898 volume_idx_repair.go:65 volume 1: /tmp/TestRepairIdxHeadTombstones_KeepsDeletedNeedlesDeleted2361434624/001/1.idx starts with 2 offset-0 tombstones, recovering the .idx rows they overwrote from /tmp/TestRepairIdxHeadTombstones_KeepsDeletedNeedlesDeleted2361434624/001/1.dat I1117 09:42:42.662299 volume_loading.go:303 volume 1: recovered 1 overwritten /tmp/TestRepairIdxHeadTombstones_KeepsDeletedNeedlesDeleted2361434624/001/1.idx rows from /tmp/TestRepairIdxHeadTombstones_KeepsDeletedNeedlesDeleted2361434624/001/1.dat --- PASS: TestRepairIdxHeadTombstones_KeepsDeletedNeedlesDeleted (0.01s) === RUN TestStaleIndexEntry_HealsOnWrite E1117 09:42:42.670656 needle_read.go:55 /tmp/TestStaleIndexEntry_HealsOnWrite1048148651/001/1.dat read 0 dataSize 144 offset 34359739408 fileSize 3864: EOF I1117 09:42:42.672085 volume_read.go:442 volume 1 index entry for needle 9 resolves to needle 2; reporting not-found E1117 09:42:42.673314 needle_read.go:55 /tmp/TestStaleIndexEntry_HealsOnWrite1048148651/001/1.dat read 0 dataSize 144 offset 34359739408 fileSize 3864: EOF I1117 09:42:42.673666 volume_write.go:34 Failed to check updated file at offset 1040 size 108: EOF I1117 09:42:42.674320 volume_write.go:380 volume 1 index entry for 1,090000abcd resolves to 1,0200000000; overwriting stale index entry --- PASS: TestStaleIndexEntry_HealsOnWrite (0.01s) === RUN TestStaleIndexEntry_SurvivesFailedWrite E1117 09:42:42.682626 needle_read.go:55 /tmp/TestStaleIndexEntry_SurvivesFailedWrite610901014/001/1.dat read 0 dataSize 48 offset 34359738376 fileSize 56: EOF I1117 09:42:42.682929 volume_write.go:34 Failed to check updated file at offset 8 size 14: EOF I1117 09:42:42.683291 volume_write.go:380 volume 1 index entry for 1,0900000000 resolves to 1,0200000000; overwriting stale index entry --- PASS: TestStaleIndexEntry_SurvivesFailedWrite (0.01s) === RUN TestStaleIndexEntry_KeepsCookieConflictForSameKey I1117 09:42:42.691738 volume_write.go:389 write cookie mismatch: existing 1,0200000000, new 1,020000abcd --- PASS: TestStaleIndexEntry_KeepsCookieConflictForSameKey (0.01s) === RUN TestVolumeInfoCountsDoNotWrap === RUN TestVolumeInfoCountsDoNotWrap/an_ordinary_count === RUN TestVolumeInfoCountsDoNotWrap/the_ceiling === RUN TestVolumeInfoCountsDoNotWrap/past_the_ceiling === RUN TestVolumeInfoCountsDoNotWrap/far_past_it --- PASS: TestVolumeInfoCountsDoNotWrap (0.00s) --- PASS: TestVolumeInfoCountsDoNotWrap/an_ordinary_count (0.00s) --- PASS: TestVolumeInfoCountsDoNotWrap/the_ceiling (0.00s) --- PASS: TestVolumeInfoCountsDoNotWrap/past_the_ceiling (0.00s) --- PASS: TestVolumeInfoCountsDoNotWrap/far_past_it (0.00s) === RUN TestVolumeInfoSurvivesMoreDeletesThanFiles --- PASS: TestVolumeInfoSurvivesMoreDeletesThanFiles (0.00s) === RUN TestRepeatedVolumeStringsAreShared --- PASS: TestRepeatedVolumeStringsAreShared (0.00s) === RUN TestShortVolumeInfoSharesTheSameStrings --- PASS: TestShortVolumeInfoSharesTheSameStrings (0.00s) === RUN TestEmptyVolumeStringsStayEmpty --- PASS: TestEmptyVolumeStringsStayEmpty (0.00s) === RUN TestVolumeStringsStaySharedAcrossCollection --- PASS: TestVolumeStringsStaySharedAcrossCollection (0.12s) === RUN TestInterningIsSafeUnderConcurrentReports --- PASS: TestInterningIsSafeUnderConcurrentReports (0.00s) === RUN TestVolumeInfoHasNoInteriorPadding volume_info_layout_test.go:32: 111 bytes of fields in a 112 byte struct --- PASS: TestVolumeInfoHasNoInteriorPadding (0.00s) === RUN TestSortVolumeInfos --- PASS: TestSortVolumeInfos (0.00s) === RUN TestNewVolumeInfoFromShortKeepsDiskId --- PASS: TestNewVolumeInfoFromShortKeepsDiskId (0.00s) === RUN TestCheckReadWriteErrorTracksConsecutiveEIO --- PASS: TestCheckReadWriteErrorTracksConsecutiveEIO (0.00s) === RUN TestCheckReadWriteErrorNonEIOResetsStreak --- PASS: TestCheckReadWriteErrorNonEIOResetsStreak (0.00s) === RUN TestCheckReadWriteErrorIgnoresPlainError --- PASS: TestCheckReadWriteErrorIgnoresPlainError (0.00s) === RUN TestIoErrorToleranceGate --- PASS: TestIoErrorToleranceGate (0.00s) === RUN TestQuarantineIsSticky --- PASS: TestQuarantineIsSticky (0.00s) === RUN TestReadNeedleBlobTracksEIO E1117 09:42:42.837775 needle_read.go:55 eio read 0 dataSize 32 offset 0 fileSize 0: input/output error --- PASS: TestReadNeedleBlobTracksEIO (0.00s) === RUN TestIoErrorStateIsRaceFree --- PASS: TestIoErrorStateIsRaceFree (0.01s) === RUN TestLoad_CorruptIdx_NoSegfault I1117 09:42:42.859983 volume_loading.go:312 open to read file /tmp/TestLoad_CorruptIdx_NoSegfault953593685/001/1.idx I1117 09:42:42.860610 volume_loading.go:331 volumeDataIntegrityChecking failed verifyIndexFileIntegrity /tmp/TestLoad_CorruptIdx_NoSegfault953593685/001/1.idx failed: index file's size is 15 bytes, maybe corrupted I1117 09:42:42.860917 needle_map_sorted_file.go:40 Start to Generate /tmp/TestLoad_CorruptIdx_NoSegfault953593685/001/1.sdx from /tmp/TestLoad_CorruptIdx_NoSegfault953593685/001/1.idx I1117 09:42:42.864470 needle_map_sorted_file.go:42 Finished Generating /tmp/TestLoad_CorruptIdx_NoSegfault953593685/001/1.sdx from /tmp/TestLoad_CorruptIdx_NoSegfault953593685/001/1.idx I1117 09:42:42.865051 volume_loading.go:358 loading sorted db /tmp/TestLoad_CorruptIdx_NoSegfault953593685/001/1.sdx error: unexpected file /tmp/TestLoad_CorruptIdx_NoSegfault953593685/001/1.idx size: 15 --- PASS: TestLoad_CorruptIdx_NoSegfault (0.01s) === RUN TestLoad_DatOpenFail_NoNilPanic --- PASS: TestLoad_DatOpenFail_NoNilPanic (0.00s) === RUN TestMarkVolumeWritable_ReopensPersistedReadOnly I1117 09:42:42.876857 volume_loading.go:312 open to read file /tmp/TestMarkVolumeWritable_ReopensPersistedReadOnly3443166846/001/1.idx I1117 09:42:42.877295 needle_map_sorted_file.go:40 Start to Generate /tmp/TestMarkVolumeWritable_ReopensPersistedReadOnly3443166846/001/1.sdx from /tmp/TestMarkVolumeWritable_ReopensPersistedReadOnly3443166846/001/1.idx I1117 09:42:42.880713 needle_map_sorted_file.go:42 Finished Generating /tmp/TestMarkVolumeWritable_ReopensPersistedReadOnly3443166846/001/1.sdx from /tmp/TestMarkVolumeWritable_ReopensPersistedReadOnly3443166846/001/1.idx I1117 09:42:42.882229 volume_write.go:424 index needle 2 of volume 1 at offset 896: needle map /tmp/TestMarkVolumeWritable_ReopensPersistedReadOnly3443166846/001/1.sdx is read only: invalid argument --- PASS: TestMarkVolumeWritable_ReopensPersistedReadOnly (0.01s) === RUN TestMarkVolumeWritableOnATieredVolumeKeepsDeletesOnly --- PASS: TestMarkVolumeWritableOnATieredVolumeKeepsDeletesOnly (0.01s) === RUN TestReopenIdxForWrite_NoopWhenAlreadyWritable --- PASS: TestReopenIdxForWrite_NoopWhenAlreadyWritable (0.00s) === RUN TestDeleteOfMissingNeedleCancelsQueuedWrite === RUN TestDeleteOfMissingNeedleCancelsQueuedWrite/fsync=false === RUN TestDeleteOfMissingNeedleCancelsQueuedWrite/fsync=true --- PASS: TestDeleteOfMissingNeedleCancelsQueuedWrite (0.02s) --- PASS: TestDeleteOfMissingNeedleCancelsQueuedWrite/fsync=false (0.01s) --- PASS: TestDeleteOfMissingNeedleCancelsQueuedWrite/fsync=true (0.01s) === RUN TestDeleteCancelsQueuedRewrite --- PASS: TestDeleteCancelsQueuedRewrite (0.01s) === RUN TestWriteAfterDeleteIsNotCancelled --- PASS: TestWriteAfterDeleteIsNotCancelled (0.00s) === RUN TestCancelWithOtherCookieKeepsWrite --- PASS: TestCancelWithOtherCookieKeepsWrite (0.00s) === RUN TestWriteAfterCancelledWriteStaysLive --- PASS: TestWriteAfterCancelledWriteStaysLive (0.01s) === RUN TestTakenBackTombstoneIsSynced === RUN TestTakenBackTombstoneIsSynced/inline=false === RUN TestTakenBackTombstoneIsSynced/inline=true --- PASS: TestTakenBackTombstoneIsSynced (0.01s) --- PASS: TestTakenBackTombstoneIsSynced/inline=false (0.01s) --- PASS: TestTakenBackTombstoneIsSynced/inline=true (0.00s) === RUN TestReadNeedleNilNeedleMap I1117 09:42:42.951617 volume_read.go:69 volume 1: needle map not loaded; read returns not-found I1117 09:42:42.952110 volume_read.go:360 volume 1: needle map not loaded; read returns not-found --- PASS: TestReadNeedleNilNeedleMap (0.00s) === RUN TestReadNeedMetaWithWritesAndUpdates --- PASS: TestReadNeedMetaWithWritesAndUpdates (0.01s) === RUN TestReadNeedMetaWithDeletesThenWrites --- PASS: TestReadNeedMetaWithDeletesThenWrites (0.01s) === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-1/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-1/readBody=true I1117 09:42:42.976912 volume_read.go:630 cannot read needle head [856, 872) body [872, 888) body length 16: needle 63 size -1 out of range for body length 16: needle data corrupted === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-36/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-36/readBody=true === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-43/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-43/readBody=true === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-44/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-44/readBody=true === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-4096/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-4096/readBody=true === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-1/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-1/readBody=true I1117 09:42:42.998332 volume_read.go:630 cannot read needle head [912, 928) body [928, 936) body length 8: needle 63 size -1 out of range for body length 8: needle data corrupted === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-28/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-28/readBody=true === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-35/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-35/readBody=true === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-36/readBody=false === RUN TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-36/readBody=true --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance (0.04s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-1/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-1/readBody=true (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-36/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-36/readBody=true (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-43/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-43/readBody=true (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-44/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-44/readBody=true (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-4096/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v3/size-4096/readBody=true (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-1/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-1/readBody=true (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-28/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-28/readBody=true (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-35/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-35/readBody=true (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-36/readBody=false (0.00s) --- PASS: TestScanVolumeFileFrom_StopsAtRecordThatCannotAdvance/v2/size-36/readBody=true (0.00s) === RUN TestReadNeedleDataIntoChecksumMismatchHoldsLastPage === RUN TestReadNeedleDataIntoChecksumMismatchHoldsLastPage/two_pages === RUN TestReadNeedleDataIntoChecksumMismatchHoldsLastPage/three_pages === RUN TestReadNeedleDataIntoChecksumMismatchHoldsLastPage/one_buffer --- PASS: TestReadNeedleDataIntoChecksumMismatchHoldsLastPage (0.01s) --- PASS: TestReadNeedleDataIntoChecksumMismatchHoldsLastPage/two_pages (0.00s) --- PASS: TestReadNeedleDataIntoChecksumMismatchHoldsLastPage/three_pages (0.00s) --- PASS: TestReadNeedleDataIntoChecksumMismatchHoldsLastPage/one_buffer (0.00s) === RUN TestReadNeedleDataIntoRangeChecksumMismatch --- PASS: TestReadNeedleDataIntoRangeChecksumMismatch (0.03s) === RUN TestReadNeedleDataIntoRangeDamagedAfterCheck --- PASS: TestReadNeedleDataIntoRangeDamagedAfterCheck (0.21s) === RUN TestReadNeedleMustMetaOnly --- PASS: TestReadNeedleMustMetaOnly (0.01s) === RUN TestReadNeedleHasRange --- PASS: TestReadNeedleHasRange (0.01s) === RUN TestReadNeedleDataIntoKeepsTheMetaRecord --- PASS: TestReadNeedleDataIntoKeepsTheMetaRecord (0.01s) === RUN TestReadNeedleDataIntoFollowsACompaction === RUN TestReadNeedleDataIntoFollowsACompaction/legacy_checksum_false I1117 09:42:43.295497 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestReadNeedleDataIntoFollowsACompactionlegacy_checksum_false1488796939/001/1.cpx I1117 09:42:43.297871 volume_vacuum.go:184 Committing volume 1 vacuuming... === RUN TestReadNeedleDataIntoFollowsACompaction/legacy_checksum_true I1117 09:42:43.315940 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestReadNeedleDataIntoFollowsACompactionlegacy_checksum_true3905500232/001/1.cpx I1117 09:42:43.317527 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestReadNeedleDataIntoFollowsACompaction (0.04s) --- PASS: TestReadNeedleDataIntoFollowsACompaction/legacy_checksum_false (0.02s) --- PASS: TestReadNeedleDataIntoFollowsACompaction/legacy_checksum_true (0.02s) === RUN TestReadNeedleDataIntoRefusesAReplacementAfterCompaction I1117 09:42:43.343610 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestReadNeedleDataIntoRefusesAReplacementAfterCompaction669357541/001/1.cpx I1117 09:42:43.345729 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestReadNeedleDataIntoRefusesAReplacementAfterCompaction (0.03s) === RUN TestReadNeedleMetaOnlyVersion1 --- PASS: TestReadNeedleMetaOnlyVersion1 (0.11s) === RUN TestRemoteSuperBlockLogOnlyOnError --- PASS: TestRemoteSuperBlockLogOnlyOnError (0.00s) === RUN TestReadRemoteSuperBlockStallSkipsBackend --- PASS: TestReadRemoteSuperBlockStallSkipsBackend (0.06s) === RUN TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend I1117 09:42:43.575042 volume_tier.go:32 volume 72 is tiered to test_local_dir.default as obj-1794908563568786209-154143 and read only I1117 09:42:43.575297 volume_loading.go:175 loading volume 72 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563568786209-154143" file_size:2728 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 I1117 09:42:43.576901 volume_tier.go:32 volume 70 is tiered to test_local_dir.default as obj-1794908563561521837-154143 and read only I1117 09:42:43.577080 volume_loading.go:175 loading volume 70 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563561521837-154143" file_size:1912 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 E1117 09:42:43.777209 volume_loading.go:481 readSuperBlock remote volume 72: backend test_local_dir.default did not return the super block within 200ms E1117 09:42:43.778165 volume_loading.go:481 readSuperBlock remote volume 70: backend test_local_dir.default did not return the super block within 200ms I1117 09:42:43.778374 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/72.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/72.idx I1117 09:42:43.778737 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/70.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/70.idx I1117 09:42:43.792279 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/70.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/70.idx I1117 09:42:43.792279 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/72.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/72.idx I1117 09:42:43.795230 volume_tier.go:32 volume 69 is tiered to test_local_dir.default as obj-1794908563557858712-154143 and read only I1117 09:42:43.795401 volume_tier.go:32 volume 68 is tiered to test_local_dir.default as obj-1794908563554444781-154143 and read only I1117 09:42:43.795398 volume_loading.go:175 loading volume 69 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563557858712-154143" file_size:2184 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 I1117 09:42:43.795565 volume_loading.go:175 loading volume 68 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563554444781-154143" file_size:2240 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 E1117 09:42:43.796276 volume_loading.go:481 readSuperBlock remote volume 68: backend test_local_dir.default stalled on a super block read, skipped E1117 09:42:43.796264 volume_loading.go:481 readSuperBlock remote volume 69: backend test_local_dir.default stalled on a super block read, skipped I1117 09:42:43.796811 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/68.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/68.idx I1117 09:42:43.796919 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/69.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/69.idx I1117 09:42:43.809841 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/68.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/68.idx I1117 09:42:43.810205 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/69.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/69.idx I1117 09:42:43.812688 volume_tier.go:32 volume 71 is tiered to test_local_dir.default as obj-1794908563565210271-154143 and read only I1117 09:42:43.812770 volume_tier.go:32 volume 66 is tiered to test_local_dir.default as obj-1794908563547814303-154143 and read only I1117 09:42:43.812853 volume_loading.go:175 loading volume 71 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563565210271-154143" file_size:2896 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 I1117 09:42:43.812942 volume_loading.go:175 loading volume 66 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563547814303-154143" file_size:3376 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 E1117 09:42:43.813521 volume_loading.go:481 readSuperBlock remote volume 71: backend test_local_dir.default stalled on a super block read, skipped E1117 09:42:43.813564 volume_loading.go:481 readSuperBlock remote volume 66: backend test_local_dir.default stalled on a super block read, skipped I1117 09:42:43.813977 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/71.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/71.idx I1117 09:42:43.814024 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/66.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/66.idx I1117 09:42:43.826372 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/66.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/66.idx I1117 09:42:43.826976 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/71.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/71.idx I1117 09:42:43.829137 volume_tier.go:32 volume 67 is tiered to test_local_dir.default as obj-1794908563551018610-154143 and read only I1117 09:42:43.829309 volume_tier.go:32 volume 65 is tiered to test_local_dir.default as obj-1794908563544090550-154143 and read only I1117 09:42:43.829305 volume_loading.go:175 loading volume 67 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563551018610-154143" file_size:728 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 I1117 09:42:43.829478 volume_loading.go:175 loading volume 65 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563544090550-154143" file_size:3216 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 E1117 09:42:43.830021 volume_loading.go:481 readSuperBlock remote volume 67: backend test_local_dir.default stalled on a super block read, skipped E1117 09:42:43.830074 volume_loading.go:481 readSuperBlock remote volume 65: backend test_local_dir.default stalled on a super block read, skipped I1117 09:42:43.830510 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/67.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/67.idx I1117 09:42:43.830533 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/65.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/65.idx I1117 09:42:43.834169 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/67.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/67.idx I1117 09:42:43.834873 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/65.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/65.idx I1117 09:42:43.836886 volume_tier.go:32 volume 64 is tiered to test_local_dir.default as obj-1794908563540243230-154143 and read only I1117 09:42:43.837294 volume_tier.go:32 volume 63 is tiered to test_local_dir.default as obj-1794908563536762950-154143 and read only I1117 09:42:43.837045 volume_loading.go:175 loading volume 64 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563540243230-154143" file_size:1272 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 I1117 09:42:43.837451 volume_loading.go:175 loading volume 63 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563536762950-154143" file_size:2816 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 E1117 09:42:43.837751 volume_loading.go:481 readSuperBlock remote volume 64: backend test_local_dir.default stalled on a super block read, skipped E1117 09:42:43.838006 volume_loading.go:481 readSuperBlock remote volume 63: backend test_local_dir.default stalled on a super block read, skipped I1117 09:42:43.838203 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/64.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/64.idx I1117 09:42:43.838443 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/63.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/63.idx I1117 09:42:43.848815 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/64.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/64.idx I1117 09:42:43.850353 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/63.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/63.idx I1117 09:42:43.853266 volume_tier.go:32 volume 62 is tiered to test_local_dir.default as obj-1794908563533147404-154143 and read only I1117 09:42:43.853479 volume_loading.go:175 loading volume 62 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563533147404-154143" file_size:2184 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 I1117 09:42:43.855196 volume_tier.go:32 volume 61 is tiered to test_local_dir.default as obj-1794908563529298994-154143 and read only E1117 09:42:43.855755 volume_loading.go:481 readSuperBlock remote volume 62: backend test_local_dir.default stalled on a super block read, skipped I1117 09:42:43.855438 volume_loading.go:175 loading volume 61 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563529298994-154143" file_size:2512 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 I1117 09:42:43.856396 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/62.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/62.idx E1117 09:42:43.856384 volume_loading.go:481 readSuperBlock remote volume 61: backend test_local_dir.default stalled on a super block read, skipped I1117 09:42:43.857287 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/61.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/61.idx I1117 09:42:43.864135 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/62.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/62.idx I1117 09:42:43.875357 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/61.sdx from /tmp/TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend25135055/002/61.idx --- PASS: TestRemoteTier_DiskScanDoesNotWaitOnStalledBackend (0.36s) === RUN TestRemoteTier_IdxHeadRepairWaitsForReachableBackend I1117 09:42:43.888712 volume_tier.go:32 volume 80 is tiered to test_local_dir.default as obj-1794908563885188570-154143 and read only I1117 09:42:43.888918 volume_loading.go:175 loading volume 80 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563885188570-154143" file_size:3384 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 E1117 09:42:44.090635 volume_loading.go:481 readSuperBlock remote volume 80: backend test_local_dir.default did not return the super block within 200ms I1117 09:42:44.091378 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.sdx from /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.idx I1117 09:42:44.105240 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.sdx from /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.idx I1117 09:42:44.109590 volume_tier.go:32 volume 80 is tiered to test_local_dir.default as obj-1794908563885188570-154143 and read only I1117 09:42:44.109812 volume_loading.go:175 loading volume 80 from remote files:{backend_type:"test_local_dir" backend_id:"default" key:"obj-1794908563885188570-154143" file_size:3384 modified_time:1794908563 extension:".dat"} version:3 bytes_offset:4 I1117 09:42:44.111272 volume_idx_repair.go:65 volume 80: /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.idx starts with 2 offset-0 tombstones, recovering the .idx rows they overwrote from /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.dat I1117 09:42:44.113309 volume_loading.go:303 volume 80: recovered 2 overwritten /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.idx rows from /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.dat I1117 09:42:44.113816 needle_map_sorted_file.go:40 Start to Generate /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.sdx from /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.idx I1117 09:42:44.127988 needle_map_sorted_file.go:42 Finished Generating /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.sdx from /tmp/TestRemoteTier_IdxHeadRepairWaitsForReachableBackend3005437847/002/80.idx --- PASS: TestRemoteTier_IdxHeadRepairWaitsForReachableBackend (0.25s) === RUN TestVifReplicationOutranksSuperBlock --- PASS: TestVifReplicationOutranksSuperBlock (0.01s) === RUN TestEmptyVifReplicationLeavesSuperBlockAlone --- PASS: TestEmptyVifReplicationLeavesSuperBlockAlone (0.00s) === RUN TestAttachRemoteDatFileKeepsACommittedVifEntry --- PASS: TestAttachRemoteDatFileKeepsACommittedVifEntry (0.01s) === RUN TestAttachRemoteDatFileAcceptsAnUnalignedDatTail I1117 09:42:44.159253 volume_loading.go:312 open to read file /tmp/TestAttachRemoteDatFileAcceptsAnUnalignedDatTail1446075440/002/88.idx W1117 09:42:44.159770 volume_checking.go:773 data file /tmp/TestAttachRemoteDatFileAcceptsAnUnalignedDatTail1446075440/002/88.dat actual 1360 bytes expected 1352 bytes! I1117 09:42:44.160506 volume_loading.go:331 volumeDataIntegrityChecking failed CheckVolumeDataIntegrity /tmp/TestAttachRemoteDatFileAcceptsAnUnalignedDatTail1446075440/002/88.idx failed: data file /tmp/TestAttachRemoteDatFileAcceptsAnUnalignedDatTail1446075440/002/88.dat actual 1360 bytes expected 1352 bytes I1117 09:42:44.160799 needle_map_sorted_file.go:40 Start to Generate /tmp/TestAttachRemoteDatFileAcceptsAnUnalignedDatTail1446075440/002/88.sdx from /tmp/TestAttachRemoteDatFileAcceptsAnUnalignedDatTail1446075440/002/88.idx I1117 09:42:44.173499 needle_map_sorted_file.go:42 Finished Generating /tmp/TestAttachRemoteDatFileAcceptsAnUnalignedDatTail1446075440/002/88.sdx from /tmp/TestAttachRemoteDatFileAcceptsAnUnalignedDatTail1446075440/002/88.idx --- PASS: TestAttachRemoteDatFileAcceptsAnUnalignedDatTail (0.02s) === RUN TestMarkTieredDeletable --- PASS: TestMarkTieredDeletable (0.01s) === RUN TestMarkTieredDeletableLeavesANonTieredVolume --- PASS: TestMarkTieredDeletableLeavesANonTieredVolume (0.00s) === RUN TestMarkTieredDeletableKeepsAConcurrentQuarantine --- PASS: TestMarkTieredDeletableKeepsAConcurrentQuarantine (0.11s) === RUN TestMarkTieredDeletableRefusesAVolumePastIoErrorTolerance --- PASS: TestMarkTieredDeletableRefusesAVolumePastIoErrorTolerance (0.01s) === RUN TestDeleteVolumeNeedleRacesMarkTieredDeletable --- PASS: TestDeleteVolumeNeedleRacesMarkTieredDeletable (0.01s) === RUN TestVolumeInfoSharesTheStringsEveryVolumeRepeats --- PASS: TestVolumeInfoSharesTheStringsEveryVolumeRepeats (0.04s) === RUN TestVolumeTtlClockSurvivesDeletes --- PASS: TestVolumeTtlClockSurvivesDeletes (0.01s) === RUN TestVolumeTtlClockKeepsMtimeWithoutRecoverableWrite --- PASS: TestVolumeTtlClockKeepsMtimeWithoutRecoverableWrite (0.01s) === RUN TestVolumeTtlClockAfterVacuumTakesNewestWrite I1117 09:42:44.394308 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVolumeTtlClockAfterVacuumTakesNewestWrite921331227/001/1.cpx I1117 09:42:44.396102 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestVolumeTtlClockAfterVacuumTakesNewestWrite (0.03s) === RUN TestVolumeTtlClockDeclinesUnaffordableScan I1117 09:42:44.432851 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVolumeTtlClockDeclinesUnaffordableScan1238143990/001/1.cpx I1117 09:42:44.434564 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:42:44.440116 volume_checking.go:654 volume 1: more than 2 needles to scan for its last write, keeping the /tmp/TestVolumeTtlClockDeclinesUnaffordableScan1238143990/001/1.dat mtime --- PASS: TestVolumeTtlClockDeclinesUnaffordableScan (0.04s) === RUN TestVolumeTtlClockSkipsUnaffordableScanWithoutDatReads I1117 09:42:44.453245 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVolumeTtlClockSkipsUnaffordableScanWithoutDatReads235369221/001/1.cpx I1117 09:42:44.454935 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:42:44.458742 volume_checking.go:654 volume 1: more than 2 needles to scan for its last write, keeping the /tmp/TestVolumeTtlClockSkipsUnaffordableScanWithoutDatReads235369221/001/1.dat mtime --- PASS: TestVolumeTtlClockSkipsUnaffordableScanWithoutDatReads (0.02s) === RUN TestVolumeTtlClockCarriedAcrossVacuumCommit I1117 09:42:44.477424 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVolumeTtlClockCarriedAcrossVacuumCommit2206884580/001/1.cpx I1117 09:42:44.479980 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestVolumeTtlClockCarriedAcrossVacuumCommit (0.03s) === RUN TestVolumeTtlClockAtCommitUsesAppendTime I1117 09:42:44.517692 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVolumeTtlClockAtCommitUsesAppendTime750925507/001/1.cpx I1117 09:42:44.519380 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestVolumeTtlClockAtCommitUsesAppendTime (0.03s) === RUN TestVolumeTtlClockAtCommitSkipsDeletedWrite I1117 09:42:44.551523 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestVolumeTtlClockAtCommitSkipsDeletedWrite456023916/001/1.cpx I1117 09:42:44.553346 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:42:44.554945 needle_map_memory.go:122 loading idx from offset 2 for file: /tmp/TestVolumeTtlClockAtCommitSkipsDeletedWrite456023916/001/1.cpx --- PASS: TestVolumeTtlClockAtCommitSkipsDeletedWrite (0.04s) === RUN TestVolumeExpireAtSecCountsFromLastWrite --- PASS: TestVolumeExpireAtSecCountsFromLastWrite (0.00s) === RUN TestReconcileRollForwardMarkerOnly I1117 09:42:44.567184 volume_loading.go:387 loading leveldb index /tmp/TestReconcileRollForwardMarkerOnly1307438428/001/1.ldb I1117 09:42:44.613353 needle_map_leveldb.go:353 loading idx to leveldb from offset 0 for file: /tmp/TestReconcileRollForwardMarkerOnly1307438428/001/1.cpx I1117 09:42:44.625385 volume_vacuum.go:382 volume 1: rolling forward interrupted compaction commit I1117 09:42:44.629089 volume_loading.go:387 loading leveldb index /tmp/TestReconcileRollForwardMarkerOnly1307438428/001/1.ldb --- PASS: TestReconcileRollForwardMarkerOnly (0.10s) === RUN TestReconcileRollForwardPartialRename I1117 09:42:44.667724 volume_loading.go:387 loading leveldb index /tmp/TestReconcileRollForwardPartialRename1096468705/001/1.ldb I1117 09:42:44.731841 needle_map_leveldb.go:353 loading idx to leveldb from offset 0 for file: /tmp/TestReconcileRollForwardPartialRename1096468705/001/1.cpx I1117 09:42:44.751417 volume_vacuum.go:382 volume 1: rolling forward interrupted compaction commit I1117 09:42:44.754685 volume_loading.go:387 loading leveldb index /tmp/TestReconcileRollForwardPartialRename1096468705/001/1.ldb --- PASS: TestReconcileRollForwardPartialRename (0.12s) === RUN TestReconcileRollBackNoMarker I1117 09:42:44.817738 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestReconcileRollBackNoMarker1688639327/001/1.cpx I1117 09:42:44.821049 volume_vacuum.go:391 volume 1: rolling back orphan compaction file .cpd I1117 09:42:44.821332 volume_vacuum.go:391 volume 1: rolling back orphan compaction file .cpx --- PASS: TestReconcileRollBackNoMarker (0.04s) === RUN TestReconcileSkipsLoadedVolumeMidVacuum I1117 09:42:44.865633 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestReconcileSkipsLoadedVolumeMidVacuum233620745/001/1.cpx --- PASS: TestReconcileSkipsLoadedVolumeMidVacuum (0.04s) === RUN TestApplyCompactSwapMissingTempFilesPreservesLive --- PASS: TestApplyCompactSwapMissingTempFilesPreservesLive (0.01s) === RUN TestDestroyRemovesCommitMarker I1117 09:42:44.885306 volume_write.go:138 removed volume file /tmp/TestDestroyRemovesCommitMarker1025373408/001/1.dat (size=1376) I1117 09:42:44.885515 volume_write.go:138 removed volume file /tmp/TestDestroyRemovesCommitMarker1025373408/001/1.idx (size=48) --- PASS: TestDestroyRemovesCommitMarker (0.01s) === RUN TestReconcileSkipsVidWithCopyInFlight I1117 09:42:44.892229 volume_vacuum.go:382 volume 7: rolling forward interrupted compaction commit --- PASS: TestReconcileSkipsVidWithCopyInFlight (0.00s) === RUN TestMakeDiff --- PASS: TestMakeDiff (0.00s) === RUN TestMemIndexCompaction I1117 09:42:49.267929 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestMemIndexCompaction2766789469/001/1.cpx volume_vacuum_test.go:100: compaction speed: 2013445.37 bytes/s I1117 09:42:53.604720 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:42:54.751178 needle_map_memory.go:122 loading idx from offset 9702 for file: /tmp/TestMemIndexCompaction2766789469/001/1.cpx volume_vacuum_test.go:119: realRecordCount:29702, liveRowCount:29119, v.FileCount():29119 mm.DeletedCount():9702 --- PASS: TestMemIndexCompaction (24.73s) === RUN TestLDBIndexCompaction I1117 09:43:09.625664 volume_loading.go:387 loading leveldb index /tmp/TestLDBIndexCompaction4123871617/001/1.ldb I1117 09:43:16.916755 needle_map_leveldb.go:353 loading idx to leveldb from offset 0 for file: /tmp/TestLDBIndexCompaction4123871617/001/1.cpx volume_vacuum_test.go:100: compaction speed: 1517096.77 bytes/s I1117 09:43:28.169374 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:43:29.263778 needle_map_leveldb.go:353 loading idx to leveldb from offset 9693 for file: /tmp/TestLDBIndexCompaction4123871617/001/1.cpx I1117 09:43:34.105083 volume_loading.go:384 updating leveldb index /tmp/TestLDBIndexCompaction4123871617/001/1.ldb volume_vacuum_test.go:114: watermark from levelDB: 20000, realWatermark: 20000, nm.recordCount: 29693, realRecordCount:29693, fileCount=29114, deletedcount:9693 I1117 09:43:35.236167 volume_loading.go:387 loading leveldb index /tmp/TestLDBIndexCompaction4123871617/001/1.ldb --- PASS: TestLDBIndexCompaction (29.41s) === RUN TestCommitCompactDeletionTailKeepsWritable I1117 09:43:39.038567 volume_loading.go:387 loading leveldb index /tmp/TestCommitCompactDeletionTailKeepsWritable354974830/001/1.ldb I1117 09:43:39.106555 needle_map_leveldb.go:353 loading idx to leveldb from offset 0 for file: /tmp/TestCommitCompactDeletionTailKeepsWritable354974830/001/1.cpx I1117 09:43:39.134792 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:43:39.135832 needle_map_leveldb.go:353 loading idx to leveldb from offset 5 for file: /tmp/TestCommitCompactDeletionTailKeepsWritable354974830/001/1.cpx I1117 09:43:39.171294 volume_loading.go:384 updating leveldb index /tmp/TestCommitCompactDeletionTailKeepsWritable354974830/001/1.ldb I1117 09:43:39.191874 volume_loading.go:387 loading leveldb index /tmp/TestCommitCompactDeletionTailKeepsWritable354974830/001/1.ldb --- PASS: TestCommitCompactDeletionTailKeepsWritable (0.17s) === RUN TestCompactionInProgressRefusesOtherVacuumSteps I1117 09:43:39.227426 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestCompactionInProgressRefusesOtherVacuumSteps2385795140/001/1.cpx I1117 09:43:39.229710 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:43:39.230061 volume_vacuum.go:408 Cleaning up volume 1 vacuuming... I1117 09:43:39.230734 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestCompactionInProgressRefusesOtherVacuumSteps (0.03s) === RUN TestCommitCompactWithoutTempFilesKeepsVolumeLoaded I1117 09:43:39.258169 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestCommitCompactWithoutTempFilesKeepsVolumeLoaded1874630925/001/1.cpx I1117 09:43:39.259557 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:43:39.262755 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestCommitCompactWithoutTempFilesKeepsVolumeLoaded (0.03s) === RUN TestCommitCompactMakeupDiffFailureKeepsVolumeLoaded I1117 09:43:39.274394 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestCommitCompactMakeupDiffFailureKeepsVolumeLoaded3765255720/001/1.cpx I1117 09:43:39.276138 volume_vacuum.go:184 Committing volume 1 vacuuming... I1117 09:43:39.277066 volume_vacuum.go:217 makeupDiff in CommitCompact volume 1 failed current old dat file's compact revision 0 is not the expected one 1 --- PASS: TestCommitCompactMakeupDiffFailureKeepsVolumeLoaded (0.01s) === RUN TestCompactVolumeFilesOffline I1117 09:43:39.322199 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestCompactVolumeFilesOffline1861753911/001/1.cpx I1117 09:43:39.323813 volume_vacuum.go:184 Committing volume 1 vacuuming... --- PASS: TestCompactVolumeFilesOffline (0.05s) === RUN TestCleanupCompactRemovesTempFiles I1117 09:43:39.339085 volume_vacuum.go:408 Cleaning up volume 1 vacuuming... --- PASS: TestCleanupCompactRemovesTempFiles (0.01s) === RUN TestCompactByIndex_DropsDanglingNeedle E1117 09:43:39.371658 needle_read.go:55 /tmp/TestCompactByIndex_DropsDanglingNeedle97713649/001/1.dat read 0 dataSize 2080 offset 1053304 fileSize 4728: EOF W1117 09:43:39.372342 volume_vacuum.go:780 vacuum volume 1: dropping unreadable needle key=108 offset=1053304 size=2048: EOF W1117 09:43:39.372720 volume_vacuum.go:808 vacuum volume 1: dropped 1 unreadable index entries (2048 data bytes) during compaction I1117 09:43:39.373493 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestCompactByIndex_DropsDanglingNeedle97713649/001/1.cpx --- PASS: TestCompactByIndex_DropsDanglingNeedle (0.04s) === RUN TestCompactByIndex_ConcurrentWriteDoesNotFailIntegrityCheck I1117 09:43:39.403541 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestCompactByIndex_ConcurrentWriteDoesNotFailIntegrityCheck357562187/001/1.cpx --- PASS: TestCompactByIndex_ConcurrentWriteDoesNotFailIntegrityCheck (0.03s) === RUN TestCompactByVolumeData_SkipsNegativeSizeHeader I1117 09:43:39.425884 volume_read.go:630 cannot read needle head [656, 672) body [672, 688) body length 16: needle 63 size -1 out of range for body length 16: needle data corrupted --- PASS: TestCompactByVolumeData_SkipsNegativeSizeHeader (0.02s) === RUN TestCompactByVolumeData_FailsOnHeaderThatCannotAdvance === RUN TestCompactByVolumeData_FailsOnHeaderThatCannotAdvance/size-36 === RUN TestCompactByVolumeData_FailsOnHeaderThatCannotAdvance/size-100 --- PASS: TestCompactByVolumeData_FailsOnHeaderThatCannotAdvance (0.05s) --- PASS: TestCompactByVolumeData_FailsOnHeaderThatCannotAdvance/size-36 (0.02s) --- PASS: TestCompactByVolumeData_FailsOnHeaderThatCannotAdvance/size-100 (0.02s) === RUN TestExceedsExpectedCompactedSize === RUN TestExceedsExpectedCompactedSize/destination_matches_expected_size_exactly === RUN TestExceedsExpectedCompactedSize/destination_larger_than_expected_is_fine === RUN TestExceedsExpectedCompactedSize/destination_short_of_expected_signals_data_loss --- PASS: TestExceedsExpectedCompactedSize (0.00s) --- PASS: TestExceedsExpectedCompactedSize/destination_matches_expected_size_exactly (0.00s) --- PASS: TestExceedsExpectedCompactedSize/destination_larger_than_expected_is_fine (0.00s) --- PASS: TestExceedsExpectedCompactedSize/destination_short_of_expected_signals_data_loss (0.00s) === RUN TestCompactRefusesTieredVolume --- PASS: TestCompactRefusesTieredVolume (0.01s) === RUN TestCommitCompactRefusesVolumeTieredDuringCopy === RUN TestCommitCompactRefusesVolumeTieredDuringCopy/memory I1117 09:43:39.541268 needle_map_memory.go:122 loading idx from offset 0 for file: /tmp/TestCommitCompactRefusesVolumeTieredDuringCopymemory775950417/002/35.cpx I1117 09:43:39.546057 volume_vacuum.go:184 Committing volume 35 vacuuming... === RUN TestCommitCompactRefusesVolumeTieredDuringCopy/leveldb I1117 09:43:39.554362 volume_loading.go:387 loading leveldb index /tmp/TestCommitCompactRefusesVolumeTieredDuringCopyleveldb772811249/002/35.ldb I1117 09:43:39.608495 needle_map_leveldb.go:353 loading idx to leveldb from offset 0 for file: /tmp/TestCommitCompactRefusesVolumeTieredDuringCopyleveldb772811249/002/35.cpx I1117 09:43:39.628288 volume_vacuum.go:184 Committing volume 35 vacuuming... --- PASS: TestCommitCompactRefusesVolumeTieredDuringCopy (0.14s) --- PASS: TestCommitCompactRefusesVolumeTieredDuringCopy/memory (0.06s) --- PASS: TestCommitCompactRefusesVolumeTieredDuringCopy/leveldb (0.08s) === RUN TestWriteNeedle2FsyncsInlineWhileStopping --- PASS: TestWriteNeedle2FsyncsInlineWhileStopping (0.00s) === RUN TestWriteNeedle2TruncatesWhenInlineFsyncFails --- PASS: TestWriteNeedle2TruncatesWhenInlineFsyncFails (0.00s) === RUN TestWriteNeedle2DropsIndexOfUnflushedNewNeedle --- PASS: TestWriteNeedle2DropsIndexOfUnflushedNewNeedle (0.00s) === RUN TestWriteNeedle2RollsBackBatchFsyncFailure --- PASS: TestWriteNeedle2RollsBackBatchFsyncFailure (0.01s) === RUN TestWriteNeedle2RollsBackBatchFsyncFailureAndReloadsNewNeedle --- PASS: TestWriteNeedle2RollsBackBatchFsyncFailureAndReloadsNewNeedle (0.01s) === RUN TestWriteNeedle2RollsBackBatchFsyncFailureAndReloadsOverwrite --- PASS: TestWriteNeedle2RollsBackBatchFsyncFailureAndReloadsOverwrite (0.01s) === RUN TestBatchDeleteRollsBackOnFsyncFailure --- PASS: TestBatchDeleteRollsBackOnFsyncFailure (0.01s) === RUN TestBatchSyncFailureEntersFailClosedWhenTruncateFails E1117 09:43:39.677715 volume.go:631 volume 1 entered unavailable state after failed recovery: batch fsync failed truncate /tmp/TestBatchSyncFailureEntersFailClosedWhenTruncateFails1635123579/001/1.dat to 8: truncate failed --- PASS: TestBatchSyncFailureEntersFailClosedWhenTruncateFails (0.01s) === RUN TestUnavailableVolumeCannotBeMarkedWritable I1117 09:43:39.683104 store.go:431 In dir /tmp/TestUnavailableVolumeCannotBeMarkedWritable1051117698/001 (disk ID 0) adds volume:19 collection: replicaPlacement:000 ttl: I1117 09:43:39.684729 store.go:436 add volume 19 on disk ID 0 E1117 09:43:39.686028 volume.go:631 volume 19 entered unavailable state after failed recovery: batch recovery failed --- PASS: TestUnavailableVolumeCannotBeMarkedWritable (0.01s) === RUN TestMixedBatchSyncFailureRollsBackAsOneUnit --- PASS: TestMixedBatchSyncFailureRollsBackAsOneUnit (0.01s) === RUN TestWriteNeedle2EntersFailClosedWhenInlineRollbackFails E1117 09:43:39.698142 volume.go:631 volume 1 entered unavailable state after failed recovery: truncate /tmp/TestWriteNeedle2EntersFailClosedWhenInlineRollbackFails2081655976/001/1.dat back to 8 after a failed fsync: truncate failed --- PASS: TestWriteNeedle2EntersFailClosedWhenInlineRollbackFails (0.00s) === RUN TestUnavailableVolumeStaysUnavailableAfterReload E1117 09:43:39.702503 volume.go:631 volume 1 entered unavailable state after failed recovery: batch recovery failed I1117 09:43:39.703888 volume_loading.go:312 open to read file /tmp/TestUnavailableVolumeStaysUnavailableAfterReload1028796531/001/1.idx I1117 09:43:39.704227 needle_map_sorted_file.go:40 Start to Generate /tmp/TestUnavailableVolumeStaysUnavailableAfterReload1028796531/001/1.sdx from /tmp/TestUnavailableVolumeStaysUnavailableAfterReload1028796531/001/1.idx I1117 09:43:39.718111 needle_map_sorted_file.go:42 Finished Generating /tmp/TestUnavailableVolumeStaysUnavailableAfterReload1028796531/001/1.sdx from /tmp/TestUnavailableVolumeStaysUnavailableAfterReload1028796531/001/1.idx W1117 09:43:39.719031 volume.go:669 volume 1 is unavailable: batch recovery failed --- PASS: TestUnavailableVolumeStaysUnavailableAfterReload (0.02s) === RUN TestBatchFsyncRollbackWithLevelDbMapper I1117 09:43:39.722767 volume_loading.go:387 loading leveldb index /tmp/TestBatchFsyncRollbackWithLevelDbMapper2343814611/001/1.ldb I1117 09:43:39.757378 volume_loading.go:387 loading leveldb index /tmp/TestBatchFsyncRollbackWithLevelDbMapper2343814611/001/1.ldb --- PASS: TestBatchFsyncRollbackWithLevelDbMapper (0.05s) === RUN TestBatchFsyncRollbackRestoresOriginalValueAfterRepeatedNeedleId --- PASS: TestBatchFsyncRollbackRestoresOriginalValueAfterRepeatedNeedleId (0.01s) === RUN TestBatchRollbackLeavesNoPhantomMapping --- PASS: TestBatchRollbackLeavesNoPhantomMapping (0.01s) === RUN TestFailedBatchMarksEveryRequestFailed I1117 09:43:39.791940 volume_write.go:389 write cookie mismatch: existing 1,1600000000, new 1,1600000001 --- PASS: TestFailedBatchMarksEveryRequestFailed (0.00s) === RUN TestProcessBatchRefusesWritesAfterDurableIndexFailure I1117 09:43:39.797109 volume_write.go:424 index needle 2 of volume 1 at offset 88: index write failed --- PASS: TestProcessBatchRefusesWritesAfterDurableIndexFailure (0.00s) === RUN TestUnavailableVolumeIsSkippedInHeartbeat E1117 09:43:39.805011 volume.go:631 volume 1 entered unavailable state after failed recovery: batch recovery failed --- PASS: TestUnavailableVolumeIsSkippedInHeartbeat (0.01s) === RUN TestStoreWriteVolumeNeedleStaysDurableWhileStopping I1117 09:43:39.809909 store.go:431 In dir /tmp/TestStoreWriteVolumeNeedleStaysDurableWhileStopping3126995905/001 (disk ID 0) adds volume:1 collection: replicaPlacement:000 ttl: I1117 09:43:39.811910 store.go:436 add volume 1 on disk ID 0 --- PASS: TestStoreWriteVolumeNeedleStaysDurableWhileStopping (0.01s) === RUN TestSearchVolumesWithDeletedNeedles offset: 12296, isLast: false --- PASS: TestSearchVolumesWithDeletedNeedles (0.01s) === RUN TestDestroyEmptyVolumeWithOnlyEmpty I1117 09:43:39.825485 volume_write.go:138 removed volume file /tmp/TestDestroyEmptyVolumeWithOnlyEmpty1804954409/001/1.dat (size=8) I1117 09:43:39.825663 volume_write.go:138 removed volume file /tmp/TestDestroyEmptyVolumeWithOnlyEmpty1804954409/001/1.idx (size=0) --- PASS: TestDestroyEmptyVolumeWithOnlyEmpty (0.00s) === RUN TestDestroyEmptyVolumeWithoutOnlyEmpty I1117 09:43:39.829629 volume_write.go:138 removed volume file /tmp/TestDestroyEmptyVolumeWithoutOnlyEmpty861218676/001/1.dat (size=8) I1117 09:43:39.829808 volume_write.go:138 removed volume file /tmp/TestDestroyEmptyVolumeWithoutOnlyEmpty861218676/001/1.idx (size=0) --- PASS: TestDestroyEmptyVolumeWithoutOnlyEmpty (0.00s) === RUN TestDestroyNonemptyVolumeWithOnlyEmpty --- PASS: TestDestroyNonemptyVolumeWithOnlyEmpty (0.00s) === RUN TestDestroyNonemptyVolumeWithoutOnlyEmpty I1117 09:43:39.838166 volume_write.go:138 removed volume file /tmp/TestDestroyNonemptyVolumeWithoutOnlyEmpty2196773250/001/1.dat (size=1024) I1117 09:43:39.838345 volume_write.go:138 removed volume file /tmp/TestDestroyNonemptyVolumeWithoutOnlyEmpty2196773250/001/1.idx (size=16) --- PASS: TestDestroyNonemptyVolumeWithoutOnlyEmpty (0.00s) === RUN TestWriteNeedleBlobRejectedOnReadOnlyVolume I1117 09:43:39.844637 volume_loading.go:312 open to read file /tmp/TestWriteNeedleBlobRejectedOnReadOnlyVolume2291591761/001/7.idx I1117 09:43:39.845023 needle_map_sorted_file.go:40 Start to Generate /tmp/TestWriteNeedleBlobRejectedOnReadOnlyVolume2291591761/001/7.sdx from /tmp/TestWriteNeedleBlobRejectedOnReadOnlyVolume2291591761/001/7.idx I1117 09:43:39.856754 needle_map_sorted_file.go:42 Finished Generating /tmp/TestWriteNeedleBlobRejectedOnReadOnlyVolume2291591761/001/7.sdx from /tmp/TestWriteNeedleBlobRejectedOnReadOnlyVolume2291591761/001/7.idx --- PASS: TestWriteNeedleBlobRejectedOnReadOnlyVolume (0.02s) === RUN TestWriteNeedleBlobRejectsSizeMismatch --- PASS: TestWriteNeedleBlobRejectsSizeMismatch (0.00s) === RUN TestReadNeedleBlobRejectsNegativeSize === RUN TestReadNeedleBlobRejectsNegativeSize/size_-1 === RUN TestReadNeedleBlobRejectsNegativeSize/size_-100 === RUN TestReadNeedleBlobRejectsNegativeSize/size_-2147483648 --- PASS: TestReadNeedleBlobRejectsNegativeSize (0.01s) --- PASS: TestReadNeedleBlobRejectsNegativeSize/size_-1 (0.00s) --- PASS: TestReadNeedleBlobRejectsNegativeSize/size_-100 (0.00s) --- PASS: TestReadNeedleBlobRejectsNegativeSize/size_-2147483648 (0.00s) === RUN TestWriteNeedleBlobRejectsNegativeSize === RUN TestWriteNeedleBlobRejectsNegativeSize/size_-1 === RUN TestWriteNeedleBlobRejectsNegativeSize/size_-5 --- PASS: TestWriteNeedleBlobRejectsNegativeSize (0.01s) --- PASS: TestWriteNeedleBlobRejectsNegativeSize/size_-1 (0.00s) --- PASS: TestWriteNeedleBlobRejectsNegativeSize/size_-5 (0.00s) === RUN TestWriteNeedleBlobRejectsLengthMismatch === RUN TestWriteNeedleBlobRejectsLengthMismatch/one_byte_too_long === RUN TestWriteNeedleBlobRejectsLengthMismatch/one_byte_short === RUN TestWriteNeedleBlobRejectsLengthMismatch/8_bytes_too_long --- PASS: TestWriteNeedleBlobRejectsLengthMismatch (0.01s) --- PASS: TestWriteNeedleBlobRejectsLengthMismatch/one_byte_too_long (0.00s) --- PASS: TestWriteNeedleBlobRejectsLengthMismatch/one_byte_short (0.00s) --- PASS: TestWriteNeedleBlobRejectsLengthMismatch/8_bytes_too_long (0.00s) === RUN TestWriteNeedleBlobRoundTrip --- PASS: TestWriteNeedleBlobRoundTrip (0.00s) === RUN TestDoWriteRequestRefusesReadOnlyBeforeAppend --- PASS: TestDoWriteRequestRefusesReadOnlyBeforeAppend (0.00s) === RUN TestSyncBatchDefersFlushForStragglers --- PASS: TestSyncBatchDefersFlushForStragglers (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage 185.738s === RUN TestCreateVolumeFilePreallocateKeepsSize --- PASS: TestCreateVolumeFilePreallocateKeepsSize (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/backend 0.914s ? github.com/seaweedfs/seaweedfs/weed/storage/backend/all [no test files] === RUN TestMemoryMapMaxSizeReadWrite --- PASS: TestMemoryMapMaxSizeReadWrite (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/backend/memory_map 0.301s ? github.com/seaweedfs/seaweedfs/weed/storage/backend/rclone_backend [no test files] === RUN TestReadAtReturnsEOFForShortRead --- PASS: TestReadAtReturnsEOFForShortRead (0.01s) === RUN TestReadAtClearsEOFOnFullRead --- PASS: TestReadAtClearsEOFOnFullRead (0.00s) === RUN TestReadAtRejectsInvalidRequestsLocally === RUN TestReadAtRejectsInvalidRequestsLocally/empty_buffer === RUN TestReadAtRejectsInvalidRequestsLocally/negative_offset --- PASS: TestReadAtRejectsInvalidRequestsLocally (0.01s) --- PASS: TestReadAtRejectsInvalidRequestsLocally/empty_buffer (0.00s) --- PASS: TestReadAtRejectsInvalidRequestsLocally/negative_offset (0.00s) === RUN TestParseConcurrency W1117 09:40:36.468266 s3_backend.go:109 invalid concurrency value "0", using default 5 W1117 09:40:36.504383 s3_backend.go:109 invalid concurrency value "-3", using default 5 W1117 09:40:36.507613 s3_backend.go:109 invalid concurrency value "abc", using default 5 --- PASS: TestParseConcurrency (0.04s) === RUN TestS3BackendStorageConcurrencyConfigRoundTrip I1117 09:40:36.557226 s3_backend.go:76 created backend storage s3.test for region bucket I1117 09:40:36.558118 s3_backend.go:76 created backend storage s3.test for region bucket --- PASS: TestS3BackendStorageConcurrencyConfigRoundTrip (0.05s) === RUN TestS3BackendHTTPOptionsReachTheClient I1117 09:40:36.577537 s3_backend.go:76 created backend storage s3.http-options for region bucket --- PASS: TestS3BackendHTTPOptionsReachTheClient (0.02s) === RUN TestS3BackendDefaultTransportHasTimeouts I1117 09:40:36.583974 s3_backend.go:76 created backend storage s3.http-defaults for region bucket --- PASS: TestS3BackendDefaultTransportHasTimeouts (0.00s) === RUN TestS3BackendReadFailsAgainstSilentEndpoint I1117 09:40:36.607598 s3_backend.go:76 created backend storage s3.stalling for region us-east-1 bucket b --- PASS: TestS3BackendReadFailsAgainstSilentEndpoint (1.05s) === RUN TestS3BackendReadFailsWhenBodyStalls I1117 09:40:37.647955 s3_backend.go:76 created backend storage s3.stalling for region us-east-1 bucket b --- PASS: TestS3BackendReadFailsWhenBodyStalls (0.19s) === RUN TestS3BackendSessionsDifferByHTTPOptions --- PASS: TestS3BackendSessionsDifferByHTTPOptions (0.01s) === RUN TestParseNonNegative W1117 09:40:37.839625 s3_backend.go:122 invalid test value "-1", using the default W1117 09:40:37.839891 s3_backend.go:122 invalid test value "x", using the default --- PASS: TestParseNonNegative (0.00s) === RUN TestS3BackendIdleTimeoutOverflowFallsBackToDefault I1117 09:40:37.845621 s3_backend.go:76 created backend storage s3.idle-overflow-0 for region bucket W1117 09:40:37.848724 s3_backend.go:143 idle_connection_timeout_seconds "9223372037" is out of range, using the default I1117 09:40:37.851281 s3_backend.go:76 created backend storage s3.idle-overflow-1 for region bucket W1117 09:40:37.852246 s3_backend.go:143 idle_connection_timeout_seconds "10000000000" is out of range, using the default I1117 09:40:37.852490 s3_backend.go:76 created backend storage s3.idle-overflow-2 for region bucket W1117 09:40:37.852910 s3_backend.go:139 invalid idle_connection_timeout_seconds value "-1", using the default I1117 09:40:37.853126 s3_backend.go:76 created backend storage s3.idle-overflow-3 for region bucket W1117 09:40:37.853534 s3_backend.go:139 invalid idle_connection_timeout_seconds value "x", using the default I1117 09:40:37.853689 s3_backend.go:76 created backend storage s3.idle-overflow-4 for region bucket --- PASS: TestS3BackendIdleTimeoutOverflowFallsBackToDefault (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/backend/s3_backend 3.576s === RUN TestBitrotSidecarBytes_RustInterop --- PASS: TestBitrotSidecarBytes_RustInterop (0.08s) === RUN TestBitrotSidecarRoundTripAndSelfIntegrity --- PASS: TestBitrotSidecarRoundTripAndSelfIntegrity (0.01s) === RUN TestShardChecksumBuilderCrossesBoundaries --- PASS: TestShardChecksumBuilderCrossesBoundaries (0.38s) === RUN TestValidateBitrotManifest --- PASS: TestValidateBitrotManifest (0.00s) === RUN TestEncodeProducesVerifiableSidecar I1117 09:40:37.223107 ec_encoder.go:225 encodeDatFile /tmp/TestEncodeProducesVerifiableSidecar1441857949/001/7.dat size:6291456 with EC context 10+4 (total: 14) --- PASS: TestEncodeProducesVerifiableSidecar (2.78s) === RUN TestRebuildExcludesCorruptPresentShard I1117 09:40:40.008532 ec_encoder.go:225 encodeDatFile /tmp/TestRebuildExcludesCorruptPresentShard1590697546/001/9.dat size:6291456 with EC context 10+4 (total: 14) W1117 09:40:41.533557 ec_encoder.go:343 bitrot: present shard 3 for /tmp/TestRebuildExcludesCorruptPresentShard1590697546/001/9 fails checksum; excluding from rebuild inputs and regenerating I1117 09:40:41.546026 ec_encoder.go:359 rebuilding /tmp/TestRebuildExcludesCorruptPresentShard1590697546/001/9: 12 shards present, 2 missing [0 3], config 10+4 (total: 14) --- PASS: TestRebuildExcludesCorruptPresentShard (2.49s) === RUN TestComputeProtectionFromShardsBackfill I1117 09:40:42.512448 ec_encoder.go:225 encodeDatFile /tmp/TestComputeProtectionFromShardsBackfill2044407049/001/11.dat size:6291456 with EC context 10+4 (total: 14) --- PASS: TestComputeProtectionFromShardsBackfill (2.16s) === RUN TestRebuildFailClosedCleansUpGeneratedShard I1117 09:40:44.679147 ec_encoder.go:225 encodeDatFile /tmp/TestRebuildFailClosedCleansUpGeneratedShard1090931306/001/13.dat size:6291456 with EC context 10+4 (total: 14) I1117 09:40:45.994041 ec_encoder.go:359 rebuilding /tmp/TestRebuildFailClosedCleansUpGeneratedShard1090931306/001/13: 13 shards present, 1 missing [0], config 10+4 (total: 14) I1117 09:40:46.603982 ec_encoder.go:359 rebuilding /tmp/TestRebuildFailClosedCleansUpGeneratedShard1090931306/001/13: 13 shards present, 1 missing [0], config 10+4 (total: 14) --- PASS: TestRebuildFailClosedCleansUpGeneratedShard (2.30s) === RUN TestRemoveBitrotSidecars --- PASS: TestRemoveBitrotSidecars (0.00s) === RUN TestVerifyEcVolumeDataShards I1117 09:40:47.706655 ec_encoder.go:225 encodeDatFile /tmp/TestVerifyEcVolumeDataShards723457106/001/42.dat size:26214400 with EC context 10+4 (total: 14) --- PASS: TestVerifyEcVolumeDataShards (4.47s) === RUN TestSelectBitrotProtection --- PASS: TestSelectBitrotProtection (0.00s) === RUN TestEcConsistency_WritesBetweenEncodeAndEcx I1117 09:40:51.197208 ec_encoder.go:225 encodeDatFile /tmp/TestEcConsistency_WritesBetweenEncodeAndEcx424878441/001/consistency.dat size:103000 with EC context 10+4 (total: 14) ec_consistency_test.go:91: Trying to read needle 2 at offset 103000 size 5032 from EC shards (shardSize=10300) ec_consistency_test.go:92: Intervals: [{BlockIndex:30 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:31 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:32 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:33 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:34 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:35 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:36 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:37 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:38 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:39 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:40 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:41 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:42 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:43 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:44 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:45 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:46 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:47 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:48 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:49 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:50 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:51 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:52 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:53 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:54 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:55 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:56 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:57 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:58 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:59 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:60 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:61 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:62 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:63 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:64 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:65 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:66 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:67 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:68 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:69 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:70 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:71 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:72 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:73 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:74 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:75 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:76 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:77 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:78 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:79 InnerBlockOffset:0 Size:100 IsLargeBlock:false LargeBlockRowsCount:1} {BlockIndex:80 InnerBlockOffset:0 Size:32 IsLargeBlock:false LargeBlockRowsCount:1}] ec_consistency_test.go:99: CONFIRMED: Read error for needle written after EC encoding: read past end of shard 0: offset 10300 + size 100 > fileSize 10300 ec_consistency_test.go:129: Original data reads correctly from EC shards --- PASS: TestEcConsistency_WritesBetweenEncodeAndEcx (0.12s) === RUN TestEcConsistency_ExactLargeRowEncoding I1117 09:40:51.315428 ec_encoder.go:225 encodeDatFile /tmp/TestEcConsistency_ExactLargeRowEncoding44983177/001/exact.dat size:100000 with EC context 10+4 (total: 14) --- PASS: TestEcConsistency_ExactLargeRowEncoding (0.10s) === RUN TestVerifyDecodedDatFile === RUN TestVerifyDecodedDatFile/exactly_the_referenced_extent_is_complete === RUN TestVerifyDecodedDatFile/longer_than_referenced_is_fine:_padding_is_not_missing_data === RUN TestVerifyDecodedDatFile/one_byte_short_still_loses_the_last_needle === RUN TestVerifyDecodedDatFile/an_empty_file_is_short_of_everything === RUN TestVerifyDecodedDatFile/an_index_referencing_nothing_accepts_an_empty_file --- PASS: TestVerifyDecodedDatFile (0.01s) --- PASS: TestVerifyDecodedDatFile/exactly_the_referenced_extent_is_complete (0.00s) --- PASS: TestVerifyDecodedDatFile/longer_than_referenced_is_fine:_padding_is_not_missing_data (0.00s) --- PASS: TestVerifyDecodedDatFile/one_byte_short_still_loses_the_last_needle (0.00s) --- PASS: TestVerifyDecodedDatFile/an_empty_file_is_short_of_everything (0.00s) --- PASS: TestVerifyDecodedDatFile/an_index_referencing_nothing_accepts_an_empty_file (0.00s) === RUN TestVerifyDecodedDatFileMissing --- PASS: TestVerifyDecodedDatFileMissing (0.00s) === RUN TestFindDatFileSizeWithRelocatedShard0 I1117 09:40:51.447913 ec_encoder.go:225 encodeDatFile /tmp/TestFindDatFileSizeWithRelocatedShard02006744001/001/1.dat size:2590912 with EC context 10+4 (total: 14) --- PASS: TestFindDatFileSizeWithRelocatedShard0 (2.04s) === RUN TestMinusParityShardsRatio === RUN TestMinusParityShardsRatio/default_10+4_all_present === RUN TestMinusParityShardsRatio/zero_ratio_falls_back_to_default === RUN TestMinusParityShardsRatio/9+3_all_present === RUN TestMinusParityShardsRatio/9+3_drops_parity_id_9 === RUN TestMinusParityShardsRatio/12+4_keeps_data_ids_>=_10 === RUN TestMinusParityShardsRatio/16+6_keeps_data_ids_>=_10 --- PASS: TestMinusParityShardsRatio (0.01s) --- PASS: TestMinusParityShardsRatio/default_10+4_all_present (0.00s) --- PASS: TestMinusParityShardsRatio/zero_ratio_falls_back_to_default (0.00s) --- PASS: TestMinusParityShardsRatio/9+3_all_present (0.00s) --- PASS: TestMinusParityShardsRatio/9+3_drops_parity_id_9 (0.00s) --- PASS: TestMinusParityShardsRatio/12+4_keeps_data_ids_>=_10 (0.00s) --- PASS: TestMinusParityShardsRatio/16+6_keeps_data_ids_>=_10 (0.00s) === RUN TestRebuildEcxFile_AppliesTombstonesAndRemovesJournal --- PASS: TestRebuildEcxFile_AppliesTombstonesAndRemovesJournal (0.00s) === RUN TestRebuildEcxFile_TornJournalAborts --- PASS: TestRebuildEcxFile_TornJournalAborts (0.00s) === RUN TestRebuildEcxFile_NoJournalNoop --- PASS: TestRebuildEcxFile_NoJournalNoop (0.00s) === RUN TestRebuildEcFiles_TruncatedInputErrorsWithoutPublishing --- PASS: TestRebuildEcFiles_TruncatedInputErrorsWithoutPublishing (0.01s) === RUN TestRebuildEcFiles_ZeroSizeInputsErrors --- PASS: TestRebuildEcFiles_ZeroSizeInputsErrors (0.01s) === RUN TestRebuildEcFiles_HappyPathRebuildsByteIdentical I1117 09:40:53.516493 ec_encoder.go:225 encodeDatFile /tmp/TestRebuildEcFiles_HappyPathRebuildsByteIdentical38946454/001/vol.dat size:7000 with EC context 10+4 (total: 14) I1117 09:40:54.603648 ec_encoder.go:359 rebuilding /tmp/TestRebuildEcFiles_HappyPathRebuildsByteIdentical38946454/001/vol: 13 shards present, 1 missing [5], config 10+4 (total: 14) --- PASS: TestRebuildEcFiles_HappyPathRebuildsByteIdentical (1.15s) === RUN TestRebuildEcFiles_ZeroSizedShardRegeneratedInPlace I1117 09:40:54.667101 ec_encoder.go:225 encodeDatFile /tmp/TestRebuildEcFiles_ZeroSizedShardRegeneratedInPlace4227926803/001/vol.dat size:7000 with EC context 10+4 (total: 14) W1117 09:40:55.499691 ec_encoder.go:273 shard 2 for /tmp/TestRebuildEcFiles_ZeroSizedShardRegeneratedInPlace4227926803/001/vol is zero-sized at /tmp/TestRebuildEcFiles_ZeroSizedShardRegeneratedInPlace4227926803/001/vol.ec02; excluding from rebuild inputs and regenerating I1117 09:40:55.502761 ec_encoder.go:359 rebuilding /tmp/TestRebuildEcFiles_ZeroSizedShardRegeneratedInPlace4227926803/001/vol: 13 shards present, 1 missing [2], config 10+4 (total: 14) --- PASS: TestRebuildEcFiles_ZeroSizedShardRegeneratedInPlace (0.93s) === RUN TestRebuildEcFiles_CustomRatioRebuildsByteIdentical I1117 09:40:55.597335 ec_encoder.go:225 encodeDatFile /tmp/TestRebuildEcFiles_CustomRatioRebuildsByteIdentical2521749914/001/vol.dat size:9000 with EC context 9+3 (total: 12) I1117 09:40:56.318620 ec_encoder.go:359 rebuilding /tmp/TestRebuildEcFiles_CustomRatioRebuildsByteIdentical2521749914/001/vol: 11 shards present, 1 missing [7], config 9+3 (total: 12) --- PASS: TestRebuildEcFiles_CustomRatioRebuildsByteIdentical (0.79s) === RUN TestRebuildEcFiles_ResolvesGeometryFromSidecarWithoutVif I1117 09:40:56.391198 ec_encoder.go:225 encodeDatFile /tmp/TestRebuildEcFiles_ResolvesGeometryFromSidecarWithoutVif2132381182/001/vol.dat size:7000 with EC context 12+4 (total: 16) I1117 09:40:57.307512 ec_encoder.go:177 Rebuilding EC files for /tmp/TestRebuildEcFiles_ResolvesGeometryFromSidecarWithoutVif2132381182/001/vol with config from the bitrot sidecar: 12+4 (total: 16) I1117 09:40:58.357667 ec_encoder.go:359 rebuilding /tmp/TestRebuildEcFiles_ResolvesGeometryFromSidecarWithoutVif2132381182/001/vol: 15 shards present, 1 missing [11], config 12+4 (total: 16) --- PASS: TestRebuildEcFiles_ResolvesGeometryFromSidecarWithoutVif (2.13s) === RUN TestRebuildEcFiles_FindsVifInAnAdditionalDir I1117 09:40:58.519363 ec_encoder.go:225 encodeDatFile /tmp/TestRebuildEcFiles_FindsVifInAnAdditionalDir1335772214/001/vol.dat size:7000 with EC context 12+4 (total: 16) I1117 09:40:59.530028 ec_encoder.go:153 Rebuilding EC files for /tmp/TestRebuildEcFiles_FindsVifInAnAdditionalDir1335772214/001/vol with config from .vif: 12+4 (total: 16) I1117 09:40:59.533414 ec_encoder.go:359 rebuilding /tmp/TestRebuildEcFiles_FindsVifInAnAdditionalDir1335772214/001/vol: 15 shards present, 1 missing [11], config 12+4 (total: 16) --- PASS: TestRebuildEcFiles_FindsVifInAnAdditionalDir (1.11s) === RUN TestEcReadRoundTrip === RUN TestEcReadRoundTrip/1_large_row_exact I1117 09:40:59.632807 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTrip1_large_row_exact3288841247/001/rt_100000.dat size:100000 with EC context 10+4 (total: 14) ec_roundtrip_test.go:59: WARN: EC read mismatch at offset 50000 (fallback path, shardFileSize=10000) === RUN TestEcReadRoundTrip/2_large_rows_exact I1117 09:40:59.696680 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTrip2_large_rows_exact103728515/001/rt_200000.dat size:200000 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/3_large_rows_exact I1117 09:40:59.811864 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTrip3_large_rows_exact3781587951/001/rt_300000.dat size:300000 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/1_large_row_plus_1 I1117 09:40:59.975641 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTrip1_large_row_plus_13691616386/001/rt_100001.dat size:100001 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/2_large_rows_plus_small I1117 09:41:00.039075 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTrip2_large_rows_plus_small3274410847/001/rt_201000.dat size:201000 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/1_large_row_plus_half_small I1117 09:41:00.146527 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTrip1_large_row_plus_half_small2364369015/001/rt_100500.dat size:100500 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/just_under_1_large_row I1117 09:41:00.205887 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTripjust_under_1_large_row3380926841/001/rt_99999.dat size:99999 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/just_under_2_large_rows I1117 09:41:00.265648 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTripjust_under_2_large_rows2492189092/001/rt_199999.dat size:199999 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/small_only I1117 09:41:00.371341 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTripsmall_only3446248087/001/rt_3000.dat size:3000 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/small_single_row I1117 09:41:00.380368 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTripsmall_single_row4054140199/001/rt_1000.dat size:1000 with EC context 10+4 (total: 14) === RUN TestEcReadRoundTrip/boundary_spanning I1117 09:41:00.388676 ec_encoder.go:225 encodeDatFile /tmp/TestEcReadRoundTripboundary_spanning3678368560/001/rt_105050.dat size:105050 with EC context 10+4 (total: 14) --- PASS: TestEcReadRoundTrip (0.82s) --- PASS: TestEcReadRoundTrip/1_large_row_exact (0.06s) --- PASS: TestEcReadRoundTrip/2_large_rows_exact (0.11s) --- PASS: TestEcReadRoundTrip/3_large_rows_exact (0.16s) --- PASS: TestEcReadRoundTrip/1_large_row_plus_1 (0.06s) --- PASS: TestEcReadRoundTrip/2_large_rows_plus_small (0.11s) --- PASS: TestEcReadRoundTrip/1_large_row_plus_half_small (0.06s) --- PASS: TestEcReadRoundTrip/just_under_1_large_row (0.06s) --- PASS: TestEcReadRoundTrip/just_under_2_large_rows (0.11s) --- PASS: TestEcReadRoundTrip/small_only (0.01s) --- PASS: TestEcReadRoundTrip/small_single_row (0.01s) --- PASS: TestEcReadRoundTrip/boundary_spanning (0.06s) === RUN TestEcOffByOneBug_Issue8947 I1117 09:41:00.452403 ec_encoder.go:225 encodeDatFile /tmp/TestEcOffByOneBug_Issue89472331319313/001/bug_200000.dat size:200000 with EC context 10+4 (total: 14) ec_roundtrip_test.go:269: Buggy formula returned wrong data: expected first bytes 63cc9f43cab672ed, got a2e2f8ccf9ce1c5a ec_roundtrip_test.go:279: Fixed: nLargeBlockRows=2, interval={BlockIndex:11 InnerBlockOffset:50 Size:50 IsLargeBlock:true LargeBlockRowsCount:2} ec_roundtrip_test.go:280: Buggy: nLargeBlockRows=1, interval={BlockIndex:100 InnerBlockOffset:50 Size:50 IsLargeBlock:false LargeBlockRowsCount:1} --- PASS: TestEcOffByOneBug_Issue8947 (0.11s) === RUN TestEcDecodeDatRoundTrip === RUN TestEcDecodeDatRoundTrip/size_1000 I1117 09:41:00.567535 ec_encoder.go:225 encodeDatFile /tmp/TestEcDecodeDatRoundTripsize_1000282051824/001/dec_1000.dat size:1000 with EC context 10+4 (total: 14) === RUN TestEcDecodeDatRoundTrip/size_10485760 I1117 09:41:01.493362 ec_encoder.go:225 encodeDatFile /tmp/TestEcDecodeDatRoundTripsize_104857601118744437/001/dec_10485760.dat size:10485760 with EC context 10+4 (total: 14) === RUN TestEcDecodeDatRoundTrip/size_10486260 I1117 09:41:02.257711 ec_encoder.go:225 encodeDatFile /tmp/TestEcDecodeDatRoundTripsize_10486260580776834/001/dec_10486260.dat size:10486260 with EC context 10+4 (total: 14) --- PASS: TestEcDecodeDatRoundTrip (3.24s) --- PASS: TestEcDecodeDatRoundTrip/size_1000 (0.86s) --- PASS: TestEcDecodeDatRoundTrip/size_10485760 (0.76s) --- PASS: TestEcDecodeDatRoundTrip/size_10486260 (1.61s) === RUN TestWriteDatFileAfterTailDeletion I1117 09:41:03.807594 ec_encoder.go:225 encodeDatFile /tmp/TestWriteDatFileAfterTailDeletion2756198223/001/tail_del.dat size:102530 with EC context 10+4 (total: 14) --- PASS: TestWriteDatFileAfterTailDeletion (0.14s) === RUN TestWriteDatFileFallbackLayout I1117 09:41:03.944237 ec_encoder.go:225 encodeDatFile /tmp/TestWriteDatFileFallbackLayout667970431/001/plain.dat size:102530 with EC context 10+4 (total: 14) I1117 09:41:04.037082 ec_encoder.go:225 encodeDatFile /tmp/TestWriteDatFileFallbackLayout667970431/001/ambiguous1.dat size:99999 with EC context 10+4 (total: 14) I1117 09:41:04.132868 ec_encoder.go:225 encodeDatFile /tmp/TestWriteDatFileFallbackLayout667970431/001/ambiguous2.dat size:199999 with EC context 10+4 (total: 14) --- PASS: TestWriteDatFileFallbackLayout (0.36s) === RUN TestShardsInfo_SetAndGet --- PASS: TestShardsInfo_SetAndGet (0.00s) === RUN TestShardsInfo_SortedOrder --- PASS: TestShardsInfo_SortedOrder (0.00s) === RUN TestShardsInfo_Delete --- PASS: TestShardsInfo_Delete (0.00s) === RUN TestShardsInfo_Update --- PASS: TestShardsInfo_Update (0.00s) === RUN TestShardsInfo_TotalSize --- PASS: TestShardsInfo_TotalSize (0.00s) === RUN TestShardsInfo_Sizes --- PASS: TestShardsInfo_Sizes (0.00s) === RUN TestShardsInfo_Copy --- PASS: TestShardsInfo_Copy (0.00s) === RUN TestShardsInfo_AddSubtract --- PASS: TestShardsInfo_AddSubtract (0.00s) === RUN TestShardsInfo_PlusMinus --- PASS: TestShardsInfo_PlusMinus (0.00s) === RUN TestShardsInfo_DeleteParityShards --- PASS: TestShardsInfo_DeleteParityShards (0.00s) === RUN TestShardsInfo_FromVolumeEcShardInformationMessage === RUN TestShardsInfo_FromVolumeEcShardInformationMessage/nil_message === RUN TestShardsInfo_FromVolumeEcShardInformationMessage/single_shard === RUN TestShardsInfo_FromVolumeEcShardInformationMessage/multiple_shards === RUN TestShardsInfo_FromVolumeEcShardInformationMessage/missing_sizes --- PASS: TestShardsInfo_FromVolumeEcShardInformationMessage (0.00s) --- PASS: TestShardsInfo_FromVolumeEcShardInformationMessage/nil_message (0.00s) --- PASS: TestShardsInfo_FromVolumeEcShardInformationMessage/single_shard (0.00s) --- PASS: TestShardsInfo_FromVolumeEcShardInformationMessage/multiple_shards (0.00s) --- PASS: TestShardsInfo_FromVolumeEcShardInformationMessage/missing_sizes (0.00s) === RUN TestEcShardsTotalSize === RUN TestEcShardsTotalSize/nil_message === RUN TestEcShardsTotalSize/all_shards_present === RUN TestEcShardsTotalSize/only_parity_shards --- PASS: TestEcShardsTotalSize (0.00s) --- PASS: TestEcShardsTotalSize/nil_message (0.00s) --- PASS: TestEcShardsTotalSize/all_shards_present (0.00s) --- PASS: TestEcShardsTotalSize/only_parity_shards (0.00s) === RUN TestEcShardsDataSize === RUN TestEcShardsDataSize/nil_message === RUN TestEcShardsDataSize/data_shards_only === RUN TestEcShardsDataSize/mixed_data_and_parity_(default_10+4) === RUN TestEcShardsDataSize/only_parity_shards_(excluded) === RUN TestEcShardsDataSize/missing_sizes_tolerated === RUN TestEcShardsDataSize/custom_6+3_ratio:_shards_0..5_are_data,_6..8_are_parity === RUN TestEcShardsDataSize/custom_16+6_ratio:_shard_id_12_is_data,_not_parity === RUN TestEcShardsDataSize/negative_dataShards_falls_back_to_default --- PASS: TestEcShardsDataSize (0.01s) --- PASS: TestEcShardsDataSize/nil_message (0.00s) --- PASS: TestEcShardsDataSize/data_shards_only (0.00s) --- PASS: TestEcShardsDataSize/mixed_data_and_parity_(default_10+4) (0.00s) --- PASS: TestEcShardsDataSize/only_parity_shards_(excluded) (0.00s) --- PASS: TestEcShardsDataSize/missing_sizes_tolerated (0.00s) --- PASS: TestEcShardsDataSize/custom_6+3_ratio:_shards_0..5_are_data,_6..8_are_parity (0.00s) --- PASS: TestEcShardsDataSize/custom_16+6_ratio:_shard_id_12_is_data,_not_parity (0.00s) --- PASS: TestEcShardsDataSize/negative_dataShards_falls_back_to_default (0.00s) === RUN TestShardsInfo_String --- PASS: TestShardsInfo_String (0.00s) === RUN TestShardsInfo_ConcurrentAccess --- PASS: TestShardsInfo_ConcurrentAccess (0.04s) === RUN TestEncodingDecoding I1117 09:41:04.371775 ec_encoder.go:225 encodeDatFile 1.dat size:2590912 with EC context 10+4 (total: 14) --- PASS: TestEncodingDecoding (2.30s) === RUN TestLocateData [{BlockIndex:5 InnerBlockOffset:100 Size:9900 IsLargeBlock:true LargeBlockRowsCount:1} {BlockIndex:6 InnerBlockOffset:0 Size:10000 IsLargeBlock:true LargeBlockRowsCount:1} {BlockIndex:7 InnerBlockOffset:0 Size:10000 IsLargeBlock:true LargeBlockRowsCount:1} {BlockIndex:8 InnerBlockOffset:0 Size:10000 IsLargeBlock:true LargeBlockRowsCount:1} {BlockIndex:9 InnerBlockOffset:0 Size:10000 IsLargeBlock:true LargeBlockRowsCount:1} {BlockIndex:0 InnerBlockOffset:0 Size:1 IsLargeBlock:false LargeBlockRowsCount:1}] --- PASS: TestLocateData (0.00s) === RUN TestLocateData2 --- PASS: TestLocateData2 (0.00s) === RUN TestLocateData3 {BlockIndex:8876 InnerBlockOffset:912752 Size:112568 IsLargeBlock:false LargeBlockRowsCount:2} --- PASS: TestLocateData3 (0.00s) === RUN TestLocateData_ExactMultiple_Issue8947 --- PASS: TestLocateData_ExactMultiple_Issue8947 (0.00s) === RUN TestLocateData_Issue8179 --- PASS: TestLocateData_Issue8179 (0.01s) === RUN TestUniformBlockSizeMatchesLegacyShardSize --- PASS: TestUniformBlockSizeMatchesLegacyShardSize (0.00s) === RUN TestLocateDataMatchesEncoderForBothLayouts === RUN TestLocateDataMatchesEncoderForBothLayouts/uniform I1117 09:41:07.638656 ec_encoder.go:225 encodeDatFile /tmp/TestLocateDataMatchesEncoderForBothLayouts968240949/001/uniform.dat size:26226745 with EC context 10+4 (total: 14) === RUN TestLocateDataMatchesEncoderForBothLayouts/legacy I1117 09:41:10.354730 ec_encoder.go:225 encodeDatFile /tmp/TestLocateDataMatchesEncoderForBothLayouts968240949/001/legacy.dat size:26226745 with EC context 10+4 (total: 14) --- PASS: TestLocateDataMatchesEncoderForBothLayouts (5.50s) --- PASS: TestLocateDataMatchesEncoderForBothLayouts/uniform (2.81s) --- PASS: TestLocateDataMatchesEncoderForBothLayouts/legacy (2.64s) === RUN TestUniformDecodeRoundTrip I1117 09:41:13.034140 ec_encoder.go:225 encodeDatFile /tmp/TestUniformDecodeRoundTrip1802195077/001/1.dat size:26214400 with EC context 10+4 (total: 14) --- PASS: TestUniformDecodeRoundTrip (2.88s) === RUN TestEcVolumeGeometryFromVif === RUN TestEcVolumeGeometryFromVif/legacy I1117 09:41:16.006034 ec_encoder.go:225 encodeDatFile /tmp/TestEcVolumeGeometryFromViflegacy136417769/001/7.dat size:26214400 with EC context 10+4 (total: 14) === RUN TestEcVolumeGeometryFromVif/uniform I1117 09:41:20.297863 ec_encoder.go:225 encodeDatFile /tmp/TestEcVolumeGeometryFromVifuniform4290394156/001/7.dat size:26214400 with EC context 10+4 (total: 14) --- PASS: TestEcVolumeGeometryFromVif (8.48s) --- PASS: TestEcVolumeGeometryFromVif/legacy (4.31s) --- PASS: TestEcVolumeGeometryFromVif/uniform (4.17s) === RUN TestEcjNotCompactedAfterLoadError W1117 09:41:23.702826 ec_volume.go:293 ec volume 60: load deleted needles from .ecj: read ecj at 1048576: injected read failure W1117 09:41:23.703931 volume_info.go:47 empty volume info file /tmp/TestEcjNotCompactedAfterLoadError848165676/001/60.vif, treating as non-existent W1117 09:41:23.704980 ec_volume.go:425 vif file not found, using defaults, volumeId:60, filename:/tmp/TestEcjNotCompactedAfterLoadError848165676/001/60.vif W1117 09:41:23.713964 ec_volume.go:803 ec volume 60: not compacting .ecj: its load failed, so the in-memory set may be partial W1117 09:41:24.050342 volume_info.go:47 empty volume info file /tmp/TestEcjNotCompactedAfterLoadError848165676/001/60.vif, treating as non-existent W1117 09:41:24.050937 ec_volume.go:425 vif file not found, using defaults, volumeId:60, filename:/tmp/TestEcjNotCompactedAfterLoadError848165676/001/60.vif W1117 09:41:24.053409 ec_volume.go:866 ec volume 60: compacting bloated .ecj deletion journal on-disk=3276808 unique=101 compacted=808 --- PASS: TestEcjNotCompactedAfterLoadError (0.51s) === RUN TestEcjSiblingHolderBlocksCompaction W1117 09:41:24.066225 volume_info.go:47 empty volume info file /tmp/TestEcjSiblingHolderBlocksCompaction239369503/001/a/61.vif, treating as non-existent W1117 09:41:24.066710 ec_volume.go:425 vif file not found, using defaults, volumeId:61, filename:/tmp/TestEcjSiblingHolderBlocksCompaction239369503/001/a/61.vif W1117 09:41:24.393052 volume_info.go:47 empty volume info file /tmp/TestEcjSiblingHolderBlocksCompaction239369503/001/a/61.vif, treating as non-existent W1117 09:41:24.393651 ec_volume.go:425 vif file not found, using defaults, volumeId:61, filename:/tmp/TestEcjSiblingHolderBlocksCompaction239369503/001/a/61.vif W1117 09:41:24.700467 volume_info.go:47 empty volume info file /tmp/TestEcjSiblingHolderBlocksCompaction239369503/001/a/61.vif, treating as non-existent W1117 09:41:24.700949 ec_volume.go:425 vif file not found, using defaults, volumeId:61, filename:/tmp/TestEcjSiblingHolderBlocksCompaction239369503/001/a/61.vif W1117 09:41:24.703418 ec_volume.go:866 ec volume 61: compacting bloated .ecj deletion journal on-disk=3276808 unique=101 compacted=808 --- PASS: TestEcjSiblingHolderBlocksCompaction (0.65s) === RUN TestEcjActiveCopyBlocksCompaction W1117 09:41:25.041509 volume_info.go:47 empty volume info file /tmp/TestEcjActiveCopyBlocksCompaction384932754/001/62.vif, treating as non-existent W1117 09:41:25.042185 ec_volume.go:425 vif file not found, using defaults, volumeId:62, filename:/tmp/TestEcjActiveCopyBlocksCompaction384932754/001/62.vif W1117 09:41:25.350733 volume_info.go:47 empty volume info file /tmp/TestEcjActiveCopyBlocksCompaction384932754/001/62.vif, treating as non-existent W1117 09:41:25.351283 ec_volume.go:425 vif file not found, using defaults, volumeId:62, filename:/tmp/TestEcjActiveCopyBlocksCompaction384932754/001/62.vif W1117 09:41:25.352208 ec_volume.go:866 ec volume 62: compacting bloated .ecj deletion journal on-disk=3276800 unique=100 compacted=800 --- PASS: TestEcjActiveCopyBlocksCompaction (0.65s) === RUN TestEcjWriterWaitsForCompaction --- PASS: TestEcjWriterWaitsForCompaction (0.10s) === RUN TestEcjFinishedWriterSinceHoldBlocksCompaction --- PASS: TestEcjFinishedWriterSinceHoldBlocksCompaction (0.00s) === RUN TestEcjInPlaceRewriteDuringLoadBlocksCompaction W1117 09:41:25.801114 volume_info.go:47 empty volume info file /tmp/TestEcjInPlaceRewriteDuringLoadBlocksCompaction2092773105/001/66.vif, treating as non-existent W1117 09:41:25.801735 ec_volume.go:425 vif file not found, using defaults, volumeId:66, filename:/tmp/TestEcjInPlaceRewriteDuringLoadBlocksCompaction2092773105/001/66.vif --- PASS: TestEcjInPlaceRewriteDuringLoadBlocksCompaction (0.38s) === RUN TestEcjRegistryKeysResolveDirectories --- PASS: TestEcjRegistryKeysResolveDirectories (0.00s) === RUN TestEcjChangedAfterLoadIsDetected W1117 09:41:25.849561 volume_info.go:47 empty volume info file /tmp/TestEcjChangedAfterLoadIsDetected1334319337/001/63.vif, treating as non-existent W1117 09:41:25.850435 ec_volume.go:425 vif file not found, using defaults, volumeId:63, filename:/tmp/TestEcjChangedAfterLoadIsDetected1334319337/001/63.vif --- PASS: TestEcjChangedAfterLoadIsDetected (0.01s) === RUN TestEcjRenameFailureKeepsOriginalJournal W1117 09:41:26.201692 volume_info.go:47 empty volume info file /tmp/TestEcjRenameFailureKeepsOriginalJournal734599412/001/64.vif, treating as non-existent W1117 09:41:26.202272 ec_volume.go:425 vif file not found, using defaults, volumeId:64, filename:/tmp/TestEcjRenameFailureKeepsOriginalJournal734599412/001/64.vif W1117 09:41:26.203013 ec_volume.go:866 ec volume 64: compacting bloated .ecj deletion journal on-disk=3276800 unique=100 compacted=800 W1117 09:41:26.207404 ec_volume.go:880 ec volume 64: compact .ecj: journal left as it was: injected rename failure --- PASS: TestEcjRenameFailureKeepsOriginalJournal (0.39s) === RUN TestEcjRenameAndRestoreFailureIsMountError W1117 09:41:26.580261 volume_info.go:47 empty volume info file /tmp/TestEcjRenameAndRestoreFailureIsMountError3731334250/001/65.vif, treating as non-existent W1117 09:41:26.580953 ec_volume.go:425 vif file not found, using defaults, volumeId:65, filename:/tmp/TestEcjRenameAndRestoreFailureIsMountError3731334250/001/65.vif W1117 09:41:26.581605 ec_volume.go:866 ec volume 65: compacting bloated .ecj deletion journal on-disk=3276800 unique=100 compacted=800 --- PASS: TestEcjRenameAndRestoreFailureIsMountError (0.38s) === RUN TestEcjPostRenameReopenFailureIsMountError W1117 09:41:26.950144 volume_info.go:47 empty volume info file /tmp/TestEcjPostRenameReopenFailureIsMountError39761646/001/66.vif, treating as non-existent W1117 09:41:26.950756 ec_volume.go:425 vif file not found, using defaults, volumeId:66, filename:/tmp/TestEcjPostRenameReopenFailureIsMountError39761646/001/66.vif W1117 09:41:26.951382 ec_volume.go:866 ec volume 66: compacting bloated .ecj deletion journal on-disk=3276800 unique=100 compacted=800 --- PASS: TestEcjPostRenameReopenFailureIsMountError (0.32s) === RUN TestEcjPostRenameFsyncFailureIsMountError W1117 09:41:27.279136 volume_info.go:47 empty volume info file /tmp/TestEcjPostRenameFsyncFailureIsMountError1167794224/001/67.vif, treating as non-existent W1117 09:41:27.279723 ec_volume.go:425 vif file not found, using defaults, volumeId:67, filename:/tmp/TestEcjPostRenameFsyncFailureIsMountError1167794224/001/67.vif W1117 09:41:27.280408 ec_volume.go:866 ec volume 67: compacting bloated .ecj deletion journal on-disk=3276800 unique=100 compacted=800 --- PASS: TestEcjPostRenameFsyncFailureIsMountError (0.33s) === RUN TestEcjStaleCompactionTmpRemoved W1117 09:41:27.290213 volume_info.go:47 empty volume info file /tmp/TestEcjStaleCompactionTmpRemoved1246666222/001/68.vif, treating as non-existent W1117 09:41:27.290676 ec_volume.go:425 vif file not found, using defaults, volumeId:68, filename:/tmp/TestEcjStaleCompactionTmpRemoved1246666222/001/68.vif --- PASS: TestEcjStaleCompactionTmpRemoved (0.01s) === RUN TestEcjRefusedMountDoesNotCompact W1117 09:41:27.626951 volume_info.go:55 unmarshal error: proto: syntax error (line 1:2): invalid value not oldFormat: failed to unmarshal old version volume info: proto: syntax error (line 1:2): invalid value not --- PASS: TestEcjRefusedMountDoesNotCompact (0.36s) === RUN TestMergeEcRuntimesWithEmptiedRuntime --- PASS: TestMergeEcRuntimesWithEmptiedRuntime (0.00s) === RUN TestMergeEcRuntimesAllEmptiedIsVanished --- PASS: TestMergeEcRuntimesAllEmptiedIsVanished (0.00s) === RUN TestMergeEcRuntimesEmptiedNewerGenerationDoesNotAnchor --- PASS: TestMergeEcRuntimesEmptiedNewerGenerationDoesNotAnchor (0.00s) === RUN TestNewEcVolumeTakesLayoutFromSidecarWhenVifHasNoConfig I1117 09:41:27.674010 ec_volume.go:381 ec volume 1: .vif records no EC config; took it from the bitrot sidecar: 12+4 (total: 16) W1117 09:41:27.674705 ec_bitrot.go:590 ec volume 1: bitrot sidecar /tmp/TestNewEcVolumeTakesLayoutFromSidecarWhenVifHasNoConfig580438851/001/1.ecsum manifest invalid: incomplete manifest: 0 shard entries, expected 16 --- PASS: TestNewEcVolumeTakesLayoutFromSidecarWhenVifHasNoConfig (0.01s) === RUN TestNewEcVolumeFindsSidecarInTheIndexDirectory === RUN TestNewEcVolumeFindsSidecarInTheIndexDirectory/no_vif_at_all I1117 09:41:27.680684 ec_volume.go:419 ec volume 2: .vif missing; took EC config from the bitrot sidecar: 12+4 (total: 16) W1117 09:41:27.681196 ec_bitrot.go:590 ec volume 2: bitrot sidecar /tmp/TestNewEcVolumeFindsSidecarInTheIndexDirectoryno_vif_at_all1862571502/002/2.ecsum manifest invalid: incomplete manifest: 0 shard entries, expected 16 === RUN TestNewEcVolumeFindsSidecarInTheIndexDirectory/vif_without_ec_config I1117 09:41:27.686060 ec_volume.go:381 ec volume 2: .vif records no EC config; took it from the bitrot sidecar: 12+4 (total: 16) W1117 09:41:27.686527 ec_bitrot.go:590 ec volume 2: bitrot sidecar /tmp/TestNewEcVolumeFindsSidecarInTheIndexDirectoryvif_without_ec_co3646657756/002/2.ecsum manifest invalid: incomplete manifest: 0 shard entries, expected 16 --- PASS: TestNewEcVolumeFindsSidecarInTheIndexDirectory (0.01s) --- PASS: TestNewEcVolumeFindsSidecarInTheIndexDirectory/no_vif_at_all (0.00s) --- PASS: TestNewEcVolumeFindsSidecarInTheIndexDirectory/vif_without_ec_config (0.00s) === RUN TestNewEcVolumeConfigFreeVifWithNoSidecarUsesDefaults --- PASS: TestNewEcVolumeConfigFreeVifWithNoSidecarUsesDefaults (0.00s) === RUN TestNewEcVolumeConfigFreeVifWithUnusableSidecarFails --- PASS: TestNewEcVolumeConfigFreeVifWithUnusableSidecarFails (0.00s) === RUN TestReloadBitrotSidecarFindsItOnASiblingDisk W1117 09:41:27.701000 ec_bitrot.go:533 ec volume 7: reload bitrot sidecar: ec volume 7 generation 0: /tmp/TestReloadBitrotSidecarFindsItOnASiblingDisk3228453740/002/7.ecsum records layout 10+2 block 0 but the volume is mounted as 10+4 block 0; refusing to serve one of the two layouts --- PASS: TestReloadBitrotSidecarFindsItOnASiblingDisk (0.01s) === RUN TestFindBitrotSidecarSearchesEveryCandidate --- PASS: TestFindBitrotSidecarSearchesEveryCandidate (0.00s) === RUN TestPositioning offset: 31300679656 size: 1167 offset: 11513014944 size: 66044 offset: 26311863528 size: 26823 interval: {BlockIndex:14852 InnerBlockOffset:994536 Size:26856 IsLargeBlock:false LargeBlockRowsCount:1}, shardId: 2, shardOffset: 2631871720 --- PASS: TestPositioning (0.00s) === RUN TestNewEcVolumeLoadsEncodeTsNs --- PASS: TestNewEcVolumeLoadsEncodeTsNs (0.00s) === RUN TestNewEcVolumeDoesNotWriteStubVif W1117 09:41:27.716249 ec_volume.go:425 vif file not found, using defaults, volumeId:124, filename:/tmp/TestNewEcVolumeDoesNotWriteStubVif1645940983/001/124.vif --- PASS: TestNewEcVolumeDoesNotWriteStubVif (0.00s) === RUN TestNewEcVolumeLoadsCustomRatio --- PASS: TestNewEcVolumeLoadsCustomRatio (0.00s) === RUN TestNewEcVolumePrefersLocalEcx --- PASS: TestNewEcVolumePrefersLocalEcx (0.00s) === RUN TestNewEcVolumeZeroByteLocalYieldsToSharedEcx --- PASS: TestNewEcVolumeZeroByteLocalYieldsToSharedEcx (0.00s) === RUN TestEcVolumeDestroySweepsBothDirs --- PASS: TestEcVolumeDestroySweepsBothDirs (0.00s) === RUN TestLocateEcShardNeedleMatchesInterval --- PASS: TestLocateEcShardNeedleMatchesInterval (0.00s) === RUN TestLocateEcShardNeedleIntervalAfterLastShardUnmounted --- PASS: TestLocateEcShardNeedleIntervalAfterLastShardUnmounted (0.00s) === RUN TestLocateEcShardNeedleWithoutMountedShards --- PASS: TestLocateEcShardNeedleWithoutMountedShards (0.00s) === RUN TestNewEcVolumeFailsOnMalformedVif W1117 09:41:27.744067 volume_info.go:55 unmarshal error: proto: syntax error (line 1:1): invalid value not oldFormat: failed to unmarshal old version volume info: proto: syntax error (line 1:1): invalid value not --- PASS: TestNewEcVolumeFailsOnMalformedVif (0.00s) === RUN TestNewEcVolumeAbsentVifMountsWithDefaults W1117 09:41:27.747448 ec_volume.go:425 vif file not found, using defaults, volumeId:1, filename:/tmp/TestNewEcVolumeAbsentVifMountsWithDefaults1317861252/001/1.vif --- PASS: TestNewEcVolumeAbsentVifMountsWithDefaults (0.00s) === RUN TestNewEcVolumeRejectsImplausibleBlockSize --- PASS: TestNewEcVolumeRejectsImplausibleBlockSize (0.01s) === RUN TestNewEcVolumeAcceptsAlignedBlockSize --- PASS: TestNewEcVolumeAcceptsAlignedBlockSize (0.00s) === RUN TestNewEcVolumeRejectsSidecarGeometryDisagreement --- PASS: TestNewEcVolumeRejectsSidecarGeometryDisagreement (0.00s) === RUN TestNewEcVolumeRejectsUnusableSoleSidecar --- PASS: TestNewEcVolumeRejectsUnusableSoleSidecar (0.01s) === RUN TestDistributeEcShardsZeroIsSequential I1117 09:41:27.779621 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.780299 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.822649 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.822929 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.823175 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.823481 shard_distribution.go:137 All shards distributed to destination server I1117 09:41:27.823787 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.823972 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.824149 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.824311 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.824497 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.824639 shard_distribution.go:137 All shards distributed to destination server --- PASS: TestDistributeEcShardsZeroIsSequential (0.05s) === RUN TestDistributeEcShardsNoCapParallelByKey I1117 09:41:27.830444 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.831106 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.831284 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.833148 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.833160 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.833102 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.833150 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.834576 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.834603 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.834573 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.834604 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.835479 shard_distribution.go:137 All shards distributed to destination server I1117 09:41:27.835646 shard_distribution.go:137 All shards distributed to destination server I1117 09:41:27.835792 shard_distribution.go:137 All shards distributed to destination server --- PASS: TestDistributeEcShardsNoCapParallelByKey (0.01s) === RUN TestDistributeEcShardsSameDiskQueued I1117 09:41:27.838937 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.839341 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.880077 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.880307 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.880474 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.880714 shard_distribution.go:137 All shards distributed to destination server --- PASS: TestDistributeEcShardsSameDiskQueued (0.04s) === RUN TestDistributeEcShardsAutoDiskSerializesServer I1117 09:41:27.883909 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.884092 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.884473 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.884574 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.885059 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.885105 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.885226 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.885379 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.885618 shard_distribution.go:137 All shards distributed to destination server I1117 09:41:27.885764 shard_distribution.go:137 All shards distributed to destination server --- PASS: TestDistributeEcShardsAutoDiskSerializesServer (0.00s) === RUN TestDistributeEcShardsTwoDisksTwoStreams I1117 09:41:27.888311 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.888730 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.888844 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.889239 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.889262 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.889809 shard_distribution.go:137 All shards distributed to destination server --- PASS: TestDistributeEcShardsTwoDisksTwoStreams (0.00s) === RUN TestDistributeEcShardsCapNeverExceedsN I1117 09:41:27.893754 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.893940 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.894587 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.894654 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.935450 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.935504 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.935983 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.936219 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.936271 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.936454 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.936712 shard_distribution.go:137 All shards distributed to destination server I1117 09:41:27.936880 shard_distribution.go:137 All shards distributed to destination server --- PASS: TestDistributeEcShardsCapNeverExceedsN (0.05s) === RUN TestDistributeEcShardsErrorAbortSameKey I1117 09:41:27.939920 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.940401 shard_distribution.go:137 Starting shard file transfer I1117 09:41:27.940629 shard_distribution.go:137 Shard file transfer completed I1117 09:41:27.940799 shard_distribution.go:137 Starting shard file transfer --- PASS: TestDistributeEcShardsErrorAbortSameKey (0.00s) === RUN TestDistributeEcShardsErrorAbortCancelsOtherKeys I1117 09:41:27.943958 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.944142 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.944295 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.944744 shard_distribution.go:137 Starting shard file transfer --- PASS: TestDistributeEcShardsErrorAbortCancelsOtherKeys (0.00s) === RUN TestDistributeEcShardsMissingFile I1117 09:41:27.947466 shard_distribution.go:137 Starting shard distribution to destination server I1117 09:41:27.948190 shard_distribution.go:137 Starting shard distribution to destination server --- PASS: TestDistributeEcShardsMissingFile (0.00s) === RUN TestShardTransferKeyUsesDestNodeNotRack --- PASS: TestShardTransferKeyUsesDestNodeNotRack (0.00s) === RUN TestRequireRecoverableShardSet_AllPresent --- PASS: TestRequireRecoverableShardSet_AllPresent (0.00s) === RUN TestRequireRecoverableShardSet_DegradedButRecoverable --- PASS: TestRequireRecoverableShardSet_DegradedButRecoverable (0.00s) === RUN TestRequireRecoverableShardSet_BelowDataShards --- PASS: TestRequireRecoverableShardSet_BelowDataShards (0.00s) === RUN TestRequireRecoverableShardSet_EmptyBitmap --- PASS: TestRequireRecoverableShardSet_EmptyBitmap (0.00s) === RUN TestRequireRecoverableShardSet_CustomRatio --- PASS: TestRequireRecoverableShardSet_CustomRatio (0.00s) === RUN TestRequireRecoverableShardSet_RejectsInvalidParams --- PASS: TestRequireRecoverableShardSet_RejectsInvalidParams (0.00s) === RUN TestSummarizeShardInventory_Deterministic --- PASS: TestSummarizeShardInventory_Deterministic (0.00s) === RUN TestSummarizeShardInventory_IncludesError --- PASS: TestSummarizeShardInventory_IncludesError (0.00s) === RUN TestHasLiveNeedles_AllDeletedIsFalse --- PASS: TestHasLiveNeedles_AllDeletedIsFalse (0.00s) === RUN TestHasLiveNeedles_WithLiveEntryIsTrue --- PASS: TestHasLiveNeedles_WithLiveEntryIsTrue (0.00s) === RUN TestHasLiveNeedles_EmptyFileIsFalse --- PASS: TestHasLiveNeedles_EmptyFileIsFalse (0.00s) === RUN TestHasLiveNeedles_TruncatedEcxErrors --- PASS: TestHasLiveNeedles_TruncatedEcxErrors (0.00s) === RUN TestWriteIdxFileFromEcIndex_PreservesDeletedNeedles --- PASS: TestWriteIdxFileFromEcIndex_PreservesDeletedNeedles (0.00s) === RUN TestWriteIdxFileFromEcIndex_ProcessesEcjJournal --- PASS: TestWriteIdxFileFromEcIndex_ProcessesEcjJournal (0.00s) === RUN TestDecodeAtomicPublish --- PASS: TestDecodeAtomicPublish (0.00s) === RUN TestDecodeWithNonEmptyEcj_AllDeleted --- PASS: TestDecodeWithNonEmptyEcj_AllDeleted (0.00s) === RUN TestDecodeWithNonEmptyEcj_PartiallyDeleted --- PASS: TestDecodeWithNonEmptyEcj_PartiallyDeleted (0.00s) === RUN TestDecodeWithEmptyEcj --- PASS: TestDecodeWithEmptyEcj (0.00s) === RUN TestDecodeWithNoEcjFile --- PASS: TestDecodeWithNoEcjFile (0.00s) === RUN TestEcxFileDeletionVisibleAfterSync --- PASS: TestEcxFileDeletionVisibleAfterSync (0.00s) === RUN TestEcxFileDeletionWithSeparateHandles --- PASS: TestEcxFileDeletionWithSeparateHandles (0.00s) === RUN TestEcVolumeDeleteDurableToJournal W1117 09:41:27.991419 volume_info.go:47 empty volume info file /tmp/TestEcVolumeDeleteDurableToJournal3156217647/001/test_1.vif, treating as non-existent W1117 09:41:27.991922 ec_volume.go:425 vif file not found, using defaults, volumeId:1, filename:/tmp/TestEcVolumeDeleteDurableToJournal3156217647/001/test_1.vif --- PASS: TestEcVolumeDeleteDurableToJournal (0.00s) === RUN TestScrubLocal_SuppressesDeleteStateDisagreement W1117 09:41:27.996623 volume_info.go:47 empty volume info file /tmp/TestScrubLocal_SuppressesDeleteStateDisagreement1488158274/001/test_1.vif, treating as non-existent W1117 09:41:27.997082 ec_volume.go:425 vif file not found, using defaults, volumeId:1, filename:/tmp/TestScrubLocal_SuppressesDeleteStateDisagreement1488158274/001/test_1.vif --- PASS: TestScrubLocal_SuppressesDeleteStateDisagreement (0.01s) === RUN TestScrubLocal_ReportsGenuineSizeCorruption W1117 09:41:28.002734 volume_info.go:47 empty volume info file /tmp/TestScrubLocal_ReportsGenuineSizeCorruption1653867534/001/test_1.vif, treating as non-existent W1117 09:41:28.003193 ec_volume.go:425 vif file not found, using defaults, volumeId:1, filename:/tmp/TestScrubLocal_ReportsGenuineSizeCorruption1653867534/001/test_1.vif --- PASS: TestScrubLocal_ReportsGenuineSizeCorruption (0.00s) === RUN TestEcVolumeFileAndDeleteCountInitial W1117 09:41:28.007460 volume_info.go:47 empty volume info file /tmp/TestEcVolumeFileAndDeleteCountInitial831577033/001/test_1.vif, treating as non-existent W1117 09:41:28.007915 ec_volume.go:425 vif file not found, using defaults, volumeId:1, filename:/tmp/TestEcVolumeFileAndDeleteCountInitial831577033/001/test_1.vif --- PASS: TestEcVolumeFileAndDeleteCountInitial (0.00s) === RUN TestEcVolumeFileAndDeleteCountAfterDelete W1117 09:41:28.011159 volume_info.go:47 empty volume info file /tmp/TestEcVolumeFileAndDeleteCountAfterDelete2561766364/001/test_1.vif, treating as non-existent W1117 09:41:28.011603 ec_volume.go:425 vif file not found, using defaults, volumeId:1, filename:/tmp/TestEcVolumeFileAndDeleteCountAfterDelete2561766364/001/test_1.vif --- PASS: TestEcVolumeFileAndDeleteCountAfterDelete (0.00s) === RUN TestEcjTornTailTruncatedOnMount W1117 09:41:28.015475 ec_volume.go:278 ec volume 7: truncating torn .ecj tail 29 -> 24 bytes W1117 09:41:28.016928 volume_info.go:47 empty volume info file /tmp/TestEcjTornTailTruncatedOnMount1977534989/001/7.vif, treating as non-existent W1117 09:41:28.017368 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestEcjTornTailTruncatedOnMount1977534989/001/7.vif W1117 09:41:28.019026 volume_info.go:47 empty volume info file /tmp/TestEcjTornTailTruncatedOnMount1977534989/001/7.vif, treating as non-existent W1117 09:41:28.019418 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestEcjTornTailTruncatedOnMount1977534989/001/7.vif --- PASS: TestEcjTornTailTruncatedOnMount (0.01s) === RUN TestEcjLoadsAcrossChunkBoundary W1117 09:41:28.649607 volume_info.go:47 empty volume info file /tmp/TestEcjLoadsAcrossChunkBoundary2801054901/001/7.vif, treating as non-existent W1117 09:41:28.650316 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestEcjLoadsAcrossChunkBoundary2801054901/001/7.vif --- PASS: TestEcjLoadsAcrossChunkBoundary (0.63s) === RUN TestEcjBloatedJournalCompactedOnMount W1117 09:41:29.430702 volume_info.go:47 empty volume info file /tmp/TestEcjBloatedJournalCompactedOnMount3342172533/001/7.vif, treating as non-existent W1117 09:41:29.431286 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestEcjBloatedJournalCompactedOnMount3342172533/001/7.vif W1117 09:41:29.431993 ec_volume.go:866 ec volume 7: compacting bloated .ecj deletion journal on-disk=8000000 unique=100 compacted=800 W1117 09:41:29.440967 volume_info.go:47 empty volume info file /tmp/TestEcjBloatedJournalCompactedOnMount3342172533/001/7.vif, treating as non-existent W1117 09:41:29.441415 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestEcjBloatedJournalCompactedOnMount3342172533/001/7.vif --- PASS: TestEcjBloatedJournalCompactedOnMount (0.79s) === RUN TestEcjHealthySmallJournalNotRewritten W1117 09:41:29.449876 volume_info.go:47 empty volume info file /tmp/TestEcjHealthySmallJournalNotRewritten81905192/001/7.vif, treating as non-existent W1117 09:41:29.450398 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestEcjHealthySmallJournalNotRewritten81905192/001/7.vif --- PASS: TestEcjHealthySmallJournalNotRewritten (0.01s) === RUN TestShardsInfoDeleteParityShards --- PASS: TestShardsInfoDeleteParityShards (0.00s) === RUN TestShardsInfoAsSlice --- PASS: TestShardsInfoAsSlice (0.00s) === RUN TestShardsInfoSerialize === RUN TestShardsInfoSerialize/no_bits === RUN TestShardsInfoSerialize/single_shard,_first === RUN TestShardsInfoSerialize/single_shard,_5th === RUN TestShardsInfoSerialize/multiple_shards --- PASS: TestShardsInfoSerialize (0.01s) --- PASS: TestShardsInfoSerialize/no_bits (0.00s) --- PASS: TestShardsInfoSerialize/single_shard,_first (0.00s) --- PASS: TestShardsInfoSerialize/single_shard,_5th (0.00s) --- PASS: TestShardsInfoSerialize/multiple_shards (0.00s) === RUN TestShardsInfoFromVolumeEcShardInformationMessage === RUN TestShardsInfoFromVolumeEcShardInformationMessage/no_msg === RUN TestShardsInfoFromVolumeEcShardInformationMessage/no_shards === RUN TestShardsInfoFromVolumeEcShardInformationMessage/single_shard === RUN TestShardsInfoFromVolumeEcShardInformationMessage/multiple_shards === RUN TestShardsInfoFromVolumeEcShardInformationMessage/multiple_shards_with_missing_sizes --- PASS: TestShardsInfoFromVolumeEcShardInformationMessage (0.00s) --- PASS: TestShardsInfoFromVolumeEcShardInformationMessage/no_msg (0.00s) --- PASS: TestShardsInfoFromVolumeEcShardInformationMessage/no_shards (0.00s) --- PASS: TestShardsInfoFromVolumeEcShardInformationMessage/single_shard (0.00s) --- PASS: TestShardsInfoFromVolumeEcShardInformationMessage/multiple_shards (0.00s) --- PASS: TestShardsInfoFromVolumeEcShardInformationMessage/multiple_shards_with_missing_sizes (0.00s) === RUN TestShardsInfoCombine --- PASS: TestShardsInfoCombine (0.00s) === RUN TestEcjIdDecoder_RecordsSplitAcrossChunks --- PASS: TestEcjIdDecoder_RecordsSplitAcrossChunks (0.01s) === RUN TestReadEcjIds --- PASS: TestReadEcjIds (0.53s) === RUN TestAppendEcjIds_AppendsOnlyMissingIds --- PASS: TestAppendEcjIds_AppendsOnlyMissingIds (0.00s) === RUN TestAppendEcjIds_RoundTripStaysConstant --- PASS: TestAppendEcjIds_RoundTripStaysConstant (0.01s) === RUN TestAppendEcjIds_NothingNewLeavesJournalAlone --- PASS: TestAppendEcjIds_NothingNewLeavesJournalAlone (0.00s) === RUN TestAppendEcjIds_RepairsTornTail --- PASS: TestAppendEcjIds_RepairsTornTail (0.00s) === RUN TestAppendEcjIds_RejectsChangedJournal --- PASS: TestAppendEcjIds_RejectsChangedJournal (0.00s) === RUN TestWriteEcjIds_Rollback --- PASS: TestWriteEcjIds_Rollback (0.00s) === RUN TestMergeJournal_MountedVolumeAppendsInPlace W1117 09:41:30.049872 volume_info.go:47 empty volume info file /tmp/TestMergeJournal_MountedVolumeAppendsInPlace1082207235/001/7.vif, treating as non-existent W1117 09:41:30.065359 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestMergeJournal_MountedVolumeAppendsInPlace1082207235/001/7.vif W1117 09:41:30.073442 volume_info.go:47 empty volume info file /tmp/TestMergeJournal_MountedVolumeAppendsInPlace1082207235/001/7.vif, treating as non-existent W1117 09:41:30.074195 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestMergeJournal_MountedVolumeAppendsInPlace1082207235/001/7.vif --- PASS: TestMergeJournal_MountedVolumeAppendsInPlace (0.03s) === RUN TestMergeJournal_ConcurrentDeletesPersist W1117 09:41:30.084838 volume_info.go:47 empty volume info file /tmp/TestMergeJournal_ConcurrentDeletesPersist3844681890/001/7.vif, treating as non-existent W1117 09:41:30.085339 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestMergeJournal_ConcurrentDeletesPersist3844681890/001/7.vif --- PASS: TestMergeJournal_ConcurrentDeletesPersist (0.03s) === RUN TestMergeJournal_ClosedVolume W1117 09:41:30.113071 volume_info.go:47 empty volume info file /tmp/TestMergeJournal_ClosedVolume2476899338/001/7.vif, treating as non-existent W1117 09:41:30.113542 ec_volume.go:425 vif file not found, using defaults, volumeId:7, filename:/tmp/TestMergeJournal_ClosedVolume2476899338/001/7.vif --- PASS: TestMergeJournal_ClosedVolume (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/erasure_coding 55.698s === RUN TestDefaultECConfig --- PASS: TestDefaultECConfig (0.01s) === RUN TestNewECConfig --- PASS: TestNewECConfig (0.00s) === RUN TestNewReplicationConfigFromString --- PASS: TestNewReplicationConfigFromString (0.00s) === RUN TestCalculateDistribution --- PASS: TestCalculateDistribution (0.00s) === RUN TestCalculateDistributionMaxWithinLossBudget --- PASS: TestCalculateDistributionMaxWithinLossBudget (0.00s) === RUN TestCalculateDistributionSingleDomain --- PASS: TestCalculateDistributionSingleDomain (0.00s) === RUN TestFaultToleranceAnalysis --- PASS: TestFaultToleranceAnalysis (0.00s) === RUN TestFaultToleranceAnalysisNotSurvivable --- PASS: TestFaultToleranceAnalysisNotSurvivable (0.00s) === RUN TestTopologyAnalysis --- PASS: TestTopologyAnalysis (0.01s) === RUN TestTopologyAnalysisDuplicateNode --- PASS: TestTopologyAnalysisDuplicateNode (0.00s) === RUN TestTopologyAnalysisNodeCapacityLateRegistration --- PASS: TestTopologyAnalysisNodeCapacityLateRegistration (0.00s) === RUN TestTopologyAnalysisAddShardLocation --- PASS: TestTopologyAnalysisAddShardLocation (0.01s) === RUN TestTopologyAnalysisSameRackNameAcrossDCs --- PASS: TestTopologyAnalysisSameRackNameAcrossDCs (0.00s) === RUN TestTopologyAnalysisSlashInNames --- PASS: TestTopologyAnalysisSlashInNames (0.00s) === RUN TestPlanRebalanceAcrossDCs --- PASS: TestPlanRebalanceAcrossDCs (0.03s) === RUN TestPlanRebalanceAcrossRacks --- PASS: TestPlanRebalanceAcrossRacks (0.02s) === RUN TestPlanRebalanceWithinRack --- PASS: TestPlanRebalanceWithinRack (0.01s) === RUN TestPlanRebalanceRespectsFreeSlots --- PASS: TestPlanRebalanceRespectsFreeSlots (0.01s) === RUN TestPlanRebalanceNoopWhenBalanced --- PASS: TestPlanRebalanceNoopWhenBalanced (0.00s) === RUN TestPlanRebalanceNilAnalysis --- PASS: TestPlanRebalanceNilAnalysis (0.00s) === RUN TestPlanRebalanceNodeTargetAfterMoves --- PASS: TestPlanRebalanceNodeTargetAfterMoves (0.03s) === RUN TestPlanRebalanceNoDuplicateShardInDomain --- PASS: TestPlanRebalanceNoDuplicateShardInDomain (0.02s) === RUN TestPlanRebalanceShardForUnregisteredNode --- PASS: TestPlanRebalanceShardForUnregisteredNode (0.01s) === RUN TestPlanRebalanceSkipsBlockedSource --- PASS: TestPlanRebalanceSkipsBlockedSource (0.01s) === RUN TestPlanRebalanceCollapsesChainedMoves --- PASS: TestPlanRebalanceCollapsesChainedMoves (0.01s) === RUN TestPlanRebalanceMovesRespectSlots --- PASS: TestPlanRebalanceMovesRespectSlots (0.01s) === RUN TestPlanRebalanceNoDuplicateShardOnNode --- PASS: TestPlanRebalanceNoDuplicateShardOnNode (0.04s) === RUN TestCalculateDistributionZeroReplication --- PASS: TestCalculateDistributionZeroReplication (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/erasure_coding/distribution 2.561s === RUN TestPlanTotalShardsPerRackCap === RUN TestPlanTotalShardsPerRackCap/threshold=0 balancer_rack_cap_test.go:95: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] === RUN TestPlanTotalShardsPerRackCap/threshold=0.2 balancer_rack_cap_test.go:95: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] --- PASS: TestPlanTotalShardsPerRackCap (0.08s) --- PASS: TestPlanTotalShardsPerRackCap/threshold=0 (0.04s) --- PASS: TestPlanTotalShardsPerRackCap/threshold=0.2 (0.01s) === RUN TestPlanTotalShardsPerRackCapTwoNodesPerRack === RUN TestPlanTotalShardsPerRackCapTwoNodesPerRack/threshold=0 balancer_rack_cap_test.go:113: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] === RUN TestPlanTotalShardsPerRackCapTwoNodesPerRack/threshold=0.2 balancer_rack_cap_test.go:113: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] --- PASS: TestPlanTotalShardsPerRackCapTwoNodesPerRack (0.05s) --- PASS: TestPlanTotalShardsPerRackCapTwoNodesPerRack/threshold=0 (0.03s) --- PASS: TestPlanTotalShardsPerRackCapTwoNodesPerRack/threshold=0.2 (0.02s) === RUN TestPlanTotalCapFromClumpedStart === RUN TestPlanTotalCapFromClumpedStart/threshold=0 balancer_rack_cap_test.go:131: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] === RUN TestPlanTotalCapFromClumpedStart/threshold=0.2 balancer_rack_cap_test.go:131: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] --- PASS: TestPlanTotalCapFromClumpedStart (0.02s) --- PASS: TestPlanTotalCapFromClumpedStart/threshold=0 (0.01s) --- PASS: TestPlanTotalCapFromClumpedStart/threshold=0.2 (0.01s) === RUN TestPlanTotalCapAllRacksBearData === RUN TestPlanTotalCapAllRacksBearData/threshold=0 balancer_rack_cap_test.go:145: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] === RUN TestPlanTotalCapAllRacksBearData/threshold=0.2 balancer_rack_cap_test.go:145: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] --- PASS: TestPlanTotalCapAllRacksBearData (0.12s) --- PASS: TestPlanTotalCapAllRacksBearData/threshold=0 (0.10s) --- PASS: TestPlanTotalCapAllRacksBearData/threshold=0.2 (0.01s) === RUN TestPlanTotalCapParityOnDataRacks === RUN TestPlanTotalCapParityOnDataRacks/threshold=0 balancer_rack_cap_test.go:163: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] === RUN TestPlanTotalCapParityOnDataRacks/threshold=0.2 balancer_rack_cap_test.go:163: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] --- PASS: TestPlanTotalCapParityOnDataRacks (0.02s) --- PASS: TestPlanTotalCapParityOnDataRacks/threshold=0 (0.01s) --- PASS: TestPlanTotalCapParityOnDataRacks/threshold=0.2 (0.01s) === RUN TestPlanTotalCapIgnoresImbalanceThreshold balancer_rack_cap_test.go:176: total shards per rack: map[dc1:rack1:2 dc1:rack2:2 dc1:rack3:2 dc1:rack4:2 dc1:rack5:2 dc1:rack6:2 dc1:rack7:1 dc1:rack8:1] --- PASS: TestPlanTotalCapIgnoresImbalanceThreshold (0.01s) === RUN TestPlanTotalCapWithNearlyFullRack === RUN TestPlanTotalCapWithNearlyFullRack/threshold=0 balancer_rack_cap_test.go:197: total shards per rack: map[dc1:hdd0:2 dc1:hdd1:2 dc1:hdd2:2 dc1:hdd3:2 dc1:hdd4:2 dc1:hdd5:1 dc1:hdd6:1 dc1:hdd7:1 dc1:ssd:1] === RUN TestPlanTotalCapWithNearlyFullRack/threshold=0.2 balancer_rack_cap_test.go:197: total shards per rack: map[dc1:hdd0:2 dc1:hdd1:2 dc1:hdd2:2 dc1:hdd3:2 dc1:hdd4:2 dc1:hdd5:1 dc1:hdd6:1 dc1:hdd7:1 dc1:ssd:1] --- PASS: TestPlanTotalCapWithNearlyFullRack (0.04s) --- PASS: TestPlanTotalCapWithNearlyFullRack/threshold=0 (0.02s) --- PASS: TestPlanTotalCapWithNearlyFullRack/threshold=0.2 (0.01s) === RUN TestPlanTotalCapRisesWhenRacksAreFull === RUN TestPlanTotalCapRisesWhenRacksAreFull/threshold=0 balancer_rack_cap_test.go:218: total shards per rack: map[dc1:rack1:1 dc1:rack2:3 dc1:rack3:3 dc1:rack4:3 dc1:rack5:2 dc1:rack6:2 dc1:rack7:0 dc1:rack8:0] === RUN TestPlanTotalCapRisesWhenRacksAreFull/threshold=0.2 balancer_rack_cap_test.go:218: total shards per rack: map[dc1:rack1:1 dc1:rack2:3 dc1:rack3:3 dc1:rack4:3 dc1:rack5:2 dc1:rack6:2 dc1:rack7:0 dc1:rack8:0] --- PASS: TestPlanTotalCapRisesWhenRacksAreFull (0.02s) --- PASS: TestPlanTotalCapRisesWhenRacksAreFull/threshold=0 (0.01s) --- PASS: TestPlanTotalCapRisesWhenRacksAreFull/threshold=0.2 (0.01s) === RUN TestPlanRackTotalCap === RUN TestPlanRackTotalCap/all_on_one_rack === RUN TestPlanRackTotalCap/even_over_5 === RUN TestPlanRackTotalCap/two_full_empty_racks === RUN TestPlanRackTotalCap/small_nearly_full_ninth_rack === RUN TestPlanRackTotalCap/only_the_holding_rack_has_room --- PASS: TestPlanRackTotalCap (0.01s) --- PASS: TestPlanRackTotalCap/all_on_one_rack (0.00s) --- PASS: TestPlanRackTotalCap/even_over_5 (0.00s) --- PASS: TestPlanRackTotalCap/two_full_empty_racks (0.00s) --- PASS: TestPlanRackTotalCap/small_nearly_full_ninth_rack (0.00s) --- PASS: TestPlanRackTotalCap/only_the_holding_rack_has_room (0.00s) === RUN TestPlanTotalCapDataRackWaitsForParitySlot === RUN TestPlanTotalCapDataRackWaitsForParitySlot/threshold=0 balancer_rack_cap_test.go:287: total shards per rack: map[dc1:rack1:3 dc1:rack2:3 dc1:rack3:3 dc1:rack4:2 dc1:rack5:3] === RUN TestPlanTotalCapDataRackWaitsForParitySlot/threshold=0.2 balancer_rack_cap_test.go:287: total shards per rack: map[dc1:rack1:3 dc1:rack2:3 dc1:rack3:3 dc1:rack4:2 dc1:rack5:3] --- PASS: TestPlanTotalCapDataRackWaitsForParitySlot (0.02s) --- PASS: TestPlanTotalCapDataRackWaitsForParitySlot/threshold=0 (0.01s) --- PASS: TestPlanTotalCapDataRackWaitsForParitySlot/threshold=0.2 (0.01s) === RUN TestPlanTotalCapCountsSameRackCount --- PASS: TestPlanTotalCapCountsSameRackCount (0.01s) === RUN TestPickBestDiskOnNode === RUN TestPickBestDiskOnNode/skips_disks_with_no_free_slots === RUN TestPickBestDiskOnNode/spreads_a_volume's_shards_across_disks === RUN TestPickBestDiskOnNode/data_shard_avoids_disk_holding_parity === RUN TestPickBestDiskOnNode/anti-affinity_follows_the_supplied_ratio_boundary === RUN TestPickBestDiskOnNode/only_matching_disk_type_when_set --- PASS: TestPickBestDiskOnNode (0.01s) --- PASS: TestPickBestDiskOnNode/skips_disks_with_no_free_slots (0.00s) --- PASS: TestPickBestDiskOnNode/spreads_a_volume's_shards_across_disks (0.00s) --- PASS: TestPickBestDiskOnNode/data_shard_avoids_disk_holding_parity (0.00s) --- PASS: TestPickBestDiskOnNode/anti-affinity_follows_the_supplied_ratio_boundary (0.00s) --- PASS: TestPickBestDiskOnNode/only_matching_disk_type_when_set (0.00s) === RUN TestPickBestNodeForVolume === RUN TestPickBestNodeForVolume/more_free_slots_wins_the_count_tie === RUN TestPickBestNodeForVolume/fewer_live_shards_wins_the_free_tie === RUN TestPickBestNodeForVolume/volume_spread_beats_free_slots --- PASS: TestPickBestNodeForVolume (0.01s) --- PASS: TestPickBestNodeForVolume/more_free_slots_wins_the_count_tie (0.00s) --- PASS: TestPickBestNodeForVolume/fewer_live_shards_wins_the_free_tie (0.00s) --- PASS: TestPickBestNodeForVolume/volume_spread_beats_free_slots (0.00s) === RUN TestPlanSkipsDestinationsWithoutMatchingDiskType --- PASS: TestPlanSkipsDestinationsWithoutMatchingDiskType (0.01s) === RUN TestPlanSourceDiskAttribution --- PASS: TestPlanSourceDiskAttribution (0.01s) === RUN TestPlanSpreadsAcrossDestinationDisks --- PASS: TestPlanSpreadsAcrossDestinationDisks (0.01s) === RUN TestPlanCrossRackParityAntiAffinity --- PASS: TestPlanCrossRackParityAntiAffinity (0.00s) === RUN TestWithinRackParityAntiAffinity --- PASS: TestWithinRackParityAntiAffinity (0.00s) === RUN TestPlanReplicaPlacementCapsPerRack --- PASS: TestPlanReplicaPlacementCapsPerRack (0.01s) === RUN TestPlanDedup --- PASS: TestPlanDedup (0.00s) === RUN TestCeilDivide --- PASS: TestCeilDivide (0.00s) === RUN TestPlanConvergesToBalancedLoadOverRounds balancer_test.go:400: converged after 8 rounds: map[10.0.0.1:140 10.0.0.2:140 10.0.0.3:140 10.0.0.4:140 10.0.0.5:140 10.0.0.6:140] --- PASS: TestPlanConvergesToBalancedLoadOverRounds (0.76s) === RUN TestGlobalImbalanceMovesFromFullToEmpty --- PASS: TestGlobalImbalanceMovesFromFullToEmpty (0.00s) === RUN TestGlobalImbalanceHeterogeneousCapacity --- PASS: TestGlobalImbalanceHeterogeneousCapacity (0.00s) === RUN TestGlobalImbalanceSkipsFullNodes --- PASS: TestGlobalImbalanceSkipsFullNodes (0.00s) === RUN TestPlanBalancesSkewedDataParityWithEvenTotals --- PASS: TestPlanBalancesSkewedDataParityWithEvenTotals (0.00s) === RUN TestPlanVolumeRatioOverridesCollection --- PASS: TestPlanVolumeRatioOverridesCollection (0.01s) === RUN TestGlobalPrefersVolumeAbsentFromDestination --- PASS: TestGlobalPrefersVolumeAbsentFromDestination (0.00s) === RUN TestPlanKeepsCollectionsWithSameVolumeIdDistinct --- PASS: TestPlanKeepsCollectionsWithSameVolumeIdDistinct (0.00s) === RUN TestDedupFreesCapacityForLaterPhases --- PASS: TestDedupFreesCapacityForLaterPhases (0.00s) === RUN TestWithinRackSpreadsAcrossMachines --- PASS: TestWithinRackSpreadsAcrossMachines (0.00s) === RUN TestWithinRackMachineSpreadBalancesCombinedOccupancy --- PASS: TestWithinRackMachineSpreadBalancesCombinedOccupancy (0.02s) === RUN TestWithinRackMachineSpreadActsOnExactlyHalfSkew --- PASS: TestWithinRackMachineSpreadActsOnExactlyHalfSkew (0.02s) === RUN TestWithinRackSpreadUsesRackLocalShardCount --- PASS: TestWithinRackSpreadUsesRackLocalShardCount (0.00s) === RUN TestWithinRackNodeFallbackHonorsThreshold --- PASS: TestWithinRackNodeFallbackHonorsThreshold (0.00s) === RUN TestWithinRackSpreadDefaultsToNodes --- PASS: TestWithinRackSpreadDefaultsToNodes (0.00s) === RUN TestGlobalDoesNotConcentrateVolumeAcrossMachines --- PASS: TestGlobalDoesNotConcentrateVolumeAcrossMachines (0.00s) === RUN TestWithinRackMachineSkipsCappedMachine --- PASS: TestWithinRackMachineSkipsCappedMachine (0.00s) === RUN TestGlobalPrefersVolumeAbsentFromDestinationMachine --- PASS: TestGlobalPrefersVolumeAbsentFromDestinationMachine (0.00s) === RUN TestNoReceiveNodeNeverTargeted --- PASS: TestNoReceiveNodeNeverTargeted (0.00s) === RUN TestNoReceiveDiskLeavesSiblingsEligible --- PASS: TestNoReceiveDiskLeavesSiblingsEligible (0.00s) === RUN TestGlobalDrainsToSameMachineWhenOtherMachinesAreBlocked --- PASS: TestGlobalDrainsToSameMachineWhenOtherMachinesAreBlocked (0.01s) === RUN TestGlobalTriesTargetsByFullnessAfterTheMove --- PASS: TestGlobalTriesTargetsByFullnessAfterTheMove (0.00s) === RUN TestGlobalMoveFreesTheSourceDisk --- PASS: TestGlobalMoveFreesTheSourceDisk (0.00s) === RUN TestGlobalSameMachineMoveSkipsASiblingHoldingTheVolume --- PASS: TestGlobalSameMachineMoveSkipsASiblingHoldingTheVolume (0.00s) === RUN TestPlaceTotalShardsPerRackCap === RUN TestPlaceTotalShardsPerRackCap/strict place_rack_cap_test.go:88: total shards per rack: map[rack0:2 rack1:2 rack2:2 rack3:2 rack4:2 rack5:2 rack6:1 rack7:1] === RUN TestPlaceTotalShardsPerRackCap/durability-first place_rack_cap_test.go:88: total shards per rack: map[rack0:2 rack1:2 rack2:2 rack3:2 rack4:2 rack5:2 rack6:1 rack7:1] --- PASS: TestPlaceTotalShardsPerRackCap (0.14s) --- PASS: TestPlaceTotalShardsPerRackCap/strict (0.12s) --- PASS: TestPlaceTotalShardsPerRackCap/durability-first (0.02s) === RUN TestPlaceTotalCapWithStarvedRack place_rack_cap_test.go:103: total shards per rack: map[rack0:1 rack1:2 rack2:2 rack3:2 rack4:2 rack5:2 rack6:2 rack7:1] --- PASS: TestPlaceTotalCapWithStarvedRack (0.01s) === RUN TestPlaceTotalCapRisesForNearlyFullRacks === RUN TestPlaceTotalCapRisesForNearlyFullRacks/3_racks,_one_with_1_slot place_rack_cap_test.go:152: total shards per rack: map[rack0:7 rack1:6 rack2:1] === RUN TestPlaceTotalCapRisesForNearlyFullRacks/8_racks,_seven_with_1_slot place_rack_cap_test.go:152: total shards per rack: map[rack0:7 rack1:1 rack2:1 rack3:1 rack4:1 rack5:1 rack6:1 rack7:1] --- PASS: TestPlaceTotalCapRisesForNearlyFullRacks (0.02s) --- PASS: TestPlaceTotalCapRisesForNearlyFullRacks/3_racks,_one_with_1_slot (0.01s) --- PASS: TestPlaceTotalCapRisesForNearlyFullRacks/8_racks,_seven_with_1_slot (0.01s) === RUN TestPlaceTotalCapKeepsPreferredTagTier place_rack_cap_test.go:197: total shards per rack: map[rack0:6 rack1:6 rack2:2] --- PASS: TestPlaceTotalCapKeepsPreferredTagTier (0.01s) === RUN TestPlaceSkipsRackWithFullDisks place_rack_cap_test.go:212: total shards per rack: map[rack0:10 rack1:4] --- PASS: TestPlaceSkipsRackWithFullDisks (0.01s) === RUN TestPlaceTotalCapCountsSameRackCount === RUN TestPlaceTotalCapCountsSameRackCount/strict place_rack_cap_test.go:247: total shards per rack: map[rack0:1 rack1:1 rack2:1 rack3:1 rack4:3 rack5:3 rack6:2 rack7:2] === RUN TestPlaceTotalCapCountsSameRackCount/durability-first place_rack_cap_test.go:247: total shards per rack: map[rack0:1 rack1:1 rack2:1 rack3:1 rack4:3 rack5:3 rack6:2 rack7:2] --- PASS: TestPlaceTotalCapCountsSameRackCount (0.04s) --- PASS: TestPlaceTotalCapCountsSameRackCount/strict (0.02s) --- PASS: TestPlaceTotalCapCountsSameRackCount/durability-first (0.01s) === RUN TestRackTotalCap === RUN TestRackTotalCap/even_over_8 === RUN TestRackTotalCap/even_over_5 === RUN TestRackTotalCap/one_rack_with_1_slot === RUN TestRackTotalCap/one_rack_full === RUN TestRackTotalCap/held_above_even_share === RUN TestRackTotalCap/not_enough_room --- PASS: TestRackTotalCap (0.01s) --- PASS: TestRackTotalCap/even_over_8 (0.00s) --- PASS: TestRackTotalCap/even_over_5 (0.00s) --- PASS: TestRackTotalCap/one_rack_with_1_slot (0.00s) --- PASS: TestRackTotalCap/one_rack_full (0.00s) --- PASS: TestRackTotalCap/held_above_even_share (0.00s) --- PASS: TestRackTotalCap/not_enough_room (0.00s) === RUN TestPlaceStrictSpreadAndCaps --- PASS: TestPlaceStrictSpreadAndCaps (0.01s) === RUN TestPlaceDistributesEvenlyAcrossManyVolumes --- PASS: TestPlaceDistributesEvenlyAcrossManyVolumes (1.17s) === RUN TestPlaceSpreadsAcrossMachines --- PASS: TestPlaceSpreadsAcrossMachines (0.01s) === RUN TestPlaceStrictFailsAndRollsBack --- PASS: TestPlaceStrictFailsAndRollsBack (0.00s) === RUN TestPlaceDurabilityFirstRelaxesRP --- PASS: TestPlaceDurabilityFirstRelaxesRP (0.02s) === RUN TestPlaceSameRackCountIsDirectPerNodeCap --- PASS: TestPlaceSameRackCountIsDirectPerNodeCap (0.02s) === RUN TestPlaceDiskTypeHardFilter --- PASS: TestPlaceDiskTypeHardFilter (0.01s) === RUN TestPlaceDiskTypeUnavailableFails --- PASS: TestPlaceDiskTypeUnavailableFails (0.00s) === RUN TestPlaceHDDRequestMatchesEmptyTypeDisks --- PASS: TestPlaceHDDRequestMatchesEmptyTypeDisks (0.01s) === RUN TestPlaceDurabilityCapRejectsSkewed --- PASS: TestPlaceDurabilityCapRejectsSkewed (0.00s) === RUN TestReleaseVolumeShards --- PASS: TestReleaseVolumeShards (0.00s) === RUN TestClearShardAccounting --- PASS: TestClearShardAccounting (0.00s) === RUN TestPlaceDiskTypePreferSpills --- PASS: TestPlaceDiskTypePreferSpills (0.01s) === RUN TestPlacePreferredTagsUseTaggedDisks --- PASS: TestPlacePreferredTagsUseTaggedDisks (0.01s) === RUN TestPlacePreferredTagsSpillWhenInsufficient --- PASS: TestPlacePreferredTagsSpillWhenInsufficient (0.01s) === RUN TestPlaceStrictCapsCountEligibleRacks --- PASS: TestPlaceStrictCapsCountEligibleRacks (0.01s) === RUN TestPlaceRotatesExtraRackShardsAcrossVolumes --- PASS: TestPlaceRotatesExtraRackShardsAcrossVolumes (0.04s) === RUN TestWithinRackPaysDownShardDebt3 --- PASS: TestWithinRackPaysDownShardDebt3 (0.03s) === RUN TestWithinRackFourShardsStayEven --- PASS: TestWithinRackFourShardsStayEven (0.00s) === RUN TestEcVolumeCountIsNotScore --- PASS: TestEcVolumeCountIsNotScore (0.13s) === RUN TestFreeSlotsWinsAsymmetricExtras --- PASS: TestFreeSlotsWinsAsymmetricExtras (0.00s) === RUN TestReleaseVolumeShardsKeepsOtherLiveCounts --- PASS: TestReleaseVolumeShardsKeepsOtherLiveCounts (0.00s) === RUN TestPlace10Plus4ImbalanceTiebreak === RUN TestPlace10Plus4ImbalanceTiebreak/1-1-4 === RUN TestPlace10Plus4ImbalanceTiebreak/1-1-6 === RUN TestPlace10Plus4ImbalanceTiebreak/1-1-8 === RUN TestPlace10Plus4ImbalanceTiebreak/1-1-15 === RUN TestPlace10Plus4ImbalanceTiebreak/1-1-7 === RUN TestPlace10Plus4ImbalanceTiebreak/7-1-2 === RUN TestPlace10Plus4ImbalanceTiebreak/4-2-3 === RUN TestPlace10Plus4ImbalanceTiebreak/5-2-2 === RUN TestPlace10Plus4ImbalanceTiebreak/6-1-2 --- PASS: TestPlace10Plus4ImbalanceTiebreak (0.07s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/1-1-4 (0.01s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/1-1-6 (0.01s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/1-1-8 (0.00s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/1-1-15 (0.01s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/1-1-7 (0.01s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/7-1-2 (0.01s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/4-2-3 (0.01s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/5-2-2 (0.01s) --- PASS: TestPlace10Plus4ImbalanceTiebreak/6-1-2 (0.01s) === RUN TestVolumeDeadbandToShardSlots --- PASS: TestVolumeDeadbandToShardSlots (0.00s) === RUN TestAbsIntDiff --- PASS: TestAbsIntDiff (0.00s) === RUN TestFreeSlotsDeadbandDefersToLiveShards --- PASS: TestFreeSlotsDeadbandDefersToLiveShards (0.00s) === RUN TestFreeSlotsDeadbandZeroExactTieUsesLiveShards --- PASS: TestFreeSlotsDeadbandZeroExactTieUsesLiveShards (0.00s) === RUN TestFreeSlotsDeadbandStillHonorsLargeGap --- PASS: TestFreeSlotsDeadbandStillHonorsLargeGap (0.00s) === RUN TestFreeSlotsDeadbandScalesWithRatio --- PASS: TestFreeSlotsDeadbandScalesWithRatio (0.00s) === RUN TestRackDeadbandDefersToLiveShards --- PASS: TestRackDeadbandDefersToLiveShards (0.00s) === RUN TestRackDeadbandStillHonorsLargeGap --- PASS: TestRackDeadbandStillHonorsLargeGap (0.00s) === RUN TestNodeDeadbandAnchorsOnMaxFree === RUN TestNodeDeadbandAnchorsOnMaxFree/high-to-low === RUN TestNodeDeadbandAnchorsOnMaxFree/low-to-high --- PASS: TestNodeDeadbandAnchorsOnMaxFree (0.01s) --- PASS: TestNodeDeadbandAnchorsOnMaxFree/high-to-low (0.00s) --- PASS: TestNodeDeadbandAnchorsOnMaxFree/low-to-high (0.00s) === RUN TestRackDeadbandAnchorsOnMaxFree === RUN TestRackDeadbandAnchorsOnMaxFree/high-to-low === RUN TestRackDeadbandAnchorsOnMaxFree/low-to-high --- PASS: TestRackDeadbandAnchorsOnMaxFree (0.01s) --- PASS: TestRackDeadbandAnchorsOnMaxFree/high-to-low (0.00s) --- PASS: TestRackDeadbandAnchorsOnMaxFree/low-to-high (0.00s) === RUN TestSmallRatioAcrossThreeDCs === RUN TestSmallRatioAcrossThreeDCs/000/000 === RUN TestSmallRatioAcrossThreeDCs/000/001 === RUN TestSmallRatioAcrossThreeDCs/000/002 === RUN TestSmallRatioAcrossThreeDCs/000/010 === RUN TestSmallRatioAcrossThreeDCs/000/011 === RUN TestSmallRatioAcrossThreeDCs/000/012 === RUN TestSmallRatioAcrossThreeDCs/000/020 === RUN TestSmallRatioAcrossThreeDCs/000/021 === RUN TestSmallRatioAcrossThreeDCs/000/022 === RUN TestSmallRatioAcrossThreeDCs/000/100 === RUN TestSmallRatioAcrossThreeDCs/000/101 === RUN TestSmallRatioAcrossThreeDCs/000/102 === RUN TestSmallRatioAcrossThreeDCs/000/110 === RUN TestSmallRatioAcrossThreeDCs/000/111 === RUN TestSmallRatioAcrossThreeDCs/000/112 === RUN TestSmallRatioAcrossThreeDCs/000/120 === RUN TestSmallRatioAcrossThreeDCs/000/121 === RUN TestSmallRatioAcrossThreeDCs/000/122 === RUN TestSmallRatioAcrossThreeDCs/000/200 === RUN TestSmallRatioAcrossThreeDCs/000/201 === RUN TestSmallRatioAcrossThreeDCs/000/202 === RUN TestSmallRatioAcrossThreeDCs/000/210 === RUN TestSmallRatioAcrossThreeDCs/000/211 === RUN TestSmallRatioAcrossThreeDCs/000/212 === RUN TestSmallRatioAcrossThreeDCs/000/220 === RUN TestSmallRatioAcrossThreeDCs/000/221 === RUN TestSmallRatioAcrossThreeDCs/000/222 === RUN TestSmallRatioAcrossThreeDCs/200/000 === RUN TestSmallRatioAcrossThreeDCs/200/001 === RUN TestSmallRatioAcrossThreeDCs/200/002 === RUN TestSmallRatioAcrossThreeDCs/200/010 === RUN TestSmallRatioAcrossThreeDCs/200/011 === RUN TestSmallRatioAcrossThreeDCs/200/012 === RUN TestSmallRatioAcrossThreeDCs/200/020 === RUN TestSmallRatioAcrossThreeDCs/200/021 === RUN TestSmallRatioAcrossThreeDCs/200/022 === RUN TestSmallRatioAcrossThreeDCs/200/100 === RUN TestSmallRatioAcrossThreeDCs/200/101 === RUN TestSmallRatioAcrossThreeDCs/200/102 === RUN TestSmallRatioAcrossThreeDCs/200/110 === RUN TestSmallRatioAcrossThreeDCs/200/111 === RUN TestSmallRatioAcrossThreeDCs/200/112 === RUN TestSmallRatioAcrossThreeDCs/200/120 === RUN TestSmallRatioAcrossThreeDCs/200/121 === RUN TestSmallRatioAcrossThreeDCs/200/122 === RUN TestSmallRatioAcrossThreeDCs/200/200 === RUN TestSmallRatioAcrossThreeDCs/200/201 === RUN TestSmallRatioAcrossThreeDCs/200/202 === RUN TestSmallRatioAcrossThreeDCs/200/210 === RUN TestSmallRatioAcrossThreeDCs/200/211 === RUN TestSmallRatioAcrossThreeDCs/200/212 === RUN TestSmallRatioAcrossThreeDCs/200/220 === RUN TestSmallRatioAcrossThreeDCs/200/221 === RUN TestSmallRatioAcrossThreeDCs/200/222 === RUN TestSmallRatioAcrossThreeDCs/211/000 === RUN TestSmallRatioAcrossThreeDCs/211/001 === RUN TestSmallRatioAcrossThreeDCs/211/002 === RUN TestSmallRatioAcrossThreeDCs/211/010 === RUN TestSmallRatioAcrossThreeDCs/211/011 === RUN TestSmallRatioAcrossThreeDCs/211/012 === RUN TestSmallRatioAcrossThreeDCs/211/020 === RUN TestSmallRatioAcrossThreeDCs/211/021 === RUN TestSmallRatioAcrossThreeDCs/211/022 === RUN TestSmallRatioAcrossThreeDCs/211/100 === RUN TestSmallRatioAcrossThreeDCs/211/101 === RUN TestSmallRatioAcrossThreeDCs/211/102 === RUN TestSmallRatioAcrossThreeDCs/211/110 === RUN TestSmallRatioAcrossThreeDCs/211/111 === RUN TestSmallRatioAcrossThreeDCs/211/112 === RUN TestSmallRatioAcrossThreeDCs/211/120 === RUN TestSmallRatioAcrossThreeDCs/211/121 === RUN TestSmallRatioAcrossThreeDCs/211/122 === RUN TestSmallRatioAcrossThreeDCs/211/200 === RUN TestSmallRatioAcrossThreeDCs/211/201 === RUN TestSmallRatioAcrossThreeDCs/211/202 === RUN TestSmallRatioAcrossThreeDCs/211/210 === RUN TestSmallRatioAcrossThreeDCs/211/211 === RUN TestSmallRatioAcrossThreeDCs/211/212 === RUN TestSmallRatioAcrossThreeDCs/211/220 === RUN TestSmallRatioAcrossThreeDCs/211/221 === RUN TestSmallRatioAcrossThreeDCs/211/222 === RUN TestSmallRatioAcrossThreeDCs/011/000 === RUN TestSmallRatioAcrossThreeDCs/011/001 === RUN TestSmallRatioAcrossThreeDCs/011/002 === RUN TestSmallRatioAcrossThreeDCs/011/010 === RUN TestSmallRatioAcrossThreeDCs/011/011 === RUN TestSmallRatioAcrossThreeDCs/011/012 === RUN TestSmallRatioAcrossThreeDCs/011/020 === RUN TestSmallRatioAcrossThreeDCs/011/021 === RUN TestSmallRatioAcrossThreeDCs/011/022 === RUN TestSmallRatioAcrossThreeDCs/011/100 === RUN TestSmallRatioAcrossThreeDCs/011/101 === RUN TestSmallRatioAcrossThreeDCs/011/102 === RUN TestSmallRatioAcrossThreeDCs/011/110 === RUN TestSmallRatioAcrossThreeDCs/011/111 === RUN TestSmallRatioAcrossThreeDCs/011/112 === RUN TestSmallRatioAcrossThreeDCs/011/120 === RUN TestSmallRatioAcrossThreeDCs/011/121 === RUN TestSmallRatioAcrossThreeDCs/011/122 === RUN TestSmallRatioAcrossThreeDCs/011/200 === RUN TestSmallRatioAcrossThreeDCs/011/201 === RUN TestSmallRatioAcrossThreeDCs/011/202 === RUN TestSmallRatioAcrossThreeDCs/011/210 === RUN TestSmallRatioAcrossThreeDCs/011/211 === RUN TestSmallRatioAcrossThreeDCs/011/212 === RUN TestSmallRatioAcrossThreeDCs/011/220 === RUN TestSmallRatioAcrossThreeDCs/011/221 === RUN TestSmallRatioAcrossThreeDCs/011/222 --- PASS: TestSmallRatioAcrossThreeDCs (0.44s) --- PASS: TestSmallRatioAcrossThreeDCs/000/000 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/001 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/002 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/010 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/011 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/012 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/020 (0.01s) --- PASS: TestSmallRatioAcrossThreeDCs/000/021 (0.01s) --- PASS: TestSmallRatioAcrossThreeDCs/000/022 (0.01s) --- PASS: TestSmallRatioAcrossThreeDCs/000/100 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/101 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/102 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/110 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/111 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/112 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/120 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/121 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/122 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/200 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/201 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/202 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/210 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/211 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/212 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/220 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/221 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/000/222 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/000 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/001 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/002 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/010 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/011 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/012 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/020 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/021 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/022 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/100 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/101 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/102 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/110 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/111 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/112 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/120 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/121 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/122 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/200 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/201 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/202 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/210 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/211 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/212 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/220 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/221 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/200/222 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/000 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/001 (0.01s) --- PASS: TestSmallRatioAcrossThreeDCs/211/002 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/010 (0.01s) --- PASS: TestSmallRatioAcrossThreeDCs/211/011 (0.01s) --- PASS: TestSmallRatioAcrossThreeDCs/211/012 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/020 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/021 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/022 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/100 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/101 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/102 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/110 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/111 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/112 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/120 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/121 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/122 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/200 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/201 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/202 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/210 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/211 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/212 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/220 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/211/221 (0.01s) --- PASS: TestSmallRatioAcrossThreeDCs/211/222 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/000 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/001 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/002 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/010 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/011 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/012 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/020 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/021 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/022 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/100 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/101 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/102 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/110 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/111 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/112 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/120 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/121 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/122 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/200 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/201 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/202 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/210 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/211 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/212 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/220 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/221 (0.00s) --- PASS: TestSmallRatioAcrossThreeDCs/011/222 (0.00s) === RUN TestSmallRatioDoesNotMoveParityToFullRack --- PASS: TestSmallRatioDoesNotMoveParityToFullRack (0.00s) === RUN TestFromActiveTopology --- PASS: TestFromActiveTopology (0.01s) === RUN TestFromActiveTopologySkipsPhysicallyFullDisk --- PASS: TestFromActiveTopologySkipsPhysicallyFullDisk (0.00s) === RUN TestFromActiveTopologyGroupsByAddressHost --- PASS: TestFromActiveTopologyGroupsByAddressHost (0.00s) === RUN TestEcShardSlotsOnDiskRoundsUp --- PASS: TestEcShardSlotsOnDiskRoundsUp (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/erasure_coding/ecbalancer 6.165s === RUN TestCheckIndexFile_IgnoresOffset0Tombstone --- PASS: TestCheckIndexFile_IgnoresOffset0Tombstone (0.00s) === RUN TestCheckIndexFile === RUN TestCheckIndexFile/healthy_index === RUN TestCheckIndexFile/healthy_index_with_deleted_files === RUN TestCheckIndexFile/damaged_index_(bitrot) === RUN TestCheckIndexFile/damaged_index_(truncated) === RUN TestCheckIndexFile/healthy_EC_index_with_deleted_files === RUN TestCheckIndexFile/damaged_EC_index_(bitrot) --- PASS: TestCheckIndexFile (0.07s) --- PASS: TestCheckIndexFile/healthy_index (0.01s) --- PASS: TestCheckIndexFile/healthy_index_with_deleted_files (0.00s) --- PASS: TestCheckIndexFile/damaged_index_(bitrot) (0.02s) --- PASS: TestCheckIndexFile/damaged_index_(truncated) (0.00s) --- PASS: TestCheckIndexFile/healthy_EC_index_with_deleted_files (0.00s) --- PASS: TestCheckIndexFile/damaged_EC_index_(bitrot) (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/idx 0.936s === RUN TestParseFileIdFromString --- PASS: TestParseFileIdFromString (0.01s) === RUN TestNeedleIdFileId --- PASS: TestNeedleIdFileId (0.00s) === RUN TestEagerPreGrow === RUN TestEagerPreGrow/small_content-length_grows_exactly === RUN TestEagerPreGrow/content-length_at_cap_grows_to_cap === RUN TestEagerPreGrow/content-length_above_cap_is_clamped_to_cap === RUN TestEagerPreGrow/content-length_above_sizeLimit_is_rejected === RUN TestEagerPreGrow/zero_content-length_is_a_no-op === RUN TestEagerPreGrow/negative_content-length_(chunked_encoding)_is_a_no-op === RUN TestEagerPreGrow/buffer_with_sufficient_cap_is_left_alone --- PASS: TestEagerPreGrow (0.25s) --- PASS: TestEagerPreGrow/small_content-length_grows_exactly (0.09s) --- PASS: TestEagerPreGrow/content-length_at_cap_grows_to_cap (0.05s) --- PASS: TestEagerPreGrow/content-length_above_cap_is_clamped_to_cap (0.04s) --- PASS: TestEagerPreGrow/content-length_above_sizeLimit_is_rejected (0.00s) --- PASS: TestEagerPreGrow/zero_content-length_is_a_no-op (0.00s) --- PASS: TestEagerPreGrow/negative_content-length_(chunked_encoding)_is_a_no-op (0.00s) --- PASS: TestEagerPreGrow/buffer_with_sufficient_cap_is_left_alone (0.04s) === RUN TestParseUpload_GzipStreamCount === RUN TestParseUpload_GzipStreamCount/no_MD5:_stream-count needle_parse_upload_stream_test.go:73: allocated=84432 bytes (gzipped=16826, uncompressed=4194304) === RUN TestParseUpload_GzipStreamCount/MD5_on_part:_materialize needle_parse_upload_stream_test.go:73: allocated=16816848 bytes (gzipped=16826, uncompressed=4194304) === RUN TestParseUpload_GzipStreamCount/MD5_on_request:_materialize needle_parse_upload_stream_test.go:73: allocated=16866288 bytes (gzipped=16826, uncompressed=4194304) --- PASS: TestParseUpload_GzipStreamCount (3.38s) --- PASS: TestParseUpload_GzipStreamCount/no_MD5:_stream-count (0.26s) --- PASS: TestParseUpload_GzipStreamCount/MD5_on_part:_materialize (0.77s) --- PASS: TestParseUpload_GzipStreamCount/MD5_on_request:_materialize (0.54s) === RUN TestParseUploadUsesDiscoveredFilePartContentType --- PASS: TestParseUploadUsesDiscoveredFilePartContentType (0.01s) === RUN TestParseUploadRetainsReplicaControls --- PASS: TestParseUploadRetainsReplicaControls (0.04s) === RUN TestReadNeedleTailLegacyChecksum --- PASS: TestReadNeedleTailLegacyChecksum (0.00s) === RUN TestReadNeedleTailRawChecksum --- PASS: TestReadNeedleTailRawChecksum (0.00s) === RUN TestReadNeedleTailCorrupted --- PASS: TestReadNeedleTailCorrupted (0.00s) === RUN TestReadNeedleBlobRejectsNegativeSize --- PASS: TestReadNeedleBlobRejectsNegativeSize (0.00s) === RUN TestReadNeedleBodyBytesRejectsCorruptSize === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version1 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version1/size_-1 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version1/size_-12 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version1/size_larger_than_body === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version1/no_room_for_the_tail === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version1/empty_body === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version1/empty_body_with_data_size === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version2 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version2/size_-1 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version2/size_-12 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version2/size_larger_than_body === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version2/no_room_for_the_tail === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version2/empty_body === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version2/empty_body_with_data_size === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version3 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version3/size_-1 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version3/size_-12 === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version3/size_larger_than_body === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version3/no_room_for_the_tail === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version3/empty_body === RUN TestReadNeedleBodyBytesRejectsCorruptSize/Version3/empty_body_with_data_size --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize (0.04s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version1 (0.01s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version1/size_-1 (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version1/size_-12 (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version1/size_larger_than_body (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version1/no_room_for_the_tail (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version1/empty_body (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version1/empty_body_with_data_size (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version2 (0.02s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version2/size_-1 (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version2/size_-12 (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version2/size_larger_than_body (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version2/no_room_for_the_tail (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version2/empty_body (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version2/empty_body_with_data_size (0.01s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version3 (0.01s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version3/size_-1 (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version3/size_-12 (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version3/size_larger_than_body (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version3/no_room_for_the_tail (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version3/empty_body (0.00s) --- PASS: TestReadNeedleBodyBytesRejectsCorruptSize/Version3/empty_body_with_data_size (0.00s) === RUN TestReadNeedleBodyBytesWrittenNeedles === RUN TestReadNeedleBodyBytesWrittenNeedles/Version1 === RUN TestReadNeedleBodyBytesWrittenNeedles/Version2 === RUN TestReadNeedleBodyBytesWrittenNeedles/Version3 --- PASS: TestReadNeedleBodyBytesWrittenNeedles (0.01s) --- PASS: TestReadNeedleBodyBytesWrittenNeedles/Version1 (0.00s) --- PASS: TestReadNeedleBodyBytesWrittenNeedles/Version2 (0.00s) --- PASS: TestReadNeedleBodyBytesWrittenNeedles/Version3 (0.00s) === RUN TestParseKeyHash --- PASS: TestParseKeyHash (0.00s) === RUN TestNeedleParsePathRejectsDeltaOverflow --- PASS: TestNeedleParsePathRejectsDeltaOverflow (0.00s) === RUN TestAppend --- PASS: TestAppend (0.01s) === RUN TestWriteNeedle_CompatibilityWithLegacy === RUN TestWriteNeedle_CompatibilityWithLegacy/Version1 === RUN TestWriteNeedle_CompatibilityWithLegacy/Version2 === RUN TestWriteNeedle_CompatibilityWithLegacy/Version3 --- PASS: TestWriteNeedle_CompatibilityWithLegacy (0.01s) --- PASS: TestWriteNeedle_CompatibilityWithLegacy/Version1 (0.00s) --- PASS: TestWriteNeedle_CompatibilityWithLegacy/Version2 (0.00s) --- PASS: TestWriteNeedle_CompatibilityWithLegacy/Version3 (0.00s) === RUN TestNewVolumeId volume_id_test.go:11: a is not legal volume id, strconv.ParseUint: parsing "a": invalid syntax --- PASS: TestNewVolumeId (0.00s) === RUN TestVolumeId_String --- PASS: TestVolumeId_String (0.00s) === RUN TestVolumeId_Next --- PASS: TestVolumeId_Next (0.00s) === RUN TestTTLReadWrite --- PASS: TestTTLReadWrite (0.00s) === RUN TestLoadTTLIsInterned --- PASS: TestLoadTTLIsInterned (0.08s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/needle 4.711s === RUN TestMemoryUsage Each 13.22 Bytes Alloc = 21 MiB TotalAlloc = 47 MiB Sys = 47 MiB NumGC = 9 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 34.767251994s Each 12.86 Bytes Alloc = 41 MiB TotalAlloc = 92 MiB Sys = 75 MiB NumGC = 11 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 30.323403193s Each 12.73 Bytes Alloc = 61 MiB TotalAlloc = 138 MiB Sys = 99 MiB NumGC = 13 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 30.561380821s Each 12.67 Bytes Alloc = 82 MiB TotalAlloc = 183 MiB Sys = 123 MiB NumGC = 14 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 30.669816134s Each 12.64 Bytes Alloc = 102 MiB TotalAlloc = 229 MiB Sys = 144 MiB NumGC = 15 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 29.617573727s Each 12.61 Bytes Alloc = 122 MiB TotalAlloc = 274 MiB Sys = 168 MiB NumGC = 16 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 29.046374633s Each 12.59 Bytes Alloc = 142 MiB TotalAlloc = 320 MiB Sys = 184 MiB NumGC = 17 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 28.91481409s Each 12.58 Bytes Alloc = 162 MiB TotalAlloc = 365 MiB Sys = 208 MiB NumGC = 18 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 28.697253352s Each 12.57 Bytes Alloc = 183 MiB TotalAlloc = 411 MiB Sys = 229 MiB NumGC = 19 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 28.555992381s Each 12.56 Bytes Alloc = 203 MiB TotalAlloc = 457 MiB Sys = 249 MiB NumGC = 20 CompactMap = 1539351/1749659 elements on 2198 segments, 87.98% efficiency Taken = 29.019620488s --- PASS: TestMemoryUsage (300.18s) === RUN TestSegmentBsearchKey === RUN TestSegmentBsearchKey/empty_segment === RUN TestSegmentBsearchKey/new_key,_insert_at_beginning === RUN TestSegmentBsearchKey/new_key,_insert_at_end === RUN TestSegmentBsearchKey/new_key,_insert_second === RUN TestSegmentBsearchKey/new_key,_insert_in_middle === RUN TestSegmentBsearchKey/key_#1 === RUN TestSegmentBsearchKey/key_#2 === RUN TestSegmentBsearchKey/key_#3 === RUN TestSegmentBsearchKey/key_#4 === RUN TestSegmentBsearchKey/key_#5 --- PASS: TestSegmentBsearchKey (0.01s) --- PASS: TestSegmentBsearchKey/empty_segment (0.00s) --- PASS: TestSegmentBsearchKey/new_key,_insert_at_beginning (0.00s) --- PASS: TestSegmentBsearchKey/new_key,_insert_at_end (0.00s) --- PASS: TestSegmentBsearchKey/new_key,_insert_second (0.00s) --- PASS: TestSegmentBsearchKey/new_key,_insert_in_middle (0.00s) --- PASS: TestSegmentBsearchKey/key_#1 (0.00s) --- PASS: TestSegmentBsearchKey/key_#2 (0.00s) --- PASS: TestSegmentBsearchKey/key_#3 (0.00s) --- PASS: TestSegmentBsearchKey/key_#4 (0.00s) --- PASS: TestSegmentBsearchKey/key_#5 (0.00s) === RUN TestSegmentSet --- PASS: TestSegmentSet (0.01s) === RUN TestSegmentSetOrdering --- PASS: TestSegmentSetOrdering (156.54s) === RUN TestSegmentGet === RUN TestSegmentGet/invalid_key === RUN TestSegmentGet/key_#1 === RUN TestSegmentGet/key_#2 === RUN TestSegmentGet/key_#3 --- PASS: TestSegmentGet (0.00s) --- PASS: TestSegmentGet/invalid_key (0.00s) --- PASS: TestSegmentGet/key_#1 (0.00s) --- PASS: TestSegmentGet/key_#2 (0.00s) --- PASS: TestSegmentGet/key_#3 (0.00s) === RUN TestSegmentDelete --- PASS: TestSegmentDelete (0.00s) === RUN TestSegmentForKey === RUN TestSegmentForKey/first_segment === RUN TestSegmentForKey/second_segment,_gapless === RUN TestSegmentForKey/gapped_segment --- PASS: TestSegmentForKey (0.00s) --- PASS: TestSegmentForKey/first_segment (0.00s) --- PASS: TestSegmentForKey/second_segment,_gapless (0.00s) --- PASS: TestSegmentForKey/gapped_segment (0.00s) === RUN TestAscendingVisit --- PASS: TestAscendingVisit (0.00s) === RUN TestRandomInsert --- PASS: TestRandomInsert (1274.07s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/needle_map 1731.643s === RUN TestMemoryUsage Each 15.42 Bytes Alloc = 24 MiB TotalAlloc = 115 MiB Sys = 55 MiB NumGC = 17 Taken = 20.382106707s Each 15.05 Bytes Alloc = 48 MiB TotalAlloc = 228 MiB Sys = 87 MiB NumGC = 21 Taken = 17.435164293s Each 14.93 Bytes Alloc = 72 MiB TotalAlloc = 341 MiB Sys = 131 MiB NumGC = 24 Taken = 15.953930469s Each 14.86 Bytes Alloc = 96 MiB TotalAlloc = 455 MiB Sys = 163 MiB NumGC = 26 Taken = 15.572241022s Each 14.83 Bytes Alloc = 119 MiB TotalAlloc = 568 MiB Sys = 208 MiB NumGC = 28 Taken = 15.870421027s Each 14.80 Bytes Alloc = 143 MiB TotalAlloc = 682 MiB Sys = 252 MiB NumGC = 29 Taken = 16.564260955s Each 14.78 Bytes Alloc = 167 MiB TotalAlloc = 795 MiB Sys = 276 MiB NumGC = 30 Taken = 16.297853345s Each 14.77 Bytes Alloc = 191 MiB TotalAlloc = 909 MiB Sys = 304 MiB NumGC = 31 Taken = 15.520502287s Each 14.76 Bytes Alloc = 214 MiB TotalAlloc = 1022 MiB Sys = 328 MiB NumGC = 32 Taken = 15.617058498s Each 14.75 Bytes Alloc = 238 MiB TotalAlloc = 1136 MiB Sys = 352 MiB NumGC = 33 Taken = 15.140030669s --- PASS: TestMemoryUsage (164.35s) === RUN TestSnowflakeSequencer I1117 09:43:20.056862 snowflake_sequencer.go:24 use snowflake seq id generator, nodeid:for_test hex_of_nodeid: 1 --- PASS: TestSnowflakeSequencer (0.75s) === RUN TestOverflow2 needle key: 150073 needle key: 150076 needle key: 150088 needle key: 150089 needle key: 150124 needle key: 150137 needle key: 150145 needle key: 150147 needle key: 150158 needle key: 150162 --- PASS: TestOverflow2 (0.00s) === RUN TestIssue52 key 10002 ok true 10002, 1250, 10002 key 10002 ok true 10002, 1250, 10002 --- PASS: TestIssue52 (0.00s) === RUN TestCompactMap --- PASS: TestCompactMap (2.90s) === RUN TestOverflow overflow[ 0 ]: 1 overflow[ 1 ]: 2 overflow[ 2 ]: 3 overflow[ 3 ]: 4 overflow[ 4 ]: 5 overflow[ 0 ]: 1 size -12 overflow[ 1 ]: 2 size 12 overflow[ 2 ]: 3 size 24 overflow[ 3 ]: 4 size -12 overflow[ 4 ]: 5 size 12 overflow[ 0 ]: 1 overflow[ 1 ]: 2 overflow[ 2 ]: 3 overflow[ 3 ]: 4 overflow[ 4 ]: 5 overflow[ 0 ]: 1 overflow[ 1 ]: 2 overflow[ 2 ]: 3 overflow[ 3 ]: 4 overflow[ 4 ]: 5 --- PASS: TestOverflow (0.00s) === RUN TestCompactSection_Get compact_map_test.go:204: 1574318345753513987 compact_map_test.go:215: 1574318350048481283 --- PASS: TestCompactSection_Get (15.09s) === RUN TestCompactSection_PutOutOfOrderItemBeyondLookBackWindow --- PASS: TestCompactSection_PutOutOfOrderItemBeyondLookBackWindow (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/needle_map/old 184.056s === RUN TestReplicaPlacementFromByteMatchesString --- PASS: TestReplicaPlacementFromByteMatchesString (0.01s) === RUN TestReplicaPlacementSerialDeserial --- PASS: TestReplicaPlacementSerialDeserial (0.00s) === RUN TestReplicaPlacementHasReplication === RUN TestReplicaPlacementHasReplication/empty_replica_placement === RUN TestReplicaPlacementHasReplication/no_replication === RUN TestReplicaPlacementHasReplication/same_rack_replication === RUN TestReplicaPlacementHasReplication/diff_rack_replication === RUN TestReplicaPlacementHasReplication/DC_replication === RUN TestReplicaPlacementHasReplication/full_replication --- PASS: TestReplicaPlacementHasReplication (0.01s) --- PASS: TestReplicaPlacementHasReplication/empty_replica_placement (0.00s) --- PASS: TestReplicaPlacementHasReplication/no_replication (0.00s) --- PASS: TestReplicaPlacementHasReplication/same_rack_replication (0.00s) --- PASS: TestReplicaPlacementHasReplication/diff_rack_replication (0.00s) --- PASS: TestReplicaPlacementHasReplication/DC_replication (0.00s) --- PASS: TestReplicaPlacementHasReplication/full_replication (0.00s) === RUN TestSuperBlockReadWrite --- PASS: TestSuperBlockReadWrite (0.00s) === RUN TestReadSuperBlockWithExtra --- PASS: TestReadSuperBlockWithExtra (0.06s) === RUN TestReadSuperBlockExtraFullReadWithEOF --- PASS: TestReadSuperBlockExtraFullReadWithEOF (0.01s) === RUN TestReadSuperBlockTruncatedExtra --- PASS: TestReadSuperBlockTruncatedExtra (0.01s) === RUN TestReadSuperBlockShortReadWithoutError --- PASS: TestReadSuperBlockShortReadWithoutError (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/super_block 1.116s === RUN TestReadableStringRoundTrip --- PASS: TestReadableStringRoundTrip (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/types 0.965s ? github.com/seaweedfs/seaweedfs/weed/storage/volume_info [no test files] === RUN TestEqualLiveNeedleSets_SameFileCountDifferentIds --- PASS: TestEqualLiveNeedleSets_SameFileCountDifferentIds (0.20s) === RUN TestEqualLiveNeedleSets_VacuumOffsetsIgnored --- PASS: TestEqualLiveNeedleSets_VacuumOffsetsIgnored (0.09s) === RUN TestEqualLiveNeedleSets_SizeMismatchIgnored --- PASS: TestEqualLiveNeedleSets_SizeMismatchIgnored (0.05s) === RUN TestLiveNeedlesFromIndex_SkipsDeleted --- PASS: TestLiveNeedlesFromIndex_SkipsDeleted (0.03s) === RUN TestSelectSourceIfIndexesMatch_SingleReplica --- PASS: TestSelectSourceIfIndexesMatch_SingleReplica (0.00s) === RUN TestSelectSourceIfIndexesMatch_NoReplicas --- PASS: TestSelectSourceIfIndexesMatch_NoReplicas (0.00s) === RUN TestChooseSourceFromLiveNeedles_SuccessContainsConsistent --- PASS: TestChooseSourceFromLiveNeedles_SuccessContainsConsistent (0.00s) === RUN TestChooseSourceFromLiveNeedles_EmptyVsLiveRefuses --- PASS: TestChooseSourceFromLiveNeedles_EmptyVsLiveRefuses (0.00s) === RUN TestChooseSourceFromLiveNeedles_AllEmpty --- PASS: TestChooseSourceFromLiveNeedles_AllEmpty (0.00s) === RUN TestRequireCapacitySource_ThreeLocationsSourceFromCapacity --- PASS: TestRequireCapacitySource_ThreeLocationsSourceFromCapacity (0.00s) === RUN TestBuildUnionFromMultipleIndexDatabases --- PASS: TestBuildUnionFromMultipleIndexDatabases (0.09s) === RUN TestFindLargestReplica === RUN TestFindLargestReplica/single_replica === RUN TestFindLargestReplica/first_is_largest === RUN TestFindLargestReplica/last_is_largest === RUN TestFindLargestReplica/middle_is_largest === RUN TestFindLargestReplica/all_equal_-_pick_first --- PASS: TestFindLargestReplica (0.01s) --- PASS: TestFindLargestReplica/single_replica (0.00s) --- PASS: TestFindLargestReplica/first_is_largest (0.00s) --- PASS: TestFindLargestReplica/last_is_largest (0.00s) --- PASS: TestFindLargestReplica/middle_is_largest (0.00s) --- PASS: TestFindLargestReplica/all_equal_-_pick_first (0.00s) === RUN TestDeletedEntriesAreSkipped --- PASS: TestDeletedEntriesAreSkipped (0.10s) === RUN TestReplicaUnionBuilder_EmptyLocations --- PASS: TestReplicaUnionBuilder_EmptyLocations (0.00s) === RUN TestAvoidDuplicateCopies --- PASS: TestAvoidDuplicateCopies (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/storage/volume_replica 3.344s === RUN TestCollectVolumeStatsCountsEcShards I1117 09:40:37.679294 node.go:539 weedfs adds child dc1 I1117 09:40:37.717958 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.725791 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:37.727962 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:40:37.728515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.2:34534 I1117 09:40:37.729433 node.go:539 weedfs:dc1:rack1:127.0.0.2:34534 adds child --- PASS: TestCollectVolumeStatsCountsEcShards (0.10s) === RUN TestCollectDataWaitsForMinDiskBytes I1117 09:40:37.781263 node.go:539 weedfs adds child dc1 I1117 09:40:37.782098 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.782554 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:37.783353 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:40:37.789166 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestCollectDataWaitsForMinDiskBytes (0.02s) PASS ok github.com/seaweedfs/seaweedfs/weed/telemetry 2.494s === RUN TestGetVolumeLayoutOfAbsentKey --- PASS: TestGetVolumeLayoutOfAbsentKey (0.00s) === RUN TestConcurrentLastReplicaRemoval I1117 09:40:37.422671 node.go:539 weedfs adds child dc1 I1117 09:40:37.507007 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.515223 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.517025 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.535247 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.536021 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.538741 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.539390 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.544950 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.545492 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.550060 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.550580 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.554531 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.555172 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.556337 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.557523 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.560283 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.560534 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.562353 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.562948 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.564600 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.570029 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.569717 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.572657 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.574190 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.573810 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.575004 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.575205 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.576963 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.566910 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.577180 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.577475 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.577674 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.577130 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.577130 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.578455 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.580402 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.580570 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.586572 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.586879 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.588006 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.588414 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.588886 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.589110 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.594129 node.go:539 weedfs adds child dc1 I1117 09:40:37.594454 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.594810 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.595349 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.598218 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.599038 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.600339 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.600634 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.601337 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.602248 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.604169 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.604586 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.606272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.606722 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.609628 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.610390 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.611176 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.611413 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.612474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.612717 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.618033 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.618798 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.618994 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.619134 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.619294 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.619728 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.619933 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.620175 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.620336 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.620059 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.620855 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.620680 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.621048 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.620001 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.621255 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.621415 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.621595 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.621744 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.621939 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.622499 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.622691 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.617528 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.623573 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.623775 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.625216 node.go:539 weedfs adds child dc1 I1117 09:40:37.625502 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.625855 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.626615 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.628543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.628950 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.630698 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.631057 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.633807 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.634426 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.641772 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.642312 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.643164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.643526 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.644260 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.644488 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.645243 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.645466 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.646379 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.646804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.647739 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.648328 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.648689 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.649315 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.650002 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.650346 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.650151 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.650747 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.650949 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.651258 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.651772 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.651956 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.651224 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.652229 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.652417 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.652234 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.652857 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.652699 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.653395 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.653034 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.656374 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.658126 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.658408 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.658581 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.659230 node.go:539 weedfs adds child dc1 I1117 09:40:37.659585 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.659894 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.660210 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.661319 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.661557 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.662974 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.670851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.672005 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.672258 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.672949 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.676863 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.677667 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.677877 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.678653 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.678846 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.679521 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.679715 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.680631 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.680881 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.681654 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.682196 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.682379 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.682808 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.683419 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.683592 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.682811 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.683384 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.683832 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.684068 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.684254 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.684391 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.684693 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.685350 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.685651 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.685894 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.686118 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.686431 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.686622 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.686971 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.687125 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.684338 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.688153 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.688347 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.689180 node.go:539 weedfs adds child dc1 I1117 09:40:37.689389 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.689696 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.690160 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.691320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.691725 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.692521 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.692844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.695280 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.695666 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.697724 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.697964 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.701532 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.701824 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.703678 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.703942 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.704731 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.704940 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.705830 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.706073 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.710291 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.714476 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.714681 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.711252 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.714941 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.715080 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.711901 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.714661 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.715272 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.712518 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.715401 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.715562 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.715682 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.716098 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.716285 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.713627 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.716050 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.716536 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.716698 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.713137 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.716961 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.717203 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.717398 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.717569 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.719190 node.go:539 weedfs adds child dc1 I1117 09:40:37.719591 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.719990 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.720346 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.721790 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.721974 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.723767 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.724094 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.725708 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.726088 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.727666 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.727886 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.729042 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.729407 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.730147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.730493 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.731097 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.731369 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.732193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.732418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.733560 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.734186 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.734377 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.734837 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.735347 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.735517 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.735927 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.736795 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.737450 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.738218 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.739636 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.740071 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.740307 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.740455 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.740632 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.740782 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.741018 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.741166 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.738938 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.741464 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.741637 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.741808 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.742383 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.742556 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.743565 node.go:539 weedfs adds child dc1 I1117 09:40:37.743774 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.744303 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.744609 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.746175 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.746651 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.747864 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.748101 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.749121 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.749440 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.750061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.750260 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.751368 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.751566 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.752223 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.752407 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.752918 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.754401 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.755147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.755411 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.756057 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.756648 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.756827 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.757353 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.757886 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.758072 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.758196 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.758335 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.758717 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.758884 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.759085 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.759222 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.759048 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.759513 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.759683 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.759476 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.759926 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.760092 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.759948 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.760370 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.760969 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.761561 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.762166 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.762463 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.763763 node.go:539 weedfs adds child dc1 I1117 09:40:37.764125 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.765170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.765686 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.767755 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.768194 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.769792 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.770361 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.771977 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.772419 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.774016 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.774291 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.774952 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.775184 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.775808 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.776019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.778039 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.778551 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.780155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.780380 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.781845 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.782395 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.782579 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.783461 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.784227 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.784582 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.785163 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.785698 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.785908 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.786217 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.786810 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.786999 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.786847 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.787373 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.787551 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.787291 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.787811 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.787828 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.788056 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.789099 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.789383 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.789539 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.789723 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.789873 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.790315 node.go:539 weedfs adds child dc1 I1117 09:40:37.791112 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.791588 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.791985 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.793350 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.793761 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.794757 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.795205 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.796175 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.796424 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.797061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.797644 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.798436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.798859 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.799694 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.800050 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.800975 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.801470 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.802371 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.802823 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.803598 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.804200 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.804391 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.804977 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.805804 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.806669 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.806714 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.807261 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.807406 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.807952 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.808138 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.808325 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.808462 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.808307 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.808631 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.808823 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.809103 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.809244 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.809644 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.809792 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.810260 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.810458 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.810691 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.810848 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.811922 node.go:539 weedfs adds child dc1 I1117 09:40:37.812325 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.812588 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.812987 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.814470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.814830 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.816426 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.816930 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.817698 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.817895 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.818498 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.818936 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.819722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.821559 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.825285 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.826087 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.826935 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.827248 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.827993 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.828340 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.829079 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.829666 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.830502 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.831843 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.832517 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.833154 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.833749 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.831297 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.832706 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.834853 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.838120 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.838346 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.838570 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.838717 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.838918 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.839048 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.839244 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.839372 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.839616 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.839755 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.840306 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.840488 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.840833 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.840985 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.842135 node.go:539 weedfs adds child dc1 I1117 09:40:37.842678 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.845182 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.845513 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.847520 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.848007 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.849128 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.849520 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.850551 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.851011 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.852104 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.852897 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.854293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.854783 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.855656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.855903 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.856717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.856933 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.857862 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.858584 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.859879 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.860492 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.860688 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.861000 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.861513 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.861692 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.861975 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.862468 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.862645 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.863326 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.863459 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.863850 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.864070 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.864286 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.864173 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.864528 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.864732 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.864895 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.864907 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.862916 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.865402 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.865651 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.865862 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.866021 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.866683 node.go:539 weedfs adds child dc1 I1117 09:40:37.866891 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.867394 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.867688 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.868924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.869184 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.870022 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.870261 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.872564 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.872981 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.873752 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.873977 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.874666 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.874877 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.877126 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.877560 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.878402 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.878780 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.879820 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.880304 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.881839 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.882537 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.882739 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.883100 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.883630 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.883813 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.884097 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.884591 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.884768 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.885039 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.885542 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.886088 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.886733 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.887326 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.887917 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.885726 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.888863 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.889021 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.889339 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.889474 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.889771 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.889905 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.890200 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.890332 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.891042 node.go:539 weedfs adds child dc1 I1117 09:40:37.891287 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.891667 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.891928 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.893055 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.893300 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.894222 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.894456 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.895355 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.895605 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.899078 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.899458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.900464 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.900733 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.901495 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.901844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.902497 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.902775 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.905819 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.906273 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.907815 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.908452 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.908644 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.908936 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.909439 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.909616 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.909899 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.910074 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.910405 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.910681 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.910884 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.910654 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.911034 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.911268 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.911403 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.911239 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.911737 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.911912 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.911646 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.912152 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.912297 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.912151 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.912572 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.912737 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.913341 node.go:539 weedfs adds child dc1 I1117 09:40:37.913521 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.913761 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.914126 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.914917 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.915218 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.915840 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.916188 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.917200 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.917779 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.918709 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.919312 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.920322 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.920900 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.922013 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.922418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.923235 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.923695 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.924537 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.924989 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.926156 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.926930 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.928723 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.926689 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.926753 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.929069 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.926829 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.926241 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.927312 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.927492 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.927987 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.929880 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.930141 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.930309 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.930503 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.930652 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.930847 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.930984 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.931168 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.931330 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.931526 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.931666 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.931843 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.931979 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.932564 node.go:539 weedfs adds child dc1 I1117 09:40:37.932814 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.933168 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.933537 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.935453 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.935774 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.937104 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.937355 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.938270 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.938507 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.939374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.939697 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.940341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.940654 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.941247 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.941452 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.942640 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.942876 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.945731 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.946178 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.947567 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.948175 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.948365 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.948664 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.948678 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.949173 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.949353 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.949580 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.949422 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.949753 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.950001 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.950423 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.950698 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.950955 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.951748 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.952945 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.953421 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.953725 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.954251 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.954439 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.954648 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.954801 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.954990 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.955159 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.956536 node.go:539 weedfs adds child dc1 I1117 09:40:37.956927 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.957267 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.957893 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.959071 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.959351 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.960379 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.960819 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.961711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.962390 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.963489 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.963880 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.964766 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.965119 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.966021 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.966441 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.967272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.967613 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:37.968401 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:37.968685 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:37.969680 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:37.970307 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:37.970509 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:37.969723 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:37.970338 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:37.970759 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:37.970907 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:37.971107 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:37.971256 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:37.970962 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:37.971467 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:37.971653 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:37.971527 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:37.972005 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:37.972187 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:37.971953 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:37.972430 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:37.972607 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:37.972635 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:37.973146 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:37.973537 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:37.974101 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:37.974486 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:37.974917 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:37.976843 node.go:539 weedfs adds child dc1 I1117 09:40:37.977359 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:37.977719 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:37.977982 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:37.979093 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:37.979315 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:37.980093 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:37.980377 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:37.981048 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:37.981262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:37.981863 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:37.982065 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:37.982786 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:37.993368 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:37.994438 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:37.994971 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:37.997202 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:37.997803 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.000014 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.000336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.001850 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.002477 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.002671 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.003092 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.003624 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.003813 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.004100 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.004585 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.004759 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.005022 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.006459 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.006707 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.005661 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.006445 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.006948 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.007082 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.007274 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.007407 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.007114 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.007672 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.007813 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.008556 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.009080 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.009267 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.009746 node.go:539 weedfs adds child dc1 I1117 09:40:38.009949 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.010302 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.010718 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.011851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.012176 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.013293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.013544 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.014856 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.015162 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.016672 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.016900 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.017789 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.018091 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.019899 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.020129 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.021678 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.021930 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.023006 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.023400 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.024146 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.024719 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.024912 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.025210 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.025704 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.025886 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.026692 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.027249 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.027437 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.026357 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.027674 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.027852 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.027753 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.028247 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.028118 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.028421 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.028705 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.028869 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.029018 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.029585 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.029781 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.030196 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.031044 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.031391 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.032151 node.go:539 weedfs adds child dc1 I1117 09:40:38.032636 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.033074 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.033582 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.035658 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.036704 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.038525 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.039009 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.040273 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.040488 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.041125 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.041481 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.042211 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.042514 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.043880 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.044153 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.045467 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.045720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.047172 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.047419 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.048939 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.049585 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.049793 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.050142 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.050684 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.050859 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.050133 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.050737 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.051085 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.051223 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.051390 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.051512 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.051320 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.051796 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.051985 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.051761 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.052211 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.052367 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.052273 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.052740 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.052916 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.052725 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.053152 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.053319 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.053829 node.go:539 weedfs adds child dc1 I1117 09:40:38.054037 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.054287 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.054571 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.055417 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.055599 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.056336 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.056551 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.057128 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.057358 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.057976 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.058177 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.060019 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.060329 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.060839 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.061019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.061866 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.062061 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.062804 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.062982 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.063969 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.064495 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.064675 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.064936 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.065408 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.065727 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.066086 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.066647 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.066882 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.066695 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.067266 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.067464 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.067281 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.067744 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.068282 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.068517 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.068352 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.068854 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.069039 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.069303 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.069480 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.070057 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.070897 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.071558 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.072555 node.go:539 weedfs adds child dc1 I1117 09:40:38.072905 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.073150 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.073581 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.074443 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.074752 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.075445 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.075664 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.076169 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.077283 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.079015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.079284 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.080775 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.080996 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.082273 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.082483 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.083604 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.083894 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.085145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.085354 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.086467 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.086987 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.087156 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.087575 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.088123 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.088599 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.088910 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.089077 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.089505 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.089602 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.091450 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.091619 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.091824 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.092025 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.092188 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.092311 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.092471 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.092594 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.092747 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.092865 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.093053 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.093178 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.093340 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.093466 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.093891 node.go:539 weedfs adds child dc1 I1117 09:40:38.094305 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.095135 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.095671 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.096674 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.097029 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.097876 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.098211 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.099122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.099469 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.100606 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.101139 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.102412 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.102602 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.103955 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.104312 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.105440 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.105649 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.107250 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.107556 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.108380 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.108899 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.109069 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.109974 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.110436 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.110600 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.111462 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.111945 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.112131 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.109448 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.112396 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.112577 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.112412 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.112832 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.112987 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.112845 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.113337 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.113234 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.110845 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.113500 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.114582 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.114759 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.115682 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.116079 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.117138 node.go:539 weedfs adds child dc1 I1117 09:40:38.117375 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.117857 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.118348 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.119281 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.119562 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.121436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.121660 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.122209 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.122467 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.123041 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.123278 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.123832 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.124003 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.124534 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.124720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.125326 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.125521 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.126062 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.126320 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.129015 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.129563 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.129756 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.130456 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.130941 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.131109 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.131717 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.132227 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.132394 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.132791 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.133262 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.133431 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.134156 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.134595 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.134761 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.135003 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.135440 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.135607 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.135870 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.136307 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.133673 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.136811 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.137291 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.137566 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.138318 node.go:539 weedfs adds child dc1 I1117 09:40:38.138540 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.138825 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.139034 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.140398 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.140691 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.142404 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.142760 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.144293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.144539 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.145876 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.146066 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.147150 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.147737 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.149411 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.149625 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.150472 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.150670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.151524 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.151797 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.152483 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.153816 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.154004 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.154322 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.154808 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.154978 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.155417 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.155881 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.156096 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.156789 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.157261 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.157431 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.157684 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.158119 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.158282 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.158543 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.159048 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.159211 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.152976 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.159980 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.160146 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.160590 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.161040 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.161199 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.161858 node.go:539 weedfs adds child dc1 I1117 09:40:38.162071 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.162299 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.162515 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.163869 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.164211 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.165112 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.166191 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.167556 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.167801 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.168474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.168676 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.169271 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.170186 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.171573 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.171838 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.173061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.173257 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.174585 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.174975 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.176263 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.176878 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.177062 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.177319 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.177773 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.177933 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.178192 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.178627 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.178789 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.179045 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.179466 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.179886 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.180488 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.181219 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.181946 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.179628 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.182893 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.183018 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.183306 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.183578 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.183977 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.184098 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.184370 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.184507 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.185142 node.go:539 weedfs adds child dc1 I1117 09:40:38.185430 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.185705 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.185926 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.187369 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.187719 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.189193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.189387 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.190596 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.190780 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.191461 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.191679 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.192159 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.192422 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.194483 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.195015 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.196078 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.196287 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.197015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.197205 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.197819 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.198338 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.198515 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.198931 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.199403 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.199566 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.200255 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.200736 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.200902 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.201154 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.201590 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.201749 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.202119 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.202534 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.202693 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.203347 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.203876 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.204047 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.204321 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.204760 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.204931 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.202944 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.206287 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.206618 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.207329 node.go:539 weedfs adds child dc1 I1117 09:40:38.207721 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.208285 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.208701 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.210186 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.210417 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.212118 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.212341 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.213827 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.214337 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.215772 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.215983 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.217176 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.217379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.218190 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.218370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.218889 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.219216 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.220474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.221016 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.222185 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.222747 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.222944 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.223230 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.223687 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.223930 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.224183 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.224633 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.224794 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.225261 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.225797 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.225971 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.226241 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.226706 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.226872 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.227135 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.227564 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.227727 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.228409 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.228919 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.229085 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.229437 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.229899 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.230064 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.230884 node.go:539 weedfs adds child dc1 I1117 09:40:38.231061 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.231297 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.231715 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.233248 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.233495 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.234814 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.235116 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.236303 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.236500 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.237946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.238394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.239531 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.239744 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.240473 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.240690 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.241197 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.241472 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.242093 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.242282 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.243644 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.244257 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.244435 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.244859 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.245322 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.245485 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.245894 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.246672 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.247274 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.248476 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.246368 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.250199 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.250590 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.250750 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.251146 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.251692 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.251878 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.252185 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.252353 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.252549 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.252687 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.249401 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.253128 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.253292 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.253814 node.go:539 weedfs adds child dc1 I1117 09:40:38.254075 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.254519 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.254796 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.255693 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.255929 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.257594 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.257986 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.260164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.260504 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.261816 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.262003 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.263203 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.263394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.264646 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.264881 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.265449 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.265745 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.266351 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.266555 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.267466 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.268095 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.268715 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.269426 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.270552 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.271076 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.271591 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.272607 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.274036 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.274226 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.274543 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.274680 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.274948 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.275068 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.275339 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.275466 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.275720 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.275843 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.276107 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.276225 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.276487 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.276609 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.276869 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.277066 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.277704 node.go:539 weedfs adds child dc1 I1117 09:40:38.277932 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.278164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.278402 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.279700 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.279902 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.281921 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.282403 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.283974 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.284553 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.286120 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.286469 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.288188 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.288803 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.290293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.290600 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.291580 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.291770 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.292480 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.292720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.293376 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.293923 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.294098 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.294598 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.295067 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.295240 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.295645 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.296077 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.296238 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.297039 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.297552 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.297719 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.297977 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.298415 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.298576 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.298819 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.299236 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.299398 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.300164 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.300653 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.300823 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.299650 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.301500 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.301659 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.304296 node.go:539 weedfs adds child dc1 I1117 09:40:38.304496 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.304885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.305523 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.310351 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.310679 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.312238 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.312800 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.313468 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.313772 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.314617 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.314959 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.315579 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.315750 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.316355 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.321827 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.323313 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.323884 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.325333 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.325671 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.327134 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.327687 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.327860 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.328136 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.328599 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.328766 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.329026 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.329471 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.329638 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.329977 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.330466 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.330635 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.330877 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.331551 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.331848 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.331541 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.330911 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.332802 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.333056 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.333391 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.333530 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.333850 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.334435 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.334597 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.335149 node.go:539 weedfs adds child dc1 I1117 09:40:38.335696 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.336078 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.336521 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.338052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.338253 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.339382 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.339561 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.340292 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.340485 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.341178 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.341382 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.343575 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.344012 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.345474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.345705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.346492 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.346672 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.347320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.347538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.348205 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.348719 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.348896 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.349293 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.349982 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.350654 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.351408 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.351973 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.352500 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.352997 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.349728 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.354244 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.354576 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.354714 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.354991 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.355138 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.355407 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.355533 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.355794 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.355912 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.356180 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.356308 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.356596 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.356728 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.357390 node.go:539 weedfs adds child dc1 I1117 09:40:38.357553 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.357790 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.358114 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.359241 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.359522 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.360820 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.361224 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.361904 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.362945 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.363950 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.364838 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.366753 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.367213 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.368195 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.368380 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.368954 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.369129 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.369688 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.371302 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.372569 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.373240 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.373737 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.374320 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.374884 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.375415 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.375913 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.373430 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.376948 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.378028 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.378459 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.379363 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.378826 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.377353 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.380177 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.381091 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.381525 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.381677 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.381855 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.381986 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.382173 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.382287 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.382442 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.382624 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.383026 node.go:539 weedfs adds child dc1 I1117 09:40:38.383206 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.384502 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.384900 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.386456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.386744 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.388154 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.388453 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.389728 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.390165 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.390781 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.391384 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.392611 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.392786 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.393432 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.393630 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.396755 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.396988 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.398482 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.398975 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.400085 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.400599 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.400775 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.401037 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.401465 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.401622 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.401859 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.402269 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.402426 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.402664 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.403340 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.403979 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.404565 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.405113 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.406103 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.406437 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.406781 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.406913 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.407082 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.407217 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.407400 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.407529 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.407723 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.407863 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.408408 node.go:539 weedfs adds child dc1 I1117 09:40:38.408639 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.408894 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.409190 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.410817 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.411228 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.412849 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.413239 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.414707 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.415061 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.416335 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.416538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.417049 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.417356 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.418063 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.418238 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.418885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.419081 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.419694 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.421138 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.422461 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.423006 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.423192 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.423453 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.423893 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.424053 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.424290 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.424713 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.424868 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.425219 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.425643 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.425799 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.426158 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.429495 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.429684 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.426698 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.429937 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.430090 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.427192 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.430294 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.430420 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.427873 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.430612 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.430741 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.431410 node.go:539 weedfs adds child dc1 I1117 09:40:38.431646 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.431902 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.432133 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.434020 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.434606 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.436616 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.436944 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.438301 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.438500 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.439140 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.439362 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.440984 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.441506 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.442950 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.443360 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.444791 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.444988 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.446798 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.447149 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.447819 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.448312 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.448487 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.448868 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.449322 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.449483 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.449976 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.450440 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.450602 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.450841 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.451254 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.451407 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.451635 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.452047 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.452271 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.452517 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.452922 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.453322 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.454004 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.454503 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.454650 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.454920 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.455362 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.455530 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.456365 node.go:539 weedfs adds child dc1 I1117 09:40:38.456731 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.457109 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.457470 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.458914 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.459093 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.460480 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.460872 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.462411 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.462753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.464135 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.464796 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.466058 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.467206 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.468131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.471367 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.472398 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.472589 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.480127 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.480446 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.481301 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.481821 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.481996 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.482429 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.482942 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.483725 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.484299 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.484824 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.485349 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.485852 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.488627 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.486360 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.489578 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.489763 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.490049 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.490203 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.490465 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.490628 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.490814 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.490956 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.491124 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.491247 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.491407 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.491543 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.492095 node.go:539 weedfs adds child dc1 I1117 09:40:38.492263 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.492495 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.497845 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.501052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.501710 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.503517 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.504009 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.505465 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.505794 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.506393 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.506597 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.507266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.510375 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.511534 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.512056 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.512745 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.513450 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.514375 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.514767 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.515765 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.516317 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.516524 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.515744 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.516351 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.516738 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.516880 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.517053 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.517211 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.516947 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.517456 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.517641 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.517479 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.517944 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.518108 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.517922 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.518380 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.518556 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.518374 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.518807 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.518963 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.518830 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.519265 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.519431 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.520489 node.go:539 weedfs adds child dc1 I1117 09:40:38.521034 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.521429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.521757 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.522662 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.523408 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.524325 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.524514 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.525425 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.525747 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.526545 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.526869 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.527460 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.527647 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.528642 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.528832 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.529528 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.529718 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.530387 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.530822 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.531682 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.532397 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.532739 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.533486 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.534234 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.534574 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.534999 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.535674 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.535994 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.536434 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.536651 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.537057 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.537226 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.537435 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.537277 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.537571 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.537760 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.537888 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.538084 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.538139 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.538516 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.538678 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.538863 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.539000 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.542982 node.go:539 weedfs adds child dc1 I1117 09:40:38.543357 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.543808 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.544096 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.546307 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.546615 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.547594 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.547968 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.548667 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.549614 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.551817 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.552068 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.553570 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.553769 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.554933 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.555242 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.556177 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.556357 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.557741 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.558204 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.559301 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.563245 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.563472 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.560319 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.563759 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.563885 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.561113 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.563950 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.564367 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.561657 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.562247 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.563249 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.564636 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.565078 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.565252 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.565630 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.562766 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.565848 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.566122 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.566285 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.566472 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.566601 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.566774 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.566906 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.567417 node.go:539 weedfs adds child dc1 I1117 09:40:38.567619 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.567845 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.568071 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.568819 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.568995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.569581 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.570778 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.571960 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.572133 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.573223 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.573533 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.574762 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.574976 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.576276 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.576462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.577656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.577982 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.579390 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.579791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.581284 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.581372 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.581799 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.581972 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.582171 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.582299 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.582037 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.582494 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.582662 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.582531 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.582947 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.583111 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.582926 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.583433 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.583602 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.583359 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.583783 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.583943 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.583860 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.584285 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.584450 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.584406 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.584866 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.585030 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.585593 node.go:539 weedfs adds child dc1 I1117 09:40:38.585809 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.586048 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.586269 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.587216 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.587493 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.588188 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.588373 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.588939 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.589109 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.589698 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.591151 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.592518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.592747 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.593866 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.594327 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.595535 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.595861 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.597801 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.598201 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.599561 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.600195 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.600371 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.600753 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.600860 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.602071 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.601377 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.601428 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.602196 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.602391 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.602131 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.602511 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.602671 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.602786 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.602985 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.603110 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.602830 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.603271 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.603391 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.603554 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.603671 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.604400 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.605094 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.605450 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.606229 node.go:539 weedfs adds child dc1 I1117 09:40:38.606645 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.606927 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.607285 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.608598 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.609030 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.610651 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.611102 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.612669 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.613214 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.614698 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.615214 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.615888 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.616063 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.616739 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.616940 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.617419 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.617669 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.618229 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.618406 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.619310 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.620349 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.620904 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.621092 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.621530 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.621979 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.622146 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.622505 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.622928 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.623186 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.623451 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.623605 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.624189 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.624025 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.624609 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.625102 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.625045 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.625427 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.625959 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.626155 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.626550 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.626710 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.626928 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.627076 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.627852 node.go:539 weedfs adds child dc1 I1117 09:40:38.628390 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.628662 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.629149 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.630540 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.630748 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.632256 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.632543 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.634778 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.635025 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.636434 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.637155 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.638020 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.638498 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.639267 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.639623 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.640561 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.640905 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.641906 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.642685 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.644338 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.644351 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.644393 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.644886 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.645063 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.645277 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.645046 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.645405 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.645086 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.645611 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.645798 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.645578 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.646014 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.646175 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.643950 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.646367 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.646528 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.646720 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.647064 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.645750 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.647581 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.647879 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.648289 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.648596 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.649493 node.go:539 weedfs adds child dc1 I1117 09:40:38.649906 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.650298 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.650752 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.651906 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.652250 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.653256 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.653739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.654723 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.655021 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.655816 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.656027 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.656785 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.657133 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.662130 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.662450 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.664366 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.664626 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.666039 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.666267 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.667736 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.667806 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.667904 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.667964 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.668359 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.668635 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.668444 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.668865 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.668591 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.668625 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.669044 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.669228 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.669375 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.669550 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.669688 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.669873 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.670014 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.670212 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.670346 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.670523 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.670646 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.667872 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.671226 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.671407 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.671973 node.go:539 weedfs adds child dc1 I1117 09:40:38.672203 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.672456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.672685 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.673905 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.674342 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.675330 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.675771 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.676697 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.677070 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.677827 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.678392 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.679182 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.679668 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.680409 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.680614 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.681498 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.681843 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.682720 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.683161 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.685028 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.685138 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.685701 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.685884 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.686100 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.685861 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.686246 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.686434 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.686579 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.686543 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.686702 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.686775 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.687159 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.686841 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.687340 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.687547 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.687381 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.687708 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.687897 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.688031 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.688214 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.688339 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.688523 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.688642 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.689137 node.go:539 weedfs adds child dc1 I1117 09:40:38.689352 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.689585 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.689824 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.691536 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.691824 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.692484 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.692669 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.693717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.693921 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.694771 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.695107 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.695980 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.696353 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.697109 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.697497 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.698013 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.698198 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.698835 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.699026 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.699988 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.700791 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.701177 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.701742 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.702258 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.702446 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.702884 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.703382 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.703559 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.704059 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.704159 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.704774 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.705119 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.705310 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.705463 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.705029 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.705664 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.705809 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.705532 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.706046 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.706243 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.706059 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.706498 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.706672 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.707105 node.go:539 weedfs adds child dc1 I1117 09:40:38.707364 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.707587 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.708030 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.708973 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.709404 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.710296 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.710684 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.711264 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.711544 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.712057 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.712634 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.713292 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.713668 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.714579 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.714893 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.715791 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.716050 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.716767 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.717024 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.717733 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.718276 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.718459 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.718863 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.719345 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.719527 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.720813 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.720790 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.721301 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.721474 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.721685 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.721429 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.721819 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.721527 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.721984 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.722116 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.722291 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.722137 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.722438 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.721988 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.722638 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.722755 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.722910 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.723013 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.723567 node.go:539 weedfs adds child dc1 I1117 09:40:38.723727 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.723954 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.724382 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.725210 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.725417 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.725924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.726145 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.731175 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.731696 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.740120 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.740417 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.741162 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.741339 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.742001 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.742219 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.742717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.743002 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.743804 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.744287 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.745511 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.745635 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.745698 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.746051 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.746344 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.746243 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.746589 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.746270 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.746759 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.746955 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.746673 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.747091 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.747426 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.747268 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.747608 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.747803 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.747968 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.748182 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.748321 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.748533 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.748670 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.748690 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.749425 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.749611 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.750104 node.go:539 weedfs adds child dc1 I1117 09:40:38.750434 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.750687 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.750873 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.751544 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.752726 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.760912 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.761172 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.761883 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.762087 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.762560 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.762869 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.765950 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.766214 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.767425 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.767591 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.768690 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.768860 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.770026 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.770226 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.770878 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.770900 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.771345 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.771503 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.771688 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.771808 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.771572 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.772053 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.772242 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.772027 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.772413 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.772552 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.772600 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.772076 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.772654 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.773700 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.774149 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.774469 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.774637 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.774761 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.774932 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.775044 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.775195 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.775297 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.775644 node.go:539 weedfs adds child dc1 I1117 09:40:38.775793 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.776141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.776357 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.777552 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.778122 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.779447 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.780222 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.780946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.781294 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.781834 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.782013 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.782740 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.782923 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.784983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.785893 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.787572 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.788131 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.788990 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.789221 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.790165 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.790895 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.791240 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.791665 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.794345 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.794497 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.792517 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.794724 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.794892 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.793080 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.795070 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.795194 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.795487 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.795969 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.796118 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.796863 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.797362 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.797508 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.793854 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.797843 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.798033 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.796338 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.798651 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.798826 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.799359 node.go:539 weedfs adds child dc1 I1117 09:40:38.799537 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.799995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.800264 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.801204 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.801510 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.802256 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.802470 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.803037 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.804836 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.806383 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.806843 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.808404 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.808809 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.810310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.810703 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.812058 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.812747 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.813423 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.813680 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.815146 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.815310 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.815901 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.815773 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.815804 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.815810 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.815212 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.815148 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.816233 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.816707 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.816426 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.816904 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.817140 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.817299 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.817510 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.817656 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.817858 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.817989 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.818202 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.818338 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.818538 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.818676 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.818933 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.819140 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.819610 node.go:539 weedfs adds child dc1 I1117 09:40:38.819917 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.820366 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.820647 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.822376 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.822714 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.823596 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.823800 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.824518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.824747 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.825320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.826198 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.827250 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.827551 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.828232 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.828436 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.829155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.829387 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.831046 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.831495 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.832480 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.832576 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.833088 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.833272 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.833015 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.833493 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.833663 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.833595 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.833859 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.834103 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.833923 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.834300 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.834121 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.834447 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.833262 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.834640 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.834782 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.835074 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.835371 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.835155 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.835782 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.835969 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.836158 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.836407 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.836946 node.go:539 weedfs adds child dc1 I1117 09:40:38.837131 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.837381 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.837728 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.838630 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.838913 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.839676 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.844052 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.844838 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.845220 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.845886 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.846109 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.846764 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.846963 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.847714 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.847948 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.849547 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.849897 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.850596 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.851381 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.852458 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.853208 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.857860 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.853907 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.858204 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.858380 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.854512 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.858630 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.858779 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.854699 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.859007 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.859145 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.855094 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.859372 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.859510 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.855210 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.855650 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.859982 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.860189 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.855795 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.860432 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.860570 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.864212 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.864420 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.864918 node.go:539 weedfs adds child dc1 I1117 09:40:38.865253 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.865645 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.865935 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.867330 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.867639 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.869254 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.869491 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.870217 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.870626 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.871293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.871573 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.872131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.872333 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.872952 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.873163 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.873727 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.874108 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.874930 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.875379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.876218 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.876954 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.877316 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.877768 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.878474 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.878803 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.878569 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.879086 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.879553 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.879819 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.879824 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.877792 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.880350 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.886425 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.886870 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.887077 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.887291 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.887452 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.887639 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.887788 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.888035 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.888180 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.888370 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.888509 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.889094 node.go:539 weedfs adds child dc1 I1117 09:40:38.889280 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.889732 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.901991 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.903206 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.903518 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.904540 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.904757 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.905392 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.905793 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.908020 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.908438 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.911704 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.912174 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.913064 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.913427 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.914469 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.914694 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.915435 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.915864 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.916688 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.917255 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.917450 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.916689 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.917296 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.917688 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.917401 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.917849 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.918025 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.917851 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.918161 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.918359 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.918069 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.916746 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.918496 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.918665 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.918433 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.918800 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.918961 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.919085 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.919273 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.919399 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.919572 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.919864 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.920623 node.go:539 weedfs adds child dc1 I1117 09:40:38.921007 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.921416 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.921798 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.922936 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.923296 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.924351 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.924684 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.925440 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.925638 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.926150 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.926459 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.926980 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.927305 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.927851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.928057 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.928634 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.928895 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.929598 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.929850 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.930456 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.930493 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.930919 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.931074 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.931247 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.931386 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.931282 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.931798 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.931668 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.931985 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.932196 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.932359 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.932161 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.932546 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.932690 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.932646 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.933318 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.932903 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.939458 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.939722 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.940051 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.940213 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.940434 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.940594 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.943270 node.go:539 weedfs adds child dc1 I1117 09:40:38.943587 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.943892 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.944164 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.946548 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.947253 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.948534 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.948762 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.949465 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.949665 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.951967 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.952321 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.954040 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.954547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.955453 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.956390 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.957943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:38.958807 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:38.959656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:38.960734 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:38.961962 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:38.965676 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:38.965872 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:38.962777 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:38.966131 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:38.966260 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:38.963329 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:38.966655 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:38.963848 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:38.964341 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:38.965000 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:38.970579 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:38.970783 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:38.971034 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:38.971163 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:38.971333 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:38.971457 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:38.971630 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:38.971746 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:38.971918 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:38.972041 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:38.972354 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:38.972908 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:38.973090 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:38.973689 node.go:539 weedfs adds child dc1 I1117 09:40:38.973876 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:38.974336 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:38.974719 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:38.977766 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:38.978282 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:38.979920 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:38.980301 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:38.981630 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:38.982061 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:38.986780 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:38.987037 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:38.987889 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:38.988083 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:38.988760 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:38.989004 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:38.989509 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.007023 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.008136 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.008594 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.009687 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.010286 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.010484 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.010959 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.011485 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.011672 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.012086 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.012561 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.012734 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.013352 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.013840 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.014005 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.014262 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.014691 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.014861 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.015117 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.015538 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.015699 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.009344 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.018341 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.018528 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.013005 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.019123 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.019294 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.019974 node.go:539 weedfs adds child dc1 I1117 09:40:39.020160 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.020486 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.020716 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.022187 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.022641 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.023605 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.024134 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.025192 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.026258 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.026977 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.027181 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.027840 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.028053 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.028579 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.028924 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.029422 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.029620 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.032328 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.032587 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.034334 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.035104 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.035407 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.035822 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.039994 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.040237 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.036532 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.040494 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.040645 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.037115 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.040891 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.041044 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.037698 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.041272 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.038348 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.039136 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.041313 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.042639 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.042993 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.043293 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.043637 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.044090 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.044491 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.044879 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.045520 node.go:539 weedfs adds child dc1 I1117 09:40:39.045981 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.046302 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.046724 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.048216 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.048782 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.076138 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.081081 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.083241 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.083853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.086764 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.087096 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.088185 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.088424 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.089131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.090257 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.091310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.091888 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.093152 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.093478 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.109296 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.110322 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.110413 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.111078 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.111247 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.111354 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.108883 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.113309 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.119437 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.119771 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.114009 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.119941 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.120129 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.120275 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.120448 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.120581 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.120757 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.120885 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.121083 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.121223 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.121404 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.121539 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.121712 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.121849 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.122403 node.go:539 weedfs adds child dc1 I1117 09:40:39.122818 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.123486 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.123979 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.125462 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.125984 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.127085 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.127601 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.130265 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.130667 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.131319 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.131520 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.132417 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.132619 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.133319 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.133516 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.134230 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.134473 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.135095 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.135367 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.136726 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.137296 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.137491 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.137931 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.138404 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.138583 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.138985 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.139448 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.139622 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.136083 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.140557 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.140337 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.140749 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.140998 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.141160 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.141048 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.141529 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.141700 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.141464 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.141909 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.142071 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.141959 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.142410 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.143077 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.144163 node.go:539 weedfs adds child dc1 I1117 09:40:39.144394 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.144673 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.144914 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.145803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.145990 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.146627 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.146824 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.147410 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.147601 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.148394 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.148633 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.149245 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.149508 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.164215 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.164567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.165328 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.165533 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.166321 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.167477 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.168193 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.168761 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.168946 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.169436 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.169918 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.170090 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.170352 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.170809 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.170980 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.171234 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.171693 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.171858 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.173614 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.174217 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.174400 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.174690 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.175143 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.175311 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.175603 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.176065 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.176232 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.172105 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.183432 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.183749 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.184317 node.go:539 weedfs adds child dc1 I1117 09:40:39.184489 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.184753 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.185098 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.185921 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.186264 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.190147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.193390 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.194126 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.194446 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.195146 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.195368 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.196039 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.196243 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.199690 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.200093 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.200684 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.200875 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.201788 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.201996 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.203414 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.204013 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.204202 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.204673 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.205193 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.205372 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.205902 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.207753 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.208588 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.209174 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.209917 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.202851 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.212756 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.213017 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.213358 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.214263 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.214480 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.214618 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.214804 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.214932 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.215105 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.215231 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.215406 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.215532 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.219200 node.go:539 weedfs adds child dc1 I1117 09:40:39.219435 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.219701 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.220137 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.220975 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.221274 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.221963 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.222177 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.222782 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.228313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.229361 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.229618 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.230833 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.231058 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.231895 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.232176 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.232778 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.233199 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.234494 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.234956 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.236700 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.237319 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.237510 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.237800 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.238266 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.238431 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.238827 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.239258 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.239423 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.239999 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.240556 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.240725 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.240992 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.241417 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.241579 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.241954 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.242404 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.242571 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.235669 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.243258 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.243609 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.239682 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.244776 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.245079 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.246186 node.go:539 weedfs adds child dc1 I1117 09:40:39.246653 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.247070 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.247437 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.248946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.249303 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.250891 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.251228 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.251996 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.252777 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.254339 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.254606 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.255167 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.255435 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.255983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.256186 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.257188 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.257401 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.258189 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.258394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.259058 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.259586 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.259992 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.260689 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.261363 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.262357 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.263638 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.264212 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.262898 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.265289 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.265796 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.266095 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.266522 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.266777 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.267187 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.267503 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.267907 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.268188 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.268602 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.268878 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.269287 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.269417 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.269752 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.269932 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.270934 node.go:539 weedfs adds child dc1 I1117 09:40:39.271304 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.271671 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.272029 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.273544 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.273839 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.275495 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.275787 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.276470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.276714 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.277230 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.277415 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.277993 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.278182 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.278803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.279016 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.279511 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.281429 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.282980 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.283382 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.284250 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.285175 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.285871 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.286365 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.286868 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.287355 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.287912 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.289127 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.289599 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.289809 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.289943 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.290099 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.290221 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.290387 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.290497 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.290642 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.290753 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.291262 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.291486 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.291866 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.291154 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.292445 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.292813 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.293226 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.294240 node.go:539 weedfs adds child dc1 I1117 09:40:39.294481 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.294726 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.294963 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.296027 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.296316 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.298287 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.298576 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.299431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.299628 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.300448 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.300679 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.301239 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.301527 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.302141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.302338 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.303011 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.304708 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.305960 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.306288 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.306972 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.307508 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.307683 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.307939 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.308379 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.308539 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.308911 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.309342 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.309502 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.309994 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.310472 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.310641 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.310904 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.311367 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.311545 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.311812 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.312225 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.312385 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.312627 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.313430 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.314114 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.323371 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.323790 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.323965 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.324653 node.go:539 weedfs adds child dc1 I1117 09:40:39.324918 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.325170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.328540 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.330232 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.330516 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.331458 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.332161 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.333214 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.333475 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.334179 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.334489 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.335038 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.335235 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.337627 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.337848 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.339292 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.339478 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.340768 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.341345 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.342889 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.343461 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.343642 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.343915 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.344364 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.344525 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.344771 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.345196 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.345356 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.345992 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.346507 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.346674 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.347681 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.348207 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.348374 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.349043 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.349510 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.349723 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.350563 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.351032 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.351194 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.345612 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.352093 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.352279 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.353014 node.go:539 weedfs adds child dc1 I1117 09:40:39.353282 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.353557 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.353798 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.354754 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.355018 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.355758 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.357357 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.358325 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.358531 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.359227 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.359463 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.360010 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.360320 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.363112 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.363598 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.365334 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.365680 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.367379 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.367739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.369066 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.369634 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.369841 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.370132 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.370588 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.370753 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.371006 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.371434 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.371593 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.371830 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.372253 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.372412 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.373176 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.374706 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.375884 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.375155 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.376798 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.376967 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.374017 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.377156 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.377283 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.377774 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.378510 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.378676 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.379134 node.go:539 weedfs adds child dc1 I1117 09:40:39.379455 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.379784 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.380004 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.380758 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.380981 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.381582 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.381760 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.382364 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.382607 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.384415 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.385346 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.387468 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.387699 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.388430 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.388670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.389140 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.389396 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.389963 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.390158 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.390937 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.391444 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.391619 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.391889 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.392334 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.392495 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.393291 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.393777 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.393942 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.394323 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.394743 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.394903 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.395299 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.395719 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.395878 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.396650 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.397108 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.397269 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.396256 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.398785 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.399168 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.392901 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.400250 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.400562 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.401245 node.go:539 weedfs adds child dc1 I1117 09:40:39.401474 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.401968 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.402308 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.403880 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.404399 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.406170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.406760 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.407391 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.407681 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.408324 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.408514 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.409153 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.410459 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.411992 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.412465 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.412998 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.413256 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.413904 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.414085 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.414694 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.415220 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.415396 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.415865 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.416314 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.416826 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.417603 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.418388 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.418920 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.420049 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.419442 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.421642 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.422203 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.422561 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.423215 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.423699 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.424182 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.424509 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.424728 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.424849 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.425020 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.425147 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.425335 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.425465 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.426121 node.go:539 weedfs adds child dc1 I1117 09:40:39.426332 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.426576 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.426800 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.428409 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.428834 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.430681 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.431169 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.433025 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.433256 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.433885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.434207 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.434738 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.435735 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.437023 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.437230 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.438729 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.439213 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.440721 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.441058 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.441715 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.442229 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.442403 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.442661 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.443115 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.443285 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.443659 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.444104 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.444266 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.444509 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.444930 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.445088 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.445324 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.445741 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.445899 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.446644 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.447155 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.447330 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.447618 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.448070 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.448245 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.446137 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.449264 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.449784 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.450845 node.go:539 weedfs adds child dc1 I1117 09:40:39.451302 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.451558 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.451781 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.453487 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.453913 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.454900 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.455198 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.455904 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.456101 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.456795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.457013 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.457507 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.457778 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.458268 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.458454 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.459096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.459276 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.462109 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.462379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.463105 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.463618 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.463804 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.464202 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.464717 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.464886 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.465131 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.465556 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.465718 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.465971 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.466965 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.467538 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.468080 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.468614 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.469491 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.469867 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.470435 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.470730 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.470917 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.471046 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.471213 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.471337 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.471499 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.471623 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.472154 node.go:539 weedfs adds child dc1 I1117 09:40:39.472366 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.472665 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.473214 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.474694 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.475067 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.476660 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.476849 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.478536 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.479096 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.479911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.480657 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.482225 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.483247 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.484388 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.484604 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.485210 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.485389 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.486065 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.486273 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.488814 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.489364 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.489540 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.489827 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.490449 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.490630 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.490899 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.491370 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.491540 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.491786 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.492213 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.492378 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.492624 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.493641 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.494223 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.494951 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.493053 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.495608 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.495919 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.496067 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.496343 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.496488 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.496834 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.497017 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.497943 node.go:539 weedfs adds child dc1 I1117 09:40:39.498473 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.498941 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.499474 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.500446 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.500677 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.501518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.501708 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.502385 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.502605 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.504659 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.504997 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.505763 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.505975 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.506629 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.506825 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.507568 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.507791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.508380 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.508637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.510014 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.510566 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.510764 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.511031 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.511215 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.511556 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.511735 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.511949 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.512104 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.511935 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.512487 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.512669 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.512532 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.512974 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.513147 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.512941 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.513519 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.509288 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.513992 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.515507 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.515773 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.515917 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.516071 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.516188 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.516640 node.go:539 weedfs adds child dc1 I1117 09:40:39.517029 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.517343 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.517687 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.518711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.518926 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.521237 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.521876 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.523700 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.524140 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.525196 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.525442 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.526270 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.526533 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.527149 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.528766 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.529694 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.530696 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.531563 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.531769 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.532573 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.533494 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.534175 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.534472 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.534852 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.535046 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.535427 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.535776 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.534337 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.537409 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.538743 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.538945 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.539145 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.539291 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.539516 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.539650 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.539830 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.539959 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.540145 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.540283 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.540469 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.540606 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.540801 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.540936 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.541580 node.go:539 weedfs adds child dc1 I1117 09:40:39.541933 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.542253 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.542691 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.544652 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.544985 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.546425 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.546773 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.548310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.548536 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.549983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.550300 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.551599 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.551854 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.552501 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.552833 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.554992 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.555340 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.556053 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.556262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.557198 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.557823 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.558040 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.558488 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.559007 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.559190 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.560006 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.560553 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.560734 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.561016 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.561496 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.561674 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.561942 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.562417 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.562589 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.562935 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.563549 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.563269 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.563729 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.563941 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.564073 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.559611 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.565465 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.565863 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.566892 node.go:539 weedfs adds child dc1 I1117 09:40:39.567404 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.567826 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.568072 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.569579 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.569959 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.570702 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.570880 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.571475 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.571654 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.572253 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.572458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.574075 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.574585 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.575600 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.575805 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.576325 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.576510 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.577047 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.577324 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.577909 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.578412 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.578590 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.579014 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.579496 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.579666 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.580221 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.580727 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.580897 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.581270 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.581772 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.581936 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.582206 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.582653 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.582822 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.583452 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.583938 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.584109 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.584380 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.584788 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.584930 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.585726 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.586129 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.586256 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.587258 node.go:539 weedfs adds child dc1 I1117 09:40:39.587790 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.588200 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.588584 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.590034 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.590368 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.591288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.592133 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.592881 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.593659 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.595206 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.595431 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.595999 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.596249 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.597429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.598094 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.599636 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.604131 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.605029 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.605230 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.605895 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.606948 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.607798 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.608561 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.609240 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.610079 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.610774 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.617791 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.618127 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.618408 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.618571 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.618757 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.618889 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.619104 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.619256 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.619453 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.619589 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.619798 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.619934 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.620129 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.620260 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.620751 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.621340 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.621522 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.622265 node.go:539 weedfs adds child dc1 I1117 09:40:39.622519 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.622797 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.623035 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.627063 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.627328 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.629155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.629458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.631624 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.631859 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.632659 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.633950 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.634846 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.635785 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.637338 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.638112 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.639008 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.639209 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.640919 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.641184 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.643888 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.644452 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.644628 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.644887 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.645328 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.645489 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.645730 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.646150 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.646310 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.646638 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.647114 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.647278 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.647518 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.647949 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.648103 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.648361 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.648771 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.648931 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.649749 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.650446 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.650672 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.651162 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.651821 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.652204 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.652974 node.go:539 weedfs adds child dc1 I1117 09:40:39.653609 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.653930 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.654246 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.655501 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.656362 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.658636 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.659117 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.661309 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.661594 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.662277 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.662573 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.663141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.663350 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.664121 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.664318 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.665031 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.665284 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.665971 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.666244 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.669990 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.670654 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.670851 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.671150 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.671642 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.671818 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.672087 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.672563 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.672741 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.673688 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.675809 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.675999 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.673913 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.676598 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.674117 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.674586 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.678585 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.679128 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.679875 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.680914 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.681121 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.673004 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.683600 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.683791 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.684340 node.go:539 weedfs adds child dc1 I1117 09:40:39.684528 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.684795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.685190 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.687695 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.688159 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.689329 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.689880 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.690923 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.691259 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.692036 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.692227 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.692806 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.692985 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.693608 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.693998 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.694633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.695042 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.695779 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.696158 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.697263 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.698152 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.698515 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.699199 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.699926 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.700254 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.700134 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.700243 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.700652 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.701125 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.701146 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.701822 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.700698 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.702781 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.703265 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.703473 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.703670 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.703797 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.703974 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.704106 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.704270 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.704394 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.704561 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.704688 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.705234 node.go:539 weedfs adds child dc1 I1117 09:40:39.705461 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.705706 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.705936 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.707556 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.707960 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.709635 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.709886 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.710614 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.710813 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.711415 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.711576 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.712327 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.712522 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.712992 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.713971 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.714488 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.714651 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.715199 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.715357 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.715928 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.716051 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.716536 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.716762 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.716694 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.717103 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.717246 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.717464 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.717247 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.717618 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.717802 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.717936 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.717789 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.718218 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.718385 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.718233 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.718669 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.718810 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.718645 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.719092 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.719258 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.719053 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.719422 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.719561 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.719967 node.go:539 weedfs adds child dc1 I1117 09:40:39.720126 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.720380 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.720692 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.721301 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.721544 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.722026 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.722300 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.722713 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.722907 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.723438 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.723684 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.724263 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.724467 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.725059 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.725290 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.725701 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.725896 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.726455 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.726792 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.727672 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.728313 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.728250 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.728656 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.731379 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.731569 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.727720 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.731810 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.731948 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.728930 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.732255 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.728915 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.729439 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.729471 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.730087 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.734925 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.735154 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.735287 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.735472 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.735602 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.735775 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.735896 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.736055 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.736189 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.736919 node.go:539 weedfs adds child dc1 I1117 09:40:39.737182 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.737445 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.737681 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.738698 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.738974 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.740980 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.741215 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.742479 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.742707 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.743862 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.744058 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.744830 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.745149 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.745711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.746473 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.747314 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.747529 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.748239 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.748517 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.750622 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.751205 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.751394 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.751788 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.752508 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.752676 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.752950 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.753443 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.753621 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.753887 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.754366 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.754536 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.754811 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.755269 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.755431 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.755689 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.756129 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.756285 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.749248 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.756776 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.756941 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.757252 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.757895 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.758073 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.759194 node.go:539 weedfs adds child dc1 I1117 09:40:39.759605 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.760085 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.760508 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.762441 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.762895 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.764655 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.765158 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.765984 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.766853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.767684 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.768003 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.769995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.770225 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.771463 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.771957 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.773567 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.774184 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.775261 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.775714 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.777976 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.778557 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.778733 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.779008 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.779437 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.779597 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.779847 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.780269 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.780430 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.780675 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.781115 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.781283 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.781537 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.781958 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.782116 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.777477 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.783497 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.783679 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.782785 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.784735 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.784907 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.782368 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.785736 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.786136 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.787090 node.go:539 weedfs adds child dc1 I1117 09:40:39.787303 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.787530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.787744 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.788570 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.788747 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.789451 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.789635 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.791759 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.792295 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.792998 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.793770 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.794467 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.794663 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.795293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.795509 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.796006 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.796266 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.796943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.797124 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.797775 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.798327 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.798516 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.798981 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.799451 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.799615 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.799976 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.800499 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.800668 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.801066 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.801542 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.801705 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.802111 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.802551 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.802713 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.803963 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.804467 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.804634 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.804898 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.805334 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.805497 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.805847 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.806601 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.806766 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.807489 node.go:539 weedfs adds child dc1 I1117 09:40:39.807777 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.807995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.808205 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.809179 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.809435 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.810790 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.811331 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.812681 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.813211 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.814197 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.815003 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.816429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.816790 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.818057 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.818462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.819153 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.819779 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.820895 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.821068 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.821664 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.830579 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.830806 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.822391 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.831068 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.831303 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.822947 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.831526 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.831677 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.824030 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.831887 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.832014 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.824545 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.832230 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.832356 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.825037 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.832550 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.832678 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.825545 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.832915 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.823577 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.833037 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.843606 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.843818 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.844472 node.go:539 weedfs adds child dc1 I1117 09:40:39.844675 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.844921 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.845347 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.846268 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.846716 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.847504 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.847852 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.848489 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.848674 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.849492 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.849674 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.858239 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.858520 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.859202 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.859495 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.860069 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.860349 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.860911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.861094 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.861877 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.862398 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.862576 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.863554 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.864083 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.864256 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.864657 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.865091 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.865250 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.865525 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.865945 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.866103 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.866671 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.867141 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.867311 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.867584 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.867998 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.868157 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.866343 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.869403 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.869564 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.863005 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.870612 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.870915 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.871990 node.go:539 weedfs adds child dc1 I1117 09:40:39.872357 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.872721 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.873075 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.874540 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.874860 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.876230 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.876429 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.877929 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.878157 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.879437 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.879741 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.880662 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.881009 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.881613 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.881809 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.882543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.882729 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.884852 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.885202 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.886715 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.887255 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.887435 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.887872 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.888399 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.888572 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.889026 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.889504 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.889675 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.889945 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.890372 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.890533 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.890787 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.891203 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.891360 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.891609 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.892013 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.892175 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.892517 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.892952 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.893124 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.893642 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.894116 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.894280 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.894828 node.go:539 weedfs adds child dc1 I1117 09:40:39.895063 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.895291 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.895669 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.897123 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.897638 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.899267 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.899567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.900188 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.900382 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.901137 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.901318 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.901916 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.902097 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.902617 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.902873 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.905153 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.905576 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.906858 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.907174 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.909145 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.909647 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.909826 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.910079 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.910504 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.910664 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.910913 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.911326 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.911483 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.911721 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.912137 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.912293 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.912531 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.912939 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.908552 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.913674 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.914454 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.915180 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.915745 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.916038 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.916458 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.916813 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.917209 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.917473 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.918429 node.go:539 weedfs adds child dc1 I1117 09:40:39.918771 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.919207 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.919794 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.921120 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.921436 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.922902 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.923220 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.924521 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.924825 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.926549 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.926755 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.928172 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.928353 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.929533 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.929908 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.930488 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.930739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.931320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.932123 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.933541 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.934127 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.934315 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.934620 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.935076 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.935238 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.935483 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.935908 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.936070 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.936612 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.937089 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.937258 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.937115 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.937697 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.937546 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.937889 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.938127 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.938282 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.936341 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.938540 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.938698 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.938682 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.939212 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.939648 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.940144 node.go:539 weedfs adds child dc1 I1117 09:40:39.940347 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.940620 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.941046 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.942238 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.942571 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.943419 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.943659 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.944248 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.944692 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.945287 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.945492 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.946164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.946364 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.949272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.949876 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.950959 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.951215 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.951980 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.952200 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.953615 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.954179 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.954381 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.954824 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.955341 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.955521 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.955812 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.956292 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.956719 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.952913 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.957394 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.957600 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.957990 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.959211 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.959482 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.959803 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.960151 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.960457 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.960655 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.960797 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.960986 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.961115 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.961394 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.961529 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.962110 node.go:539 weedfs adds child dc1 I1117 09:40:39.962293 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.962534 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.962755 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.963982 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.964441 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.965315 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.965731 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.966493 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.966694 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.967302 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.967828 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.968451 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.968657 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.969132 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.969448 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.970088 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.970422 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.971592 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.971801 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.972653 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.973408 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.973764 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.973646 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.973711 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.973772 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.974227 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.973156 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.974427 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.973133 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.974643 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.974438 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.974801 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.974991 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.975131 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.975323 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.975461 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.975654 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.975791 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.975969 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.976105 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.973199 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.976818 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.976988 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.977404 node.go:539 weedfs adds child dc1 I1117 09:40:39.980421 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.981477 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.981867 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.982828 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.983065 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:39.983943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:39.984303 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:39.985108 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:39.985611 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:39.986346 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:39.986669 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:39.987540 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:39.987870 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:39.988678 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:39.989011 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:39.989774 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:39.990108 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:39.991257 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:39.991471 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:39.992281 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:39.992780 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:39.992950 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:39.992847 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:39.993381 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:39.993206 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:39.993564 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:39.993776 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:39.993921 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:39.993734 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:39.993584 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:39.994153 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:39.993789 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:39.994315 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:39.994490 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:39.994622 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:39.994343 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:39.994443 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:39.994832 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:39.995017 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:39.995238 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:39.995386 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:39.995588 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:39.996060 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:39.996701 node.go:539 weedfs adds child dc1 I1117 09:40:39.997115 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:39.997534 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:39.997828 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:39.998799 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:39.999037 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.002156 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.002665 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.004838 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.005212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.006064 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.006277 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.008266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.008642 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.010147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.010370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.012042 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.012269 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.013893 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.014125 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.015549 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.016302 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.016510 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.016836 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.017349 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.017526 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.017824 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.018322 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.018511 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.018799 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.019321 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.019504 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.020000 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.020641 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.020843 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.021154 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.021691 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.021875 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.022445 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.022992 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.023176 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.023492 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.023951 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.024124 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.024889 node.go:539 weedfs adds child dc1 I1117 09:40:40.025074 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.025341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.025739 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.027345 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.027781 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.029305 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.029670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.031228 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.031454 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.033731 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.034076 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.035325 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.035557 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.036078 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.036344 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.037817 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.038015 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.039554 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.039761 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.041072 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.041619 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.041799 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.042075 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.042526 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.042700 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.042996 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.043445 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.043616 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.044426 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.044424 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.044905 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.045072 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.045315 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.045126 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.045461 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.045677 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.046237 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.043975 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.046609 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.047303 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.047612 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.048244 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.048621 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.049566 node.go:539 weedfs adds child dc1 I1117 09:40:40.049843 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.050122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.050372 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.051390 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.051688 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.052476 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.052682 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.055527 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.055800 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.056581 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.056781 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.057598 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.057835 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.058458 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.058790 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.059379 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.059582 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.060791 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.061007 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.061766 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.062526 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.062868 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.062356 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.063450 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.063600 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.063489 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.063963 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.063372 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.064428 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.064106 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.062917 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.061719 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.064608 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.064802 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.064944 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.065135 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.065278 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.065563 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.065866 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.066230 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.066523 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.066871 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.067355 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.068089 node.go:539 weedfs adds child dc1 I1117 09:40:40.068281 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.068538 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.068936 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.069953 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.070234 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.071017 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.071371 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.072009 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.072216 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.073219 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.073426 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.074088 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.074282 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.075050 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.075282 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.075820 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.076261 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.077156 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.077731 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.078691 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.078794 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.079292 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.079485 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.079717 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.079468 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.079876 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.080078 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.080229 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.080044 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.080515 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.080699 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.080614 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.081093 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.081266 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.080972 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.081510 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.081673 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.081514 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.081985 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.082164 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.081940 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.082406 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.082581 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.083050 node.go:539 weedfs adds child dc1 I1117 09:40:40.083709 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.084165 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.084400 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.085585 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.085866 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.086867 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.087181 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.087990 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.088390 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.089058 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.089361 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.089924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.090131 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.090771 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.090974 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.091648 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.091876 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.092470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.092739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.093409 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.093986 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.094174 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.094606 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.095103 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.095363 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.095793 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.096314 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.096557 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.096723 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.096841 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.097317 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.097513 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.097734 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.097892 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.097440 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.098178 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.098350 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.098332 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.098815 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.098611 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.098992 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.099193 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.099342 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.100167 node.go:539 weedfs adds child dc1 I1117 09:40:40.100486 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.100913 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.101310 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.103011 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.103392 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.107413 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.107878 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.109594 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.110385 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.112082 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.112344 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.113683 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.114220 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.115727 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.116168 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.117424 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.117636 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.118605 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.118853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.119994 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.120570 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.120765 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.121216 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.121720 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.121904 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.122328 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.122816 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.123011 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.119533 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.125199 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.125388 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.123676 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.125639 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.125786 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.123741 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.126032 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.126196 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.123897 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.126444 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.126588 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.124269 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.126883 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.127014 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.127838 node.go:539 weedfs adds child dc1 I1117 09:40:40.128035 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.128298 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.128613 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.129659 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.130489 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.131441 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.131755 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.132359 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.132636 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.133300 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.133505 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.134228 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.134523 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.135331 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.135788 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.136501 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.137882 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.139357 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.139575 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.140967 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.141546 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.141748 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.140917 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.141585 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.141986 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.142131 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.142319 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.142480 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.142190 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.142699 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.142876 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.142784 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.143272 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.143446 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.143246 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.143741 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.143917 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.144447 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.144966 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.145254 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.145623 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.146122 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.146303 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.146780 node.go:539 weedfs adds child dc1 I1117 09:40:40.147169 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.147451 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.147850 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.148680 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.149007 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.149664 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.150591 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.151878 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.152247 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.153622 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.153822 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.154972 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.155142 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.156163 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.156393 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.156903 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.157156 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.157812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.157986 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.159306 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.158713 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.160383 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.160581 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.160347 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.160798 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.160494 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.160941 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.160456 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.161133 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.160909 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.161262 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.161089 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.161428 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.161562 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.161295 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.161722 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.161845 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.162009 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.162132 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.162282 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.162399 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.162593 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.162718 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.163192 node.go:539 weedfs adds child dc1 I1117 09:40:40.164301 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.164593 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.164807 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.165631 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.165814 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.166670 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.166848 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.167548 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.167723 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.168333 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.168883 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.169578 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.169980 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.170860 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.171057 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.171629 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.171806 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.172487 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.172693 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.173347 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.173955 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.174152 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.173600 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.174455 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.174620 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.174438 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.174908 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.175081 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.174870 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.175285 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.175443 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.175355 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.175831 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.175693 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.175998 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.176210 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.176349 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.176208 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.177655 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.177847 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.176710 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.178070 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.178225 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.178835 node.go:539 weedfs adds child dc1 I1117 09:40:40.179076 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.179336 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.179569 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.180448 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.180654 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.181525 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.181743 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.182491 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.182730 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.184947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.185292 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.186881 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.187235 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.188909 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.189171 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.190951 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.191443 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.192745 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.193188 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.193895 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.194608 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.194800 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.195237 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.195759 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.195941 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.196882 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.197439 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.197622 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.197895 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.198380 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.198552 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.198816 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.199279 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.199457 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.200332 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.200865 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.201046 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.201522 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.202756 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.202946 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.202082 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.203200 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.203356 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.203898 node.go:539 weedfs adds child dc1 I1117 09:40:40.204089 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.204344 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.204693 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.205468 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.205782 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.207310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.207623 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.208938 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.209220 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.210645 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.211209 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.211905 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.212126 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.212911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.213204 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.213875 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.214130 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.214884 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.215116 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.215789 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.216707 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.217577 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.218367 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.220139 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.220028 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.220386 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.220747 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.220940 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.221162 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.221302 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.221207 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.220651 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.221496 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.221747 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.219431 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.221951 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.222307 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.222623 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.222883 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.223180 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.223573 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.223778 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.223919 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.224424 node.go:539 weedfs adds child dc1 I1117 09:40:40.224613 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.225061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.225334 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.226382 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.228022 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.229928 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.230185 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.232032 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.232999 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.234076 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.235276 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.235941 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.236139 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.238414 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.238774 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.239688 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.239921 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.240639 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.240990 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.241751 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.242419 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.242623 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.243638 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.244217 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.244414 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.245067 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.245580 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.245811 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.246930 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.249200 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.249402 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.247896 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.249655 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.249825 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.248501 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.250087 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.250234 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.246259 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.251340 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.251734 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.251960 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.252484 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.252665 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.253636 node.go:539 weedfs adds child dc1 I1117 09:40:40.254089 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.254569 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.255158 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.257276 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.257717 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.259469 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.259898 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.261191 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.261577 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.262466 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.262671 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.264391 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.264657 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.265309 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.265610 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.266208 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.266537 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.267606 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.268031 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.268966 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.269656 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.270336 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.271421 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.272079 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.272394 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.272819 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.273649 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.273988 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.273399 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.274234 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.274020 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.274372 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.274693 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.274875 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.275163 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.275716 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.275885 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.276166 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.277381 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.277655 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.274600 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.280086 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.280440 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.281051 node.go:539 weedfs adds child dc1 I1117 09:40:40.281240 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.281753 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.282025 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.283000 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.283827 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.285390 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.285620 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.289294 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.289658 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.290399 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.291588 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.292615 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.292984 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.293599 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.293918 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.294470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.294734 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.295635 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.295834 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.296811 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.297420 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.297601 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.298056 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.298531 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.298707 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.299237 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.300315 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.301270 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.302034 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.302910 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.304667 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.305208 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.305902 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.306431 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.306834 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.307591 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.307913 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.308280 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.308671 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.309111 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.309391 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.309821 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.310093 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.310624 node.go:539 weedfs adds child dc1 I1117 09:40:40.310810 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.311097 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.312263 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.313173 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.313546 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.314309 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.314634 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.315251 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.315531 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.316107 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.316313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.319613 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.319855 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.321098 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.321753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.322812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.323199 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.323910 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.324210 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.324920 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.325534 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.325734 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.326663 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.327225 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.327635 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.328270 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.328871 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.329646 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.330278 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.331779 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.332070 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.332228 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.332437 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.332604 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.332820 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.332948 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.333144 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.333279 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.333490 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.333632 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.326199 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.334636 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.334872 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.335683 node.go:539 weedfs adds child dc1 I1117 09:40:40.335976 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.336314 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.336589 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.338737 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.339257 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.341428 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.342206 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.344480 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.345122 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.346744 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.347461 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.349268 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.349558 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.351382 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.351712 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.353535 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.353864 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.355058 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.355904 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.359551 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.360160 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.358135 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.360347 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.361045 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.359499 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.358859 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.362252 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.362473 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.359826 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.362724 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.360068 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.362872 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.363290 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.363589 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.360590 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.364145 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.364356 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.364811 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.365169 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.365568 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.365741 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.366339 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.366581 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.367452 node.go:539 weedfs adds child dc1 I1117 09:40:40.367710 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.368423 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.368784 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.370463 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.371015 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.372356 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.372675 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.373568 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.373988 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.374836 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.375289 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.377091 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.377341 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.378987 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.379370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.380511 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.381259 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.381956 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.382168 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.383424 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.384002 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.384196 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.384628 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.385120 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.385298 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.385701 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.386187 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.386690 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.386763 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.387304 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.387402 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.386366 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.383045 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.388268 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.388486 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.388763 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.388951 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.389290 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.389460 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.389813 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.389984 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.390328 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.390526 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.391384 node.go:539 weedfs adds child dc1 I1117 09:40:40.391743 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.392414 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.392933 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.394385 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.394930 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.396566 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.397071 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.398236 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.398648 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.399727 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.400240 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.401918 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.402227 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.403676 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.404014 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.405392 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.405840 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.407687 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.408307 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.410067 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.410488 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.411437 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.413300 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.410979 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.412020 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.414296 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.414887 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.415053 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.415236 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.415383 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.415575 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.415718 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.413453 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.415959 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.416099 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.415834 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.414106 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.416375 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.416581 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.416769 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.416906 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.417085 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.417223 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.417838 node.go:539 weedfs adds child dc1 I1117 09:40:40.418062 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.418292 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.418505 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.419307 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.419497 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.421205 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.421503 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.422353 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.422588 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.423183 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.423538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.424096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.424287 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.429851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.430226 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.431135 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.431355 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.432333 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.432575 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.434277 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.435330 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.435532 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.435988 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.436498 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.436679 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.436976 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.437620 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.438111 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.438410 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.438901 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.439086 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.439363 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.440504 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.441111 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.442227 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.444316 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.444644 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.445153 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.445655 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.446037 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.446232 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.446439 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.446575 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.447542 node.go:539 weedfs adds child dc1 I1117 09:40:40.447823 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.448288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.448591 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.449533 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.449767 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.460431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.460791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.461689 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.462073 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.462721 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.472816 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.474175 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.474471 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.475248 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.475453 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.476208 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.480939 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.484069 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.484759 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.486920 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.487495 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.487694 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.488003 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.488490 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.488653 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.486257 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.489214 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.489412 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.489857 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.490591 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.490779 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.491441 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.491893 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.492058 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.492482 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.492951 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.493157 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.493920 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.494450 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.494667 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.495580 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.496532 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.497445 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.498532 node.go:539 weedfs adds child dc1 I1117 09:40:40.498829 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.499115 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.499424 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.501456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.501786 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.503901 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.504552 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.506200 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.507063 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.508545 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.509013 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.510289 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.511560 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.513484 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.514025 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.516003 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.516348 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.518995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.519429 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.521301 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.521879 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.522061 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.522350 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.522810 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.522961 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.523223 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.523665 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.523829 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.524069 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.524503 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.524675 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.525075 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.525536 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.525702 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.525986 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.526721 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.527088 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.528134 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.528701 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.529212 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.529392 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.529646 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.529827 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.531022 node.go:539 weedfs adds child dc1 I1117 09:40:40.531350 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.531867 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.532233 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.536110 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.536919 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.540125 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.541378 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.545034 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.546740 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.552518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.553879 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.555276 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.555604 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.556121 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.556305 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.557066 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.557264 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.557933 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.564077 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.564985 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.565596 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.565796 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.567458 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.568012 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.568209 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.568502 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.568980 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.569160 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.569441 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.569925 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.570098 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.570381 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.570904 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.571055 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.573457 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.574089 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.574295 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.571274 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.575204 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.575391 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.566244 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.575732 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.575927 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.576967 node.go:539 weedfs adds child dc1 I1117 09:40:40.577245 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.577558 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.577906 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.579595 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.579856 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.580724 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.580955 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.581782 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.582040 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.582717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.582947 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.584041 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.584518 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.585289 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.585827 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.597050 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.597670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.613596 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.614176 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.616285 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.616922 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.617365 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.617888 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.616267 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.617719 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.616267 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.618554 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.617398 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.619427 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.620778 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.621074 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.621252 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.621496 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.621663 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.621875 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.618791 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.623488 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.626905 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.627126 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.627410 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.627575 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.627842 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.634461 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.635358 node.go:539 weedfs adds child dc1 I1117 09:40:40.635652 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.636149 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.636490 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.637664 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.637958 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.638911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.639167 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.641892 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.642298 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.643036 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.643262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.644098 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.644299 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.645039 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.645270 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.646056 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.646560 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.647475 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.647885 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.650294 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.651050 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.651264 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.651215 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.651855 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.651573 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.652051 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.652314 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.652484 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.652219 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.652739 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.652928 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.653285 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.654049 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.654229 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.654289 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.654807 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.654995 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.654874 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.655441 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.655622 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.652787 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.656244 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.656436 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.657170 node.go:539 weedfs adds child dc1 I1117 09:40:40.657363 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.657914 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.658237 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.660015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.660474 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.662403 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.662695 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.664201 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.664458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.666147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.666792 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.668648 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.668887 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.669890 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.670165 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.670907 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.671136 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.671802 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.672087 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.673308 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.673839 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.674040 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.675109 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.675707 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.675896 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.676362 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.676845 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.677026 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.677451 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.677919 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.678095 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.678525 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.678991 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.679166 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.674511 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.680062 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.680241 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.672775 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.680767 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.680947 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.679596 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.681456 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.681639 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.682494 node.go:539 weedfs adds child dc1 I1117 09:40:40.682738 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.683038 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.683468 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.685196 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.685690 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.687568 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.688096 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.688951 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.689858 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.691195 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.691868 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.693561 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.693976 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.694760 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.695829 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.696635 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.697403 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.699193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.699404 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.700636 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.701257 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.701461 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.701924 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.702407 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.702582 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.703312 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.703819 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.704000 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.704280 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.704752 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.704926 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.705200 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.705659 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.705835 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.702853 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.706805 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.707007 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.707025 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.707832 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.708225 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.706104 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.708786 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.709107 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.709753 node.go:539 weedfs adds child dc1 I1117 09:40:40.710273 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.710752 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.711203 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.712284 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.712657 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.713735 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.714370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.715316 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.715566 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.716184 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.716554 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.717163 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.717418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.718105 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.718313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.719164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.719410 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.720486 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.720913 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.721686 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.722248 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.722436 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.725729 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.726340 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.726559 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.722895 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.726873 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.727068 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.727385 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.727644 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.730821 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.736650 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.737004 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.737177 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.737376 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.737522 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.737726 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.737875 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.738269 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.739478 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.739635 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.740107 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.740302 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.741626 node.go:539 weedfs adds child dc1 I1117 09:40:40.741893 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.742196 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.742470 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.747100 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.748444 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.750673 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.751365 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.753056 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.753515 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.755343 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.755897 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.757861 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.758433 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.759320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.759979 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.760956 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.761782 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.764155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.764642 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.765890 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.768825 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.769304 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.769792 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.772130 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.772368 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.767383 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.772683 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.772833 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.767951 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.773112 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.773255 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.770379 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.773489 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.773624 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.770919 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.773852 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.773992 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.766732 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.773696 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.774236 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.774376 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.774558 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.774702 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.776202 node.go:539 weedfs adds child dc1 I1117 09:40:40.776516 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.776827 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.777076 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.778209 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.778429 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.781170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.781788 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.783107 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.783536 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.784593 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.785009 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.785772 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.786150 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.786829 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.787209 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.797175 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.797615 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.798801 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.799561 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.801198 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.801781 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.801985 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.802516 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.803050 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.803251 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.803548 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.804044 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.804227 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.804551 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.805214 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.805793 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.806025 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.806230 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.806378 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.804635 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.806153 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.806612 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.806752 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.800517 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.806943 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.807249 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.807507 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.807685 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.808341 node.go:539 weedfs adds child dc1 I1117 09:40:40.808542 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.808871 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.809487 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.811405 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.811781 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.813428 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.813766 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.815164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.815474 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.816832 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.817261 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.818649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.819295 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.820409 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.821490 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.822378 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.822865 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.824317 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.824896 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.826625 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.827816 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.828754 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.828469 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.829001 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.827769 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.828183 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.827545 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.828717 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.829905 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.830098 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.830312 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.830460 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.830177 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.830656 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.830788 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.830956 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.831074 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.831247 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.831358 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.831688 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.832051 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.832406 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.832704 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.833632 node.go:539 weedfs adds child dc1 I1117 09:40:40.834099 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.834636 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.834893 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.836520 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.836995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.838065 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.838277 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.839084 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.839359 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.841547 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.841955 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.843580 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.844072 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.845540 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.845928 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.847343 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.847851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.849384 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.849638 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.850359 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.850941 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.851135 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.851586 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.852073 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.852250 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.852516 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.852993 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.853442 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.854075 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.854749 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.855345 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.855920 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.856824 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.857358 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.857674 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.858191 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.858391 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.858597 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.858758 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.858957 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.859108 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.859295 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.859437 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.860198 node.go:539 weedfs adds child dc1 I1117 09:40:40.860452 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.860723 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.860969 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.861892 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.862105 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.862827 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.864246 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.866122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.866655 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.867816 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.868152 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.868734 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.868948 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.871008 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.871478 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.872543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.872804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.873665 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.873895 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.874563 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.875154 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.875369 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.875897 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.876786 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.877230 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.877757 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.878503 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.878516 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.878297 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.878904 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.879010 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.877861 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.879261 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.879794 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.880522 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.880747 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.880902 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.881094 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.881223 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.881413 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.881549 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.881728 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.881862 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.882487 node.go:539 weedfs adds child dc1 I1117 09:40:40.882751 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.883052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.883459 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.884344 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.884574 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.885145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.885592 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.886259 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.886463 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.887244 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.887438 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.888127 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.888369 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.889072 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.889289 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.889947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.890206 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.890800 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.891014 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.891806 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.892364 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.892550 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.893307 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.893795 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.893486 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.893429 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.893965 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.894163 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.894307 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.894155 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.894517 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.894242 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.894669 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.894838 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.894959 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.895126 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.894939 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.895264 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.895441 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.895563 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.892978 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.896109 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.896276 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.896821 node.go:539 weedfs adds child dc1 I1117 09:40:40.897238 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.897623 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.897980 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.898959 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.899294 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.900125 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.900458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.901385 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.901933 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.902638 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.903670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.904454 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.904788 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.905916 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.906104 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.906725 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.906975 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.907583 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.908056 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.908777 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.909311 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.909488 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.913785 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.914842 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.915045 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.915498 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.915989 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.916168 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.916686 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.917208 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.917382 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.917659 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.918114 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.918283 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.918542 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.918971 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.919142 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.919857 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.920434 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.920607 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.924307 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.925009 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.925208 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.925867 node.go:539 weedfs adds child dc1 I1117 09:40:40.926120 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.926393 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.926660 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.927852 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.928073 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.928909 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.929132 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.931408 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.931776 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.933374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.933975 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.934981 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.935535 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.936885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.937454 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.938483 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.938976 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.940147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.940601 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.941965 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.942652 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.943014 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.942870 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.943227 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.942875 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.942208 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.942291 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.942022 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.943457 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.941552 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.943783 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.944014 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.944378 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.944572 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.944720 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.944912 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.945060 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.945248 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.945386 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.945584 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.945789 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.945983 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.946115 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.947044 node.go:539 weedfs adds child dc1 I1117 09:40:40.947311 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.947560 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.947780 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.948705 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.948969 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.949654 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.950272 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.950819 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.951097 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.951670 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.952228 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.952815 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.953039 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.953549 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.953895 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.954372 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.954564 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.955363 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.955549 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.956209 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.957106 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.957352 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.957850 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.958372 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.958607 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.959044 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.959542 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.959784 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.960100 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.960642 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.961220 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.961849 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.960054 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.963162 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.963347 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.963639 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.963785 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.963963 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.964089 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.964278 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.964391 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.964563 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.964684 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.965134 node.go:539 weedfs adds child dc1 I1117 09:40:40.965448 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.965712 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.965929 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.970791 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.971217 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.972170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.972393 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.974278 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.974700 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.975406 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.975769 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.976389 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.976615 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.978277 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.978506 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.979261 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.979469 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.980327 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.980628 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:40.981340 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:40.981926 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:40.982183 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:40.981875 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:40.982423 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:40.982593 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:40.982640 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:40.982853 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:40.983347 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:40.983724 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:40.984126 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:40.984291 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:40.984795 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:40.984987 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:40.985236 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:40.985393 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:40.985604 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:40.985752 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:40.985971 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:40.986109 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:40.986380 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:40.986532 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:40.986739 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:40.986883 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:40.987505 node.go:539 weedfs adds child dc1 I1117 09:40:40.987772 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:40.988231 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:40.988647 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:40.990584 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:40.990844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:40.992530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:40.992919 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:40.994069 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:40.994400 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:40.995004 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:40.995297 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:40.996092 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:40.996365 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:40.997121 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:40.997607 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:40.998318 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:40.998619 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:40.999329 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:40.999556 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.000418 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.000575 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.000948 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.001242 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.001177 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.001602 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.001930 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.002311 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.002632 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.002633 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.002169 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.003041 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.002741 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.001682 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.003231 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.003540 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.003308 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.004441 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.004667 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.004823 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.005011 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.005168 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.005356 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.005515 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.006233 node.go:539 weedfs adds child dc1 I1117 09:40:41.007259 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.007646 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.007899 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.009805 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.010081 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.011825 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.012207 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.014094 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.014380 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.015112 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.015322 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.015970 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.016325 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.016914 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.017122 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.017874 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.018076 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.018765 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.019007 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.020036 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.020660 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.020863 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.021350 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.021940 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.022120 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.022573 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.019724 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.023843 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.023945 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.024309 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.024488 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.025182 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.026203 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.026558 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.027211 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.027439 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.027587 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.028022 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.028160 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.028355 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.028485 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.028671 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.028797 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.029690 node.go:539 weedfs adds child dc1 I1117 09:40:41.029893 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.030152 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.030623 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.031916 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.032241 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.033802 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.034234 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.035370 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.035622 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.036679 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.037034 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.037922 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.038275 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.039110 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.039662 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.040493 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.041047 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.041746 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.041949 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.042764 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.042774 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.042856 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.043358 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.042805 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.043551 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.043262 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.043438 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.043805 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.043534 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.043985 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.044198 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.044344 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.044590 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.044739 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.044918 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.045054 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.045244 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.045391 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.045570 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.045711 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.046724 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.047303 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.047490 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.048166 node.go:539 weedfs adds child dc1 I1117 09:40:41.048415 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.048684 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.048935 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.050441 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.050881 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.051948 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.053025 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.054057 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.054886 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.056575 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.056789 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.057583 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.058218 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.058989 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.059916 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.061494 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.061781 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.063378 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.063597 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.065384 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.065988 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.069614 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.069675 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.070237 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.066580 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.067262 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.067801 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.068343 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.068890 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.070427 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.070815 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.070863 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.071217 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.071807 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.072147 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.072512 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.072850 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.073205 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.073366 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.073716 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.073998 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.074355 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.074642 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.081793 node.go:539 weedfs adds child dc1 I1117 09:40:41.082205 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.082559 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.082859 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.084075 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.084273 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.086436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.086687 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.087482 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.087678 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.088423 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.088671 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.089233 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.089548 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.092512 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.092829 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.094528 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.095099 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.096561 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.096778 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.098199 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.098817 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.099004 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.098838 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.099288 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.099444 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.099681 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.100090 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.100237 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.099896 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.100440 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.100232 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.100620 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.100471 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.100845 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.101005 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.101194 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.101333 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.101628 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.099281 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.102290 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.102461 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.102677 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.102919 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.103543 node.go:539 weedfs adds child dc1 I1117 09:40:41.103722 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.103993 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.104442 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.105494 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.105733 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.106378 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.106600 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.107108 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.107354 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.107830 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.108019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.108613 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.108839 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.109466 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.109669 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.110183 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.110437 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.111073 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.111261 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.112088 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.112124 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.112603 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.112797 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.113026 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.112835 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.113174 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.113466 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.113648 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.113401 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.113832 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.114077 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.113921 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.114391 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.114563 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.114322 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.114743 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.114901 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.115147 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.114830 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.115581 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.115848 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.116072 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.116239 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.116924 node.go:539 weedfs adds child dc1 I1117 09:40:41.117164 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.117421 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.117661 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.118684 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.118906 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.119823 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.120144 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.120794 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.120999 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.121543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.121886 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.122555 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.122768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.124403 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.124729 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.126259 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.126710 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.127984 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.128567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.129702 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.132334 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.132816 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.133032 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.133293 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.133449 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.130344 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.133905 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.132947 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.133745 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.130890 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.134080 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.131378 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.131848 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.134340 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.134475 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.134654 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.134774 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.134952 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.135079 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.135248 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.135364 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.135566 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.135700 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.136116 node.go:539 weedfs adds child dc1 I1117 09:40:41.136426 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.136693 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.136987 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.137771 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.137956 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.138649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.138908 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.139567 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.140967 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.141487 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.141909 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.142528 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.142854 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.143574 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.143907 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.144697 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.145128 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.146154 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.146535 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.147253 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.147809 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.147997 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.148427 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.148927 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.149108 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.149382 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.153613 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.154036 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.150014 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.150584 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.151136 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.151682 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.152220 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.154452 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.154792 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.154990 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.155290 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.155599 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.155746 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.156051 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.156201 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.156499 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.156658 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.157388 node.go:539 weedfs adds child dc1 I1117 09:40:41.157638 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.157893 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.158212 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.160161 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.160423 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.161912 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.162132 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.163515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.163885 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.164737 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.164940 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.165608 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.165836 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.166354 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.166706 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.167314 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.167522 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.168255 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.168455 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.169186 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.169767 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.169494 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.170129 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.170695 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.170029 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.170612 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.171042 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.170512 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.171375 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.171312 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.171953 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.172127 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.169122 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.172307 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.172461 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.172658 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.172789 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.172988 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.173139 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.173315 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.173453 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.173637 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.173757 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.174316 node.go:539 weedfs adds child dc1 I1117 09:40:41.174559 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.174810 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.175027 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.175848 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.176046 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.176770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.176964 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.177597 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.178020 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.178677 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.179282 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.180482 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.180820 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.181892 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.182227 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.183295 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.183487 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.184077 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.184639 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.185425 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.186103 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.186430 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.185503 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.186939 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.186882 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.187230 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.187602 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.187743 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.187506 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.187974 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.188159 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.187993 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.188436 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.188603 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.188426 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.188917 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.189102 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.188874 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.186334 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.189316 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.189482 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.189689 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.189835 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.190583 node.go:539 weedfs adds child dc1 I1117 09:40:41.190863 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.191182 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.191426 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.192515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.192713 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.193658 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.193923 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.194566 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.194751 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.195456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.195652 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.196493 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.196997 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.197749 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.198086 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.198856 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.199055 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.199685 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.199884 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.200906 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.201106 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.201635 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.201669 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.201670 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.202114 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.201003 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.201772 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.201737 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.202353 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.202541 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.200560 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.202750 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.202918 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.203129 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.203281 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.203466 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.203608 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.203812 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.203941 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.205078 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.205398 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.205622 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.205751 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.206376 node.go:539 weedfs adds child dc1 I1117 09:40:41.206689 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.206960 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.207207 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.208586 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.209044 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.209910 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.210316 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.211074 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.211302 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.212197 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.212566 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.213367 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.213701 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.214403 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.214819 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.215504 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.215840 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.216679 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.217101 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.218268 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.218214 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.218870 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.219076 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.219330 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.219496 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.219346 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.219999 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.220007 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.220326 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.220822 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.220829 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.221121 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.221682 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.222296 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.222203 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.222783 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.221628 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.223143 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.223284 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.223507 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.223644 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.223838 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.223981 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.224536 node.go:539 weedfs adds child dc1 I1117 09:40:41.224739 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.225462 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.225767 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.227463 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.228069 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.229991 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.230531 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.231784 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.232198 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.232968 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.233685 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.235226 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.235487 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.236919 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.237359 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.238896 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.239302 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.240180 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.241053 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.242419 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.242996 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.243209 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.243503 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.243972 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.244143 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.244410 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.244862 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.245035 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.245343 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.245791 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.245967 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.246774 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.247271 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.247442 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.247711 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.248162 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.248336 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.248627 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.249098 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.249271 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.246253 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.250356 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.250542 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.251164 node.go:539 weedfs adds child dc1 I1117 09:40:41.251513 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.251829 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.252128 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.253466 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.253686 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.255061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.255271 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.256819 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.257113 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.258440 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.258845 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.260122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.260360 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.261515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.261685 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.262184 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.262351 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.262966 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.263970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.265010 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.265510 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.265684 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.265942 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.266368 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.266552 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.266795 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.269290 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.269446 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.267444 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.269639 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.269771 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.267546 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.269975 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.270095 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.267759 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.270287 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.270483 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.268035 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.271010 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.271265 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.268666 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.272085 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.272376 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.273328 node.go:539 weedfs adds child dc1 I1117 09:40:41.273804 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.274133 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.274464 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.275971 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.276485 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.278109 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.279427 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.280198 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.280397 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.281665 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.281860 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.282474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.282658 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.283201 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.283613 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.284176 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.284370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.285183 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.285371 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.286704 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.287247 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.287433 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.287891 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.288358 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.288535 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.288919 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.289358 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.289526 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.290294 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.290809 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.290980 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.291265 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.291706 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.291875 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.292120 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.292548 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.292709 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.286078 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.293775 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.293978 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.292965 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.297863 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.298169 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.298970 node.go:539 weedfs adds child dc1 I1117 09:40:41.299162 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.299415 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.299787 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.300641 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.300947 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.301518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.301756 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.302227 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.302407 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.304847 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.305146 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.306062 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.306318 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.307100 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.307352 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.307943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.308240 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.308898 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.309161 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.310092 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.310678 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.310901 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.310106 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.311175 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.311332 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.310687 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.311225 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.311547 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.311705 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.311894 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.311753 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.312033 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.312289 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.312457 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.312269 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.312737 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.312913 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.312717 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.313469 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.319873 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.320289 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.320627 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.320796 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.321478 node.go:539 weedfs adds child dc1 I1117 09:40:41.321752 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.322029 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.322263 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.329306 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.329599 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.330572 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.330798 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.331539 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.331742 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.334308 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.334792 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.335489 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.335792 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.337220 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.337595 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.339290 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.339740 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.341393 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.341751 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.342498 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.343502 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.344700 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.345515 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.346119 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.346694 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.346750 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.347238 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.348323 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.348541 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.348787 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.348930 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.349124 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.349395 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.349580 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.349703 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.349895 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.350112 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.350290 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.350417 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.350609 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.350751 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.350933 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.351061 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.352036 node.go:539 weedfs adds child dc1 I1117 09:40:41.352538 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.353061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.353580 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.355292 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.355928 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.357859 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.358304 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.358979 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.359249 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.360001 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.360186 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.360831 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.361046 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.361545 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.361823 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.362315 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.362503 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.365030 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.365479 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.367006 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.367588 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.367781 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.368070 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.368570 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.368752 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.369017 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.369493 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.369676 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.370282 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.370378 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.370358 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.370893 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.371109 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.372178 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.373513 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.373757 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.373914 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.374103 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.374243 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.374766 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.374919 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.375108 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.375242 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.376024 node.go:539 weedfs adds child dc1 I1117 09:40:41.376424 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.377086 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.380157 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.381259 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.381508 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.382252 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.382466 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.382973 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.384795 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.386011 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.386312 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.387288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.387481 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.388920 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.389207 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.390148 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.390495 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.391474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.391747 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.392397 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.392950 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.393379 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.393949 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.394559 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.394872 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.395413 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.396058 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.396457 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.396771 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.396979 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.397373 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.397565 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.397537 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.397789 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.398096 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.398325 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.398951 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.399268 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.399558 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.400017 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.400300 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.400773 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.401055 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.401895 node.go:539 weedfs adds child dc1 I1117 09:40:41.402352 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.402720 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.402980 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.404493 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.404764 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.406200 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.406399 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.407563 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.407782 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.409167 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.409360 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.410792 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.411153 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.412256 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.412527 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.413026 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.413919 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.415252 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.415462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.416227 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.416775 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.416955 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.417359 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.417810 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.417975 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.418925 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.419420 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.419593 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.419868 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.420317 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.420481 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.420879 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.421325 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.418225 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.421504 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.421718 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.421857 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.421818 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.422153 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.422431 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.422700 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.422938 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.423085 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.423506 node.go:539 weedfs adds child dc1 I1117 09:40:41.423946 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.424427 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.424890 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.426093 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.426547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.427914 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.428187 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.429111 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.429424 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.430771 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.430990 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.431751 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.431945 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.432561 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.432745 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.434540 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.435157 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.436649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.437130 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.437906 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.438434 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.438613 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.439015 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.439453 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.439620 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.439988 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.440495 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.440666 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.440929 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.441386 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.441565 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.441822 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.442253 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.442418 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.442670 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.443321 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.444283 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.444816 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.445408 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.445771 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.445910 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.446190 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.446321 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.447076 node.go:539 weedfs adds child dc1 I1117 09:40:41.447350 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.447607 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.447904 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.448978 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.450084 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.451775 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.452180 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.452939 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.453137 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.453703 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.454019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.454555 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.454873 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.455424 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.455626 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.456172 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.457489 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.458529 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.458977 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.460433 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.460989 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.461195 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.461369 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.461657 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.461889 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.461924 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.462278 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.462466 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.463158 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.464137 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.464688 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.465000 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.465138 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.465334 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.465466 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.465652 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.465787 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.465956 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.466072 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.466238 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.466363 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.466553 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.466683 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.467266 node.go:539 weedfs adds child dc1 I1117 09:40:41.467483 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.467736 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.468029 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.468826 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.469010 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.469677 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.470874 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.472527 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.473033 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.473649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.473943 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.474447 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.474633 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.475373 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.475556 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.476104 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.476284 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.478773 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.479371 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.480696 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.481232 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.481408 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.481666 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.482103 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.482263 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.482505 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.482917 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.483096 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.483333 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.483757 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.483915 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.484158 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.484581 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.484742 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.484994 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.485413 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.485573 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.486376 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.487206 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.487958 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.488276 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.488689 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.488820 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.489347 node.go:539 weedfs adds child dc1 I1117 09:40:41.489564 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.490095 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.490510 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.492002 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.492465 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.493265 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.493510 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.494563 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.494757 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.495338 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.495545 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.496226 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.497939 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.499345 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.499842 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.501083 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.501466 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.502154 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.502377 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.503424 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.503962 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.504139 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.504536 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.504996 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.505161 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.505534 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.505975 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.506214 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.506978 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.507460 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.507629 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.507893 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.508332 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.508501 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.503045 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.508874 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.509066 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.508860 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.509296 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.509461 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.510063 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.510642 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.510944 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.511682 node.go:539 weedfs adds child dc1 I1117 09:40:41.512076 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.512373 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.512994 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.514065 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.514324 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.515203 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.515439 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.515994 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.516301 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.517260 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.517468 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.518148 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.518336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.519084 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.519341 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.519947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.520257 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.520924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.521139 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.521997 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.522592 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.522788 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.523292 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.523859 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.523684 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.524049 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.524274 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.524417 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.524211 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.524689 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.524843 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.524837 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.525283 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.525091 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.525448 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.525642 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.525789 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.525663 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.525744 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.526207 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.526394 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.526994 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.527309 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.527967 node.go:539 weedfs adds child dc1 I1117 09:40:41.528327 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.529192 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.529962 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.531064 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.531254 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.531958 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.532214 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.533039 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.534366 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.535323 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.535711 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.536315 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.536538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.537196 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.537740 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.538486 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.538687 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.539319 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.539621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.540303 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.540424 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.540480 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.540788 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.541105 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.540809 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.540531 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.541003 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.541049 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.541338 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.541523 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.541717 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.541866 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.542057 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.542191 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.542364 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.542506 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.542739 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.542870 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.543042 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.542739 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.543187 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.543372 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.543510 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.544387 node.go:539 weedfs adds child dc1 I1117 09:40:41.544813 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.545196 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.545458 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.546578 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.547000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.547898 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.548110 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.549213 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.550152 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.551188 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.551577 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.552445 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.552866 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.553641 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.553927 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.554929 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.555365 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.556587 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.556855 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.557600 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.558142 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.558317 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.558749 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.559207 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.559375 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.559984 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.560061 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.560451 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.560711 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.560726 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.560118 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.561607 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.559634 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.562359 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.563051 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.563667 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.563810 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.564000 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.564134 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.564306 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.564435 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.564600 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.564722 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.565259 node.go:539 weedfs adds child dc1 I1117 09:40:41.565459 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.565716 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.566105 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.568731 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.569195 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.569946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.570243 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.570838 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.571034 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.572758 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.572998 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.574051 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.574348 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.575364 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.575592 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.576297 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.576614 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.577278 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.577589 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.578551 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.579304 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.579214 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.579610 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.579814 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.579966 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.579802 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.580242 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.580415 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.580200 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.580588 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.580732 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.580668 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.581101 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.580954 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.581267 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.581465 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.581607 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.578658 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.581436 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.581821 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.581958 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.582124 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.582274 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.583621 node.go:539 weedfs adds child dc1 I1117 09:40:41.584076 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.584890 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.585430 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.587849 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.588401 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.590711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.591597 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.593618 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.594043 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.595847 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.596097 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.596745 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.597088 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.597722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.598002 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.598573 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.598763 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.599424 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.599611 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.601426 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.602001 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.602186 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.602460 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.602913 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.603088 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.603387 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.603822 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.603472 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.603985 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.604178 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.604320 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.604158 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.604655 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.604558 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.604845 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.605088 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.605259 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.605128 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.605565 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.605730 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.605537 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.606022 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.606485 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.607483 node.go:539 weedfs adds child dc1 I1117 09:40:41.607688 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.607952 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.608328 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.609390 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.609924 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.610911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.611422 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.612315 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.612540 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.613553 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.613832 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.614500 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.614702 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.615362 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.615590 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.616093 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.617732 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.618420 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.618622 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.619300 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.619819 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.620009 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.620047 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.620280 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.620611 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.620801 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.621028 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.620807 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.621158 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.621344 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.621499 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.621302 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.621718 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.621879 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.621930 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.622406 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.622119 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.622580 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.622769 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.622934 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.622849 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.624643 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.625020 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.625701 node.go:539 weedfs adds child dc1 I1117 09:40:41.626100 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.626422 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.626675 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.628044 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.628391 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.629310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.629785 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.630800 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.631351 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.632217 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.632912 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.633554 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.633749 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.634563 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.634764 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.643249 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.643780 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.645899 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.646262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.648023 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.648635 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.648832 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.649187 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.649720 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.649917 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.650213 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.650712 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.650895 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.651178 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.651638 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.651811 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.652083 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.652540 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.652712 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.653359 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.653908 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.654092 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.654575 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.655077 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.655252 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.652968 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.655910 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.656088 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.656884 node.go:539 weedfs adds child dc1 I1117 09:40:41.657291 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.657707 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.658228 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.659843 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.660327 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.662003 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.662329 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.664348 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.664663 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.666531 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.666811 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.668009 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.668244 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.668986 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.669239 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.669817 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.670139 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.670765 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.670974 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.671964 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.672521 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.672718 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.673564 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.674084 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.674274 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.674686 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.675206 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.675391 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.675695 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.676171 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.676346 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.676651 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.678828 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.678999 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.677250 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.679226 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.679386 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.677981 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.679599 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.679728 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.680539 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.681298 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.681640 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.682561 node.go:539 weedfs adds child dc1 I1117 09:40:41.682800 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.683086 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.683416 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.684990 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.685212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.687347 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.687755 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.689849 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.690233 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.691718 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.692120 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.693343 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.693560 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.694398 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.694668 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.695366 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.695558 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.696392 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.697545 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.698861 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.699443 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.699638 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.699946 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.703414 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.703879 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.704455 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.705026 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.705226 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.700648 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.705936 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.706311 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.701222 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.707147 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.707302 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.701741 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.707572 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.702279 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.702799 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.708498 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.709921 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.710079 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.710502 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.711011 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.711995 node.go:539 weedfs adds child dc1 I1117 09:40:41.712192 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.712484 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.712997 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.714006 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.714356 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.715076 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.715347 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.715891 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.716095 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.719215 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.719494 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.721003 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.721381 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.722844 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.723248 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.724234 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.724456 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.725087 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.725398 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.727234 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.727794 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.727984 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.728396 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.728882 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.729063 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.729261 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.729361 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.729836 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.730031 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.730328 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.730343 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.730802 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.730982 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.731425 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.731656 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.731807 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.732187 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.726050 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.732349 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.732532 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.732654 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.732863 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.732999 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.733458 node.go:539 weedfs adds child dc1 I1117 09:40:41.733800 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.734149 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.734468 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.735408 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.735630 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.736474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.736670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.737310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.737617 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.738119 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.738535 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.739173 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.739501 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.741085 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.741866 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.742826 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.743208 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.743995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.744276 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.744960 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.745058 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.745515 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.745208 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.745696 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.745544 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.745892 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.745672 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.746039 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.744959 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.746233 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.746419 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.746627 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.746790 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.746147 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.750315 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.750529 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.746738 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.750777 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.750914 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.751396 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.751538 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.751723 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.751855 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.752363 node.go:539 weedfs adds child dc1 I1117 09:40:41.752709 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.756747 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.757137 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.758150 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.758370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.759171 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.759433 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.761280 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.761661 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.762719 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.763500 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.764423 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.765286 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.766532 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.767279 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.768550 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.768804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.769544 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.770356 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.771635 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.772194 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.772390 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.772698 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.773211 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.773394 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.773674 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.774156 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.774327 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.774592 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.775057 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.775233 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.775590 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.775607 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.775692 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.776144 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.776319 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.776557 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.776699 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.776883 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.777010 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.777677 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.778377 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.778722 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.779458 node.go:539 weedfs adds child dc1 I1117 09:40:41.779804 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.780482 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.780918 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.782553 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.782814 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.784398 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.784611 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.786076 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.786911 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.788764 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.789190 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.790834 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.791062 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.792657 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.792875 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.794141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.794344 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.795201 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.795506 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.796660 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.797211 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.797400 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.797694 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.798242 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.798416 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.796194 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.799128 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.798842 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.799335 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.799574 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.799726 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.800023 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.800866 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.800847 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.800246 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.801377 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.801618 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.802331 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.802940 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.803452 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.805480 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.805735 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.805884 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.806660 node.go:539 weedfs adds child dc1 I1117 09:40:41.806920 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.807459 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.807951 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.810128 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.810506 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.812610 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.812854 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.814756 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.815148 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.816890 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.817331 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.818770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.819169 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.819943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.820345 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.821477 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.821709 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.823419 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.824074 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.825648 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.825943 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.825984 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.826011 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.826544 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.826653 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.826617 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.826704 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.826309 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.827903 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.828492 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.828837 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.829222 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.829518 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.829910 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.830205 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.830409 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.830550 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.830740 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.830882 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.831239 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.831438 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.831670 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.831824 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.832526 node.go:539 weedfs adds child dc1 I1117 09:40:41.832784 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.833057 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.833426 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.834292 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.834604 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.835327 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.835635 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.836243 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.836451 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.837258 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.837720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.838560 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.838922 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.839676 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.840146 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.840704 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.840903 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.841849 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.842046 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.842856 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.843437 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.843631 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.844071 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.844588 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.844795 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.845079 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.845682 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.845858 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.846118 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.846601 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.846248 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.846775 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.846979 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.847128 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.847073 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.847492 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.847371 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.847652 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.847867 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.848231 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.848403 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.848613 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.848924 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.849519 node.go:539 weedfs adds child dc1 I1117 09:40:41.849984 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.850422 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.850871 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.852549 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.853012 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.854352 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.854830 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.855955 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.856329 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.856955 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.857267 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.857892 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.858120 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.859429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.859901 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.860704 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.860902 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.861645 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.861835 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.862506 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.863061 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.863263 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.863445 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.864082 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.864284 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.864086 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.864571 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.864754 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.863542 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.864988 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.864811 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.865135 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.865464 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.865358 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.865648 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.865909 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.866082 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.866044 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.866343 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.868208 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.868509 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.868728 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.868865 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.869497 node.go:539 weedfs adds child dc1 I1117 09:40:41.869802 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.870092 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.870341 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.875190 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.875543 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.877227 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.877504 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.878405 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.878970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.880845 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.881347 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.882764 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.883157 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.883827 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.884153 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.884778 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.885020 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.886529 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.887170 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.888752 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.889593 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.889962 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.890032 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.890572 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.890271 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.890748 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.890964 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.891119 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.890914 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.891369 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.891543 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.891507 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.891980 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.891810 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.892138 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.892339 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.892472 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.892403 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.893498 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.894092 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.892842 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.894766 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.895114 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.895747 node.go:539 weedfs adds child dc1 I1117 09:40:41.895939 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.896190 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.896626 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.897443 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.897852 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.899861 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.900290 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.901610 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.902172 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.903656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.904095 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.905229 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.905440 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.906665 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.906907 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.907495 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.907793 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.908536 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.908733 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.910850 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.911434 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.911683 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.911454 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.911939 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.912113 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.911983 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.912459 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.912364 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.912634 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.912930 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.913105 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.912897 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.913381 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.913559 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.913352 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.913767 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.913929 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.913822 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.914312 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.914444 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.914338 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.914782 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.914963 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.915568 node.go:539 weedfs adds child dc1 I1117 09:40:41.915805 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.916067 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.916310 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.917873 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.918105 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.919552 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.919782 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.920970 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.921302 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.922822 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.923330 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.924990 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.925245 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.926650 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.927135 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.928441 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.928705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.929877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.930098 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.935805 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.936599 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.936293 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.936803 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.937066 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.937226 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.937113 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.937684 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.937366 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.937851 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.937703 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.937795 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.938050 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.937587 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.938349 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.938577 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.938750 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.939201 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.936063 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.939347 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.939855 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.940134 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.944222 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.944480 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.949573 node.go:539 weedfs adds child dc1 I1117 09:40:41.953451 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.954179 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.954594 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.961653 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.962101 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.963289 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.963559 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.964551 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.965027 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.974494 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.974968 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.975941 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.976170 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:41.980427 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:41.980962 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:41.982120 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:41.982620 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:41.983968 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:41.985185 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:41.987333 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:41.988235 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:41.988096 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:41.988757 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:41.988648 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:41.988751 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:41.987890 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:41.989131 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:41.989302 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:41.988829 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:41.989504 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:41.989661 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:41.989341 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:41.989847 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:41.989988 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:41.990189 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:41.990323 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:41.990510 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:41.990646 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:41.990837 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:41.990963 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:41.991393 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:41.991948 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:41.992119 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:41.992757 node.go:539 weedfs adds child dc1 I1117 09:40:41.992970 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:41.993744 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:41.993992 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:41.995297 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:41.995498 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:41.996266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:41.996465 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:41.997211 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:41.997430 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:41.997981 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:41.998293 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:41.998803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:41.998989 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.000339 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.000597 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.001294 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.001676 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.002501 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.003037 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.004143 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.004676 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.004388 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.004856 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.005060 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.004805 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.005195 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.005058 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.005371 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.005492 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.005387 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.005690 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.005837 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.005621 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.005906 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.006176 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.006320 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.006521 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.006668 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.006510 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.006842 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.006974 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.007143 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.007277 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.007972 node.go:539 weedfs adds child dc1 I1117 09:40:42.008250 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.008516 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.008752 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.010538 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.010797 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.011867 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.012097 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.013607 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.013823 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.014830 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.015190 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.016078 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.016473 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.017274 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.018167 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.019601 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.020019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.020968 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.021305 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.022217 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.023252 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.023606 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.023597 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.024315 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.024084 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.024526 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.024807 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.024691 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.024981 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.025254 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.025399 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.025260 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.025706 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.025872 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.025861 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.026305 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.026127 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.026905 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.026699 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.027465 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.027643 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.027907 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.028325 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.028880 node.go:539 weedfs adds child dc1 I1117 09:40:42.029059 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.029430 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.030129 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.031756 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.032290 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.033610 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.034644 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.036236 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.036765 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.037432 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.037654 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.039879 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.040095 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.041872 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.042271 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.043562 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.044672 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.045500 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.045699 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.046695 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.047598 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.047777 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.048091 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.048573 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.048746 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.048219 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.049047 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.049254 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.049232 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.049679 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.049853 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.049563 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.050067 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.050250 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.050112 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.050537 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.050700 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.050529 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.051002 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.050957 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.051374 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.051610 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.051772 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.052489 node.go:539 weedfs adds child dc1 I1117 09:40:42.052748 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.053014 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.053271 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.054320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.054534 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.055393 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.055601 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.056329 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.057230 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.058132 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.058599 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.059798 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.060023 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.060971 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.061970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.062946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.063369 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.064341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.066045 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.067777 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.068409 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.068620 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.068929 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.069461 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.069652 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.069858 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.070457 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.070224 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.070652 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.070556 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.070296 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.070903 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.071171 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.070918 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.070999 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.071407 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.071567 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.071789 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.071943 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.072153 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.072299 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.072508 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.072661 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.073551 node.go:539 weedfs adds child dc1 I1117 09:40:42.073849 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.074238 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.074536 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.075736 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.075956 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.077175 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.077412 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.078333 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.079515 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.080274 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.080894 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.082454 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.083367 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.084261 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.084515 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.085560 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.085770 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.086812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.087144 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.088019 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.088790 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.088672 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.088987 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.089243 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.088080 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.088022 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.089652 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.088806 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.089885 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.089781 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.090280 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.090526 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.090683 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.090995 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.091180 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.091390 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.091539 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.091814 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.092151 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.092557 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.092709 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.092912 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.093061 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.093778 node.go:539 weedfs adds child dc1 I1117 09:40:42.094047 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.094372 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.094653 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.096195 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.096614 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.097659 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.097862 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.098682 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.098860 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.099511 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.099697 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.100420 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.100626 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.101136 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.101408 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.101901 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.102149 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.102822 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.103008 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.104600 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.105274 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.105491 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.104601 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.105399 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.105762 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.105499 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.105943 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.106141 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.106289 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.106114 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.104673 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.106527 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.105997 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.106661 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.106843 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.107209 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.106552 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.107413 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.107848 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.108335 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.108571 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.108919 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.109421 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.110302 node.go:539 weedfs adds child dc1 I1117 09:40:42.110869 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.111306 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.111985 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.113610 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.113991 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.115931 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.116317 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.117081 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.117387 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.118465 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.118677 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.119427 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.119724 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.121150 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.121544 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.122176 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.122389 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.123341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.123628 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.124464 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.125047 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.125248 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.125747 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.126258 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.126809 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.127120 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.127544 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.127786 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.127816 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.128139 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.129086 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.129349 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.129647 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.130025 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.130312 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.130686 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.131045 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.131508 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.131656 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.131855 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.132004 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.132215 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.132360 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.132906 node.go:539 weedfs adds child dc1 I1117 09:40:42.133287 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.133606 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.133856 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.134938 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.135215 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.136872 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.137106 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.138342 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.138729 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.140205 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.140702 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.141633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.141928 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.142711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.143453 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.145023 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.145547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.146468 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.147036 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.148313 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.149053 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.149594 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.149700 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.150305 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.150255 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.150602 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.150268 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.150371 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.150772 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.150993 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.150830 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.151145 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.150978 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.151353 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.151625 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.152397 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.152789 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.153565 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.153769 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.153998 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.154141 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.154350 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.154498 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.155157 node.go:539 weedfs adds child dc1 I1117 09:40:42.155604 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.155967 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.156274 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.158293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.158554 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.160070 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.160301 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.161178 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.161412 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.162002 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.162313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.162921 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.164629 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.166513 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.167092 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.168845 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.169074 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.170812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.171160 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.171922 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.172461 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.172639 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.172378 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.172929 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.173169 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.173341 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.173851 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.173668 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.174034 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.174252 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.174402 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.174456 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.174970 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.174688 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.175152 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.175693 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.175485 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.175879 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.176078 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.176223 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.172932 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.176865 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.177329 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.178200 node.go:539 weedfs adds child dc1 I1117 09:40:42.178454 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.179007 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.179260 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.181325 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.181581 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.182609 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.182824 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.183756 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.183967 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.184730 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.184939 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.185649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.186083 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.187474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.187707 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.188511 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.188719 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.189535 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.189749 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.191275 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.191869 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.192058 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.192481 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.192941 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.192888 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.192939 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.192986 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.193043 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.193599 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.194213 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.193993 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.194546 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.194967 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.195381 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.195693 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.196059 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.196346 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.196725 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.196890 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.197079 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.197205 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.197399 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.197533 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.198001 node.go:539 weedfs adds child dc1 I1117 09:40:42.198190 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.198677 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.199022 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.200362 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.200621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.202155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.202494 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.203995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.204404 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.205316 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.205875 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.206784 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.207002 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.207786 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.207986 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.208632 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.209023 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.209851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.210498 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.211838 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.212412 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.212611 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.211850 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.212858 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.212556 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.213018 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.213235 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.213372 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.213180 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.213643 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.213801 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.213639 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.214088 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.214252 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.214099 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.214569 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.214751 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.214904 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.215427 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.215610 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.211800 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.216642 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.216852 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.217599 node.go:539 weedfs adds child dc1 I1117 09:40:42.223835 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.224499 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.224888 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.225937 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.226199 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.230826 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.231216 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.232433 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.232655 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.233364 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.233725 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.234316 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.234528 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.235581 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.235789 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.236509 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.236720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.237498 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.237734 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.238428 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.238534 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.239003 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.239177 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.239425 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.239166 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.239537 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.239694 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.240137 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.240213 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.240736 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.240921 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.240489 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.241329 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.241204 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.241699 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.241972 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.241804 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.242323 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.242679 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.242954 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.239760 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.245930 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.246096 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.247308 node.go:539 weedfs adds child dc1 I1117 09:40:42.247533 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.247834 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.248228 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.249141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.249444 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.250238 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.250518 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.251080 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.251286 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.252020 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.252216 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.252786 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.252974 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.255955 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.256257 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.257610 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.258038 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.259366 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.259679 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.260376 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.260860 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.263684 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.264142 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.264391 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.264557 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.261326 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.264813 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.264963 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.262115 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.265189 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.265308 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.262653 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.265515 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.265652 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.263132 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.265906 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.266060 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.262991 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.266293 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.263565 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.267071 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.267307 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.267442 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.267929 node.go:539 weedfs adds child dc1 I1117 09:40:42.268343 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.268650 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.269005 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.270887 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.271394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.272241 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.272428 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.273103 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.273443 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.274911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.275247 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.275862 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.276382 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.278221 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.278435 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.279830 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.280058 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.281106 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.281458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.282094 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.282633 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.282827 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.283131 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.283639 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.283336 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.283814 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.284042 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.283765 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.284201 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.283905 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.284067 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.284406 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.284708 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.284458 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.284644 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.284955 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.285107 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.285324 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.285461 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.285659 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.285798 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.286010 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.286154 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.289946 node.go:539 weedfs adds child dc1 I1117 09:40:42.290211 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.290503 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.290904 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.291834 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.292208 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.293246 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.293792 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.294760 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.295072 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.295649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.295853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.296522 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.296840 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.297461 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.297656 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.298242 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.298482 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.299147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.299474 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.300645 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.301273 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.301479 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.301979 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.302496 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.302689 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.303382 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.303940 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.304131 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.304441 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.304933 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.305096 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.305365 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.305816 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.305966 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.306685 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.303019 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.307217 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.307396 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.307614 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.306205 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.307734 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.307912 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.308054 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.308686 node.go:539 weedfs adds child dc1 I1117 09:40:42.308923 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.309194 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.309450 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.310964 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.311151 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.312734 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.312958 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.314308 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.314481 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.315477 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.315651 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.316146 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.316488 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.317026 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.317196 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.318000 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.318180 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.319401 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.319723 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.321032 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.321149 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.321186 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.321583 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.321771 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.321988 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.321788 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.322117 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.322298 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.322113 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.322429 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.322372 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.322716 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.322897 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.323090 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.323238 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.320428 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.323434 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.323571 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.323761 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.323893 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.324256 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.324692 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.324839 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.325425 node.go:539 weedfs adds child dc1 I1117 09:40:42.325648 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.325903 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.326144 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.327216 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.327633 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.329070 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.329313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.331044 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.331541 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.332540 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.333484 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.334559 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.335024 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.335682 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.335987 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.336727 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.337235 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.337936 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.338125 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.338932 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.339466 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.339242 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.339225 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.339376 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.339650 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.339975 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.339829 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.340158 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.339865 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.339965 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.340328 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.340465 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.340613 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.340737 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.340894 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.341024 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.341209 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.341353 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.341539 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.341668 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.338943 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.342306 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.342490 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.342992 node.go:539 weedfs adds child dc1 I1117 09:40:42.343342 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.343658 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.343903 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.344929 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.345168 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.346728 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.346931 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.347494 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.347921 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.348522 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.348766 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.349232 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.349401 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.350015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.350176 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.350755 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.350940 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.351546 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.351779 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.352404 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.352920 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.352730 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.353160 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.352963 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.352385 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.352978 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.353021 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.352379 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.353399 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.354115 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.354491 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.354746 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.354908 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.355116 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.355256 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.355441 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.355574 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.355809 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.355949 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.356137 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.356571 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.356781 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.356913 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.357513 node.go:539 weedfs adds child dc1 I1117 09:40:42.357755 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.358030 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.358280 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.359254 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.359540 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.361330 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.361567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.362766 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.362974 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.363707 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.363942 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.364747 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.365050 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.365631 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.365829 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.366642 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.366856 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.367586 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.367850 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.368535 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.369100 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.369287 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.370088 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.370690 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.370481 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.370867 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.371099 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.371246 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.371156 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.371631 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.371815 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.371670 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.372132 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.372302 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.372087 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.372592 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.372767 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.372706 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.373023 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.373392 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.373565 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.373787 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.373929 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.374605 node.go:539 weedfs adds child dc1 I1117 09:40:42.374802 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.375054 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.375431 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.376266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.377558 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.378812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.379129 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.380691 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.380940 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.382514 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.382807 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.383799 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.384011 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.384608 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.384915 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.385536 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.385806 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.387541 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.387799 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.388584 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.388586 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.389168 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.389348 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.389241 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.389559 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.389698 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.389880 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.390007 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.389820 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.390287 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.390460 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.390254 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.390677 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.390834 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.390725 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.391169 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.391074 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.391344 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.391548 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.391687 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.391584 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.391989 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.392147 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.392556 node.go:539 weedfs adds child dc1 I1117 09:40:42.392730 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.393334 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.393573 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.395090 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.395451 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.397005 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.397192 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.397860 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.398171 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.398718 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.398903 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.399659 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.400739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.402544 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.402908 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.404959 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.405300 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.406872 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.407313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.408719 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.408872 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.408923 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.409254 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.409560 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.409796 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.409974 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.409547 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.409792 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.410181 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.410324 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.410022 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.409583 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.410511 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.410349 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.410647 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.410928 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.411116 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.411333 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.411666 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.412011 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.412411 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.412740 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.413075 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.413958 node.go:539 weedfs adds child dc1 I1117 09:40:42.414256 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.414537 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.414976 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.415880 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.416176 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.416856 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.417135 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.417795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.418010 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.418725 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.418928 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.419523 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.419726 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.421755 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.422136 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.422722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.423225 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.424396 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.424589 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.425353 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.425506 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.425910 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.426099 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.425939 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.425339 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.426310 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.425350 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.426041 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.426466 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.426190 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.426651 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.426779 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.426949 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.427065 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.426941 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.427259 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.427515 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.427750 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.427905 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.428456 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.428745 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.429104 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.429599 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.430514 node.go:539 weedfs adds child dc1 I1117 09:40:42.431136 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.431429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.431690 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.433225 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.433450 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.434803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.435019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.435734 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.436335 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.437171 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.437417 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.438098 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.438538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.439161 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.439364 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.440587 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.440798 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.441666 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.441913 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.442761 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.443477 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.443331 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.443690 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.443931 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.443964 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.442690 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.444251 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.444744 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.444898 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.445061 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.444738 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.444915 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.445195 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.445367 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.445531 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.445384 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.445385 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.445725 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.446114 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.446318 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.446470 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.446665 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.446799 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.447559 node.go:539 weedfs adds child dc1 I1117 09:40:42.447783 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.448055 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.448282 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.449104 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.449309 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.450084 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.450295 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.451032 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.451263 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.451816 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.452158 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.452735 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.452994 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.453856 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.454065 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.454681 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.454872 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.455592 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.455908 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.456895 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.457570 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.458020 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.458139 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.458469 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.458889 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.459382 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.459773 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.459930 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.459675 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.458275 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.458123 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.458757 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.458854 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.460498 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.460683 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.461091 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.461237 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.461529 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.461663 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.461952 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.462083 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.462352 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.462487 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.463998 node.go:539 weedfs adds child dc1 I1117 09:40:42.465034 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.465499 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.465784 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.469100 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.469462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.474007 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.474477 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.475917 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.478002 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.479599 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.479878 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.480746 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.480952 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.481645 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.481831 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.482550 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.482844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.483503 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.483774 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.485355 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.485519 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.485999 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.486174 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.486369 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.486195 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.486499 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.486664 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.486392 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.486779 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.486651 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.486825 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.487208 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.487461 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.487793 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.488353 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.488693 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.489234 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.489553 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.486357 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.490390 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.490697 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.491122 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.491395 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.492199 node.go:539 weedfs adds child dc1 I1117 09:40:42.492559 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.492947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.493309 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.494790 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.495137 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.495885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.496118 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.497450 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.497688 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.498685 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.498994 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.499539 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.499740 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.500625 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.500948 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.502196 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.502677 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.503323 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.503617 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.504395 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.505093 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.505146 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.505591 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.505350 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.505771 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.505984 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.505808 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.506145 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.505959 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.506314 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.506481 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.506368 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.506676 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.506528 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.506813 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.507099 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.507273 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.507472 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.507635 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.507834 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.507988 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.508201 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.508340 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.509137 node.go:539 weedfs adds child dc1 I1117 09:40:42.509422 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.509717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.509952 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.510898 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.511100 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.511920 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.512180 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.512938 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.513183 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.513764 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.514088 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.514656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.514925 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.515698 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.515902 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.516552 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.516752 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.517394 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.518109 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.519022 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.519196 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.519364 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.519126 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.519328 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.519805 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.519019 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.520006 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.519126 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.519105 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.520213 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.520380 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.520586 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.520712 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.520881 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.521015 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.521203 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.521325 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.521481 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.521603 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.521780 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.521902 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.522066 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.522417 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.523315 node.go:539 weedfs adds child dc1 I1117 09:40:42.523672 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.524225 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.524806 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.526688 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.527288 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.528030 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.528338 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.528885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.529138 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.529647 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.530792 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.532455 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.532769 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.534157 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.534579 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.535854 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.536244 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.537869 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.538332 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.539000 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.539508 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.539683 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.540118 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.540569 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.540731 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.540980 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.541424 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.541596 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.541862 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.542319 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.542495 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.543326 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.543842 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.544021 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.544291 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.544746 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.544912 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.545185 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.545637 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.545806 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.542762 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.546662 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.547051 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.547914 node.go:539 weedfs adds child dc1 I1117 09:40:42.548311 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.548726 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.549111 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.550626 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.551015 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.552509 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.552813 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.554221 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.554626 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.556231 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.556646 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.558271 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.558737 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.560198 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.560853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.562086 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.562802 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.563758 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.564632 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.565905 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.569966 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.570183 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.566682 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.570455 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.570623 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.567239 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.570854 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.571013 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.567719 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.571259 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.571416 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.568195 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.571659 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.571826 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.568677 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.572064 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.572209 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.569223 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.572484 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.572626 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.569708 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.573474 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.573655 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.574471 node.go:539 weedfs adds child dc1 I1117 09:40:42.574663 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.574995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.575235 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.576916 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.577440 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.579004 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.579329 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.580623 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.580833 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.582160 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.582373 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.583956 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.584203 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.585162 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.585460 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.586011 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.586223 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.588374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.588905 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.590500 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.591113 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.591312 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.591612 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.592091 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.592270 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.592548 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.593024 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.596150 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.593340 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.593538 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.593909 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.594583 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.595256 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.596822 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.597403 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.597636 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.597784 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.597990 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.598134 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.598455 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.598606 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.598955 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.599147 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.599926 node.go:539 weedfs adds child dc1 I1117 09:40:42.600266 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.600551 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.600897 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.601816 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.602242 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.602938 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.603152 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.603775 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.604021 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.604630 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.604995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.605548 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.605760 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.606523 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.606858 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.607587 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.607822 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.608351 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.608602 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.609147 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.609191 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.609593 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.609763 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.609951 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.610068 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.610035 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.610288 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.610547 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.610734 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.610935 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.610846 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.610772 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.610820 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.611077 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.611327 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.611791 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.611960 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.612402 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.612558 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.612762 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.612895 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.613083 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.613207 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.613621 node.go:539 weedfs adds child dc1 I1117 09:40:42.613804 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.614204 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.614451 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.615197 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.615563 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.616157 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.616358 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.616895 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.617149 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.617686 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.617873 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.618491 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.618669 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.619193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.619389 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.619902 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.620259 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.620954 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.621404 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.621994 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.622020 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.622094 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.622033 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.622488 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.622659 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.622848 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.622595 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.622671 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.622972 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.623177 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.622712 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.623299 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.623125 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.623468 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.623604 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.623783 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.623905 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.624087 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.624214 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.624529 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.624657 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.624831 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.624961 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.625323 node.go:539 weedfs adds child dc1 I1117 09:40:42.625556 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.625946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.626347 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.627405 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.627761 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.628675 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.629022 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.629633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.630068 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.630751 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.630991 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.631622 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.631958 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.632514 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.632731 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.633322 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.633520 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.634226 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.634460 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.635063 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.635086 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.635586 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.635783 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.635609 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.636001 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.636170 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.635896 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.636360 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.636124 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.636501 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.636693 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.636493 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.636829 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.635048 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.636665 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.637037 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.637214 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.637431 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.637600 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.637792 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.637926 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.638106 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.638236 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.638668 node.go:539 weedfs adds child dc1 I1117 09:40:42.638972 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.639263 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.639495 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.640594 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.640839 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.641638 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.641838 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.642405 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.642695 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.643272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.643527 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.644068 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.644542 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.645630 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.645844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.646568 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.646857 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.647814 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.648173 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.648824 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.648963 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.648961 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.648855 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.649407 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.648911 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.649599 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.649438 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.649465 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.649880 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.650048 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.650204 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.650320 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.650465 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.650580 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.650728 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.650842 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.650990 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.651097 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.651245 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.651376 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.651689 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.652114 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.652258 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.652739 node.go:539 weedfs adds child dc1 I1117 09:40:42.652929 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.653179 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.653408 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.654641 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.655000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.656145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.656461 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.657060 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.657246 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.657820 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.657985 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.658592 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.658793 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.659386 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.659632 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.660262 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.660567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.661251 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.661440 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.662050 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.662071 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.662113 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.662050 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.662221 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.662574 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.662231 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.662291 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.662291 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.662759 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.662931 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.663102 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.663272 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.663407 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.663578 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.663692 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.663851 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.663973 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.664141 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.664257 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.664409 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.664515 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.664702 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.664814 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.665181 node.go:539 weedfs adds child dc1 I1117 09:40:42.665340 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.665549 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.665914 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.666569 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.666845 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.667457 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.667679 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.668723 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.668991 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.669499 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.670222 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.671479 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.671888 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.673066 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.673688 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.674236 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.674524 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.675088 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.675829 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.677189 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.677720 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.677895 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.678159 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.678589 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.678751 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.679018 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.679435 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.679596 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.680334 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.680824 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.680990 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.681244 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.681667 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.681825 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.682073 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.682478 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.682637 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.682881 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.683814 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.684137 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.684626 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.684871 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.685027 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.685528 node.go:539 weedfs adds child dc1 I1117 09:40:42.685818 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.686052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.686274 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.687111 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.687295 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.687924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.688102 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.688634 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.688812 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.689284 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.689671 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.691913 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.692161 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.693860 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.694099 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.694592 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.694825 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.695310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.695471 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.696036 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.696934 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.697572 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.698052 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.698508 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.698961 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.699769 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.700044 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.699429 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.700284 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.700423 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.700589 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.700719 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.700868 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.700989 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.701144 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.700895 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.701263 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.701431 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.701538 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.701696 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.701808 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.701963 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.702076 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.702473 node.go:539 weedfs adds child dc1 I1117 09:40:42.702716 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.703123 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.703409 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.704494 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.704779 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.706055 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.706276 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.706911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.707422 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.708022 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.708259 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.708998 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.709239 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.709876 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.710069 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.710757 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.710991 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.711740 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.712046 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.712706 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.712691 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.712691 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.713199 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.713372 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.713274 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.713557 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.713680 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.713408 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.712661 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.713836 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.713635 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.713940 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.714287 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.714110 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.714466 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.714732 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.714858 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.715029 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.715144 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.715298 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.715410 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.715569 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.715688 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.716159 node.go:539 weedfs adds child dc1 I1117 09:40:42.716367 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.716593 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.716796 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.717642 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.717844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.718770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.719134 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.719989 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.720187 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.720828 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.721162 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.721876 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.722126 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.722715 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.722905 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.723499 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.723828 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.724542 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.724803 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.725477 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.725493 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.725609 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.726056 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.725525 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.725846 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.726244 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.725515 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.726078 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.726044 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.726459 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.726656 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.726877 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.727052 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.727238 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.727381 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.727557 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.727676 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.727837 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.727954 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.728110 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.728225 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.728369 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.728488 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.728887 node.go:539 weedfs adds child dc1 I1117 09:40:42.729215 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.729580 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.730012 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.731448 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.731656 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.732428 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.732638 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.733380 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.733686 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.734307 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.734624 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.735187 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.735390 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.736014 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.736276 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.737472 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.737955 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.738870 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.739336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.740232 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.740945 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.741280 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.741883 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.742608 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.742934 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.743423 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.743920 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.743591 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.743693 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.744115 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.744347 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.744490 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.744285 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.744681 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.744457 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.744839 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.745034 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.745175 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.745384 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.745103 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.745584 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.745778 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.745923 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.750352 node.go:539 weedfs adds child dc1 I1117 09:40:42.750970 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.751484 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.751813 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.752988 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.760274 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.761592 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.762405 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.765017 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.765637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.766582 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.766815 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.767667 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.767919 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.768556 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.768889 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.769507 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.769720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.777374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.779986 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.780995 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.781072 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.781560 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.781744 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.781969 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.781746 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.782242 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.782297 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.782697 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.783065 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.783276 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.783422 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.783581 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.783705 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.783857 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.783979 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.784125 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.784232 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.784473 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.784844 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.784987 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.782824 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.794863 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.795097 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.795688 node.go:539 weedfs adds child dc1 I1117 09:40:42.795881 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.796441 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.796745 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.797831 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.798068 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.798872 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.799094 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.799675 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.801686 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.802943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.803255 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.803850 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.804172 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.804728 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.804922 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.805711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.805922 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.807845 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.808400 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.810349 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.810880 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.811067 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.811342 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.811794 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.811973 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.812228 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.812668 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.812841 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.813311 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.813395 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.813881 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.814066 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.814293 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.809708 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.814956 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.815598 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.816252 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.816717 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.816899 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.817113 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.817250 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.817443 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.817579 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.818255 node.go:539 weedfs adds child dc1 I1117 09:40:42.818447 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.818710 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.819212 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.820483 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.820992 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.822336 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.823212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.824605 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.824958 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.825513 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.825702 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.826303 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.827445 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.828656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.828976 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.830164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.830460 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.831058 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.831262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.833184 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.833940 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.833909 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.833829 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.833807 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.834610 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.833188 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.833309 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.835200 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.835393 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.834943 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.834704 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.835695 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.835863 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.836064 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.836214 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.836482 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.836658 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.836895 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.837062 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.837269 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.837430 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.837623 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.837782 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.838240 node.go:539 weedfs adds child dc1 I1117 09:40:42.838554 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.838851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.839103 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.840169 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.840485 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.841243 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.841482 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.842107 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.842335 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.842872 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.844605 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.845530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.845753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.846436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.846638 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.847240 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.847532 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.848200 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.848510 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.849212 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.849873 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.850393 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.850730 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.851110 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.851216 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.851689 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.852047 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.852348 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.851867 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.852566 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.850612 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.853122 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.854227 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.853228 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.853502 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.854447 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.854595 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.854773 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.854905 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.855079 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.855207 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.855381 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.855506 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.855988 node.go:539 weedfs adds child dc1 I1117 09:40:42.856151 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.856416 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.857211 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.858457 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.859973 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.860883 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.861187 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.863272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.863659 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.864474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.864890 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.865618 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.865811 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.867177 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.867414 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.868989 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.869539 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.871038 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.871362 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.872538 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.873028 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.873212 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.873540 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.873988 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.874138 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.874690 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.874744 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.874809 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.874904 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.875273 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.875437 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.875627 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.875757 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.875538 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.875942 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.876297 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.874367 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.876522 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.876751 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.877294 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.877504 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.877741 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.877868 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.878311 node.go:539 weedfs adds child dc1 I1117 09:40:42.878632 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.878950 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.879200 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.880127 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.880337 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.881197 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.881403 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.882918 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.883228 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.883741 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.883997 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.884455 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.884621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.885464 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.885817 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.886578 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.886930 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.887648 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.887971 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.888612 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.889311 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.889236 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.889312 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.888612 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.888694 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.889648 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.888738 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.890008 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.889344 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.889873 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.890176 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.890390 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.890546 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.890707 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.890839 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.891076 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.891209 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.891404 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.891536 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.891759 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.891903 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.892162 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.892305 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.892847 node.go:539 weedfs adds child dc1 I1117 09:40:42.893082 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.893331 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.893552 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.894518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.894727 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.895387 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.895551 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.896071 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.896262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.897295 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.897527 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.898120 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.898381 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.899056 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.899293 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.900388 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.900714 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.901403 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.901707 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.902407 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.902443 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.902512 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.902558 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.902908 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.902655 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.902634 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.902407 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.902536 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.903094 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.903455 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.903650 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.903879 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.904030 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.904229 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.904380 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.904573 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.904718 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.904918 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.905051 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.905235 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.905381 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.905577 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.905715 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.906257 node.go:539 weedfs adds child dc1 I1117 09:40:42.906570 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.907046 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.907336 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.908711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.908970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.909981 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.910199 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.910971 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.911244 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.911859 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.912125 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.912695 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.913106 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.913974 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.914215 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.914757 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.915003 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.915552 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.915720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.916481 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.916570 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.916609 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.916624 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.917003 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.916509 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.916806 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.917183 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.916888 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.916470 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.917377 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.917562 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.917779 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.917940 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.918121 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.918232 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.918402 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.918531 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.918713 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.918854 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.919047 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.919177 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.919358 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.919477 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.920092 node.go:539 weedfs adds child dc1 I1117 09:40:42.920308 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.920734 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.921008 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.921887 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.922119 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.922778 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.922997 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.923668 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.924268 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.925048 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.925262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.925926 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.926112 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.926824 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.927013 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.927488 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.927753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.928272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.928452 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.929229 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.929339 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.929385 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.929817 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.929448 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.929663 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.929627 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.930015 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.929897 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.930289 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.930027 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.931013 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.931215 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.931337 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.931615 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.931749 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.931927 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.932064 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.932249 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.932376 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.932573 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.932699 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.932874 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.933016 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.933599 node.go:539 weedfs adds child dc1 I1117 09:40:42.933835 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.934101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.934359 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.935160 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.935430 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.936190 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.936394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.937349 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.937553 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.938189 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.938391 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.939086 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.939321 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.940037 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.940278 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.941167 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.941376 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.942069 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.942264 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.943325 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.943914 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.944116 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.943391 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.943950 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.944373 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.944517 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.944367 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.944711 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.944525 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.944514 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.944568 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.944855 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.945183 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.945374 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.945595 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.942987 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.945770 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.945980 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.946136 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.946346 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.946494 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.946694 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.946840 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.947435 node.go:539 weedfs adds child dc1 I1117 09:40:42.947682 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.947956 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.948205 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.949526 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.949775 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.950655 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.950873 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.951663 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.951875 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.952518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.952787 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.953983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.954548 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.955189 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.955409 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.956374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.956602 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.957388 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.957596 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.958350 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.958931 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.959131 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.959793 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.959780 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.960082 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.960252 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.960475 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.960781 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.960530 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.960960 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.961211 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.961333 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.961094 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.961488 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.961609 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.961775 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.961891 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.962040 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.962145 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.962292 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.962406 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.962580 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.962706 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.963452 node.go:539 weedfs adds child dc1 I1117 09:40:42.963650 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.963867 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.964088 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.965389 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.965569 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.966567 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.966764 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.967364 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.967547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.968636 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.968867 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.969590 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.969910 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.970429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.970621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.971335 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.971519 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.972146 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.972370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.972950 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.973913 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:42.973922 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.974290 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:42.974584 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.974792 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.975132 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.975318 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.975203 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:42.975506 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.973717 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.974260 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:42.975647 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.975489 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.975818 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:42.975947 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:42.976286 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:42.976476 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:42.976710 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.976846 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.977011 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:42.977146 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:42.977308 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:42.977449 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:42.977927 node.go:539 weedfs adds child dc1 I1117 09:40:42.978109 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:42.978351 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:42.978597 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:42.979508 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:42.984516 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:42.985856 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:42.986625 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:42.987426 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:42.987703 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:42.988447 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:42.988633 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:42.990619 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:42.990975 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:42.992255 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:42.992659 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:42.994112 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:42.994670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:42.996299 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:42.996638 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:42.998318 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:42.998859 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:42.999067 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:42.998326 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:42.998900 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:42.998884 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:42.999304 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:42.999438 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:42.998415 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:42.999620 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:42.999748 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:42.999550 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:42.999933 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.000056 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.000252 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.000388 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.000130 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.000595 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.000742 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.000925 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.001101 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.002108 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.002649 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.002838 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.003408 node.go:539 weedfs adds child dc1 I1117 09:40:43.003641 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.003881 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.004172 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.004992 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.005504 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.006845 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.007409 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.008479 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.008839 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.009636 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.013468 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.014197 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.014399 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.015096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.015283 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.015767 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.015926 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.019842 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.020745 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.021694 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.021818 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.022179 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.022472 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.022390 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.022703 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.022867 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.023057 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.022869 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.023218 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.023409 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.023534 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.023339 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.023716 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.023867 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.023801 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.024288 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.024125 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.024461 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.024656 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.024782 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.024704 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.025077 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.025567 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.026148 node.go:539 weedfs adds child dc1 I1117 09:40:43.026607 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.026898 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.027245 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.028242 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.028474 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.029138 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.029330 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.029984 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.030200 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.030681 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.030946 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.031446 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.031637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.032440 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.032651 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.033411 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.033759 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.034508 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.034804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.035488 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.035586 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.036075 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.036263 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.036065 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.036196 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.035491 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.036592 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.036865 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.037034 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.036845 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.037248 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.037384 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.037072 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.037588 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.037762 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.037956 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.038070 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.038313 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.038428 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.038623 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.038748 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.038916 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.039030 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.039558 node.go:539 weedfs adds child dc1 I1117 09:40:43.039913 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.040269 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.040700 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.041767 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.041979 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.042671 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.042881 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.043551 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.043829 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.044440 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.044627 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.045103 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.045451 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.046092 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.046281 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.046928 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.047218 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.047981 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.048185 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.048833 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.048865 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.048867 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.049332 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.048809 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.049522 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.049280 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.049416 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.049727 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.049335 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.049863 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.050016 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.050123 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.050262 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.050380 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.049964 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.050536 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.050644 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.050817 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.050928 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.051126 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.051246 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.051409 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.051590 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.052073 node.go:539 weedfs adds child dc1 I1117 09:40:43.052254 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.052727 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.053349 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.054192 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.054445 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.055036 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.055235 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.055743 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.055995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.056554 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.056753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.057399 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.057612 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.058311 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.058545 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.059083 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.059348 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.060207 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.060512 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.061312 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.061352 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.061437 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.061469 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.061826 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.061528 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.061587 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.061312 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.062029 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.062219 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.062194 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.062511 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.062700 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.062833 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.063008 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.063129 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.063312 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.063437 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.063636 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.063778 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.064039 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.064178 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.064380 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.064528 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.064987 node.go:539 weedfs adds child dc1 I1117 09:40:43.065153 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.065566 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.065837 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.066815 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.067185 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.067932 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.068139 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.068772 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.068976 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.069463 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.069899 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.070350 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.070535 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.071076 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.071247 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.071885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.072093 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.072672 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.072991 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.073645 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.073814 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.074216 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.073648 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.074398 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.073814 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.074250 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.074580 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.074407 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.074814 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.074566 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.075031 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.075169 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.074127 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.075354 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.075489 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.075685 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.075819 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.076008 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.076133 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.076369 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.076506 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.076686 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.076804 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.077299 node.go:539 weedfs adds child dc1 I1117 09:40:43.077532 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.077798 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.078009 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.078848 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.079059 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.079925 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.080100 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.080605 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.080882 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.081548 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.081827 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.082364 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.082650 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.083368 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.083760 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.084511 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.084720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.085408 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.085667 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.086319 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.086412 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.086294 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.086535 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.086861 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.086288 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.086354 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.087058 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.086880 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.086886 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.087395 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.087594 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.087826 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.087986 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.088196 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.088340 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.088553 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.088694 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.088964 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.089103 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.089314 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.089463 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.089659 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.089835 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.090457 node.go:539 weedfs adds child dc1 I1117 09:40:43.090655 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.090992 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.091374 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.092332 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.092624 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.093305 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.093589 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.094176 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.094398 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.095300 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.095516 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.096124 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.096340 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.097052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.097299 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.098096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.098357 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.098985 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.099157 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.099928 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.100007 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.100030 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.100443 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.100647 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.100460 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.099896 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.100563 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.100874 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.100649 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.101015 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.101203 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.101002 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.101335 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.101618 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.101773 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.101956 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.102084 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.102267 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.102385 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.102558 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.102680 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.102862 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.102976 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.103478 node.go:539 weedfs adds child dc1 I1117 09:40:43.103845 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.104100 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.105690 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.108197 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.109230 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.110341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.110955 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.116000 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.116649 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.117953 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.118461 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.119172 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.119508 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.120984 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.121224 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.133351 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.134063 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.135557 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.135990 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.136970 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.137392 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.137665 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.137699 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.137067 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.137801 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.138047 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.136977 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.138476 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.138735 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.138895 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.139079 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.139221 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.139397 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.139532 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.139716 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.139856 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.140057 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.140188 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.140372 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.140504 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.137109 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.144321 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.144519 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.145046 node.go:539 weedfs adds child dc1 I1117 09:40:43.145375 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.145660 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.145895 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.146877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.147372 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.148483 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.148803 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.149480 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.149918 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.150645 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.151071 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.151737 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.151927 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.152485 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.152655 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.153219 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.153438 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.158182 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.158547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.159221 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.159716 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.159551 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.159516 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.159904 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.159785 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.160188 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.160212 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.159855 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.160703 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.160366 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.160574 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.160985 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.161147 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.161374 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.161524 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.161727 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.161866 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.162067 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.162212 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.162432 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.162570 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.162771 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.162908 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.163739 node.go:539 weedfs adds child dc1 I1117 09:40:43.164060 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.164349 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.164611 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.165674 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.165908 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.166751 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.167068 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.167781 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.168062 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.168742 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.168946 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.169627 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.169865 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.170435 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.170711 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.171258 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.171494 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.172322 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.172547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.173275 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.173361 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.173340 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.173834 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.174016 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.173902 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.174201 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.173876 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.174071 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.173303 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.174352 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.174767 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.174657 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.175128 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.175346 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.175514 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.175696 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.175829 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.176030 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.176583 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.176941 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.177126 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.177329 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.177463 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.178054 node.go:539 weedfs adds child dc1 I1117 09:40:43.178263 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.178806 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.179124 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.180443 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.180929 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.181923 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.182162 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.182749 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.183044 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.183607 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.183811 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.184455 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.184657 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.185297 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.185519 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.186051 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.186731 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.187706 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.188612 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.189965 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.190536 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.190728 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.191010 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.191473 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.191650 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.191923 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.192400 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.192126 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.192577 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.192795 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.192937 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.192777 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.193268 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.193638 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.193568 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.194081 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.194262 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.194062 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.194523 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.194695 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.194986 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.195496 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.195731 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.196493 node.go:539 weedfs adds child dc1 I1117 09:40:43.196740 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.197032 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.197293 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.198375 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.198669 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.199434 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.200180 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.201416 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.201637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.202725 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.202936 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.203602 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.203793 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.204558 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.205007 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.205846 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.206185 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.207323 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.207533 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.208289 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.208419 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.208916 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.209104 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.209299 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.209417 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.209234 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.210184 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.210281 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.209679 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.210830 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.210938 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.209721 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.211625 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.211879 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.212036 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.212225 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.212360 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.212968 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.213116 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.213325 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.213451 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.213614 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.213822 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.214450 node.go:539 weedfs adds child dc1 I1117 09:40:43.214637 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.214911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.215250 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.216597 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.216814 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.218366 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.218564 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.219436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.219668 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.220137 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.220303 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.220915 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.221185 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.221906 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.222137 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.223387 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.223637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.224298 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.225019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.226487 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.226795 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.227188 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.227568 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.226838 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.226556 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.226880 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.227761 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.226496 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.226999 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.227957 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.228068 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.228232 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.228388 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.228571 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.228712 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.228900 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.229030 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.229216 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.229341 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.229517 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.229659 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.230139 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.230266 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.230678 node.go:539 weedfs adds child dc1 I1117 09:40:43.230853 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.231113 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.231615 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.232503 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.232837 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.233627 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.234266 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.234850 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.235128 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.235628 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.235837 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.236368 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.236564 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.237151 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.237342 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.237840 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.238114 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.238756 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.238925 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.239689 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.239803 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.239689 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.240271 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.239936 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.240013 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.240048 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.240458 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.239708 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.240321 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.240662 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.240785 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.240950 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.241066 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.241227 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.241335 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.241482 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.241584 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.241738 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.241864 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.242050 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.242182 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.242373 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.242503 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.243195 node.go:539 weedfs adds child dc1 I1117 09:40:43.243403 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.243679 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.243919 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.244776 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.244979 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.245579 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.245755 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.246234 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.246425 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.246972 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.247177 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.247689 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.247967 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.248517 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.248726 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.249373 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.249582 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.250274 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.250453 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.251016 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.251093 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.251069 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.251244 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.251529 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.251236 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.251387 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.251740 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.251094 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.251924 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.251591 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.252052 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.252222 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.252347 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.252515 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.252637 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.252826 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.252937 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.253108 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.253221 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.253440 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.253563 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.253731 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.253864 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.254321 node.go:539 weedfs adds child dc1 I1117 09:40:43.254517 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.254771 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.255126 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.256000 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.256232 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.256986 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.257251 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.257812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.258021 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.258619 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.258814 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.259391 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.259590 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.260124 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.260488 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.261056 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.261260 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.262096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.262293 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.262998 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.263004 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.263549 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.263740 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.263972 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.263720 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.264144 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.264335 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.264070 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.264111 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.264479 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.264156 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.264304 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.264702 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.264834 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.264694 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.265030 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.265146 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.265306 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.265571 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.265858 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.266104 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.266373 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.266645 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.267204 node.go:539 weedfs adds child dc1 I1117 09:40:43.267525 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.268032 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.268395 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.269224 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.269598 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.270587 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.270970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.271715 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.272183 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.272981 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.273305 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.274108 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.274305 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.274938 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.275171 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.276002 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.276223 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.276888 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.277072 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.277662 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.278181 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.278354 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.278251 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.278330 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.278679 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.278474 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.278540 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.278975 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.279195 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.279346 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.279158 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.279539 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.279281 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.279674 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.279870 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.280012 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.279841 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.280195 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.280329 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.280537 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.280673 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.280853 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.280996 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.281734 node.go:539 weedfs adds child dc1 I1117 09:40:43.281967 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.282354 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.282628 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.284181 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.284404 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.285681 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.285904 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.286885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.287099 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.288622 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.288840 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.290204 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.290451 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.291041 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.291331 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.291903 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.292111 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.293338 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.293547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.294259 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.294937 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.295530 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.295732 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.294954 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.295548 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.295997 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.296147 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.296335 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.296154 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.296483 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.296661 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.296792 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.296760 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.297241 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.297424 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.297299 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.297781 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.297959 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.297877 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.298348 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.298528 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.298889 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.299076 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.299511 node.go:539 weedfs adds child dc1 I1117 09:40:43.299700 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.300300 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.300690 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.301633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.301940 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.302598 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.302863 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.303578 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.303844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.304426 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.304645 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.305333 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.305544 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.306962 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.307212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.307832 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.308106 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.308751 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.309029 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.309946 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.309987 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.310522 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.310202 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.310743 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.310952 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.310824 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.311194 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.311013 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.311387 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.311521 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.311701 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.311436 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.311837 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.311597 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.311665 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.312015 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.312151 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.312335 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.312470 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.313163 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.313487 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.314434 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.314621 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.315168 node.go:539 weedfs adds child dc1 I1117 09:40:43.315405 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.315662 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.315913 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.316922 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.317147 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.318053 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.318255 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.320534 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.320744 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.321320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.321804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.322398 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.322692 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.323846 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.324365 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.325594 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.326315 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.327714 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.328318 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.329627 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.330400 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.330427 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.330550 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.331027 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.331098 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.331201 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.331610 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.331798 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.331707 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.332037 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.332178 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.332525 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.332802 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.333003 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.333141 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.333322 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.333454 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.333651 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.333779 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.333967 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.334106 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.334297 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.334427 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.335033 node.go:539 weedfs adds child dc1 I1117 09:40:43.335263 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.335538 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.335784 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.336877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.337272 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.338395 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.338621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.339311 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.339519 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.340198 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.340449 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.341312 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.341686 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.342273 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.342552 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.343185 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.343422 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.344087 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.344281 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.345031 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.344975 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.345137 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.345086 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.345571 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.345003 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.345032 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.345786 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.345606 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.346036 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.345795 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.346199 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.346356 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.346486 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.346670 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.346781 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.346981 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.347099 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.347256 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.347373 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.347537 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.347675 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.347839 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.347951 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.348469 node.go:539 weedfs adds child dc1 I1117 09:40:43.348635 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.348846 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.349218 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.350056 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.350379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.351115 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.351396 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.351966 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.352159 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.352753 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.352959 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.353694 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.353921 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.354573 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.354803 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.355298 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.355694 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.356357 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.356671 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.357463 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.358016 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.358208 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.357909 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.358033 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.358442 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.358062 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.358627 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.358502 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.358833 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.358989 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.358763 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.359167 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.359297 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.359040 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.359545 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.359693 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.360089 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.360222 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.358797 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.360422 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.360563 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.360799 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.360928 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.361320 node.go:539 weedfs adds child dc1 I1117 09:40:43.361482 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.361829 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.362145 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.363065 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.363510 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.364181 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.364405 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.364958 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.365240 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.365813 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.366009 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.366744 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.367066 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.367657 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.367850 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.368429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.368639 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.369212 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.369483 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.370596 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.371273 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.371602 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.372034 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.372646 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.373016 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.373037 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.374856 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.375053 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.373442 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.373944 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.374104 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.373611 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.375353 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.375505 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.374448 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.375690 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.375953 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.376169 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.376305 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.376507 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.376643 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.376828 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.376973 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.377567 node.go:539 weedfs adds child dc1 I1117 09:40:43.378030 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.378453 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.378714 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.379676 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.379899 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.380751 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.381066 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.381745 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.382161 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.382816 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.383009 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.383530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.383819 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.384402 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.384666 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.385145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.385336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.385888 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.386079 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.386751 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.387429 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.387766 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.387521 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.387917 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.388031 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.387292 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.388312 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.386810 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.388583 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.388792 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.388615 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.388991 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.386751 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.389196 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.389347 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.389719 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.389885 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.390059 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.390203 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.390463 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.390593 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.390781 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.390928 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.391451 node.go:539 weedfs adds child dc1 I1117 09:40:43.391666 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.391923 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.392150 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.393408 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.393674 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.394530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.395259 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.396278 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.397125 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.397933 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.398418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.400408 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.401254 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.402154 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.402412 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.403865 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.404237 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.405608 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.406376 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.407397 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.407999 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.408202 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.408674 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.409185 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.409368 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.409989 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.410510 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.410689 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.410978 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.411498 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.411676 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.411987 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.412456 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.412628 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.409643 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.413393 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.413756 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.413958 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.414191 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.412909 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.414539 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.415058 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.415259 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.416217 node.go:539 weedfs adds child dc1 I1117 09:40:43.416631 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.416989 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.417220 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.418996 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.419288 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.421287 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.421664 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.422698 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.423461 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.424909 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.425144 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.425703 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.426052 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.426630 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.426822 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.427436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.427622 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.428365 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.428588 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.429234 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.430021 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.430819 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.431019 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.431698 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.431873 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.432288 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.432453 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.433326 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.433527 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.433900 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.434090 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.434298 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.434459 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.434632 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.434770 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.434957 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.435091 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.435259 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.435383 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.435564 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.435697 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.435861 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.435990 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.436809 node.go:539 weedfs adds child dc1 I1117 09:40:43.437076 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.437413 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.437634 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.438638 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.438823 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.439602 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.440041 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.440686 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.440877 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.441562 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.441815 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.442312 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.442534 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.443005 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.443397 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.445086 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.445316 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.445823 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.446091 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.446657 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.447125 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.447576 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.448265 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.448899 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.449990 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.450069 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.450600 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.447314 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.451684 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.451994 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.452316 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.452779 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.453134 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.453436 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.453769 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.454037 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.454348 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.454688 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.455059 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.455324 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.449478 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.455825 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.456168 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.456838 node.go:539 weedfs adds child dc1 I1117 09:40:43.457240 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.457712 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.458099 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.459616 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.460069 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.461507 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.461890 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.462784 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.462981 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.463714 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.463932 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.464399 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.464656 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.465090 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.465256 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.465749 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.465956 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.468769 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.469039 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.470374 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.470860 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.471019 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.471042 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.471256 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.471565 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.471748 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.471929 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.471792 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.472038 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.472261 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.472416 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.472243 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.472695 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.472869 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.472631 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.473151 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.473314 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.477368 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.477626 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.477927 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.478067 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.478249 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.478384 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.478997 node.go:539 weedfs adds child dc1 I1117 09:40:43.479224 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.479483 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.479717 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.480643 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.480857 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.482687 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.482885 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.483580 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.483779 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.484391 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.484756 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.485644 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.485956 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.486724 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.487139 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.488400 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.488602 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.489519 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.489720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.490360 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.490407 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.490853 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.490635 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.491009 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.491210 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.491337 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.491077 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.491484 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.490680 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.491267 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.491597 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.491774 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.491901 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.491689 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.491799 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.492078 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.492322 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.492791 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.492931 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.493108 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.493241 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.493411 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.493539 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.494099 node.go:539 weedfs adds child dc1 I1117 09:40:43.494256 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.494596 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.494815 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.495510 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.495705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.496228 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.496409 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.496850 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.497069 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.497593 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.497787 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.498454 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.498651 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.499239 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.499416 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.499902 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.500170 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.500894 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.501140 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.501773 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.502315 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.502506 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.503308 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.503826 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.504018 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.502937 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.504501 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.504301 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.504691 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.504904 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.505048 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.504876 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.505334 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.505487 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.505312 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.505780 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.505948 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.505770 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.506226 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.505970 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.506580 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.506926 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.507201 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.507816 node.go:539 weedfs adds child dc1 I1117 09:40:43.508145 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.508530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.509122 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.510083 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.510930 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.511872 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.512290 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.513021 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.513487 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.514236 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.514849 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.515751 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.516161 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.517255 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.517668 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.518184 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.518353 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.518940 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.519109 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.519748 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.519788 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.519853 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.520239 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.519998 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.520403 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.520238 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.519726 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.520590 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.520707 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.520460 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.520878 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.520999 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.520796 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.521163 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.521290 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.521455 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.521578 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.521737 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.521846 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.522008 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.522126 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.522285 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.522401 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.522830 node.go:539 weedfs adds child dc1 I1117 09:40:43.523009 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.523226 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.523491 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.524173 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.524336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.525061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.525391 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.526020 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.526288 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.526956 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.527275 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.528018 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.528225 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.528922 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.529125 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.529699 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.530251 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.531672 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.532082 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.532827 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.534664 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.533279 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.533590 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.534848 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.533840 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.534121 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.534087 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.535066 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.534118 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.533889 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.535207 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.535379 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.535511 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.535682 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.535807 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.536324 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.537224 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.537422 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.537545 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.537718 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.537834 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.538017 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.538364 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.538863 node.go:539 weedfs adds child dc1 I1117 09:40:43.539072 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.539316 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.539528 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.540479 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.540742 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.541695 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.541884 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.542586 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.542769 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.543598 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.543921 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.544454 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.544746 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.545255 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.545442 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.546089 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.546275 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.547107 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.547435 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.548115 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.548624 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.548804 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.549275 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.550042 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.550615 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.551139 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.551803 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.552348 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.553196 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.553392 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.553758 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.553903 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.554203 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.554338 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.554612 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.554731 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.555031 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.555191 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.555366 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.555493 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.552914 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.555965 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.556112 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.556602 node.go:539 weedfs adds child dc1 I1117 09:40:43.556765 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.557217 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.557493 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.558543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.558754 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.559396 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.559587 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.560746 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.560937 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.561899 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.562119 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.562569 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.562731 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.563411 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.563689 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.564320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.564606 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.565259 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.565472 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.566230 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.566395 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.566752 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.567009 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.567188 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.567308 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.567046 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.567522 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.567706 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.567532 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.567911 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.568056 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.567978 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.568434 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.568289 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.568607 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.568811 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.568961 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.568843 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.569459 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.569621 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.569455 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.570014 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.570198 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.570768 node.go:539 weedfs adds child dc1 I1117 09:40:43.570994 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.571210 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.571418 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.572176 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.572368 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.573144 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.573439 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.574035 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.574203 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.574633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.574967 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.575413 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.575673 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.576212 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.576394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.576984 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.577148 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.577713 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.577906 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.578420 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.578886 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.579077 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.579652 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.580273 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.580456 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.579509 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.580315 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.580684 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.580815 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.580993 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.580801 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.581126 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.581298 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.581427 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.581357 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.581970 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.582155 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.581914 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.582373 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.582544 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.582435 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.582897 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.583470 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.584109 node.go:539 weedfs adds child dc1 I1117 09:40:43.584354 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.584625 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.584927 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.585691 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.586057 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.586960 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.587251 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.587776 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.587944 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.588439 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.588601 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.589162 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.589326 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.590277 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.590822 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.591470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.591987 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.592925 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.593341 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.594248 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.594872 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.595047 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.594804 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.595279 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.595450 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.594256 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.595307 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.595662 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.595793 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.595956 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.595779 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.596086 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.596285 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.596420 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.596263 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.596703 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.596850 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.596665 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.597049 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.597193 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.597069 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.597453 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.597603 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.597954 node.go:539 weedfs adds child dc1 I1117 09:40:43.598104 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.598423 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.598653 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.599295 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.599509 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.600320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.600542 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.600996 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.601243 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.601748 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.601926 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.602586 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.602796 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.603518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.603842 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.604288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.604539 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.605143 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.605321 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.606037 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.606568 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.606746 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.606597 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.606599 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.606643 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.606757 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.606835 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.607070 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.607001 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.607404 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.607195 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.607609 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.607752 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.607932 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.608043 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.608202 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.608310 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.608529 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.608641 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.608807 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.608922 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.609081 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.609188 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.609525 node.go:539 weedfs adds child dc1 I1117 09:40:43.609668 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.610008 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.610221 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.610926 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.611110 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.611637 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.611811 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.612258 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.612509 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.612995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.613196 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.613796 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.613979 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.614528 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.614709 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.615180 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.615547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.616108 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.616313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.616920 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.616914 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.616895 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.617082 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.617130 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.616934 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.617388 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.617151 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.617307 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.617778 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.618002 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.618162 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.618356 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.618493 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.618686 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.618816 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.619006 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.619133 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.619324 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.619455 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.619645 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.619872 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.620052 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.620186 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.620656 node.go:539 weedfs adds child dc1 I1117 09:40:43.620928 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.621370 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.621590 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.622413 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.622650 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.623290 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.623508 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.624131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.624342 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.624851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.625104 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.625616 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.625806 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.626510 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.626704 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.627275 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.627462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.628068 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.628317 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.628929 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.629028 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.629049 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.629439 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.629049 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.629622 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.629578 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.629887 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.630134 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.629992 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.629975 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.630347 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.630123 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.630495 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.630658 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.630854 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.631023 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.631167 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.631361 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.631506 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.631694 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.631815 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.631983 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.632157 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.632577 node.go:539 weedfs adds child dc1 I1117 09:40:43.632826 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.633228 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.633553 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.634262 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.634509 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.635110 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.635348 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.635892 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.636109 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.636605 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.636798 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.637328 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.637574 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.638151 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.638355 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.638875 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.639152 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.639716 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.640011 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.640741 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.640823 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.640891 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.641280 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.640992 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.641462 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.640735 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.641290 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.641663 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.641456 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.641805 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.641978 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.641494 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.642166 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.642440 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.642594 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.642803 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.642965 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.643173 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.643311 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.643514 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.643652 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.643837 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.643963 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.644401 node.go:539 weedfs adds child dc1 I1117 09:40:43.644597 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.644922 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.645295 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.646849 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.647256 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.648522 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.648940 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.649719 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.650008 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.650674 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.651327 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.652159 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.652734 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.653801 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.654028 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.654564 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.655033 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.655752 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.656134 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.656923 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.657456 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.657660 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.657863 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.657924 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.658424 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.658612 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.658420 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.657841 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.658420 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.657955 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.658822 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.659049 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.658847 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.659267 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.659421 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.659624 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.659789 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.659994 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.660134 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.660433 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.660565 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.660862 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.661001 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.661501 node.go:539 weedfs adds child dc1 I1117 09:40:43.661714 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.662230 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.662539 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.663472 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.663748 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.664650 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.664887 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.665470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.665763 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.666795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.667017 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.667938 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.668168 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.668918 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.669132 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.670012 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.670628 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.671543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.671929 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.673122 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.673416 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.673990 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.674220 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.674465 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.674614 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.674418 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.674904 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.674632 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.675082 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.674889 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.673294 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.675278 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.673913 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.675454 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.675236 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.675620 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.675738 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.675912 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.676031 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.676193 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.676300 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.676481 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.676619 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.677196 node.go:539 weedfs adds child dc1 I1117 09:40:43.677521 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.677799 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.678050 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.679005 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.679241 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.680406 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.680742 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.681571 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.681967 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.682723 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.683296 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.683929 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.684463 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.685429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.685755 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.686756 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.687009 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.687941 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.688216 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.689225 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.689251 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.689310 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.689048 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.689763 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.689966 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.689900 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.689943 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.689943 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.690205 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.690539 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.690480 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.690750 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.690919 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.691086 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.691209 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.691406 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.691516 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.691680 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.691809 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.691994 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.692127 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.692307 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.692430 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.693105 node.go:539 weedfs adds child dc1 I1117 09:40:43.693324 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.693592 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.693976 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.694953 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.695371 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.696092 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.696503 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.697186 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.697418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.698096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.698284 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.699586 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.699929 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.700671 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.700902 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.701472 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.701736 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.702372 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.702645 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.703422 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.703951 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.704134 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.703382 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.703986 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.703958 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.704377 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.704588 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.704500 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.704773 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.704627 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.703422 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.705023 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.705220 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.705019 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.705368 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.705541 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.705666 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.705852 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.706511 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.707248 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.707924 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.708303 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.708681 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.709379 node.go:539 weedfs adds child dc1 I1117 09:40:43.709871 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.710313 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.710985 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.712673 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.713087 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.714372 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.714572 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.715300 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.715509 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.716622 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.717025 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.718110 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.718382 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.718946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.719230 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.719726 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.720844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.721803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.722123 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.722974 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.723506 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.723683 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.724079 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.724531 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.724699 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.725070 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.725507 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.725666 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.725911 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.726332 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.726654 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.726765 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.727258 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.727445 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.728178 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.728680 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.729072 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.729641 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.729855 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.730074 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.730229 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.730436 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.730589 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.731357 node.go:539 weedfs adds child dc1 I1117 09:40:43.731609 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.731896 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.732135 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.733370 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.733808 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.734748 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.735114 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.736658 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.736889 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.737767 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.738064 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.738866 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.739216 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.740344 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.740890 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.741483 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.741679 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.742505 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.742717 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.743758 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.743898 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.744359 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.745390 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.745657 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.745813 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.744803 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.745197 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.744561 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.746232 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.746536 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.746814 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.747053 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.747201 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.747368 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.747503 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.747683 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.747819 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.748007 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.748143 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.748340 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.748471 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.748653 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.748766 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.749532 node.go:539 weedfs adds child dc1 I1117 09:40:43.749804 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.750073 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.750430 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.751323 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.751646 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.752295 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.752534 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.753161 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.753359 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.753924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.754084 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.754857 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.755170 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.755675 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.756052 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.757106 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.757317 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.758519 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.758829 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.759564 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.759612 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.759674 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.759748 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.760099 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.759717 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.760279 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.760327 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.760339 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.760394 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.761253 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.761428 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.761609 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.761746 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.761906 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.762047 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.762211 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.762335 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.762511 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.762630 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.762898 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.763025 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.763536 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.763851 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.764735 node.go:539 weedfs adds child dc1 I1117 09:40:43.765086 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.765368 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.765792 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.766624 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.766928 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.767667 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.767949 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.768478 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.768667 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.769463 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.769646 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.770627 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.770811 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.771421 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.771621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.772103 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.772331 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.772898 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.773316 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.774009 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.774059 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.774139 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.774126 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.774511 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.774243 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.774195 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.774689 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.774013 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.774450 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.774894 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.775084 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.775288 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.775412 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.775596 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.775734 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.775936 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.776082 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.776264 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.776377 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.776572 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.776745 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.776937 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.777077 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.777690 node.go:539 weedfs adds child dc1 I1117 09:40:43.777889 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.778105 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.778334 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.779435 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.779690 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.780652 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.780864 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.781559 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.781768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.782454 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.782683 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.783241 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.783508 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.784041 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.784294 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.784847 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.785032 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.785746 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.785948 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.786640 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.786606 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.786574 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.786809 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.787153 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.786887 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.786613 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.787064 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.787302 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.787332 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.787876 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.788058 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.788243 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.788367 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.788544 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.788684 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.788867 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.788981 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.789149 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.789257 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.789468 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.789581 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.789767 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.789872 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.790442 node.go:539 weedfs adds child dc1 I1117 09:40:43.790629 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.790932 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.791144 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.791901 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.792094 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.792808 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.793155 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.793826 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.794000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.794556 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.794733 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.795285 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.795691 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.796153 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.796331 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.797257 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.797457 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.798112 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.798474 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.799196 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.799192 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.799324 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.799670 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.799630 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.799344 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.799192 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.799327 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.800033 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.800005 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.801319 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.801659 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.801865 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.802006 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.802295 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.802428 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.802677 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.802815 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.803017 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.803164 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.803348 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.803480 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.803669 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.803808 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.804287 node.go:539 weedfs adds child dc1 I1117 09:40:43.804609 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.804927 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.805149 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.806323 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.806559 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.807261 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.807456 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.808097 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.808533 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.809400 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.809662 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.810230 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.810449 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.811039 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.811227 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.811831 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.812069 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.812703 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.812955 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.813590 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.814314 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.814345 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.814637 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.815093 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.815039 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.815495 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.815821 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.816558 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.815620 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.813652 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.816717 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.817064 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.817353 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.816613 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.816160 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.817579 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.817745 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.817935 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.818065 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.818232 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.818351 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.818530 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.818655 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.819053 node.go:539 weedfs adds child dc1 I1117 09:40:43.819234 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.819553 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.819924 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.820676 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.820954 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.821644 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.821898 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.822534 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.822852 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.823399 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.823591 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.824188 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.824400 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.824994 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.825204 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.825712 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.825940 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.826906 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.827388 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.828553 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.829363 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.829249 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.829900 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.830158 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.830326 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.829889 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.830573 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.830382 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.830721 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.830913 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.831066 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.830890 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.831378 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.831562 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.831378 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.831859 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.832040 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.828645 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.831842 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.832272 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.832409 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.832611 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.832734 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.833269 node.go:539 weedfs adds child dc1 I1117 09:40:43.833590 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.833877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.834113 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.835129 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.835361 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.836062 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.836250 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.837189 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.837418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.838047 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.838319 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.838871 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.839077 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.839936 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.840308 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.841144 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.841552 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.842319 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.842773 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.843696 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.843917 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.843765 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.843738 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.844253 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.844340 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.844489 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.844902 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.844883 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.845132 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.845370 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.845753 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.845888 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.846134 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.846253 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.845980 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.846501 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.846677 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.846860 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.847010 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.847334 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.847454 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.847704 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.847898 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.848497 node.go:539 weedfs adds child dc1 I1117 09:40:43.848720 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.848968 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.849260 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.850129 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.850392 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.851142 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.851546 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.855040 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.855355 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.855949 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.856335 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.856897 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.857100 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.864717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.865028 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.865734 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.865937 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.866573 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.866923 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.867693 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.868255 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.868441 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.868876 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.869359 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.869534 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.870155 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.870666 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.870839 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.871353 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.871881 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.872062 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.872691 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.875146 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.875326 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.873331 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.875574 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.875733 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.873926 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.875957 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.876096 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.874450 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.876326 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.876487 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.876929 node.go:539 weedfs adds child dc1 I1117 09:40:43.877129 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.877381 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.877745 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.878633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.878947 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.879608 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.879885 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.880675 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.880925 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.881469 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.881824 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.882568 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.882997 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.884133 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.884565 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.885353 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.885759 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.886994 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.887201 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.888235 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.888297 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.888798 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.888988 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.888796 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.888817 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.889167 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.888202 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.888233 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.889295 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.889091 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.889578 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.889479 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.889837 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.890040 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.890186 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.890388 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.890528 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.890736 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.890882 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.891088 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.891398 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.891719 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.891865 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.892382 node.go:539 weedfs adds child dc1 I1117 09:40:43.892579 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.892849 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.893296 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.894181 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.894444 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.895257 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.895498 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.896107 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.896376 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.896949 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.897146 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.897736 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.898059 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.898657 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.898871 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.899587 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.899849 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.900414 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.900586 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.901348 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.901504 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.901491 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.901823 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.902205 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.902040 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.902168 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.902466 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.902701 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.902583 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.902921 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.903091 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.902894 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.903268 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.903387 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.903554 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.903682 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.903280 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.903875 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.904059 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.904283 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.904424 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.904622 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.904744 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.905312 node.go:539 weedfs adds child dc1 I1117 09:40:43.905529 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.905768 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.906002 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.906937 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.907435 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.908542 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.908846 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.909428 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.909593 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.910417 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.910771 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.911529 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.911706 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.912387 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.912555 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.913140 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.913345 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.914181 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.914496 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.915152 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.916109 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.916308 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.915313 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.916088 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.916571 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.916731 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.916722 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.916750 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.917216 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.917561 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.917297 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.917876 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.918309 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.918477 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.918634 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.918764 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.918921 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.919033 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.919188 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.919304 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.916693 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.920640 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.920937 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.921544 node.go:539 weedfs adds child dc1 I1117 09:40:43.921731 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.922204 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.922484 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.923470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.923753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.924529 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.924723 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.925307 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.925605 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.926215 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.926623 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.927448 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.927714 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.928403 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.928602 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.929363 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.929598 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.930549 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.930843 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.931579 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.931770 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.931574 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.932284 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.931647 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.932181 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.932473 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.932790 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.932586 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.932194 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.932719 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.933025 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.933308 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.933484 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.933675 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.933828 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.934016 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.934145 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.934306 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.934468 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.934638 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.934746 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.934910 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.935097 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.935613 node.go:539 weedfs adds child dc1 I1117 09:40:43.935796 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.936060 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.936779 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.937611 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.937939 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.938610 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.938889 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.939505 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.939786 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.940456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.940663 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.941314 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.941519 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.942154 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.942351 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.942936 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.943392 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.944076 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.944295 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.945567 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.945568 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.945683 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.946093 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.945816 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.946257 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.946462 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.946254 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.946609 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.946441 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.946779 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.946501 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.946911 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.946687 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.947111 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.947244 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.947465 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.947596 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.947792 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.947921 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.948123 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.948260 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.948462 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.948602 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.949139 node.go:539 weedfs adds child dc1 I1117 09:40:43.949349 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.949603 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.949919 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.950922 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.951224 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.951994 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.952265 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.952770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.952953 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.953711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.953965 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.954650 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.954868 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.955433 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.955656 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.956086 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.956270 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.957237 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.957443 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.958147 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.958182 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.958273 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.958675 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.958152 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.958196 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.958867 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.958585 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.958723 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.959065 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.959217 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.959415 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.959208 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.959586 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.959803 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.959944 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.960128 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.960242 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.960400 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.960527 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.960700 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.960812 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.960994 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.961110 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.961586 node.go:539 weedfs adds child dc1 I1117 09:40:43.961772 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.962030 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.962382 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.963199 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.963458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.964288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.964523 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.965271 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.965694 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.966243 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.966607 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.967271 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.967601 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.968283 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.968600 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.969116 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.969400 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.970055 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.970356 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.971194 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.971273 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.971722 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.971474 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.971918 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.971966 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.972094 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.972160 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.972438 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.971198 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.972608 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.972516 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.972907 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.973177 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.973373 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.973509 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.973678 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.973803 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.973985 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.974100 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.974266 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.974408 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.974603 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.974713 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.975110 node.go:539 weedfs adds child dc1 I1117 09:40:43.975276 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.975700 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.975966 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.976831 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.977076 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.977936 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.978177 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.978791 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.979162 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.980068 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.980251 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.980970 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.981163 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.981702 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.981888 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:43.982408 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:43.982815 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:43.983823 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:43.984589 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:43.986196 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:43.986843 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:43.986556 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:43.986626 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:43.987047 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:43.986835 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:43.986196 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:43.987271 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:43.987471 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:43.987272 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:43.987262 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:43.987674 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:43.987422 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:43.987804 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:43.987972 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:43.988107 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:43.988261 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:43.988398 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:43.988561 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:43.988709 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:43.988899 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:43.989214 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:43.989415 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:43.989561 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:43.990268 node.go:539 weedfs adds child dc1 I1117 09:40:43.990688 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:43.991131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:43.991527 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:43.993161 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:43.993394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:43.995261 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:43.995567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:43.996418 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:43.996644 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:43.997411 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:43.997619 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:43.998240 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:43.998656 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:43.999330 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:43.999615 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.002607 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.003290 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.005055 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.005557 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.007527 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.008169 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.008374 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.008692 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.009209 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.009390 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.009482 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.009558 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.009672 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.009518 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.010042 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.010207 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.010391 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.010120 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.010508 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.010727 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.011068 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.010864 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.011282 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.011425 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.011611 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.011743 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.011919 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.012038 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.012461 node.go:539 weedfs adds child dc1 I1117 09:40:44.012778 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.013192 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.014182 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.015717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.015943 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.016815 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.017033 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.017796 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.018147 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.018636 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.018899 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.019486 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.019773 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.021097 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.021376 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.022260 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.022550 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.023312 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.023547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.024226 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.024258 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.024412 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.024757 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.025032 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.024960 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.024922 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.025262 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.025425 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.025626 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.025448 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.025773 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.025518 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.025966 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.026102 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.026005 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.026304 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.026599 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.027181 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.027320 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.027674 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.027814 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.028130 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.028273 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.028939 node.go:539 weedfs adds child dc1 I1117 09:40:44.029184 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.029443 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.029702 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.031289 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.031785 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.033275 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.033497 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.034253 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.034552 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.036287 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.037066 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.037923 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.038277 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.039019 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.039241 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.041803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.043260 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.044231 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.044458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.045217 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.045809 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.046013 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.046702 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.047275 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.047476 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.047978 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.048524 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.048718 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.048860 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.049024 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.049401 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.049582 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.049806 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.049968 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.050007 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.050241 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.050503 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.050829 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.051024 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.051170 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.049653 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.051950 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.057151 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.059249 node.go:539 weedfs adds child dc1 I1117 09:40:44.059732 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.060145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.060493 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.062362 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.062660 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.087599 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.088173 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.089027 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.089450 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.090375 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.090835 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.092239 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.092649 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.093419 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.094181 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.095072 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.095336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.098470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.099022 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.104463 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.105544 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.105802 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.107031 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.107746 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.107955 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.108504 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.109909 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.109694 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.110583 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.111112 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.110741 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.111374 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.116158 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.116725 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.109339 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.116993 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.117240 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.117410 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.116993 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.117645 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.117792 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.117987 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.118129 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.118872 node.go:539 weedfs adds child dc1 I1117 09:40:44.119134 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.119451 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.119720 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.120882 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.121101 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.121999 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.122398 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.123481 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.123768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.125293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.125512 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.126213 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.126589 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.127237 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.127447 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.128256 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.128458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.129226 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.129424 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.131015 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.131308 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.131666 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.131002 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.131710 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.131015 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.130961 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.132499 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.132275 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.132892 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.133522 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.133905 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.134119 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.134263 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.134475 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.134624 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.134827 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.134956 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.135133 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.135271 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.135471 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.135614 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.135802 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.135942 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.136940 node.go:539 weedfs adds child dc1 I1117 09:40:44.137339 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.137626 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.137987 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.139667 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.140343 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.141181 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.141575 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.142313 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.142569 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.143336 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.143533 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.144286 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.144533 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.146372 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.146781 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.147367 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.147565 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.148379 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.148575 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.150019 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.150586 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.150776 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.151061 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.151525 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.151696 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.152104 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.152564 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.152732 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.153624 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.154563 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.154514 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.149335 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.153655 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.155123 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.156272 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.155624 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.156639 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.157219 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.157395 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.157606 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.157754 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.157912 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.158051 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.158739 node.go:539 weedfs adds child dc1 I1117 09:40:44.158988 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.159286 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.160103 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.161697 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.162243 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.163038 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.163363 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.164028 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.164238 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.164903 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.166182 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.167812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.168241 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.168877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.169280 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.170015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.170236 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.172200 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.172460 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.174629 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.175234 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.175431 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.175732 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.176182 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.176333 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.176597 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.177072 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.177250 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.177535 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.177979 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.178148 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.178439 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.178903 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.179127 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.179382 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.180464 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.181486 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.182524 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.182973 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.183522 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.183734 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.184049 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.184187 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.184885 node.go:539 weedfs adds child dc1 I1117 09:40:44.185095 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.185538 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.185815 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.186714 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.186975 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.187718 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.187977 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.188563 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.188838 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.189393 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.189664 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.192297 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.192777 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.194328 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.194760 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.195547 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.195778 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.197184 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.197650 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.198942 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.199516 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.199712 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.200768 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.201303 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.201488 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.201758 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.202240 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.202425 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.202709 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.203194 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.203369 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.203639 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.204108 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.204282 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.204564 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.205022 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.205195 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.200016 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.205564 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.205737 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.206086 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.206627 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.206812 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.207381 node.go:539 weedfs adds child dc1 I1117 09:40:44.207613 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.207851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.208079 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.208868 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.209037 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.209633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.210777 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.211744 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.212791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.213532 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.213725 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.214210 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.214489 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.215035 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.215241 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.216928 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.217419 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.218824 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.219336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.220841 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.221362 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.221563 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.221856 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.222354 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.222541 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.222841 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.223321 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.223500 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.223782 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.224254 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.224434 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.224992 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.225504 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.225691 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.225986 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.220294 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.227439 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.228376 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.228782 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.229298 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.229686 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.229953 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.230088 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.230988 node.go:539 weedfs adds child dc1 I1117 09:40:44.231302 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.231592 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.231993 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.233522 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.233768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.235649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.235992 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.236958 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.237272 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.237831 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.238010 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.238553 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.238722 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.239357 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.239570 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.241837 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.242197 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.242941 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.243239 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.244165 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.244898 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.245237 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.245844 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.246563 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.246748 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.246666 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.247195 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.247022 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.247369 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.247570 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.247696 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.247621 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.248085 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.248258 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.248059 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.248498 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.248668 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.248647 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.249099 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.248953 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.249275 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.249502 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.249647 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.250523 node.go:539 weedfs adds child dc1 I1117 09:40:44.251058 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.251515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.251990 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.253145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.253579 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.254561 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.254773 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.255570 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.255783 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.256502 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.256906 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.257567 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.257918 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.258557 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.258774 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.259426 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.259851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.260901 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.261417 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.262361 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.263148 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.263149 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.263496 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.263734 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.263885 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.263760 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.264321 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.264175 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.264515 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.264739 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.264903 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.264751 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.265224 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.265172 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.265486 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.265766 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.265949 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.265724 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.262535 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.266505 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.266780 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.267190 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.267372 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.268387 node.go:539 weedfs adds child dc1 I1117 09:40:44.268703 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.269428 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.269980 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.272012 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.272458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.273589 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.274012 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.275418 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.275901 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.277258 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.277668 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.278384 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.278677 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.279356 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.279569 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.280415 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.280752 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.281830 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.282219 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.283229 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.283341 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.283774 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.283969 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.283778 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.284204 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.283954 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.284344 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.284518 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.284320 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.284649 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.283229 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.284550 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.284819 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.285070 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.284953 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.285286 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.285432 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.285612 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.285744 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.285933 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.286053 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.286318 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.286523 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.287059 node.go:539 weedfs adds child dc1 I1117 09:40:44.287236 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.287656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.287914 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.289155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.289577 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.290611 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.290807 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.291636 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.291855 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.292431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.292713 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.294277 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.294575 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.295525 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.295886 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.296779 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.297196 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.297945 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.298251 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.298892 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.299425 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.299609 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.300164 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.300774 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.300953 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.301260 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.301743 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.301912 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.302311 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.302770 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.302943 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.303490 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.303727 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.304069 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.304294 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.304671 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.305115 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.305477 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.305899 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.306187 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.305925 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.306694 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.306941 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.307424 node.go:539 weedfs adds child dc1 I1117 09:40:44.307744 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.308284 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.308679 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.309571 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.310057 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.311172 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.311370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.311940 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.312280 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.312760 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.312927 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.315017 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.315352 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.315983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.316143 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.317539 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.318017 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.318694 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.319611 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.320617 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.324961 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.325190 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.321479 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.325475 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.325653 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.321974 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.325897 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.326041 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.322398 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.326305 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.322853 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.323314 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.323804 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.324320 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.327308 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.327518 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.327668 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.327863 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.328005 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.328196 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.328339 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.328535 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.328671 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.329333 node.go:539 weedfs adds child dc1 I1117 09:40:44.329593 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.330001 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.330263 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.331504 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.331725 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.332511 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.332707 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.335545 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.335775 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.337262 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.337462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.338638 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.339279 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.340793 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.341445 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.343065 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.343348 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.344529 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.344723 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.345623 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.346220 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.347084 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.347772 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.348535 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.349158 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.349684 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.350018 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.350174 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.350575 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.350531 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.349938 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.350872 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.351481 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.351299 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.351777 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.352313 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.352627 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.352953 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.353290 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.353622 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.353889 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.354223 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.354599 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.355248 node.go:539 weedfs adds child dc1 I1117 09:40:44.355571 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.356126 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.356577 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.358229 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.358675 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.360167 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.360666 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.362306 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.362639 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.364174 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.364578 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.365626 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.366299 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.367670 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.367941 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.368598 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.368931 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.370746 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.371048 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.372033 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.372624 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.372818 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.373257 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.373690 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.373895 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.374148 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.374593 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.374766 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.375238 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.375731 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.375910 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.375654 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.376193 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.376388 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.376182 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.376656 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.376832 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.376687 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.377140 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.377305 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.377242 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.377715 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.377894 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.378483 node.go:539 weedfs adds child dc1 I1117 09:40:44.378728 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.378977 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.379183 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.380037 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.380258 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.380967 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.381153 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.381752 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.382004 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.383371 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.383908 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.384812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.385232 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.385766 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.385964 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.387192 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.387595 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.389246 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.389701 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.391080 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.391638 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.391898 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.392188 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.392671 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.392844 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.393136 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.393613 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.393785 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.394057 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.394521 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.394698 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.394979 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.395451 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.395624 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.395875 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.396338 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.396691 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.397356 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.399559 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.399979 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.400157 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.400371 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.400513 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.401087 node.go:539 weedfs adds child dc1 I1117 09:40:44.401313 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.401576 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.401832 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.402797 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.403028 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.405590 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.405962 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.407611 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.407989 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.409726 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.410172 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.411566 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.412142 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.413281 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.413463 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.414034 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.414194 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.415002 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.415210 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.415744 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.416204 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.416359 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.416620 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.419827 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.419425 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.417834 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.418958 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.420025 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.421046 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.417218 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.420289 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.418290 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.422361 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.422583 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.422726 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.422910 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.423030 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.423769 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.424036 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.424453 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.424718 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.425113 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.425360 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.426112 node.go:539 weedfs adds child dc1 I1117 09:40:44.426438 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.426775 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.427029 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.427919 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.428128 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.430860 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.431415 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.432934 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.433308 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.434098 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.434329 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.435191 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.435529 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.436081 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.436278 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.438591 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.439179 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.440887 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.441244 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.442000 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.442567 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.442759 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.443515 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.443982 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.444136 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.444391 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.444792 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.444938 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.445168 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.445554 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.445697 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.445915 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.446864 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.447467 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.448122 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.449076 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.449417 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.449900 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.450348 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.450740 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.451142 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.451651 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.451842 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.452599 node.go:539 weedfs adds child dc1 I1117 09:40:44.453225 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.453671 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.454092 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.454925 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.455302 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.456002 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.456281 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.458462 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.459071 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.460794 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.461214 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.462121 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.463139 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.464953 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.465315 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.466001 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.466301 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.466991 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.467209 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.468169 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.468927 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.469936 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.470102 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.470311 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.470423 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.470419 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.470929 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.470721 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.471123 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.471349 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.471495 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.471478 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.471770 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.472072 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.472331 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.472526 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.472338 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.472688 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.472872 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.473025 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.472901 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.474667 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.474861 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.475760 node.go:539 weedfs adds child dc1 I1117 09:40:44.476101 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.476526 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.476792 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.477773 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.477961 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.479521 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.480134 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.481795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.482036 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.482635 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.482804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.483813 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.484539 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.485424 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.486117 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.487034 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.487332 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.488202 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.488498 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.490374 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.490974 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.491153 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.491524 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.491935 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.492090 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.492340 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.492728 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.492874 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.493524 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.494039 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.494223 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.494515 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.494981 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.495157 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.495496 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.495982 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.496166 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.489235 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.497521 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.497948 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.498145 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.498776 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.501803 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.502573 node.go:539 weedfs adds child dc1 I1117 09:40:44.502846 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.503141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.503492 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.504541 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.504764 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.505732 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.505946 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.506919 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.507132 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.507971 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.508232 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.509742 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.510736 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.512890 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.513759 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.514733 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.514963 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.515809 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.516076 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.518730 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.521027 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.520961 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.519853 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.519729 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.520352 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.520359 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.520332 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.519701 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.521560 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.522420 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.522612 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.522802 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.522958 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.523150 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.523284 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.523583 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.523714 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.524010 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.524136 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.524419 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.524551 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.524853 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.525002 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.525658 node.go:539 weedfs adds child dc1 I1117 09:40:44.525896 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.526150 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.526457 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.527396 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.527592 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.528301 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.528491 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.529250 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.529480 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.531635 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.532674 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.534043 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.534294 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.534955 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.535285 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.535876 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.536163 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.539439 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.540089 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.541782 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.542437 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.542640 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.542955 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.543486 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.543644 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.543897 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.544384 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.544538 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.544814 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.545299 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.545469 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.545703 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.546126 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.546308 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.546671 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.547200 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.546886 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.547390 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.547617 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.547750 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.548393 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.548827 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.548976 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.549479 node.go:539 weedfs adds child dc1 I1117 09:40:44.549645 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.549882 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.550158 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.552270 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.552922 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.554710 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.555145 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.556870 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.557262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.558136 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.558337 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.559015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.559233 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.560432 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.560948 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.561891 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.562268 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.563244 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.563771 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.564679 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.569364 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.569569 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.565442 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.569929 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.570081 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.566121 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.570304 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.570432 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.566645 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.570653 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.570786 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.567195 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.570997 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.571133 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.567685 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.571350 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.571481 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.568173 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.571696 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.571831 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.568680 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.572051 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.572196 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.572815 node.go:539 weedfs adds child dc1 I1117 09:40:44.573039 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.573494 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.573793 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.575046 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.575271 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.576967 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.577379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.578730 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.579056 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.579606 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.579799 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.580496 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.580739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.581374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.582588 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.583355 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.583560 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.584301 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.584493 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.585126 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.589096 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.586277 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.586878 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.587076 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.587397 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.587662 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.587899 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.588179 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.590311 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.590551 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.590692 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.590862 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.590996 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.591153 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.591268 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.591432 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.591695 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.591857 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.591967 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.592123 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.592234 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.592387 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.592622 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.593082 node.go:539 weedfs adds child dc1 I1117 09:40:44.593389 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.593638 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.593976 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.595007 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.595311 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.595947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.596118 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.597179 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.597621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.598198 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.598599 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.599143 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.599326 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.599922 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.600099 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.600722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.600907 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.601594 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.601800 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.602388 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.602391 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.602905 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.603377 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.603246 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.603795 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.603759 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.604306 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.603166 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.604363 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.604085 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.604758 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.605023 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.605256 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.604696 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.605384 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.605705 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.605895 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.606094 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.606244 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.606628 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.606759 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.606936 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.607074 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.607500 node.go:539 weedfs adds child dc1 I1117 09:40:44.607707 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.607946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.608320 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.609112 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.609441 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.610345 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.610737 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.611489 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.611872 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.612496 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.612788 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.613435 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.613729 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.614376 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.614719 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.615933 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.616448 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.617730 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.617945 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.618889 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.619491 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.620001 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.620097 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.620167 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.620205 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.620627 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.620910 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.620741 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.620838 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.621147 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.621292 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.621446 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.621725 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.621904 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.622025 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.622184 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.622299 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.622461 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.622567 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.622725 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.622832 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.622991 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.623108 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.623475 node.go:539 weedfs adds child dc1 I1117 09:40:44.623841 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.624144 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.624341 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.625271 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.625511 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.626244 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.626456 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.627136 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.627360 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.627879 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.628132 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.628651 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.628832 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.629364 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.629518 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.630444 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.630865 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.631676 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.632128 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.633305 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.634956 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.635388 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.635772 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.636030 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.636209 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.634152 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.636459 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.634349 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.634718 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.634776 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.634232 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.636684 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.637139 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.637334 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.637529 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.637688 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.637885 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.638053 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.638260 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.638691 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.638374 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.639267 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.639552 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.640344 node.go:539 weedfs adds child dc1 I1117 09:40:44.640809 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.641149 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.641498 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.642613 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.642834 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.643594 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.643803 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.644539 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.644775 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.645327 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.645631 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.646192 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.647750 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.649060 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.649315 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.650121 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.650343 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.651080 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.651356 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.652035 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.652682 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.652880 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.653378 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.653495 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.653949 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.654139 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.654371 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.654171 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.654535 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.654174 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.654121 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.654812 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.654692 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.654956 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.654762 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.655167 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.655304 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.655500 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.655640 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.655835 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.655972 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.656159 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.656292 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.656923 node.go:539 weedfs adds child dc1 I1117 09:40:44.657331 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.657910 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.658553 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.659800 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.660144 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.661015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.664086 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.664832 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.665324 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.665979 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.666189 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.666958 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.667157 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.667837 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.668130 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.668795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.669028 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.669615 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.675040 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.679095 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.679213 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.679762 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.679987 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.679932 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.680341 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.680508 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.680730 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.680541 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.680877 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.681093 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.681230 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.681160 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.681636 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.681816 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.681514 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.682066 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.682203 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.682057 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.682504 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.682677 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.682477 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.682931 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.684030 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.684716 node.go:539 weedfs adds child dc1 I1117 09:40:44.684961 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.685182 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.685439 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.686302 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.686493 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.687241 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.687411 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.688160 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.688330 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.689667 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.689847 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.690874 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.691584 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.692256 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.692921 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.694074 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.694248 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.694890 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.695051 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.695633 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.695726 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.695693 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.695666 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.696117 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.695799 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.696299 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.695891 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.696249 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.696541 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.696496 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.696893 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.697082 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.697393 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.697568 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.697686 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.697849 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.697954 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.698124 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.698230 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.698394 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.698498 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.698790 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.700045 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.700635 node.go:539 weedfs adds child dc1 I1117 09:40:44.700906 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.701173 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.701470 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.702512 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.702726 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.703515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.703694 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.704467 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.704675 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.705360 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.705556 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.707155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.707633 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.708763 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.709483 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.710496 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.711079 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.712492 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.712896 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.714031 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.714771 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.715099 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.715788 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.716462 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.717302 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.716611 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.717811 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.717982 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.717276 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.717858 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.718259 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.718406 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.718594 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.718737 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.718462 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.718512 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.718927 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.719081 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.719266 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.719401 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.716919 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.719988 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.720163 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.721916 node.go:539 weedfs adds child dc1 I1117 09:40:44.722185 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.722447 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.722686 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.723710 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.723950 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.724658 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.724845 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.725442 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.725674 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.726316 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.727138 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.728428 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.730423 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.731019 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.731231 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.731985 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.732189 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.732924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.736441 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.737336 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.737884 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.738074 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.738436 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.738830 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.738975 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.739195 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.739567 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.739968 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.740513 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.741046 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.741570 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.742115 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.739707 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.744165 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.744325 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.744640 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.744772 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.744939 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.745067 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.745233 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.745361 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.745532 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.745656 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.746079 node.go:539 weedfs adds child dc1 I1117 09:40:44.746268 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.746725 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.747071 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.748369 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.748610 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.750315 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.750804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.752686 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.753019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.754213 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.754824 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.756260 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.756742 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.758334 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.758767 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.759525 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.759815 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.760503 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.760814 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.761480 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.762002 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.762177 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.762599 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.763512 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.764248 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.765106 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.763053 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.765659 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.765945 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.766202 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.765998 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.766360 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.766702 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.767054 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.767278 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.766198 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.767453 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.767889 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.768061 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.768259 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.768394 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.768568 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.768703 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.769132 node.go:539 weedfs adds child dc1 I1117 09:40:44.769314 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.769864 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.770222 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.771187 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.771419 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.772129 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.772343 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.772980 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.774307 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.775467 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.775671 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.776877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.777071 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.778576 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.778767 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.783543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.783848 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.784816 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.785146 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.785808 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.786326 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.786653 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.787245 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.788019 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.788569 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.789089 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.790123 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.789614 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.797199 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.797515 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.797675 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.797869 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.798005 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.798182 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.798315 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.798497 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.798627 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.798800 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.798922 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.799097 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.799224 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.799389 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.799513 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.800109 node.go:539 weedfs adds child dc1 I1117 09:40:44.800326 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.800582 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.800813 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.801859 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.802054 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.802803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.803048 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.806564 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.806804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.807549 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.807774 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.808288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.808574 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.810248 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.810674 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.812061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.812432 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.813844 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.814203 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.815502 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.815707 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.815763 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.816167 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.816375 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.816623 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.816446 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.816445 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.816767 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.817117 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.817305 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.817011 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.817202 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.817518 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.817782 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.818205 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.818027 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.818743 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.819099 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.819278 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.819475 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.819622 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.819819 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.819950 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.820677 node.go:539 weedfs adds child dc1 I1117 09:40:44.820866 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.821116 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.821507 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.822285 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.822609 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.824197 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.824835 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.826291 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.826510 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.827690 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.827899 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.829276 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.829527 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.831429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.831754 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.832382 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.832676 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.833903 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.834117 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.835378 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.835950 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.836134 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.836510 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.837026 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.837203 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.837477 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.837936 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.838107 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.838366 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.838829 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.838998 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.839257 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.840003 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.840619 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.841122 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.839703 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.842264 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.842506 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.842633 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.842792 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.842903 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.843054 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.843182 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.843630 node.go:539 weedfs adds child dc1 I1117 09:40:44.843936 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.844242 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.844483 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.845433 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.845637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.846310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.847451 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.849495 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.849894 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.851234 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.851540 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.852752 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.853137 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.854599 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.855000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.856065 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.856303 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.857304 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.857555 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.858253 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.858356 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.858779 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.859042 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.858808 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.858253 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.858978 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.859266 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.859451 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.859644 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.859417 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.859799 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.859531 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.859992 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.860173 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.860113 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.860377 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.860514 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.860712 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.860845 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.861034 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.861170 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.861368 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.861501 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.861906 node.go:539 weedfs adds child dc1 I1117 09:40:44.862119 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.862538 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.862806 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.863784 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.864131 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.864901 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.865238 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.865849 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.866244 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.866865 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.867252 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.868167 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.868532 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.869322 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.869672 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.870470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.870847 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.871530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.871966 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.872842 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.873570 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.873869 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.873623 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.874244 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.874005 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.874386 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.874194 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.874584 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.874737 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.874609 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.874926 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.874768 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.875063 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.875405 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.875174 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.875258 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.875581 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.875770 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.875928 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.876133 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.876270 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.876482 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.876705 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.877175 node.go:539 weedfs adds child dc1 I1117 09:40:44.877366 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.877722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.878122 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.878980 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.881027 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.882739 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.883253 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.884363 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.884724 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.885328 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.885538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.886569 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.887085 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.887908 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.888330 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.889237 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.889604 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.890296 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.890471 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.891096 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.891202 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.891182 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.891619 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.891857 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.891767 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.891842 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.892062 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.892345 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.892562 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.892387 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.892404 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.892732 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.892938 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.893095 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.892902 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.893279 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.893413 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.893620 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.896164 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.898236 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.898664 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.899277 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.899441 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.899942 node.go:539 weedfs adds child dc1 I1117 09:40:44.900293 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.900614 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.900859 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.901793 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.902016 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.902823 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.903033 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.903979 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.904287 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.904964 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.905273 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.905856 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.906040 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.906922 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.907237 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.907766 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.908199 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.908838 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.909330 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.910152 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.910911 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.911143 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.910239 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.910971 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.911374 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.911517 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.911695 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.911826 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.911688 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.912164 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.912357 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.912089 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.912605 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.912748 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.912575 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.913011 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.913184 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.913342 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.913829 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.914007 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.913019 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.916556 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.916736 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.917297 node.go:539 weedfs adds child dc1 I1117 09:40:44.917615 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.917915 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.918160 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.919044 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.919242 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.920119 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.920333 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.921052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.921500 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.922266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.922857 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.923515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.923994 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.924888 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.925240 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.926017 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.926367 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.927349 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.927855 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.928694 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.929029 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.928750 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.929064 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.929405 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.929369 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.929775 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.929340 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.930013 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.930189 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.930384 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.930521 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.930124 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.930685 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.930809 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.930630 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.931041 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.931174 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.931360 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.931497 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.931712 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.931846 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.932044 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.932187 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.932750 node.go:539 weedfs adds child dc1 I1117 09:40:44.932949 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.933365 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.933805 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.934807 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.935230 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.936121 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.936551 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.937304 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.937520 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.938266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.938754 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.942220 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.942794 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.944155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.945332 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.948143 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.948374 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.949153 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.949400 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.950128 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.950736 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:44.950946 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:44.950126 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.951217 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.951398 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:44.950752 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.951278 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.951847 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.952355 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.952974 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.953778 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.954483 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:44.954650 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:44.954846 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.954966 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.955128 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:44.957101 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:44.957646 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:44.958217 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:44.958641 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.958869 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.959116 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.959258 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.959983 node.go:539 weedfs adds child dc1 I1117 09:40:44.960221 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:44.960596 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:44.960917 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:44.966690 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:44.969787 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:44.971015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:44.971326 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:44.973720 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:44.975297 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:44.976382 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:44.976660 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:44.977266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:44.977556 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:44.978112 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:44.978286 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:44.978803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:44.978987 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:44.979659 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:44.984465 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:44.988179 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:44.988854 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:44.989060 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:44.989387 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:44.989953 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:44.990146 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:44.990451 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:44.991179 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:44.991896 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:44.992561 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:44.993361 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:44.994083 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:44.995893 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:44.996968 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:44.997489 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:44.997906 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.006736 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.007040 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.007302 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.007445 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.007647 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.007785 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.007970 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.008105 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.008880 node.go:539 weedfs adds child dc1 I1117 09:40:45.009147 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.009430 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.009698 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.018447 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.018765 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.023940 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.024316 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.025141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.029992 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.030834 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.031037 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.031727 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.031945 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.032448 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.032719 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.034613 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.035014 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.037628 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.038044 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.039661 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.040252 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.040441 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.040722 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.041201 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.041377 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.041660 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.042147 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.042319 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.042577 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.043027 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.043322 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.043982 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.044525 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.045352 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.046979 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.047445 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.047748 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.048176 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.048452 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.048886 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.049180 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.049616 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.049896 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.050587 node.go:539 weedfs adds child dc1 I1117 09:40:45.050924 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.051496 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.051987 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.053586 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.053910 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.054695 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.054896 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.055452 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.055774 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.056317 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.057628 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.058342 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.058546 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.059210 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.059434 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.059943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.060224 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.060936 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.061135 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.061830 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.062351 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.062527 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.063927 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.064463 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.064696 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.065097 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.065050 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.065540 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.065706 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.065902 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.066047 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.065831 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.066316 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.066508 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.066800 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.067266 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.067446 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.066292 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.067795 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.067961 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.062948 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.068881 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.069272 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.069849 node.go:539 weedfs adds child dc1 I1117 09:40:45.070088 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.070341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.070567 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.071431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.071623 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.072328 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.072550 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.073947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.074236 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.075020 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.075485 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.076194 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.076540 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.077714 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.078114 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.078698 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.078957 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.079594 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.079793 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.080459 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.083315 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.083505 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.081155 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.083762 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.083910 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.081216 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.084150 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.084288 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.081896 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.084512 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.084658 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.081932 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.084893 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.085026 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.082092 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.085246 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.085380 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.082150 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.085653 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.085791 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.082425 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.085991 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.086123 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.087198 node.go:539 weedfs adds child dc1 I1117 09:40:45.087533 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.088000 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.088610 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.090533 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.091058 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.092570 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.093089 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.094514 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.094743 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.095562 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.095772 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.097496 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.097920 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.098818 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.099019 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.099768 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.100015 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.100691 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.100978 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.101635 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.102172 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.102349 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.103972 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.104543 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.104736 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.105169 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.105664 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.105849 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.106917 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.107469 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.107651 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.107914 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.108310 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.108455 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.108694 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.109069 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.109211 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.106263 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.109976 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.110250 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.102778 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.110920 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.111241 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.112128 node.go:539 weedfs adds child dc1 I1117 09:40:45.112367 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.112583 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.112788 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.113715 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.113920 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.114725 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.114931 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.115603 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.115804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.117937 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.118670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.119363 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.119583 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.120277 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.120514 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.121038 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.121338 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.122064 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.122292 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.123834 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.124470 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.124668 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.124422 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.124985 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.125179 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.125128 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.125611 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.125478 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.125783 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.126101 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.126455 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.126176 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.126819 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.126849 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.127305 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.127603 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.127931 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.128090 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.128298 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.128445 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.128243 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.128864 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.129058 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.129618 node.go:539 weedfs adds child dc1 I1117 09:40:45.129853 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.130346 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.130693 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.131806 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.132063 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.133110 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.133336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.134021 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.134369 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.135025 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.135240 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.136030 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.136240 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.137568 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.138344 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.139530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.140414 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.141177 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.141605 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.142341 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.142883 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.143511 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.144594 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.145433 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.146989 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.147646 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.148413 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.143052 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.149553 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.149711 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.149914 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.150057 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.150265 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.150399 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.150622 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.150764 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.146100 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.150966 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.151289 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.151518 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.151657 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.151852 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.151995 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.152464 node.go:539 weedfs adds child dc1 I1117 09:40:45.153122 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.153513 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.153766 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.156748 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.157164 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.158135 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.158546 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.159582 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.160069 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.160691 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.160984 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.161506 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.161706 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.162304 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.162508 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.163840 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.164165 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.164768 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.164945 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.165714 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.166189 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.166348 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.166597 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.168050 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.168399 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.168551 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.166750 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.168704 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.166796 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.167491 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.168833 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.169201 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.169381 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.168138 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.169565 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.167190 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.169725 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.169987 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.170138 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.170307 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.170485 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.170650 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.170762 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.171107 node.go:539 weedfs adds child dc1 I1117 09:40:45.171262 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.171623 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.171845 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.172782 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.173006 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.174637 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.175060 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.175759 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.176573 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.177161 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.177333 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.177964 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.178133 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.178957 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.179136 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.179619 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.180346 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.181719 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.182163 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.183296 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.183880 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.184081 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.184741 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.185423 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.185469 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.186074 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.186114 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.186630 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.187162 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.187600 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.187876 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.188108 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.188248 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.188432 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.188554 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.188738 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.188856 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.189028 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.189152 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.189335 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.189459 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.189629 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.189760 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.192218 node.go:539 weedfs adds child dc1 I1117 09:40:45.192459 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.192706 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.192999 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.194018 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.194217 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.194944 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.195207 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.195939 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.196326 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.197018 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.197229 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.197726 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.197971 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.198469 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.198645 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.199167 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.199342 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.200940 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.201374 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.202036 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.202548 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.202725 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.203114 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.204318 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.204490 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.204739 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.205167 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.205324 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.205561 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.205975 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.206133 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.206678 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.207208 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.207391 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.207651 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.208090 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.207958 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.208257 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.208462 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.208612 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.208489 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.208907 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.209071 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.209528 node.go:539 weedfs adds child dc1 I1117 09:40:45.209705 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.211229 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.211642 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.212487 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.212710 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.213417 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.214655 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.215604 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.216052 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.216712 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.216970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.217601 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.217807 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.218431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.218594 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.219222 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.219430 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.220436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.220949 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.222020 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.222829 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.222772 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.223193 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.223448 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.223187 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.223582 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.223378 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.222050 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.222041 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.222628 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.223758 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.224306 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.224438 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.224636 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.224776 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.224963 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.225090 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.225265 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.225390 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.225631 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.225766 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.225938 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.226075 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.226591 node.go:539 weedfs adds child dc1 I1117 09:40:45.226800 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.227043 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.227270 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.228158 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.228424 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.229119 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.229365 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.230347 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.230769 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.231766 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.232317 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.232920 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.233307 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.234095 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.234444 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.235203 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.235622 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.236614 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.237024 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.237688 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.238228 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.238004 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.238404 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.238296 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.238622 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.238757 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.238614 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.238928 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.239057 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.238968 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.239245 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.239373 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.239572 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.239333 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.239548 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.239703 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.239890 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.240359 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.240538 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.240728 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.240877 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.241478 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.241679 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.242253 node.go:539 weedfs adds child dc1 I1117 09:40:45.242523 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.242794 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.243037 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.244423 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.244739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.246023 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.246236 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.247402 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.247608 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.248267 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.248463 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.249143 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.249431 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.250215 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.250540 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.251116 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.251313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.251976 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.252170 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.253010 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.252863 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.253551 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.253916 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.254798 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.254206 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.254255 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.254313 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.255364 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.254406 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.255599 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.255792 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.256010 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.256165 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.256413 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.256558 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.256811 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.256961 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.257202 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.257374 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.257595 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.257752 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.257925 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.258064 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.258603 node.go:539 weedfs adds child dc1 I1117 09:40:45.258796 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.259230 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.259568 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.260472 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.260767 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.261532 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.261759 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.262305 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.262586 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.264339 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.264800 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.266564 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.267002 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.268596 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.269022 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.270541 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.270756 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.271643 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.271871 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.272534 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.273330 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.273428 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.273951 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.274077 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.274683 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.274914 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.275398 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.276179 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.276387 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.276656 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.276824 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.277008 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.277135 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.277294 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.277402 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.277578 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.277693 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.277843 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.277949 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.278099 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.278205 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.278351 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.278455 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.279008 node.go:539 weedfs adds child dc1 I1117 09:40:45.279199 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.279454 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.279803 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.281176 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.281629 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.283147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.283598 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.285243 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.285889 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.287290 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.287543 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.288275 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.288670 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.289473 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.290516 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.291707 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.292002 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.292551 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.292718 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.293334 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.293625 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.294171 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.293951 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.294366 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.294235 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.294599 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.294743 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.294570 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.294927 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.295051 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.294832 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.295221 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.295353 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.295138 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.295520 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.295647 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.295393 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.295846 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.296022 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.296225 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.296367 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.296551 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.296683 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.297214 node.go:539 weedfs adds child dc1 I1117 09:40:45.297441 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.297693 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.297908 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.299588 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.300112 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.301820 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.302203 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.303716 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.304058 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.305461 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.305793 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.307296 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.307611 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.308157 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.308349 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.309272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.309516 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.310139 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.310381 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.311958 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.312484 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.312666 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.312929 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.313388 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.313554 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.313807 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.314247 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.314413 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.314663 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.315105 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.315268 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.315809 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.316283 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.316475 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.316741 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.317174 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.317340 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.317020 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.317569 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.315536 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.317766 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.318194 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.318520 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.319305 node.go:539 weedfs adds child dc1 I1117 09:40:45.319705 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.320221 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.320618 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.321725 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.321996 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.322817 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.323224 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.323928 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.324226 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.324877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.325079 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.326747 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.327239 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.328018 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.328791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.329948 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.330555 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.331573 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.332054 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.333303 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.333367 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.333881 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.334080 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.334300 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.334448 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.334032 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.334667 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.334534 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.334814 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.334995 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.335124 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.335007 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.335394 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.335544 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.335407 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.335865 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.336153 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.336909 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.343248 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.343652 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.343860 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.344075 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.344226 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.344815 node.go:539 weedfs adds child dc1 I1117 09:40:45.345019 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.345470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.345842 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.349443 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.349692 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.350571 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.350805 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.351497 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.351753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.352270 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.352540 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.353033 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.358881 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.362103 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.362991 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.364203 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.364685 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.365576 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.366055 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.367349 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.367452 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.367864 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.368027 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.367910 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.368209 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.368026 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.367349 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.368346 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.368602 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.368454 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.368543 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.368775 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.369010 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.368807 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.369153 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.369432 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.369614 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.369833 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.370165 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.370377 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.370516 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.370707 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.370846 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.371417 node.go:539 weedfs adds child dc1 I1117 09:40:45.371645 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.371918 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.372159 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.373353 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.373729 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.374690 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.375127 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.376111 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.376487 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.377388 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.377779 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.378711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.379310 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.380123 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.380494 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.381481 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.381911 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.382983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.383456 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.384178 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.384353 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.384839 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.385040 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.385342 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.385213 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.385515 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.385729 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.385878 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.385770 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.386207 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.386379 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.386166 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.386643 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.386816 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.386661 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.387086 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.387249 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.387680 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.388213 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.388398 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.388948 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.389487 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.389672 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.390220 node.go:539 weedfs adds child dc1 I1117 09:40:45.390548 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.390850 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.391091 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.392070 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.392321 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.393259 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.393621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.394236 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.394553 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.395133 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.395567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.396118 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.396319 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.397269 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.397629 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.398406 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.398768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.399533 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.400004 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.400810 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.401356 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.401548 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.400796 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.401412 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.401790 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.401934 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.401890 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.402264 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.402665 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.402507 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.402532 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.402953 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.403389 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.401999 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.403196 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.403672 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.404529 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.404803 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.405045 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.405362 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.405547 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.405773 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.405913 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.406332 node.go:539 weedfs adds child dc1 I1117 09:40:45.406539 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.406991 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.407277 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.408145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.408465 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.409232 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.409473 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.411082 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.411362 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.411985 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.412316 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.412874 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.413056 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.413878 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.414089 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.415221 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.415416 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.416147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.416495 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.417208 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.417774 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.417934 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.418347 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.418963 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.420046 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.420097 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.420559 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.420645 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.419543 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.422738 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.422934 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.423172 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.423316 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.423500 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.423643 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.423849 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.423981 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.424165 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.424315 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.424514 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.424651 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.424827 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.424960 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.425638 node.go:539 weedfs adds child dc1 I1117 09:40:45.425895 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.426256 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.426878 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.428685 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.429104 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.430856 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.431400 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.432427 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.432641 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.440422 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.440781 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.442687 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.443256 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.445066 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.445631 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.446385 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.446610 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.447399 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.447602 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.448362 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.448962 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.449150 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.450201 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.450744 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.450931 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.450890 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.451451 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.451639 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.451352 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.451904 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.452061 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.451873 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.452341 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.452513 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.452330 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.452777 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.452945 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.452784 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.463545 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.463963 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.449635 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.465623 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.465834 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.466409 node.go:539 weedfs adds child dc1 I1117 09:40:45.466618 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.467101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.467400 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.468373 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.468625 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.469496 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.469729 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.476772 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.477606 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.483535 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.483906 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.489142 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.490173 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.492029 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.492257 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.492862 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.495010 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.497695 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.498452 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.500954 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.502893 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.505684 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.503026 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.505942 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.506075 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.506322 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.506764 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.506929 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.507185 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.507608 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.507311 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.507338 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.507775 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.507961 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.508108 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.508290 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.508425 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.501442 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.508886 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.509037 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.503558 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.509906 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.510053 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.510534 node.go:539 weedfs adds child dc1 I1117 09:40:45.510719 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.510933 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.511127 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.511810 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.511978 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.512522 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.513208 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.514173 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.514412 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.515381 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.515758 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.516977 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.517379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.533919 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.534436 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.535426 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.535844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.540135 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.540761 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.541952 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.542779 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.543137 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.543937 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.544674 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.544654 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.545045 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.545454 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.545266 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.545612 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.546024 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.546174 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.543985 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.548217 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.548225 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.551737 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.552214 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.552551 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.546265 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.552741 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.553022 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.553173 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.553378 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.553521 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.554266 node.go:539 weedfs adds child dc1 I1117 09:40:45.554481 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.554782 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.555949 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.559501 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.559877 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.567310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.567978 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.568937 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.569150 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.569729 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.571340 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.572289 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.572704 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.573417 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.573880 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.574429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.574643 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.575551 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.575764 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.576684 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.577291 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.577020 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.577514 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.577811 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.577550 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.577967 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.577773 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.578126 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.578247 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.578394 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.578121 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.578504 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.578269 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.576836 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.578653 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.578891 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.578678 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.579110 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.579284 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.579480 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.579622 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.579804 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.579939 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.580442 node.go:539 weedfs adds child dc1 I1117 09:40:45.580634 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.580877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.581223 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.582024 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.582345 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.583353 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.583615 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.584328 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.584530 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.585038 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.585281 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.585718 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.585902 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.586498 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.587120 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.587768 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.587973 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.588824 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.589217 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.590781 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.590806 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.591366 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.591735 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.592936 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.592016 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.592099 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.592317 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.593004 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.593831 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.594083 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.594389 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.594708 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.594864 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.595070 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.595216 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.595647 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.595820 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.596217 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.596389 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.596734 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.596851 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.597040 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.597174 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.597971 node.go:539 weedfs adds child dc1 I1117 09:40:45.598162 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.598452 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.598907 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.600155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.600536 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.601920 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.602249 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.603074 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.603293 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.604216 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.604456 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.605388 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.605565 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.606123 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.606649 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.607203 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.607484 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.608238 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.608503 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.609493 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.609534 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.609498 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.610060 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.609601 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.610254 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.609459 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.610076 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.610115 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.610456 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.609522 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.610577 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.610734 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.610838 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.610997 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.611124 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.611329 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.611469 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.611652 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.611785 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.611984 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.612110 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.612307 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.612441 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.612908 node.go:539 weedfs adds child dc1 I1117 09:40:45.613277 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.614089 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.614516 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.615657 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.616490 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.617512 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.617879 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.618653 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.619219 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.620327 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.620737 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.621700 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.621914 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.622590 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.622824 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.624134 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.624568 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.625288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.625671 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.626418 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.627118 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.627455 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.628028 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.628662 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.629032 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.629496 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.629954 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.630101 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.629971 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.630471 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.630314 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.630627 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.630821 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.630948 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.630860 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.631356 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.631187 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.631521 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.631723 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.631658 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.631893 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.632079 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.632219 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.632697 node.go:539 weedfs adds child dc1 I1117 09:40:45.632878 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.633380 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.633752 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.635413 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.635853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.637347 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.637761 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.639201 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.639564 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.640533 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.640918 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.641688 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.642168 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.642985 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.643429 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.644413 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.644768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.645740 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.645941 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.647079 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.647592 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.647758 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.647060 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.647966 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.647783 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.648087 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.648237 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.648348 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.646692 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.648533 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.648280 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.648637 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.648789 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.648908 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.648559 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.648804 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.649079 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.649190 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.649008 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.649337 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.649448 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.649589 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.649705 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.651404 node.go:539 weedfs adds child dc1 I1117 09:40:45.651704 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.652571 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.652786 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.653728 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.653987 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.654786 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.655016 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.655725 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.656060 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.656974 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.657224 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.657689 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.657889 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.658437 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.658612 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.659193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.659391 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.660341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.660647 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.661335 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.661367 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.661438 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.661888 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.661329 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.662105 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.661570 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.661909 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.662314 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.662067 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.662129 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.662490 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.662697 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.662818 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.662986 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.663114 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.663277 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.663392 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.663556 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.663669 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.663857 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.663993 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.664193 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.664337 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.664861 node.go:539 weedfs adds child dc1 I1117 09:40:45.665427 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.665934 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.666180 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.667049 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.667241 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.667859 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.668084 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.668608 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.668851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.669302 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.669496 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.670028 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.670209 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.670724 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.670915 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.671371 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.671567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.672174 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.672382 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.672933 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.672978 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.673435 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.673192 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.673620 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.673499 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.673818 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.672933 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.673647 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.673970 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.673800 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.674149 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.673781 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.674265 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.674411 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.674520 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.674685 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.674789 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.674941 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.675053 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.675232 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.675355 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.675537 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.675676 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.676082 node.go:539 weedfs adds child dc1 I1117 09:40:45.676357 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.676646 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.676968 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.677854 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.678060 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.678827 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.679001 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.679649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.679860 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.680431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.680735 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.681284 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.681525 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.682180 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.682385 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.682948 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.683157 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.683877 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.684108 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.684764 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.684881 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.685408 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.684759 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.685609 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.685341 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.684761 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.685489 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.685815 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.685346 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.684791 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.685960 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.686138 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.686274 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.686470 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.686605 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.686791 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.686925 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.687107 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.687236 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.687425 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.687562 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.687756 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.687886 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.688406 node.go:539 weedfs adds child dc1 I1117 09:40:45.688620 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.688853 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.689074 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.690157 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.690427 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.691193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.691447 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.691983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.692195 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.692777 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.692985 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.693575 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.693803 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.694303 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.694574 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.695110 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.695368 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.696224 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.696443 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.697253 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.697273 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.697389 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.697754 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.697262 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.697288 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.697929 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.698126 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.697865 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.697877 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.697955 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.698272 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.698582 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.698765 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.698978 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.699124 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.699317 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.699461 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.699661 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.699818 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.700019 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.700149 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.700348 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.700482 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.701164 node.go:539 weedfs adds child dc1 I1117 09:40:45.701385 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.701700 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.701973 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.702898 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.703114 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.703894 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.704111 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.704740 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.704941 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.705481 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.705807 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.706354 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.706569 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.707321 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.707578 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.708866 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.709081 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.710131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.710376 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.711111 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.711666 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.711854 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.712289 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.712764 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.712937 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.713311 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.713391 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.713813 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.713992 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.714221 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.713936 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.714381 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.714044 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.714583 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.714738 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.714937 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.714714 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.715072 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.715265 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.715399 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.715711 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.716186 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.716360 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.716981 node.go:539 weedfs adds child dc1 I1117 09:40:45.717198 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.717459 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.717691 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.718688 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.718971 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.719644 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.720507 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.721090 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.721298 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.721913 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.722117 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.722736 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.722962 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.723518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.723786 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.724349 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.724552 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.725347 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.725644 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.726366 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.726512 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.726921 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.727096 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.726367 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.727301 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.727438 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.727143 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.727622 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.727417 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.727768 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.727941 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.727734 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.728056 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.728224 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.727973 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.728336 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.728091 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.728519 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.728690 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.728862 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.728976 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.729152 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.729272 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.729806 node.go:539 weedfs adds child dc1 I1117 09:40:45.730005 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.730261 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.730496 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.731372 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.731698 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.732495 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.732783 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.733451 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.733793 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.734770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.735147 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.735798 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.736194 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.736896 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.737271 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.737961 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.738287 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.739170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.739527 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.740173 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.740675 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.740848 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.741232 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.741659 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.741820 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.742084 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.742535 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.742774 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.743323 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.743791 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.743531 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.743574 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.743955 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.744164 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.744299 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.744479 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.744620 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.744191 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.744830 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.743022 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.745018 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.745263 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.745631 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.746256 node.go:539 weedfs adds child dc1 I1117 09:40:45.746433 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.746669 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.747000 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.747786 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.748107 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.748708 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.748949 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.749437 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.749629 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.750585 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.750774 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.751304 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.751481 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.751955 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.752200 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.752669 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.752888 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.753762 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.753979 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.754707 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.754821 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.755188 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.754923 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.754988 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.754858 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.755361 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.754938 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.755556 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.755221 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.755741 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.755576 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.755935 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.756067 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.756258 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.756384 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.756593 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.756729 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.756920 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.757055 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.757254 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.757391 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.757749 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.758187 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.758924 node.go:539 weedfs adds child dc1 I1117 09:40:45.759269 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.759847 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.760256 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.761275 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.761691 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.762509 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.762961 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.763568 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.763854 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.764398 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.764601 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.765288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.765489 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.767290 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.767672 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.768561 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.768772 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.769375 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.769602 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.770234 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.770760 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.770947 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.771376 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.771848 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.772221 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.772471 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.772826 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.773370 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.773034 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.773246 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.773637 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.773839 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.774090 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.774262 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.774260 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.774672 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.775090 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.775318 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.775475 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.775665 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.775793 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.775939 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.776063 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.776757 node.go:539 weedfs adds child dc1 I1117 09:40:45.776965 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.777220 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.777521 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.778933 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.779147 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.780626 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.781005 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.782058 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.782312 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.782996 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.783200 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.783880 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.784109 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.784575 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.784798 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.785274 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.785439 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.786021 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.786183 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.787044 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.787586 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.787779 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.787982 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.788551 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.788759 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.788056 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.788533 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.788587 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.788998 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.788833 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.789125 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.788814 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.789117 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.789394 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.789539 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.789731 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.789877 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.790092 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.790242 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.790836 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.790978 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.791276 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.791422 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.792158 node.go:539 weedfs adds child dc1 I1117 09:40:45.792384 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.792688 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.792932 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.793910 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.794140 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.794957 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.795147 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.795792 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.796057 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.797063 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.797313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.798181 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.798827 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.799626 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.800112 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.800741 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.800947 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.801648 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.801880 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.802588 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.802581 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.803088 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.803253 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.803451 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.803577 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.803706 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.804244 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.803954 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.804419 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.804263 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.803808 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.804603 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.804739 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.804917 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.804778 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.805053 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.804763 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.805214 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.805358 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.805547 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.805692 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.805884 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.806027 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.806434 node.go:539 weedfs adds child dc1 I1117 09:40:45.808202 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.808722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.809035 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.810048 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.810278 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.810983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.811199 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.811706 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.811989 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.812506 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.812700 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.815397 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.815753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.816504 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.816699 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.817244 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.817531 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.818096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.818366 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.820723 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.821210 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.821653 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.821469 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.821453 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.820840 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.821854 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.820880 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.821849 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.822172 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.822313 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.822211 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.822512 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.822664 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.822838 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.822991 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.823308 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.823454 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.823744 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.823883 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.824177 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.824371 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.824667 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.824814 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.825768 node.go:539 weedfs adds child dc1 I1117 09:40:45.826009 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.826273 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.826682 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.828231 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.828603 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.830316 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.830743 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.831801 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.832124 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.832768 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.833186 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.833896 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.834110 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.835003 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.835213 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.835917 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.836122 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.837045 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.837283 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.837998 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.838144 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.838023 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.838215 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.838159 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.838555 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.838779 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.838479 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.838977 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.839137 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.839331 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.839488 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.839416 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.839696 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.839944 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.840191 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.840353 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.840546 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.840693 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.840903 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.841045 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.840917 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.841441 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.841610 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.842231 node.go:539 weedfs adds child dc1 I1117 09:40:45.842407 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.842657 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.842936 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.844119 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.844409 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.845194 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.845471 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.846397 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.846595 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.847199 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.847379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.847969 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.848171 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.848647 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.848878 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.849357 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.849704 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.850743 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.851127 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.852166 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.852234 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.852166 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.852672 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.852388 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.852333 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.852584 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.852715 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.852149 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.852870 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.853296 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.853467 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.853642 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.853765 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.853922 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.854034 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.854197 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.854308 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.854463 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.854574 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.854730 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.854842 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.854991 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.855104 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.855533 node.go:539 weedfs adds child dc1 I1117 09:40:45.855702 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.855891 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.856091 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.856829 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.856995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.857516 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.857681 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.858128 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.858345 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.858829 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.859134 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.859646 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.859850 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.860462 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.860640 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.861116 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.861275 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.861924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.862142 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.862807 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.862781 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.862926 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.863307 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.862835 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.863497 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.862804 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.863376 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.863431 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.863719 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.863584 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.863960 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.864172 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.864330 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.864534 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.864668 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.864864 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.865001 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.865193 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.865324 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.865553 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.865689 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.865876 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.866186 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.866731 node.go:539 weedfs adds child dc1 I1117 09:40:45.866964 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.867209 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.867503 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.868341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.868553 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.869204 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.869401 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.870372 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.870719 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.871302 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.871649 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.872233 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.872438 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.873167 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.873371 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.873983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.874183 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.875101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.875402 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.876172 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.876170 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.876183 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.876704 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.876271 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.876891 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.876140 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.876769 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.877113 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.876747 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.877275 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.877472 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.876060 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.877611 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.877897 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.878077 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.878283 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.878431 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.878633 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.878774 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.878962 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.879098 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.879291 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.879430 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.879944 node.go:539 weedfs adds child dc1 I1117 09:40:45.880220 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.880475 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.880722 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.881633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.881884 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.883085 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.883424 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.884159 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.884490 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.885185 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.885520 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.886170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.886724 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.887294 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.887500 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.888207 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.888471 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.889120 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.889315 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.890033 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.890575 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.890309 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.890751 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.890960 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.891119 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.891062 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.891523 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.891369 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.891698 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.891898 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.892040 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.891891 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.892305 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.892465 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.892323 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.892775 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.892946 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.892707 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.893392 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.896502 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.896689 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.897067 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.897207 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.897734 node.go:539 weedfs adds child dc1 I1117 09:40:45.898033 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.898348 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.898568 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.899534 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.899705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.902517 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.902978 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.904414 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.904672 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.905186 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.905457 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.905947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.906137 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.907544 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.907980 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.908810 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.909046 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.909673 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.910064 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.910717 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.910758 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.911290 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.910983 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.910788 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.911478 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.910766 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.911321 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.911321 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.911688 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.911989 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.911418 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.912186 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.913109 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.913348 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.913522 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.913716 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.913853 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.914046 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.914199 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.914381 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.914515 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.914707 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.914838 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.915404 node.go:539 weedfs adds child dc1 I1117 09:40:45.915630 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.915887 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.916181 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.918135 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.918432 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.919086 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.919340 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.919919 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.920125 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.920757 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.920956 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.921560 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.921997 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.922701 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.923180 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.923784 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.924015 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.924895 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.925100 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.926190 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.926293 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.926308 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.926795 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.926989 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.926828 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.926910 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.926244 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.927215 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.926869 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.926974 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.927391 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.927587 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.927723 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.927916 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.928066 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.928268 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.928406 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.928592 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.928726 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.928912 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.929054 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.929246 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.929376 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.930199 node.go:539 weedfs adds child dc1 I1117 09:40:45.930390 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.930829 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.931107 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.932060 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.932291 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.932982 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.933389 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.934109 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.934386 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.934941 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.935143 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.935898 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.936101 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.936955 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.937148 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.937692 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.937992 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.938739 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.938951 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.940824 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.941357 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.941545 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.941967 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.940101 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.942454 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.942634 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.942844 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.942583 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.942690 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.942985 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.943270 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.943443 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.943230 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.943612 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.943382 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.943747 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.943915 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.944038 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.943798 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.944209 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.944331 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.944501 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.944625 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.945168 node.go:539 weedfs adds child dc1 I1117 09:40:45.945376 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.945601 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.945816 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.946866 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.947053 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.947720 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.947904 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.948450 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.948626 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.949149 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.949368 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.950939 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.951253 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.951864 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.952055 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.952722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.952909 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.953528 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.953761 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.954456 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.954959 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.955129 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.955608 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.956045 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.956207 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.956466 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.956880 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.957039 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.957282 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.957696 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.957861 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.958123 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.958559 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.958721 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.958961 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.959368 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.959526 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.959961 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.960417 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.960579 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.960808 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.961252 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.961416 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.961860 node.go:539 weedfs adds child dc1 I1117 09:40:45.962038 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.962262 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.962709 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.963512 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.963798 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.964394 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.964632 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.965317 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.965751 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.966391 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.966654 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.967248 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.967430 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.968028 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.968394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.969004 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.969388 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.969961 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.970147 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.970984 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.970990 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.971106 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.971031 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.971508 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.971052 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.970996 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.971683 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.971534 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.971534 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.971887 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.972033 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.972219 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.972342 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.972522 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.972651 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.972817 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.972956 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.973146 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.973274 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.973445 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.973567 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.973745 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.973920 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.974313 node.go:539 weedfs adds child dc1 I1117 09:40:45.974594 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.974839 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.975055 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.975959 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.976169 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.976868 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.977052 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.977644 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.977849 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.978332 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.978577 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.979233 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.979480 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.980225 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.980580 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.981164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.981421 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.981982 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.982754 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.983736 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:45.984264 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:45.984436 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:45.983741 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.984668 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.984703 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.985040 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.985270 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.985004 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:45.985095 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:45.985245 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:45.985070 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.985414 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.985804 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:45.985967 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:45.986130 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:45.986286 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:45.986673 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:45.986816 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:45.986352 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.987003 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.987136 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.987325 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.987475 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.987884 node.go:539 weedfs adds child dc1 I1117 09:40:45.988152 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:45.988459 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:45.988671 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:45.989546 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:45.989923 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:45.990678 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:45.990899 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:45.991533 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:45.991736 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:45.992237 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:45.992499 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:45.993003 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:45.993462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:45.994288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:45.994592 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:45.995371 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:45.995625 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:45.996246 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:45.996532 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:45.997189 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:45.997694 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:45.997870 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:45.998267 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:45.998758 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:45.998641 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:45.998979 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:45.999298 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:45.999197 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:45.999479 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:45.999667 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:45.999810 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:45.999703 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.000141 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.000309 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.000070 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.000517 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.000679 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.000590 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.001086 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.001257 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.000917 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.002460 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.002682 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.003297 node.go:539 weedfs adds child dc1 I1117 09:40:46.003642 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.003949 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.004188 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.006313 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.007218 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.009395 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.009830 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.010763 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.011000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.012312 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.012950 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.014069 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.014895 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.015747 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.016062 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.016670 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.016871 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.017635 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.017859 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.018969 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.019798 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.018973 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.019580 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.020154 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.019093 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.019099 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.019607 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.019805 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.020248 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.020900 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.021072 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.021253 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.021387 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.021558 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.021685 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.022352 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.022621 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.022901 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.023058 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.023489 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.023673 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.023883 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.024024 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.025162 node.go:539 weedfs adds child dc1 I1117 09:40:46.025607 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.026093 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.026558 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.027303 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.027569 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.028165 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.028420 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.028931 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.030042 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.031135 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.031620 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.032433 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.032616 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.033135 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.033444 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.034983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.036264 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.038583 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.039386 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.040291 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.040849 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.041026 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.041443 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.041884 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.042049 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.042956 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.043515 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.043694 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.043997 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.044468 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.044279 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.044645 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.044858 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.044988 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.044943 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.045471 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.045249 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.045640 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.045837 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.045955 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.045837 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.046280 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.047083 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.048056 node.go:539 weedfs adds child dc1 I1117 09:40:46.048344 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.048575 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.048797 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.050321 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.050582 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.051783 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.052065 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.053140 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.053464 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.054278 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.054649 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.055458 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.056317 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.057016 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.057290 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.057863 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.058050 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.058811 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.059054 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.060122 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.060652 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.060827 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.061301 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.061756 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.061921 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.062426 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.063284 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.063759 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.063928 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.059713 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.064387 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.064173 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.064577 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.064693 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.065133 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.064965 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.065295 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.065476 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.065653 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.066073 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.066235 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.066447 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.066602 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.067077 node.go:539 weedfs adds child dc1 I1117 09:40:46.073663 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.074035 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.074481 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.075441 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.075843 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.078412 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.078701 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.079371 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.079799 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.081163 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.081380 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.082767 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.082977 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.084441 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.084691 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.086483 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.086765 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.088440 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.089851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.092330 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.096999 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.097227 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.091193 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.097528 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.097686 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.093342 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.097931 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.098091 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.093889 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.098318 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.098543 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.094539 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.098800 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.098940 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.095089 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.099164 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.099296 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.095618 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.099513 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.099642 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.096157 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.101086 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.101479 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.102149 node.go:539 weedfs adds child dc1 I1117 09:40:46.102347 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.102626 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.103011 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.103839 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.104157 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.104811 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.105070 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.105662 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.105877 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.108728 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.109212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.110734 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.110948 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.112472 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.113016 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.114547 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.114874 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.116179 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.116423 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.117253 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.117823 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.118020 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.118324 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.118809 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.118988 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.120030 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.120536 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.119411 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.120721 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.120949 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.121120 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.121107 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.121586 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.121404 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.121758 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.121967 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.122123 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.121997 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.122456 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.122633 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.122374 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.122827 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.122993 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.123520 node.go:539 weedfs adds child dc1 I1117 09:40:46.123827 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.124101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.124358 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.125306 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.125783 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.126654 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.126995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.127786 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.128154 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.128872 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.129287 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.129991 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.130339 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.131218 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.131409 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.132014 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.132233 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.132817 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.133277 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.134111 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.134829 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.135167 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.134885 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.135724 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.135577 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.135473 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.136049 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.136431 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.136583 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.136839 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.134113 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.137281 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.136025 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.137466 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.137649 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.138007 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.138216 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.138460 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.138637 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.138845 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.138983 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.139194 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.139334 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.139967 node.go:539 weedfs adds child dc1 I1117 09:40:46.140176 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.140457 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.140963 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.141949 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.142208 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.143047 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.145243 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.147077 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.147672 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.148976 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.149209 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.151686 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.152124 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.153823 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.154226 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.155619 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.155995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.157689 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.157937 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.158687 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.158773 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.159284 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.159478 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.159323 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.159691 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.159456 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.159842 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.158713 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.159598 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.160056 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.159929 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.159983 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.160249 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.160617 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.160805 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.161711 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.161843 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.162018 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.162300 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.162494 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.162633 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.162827 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.162968 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.163447 node.go:539 weedfs adds child dc1 I1117 09:40:46.163804 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.164083 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.164288 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.165323 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.165525 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.166187 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.166369 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.167781 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.168028 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.169365 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.169682 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.170806 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.170981 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.171510 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.171681 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.172246 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.172409 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.172897 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.173726 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.174371 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.174886 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.174588 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.175074 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.175394 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.175297 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.175562 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.175852 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.176026 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.175789 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.176248 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.176434 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.176265 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.176657 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.176798 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.176709 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.177183 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.176813 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.177021 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.177363 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.177540 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.177694 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.177867 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.177976 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.178492 node.go:539 weedfs adds child dc1 I1117 09:40:46.178789 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.179365 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.179808 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.180894 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.181217 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.182221 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.182446 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.183052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.183571 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.184212 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.184424 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.185282 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.185484 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.186736 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.187125 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.188151 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.188478 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.189184 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.189552 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.191063 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.192350 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.191120 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.191742 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.191825 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.191964 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.190363 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.192156 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.193205 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.194622 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.194979 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.195498 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.195932 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.196299 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.196756 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.197103 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.197512 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.198153 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.198675 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.198840 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.199036 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.199243 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.199447 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.199586 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.200457 node.go:539 weedfs adds child dc1 I1117 09:40:46.200889 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.201397 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.202036 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.202979 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.203497 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.204808 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.205785 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.207284 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.207637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.208946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.209159 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.210239 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.210863 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.212470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.212898 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.214141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.214455 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.215125 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.215334 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.216661 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.217201 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.217449 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.217740 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.218219 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.218397 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.218832 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.219296 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.219470 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.216217 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.220163 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.220321 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.220568 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.220635 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.220966 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.221234 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.221192 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.221444 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.221624 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.221822 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.221971 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.222883 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.223380 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.223563 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.224198 node.go:539 weedfs adds child dc1 I1117 09:40:46.224509 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.224800 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.225045 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.226523 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.226781 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.228520 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.228898 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.230409 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.230913 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.232122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.232477 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.234006 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.234369 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.235132 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.235373 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.235951 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.236265 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.236936 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.237147 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.237928 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.240083 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.240497 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.240716 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.238628 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.240328 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.239377 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.240978 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.241162 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.240903 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.240873 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.241378 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.240855 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.241531 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.241722 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.241858 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.242060 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.242202 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.242508 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.242656 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.242876 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.243027 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.243222 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.243375 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.244034 node.go:539 weedfs adds child dc1 I1117 09:40:46.244233 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.244493 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.245083 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.246259 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.246591 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.247402 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.247675 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.248216 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.248418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.249031 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.249214 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.250318 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.250894 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.251643 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.251953 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.252569 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.252832 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.254100 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.254353 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.256392 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.256491 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.257005 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.257335 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.257123 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.257632 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.257777 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.258002 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.257763 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.258162 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.258364 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.258502 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.258345 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.255719 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.258825 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.259024 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.258809 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.259225 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.259369 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.259178 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.259564 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.260513 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.260728 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.260870 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.261476 node.go:539 weedfs adds child dc1 I1117 09:40:46.261722 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.262006 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.262333 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.263297 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.263516 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.264508 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.264734 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.265452 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.265653 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.266456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.266675 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.267330 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.267624 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.268192 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.268452 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.268972 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.269173 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.269945 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.270205 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.271379 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.271900 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.271681 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.271715 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.272102 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.272387 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.272549 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.272261 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.271777 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.272382 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.272352 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.272735 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.272903 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.273138 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.273372 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.273576 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.273705 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.273890 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.274019 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.274197 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.274323 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.271237 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.275076 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.275260 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.275799 node.go:539 weedfs adds child dc1 I1117 09:40:46.275963 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.276174 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.276589 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.277395 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.277817 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.278556 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.278887 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.279711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.280850 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.282129 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.282339 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.283735 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.284001 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.285582 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.286006 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.287179 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.287496 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.288204 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.288394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.289104 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.289639 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.290021 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.290810 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.291417 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.291709 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.291554 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.291856 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.292058 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.292194 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.292396 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.292212 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.292549 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.292744 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.292893 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.293319 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.293432 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.293813 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.292792 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.293989 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.294281 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.294462 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.294666 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.294833 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.295509 node.go:539 weedfs adds child dc1 I1117 09:40:46.295740 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.296301 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.297034 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.298785 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.299295 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.300182 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.300538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.301400 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.301600 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.302344 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.302712 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.303532 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.303772 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.304315 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.304597 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.305159 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.305442 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.306266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.306461 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.307073 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.307234 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.307604 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.307244 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.307386 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.307786 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.307617 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.307073 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.308004 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.307339 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.307826 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.308172 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.308332 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.308469 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.308634 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.308761 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.308952 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.309088 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.309267 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.309377 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.309572 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.309686 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.310406 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.310557 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.311163 node.go:539 weedfs adds child dc1 I1117 09:40:46.311408 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.311675 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.311927 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.313000 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.315246 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.316876 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.317118 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.317862 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.318074 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.318711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.319005 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.321176 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.321891 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.323557 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.323786 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.325529 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.325768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.326729 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.326970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.327662 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.328223 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.330565 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.328689 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.330990 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.331121 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.328750 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.331346 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.331541 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.328828 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.331787 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.331923 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.329226 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.329335 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.329687 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.329939 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.332226 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.332556 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.332766 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.332921 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.333122 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.333264 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.333473 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.333710 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.334204 node.go:539 weedfs adds child dc1 I1117 09:40:46.334407 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.334843 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.335205 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.336425 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.336681 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.337479 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.337720 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.338370 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.338677 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.340916 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.341178 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.341943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.342155 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.342908 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.343225 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.343874 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.344196 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.344995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.345270 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.346889 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.348579 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.348947 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.349482 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.349852 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.347572 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.347694 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.348075 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.348224 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.347012 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.348495 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.350593 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.350874 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.351032 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.351254 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.351392 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.351581 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.351709 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.351914 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.352050 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.352238 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.352368 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.352572 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.352708 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.353689 node.go:539 weedfs adds child dc1 I1117 09:40:46.353921 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.354420 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.354773 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.355811 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.356281 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.357498 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.357812 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.358459 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.358776 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.359446 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.359646 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.360462 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.360665 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.361345 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.361541 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.362108 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.362539 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.364460 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.364699 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.365621 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.365687 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.365733 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.366187 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.366380 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.366617 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.366344 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.366384 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.366764 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.366437 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.366506 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.366963 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.367113 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.367316 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.367455 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.367656 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.367407 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.367797 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.367980 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.368113 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.368307 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.368442 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.368980 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.369168 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.369851 node.go:539 weedfs adds child dc1 I1117 09:40:46.370082 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.370361 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.370600 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.371617 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.371872 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.373131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.373483 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.374124 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.374321 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.375048 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.375244 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.375692 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.375924 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.376355 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.377247 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.378290 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.378451 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.379571 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.379941 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.380591 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.381149 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.381345 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.381770 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.382255 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.382429 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.383171 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.383793 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.383978 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.384253 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.384730 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.384900 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.385161 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.385618 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.385783 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.386066 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.386662 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.382684 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.388490 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.388687 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.389008 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.389155 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.389463 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.389632 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.390546 node.go:539 weedfs adds child dc1 I1117 09:40:46.391053 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.391484 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.391946 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.393715 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.394124 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.395175 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.395388 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.396014 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.396287 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.396916 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.397104 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.397677 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.397998 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.398558 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.398785 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.399468 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.399655 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.402770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.403340 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.404722 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.405288 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.405472 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.405759 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.406249 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.406427 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.406694 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.407162 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.407337 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.407598 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.408037 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.408213 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.408488 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.408961 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.409135 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.409416 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.412468 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.412845 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.409998 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.410805 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.413938 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.414221 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.414546 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.414820 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.415760 node.go:539 weedfs adds child dc1 I1117 09:40:46.416095 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.416389 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.416664 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.417642 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.417853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.419380 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.419592 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.421065 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.421321 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.421927 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.422232 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.422792 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.423052 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.425563 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.425943 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.427454 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.427834 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.429548 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.429800 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.431187 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.431764 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.431955 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.432261 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.432738 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.432915 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.433202 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.433887 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.434380 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.434560 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.434840 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.435300 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.435468 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.435735 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.436181 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.436352 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.436689 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.439807 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.440180 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.440640 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.437272 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.441446 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.441929 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.442432 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.443237 node.go:539 weedfs adds child dc1 I1117 09:40:46.443656 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.444364 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.444826 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.446457 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.446913 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.448281 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.448550 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.449490 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.450615 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.452190 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.452804 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.454374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.454648 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.455266 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.455557 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.456120 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.456318 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.458817 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.459230 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.460827 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.461616 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.465762 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.462065 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.466046 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.466221 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.462650 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.466451 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.463701 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.466578 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.464231 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.464702 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.465140 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.463215 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.466745 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.467121 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.467372 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.467550 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.467758 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.467912 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.468116 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.468249 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.468465 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.468598 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.469050 node.go:539 weedfs adds child dc1 I1117 09:40:46.469368 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.469682 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.469939 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.470935 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.471380 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.472302 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.472651 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.474275 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.474705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.475477 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.477953 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.478728 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.478933 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.479605 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.479894 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.480661 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.481094 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.481868 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.482312 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.483150 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.483898 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.484243 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.483152 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.484784 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.485134 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.484495 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.485654 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.485908 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.485716 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.486383 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.486256 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.486665 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.486844 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.486985 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.485153 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.487204 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.486872 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.487341 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.483902 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.487514 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.487632 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.487778 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.487888 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.488479 node.go:539 weedfs adds child dc1 I1117 09:40:46.488720 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.488978 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.489215 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.490067 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.490538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.491558 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.491763 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.492440 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.492698 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.493365 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.493582 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.494064 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.494510 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.495101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.495394 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.495997 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.496188 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.497673 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.498121 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.499498 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.499932 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.499960 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.500280 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.500533 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.500654 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.500999 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.501035 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.501542 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.501260 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.501706 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.501870 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.502009 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.502212 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.501914 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.502332 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.502514 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.502712 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.502894 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.503458 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.503661 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.503773 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.503901 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.504013 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.504596 node.go:539 weedfs adds child dc1 I1117 09:40:46.504761 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.504997 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.505364 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.506255 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.507233 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.508709 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.509364 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.510505 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.510691 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.511792 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.512111 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.513109 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.513379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.514823 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.515236 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.516581 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.516989 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.518012 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.518215 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.519566 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.520106 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.520300 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.520729 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.521198 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.521454 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.521729 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.522204 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.523449 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.518999 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.523751 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.523896 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.522673 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.523798 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.524131 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.524280 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.524491 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.524625 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.524376 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.523252 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.524843 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.524995 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.525196 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.525340 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.525967 node.go:539 weedfs adds child dc1 I1117 09:40:46.526202 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.526603 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.526804 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.528102 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.528299 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.529535 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.529728 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.531120 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.531319 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.532765 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.533001 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.534303 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.534614 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.535478 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.535894 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.536844 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.537052 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.537933 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.538166 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.538921 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.539093 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.539346 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.539506 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.539905 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.540028 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.540571 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.541044 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.543001 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.543352 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.543594 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.543211 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.545321 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.545709 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.546745 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.548438 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.548658 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.548793 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.548987 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.549130 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.549301 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.549426 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.549598 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.550816 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.551478 node.go:539 weedfs adds child dc1 I1117 09:40:46.551908 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.552153 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.552454 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.553374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.553561 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.555091 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.555371 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.556851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.557186 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.558146 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.558322 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.558822 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.559144 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.560752 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.560930 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.562431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.562604 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.565226 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.565653 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.566995 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.567487 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.567644 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.567887 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.568279 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.568420 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.568642 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.569026 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.569169 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.569391 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.570355 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.570455 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.570665 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.571399 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.572294 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.572466 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.572690 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.572800 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.572972 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.573098 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.573375 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.573484 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.573751 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.573885 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.574630 node.go:539 weedfs adds child dc1 I1117 09:40:46.574845 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.575057 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.575334 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.576149 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.576393 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.576942 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.577154 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.577630 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.577791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.578293 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.578536 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.579028 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.579199 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.579601 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.581038 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.582484 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.582791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.583834 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.584080 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.584732 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.585207 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.585360 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.585728 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.586115 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.586268 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.586657 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.587092 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.586826 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.586881 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.587244 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.587572 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.587944 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.587450 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.588150 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.588297 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.587841 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.588481 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.588773 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.587449 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.589114 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.589632 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.590055 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.590320 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.590921 node.go:539 weedfs adds child dc1 I1117 09:40:46.591294 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.592015 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.592297 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.593189 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.593404 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.594085 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.594269 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.594795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.595164 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.595787 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.595977 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.597803 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.598379 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.599861 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.600347 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.601960 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.602402 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.603925 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.604282 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.605305 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.605822 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.605991 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.605704 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.606371 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.606254 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.606575 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.606850 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.606597 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.606997 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.607190 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.607318 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.605377 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.605804 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.607758 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.607962 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.607872 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.608195 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.608344 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.607315 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.608911 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.609046 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.609289 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.609441 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.609928 node.go:539 weedfs adds child dc1 I1117 09:40:46.610131 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.610576 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.611054 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.612139 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.612389 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.613117 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.613352 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.613916 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.614283 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.614879 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.615100 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.615907 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.616200 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.617297 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.617697 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.618438 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.619462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.620774 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.621736 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.623097 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.623919 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.624120 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.623961 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.624219 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.624512 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.624408 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.624772 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.624960 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.625086 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.625584 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.625364 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.625792 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.625912 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.626092 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.626206 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.626460 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.626609 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.626805 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.626934 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.627118 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.627308 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.627495 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.627637 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.628194 node.go:539 weedfs adds child dc1 I1117 09:40:46.628427 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.628717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.628965 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.629881 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.630088 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.630813 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.631012 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.631715 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.631985 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.632490 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.632752 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.633200 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.633528 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.635085 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.635303 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.636082 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.636284 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.637171 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.637705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.638356 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.638456 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.638487 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.638828 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.639125 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.639325 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.639072 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.639492 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.639658 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.639804 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.639611 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.639326 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.640137 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.640208 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.641196 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.641389 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.641655 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.641782 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.642040 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.642577 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.643216 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.643541 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.643941 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.644325 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.645569 node.go:539 weedfs adds child dc1 I1117 09:40:46.645936 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.646255 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.646552 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.648004 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.648232 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.649155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.649344 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.650819 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.651062 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.651923 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.652137 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.653213 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.653586 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.654501 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.654753 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.655341 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.655626 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.656330 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.656739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.657444 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.657945 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.657596 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.658131 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.657957 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.658314 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.658438 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.658643 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.658346 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.658769 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.658585 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.658916 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.659025 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.659173 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.658951 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.659295 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.657416 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.659154 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.659449 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.659570 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.659715 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.659832 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.663168 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.663317 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.663922 node.go:539 weedfs adds child dc1 I1117 09:40:46.664120 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.664359 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.664813 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.665643 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.665873 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.666432 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.666693 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.667170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.667357 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.668042 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.668970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.669547 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.669724 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.670339 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.670596 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.671082 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.671340 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.671899 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.672082 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.672707 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.673724 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.673974 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.674511 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.673684 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.675041 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.675193 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.674304 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.675362 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.675943 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.676134 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.676422 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.676573 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.676832 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.676972 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.677141 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.677281 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.677457 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.677617 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.677902 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.678041 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.675036 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.678369 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.678611 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.679074 node.go:539 weedfs adds child dc1 I1117 09:40:46.679484 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.679782 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.680029 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.680949 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.681172 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.681827 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.682013 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.699707 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.700640 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.702839 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.703935 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.705407 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.705708 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.706620 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.707030 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.708123 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.708490 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.709604 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.710541 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.711937 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.712635 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.712828 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.712478 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.713367 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.713539 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.711991 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.714050 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.713860 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.714261 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.714511 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.714082 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.713517 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.714457 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.714676 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.715539 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.715746 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.715967 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.716131 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.711905 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.716650 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.716831 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.717344 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.717982 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.728473 node.go:539 weedfs adds child dc1 I1117 09:40:46.728779 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.729098 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.729598 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.731478 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.733203 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.734503 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.735312 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.740812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.741224 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.742185 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.742407 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.743694 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.744158 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.745172 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.745721 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.746569 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.746859 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.747786 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.747994 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.748969 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.749144 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.749213 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.749681 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.749893 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.750130 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.749995 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.750294 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.750876 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.750642 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.751179 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.750538 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.750484 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.751761 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.750052 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.751939 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.752150 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.752295 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.752481 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.752598 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.752900 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.753017 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.753205 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.753666 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.754333 node.go:539 weedfs adds child dc1 I1117 09:40:46.754505 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.754757 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.754973 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.756070 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.756398 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.757283 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.757480 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.758234 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.758421 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.759477 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.759667 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.760358 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.760578 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.761247 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.761542 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.762067 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.762283 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.762967 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.763178 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.764639 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.764974 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.765476 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.766010 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.766040 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.764853 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.765464 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.765902 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.766342 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.766705 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.767000 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.767289 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.767495 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.767636 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.767822 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.767948 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.768134 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.768264 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.768433 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.768572 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.768764 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.768889 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.769071 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.769204 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.769781 node.go:539 weedfs adds child dc1 I1117 09:40:46.769980 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.770437 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.770748 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.771759 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.771996 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.772759 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.772995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.773973 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.774883 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.776285 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.776899 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.778352 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.778900 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.780196 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.780460 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.781067 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.781386 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.782212 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.782496 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.783243 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.783244 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.783793 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.783984 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.783793 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.784195 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.783912 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.784356 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.783248 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.784531 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.784334 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.784675 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.784392 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.784928 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.785106 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.785297 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.784983 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.785428 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.785605 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.785735 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.785994 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.786121 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.786287 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.786425 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.786896 node.go:539 weedfs adds child dc1 I1117 09:40:46.787068 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.787369 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.787791 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.788642 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.789000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.792407 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.792762 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.793552 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.793866 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.794470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.794679 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.795369 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.795635 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.796314 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.796607 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.797257 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.797572 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.800781 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.801046 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.802580 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.803081 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.803242 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.803166 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.803652 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.803402 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.803483 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.803810 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.804000 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.804138 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.803978 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.803983 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.804290 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.804411 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.804561 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.804438 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.804493 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.804673 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.805182 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.805346 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.805514 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.805650 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.805811 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.805935 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.806704 node.go:539 weedfs adds child dc1 I1117 09:40:46.806877 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.807141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.807519 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.808415 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.808759 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.809425 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.809703 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.810552 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.810864 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.811669 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.811865 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.812463 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.812645 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.813151 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.813685 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.814523 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.815053 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.815742 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.815942 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.816655 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.817456 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.817262 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.817291 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.817425 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.816709 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.816669 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.817689 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.817846 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.818195 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.816741 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.819238 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.819567 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.819729 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.820036 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.820181 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.820479 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.820619 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.820907 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.821203 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.821654 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.821932 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.822425 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.822908 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.823755 node.go:539 weedfs adds child dc1 I1117 09:40:46.824424 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.824973 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.825452 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.826602 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.826828 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.827633 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.827846 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.828675 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.828921 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.829515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.831517 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.833299 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.833852 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.834506 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.834873 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.835486 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.835790 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.837717 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.838131 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.839856 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.840498 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.840704 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.841012 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.841506 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.841686 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.841964 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.842439 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.842621 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.843508 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.844063 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.844248 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.844550 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.845035 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.845213 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.845532 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.846000 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.846174 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.846579 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.847111 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.847295 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.842915 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.848996 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.849239 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.850065 node.go:539 weedfs adds child dc1 I1117 09:40:46.850719 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.851250 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.851500 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.853481 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.853741 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.854612 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.854819 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.855621 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.855880 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.857631 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.858188 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.859223 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.859441 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.860303 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.860598 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.861261 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.861467 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.862158 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.862485 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.863672 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.863845 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.864344 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.864539 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.864775 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.864553 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.864922 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.865106 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.865238 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.864971 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.865522 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.865288 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.865715 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.865516 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.865929 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.866102 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.865884 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.866287 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.866738 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.867213 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.868466 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.868797 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.869013 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.869158 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.869630 node.go:539 weedfs adds child dc1 I1117 09:40:46.869997 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.870364 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.870606 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.871772 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.872140 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.873254 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.873693 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.874625 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.874868 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.875447 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.875768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.876371 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.876587 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.877632 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.878055 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.878920 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.879306 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.880267 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.880721 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.881653 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.882216 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.882411 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.882893 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.883431 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.883617 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.883397 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.883960 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.884168 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.883888 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.884383 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.884562 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.884633 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.884835 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.885148 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.885342 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.885601 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.885746 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.885555 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.886010 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.886181 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.886174 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.888173 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.888360 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.889019 node.go:539 weedfs adds child dc1 I1117 09:40:46.889502 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.889943 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.890686 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.891697 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.891905 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.892876 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.893768 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.894663 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.895039 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.895766 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.895981 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.896486 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.896791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.897757 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.898108 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.898635 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.898836 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.899615 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.900990 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.902724 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.903599 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.903782 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.903675 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.904219 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.904058 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.904405 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.904619 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.904793 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.904623 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.905075 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.905247 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.905080 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.905546 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.905496 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.906649 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.907571 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.907835 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.906199 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.907995 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.908197 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.908339 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.908548 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.908784 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.909268 node.go:539 weedfs adds child dc1 I1117 09:40:46.909466 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.910804 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.911412 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.912611 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.912965 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.913747 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.914048 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.914637 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.914896 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.915438 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.915638 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.916337 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.917888 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.918741 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.919193 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.920155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.920393 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.921122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.921320 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.922072 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.922633 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.922827 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.922519 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.923044 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.923237 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.923118 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.923569 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.923715 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.923510 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.923979 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.924149 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.923941 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.924316 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.924458 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.924526 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.925012 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.925196 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.922045 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.925794 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.925970 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.925698 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.926220 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.926360 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.926942 node.go:539 weedfs adds child dc1 I1117 09:40:46.927167 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.927585 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.927825 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.928860 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.929065 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.929930 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.930135 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.931623 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.931929 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.932522 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.932846 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.934275 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.934478 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.935296 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.935506 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.936142 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.936338 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.937017 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.938411 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.939220 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.939293 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.939800 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.939995 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.940229 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.940419 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.939940 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.940648 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.940477 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.940803 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.941087 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.941225 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.941051 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.941520 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.941701 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.941492 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.941944 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.942121 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.941980 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.942441 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.942618 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.942380 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.942830 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.946693 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.947452 node.go:539 weedfs adds child dc1 I1117 09:40:46.947742 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.948022 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.948294 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.949262 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.949791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.950888 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.951104 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.951824 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.952018 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.952691 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.952881 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.953663 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.954280 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.954889 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.955090 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.955812 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.956097 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.957064 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.957262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.957961 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.958058 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.958505 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.958690 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.958905 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.958745 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.959054 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.959333 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.959314 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.959957 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.960511 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.960411 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.960702 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.960993 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.961172 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.960936 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.961408 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.961573 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.959895 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.961434 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.961789 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.961928 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.962128 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.962263 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.962808 node.go:539 weedfs adds child dc1 I1117 09:40:46.962986 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.963242 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.963934 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.964857 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.965171 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.965919 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.966191 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.967462 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.967684 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.968530 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.968727 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.969432 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.969750 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.970336 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.970638 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.971544 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.971755 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.972682 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.972874 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.973848 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.973907 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.974419 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.974636 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.974443 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.974549 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.973907 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.974860 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.975101 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.974998 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.975322 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.975459 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.975648 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.975793 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.975975 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.975723 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.976099 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.976271 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.974488 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.976948 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.977142 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.977279 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.977466 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.977597 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.978007 node.go:539 weedfs adds child dc1 I1117 09:40:46.978195 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.978605 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.978871 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.979867 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.980264 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.981390 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.981612 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:46.982526 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:46.982824 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:46.983389 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:46.983594 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:46.984423 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:46.985076 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:46.985780 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:46.986025 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:46.987119 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:46.987434 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:46.988140 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:46.988401 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:46.989087 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:46.989213 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:46.989642 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:46.989834 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:46.989108 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:46.991204 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:46.991393 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:46.991260 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:46.991684 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:46.989887 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:46.991857 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:46.989672 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:46.990120 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:46.990181 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:46.992040 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:46.992180 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:46.992349 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:46.992473 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:46.992653 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:46.992769 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:46.992935 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:46.993059 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:46.993243 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:46.993367 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:46.994114 node.go:539 weedfs adds child dc1 I1117 09:40:46.994343 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:46.994683 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:46.994915 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:46.996074 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:46.996993 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:46.998555 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:46.998855 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.000310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.000511 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.001855 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.002060 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.003408 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.003643 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.005096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.005490 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.006783 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.007055 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.008380 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.008736 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.009636 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.011204 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.011047 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.011447 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.011748 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.011593 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.011995 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.012256 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.012120 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.012406 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.012729 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.012631 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.012947 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.013140 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.013344 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.010363 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.013570 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.013311 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.013711 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.013896 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.014036 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.020324 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.021068 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.021289 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.022026 node.go:539 weedfs adds child dc1 I1117 09:40:47.022280 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.022542 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.022858 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.026920 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.027285 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.030964 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.031339 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.031968 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.032163 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.032843 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.033052 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.038091 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.038306 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.038863 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.039171 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.039661 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.039853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.041878 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.042851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.043992 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.044762 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.045201 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.045669 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.046236 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.046420 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.046640 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.046716 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.047148 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.047327 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.047569 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.047301 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.047707 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.047877 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.048005 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.047892 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.048361 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.048538 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.048390 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.048811 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.048970 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.048837 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.049295 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.049470 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.050397 node.go:539 weedfs adds child dc1 I1117 09:40:47.050825 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.051499 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.051935 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.053775 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.054208 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.056344 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.056655 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.057315 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.057610 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.058272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.058487 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.059249 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.059452 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.060483 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.060800 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.061358 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.061747 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.062468 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.062682 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.064367 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.065116 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.065064 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.065854 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.065965 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.066381 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.066855 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.068865 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.069114 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.069271 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.066532 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.066895 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.069718 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.069912 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.070097 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.070241 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.070418 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.070545 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.070705 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.070838 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.071003 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.071131 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.071288 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.071412 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.072769 node.go:539 weedfs adds child dc1 I1117 09:40:47.073208 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.075602 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.076194 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.077517 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.077840 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.078472 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.078727 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.079232 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.079428 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.081179 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.081495 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.082684 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.082883 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.083470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.083708 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.084294 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.084503 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.086415 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.086886 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.088148 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.088881 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.091600 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.092103 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.092592 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.089963 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.090484 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.090990 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.091493 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.089299 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.092748 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.093386 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.093585 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.093307 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.093798 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.093940 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.094132 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.094265 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.094475 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.094608 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.094798 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.094931 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.095121 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.095254 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.095848 node.go:539 weedfs adds child dc1 I1117 09:40:47.096091 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.096756 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.097021 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.098355 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.098778 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.099634 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.099941 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.100774 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.101014 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.101728 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.101967 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.102605 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.102897 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.103584 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.103872 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.104543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.104745 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.105546 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.105777 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.106478 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.106544 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.106483 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.106596 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.106964 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.106614 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.107123 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.106591 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.107296 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.107411 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.107146 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.107216 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.107602 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.107776 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.108031 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.108200 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.108403 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.108551 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.108759 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.108902 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.109107 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.109253 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.109447 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.109583 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.110413 node.go:539 weedfs adds child dc1 I1117 09:40:47.110826 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.111257 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.111650 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.113052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.113707 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.114871 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.115245 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.116131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.116507 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.117347 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.117709 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.118589 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.118979 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.120051 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.120640 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.121428 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.121617 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.123236 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.123458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.124155 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.124656 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.124815 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.124585 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.125126 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.125310 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.126201 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.127022 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.127840 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.127578 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.128108 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.128295 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.128066 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.128494 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.131225 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.127574 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.131490 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.131638 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.128596 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.131816 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.131935 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.128980 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.132105 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.132223 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.134773 node.go:539 weedfs adds child dc1 I1117 09:40:47.135047 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.135353 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.135735 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.137548 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.137885 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.138515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.139082 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.139858 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.140282 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.141132 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.141324 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.142613 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.142821 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.143794 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.144133 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.144923 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.145232 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.145911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.146098 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.147783 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.148730 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.148824 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.149221 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.149492 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.149922 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.150148 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.150288 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.150114 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.150472 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.150209 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.149399 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.150620 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.150816 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.150962 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.151132 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.151275 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.150827 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.151456 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.151590 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.151762 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.151875 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.152042 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.152146 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.152686 node.go:539 weedfs adds child dc1 I1117 09:40:47.152880 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.153123 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.153421 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.154351 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.154544 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.155308 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.155595 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.156295 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.156777 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.157675 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.157883 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.158798 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.159197 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.160455 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.161128 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.161912 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.162122 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.162837 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.163035 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.163706 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.163784 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.164252 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.164443 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.164675 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.164452 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.165206 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.165034 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.165033 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.165461 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.165617 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.165794 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.165567 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.165639 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.165942 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.165510 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.166140 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.166276 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.166460 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.166599 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.166781 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.166913 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.167076 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.167258 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.167789 node.go:539 weedfs adds child dc1 I1117 09:40:47.167950 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.168170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.168368 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.169507 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.169825 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.170572 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.170889 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.171487 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.171694 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.172310 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.172500 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.173403 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.173794 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.174923 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.175211 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.175656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.175854 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.176521 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.176685 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.177737 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.177752 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.178231 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.178391 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.178575 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.178703 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.178416 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.178899 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.179087 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.178925 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.179039 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.179017 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.179412 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.178967 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.179582 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.178953 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.179799 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.180163 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.180329 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.180468 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.180629 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.180743 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.180910 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.181032 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.181585 node.go:539 weedfs adds child dc1 I1117 09:40:47.181881 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.182397 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.182866 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.184103 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.184296 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.184852 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.185031 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.185475 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.185695 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.186151 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.186321 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.188557 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.188737 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.190046 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.190287 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.191464 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.191678 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.192238 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.192627 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.193386 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.194007 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.194198 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.194499 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.194957 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.195121 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.195511 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.195957 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.196120 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.196663 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.197153 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.197324 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.197589 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.198033 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.198203 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.198479 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.198924 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.199087 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.199460 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.199943 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.200111 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.200389 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.202698 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.202958 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.206713 node.go:539 weedfs adds child dc1 I1117 09:40:47.207002 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.207247 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.207538 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.209649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.209983 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.211947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.212241 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.212905 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.213943 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.215518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.215749 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.217064 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.217557 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.219275 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.219483 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.220369 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.220561 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.221231 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.221471 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.222108 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.222624 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.222807 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.223313 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.223811 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.223984 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.224391 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.224849 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.225015 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.225426 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.225862 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.226024 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.226728 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.227218 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.227387 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.227648 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.228089 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.228253 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.229245 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.229908 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.230570 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.226269 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.231104 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.231402 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.232143 node.go:539 weedfs adds child dc1 I1117 09:40:47.232464 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.232834 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.233373 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.234443 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.234827 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.235719 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.236619 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.237229 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.237442 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.238168 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.238339 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.238948 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.240433 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.241820 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.242481 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.243237 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.243479 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.244122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.244418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.245127 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.245718 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.245897 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.246662 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.247138 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.247308 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.247688 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.248112 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.248274 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.248716 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.249175 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.249342 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.250006 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.250468 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.250633 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.250894 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.251312 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.251474 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.249587 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.252883 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.253045 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.246328 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.254044 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.254375 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.255089 node.go:539 weedfs adds child dc1 I1117 09:40:47.255594 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.256026 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.256455 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.257562 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.257758 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.258445 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.258631 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.259272 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.259461 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.262071 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.262492 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.263847 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.264314 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.265713 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.266040 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.266807 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.267505 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.268784 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.269107 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.270457 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.271002 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.271184 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.272211 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.276275 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.276500 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.273174 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.276792 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.276943 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.274063 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.277187 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.277320 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.274661 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.277548 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.277698 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.275200 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.277931 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.278066 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.271494 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.278354 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.278479 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.273769 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.279026 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.279191 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.279680 node.go:539 weedfs adds child dc1 I1117 09:40:47.279909 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.280306 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.280543 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.281288 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.281473 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.282032 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.283373 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.284990 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.285600 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.287101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.287344 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.288173 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.288470 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.289131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.289313 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.291122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.291707 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.292418 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.292717 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.293960 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.294546 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.294786 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.295099 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.295606 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.295805 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.297035 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.297566 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.297756 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.299010 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.302178 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.302357 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.300509 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.302584 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.302708 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.301045 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.302903 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.303030 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.299083 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.296093 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.303251 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.304130 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.304355 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.304502 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.305049 node.go:539 weedfs adds child dc1 I1117 09:40:47.305216 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.305488 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.305949 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.308053 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.308740 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.309621 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.309924 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.310457 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.311477 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.313277 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.313806 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.314541 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.314735 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.315320 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.315618 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.316180 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.317461 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.318795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.319458 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.321030 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.323970 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.324188 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.323679 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.321959 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.322105 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.322687 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.322763 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.323238 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.324419 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.324757 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.324945 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.325117 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.325277 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.325390 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.325568 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.325678 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.325884 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.326037 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.326231 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.326666 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.326377 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.327824 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.328130 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.329122 node.go:539 weedfs adds child dc1 I1117 09:40:47.329628 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.330228 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.330693 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.332422 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.332828 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.333661 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.333925 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.334532 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.334696 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.335210 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.335565 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.336142 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.336334 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.339313 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.339976 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.340616 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.340805 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.341580 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.341812 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.342455 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.343017 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.344060 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.344467 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.344782 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.345055 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.345334 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.345588 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.345866 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.348418 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.348983 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.349159 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.349366 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.349750 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.350210 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.350484 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.350965 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.351150 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.351350 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.351493 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.351669 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.351807 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.351988 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.352123 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.352854 node.go:539 weedfs adds child dc1 I1117 09:40:47.353513 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.354038 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.354548 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.356195 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.356885 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.358795 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.359580 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.360655 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.360876 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.361621 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.361825 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.362378 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.362770 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.366671 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.367211 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.368595 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.368816 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.369569 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.369782 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.371120 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.371668 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.371864 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.371770 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.372309 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.372158 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.372495 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.372708 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.372844 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.372683 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.373161 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.373304 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.373741 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.373822 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.374310 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.374468 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.374763 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.374889 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.375131 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.375247 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.375490 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.375607 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.376197 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.376319 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.376941 node.go:539 weedfs adds child dc1 I1117 09:40:47.377259 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.377542 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.377778 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.378696 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.378986 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.379635 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.380587 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.382032 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.382370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.383028 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.383292 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.383822 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.383996 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.384546 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.384713 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.385264 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.385457 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.387145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.387592 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.388455 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.388514 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.389195 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.388638 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.389238 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.389845 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.389749 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.389844 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.390204 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.390367 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.390529 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.390545 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.391258 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.391930 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.392217 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.392351 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.392683 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.392841 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.393018 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.393151 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.393309 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.393414 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.393556 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.393665 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.394402 node.go:539 weedfs adds child dc1 I1117 09:40:47.394662 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.394952 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.395229 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.396517 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.396844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.398348 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.398681 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.399752 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.400396 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.401822 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.402435 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.403352 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.404220 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.405262 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.406199 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.407692 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.408040 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.408776 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.408989 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.410487 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.410986 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.411154 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.411579 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.411978 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.412124 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.412505 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.412939 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.413296 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.413812 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.414305 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.414803 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.415740 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.416242 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.416914 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.417065 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.417421 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.417568 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.418000 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.418198 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.418407 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.418545 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.418730 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.418871 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.419869 node.go:539 weedfs adds child dc1 I1117 09:40:47.420248 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.421131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.421386 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.422716 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.422964 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.423775 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.424015 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.424607 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.424904 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.425470 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.425713 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.426221 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.427934 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.428651 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.428921 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.429360 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.429570 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.430188 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.430381 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.431061 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.431529 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.431682 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.432030 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.432481 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.432630 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.433765 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.434194 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.434352 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.434721 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.435180 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.435357 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.435649 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.436124 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.435570 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.436289 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.437175 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.437584 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.436626 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.438237 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.438534 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.432965 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.439368 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.439687 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.440117 node.go:539 weedfs adds child dc1 I1117 09:40:47.440410 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.440680 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.440895 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.441649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.441837 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.442520 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.442706 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.444722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.445154 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.446550 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.447212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.448553 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.448797 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.449431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.449635 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.450173 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.450476 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.451111 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.451362 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.452005 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.452514 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.452667 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.453503 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.453924 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.454070 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.452932 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.454701 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.454896 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.455187 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.455286 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.455722 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.455907 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.456134 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.455920 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.456290 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.456485 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.456629 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.456432 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.456827 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.457004 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.457113 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.457757 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.458157 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.458838 node.go:539 weedfs adds child dc1 I1117 09:40:47.459123 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.459431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.459708 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.460617 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.460926 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.461522 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.461830 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.463032 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.463264 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.464638 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.464942 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.466118 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.466336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.466896 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.467262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.467851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.468048 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.469247 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.469460 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.470673 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.470827 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.471224 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.470758 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.471414 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.471628 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.471775 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.471960 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.472108 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.471488 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.472019 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.471738 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.472324 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.472078 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.472661 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.472379 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.472910 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.473109 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.473332 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.473693 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.474078 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.474409 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.474788 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.475110 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.475934 node.go:539 weedfs adds child dc1 I1117 09:40:47.476187 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.476491 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.476811 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.478028 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.478290 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.479087 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.479288 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.479924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.480127 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.480875 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.481112 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.481971 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.482248 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.482884 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.483162 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.483843 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.484049 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.484767 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.485136 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.485843 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.486064 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.486441 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.485823 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.485897 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.486643 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.486456 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.485923 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.486455 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.486871 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.487016 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.487207 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.487359 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.487061 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.487548 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.487688 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.487868 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.488008 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.488201 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.488334 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.488517 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.488653 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.488854 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.488996 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.489575 node.go:539 weedfs adds child dc1 I1117 09:40:47.490167 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.490564 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.491001 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.492543 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.492931 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.494374 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.494783 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.496032 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.496248 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.497647 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.497871 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.499511 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.499842 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.501122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.501436 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.502055 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.502356 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.503231 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.503436 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.504191 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.504323 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.504326 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.504194 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.504741 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.504936 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.504251 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.504786 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.504851 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.505155 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.504965 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.505432 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.505646 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.505803 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.505995 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.506163 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.506367 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.506521 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.506731 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.506877 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.507157 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.507293 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.507487 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.507624 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.508238 node.go:539 weedfs adds child dc1 I1117 09:40:47.508419 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.508822 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.509124 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.510606 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.510995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.511777 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.512022 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.512616 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.512969 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.513562 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.513766 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.514500 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.514702 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.515329 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.515528 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.516214 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.516457 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.517101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.517386 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.518089 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.518870 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.519363 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.518496 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.519840 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.519958 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.520002 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.520300 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.520183 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.520582 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.520804 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.520966 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.518254 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.520631 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.521171 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.521327 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.521507 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.521644 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.521823 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.521968 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.522313 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.522490 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.522720 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.522873 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.523642 node.go:539 weedfs adds child dc1 I1117 09:40:47.524053 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.524436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.524849 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.525995 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.526496 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.527474 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.527935 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.528739 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.529161 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.530007 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.530462 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.531323 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.531762 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.532385 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.532691 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.533269 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.533489 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.534428 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.534639 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.535529 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.535519 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.535596 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.535664 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.535427 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.536001 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.535802 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.536286 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.536533 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.536680 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.535398 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.536880 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.537035 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.536666 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.537232 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.537368 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.537539 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.537656 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.537803 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.537922 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.538078 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.538187 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.538329 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.538442 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.538929 node.go:539 weedfs adds child dc1 I1117 09:40:47.539131 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.539383 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.540003 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.541409 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.541692 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.543095 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.543508 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.544774 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.544986 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.546295 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.546494 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.547833 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.548100 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.548637 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.548903 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.549429 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.549634 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.551586 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.551906 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.552724 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.552871 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.552947 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.553320 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.553516 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.553806 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.553625 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.553536 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.553953 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.554019 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.554268 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.554471 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.554278 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.554664 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.554783 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.555176 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.554936 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.555299 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.555542 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.555867 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.556043 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.556163 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.556332 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.556765 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.557389 node.go:539 weedfs adds child dc1 I1117 09:40:47.557750 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.558214 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.558850 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.560087 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.560412 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.561287 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.561567 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.562193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.562601 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.563746 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.563966 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.565006 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.565215 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.566658 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.567092 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.568359 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.569060 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.570614 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.571055 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.572264 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.572546 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.572196 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.573043 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.573255 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.572428 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.572319 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.573103 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.573453 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.572457 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.573222 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.573782 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.574036 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.574187 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.574389 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.574538 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.574743 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.574888 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.575266 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.575463 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.575655 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.575810 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.576000 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.576136 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.576820 node.go:539 weedfs adds child dc1 I1117 09:40:47.577045 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.577305 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.577616 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.578558 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.578793 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.579642 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.580398 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.581321 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.581749 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.582735 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.583020 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.583612 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.583916 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.584512 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.584803 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.585433 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.585637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.586473 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.586749 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.587861 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.587944 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.588424 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.588614 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.588361 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.588440 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.588832 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.588998 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.588764 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.588650 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.589194 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.589337 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.589546 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.589677 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.589415 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.589903 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.590073 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.587482 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.590295 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.590434 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.590620 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.590754 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.591421 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.591585 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.592224 node.go:539 weedfs adds child dc1 I1117 09:40:47.592424 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.592673 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.593015 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.596300 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.596616 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.597345 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.597633 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.598126 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.598300 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.598996 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.599183 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.600361 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.600610 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.601988 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.602289 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.602998 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.603312 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.604295 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.604760 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.605957 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.606538 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.606728 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.606574 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.606412 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.606483 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.606913 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.607118 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.606115 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.606575 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.607509 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.606637 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.607735 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.607949 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.608202 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.608381 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.608564 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.608907 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.609159 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.609276 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.609511 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.609615 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.609846 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.610012 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.610621 node.go:539 weedfs adds child dc1 I1117 09:40:47.610866 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.611283 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.611550 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.612471 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.612702 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.613449 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.613680 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.614681 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.615325 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.616770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.617247 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.618434 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.618740 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.619435 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.620119 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.620969 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.621509 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.623668 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.624475 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.625783 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.625926 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.625905 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.626337 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.626541 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.626432 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.626762 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.626912 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.626680 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.626777 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.627123 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.626831 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.627258 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.627450 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.627586 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.626998 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.627841 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.628448 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.628686 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.629031 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.629471 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.629891 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.630082 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.630202 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.630898 node.go:539 weedfs adds child dc1 I1117 09:40:47.631263 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.631602 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.631872 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.632918 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.633137 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.633908 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.634120 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.635180 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.635876 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.636850 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.637370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.638684 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.638964 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.640445 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.640708 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.641976 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.642247 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.643862 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.644088 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.644721 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.645305 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.645487 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.645966 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.646477 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.646728 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.646996 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.647450 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.647620 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.647872 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.648340 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.648513 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.648779 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.649217 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.649380 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.649986 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.650461 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.650633 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.651179 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.651659 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.651836 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.649654 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.652388 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.652552 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.653094 node.go:539 weedfs adds child dc1 I1117 09:40:47.653502 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.654028 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.654287 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.655745 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.656091 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.656821 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.657017 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.657663 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.657911 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.658353 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.658608 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.659133 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.659322 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.661718 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.661898 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.663485 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.664428 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.666477 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.667222 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.668813 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.669388 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.669572 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.670010 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.670591 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.670782 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.670960 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.671244 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.671836 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.672420 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.672837 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.673100 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.673471 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.673851 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.674131 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.674341 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.674052 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.674571 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.674811 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.675081 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.675253 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.672990 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.675878 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.676088 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.677028 node.go:539 weedfs adds child dc1 I1117 09:40:47.677427 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.677859 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.678398 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.679681 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.679898 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.680550 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.681320 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.683023 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.683294 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.683878 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.684189 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.684763 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.684964 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.686725 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.687115 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.687792 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.688133 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.688924 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.689207 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.690369 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.690966 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.691335 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.691004 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.690290 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.690346 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.691514 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.690683 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.690466 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.691719 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.691904 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.692112 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.691728 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.692327 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.692524 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.692658 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.692846 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.692995 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.693386 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.693639 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.694127 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.694406 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.694727 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.695040 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.695928 node.go:539 weedfs adds child dc1 I1117 09:40:47.696423 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.696851 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.697220 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.698311 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.699179 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.701104 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.701442 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.703336 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.703800 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.704876 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.705767 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.707200 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.707700 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.708431 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.708648 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.709443 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.709652 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.711246 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.711472 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.712637 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.712749 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.712702 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.712666 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.712887 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.712978 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.713390 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.713603 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.712201 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.714140 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.714619 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.714977 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.715153 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.715318 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.715444 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.715591 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.715707 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.715868 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.715978 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.715765 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.716119 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.716234 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.716611 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.716867 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.717690 node.go:539 weedfs adds child dc1 I1117 09:40:47.717909 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.718118 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.718412 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.719544 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.720049 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.721384 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.721841 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.723137 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.723360 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.724350 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.724702 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.726955 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.727512 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.728300 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.728712 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.729482 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.729740 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.730397 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.730835 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.731561 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.732103 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.732265 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.732647 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.733553 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.733665 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.733952 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.734336 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.734342 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.734563 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.735188 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.735632 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.736057 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.736289 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.736500 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.736883 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.737289 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.737428 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.737607 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.737746 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.738111 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.738300 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.738487 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.738641 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.739631 node.go:539 weedfs adds child dc1 I1117 09:40:47.739994 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.740300 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.740536 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.741545 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.741745 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.742363 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.742529 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.743505 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.743851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.745210 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.745687 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.747031 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.747851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.748359 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.748527 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.749016 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.749176 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.750664 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.751215 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.752662 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.753199 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.753372 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.753635 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.754072 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.754231 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.754482 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.754906 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.755064 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.755330 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.755738 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.755894 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.756671 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.757170 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.757345 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.758877 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.759524 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.759709 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.760108 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.760590 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.760753 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.756137 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.761586 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.761760 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.762449 node.go:539 weedfs adds child dc1 I1117 09:40:47.762710 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.763003 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.763264 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.764291 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.764583 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.765423 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.765625 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.766231 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.767372 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.769014 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.769335 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.769925 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.770245 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.770833 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.771040 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.771651 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.771901 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.772567 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.772785 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.775326 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.775875 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.776048 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.776344 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.776786 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.776945 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.777187 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.777604 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.777763 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.777999 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.779240 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.779815 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.780347 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.781099 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.781544 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.781784 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.782059 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.782492 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.782750 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.782885 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.783056 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.783194 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.783372 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.783497 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.783992 node.go:539 weedfs adds child dc1 I1117 09:40:47.784181 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.784421 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.784777 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.785565 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.785872 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.787237 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.787513 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.788649 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.789087 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.789657 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.789913 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.791417 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.791920 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.792702 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.793796 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.794786 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.795512 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.796109 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.796369 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.796973 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.797507 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.797696 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.798109 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.798588 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.798752 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.799177 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.799621 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.799791 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.800039 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.801175 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.800180 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.800716 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.800808 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.801782 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.802418 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.802603 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.802720 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.802881 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.802995 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.803161 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.803273 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.803428 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.803540 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.804038 node.go:539 weedfs adds child dc1 I1117 09:40:47.804441 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.804744 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.805021 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.806021 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.806205 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.806875 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.807048 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.807641 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.807802 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.808361 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.808547 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.809012 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.809187 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.809617 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.810205 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.810787 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.810953 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.812117 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.812284 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.813261 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.813820 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.814010 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.813294 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.813848 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.814249 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.814410 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.814589 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.814401 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.814723 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.814898 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.815005 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.814933 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.815363 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.815220 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.815534 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.815730 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.815868 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.815678 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.816045 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.816195 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.816108 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.818060 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.818493 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.819115 node.go:539 weedfs adds child dc1 I1117 09:40:47.819369 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.819813 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.820084 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.820939 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.821152 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.821787 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.821976 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.822456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.822838 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.823617 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.824020 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.824822 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.825201 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.825902 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.826133 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.826759 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.826942 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.827522 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.827764 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.828420 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.828493 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.828583 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.828967 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.829156 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.828892 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.828980 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.829136 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.829400 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.829125 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.829654 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.829870 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.830019 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.829743 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.830213 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.830364 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.830737 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.830934 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.831137 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.831272 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.831454 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.831590 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.831769 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.831905 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.832372 node.go:539 weedfs adds child dc1 I1117 09:40:47.832556 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.833047 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.833865 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.835318 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.835717 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.837115 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.837563 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.838894 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.839343 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.839962 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.840212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.841381 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.841585 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.842206 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.842398 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.843766 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.844241 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.844884 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.845139 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.845931 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.845921 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.846477 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.845864 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.846666 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.845894 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.846495 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.846475 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.846525 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.845965 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.846962 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.847147 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.847353 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.847737 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.847943 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.848080 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.848620 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.848810 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.849014 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.849152 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.849341 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.849484 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.849656 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.849791 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.850407 node.go:539 weedfs adds child dc1 I1117 09:40:47.850679 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.850940 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.851330 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.852171 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.854345 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.856027 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.856455 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.857875 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.858262 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.859901 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.860155 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.860861 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.861064 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.861625 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.861879 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.862351 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.862528 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.864485 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.864968 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.866112 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.866656 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.866836 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.867229 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.867672 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.867833 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.868069 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.868485 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.868647 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.868885 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.869299 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.869461 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.870003 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.870494 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.870682 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.870984 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.871466 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.871646 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.871723 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.872294 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.872476 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.869704 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.873456 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.873735 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.874382 node.go:539 weedfs adds child dc1 I1117 09:40:47.874571 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.874894 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.875127 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.876145 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.876453 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.877239 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.877443 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.881816 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.882302 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.883706 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.883936 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.884832 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.885084 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.885740 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.886063 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.887912 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.888197 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.889689 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.890141 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.892062 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.892649 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.892839 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.893598 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.894188 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.894371 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.894659 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.895154 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.895333 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.895613 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.896082 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.896254 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.896622 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.897124 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.897300 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.897572 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.898027 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.898201 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.898480 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.898936 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.899108 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.899851 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.900499 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.900835 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.901764 node.go:539 weedfs adds child dc1 I1117 09:40:47.902240 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.902679 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.903109 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.904964 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.905393 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.906295 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.906498 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.907257 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.907494 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.908106 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.908530 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.909076 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.909329 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.911136 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.911608 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.913123 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.913535 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.915083 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.915440 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.916238 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.916788 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.916978 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.917399 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.917863 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.918047 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.918317 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.918775 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.918947 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.919205 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.919663 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.919986 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.920577 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.921157 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.921728 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.923117 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.923748 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.924108 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.924617 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.924953 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.925202 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.925341 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.925517 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.925656 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.926209 node.go:539 weedfs adds child dc1 I1117 09:40:47.926452 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.926715 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.927054 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.928069 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.928427 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.929109 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.929305 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.932095 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.932677 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.934227 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.934425 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.935845 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.936303 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.937715 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.938024 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.939713 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.940700 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.941592 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.941798 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.943224 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.943842 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.944026 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.944509 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.944980 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.945148 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.945545 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.945986 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.946152 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.946980 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.947165 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.947474 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.947768 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.948097 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.949188 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.949506 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.947658 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.949816 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.949951 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.948753 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.951092 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.951702 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.951910 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.952044 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.952586 node.go:539 weedfs adds child dc1 I1117 09:40:47.953540 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.954131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.954794 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.956482 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.956752 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.957614 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.957807 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.958524 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.958724 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.959355 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.959685 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.961518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.961742 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.962387 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.963627 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.964322 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.964538 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.965273 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.965589 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.967380 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.968298 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.968482 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.968995 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.969478 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.969652 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.969946 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:47.970427 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:47.970603 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:47.970870 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.971331 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.971502 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.971848 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.972311 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.972487 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.973165 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.973680 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.973853 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:47.966324 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.975526 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.975704 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.972788 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.976881 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:47.977105 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:47.977897 node.go:539 weedfs adds child dc1 I1117 09:40:47.978315 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:47.978648 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:47.978926 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:47.980662 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:47.981071 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:47.982718 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:47.982990 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:47.984661 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:47.984995 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:47.986492 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:47.986891 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:47.988535 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:47.988808 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:47.989411 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:47.989694 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:47.990227 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:47.990410 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:47.991046 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:47.991484 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:47.992091 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:47.992615 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:47.992788 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:47.993627 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:47.994109 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:47.994281 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:47.994870 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:47.995350 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:47.995522 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:47.995783 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:47.996212 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:47.996379 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:47.996783 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:47.997204 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:47.997371 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:47.997627 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:47.998278 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:47.998740 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:47.998912 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.000085 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.000472 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.000803 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.001524 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.001955 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.002585 node.go:539 weedfs adds child dc1 I1117 09:40:48.002804 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.003039 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.003431 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.044947 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.045656 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.047141 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.049729 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.063531 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.064125 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.064971 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.065339 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.071699 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.074286 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.075345 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.075585 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.076278 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.076475 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.077193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.077513 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.078257 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.078318 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.078961 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.079172 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.078361 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.078386 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.079416 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.079175 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.079591 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.079783 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.079557 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.079792 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.079919 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.079679 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.080347 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.080521 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.080715 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.080848 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.081031 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.081163 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.081555 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.081893 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.082245 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.082515 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.083258 node.go:539 weedfs adds child dc1 I1117 09:40:48.083633 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.083898 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.084153 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.085127 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.085321 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.086023 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.086217 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.087118 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.087464 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.088174 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.088629 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.089325 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.089731 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.090406 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.090725 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.091523 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.091744 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.092441 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.092643 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.093238 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.093747 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.093513 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.093927 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.094123 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.094261 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.094152 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.094547 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.094698 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.094516 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.094944 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.095104 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.094916 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.095345 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.095710 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.095698 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.096879 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.097158 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.097537 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.097777 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.098145 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.098384 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.098782 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.099026 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.099825 node.go:539 weedfs adds child dc1 I1117 09:40:48.100088 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.100330 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.100535 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.103501 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.103929 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.105125 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.105300 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.105741 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.106008 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.106456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.106675 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.107590 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.107829 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.108256 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.108426 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.112157 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.112358 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.114193 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.114369 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.116620 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.117120 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.117276 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.117511 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.117899 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.118043 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.118274 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.118679 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.118820 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.119045 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.119419 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.119561 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.120072 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.120549 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.120694 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.120925 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.121319 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.121491 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.122278 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.122769 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.122935 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.123118 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.123692 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.123889 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.124682 node.go:539 weedfs adds child dc1 I1117 09:40:48.124924 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.125205 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.125461 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.126656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.127035 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.128071 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.128433 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.129283 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.129647 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.130728 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.131123 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.131806 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.132217 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.132836 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.133138 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.133809 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.134196 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.135081 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.135280 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.135926 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.136500 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.136673 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.137208 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.137771 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.137955 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.137259 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.138181 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.137952 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.138334 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.138512 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.138643 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.138535 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.139000 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.138900 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.139183 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.139410 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.139573 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.139775 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.140259 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.140427 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.139442 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.140954 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.141189 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.141763 node.go:539 weedfs adds child dc1 I1117 09:40:48.142077 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.144029 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.144364 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.145479 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.145699 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.146395 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.147847 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.148946 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.149288 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.149885 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.150076 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.153787 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.156820 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.157671 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.157879 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.158502 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.158684 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.159274 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.159563 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.161625 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.162155 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.162333 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.163150 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.163645 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.163243 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.163820 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.164019 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.164156 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.163878 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.164022 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.164394 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.164568 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.164778 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.164916 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.164663 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.165113 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.165277 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.162598 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.165659 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.165819 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.166450 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.166942 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.167116 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.167706 node.go:539 weedfs adds child dc1 I1117 09:40:48.167937 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.168192 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.168460 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.169466 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.169671 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.174662 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.174912 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.176656 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.176861 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.178182 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.178373 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.180298 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.180539 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.181754 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.182101 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.182685 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.182888 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.183668 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.183865 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.184571 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.185360 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.185404 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.185470 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.186027 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.186136 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.186139 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.186895 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.187183 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.186599 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.187428 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.187574 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.187764 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.187900 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.188103 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.188236 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.188424 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.188555 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.188788 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.188917 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.189102 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.189235 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.189418 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.189556 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.189988 node.go:539 weedfs adds child dc1 I1117 09:40:48.190180 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.190559 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.190806 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.192061 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.192292 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.193542 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.193949 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.194973 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.195416 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.196117 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.196486 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.197350 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.197684 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.198773 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.199117 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.200025 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.200450 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.201777 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.202288 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.203449 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.203519 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.203540 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.203980 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.203594 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.204167 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.204373 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.204189 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.204515 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.204309 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.204314 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.204690 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.204951 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.205442 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.205887 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.206042 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.206236 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.206359 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.206546 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.206675 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.206860 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.207061 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.207317 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.207456 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.208117 node.go:539 weedfs adds child dc1 I1117 09:40:48.208332 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.208579 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.208811 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.209699 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.209901 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.210591 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.210890 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.211819 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.212017 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.212657 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.212863 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.214950 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.215252 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.216405 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.216607 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.217304 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.217526 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.218186 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.218375 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.218997 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.219536 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.219970 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.220702 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.221418 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.222140 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.222689 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.223314 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.223405 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.219713 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.224270 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.224756 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.225004 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.225280 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.225618 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.225889 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.226222 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.226608 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.226955 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.227228 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.227571 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.227846 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.228177 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.228457 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.229274 node.go:539 weedfs adds child dc1 I1117 09:40:48.229515 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.229770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.230132 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.230911 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.231225 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.231827 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.232065 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.232567 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.232763 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.234011 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.234436 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.235279 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.235667 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.236182 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.236529 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.237074 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.237267 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.238067 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.238272 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.238976 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.239161 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.239487 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.239689 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.239873 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.240155 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.240642 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.240876 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.241072 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.240914 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.241347 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.241557 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.241340 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.241769 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.241929 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.242168 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.242578 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.242739 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.240414 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.242941 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.243061 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.241813 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.244815 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.245175 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.245845 node.go:539 weedfs adds child dc1 I1117 09:40:48.246076 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.246317 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.246560 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.248044 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.248278 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.249213 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.249405 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.250083 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.250273 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.250865 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.251050 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.251536 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.251831 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.252343 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.252582 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.253052 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.255235 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.256012 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.256302 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.256938 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.257465 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.257647 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.258049 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.258510 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.258677 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.259067 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.259507 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.259673 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.259987 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.260164 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.260570 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.260831 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.261091 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.261661 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.261804 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.262001 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.262129 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.262404 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.262529 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.262790 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.262918 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.263215 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.263406 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.263938 node.go:539 weedfs adds child dc1 I1117 09:40:48.264367 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.264600 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.264823 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.266122 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.266515 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.268239 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.268498 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.270016 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.270442 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.271700 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.271916 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.272436 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.272705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.274233 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.274786 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.275751 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.276028 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.276716 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.276972 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.277790 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.277902 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.278307 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.278485 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.278682 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.278549 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.278836 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.279015 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.279133 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.279114 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.279497 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.279643 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.279388 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.279882 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.280105 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.280377 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.280928 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.281238 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.281565 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.281841 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.282154 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.282416 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.282735 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.283023 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.283600 node.go:539 weedfs adds child dc1 I1117 09:40:48.284006 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.284452 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.284836 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.285797 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.286242 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.287420 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.287613 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.289168 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.289534 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.290843 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.291133 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.292449 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.292791 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.294377 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.295113 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.295677 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.295864 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.296493 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.296756 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.297346 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.297862 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.298039 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.298557 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.299108 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.299282 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.299986 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.300466 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.300637 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.301047 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.301488 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.301654 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.301912 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.302343 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.302506 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.302747 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.304419 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.303307 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.305116 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.305305 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.305437 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.299682 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.306465 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.306859 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.308249 node.go:539 weedfs adds child dc1 I1117 09:40:48.308890 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.309557 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.310000 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.311540 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.311933 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.312846 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.313043 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.313617 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.313796 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.314427 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.314640 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.315105 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.316412 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.317699 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.318040 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.319328 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.319677 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.321031 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.321266 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.321913 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.322432 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.322608 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.322867 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.323317 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.323547 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.323929 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.324361 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.324523 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.324774 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.325196 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.325356 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.325611 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.326032 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.326194 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.326621 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.327067 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.327230 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.327490 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.327910 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.328072 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.328614 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.329200 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.329513 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.330296 node.go:539 weedfs adds child dc1 I1117 09:40:48.330715 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.331113 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.331635 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.332983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.333464 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.335009 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.335450 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.336826 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.337180 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.338668 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.339025 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.340369 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.340983 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.342473 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.342871 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.344183 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.344632 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.346002 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.346357 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.347897 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.348423 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.348596 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.348892 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.349336 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.349497 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.349754 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.350179 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.350339 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.351011 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.351118 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.351486 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.351653 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.351857 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.351981 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.351985 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.352439 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.352622 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.353011 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.353492 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.353658 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.350586 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.354427 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.354728 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.355432 node.go:539 weedfs adds child dc1 I1117 09:40:48.355863 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.356274 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.356826 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.358395 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.358759 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.360068 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.360780 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.362718 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.363203 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.364610 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.365128 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.366214 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.366838 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.368170 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.368828 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.369897 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.370617 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.371769 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.372570 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.373791 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.377982 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.378175 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.374398 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.378424 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.378577 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.374924 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.378796 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.378951 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.375390 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.379157 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.379339 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.375875 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.379569 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.379693 volume_layout.go:477 volume 6 does not have enough copies I1117 09:40:48.376370 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.376855 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.377346 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.381025 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.381225 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.381546 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.381824 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.382137 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.382414 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.383273 node.go:539 weedfs adds child dc1 I1117 09:40:48.383657 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.384039 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:9000 I1117 09:40:48.384486 node.go:539 weedfs:dc1:rack1:127.0.0.1:9000 adds child I1117 09:40:48.385890 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.386226 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.387155 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8081 I1117 09:40:48.387347 node.go:539 weedfs:dc1:rack1:127.0.0.1:8081 adds child I1117 09:40:48.387928 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8082 I1117 09:40:48.388110 node.go:539 weedfs:dc1:rack1:127.0.0.1:8082 adds child I1117 09:40:48.388746 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8083 I1117 09:40:48.388960 node.go:539 weedfs:dc1:rack1:127.0.0.1:8083 adds child I1117 09:40:48.389430 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8084 I1117 09:40:48.389708 node.go:539 weedfs:dc1:rack1:127.0.0.1:8084 adds child I1117 09:40:48.392131 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8085 I1117 09:40:48.392762 node.go:539 weedfs:dc1:rack1:127.0.0.1:8085 adds child I1117 09:40:48.394220 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8086 I1117 09:40:48.394565 node.go:539 weedfs:dc1:rack1:127.0.0.1:8086 adds child I1117 09:40:48.396113 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8087 I1117 09:40:48.396330 node.go:539 weedfs:dc1:rack1:127.0.0.1:8087 adds child I1117 09:40:48.396969 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8081 I1117 09:40:48.397477 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:48.397651 volume_layout.go:477 volume 2 does not have enough copies I1117 09:40:48.398047 topology.go:1124 removing volume info: Id:8, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8087 I1117 09:40:48.398581 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:40:48.398749 volume_layout.go:477 volume 8 does not have enough copies I1117 09:40:48.399004 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8086 I1117 09:40:48.399447 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:48.399608 volume_layout.go:477 volume 7 does not have enough copies I1117 09:40:48.399966 topology.go:1124 removing volume info: Id:4, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8083 I1117 09:40:48.400503 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:40:48.400673 volume_layout.go:477 volume 4 does not have enough copies I1117 09:40:48.400919 topology.go:1124 removing volume info: Id:5, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8084 I1117 09:40:48.401541 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8082 I1117 09:40:48.402122 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:40:48.402737 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:40:48.402900 volume_layout.go:477 volume 5 does not have enough copies I1117 09:40:48.403125 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:40:48.403257 volume_layout.go:477 volume 3 does not have enough copies I1117 09:40:48.403437 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:48.403569 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:48.404220 topology.go:1124 removing volume info: Id:6, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8085 I1117 09:40:48.404818 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:40:48.405125 volume_layout.go:477 volume 6 does not have enough copies --- PASS: TestConcurrentLastReplicaRemoval (10.99s) === RUN TestCollectionStatisticsMatchesAFullListing I1117 09:40:48.408343 node.go:539 stats adds child dc1 I1117 09:40:48.408719 node.go:539 stats:dc1 adds child rack1 I1117 09:40:48.409644 node.go:539 stats:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:40:48.410289 node.go:539 stats:dc1:rack1:10.0.0.1:8080 adds child I1117 09:40:48.410786 node.go:539 stats:dc1:rack1:10.0.0.1:8080 adds child ssd I1117 09:40:48.411221 node.go:539 stats:dc1:rack1 adds child 10.0.0.2:8080 I1117 09:40:48.412047 node.go:539 stats:dc1:rack1:10.0.0.2:8080 adds child I1117 09:40:48.412237 node.go:539 stats:dc1:rack1:10.0.0.2:8080 adds child ssd I1117 09:40:48.412882 node.go:539 stats:dc1:rack1 adds child 10.0.0.3:8080 I1117 09:40:48.413366 node.go:539 stats:dc1:rack1:10.0.0.3:8080 adds child I1117 09:40:48.413690 node.go:539 stats:dc1:rack1:10.0.0.3:8080 adds child ssd --- PASS: TestCollectionStatisticsMatchesAFullListing (0.04s) === RUN TestCollectionStatisticsPicksTheLargestReplica I1117 09:40:48.446176 node.go:539 stats adds child dc1 I1117 09:40:48.446630 node.go:539 stats:dc1 adds child rack1 I1117 09:40:48.447288 node.go:539 stats:dc1:rack1 adds child a I1117 09:40:48.448272 node.go:539 stats:dc1:rack1:a adds child I1117 09:40:48.448889 node.go:539 stats:dc1:rack1 adds child b I1117 09:40:48.449369 node.go:539 stats:dc1:rack1:b adds child --- PASS: TestCollectionStatisticsPicksTheLargestReplica (0.01s) === RUN TestCollectionStatisticsTakesTheLargestEcFileCount I1117 09:40:48.460279 node.go:539 stats adds child dc1 I1117 09:40:48.460993 node.go:539 stats:dc1 adds child rack1 I1117 09:40:48.461643 node.go:539 stats:dc1:rack1 adds child a I1117 09:40:48.462474 node.go:539 stats:dc1:rack1:a adds child I1117 09:40:48.463018 node.go:539 stats:dc1:rack1 adds child b I1117 09:40:48.463395 node.go:539 stats:dc1:rack1:b adds child --- PASS: TestCollectionStatisticsTakesTheLargestEcFileCount (0.01s) === RUN TestCollectionStatisticsCountsRegularAndEcTogether I1117 09:40:48.467847 node.go:539 stats adds child dc1 I1117 09:40:48.468104 node.go:539 stats:dc1 adds child rack1 I1117 09:40:48.468559 node.go:539 stats:dc1:rack1 adds child a I1117 09:40:48.469071 node.go:539 stats:dc1:rack1:a adds child --- PASS: TestCollectionStatisticsCountsRegularAndEcTogether (0.00s) === RUN TestCollectionStatisticsPicksTheReplicaHoldingTheMostLiveData I1117 09:40:48.472408 node.go:539 stats adds child dc1 I1117 09:40:48.473021 node.go:539 stats:dc1 adds child rack1 I1117 09:40:48.473611 node.go:539 stats:dc1:rack1 adds child a I1117 09:40:48.473987 node.go:539 stats:dc1:rack1:a adds child I1117 09:40:48.474498 node.go:539 stats:dc1:rack1 adds child b I1117 09:40:48.474930 node.go:539 stats:dc1:rack1:b adds child --- PASS: TestCollectionStatisticsPicksTheReplicaHoldingTheMostLiveData (0.01s) === RUN TestCollectionStatisticsDeletionsNeverExceedTheVolume I1117 09:40:48.479047 node.go:539 stats adds child dc1 I1117 09:40:48.479455 node.go:539 stats:dc1 adds child rack1 I1117 09:40:48.480031 node.go:539 stats:dc1:rack1 adds child a I1117 09:40:48.480724 node.go:539 stats:dc1:rack1:a adds child --- PASS: TestCollectionStatisticsDeletionsNeverExceedTheVolume (0.00s) === RUN TestCrowdedVolumesAreOnesThatCanTakeWrites I1117 09:40:48.485575 node.go:539 crowd adds child dc1 I1117 09:40:48.486007 node.go:539 crowd:dc1 adds child rack1 I1117 09:40:48.486476 node.go:539 crowd:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.486754 node.go:539 crowd:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.488329 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestCrowdedVolumesAreOnesThatCanTakeWrites (0.01s) === RUN TestCrowdedCountStillMatchesWritables I1117 09:40:48.495997 node.go:539 crowd adds child dc1 I1117 09:40:48.496598 node.go:539 crowd:dc1 adds child rack1 I1117 09:40:48.497210 node.go:539 crowd:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:48.497609 node.go:539 crowd:dc1:rack1:127.0.0.1:8080 adds child I1117 09:40:48.498769 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestCrowdedCountStillMatchesWritables (0.00s) === RUN TestSetVolumeCrowdedNoRaceWithGetWritableVolumeCount I1117 09:40:48.503853 volume_layout.go:1348 Volume 2 becomes crowded --- PASS: TestSetVolumeCrowdedNoRaceWithGetWritableVolumeCount (0.06s) === RUN TestSyncRefreshesEcCountsWithoutShardChange I1117 09:40:48.558477 node.go:539 weedfs adds child dc1 I1117 09:40:48.558905 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.559391 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:48.559623 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestSyncRefreshesEcCountsWithoutShardChange (0.01s) === RUN TestSyncKeepsEcCountsWhenNotReported I1117 09:40:48.566065 node.go:539 weedfs adds child dc1 I1117 09:40:48.566270 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.566516 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:48.566831 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestSyncKeepsEcCountsWhenNotReported (0.00s) === RUN TestSyncMembershipChangeCarriesNewEcCounts I1117 09:40:48.571454 node.go:539 weedfs adds child dc1 I1117 09:40:48.571670 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.571916 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:48.572117 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:40:48.573036 topology_ec.go:153 removing ec shard info:&{VolumeId:100 Collection:col DiskType: DiskId:0 ExpireAtSec:0 ShardsInfo:2:1.0 kB FileCount:1000 DeleteCount:10 EncodeTsNs:0} --- PASS: TestSyncMembershipChangeCarriesNewEcCounts (0.01s) === RUN TestIncrementalSyncRefreshesEcCounts I1117 09:40:48.580379 node.go:539 weedfs adds child dc1 I1117 09:40:48.580777 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.581108 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:48.581382 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestIncrementalSyncRefreshesEcCounts (0.00s) === RUN TestEcCountRefreshDoesNotRaceReaders I1117 09:40:48.586148 node.go:539 weedfs adds child dc1 I1117 09:40:48.586455 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:48.587761 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:48.588082 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestEcCountRefreshDoesNotRaceReaders (0.44s) === RUN TestEcShardsAcrossMultipleDisksOnSameNode I1117 09:40:49.027926 node.go:539 weedfs adds child dc1 I1117 09:40:49.028330 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.030691 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:49.031381 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestEcShardsAcrossMultipleDisksOnSameNode (0.01s) === RUN TestEcShardsAfterRestartHeartbeat I1117 09:40:49.039139 node.go:539 weedfs adds child dc1 I1117 09:40:49.039661 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.040282 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:49.040749 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestEcShardsAfterRestartHeartbeat (0.00s) === RUN TestEcShardRelocationAcrossDisksKeepsLookup I1117 09:40:49.042499 node.go:539 weedfs adds child dc1 I1117 09:40:49.042704 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.043216 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:49.043470 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:40:49.044332 topology_ec.go:153 removing ec shard info:&{VolumeId:15 Collection:c DiskType: DiskId:0 ExpireAtSec:0 ShardsInfo:3:1.0 kB FileCount:0 DeleteCount:0 EncodeTsNs:0} I1117 09:40:49.046416 topology_ec.go:153 removing ec shard info:&{VolumeId:15 Collection:c DiskType: DiskId:1 ExpireAtSec:0 ShardsInfo:5:1.0 kB FileCount:0 DeleteCount:0 EncodeTsNs:0} I1117 09:40:49.048212 topology_ec.go:153 removing ec shard info:&{VolumeId:15 Collection:c DiskType: DiskId:0 ExpireAtSec:0 ShardsInfo:5:1.0 kB FileCount:0 DeleteCount:0 EncodeTsNs:0} I1117 09:40:49.049414 topology_ec.go:153 removing ec shard info:&{VolumeId:15 Collection:c DiskType: DiskId:0 ExpireAtSec:0 ShardsInfo:7:1.0 kB FileCount:0 DeleteCount:0 EncodeTsNs:0} I1117 09:40:49.050568 topology_ec.go:153 removing ec shard info:&{VolumeId:15 Collection:c DiskType: DiskId:1 ExpireAtSec:0 ShardsInfo:7:1.0 kB FileCount:0 DeleteCount:0 EncodeTsNs:0} --- PASS: TestEcShardRelocationAcrossDisksKeepsLookup (0.01s) === RUN TestToDataNodeInfoReportsEmptyPhysicalDisks I1117 09:40:49.052387 node.go:539 weedfs adds child dc1 I1117 09:40:49.052623 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.053009 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:49.053608 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestToDataNodeInfoReportsEmptyPhysicalDisks (0.01s) === RUN TestToDataNodeInfoKeepsZeroCapacityDisk I1117 09:40:49.061803 node.go:539 weedfs adds child dc1 I1117 09:40:49.062193 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.062708 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:49.062944 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestToDataNodeInfoKeepsZeroCapacityDisk (0.00s) === RUN TestToDataNodeInfoFallsBackWhenNoCapacityReported I1117 09:40:49.065843 node.go:539 weedfs adds child dc1 I1117 09:40:49.066047 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.066571 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:49.067031 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestToDataNodeInfoFallsBackWhenNoCapacityReported (0.00s) === RUN TestNewDiskTypeFromHeartbeatDoesNotRaceReaders I1117 09:40:49.069844 node.go:539 weedfs adds child dc1 I1117 09:40:49.070127 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.070718 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.071272 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.072035 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max0 I1117 09:40:49.077319 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes0 I1117 09:40:49.078190 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec0 I1117 09:40:49.080197 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max1 I1117 09:40:49.080955 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes1 I1117 09:40:49.081501 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec1 I1117 09:40:49.082469 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max2 I1117 09:40:49.083106 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes2 I1117 09:40:49.083658 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec2 I1117 09:40:49.084512 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max3 I1117 09:40:49.085021 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes3 I1117 09:40:49.085502 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec3 I1117 09:40:49.086210 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max4 I1117 09:40:49.086867 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes4 I1117 09:40:49.087875 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec4 I1117 09:40:49.089186 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max5 I1117 09:40:49.089660 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes5 I1117 09:40:49.090110 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec5 I1117 09:40:49.090965 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max6 I1117 09:40:49.091592 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes6 I1117 09:40:49.096001 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec6 I1117 09:40:49.110419 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max7 I1117 09:40:49.111314 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes7 I1117 09:40:49.112455 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec7 I1117 09:40:49.120455 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max8 I1117 09:40:49.130141 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes8 I1117 09:40:49.140382 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec8 I1117 09:40:49.145856 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max9 I1117 09:40:49.147855 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes9 I1117 09:40:49.148545 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec9 I1117 09:40:49.150283 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max10 I1117 09:40:49.153273 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes10 I1117 09:40:49.153978 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec10 I1117 09:40:49.155322 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max11 I1117 09:40:49.156182 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes11 I1117 09:40:49.156967 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec11 I1117 09:40:49.159265 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max12 I1117 09:40:49.159988 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes12 I1117 09:40:49.160618 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec12 I1117 09:40:49.162034 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max13 I1117 09:40:49.171212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes13 I1117 09:40:49.175306 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec13 I1117 09:40:49.184342 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max14 I1117 09:40:49.189961 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes14 I1117 09:40:49.192847 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec14 I1117 09:40:49.196134 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max15 I1117 09:40:49.198236 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes15 I1117 09:40:49.209635 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec15 I1117 09:40:49.212224 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max16 I1117 09:40:49.214234 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes16 I1117 09:40:49.217167 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec16 I1117 09:40:49.218698 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max17 I1117 09:40:49.219673 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes17 I1117 09:40:49.222919 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec17 I1117 09:40:49.224402 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max18 I1117 09:40:49.225397 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes18 I1117 09:40:49.226416 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec18 I1117 09:40:49.227750 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max19 I1117 09:40:49.229198 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes19 I1117 09:40:49.230653 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec19 I1117 09:40:49.232644 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max20 I1117 09:40:49.233490 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes20 I1117 09:40:49.234432 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec20 I1117 09:40:49.235722 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max21 I1117 09:40:49.236570 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes21 I1117 09:40:49.237507 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec21 I1117 09:40:49.238901 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max22 I1117 09:40:49.239529 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes22 I1117 09:40:49.240350 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec22 I1117 09:40:49.241843 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max23 I1117 09:40:49.242578 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes23 I1117 09:40:49.243958 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec23 I1117 09:40:49.245355 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max24 I1117 09:40:49.246099 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes24 I1117 09:40:49.246704 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec24 I1117 09:40:49.247850 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max25 I1117 09:40:49.248461 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes25 I1117 09:40:49.249109 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec25 I1117 09:40:49.256649 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max26 I1117 09:40:49.257711 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes26 I1117 09:40:49.258563 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec26 I1117 09:40:49.260558 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max27 I1117 09:40:49.264705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes27 I1117 09:40:49.265388 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec27 I1117 09:40:49.267326 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max28 I1117 09:40:49.268296 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes28 I1117 09:40:49.269314 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec28 I1117 09:40:49.274853 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max29 I1117 09:40:49.275796 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes29 I1117 09:40:49.276684 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec29 I1117 09:40:49.281511 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max30 I1117 09:40:49.282317 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes30 I1117 09:40:49.283044 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec30 I1117 09:40:49.284560 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max31 I1117 09:40:49.285563 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes31 I1117 09:40:49.295571 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec31 I1117 09:40:49.297546 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max32 I1117 09:40:49.299074 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes32 I1117 09:40:49.300314 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec32 I1117 09:40:49.303176 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max33 I1117 09:40:49.304212 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes33 I1117 09:40:49.305834 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec33 I1117 09:40:49.311886 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max34 I1117 09:40:49.313130 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes34 I1117 09:40:49.320418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec34 I1117 09:40:49.333721 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max35 I1117 09:40:49.335037 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes35 I1117 09:40:49.336082 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec35 I1117 09:40:49.341526 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max36 I1117 09:40:49.342888 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes36 I1117 09:40:49.347397 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec36 I1117 09:40:49.354145 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max37 I1117 09:40:49.356575 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes37 I1117 09:40:49.357766 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec37 I1117 09:40:49.360615 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max38 I1117 09:40:49.362148 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes38 I1117 09:40:49.363375 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec38 I1117 09:40:49.365897 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max39 I1117 09:40:49.371060 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes39 I1117 09:40:49.372748 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec39 I1117 09:40:49.380318 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max40 I1117 09:40:49.381750 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes40 I1117 09:40:49.387079 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec40 I1117 09:40:49.389124 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max41 I1117 09:40:49.390426 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes41 I1117 09:40:49.391367 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec41 I1117 09:40:49.393740 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max42 I1117 09:40:49.395639 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes42 I1117 09:40:49.396289 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec42 I1117 09:40:49.398351 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max43 I1117 09:40:49.399339 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes43 I1117 09:40:49.400175 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec43 I1117 09:40:49.402049 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max44 I1117 09:40:49.402902 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes44 I1117 09:40:49.404118 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec44 I1117 09:40:49.405777 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max45 I1117 09:40:49.406786 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes45 I1117 09:40:49.408040 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec45 I1117 09:40:49.411328 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max46 I1117 09:40:49.414961 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes46 I1117 09:40:49.416761 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec46 I1117 09:40:49.419350 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max47 I1117 09:40:49.432056 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes47 I1117 09:40:49.437831 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec47 I1117 09:40:49.443949 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max48 I1117 09:40:49.445665 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes48 I1117 09:40:49.447347 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec48 I1117 09:40:49.449649 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max49 I1117 09:40:49.450689 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes49 I1117 09:40:49.452328 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec49 I1117 09:40:49.454364 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max50 I1117 09:40:49.455372 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes50 I1117 09:40:49.456691 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec50 I1117 09:40:49.459336 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max51 I1117 09:40:49.460669 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes51 I1117 09:40:49.465290 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec51 I1117 09:40:49.467825 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max52 I1117 09:40:49.469260 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes52 I1117 09:40:49.471057 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec52 I1117 09:40:49.474548 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max53 I1117 09:40:49.476072 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes53 I1117 09:40:49.477248 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec53 I1117 09:40:49.480386 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max54 I1117 09:40:49.481923 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes54 I1117 09:40:49.483585 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec54 I1117 09:40:49.485695 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max55 I1117 09:40:49.490750 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes55 I1117 09:40:49.491716 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec55 I1117 09:40:49.493833 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max56 I1117 09:40:49.495124 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes56 I1117 09:40:49.500894 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec56 I1117 09:40:49.503000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max57 I1117 09:40:49.504225 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes57 I1117 09:40:49.505715 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec57 I1117 09:40:49.509001 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max58 I1117 09:40:49.510150 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes58 I1117 09:40:49.511402 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec58 I1117 09:40:49.516697 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max59 I1117 09:40:49.518501 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes59 I1117 09:40:49.520003 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec59 I1117 09:40:49.525380 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max60 I1117 09:40:49.526641 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes60 I1117 09:40:49.528082 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec60 I1117 09:40:49.530561 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max61 I1117 09:40:49.534046 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes61 I1117 09:40:49.540424 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec61 I1117 09:40:49.542802 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max62 I1117 09:40:49.544000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes62 I1117 09:40:49.545451 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec62 I1117 09:40:49.547692 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max63 I1117 09:40:49.549144 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes63 I1117 09:40:49.550640 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec63 I1117 09:40:49.553141 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max64 I1117 09:40:49.554210 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes64 I1117 09:40:49.559888 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec64 I1117 09:40:49.563327 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max65 I1117 09:40:49.564548 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes65 I1117 09:40:49.565813 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec65 I1117 09:40:49.567960 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max66 I1117 09:40:49.569204 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes66 I1117 09:40:49.574011 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec66 I1117 09:40:49.575998 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max67 I1117 09:40:49.578000 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes67 I1117 09:40:49.578796 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec67 I1117 09:40:49.581024 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max68 I1117 09:40:49.582632 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes68 I1117 09:40:49.584427 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec68 I1117 09:40:49.587370 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max69 I1117 09:40:49.589267 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes69 I1117 09:40:49.593645 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec69 I1117 09:40:49.598202 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max70 I1117 09:40:49.600051 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes70 I1117 09:40:49.607596 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec70 I1117 09:40:49.610316 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max71 I1117 09:40:49.612074 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes71 I1117 09:40:49.614169 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec71 I1117 09:40:49.620534 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max72 I1117 09:40:49.621792 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes72 I1117 09:40:49.624037 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec72 I1117 09:40:49.626089 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max73 I1117 09:40:49.627754 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes73 I1117 09:40:49.629709 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec73 I1117 09:40:49.638741 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max74 I1117 09:40:49.641871 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes74 I1117 09:40:49.644700 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec74 I1117 09:40:49.647581 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max75 I1117 09:40:49.649090 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes75 I1117 09:40:49.650935 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec75 I1117 09:40:49.653918 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max76 I1117 09:40:49.655672 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes76 I1117 09:40:49.657470 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec76 I1117 09:40:49.660713 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max77 I1117 09:40:49.662637 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes77 I1117 09:40:49.664318 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec77 I1117 09:40:49.672418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max78 I1117 09:40:49.674006 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes78 I1117 09:40:49.676135 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec78 I1117 09:40:49.679366 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max79 I1117 09:40:49.681969 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes79 I1117 09:40:49.687251 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec79 I1117 09:40:49.692450 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max80 I1117 09:40:49.694198 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes80 I1117 09:40:49.697385 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec80 I1117 09:40:49.702739 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max81 I1117 09:40:49.703700 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes81 I1117 09:40:49.705437 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec81 I1117 09:40:49.709284 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max82 I1117 09:40:49.711464 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes82 I1117 09:40:49.717807 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec82 I1117 09:40:49.721265 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max83 I1117 09:40:49.723226 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes83 I1117 09:40:49.727193 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec83 I1117 09:40:49.734785 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max84 I1117 09:40:49.736253 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes84 I1117 09:40:49.737546 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec84 I1117 09:40:49.739844 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max85 I1117 09:40:49.741493 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes85 I1117 09:40:49.742365 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec85 I1117 09:40:49.744737 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max86 I1117 09:40:49.745618 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes86 I1117 09:40:49.747087 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec86 I1117 09:40:49.749294 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max87 I1117 09:40:49.750766 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes87 I1117 09:40:49.752145 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec87 I1117 09:40:49.754097 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max88 I1117 09:40:49.755549 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes88 I1117 09:40:49.756482 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec88 I1117 09:40:49.759109 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max89 I1117 09:40:49.760005 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes89 I1117 09:40:49.761488 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec89 I1117 09:40:49.763587 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max90 I1117 09:40:49.765210 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes90 I1117 09:40:49.766655 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec90 I1117 09:40:49.770154 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max91 I1117 09:40:49.772695 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes91 I1117 09:40:49.773778 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec91 I1117 09:40:49.777702 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max92 I1117 09:40:49.779623 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes92 I1117 09:40:49.781593 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec92 I1117 09:40:49.784132 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max93 I1117 09:40:49.785619 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes93 I1117 09:40:49.786998 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec93 I1117 09:40:49.789621 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max94 I1117 09:40:49.790994 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes94 I1117 09:40:49.792376 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec94 I1117 09:40:49.795096 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max95 I1117 09:40:49.797029 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes95 I1117 09:40:49.798484 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec95 I1117 09:40:49.800930 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max96 I1117 09:40:49.802552 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes96 I1117 09:40:49.803897 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec96 I1117 09:40:49.806340 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max97 I1117 09:40:49.807555 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes97 I1117 09:40:49.808895 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec97 I1117 09:40:49.812255 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max98 I1117 09:40:49.813873 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes98 I1117 09:40:49.815533 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec98 I1117 09:40:49.819257 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child max99 I1117 09:40:49.821152 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child bytes99 I1117 09:40:49.822553 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ec99 --- PASS: TestNewDiskTypeFromHeartbeatDoesNotRaceReaders (0.76s) === RUN TestConcurrentFirstUseOfDiskTypeSharesOneDisk I1117 09:40:49.828445 node.go:539 weedfs adds child dc1 I1117 09:40:49.828661 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.829063 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.829422 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.830705 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.832665 node.go:539 weedfs adds child dc1 I1117 09:40:49.832981 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.833347 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.833602 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.834142 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.835075 node.go:539 weedfs adds child dc1 I1117 09:40:49.835285 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.835688 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.836163 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.836762 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.838080 node.go:539 weedfs adds child dc1 I1117 09:40:49.838391 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.838767 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.839147 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.839731 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.840620 node.go:539 weedfs adds child dc1 I1117 09:40:49.840950 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.841326 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.841698 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.842441 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.843314 node.go:539 weedfs adds child dc1 I1117 09:40:49.843549 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.843932 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.844136 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.844814 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.845932 node.go:539 weedfs adds child dc1 I1117 09:40:49.846360 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.846859 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.847094 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.847587 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.848582 node.go:539 weedfs adds child dc1 I1117 09:40:49.848763 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.848994 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.849174 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.849850 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.851008 node.go:539 weedfs adds child dc1 I1117 09:40:49.851184 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.851439 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.855322 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.857099 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.866812 node.go:539 weedfs adds child dc1 I1117 09:40:49.867232 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.867586 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.867896 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.868581 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.873164 node.go:539 weedfs adds child dc1 I1117 09:40:49.873647 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.874262 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.874880 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.875774 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.880785 node.go:539 weedfs adds child dc1 I1117 09:40:49.881129 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.881420 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.881662 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.882511 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.883489 node.go:539 weedfs adds child dc1 I1117 09:40:49.883695 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.883980 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.884213 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.884900 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.885939 node.go:539 weedfs adds child dc1 I1117 09:40:49.886161 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.886452 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.886737 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.887232 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.888124 node.go:539 weedfs adds child dc1 I1117 09:40:49.888309 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.888538 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.888781 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.889546 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.890761 node.go:539 weedfs adds child dc1 I1117 09:40:49.891025 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.891311 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.891525 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.892232 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.893302 node.go:539 weedfs adds child dc1 I1117 09:40:49.893521 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.893835 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.894068 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.894770 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.895879 node.go:539 weedfs adds child dc1 I1117 09:40:49.896086 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.896437 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.896662 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.897180 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.898019 node.go:539 weedfs adds child dc1 I1117 09:40:49.898231 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.898473 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.898681 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.899324 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.900346 node.go:539 weedfs adds child dc1 I1117 09:40:49.900596 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.900908 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.901153 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.901751 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.903296 node.go:539 weedfs adds child dc1 I1117 09:40:49.903514 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.903770 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.904043 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.904593 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.905650 node.go:539 weedfs adds child dc1 I1117 09:40:49.905842 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.906101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.906333 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.907384 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.908874 node.go:539 weedfs adds child dc1 I1117 09:40:49.909053 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.909360 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.909597 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.910294 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.911885 node.go:539 weedfs adds child dc1 I1117 09:40:49.912110 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.912398 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.912647 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.913209 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.914199 node.go:539 weedfs adds child dc1 I1117 09:40:49.914393 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.914664 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.914880 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.915378 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.916316 node.go:539 weedfs adds child dc1 I1117 09:40:49.916585 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.916828 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.917074 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.917561 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.918368 node.go:539 weedfs adds child dc1 I1117 09:40:49.918564 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.918797 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.919008 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.919389 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.920188 node.go:539 weedfs adds child dc1 I1117 09:40:49.920353 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.920564 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.920825 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.921209 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.921906 node.go:539 weedfs adds child dc1 I1117 09:40:49.922061 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.922299 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.922528 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.922906 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.923725 node.go:539 weedfs adds child dc1 I1117 09:40:49.923929 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.924147 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.924352 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.924922 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.925667 node.go:539 weedfs adds child dc1 I1117 09:40:49.925845 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.926064 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.926238 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.926709 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.927677 node.go:539 weedfs adds child dc1 I1117 09:40:49.927862 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.928137 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.928344 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.928749 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.929571 node.go:539 weedfs adds child dc1 I1117 09:40:49.929755 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.929983 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.930252 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.930663 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.931416 node.go:539 weedfs adds child dc1 I1117 09:40:49.931934 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.932164 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.932373 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.933252 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.934418 node.go:539 weedfs adds child dc1 I1117 09:40:49.934592 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.935022 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.935343 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.936065 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.937565 node.go:539 weedfs adds child dc1 I1117 09:40:49.937786 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.938188 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.938440 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.939931 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.940880 node.go:539 weedfs adds child dc1 I1117 09:40:49.941108 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.941456 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.941712 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.942311 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.943269 node.go:539 weedfs adds child dc1 I1117 09:40:49.943449 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.943705 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.943945 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.944449 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.945503 node.go:539 weedfs adds child dc1 I1117 09:40:49.945731 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.946038 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.946418 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.946958 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.948245 node.go:539 weedfs adds child dc1 I1117 09:40:49.948439 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.948694 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.949074 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.949604 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.950730 node.go:539 weedfs adds child dc1 I1117 09:40:49.950928 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.951172 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.951361 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.951858 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.952750 node.go:539 weedfs adds child dc1 I1117 09:40:49.952925 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.953233 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.953555 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.954069 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.955032 node.go:539 weedfs adds child dc1 I1117 09:40:49.955283 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.955606 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.955851 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.956327 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.957184 node.go:539 weedfs adds child dc1 I1117 09:40:49.957395 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.957647 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.957881 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.958417 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.959343 node.go:539 weedfs adds child dc1 I1117 09:40:49.959559 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.959850 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.960071 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.960543 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.961822 node.go:539 weedfs adds child dc1 I1117 09:40:49.962168 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.962606 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.963219 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.963868 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.964717 node.go:539 weedfs adds child dc1 I1117 09:40:49.964903 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.965214 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.965482 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.965970 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.966877 node.go:539 weedfs adds child dc1 I1117 09:40:49.967065 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.967314 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.967623 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.968079 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.969043 node.go:539 weedfs adds child dc1 I1117 09:40:49.969219 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.969521 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.969806 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.970251 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:40:49.971100 node.go:539 weedfs adds child dc1 I1117 09:40:49.971303 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.971533 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:40:49.971726 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child hdd I1117 09:40:49.972141 node.go:539 weedfs:dc1:rack1:127.0.0.1:8080 adds child ssd --- PASS: TestConcurrentFirstUseOfDiskTypeSharesOneDisk (0.14s) === RUN TestCapacityQueriesDoNotCreateDiskTypes I1117 09:40:49.974012 node.go:539 weedfs adds child dc1 I1117 09:40:49.974204 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:49.974518 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:40:49.974941 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:40:49.975348 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.2:34534 I1117 09:40:49.975724 node.go:539 weedfs:dc1:rack1:127.0.0.2:34534 adds child ssd --- PASS: TestCapacityQueriesDoNotCreateDiskTypes (0.01s) === RUN TestDiskInfoReportsEveryVolume I1117 09:40:49.980780 node.go:539 diskinfo adds child dc1 I1117 09:40:49.981162 node.go:539 diskinfo:dc1 adds child rack1 I1117 09:40:49.981559 node.go:539 diskinfo:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:40:49.981786 node.go:539 diskinfo:dc1:rack1:10.0.0.1:8080 adds child --- PASS: TestDiskInfoReportsEveryVolume (0.00s) === RUN TestDiskInfoReportsTheDiskIdOfEcOnlyDisks I1117 09:40:49.985016 node.go:539 diskinfo adds child dc1 I1117 09:40:49.985253 node.go:539 diskinfo:dc1 adds child rack1 I1117 09:40:49.985648 node.go:539 diskinfo:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:40:49.985864 node.go:539 diskinfo:dc1:rack1:10.0.0.1:8080 adds child --- PASS: TestDiskInfoReportsTheDiskIdOfEcOnlyDisks (0.00s) === RUN TestProvisionalUpdateKeepsReportedDiskId --- PASS: TestProvisionalUpdateKeepsReportedDiskId (0.00s) === RUN TestSetVolumeReadOnlyKeepsProvisionalProtection I1117 09:40:49.989710 node.go:539 dn1 adds child I1117 09:40:49.992392 data_node.go:159 Deleting volume id: 1 --- PASS: TestSetVolumeReadOnlyKeepsProvisionalProtection (0.00s) === RUN TestDuplicateVolumeIdAcrossCollections I1117 09:40:49.993990 node.go:539 server1 adds child I1117 09:40:49.994353 node.go:539 server2 adds child E1117 09:40:50.001186 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only E1117 09:40:50.001621 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only E1117 09:40:50.004285 topology.go:942 duplicate volume id 7: server1 reports it under collection="a" rp=000 ttl= disk= but other data nodes also serve it under collection="b" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.024990 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:50.026185 volume_layout.go:1149 Volume 7 becomes unwritable --- PASS: TestDuplicateVolumeIdAcrossCollections (0.04s) === RUN TestSameLayoutReplicaIsNotDuplicate I1117 09:40:50.032053 node.go:539 server1 adds child I1117 09:40:50.032569 node.go:539 server2 adds child --- PASS: TestSameLayoutReplicaIsNotDuplicate (0.00s) === RUN TestSameLayoutReplicaWithoutTtlIsNotDuplicate I1117 09:40:50.035718 node.go:539 server1 adds child I1117 09:40:50.036135 node.go:539 server2 adds child --- PASS: TestSameLayoutReplicaWithoutTtlIsNotDuplicate (0.00s) === RUN TestSameNodeVolumeMoveIsNotDuplicate I1117 09:40:50.038231 node.go:539 server1 adds child I1117 09:40:50.039230 data_node.go:159 Deleting volume id: 7 I1117 09:40:50.039466 node.go:539 server1 adds child ssd --- PASS: TestSameNodeVolumeMoveIsNotDuplicate (0.00s) === RUN TestQuarantineReleasedWhenConflictResolves I1117 09:40:50.042173 node.go:539 server1 adds child I1117 09:40:50.042508 node.go:539 server2 adds child E1117 09:40:50.043944 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.044209 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:50.044624 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:50.045186 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:b, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from server2 --- PASS: TestQuarantineReleasedWhenConflictResolves (0.01s) === RUN TestFailedReleasePushRestoresQuarantineMark I1117 09:40:50.048976 node.go:539 server1 adds child I1117 09:40:50.049405 node.go:539 server2 adds child E1117 09:40:50.051339 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.051740 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:50.053309 volume_layout.go:1149 Volume 7 becomes unwritable E1117 09:40:50.054138 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.054813 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:b, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from server2 I1117 09:40:50.056875 volume_layout.go:1149 Volume 7 becomes unwritable --- PASS: TestFailedReleasePushRestoresQuarantineMark (0.01s) === RUN TestQuarantineKeptWhenReplicaUnreadable I1117 09:40:50.061417 node.go:539 server1 adds child I1117 09:40:50.061771 node.go:539 server2 adds child E1117 09:40:50.062865 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.063123 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:50.063316 volume_layout.go:1149 Volume 7 becomes unwritable E1117 09:40:50.063212 topology.go:942 duplicate volume id 7: server1 reports it under collection="a" rp=000 ttl= disk= but other data nodes also serve it under collection="b" rp=000 ttl= disk=; marking all copies read-only E1117 09:40:50.064341 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.064831 data_node.go:159 Deleting volume id: 7 I1117 09:40:50.065075 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:b, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from server2 --- PASS: TestQuarantineKeptWhenReplicaUnreadable (0.01s) === RUN TestStaleDuplicateReportDoesNotQuarantineSurvivor I1117 09:40:50.068838 node.go:539 server1 adds child --- PASS: TestStaleDuplicateReportDoesNotQuarantineSurvivor (0.00s) === RUN TestQuarantineSurvivesResync I1117 09:40:50.071350 node.go:539 server1 adds child I1117 09:40:50.071940 node.go:539 server2 adds child E1117 09:40:50.073048 topology.go:942 duplicate volume id 7: server1 reports it under collection="a" rp=000 ttl= disk= but other data nodes also serve it under collection="b" rp=000 ttl= disk=; marking all copies read-only E1117 09:40:50.073210 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only E1117 09:40:50.073097 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.073395 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:40:50.073612 volume_layout.go:1149 Volume 7 becomes unwritable --- PASS: TestQuarantineSurvivesResync (0.01s) === RUN TestQuarantineSurvivesReplicaRejoin I1117 09:40:50.078789 node.go:539 server1 adds child I1117 09:40:50.079475 node.go:539 server2 adds child I1117 09:40:50.079774 node.go:539 server3 adds child E1117 09:40:50.080977 topology.go:942 duplicate volume id 7: server2 reports it under collection="a" rp=001 ttl= disk= but other data nodes also serve it under collection="b" rp=001 ttl= disk=; marking all copies read-only E1117 09:40:50.081071 topology.go:942 duplicate volume id 7: server3 reports it under collection="b" rp=001 ttl= disk= but other data nodes also serve it under collection="a" rp=001 ttl= disk=; marking all copies read-only E1117 09:40:50.081079 topology.go:942 duplicate volume id 7: server1 reports it under collection="a" rp=001 ttl= disk= but other data nodes also serve it under collection="b" rp=001 ttl= disk=; marking all copies read-only I1117 09:40:50.081264 volume_layout.go:1149 Volume 7 becomes unwritable E1117 09:40:50.081274 topology.go:942 duplicate volume id 7: server3 reports it under collection="b" rp=001 ttl= disk= but other data nodes also serve it under collection="a" rp=001 ttl= disk=; marking all copies read-only I1117 09:40:50.084068 volume_layout.go:1244 Volume 7 has 1 replica, less than required 2 --- PASS: TestQuarantineSurvivesReplicaRejoin (0.01s) E1117 09:40:50.086355 topology.go:942 duplicate volume id 7: server1 reports it under collection="a" rp=001 ttl= disk= but other data nodes also serve it under collection="b" rp=001 ttl= disk=; marking all copies read-only === RUN TestReplicationChangeIsNotDuplicate I1117 09:40:50.088439 node.go:539 server1 adds child I1117 09:40:50.088909 node.go:539 server2 adds child --- PASS: TestReplicationChangeIsNotDuplicate (0.00s) === RUN TestDuplicateVolumeIdAcrossTtls I1117 09:40:50.091396 node.go:539 server1 adds child I1117 09:40:50.091699 node.go:539 server2 adds child E1117 09:40:50.092692 topology.go:942 duplicate volume id 7: server1 reports it under collection="a" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl=3d disk=; marking all copies read-only E1117 09:40:50.092768 topology.go:942 duplicate volume id 7: server2 reports it under collection="a" rp=000 ttl=3d disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.092958 volume_layout.go:1149 Volume 7 becomes unwritable E1117 09:40:50.092990 topology.go:942 duplicate volume id 7: server2 reports it under collection="a" rp=000 ttl=3d disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.093171 volume_layout.go:1149 Volume 7 becomes unwritable --- PASS: TestDuplicateVolumeIdAcrossTtls (0.00s) === RUN TestFailedWritablePushRetriedOnNextReport I1117 09:40:50.095562 node.go:539 server1 adds child I1117 09:40:50.096106 node.go:539 server2 adds child E1117 09:40:50.097091 topology.go:942 duplicate volume id 7: server2 reports it under collection="b" rp=000 ttl= disk= but other data nodes also serve it under collection="a" rp=000 ttl= disk=; marking all copies read-only I1117 09:40:50.097723 topology.go:1124 removing volume info: Id:7, Size:0, ReplicaPlacement:000, Collection:b, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from server2 I1117 09:40:50.098558 volume_layout.go:1149 Volume 7 becomes unwritable --- PASS: TestFailedWritablePushRetriedOnNextReport (0.01s) === RUN TestGrowthFreezeOnTopologyMismatch E1117 09:40:50.103818 topology.go:1638 volume growth frozen: a volume server reports topology id cluster-b but this cluster is cluster-a; the master state was rebuilt. Verify the cluster inventory, then run: volume.growth.resume I1117 09:40:50.104655 topology.go:1711 volume growth resumed by operator --- PASS: TestGrowthFreezeOnTopologyMismatch (0.00s) === RUN TestGrowthFreezeDisabled --- PASS: TestGrowthFreezeDisabled (0.00s) === RUN TestGrowthFreezeAutoRecovery E1117 09:40:50.107048 topology.go:1638 volume growth frozen: a volume server reports topology id cluster-b but this cluster is cluster-a; the master state was rebuilt. Verify the cluster inventory, then run: volume.growth.resume I1117 09:40:50.168887 topology.go:1662 volume growth unfrozen after 50ms --- PASS: TestGrowthFreezeAutoRecovery (0.06s) === RUN TestGrowthFreezeAutoRecoveryReplicates E1117 09:40:50.170888 topology.go:1638 volume growth frozen: a volume server reports topology id cluster-b but this cluster is cluster-a; the master state was rebuilt. Verify the cluster inventory, then run: volume.growth.resume I1117 09:40:50.238554 topology.go:1662 volume growth unfrozen after 50ms --- PASS: TestGrowthFreezeAutoRecoveryReplicates (0.07s) === RUN TestRepeatMismatchKeepsFreezeGeneration E1117 09:40:50.240824 topology.go:1638 volume growth frozen: a volume server reports topology id cluster-b but this cluster is cluster-a; the master state was rebuilt. Verify the cluster inventory, then run: volume.growth.resume --- PASS: TestRepeatMismatchKeepsFreezeGeneration (0.00s) === RUN TestGrowthFreezeStateConsistentPair I1117 09:40:50.242085 topology.go:1734 volume growth freeze applied from raft I1117 09:40:50.242476 topology.go:1711 volume growth resumed by operator --- PASS: TestGrowthFreezeStateConsistentPair (0.00s) === RUN TestReplicateGrowthUnfreezeSkipsRefreeze I1117 09:40:50.244058 topology.go:1734 volume growth freeze applied from raft --- PASS: TestReplicateGrowthUnfreezeSkipsRefreeze (0.00s) === RUN TestReplicateGrowthUnfreezeRearmsOnFailure I1117 09:40:50.245051 topology.go:1734 volume growth freeze applied from raft W1117 09:40:50.245407 topology.go:1779 apply growth freeze false: not the leader W1117 09:40:51.246488 topology.go:1779 apply growth freeze false: not the leader W1117 09:40:53.247816 topology.go:1779 apply growth freeze false: not the leader W1117 09:40:53.248734 topology.go:1696 volume growth unfreeze not replicated; freeze re-armed for retry --- PASS: TestReplicateGrowthUnfreezeRearmsOnFailure (3.00s) === RUN TestReplicateGrowthUnfreezeDoesNotRearmAfterResume I1117 09:40:53.250272 topology.go:1734 volume growth freeze applied from raft I1117 09:40:53.250483 topology.go:1711 volume growth resumed by operator --- PASS: TestReplicateGrowthUnfreezeDoesNotRearmAfterResume (0.00s) === RUN TestCheckReportedTopologyIdBeforeTopologyIdKnown E1117 09:40:53.251885 topology.go:1638 volume growth frozen: a volume server reports topology id cluster-b but this cluster is cluster-c; the master state was rebuilt. Verify the cluster inventory, then run: volume.growth.resume --- PASS: TestCheckReportedTopologyIdBeforeTopologyIdKnown (0.00s) === RUN TestReportedTopologyIdStashDoesNotFreezeOnMatch --- PASS: TestReportedTopologyIdStashDoesNotFreezeOnMatch (0.00s) === RUN TestGrowthFreezeSurvivesMirrorRestore E1117 09:40:53.258556 topology.go:1638 volume growth frozen: a volume server reports topology id cluster-b but this cluster is cluster-a; the master state was rebuilt. Verify the cluster inventory, then run: volume.growth.resume I1117 09:40:53.282871 topology.go:1734 volume growth freeze applied from raft I1117 09:40:53.283374 topology.go:1711 volume growth resumed by operator --- PASS: TestGrowthFreezeSurvivesMirrorRestore (0.03s) === RUN TestGrowthFreezeCommandApply I1117 09:40:53.298657 topology.go:1734 volume growth freeze applied from raft --- PASS: TestGrowthFreezeCommandApply (0.00s) === RUN TestLegacyFreezeReplayStaysAgeless I1117 09:40:53.303281 topology.go:1734 volume growth freeze applied from raft I1117 09:40:53.303588 topology.go:1734 volume growth freeze applied from raft I1117 09:40:53.303783 topology.go:1662 volume growth unfrozen after 1m0s --- PASS: TestLegacyFreezeReplayStaysAgeless (0.00s) === RUN TestGrowthUnfreezeBoundToFreezeInstant I1117 09:40:53.305112 topology.go:1734 volume growth freeze applied from raft --- PASS: TestGrowthUnfreezeBoundToFreezeInstant (0.00s) === RUN TestAllocationDelay --- PASS: TestAllocationDelay (0.00s) === RUN TestAllocationDelayEarlyRelease --- PASS: TestAllocationDelayEarlyRelease (2.10s) === RUN TestAllocationDelayExtendedByEvidence --- PASS: TestAllocationDelayExtendedByEvidence (2.30s) === RUN TestAllocationDeferralDuration --- PASS: TestAllocationDeferralDuration (0.00s) === RUN TestAllocationDeferralReleasedByInventory --- PASS: TestAllocationDeferralReleasedByInventory (0.00s) === RUN TestAllocationDeferralReleasedByExpectedReporter --- PASS: TestAllocationDeferralReleasedByExpectedReporter (0.00s) === RUN TestAllocationDeferralConfirmPulseAfterAppliedReport --- PASS: TestAllocationDeferralConfirmPulseAfterAppliedReport (0.00s) === RUN TestQueuedTopologyReportFreezesBeforeGateOpens E1117 09:40:57.723626 topology.go:1638 volume growth frozen: a volume server reports topology id cluster-a but this cluster is cluster-b; the master state was rebuilt. Verify the cluster inventory, then run: volume.growth.resume --- PASS: TestQueuedTopologyReportFreezesBeforeGateOpens (0.00s) === RUN TestSingleReporterAdmission --- PASS: TestSingleReporterAdmission (0.00s) === RUN TestMaintenanceModeReportsNoFreeSlots I1117 09:40:57.725629 node.go:539 rack1 adds child server1 I1117 09:40:57.725873 node.go:539 rack1:server1 adds child --- PASS: TestMaintenanceModeReportsNoFreeSlots (0.00s) === RUN TestVolumeGrowthSkipsMaintenanceNodeInSameRack I1117 09:40:57.727460 node.go:539 weedfs adds child dc1 I1117 09:40:57.727798 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.727999 node.go:539 weedfs:dc1:rack1 adds child busy I1117 09:40:57.728148 node.go:539 weedfs:dc1:rack1:busy adds child I1117 09:40:57.728384 node.go:539 weedfs:dc1:rack1 adds child small1 I1117 09:40:57.728529 node.go:539 weedfs:dc1:rack1:small1 adds child I1117 09:40:57.728768 node.go:539 weedfs:dc1:rack1 adds child small2 I1117 09:40:57.728941 node.go:539 weedfs:dc1:rack1:small2 adds child --- PASS: TestVolumeGrowthSkipsMaintenanceNodeInSameRack (0.02s) === RUN TestVolumeGrowthSkipsMaintenanceNodeInOtherRack I1117 09:40:57.751497 node.go:539 weedfs adds child dc1 I1117 09:40:57.751928 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.752140 node.go:539 weedfs:dc1:rack1 adds child r1n1 I1117 09:40:57.752313 node.go:539 weedfs:dc1:rack1:r1n1 adds child I1117 09:40:57.752735 node.go:539 weedfs:dc1 adds child rack2 I1117 09:40:57.752929 node.go:539 weedfs:dc1:rack2 adds child r2busy I1117 09:40:57.753214 node.go:539 weedfs:dc1:rack2:r2busy adds child I1117 09:40:57.753460 node.go:539 weedfs:dc1:rack2 adds child r2ok I1117 09:40:57.753620 node.go:539 weedfs:dc1:rack2:r2ok adds child --- PASS: TestVolumeGrowthSkipsMaintenanceNodeInOtherRack (0.01s) === RUN TestMaintenanceModeTogglesVolumeWritability I1117 09:40:57.763545 node.go:539 weedfs adds child dc1 I1117 09:40:57.764130 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.764533 node.go:539 weedfs:dc1:rack1 adds child dn1 I1117 09:40:57.764705 node.go:539 weedfs:dc1:rack1:dn1 adds child I1117 09:40:57.764938 node.go:539 weedfs:dc1:rack1 adds child dn2 I1117 09:40:57.765084 node.go:539 weedfs:dc1:rack1:dn2 adds child I1117 09:40:57.767240 topology_event_handling.go:105 volume server dn1 maintenance mode: true I1117 09:40:57.767614 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:57.767870 volume_layout.go:480 volume 1 is not fully writable I1117 09:40:57.768185 topology_event_handling.go:105 volume server dn1 maintenance mode: false I1117 09:40:57.768424 topology_event_handling.go:105 volume server dn2 maintenance mode: true I1117 09:40:57.768636 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:57.768873 volume_layout.go:480 volume 1 is not fully writable I1117 09:40:57.769032 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:40:57.769187 volume_layout.go:480 volume 2 is not fully writable --- PASS: TestMaintenanceModeTogglesVolumeWritability (0.01s) === RUN TestMaintenanceModeHoldsThroughVacuumAndMarkWritable I1117 09:40:57.770842 node.go:539 weedfs adds child dc1 I1117 09:40:57.771254 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.771458 node.go:539 weedfs:dc1:rack1 adds child dn1 I1117 09:40:57.771616 node.go:539 weedfs:dc1:rack1:dn1 adds child I1117 09:40:57.771847 node.go:539 weedfs:dc1:rack1 adds child dn2 I1117 09:40:57.771993 node.go:539 weedfs:dc1:rack1:dn2 adds child I1117 09:40:57.772846 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:57.773280 topology_event_handling.go:105 volume server dn1 maintenance mode: true I1117 09:40:57.774285 topology_event_handling.go:105 volume server dn1 maintenance mode: false I1117 09:40:57.775005 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:57.775186 topology_event_handling.go:105 volume server dn1 maintenance mode: true I1117 09:40:57.775540 topology_event_handling.go:105 volume server dn1 maintenance mode: false --- PASS: TestMaintenanceModeHoldsThroughVacuumAndMarkWritable (0.01s) === RUN TestMarkReadOnlyAndWritableAheadOfHeartbeat I1117 09:40:57.776723 node.go:539 weedfs adds child dc1 I1117 09:40:57.777099 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.777316 node.go:539 weedfs:dc1:rack1 adds child dn1 I1117 09:40:57.777490 node.go:539 weedfs:dc1:rack1:dn1 adds child I1117 09:40:57.777859 node.go:539 weedfs:dc1:rack1 adds child dn2 I1117 09:40:57.778014 node.go:539 weedfs:dc1:rack1:dn2 adds child I1117 09:40:57.779120 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:57.779278 volume_layout.go:480 volume 1 is not fully writable I1117 09:40:57.780384 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:57.780582 topology_event_handling.go:105 volume server dn1 maintenance mode: true I1117 09:40:57.781113 topology_event_handling.go:105 volume server dn1 maintenance mode: false --- PASS: TestMarkReadOnlyAndWritableAheadOfHeartbeat (0.00s) === RUN TestMaintenanceModeAfterVolumeLeftLayout I1117 09:40:57.782269 node.go:539 weedfs adds child dc1 I1117 09:40:57.782639 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.783037 node.go:539 weedfs:dc1:rack1 adds child dn1 I1117 09:40:57.783240 node.go:539 weedfs:dc1:rack1:dn1 adds child I1117 09:40:57.784141 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:40:57.784323 volume_layout.go:477 volume 1 does not have enough copies I1117 09:40:57.784522 topology_event_handling.go:105 volume server dn1 maintenance mode: true I1117 09:40:57.784780 topology_event_handling.go:105 volume server dn1 maintenance mode: false --- PASS: TestMaintenanceModeAfterVolumeLeftLayout (0.00s) === RUN TestGrowthBlockerNeedsRoom I1117 09:40:57.785978 node.go:539 weedfs adds child dc1 I1117 09:40:57.786344 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.786566 node.go:539 weedfs:dc1:rack1 adds child s1 I1117 09:40:57.786715 node.go:539 weedfs:dc1:rack1:s1 adds child I1117 09:40:57.787194 node.go:539 weedfs:dc1 adds child rack2 I1117 09:40:57.787471 node.go:539 weedfs:dc1:rack2 adds child s2 I1117 09:40:57.787654 node.go:539 weedfs:dc1:rack2:s2 adds child I1117 09:40:57.803423 node.go:539 weedfs adds child dc1 I1117 09:40:57.804007 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.804288 node.go:539 weedfs:dc1:rack1 adds child s1 I1117 09:40:57.804550 node.go:539 weedfs:dc1:rack1:s1 adds child --- PASS: TestGrowthBlockerNeedsRoom (0.02s) === RUN TestMaxVolumeIdFileRestore --- PASS: TestMaxVolumeIdFileRestore (0.01s) === RUN TestMaxVolumeIdFileRestoresTopologyId --- PASS: TestMaxVolumeIdFileRestoresTopologyId (0.00s) === RUN TestMaxVolumeIdFileRewritesOnTopologyIdChange --- PASS: TestMaxVolumeIdFileRewritesOnTopologyIdChange (0.00s) === RUN TestMaxVolumeIdFileMonotonic --- PASS: TestMaxVolumeIdFileMonotonic (0.00s) === RUN TestMaxVolumeIdFileCorrupt W1117 09:40:57.827649 topology.go:1985 corrupt max volume id file /tmp/TestMaxVolumeIdFileCorrupt1714414935/001/max_volume_id: invalid character 'n' looking for beginning of object key string --- PASS: TestMaxVolumeIdFileCorrupt (0.01s) === RUN TestOversizedVolumeStaysUnwritableAcrossLocationReset I1117 09:40:57.830196 node.go:539 server1 adds child I1117 09:40:57.830882 node.go:539 server2 adds child I1117 09:40:57.833033 volume_layout.go:1244 Volume 35 has 1 replica, less than required 2 I1117 09:40:57.833221 volume_layout.go:1244 Volume 35 has 0 replica, less than required 2 --- PASS: TestOversizedVolumeStaysUnwritableAcrossLocationReset (0.00s) === RUN TestOversizedVolumeRejectsExplicitWritableMark I1117 09:40:57.835540 node.go:539 server1 adds child I1117 09:40:57.835841 node.go:539 server2 adds child --- PASS: TestOversizedVolumeRejectsExplicitWritableMark (0.00s) === RUN TestOversizedVerdictClearsOnlyForReportingReplica I1117 09:40:57.838988 node.go:539 server1 adds child I1117 09:40:57.839501 node.go:539 server2 adds child I1117 09:40:57.840329 volume_layout.go:1244 Volume 35 has 1 replica, less than required 2 --- PASS: TestOversizedVerdictClearsOnlyForReportingReplica (0.00s) === RUN TestExpiredOversizedVerdictHoldsForRemountedReplica I1117 09:40:57.842552 node.go:539 server1 adds child I1117 09:40:57.843147 node.go:539 server2 adds child I1117 09:40:57.843813 volume_layout.go:1244 Volume 35 has 1 replica, less than required 2 I1117 09:40:57.843951 volume_layout.go:1244 Volume 35 has 0 replica, less than required 2 --- PASS: TestExpiredOversizedVerdictHoldsForRemountedReplica (0.00s) === RUN TestRaceConditionStress I1117 09:40:57.846313 node.go:539 weedfs adds child dc1 I1117 09:40:57.846628 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.847033 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:40:57.847346 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:40:57.847530 node.go:539 weedfs:dc1:rack1 adds child server2 I1117 09:40:57.847800 node.go:539 weedfs:dc1:rack1:server2 adds child I1117 09:40:57.847975 node.go:539 weedfs:dc1:rack1 adds child server3 I1117 09:40:57.848138 node.go:539 weedfs:dc1:rack1:server3 adds child race_condition_stress_test.go:108: Test completed in 69.217442ms race_condition_stress_test.go:109: Successful allocations: 50 race_condition_stress_test.go:110: Failed allocations: 0 race_condition_stress_test.go:111: Total volumes created: 50 race_condition_stress_test.go:120: Server 1: 11 volumes (max: 40) race_condition_stress_test.go:120: Server 2: 16 volumes (max: 40) race_condition_stress_test.go:120: Server 3: 23 volumes (max: 40) race_condition_stress_test.go:148: Race condition test passed: Capacity limits respected with 50 concurrent requests --- PASS: TestRaceConditionStress (0.08s) === RUN TestCapacityJudgmentAccuracy I1117 09:40:57.925547 node.go:539 weedfs adds child dc1 I1117 09:40:57.926099 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.926482 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:40:57.926829 node.go:539 weedfs:dc1:rack1:server1 adds child race_condition_stress_test.go:226: Step 0: Volume count after update: 1 race_condition_stress_test.go:226: Step 1: Volume count after update: 2 race_condition_stress_test.go:226: Step 2: Volume count after update: 3 race_condition_stress_test.go:226: Step 3: Volume count after update: 4 race_condition_stress_test.go:226: Step 4: Volume count after update: 5 race_condition_stress_test.go:226: Step 5: Volume count after update: 6 race_condition_stress_test.go:226: Step 6: Volume count after update: 7 race_condition_stress_test.go:226: Step 7: Volume count after update: 8 race_condition_stress_test.go:226: Step 8: Volume count after update: 9 race_condition_stress_test.go:226: Step 9: Volume count after update: 10 I1117 09:40:57.936080 node.go:224 weedfs failed to pick 1 from 0 node candidates race_condition_stress_test.go:252: Capacity judgment accuracy test passed --- PASS: TestCapacityJudgmentAccuracy (0.01s) === RUN TestReservationSystemPerformance I1117 09:40:57.937888 node.go:539 weedfs adds child dc1 I1117 09:40:57.938247 node.go:539 weedfs:dc1 adds child rack1 I1117 09:40:57.938624 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:40:57.939247 node.go:539 weedfs:dc1:rack1:server1 adds child race_condition_stress_test.go:299: Performance: 1000 reservations in 214.44867ms (avg: 214.448µs per reservation) race_condition_stress_test.go:306: Performance test passed: 214.448µs per reservation --- PASS: TestReservationSystemPerformance (0.22s) === RUN TestDisk_GetEcShards_Race --- PASS: TestDisk_GetEcShards_Race (9.77s) === RUN TestClassifyReplicationError === RUN TestClassifyReplicationError/deadline_exceeded === RUN TestClassifyReplicationError/context_cancelled === RUN TestClassifyReplicationError/connection_refused === RUN TestClassifyReplicationError/generic_error === RUN TestClassifyReplicationError/nil_error --- PASS: TestClassifyReplicationError (0.01s) --- PASS: TestClassifyReplicationError/deadline_exceeded (0.00s) --- PASS: TestClassifyReplicationError/context_cancelled (0.00s) --- PASS: TestClassifyReplicationError/connection_refused (0.00s) --- PASS: TestClassifyReplicationError/generic_error (0.00s) --- PASS: TestClassifyReplicationError/nil_error (0.00s) === RUN TestDistributedOperationCancelsSiblingsOnFirstError --- PASS: TestDistributedOperationCancelsSiblingsOnFirstError (0.00s) === RUN TestDistributedOperationEmpty --- PASS: TestDistributedOperationEmpty (0.00s) === RUN TestGetWritableRemoteReplicationsRefreshesReadOnlyReplicas --- PASS: TestGetWritableRemoteReplicationsRefreshesReadOnlyReplicas (0.25s) === RUN TestReplicatedWriteForwardsFsyncToReplicas === RUN TestReplicatedWriteForwardsFsyncToReplicas/fsync_requested === RUN TestReplicatedWriteForwardsFsyncToReplicas/no_fsync_requested --- PASS: TestReplicatedWriteForwardsFsyncToReplicas (0.17s) --- PASS: TestReplicatedWriteForwardsFsyncToReplicas/fsync_requested (0.11s) --- PASS: TestReplicatedWriteForwardsFsyncToReplicas/no_fsync_requested (0.04s) === RUN TestReplicatedWriteOverlapsLocalAndReplicaWrites I1117 09:41:08.391113 store.go:431 In dir /tmp/TestReplicatedWriteOverlapsLocalAndReplicaWrites2702523622/001 (disk ID 0) adds volume:7 collection: replicaPlacement:001 ttl:15d I1117 09:41:08.419511 store.go:436 add volume 7 on disk ID 0 --- PASS: TestReplicatedWriteOverlapsLocalAndReplicaWrites (0.16s) === RUN TestReplicatedWriteFailsWhenEitherLegFails === RUN TestReplicatedWriteFailsWhenEitherLegFails/local_write_fails I1117 09:41:08.544100 store.go:431 In dir /tmp/TestReplicatedWriteFailsWhenEitherLegFailslocal_write_fails1486649692/001 (disk ID 0) adds volume:8 collection: replicaPlacement:001 ttl: I1117 09:41:08.546598 store.go:436 add volume 8 on disk ID 0 I1117 09:41:08.557090 store_replicate.go:122 failed to write to local disk: volume 8 is read only E1117 09:41:08.570170 upload_content.go:696 unmarshal http://127.0.0.1:40887/8,01637037d6?ttl=&type=replicate: W1117 09:41:08.571246 upload_content.go:377 uploading 0 to http://127.0.0.1:40887/8,01637037d6?ttl=&type=replicate: unmarshal http://127.0.0.1:40887/8,01637037d6?ttl=&type=replicate: unexpected end of JSON input E1117 09:41:08.571711 store_replicate.go:182 replication-UploadData, err:unmarshal http://127.0.0.1:40887/8,01637037d6?ttl=&type=replicate: unexpected end of JSON input, url:http://127.0.0.1:40887/8,01637037d6?ttl=&type=replicate I1117 09:41:08.573475 store_replicate.go:193 failed to write to replicas for volume 8: [127.0.0.1:40887]: unmarshal http://127.0.0.1:40887/8,01637037d6?ttl=&type=replicate: unexpected end of JSON input === RUN TestReplicatedWriteFailsWhenEitherLegFails/replica_write_fails I1117 09:41:08.594373 store.go:431 In dir /tmp/TestReplicatedWriteFailsWhenEitherLegFailsreplica_write_fails2975153484/001 (disk ID 0) adds volume:9 collection: replicaPlacement:001 ttl: I1117 09:41:08.598872 store.go:436 add volume 9 on disk ID 0 E1117 09:41:08.641100 upload_content.go:696 unmarshal http://127.0.0.1:37165/9,01637037d6?ttl=&type=replicate: W1117 09:41:08.641462 upload_content.go:377 uploading 0 to http://127.0.0.1:37165/9,01637037d6?ttl=&type=replicate: unmarshal http://127.0.0.1:37165/9,01637037d6?ttl=&type=replicate: unexpected end of JSON input E1117 09:41:08.641738 store_replicate.go:182 replication-UploadData, err:unmarshal http://127.0.0.1:37165/9,01637037d6?ttl=&type=replicate: unexpected end of JSON input, url:http://127.0.0.1:37165/9,01637037d6?ttl=&type=replicate I1117 09:41:08.642269 store_replicate.go:193 failed to write to replicas for volume 9: [127.0.0.1:37165]: unmarshal http://127.0.0.1:37165/9,01637037d6?ttl=&type=replicate: unexpected end of JSON input === RUN TestReplicatedWriteFailsWhenEitherLegFails/replica_read_only I1117 09:41:08.654244 store.go:431 In dir /tmp/TestReplicatedWriteFailsWhenEitherLegFailsreplica_read_only1168588198/001 (disk ID 0) adds volume:10 collection: replicaPlacement:001 ttl: I1117 09:41:08.656794 store.go:436 add volume 10 on disk ID 0 E1117 09:41:08.675927 upload_content.go:696 unmarshal http://127.0.0.1:41755/10,01637037d6?ttl=&type=replicate: E1117 09:41:08.676472 store_replicate.go:182 replication-UploadData, err:unmarshal http://127.0.0.1:41755/10,01637037d6?ttl=&type=replicate: unexpected end of JSON input, url:http://127.0.0.1:41755/10,01637037d6?ttl=&type=replicate I1117 09:41:08.677121 store_replicate.go:193 failed to write to replicas for volume 10: [127.0.0.1:41755]: unmarshal http://127.0.0.1:41755/10,01637037d6?ttl=&type=replicate: unexpected end of JSON input --- PASS: TestReplicatedWriteFailsWhenEitherLegFails (0.15s) --- PASS: TestReplicatedWriteFailsWhenEitherLegFails/local_write_fails (0.05s) --- PASS: TestReplicatedWriteFailsWhenEitherLegFails/replica_write_fails (0.07s) --- PASS: TestReplicatedWriteFailsWhenEitherLegFails/replica_read_only (0.03s) === RUN TestReplicatedWriteRejectsWriteWithNoTarget === RUN TestReplicatedWriteRejectsWriteWithNoTarget/volume_unknown_to_the_master I1117 09:41:08.696834 store_replicate.go:55 volume 31234 not found on 127.0.0.1:8080 === RUN TestReplicatedWriteRejectsWriteWithNoTarget/master_lists_only_this_server I1117 09:41:08.703885 store_replicate.go:55 volume 31234 not found on 127.0.0.1:8080 === RUN TestReplicatedWriteRejectsWriteWithNoTarget/replica_write_for_a_volume_not_on_this_server I1117 09:41:08.705662 store_replicate.go:55 volume 31234 not found on 127.0.0.1:8080 --- PASS: TestReplicatedWriteRejectsWriteWithNoTarget (0.03s) --- PASS: TestReplicatedWriteRejectsWriteWithNoTarget/volume_unknown_to_the_master (0.01s) --- PASS: TestReplicatedWriteRejectsWriteWithNoTarget/master_lists_only_this_server (0.01s) --- PASS: TestReplicatedWriteRejectsWriteWithNoTarget/replica_write_for_a_volume_not_on_this_server (0.00s) === RUN TestReplicatedWriteFailsAtTheBoundWhenAReplicaNeverAnswers E1117 09:41:09.033353 store_replicate.go:182 replication-UploadData, err:context deadline exceeded, url:http://127.0.0.1:33509/1,01637037d6?ttl=&type=replicate I1117 09:41:09.034277 store_replicate.go:193 failed to write to replicas for volume 1: [127.0.0.1:33509]: context deadline exceeded --- PASS: TestReplicatedWriteFailsAtTheBoundWhenAReplicaNeverAnswers (0.33s) === RUN TestReplicatedWriteGivesALargerBodyMoreTime --- PASS: TestReplicatedWriteGivesALargerBodyMoreTime (0.94s) === RUN TestReplicaRequestBoundGrowsWithTheBody --- PASS: TestReplicaRequestBoundGrowsWithTheBody (0.00s) === RUN TestRegisterEcShardsAdvancesMaxVolumeId I1117 09:41:09.982615 node.go:539 weedfs adds child dc1 I1117 09:41:09.982879 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:09.983259 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:09.983501 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestRegisterEcShardsAdvancesMaxVolumeId (0.00s) === RUN TestIncrementalSyncDataNodeEcShardsAdvancesMaxVolumeId I1117 09:41:09.984817 node.go:539 weedfs adds child dc1 I1117 09:41:09.985007 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:09.985313 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:09.985511 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestIncrementalSyncDataNodeEcShardsAdvancesMaxVolumeId (0.00s) === RUN TestCollectionVolumeStats I1117 09:41:09.986533 node.go:539 weedfs adds child dc1 I1117 09:41:09.986735 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:09.987069 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:09.987508 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:09.987774 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child ssd I1117 09:41:09.990075 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.2:34534 I1117 09:41:09.990289 node.go:539 weedfs:dc1:rack1:127.0.0.2:34534 adds child I1117 09:41:09.990491 node.go:539 weedfs:dc1:rack1:127.0.0.2:34534 adds child ssd --- PASS: TestCollectionVolumeStats (0.01s) === RUN TestCollectionVolumeStatsWithEcVolumes I1117 09:41:09.994176 node.go:539 weedfs adds child dc1 I1117 09:41:09.994356 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:09.994661 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:09.994914 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:09.995163 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.2:34534 I1117 09:41:09.995358 node.go:539 weedfs:dc1:rack1:127.0.0.2:34534 adds child --- PASS: TestCollectionVolumeStatsWithEcVolumes (0.00s) === RUN TestCollectionVolumeStatsClampsDeletedOverTotals I1117 09:41:09.997815 node.go:539 weedfs adds child dc1 I1117 09:41:09.998010 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:09.998332 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:09.998532 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestCollectionVolumeStatsClampsDeletedOverTotals (0.00s) === RUN TestRemoveDataCenter data: map[dc1:map[rack1:map[server111:map[limit:3 volumes:[map[id:1 size:12312] map[id:2 size:12312] map[id:3 size:12312]]] server112:map[limit:10 volumes:[map[id:4 size:12312] map[id:5 size:12312] map[id:6 size:12312]]]] rack2:map[server121:map[limit:4 volumes:[map[id:4 size:12312] map[id:5 size:12312] map[id:6 size:12312]]] server122:map[limit:4 volumes:[]] server123:map[limit:5 volumes:[map[id:2 size:12312] map[id:3 size:12312] map[id:4 size:12312]]]]] dc2:map[] dc3:map[rack2:map[server321:map[limit:4 volumes:[map[id:1 size:12312] map[id:3 size:12312] map[id:5 size:12312]]]]]] I1117 09:41:10.019644 node.go:539 weedfs adds child dc1 I1117 09:41:10.020235 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.020721 node.go:539 weedfs:dc1:rack1 adds child server111 I1117 09:41:10.021220 node.go:539 weedfs:dc1:rack1:server111 adds child I1117 09:41:10.021805 node.go:539 weedfs:dc1:rack1 adds child server112 I1117 09:41:10.021994 node.go:539 weedfs:dc1:rack1:server112 adds child I1117 09:41:10.022360 node.go:539 weedfs:dc1 adds child rack2 I1117 09:41:10.022552 node.go:539 weedfs:dc1:rack2 adds child server121 I1117 09:41:10.022717 node.go:539 weedfs:dc1:rack2:server121 adds child I1117 09:41:10.023018 node.go:539 weedfs:dc1:rack2 adds child server122 I1117 09:41:10.023227 node.go:539 weedfs:dc1:rack2:server122 adds child I1117 09:41:10.023445 node.go:539 weedfs:dc1:rack2 adds child server123 I1117 09:41:10.023607 node.go:539 weedfs:dc1:rack2:server123 adds child I1117 09:41:10.024134 node.go:539 weedfs adds child dc2 I1117 09:41:10.024278 node.go:539 weedfs adds child dc3 I1117 09:41:10.024447 node.go:539 weedfs:dc3 adds child rack2 I1117 09:41:10.024618 node.go:539 weedfs:dc3:rack2 adds child server321 I1117 09:41:10.024804 node.go:539 weedfs:dc3:rack2:server321 adds child I1117 09:41:10.025669 node.go:560 weedfs removes dc2 I1117 09:41:10.026000 node.go:560 weedfs removes dc3 --- PASS: TestRemoveDataCenter (0.03s) === RUN TestHandlingVolumeServerHeartbeat I1117 09:41:10.027135 node.go:539 weedfs adds child dc1 I1117 09:41:10.027310 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.027634 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.027944 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:10.028164 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child ssd I1117 09:41:10.033003 data_node.go:159 Deleting volume id: 8 I1117 09:41:10.033195 data_node.go:159 Deleting volume id: 9 I1117 09:41:10.033329 data_node.go:159 Deleting volume id: 10 I1117 09:41:10.033458 data_node.go:159 Deleting volume id: 11 I1117 09:41:10.033602 data_node.go:159 Deleting volume id: 12 I1117 09:41:10.033736 data_node.go:159 Deleting volume id: 13 I1117 09:41:10.033857 data_node.go:159 Deleting volume id: 14 I1117 09:41:10.034099 data_node.go:159 Deleting volume id: 7 I1117 09:41:10.034463 topology.go:1124 removing volume info: Id:8, Size:25432, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:2343, DeleteCount:345, DeletedByteCount:34524, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.034817 volume_layout.go:1149 Volume 8 becomes unwritable I1117 09:41:10.034988 volume_layout.go:477 volume 8 does not have enough copies I1117 09:41:10.035181 topology.go:1124 removing volume info: Id:9, Size:25432, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:2343, DeleteCount:345, DeletedByteCount:34524, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.035416 volume_layout.go:1149 Volume 9 becomes unwritable I1117 09:41:10.035570 volume_layout.go:477 volume 9 does not have enough copies I1117 09:41:10.035711 topology.go:1124 removing volume info: Id:10, Size:25432, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:2343, DeleteCount:345, DeletedByteCount:34524, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.035937 volume_layout.go:1149 Volume 10 becomes unwritable I1117 09:41:10.036081 volume_layout.go:477 volume 10 does not have enough copies I1117 09:41:10.036336 topology.go:1124 removing volume info: Id:11, Size:25432, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:2343, DeleteCount:345, DeletedByteCount:34524, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.036575 volume_layout.go:1149 Volume 11 becomes unwritable I1117 09:41:10.036732 volume_layout.go:477 volume 11 does not have enough copies I1117 09:41:10.036872 topology.go:1124 removing volume info: Id:12, Size:25432, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:2343, DeleteCount:345, DeletedByteCount:34524, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.037092 volume_layout.go:1149 Volume 12 becomes unwritable I1117 09:41:10.037250 volume_layout.go:477 volume 12 does not have enough copies I1117 09:41:10.037383 topology.go:1124 removing volume info: Id:13, Size:25432, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:2343, DeleteCount:345, DeletedByteCount:34524, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.037605 volume_layout.go:1149 Volume 13 becomes unwritable I1117 09:41:10.037747 volume_layout.go:477 volume 13 does not have enough copies I1117 09:41:10.037880 topology.go:1124 removing volume info: Id:14, Size:25432, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:2343, DeleteCount:345, DeletedByteCount:34524, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.038102 volume_layout.go:1149 Volume 14 becomes unwritable I1117 09:41:10.038246 volume_layout.go:477 volume 14 does not have enough copies I1117 09:41:10.038642 topology.go:1124 removing volume info: Id:7, Size:25432, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:2343, DeleteCount:345, DeletedByteCount:34524, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.038887 volume_layout.go:1149 Volume 7 becomes unwritable I1117 09:41:10.039044 volume_layout.go:477 volume 7 does not have enough copies I1117 09:41:10.042117 topology.go:1124 removing volume info: Id:3, Size:0, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.042388 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:41:10.042534 volume_layout.go:477 volume 3 does not have enough copies after add volume id 1 after add volume id 2 after add volume id 3 after add volume id 4 after add volume id 5 after add volume id 6 after add writable volume id 1 after add writable volume id 2 after add writable volume id 4 after add writable volume id 5 after add writable volume id 6 after add writable volume id 3 I1117 09:41:10.044203 topology_event_handling.go:117 Removing Volume 1 from the dead volume server 127.0.0.1:34534 I1117 09:41:10.044424 volume_layout.go:1244 Volume 1 has 0 replica, less than required 1 I1117 09:41:10.044560 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:10.044810 topology_event_handling.go:117 Removing Volume 2 from the dead volume server 127.0.0.1:34534 I1117 09:41:10.044959 volume_layout.go:1244 Volume 2 has 0 replica, less than required 1 I1117 09:41:10.045084 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:41:10.045226 topology_event_handling.go:117 Removing Volume 3 from the dead volume server 127.0.0.1:34534 I1117 09:41:10.045384 volume_layout.go:1244 Volume 3 has 0 replica, less than required 1 I1117 09:41:10.045515 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:41:10.045651 topology_event_handling.go:117 Removing Volume 4 from the dead volume server 127.0.0.1:34534 I1117 09:41:10.045797 volume_layout.go:1244 Volume 4 has 0 replica, less than required 1 I1117 09:41:10.045924 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:41:10.046060 topology_event_handling.go:117 Removing Volume 5 from the dead volume server 127.0.0.1:34534 I1117 09:41:10.046209 volume_layout.go:1244 Volume 5 has 0 replica, less than required 1 I1117 09:41:10.046331 volume_layout.go:1149 Volume 5 becomes unwritable I1117 09:41:10.046476 topology_event_handling.go:117 Removing Volume 6 from the dead volume server 127.0.0.1:34534 I1117 09:41:10.046622 volume_layout.go:1244 Volume 6 has 0 replica, less than required 1 I1117 09:41:10.046753 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:41:10.048253 node.go:560 weedfs:dc1:rack1 removes 127.0.0.1:34534 --- PASS: TestHandlingVolumeServerHeartbeat (0.02s) === RUN TestIncrementalSyncReplacesVolumeReadOnlyState === RUN TestIncrementalSyncReplacesVolumeReadOnlyState/writable_to_read-only I1117 09:41:10.050252 node.go:539 weedfs adds child dc1 I1117 09:41:10.050452 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.050781 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.051054 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:10.051890 volume_layout.go:1149 Volume 1 becomes unwritable === RUN TestIncrementalSyncReplacesVolumeReadOnlyState/read-only_to_writable I1117 09:41:10.054341 node.go:539 weedfs adds child dc1 I1117 09:41:10.054863 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.055095 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.055376 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestIncrementalSyncReplacesVolumeReadOnlyState (0.01s) --- PASS: TestIncrementalSyncReplacesVolumeReadOnlyState/writable_to_read-only (0.00s) --- PASS: TestIncrementalSyncReplacesVolumeReadOnlyState/read-only_to_writable (0.00s) === RUN TestIncrementalSyncRegistersMovedVolumeBeforeRemoval I1117 09:41:10.057842 node.go:539 weedfs adds child dc1 I1117 09:41:10.058049 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.058405 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.058608 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:10.058798 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child ssd I1117 09:41:10.060631 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.061247 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:10.061466 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestIncrementalSyncRegistersMovedVolumeBeforeRemoval (0.00s) === RUN TestDataNodeToDataNodeInfo_IncludeEmptyDiskFromUsage --- PASS: TestDataNodeToDataNodeInfo_IncludeEmptyDiskFromUsage (0.00s) === RUN TestAddRemoveVolume I1117 09:41:10.063980 node.go:539 weedfs adds child dc1 I1117 09:41:10.064175 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.064515 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.064812 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:10.065037 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child ssd I1117 09:41:10.066037 topology.go:1124 removing volume info: Id:1, Size:100, ReplicaPlacement:000, Collection:xcollection, Version:3, Ttl:, FileCount:123, DeleteCount:23, DeletedByteCount:45, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.066544 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:10.066711 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestAddRemoveVolume (0.00s) === RUN TestUnRegisterVolumeLayoutClearsReplicaPlacementMismatchMetric I1117 09:41:10.068018 node.go:539 weedfs adds child dc1 I1117 09:41:10.068203 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.068511 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.068763 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:10.075173 topology.go:1124 removing volume info: Id:42, Size:100, ReplicaPlacement:001, Collection:metrics-test, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 --- PASS: TestUnRegisterVolumeLayoutClearsReplicaPlacementMismatchMetric (0.01s) === RUN TestUnRegisterVolumeLayoutKeepsReplicaPlacementMismatchMetricWhilePlacementsRemain I1117 09:41:10.078467 node.go:539 weedfs adds child dc1 I1117 09:41:10.078660 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.078978 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.079258 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:10.079510 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34535 I1117 09:41:10.079706 node.go:539 weedfs:dc1:rack1:127.0.0.1:34535 adds child I1117 09:41:10.081882 topology.go:1124 removing volume info: Id:42, Size:100, ReplicaPlacement:001, Collection:metrics-test, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.082204 volume_layout.go:1149 Volume 42 becomes unwritable I1117 09:41:10.082385 volume_layout.go:477 volume 42 does not have enough copies I1117 09:41:10.083262 topology.go:1124 removing volume info: Id:42, Size:100, ReplicaPlacement:001, Collection:metrics-test, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34535 --- PASS: TestUnRegisterVolumeLayoutKeepsReplicaPlacementMismatchMetricWhilePlacementsRemain (0.01s) === RUN TestVolumeReadOnlyStatusChange I1117 09:41:10.086208 node.go:539 weedfs adds child dc1 I1117 09:41:10.086429 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.087024 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.087326 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestVolumeReadOnlyStatusChange (0.00s) === RUN TestDeletingReadOnlyVolumeKeepsActiveCount I1117 09:41:10.089594 node.go:539 weedfs adds child dc1 I1117 09:41:10.089789 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.090096 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.090574 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:10.091442 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:34534 I1117 09:41:10.091757 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:10.091928 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestDeletingReadOnlyVolumeKeepsActiveCount (0.00s) === RUN TestVolumeReadOnlyAndRemoteStatusChange I1117 09:41:10.093232 node.go:539 weedfs adds child dc1 I1117 09:41:10.093408 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.093711 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:10.093919 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child --- PASS: TestVolumeReadOnlyAndRemoteStatusChange (0.00s) === RUN TestListCollections I1117 09:41:10.096317 node.go:539 weedfs adds child dc1 I1117 09:41:10.096503 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:10.096722 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 === RUN TestListCollections/no_volume_types_selected === RUN TestListCollections/normal_volumes === RUN TestListCollections/EC_volumes === RUN TestListCollections/normal_+_EC_volumes --- PASS: TestListCollections (0.01s) --- PASS: TestListCollections/no_volume_types_selected (0.00s) --- PASS: TestListCollections/normal_volumes (0.00s) --- PASS: TestListCollections/EC_volumes (0.00s) --- PASS: TestListCollections/normal_+_EC_volumes (0.00s) === RUN TestListCollectionsWithConcurrentCollectionDelete --- PASS: TestListCollectionsWithConcurrentCollectionDelete (5.52s) === RUN TestDataNodeIdBasedIdentification I1117 09:41:15.622414 node.go:539 weedfs adds child dc1 I1117 09:41:15.622720 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.623151 node.go:539 weedfs:dc1:rack1 adds child node-1 I1117 09:41:15.623452 node.go:539 weedfs:dc1:rack1:node-1 adds child I1117 09:41:15.624049 rack.go:68 DataNode node-1 address changed from 10.0.0.1:8080 to 10.0.0.2:8080 I1117 09:41:15.625076 node.go:539 weedfs:dc1:rack1 adds child node-2 I1117 09:41:15.625359 node.go:539 weedfs:dc1:rack1:node-2 adds child I1117 09:41:15.625712 node.go:539 weedfs:dc1:rack1 adds child 10.0.0.4:8080 I1117 09:41:15.625914 node.go:539 weedfs:dc1:rack1:10.0.0.4:8080 adds child I1117 09:41:15.626578 rack.go:100 Volume server 10.0.0.4:8080 transitioning id from 10.0.0.4:8080 to node-4-explicit I1117 09:41:15.627461 node.go:539 weedfs:dc1:rack1 adds child node-99 I1117 09:41:15.627723 node.go:539 weedfs:dc1:rack1:node-99 adds child --- PASS: TestDataNodeIdBasedIdentification (0.01s) === RUN TestLookupDataNodeByAddress I1117 09:41:15.628898 node.go:539 weedfs adds child dc1 I1117 09:41:15.629093 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.629424 node.go:539 weedfs:dc1:rack1 adds child n1 I1117 09:41:15.629679 node.go:539 weedfs:dc1:rack1:n1 adds child I1117 09:41:15.630173 rack.go:68 DataNode n1 address changed from 10.1.2.3:8080 to 10.9.9.9:8080 I1117 09:41:15.630694 node.go:560 weedfs:dc1:rack1 removes n1 --- PASS: TestLookupDataNodeByAddress (0.00s) === RUN TestSyncDataNodeRegistrationReRegistersMissingVolume I1117 09:41:15.631704 node.go:539 weedfs adds child dc1 I1117 09:41:15.631909 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.632225 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:15.632443 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:15.633777 volume_layout.go:1244 Volume 18994 has 0 replica, less than required 1 I1117 09:41:15.633954 volume_layout.go:1149 Volume 18994 becomes unwritable --- PASS: TestSyncDataNodeRegistrationReRegistersMissingVolume (0.00s) === RUN TestSetVolumeAvailableRepairsMissingVolume I1117 09:41:15.635442 node.go:539 weedfs adds child dc1 I1117 09:41:15.635652 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.636046 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:15.636334 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:15.637166 volume_layout.go:1244 Volume 2640 has 0 replica, less than required 1 I1117 09:41:15.637326 volume_layout.go:1149 Volume 2640 becomes unwritable --- PASS: TestSetVolumeAvailableRepairsMissingVolume (0.00s) === RUN TestFullHeartbeatUpdatesLayoutReadOnlyFlag I1117 09:41:15.639036 node.go:539 weedfs adds child dc1 I1117 09:41:15.639438 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.639847 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:15.640130 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:15.640958 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:41:15.642125 volume_layout.go:1340 Volume 1 becomes uncrowded I1117 09:41:15.642743 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:41:15.643952 volume_layout.go:1340 Volume 1 becomes uncrowded I1117 09:41:15.645964 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestFullHeartbeatUpdatesLayoutReadOnlyFlag (0.01s) === RUN TestIsEmptyVolumeDeleteCandidate === RUN TestIsEmptyVolumeDeleteCandidate/empty_and_quiet === RUN TestIsEmptyVolumeDeleteCandidate/all_garbage_and_quiet === RUN TestIsEmptyVolumeDeleteCandidate/remote-backed === RUN TestIsEmptyVolumeDeleteCandidate/read-only_without_delete_permission === RUN TestIsEmptyVolumeDeleteCandidate/read-only_can_delete === RUN TestIsEmptyVolumeDeleteCandidate/live_files === RUN TestIsEmptyVolumeDeleteCandidate/no_live_files_but_oversized_is_fine === RUN TestIsEmptyVolumeDeleteCandidate/unreported_mtime === RUN TestIsEmptyVolumeDeleteCandidate/still_quiet-recent --- PASS: TestIsEmptyVolumeDeleteCandidate (0.01s) --- PASS: TestIsEmptyVolumeDeleteCandidate/empty_and_quiet (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/all_garbage_and_quiet (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/remote-backed (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/read-only_without_delete_permission (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/read-only_can_delete (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/live_files (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/no_live_files_but_oversized_is_fine (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/unreported_mtime (0.00s) --- PASS: TestIsEmptyVolumeDeleteCandidate/still_quiet-recent (0.00s) === RUN TestDeleteEmptyVolumesDeletesOnlyQuietEmptyCopies I1117 09:41:15.656556 node.go:539 weedfs adds child dc1 I1117 09:41:15.656914 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.657513 node.go:539 weedfs:dc1:rack1 adds child dn-46271 I1117 09:41:15.657897 node.go:539 weedfs:dc1:rack1:dn-46271 adds child I1117 09:41:15.660783 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:15.661352 topology_vacuum.go:512 deleting empty volume 1 on 127.0.0.1:8080 I1117 09:41:15.685908 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:1794901275 from dn-46271 I1117 09:41:15.686645 topology_vacuum.go:512 deleting empty volume 2 on 127.0.0.1:8080 I1117 09:41:15.696220 topology.go:1124 removing volume info: Id:2, Size:1048576, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:100, DeleteCount:100, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:1794901275 from dn-46271 --- PASS: TestDeleteEmptyVolumesDeletesOnlyQuietEmptyCopies (0.04s) === RUN TestDeleteEmptyVolumesSkipsVidWithLiveReplica I1117 09:41:15.700352 node.go:539 weedfs adds child dc1 I1117 09:41:15.700563 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.700901 node.go:539 weedfs:dc1:rack1 adds child dn-empty I1117 09:41:15.701153 node.go:539 weedfs:dc1:rack1:dn-empty adds child I1117 09:41:15.701557 node.go:539 weedfs:dc1:rack1 adds child dn-live I1117 09:41:15.701927 node.go:539 weedfs:dc1:rack1:dn-live adds child I1117 09:41:15.703091 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:15.703397 volume_layout.go:477 volume 1 does not have enough copies I1117 09:41:15.703746 volume_layout.go:483 volume 1 is oversized --- PASS: TestDeleteEmptyVolumesSkipsVidWithLiveReplica (0.01s) === RUN TestDeleteEmptyVolumesKeepsVidWhenCopyDeleteFails I1117 09:41:15.707010 node.go:539 weedfs adds child dc1 I1117 09:41:15.707221 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.707578 node.go:539 weedfs:dc1:rack1 adds child dn-empty I1117 09:41:15.707797 node.go:539 weedfs:dc1:rack1:dn-empty adds child I1117 09:41:15.708087 node.go:539 weedfs:dc1:rack1 adds child dn-dead I1117 09:41:15.708331 node.go:539 weedfs:dc1:rack1:dn-dead adds child I1117 09:41:15.710121 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:15.710318 volume_layout.go:477 volume 1 does not have enough copies I1117 09:41:15.710876 topology_vacuum.go:512 deleting empty volume 1 on 127.0.0.1:8080 I1117 09:41:15.720620 topology.go:1124 removing volume info: Id:1, Size:0, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:1794901275 from dn-empty I1117 09:41:15.721056 topology_vacuum.go:512 deleting empty volume 1 on 127.0.0.2:8080 W1117 09:41:15.737958 topology_vacuum.go:518 delete empty volume 1 on 127.0.0.2:8080: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.2:1: connect: connection refused" --- PASS: TestDeleteEmptyVolumesKeepsVidWhenCopyDeleteFails (0.03s) === RUN TestVacuumReadOnlyDiskLowVolume I1117 09:41:15.742272 node.go:539 weedfs adds child dc1 I1117 09:41:15.742453 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.742939 node.go:539 weedfs:dc1:rack1 adds child dn I1117 09:41:15.743155 node.go:539 weedfs:dc1:rack1:dn adds child I1117 09:41:15.759649 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8080 I1117 09:41:15.777537 topology_vacuum.go:138 Complete vacuuming 1 on 127.0.0.1:8080 I1117 09:41:15.778094 topology_vacuum.go:162 Start Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:15.785345 topology_vacuum.go:184 Complete Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:15.791338 topology_vacuum.go:69 skip vacuuming read-only volume 2 on 127.0.0.1:8080 I1117 09:41:15.794900 topology_vacuum.go:110 0 Start vacuuming 3 on 127.0.0.1:8080 I1117 09:41:15.806708 topology_vacuum.go:138 Complete vacuuming 3 on 127.0.0.1:8080 I1117 09:41:15.806947 topology_vacuum.go:162 Start Committing vacuum 3 on 127.0.0.1:8080 I1117 09:41:15.809566 topology_vacuum.go:184 Complete Committing vacuum 3 on 127.0.0.1:8080 I1117 09:41:15.812536 topology_vacuum.go:464 vacuuming read-only volume 5 on explicit request I1117 09:41:15.815396 topology_vacuum.go:110 0 Start vacuuming 5 on 127.0.0.1:8080 I1117 09:41:15.825131 topology_vacuum.go:138 Complete vacuuming 5 on 127.0.0.1:8080 I1117 09:41:15.825363 topology_vacuum.go:162 Start Committing vacuum 5 on 127.0.0.1:8080 I1117 09:41:15.827650 topology_vacuum.go:184 Complete Committing vacuum 5 on 127.0.0.1:8080 --- PASS: TestVacuumReadOnlyDiskLowVolume (0.09s) === RUN TestVacuumStalledVolumeServerReleasesGuard === RUN TestVacuumStalledVolumeServerReleasesGuard/check I1117 09:41:15.830903 node.go:539 weedfs adds child dc1 I1117 09:41:15.831129 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:15.832710 node.go:539 weedfs:dc1:rack1 adds child dn-hang I1117 09:41:15.832923 node.go:539 weedfs:dc1:rack1:dn-hang adds child === RUN TestVacuumStalledVolumeServerReleasesGuard/compact I1117 09:41:16.090142 node.go:539 weedfs adds child dc1 I1117 09:41:16.090339 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:16.091042 topology_vacuum.go:82 Checking vacuuming 1 on 127.0.0.1:8081: rpc error: code = DeadlineExceeded desc = context deadline exceeded I1117 09:41:16.092111 node.go:539 weedfs:dc1:rack1 adds child dn-hang I1117 09:41:16.092390 node.go:539 weedfs:dc1:rack1:dn-hang adds child I1117 09:41:16.104861 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8081 I1117 09:41:16.856261 topology_vacuum.go:242 Start cleaning up 1 on 127.0.0.1:8081 I1117 09:41:16.863751 topology_vacuum.go:254 Complete cleaning up vacuum 1 on 127.0.0.1:8081 E1117 09:41:16.864508 topology_vacuum.go:135 Error when vacuuming 1 on 127.0.0.1:8081: rpc error: code = DeadlineExceeded desc = context deadline exceeded === RUN TestVacuumStalledVolumeServerReleasesGuard/commit I1117 09:41:16.866384 node.go:539 weedfs adds child dc1 I1117 09:41:16.866686 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:16.868615 node.go:539 weedfs:dc1:rack1 adds child dn-hang I1117 09:41:16.868879 node.go:539 weedfs:dc1:rack1:dn-hang adds child I1117 09:41:16.879334 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8081 I1117 09:41:16.890210 topology_vacuum.go:138 Complete vacuuming 1 on 127.0.0.1:8081 I1117 09:41:16.890515 topology_vacuum.go:162 Start Committing vacuum 1 on 127.0.0.1:8081 E1117 09:41:17.142097 topology_vacuum.go:181 Error when committing vacuum 1 on 127.0.0.1:8081: rpc error: code = DeadlineExceeded desc = context deadline exceeded === RUN TestVacuumStalledVolumeServerReleasesGuard/status I1117 09:41:17.144786 node.go:539 weedfs adds child dc1 I1117 09:41:17.145039 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:17.154555 node.go:539 weedfs:dc1:rack1 adds child dn-ok I1117 09:41:17.157270 node.go:539 weedfs:dc1:rack1:dn-ok adds child I1117 09:41:17.164640 node.go:539 weedfs:dc1:rack1 adds child dn-hang I1117 09:41:17.165057 node.go:539 weedfs:dc1:rack1:dn-hang adds child I1117 09:41:17.178800 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8080 I1117 09:41:17.188913 topology_vacuum.go:138 Complete vacuuming 1 on 127.0.0.1:8080 I1117 09:41:17.189210 topology_vacuum.go:162 Start Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:17.192279 topology_vacuum.go:184 Complete Committing vacuum 1 on 127.0.0.1:8080 E1117 09:41:17.444839 topology_vacuum.go:216 Error when checking volume 1 status on 127.0.0.1:8081: rpc error: code = DeadlineExceeded desc = context deadline exceeded === RUN TestVacuumStalledVolumeServerReleasesGuard/cleanup I1117 09:41:17.448656 node.go:539 weedfs adds child dc1 I1117 09:41:17.448901 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:17.450593 node.go:539 weedfs:dc1:rack1 adds child dn-hang I1117 09:41:17.450812 node.go:539 weedfs:dc1:rack1:dn-hang adds child I1117 09:41:17.461089 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8081 E1117 09:41:17.473267 topology_vacuum.go:135 Error when vacuuming 1 on 127.0.0.1:8081: rpc error: code = Unknown desc = compact failed I1117 09:41:17.473640 topology_vacuum.go:242 Start cleaning up 1 on 127.0.0.1:8081 E1117 09:41:17.725072 topology_vacuum.go:252 Error when cleaning up vacuum 1 on 127.0.0.1:8081: rpc error: code = DeadlineExceeded desc = context deadline exceeded --- PASS: TestVacuumStalledVolumeServerReleasesGuard (1.90s) --- PASS: TestVacuumStalledVolumeServerReleasesGuard/check (0.26s) --- PASS: TestVacuumStalledVolumeServerReleasesGuard/compact (0.78s) --- PASS: TestVacuumStalledVolumeServerReleasesGuard/commit (0.28s) --- PASS: TestVacuumStalledVolumeServerReleasesGuard/status (0.30s) --- PASS: TestVacuumStalledVolumeServerReleasesGuard/cleanup (0.28s) === RUN TestVacuumReportsAnotherVacuumRunning I1117 09:41:17.729675 node.go:539 weedfs adds child dc1 I1117 09:41:17.729907 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:17.730369 node.go:539 weedfs:dc1:rack1 adds child dn I1117 09:41:17.730603 node.go:539 weedfs:dc1:rack1:dn adds child I1117 09:41:17.740253 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8080 I1117 09:41:17.747723 topology_vacuum.go:273 Vacuum is already running I1117 09:41:17.751317 topology_vacuum.go:138 Complete vacuuming 1 on 127.0.0.1:8080 I1117 09:41:17.751593 topology_vacuum.go:162 Start Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:17.754252 topology_vacuum.go:184 Complete Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:17.757666 topology_vacuum.go:110 0 Start vacuuming 2 on 127.0.0.1:8080 I1117 09:41:17.767206 topology_vacuum.go:138 Complete vacuuming 2 on 127.0.0.1:8080 I1117 09:41:17.767428 topology_vacuum.go:162 Start Committing vacuum 2 on 127.0.0.1:8080 I1117 09:41:17.770173 topology_vacuum.go:184 Complete Committing vacuum 2 on 127.0.0.1:8080 --- PASS: TestVacuumReportsAnotherVacuumRunning (0.04s) === RUN TestVacuumSkipsTieredReplica I1117 09:41:17.773624 node.go:539 weedfs adds child dc1 I1117 09:41:17.773856 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:17.774173 node.go:539 weedfs:dc1:rack1 adds child dn I1117 09:41:17.774446 node.go:539 weedfs:dc1:rack1:dn adds child I1117 09:41:17.775837 topology_vacuum.go:464 vacuuming read-only volume 1 on explicit request I1117 09:41:17.784948 topology_vacuum.go:110 0 Start vacuuming 2 on 127.0.0.1:8080 I1117 09:41:17.795154 topology_vacuum.go:138 Complete vacuuming 2 on 127.0.0.1:8080 I1117 09:41:17.795642 topology_vacuum.go:162 Start Committing vacuum 2 on 127.0.0.1:8080 I1117 09:41:17.798351 topology_vacuum.go:184 Complete Committing vacuum 2 on 127.0.0.1:8080 --- PASS: TestVacuumSkipsTieredReplica (0.03s) === RUN TestVacuumRackLimitSerializesVolumes I1117 09:41:17.802683 node.go:539 weedfs adds child dc1 I1117 09:41:17.802878 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:17.803197 node.go:539 weedfs:dc1:rack1 adds child dn-1 I1117 09:41:17.803406 node.go:539 weedfs:dc1:rack1:dn-1 adds child I1117 09:41:17.803821 node.go:539 weedfs:dc1:rack1 adds child dn-2 I1117 09:41:17.803999 node.go:539 weedfs:dc1:rack1:dn-2 adds child I1117 09:41:17.818291 topology_vacuum.go:110 0 Start vacuuming 2 on 127.0.0.1:8081 I1117 09:41:18.132055 topology_vacuum.go:138 Complete vacuuming 2 on 127.0.0.1:8081 I1117 09:41:18.132361 topology_vacuum.go:162 Start Committing vacuum 2 on 127.0.0.1:8081 I1117 09:41:18.135437 topology_vacuum.go:184 Complete Committing vacuum 2 on 127.0.0.1:8081 I1117 09:41:18.146252 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8080 I1117 09:41:18.156536 topology_vacuum.go:138 Complete vacuuming 1 on 127.0.0.1:8080 I1117 09:41:18.156832 topology_vacuum.go:162 Start Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:18.160114 topology_vacuum.go:184 Complete Committing vacuum 1 on 127.0.0.1:8080 --- PASS: TestVacuumRackLimitSerializesVolumes (0.36s) === RUN TestVacuumRackLimitScopesRacksByDataCenter I1117 09:41:18.166999 node.go:539 weedfs adds child dc1 I1117 09:41:18.168059 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.168426 node.go:539 weedfs:dc1:rack1 adds child dn-1 I1117 09:41:18.168750 node.go:539 weedfs:dc1:rack1:dn-1 adds child I1117 09:41:18.169003 node.go:539 weedfs adds child dc2 I1117 09:41:18.169162 node.go:539 weedfs:dc2 adds child rack1 I1117 09:41:18.169450 node.go:539 weedfs:dc2:rack1 adds child dn-2 I1117 09:41:18.169646 node.go:539 weedfs:dc2:rack1:dn-2 adds child I1117 09:41:18.182596 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8080 I1117 09:41:18.186578 topology_vacuum.go:110 0 Start vacuuming 2 on 127.0.0.1:8081 I1117 09:41:18.196736 topology_vacuum.go:138 Complete vacuuming 2 on 127.0.0.1:8081 I1117 09:41:18.196723 topology_vacuum.go:138 Complete vacuuming 1 on 127.0.0.1:8080 I1117 09:41:18.196985 topology_vacuum.go:162 Start Committing vacuum 2 on 127.0.0.1:8081 I1117 09:41:18.197102 topology_vacuum.go:162 Start Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:18.199834 topology_vacuum.go:184 Complete Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:18.199857 topology_vacuum.go:184 Complete Committing vacuum 2 on 127.0.0.1:8081 --- PASS: TestVacuumRackLimitScopesRacksByDataCenter (0.04s) === RUN TestVacuumRackLimitSurvivesUnregister I1117 09:41:18.204216 node.go:539 weedfs adds child dc1 I1117 09:41:18.204409 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.204724 node.go:539 weedfs:dc1:rack1 adds child dn-1 I1117 09:41:18.204997 node.go:539 weedfs:dc1:rack1:dn-1 adds child I1117 09:41:18.214870 topology_vacuum.go:110 0 Start vacuuming 1 on 127.0.0.1:8080 I1117 09:41:18.222101 topology_event_handling.go:117 Removing Volume 1 from the dead volume server dn-1 I1117 09:41:18.222332 volume_layout.go:1244 Volume 1 has 0 replica, less than required 1 I1117 09:41:18.222804 node.go:560 weedfs:dc1:rack1 removes dn-1 I1117 09:41:18.226185 topology_vacuum.go:138 Complete vacuuming 1 on 127.0.0.1:8080 I1117 09:41:18.226439 topology_vacuum.go:162 Start Committing vacuum 1 on 127.0.0.1:8080 I1117 09:41:18.229219 topology_vacuum.go:184 Complete Committing vacuum 1 on 127.0.0.1:8080 --- PASS: TestVacuumRackLimitSurvivesUnregister (0.03s) === RUN TestVolumeDigestIsStableAcrossRepeatedHeartbeats I1117 09:41:18.231578 node.go:539 digest adds child dc1 I1117 09:41:18.231791 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.232186 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.232788 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestVolumeDigestIsStableAcrossRepeatedHeartbeats (0.00s) === RUN TestVolumeDigestIsIndependentOfReportOrder I1117 09:41:18.236657 node.go:539 digest adds child dc1 I1117 09:41:18.237104 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.237448 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.237698 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.239136 node.go:539 digest adds child dc1 I1117 09:41:18.239302 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.239592 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.239830 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestVolumeDigestIsIndependentOfReportOrder (0.00s) === RUN TestVolumeDigestTracksEveryReportedField === RUN TestVolumeDigestTracksEveryReportedField/id === RUN TestVolumeDigestTracksEveryReportedField/size === RUN TestVolumeDigestTracksEveryReportedField/collection === RUN TestVolumeDigestTracksEveryReportedField/file_count === RUN TestVolumeDigestTracksEveryReportedField/delete_count === RUN TestVolumeDigestTracksEveryReportedField/deleted_byte_count === RUN TestVolumeDigestTracksEveryReportedField/read_only === RUN TestVolumeDigestTracksEveryReportedField/read_only_can_delete === RUN TestVolumeDigestTracksEveryReportedField/replica_placement === RUN TestVolumeDigestTracksEveryReportedField/version === RUN TestVolumeDigestTracksEveryReportedField/ttl === RUN TestVolumeDigestTracksEveryReportedField/compact_revision === RUN TestVolumeDigestTracksEveryReportedField/modified_at_second === RUN TestVolumeDigestTracksEveryReportedField/remote_storage_name === RUN TestVolumeDigestTracksEveryReportedField/remote_storage_key === RUN TestVolumeDigestTracksEveryReportedField/disk_type === RUN TestVolumeDigestTracksEveryReportedField/disk_id --- PASS: TestVolumeDigestTracksEveryReportedField (0.02s) --- PASS: TestVolumeDigestTracksEveryReportedField/id (0.01s) --- PASS: TestVolumeDigestTracksEveryReportedField/size (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/collection (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/file_count (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/delete_count (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/deleted_byte_count (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/read_only (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/read_only_can_delete (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/replica_placement (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/version (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/ttl (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/compact_revision (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/modified_at_second (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/remote_storage_name (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/remote_storage_key (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/disk_type (0.00s) --- PASS: TestVolumeDigestTracksEveryReportedField/disk_id (0.00s) === RUN TestVolumeDigestFollowsVolumeChanges I1117 09:41:18.266256 node.go:539 digest adds child dc1 I1117 09:41:18.266607 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.266993 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.267475 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.269891 data_node.go:159 Deleting volume id: 2 I1117 09:41:18.270196 topology.go:1124 removing volume info: Id:2, Size:1048576, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:10, DeleteCount:1, DeletedByteCount:128, ReadOnly:false, ModifiedAtSecond:1700000000 from 127.0.0.1:8080 I1117 09:41:18.270578 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:41:18.270795 volume_layout.go:477 volume 2 does not have enough copies --- PASS: TestVolumeDigestFollowsVolumeChanges (0.01s) === RUN TestVolumeDigestEmptiesWithTheNode I1117 09:41:18.272432 node.go:539 digest adds child dc1 I1117 09:41:18.272627 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.273010 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.273267 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.274618 data_node.go:159 Deleting volume id: 1 I1117 09:41:18.274795 data_node.go:159 Deleting volume id: 2 I1117 09:41:18.274975 topology.go:1124 removing volume info: Id:1, Size:1048576, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:10, DeleteCount:1, DeletedByteCount:128, ReadOnly:false, ModifiedAtSecond:1700000000 from 127.0.0.1:8080 I1117 09:41:18.275262 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.275441 volume_layout.go:477 volume 1 does not have enough copies I1117 09:41:18.275601 topology.go:1124 removing volume info: Id:2, Size:1048576, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:10, DeleteCount:1, DeletedByteCount:128, ReadOnly:false, ModifiedAtSecond:1700000000 from 127.0.0.1:8080 I1117 09:41:18.275855 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:41:18.276028 volume_layout.go:477 volume 2 does not have enough copies --- PASS: TestVolumeDigestEmptiesWithTheNode (0.00s) === RUN TestVolumeDigestFollowsDeltaRegistration I1117 09:41:18.277141 node.go:539 digest adds child dc1 I1117 09:41:18.277330 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.277596 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.277820 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.279275 topology.go:1124 removing volume info: Id:2, Size:0, ReplicaPlacement:000, Collection:, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 --- PASS: TestVolumeDigestFollowsDeltaRegistration (0.00s) === RUN TestVolumeDigestMatchesAfterApplyingOnlyChangedVolumes I1117 09:41:18.282360 node.go:539 digest adds child dc1 I1117 09:41:18.282635 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.282887 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.283239 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.292777 node.go:539 digest adds child dc1 I1117 09:41:18.293017 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.293262 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.293572 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestVolumeDigestMatchesAfterApplyingOnlyChangedVolumes (0.02s) === RUN TestVolumeDigestCatchesASilentlyLostVolume I1117 09:41:18.302729 node.go:539 digest adds child dc1 I1117 09:41:18.302903 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.303165 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.303664 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.304666 node.go:539 digest adds child dc1 I1117 09:41:18.304833 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.305184 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.305400 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestVolumeDigestCatchesASilentlyLostVolume (0.00s) === RUN TestVolumeIndexDigestSeesLookupDivergence I1117 09:41:18.306825 node.go:539 digest adds child dc1 I1117 09:41:18.306973 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.307211 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.307412 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.308431 volume_layout.go:1244 Volume 1 has 0 replica, less than required 1 I1117 09:41:18.308577 volume_layout.go:1149 Volume 1 becomes unwritable --- PASS: TestVolumeIndexDigestSeesLookupDivergence (0.00s) === RUN TestVolumeIndexDigestFollowsNodeLifecycle I1117 09:41:18.309881 node.go:539 digest adds child dc1 I1117 09:41:18.310033 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.310233 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.310610 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.311813 data_node.go:159 Deleting volume id: 3 I1117 09:41:18.312041 topology.go:1124 removing volume info: Id:3, Size:1048576, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:10, DeleteCount:1, DeletedByteCount:128, ReadOnly:false, ModifiedAtSecond:1700000000 from 127.0.0.1:8080 I1117 09:41:18.312313 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:41:18.312463 volume_layout.go:477 volume 3 does not have enough copies I1117 09:41:18.313105 topology.go:1124 removing volume info: Id:9, Size:0, ReplicaPlacement:000, Collection:, Version:0, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:41:18.313334 volume_layout.go:1149 Volume 9 becomes unwritable I1117 09:41:18.313460 volume_layout.go:477 volume 9 does not have enough copies I1117 09:41:18.313693 topology_event_handling.go:117 Removing Volume 1 from the dead volume server 127.0.0.1:8080 I1117 09:41:18.313844 volume_layout.go:1244 Volume 1 has 0 replica, less than required 1 I1117 09:41:18.313988 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.314179 topology_event_handling.go:117 Removing Volume 2 from the dead volume server 127.0.0.1:8080 I1117 09:41:18.314314 volume_layout.go:1244 Volume 2 has 0 replica, less than required 1 I1117 09:41:18.314431 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:41:18.315672 node.go:560 digest:dc1:rack1 removes 127.0.0.1:8080 --- PASS: TestVolumeIndexDigestFollowsNodeLifecycle (0.01s) === RUN TestVolumeDigestRefusesDuplicateVolumeIds I1117 09:41:18.316506 node.go:539 digest adds child dc1 I1117 09:41:18.316645 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.316872 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.317277 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestVolumeDigestRefusesDuplicateVolumeIds (0.00s) === RUN TestVolumeIndexDigestFollowsDisplacedLookupEntry I1117 09:41:18.319327 node.go:539 digest adds child dc1 I1117 09:41:18.319497 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.319804 node.go:539 digest:dc1:rack1 adds child n1 I1117 09:41:18.319984 node.go:539 digest:dc1:rack1:n1 adds child W1117 09:41:18.320464 rack.go:96 Volume server with id n2 has ip:port 10.1.2.3:8080 which is used by node n1 I1117 09:41:18.320663 node.go:539 digest:dc1:rack1 adds child n2 I1117 09:41:18.320844 node.go:539 digest:dc1:rack1:n2 adds child --- PASS: TestVolumeIndexDigestFollowsDisplacedLookupEntry (0.00s) === RUN TestVolumeIndexDigestFollowsRemovedLookupEntry I1117 09:41:18.322690 node.go:539 digest adds child dc1 I1117 09:41:18.322841 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.323038 node.go:539 digest:dc1:rack1 adds child n1 I1117 09:41:18.323257 node.go:539 digest:dc1:rack1:n1 adds child W1117 09:41:18.323459 rack.go:96 Volume server with id n2 has ip:port 10.1.2.3:8080 which is used by node n1 I1117 09:41:18.323637 node.go:539 digest:dc1:rack1 adds child n2 I1117 09:41:18.323812 node.go:539 digest:dc1:rack1:n2 adds child I1117 09:41:18.324648 volume_layout.go:1244 Volume 1 has 0 replica, less than required 1 I1117 09:41:18.324784 volume_layout.go:1149 Volume 1 becomes unwritable --- PASS: TestVolumeIndexDigestFollowsRemovedLookupEntry (0.00s) === RUN TestMasterDigestMatchesWhatAVolumeServerReports I1117 09:41:18.337932 node.go:539 digest adds child dc1 I1117 09:41:18.338227 node.go:539 digest:dc1 adds child rack1 I1117 09:41:18.338454 node.go:539 digest:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.338677 node.go:539 digest:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestMasterDigestMatchesWhatAVolumeServerReports (0.02s) === RUN TestVolumeMovedBetweenDisks === RUN TestVolumeMovedBetweenDisks/SameDiskType I1117 09:41:18.342216 node.go:539 move adds child dc1 I1117 09:41:18.342381 node.go:539 move:dc1 adds child rack1 I1117 09:41:18.342678 node.go:539 move:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.343140 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:41:18.343376 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child === RUN TestVolumeMovedBetweenDisks/DifferentDiskType I1117 09:41:18.345313 node.go:539 move adds child dc1 I1117 09:41:18.345521 node.go:539 move:dc1 adds child rack1 I1117 09:41:18.345775 node.go:539 move:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.346149 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.346313 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:41:18.347023 data_node.go:159 Deleting volume id: 1 I1117 09:41:18.347393 topology.go:1124 removing volume info: Id:1, Size:1024, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:41:18.347652 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.347799 volume_layout.go:477 volume 1 does not have enough copies === RUN TestVolumeMovedBetweenDisks/BackAgain I1117 09:41:18.348860 node.go:539 move adds child dc1 I1117 09:41:18.349014 node.go:539 move:dc1 adds child rack1 I1117 09:41:18.349274 node.go:539 move:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.349659 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.349899 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:41:18.350527 data_node.go:159 Deleting volume id: 1 I1117 09:41:18.350858 topology.go:1124 removing volume info: Id:1, Size:1024, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:41:18.351093 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.351238 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestVolumeMovedBetweenDisks (0.01s) --- PASS: TestVolumeMovedBetweenDisks/SameDiskType (0.00s) --- PASS: TestVolumeMovedBetweenDisks/DifferentDiskType (0.00s) --- PASS: TestVolumeMovedBetweenDisks/BackAgain (0.00s) === RUN TestVolumeReportedOnTwoDiskTypesIsKept I1117 09:41:18.352421 node.go:539 move adds child dc1 I1117 09:41:18.352565 node.go:539 move:dc1 adds child rack1 I1117 09:41:18.352760 node.go:539 move:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.353199 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.353433 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:41:18.354809 data_node.go:159 Deleting volume id: 1 I1117 09:41:18.354997 topology.go:1124 removing volume info: Id:1, Size:1024, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:41:18.355214 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.355359 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestVolumeReportedOnTwoDiskTypesIsKept (0.00s) === RUN TestVolumeReportedTwiceOnOneDiskTypeIsFlagged I1117 09:41:18.356428 node.go:539 move adds child dc1 I1117 09:41:18.356573 node.go:539 move:dc1 adds child rack1 I1117 09:41:18.356774 node.go:539 move:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.356991 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.357181 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child ssd --- PASS: TestVolumeReportedTwiceOnOneDiskTypeIsFlagged (0.00s) === RUN TestVolumeDigestSurvivesADiskMove I1117 09:41:18.358629 node.go:539 move adds child dc1 I1117 09:41:18.358770 node.go:539 move:dc1 adds child rack1 I1117 09:41:18.358955 node.go:539 move:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.359217 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:18.359649 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:41:18.360304 data_node.go:159 Deleting volume id: 1 I1117 09:41:18.360650 topology.go:1124 removing volume info: Id:1, Size:1024, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 127.0.0.1:8080 I1117 09:41:18.360871 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.361020 volume_layout.go:477 volume 1 does not have enough copies I1117 09:41:18.361418 node.go:539 move adds child dc1 I1117 09:41:18.361568 node.go:539 move:dc1 adds child rack1 I1117 09:41:18.361765 node.go:539 move:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:18.361939 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child ssd I1117 09:41:18.362150 node.go:539 move:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestVolumeDigestSurvivesADiskMove (0.00s) === RUN TestVolumeFilterSelects I1117 09:41:18.363572 node.go:539 filter adds child dc1 I1117 09:41:18.363742 node.go:539 filter:dc1 adds child rack1 I1117 09:41:18.364014 node.go:539 filter:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:41:18.364195 node.go:539 filter:dc1:rack1:10.0.0.1:8080 adds child === RUN TestVolumeFilterSelects/no_filter_takes_everything === RUN TestVolumeFilterSelects/one_collection === RUN TestVolumeFilterSelects/the_default_collection === RUN TestVolumeFilterSelects/a_collection_nothing_is_in === RUN TestVolumeFilterSelects/one_volume === RUN TestVolumeFilterSelects/one_ec_volume === RUN TestVolumeFilterSelects/both,_agreeing === RUN TestVolumeFilterSelects/both,_disagreeing --- PASS: TestVolumeFilterSelects (0.01s) --- PASS: TestVolumeFilterSelects/no_filter_takes_everything (0.00s) --- PASS: TestVolumeFilterSelects/one_collection (0.00s) --- PASS: TestVolumeFilterSelects/the_default_collection (0.00s) --- PASS: TestVolumeFilterSelects/a_collection_nothing_is_in (0.00s) --- PASS: TestVolumeFilterSelects/one_volume (0.00s) --- PASS: TestVolumeFilterSelects/one_ec_volume (0.00s) --- PASS: TestVolumeFilterSelects/both,_agreeing (0.00s) --- PASS: TestVolumeFilterSelects/both,_disagreeing (0.00s) === RUN TestVolumeFilterVolumeIds I1117 09:41:18.377097 node.go:539 filter adds child dc1 I1117 09:41:18.377298 node.go:539 filter:dc1 adds child rack1 I1117 09:41:18.377495 node.go:539 filter:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:41:18.377701 node.go:539 filter:dc1:rack1:10.0.0.1:8080 adds child === RUN TestVolumeFilterVolumeIds/no_id_asked === RUN TestVolumeFilterVolumeIds/one_regular_volume_asked === RUN TestVolumeFilterVolumeIds/one_ec_volume_asked === RUN TestVolumeFilterVolumeIds/both_kinds_asked === RUN TestVolumeFilterVolumeIds/every_volume_asked === RUN TestVolumeFilterVolumeIds/a_missing_id === RUN TestVolumeFilterVolumeIds/a_found_and_a_missing_id --- PASS: TestVolumeFilterVolumeIds (0.01s) --- PASS: TestVolumeFilterVolumeIds/no_id_asked (0.00s) --- PASS: TestVolumeFilterVolumeIds/one_regular_volume_asked (0.00s) --- PASS: TestVolumeFilterVolumeIds/one_ec_volume_asked (0.00s) --- PASS: TestVolumeFilterVolumeIds/both_kinds_asked (0.00s) --- PASS: TestVolumeFilterVolumeIds/every_volume_asked (0.00s) --- PASS: TestVolumeFilterVolumeIds/a_missing_id (0.00s) --- PASS: TestVolumeFilterVolumeIds/a_found_and_a_missing_id (0.00s) === RUN TestVolumeFilterRemoteStorageNameWildcards I1117 09:41:18.388297 node.go:539 filter adds child dc1 I1117 09:41:18.388536 node.go:539 filter:dc1 adds child rack1 I1117 09:41:18.388857 node.go:539 filter:dc1:rack1 adds child 10.0.0.2:8080 I1117 09:41:18.389066 node.go:539 filter:dc1:rack1:10.0.0.2:8080 adds child === RUN TestVolumeFilterRemoteStorageNameWildcards/no_remote_storage_asked === RUN TestVolumeFilterRemoteStorageNameWildcards/an_exact_name === RUN TestVolumeFilterRemoteStorageNameWildcards/a_wildcarded_storage === RUN TestVolumeFilterRemoteStorageNameWildcards/a_wildcarded_tier === RUN TestVolumeFilterRemoteStorageNameWildcards/every_tiered_volume === RUN TestVolumeFilterRemoteStorageNameWildcards/a_name_no_volume_is_on === RUN TestVolumeFilterRemoteStorageNameWildcards/the_local_ones_only --- PASS: TestVolumeFilterRemoteStorageNameWildcards (0.01s) --- PASS: TestVolumeFilterRemoteStorageNameWildcards/no_remote_storage_asked (0.00s) --- PASS: TestVolumeFilterRemoteStorageNameWildcards/an_exact_name (0.00s) --- PASS: TestVolumeFilterRemoteStorageNameWildcards/a_wildcarded_storage (0.00s) --- PASS: TestVolumeFilterRemoteStorageNameWildcards/a_wildcarded_tier (0.00s) --- PASS: TestVolumeFilterRemoteStorageNameWildcards/every_tiered_volume (0.00s) --- PASS: TestVolumeFilterRemoteStorageNameWildcards/a_name_no_volume_is_on (0.00s) --- PASS: TestVolumeFilterRemoteStorageNameWildcards/the_local_ones_only (0.00s) === RUN TestVolumeFilterKeepsTheTopology I1117 09:41:18.399657 node.go:539 filter adds child dc1 I1117 09:41:18.400040 node.go:539 filter:dc1 adds child rack1 I1117 09:41:18.400340 node.go:539 filter:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:41:18.400619 node.go:539 filter:dc1:rack1:10.0.0.1:8080 adds child --- PASS: TestVolumeFilterKeepsTheTopology (0.00s) === RUN TestVolumeFilterKeepsTheDiskIdWhenNothingMatches I1117 09:41:18.403666 node.go:539 filter adds child dc1 I1117 09:41:18.404032 node.go:539 filter:dc1 adds child rack1 I1117 09:41:18.404327 node.go:539 filter:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:41:18.404556 node.go:539 filter:dc1:rack1:10.0.0.1:8080 adds child --- PASS: TestVolumeFilterKeepsTheDiskIdWhenNothingMatches (0.00s) === RUN TestNewVolumeFilterReadsTheRequest === RUN TestNewVolumeFilterReadsTheRequest/an_empty_request === RUN TestNewVolumeFilterReadsTheRequest/an_empty_collection === RUN TestNewVolumeFilterReadsTheRequest/a_named_collection === RUN TestNewVolumeFilterReadsTheRequest/the_default_collection === RUN TestNewVolumeFilterReadsTheRequest/both --- PASS: TestNewVolumeFilterReadsTheRequest (0.00s) --- PASS: TestNewVolumeFilterReadsTheRequest/an_empty_request (0.00s) --- PASS: TestNewVolumeFilterReadsTheRequest/an_empty_collection (0.00s) --- PASS: TestNewVolumeFilterReadsTheRequest/a_named_collection (0.00s) --- PASS: TestNewVolumeFilterReadsTheRequest/the_default_collection (0.00s) --- PASS: TestNewVolumeFilterReadsTheRequest/both (0.00s) === RUN TestNewVolumeFilterReadsTheRemoteStorageRequest === RUN TestNewVolumeFilterReadsTheRemoteStorageRequest/an_empty_request === RUN TestNewVolumeFilterReadsTheRemoteStorageRequest/an_empty_remote_storage_name === RUN TestNewVolumeFilterReadsTheRemoteStorageRequest/a_named_remote_storage === RUN TestNewVolumeFilterReadsTheRemoteStorageRequest/a_wildcarded_storage === RUN TestNewVolumeFilterReadsTheRemoteStorageRequest/the_local_volumes_only === RUN TestNewVolumeFilterReadsTheRemoteStorageRequest/both --- PASS: TestNewVolumeFilterReadsTheRemoteStorageRequest (0.00s) --- PASS: TestNewVolumeFilterReadsTheRemoteStorageRequest/an_empty_request (0.00s) --- PASS: TestNewVolumeFilterReadsTheRemoteStorageRequest/an_empty_remote_storage_name (0.00s) --- PASS: TestNewVolumeFilterReadsTheRemoteStorageRequest/a_named_remote_storage (0.00s) --- PASS: TestNewVolumeFilterReadsTheRemoteStorageRequest/a_wildcarded_storage (0.00s) --- PASS: TestNewVolumeFilterReadsTheRemoteStorageRequest/the_local_volumes_only (0.00s) --- PASS: TestNewVolumeFilterReadsTheRemoteStorageRequest/both (0.00s) === RUN TestNewVolumeFilterReadsTheVolumeIds === RUN TestNewVolumeFilterReadsTheVolumeIds/an_empty_request === RUN TestNewVolumeFilterReadsTheVolumeIds/one_id === RUN TestNewVolumeFilterReadsTheVolumeIds/a_list_of_ids === RUN TestNewVolumeFilterReadsTheVolumeIds/duplicates === RUN TestNewVolumeFilterReadsTheVolumeIds/a_zero_among_the_ids --- PASS: TestNewVolumeFilterReadsTheVolumeIds (0.00s) --- PASS: TestNewVolumeFilterReadsTheVolumeIds/an_empty_request (0.00s) --- PASS: TestNewVolumeFilterReadsTheVolumeIds/one_id (0.00s) --- PASS: TestNewVolumeFilterReadsTheVolumeIds/a_list_of_ids (0.00s) --- PASS: TestNewVolumeFilterReadsTheVolumeIds/duplicates (0.00s) --- PASS: TestNewVolumeFilterReadsTheVolumeIds/a_zero_among_the_ids (0.00s) === RUN TestNewVolumeFilterReadsTopologyOnly I1117 09:41:18.419751 node.go:539 filter adds child dc1 I1117 09:41:18.419992 node.go:539 filter:dc1 adds child rack1 I1117 09:41:18.420251 node.go:539 filter:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:41:18.420541 node.go:539 filter:dc1:rack1:10.0.0.1:8080 adds child --- PASS: TestNewVolumeFilterReadsTopologyOnly (0.00s) === RUN TestNewVolumeFilterRefusesTopologyOnlyWithSelectors === RUN TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/a_collection === RUN TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/volume_ids === RUN TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/the_default_collection === RUN TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/a_remote_storage === RUN TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/the_local_volumes --- PASS: TestNewVolumeFilterRefusesTopologyOnlyWithSelectors (0.00s) --- PASS: TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/a_collection (0.00s) --- PASS: TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/volume_ids (0.00s) --- PASS: TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/the_default_collection (0.00s) --- PASS: TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/a_remote_storage (0.00s) --- PASS: TestNewVolumeFilterRefusesTopologyOnlyWithSelectors/the_local_volumes (0.00s) === RUN TestVolumeFilterListsWhileVolumesChange I1117 09:41:18.428512 node.go:539 filter adds child dc1 I1117 09:41:18.428767 node.go:539 filter:dc1 adds child rack1 I1117 09:41:18.429044 node.go:539 filter:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:41:18.429272 node.go:539 filter:dc1:rack1:10.0.0.1:8080 adds child I1117 09:41:18.432175 data_node.go:159 Deleting volume id: 1 I1117 09:41:18.432578 data_node.go:159 Deleting volume id: 2 I1117 09:41:18.432724 data_node.go:159 Deleting volume id: 3 I1117 09:41:18.433158 topology.go:1124 removing volume info: Id:1, Size:1000, ReplicaPlacement:000, Collection:, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.433504 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.433691 volume_layout.go:477 volume 1 does not have enough copies I1117 09:41:18.433906 topology.go:1124 removing volume info: Id:2, Size:2000, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.434151 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:41:18.434321 volume_layout.go:477 volume 2 does not have enough copies I1117 09:41:18.434468 topology.go:1124 removing volume info: Id:3, Size:3000, ReplicaPlacement:000, Collection:other, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.434705 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:41:18.434848 volume_layout.go:477 volume 3 does not have enough copies I1117 09:41:18.435275 data_node.go:159 Deleting volume id: 100 I1117 09:41:18.435657 topology.go:1124 removing volume info: Id:100, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.435908 volume_layout.go:1149 Volume 100 becomes unwritable I1117 09:41:18.436074 volume_layout.go:477 volume 100 does not have enough copies I1117 09:41:18.436362 data_node.go:159 Deleting volume id: 101 I1117 09:41:18.436710 topology.go:1124 removing volume info: Id:101, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.436950 volume_layout.go:1149 Volume 101 becomes unwritable I1117 09:41:18.437109 volume_layout.go:477 volume 101 does not have enough copies I1117 09:41:18.437410 data_node.go:159 Deleting volume id: 102 I1117 09:41:18.437739 topology.go:1124 removing volume info: Id:102, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.437980 volume_layout.go:1149 Volume 102 becomes unwritable I1117 09:41:18.438151 volume_layout.go:477 volume 102 does not have enough copies I1117 09:41:18.438699 data_node.go:159 Deleting volume id: 103 I1117 09:41:18.439058 topology.go:1124 removing volume info: Id:103, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.439307 volume_layout.go:1149 Volume 103 becomes unwritable I1117 09:41:18.439461 volume_layout.go:477 volume 103 does not have enough copies I1117 09:41:18.439765 data_node.go:159 Deleting volume id: 104 I1117 09:41:18.440089 topology.go:1124 removing volume info: Id:104, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.440334 volume_layout.go:1149 Volume 104 becomes unwritable I1117 09:41:18.440500 volume_layout.go:477 volume 104 does not have enough copies I1117 09:41:18.440856 data_node.go:159 Deleting volume id: 105 I1117 09:41:18.441247 topology.go:1124 removing volume info: Id:105, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.441495 volume_layout.go:1149 Volume 105 becomes unwritable I1117 09:41:18.441645 volume_layout.go:477 volume 105 does not have enough copies I1117 09:41:18.441947 data_node.go:159 Deleting volume id: 106 I1117 09:41:18.442272 topology.go:1124 removing volume info: Id:106, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.442513 volume_layout.go:1149 Volume 106 becomes unwritable I1117 09:41:18.442676 volume_layout.go:477 volume 106 does not have enough copies I1117 09:41:18.443001 data_node.go:159 Deleting volume id: 107 I1117 09:41:18.443326 topology.go:1124 removing volume info: Id:107, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.443542 volume_layout.go:1149 Volume 107 becomes unwritable I1117 09:41:18.443687 volume_layout.go:477 volume 107 does not have enough copies I1117 09:41:18.443979 data_node.go:159 Deleting volume id: 108 I1117 09:41:18.444327 topology.go:1124 removing volume info: Id:108, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.444565 volume_layout.go:1149 Volume 108 becomes unwritable I1117 09:41:18.444738 volume_layout.go:477 volume 108 does not have enough copies I1117 09:41:18.445026 data_node.go:159 Deleting volume id: 109 I1117 09:41:18.445404 topology.go:1124 removing volume info: Id:109, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.445658 volume_layout.go:1149 Volume 109 becomes unwritable I1117 09:41:18.445831 volume_layout.go:477 volume 109 does not have enough copies I1117 09:41:18.446142 data_node.go:159 Deleting volume id: 110 I1117 09:41:18.446492 topology.go:1124 removing volume info: Id:110, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.446738 volume_layout.go:1149 Volume 110 becomes unwritable I1117 09:41:18.446906 volume_layout.go:477 volume 110 does not have enough copies I1117 09:41:18.447322 data_node.go:159 Deleting volume id: 111 I1117 09:41:18.447734 topology.go:1124 removing volume info: Id:111, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.448049 volume_layout.go:1149 Volume 111 becomes unwritable I1117 09:41:18.448207 volume_layout.go:477 volume 111 does not have enough copies I1117 09:41:18.448488 data_node.go:159 Deleting volume id: 112 I1117 09:41:18.448776 topology.go:1124 removing volume info: Id:112, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.449011 volume_layout.go:1149 Volume 112 becomes unwritable I1117 09:41:18.449162 volume_layout.go:477 volume 112 does not have enough copies I1117 09:41:18.449609 data_node.go:159 Deleting volume id: 113 I1117 09:41:18.449915 topology.go:1124 removing volume info: Id:113, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.450159 volume_layout.go:1149 Volume 113 becomes unwritable I1117 09:41:18.450309 volume_layout.go:477 volume 113 does not have enough copies I1117 09:41:18.450559 data_node.go:159 Deleting volume id: 114 I1117 09:41:18.450834 topology.go:1124 removing volume info: Id:114, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.451056 volume_layout.go:1149 Volume 114 becomes unwritable I1117 09:41:18.451215 volume_layout.go:477 volume 114 does not have enough copies I1117 09:41:18.451462 data_node.go:159 Deleting volume id: 115 I1117 09:41:18.451816 topology.go:1124 removing volume info: Id:115, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.452058 volume_layout.go:1149 Volume 115 becomes unwritable I1117 09:41:18.452205 volume_layout.go:477 volume 115 does not have enough copies I1117 09:41:18.452481 data_node.go:159 Deleting volume id: 116 I1117 09:41:18.452793 topology.go:1124 removing volume info: Id:116, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.453027 volume_layout.go:1149 Volume 116 becomes unwritable I1117 09:41:18.453172 volume_layout.go:477 volume 116 does not have enough copies I1117 09:41:18.453444 data_node.go:159 Deleting volume id: 117 I1117 09:41:18.453724 topology.go:1124 removing volume info: Id:117, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.453946 volume_layout.go:1149 Volume 117 becomes unwritable I1117 09:41:18.454102 volume_layout.go:477 volume 117 does not have enough copies I1117 09:41:18.454433 data_node.go:159 Deleting volume id: 118 I1117 09:41:18.454733 topology.go:1124 removing volume info: Id:118, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.454967 volume_layout.go:1149 Volume 118 becomes unwritable I1117 09:41:18.455113 volume_layout.go:477 volume 118 does not have enough copies I1117 09:41:18.455374 data_node.go:159 Deleting volume id: 119 I1117 09:41:18.455651 topology.go:1124 removing volume info: Id:119, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.455872 volume_layout.go:1149 Volume 119 becomes unwritable I1117 09:41:18.456017 volume_layout.go:477 volume 119 does not have enough copies I1117 09:41:18.456331 data_node.go:159 Deleting volume id: 120 I1117 09:41:18.456641 topology.go:1124 removing volume info: Id:120, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.456872 volume_layout.go:1149 Volume 120 becomes unwritable I1117 09:41:18.457009 volume_layout.go:477 volume 120 does not have enough copies I1117 09:41:18.457259 data_node.go:159 Deleting volume id: 121 I1117 09:41:18.457518 topology.go:1124 removing volume info: Id:121, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.457739 volume_layout.go:1149 Volume 121 becomes unwritable I1117 09:41:18.457890 volume_layout.go:477 volume 121 does not have enough copies I1117 09:41:18.458159 data_node.go:159 Deleting volume id: 122 I1117 09:41:18.458453 topology.go:1124 removing volume info: Id:122, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.458675 volume_layout.go:1149 Volume 122 becomes unwritable I1117 09:41:18.458827 volume_layout.go:477 volume 122 does not have enough copies I1117 09:41:18.459072 data_node.go:159 Deleting volume id: 123 I1117 09:41:18.459347 topology.go:1124 removing volume info: Id:123, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.459571 volume_layout.go:1149 Volume 123 becomes unwritable I1117 09:41:18.459725 volume_layout.go:477 volume 123 does not have enough copies I1117 09:41:18.459990 data_node.go:159 Deleting volume id: 124 I1117 09:41:18.460476 topology.go:1124 removing volume info: Id:124, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.460708 volume_layout.go:1149 Volume 124 becomes unwritable I1117 09:41:18.460941 volume_layout.go:477 volume 124 does not have enough copies I1117 09:41:18.461185 data_node.go:159 Deleting volume id: 125 I1117 09:41:18.461515 topology.go:1124 removing volume info: Id:125, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.461751 volume_layout.go:1149 Volume 125 becomes unwritable I1117 09:41:18.461901 volume_layout.go:477 volume 125 does not have enough copies I1117 09:41:18.462142 data_node.go:159 Deleting volume id: 126 I1117 09:41:18.462456 topology.go:1124 removing volume info: Id:126, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.462693 volume_layout.go:1149 Volume 126 becomes unwritable I1117 09:41:18.462850 volume_layout.go:477 volume 126 does not have enough copies I1117 09:41:18.463103 data_node.go:159 Deleting volume id: 127 I1117 09:41:18.463389 topology.go:1124 removing volume info: Id:127, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.463623 volume_layout.go:1149 Volume 127 becomes unwritable I1117 09:41:18.463759 volume_layout.go:477 volume 127 does not have enough copies I1117 09:41:18.464017 data_node.go:159 Deleting volume id: 128 I1117 09:41:18.464330 topology.go:1124 removing volume info: Id:128, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.464567 volume_layout.go:1149 Volume 128 becomes unwritable I1117 09:41:18.464719 volume_layout.go:477 volume 128 does not have enough copies I1117 09:41:18.464990 data_node.go:159 Deleting volume id: 129 I1117 09:41:18.465294 topology.go:1124 removing volume info: Id:129, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.465531 volume_layout.go:1149 Volume 129 becomes unwritable I1117 09:41:18.465681 volume_layout.go:477 volume 129 does not have enough copies I1117 09:41:18.465941 data_node.go:159 Deleting volume id: 130 I1117 09:41:18.466218 topology.go:1124 removing volume info: Id:130, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.466438 volume_layout.go:1149 Volume 130 becomes unwritable I1117 09:41:18.466594 volume_layout.go:477 volume 130 does not have enough copies I1117 09:41:18.466917 data_node.go:159 Deleting volume id: 131 I1117 09:41:18.467224 topology.go:1124 removing volume info: Id:131, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.467447 volume_layout.go:1149 Volume 131 becomes unwritable I1117 09:41:18.467603 volume_layout.go:477 volume 131 does not have enough copies I1117 09:41:18.467856 data_node.go:159 Deleting volume id: 132 I1117 09:41:18.468146 topology.go:1124 removing volume info: Id:132, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.468379 volume_layout.go:1149 Volume 132 becomes unwritable I1117 09:41:18.468524 volume_layout.go:477 volume 132 does not have enough copies I1117 09:41:18.468801 data_node.go:159 Deleting volume id: 133 I1117 09:41:18.469096 topology.go:1124 removing volume info: Id:133, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.469365 volume_layout.go:1149 Volume 133 becomes unwritable I1117 09:41:18.469508 volume_layout.go:477 volume 133 does not have enough copies I1117 09:41:18.469772 data_node.go:159 Deleting volume id: 134 I1117 09:41:18.470046 topology.go:1124 removing volume info: Id:134, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.470275 volume_layout.go:1149 Volume 134 becomes unwritable I1117 09:41:18.470439 volume_layout.go:477 volume 134 does not have enough copies I1117 09:41:18.470679 data_node.go:159 Deleting volume id: 135 I1117 09:41:18.471024 topology.go:1124 removing volume info: Id:135, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.471264 volume_layout.go:1149 Volume 135 becomes unwritable I1117 09:41:18.471410 volume_layout.go:477 volume 135 does not have enough copies I1117 09:41:18.471691 data_node.go:159 Deleting volume id: 136 I1117 09:41:18.471971 topology.go:1124 removing volume info: Id:136, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.472197 volume_layout.go:1149 Volume 136 becomes unwritable I1117 09:41:18.472334 volume_layout.go:477 volume 136 does not have enough copies I1117 09:41:18.472575 data_node.go:159 Deleting volume id: 137 I1117 09:41:18.472883 topology.go:1124 removing volume info: Id:137, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.473129 volume_layout.go:1149 Volume 137 becomes unwritable I1117 09:41:18.473281 volume_layout.go:477 volume 137 does not have enough copies I1117 09:41:18.473703 data_node.go:159 Deleting volume id: 138 I1117 09:41:18.474138 topology.go:1124 removing volume info: Id:138, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.474397 volume_layout.go:1149 Volume 138 becomes unwritable I1117 09:41:18.474575 volume_layout.go:477 volume 138 does not have enough copies I1117 09:41:18.474912 data_node.go:159 Deleting volume id: 139 I1117 09:41:18.475258 topology.go:1124 removing volume info: Id:139, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.475507 volume_layout.go:1149 Volume 139 becomes unwritable I1117 09:41:18.475677 volume_layout.go:477 volume 139 does not have enough copies I1117 09:41:18.475963 data_node.go:159 Deleting volume id: 140 I1117 09:41:18.476290 topology.go:1124 removing volume info: Id:140, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.476590 volume_layout.go:1149 Volume 140 becomes unwritable I1117 09:41:18.476767 volume_layout.go:477 volume 140 does not have enough copies I1117 09:41:18.477065 data_node.go:159 Deleting volume id: 141 I1117 09:41:18.477435 topology.go:1124 removing volume info: Id:141, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.477683 volume_layout.go:1149 Volume 141 becomes unwritable I1117 09:41:18.477852 volume_layout.go:477 volume 141 does not have enough copies I1117 09:41:18.478138 data_node.go:159 Deleting volume id: 142 I1117 09:41:18.478471 topology.go:1124 removing volume info: Id:142, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.478711 volume_layout.go:1149 Volume 142 becomes unwritable I1117 09:41:18.478879 volume_layout.go:477 volume 142 does not have enough copies I1117 09:41:18.479231 data_node.go:159 Deleting volume id: 143 I1117 09:41:18.479536 topology.go:1124 removing volume info: Id:143, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.479782 volume_layout.go:1149 Volume 143 becomes unwritable I1117 09:41:18.479954 volume_layout.go:477 volume 143 does not have enough copies I1117 09:41:18.480335 data_node.go:159 Deleting volume id: 144 I1117 09:41:18.480685 topology.go:1124 removing volume info: Id:144, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.480927 volume_layout.go:1149 Volume 144 becomes unwritable I1117 09:41:18.481085 volume_layout.go:477 volume 144 does not have enough copies I1117 09:41:18.481369 data_node.go:159 Deleting volume id: 145 I1117 09:41:18.481693 topology.go:1124 removing volume info: Id:145, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.481937 volume_layout.go:1149 Volume 145 becomes unwritable I1117 09:41:18.482107 volume_layout.go:477 volume 145 does not have enough copies I1117 09:41:18.482429 data_node.go:159 Deleting volume id: 146 I1117 09:41:18.482764 topology.go:1124 removing volume info: Id:146, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.483008 volume_layout.go:1149 Volume 146 becomes unwritable I1117 09:41:18.483187 volume_layout.go:477 volume 146 does not have enough copies I1117 09:41:18.483475 data_node.go:159 Deleting volume id: 147 I1117 09:41:18.483798 topology.go:1124 removing volume info: Id:147, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.484043 volume_layout.go:1149 Volume 147 becomes unwritable I1117 09:41:18.484209 volume_layout.go:477 volume 147 does not have enough copies I1117 09:41:18.484517 data_node.go:159 Deleting volume id: 148 I1117 09:41:18.484858 topology.go:1124 removing volume info: Id:148, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.485100 volume_layout.go:1149 Volume 148 becomes unwritable I1117 09:41:18.485309 volume_layout.go:477 volume 148 does not have enough copies I1117 09:41:18.485591 data_node.go:159 Deleting volume id: 149 I1117 09:41:18.485958 topology.go:1124 removing volume info: Id:149, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.486203 volume_layout.go:1149 Volume 149 becomes unwritable I1117 09:41:18.486372 volume_layout.go:477 volume 149 does not have enough copies I1117 09:41:18.486674 data_node.go:159 Deleting volume id: 100 I1117 09:41:18.487045 topology.go:1124 removing volume info: Id:100, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.487293 volume_layout.go:1149 Volume 100 becomes unwritable I1117 09:41:18.487461 volume_layout.go:477 volume 100 does not have enough copies I1117 09:41:18.487761 data_node.go:159 Deleting volume id: 101 I1117 09:41:18.488092 topology.go:1124 removing volume info: Id:101, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.488337 volume_layout.go:1149 Volume 101 becomes unwritable I1117 09:41:18.488497 volume_layout.go:477 volume 101 does not have enough copies I1117 09:41:18.488787 data_node.go:159 Deleting volume id: 102 I1117 09:41:18.489113 topology.go:1124 removing volume info: Id:102, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.489353 volume_layout.go:1149 Volume 102 becomes unwritable I1117 09:41:18.489528 volume_layout.go:477 volume 102 does not have enough copies I1117 09:41:18.489919 data_node.go:159 Deleting volume id: 103 I1117 09:41:18.490271 topology.go:1124 removing volume info: Id:103, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.490515 volume_layout.go:1149 Volume 103 becomes unwritable I1117 09:41:18.490690 volume_layout.go:477 volume 103 does not have enough copies I1117 09:41:18.490998 data_node.go:159 Deleting volume id: 104 I1117 09:41:18.491438 topology.go:1124 removing volume info: Id:104, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.491679 volume_layout.go:1149 Volume 104 becomes unwritable I1117 09:41:18.491850 volume_layout.go:477 volume 104 does not have enough copies I1117 09:41:18.492175 data_node.go:159 Deleting volume id: 105 I1117 09:41:18.492527 topology.go:1124 removing volume info: Id:105, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.492768 volume_layout.go:1149 Volume 105 becomes unwritable I1117 09:41:18.492940 volume_layout.go:477 volume 105 does not have enough copies I1117 09:41:18.493242 data_node.go:159 Deleting volume id: 106 I1117 09:41:18.493563 topology.go:1124 removing volume info: Id:106, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.493804 volume_layout.go:1149 Volume 106 becomes unwritable I1117 09:41:18.493972 volume_layout.go:477 volume 106 does not have enough copies I1117 09:41:18.494357 data_node.go:159 Deleting volume id: 107 I1117 09:41:18.494698 topology.go:1124 removing volume info: Id:107, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.494945 volume_layout.go:1149 Volume 107 becomes unwritable I1117 09:41:18.495107 volume_layout.go:477 volume 107 does not have enough copies I1117 09:41:18.495533 data_node.go:159 Deleting volume id: 108 I1117 09:41:18.495979 topology.go:1124 removing volume info: Id:108, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.496245 volume_layout.go:1149 Volume 108 becomes unwritable I1117 09:41:18.496394 volume_layout.go:477 volume 108 does not have enough copies I1117 09:41:18.496670 data_node.go:159 Deleting volume id: 109 I1117 09:41:18.496953 topology.go:1124 removing volume info: Id:109, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.497183 volume_layout.go:1149 Volume 109 becomes unwritable I1117 09:41:18.497341 volume_layout.go:477 volume 109 does not have enough copies I1117 09:41:18.497582 data_node.go:159 Deleting volume id: 110 I1117 09:41:18.497902 topology.go:1124 removing volume info: Id:110, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.498142 volume_layout.go:1149 Volume 110 becomes unwritable I1117 09:41:18.498281 volume_layout.go:477 volume 110 does not have enough copies I1117 09:41:18.498518 data_node.go:159 Deleting volume id: 111 I1117 09:41:18.498819 topology.go:1124 removing volume info: Id:111, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.499056 volume_layout.go:1149 Volume 111 becomes unwritable I1117 09:41:18.499241 volume_layout.go:477 volume 111 does not have enough copies I1117 09:41:18.499502 data_node.go:159 Deleting volume id: 112 I1117 09:41:18.499805 topology.go:1124 removing volume info: Id:112, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.500034 volume_layout.go:1149 Volume 112 becomes unwritable I1117 09:41:18.500174 volume_layout.go:477 volume 112 does not have enough copies I1117 09:41:18.500481 data_node.go:159 Deleting volume id: 113 I1117 09:41:18.500796 topology.go:1124 removing volume info: Id:113, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.501035 volume_layout.go:1149 Volume 113 becomes unwritable I1117 09:41:18.501188 volume_layout.go:477 volume 113 does not have enough copies I1117 09:41:18.501445 data_node.go:159 Deleting volume id: 114 I1117 09:41:18.501726 topology.go:1124 removing volume info: Id:114, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.501955 volume_layout.go:1149 Volume 114 becomes unwritable I1117 09:41:18.502110 volume_layout.go:477 volume 114 does not have enough copies I1117 09:41:18.502382 data_node.go:159 Deleting volume id: 115 I1117 09:41:18.502695 topology.go:1124 removing volume info: Id:115, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.502927 volume_layout.go:1149 Volume 115 becomes unwritable I1117 09:41:18.503098 volume_layout.go:477 volume 115 does not have enough copies I1117 09:41:18.503342 data_node.go:159 Deleting volume id: 116 I1117 09:41:18.503615 topology.go:1124 removing volume info: Id:116, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.503846 volume_layout.go:1149 Volume 116 becomes unwritable I1117 09:41:18.503997 volume_layout.go:477 volume 116 does not have enough copies I1117 09:41:18.504224 data_node.go:159 Deleting volume id: 117 I1117 09:41:18.504600 topology.go:1124 removing volume info: Id:117, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.504858 volume_layout.go:1149 Volume 117 becomes unwritable I1117 09:41:18.505034 volume_layout.go:477 volume 117 does not have enough copies I1117 09:41:18.505305 data_node.go:159 Deleting volume id: 118 I1117 09:41:18.505589 topology.go:1124 removing volume info: Id:118, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.505791 volume_layout.go:1149 Volume 118 becomes unwritable I1117 09:41:18.505933 volume_layout.go:477 volume 118 does not have enough copies I1117 09:41:18.506176 data_node.go:159 Deleting volume id: 119 I1117 09:41:18.506497 topology.go:1124 removing volume info: Id:119, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.506719 volume_layout.go:1149 Volume 119 becomes unwritable I1117 09:41:18.506877 volume_layout.go:477 volume 119 does not have enough copies I1117 09:41:18.507163 data_node.go:159 Deleting volume id: 120 I1117 09:41:18.507524 topology.go:1124 removing volume info: Id:120, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.507747 volume_layout.go:1149 Volume 120 becomes unwritable I1117 09:41:18.507902 volume_layout.go:477 volume 120 does not have enough copies I1117 09:41:18.508199 data_node.go:159 Deleting volume id: 121 I1117 09:41:18.508505 topology.go:1124 removing volume info: Id:121, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.508707 volume_layout.go:1149 Volume 121 becomes unwritable I1117 09:41:18.508851 volume_layout.go:477 volume 121 does not have enough copies I1117 09:41:18.509215 data_node.go:159 Deleting volume id: 122 I1117 09:41:18.509577 topology.go:1124 removing volume info: Id:122, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.509795 volume_layout.go:1149 Volume 122 becomes unwritable I1117 09:41:18.509948 volume_layout.go:477 volume 122 does not have enough copies I1117 09:41:18.510251 data_node.go:159 Deleting volume id: 123 I1117 09:41:18.510568 topology.go:1124 removing volume info: Id:123, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.510795 volume_layout.go:1149 Volume 123 becomes unwritable I1117 09:41:18.510940 volume_layout.go:477 volume 123 does not have enough copies I1117 09:41:18.511542 data_node.go:159 Deleting volume id: 124 I1117 09:41:18.511969 topology.go:1124 removing volume info: Id:124, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.512237 volume_layout.go:1149 Volume 124 becomes unwritable I1117 09:41:18.512386 volume_layout.go:477 volume 124 does not have enough copies I1117 09:41:18.512760 data_node.go:159 Deleting volume id: 125 I1117 09:41:18.513192 topology.go:1124 removing volume info: Id:125, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.513441 volume_layout.go:1149 Volume 125 becomes unwritable I1117 09:41:18.513589 volume_layout.go:477 volume 125 does not have enough copies I1117 09:41:18.513910 data_node.go:159 Deleting volume id: 126 I1117 09:41:18.514236 topology.go:1124 removing volume info: Id:126, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.514482 volume_layout.go:1149 Volume 126 becomes unwritable I1117 09:41:18.514654 volume_layout.go:477 volume 126 does not have enough copies I1117 09:41:18.514985 data_node.go:159 Deleting volume id: 127 I1117 09:41:18.515331 topology.go:1124 removing volume info: Id:127, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.515575 volume_layout.go:1149 Volume 127 becomes unwritable I1117 09:41:18.515730 volume_layout.go:477 volume 127 does not have enough copies I1117 09:41:18.516197 data_node.go:159 Deleting volume id: 128 I1117 09:41:18.516517 topology.go:1124 removing volume info: Id:128, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.516759 volume_layout.go:1149 Volume 128 becomes unwritable I1117 09:41:18.516930 volume_layout.go:477 volume 128 does not have enough copies I1117 09:41:18.517260 data_node.go:159 Deleting volume id: 129 I1117 09:41:18.517605 topology.go:1124 removing volume info: Id:129, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.517844 volume_layout.go:1149 Volume 129 becomes unwritable I1117 09:41:18.518000 volume_layout.go:477 volume 129 does not have enough copies I1117 09:41:18.518294 data_node.go:159 Deleting volume id: 130 I1117 09:41:18.518615 topology.go:1124 removing volume info: Id:130, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.518863 volume_layout.go:1149 Volume 130 becomes unwritable I1117 09:41:18.519038 volume_layout.go:477 volume 130 does not have enough copies I1117 09:41:18.519339 data_node.go:159 Deleting volume id: 131 I1117 09:41:18.519715 topology.go:1124 removing volume info: Id:131, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.519989 volume_layout.go:1149 Volume 131 becomes unwritable I1117 09:41:18.520153 volume_layout.go:477 volume 131 does not have enough copies I1117 09:41:18.520431 data_node.go:159 Deleting volume id: 132 I1117 09:41:18.520788 topology.go:1124 removing volume info: Id:132, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.521035 volume_layout.go:1149 Volume 132 becomes unwritable I1117 09:41:18.521203 volume_layout.go:477 volume 132 does not have enough copies I1117 09:41:18.521491 data_node.go:159 Deleting volume id: 133 I1117 09:41:18.521871 topology.go:1124 removing volume info: Id:133, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.522124 volume_layout.go:1149 Volume 133 becomes unwritable I1117 09:41:18.522276 volume_layout.go:477 volume 133 does not have enough copies I1117 09:41:18.522573 data_node.go:159 Deleting volume id: 134 I1117 09:41:18.522902 topology.go:1124 removing volume info: Id:134, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.523152 volume_layout.go:1149 Volume 134 becomes unwritable I1117 09:41:18.523325 volume_layout.go:477 volume 134 does not have enough copies I1117 09:41:18.523615 data_node.go:159 Deleting volume id: 135 I1117 09:41:18.523941 topology.go:1124 removing volume info: Id:135, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.524184 volume_layout.go:1149 Volume 135 becomes unwritable I1117 09:41:18.524338 volume_layout.go:477 volume 135 does not have enough copies I1117 09:41:18.524704 data_node.go:159 Deleting volume id: 136 I1117 09:41:18.525051 topology.go:1124 removing volume info: Id:136, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.525281 volume_layout.go:1149 Volume 136 becomes unwritable I1117 09:41:18.525426 volume_layout.go:477 volume 136 does not have enough copies I1117 09:41:18.525731 data_node.go:159 Deleting volume id: 137 I1117 09:41:18.526048 topology.go:1124 removing volume info: Id:137, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.526267 volume_layout.go:1149 Volume 137 becomes unwritable I1117 09:41:18.526433 volume_layout.go:477 volume 137 does not have enough copies I1117 09:41:18.526747 data_node.go:159 Deleting volume id: 138 I1117 09:41:18.527092 topology.go:1124 removing volume info: Id:138, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.527332 volume_layout.go:1149 Volume 138 becomes unwritable I1117 09:41:18.527505 volume_layout.go:477 volume 138 does not have enough copies I1117 09:41:18.527805 data_node.go:159 Deleting volume id: 139 I1117 09:41:18.528132 topology.go:1124 removing volume info: Id:139, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.528374 volume_layout.go:1149 Volume 139 becomes unwritable I1117 09:41:18.528577 volume_layout.go:477 volume 139 does not have enough copies I1117 09:41:18.528898 data_node.go:159 Deleting volume id: 140 I1117 09:41:18.529238 topology.go:1124 removing volume info: Id:140, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.529536 volume_layout.go:1149 Volume 140 becomes unwritable I1117 09:41:18.529702 volume_layout.go:477 volume 140 does not have enough copies I1117 09:41:18.529992 data_node.go:159 Deleting volume id: 141 I1117 09:41:18.530331 topology.go:1124 removing volume info: Id:141, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.530571 volume_layout.go:1149 Volume 141 becomes unwritable I1117 09:41:18.530728 volume_layout.go:477 volume 141 does not have enough copies I1117 09:41:18.531162 data_node.go:159 Deleting volume id: 142 I1117 09:41:18.531567 topology.go:1124 removing volume info: Id:142, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.531885 volume_layout.go:1149 Volume 142 becomes unwritable I1117 09:41:18.532042 volume_layout.go:477 volume 142 does not have enough copies I1117 09:41:18.532312 data_node.go:159 Deleting volume id: 143 I1117 09:41:18.532619 topology.go:1124 removing volume info: Id:143, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.532830 volume_layout.go:1149 Volume 143 becomes unwritable I1117 09:41:18.532995 volume_layout.go:477 volume 143 does not have enough copies I1117 09:41:18.533312 data_node.go:159 Deleting volume id: 144 I1117 09:41:18.533636 topology.go:1124 removing volume info: Id:144, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.533871 volume_layout.go:1149 Volume 144 becomes unwritable I1117 09:41:18.534014 volume_layout.go:477 volume 144 does not have enough copies I1117 09:41:18.534327 data_node.go:159 Deleting volume id: 145 I1117 09:41:18.534606 topology.go:1124 removing volume info: Id:145, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.534808 volume_layout.go:1149 Volume 145 becomes unwritable I1117 09:41:18.534940 volume_layout.go:477 volume 145 does not have enough copies I1117 09:41:18.535236 data_node.go:159 Deleting volume id: 146 I1117 09:41:18.535557 topology.go:1124 removing volume info: Id:146, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.535806 volume_layout.go:1149 Volume 146 becomes unwritable I1117 09:41:18.535985 volume_layout.go:477 volume 146 does not have enough copies I1117 09:41:18.536283 data_node.go:159 Deleting volume id: 147 I1117 09:41:18.536613 topology.go:1124 removing volume info: Id:147, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.536816 volume_layout.go:1149 Volume 147 becomes unwritable I1117 09:41:18.536953 volume_layout.go:477 volume 147 does not have enough copies I1117 09:41:18.537245 data_node.go:159 Deleting volume id: 148 I1117 09:41:18.537542 topology.go:1124 removing volume info: Id:148, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.537755 volume_layout.go:1149 Volume 148 becomes unwritable I1117 09:41:18.537915 volume_layout.go:477 volume 148 does not have enough copies I1117 09:41:18.538250 data_node.go:159 Deleting volume id: 149 I1117 09:41:18.538890 topology.go:1124 removing volume info: Id:149, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.539097 volume_layout.go:1149 Volume 149 becomes unwritable I1117 09:41:18.539239 volume_layout.go:477 volume 149 does not have enough copies I1117 09:41:18.539507 data_node.go:159 Deleting volume id: 100 I1117 09:41:18.539801 topology.go:1124 removing volume info: Id:100, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.540041 volume_layout.go:1149 Volume 100 becomes unwritable I1117 09:41:18.540220 volume_layout.go:477 volume 100 does not have enough copies I1117 09:41:18.540487 data_node.go:159 Deleting volume id: 101 I1117 09:41:18.540794 topology.go:1124 removing volume info: Id:101, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.541027 volume_layout.go:1149 Volume 101 becomes unwritable I1117 09:41:18.541190 volume_layout.go:477 volume 101 does not have enough copies I1117 09:41:18.541447 data_node.go:159 Deleting volume id: 102 I1117 09:41:18.541759 topology.go:1124 removing volume info: Id:102, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.541964 volume_layout.go:1149 Volume 102 becomes unwritable I1117 09:41:18.542105 volume_layout.go:477 volume 102 does not have enough copies I1117 09:41:18.542348 data_node.go:159 Deleting volume id: 103 I1117 09:41:18.542665 topology.go:1124 removing volume info: Id:103, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.542890 volume_layout.go:1149 Volume 103 becomes unwritable I1117 09:41:18.543072 volume_layout.go:477 volume 103 does not have enough copies I1117 09:41:18.543340 data_node.go:159 Deleting volume id: 104 I1117 09:41:18.543656 topology.go:1124 removing volume info: Id:104, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.543859 volume_layout.go:1149 Volume 104 becomes unwritable I1117 09:41:18.543978 volume_layout.go:477 volume 104 does not have enough copies I1117 09:41:18.544271 data_node.go:159 Deleting volume id: 105 I1117 09:41:18.544557 topology.go:1124 removing volume info: Id:105, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.544780 volume_layout.go:1149 Volume 105 becomes unwritable I1117 09:41:18.544958 volume_layout.go:477 volume 105 does not have enough copies I1117 09:41:18.545244 data_node.go:159 Deleting volume id: 106 I1117 09:41:18.545560 topology.go:1124 removing volume info: Id:106, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.545787 volume_layout.go:1149 Volume 106 becomes unwritable I1117 09:41:18.545962 volume_layout.go:477 volume 106 does not have enough copies I1117 09:41:18.546293 data_node.go:159 Deleting volume id: 107 I1117 09:41:18.546595 topology.go:1124 removing volume info: Id:107, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.546795 volume_layout.go:1149 Volume 107 becomes unwritable I1117 09:41:18.546941 volume_layout.go:477 volume 107 does not have enough copies I1117 09:41:18.547189 data_node.go:159 Deleting volume id: 108 I1117 09:41:18.547477 topology.go:1124 removing volume info: Id:108, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.547700 volume_layout.go:1149 Volume 108 becomes unwritable I1117 09:41:18.547880 volume_layout.go:477 volume 108 does not have enough copies I1117 09:41:18.550237 data_node.go:159 Deleting volume id: 109 I1117 09:41:18.551307 topology.go:1124 removing volume info: Id:109, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.551700 volume_layout.go:1149 Volume 109 becomes unwritable I1117 09:41:18.551907 volume_layout.go:477 volume 109 does not have enough copies I1117 09:41:18.552465 data_node.go:159 Deleting volume id: 110 I1117 09:41:18.553681 topology.go:1124 removing volume info: Id:110, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.554185 volume_layout.go:1149 Volume 110 becomes unwritable I1117 09:41:18.554717 volume_layout.go:477 volume 110 does not have enough copies I1117 09:41:18.555392 data_node.go:159 Deleting volume id: 111 I1117 09:41:18.556017 topology.go:1124 removing volume info: Id:111, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.556451 volume_layout.go:1149 Volume 111 becomes unwritable I1117 09:41:18.556656 volume_layout.go:477 volume 111 does not have enough copies I1117 09:41:18.557181 data_node.go:159 Deleting volume id: 112 I1117 09:41:18.557594 topology.go:1124 removing volume info: Id:112, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.557945 volume_layout.go:1149 Volume 112 becomes unwritable I1117 09:41:18.558294 volume_layout.go:477 volume 112 does not have enough copies I1117 09:41:18.558737 data_node.go:159 Deleting volume id: 113 I1117 09:41:18.559160 topology.go:1124 removing volume info: Id:113, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.559609 volume_layout.go:1149 Volume 113 becomes unwritable I1117 09:41:18.559853 volume_layout.go:477 volume 113 does not have enough copies I1117 09:41:18.560630 data_node.go:159 Deleting volume id: 114 I1117 09:41:18.561175 topology.go:1124 removing volume info: Id:114, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.561634 volume_layout.go:1149 Volume 114 becomes unwritable I1117 09:41:18.561798 volume_layout.go:477 volume 114 does not have enough copies I1117 09:41:18.562144 data_node.go:159 Deleting volume id: 115 I1117 09:41:18.562521 topology.go:1124 removing volume info: Id:115, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.562793 volume_layout.go:1149 Volume 115 becomes unwritable I1117 09:41:18.563152 volume_layout.go:477 volume 115 does not have enough copies I1117 09:41:18.563478 data_node.go:159 Deleting volume id: 116 I1117 09:41:18.563833 topology.go:1124 removing volume info: Id:116, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.564070 volume_layout.go:1149 Volume 116 becomes unwritable I1117 09:41:18.564223 volume_layout.go:477 volume 116 does not have enough copies I1117 09:41:18.564833 data_node.go:159 Deleting volume id: 117 I1117 09:41:18.565143 topology.go:1124 removing volume info: Id:117, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.565637 volume_layout.go:1149 Volume 117 becomes unwritable I1117 09:41:18.569708 volume_layout.go:477 volume 117 does not have enough copies I1117 09:41:18.570040 data_node.go:159 Deleting volume id: 118 I1117 09:41:18.570382 topology.go:1124 removing volume info: Id:118, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.570600 volume_layout.go:1149 Volume 118 becomes unwritable I1117 09:41:18.570740 volume_layout.go:477 volume 118 does not have enough copies I1117 09:41:18.571008 data_node.go:159 Deleting volume id: 119 I1117 09:41:18.571290 topology.go:1124 removing volume info: Id:119, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.571490 volume_layout.go:1149 Volume 119 becomes unwritable I1117 09:41:18.571632 volume_layout.go:477 volume 119 does not have enough copies I1117 09:41:18.571870 data_node.go:159 Deleting volume id: 120 I1117 09:41:18.572134 topology.go:1124 removing volume info: Id:120, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.572329 volume_layout.go:1149 Volume 120 becomes unwritable I1117 09:41:18.572460 volume_layout.go:477 volume 120 does not have enough copies I1117 09:41:18.572820 data_node.go:159 Deleting volume id: 121 I1117 09:41:18.573164 topology.go:1124 removing volume info: Id:121, Size:1, ReplicaPlacement:000, Collection:c, Version:3, Ttl:, FileCount:0, DeleteCount:0, DeletedByteCount:0, ReadOnly:false, ModifiedAtSecond:0 from 10.0.0.1:8080 I1117 09:41:18.573387 volume_layout.go:1149 Volume 121 becomes unwritable I1117 09:41:18.573533 volume_layout.go:477 volume 121 does not have enough copies --- PASS: TestVolumeFilterListsWhileVolumesChange (0.15s) === RUN TestVolumeGrowth_ReservationBasedAllocation I1117 09:41:18.575013 node.go:539 weedfs adds child dc1 I1117 09:41:18.575325 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.575632 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.575954 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.578087 node.go:224 weedfs failed to pick 1 from 0 node candidates --- PASS: TestVolumeGrowth_ReservationBasedAllocation (0.00s) === RUN TestVolumeGrowth_ConcurrentAllocationPreventsRaceCondition I1117 09:41:18.579060 node.go:539 weedfs adds child dc1 I1117 09:41:18.579349 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.579638 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.580013 node.go:539 weedfs:dc1:rack1:server1 adds child volume_growth_reservation_test.go:148: Request 5 succeeded, got reservation volume_growth_reservation_test.go:148: Request 0 succeeded, got reservation volume_growth_reservation_test.go:148: Request 2 succeeded, got reservation volume_growth_reservation_test.go:148: Request 9 succeeded, got reservation volume_growth_reservation_test.go:148: Request 3 succeeded, got reservation volume_growth_reservation_test.go:145: Request 8 failed as expected: No matching data node found! dc1:Only has 0 racks with more than 1 free data nodes, not enough for 1. volume_growth_reservation_test.go:145: Request 1 failed as expected: No matching data node found! rack1:Only has 0 data nodes with a slot, not enough for 1. volume_growth_reservation_test.go:145: Request 7 failed as expected: No matching data node found! dc1:Only has 0 racks with more than 1 free data nodes, not enough for 1. volume_growth_reservation_test.go:145: Request 6 failed as expected: No matching data node found! server1:Cannot reserve capacity on node server1 volume_growth_reservation_test.go:145: Request 4 failed as expected: No matching data node found! rack1:Only has 0 data nodes with a slot, not enough for 1. volume_growth_reservation_test.go:204: Concurrent test completed: 5 successes, 5 failures --- PASS: TestVolumeGrowth_ConcurrentAllocationPreventsRaceCondition (0.01s) === RUN TestVolumeGrowth_ReservationFailureRollback I1117 09:41:18.587828 node.go:539 weedfs adds child dc1 I1117 09:41:18.588125 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.588598 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.588773 node.go:539 weedfs:dc1:rack1 adds child server2 I1117 09:41:18.589109 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.589425 node.go:539 weedfs:dc1:rack1:server2 adds child --- PASS: TestVolumeGrowth_ReservationFailureRollback (0.00s) === RUN TestVolumeGrowth_ReservationTimeout --- PASS: TestVolumeGrowth_ReservationTimeout (0.00s) === RUN TestVolumeGrowth_ConfigurableReservationTimeout --- PASS: TestVolumeGrowth_ConfigurableReservationTimeout (0.00s) === RUN TestFindEmptySlotsForOneVolume data: map[dc1:map[rack1:map[server111:map[limit:3 volumes:[map[id:1 size:12312] map[id:2 size:12312] map[id:3 size:12312]]] server112:map[limit:10 volumes:[map[id:4 size:12312] map[id:5 size:12312] map[id:6 size:12312]]]] rack2:map[server121:map[limit:4 volumes:[map[id:4 size:12312] map[id:5 size:12312] map[id:6 size:12312]]] server122:map[limit:4 volumes:[]] server123:map[limit:5 volumes:[map[id:2 size:12312] map[id:3 size:12312] map[id:4 size:12312]]]]] dc2:map[] dc3:map[rack2:map[server321:map[limit:4 volumes:[map[id:1 size:12312] map[id:3 size:12312] map[id:5 size:12312]]]]]] I1117 09:41:18.600320 node.go:539 weedfs adds child dc1 I1117 09:41:18.600514 node.go:539 weedfs:dc1 adds child rack2 I1117 09:41:18.600682 node.go:539 weedfs:dc1:rack2 adds child server121 I1117 09:41:18.600838 node.go:539 weedfs:dc1:rack2:server121 adds child I1117 09:41:18.601165 node.go:539 weedfs:dc1:rack2 adds child server122 I1117 09:41:18.601300 node.go:539 weedfs:dc1:rack2:server122 adds child I1117 09:41:18.601608 node.go:539 weedfs:dc1:rack2 adds child server123 I1117 09:41:18.601766 node.go:539 weedfs:dc1:rack2:server123 adds child I1117 09:41:18.602014 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.602238 node.go:539 weedfs:dc1:rack1 adds child server111 I1117 09:41:18.602377 node.go:539 weedfs:dc1:rack1:server111 adds child I1117 09:41:18.602634 node.go:539 weedfs:dc1:rack1 adds child server112 I1117 09:41:18.602786 node.go:539 weedfs:dc1:rack1:server112 adds child I1117 09:41:18.603033 node.go:539 weedfs adds child dc2 I1117 09:41:18.603184 node.go:539 weedfs adds child dc3 I1117 09:41:18.603321 node.go:539 weedfs:dc3 adds child rack2 I1117 09:41:18.603464 node.go:539 weedfs:dc3:rack2 adds child server321 I1117 09:41:18.603598 node.go:539 weedfs:dc3:rack2:server321 adds child assigned node : server123 assigned node : server121 assigned node : server122 --- PASS: TestFindEmptySlotsForOneVolume (0.01s) === RUN TestGrowthBlocker data: map[dc1:map[rack1:map[server111:map[limit:3 volumes:[map[id:1 size:12312] map[id:2 size:12312] map[id:3 size:12312]]] server112:map[limit:10 volumes:[map[id:4 size:12312] map[id:5 size:12312] map[id:6 size:12312]]]] rack2:map[server121:map[limit:4 volumes:[map[id:4 size:12312] map[id:5 size:12312] map[id:6 size:12312]]] server122:map[limit:4 volumes:[]] server123:map[limit:5 volumes:[map[id:2 size:12312] map[id:3 size:12312] map[id:4 size:12312]]]]] dc2:map[] dc3:map[rack2:map[server321:map[limit:4 volumes:[map[id:1 size:12312] map[id:3 size:12312] map[id:5 size:12312]]]]]] I1117 09:41:18.609741 node.go:539 weedfs adds child dc1 I1117 09:41:18.609910 node.go:539 weedfs:dc1 adds child rack2 I1117 09:41:18.610182 node.go:539 weedfs:dc1:rack2 adds child server121 I1117 09:41:18.610348 node.go:539 weedfs:dc1:rack2:server121 adds child I1117 09:41:18.610638 node.go:539 weedfs:dc1:rack2 adds child server122 I1117 09:41:18.610769 node.go:539 weedfs:dc1:rack2:server122 adds child I1117 09:41:18.610937 node.go:539 weedfs:dc1:rack2 adds child server123 I1117 09:41:18.611072 node.go:539 weedfs:dc1:rack2:server123 adds child I1117 09:41:18.611310 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.611561 node.go:539 weedfs:dc1:rack1 adds child server112 I1117 09:41:18.611720 node.go:539 weedfs:dc1:rack1:server112 adds child I1117 09:41:18.611982 node.go:539 weedfs:dc1:rack1 adds child server111 I1117 09:41:18.612121 node.go:539 weedfs:dc1:rack1:server111 adds child I1117 09:41:18.612363 node.go:539 weedfs adds child dc2 I1117 09:41:18.612483 node.go:539 weedfs adds child dc3 I1117 09:41:18.612604 node.go:539 weedfs:dc3 adds child rack2 I1117 09:41:18.612769 node.go:539 weedfs:dc3:rack2 adds child server321 I1117 09:41:18.612940 node.go:539 weedfs:dc3:rack2:server321 adds child --- PASS: TestGrowthBlocker (0.01s) === RUN TestReplication011 data: map[dc1:map[rack1:map[server111:map[limit:300 volumes:[map[id:1 size:12312] map[id:2 size:12312] map[id:3 size:12312]]] server112:map[limit:300 volumes:[map[id:4 size:12312] map[id:5 size:12312] map[id:6 size:12312]]] server113:map[limit:300 volumes:[]] server114:map[limit:300 volumes:[]] server115:map[limit:300 volumes:[]] server116:map[limit:300 volumes:[]]] rack2:map[server121:map[limit:300 volumes:[map[id:4 size:12312] map[id:5 size:12312] map[id:6 size:12312]]] server122:map[limit:300 volumes:[]] server123:map[limit:300 volumes:[map[id:2 size:12312] map[id:3 size:12312] map[id:4 size:12312]]] server124:map[limit:300 volumes:[]] server125:map[limit:300 volumes:[]] server126:map[limit:300 volumes:[]]] rack3:map[server131:map[limit:300 volumes:[]] server132:map[limit:300 volumes:[]] server133:map[limit:300 volumes:[]] server134:map[limit:300 volumes:[]] server135:map[limit:300 volumes:[]] server136:map[limit:300 volumes:[]]]]] I1117 09:41:18.621772 node.go:539 weedfs adds child dc1 I1117 09:41:18.621954 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.622119 node.go:539 weedfs:dc1:rack1 adds child server113 I1117 09:41:18.622260 node.go:539 weedfs:dc1:rack1:server113 adds child I1117 09:41:18.622540 node.go:539 weedfs:dc1:rack1 adds child server114 I1117 09:41:18.622672 node.go:539 weedfs:dc1:rack1:server114 adds child I1117 09:41:18.622877 node.go:539 weedfs:dc1:rack1 adds child server115 I1117 09:41:18.623021 node.go:539 weedfs:dc1:rack1:server115 adds child I1117 09:41:18.623202 node.go:539 weedfs:dc1:rack1 adds child server116 I1117 09:41:18.623335 node.go:539 weedfs:dc1:rack1:server116 adds child I1117 09:41:18.623502 node.go:539 weedfs:dc1:rack1 adds child server111 I1117 09:41:18.623651 node.go:539 weedfs:dc1:rack1:server111 adds child I1117 09:41:18.623945 node.go:539 weedfs:dc1:rack1 adds child server112 I1117 09:41:18.624082 node.go:539 weedfs:dc1:rack1:server112 adds child I1117 09:41:18.624451 node.go:539 weedfs:dc1 adds child rack2 I1117 09:41:18.624609 node.go:539 weedfs:dc1:rack2 adds child server121 I1117 09:41:18.624746 node.go:539 weedfs:dc1:rack2:server121 adds child I1117 09:41:18.625001 node.go:539 weedfs:dc1:rack2 adds child server122 I1117 09:41:18.625130 node.go:539 weedfs:dc1:rack2:server122 adds child I1117 09:41:18.625301 node.go:539 weedfs:dc1:rack2 adds child server123 I1117 09:41:18.625450 node.go:539 weedfs:dc1:rack2:server123 adds child I1117 09:41:18.625741 node.go:539 weedfs:dc1:rack2 adds child server124 I1117 09:41:18.625885 node.go:539 weedfs:dc1:rack2:server124 adds child I1117 09:41:18.626079 node.go:539 weedfs:dc1:rack2 adds child server125 I1117 09:41:18.626209 node.go:539 weedfs:dc1:rack2:server125 adds child I1117 09:41:18.626377 node.go:539 weedfs:dc1:rack2 adds child server126 I1117 09:41:18.626513 node.go:539 weedfs:dc1:rack2:server126 adds child I1117 09:41:18.626669 node.go:539 weedfs:dc1 adds child rack3 I1117 09:41:18.626837 node.go:539 weedfs:dc1:rack3 adds child server131 I1117 09:41:18.626979 node.go:539 weedfs:dc1:rack3:server131 adds child I1117 09:41:18.627155 node.go:539 weedfs:dc1:rack3 adds child server132 I1117 09:41:18.627283 node.go:539 weedfs:dc1:rack3:server132 adds child I1117 09:41:18.627449 node.go:539 weedfs:dc1:rack3 adds child server133 I1117 09:41:18.627580 node.go:539 weedfs:dc1:rack3:server133 adds child I1117 09:41:18.627747 node.go:539 weedfs:dc1:rack3 adds child server134 I1117 09:41:18.627875 node.go:539 weedfs:dc1:rack3:server134 adds child I1117 09:41:18.628066 node.go:539 weedfs:dc1:rack3 adds child server135 I1117 09:41:18.628207 node.go:539 weedfs:dc1:rack3:server135 adds child I1117 09:41:18.628379 node.go:539 weedfs:dc1:rack3 adds child server136 I1117 09:41:18.628506 node.go:539 weedfs:dc1:rack3:server136 adds child assigned node : server111 assigned node : server112 assigned node : server121 --- PASS: TestReplication011 (0.01s) === RUN TestFindEmptySlotsForOneVolumeScheduleByWeight data: map[dc1:map[rack1:map[server111:map[limit:2000 volumes:[]]]] dc2:map[rack2:map[server222:map[limit:2000 volumes:[]]]] dc3:map[rack3:map[server333:map[limit:1000 volumes:[]]]] dc4:map[rack4:map[server444:map[limit:1000 volumes:[]]]] dc5:map[rack5:map[server555:map[limit:500 volumes:[]]]] dc6:map[rack6:map[server666:map[limit:500 volumes:[]]]]] I1117 09:41:18.632491 node.go:539 weedfs adds child dc1 I1117 09:41:18.632762 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.632939 node.go:539 weedfs:dc1:rack1 adds child server111 I1117 09:41:18.633089 node.go:539 weedfs:dc1:rack1:server111 adds child I1117 09:41:18.633296 node.go:539 weedfs adds child dc2 I1117 09:41:18.633432 node.go:539 weedfs:dc2 adds child rack2 I1117 09:41:18.633619 node.go:539 weedfs:dc2:rack2 adds child server222 I1117 09:41:18.633829 node.go:539 weedfs:dc2:rack2:server222 adds child I1117 09:41:18.634036 node.go:539 weedfs adds child dc3 I1117 09:41:18.634163 node.go:539 weedfs:dc3 adds child rack3 I1117 09:41:18.634305 node.go:539 weedfs:dc3:rack3 adds child server333 I1117 09:41:18.634437 node.go:539 weedfs:dc3:rack3:server333 adds child I1117 09:41:18.634615 node.go:539 weedfs adds child dc4 I1117 09:41:18.634769 node.go:539 weedfs:dc4 adds child rack4 I1117 09:41:18.634939 node.go:539 weedfs:dc4:rack4 adds child server444 I1117 09:41:18.635072 node.go:539 weedfs:dc4:rack4:server444 adds child I1117 09:41:18.635242 node.go:539 weedfs adds child dc5 I1117 09:41:18.635369 node.go:539 weedfs:dc5 adds child rack5 I1117 09:41:18.635520 node.go:539 weedfs:dc5:rack5 adds child server555 I1117 09:41:18.635692 node.go:539 weedfs:dc5:rack5:server555 adds child I1117 09:41:18.635868 node.go:539 weedfs adds child dc6 I1117 09:41:18.635994 node.go:539 weedfs:dc6 adds child rack6 I1117 09:41:18.636143 node.go:539 weedfs:dc6:rack6 adds child server666 I1117 09:41:18.636273 node.go:539 weedfs:dc6:rack6:server666 adds child server333 : 311 server111 : 524 server222 : 515 server444 : 320 server555 : 165 server666 : 165 --- PASS: TestFindEmptySlotsForOneVolumeScheduleByWeight (0.17s) === RUN TestPickForWrite data: map[dc1:map[rack1:map[serverdc111:map[ip:127.0.0.1 limit:100 volumes:[map[collection:test id:1 replication:001 size:12312] map[collection:test id:2 replication:100 size:12312] map[collection:test id:4 replication:100 size:12312] map[collection:test id:6 replication:010 size:12312]]]]] dc2:map[rack1:map[serverdc211:map[ip:127.0.0.2 limit:100 volumes:[map[collection:test id:2 replication:100 size:12312] map[collection:test id:3 replication:010 size:12312] map[collection:test id:5 replication:001 size:12312] map[collection:test id:6 replication:010 size:12312]]]]] dc3:map[rack1:map[serverdc311:map[ip:127.0.0.3 limit:100 volumes:[map[collection:test id:1 replication:001 size:12312] map[collection:test id:3 replication:010 size:12312] map[collection:test id:4 replication:100 size:12312] map[collection:test id:5 replication:001 size:12312]]]]]] I1117 09:41:18.803903 node.go:539 weedfs adds child dc1 I1117 09:41:18.804162 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.804430 node.go:539 weedfs:dc1:rack1 adds child serverdc111 I1117 09:41:18.804875 node.go:539 weedfs:dc1:rack1:serverdc111 adds child I1117 09:41:18.805684 node.go:539 weedfs adds child dc2 I1117 09:41:18.805834 node.go:539 weedfs:dc2 adds child rack1 I1117 09:41:18.806067 node.go:539 weedfs:dc2:rack1 adds child serverdc211 I1117 09:41:18.806247 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:41:18.806484 node.go:539 weedfs:dc2:rack1:serverdc211 adds child I1117 09:41:18.806998 volume_layout.go:1149 Volume 6 becomes unwritable I1117 09:41:18.807257 node.go:539 weedfs adds child dc3 I1117 09:41:18.807413 node.go:539 weedfs:dc3 adds child rack1 I1117 09:41:18.807612 node.go:539 weedfs:dc3:rack1 adds child serverdc311 I1117 09:41:18.807794 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.807957 node.go:539 weedfs:dc3:rack1:serverdc311 adds child I1117 09:41:18.808193 volume_layout.go:1149 Volume 3 becomes unwritable I1117 09:41:18.808438 volume_layout.go:1149 Volume 4 becomes unwritable I1117 09:41:18.808664 volume_layout.go:1149 Volume 5 becomes unwritable --- PASS: TestPickForWrite (0.02s) === RUN TestPickNodesByWeightPrefersDistinctHosts I1117 09:41:18.815402 node.go:539 rack1 adds child s1a I1117 09:41:18.815642 node.go:539 rack1:s1a adds child I1117 09:41:18.816063 node.go:539 rack1 adds child s1b I1117 09:41:18.816222 node.go:539 rack1:s1b adds child I1117 09:41:18.816423 node.go:539 rack1 adds child s2a I1117 09:41:18.816565 node.go:539 rack1:s2a adds child I1117 09:41:18.816758 node.go:539 rack1 adds child s2b I1117 09:41:18.816939 node.go:539 rack1:s2b adds child --- PASS: TestPickNodesByWeightPrefersDistinctHosts (0.01s) === RUN TestWritableAvgFill I1117 09:41:18.822131 node.go:539 weedfs adds child dc1 I1117 09:41:18.822521 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.822932 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.823534 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestWritableAvgFill (0.00s) === RUN TestWritableAvgFillNoWritables I1117 09:41:18.826202 node.go:539 weedfs adds child dc1 I1117 09:41:18.826370 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.826753 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.827052 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.827528 volume_layout.go:1149 Volume 1 becomes unwritable --- PASS: TestWritableAvgFillNoWritables (0.00s) === RUN TestWritableAvgFillUntrackedVolumeCountsAsEmpty I1117 09:41:18.829362 node.go:539 weedfs adds child dc1 I1117 09:41:18.829545 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.829788 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.830056 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestWritableAvgFillUntrackedVolumeCountsAsEmpty (0.00s) === RUN TestWritableAvgFillScopedToTarget I1117 09:41:18.833948 node.go:539 weedfs adds child dc1 I1117 09:41:18.834221 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.834407 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.834644 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.834942 node.go:539 weedfs adds child dc2 I1117 09:41:18.835095 node.go:539 weedfs:dc2 adds child rack2 I1117 09:41:18.835254 node.go:539 weedfs:dc2:rack2 adds child server2 I1117 09:41:18.835436 node.go:539 weedfs:dc2:rack2:server2 adds child --- PASS: TestWritableAvgFillScopedToTarget (0.00s) === RUN TestFindVolumeLayout I1117 09:41:18.837196 node.go:539 weedfs adds child dc1 I1117 09:41:18.837455 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.837620 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.837892 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestFindVolumeLayout (0.00s) === RUN TestSetVolumeCapacityFullStampsFullSinceAndRecovers I1117 09:41:18.839575 node.go:539 weedfs adds child dc1 I1117 09:41:18.839739 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.839889 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.840190 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.840522 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.840765 volume_layout.go:1333 Volume 1 reaches full capacity. I1117 09:41:18.841772 volume_layout.go:373 Volume 1 recovered to writable (effective=4000, reported=4000, limit=10000). --- PASS: TestSetVolumeCapacityFullStampsFullSinceAndRecovers (0.00s) === RUN TestSetVolumeAvailableRestoresActiveCountForCapacityFullVolume I1117 09:41:18.843208 node.go:539 weedfs adds child dc1 I1117 09:41:18.843356 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.843505 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.843742 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.843984 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.844124 volume_layout.go:1333 Volume 1 reaches full capacity. --- PASS: TestSetVolumeAvailableRestoresActiveCountForCapacityFullVolume (0.00s) === RUN TestDecayQuietVolumeSizesRecoversPhantomFullVolume I1117 09:41:18.845977 node.go:539 weedfs adds child dc1 I1117 09:41:18.846135 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.846326 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.846622 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.846902 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.847141 volume_layout.go:542 Volume 1 reaches full capacity (effective=24000, limit=10000). I1117 09:41:18.847928 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:41:18.848297 volume_layout.go:1340 Volume 1 becomes uncrowded I1117 09:41:18.848503 volume_layout.go:373 Volume 1 recovered to writable (effective=9000, reported=4000, limit=10000). --- PASS: TestDecayQuietVolumeSizesRecoversPhantomFullVolume (0.00s) === RUN TestDecayQuietVolumeSizesKeepsTheNextHeartbeat I1117 09:41:18.849924 node.go:539 weedfs adds child dc1 I1117 09:41:18.850075 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.850335 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.850585 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestDecayQuietVolumeSizesKeepsTheNextHeartbeat (0.00s) === RUN TestDecayQuietVolumeSizesDoesNotRollBackAHeartbeat I1117 09:41:18.852355 node.go:539 weedfs adds child dc1 I1117 09:41:18.852509 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.852668 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.852972 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.853255 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:41:18.853400 volume_layout.go:1340 Volume 1 becomes uncrowded --- PASS: TestDecayQuietVolumeSizesDoesNotRollBackAHeartbeat (0.00s) === RUN TestDecayQuietVolumeSizesYieldsToAHeartbeatItRaced I1117 09:41:18.854929 node.go:539 weedfs adds child dc1 I1117 09:41:18.855077 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.855228 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.855492 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestDecayQuietVolumeSizesYieldsToAHeartbeatItRaced (0.00s) === RUN TestDecayQuietVolumeSizesSkipsAGenuinelyFullVolume I1117 09:41:18.857422 node.go:539 weedfs adds child dc1 I1117 09:41:18.857595 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.857782 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.858024 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.858326 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.858454 volume_layout.go:1333 Volume 1 reaches full capacity. I1117 09:41:18.858585 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:41:18.858737 volume_layout.go:542 Volume 2 reaches full capacity (effective=10000, limit=10000). I1117 09:41:18.859065 volume_layout.go:373 Volume 2 recovered to writable (effective=7000, reported=4000, limit=10000). --- PASS: TestDecayQuietVolumeSizesSkipsAGenuinelyFullVolume (0.00s) === RUN TestGetPendingSize I1117 09:41:18.860534 node.go:539 weedfs adds child dc1 I1117 09:41:18.860686 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.860843 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.861164 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestGetPendingSize (0.00s) === RUN TestGetPendingSize_CompactionResets I1117 09:41:18.862659 node.go:539 weedfs adds child dc1 I1117 09:41:18.862826 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.862992 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.863237 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestGetPendingSize_CompactionResets (0.00s) === RUN TestDrainAndRemoveFromWritable_NoPending I1117 09:41:18.864762 node.go:539 weedfs adds child dc1 I1117 09:41:18.864917 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.865069 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.865346 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.865594 volume_layout.go:1149 Volume 1 becomes unwritable --- PASS: TestDrainAndRemoveFromWritable_NoPending (0.00s) === RUN TestDrainAndRemoveFromWritable_WithPending I1117 09:41:18.867040 node.go:539 weedfs adds child dc1 I1117 09:41:18.867199 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.867372 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.867727 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.868028 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.868158 volume_layout.go:542 Volume 1 reaches full capacity (effective=2098151, limit=10000). --- PASS: TestDrainAndRemoveFromWritable_WithPending (0.00s) === RUN TestDrainAndRemoveFromWritable_DecaysViaConcurrentHeartbeat I1117 09:41:18.869569 node.go:539 weedfs adds child dc1 I1117 09:41:18.869725 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:18.869895 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:18.870144 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:18.870376 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:18.870505 volume_layout.go:542 Volume 1 reaches full capacity (effective=104858600, limit=10000). I1117 09:41:19.371974 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestDrainAndRemoveFromWritable_DecaysViaConcurrentHeartbeat (5.02s) === RUN TestSetVolumeReadOnly_PreservesPending I1117 09:41:23.886349 node.go:539 weedfs adds child dc1 I1117 09:41:23.886596 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.886787 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:23.887106 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:23.887482 volume_layout.go:1149 Volume 1 becomes unwritable --- PASS: TestSetVolumeReadOnly_PreservesPending (0.00s) === RUN TestMarkDeletingKeepsVolumeUnwritableAcrossHeartbeats I1117 09:41:23.889110 node.go:539 weedfs adds child dc1 I1117 09:41:23.889267 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.889425 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:23.889750 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:23.890020 volume_layout.go:1149 Volume 1 becomes unwritable --- PASS: TestMarkDeletingKeepsVolumeUnwritableAcrossHeartbeats (0.00s) === RUN TestShouldGrowVolumesByDcAndRack_Issue8986 data: map[dc_edge:map[rack1:map[server1:map[ip:10.0.0.1 limit:30 volumes:[map[id:1 replication:010 size:12312] map[id:2 replication:010 size:12312]]]] rack2:map[server2:map[ip:10.0.0.2 limit:30 volumes:[map[id:1 replication:010 size:12312] map[id:2 replication:010 size:12312]]]] rack3:map[server3:map[ip:10.0.0.3 limit:30 volumes:[]]]]] I1117 09:41:23.893789 node.go:539 weedfs adds child dc_edge I1117 09:41:23.894057 node.go:539 weedfs:dc_edge adds child rack1 I1117 09:41:23.894268 node.go:539 weedfs:dc_edge:rack1 adds child server1 I1117 09:41:23.894622 node.go:539 weedfs:dc_edge:rack1:server1 adds child I1117 09:41:23.895037 node.go:539 weedfs:dc_edge adds child rack2 I1117 09:41:23.895229 node.go:539 weedfs:dc_edge:rack2 adds child server2 I1117 09:41:23.895469 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:23.895655 node.go:539 weedfs:dc_edge:rack2:server2 adds child I1117 09:41:23.895930 volume_layout.go:1149 Volume 2 becomes unwritable I1117 09:41:23.896152 node.go:539 weedfs:dc_edge adds child rack3 I1117 09:41:23.896322 node.go:539 weedfs:dc_edge:rack3 adds child server3 I1117 09:41:23.896484 node.go:539 weedfs:dc_edge:rack3:server3 adds child --- PASS: TestShouldGrowVolumesByDcAndRack_Issue8986 (0.01s) === RUN TestPlanRackAwareGrowth_Issue9832 I1117 09:41:23.899263 node.go:539 weedfs adds child datacenter1 I1117 09:41:23.899456 node.go:539 weedfs:datacenter1 adds child rack1 I1117 09:41:23.899711 node.go:539 weedfs:datacenter1:rack1 adds child node-a I1117 09:41:23.900045 node.go:539 weedfs:datacenter1:rack1:node-a adds child I1117 09:41:23.900307 node.go:539 weedfs:datacenter1 adds child rack2 I1117 09:41:23.900489 node.go:539 weedfs:datacenter1:rack2 adds child node-b I1117 09:41:23.900682 volume_layout.go:1149 Volume 12 becomes unwritable I1117 09:41:23.900850 node.go:539 weedfs:datacenter1:rack2:node-b adds child --- PASS: TestPlanRackAwareGrowth_Issue9832 (0.01s) === RUN TestPlanRackAwareGrowth_DefaultStepNotMultiplied I1117 09:41:23.904669 node.go:539 weedfs adds child datacenter1 I1117 09:41:23.904852 node.go:539 weedfs:datacenter1 adds child rack2 I1117 09:41:23.905034 node.go:539 weedfs:datacenter1:rack2 adds child node-b I1117 09:41:23.905327 node.go:539 weedfs:datacenter1:rack2:node-b adds child I1117 09:41:23.905573 node.go:539 weedfs:datacenter1 adds child rack1 I1117 09:41:23.905741 node.go:539 weedfs:datacenter1:rack1 adds child node-a I1117 09:41:23.905929 volume_layout.go:1149 Volume 12 becomes unwritable I1117 09:41:23.906108 node.go:539 weedfs:datacenter1:rack1:node-a adds child --- PASS: TestPlanRackAwareGrowth_DefaultStepNotMultiplied (0.00s) === RUN TestPlanRackAwareGrowth_NotCrowdedNoGrowth I1117 09:41:23.909237 node.go:539 weedfs adds child datacenter1 I1117 09:41:23.909430 node.go:539 weedfs:datacenter1 adds child rack1 I1117 09:41:23.909632 node.go:539 weedfs:datacenter1:rack1 adds child node-a I1117 09:41:23.909915 node.go:539 weedfs:datacenter1:rack1:node-a adds child I1117 09:41:23.910164 node.go:539 weedfs:datacenter1 adds child rack2 I1117 09:41:23.910331 node.go:539 weedfs:datacenter1:rack2 adds child node-b I1117 09:41:23.910544 volume_layout.go:1149 Volume 12 becomes unwritable I1117 09:41:23.910717 node.go:539 weedfs:datacenter1:rack2:node-b adds child --- PASS: TestPlanRackAwareGrowth_NotCrowdedNoGrowth (0.00s) === RUN TestPlanRackAwareGrowth_PerRackForNonRackSpanning I1117 09:41:23.912767 node.go:539 weedfs adds child datacenter1 I1117 09:41:23.912939 node.go:539 weedfs:datacenter1 adds child rack1 I1117 09:41:23.913117 node.go:539 weedfs:datacenter1:rack1 adds child node-a I1117 09:41:23.913507 node.go:539 weedfs:datacenter1:rack1:node-a adds child I1117 09:41:23.913817 node.go:539 weedfs:datacenter1 adds child rack2 I1117 09:41:23.913981 node.go:539 weedfs:datacenter1:rack2 adds child node-b I1117 09:41:23.914120 node.go:539 weedfs:datacenter1:rack2:node-b adds child --- PASS: TestPlanRackAwareGrowth_PerRackForNonRackSpanning (0.00s) === RUN TestPlanRackAwareGrowth_EvenDistributionAcrossUnevenDCs I1117 09:41:23.917483 node.go:539 weedfs adds child dc2 I1117 09:41:23.917635 node.go:539 weedfs:dc2 adds child rack5 I1117 09:41:23.917814 node.go:539 weedfs:dc2:rack5 adds child node-e I1117 09:41:23.918049 node.go:539 weedfs:dc2:rack5:node-e adds child I1117 09:41:23.918281 node.go:539 weedfs:dc2 adds child rack3 I1117 09:41:23.918440 node.go:539 weedfs:dc2:rack3 adds child node-c I1117 09:41:23.918633 node.go:539 weedfs:dc2:rack3:node-c adds child I1117 09:41:23.918825 node.go:539 weedfs:dc2 adds child rack4 I1117 09:41:23.918970 node.go:539 weedfs:dc2:rack4 adds child node-d I1117 09:41:23.919148 node.go:539 weedfs:dc2:rack4:node-d adds child I1117 09:41:23.919341 node.go:539 weedfs adds child dc1 I1117 09:41:23.919491 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.919658 node.go:539 weedfs:dc1:rack1 adds child node-a I1117 09:41:23.919843 node.go:539 weedfs:dc1:rack1:node-a adds child I1117 09:41:23.920038 node.go:539 weedfs:dc1 adds child rack2 I1117 09:41:23.920207 node.go:539 weedfs:dc1:rack2 adds child node-b I1117 09:41:23.920386 node.go:539 weedfs:dc1:rack2:node-b adds child --- PASS: TestPlanRackAwareGrowth_EvenDistributionAcrossUnevenDCs (0.01s) === RUN TestPlanRackAwareGrowth_SkipsDataCentersWithoutLayoutVolumes I1117 09:41:23.923291 node.go:539 weedfs adds child dc1 I1117 09:41:23.923444 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.923700 node.go:539 weedfs:dc1:rack1 adds child node-a I1117 09:41:23.923981 node.go:539 weedfs:dc1:rack1:node-a adds child I1117 09:41:23.924216 node.go:539 weedfs adds child dc2 I1117 09:41:23.924349 node.go:539 weedfs:dc2 adds child rack2 I1117 09:41:23.924499 node.go:539 weedfs:dc2:rack2 adds child node-b I1117 09:41:23.924650 node.go:539 weedfs:dc2:rack2:node-b adds child I1117 09:41:23.924826 node.go:539 weedfs adds child dc3 I1117 09:41:23.924950 node.go:539 weedfs:dc3 adds child rack3 I1117 09:41:23.925095 node.go:539 weedfs:dc3:rack3 adds child node-c I1117 09:41:23.925305 node.go:539 weedfs:dc3:rack3:node-c adds child I1117 09:41:23.925486 node.go:539 weedfs adds child dc4 I1117 09:41:23.925619 node.go:539 weedfs:dc4 adds child rack4 I1117 09:41:23.925842 node.go:539 weedfs:dc4:rack4 adds child node-d I1117 09:41:23.926024 node.go:539 weedfs:dc4:rack4:node-d adds child I1117 09:41:23.927955 node.go:539 weedfs adds child dc4 I1117 09:41:23.928140 node.go:539 weedfs:dc4 adds child rack4 I1117 09:41:23.928341 node.go:539 weedfs:dc4:rack4 adds child node-d I1117 09:41:23.928475 node.go:539 weedfs:dc4:rack4:node-d adds child I1117 09:41:23.928670 node.go:539 weedfs adds child dc1 I1117 09:41:23.928795 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.928940 node.go:539 weedfs:dc1:rack1 adds child node-a I1117 09:41:23.929234 node.go:539 weedfs:dc1:rack1:node-a adds child I1117 09:41:23.929447 node.go:539 weedfs adds child dc2 I1117 09:41:23.929596 node.go:539 weedfs:dc2 adds child rack2 I1117 09:41:23.929790 node.go:539 weedfs:dc2:rack2 adds child node-b I1117 09:41:23.929924 node.go:539 weedfs:dc2:rack2:node-b adds child I1117 09:41:23.930109 node.go:539 weedfs adds child dc3 I1117 09:41:23.930252 node.go:539 weedfs:dc3 adds child rack3 I1117 09:41:23.930407 node.go:539 weedfs:dc3:rack3 adds child node-c I1117 09:41:23.930536 node.go:539 weedfs:dc3:rack3:node-c adds child --- PASS: TestPlanRackAwareGrowth_SkipsDataCentersWithoutLayoutVolumes (0.01s) === RUN TestPlanRackAwareGrowth_DivisorCountsOnlyHostingRacks I1117 09:41:23.933547 node.go:539 weedfs adds child dc1 I1117 09:41:23.933780 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.933951 node.go:539 weedfs:dc1:rack1 adds child node-a I1117 09:41:23.934191 node.go:539 weedfs:dc1:rack1:node-a adds child I1117 09:41:23.934419 node.go:539 weedfs:dc1 adds child rack2 I1117 09:41:23.934577 node.go:539 weedfs:dc1:rack2 adds child node-b I1117 09:41:23.934772 node.go:539 weedfs:dc1:rack2:node-b adds child I1117 09:41:23.934993 node.go:539 weedfs adds child dc2 I1117 09:41:23.935165 node.go:539 weedfs:dc2 adds child rack3 I1117 09:41:23.935340 node.go:539 weedfs:dc2:rack3 adds child node-c I1117 09:41:23.935477 node.go:539 weedfs:dc2:rack3:node-c adds child I1117 09:41:23.935717 node.go:539 weedfs:dc2 adds child rack4 I1117 09:41:23.935880 node.go:539 weedfs:dc2:rack4 adds child node-d I1117 09:41:23.936012 node.go:539 weedfs:dc2:rack4:node-d adds child --- PASS: TestPlanRackAwareGrowth_DivisorCountsOnlyHostingRacks (0.00s) === RUN TestToVolumeGrowRequest_SingleDataCenterLayout I1117 09:41:23.938392 node.go:539 weedfs adds child dc1 I1117 09:41:23.938567 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.938730 node.go:539 weedfs:dc1:rack1 adds child node-a I1117 09:41:23.938961 node.go:539 weedfs:dc1:rack1:node-a adds child I1117 09:41:23.939163 node.go:539 weedfs adds child dc2 I1117 09:41:23.939309 node.go:539 weedfs:dc2 adds child rack2 I1117 09:41:23.939466 node.go:539 weedfs:dc2:rack2 adds child node-b I1117 09:41:23.939707 node.go:539 weedfs:dc2:rack2:node-b adds child I1117 09:41:23.939934 node.go:539 weedfs adds child dc3 I1117 09:41:23.940060 node.go:539 weedfs:dc3 adds child rack3 I1117 09:41:23.940238 node.go:539 weedfs:dc3:rack3 adds child node-c I1117 09:41:23.940429 node.go:539 weedfs:dc3:rack3:node-c adds child --- PASS: TestToVolumeGrowRequest_SingleDataCenterLayout (0.00s) === RUN TestToVolumeGrowRequest_CrossDCReplicationNeverPinned I1117 09:41:23.942656 node.go:539 weedfs adds child dc1 I1117 09:41:23.942813 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.942975 node.go:539 weedfs:dc1:rack1 adds child node-a I1117 09:41:23.943232 node.go:539 weedfs:dc1:rack1:node-a adds child I1117 09:41:23.943493 node.go:539 weedfs adds child dc2 I1117 09:41:23.943656 node.go:539 weedfs:dc2 adds child rack2 I1117 09:41:23.943826 node.go:539 weedfs:dc2:rack2 adds child node-b I1117 09:41:23.943967 node.go:539 weedfs:dc2:rack2:node-b adds child --- PASS: TestToVolumeGrowRequest_CrossDCReplicationNeverPinned (0.00s) === RUN TestShouldGrowVolumes_UnwritableCrowdedVolumes I1117 09:41:23.945093 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:41:23.945242 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:23.945406 volume_layout.go:1333 Volume 1 reaches full capacity. I1117 09:41:23.945611 volume_layout.go:1348 Volume 2 becomes crowded --- PASS: TestShouldGrowVolumes_UnwritableCrowdedVolumes (0.00s) === RUN TestPickForWriteCapsWritableVolumes I1117 09:41:23.946590 node.go:539 mw adds child dc1 I1117 09:41:23.946803 node.go:539 mw:dc1 adds child rack1 I1117 09:41:23.947186 node.go:539 mw:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:23.947674 node.go:539 mw:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:23.948987 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestPickForWriteCapsWritableVolumes (0.00s) === RUN TestPickForWriteCapFallsToNextWritable I1117 09:41:23.950698 node.go:539 mw adds child dc1 I1117 09:41:23.951079 node.go:539 mw:dc1 adds child rack1 I1117 09:41:23.951309 node.go:539 mw:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:23.951719 node.go:539 mw:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:23.952511 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:41:23.953225 volume_layout.go:1340 Volume 1 becomes uncrowded I1117 09:41:23.953391 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:23.953571 volume_layout.go:480 volume 1 is not fully writable --- PASS: TestPickForWriteCapFallsToNextWritable (0.00s) === RUN TestPickForWriteCapOfTwoAndDisabled I1117 09:41:23.954559 node.go:539 mw adds child dc1 I1117 09:41:23.954720 node.go:539 mw:dc1 adds child rack1 I1117 09:41:23.954938 node.go:539 mw:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:23.955345 node.go:539 mw:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:23.956158 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestPickForWriteCapOfTwoAndDisabled (0.00s) === RUN TestPickForWriteCapWithinRequestedLocation I1117 09:41:23.958798 node.go:539 mw adds child dc1 I1117 09:41:23.958982 node.go:539 mw:dc1 adds child rack1 I1117 09:41:23.959284 node.go:539 mw:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:23.959718 node.go:539 mw:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:23.959940 node.go:539 mw adds child dc2 I1117 09:41:23.960126 node.go:539 mw:dc2 adds child rack2 I1117 09:41:23.960418 node.go:539 mw:dc2:rack2 adds child 127.0.0.2:8080 I1117 09:41:23.960599 node.go:539 mw:dc2:rack2:127.0.0.2:8080 adds child I1117 09:41:23.961245 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestPickForWriteCapWithinRequestedLocation (0.00s) === RUN TestUpdateOversizedStateKeepsOversizedVolumeUnwritable I1117 09:41:23.964357 node.go:539 weedfs adds child dc1 I1117 09:41:23.964704 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.965020 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:23.965412 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:23.965712 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:23.965997 volume_layout.go:542 Volume 1 reaches full capacity (effective=13000, limit=10000). I1117 09:41:23.966430 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestUpdateOversizedStateKeepsOversizedVolumeUnwritable (0.00s) === RUN TestUpdateOversizedStateClearsMarkWhenVolumeShrinks I1117 09:41:23.968194 node.go:539 weedfs adds child dc1 I1117 09:41:23.968342 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.968493 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:23.968743 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestUpdateOversizedStateClearsMarkWhenVolumeShrinks (0.00s) === RUN TestEnsureCorrectWritablesHonorsRecoveryCooldown I1117 09:41:23.970839 node.go:539 weedfs adds child dc1 I1117 09:41:23.971002 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.971181 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:23.971485 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:23.971737 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:23.971882 volume_layout.go:542 Volume 1 reaches full capacity (effective=13000, limit=10000). I1117 09:41:23.972379 volume_layout.go:373 Volume 1 recovered to writable (effective=6250, reported=4000, limit=10000). --- PASS: TestEnsureCorrectWritablesHonorsRecoveryCooldown (0.00s) === RUN TestEnsureCorrectWritablesDoesNotRestoreVolumeStillAtLimit I1117 09:41:23.974195 node.go:539 weedfs adds child dc1 I1117 09:41:23.974354 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.974519 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:23.974804 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:23.975052 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:23.975189 volume_layout.go:542 Volume 1 reaches full capacity (effective=13000, limit=10000). I1117 09:41:23.975526 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestEnsureCorrectWritablesDoesNotRestoreVolumeStillAtLimit (0.00s) === RUN TestEnsureCorrectWritablesRestoresCrowdedVolumeAfterReplicaReturns I1117 09:41:23.977451 node.go:539 weedfs adds child dc1 I1117 09:41:23.977608 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.977775 node.go:539 weedfs:dc1:rack1 adds child server2 I1117 09:41:23.978032 node.go:539 weedfs:dc1:rack1:server2 adds child I1117 09:41:23.978310 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:23.978499 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:23.978667 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:23.978942 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:41:23.979285 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:23.979437 volume_layout.go:477 volume 1 does not have enough copies --- PASS: TestEnsureCorrectWritablesRestoresCrowdedVolumeAfterReplicaReturns (0.00s) === RUN TestIncrementalRegistrationKeepsOversizedMark I1117 09:41:23.980609 node.go:539 weedfs adds child dc1 I1117 09:41:23.980779 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.981101 node.go:539 weedfs:dc1:rack1 adds child 127.0.0.1:34534 I1117 09:41:23.981325 node.go:539 weedfs:dc1:rack1:127.0.0.1:34534 adds child I1117 09:41:23.982012 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestIncrementalRegistrationKeepsOversizedMark (0.00s) === RUN TestPickForWriteWeightedDistribution I1117 09:41:23.984134 node.go:539 weedfs adds child dc1 I1117 09:41:23.984273 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:23.984473 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:23.984733 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestPickForWriteWeightedDistribution (0.49s) === RUN TestPickForWriteWithPendingSize I1117 09:41:24.471881 node.go:539 weedfs adds child dc1 I1117 09:41:24.472168 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.472368 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.472735 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestPickForWriteWithPendingSize (0.08s) === RUN TestPickForWriteEstimatesPendingSizeFromVolumeAverage I1117 09:41:24.557139 node.go:539 weedfs adds child dc1 I1117 09:41:24.557364 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.557543 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.557892 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestPickForWriteEstimatesPendingSizeFromVolumeAverage (0.00s) === RUN TestPickForWriteEstimateFallsBackWithoutHistory I1117 09:41:24.560486 node.go:539 weedfs adds child dc1 I1117 09:41:24.560631 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.560850 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.561124 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestPickForWriteEstimateFallsBackWithoutHistory (0.00s) === RUN TestPickForWriteSingleWritable I1117 09:41:24.563030 node.go:539 weedfs adds child dc1 I1117 09:41:24.563199 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.563360 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.563585 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestPickForWriteSingleWritable (0.00s) === RUN TestPickForWriteAllNearFull I1117 09:41:24.565994 node.go:539 weedfs adds child dc1 I1117 09:41:24.566154 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.566338 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.566605 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestPickForWriteAllNearFull (0.00s) === RUN TestPickForWriteConstrainedWeighted I1117 09:41:24.570055 node.go:539 weedfs adds child dc1 I1117 09:41:24.570234 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.570397 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.570721 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:24.571038 node.go:539 weedfs:dc1 adds child rack2 I1117 09:41:24.571192 node.go:539 weedfs:dc1:rack2 adds child server2 I1117 09:41:24.571373 node.go:539 weedfs:dc1:rack2:server2 adds child --- PASS: TestPickForWriteConstrainedWeighted (0.26s) === RUN TestRecordAssignMarksCrowded I1117 09:41:24.831819 node.go:539 weedfs adds child dc1 I1117 09:41:24.832127 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.832363 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.832717 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:24.833014 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestRecordAssignMarksCrowded (0.00s) === RUN TestRecordAssignReachingCapacityRemovesFromWritable I1117 09:41:24.834837 node.go:539 weedfs adds child dc1 I1117 09:41:24.835004 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.835188 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.835467 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:24.835880 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:24.836049 volume_layout.go:542 Volume 1 reaches full capacity (effective=10000, limit=10000). --- PASS: TestRecordAssignReachingCapacityRemovesFromWritable (0.00s) === RUN TestUpdateVolumeSizeRecoversEagerlyRemovedVolume I1117 09:41:24.837755 node.go:539 weedfs adds child dc1 I1117 09:41:24.837956 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.838164 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.838496 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:24.838868 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:24.839005 volume_layout.go:542 Volume 1 reaches full capacity (effective=10000, limit=10000). I1117 09:41:24.839426 volume_layout.go:373 Volume 1 recovered to writable (effective=4375, reported=4000, limit=10000). --- PASS: TestUpdateVolumeSizeRecoversEagerlyRemovedVolume (0.00s) === RUN TestUpdateVolumeSizeNoRecoveryWhenDiskStillOversized I1117 09:41:24.841025 node.go:539 weedfs adds child dc1 I1117 09:41:24.841175 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.841382 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.841645 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:24.841914 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:24.842061 volume_layout.go:542 Volume 1 reaches full capacity (effective=10000, limit=10000). I1117 09:41:24.842296 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestUpdateVolumeSizeNoRecoveryWhenDiskStillOversized (0.00s) === RUN TestHeartbeatDecaysPendingSize I1117 09:41:24.844377 node.go:539 weedfs adds child dc1 I1117 09:41:24.844574 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.844781 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.845100 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestHeartbeatDecaysPendingSize (0.08s) === RUN TestHeartbeatDecayDedupReplicas I1117 09:41:24.923462 node.go:539 weedfs adds child dc1 I1117 09:41:24.923774 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.923974 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.924312 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:24.924564 node.go:539 weedfs:dc1:rack1 adds child server2 I1117 09:41:24.924745 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:24.924925 node.go:539 weedfs:dc1:rack1:server2 adds child --- PASS: TestHeartbeatDecayDedupReplicas (0.00s) === RUN TestUpdateVolumeSize_DecaysEvenWhenReportedSizeUnchanged I1117 09:41:24.926829 node.go:539 weedfs adds child dc1 I1117 09:41:24.927031 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.927217 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.927544 node.go:539 weedfs:dc1:rack1:server1 adds child --- PASS: TestUpdateVolumeSize_DecaysEvenWhenReportedSizeUnchanged (0.00s) === RUN TestShouldGrowVolumesByDcAndRack_WithPendingSize I1117 09:41:24.929891 node.go:539 weedfs adds child dc1 I1117 09:41:24.930109 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.930319 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.930714 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:24.931126 volume_layout.go:1348 Volume 1 becomes crowded --- PASS: TestShouldGrowVolumesByDcAndRack_WithPendingSize (0.00s) === RUN TestShouldGrowVolumesWithinLocation I1117 09:41:24.933867 node.go:539 weedfs adds child dc1 I1117 09:41:24.934201 node.go:539 weedfs:dc1 adds child rack1 I1117 09:41:24.934402 node.go:539 weedfs:dc1:rack1 adds child server1 I1117 09:41:24.934823 node.go:539 weedfs:dc1:rack1:server1 adds child I1117 09:41:24.935204 node.go:539 weedfs adds child dc2 I1117 09:41:24.935344 node.go:539 weedfs:dc2 adds child rack2 I1117 09:41:24.935552 node.go:539 weedfs:dc2:rack2 adds child server2 I1117 09:41:24.935708 node.go:539 weedfs:dc2:rack2:server2 adds child --- PASS: TestShouldGrowVolumesWithinLocation (0.00s) === RUN TestSizeTrackingSkipsReadOnlyVolumes I1117 09:41:24.937367 node.go:539 st adds child dc1 I1117 09:41:24.937546 node.go:539 st:dc1 adds child rack1 I1117 09:41:24.937899 node.go:539 st:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:24.938107 node.go:539 st:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestSizeTrackingSkipsReadOnlyVolumes (0.00s) === RUN TestSizeTrackingReleasedWhenAVolumeGoesReadOnly I1117 09:41:24.939962 node.go:539 st adds child dc1 I1117 09:41:24.940132 node.go:539 st:dc1 adds child rack1 I1117 09:41:24.940357 node.go:539 st:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:24.940536 node.go:539 st:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:24.941645 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:24.941810 volume_layout.go:480 volume 1 is not fully writable --- PASS: TestSizeTrackingReleasedWhenAVolumeGoesReadOnly (0.00s) === RUN TestSizeTrackingReturnsWhenAVolumeBecomesWritable I1117 09:41:24.942616 node.go:539 st adds child dc1 I1117 09:41:24.942779 node.go:539 st:dc1 adds child rack1 I1117 09:41:24.942970 node.go:539 st:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:24.943179 node.go:539 st:dc1:rack1:127.0.0.1:8080 adds child --- PASS: TestSizeTrackingReturnsWhenAVolumeBecomesWritable (0.00s) === RUN TestSizeTrackingSurvivesAFullVolume I1117 09:41:24.944906 node.go:539 st adds child dc1 I1117 09:41:24.945075 node.go:539 st:dc1 adds child rack1 I1117 09:41:24.945276 node.go:539 st:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:24.945479 node.go:539 st:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:24.946029 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:24.946181 volume_layout.go:542 Volume 1 reaches full capacity (effective=33768, limit=32768). --- PASS: TestSizeTrackingSurvivesAFullVolume (0.00s) === RUN TestSizeTrackingIgnoresReplicaReportOrder === RUN TestSizeTrackingIgnoresReplicaReportOrder/ReadOnlyFirst I1117 09:41:24.947679 node.go:539 st adds child dc1 I1117 09:41:24.948069 node.go:539 st:dc1 adds child rack1 I1117 09:41:24.948351 node.go:539 st:dc1:rack1 adds child a I1117 09:41:24.948566 node.go:539 st:dc1:rack1:a adds child I1117 09:41:24.948872 node.go:539 st:dc1:rack1 adds child b I1117 09:41:24.949045 node.go:539 st:dc1:rack1:b adds child === RUN TestSizeTrackingIgnoresReplicaReportOrder/WritableFirst I1117 09:41:24.950811 node.go:539 st adds child dc1 I1117 09:41:24.951139 node.go:539 st:dc1 adds child rack1 I1117 09:41:24.951323 node.go:539 st:dc1:rack1 adds child a I1117 09:41:24.951539 node.go:539 st:dc1:rack1:a adds child I1117 09:41:24.951752 node.go:539 st:dc1:rack1 adds child b I1117 09:41:24.951926 node.go:539 st:dc1:rack1:b adds child --- PASS: TestSizeTrackingIgnoresReplicaReportOrder (0.01s) --- PASS: TestSizeTrackingIgnoresReplicaReportOrder/ReadOnlyFirst (0.00s) --- PASS: TestSizeTrackingIgnoresReplicaReportOrder/WritableFirst (0.00s) === RUN TestCrowdedEntryReleasedWithSizeTracking I1117 09:41:24.953629 node.go:539 st adds child dc1 I1117 09:41:24.953969 node.go:539 st:dc1 adds child rack1 I1117 09:41:24.954270 node.go:539 st:dc1:rack1 adds child 127.0.0.1:8080 I1117 09:41:24.954466 node.go:539 st:dc1:rack1:127.0.0.1:8080 adds child I1117 09:41:24.955275 volume_layout.go:1348 Volume 1 becomes crowded I1117 09:41:24.955668 volume_layout.go:1340 Volume 1 becomes uncrowded I1117 09:41:24.955802 volume_layout.go:1149 Volume 1 becomes unwritable I1117 09:41:24.955953 volume_layout.go:480 volume 1 is not fully writable --- PASS: TestCrowdedEntryReleasedWithSizeTracking (0.00s) === RUN TestLocationFlagsFollowTheirNode --- PASS: TestLocationFlagsFollowTheirNode (0.00s) === RUN TestLocationFlagsClearedWithTheirNode --- PASS: TestLocationFlagsClearedWithTheirNode (0.00s) === RUN TestLocationFlagsSurviveAReplacedNode --- PASS: TestLocationFlagsSurviveAReplacedNode (0.00s) === RUN TestLocationFlagsIgnoreUntrackableReplicaCounts --- PASS: TestLocationFlagsIgnoreUntrackableReplicaCounts (0.00s) === RUN TestLocationFlagsRebuiltByRefresh --- PASS: TestLocationFlagsRebuiltByRefresh (0.00s) === RUN TestStreamVolumesStaysInsideTheAnnouncedTopology I1117 09:41:24.964305 node.go:539 bounds adds child dc1 I1117 09:41:24.964671 node.go:539 bounds:dc1 adds child rack1 I1117 09:41:24.964973 node.go:539 bounds:dc1:rack1 adds child 10.0.0.1:8080 I1117 09:41:24.965201 node.go:539 bounds:dc1:rack1:10.0.0.1:8080 adds child I1117 09:41:24.966544 node.go:539 bounds:dc1:rack1 adds child 10.0.0.2:8080 I1117 09:41:24.966740 node.go:539 bounds:dc1:rack1:10.0.0.2:8080 adds child --- PASS: TestStreamVolumesStaysInsideTheAnnouncedTopology (0.00s) === RUN TestStreamedListingRebuildsToTheSameThing I1117 09:41:24.969723 node.go:539 stream adds child dc1 I1117 09:41:24.969894 node.go:539 stream:dc1 adds child rack1 I1117 09:41:24.970283 node.go:539 stream:dc1:rack1 adds child 10.0.1.1:8080 I1117 09:41:24.970481 node.go:539 stream:dc1:rack1:10.0.1.1:8080 adds child I1117 09:41:25.023182 node.go:539 stream:dc1:rack1 adds child 10.0.1.2:8080 I1117 09:41:25.023568 node.go:539 stream:dc1:rack1:10.0.1.2:8080 adds child I1117 09:41:25.071265 node.go:539 stream adds child dc2 I1117 09:41:25.071596 node.go:539 stream:dc2 adds child rack1 I1117 09:41:25.071892 node.go:539 stream:dc2:rack1 adds child 10.0.2.1:8080 I1117 09:41:25.072106 node.go:539 stream:dc2:rack1:10.0.2.1:8080 adds child I1117 09:41:25.120647 node.go:539 stream:dc2:rack1 adds child 10.0.2.2:8080 I1117 09:41:25.121072 node.go:539 stream:dc2:rack1:10.0.2.2:8080 adds child === RUN TestStreamedListingRebuildsToTheSameThing/batch=1 === RUN TestStreamedListingRebuildsToTheSameThing/batch=7 === RUN TestStreamedListingRebuildsToTheSameThing/batch=250 === RUN TestStreamedListingRebuildsToTheSameThing/batch=100000 --- PASS: TestStreamedListingRebuildsToTheSameThing (0.50s) --- PASS: TestStreamedListingRebuildsToTheSameThing/batch=1 (0.09s) --- PASS: TestStreamedListingRebuildsToTheSameThing/batch=7 (0.08s) --- PASS: TestStreamedListingRebuildsToTheSameThing/batch=250 (0.06s) --- PASS: TestStreamedListingRebuildsToTheSameThing/batch=100000 (0.07s) === RUN TestStreamedListingHonoursTheFilter I1117 09:41:25.472462 node.go:539 stream adds child dc1 I1117 09:41:25.472893 node.go:539 stream:dc1 adds child rack1 I1117 09:41:25.473176 node.go:539 stream:dc1:rack1 adds child 10.0.1.1:8080 I1117 09:41:25.473531 node.go:539 stream:dc1:rack1:10.0.1.1:8080 adds child I1117 09:41:25.529803 node.go:539 stream:dc1:rack1 adds child 10.0.1.2:8080 I1117 09:41:25.530205 node.go:539 stream:dc1:rack1:10.0.1.2:8080 adds child I1117 09:41:25.580635 node.go:539 stream adds child dc2 I1117 09:41:25.580949 node.go:539 stream:dc2 adds child rack1 I1117 09:41:25.581241 node.go:539 stream:dc2:rack1 adds child 10.0.2.1:8080 I1117 09:41:25.581487 node.go:539 stream:dc2:rack1:10.0.2.1:8080 adds child I1117 09:41:25.632423 node.go:539 stream:dc2:rack1 adds child 10.0.2.2:8080 I1117 09:41:25.632692 node.go:539 stream:dc2:rack1:10.0.2.2:8080 adds child --- PASS: TestStreamedListingHonoursTheFilter (0.22s) PASS ok github.com/seaweedfs/seaweedfs/weed/topology 50.299s === RUN TestVolumeDensity --- PASS: TestVolumeDensity (0.00s) === RUN TestDensityRatio --- PASS: TestDensityRatio (0.00s) === RUN TestDensityNextRatio --- PASS: TestDensityNextRatio (0.00s) === RUN TestDensityRatio_OverfullSortsFullest --- PASS: TestDensityRatio_OverfullSortsFullest (0.00s) === RUN TestDiskTooFullAfter === RUN TestDiskTooFullAfter/disabled_at_0 === RUN TestDiskTooFullAfter/disabled_at_100 === RUN TestDiskTooFullAfter/not_reported_(total_0) === RUN TestDiskTooFullAfter/below_mark === RUN TestDiskTooFullAfter/at_mark === RUN TestDiskTooFullAfter/above_mark === RUN TestDiskTooFullAfter/below_but_crosses_with_incoming === RUN TestDiskTooFullAfter/below_and_stays_below_with_incoming === RUN TestDiskTooFullAfter/free_exceeds_total_(defensive) --- PASS: TestDiskTooFullAfter (0.02s) --- PASS: TestDiskTooFullAfter/disabled_at_0 (0.00s) --- PASS: TestDiskTooFullAfter/disabled_at_100 (0.00s) --- PASS: TestDiskTooFullAfter/not_reported_(total_0) (0.00s) --- PASS: TestDiskTooFullAfter/below_mark (0.00s) --- PASS: TestDiskTooFullAfter/at_mark (0.00s) --- PASS: TestDiskTooFullAfter/above_mark (0.00s) --- PASS: TestDiskTooFullAfter/below_but_crosses_with_incoming (0.00s) --- PASS: TestDiskTooFullAfter/below_and_stays_below_with_incoming (0.00s) --- PASS: TestDiskTooFullAfter/free_exceeds_total_(defensive) (0.00s) === RUN TestIsGoodMove_OverReplicatedSourceKeepsOtherReplica --- PASS: TestIsGoodMove_OverReplicatedSourceKeepsOtherReplica (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/topology/balancer 2.206s === RUN TestAsyncBatchWorkerProcessesInOrder --- PASS: TestAsyncBatchWorkerProcessesInOrder (0.01s) === RUN TestAsyncBatchWorkerDrainWaitsForEnqueued --- PASS: TestAsyncBatchWorkerDrainWaitsForEnqueued (0.00s) === RUN TestAsyncBatchWorkerEnqueueNeverBlocks --- PASS: TestAsyncBatchWorkerEnqueueNeverBlocks (0.01s) === RUN TestAsyncBatchWorkerDrainCompletesDuringShutdown --- PASS: TestAsyncBatchWorkerDrainCompletesDuringShutdown (0.10s) === RUN TestAsyncBatchWorkerShutdownDrainsThenStops --- PASS: TestAsyncBatchWorkerShutdownDrainsThenStops (0.00s) === RUN TestExtractBucketPath === RUN TestExtractBucketPath/child_paths_return_bucket === RUN TestExtractBucketPath/bucket_root_without_child_fails_when_required === RUN TestExtractBucketPath/bucket_root_allowed_when_not_required === RUN TestExtractBucketPath/path_outside_buckets_fails === RUN TestExtractBucketPath/trailing_slash_on_base_is_normalized --- PASS: TestExtractBucketPath (0.03s) --- PASS: TestExtractBucketPath/child_paths_return_bucket (0.00s) --- PASS: TestExtractBucketPath/bucket_root_without_child_fails_when_required (0.00s) --- PASS: TestExtractBucketPath/bucket_root_allowed_when_not_required (0.00s) --- PASS: TestExtractBucketPath/path_outside_buckets_fails (0.00s) --- PASS: TestExtractBucketPath/trailing_slash_on_base_is_normalized (0.00s) === RUN TestRandomUint64ReturnsFullRandomValue --- PASS: TestRandomUint64ReturnsFullRandomValue (0.01s) === RUN TestRandomUint64PanicsOnRandomReadError --- PASS: TestRandomUint64PanicsOnRandomReadError (0.00s) === RUN TestByteParsing --- PASS: TestByteParsing (0.00s) === RUN TestSameAsJavaImplementation Now we need to generate a 256-bit key for AES 256 GCM --- PASS: TestSameAsJavaImplementation (0.01s) === RUN TestIsCompressableFileType --- PASS: TestIsCompressableFileType (0.00s) === RUN TestWaitUntilReturnsWhenReady --- PASS: TestWaitUntilReturnsWhenReady (0.03s) === RUN TestWaitUntilTimesOutWithoutWakeup --- PASS: TestWaitUntilTimesOutWithoutWakeup (0.05s) === RUN TestWaitUntilStopsOnCancel --- PASS: TestWaitUntilStopsOnCancel (0.03s) === RUN TestViperProxySerializesMapReadsAgainstWrites --- PASS: TestViperProxySerializesMapReadsAgainstWrites (1.24s) === RUN TestNewViperProxyWrapsGivenViper --- PASS: TestNewViperProxyWrapsGivenViper (0.01s) === RUN TestExecuteParallelTaskGroups --- PASS: TestExecuteParallelTaskGroups (0.01s) === RUN TestExecuteParallelTaskGroupsStopsOnlyFailedGroup --- PASS: TestExecuteParallelTaskGroupsStopsOnlyFailedGroup (0.00s) === RUN TestDropOSPageCache --- PASS: TestDropOSPageCache (0.00s) === RUN TestToShortFileName --- PASS: TestToShortFileName (0.02s) === RUN TestResolvePath === RUN TestResolvePath/empty === RUN TestResolvePath/absolute === RUN TestResolvePath/relative === RUN TestResolvePath/tilde_mid_path_is_literal === RUN TestResolvePath/bare_tilde === RUN TestResolvePath/tilde_slash === RUN TestResolvePath/tilde_with_subpath === RUN TestResolvePath/tilde_with_current_user === RUN TestResolvePath/tilde_with_current_user_and_subpath === RUN TestResolvePath/tilde_unknown_user_falls_back_to_literal === RUN TestResolvePath/tilde_with_native_separator === RUN TestResolvePath/tilde_user_with_native_separator --- PASS: TestResolvePath (0.10s) --- PASS: TestResolvePath/empty (0.00s) --- PASS: TestResolvePath/absolute (0.00s) --- PASS: TestResolvePath/relative (0.00s) --- PASS: TestResolvePath/tilde_mid_path_is_literal (0.00s) --- PASS: TestResolvePath/bare_tilde (0.00s) --- PASS: TestResolvePath/tilde_slash (0.00s) --- PASS: TestResolvePath/tilde_with_subpath (0.00s) --- PASS: TestResolvePath/tilde_with_current_user (0.00s) --- PASS: TestResolvePath/tilde_with_current_user_and_subpath (0.00s) --- PASS: TestResolvePath/tilde_unknown_user_falls_back_to_literal (0.08s) --- PASS: TestResolvePath/tilde_with_native_separator (0.00s) --- PASS: TestResolvePath/tilde_user_with_native_separator (0.00s) === RUN TestResolveCommaSeparatedPaths === RUN TestResolveCommaSeparatedPaths/empty === RUN TestResolveCommaSeparatedPaths/single_absolute === RUN TestResolveCommaSeparatedPaths/single_tilde === RUN TestResolveCommaSeparatedPaths/two_absolutes === RUN TestResolveCommaSeparatedPaths/two_tildes === RUN TestResolveCommaSeparatedPaths/mixed === RUN TestResolveCommaSeparatedPaths/no_tilde_fast_path --- PASS: TestResolveCommaSeparatedPaths (0.02s) --- PASS: TestResolveCommaSeparatedPaths/empty (0.00s) --- PASS: TestResolveCommaSeparatedPaths/single_absolute (0.00s) --- PASS: TestResolveCommaSeparatedPaths/single_tilde (0.00s) --- PASS: TestResolveCommaSeparatedPaths/two_absolutes (0.00s) --- PASS: TestResolveCommaSeparatedPaths/two_tildes (0.00s) --- PASS: TestResolveCommaSeparatedPaths/mixed (0.00s) --- PASS: TestResolveCommaSeparatedPaths/no_tilde_fast_path (0.00s) === RUN TestSanitizeUTF8Name_ValidPassThrough --- PASS: TestSanitizeUTF8Name_ValidPassThrough (0.00s) === RUN TestSanitizeUTF8Name_InvalidBytes --- PASS: TestSanitizeUTF8Name_InvalidBytes (0.00s) === RUN TestFullPathSanitized_WholePath --- PASS: TestFullPathSanitized_WholePath (0.00s) === RUN TestFullPathDirAndName_OnlyNameSanitized --- PASS: TestFullPathDirAndName_OnlyNameSanitized (0.00s) === RUN TestFullPathBackslashNotSeparator === RUN TestFullPathBackslashNotSeparator//test/special\reverseslash4.jpg === RUN TestFullPathBackslashNotSeparator//a\b/c.jpg === RUN TestFullPathBackslashNotSeparator//dir/a\b\c.txt === RUN TestFullPathBackslashNotSeparator//dir/\file.txt --- PASS: TestFullPathBackslashNotSeparator (0.01s) --- PASS: TestFullPathBackslashNotSeparator//test/special\reverseslash4.jpg (0.00s) --- PASS: TestFullPathBackslashNotSeparator//a\b/c.jpg (0.00s) --- PASS: TestFullPathBackslashNotSeparator//dir/a\b\c.txt (0.00s) --- PASS: TestFullPathBackslashNotSeparator//dir/\file.txt (0.00s) === RUN TestFullPathSpecialCharactersInName === RUN TestFullPathSpecialCharactersInName//test/special#/endhashfolder.jpg === RUN TestFullPathSpecialCharactersInName//test/special?/endqfolder.jpg === RUN TestFullPathSpecialCharactersInName//test/special%/endpctfolder.jpg === RUN TestFullPathSpecialCharactersInName//test/special&/endampfolder.jpg === RUN TestFullPathSpecialCharactersInName//test/special=/endeqfolder.jpg === RUN TestFullPathSpecialCharactersInName//test/hash#file.jpg === RUN TestFullPathSpecialCharactersInName//test/q?file.jpg === RUN TestFullPathSpecialCharactersInName//test/pct%file.jpg --- PASS: TestFullPathSpecialCharactersInName (0.03s) --- PASS: TestFullPathSpecialCharactersInName//test/special#/endhashfolder.jpg (0.00s) --- PASS: TestFullPathSpecialCharactersInName//test/special?/endqfolder.jpg (0.00s) --- PASS: TestFullPathSpecialCharactersInName//test/special%/endpctfolder.jpg (0.00s) --- PASS: TestFullPathSpecialCharactersInName//test/special&/endampfolder.jpg (0.00s) --- PASS: TestFullPathSpecialCharactersInName//test/special=/endeqfolder.jpg (0.00s) --- PASS: TestFullPathSpecialCharactersInName//test/hash#file.jpg (0.00s) --- PASS: TestFullPathSpecialCharactersInName//test/q?file.jpg (0.00s) --- PASS: TestFullPathSpecialCharactersInName//test/pct%file.jpg (0.00s) === RUN TestJoinPreservesBackslash --- PASS: TestJoinPreservesBackslash (0.00s) === RUN TestAsInodeFitsSignedLong --- PASS: TestAsInodeFitsSignedLong (0.36s) === RUN TestHumanReadableIntsMax --- PASS: TestHumanReadableIntsMax (0.00s) === RUN TestHumanReadableInts --- PASS: TestHumanReadableInts (0.00s) === RUN TestOrderedLock ActiveLock 1 acquired lock 1 ActiveLock 1 released lock 1 ActiveLock 2 acquired lock 0 ActiveLock 2 released lock 0 ActiveLock 3 acquired lock 1 ActiveLock 3 released lock 1 ActiveLock 4 acquired lock 0 ActiveLock 5 acquired lock 0 ActiveLock 6 acquired lock 0 ActiveLock 7 acquired lock 0 ActiveLock 7 released lock 0 ActiveLock 4 released lock 0 ActiveLock 5 released lock 0 ActiveLock 6 released lock 0 ActiveLock 8 acquired lock 1 ActiveLock 8 released lock 1 ActiveLock 9 acquired lock 0 ActiveLock 10 acquired lock 0 ActiveLock 11 acquired lock 0 ActiveLock 12 acquired lock 0 ActiveLock 10 released lock 0 ActiveLock 9 released lock 0 ActiveLock 11 released lock 0 ActiveLock 12 released lock 0 ActiveLock 13 acquired lock 1 ActiveLock 13 released lock 1 ActiveLock 15 acquired lock 0 ActiveLock 14 acquired lock 0 ActiveLock 14 released lock 0 ActiveLock 16 acquired lock 0 ActiveLock 17 acquired lock 0 ActiveLock 15 released lock 0 ActiveLock 17 released lock 0 ActiveLock 16 released lock 0 ActiveLock 18 acquired lock 1 ActiveLock 18 released lock 1 ActiveLock 19 acquired lock 0 ActiveLock 20 acquired lock 0 ActiveLock 21 acquired lock 0 ActiveLock 22 acquired lock 0 ActiveLock 22 released lock 0 ActiveLock 21 released lock 0 ActiveLock 19 released lock 0 ActiveLock 20 released lock 0 ActiveLock 23 acquired lock 1 ActiveLock 23 released lock 1 ActiveLock 24 acquired lock 0 ActiveLock 25 acquired lock 0 ActiveLock 25 released lock 0 ActiveLock 26 acquired lock 0 ActiveLock 27 acquired lock 0 ActiveLock 27 released lock 0 ActiveLock 24 released lock 0 ActiveLock 26 released lock 0 ActiveLock 28 acquired lock 1 ActiveLock 28 released lock 1 ActiveLock 29 acquired lock 0 ActiveLock 30 acquired lock 0 ActiveLock 31 acquired lock 0 ActiveLock 32 acquired lock 0 ActiveLock 30 released lock 0 ActiveLock 32 released lock 0 ActiveLock 31 released lock 0 ActiveLock 29 released lock 0 ActiveLock 33 acquired lock 1 ActiveLock 34 acquired lock 0 ActiveLock 35 acquired lock 0 ActiveLock 36 acquired lock 0 ActiveLock 38 acquired lock 0 ActiveLock 37 acquired lock 0 ActiveLock 40 acquired lock 0 ActiveLock 41 acquired lock 0 ActiveLock 33 released lock 1 ActiveLock 37 released lock 0 ActiveLock 34 released lock 0 ActiveLock 36 released lock 0 ActiveLock 41 released lock 0 ActiveLock 40 released lock 0 ActiveLock 35 released lock 0 ActiveLock 38 released lock 0 ActiveLock 42 acquired lock 1 ActiveLock 42 released lock 1 ActiveLock 43 acquired lock 0 ActiveLock 44 acquired lock 0 ActiveLock 45 acquired lock 0 ActiveLock 46 acquired lock 0 ActiveLock 46 released lock 0 ActiveLock 47 acquired lock 0 ActiveLock 48 acquired lock 0 ActiveLock 49 acquired lock 0 ActiveLock 47 released lock 0 ActiveLock 49 released lock 0 ActiveLock 45 released lock 0 ActiveLock 43 released lock 0 ActiveLock 44 released lock 0 ActiveLock 48 released lock 0 ActiveLock 39 acquired lock 1 ActiveLock 39 released lock 1 ActiveLock 50 acquired lock 0 ActiveLock 50 released lock 0 --- PASS: TestOrderedLock (1.17s) === RUN TestShouldWaitForSharedLock --- PASS: TestShouldWaitForSharedLock (0.00s) === RUN TestShouldWaitForExclusiveLock --- PASS: TestShouldWaitForExclusiveLock (0.00s) === RUN TestParseMinFreeSpace --- PASS: TestParseMinFreeSpace (0.00s) === RUN TestHostKeyStripsPort === PAUSE TestHostKeyStripsPort === RUN TestHostKeysFromAddressesDedups === PAUSE TestHostKeysFromAddressesDedups === RUN TestSetOutboundLocalIP === RUN TestSetOutboundLocalIP/ipv4 === RUN TestSetOutboundLocalIP/ipv6 === RUN TestSetOutboundLocalIP/empty === RUN TestSetOutboundLocalIP/wildcard_v4 === RUN TestSetOutboundLocalIP/wildcard_v6 === RUN TestSetOutboundLocalIP/loopback_v4 === RUN TestSetOutboundLocalIP/loopback_v6 === RUN TestSetOutboundLocalIP/garbage --- PASS: TestSetOutboundLocalIP (0.01s) --- PASS: TestSetOutboundLocalIP/ipv4 (0.01s) --- PASS: TestSetOutboundLocalIP/ipv6 (0.00s) --- PASS: TestSetOutboundLocalIP/empty (0.00s) --- PASS: TestSetOutboundLocalIP/wildcard_v4 (0.00s) --- PASS: TestSetOutboundLocalIP/wildcard_v6 (0.00s) --- PASS: TestSetOutboundLocalIP/loopback_v4 (0.00s) --- PASS: TestSetOutboundLocalIP/loopback_v6 (0.00s) --- PASS: TestSetOutboundLocalIP/garbage (0.00s) === RUN TestSetOutboundLocalIPFirstWins --- PASS: TestSetOutboundLocalIPFirstWins (0.00s) === RUN TestOutboundLocalAddrForDial === RUN TestOutboundLocalAddrForDial/remote_tcp_binds === RUN TestOutboundLocalAddrForDial/tcp4_binds === RUN TestOutboundLocalAddrForDial/hostname_binds === RUN TestOutboundLocalAddrForDial/loopback_ip_skipped === RUN TestOutboundLocalAddrForDial/loopback_name_skipped === RUN TestOutboundLocalAddrForDial/ipv6_loopback_skipped === RUN TestOutboundLocalAddrForDial/ipv6_literal_target_skipped === RUN TestOutboundLocalAddrForDial/unix_network_skipped === RUN TestOutboundLocalAddrForDial/udp_network_skipped --- PASS: TestOutboundLocalAddrForDial (0.01s) --- PASS: TestOutboundLocalAddrForDial/remote_tcp_binds (0.00s) --- PASS: TestOutboundLocalAddrForDial/tcp4_binds (0.00s) --- PASS: TestOutboundLocalAddrForDial/hostname_binds (0.00s) --- PASS: TestOutboundLocalAddrForDial/loopback_ip_skipped (0.00s) --- PASS: TestOutboundLocalAddrForDial/loopback_name_skipped (0.00s) --- PASS: TestOutboundLocalAddrForDial/ipv6_loopback_skipped (0.00s) --- PASS: TestOutboundLocalAddrForDial/ipv6_literal_target_skipped (0.00s) --- PASS: TestOutboundLocalAddrForDial/unix_network_skipped (0.00s) --- PASS: TestOutboundLocalAddrForDial/udp_network_skipped (0.00s) === RUN TestOutboundLocalAddrFamilyMismatch --- PASS: TestOutboundLocalAddrFamilyMismatch (0.00s) === RUN TestParseHostPort === RUN TestParseHostPort/hostname === RUN TestParseHostPort/ipv4 === RUN TestParseHostPort/bracketed_ipv6 === RUN TestParseHostPort/missing_port === RUN TestParseHostPort/invalid_port --- PASS: TestParseHostPort (0.01s) --- PASS: TestParseHostPort/hostname (0.00s) --- PASS: TestParseHostPort/ipv4 (0.00s) --- PASS: TestParseHostPort/bracketed_ipv6 (0.00s) --- PASS: TestParseHostPort/missing_port (0.00s) --- PASS: TestParseHostPort/invalid_port (0.00s) === RUN TestPathPrefixFilter_Empty --- PASS: TestPathPrefixFilter_Empty (0.00s) === RUN TestPathPrefixFilter_ExcludeOnly --- PASS: TestPathPrefixFilter_ExcludeOnly (0.00s) === RUN TestPathPrefixFilter_IncludeOnly --- PASS: TestPathPrefixFilter_IncludeOnly (0.00s) === RUN TestPathPrefixFilter_DeeperPrefixWins --- PASS: TestPathPrefixFilter_DeeperPrefixWins (0.00s) === RUN TestPathPrefixFilter_DeeperExcludeWins --- PASS: TestPathPrefixFilter_DeeperExcludeWins (0.00s) === RUN TestPathPrefixFilter_MultipleOverlappingPrefixes --- PASS: TestPathPrefixFilter_MultipleOverlappingPrefixes (0.00s) === RUN TestPathPrefixFilter_InvalidPrefixes --- PASS: TestPathPrefixFilter_InvalidPrefixes (0.00s) === RUN TestPathPrefixFilter_TrailingSlashNormalization --- PASS: TestPathPrefixFilter_TrailingSlashNormalization (0.00s) === RUN TestPathPrefixFilter_BoundaryMatching --- PASS: TestPathPrefixFilter_BoundaryMatching (0.00s) === RUN TestNewQueue --- PASS: TestNewQueue (0.00s) === RUN TestEnqueueAndConsume 1 2 3 ----------------------- 4 5 6 7 ----------------------- --- PASS: TestEnqueueAndConsume (0.00s) === RUN TestShortenStep --- PASS: TestShortenStep (0.06s) === RUN TestRetryHintSlackIsJitteredWithinBounds --- PASS: TestRetryHintSlackIsJitteredWithinBounds (0.00s) === RUN TestRetryWithBackoffHonoursShorterServerHint --- PASS: TestRetryWithBackoffHonoursShorterServerHint (0.23s) === RUN TestIsTransientError --- PASS: TestIsTransientError (0.02s) === RUN TestIsTransientErrorPrefersServerStatus --- PASS: TestIsTransientErrorPrefersServerStatus (0.00s) === RUN TestIsTransientErrorMessage --- PASS: TestIsTransientErrorMessage (0.01s) === RUN TestRetryTransientError I1117 09:40:40.303968 retry.go:132 retry test: err: read: connection reset by peer I1117 09:40:41.383702 retry.go:125 retry test successfully --- PASS: TestRetryTransientError (1.09s) === RUN TestRetryUntil === RUN TestRetryUntil/SucceedsImmediately === RUN TestRetryUntil/SucceedsAfterRetry === RUN TestRetryUntil/FailsNonRetryable --- PASS: TestRetryUntil (2.51s) --- PASS: TestRetryUntil/SucceedsImmediately (0.00s) --- PASS: TestRetryUntil/SucceedsAfterRetry (2.50s) --- PASS: TestRetryUntil/FailsNonRetryable (0.00s) === RUN TestRetryWithBackoff === RUN TestRetryWithBackoff/SucceedsAfterRetries === RUN TestRetryWithBackoff/StopsOnNonRetryableError === RUN TestRetryWithBackoff/StopsOnContextCancel === RUN TestRetryWithBackoff/StopsOnMaxDuration I1117 09:40:51.418691 retry.go:230 retry test: giving up after 3s: unavailable --- PASS: TestRetryWithBackoff (7.52s) --- PASS: TestRetryWithBackoff/SucceedsAfterRetries (2.51s) --- PASS: TestRetryWithBackoff/StopsOnNonRetryableError (0.00s) --- PASS: TestRetryWithBackoff/StopsOnContextCancel (2.00s) --- PASS: TestRetryWithBackoff/StopsOnMaxDuration (3.00s) === RUN TestSingleFlightGroupDedup --- PASS: TestSingleFlightGroupDedup (0.00s) === RUN TestSingleFlightGroupDifferentKeys --- PASS: TestSingleFlightGroupDifferentKeys (0.00s) === RUN TestSingleFlightGroupErrorPropagation --- PASS: TestSingleFlightGroupErrorPropagation (0.00s) === RUN TestSingleFlightGroupFreshCallAfterCompletion --- PASS: TestSingleFlightGroupFreshCallAfterCompletion (0.00s) === RUN TestReorderToFront_StringSlice --- PASS: TestReorderToFront_StringSlice (0.00s) === CONT TestHostKeyStripsPort === CONT TestHostKeysFromAddressesDedups --- PASS: TestHostKeysFromAddressesDedups (0.00s) --- PASS: TestHostKeyStripsPort (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/util 15.930s === RUN TestSyncPoolPutBuffer_DropsOversized --- PASS: TestSyncPoolPutBuffer_DropsOversized (0.14s) === RUN TestSyncPoolPutBuffer_KeepsRightSized --- PASS: TestSyncPoolPutBuffer_KeepsRightSized (0.01s) === RUN TestSyncPoolPutBuffer_NilSafe --- PASS: TestSyncPoolPutBuffer_NilSafe (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/buffer_pool 0.496s === RUN TestJobQueue enqueued 5 items dequeue 1 dequeue 2 enqueue 6 enqueue 7 dequeue ... dequeued 3 dequeue ... dequeued 4 dequeue ... dequeued 5 dequeue ... dequeued 6 dequeue ... dequeued 7 enqueue 8 enqueue 9 enqueue 10 enqueue 11 enqueue 12 dequeued 8 dequeued 9 dequeued 10 dequeued 11 dequeued 12 --- PASS: TestJobQueue (0.01s) === RUN TestJobQueueClose dequeued 1 dequeued 2 dequeued 3 dequeued 4 dequeued 5 dequeued 6 dequeued 7 --- PASS: TestJobQueueClose (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/buffered_queue 0.322s ? github.com/seaweedfs/seaweedfs/weed/util/buffered_writer [no test files] === RUN TestOnDisk chunk_cache_on_disk_test.go:76: cache miss for entry 2 (acceptable with size constraints) chunk_cache_on_disk_test.go:129: cache miss for entry 2 after restart (acceptable) --- PASS: TestOnDisk (1.63s) === RUN TestLoadOrCreateChunkCacheVolumeClosesFilesOnError --- PASS: TestLoadOrCreateChunkCacheVolumeClosesFilesOnError (0.01s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/chunk_cache 3.742s ? github.com/seaweedfs/seaweedfs/weed/util/constants [no test files] ? github.com/seaweedfs/seaweedfs/weed/util/fla9 [no test files] ? github.com/seaweedfs/seaweedfs/weed/util/grace [no test files] === RUN TestIsProxyChunkUrl --- PASS: TestIsProxyChunkUrl (0.00s) === RUN TestJwtForFilerServer === RUN TestJwtForFilerServer/read === RUN TestJwtForFilerServer/write --- PASS: TestJwtForFilerServer (0.07s) --- PASS: TestJwtForFilerServer/read (0.05s) --- PASS: TestJwtForFilerServer/write (0.01s) === RUN TestJwtForFilerServerWithoutKeys --- PASS: TestJwtForFilerServerWithoutKeys (0.00s) === RUN TestAppendQueryParameter === RUN TestAppendQueryParameter/without_existing_query === RUN TestAppendQueryParameter/with_existing_query === RUN TestAppendQueryParameter/with_trailing_question_mark === RUN TestAppendQueryParameter/with_trailing_ampersand === RUN TestAppendQueryParameter/encodes_values === RUN TestAppendQueryParameter/preserves_fragment === RUN TestAppendQueryParameter/blank_url --- PASS: TestAppendQueryParameter (0.01s) --- PASS: TestAppendQueryParameter/without_existing_query (0.00s) --- PASS: TestAppendQueryParameter/with_existing_query (0.00s) --- PASS: TestAppendQueryParameter/with_trailing_question_mark (0.00s) --- PASS: TestAppendQueryParameter/with_trailing_ampersand (0.00s) --- PASS: TestAppendQueryParameter/encodes_values (0.00s) --- PASS: TestAppendQueryParameter/preserves_fragment (0.00s) --- PASS: TestAppendQueryParameter/blank_url (0.00s) === RUN TestReadUrlAsStreamReturnsGzipReaderError --- PASS: TestReadUrlAsStreamReturnsGzipReaderError (0.16s) === RUN TestReadUrlAsStreamStopsAtChunkSize === RUN TestReadUrlAsStreamStopsAtChunkSize/plain === RUN TestReadUrlAsStreamStopsAtChunkSize/gzip === RUN TestReadUrlAsStreamStopsAtChunkSize/cipher --- PASS: TestReadUrlAsStreamStopsAtChunkSize (0.30s) --- PASS: TestReadUrlAsStreamStopsAtChunkSize/plain (0.05s) --- PASS: TestReadUrlAsStreamStopsAtChunkSize/gzip (0.08s) --- PASS: TestReadUrlAsStreamStopsAtChunkSize/cipher (0.04s) === RUN TestReadUrlAsStreamReportsAbortPastChunkSize --- PASS: TestReadUrlAsStreamReportsAbortPastChunkSize (0.02s) === RUN TestReadErrorsCarryTheServerMessage --- PASS: TestReadErrorsCarryTheServerMessage (0.13s) === RUN TestReadErrorsDecodeGzipBody --- PASS: TestReadErrorsDecodeGzipBody (0.13s) === RUN TestReadErrorWithoutBodyIsTheStatus --- PASS: TestReadErrorWithoutBodyIsTheStatus (0.06s) === RUN TestDeleteReturnsInvalidRequestErrorBeforeAddingAuth --- PASS: TestDeleteReturnsInvalidRequestErrorBeforeAddingAuth (0.01s) === RUN TestDeleteTreatsNoContentAsSuccess --- PASS: TestDeleteTreatsNoContentAsSuccess (0.02s) === RUN TestDeleteProxiedReturnsInvalidRequestErrorBeforeAddingAuth --- PASS: TestDeleteProxiedReturnsInvalidRequestErrorBeforeAddingAuth (0.00s) === RUN TestRetriedFetchChunkDataRetriesFreshUrlsImmediately I1117 09:40:37.948354 http_global_client_util.go:766 read http://127.0.0.1:43171/3,abc failed, err: Get "http://127.0.0.1:43171/3,abc?readDeleted=true": dial tcp 127.0.0.1:43171: connect: connection refused I1117 09:40:37.976798 http_global_client_util.go:603 chunk 3,abc failed on every known location, retrying on 1 fresh ones --- PASS: TestRetriedFetchChunkDataRetriesFreshUrlsImmediately (0.06s) === RUN TestRetriedFetchChunkDataKeepsBackoffWhenLocationsAreUnchanged I1117 09:40:37.998875 http_global_client_util.go:766 read http://127.0.0.1:44483/3,abc failed, err: Get "http://127.0.0.1:44483/3,abc?readDeleted=true": dial tcp 127.0.0.1:44483: connect: connection refused I1117 09:40:38.001407 http_global_client_util.go:775 retry reading in 1s I1117 09:40:39.011825 http_global_client_util.go:766 read http://127.0.0.1:44483/3,abc failed, err: Get "http://127.0.0.1:44483/3,abc?readDeleted=true": dial tcp 127.0.0.1:44483: connect: connection refused I1117 09:40:39.013987 http_global_client_util.go:775 retry reading in 1.5s --- PASS: TestRetriedFetchChunkDataKeepsBackoffWhenLocationsAreUnchanged (2.00s) === RUN TestRetriedFetchChunkDataRefreshesLocationsAfterPartialFailure I1117 09:40:40.002451 http_global_client_util.go:766 read http://127.0.0.1:42985/3,abc failed, err: Get "http://127.0.0.1:42985/3,abc?readDeleted=true": dial tcp 127.0.0.1:42985: connect: connection refused I1117 09:40:40.028071 http_global_client_util.go:701 read http://127.0.0.1:42985/3,abc failed, err: Get "http://127.0.0.1:42985/3,abc?readDeleted=true": dial tcp 127.0.0.1:42985: connect: connection refused --- PASS: TestRetriedFetchChunkDataRefreshesLocationsAfterPartialFailure (0.06s) === RUN TestSameUrlsIgnoresOrder --- PASS: TestSameUrlsIgnoresOrder (0.00s) === RUN TestReachableFirstTriesUnansweringHostLast --- PASS: TestReachableFirstTriesUnansweringHostLast (0.00s) === RUN TestReachableFirstProbesOnceAfterRetryInterval --- PASS: TestReachableFirstProbesOnceAfterRetryInterval (0.00s) === RUN TestReachableFirstProbesOneExpiredHostPerRead --- PASS: TestReachableFirstProbesOneExpiredHostPerRead (0.00s) === RUN TestRetriedFetchChunkDataTriesUnansweringServerLast I1117 09:40:40.079290 http_global_client_util.go:766 read http://127.0.0.1:33701/3,abc failed, err: Get "http://127.0.0.1:33701/3,abc?readDeleted=true": EOF --- PASS: TestRetriedFetchChunkDataTriesUnansweringServerLast (0.03s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/http 3.935s === RUN TestNewHttpClientSetsResponseTimeouts --- PASS: TestNewHttpClientSetsResponseTimeouts (0.02s) === RUN TestResponseHeaderTimeoutUnblocksUnresponsivePeer --- PASS: TestResponseHeaderTimeoutUnblocksUnresponsivePeer (0.31s) === RUN TestResponseHeaderTimeoutUnblocksUnresponsivePeerTLS --- PASS: TestResponseHeaderTimeoutUnblocksUnresponsivePeerTLS (0.61s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/http/client 1.781s ? github.com/seaweedfs/seaweedfs/weed/util/httpdown [no test files] === RUN TestFlushBudgetBoundsQueuedBytes --- PASS: TestFlushBudgetBoundsQueuedBytes (0.07s) === RUN TestFlushBudgetAdmitsOversizedWindow --- PASS: TestFlushBudgetAdmitsOversizedWindow (0.05s) === RUN TestFlushBudgetAdmitsInSealOrder --- PASS: TestFlushBudgetAdmitsInSealOrder (0.22s) === RUN TestFlushBudgetCloseReleasesWaiters --- PASS: TestFlushBudgetCloseReleasesWaiters (0.05s) === RUN TestQueueFlushChargesTheSlabNotTheWindow --- PASS: TestQueueFlushChargesTheSlabNotTheWindow (0.21s) === RUN TestStalledFlushBlocksOversizedProducers --- PASS: TestStalledFlushBlocksOversizedProducers (2.61s) === RUN TestBlockedProducersDrainOnceFlushResumes --- PASS: TestBlockedProducersDrainOnceFlushResumes (2.02s) === RUN TestReadTsCorruptedBuffer log_buffer_corruption_test.go:46: Error message: corrupted log buffer at pos 0, size 10: bad field tag at 0 log_buffer_corruption_test.go:53: ✓ readTs correctly returned error for corrupted buffer: corrupted log buffer at pos 0, size 10: bad field tag at 0 --- PASS: TestReadTsCorruptedBuffer (0.01s) === RUN TestReadTsValidBuffer log_buffer_corruption_test.go:92: ✓ readTs correctly parsed valid buffer: size=15, ts=123456789 --- PASS: TestReadTsValidBuffer (0.03s) === RUN TestReadFromBufferCorruption E1117 09:40:43.841398 log_buffer.go:1282 ReadFromBuffer: buffer corruption at idx[0] pos 0: corrupted log buffer at pos 0, size 33: bad field tag at 0 log_buffer_corruption_test.go:134: ✓ ReadFromBuffer correctly detected corruption: log buffer is corrupted: corrupted log buffer at pos 0, size 33: bad field tag at 0 log_buffer_corruption_test.go:137: ReadFromBuffer result: buf=false, offset=-1, err=log buffer is corrupted: corrupted log buffer at pos 0, size 33: bad field tag at 0 --- PASS: TestReadFromBufferCorruption (0.09s) === RUN TestLocateByTsCorruption log_buffer_corruption_test.go:163: ✓ locateByTs correctly detected corruption: locateByTs: buffer corruption at pos 0: corrupted log buffer at pos 0, size 10: bad field tag at 0 --- PASS: TestLocateByTsCorruption (0.00s) === RUN TestErrorPropagationChain === RUN TestErrorPropagationChain/Corruption_in_readTs log_buffer_corruption_test.go:171: ✓ readTs error propagation tested === RUN TestErrorPropagationChain/Corruption_in_locateByTs log_buffer_corruption_test.go:176: ✓ locateByTs error propagation tested === RUN TestErrorPropagationChain/Corruption_in_ReadFromBuffer_binary_search log_buffer_corruption_test.go:181: ✓ ReadFromBuffer error propagation tested === NAME TestErrorPropagationChain log_buffer_corruption_test.go:184: ✓ Complete error propagation chain verified --- PASS: TestErrorPropagationChain (0.01s) --- PASS: TestErrorPropagationChain/Corruption_in_readTs (0.00s) --- PASS: TestErrorPropagationChain/Corruption_in_locateByTs (0.00s) --- PASS: TestErrorPropagationChain/Corruption_in_ReadFromBuffer_binary_search (0.00s) === RUN TestNoSilentCorruption === RUN TestNoSilentCorruption/Invalid_protobuf log_buffer_corruption_test.go:215: ✓ Correctly returned error instead of silent (0, 0): corrupted log buffer: entry size 167772160 at pos 0 exceeds buffer length 14 === RUN TestNoSilentCorruption/Truncated_data log_buffer_corruption_test.go:215: ✓ Correctly returned error instead of silent (0, 0): corrupted log buffer: entry size 1677721600 at pos 0 exceeds buffer length 7 --- PASS: TestNoSilentCorruption (0.00s) --- PASS: TestNoSilentCorruption/Invalid_protobuf (0.00s) --- PASS: TestNoSilentCorruption/Truncated_data (0.00s) === RUN TestEvictionWatermarkTracksSealedRing --- PASS: TestEvictionWatermarkTracksSealedRing (0.11s) === RUN TestGapResumeCursorReadsSingleEntrySealedWindow --- PASS: TestGapResumeCursorReadsSingleEntrySealedWindow (0.10s) === RUN TestGapResumeCursorReadsFromMemory --- PASS: TestGapResumeCursorReadsFromMemory (0.16s) === RUN TestFlushSubscriberContract --- PASS: TestFlushSubscriberContract (0.21s) === RUN TestEvictionGatedCursor --- PASS: TestEvictionGatedCursor (0.16s) === RUN TestMarkEvictedThroughGatesYoungRing --- PASS: TestMarkEvictedThroughGatesYoungRing (0.14s) === RUN TestEvictionOriginalWatermark --- PASS: TestEvictionOriginalWatermark (0.13s) === RUN TestOriginalWatermarkWindowAttribution --- PASS: TestOriginalWatermarkWindowAttribution (0.07s) === RUN TestFlushOffsetGap_ReproduceDataLoss log_buffer_flush_gap_test.go:69: Sending 100 messages... log_buffer_flush_gap_test.go:82: Forcing flush... log_buffer_flush_gap_test.go:33: FLUSH: minOffset=0 maxOffset=99 size=4434 bytes log_buffer_flush_gap_test.go:61: Parsed 100 messages from flush buffer log_buffer_flush_gap_test.go:33: FLUSH: minOffset=100 maxOffset=149 size=2352 bytes log_buffer_flush_gap_test.go:61: Parsed 50 messages from flush buffer log_buffer_flush_gap_test.go:117: BUFFER STATE AFTER FLUSH: log_buffer_flush_gap_test.go:118: bufferStartOffset: 150 log_buffer_flush_gap_test.go:119: currentOffset (HWM): 150 log_buffer_flush_gap_test.go:120: pos (bytes in buffer): 0 log_buffer_flush_gap_test.go:121: Messages sent: 150 (offsets 0-149) log_buffer_flush_gap_test.go:122: Messages flushed to disk: 150 (offsets 0-149) log_buffer_flush_gap_test.go:128: OFFSET CONTINUITY CHECK: log_buffer_flush_gap_test.go:129: Last flushed offset: 149 log_buffer_flush_gap_test.go:130: Buffer starts at: 150 log_buffer_flush_gap_test.go:131: Gap: 0 offsets log_buffer_flush_gap_test.go:143: PASS: No gap detected - offsets are continuous log_buffer_flush_gap_test.go:147: READABILITY CHECK: log_buffer_flush_gap_test.go:159: Offset 0: OK (buf=false, err=resumeFromDisk) log_buffer_flush_gap_test.go:159: Offset 10: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 20: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 30: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 40: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 50: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 60: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 70: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 80: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 90: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 100: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 110: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 120: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 130: OK (buf=true, err=) log_buffer_flush_gap_test.go:159: Offset 140: OK (buf=true, err=) log_buffer_flush_gap_test.go:177: MESSAGE ACCOUNTING: log_buffer_flush_gap_test.go:178: Expected: 150 messages log_buffer_flush_gap_test.go:179: Flushed to disk: 150 log_buffer_flush_gap_test.go:180: In memory buffer: 0 (offset range 150-149) log_buffer_flush_gap_test.go:181: Total accounted for: 150 log_buffer_flush_gap_test.go:182: Missing: 0 messages log_buffer_flush_gap_test.go:187: All messages accounted for --- PASS: TestFlushOffsetGap_ReproduceDataLoss (0.36s) === RUN TestFlushOffsetGap_CheckPrevBuffers log_buffer_flush_gap_test.go:211: Batch 0: log_buffer_flush_gap_test.go:203: FLUSH #1: minOffset=0 maxOffset=19 size=872 bytes log_buffer_flush_gap_test.go:242: Before flush: offset=20, bufferStartOffset=0 log_buffer_flush_gap_test.go:243: After flush: offset=20, bufferStartOffset=20, prevBuffers=4 log_buffer_flush_gap_test.go:249: prevBuffer[3]: offsets 0-19, size=872 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:211: Batch 1: log_buffer_flush_gap_test.go:203: FLUSH #2: minOffset=20 maxOffset=39 size=874 bytes log_buffer_flush_gap_test.go:242: Before flush: offset=40, bufferStartOffset=20 log_buffer_flush_gap_test.go:243: After flush: offset=40, bufferStartOffset=40, prevBuffers=4 log_buffer_flush_gap_test.go:249: prevBuffer[2]: offsets 0-19, size=872 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[3]: offsets 20-39, size=874 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:211: Batch 2: log_buffer_flush_gap_test.go:203: FLUSH #3: minOffset=40 maxOffset=59 size=879 bytes log_buffer_flush_gap_test.go:242: Before flush: offset=60, bufferStartOffset=40 log_buffer_flush_gap_test.go:243: After flush: offset=60, bufferStartOffset=60, prevBuffers=4 log_buffer_flush_gap_test.go:249: prevBuffer[1]: offsets 0-19, size=872 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[2]: offsets 20-39, size=874 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[3]: offsets 40-59, size=879 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:211: Batch 3: log_buffer_flush_gap_test.go:203: FLUSH #4: minOffset=60 maxOffset=79 size=904 bytes log_buffer_flush_gap_test.go:242: Before flush: offset=80, bufferStartOffset=60 log_buffer_flush_gap_test.go:243: After flush: offset=80, bufferStartOffset=80, prevBuffers=4 log_buffer_flush_gap_test.go:249: prevBuffer[0]: offsets 0-19, size=872 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[1]: offsets 20-39, size=874 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[2]: offsets 40-59, size=879 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[3]: offsets 60-79, size=904 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:211: Batch 4: log_buffer_flush_gap_test.go:203: FLUSH #5: minOffset=80 maxOffset=99 size=905 bytes log_buffer_flush_gap_test.go:242: Before flush: offset=100, bufferStartOffset=80 log_buffer_flush_gap_test.go:243: After flush: offset=100, bufferStartOffset=100, prevBuffers=4 log_buffer_flush_gap_test.go:249: prevBuffer[0]: offsets 20-39, size=874 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[1]: offsets 40-59, size=879 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[2]: offsets 60-79, size=904 bytes (NOT FLUSHED!) log_buffer_flush_gap_test.go:249: prevBuffer[3]: offsets 80-99, size=905 bytes (NOT FLUSHED!) --- PASS: TestFlushOffsetGap_CheckPrevBuffers (0.40s) === RUN TestFlushOffsetGap_ConcurrentWriteAndFlush log_buffer_flush_gap_test.go:273: FLUSH: offsets 0-100 (4478 bytes) log_buffer_flush_gap_test.go:273: FLUSH: offsets 101-150 (2353 bytes) log_buffer_flush_gap_test.go:273: FLUSH: offsets 151-199 (2316 bytes) log_buffer_flush_gap_test.go:335: FINAL STATE: log_buffer_flush_gap_test.go:336: Total messages sent: 200 (offsets 0-199) log_buffer_flush_gap_test.go:337: Flushed to disk: 200 log_buffer_flush_gap_test.go:338: In memory: 0 (offsets 200-199) log_buffer_flush_gap_test.go:339: Total accounted: 200 log_buffer_flush_gap_test.go:340: Missing: 0 --- PASS: TestFlushOffsetGap_ConcurrentWriteAndFlush (0.48s) === RUN TestFlushOffsetGap_ProductionScenario log_buffer_flush_gap_test.go:393: === ROUND 1: Adding messages 0-49 === log_buffer_flush_gap_test.go:412: Before flush: logBuffer.offset=50, bufferStartOffset=0, nextKafkaOffset=50 log_buffer_flush_gap_test.go:382: FLUSH: minOffset=0 maxOffset=49, parsed 50 messages log_buffer_flush_gap_test.go:424: After flush: logBuffer.offset=50, bufferStartOffset=50 log_buffer_flush_gap_test.go:428: === ROUND 2: Adding messages 50-99 === log_buffer_flush_gap_test.go:382: FLUSH: minOffset=50 maxOffset=99, parsed 50 messages log_buffer_flush_gap_test.go:447: === VERIFICATION === log_buffer_flush_gap_test.go:448: Expected Kafka offsets: 0-99 log_buffer_flush_gap_test.go:452: Flush #0: minOffset=0, maxOffset=49, messages=50 log_buffer_flush_gap_test.go:452: Flush #1: minOffset=50, maxOffset=99, messages=50 log_buffer_flush_gap_test.go:481: SUCCESS: All 100 Kafka offsets accounted for (0-99) log_buffer_flush_gap_test.go:490: Final buffer state: log_buffer_flush_gap_test.go:491: logBuffer.offset: 100 log_buffer_flush_gap_test.go:492: bufferStartOffset: 100 log_buffer_flush_gap_test.go:493: Expected (nextKafkaOffset): 100 --- PASS: TestFlushOffsetGap_ProductionScenario (0.32s) === RUN TestFlushOffsetGap_ConcurrentReadDuringFlush log_buffer_flush_gap_test.go:554: Adding 100 messages... log_buffer_flush_gap_test.go:568: Flushing... log_buffer_flush_gap_test.go:546: FLUSH: Stored 100 offsets to disk (minOffset=0, maxOffset=99) log_buffer_flush_gap_test.go:573: Reading messages from offset 0... E1117 09:40:46.765126 log_read_stateless.go:169 [StatelessRead] CASE 1: Historical data - offset 0 < bufferStart 100 log_buffer_flush_gap_test.go:576: Read result: messages=100, nextOffset=100, hwm=100, endOfPartition=true, err= log_buffer_flush_gap_test.go:600: All 100 offsets can be read after flush --- PASS: TestFlushOffsetGap_ConcurrentReadDuringFlush (0.23s) === RUN TestFlushOffsetGap_ForceFlushAdvancesBuffer log_buffer_flush_gap_test.go:622: === ROUND 0 === log_buffer_flush_gap_test.go:630: Before adding: offset=0, bufferStartOffset=0 log_buffer_flush_gap_test.go:649: After adding: offset=10, bufferStartOffset=0 log_buffer_flush_gap_test.go:652: Forcing flush... log_buffer_flush_gap_test.go:614: FLUSH: offsets 0-9 log_buffer_flush_gap_test.go:662: After flush: offset=10, bufferStartOffset=10 log_buffer_flush_gap_test.go:671: bufferStartOffset correctly advanced to 10 log_buffer_flush_gap_test.go:622: === ROUND 1 === log_buffer_flush_gap_test.go:630: Before adding: offset=10, bufferStartOffset=10 log_buffer_flush_gap_test.go:649: After adding: offset=20, bufferStartOffset=10 log_buffer_flush_gap_test.go:652: Forcing flush... log_buffer_flush_gap_test.go:614: FLUSH: offsets 10-19 log_buffer_flush_gap_test.go:662: After flush: offset=20, bufferStartOffset=20 log_buffer_flush_gap_test.go:671: bufferStartOffset correctly advanced to 20 log_buffer_flush_gap_test.go:622: === ROUND 2 === log_buffer_flush_gap_test.go:630: Before adding: offset=20, bufferStartOffset=20 log_buffer_flush_gap_test.go:649: After adding: offset=30, bufferStartOffset=20 log_buffer_flush_gap_test.go:652: Forcing flush... log_buffer_flush_gap_test.go:614: FLUSH: offsets 20-29 log_buffer_flush_gap_test.go:662: After flush: offset=30, bufferStartOffset=30 log_buffer_flush_gap_test.go:671: bufferStartOffset correctly advanced to 30 log_buffer_flush_gap_test.go:677: === FLUSHED RANGES === log_buffer_flush_gap_test.go:679: Flush #0: offsets 0-9 log_buffer_flush_gap_test.go:679: Flush #1: offsets 10-19 log_buffer_flush_gap_test.go:692: Continuous with previous flush log_buffer_flush_gap_test.go:679: Flush #2: offsets 20-29 log_buffer_flush_gap_test.go:692: Continuous with previous flush --- PASS: TestFlushOffsetGap_ForceFlushAdvancesBuffer (0.43s) === RUN TestOversizedEntryDoesNotInflateBufferForever --- PASS: TestOversizedEntryDoesNotInflateBufferForever (0.58s) === RUN TestOversizedEntryStillFlushes --- PASS: TestOversizedEntryStillFlushes (0.80s) === RUN TestBufferQueryability log_buffer_queryability_test.go:104: Buffer queryability test passed - data is immediately readable --- PASS: TestBufferQueryability (0.11s) === RUN TestMultipleEntriesQueryability log_buffer_queryability_test.go:168: Entry 1: Key=test-key-1, Data=test-data-1, Offset=1 log_buffer_queryability_test.go:168: Entry 2: Key=test-key-2, Data=test-data-2, Offset=2 log_buffer_queryability_test.go:168: Entry 3: Key=test-key-3, Data=test-data-3, Offset=3 log_buffer_queryability_test.go:175: Multiple entries queryability test passed - found 3 entries --- PASS: TestMultipleEntriesQueryability (0.11s) === RUN TestSchemaRegistryScenario log_buffer_queryability_test.go:243: Schema registry scenario test passed - schema value preserved: 109 bytes --- PASS: TestSchemaRegistryScenario (0.13s) === RUN TestTimeBasedFirstReadBeforeEarliest --- PASS: TestTimeBasedFirstReadBeforeEarliest (0.06s) === RUN TestEarliestTimeExactRead --- PASS: TestEarliestTimeExactRead (0.04s) === RUN TestNewLogBufferFirstBuffer processed all messages E1117 09:40:49.874481 log_read.go:305 LoopProcessLogData: test process log entry 1 key:"" ts_ns:1794908449868873223 offset:4999 size:1024: EOF before flush: sent 5000 received 5000 lastProcessedTime {2026-11-17 09:40:49.868873223 +0000 UTC 5000 false} isDone true err: EOF --- PASS: TestNewLogBufferFirstBuffer (0.82s) === RUN TestReadFromBufferTimestampBased_AfterFlushReturnsNewerData flush from 2026-11-17 09:40:49.078396545 +0000 UTC m=+12.367635252 to 2026-11-17 09:40:49.868873223 +0000 UTC m=+13.158111600 5274870 bytes --- PASS: TestReadFromBufferTimestampBased_AfterFlushReturnsNewerData (0.25s) === RUN TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError === RUN TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_offset_0_when_buffer_starts_at_4_(Schema_Registry_bug_scenario) log_buffer_test.go:211: ✓ When Schema Registry tries to read from offset 0, but data has been flushed to disk: correctly returned resumeFromDisk === RUN TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_offset_before_buffer_start_with_empty_buffer log_buffer_test.go:211: ✓ Old offset with no data in memory should trigger disk read: correctly returned resumeFromDisk === RUN TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_offset_before_buffer_start_with_data log_buffer_test.go:211: ✓ Old offset with current data in memory should still trigger disk read: correctly returned resumeFromDisk === RUN TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_current_offset_(no_disk_read_needed) log_buffer_test.go:218: ✓ Current offset should return data from memory without error: correctly returned data without error === RUN TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_offset_within_buffer_range log_buffer_test.go:218: ✓ Offset within buffer range should return data without error: correctly returned data without error --- PASS: TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError (0.18s) --- PASS: TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_offset_0_when_buffer_starts_at_4_(Schema_Registry_bug_scenario) (0.01s) --- PASS: TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_offset_before_buffer_start_with_empty_buffer (0.01s) --- PASS: TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_offset_before_buffer_start_with_data (0.01s) --- PASS: TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_current_offset_(no_disk_read_needed) (0.05s) --- PASS: TestReadFromBuffer_OldOffsetReturnsResumeFromDiskError/Request_offset_within_buffer_range (0.11s) === RUN TestReadFromBuffer_OldOffsetWithNoPrevBuffers log_buffer_test.go:262: DEBUG: ReadFromBuffer returned: buf=false, batchIdx=-2, err=resumeFromDisk log_buffer_test.go:263: DEBUG: Buffer state: bufferStartOffset=10, offset=15, pos=100 log_buffer_test.go:265: DEBUG: Requested offset 5, prevBuffers[0] range: [20-25] log_buffer_test.go:274: ✓ BUG FIX VERIFIED: Correctly returns ResumeFromDiskError when requesting old offset 5 log_buffer_test.go:275: This allows the subscriber to read from disk instead of waiting forever --- PASS: TestReadFromBuffer_OldOffsetWithNoPrevBuffers (0.01s) === RUN TestReadFromBuffer_EmptyBufferAtCurrentOffset log_buffer_test.go:300: DEBUG: ReadFromBuffer returned: buf=false, batchIdx=-2, err=resumeFromDisk log_buffer_test.go:301: DEBUG: Buffer state: bufferStartOffset=0, offset=4, pos=0 log_buffer_test.go:311: ✓ BUG #2 FIX VERIFIED: Empty buffer correctly returns ResumeFromDiskError to check disk --- PASS: TestReadFromBuffer_EmptyBufferAtCurrentOffset (0.00s) === RUN TestReadFromBuffer_OffsetRanges === RUN TestReadFromBuffer_OffsetRanges/Before_buffer_start log_buffer_test.go:371: ✓ Offset 5 < bufferStartOffset 10 → read from disk === RUN TestReadFromBuffer_OffsetRanges/At_buffer_start log_buffer_test.go:379: ✓ Offset 10 == bufferStartOffset 10 → read from buffer === RUN TestReadFromBuffer_OffsetRanges/Within_buffer_range log_buffer_test.go:379: ✓ Offset 15 is within [10, 20] → read from buffer === RUN TestReadFromBuffer_OffsetRanges/At_buffer_end log_buffer_test.go:379: ✓ Offset 20 == offset 20 → read from buffer === RUN TestReadFromBuffer_OffsetRanges/After_buffer_end log_buffer_test.go:379: ✓ Offset 25 > offset 20 → future data, return nil without error --- PASS: TestReadFromBuffer_OffsetRanges (0.01s) --- PASS: TestReadFromBuffer_OffsetRanges/Before_buffer_start (0.00s) --- PASS: TestReadFromBuffer_OffsetRanges/At_buffer_start (0.00s) --- PASS: TestReadFromBuffer_OffsetRanges/Within_buffer_range (0.00s) --- PASS: TestReadFromBuffer_OffsetRanges/At_buffer_end (0.00s) --- PASS: TestReadFromBuffer_OffsetRanges/After_buffer_end (0.00s) === RUN TestReadFromBuffer_InitializedFromDisk log_buffer_test.go:410: After InitializeOffsetFromExistingData(highestOffset=3): log_buffer_test.go:411: offset=4 (should be 4), bufferStartOffset=4 (FIX: should be 4, not 0) log_buffer_test.go:429: After writing new message: log_buffer_test.go:430: bufferStartOffset=4, offset=5, pos=56 log_buffer_test.go:431: Requested offset 0, got: buf=false, batchIdx=-2, err=resumeFromDisk log_buffer_test.go:449: ✓ BUG #3 FIX VERIFIED: Reading old offset 0 correctly returns ResumeFromDiskError log_buffer_test.go:450: This ensures Schema Registry reads correct data from disk instead of getting new messages --- PASS: TestReadFromBuffer_InitializedFromDisk (0.01s) === RUN TestLoopProcessLogDataWithOffset_DiskReadRetry log_buffer_test.go:481: DISK READ #1: startOffset=0, dataReady=false log_buffer_test.go:484: → No data on disk yet log_buffer_test.go:545: ➕ Marking data as ready on disk log_buffer_test.go:481: DISK READ #2: startOffset=0, dataReady=true log_buffer_test.go:516: ✉️ RECEIVED: offset=0 key=key-0 log_buffer_test.go:526: 📋 Reader finished: isDone=true, err= log_buffer_test.go:561: RESULTS: log_buffer_test.go:562: Disk reads: 2 log_buffer_test.go:563: Received messages: 1 log_buffer_test.go:564: Loop iterations: 1 log_buffer_test.go:576: ✓ SUCCESS: Message received after 2 disk read attempts --- PASS: TestLoopProcessLogDataWithOffset_DiskReadRetry (2.02s) === RUN TestShutdownStopsGoroutinesPromptly --- PASS: TestShutdownStopsGoroutinesPromptly (0.11s) === RUN TestConcurrentProducerConsumer log_read_integration_test.go:108: Consumer 0 consumed 500 messages log_read_integration_test.go:108: Consumer 1 consumed 500 messages --- PASS: TestConcurrentProducerConsumer (1.66s) === RUN TestBackwardSeeksWhileProducing log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:183: Seeking backward from 200 to 180 log_read_integration_test.go:205: Total unique offsets read: 500 out of 500 --- PASS: TestBackwardSeeksWhileProducing (0.74s) === RUN TestHighConcurrencyReads --- PASS: TestHighConcurrencyReads (0.07s) === RUN TestRepeatedReadsAtSameOffset --- PASS: TestRepeatedReadsAtSameOffset (0.10s) === RUN TestEmptyPartitionPolling --- PASS: TestEmptyPartitionPolling (0.10s) === RUN TestReadMessagesAtOffset_EmptyBuffer --- PASS: TestReadMessagesAtOffset_EmptyBuffer (0.00s) === RUN TestReadMessagesAtOffset_SingleMessage --- PASS: TestReadMessagesAtOffset_SingleMessage (0.01s) === RUN TestReadMessagesAtOffset_MultipleMessages --- PASS: TestReadMessagesAtOffset_MultipleMessages (0.01s) === RUN TestReadMessagesAtOffset_StartFromMiddle --- PASS: TestReadMessagesAtOffset_StartFromMiddle (0.01s) === RUN TestReadMessagesAtOffset_MaxBytesLimit --- PASS: TestReadMessagesAtOffset_MaxBytesLimit (0.00s) === RUN TestReadMessagesAtOffset_ConcurrentReads --- PASS: TestReadMessagesAtOffset_ConcurrentReads (0.01s) === RUN TestReadMessagesAtOffset_FutureOffset --- PASS: TestReadMessagesAtOffset_FutureOffset (0.00s) === RUN TestWaitForDataWithTimeout_DataAvailable --- PASS: TestWaitForDataWithTimeout_DataAvailable (0.00s) === RUN TestWaitForDataWithTimeout_NoData log_read_stateless_test.go:314: Waited 51.412875ms for timeout --- PASS: TestWaitForDataWithTimeout_NoData (0.06s) === RUN TestWaitForDataWithTimeout_DataArrives --- PASS: TestWaitForDataWithTimeout_DataArrives (0.06s) === RUN TestGetHighWaterMark --- PASS: TestGetHighWaterMark (0.01s) === RUN TestGetLogStartOffset --- PASS: TestGetLogStartOffset (0.01s) === RUN TestLoopProcessLogDataWithOffset_ClientDisconnect log_read_test.go:54: Loop exited cleanly in 251.872657ms after client disconnect --- PASS: TestLoopProcessLogDataWithOffset_ClientDisconnect (0.26s) === RUN TestLoopProcessLogDataWithOffset_EmptyBuffer log_read_test.go:109: Loop exited cleanly in 757.68135ms after 4 iterations (no busy-waiting detected) --- PASS: TestLoopProcessLogDataWithOffset_EmptyBuffer (0.76s) === RUN TestLoopProcessLogDataWithOffset_NoDataResumeFromDisk log_read_test.go:155: Loop exited cleanly in 4.002857316s after 3 iterations (proper sleep detected) --- PASS: TestLoopProcessLogDataWithOffset_NoDataResumeFromDisk (4.01s) === RUN TestLoopFlush_NotifiesSubscribersAfterFlush log_read_test.go:206: flush notification delivered in 493.137µs --- PASS: TestLoopFlush_NotifiesSubscribersAfterFlush (0.01s) === RUN TestLoopProcessLogDataWithOffset_WakesOnDataArrival I1117 09:41:00.442049 log_read.go:585 LoopProcessLogDataWithOffset: wake-test process log entry 1 log_read_test.go:275: reader processed the entry in 5.449748ms after AddToBuffer --- PASS: TestLoopProcessLogDataWithOffset_WakesOnDataArrival (0.06s) === RUN TestLoopProcessLogDataWithOffset_WakesOnShutdown log_read_test.go:336: reader exited in 564.705µs after ShutdownLogBuffer --- PASS: TestLoopProcessLogDataWithOffset_WakesOnShutdown (0.07s) === RUN TestLoopProcessLogDataWithOffset_WithData I1117 09:41:00.640713 log_read.go:585 LoopProcessLogDataWithOffset: test-client process log entry 1 log_read_test.go:402: Successfully processed 1 message(s) in 22.919684ms --- PASS: TestLoopProcessLogDataWithOffset_WithData (0.13s) === RUN TestLoopProcessLogDataWithOffset_ConcurrentDisconnect log_read_test.go:450: All 10 concurrent clients exited cleanly --- PASS: TestLoopProcessLogDataWithOffset_ConcurrentDisconnect (0.36s) === RUN TestLoopProcessLogDataWithOffset_StopTime log_read_test.go:489: Loop correctly exited for past stopTsNs in 427.009µs (waitForDataFn called 0 times) --- PASS: TestLoopProcessLogDataWithOffset_StopTime (0.10s) === RUN TestLoopProcessLogData_BoundedEmptyBufferTerminates --- PASS: TestLoopProcessLogData_BoundedEmptyBufferTerminates (0.10s) === RUN TestLoopProcessLogData_SlowConsumerFallsBehind --- PASS: TestLoopProcessLogData_SlowConsumerFallsBehind (0.12s) === RUN TestLoopProcessLogData_DuplicateReaderLeaving --- PASS: TestLoopProcessLogData_DuplicateReaderLeaving (0.76s) === RUN TestReadTsNsMatchesUnmarshal --- PASS: TestReadTsNsMatchesUnmarshal (0.00s) === RUN TestReadTsNsFuzz --- PASS: TestReadTsNsFuzz (0.27s) === RUN TestReadTsNsCorrupted --- PASS: TestReadTsNsCorrupted (0.00s) === RUN TestUnmarshalLogEntryAliasedMatchesUnmarshal --- PASS: TestUnmarshalLogEntryAliasedMatchesUnmarshal (0.82s) === RUN TestUnmarshalLogEntryAliasedAliases --- PASS: TestUnmarshalLogEntryAliasedAliases (0.00s) === RUN TestSealedReadsShareOneSnapshot --- PASS: TestSealedReadsShareOneSnapshot (0.01s) === RUN TestSharedSnapshotSurvivesRecycle --- PASS: TestSharedSnapshotSurvivesRecycle (0.01s) === RUN TestSharedSnapshotConcurrentIntegrity --- PASS: TestSharedSnapshotConcurrentIntegrity (2.11s) === RUN TestCurrentWindowPrefixSharing --- PASS: TestCurrentWindowPrefixSharing (0.01s) === RUN TestSealHandsOffCompleteSnapshot --- PASS: TestSealHandsOffCompleteSnapshot (0.00s) === RUN TestSharedSnapshotContentMatches --- PASS: TestSharedSnapshotContentMatches (0.00s) === RUN TestShutdownDrainsAcceptedRecords === RUN TestShutdownDrainsAcceptedRecords/append === RUN TestShutdownDrainsAcceptedRecords/interval === RUN TestShutdownDrainsAcceptedRecords/force --- PASS: TestShutdownDrainsAcceptedRecords (0.03s) --- PASS: TestShutdownDrainsAcceptedRecords/append (0.01s) --- PASS: TestShutdownDrainsAcceptedRecords/interval (0.01s) --- PASS: TestShutdownDrainsAcceptedRecords/force (0.01s) === RUN TestShutdownRejectsNewRecords --- PASS: TestShutdownRejectsNewRecords (0.00s) === RUN TestWaitForShutdownWithEmptyBuffer --- PASS: TestWaitForShutdownWithEmptyBuffer (0.00s) === RUN TestSubscriberWakeFilter --- PASS: TestSubscriberWakeFilter (0.11s) === RUN TestSubscriberWakeFilterStillDelivers I1117 09:41:05.750957 log_read.go:310 LoopProcessLogData2: reader process log entry 1 --- PASS: TestSubscriberWakeFilterStillDelivers (0.26s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/log_buffer 29.320s === RUN TestAllocateFree --- PASS: TestAllocateFree (0.00s) === RUN TestAllocateFreeEdgeCases --- PASS: TestAllocateFreeEdgeCases (0.01s) === RUN TestBitCount --- PASS: TestBitCount (0.00s) === RUN TestAllocationSize --- PASS: TestAllocationSize (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/mem 0.550s === RUN TestQuoteDSNValue --- PASS: TestQuoteDSNValue (0.00s) === RUN TestBuildDSN_QuotesProblematicValues --- PASS: TestBuildDSN_QuotesProblematicValues (0.04s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/pgxutil 0.465s === RUN TestNewUsesUppercaseHexFormat --- PASS: TestNewUsesUppercaseHexFormat (0.01s) === RUN TestNewIsUnique --- PASS: TestNewIsUnique (0.00s) === RUN TestEnsureIgnoresClientHeader --- PASS: TestEnsureIgnoresClientHeader (0.01s) === RUN TestEnsureReusesContextID --- PASS: TestEnsureReusesContextID (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/request_id 0.411s === RUN TestReverseInsert --- PASS: TestReverseInsert (0.01s) === RUN TestDeleteRekeyedNode --- PASS: TestDeleteRekeyedNode (0.00s) === RUN TestInsertByKeyRecoversInconsistentEnds --- PASS: TestInsertByKeyRecoversInconsistentEnds (0.00s) === RUN TestInsertAndFind --- PASS: TestInsertAndFind (3.74s) === RUN TestDelete --- PASS: TestDelete (3.51s) === RUN TestNext --- PASS: TestNext (0.68s) === RUN TestPrev --- PASS: TestPrev (0.67s) === RUN TestFindGreaterOrEqual --- PASS: TestFindGreaterOrEqual (1.36s) === RUN TestChangeValue --- PASS: TestChangeValue (1.55s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/skiplist 11.890s === RUN TestSplitStatements === RUN TestSplitStatements/Simple_single_statement === RUN TestSplitStatements/Multiple_statements === RUN TestSplitStatements/Semicolon_in_single_quotes === RUN TestSplitStatements/Semicolon_in_double_quotes === RUN TestSplitStatements/Escaped_quotes_in_strings === RUN TestSplitStatements/Escaped_quotes_in_identifiers === RUN TestSplitStatements/Single_line_comment === RUN TestSplitStatements/Single_line_comment_with_semicolon === RUN TestSplitStatements/Multi-line_comment === RUN TestSplitStatements/Multi-line_comment_with_semicolon === RUN TestSplitStatements/Complex_mixed_case === RUN TestSplitStatements/Empty_statements_filtered === RUN TestSplitStatements/Whitespace_handling === RUN TestSplitStatements/Single_statement_without_semicolon === RUN TestSplitStatements/Empty_query === RUN TestSplitStatements/Only_whitespace === RUN TestSplitStatements/Only_single_line_comment === RUN TestSplitStatements/Only_multi-line_comment --- PASS: TestSplitStatements (0.07s) --- PASS: TestSplitStatements/Simple_single_statement (0.01s) --- PASS: TestSplitStatements/Multiple_statements (0.00s) --- PASS: TestSplitStatements/Semicolon_in_single_quotes (0.00s) --- PASS: TestSplitStatements/Semicolon_in_double_quotes (0.00s) --- PASS: TestSplitStatements/Escaped_quotes_in_strings (0.00s) --- PASS: TestSplitStatements/Escaped_quotes_in_identifiers (0.00s) --- PASS: TestSplitStatements/Single_line_comment (0.00s) --- PASS: TestSplitStatements/Single_line_comment_with_semicolon (0.00s) --- PASS: TestSplitStatements/Multi-line_comment (0.00s) --- PASS: TestSplitStatements/Multi-line_comment_with_semicolon (0.00s) --- PASS: TestSplitStatements/Complex_mixed_case (0.00s) --- PASS: TestSplitStatements/Empty_statements_filtered (0.00s) --- PASS: TestSplitStatements/Whitespace_handling (0.00s) --- PASS: TestSplitStatements/Single_statement_without_semicolon (0.00s) --- PASS: TestSplitStatements/Empty_query (0.00s) --- PASS: TestSplitStatements/Only_whitespace (0.00s) --- PASS: TestSplitStatements/Only_single_line_comment (0.00s) --- PASS: TestSplitStatements/Only_multi-line_comment (0.00s) === RUN TestSplitStatements_EdgeCases === RUN TestSplitStatements_EdgeCases/Nested_comments_are_not_supported_but_handled_gracefully === RUN TestSplitStatements_EdgeCases/Unterminated_string_(malformed_SQL) === RUN TestSplitStatements_EdgeCases/Unterminated_comment_(malformed_SQL) === RUN TestSplitStatements_EdgeCases/Multiple_semicolons_in_quotes --- PASS: TestSplitStatements_EdgeCases (0.01s) --- PASS: TestSplitStatements_EdgeCases/Nested_comments_are_not_supported_but_handled_gracefully (0.00s) --- PASS: TestSplitStatements_EdgeCases/Unterminated_string_(malformed_SQL) (0.00s) --- PASS: TestSplitStatements_EdgeCases/Unterminated_comment_(malformed_SQL) (0.00s) --- PASS: TestSplitStatements_EdgeCases/Multiple_semicolons_in_quotes (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/sqlutil 0.405s ? github.com/seaweedfs/seaweedfs/weed/util/version [no test files] === RUN TestCompileCollectionMatcher --- PASS: TestCompileCollectionMatcher (0.04s) === RUN TestCompileCollectionMatcherInvalidEntry --- PASS: TestCompileCollectionMatcherInvalidEntry (0.00s) === RUN TestExpandCollectionFilter --- PASS: TestExpandCollectionFilter (0.01s) === RUN TestMatchesWildcard === RUN TestMatchesWildcard/Exact_match === RUN TestMatchesWildcard/Single_wildcard === RUN TestMatchesWildcard/Empty_string_with_wildcard === RUN TestMatchesWildcard/Prefix_wildcard === RUN TestMatchesWildcard/Suffix_wildcard === RUN TestMatchesWildcard/Middle_wildcard === RUN TestMatchesWildcard/Multiple_wildcards === RUN TestMatchesWildcard/No_match === RUN TestMatchesWildcard/Single_question_mark === RUN TestMatchesWildcard/Multiple_question_marks === RUN TestMatchesWildcard/Question_mark_no_match === RUN TestMatchesWildcard/Mixed_wildcards === RUN TestMatchesWildcard/Empty_pattern === RUN TestMatchesWildcard/Empty_pattern_with_string === RUN TestMatchesWildcard/Pattern_with_string_empty === RUN TestMatchesWildcard/Pattern_with_regex_special_chars === RUN TestMatchesWildcard/Pattern_with_dots === RUN TestMatchesWildcard/Pattern_with_dots_and_wildcard === RUN TestMatchesWildcard/Star_in_target_at_pattern_star_offset === RUN TestMatchesWildcard/Star_in_target_equals_pattern === RUN TestMatchesWildcard/Star_in_target_past_pattern_star_offset === RUN TestMatchesWildcard/Question_mark_matches_literal_star === RUN TestMatchesWildcard/Star_in_target_is_not_a_wildcard === RUN TestMatchesWildcard/ARN_pattern_with_star_in_key --- PASS: TestMatchesWildcard (0.04s) --- PASS: TestMatchesWildcard/Exact_match (0.00s) --- PASS: TestMatchesWildcard/Single_wildcard (0.00s) --- PASS: TestMatchesWildcard/Empty_string_with_wildcard (0.00s) --- PASS: TestMatchesWildcard/Prefix_wildcard (0.00s) --- PASS: TestMatchesWildcard/Suffix_wildcard (0.00s) --- PASS: TestMatchesWildcard/Middle_wildcard (0.00s) --- PASS: TestMatchesWildcard/Multiple_wildcards (0.00s) --- PASS: TestMatchesWildcard/No_match (0.00s) --- PASS: TestMatchesWildcard/Single_question_mark (0.00s) --- PASS: TestMatchesWildcard/Multiple_question_marks (0.00s) --- PASS: TestMatchesWildcard/Question_mark_no_match (0.00s) --- PASS: TestMatchesWildcard/Mixed_wildcards (0.00s) --- PASS: TestMatchesWildcard/Empty_pattern (0.00s) --- PASS: TestMatchesWildcard/Empty_pattern_with_string (0.00s) --- PASS: TestMatchesWildcard/Pattern_with_string_empty (0.00s) --- PASS: TestMatchesWildcard/Pattern_with_regex_special_chars (0.00s) --- PASS: TestMatchesWildcard/Pattern_with_dots (0.00s) --- PASS: TestMatchesWildcard/Pattern_with_dots_and_wildcard (0.00s) --- PASS: TestMatchesWildcard/Star_in_target_at_pattern_star_offset (0.00s) --- PASS: TestMatchesWildcard/Star_in_target_equals_pattern (0.00s) --- PASS: TestMatchesWildcard/Star_in_target_past_pattern_star_offset (0.00s) --- PASS: TestMatchesWildcard/Question_mark_matches_literal_star (0.00s) --- PASS: TestMatchesWildcard/Star_in_target_is_not_a_wildcard (0.00s) --- PASS: TestMatchesWildcard/ARN_pattern_with_star_in_key (0.00s) === RUN TestWildcardMatcherMatch === RUN TestWildcardMatcherMatch/Simple_star === RUN TestWildcardMatcherMatch/Question_mark === RUN TestWildcardMatcherMatch/Extension_filter --- PASS: TestWildcardMatcherMatch (0.00s) --- PASS: TestWildcardMatcherMatch/Simple_star (0.00s) --- PASS: TestWildcardMatcherMatch/Question_mark (0.00s) --- PASS: TestWildcardMatcherMatch/Extension_filter (0.00s) === RUN TestCompileWildcardPattern === RUN TestCompileWildcardPattern/s3:Get* === RUN TestCompileWildcardPattern/s3:Get?bject === RUN TestCompileWildcardPattern/s3:*Object* --- PASS: TestCompileWildcardPattern (0.01s) --- PASS: TestCompileWildcardPattern/s3:Get* (0.00s) --- PASS: TestCompileWildcardPattern/s3:Get?bject (0.00s) --- PASS: TestCompileWildcardPattern/s3:*Object* (0.00s) === RUN TestFastMatchesWildcard === RUN TestFastMatchesWildcard/s3:Get*_s3:GetObject === RUN TestFastMatchesWildcard/s3:Put*_s3:GetObject === RUN TestFastMatchesWildcard/arn:aws:s3:::bucket/*_arn:aws:s3:::bucket/file.txt === RUN TestFastMatchesWildcard/user:admin-*_user:admin-john === RUN TestFastMatchesWildcard/user:admin-*_user:guest-john --- PASS: TestFastMatchesWildcard (0.01s) --- PASS: TestFastMatchesWildcard/s3:Get*_s3:GetObject (0.00s) --- PASS: TestFastMatchesWildcard/s3:Put*_s3:GetObject (0.00s) --- PASS: TestFastMatchesWildcard/arn:aws:s3:::bucket/*_arn:aws:s3:::bucket/file.txt (0.00s) --- PASS: TestFastMatchesWildcard/user:admin-*_user:admin-john (0.00s) --- PASS: TestFastMatchesWildcard/user:admin-*_user:guest-john (0.00s) === RUN TestWildcardMatcherCaching --- PASS: TestWildcardMatcherCaching (0.00s) === RUN TestWildcardMatcherCacheBounding --- PASS: TestWildcardMatcherCacheBounding (0.00s) === RUN TestWildcardMatcherCacheLRU --- PASS: TestWildcardMatcherCacheLRU (0.00s) === RUN TestWildcardMatcherCacheClear --- PASS: TestWildcardMatcherCacheClear (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/util/wildcard 0.546s === RUN TestApplyDiscoveredFilersPrunesStaleAddress I1117 09:40:39.962894 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.2:18888] I1117 09:40:39.995306 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.0.3:18888] --- PASS: TestApplyDiscoveredFilersPrunesStaleAddress (0.04s) === RUN TestApplyDiscoveredFilersKeepsIndexOnSurvivor I1117 09:40:40.007634 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.1:18888] I1117 09:40:40.008153 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.0.3:18888] --- PASS: TestApplyDiscoveredFilersKeepsIndexOnSurvivor (0.00s) === RUN TestApplyDiscoveredFilersNoChangeIsNoop --- PASS: TestApplyDiscoveredFilersNoChangeIsNoop (0.00s) === RUN TestOnPeerUpdateTracksRollingReplacement I1117 09:40:40.012790 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.1:8888] I1117 09:40:40.013420 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.1.1:8888] I1117 09:40:40.013795 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.2:8888] I1117 09:40:40.015796 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.1.2:8888] --- PASS: TestOnPeerUpdateTracksRollingReplacement (0.00s) === RUN TestOnPeerUpdateKeepsLastFiler --- PASS: TestOnPeerUpdateKeepsLastFiler (0.00s) === RUN TestOnPeerUpdateIgnoresOtherNodeTypes --- PASS: TestOnPeerUpdateIgnoresOtherNodeTypes (0.00s) === RUN TestOnPeerUpdateDuplicateAddKeepsHealth --- PASS: TestOnPeerUpdateDuplicateAddKeepsHealth (0.00s) === RUN TestDiscoverySnapshotTakenBeforePushIsDiscarded I1117 09:40:40.032327 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.1.1:8888] I1117 09:40:40.032821 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.1:8888] --- PASS: TestDiscoverySnapshotTakenBeforePushIsDiscarded (0.00s) === RUN TestDiscoverySnapshotWithoutInterveningPushIsApplied I1117 09:40:40.034592 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.1:8888] I1117 09:40:40.034785 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.1.1:8888] --- PASS: TestDiscoverySnapshotWithoutInterveningPushIsApplied (0.00s) === RUN TestOnPeerUpdateDeferredLeaveFlushesOnJoin I1117 09:40:40.038261 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.1:8888] I1117 09:40:40.038548 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.1.1:8888] --- PASS: TestOnPeerUpdateDeferredLeaveFlushesOnJoin (0.00s) === RUN TestOnPeerUpdateNoopDoesNotDiscardSnapshot I1117 09:40:40.040586 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.1:8888] I1117 09:40:40.040829 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.1.1:8888] --- PASS: TestOnPeerUpdateNoopDoesNotDiscardSnapshot (0.00s) === RUN TestOnPeerUpdateRejoinCancelsDeferredLeave I1117 09:40:40.042957 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.1.1:8888] --- PASS: TestOnPeerUpdateRejoinCancelsDeferredLeave (0.00s) === RUN TestDiscoverySnapshotClearsDeferredLeaves I1117 09:40:40.046716 filer_client.go:523 FilerClient: removed 1 filer(s) no longer in group '': [10.0.0.1:8888] I1117 09:40:40.047234 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.1.1:8888] I1117 09:40:40.047815 filer_client.go:526 FilerClient: discovered 1 new filer(s) in group '': [10.0.0.1:8888] --- PASS: TestDiscoverySnapshotClearsDeferredLeaves (0.00s) === RUN TestOnPeerUpdateRejoinBumpsGeneration --- PASS: TestOnPeerUpdateRejoinBumpsGeneration (0.00s) === RUN TestLookupVolumeIdsCountsOnlyFilerFailures === RUN TestLookupVolumeIdsCountsOnlyFilerFailures/caller_cancelled === RUN TestLookupVolumeIdsCountsOnlyFilerFailures/caller_deadline === RUN TestLookupVolumeIdsCountsOnlyFilerFailures/caller_deadline_already_elapsed === RUN TestLookupVolumeIdsCountsOnlyFilerFailures/filer_timeout --- PASS: TestLookupVolumeIdsCountsOnlyFilerFailures (0.53s) --- PASS: TestLookupVolumeIdsCountsOnlyFilerFailures/caller_cancelled (0.28s) --- PASS: TestLookupVolumeIdsCountsOnlyFilerFailures/caller_deadline (0.10s) --- PASS: TestLookupVolumeIdsCountsOnlyFilerFailures/caller_deadline_already_elapsed (0.05s) --- PASS: TestLookupVolumeIdsCountsOnlyFilerFailures/filer_timeout (0.07s) === RUN TestOnVolumeLocationChangeDropsRetiredServer --- PASS: TestOnVolumeLocationChangeDropsRetiredServer (0.01s) === RUN TestOnVidMapResetClearsCachedLocations --- PASS: TestOnVidMapResetClearsCachedLocations (0.00s) === RUN TestOnVolumeLocationChangeReaddClearsTombstone --- PASS: TestOnVolumeLocationChangeReaddClearsTombstone (0.01s) === RUN TestDecodedCopyOutlivesShardRemoval --- PASS: TestDecodedCopyOutlivesShardRemoval (0.01s) === RUN TestShardServerOutlivesRegularRemoval --- PASS: TestShardServerOutlivesRegularRemoval (0.00s) === RUN TestRetiredShardServerLeavesCache --- PASS: TestRetiredShardServerLeavesCache (0.01s) === RUN TestMovedVolumeLeavesOldServer --- PASS: TestMovedVolumeLeavesOldServer (0.01s) === RUN TestReconnectReplayLiftsFence --- PASS: TestReconnectReplayLiftsFence (0.00s) === RUN TestJitterBounds --- PASS: TestJitterBounds (0.00s) === RUN TestJitterZeroAndNegative --- PASS: TestJitterZeroAndNegative (0.00s) === RUN TestJitterTinyDuration --- PASS: TestJitterTinyDuration (0.00s) === RUN TestJitterDistribution --- PASS: TestJitterDistribution (0.01s) === RUN TestAnnounceGateDelaysRegistration --- PASS: TestAnnounceGateDelaysRegistration (0.21s) === RUN TestLeaveLockRingIsSentOnTheOpenStream I1117 09:40:40.903038 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{} I1117 09:40:40.945599 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{} I1117 09:40:40.952251 masterclient.go:480 LockRing: filer@filer1:18888 received ring update v2: [filer2:18888] --- PASS: TestLeaveLockRingIsSentOnTheOpenStream (0.07s) === RUN TestReconnectAfterLeaveStaysOutOfLockRing I1117 09:40:40.995742 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{} I1117 09:40:40.998790 masterclient.go:442 .filer masterClient failed to receive from 127.0.0.1:0: EOF I1117 09:40:42.006779 masterclient.go:791 .filer masterClient reconnection attempt #1 I1117 09:40:42.046627 masterclient.go:544 updateVidMap ignore short heartbeat: volume_location:{} --- PASS: TestReconnectAfterLeaveStaysOutOfLockRing (1.09s) === RUN TestMovedVolumeKeepsItsLocation --- PASS: TestMovedVolumeKeepsItsLocation (0.00s) === RUN TestRemovedVolumeLosesItsLocation --- PASS: TestRemovedVolumeLosesItsLocation (0.00s) === RUN TestReadOnlyVolumeUpdatesItsLocation --- PASS: TestReadOnlyVolumeUpdatesItsLocation (0.00s) === RUN TestRemovalsAlongsideAMoveStillApply --- PASS: TestRemovalsAlongsideAMoveStillApply (0.00s) === RUN TestEcVolumeMovedKeepsItsLocation --- PASS: TestEcVolumeMovedKeepsItsLocation (0.00s) === RUN TestEcVolumeRemovedLosesItsLocation --- PASS: TestEcVolumeRemovedLosesItsLocation (0.00s) === RUN TestChangeListenerHearsAppliedChanges --- PASS: TestChangeListenerHearsAppliedChanges (0.00s) === RUN TestChangeListenerSkipsRemovalWhileOtherFormServes --- PASS: TestChangeListenerSkipsRemovalWhileOtherFormServes (0.00s) === RUN TestChangeListenerSkipsRemovalReplacedInSameMessage --- PASS: TestChangeListenerSkipsRemovalReplacedInSameMessage (0.00s) === RUN TestChangeListenerIgnoresStaleGenerationWhenSuppressing --- PASS: TestChangeListenerIgnoresStaleGenerationWhenSuppressing (0.00s) === RUN TestResetVidMapNotifiesListener --- PASS: TestResetVidMapNotifiesListener (0.00s) === RUN TestLookupVolumeIdsRetriesOnUnavailable --- PASS: TestLookupVolumeIdsRetriesOnUnavailable (4.91s) === RUN TestLookupVolumeIdsStopsOnContextCancel --- PASS: TestLookupVolumeIdsStopsOnContextCancel (2.00s) === RUN TestWaitUntilConnectedWithoutKeepConnected --- PASS: TestWaitUntilConnectedWithoutKeepConnected (0.10s) === RUN TestWaitUntilConnectedReturnsImmediatelyWhenConnected --- PASS: TestWaitUntilConnectedReturnsImmediatelyWhenConnected (0.00s) === RUN TestGetMasterRespectsContextCancellation --- PASS: TestGetMasterRespectsContextCancellation (0.10s) === RUN TestMasterClientFilerGroupLogging --- PASS: TestMasterClientFilerGroupLogging (0.00s) === RUN TestWithClientStopsWaitingOnCanceledContext --- PASS: TestWithClientStopsWaitingOnCanceledContext (0.00s) === RUN TestWithClientStopsWaitingOnDeadline --- PASS: TestWithClientStopsWaitingOnDeadline (0.10s) === RUN TestMarkServingMaster --- PASS: TestMarkServingMaster (0.00s) === RUN TestWithClientStopsBackoffOnCancel --- PASS: TestWithClientStopsBackoffOnCancel (0.01s) === RUN TestAddLocationReplacesEarlierGeneration --- PASS: TestAddLocationReplacesEarlierGeneration (0.00s) === RUN TestAddLocationMergesWithinGeneration --- PASS: TestAddLocationMergesWithinGeneration (0.01s) === RUN TestResetRetainsUntilWindowExpires --- PASS: TestResetRetainsUntilWindowExpires (0.00s) === RUN TestResetWindowRestartsOnRelearn --- PASS: TestResetWindowRestartsOnRelearn (0.00s) === RUN TestDeleteLocationDoesNotRefreshGeneration --- PASS: TestDeleteLocationDoesNotRefreshGeneration (0.00s) === RUN TestNewestGenerationWinsAcrossEcTransition === RUN TestNewestGenerationWinsAcrossEcTransition/encoded === RUN TestNewestGenerationWinsAcrossEcTransition/decoded === RUN TestNewestGenerationWinsAcrossEcTransition/same_generation_prefers_regular --- PASS: TestNewestGenerationWinsAcrossEcTransition (0.02s) --- PASS: TestNewestGenerationWinsAcrossEcTransition/encoded (0.00s) --- PASS: TestNewestGenerationWinsAcrossEcTransition/decoded (0.01s) --- PASS: TestNewestGenerationWinsAcrossEcTransition/same_generation_prefers_regular (0.00s) === RUN TestDeleteLastLocationDropsEntry --- PASS: TestDeleteLastLocationDropsEntry (0.00s) === RUN TestEcLocationsFollowGenerationRules --- PASS: TestEcLocationsFollowGenerationRules (0.00s) === RUN TestGetLocationsResultIsStable --- PASS: TestGetLocationsResultIsStable (0.00s) === RUN TestNewVidMapDefaultsRetention --- PASS: TestNewVidMapDefaultsRetention (0.00s) === RUN TestConcurrentResetAndUpdates --- PASS: TestConcurrentResetAndUpdates (0.31s) === RUN TestAddLocationUpdatesDataInRemoteOnTransition --- PASS: TestAddLocationUpdatesDataInRemoteOnTransition (0.00s) === RUN TestLookupVolumeServerUrlReflectsRemoteTransition --- PASS: TestLookupVolumeServerUrlReflectsRemoteTransition (0.00s) === RUN TestTierFlipDoesNotRaceWithLookup --- PASS: TestTierFlipDoesNotRaceWithLookup (0.14s) === RUN TestLookupFileId --- PASS: TestLookupFileId (0.04s) === RUN TestConcurrentGetLocations --- PASS: TestConcurrentGetLocations (0.17s) === RUN TestHasVolumeServer --- PASS: TestHasVolumeServer (0.00s) === RUN TestAuthoritativeVolumeLookupDoesNotTrustCachedLocations --- PASS: TestAuthoritativeVolumeLookupDoesNotTrustCachedLocations (0.00s) === RUN TestAuthoritativeVolumeLookupReturnsProviderResult --- PASS: TestAuthoritativeVolumeLookupReturnsProviderResult (0.00s) === RUN TestLookupFileIdWithFallbackLocalFirst --- PASS: TestLookupFileIdWithFallbackLocalFirst (0.00s) === RUN TestLookupFileIdWithFallbackAllRemote --- PASS: TestLookupFileIdWithFallbackAllRemote (0.00s) === RUN TestLookupFileIdWithFallbackKeepsDataCenterFirst --- PASS: TestLookupFileIdWithFallbackKeepsDataCenterFirst (0.00s) === RUN TestProviderFillServesWithoutCachingAcrossReset --- PASS: TestProviderFillServesWithoutCachingAcrossReset (0.00s) === RUN TestProviderFillSkipsTombstonedLocation --- PASS: TestProviderFillSkipsTombstonedLocation (0.00s) === RUN TestTombstoneExpires --- PASS: TestTombstoneExpires (0.00s) === RUN TestTombstoneEvictsOldestAtCap --- PASS: TestTombstoneEvictsOldestAtCap (1.12s) === RUN TestInvalidateCacheValidFileId --- PASS: TestInvalidateCacheValidFileId (0.00s) === RUN TestInvalidateCacheInvalidFileId === RUN TestInvalidateCacheInvalidFileId/empty_file_ID === RUN TestInvalidateCacheInvalidFileId/no_comma_separator === RUN TestInvalidateCacheInvalidFileId/non-numeric_vid === RUN TestInvalidateCacheInvalidFileId/negative_vid === RUN TestInvalidateCacheInvalidFileId/oversized_vid --- PASS: TestInvalidateCacheInvalidFileId (0.01s) --- PASS: TestInvalidateCacheInvalidFileId/empty_file_ID (0.00s) --- PASS: TestInvalidateCacheInvalidFileId/no_comma_separator (0.00s) --- PASS: TestInvalidateCacheInvalidFileId/non-numeric_vid (0.00s) --- PASS: TestInvalidateCacheInvalidFileId/negative_vid (0.00s) --- PASS: TestInvalidateCacheInvalidFileId/oversized_vid (0.00s) === RUN TestInvalidateCacheWithHistory --- PASS: TestInvalidateCacheWithHistory (0.00s) === RUN TestDeleteVidDropsRetainedGenerations --- PASS: TestDeleteVidDropsRetainedGenerations (0.00s) === RUN TestGetLocationsEmptyArrayNoFallback --- PASS: TestGetLocationsEmptyArrayNoFallback (0.00s) === RUN TestGetLocationsRetainedAcrossReset --- PASS: TestGetLocationsRetainedAcrossReset (0.00s) === RUN TestSharedLookupSurvivesFirstCallerCancel --- PASS: TestSharedLookupSurvivesFirstCallerCancel (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/wdclient 13.342s ? github.com/seaweedfs/seaweedfs/weed/wdclient/exclusive_locks [no test files] === RUN TestManagerLoopSendersAbortAfterStop I1117 09:40:40.727787 worker.go:148 Generated new worker ID: w-makech-a01e I1117 09:40:40.750106 worker.go:155 Saved worker ID to /tmp/TestManagerLoopSendersAbortAfterStop87593177/001/worker.id I1117 09:40:40.757391 worker.go:517 Worker w-makech-a01e stopped I1117 09:40:40.763408 worker.go:938 Worker w-makech-a01e received task cancellation for task t1 I1117 09:40:40.764566 worker.go:517 Worker w-makech-a01e stopped --- PASS: TestManagerLoopSendersAbortAfterStop (0.05s) PASS ok github.com/seaweedfs/seaweedfs/weed/worker 2.911s ? github.com/seaweedfs/seaweedfs/weed/worker/tasks [no test files] === RUN TestDetection_IgnoresEmptyDiskTypeEntries === RUN TestDetection_IgnoresEmptyDiskTypeEntries/real_disks_at_id_0 === RUN TestDetection_IgnoresEmptyDiskTypeEntries/real_disks_at_id_1 --- PASS: TestDetection_IgnoresEmptyDiskTypeEntries (0.30s) --- PASS: TestDetection_IgnoresEmptyDiskTypeEntries/real_disks_at_id_0 (0.20s) --- PASS: TestDetection_IgnoresEmptyDiskTypeEntries/real_disks_at_id_1 (0.09s) === RUN TestIntegration_DCFilterWithVolumeState I1117 09:40:40.948764 detection.go:291 BALANCE [hdd]: Created 13 task(s), cluster now balanced. Imbalance=16.0% (threshold=20.0%) detection_integration_test.go:147: DC+state filter: 13 tasks, effective=map[node-a:27 node-b:23] --- PASS: TestIntegration_DCFilterWithVolumeState (0.05s) === RUN TestIntegration_NodeFilterWithCollections I1117 09:40:40.994303 detection.go:291 BALANCE [hdd]: Created 18 task(s), cluster now balanced. Imbalance=13.3% (threshold=20.0%) detection_integration_test.go:206: Node filter with mixed collections: 18 tasks --- PASS: TestIntegration_NodeFilterWithCollections (0.02s) === RUN TestIntegration_ReplicaPlacementWithDCFilter I1117 09:40:41.013035 detection.go:291 BALANCE [hdd]: Created 11 task(s), cluster now balanced. Imbalance=17.1% (threshold=20.0%) detection_integration_test.go:287: Replica placement + DC filter: 11 tasks --- PASS: TestIntegration_ReplicaPlacementWithDCFilter (0.01s) === RUN TestIntegration_RackFilterWithReplicaPlacement I1117 09:40:41.025647 detection.go:291 BALANCE [hdd]: Created 11 task(s), cluster now balanced. Imbalance=17.1% (threshold=20.0%) detection_integration_test.go:361: Rack filter + replica placement: 11 tasks --- PASS: TestIntegration_RackFilterWithReplicaPlacement (0.01s) === RUN TestIntegration_AllFactors I1117 09:40:41.041390 detection.go:291 BALANCE [hdd]: Created 9 task(s), cluster now balanced. Imbalance=13.3% (threshold=20.0%) detection_integration_test.go:469: All factors combined: 9 tasks, effective=map[node-a:16 node-b:14] --- PASS: TestIntegration_AllFactors (0.02s) === RUN TestIntegration_FullVolumesOnlyBalancing I1117 09:40:41.055188 detection.go:291 BALANCE [hdd]: Created 11 task(s), cluster now balanced. Imbalance=17.1% (threshold=20.0%) detection_integration_test.go:512: Full-only balancing: 11 tasks --- PASS: TestIntegration_FullVolumesOnlyBalancing (0.01s) === RUN TestDetection_MixedDiskTypes I1117 09:40:41.067331 detection.go:288 BALANCE [hdd]: No tasks created - cluster well balanced. Imbalance=0.0% (threshold=20.0%). MaxUtil=10.0% on hdd-server-1, MinUtil=10.0% on hdd-server-1 I1117 09:40:41.070790 detection.go:288 BALANCE [ssd]: No tasks created - cluster well balanced. Imbalance=0.0% (threshold=20.0%). MaxUtil=1.0% on ssd-server-1, MinUtil=1.0% on ssd-server-1 --- PASS: TestDetection_MixedDiskTypes (0.01s) === RUN TestDetection_ImbalancedDiskType I1117 09:40:41.107985 detection.go:291 BALANCE [ssd]: Created 40 task(s), cluster now balanced. Imbalance=18.2% (threshold=20.0%) --- PASS: TestDetection_ImbalancedDiskType (0.03s) === RUN TestDetection_SkipsPhysicallyFullDestination I1117 09:40:41.115763 detection.go:337 BALANCE [hdd]: Created 7 task(s), no more beneficial moves available. After move, dest disk-empty util would be 0.8% vs source src util 0.0% --- PASS: TestDetection_SkipsPhysicallyFullDestination (0.01s) === RUN TestDetection_NoDestinationWhenAllDisksFull --- PASS: TestDetection_NoDestinationWhenAllDisksFull (0.00s) === RUN TestDetection_ProjectsVolumeOntoNearFullDestination I1117 09:40:41.130635 detection.go:288 BALANCE [hdd]: No tasks created - cluster well balanced. Imbalance=0.0% (threshold=20.0%). MaxUtil=80.0% on src, MinUtil=80.0% on src --- PASS: TestDetection_ProjectsVolumeOntoNearFullDestination (0.01s) === RUN TestDetection_SkipsRemoteTieredVolumes --- PASS: TestDetection_SkipsRemoteTieredVolumes (0.01s) === RUN TestDetection_RespectsMaxResults I1117 09:40:41.177761 detection.go:291 BALANCE [ssd]: Created 40 task(s), cluster now balanced. Imbalance=18.2% (threshold=20.0%) --- PASS: TestDetection_RespectsMaxResults (0.04s) === RUN TestDetection_ThreeServers_ConvergesToBalance I1117 09:40:41.192123 detection.go:291 BALANCE [hdd]: Created 23 task(s), cluster now balanced. Imbalance=17.6% (threshold=20.0%) --- PASS: TestDetection_ThreeServers_ConvergesToBalance (0.01s) === RUN TestDetection_SkipsPreExistingPendingTasks I1117 09:40:41.203652 detection.go:291 BALANCE [hdd]: Created 5 task(s), cluster now balanced. Imbalance=0.0% (threshold=20.0%) --- PASS: TestDetection_SkipsPreExistingPendingTasks (0.01s) === RUN TestDetection_NoDuplicateVolumesAcrossIterations I1117 09:40:41.216971 detection.go:291 BALANCE [ssd]: Created 18 task(s), cluster now balanced. Imbalance=13.3% (threshold=20.0%) --- PASS: TestDetection_NoDuplicateVolumesAcrossIterations (0.01s) === RUN TestDetection_ThreeServers_MaxServerShifts I1117 09:40:41.230609 detection.go:291 BALANCE [hdd]: Created 16 task(s), cluster now balanced. Imbalance=17.5% (threshold=20.0%) --- PASS: TestDetection_ThreeServers_MaxServerShifts (0.01s) === RUN TestDetection_FourServers_DestinationSpreading I1117 09:40:41.263685 detection.go:291 BALANCE [ssd]: Created 54 task(s), cluster now balanced. Imbalance=12.2% (threshold=20.0%) --- PASS: TestDetection_FourServers_DestinationSpreading (0.03s) === RUN TestDetection_ConvergenceVerification === RUN TestDetection_ConvergenceVerification/2-server-big-gap I1117 09:40:41.357318 detection.go:291 BALANCE [hdd]: Created 40 task(s), cluster now balanced. Imbalance=18.2% (threshold=20.0%) detection_test.go:915: 2-server-big-gap: 40 moves, effective=map[node-0:60 node-1:50], imbalance=18.2% === RUN TestDetection_ConvergenceVerification/3-server-staircase I1117 09:40:41.416090 detection.go:291 BALANCE [hdd]: Created 36 task(s), cluster now balanced. Imbalance=16.0% (threshold=20.0%) detection_test.go:915: 3-server-staircase: 36 moves, effective=map[node-0:54 node-1:50 node-2:46], imbalance=16.0% === RUN TestDetection_ConvergenceVerification/4-server-one-hot I1117 09:40:41.495736 detection.go:291 BALANCE [hdd]: Created 126 task(s), cluster now balanced. Imbalance=17.6% (threshold=20.0%) detection_test.go:915: 4-server-one-hot: 126 moves, effective=map[node-0:74 node-1:62 node-2:62 node-3:62], imbalance=18.5% === RUN TestDetection_ConvergenceVerification/3-server-tight-threshold I1117 09:40:41.508120 detection.go:291 BALANCE [hdd]: Created 10 task(s), cluster now balanced. Imbalance=0.0% (threshold=10.0%) detection_test.go:915: 3-server-tight-threshold: 10 moves, effective=map[node-0:20 node-1:20 node-2:20], imbalance=0.0% --- PASS: TestDetection_ConvergenceVerification (0.24s) --- PASS: TestDetection_ConvergenceVerification/2-server-big-gap (0.09s) --- PASS: TestDetection_ConvergenceVerification/3-server-staircase (0.06s) --- PASS: TestDetection_ConvergenceVerification/4-server-one-hot (0.08s) --- PASS: TestDetection_ConvergenceVerification/3-server-tight-threshold (0.01s) === RUN TestDetection_ExhaustedServerFallsThrough I1117 09:40:41.531214 detection.go:291 BALANCE [hdd]: Created 23 task(s), cluster now balanced. Imbalance=16.0% (threshold=20.0%) detection_test.go:987: Created 23 tasks from node-b after node-a exhausted --- PASS: TestDetection_ExhaustedServerFallsThrough (0.02s) === RUN TestDetection_HeterogeneousCapacity detection_test.go:1052: First balance task: move from server-3 (correct: highest utilization) --- PASS: TestDetection_HeterogeneousCapacity (0.08s) === RUN TestDetection_ZeroVolumeServerIncludedInBalance I1117 09:40:41.619800 detection.go:318 BALANCE [hdd]: Created 5 task(s), cluster as balanced as possible. Imbalance=40.0% (threshold=20.0%), max-min diff=1 detection_test.go:1134: Distribution 8/2/1/0 → map[node-a:3 node-b:3 node-c:3 node-d:2] after 5 moves (imbalance=36.4%) --- PASS: TestDetection_ZeroVolumeServerIncludedInBalance (0.01s) === RUN TestDetection_DataCenterFilter I1117 09:40:41.647119 detection.go:291 BALANCE [hdd]: Created 18 task(s), cluster now balanced. Imbalance=13.3% (threshold=20.0%) detection_test.go:1191: Created 18 tasks within dc1 scope --- PASS: TestDetection_DataCenterFilter (0.03s) === RUN TestDetection_NodeFilter I1117 09:40:41.661090 detection.go:291 BALANCE [hdd]: Created 18 task(s), cluster now balanced. Imbalance=13.3% (threshold=20.0%) detection_test.go:1244: Created 18 tasks within node-a,node-b scope --- PASS: TestDetection_NodeFilter (0.01s) === RUN TestDetection_HeterogeneousMax_NoOvershootNoOscillation I1117 09:40:41.667796 detection.go:334 BALANCE [hdd]: No tasks created - no beneficial move available. After move, dest node-b util would be 60.0% vs source node-a util 50.0% detection_test.go:1353: tasks=0, effective=map[node-a:11 node-b:5], final diff=0.050 (initial=0.050) --- PASS: TestDetection_HeterogeneousMax_NoOvershootNoOscillation (0.01s) === RUN TestDetection_RespectsClusterIdealUtilization I1117 09:40:41.680505 detection.go:291 BALANCE [hdd]: Created 3 task(s), cluster now balanced. Imbalance=11.8% (threshold=20.0%) detection_test.go:1411: tasks=3, effective=map[node-a:18 node-b:9 node-c:4], ideal=0.443 --- PASS: TestDetection_RespectsClusterIdealUtilization (0.01s) === RUN TestResolveBalanceDestination_UsesEffectiveCapacity --- PASS: TestResolveBalanceDestination_UsesEffectiveCapacity (0.01s) === RUN TestDetection_SkipsVolumeWhenTargetHoldsReplica I1117 09:40:41.745255 detection.go:291 BALANCE [hdd]: Created 41 task(s), cluster now balanced. Imbalance=19.8% (threshold=20.0%) I1117 09:40:41.756780 detection.go:288 BALANCE [hdd]: No tasks created - cluster well balanced. Imbalance=19.8% (threshold=20.0%). MaxUtil=50.0% on node-b, MinUtil=41.0% on node-d --- PASS: TestDetection_SkipsVolumeWhenTargetHoldsReplica (0.07s) === RUN TestDecodeVolumeBalanceTaskParamsFromPayload --- PASS: TestDecodeVolumeBalanceTaskParamsFromPayload (0.07s) === RUN TestDecodeVolumeBalanceTaskParamsFallback --- PASS: TestDecodeVolumeBalanceTaskParamsFallback (0.00s) === RUN TestDeriveBalanceWorkerConfig --- PASS: TestDeriveBalanceWorkerConfig (0.00s) === RUN TestDeriveBalanceWorkerConfigBatchFields --- PASS: TestDeriveBalanceWorkerConfigBatchFields (0.00s) === RUN TestDeriveBalanceWorkerConfigBatchClamping --- PASS: TestDeriveBalanceWorkerConfigBatchClamping (0.00s) === RUN TestBuildBatchVolumeBalanceProposals_SingleBatch --- PASS: TestBuildBatchVolumeBalanceProposals_SingleBatch (0.01s) === RUN TestBuildBatchVolumeBalanceProposals_MultipleBatches --- PASS: TestBuildBatchVolumeBalanceProposals_MultipleBatches (0.01s) === RUN TestBuildBatchVolumeBalanceProposals_BatchSizeOne --- PASS: TestBuildBatchVolumeBalanceProposals_BatchSizeOne (0.00s) === RUN TestVolumeBalanceDescriptorHasBatchFields --- PASS: TestVolumeBalanceDescriptorHasBatchFields (0.00s) === RUN TestBuildVolumeBalanceProposal --- PASS: TestBuildVolumeBalanceProposal (0.00s) === RUN TestVolumeBalanceHandlerRejectsUnsupportedJobType --- PASS: TestVolumeBalanceHandlerRejectsUnsupportedJobType (0.00s) === RUN TestEmitVolumeBalanceDetectionDecisionTraceNoTasks --- PASS: TestEmitVolumeBalanceDetectionDecisionTraceNoTasks (0.00s) === RUN TestVolumeBalanceDescriptorOmitsExecutionTuningFields --- PASS: TestVolumeBalanceDescriptorOmitsExecutionTuningFields (0.00s) === RUN TestBuildMoveTaskParams --- PASS: TestBuildMoveTaskParams (0.00s) === RUN TestBuildMoveTaskParamsDefaultTimeout --- PASS: TestBuildMoveTaskParamsDefaultTimeout (0.00s) === RUN TestExecuteDispatchesBatchPath I1117 09:40:41.883168 plugin_handler.go:948 batch volume balance: 2 moves, max concurrent 2 W1117 09:40:41.947753 plugin_handler.go:805 volume balance: no master addresses in cluster context, skipping pre-move check for volume 1 I1117 09:40:41.968258 task.go:63 Starting balance task - moving volume W1117 09:40:41.951257 plugin_handler.go:805 volume balance: no master addresses in cluster context, skipping pre-move check for volume 2 I1117 09:40:41.972068 task.go:63 Starting balance task - moving volume I1117 09:40:41.972602 task.go:61 move stage: marking volume 1 readonly on s1:8080 I1117 09:40:41.973453 task.go:61 move stage: marking volume 2 readonly on s2:8080 W1117 09:40:41.986035 plugin_handler.go:1062 batch balance move 1 failed: volume 2 s2:8080→t2:8080: move volume 2 from s2:8080 to t2:8080: mark volume 2 readonly on s2:8080: getOrCreateConnection s2:18080: fail to dial s2:18080: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) W1117 09:40:41.986624 plugin_handler.go:1062 batch balance move 0 failed: volume 1 s1:8080→t1:8080: move volume 1 from s1:8080 to t1:8080: mark volume 1 readonly on s1:8080: getOrCreateConnection s1:18080: fail to dial s1:18080: grpc: no transport security set (use grpc.WithTransportCredentials(insecure.NewCredentials()) explicitly or set credentials) --- PASS: TestExecuteDispatchesBatchPath (0.12s) === RUN TestExecuteSingleMovePathUnchanged W1117 09:40:42.010803 plugin_handler.go:805 volume balance: no master addresses in cluster context, skipping pre-move check for volume 99 I1117 09:40:42.011270 task.go:63 Starting balance task - moving volume I1117 09:40:42.012609 task.go:61 move stage: marking volume 99 readonly on src:8080 --- PASS: TestExecuteSingleMovePathUnchanged (0.01s) === RUN TestFilterMetricsByLocation --- PASS: TestFilterMetricsByLocation (0.00s) === RUN TestFilterMetricsByVolumeState === RUN TestFilterMetricsByVolumeState/ALL_returns_everything === RUN TestFilterMetricsByVolumeState/empty_string_returns_everything === RUN TestFilterMetricsByVolumeState/ACTIVE_keeps_FullnessRatio_below_1.01 === RUN TestFilterMetricsByVolumeState/FULL_keeps_FullnessRatio_at_or_above_1.01 === RUN TestFilterMetricsByVolumeState/unknown_value_returns_everything --- PASS: TestFilterMetricsByVolumeState (0.01s) --- PASS: TestFilterMetricsByVolumeState/ALL_returns_everything (0.00s) --- PASS: TestFilterMetricsByVolumeState/empty_string_returns_everything (0.00s) --- PASS: TestFilterMetricsByVolumeState/ACTIVE_keeps_FullnessRatio_below_1.01 (0.00s) --- PASS: TestFilterMetricsByVolumeState/FULL_keeps_FullnessRatio_at_or_above_1.01 (0.00s) --- PASS: TestFilterMetricsByVolumeState/unknown_value_returns_everything (0.00s) === RUN TestFilterMetricsByVolumeState_NilElement --- PASS: TestFilterMetricsByVolumeState_NilElement (0.00s) === RUN TestFilterMetricsByVolumeState_EmptyInput --- PASS: TestFilterMetricsByVolumeState_EmptyInput (0.00s) === RUN TestVolumeBalanceDescriptorHasVolumeStateField --- PASS: TestVolumeBalanceDescriptorHasVolumeStateField (0.00s) === RUN TestCheckMovePreconditions === RUN TestCheckMovePreconditions/valid_move === RUN TestCheckMovePreconditions/volume_left_the_source === RUN TestCheckMovePreconditions/volume_gone_entirely === RUN TestCheckMovePreconditions/target_already_has_a_replica === RUN TestCheckMovePreconditions/proposal_nodes_carry_grpc_suffix === RUN TestCheckMovePreconditions/grpc-suffixed_target_already_has_a_replica --- PASS: TestCheckMovePreconditions (0.01s) --- PASS: TestCheckMovePreconditions/valid_move (0.00s) --- PASS: TestCheckMovePreconditions/volume_left_the_source (0.00s) --- PASS: TestCheckMovePreconditions/volume_gone_entirely (0.00s) --- PASS: TestCheckMovePreconditions/target_already_has_a_replica (0.00s) --- PASS: TestCheckMovePreconditions/proposal_nodes_carry_grpc_suffix (0.00s) --- PASS: TestCheckMovePreconditions/grpc-suffixed_target_already_has_a_replica (0.00s) === RUN TestCheckMoveDiskType === RUN TestCheckMoveDiskType/same_disk_type_allowed === RUN TestCheckMoveDiskType/target_without_matching_disk_type_rejected === RUN TestCheckMoveDiskType/unknown_volume_skips_check === RUN TestCheckMoveDiskType/unknown_target_skips_check === RUN TestCheckMoveDiskType/nil_topology_skips_check === RUN TestCheckMoveDiskType/nodes_matched_by_address_without_grpc_suffix === RUN TestCheckMoveDiskType/old_topology_nodes_matched_via_id_and_grpc_port === RUN TestCheckMoveDiskType/old_topology_allows_matching_disk_type --- PASS: TestCheckMoveDiskType (0.05s) --- PASS: TestCheckMoveDiskType/same_disk_type_allowed (0.00s) --- PASS: TestCheckMoveDiskType/target_without_matching_disk_type_rejected (0.00s) --- PASS: TestCheckMoveDiskType/unknown_volume_skips_check (0.00s) --- PASS: TestCheckMoveDiskType/unknown_target_skips_check (0.01s) --- PASS: TestCheckMoveDiskType/nil_topology_skips_check (0.00s) --- PASS: TestCheckMoveDiskType/nodes_matched_by_address_without_grpc_suffix (0.00s) --- PASS: TestCheckMoveDiskType/old_topology_nodes_matched_via_id_and_grpc_port (0.00s) --- PASS: TestCheckMoveDiskType/old_topology_allows_matching_disk_type (0.00s) === RUN TestIsGoodMove_NoReplication --- PASS: TestIsGoodMove_NoReplication (0.00s) === RUN TestIsGoodMove_MachineAntiAffinity --- PASS: TestIsGoodMove_MachineAntiAffinity (0.00s) === RUN TestIsGoodMove_001_SameRack --- PASS: TestIsGoodMove_001_SameRack (0.00s) === RUN TestIsGoodMove_010_DiffRack --- PASS: TestIsGoodMove_010_DiffRack (0.00s) === RUN TestIsGoodMove_100_DiffDC --- PASS: TestIsGoodMove_100_DiffDC (0.00s) === RUN TestIsGoodMove_SameNode --- PASS: TestIsGoodMove_SameNode (0.00s) === RUN TestIsGoodMove_011_Composite --- PASS: TestIsGoodMove_011_Composite (0.00s) === RUN TestIsGoodMove_110_Composite --- PASS: TestIsGoodMove_110_Composite (0.00s) === RUN TestIsGoodMove_NilReplicaPlacement --- PASS: TestIsGoodMove_NilReplicaPlacement (0.00s) === RUN TestCalculateBalanceScore_ReplicationAware --- PASS: TestCalculateBalanceScore_ReplicationAware (0.00s) === RUN TestPlanBalanceDestination_ChoosesBestValidCompositeDestination --- PASS: TestPlanBalanceDestination_ChoosesBestValidCompositeDestination (0.00s) === RUN TestCreateBalanceTask_FallbackSelectsValidCompositeDestination --- PASS: TestCreateBalanceTask_FallbackSelectsValidCompositeDestination (0.00s) === RUN TestCreateBalanceTask_SkipsWhenTargetViolatesPlacement --- PASS: TestCreateBalanceTask_SkipsWhenTargetViolatesPlacement (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/worker/tasks/balance 4.138s ? github.com/seaweedfs/seaweedfs/weed/worker/tasks/base [no test files] === RUN TestDedupRefusesToDeleteTheOnlyRealCopy I1117 09:40:41.002010 ec_balance_task.go:96 EC balance: moving shard(s) [0] of volume 42561 from 127.0.0.1:1.38841 to 127.0.0.1:1.38841 --- PASS: TestDedupRefusesToDeleteTheOnlyRealCopy (0.36s) === RUN TestDedupRemovesAGenuineDuplicate I1117 09:40:41.343546 ec_balance_task.go:96 EC balance: moving shard(s) [0] of volume 42561 from 127.0.0.1:1.39975 to 127.0.0.1:1.39975 I1117 09:40:41.404080 ec_balance_task.go:216 EC balance volume 42561: [25.00] Removing duplicate EC shard I1117 09:40:41.489624 ec_balance_task.go:216 EC balance volume 42561: [100.00] Duplicate shard removed --- PASS: TestDedupRemovesAGenuineDuplicate (0.18s) === RUN TestDedupRefusesWhenThePeerCannotBeQueried I1117 09:40:41.520833 ec_balance_task.go:96 EC balance: moving shard(s) [0] of volume 42561 from 127.0.0.1:1.45951 to 127.0.0.1:1.45951 --- PASS: TestDedupRefusesWhenThePeerCannotBeQueried (0.05s) === RUN TestDedupRefusesWhenTheKeepNodeHoldsAnotherCollection I1117 09:40:41.566933 ec_balance_task.go:96 EC balance: moving shard(s) [0] of volume 42561 from 127.0.0.1:1.39095 to 127.0.0.1:1.39095 --- PASS: TestDedupRefusesWhenTheKeepNodeHoldsAnotherCollection (0.03s) === RUN TestBuildBalancerTopology --- PASS: TestBuildBalancerTopology (0.03s) === RUN TestBuildBalancerTopologyGroupsByHost --- PASS: TestBuildBalancerTopologyGroupsByHost (0.03s) === RUN TestBuildBalancerTopologyCollectionFilter --- PASS: TestBuildBalancerTopologyCollectionFilter (0.00s) === RUN TestDetectionDisabled --- PASS: TestDetectionDisabled (0.00s) === RUN TestDetectionNilTopology --- PASS: TestDetectionNilTopology (0.00s) === RUN TestMovePhasePriority --- PASS: TestMovePhasePriority (0.00s) === RUN TestSortMovesByPhaseKeepsGlobalAheadOfWithinRack --- PASS: TestSortMovesByPhaseKeepsGlobalAheadOfWithinRack (0.00s) === RUN TestSortMovesByPhaseKeepsAVolumesMovesInPlanOrder --- PASS: TestSortMovesByPhaseKeepsAVolumesMovesInPlanOrder (0.00s) === RUN TestDetectionKeepsGlobalMovesUnderTheCap --- PASS: TestDetectionKeepsGlobalMovesUnderTheCap (0.05s) === RUN TestDetectionUsesConfiguredGlobalCap --- PASS: TestDetectionUsesConfiguredGlobalCap (0.09s) === RUN TestGlobalMaxMovesPerRackBoundedByMaxResults --- PASS: TestGlobalMaxMovesPerRackBoundedByMaxResults (0.00s) === RUN TestECBalanceTaskRejectsOutOfRangeShardIds --- PASS: TestECBalanceTaskRejectsOutOfRangeShardIds (0.00s) === RUN TestECBalanceTaskRetriesServerPickOnPinnedDiskRefusal I1117 09:40:41.839010 ec_balance_task.go:96 EC balance: moving shard(s) [5] of volume 7 from 127.0.0.1:1.38167 to 127.0.0.1:1.41759 I1117 09:40:41.840881 ec_balance_task.go:216 EC balance volume 7: [10.00] copying EC shard(s) 7.[5] from 127.0.0.1:1 to 127.0.0.1:1 I1117 09:40:41.874670 ec_balance_task.go:138 EC balance: 127.0.0.1:1.41759 disk 2 has no space left; retrying with server-picked disk I1117 09:40:41.875599 ec_balance_task.go:216 EC balance volume 7: [10.00] copying EC shard(s) 7.[5] from 127.0.0.1:1 to 127.0.0.1:1 I1117 09:40:41.909791 ec_balance_task.go:216 EC balance volume 7: [40.00] verifying EC shard(s) 7.[5] on 127.0.0.1:1 I1117 09:40:41.916465 ec_balance_task.go:216 EC balance volume 7: [50.00] unmounting EC shard(s) 7.[5] from 127.0.0.1:1 I1117 09:40:41.932179 ec_balance_task.go:216 EC balance volume 7: [75.00] deleting EC shard(s) 7.[5] from 127.0.0.1:1 I1117 09:40:41.941397 ec_balance_task.go:216 EC balance volume 7: [100.00] moved EC shard(s) 7.[5] from 127.0.0.1:1 to 127.0.0.1:1 I1117 09:40:41.942149 ec_balance_task.go:146 EC balance: successfully moved shard(s) [5] of volume 7 from 127.0.0.1:1.38167 to 127.0.0.1:1.41759 --- PASS: TestECBalanceTaskRetriesServerPickOnPinnedDiskRefusal (0.13s) === RUN TestMultiDiskBalanceNeverLosesShards === RUN TestMultiDiskBalanceNeverLosesShards/balanced_across_disks === RUN TestMultiDiskBalanceNeverLosesShards/concentrated_on_one_node === RUN TestMultiDiskBalanceNeverLosesShards/spread_across_racks --- PASS: TestMultiDiskBalanceNeverLosesShards (0.05s) --- PASS: TestMultiDiskBalanceNeverLosesShards/balanced_across_disks (0.02s) --- PASS: TestMultiDiskBalanceNeverLosesShards/concentrated_on_one_node (0.01s) --- PASS: TestMultiDiskBalanceNeverLosesShards/spread_across_racks (0.01s) === RUN TestConcentratedVolumeSpreadsAcrossNodesAndDisks --- PASS: TestConcentratedVolumeSpreadsAcrossNodesAndDisks (0.02s) === RUN TestBuildBalancerTopologyNormalizesHddDiskType --- PASS: TestBuildBalancerTopologyNormalizesHddDiskType (0.00s) === RUN TestResolveReplicaPlacementFallsBackToMasterDefault === RUN TestResolveReplicaPlacementFallsBackToMasterDefault/explicit_config_used === RUN TestResolveReplicaPlacementFallsBackToMasterDefault/explicit_config_wins_over_default === RUN TestResolveReplicaPlacementFallsBackToMasterDefault/falls_back_to_master_default === RUN TestResolveReplicaPlacementFallsBackToMasterDefault/zero_master_default_=_no_constraint === RUN TestResolveReplicaPlacementFallsBackToMasterDefault/empty_everywhere_=_no_constraint === RUN TestResolveReplicaPlacementFallsBackToMasterDefault/invalid_value_ignored W1117 09:40:42.049343 replica_placement.go:119 ignoring invalid replica placement "nonsense": unexpected replication type: nonsense --- PASS: TestResolveReplicaPlacementFallsBackToMasterDefault (0.02s) --- PASS: TestResolveReplicaPlacementFallsBackToMasterDefault/explicit_config_used (0.00s) --- PASS: TestResolveReplicaPlacementFallsBackToMasterDefault/explicit_config_wins_over_default (0.00s) --- PASS: TestResolveReplicaPlacementFallsBackToMasterDefault/falls_back_to_master_default (0.00s) --- PASS: TestResolveReplicaPlacementFallsBackToMasterDefault/zero_master_default_=_no_constraint (0.00s) --- PASS: TestResolveReplicaPlacementFallsBackToMasterDefault/empty_everywhere_=_no_constraint (0.00s) --- PASS: TestResolveReplicaPlacementFallsBackToMasterDefault/invalid_value_ignored (0.01s) === RUN TestBuildBalancerTopologyKeepsSlotRemainder --- PASS: TestBuildBalancerTopologyKeepsSlotRemainder (0.00s) === RUN TestValidateRejectsSameNodeCrossDiskMove --- PASS: TestValidateRejectsSameNodeCrossDiskMove (0.00s) === RUN TestIsDedupPhaseRequiresSameDisk --- PASS: TestIsDedupPhaseRequiresSameDisk (0.00s) === RUN TestDeriveECBalanceWorkerConfig === RUN TestDeriveECBalanceWorkerConfig/nil_values_uses_defaults === RUN TestDeriveECBalanceWorkerConfig/custom_threshold === RUN TestDeriveECBalanceWorkerConfig/global_moves_per_rack_defaults_to_10 === RUN TestDeriveECBalanceWorkerConfig/global_moves_per_rack_override === RUN TestDeriveECBalanceWorkerConfig/global_moves_per_rack_never_0,_which_the_planner_reads_as_unlimited === RUN TestDeriveECBalanceWorkerConfig/global_moves_per_rack_clamped_to_max === RUN TestDeriveECBalanceWorkerConfig/threshold_clamped_to_min === RUN TestDeriveECBalanceWorkerConfig/threshold_clamped_to_max === RUN TestDeriveECBalanceWorkerConfig/min_server_count_clamped_to_2 --- PASS: TestDeriveECBalanceWorkerConfig (0.02s) --- PASS: TestDeriveECBalanceWorkerConfig/nil_values_uses_defaults (0.00s) --- PASS: TestDeriveECBalanceWorkerConfig/custom_threshold (0.00s) --- PASS: TestDeriveECBalanceWorkerConfig/global_moves_per_rack_defaults_to_10 (0.00s) --- PASS: TestDeriveECBalanceWorkerConfig/global_moves_per_rack_override (0.00s) --- PASS: TestDeriveECBalanceWorkerConfig/global_moves_per_rack_never_0,_which_the_planner_reads_as_unlimited (0.00s) --- PASS: TestDeriveECBalanceWorkerConfig/global_moves_per_rack_clamped_to_max (0.00s) --- PASS: TestDeriveECBalanceWorkerConfig/threshold_clamped_to_min (0.00s) --- PASS: TestDeriveECBalanceWorkerConfig/threshold_clamped_to_max (0.00s) --- PASS: TestDeriveECBalanceWorkerConfig/min_server_count_clamped_to_2 (0.00s) === RUN TestBuildECBalanceProposal --- PASS: TestBuildECBalanceProposal (0.04s) === RUN TestBuildECBalanceProposalNilResult --- PASS: TestBuildECBalanceProposalNilResult (0.00s) === RUN TestDecodeECBalanceTaskParamsFromProtobuf --- PASS: TestDecodeECBalanceTaskParamsFromProtobuf (0.01s) === RUN TestDecodeECBalanceTaskParamsFallback --- PASS: TestDecodeECBalanceTaskParamsFallback (0.00s) === RUN TestDecodeECBalanceTaskParamsProtobufValidation --- PASS: TestDecodeECBalanceTaskParamsProtobufValidation (0.00s) === RUN TestDecodeECBalanceTaskParamsMissingShardID --- PASS: TestDecodeECBalanceTaskParamsMissingShardID (0.00s) === RUN TestECBalanceHandlerCapability --- PASS: TestECBalanceHandlerCapability (0.00s) === RUN TestECBalanceConfigRoundTrip --- PASS: TestECBalanceConfigRoundTrip (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/worker/tasks/ec_balance 4.132s === RUN TestMaxShardTransfersPolicyRoundTrip === RUN TestMaxShardTransfersPolicyRoundTrip/unset === RUN TestMaxShardTransfersPolicyRoundTrip/sequential === RUN TestMaxShardTransfersPolicyRoundTrip/cap --- PASS: TestMaxShardTransfersPolicyRoundTrip (0.09s) --- PASS: TestMaxShardTransfersPolicyRoundTrip/unset (0.07s) --- PASS: TestMaxShardTransfersPolicyRoundTrip/sequential (0.01s) --- PASS: TestMaxShardTransfersPolicyRoundTrip/cap (0.00s) === RUN TestMaxShardTransfersNegativeClampsToSequential --- PASS: TestMaxShardTransfersNegativeClampsToSequential (0.00s) === RUN TestPlanECDestinationsPrefersSourceDiskType_FullCluster --- PASS: TestPlanECDestinationsPrefersSourceDiskType_FullCluster (0.17s) === RUN TestPlanECDestinationsSpillsToOtherDiskType_WhenPreferredScarce W1117 09:40:41.203676 detection.go:533 EC volume 2: placed shards outside preferred disk type "ssd" --- PASS: TestPlanECDestinationsSpillsToOtherDiskType_WhenPreferredScarce (0.14s) === RUN TestCountExistingEcShards_DoesNotUnionAcrossGenerations --- PASS: TestCountExistingEcShards_DoesNotUnionAcrossGenerations (0.00s) === RUN TestCountExistingEcShards_SingleCompleteGeneration --- PASS: TestCountExistingEcShards_SingleCompleteGeneration (0.00s) === RUN TestCountExistingEcShards_PreUpgradeZeroGeneration --- PASS: TestCountExistingEcShards_PreUpgradeZeroGeneration (0.00s) === RUN TestPlanECDestinationsStrictPlacement W1117 09:40:41.304162 detection.go:542 EC volume 1: placed with relaxed placement constraints [anti-affinity caps replica-placement] --- PASS: TestPlanECDestinationsStrictPlacement (0.06s) === RUN TestStrictPlacementRoundTripsThroughTaskPolicy --- PASS: TestStrictPlacementRoundTripsThroughTaskPolicy (0.00s) === RUN TestPlanECDestinationsUsesPlanner --- PASS: TestPlanECDestinationsUsesPlanner (0.05s) === RUN TestDetectionSkipsWhenECShardsAlreadyExist W1117 09:40:41.385678 detection.go:159 EC Detection: Volume 42 has all 14 EC shards in topology; source replica on 127.0.0.1:8080 is orphaned (#9448). W1117 09:40:41.386553 detection.go:177 EC Detection: no gRPC dial option available to auto-clean orphaned source for volume 42; to clean up by hand, send a targeted VolumeDelete RPC to 127.0.0.1:8080 only — DO NOT use the cluster-wide `volume.delete` shell command, which would also delete the EC shards. --- PASS: TestDetectionSkipsWhenECShardsAlreadyExist (0.02s) === RUN TestDetectionAllowsRegularReplicaWhenShardsPartial I1117 09:40:41.437820 detection.go:220 EC Detection: Volume 43 meets all criteria, attempting to create task I1117 09:40:41.444889 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 43 I1117 09:40:41.473053 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 43 I1117 09:40:41.474053 detection.go:279 EC Detection: Looking for replica locations for volume 43 I1117 09:40:41.475145 detection.go:285 EC Detection: Found 1 replica locations for volume 43 I1117 09:40:41.484463 detection.go:404 EC Detection: Successfully created EC task for volume 43, adding to results --- PASS: TestDetectionAllowsRegularReplicaWhenShardsPartial (0.10s) === RUN TestCountExistingEcShardsForVolume --- PASS: TestCountExistingEcShardsForVolume (0.00s) === RUN TestDetectionContextCancellation --- PASS: TestDetectionContextCancellation (0.02s) === RUN TestDetectionCollectionFilter === RUN TestDetectionCollectionFilter/#00 I1117 09:40:41.550003 detection.go:220 EC Detection: Volume 1 meets all criteria, attempting to create task I1117 09:40:41.550932 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 1 I1117 09:40:41.561913 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 1 I1117 09:40:41.562773 detection.go:279 EC Detection: Looking for replica locations for volume 1 I1117 09:40:41.563593 detection.go:285 EC Detection: Found 14 replica locations for volume 1 I1117 09:40:41.567258 detection.go:404 EC Detection: Successfully created EC task for volume 1, adding to results I1117 09:40:41.568344 detection.go:220 EC Detection: Volume 2 meets all criteria, attempting to create task I1117 09:40:41.568905 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 2 I1117 09:40:41.580461 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 2 I1117 09:40:41.581063 detection.go:279 EC Detection: Looking for replica locations for volume 2 I1117 09:40:41.581780 detection.go:285 EC Detection: Found 14 replica locations for volume 2 I1117 09:40:41.584880 detection.go:404 EC Detection: Successfully created EC task for volume 2, adding to results I1117 09:40:41.585382 detection.go:220 EC Detection: Volume 3 meets all criteria, attempting to create task I1117 09:40:41.586326 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 3 I1117 09:40:41.599893 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 3 I1117 09:40:41.600464 detection.go:279 EC Detection: Looking for replica locations for volume 3 I1117 09:40:41.601280 detection.go:285 EC Detection: Found 14 replica locations for volume 3 I1117 09:40:41.604236 detection.go:404 EC Detection: Successfully created EC task for volume 3, adding to results === RUN TestDetectionCollectionFilter/ALL_COLLECTIONS I1117 09:40:41.665534 detection.go:220 EC Detection: Volume 1 meets all criteria, attempting to create task I1117 09:40:41.666241 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 1 I1117 09:40:41.684014 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 1 I1117 09:40:41.684657 detection.go:279 EC Detection: Looking for replica locations for volume 1 I1117 09:40:41.685335 detection.go:285 EC Detection: Found 14 replica locations for volume 1 I1117 09:40:41.688895 detection.go:404 EC Detection: Successfully created EC task for volume 1, adding to results I1117 09:40:41.689445 detection.go:220 EC Detection: Volume 2 meets all criteria, attempting to create task I1117 09:40:41.690163 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 2 I1117 09:40:41.701372 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 2 I1117 09:40:41.702116 detection.go:279 EC Detection: Looking for replica locations for volume 2 I1117 09:40:41.702702 detection.go:285 EC Detection: Found 14 replica locations for volume 2 I1117 09:40:41.705921 detection.go:404 EC Detection: Successfully created EC task for volume 2, adding to results I1117 09:40:41.706311 detection.go:220 EC Detection: Volume 3 meets all criteria, attempting to create task I1117 09:40:41.707097 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 3 I1117 09:40:41.718412 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 3 I1117 09:40:41.719194 detection.go:279 EC Detection: Looking for replica locations for volume 3 I1117 09:40:41.719908 detection.go:285 EC Detection: Found 14 replica locations for volume 3 I1117 09:40:41.723011 detection.go:404 EC Detection: Successfully created EC task for volume 3, adding to results === RUN TestDetectionCollectionFilter/collection-a I1117 09:40:41.755365 detection.go:220 EC Detection: Volume 1 meets all criteria, attempting to create task I1117 09:40:41.755950 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 1 I1117 09:40:41.766782 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 1 I1117 09:40:41.767684 detection.go:279 EC Detection: Looking for replica locations for volume 1 I1117 09:40:41.768765 detection.go:285 EC Detection: Found 14 replica locations for volume 1 I1117 09:40:41.771665 detection.go:404 EC Detection: Successfully created EC task for volume 1, adding to results I1117 09:40:41.772053 detection.go:220 EC Detection: Volume 2 meets all criteria, attempting to create task I1117 09:40:41.772490 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 2 I1117 09:40:41.783698 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 2 I1117 09:40:41.784277 detection.go:279 EC Detection: Looking for replica locations for volume 2 I1117 09:40:41.784779 detection.go:285 EC Detection: Found 14 replica locations for volume 2 I1117 09:40:41.788026 detection.go:404 EC Detection: Successfully created EC task for volume 2, adding to results I1117 09:40:41.788426 detection.go:220 EC Detection: Volume 3 meets all criteria, attempting to create task I1117 09:40:41.788889 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 3 I1117 09:40:41.802657 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 3 I1117 09:40:41.803588 detection.go:279 EC Detection: Looking for replica locations for volume 3 I1117 09:40:41.804373 detection.go:285 EC Detection: Found 14 replica locations for volume 3 I1117 09:40:41.807939 detection.go:404 EC Detection: Successfully created EC task for volume 3, adding to results === RUN TestDetectionCollectionFilter/collection-a,collection-b I1117 09:40:41.910433 detection.go:220 EC Detection: Volume 1 meets all criteria, attempting to create task I1117 09:40:41.911063 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 1 I1117 09:40:41.926759 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 1 I1117 09:40:41.927435 detection.go:279 EC Detection: Looking for replica locations for volume 1 I1117 09:40:41.928019 detection.go:285 EC Detection: Found 14 replica locations for volume 1 I1117 09:40:41.931779 detection.go:404 EC Detection: Successfully created EC task for volume 1, adding to results I1117 09:40:41.932384 detection.go:220 EC Detection: Volume 2 meets all criteria, attempting to create task I1117 09:40:41.932932 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 2 I1117 09:40:41.945249 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 2 I1117 09:40:41.945854 detection.go:279 EC Detection: Looking for replica locations for volume 2 I1117 09:40:41.946378 detection.go:285 EC Detection: Found 14 replica locations for volume 2 I1117 09:40:41.949034 detection.go:404 EC Detection: Successfully created EC task for volume 2, adding to results I1117 09:40:41.949961 detection.go:220 EC Detection: Volume 3 meets all criteria, attempting to create task I1117 09:40:41.950401 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 3 I1117 09:40:41.963679 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 3 I1117 09:40:41.964360 detection.go:279 EC Detection: Looking for replica locations for volume 3 I1117 09:40:41.965003 detection.go:285 EC Detection: Found 14 replica locations for volume 3 I1117 09:40:41.968912 detection.go:404 EC Detection: Successfully created EC task for volume 3, adding to results === RUN TestDetectionCollectionFilter/_collection-b_,_collection-a_ I1117 09:40:42.006560 detection.go:220 EC Detection: Volume 1 meets all criteria, attempting to create task I1117 09:40:42.007282 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 1 I1117 09:40:42.021317 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 1 I1117 09:40:42.021960 detection.go:279 EC Detection: Looking for replica locations for volume 1 I1117 09:40:42.024202 detection.go:285 EC Detection: Found 14 replica locations for volume 1 I1117 09:40:42.028284 detection.go:404 EC Detection: Successfully created EC task for volume 1, adding to results I1117 09:40:42.028719 detection.go:220 EC Detection: Volume 2 meets all criteria, attempting to create task I1117 09:40:42.029128 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 2 I1117 09:40:42.042211 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 2 I1117 09:40:42.042875 detection.go:279 EC Detection: Looking for replica locations for volume 2 I1117 09:40:42.043565 detection.go:285 EC Detection: Found 14 replica locations for volume 2 I1117 09:40:42.047765 detection.go:404 EC Detection: Successfully created EC task for volume 2, adding to results I1117 09:40:42.048256 detection.go:220 EC Detection: Volume 3 meets all criteria, attempting to create task I1117 09:40:42.048804 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 3 I1117 09:40:42.061618 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 3 I1117 09:40:42.062500 detection.go:279 EC Detection: Looking for replica locations for volume 3 I1117 09:40:42.063340 detection.go:285 EC Detection: Found 14 replica locations for volume 3 I1117 09:40:42.067000 detection.go:404 EC Detection: Successfully created EC task for volume 3, adding to results === RUN TestDetectionCollectionFilter/collection-* I1117 09:40:42.103770 detection.go:220 EC Detection: Volume 1 meets all criteria, attempting to create task I1117 09:40:42.104626 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 1 I1117 09:40:42.118105 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 1 I1117 09:40:42.118711 detection.go:279 EC Detection: Looking for replica locations for volume 1 I1117 09:40:42.119390 detection.go:285 EC Detection: Found 14 replica locations for volume 1 I1117 09:40:42.122915 detection.go:404 EC Detection: Successfully created EC task for volume 1, adding to results I1117 09:40:42.123428 detection.go:220 EC Detection: Volume 2 meets all criteria, attempting to create task I1117 09:40:42.123974 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 2 I1117 09:40:42.135845 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 2 I1117 09:40:42.136588 detection.go:279 EC Detection: Looking for replica locations for volume 2 I1117 09:40:42.137132 detection.go:285 EC Detection: Found 14 replica locations for volume 2 I1117 09:40:42.140513 detection.go:404 EC Detection: Successfully created EC task for volume 2, adding to results I1117 09:40:42.140981 detection.go:220 EC Detection: Volume 3 meets all criteria, attempting to create task I1117 09:40:42.141419 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 3 I1117 09:40:42.158563 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 3 I1117 09:40:42.159462 detection.go:279 EC Detection: Looking for replica locations for volume 3 I1117 09:40:42.160147 detection.go:285 EC Detection: Found 14 replica locations for volume 3 I1117 09:40:42.163726 detection.go:404 EC Detection: Successfully created EC task for volume 3, adding to results === RUN TestDetectionCollectionFilter/collection-b,collection-c === RUN TestDetectionCollectionFilter/collection-ab --- PASS: TestDetectionCollectionFilter (0.76s) --- PASS: TestDetectionCollectionFilter/#00 (0.09s) --- PASS: TestDetectionCollectionFilter/ALL_COLLECTIONS (0.12s) --- PASS: TestDetectionCollectionFilter/collection-a (0.08s) --- PASS: TestDetectionCollectionFilter/collection-a,collection-b (0.16s) --- PASS: TestDetectionCollectionFilter/_collection-b_,_collection-a_ (0.10s) --- PASS: TestDetectionCollectionFilter/collection-* (0.10s) --- PASS: TestDetectionCollectionFilter/collection-b,collection-c (0.03s) --- PASS: TestDetectionCollectionFilter/collection-ab (0.07s) === RUN TestDetectionMaxResultsHonorsLimit I1117 09:40:42.328844 detection.go:220 EC Detection: Volume 1 meets all criteria, attempting to create task I1117 09:40:42.329550 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 1 I1117 09:40:42.341550 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 1 I1117 09:40:42.342146 detection.go:279 EC Detection: Looking for replica locations for volume 1 I1117 09:40:42.342746 detection.go:285 EC Detection: Found 14 replica locations for volume 1 I1117 09:40:42.346083 detection.go:404 EC Detection: Successfully created EC task for volume 1, adding to results --- PASS: TestDetectionMaxResultsHonorsLimit (0.07s) === RUN TestPlanECDestinationsSpreadsAcrossPhysicalDisks --- PASS: TestPlanECDestinationsSpreadsAcrossPhysicalDisks (0.02s) === RUN TestPlanECDestinationsFailsWithInsufficientCapacity --- PASS: TestPlanECDestinationsFailsWithInsufficientCapacity (0.03s) === RUN TestPlanECDestinationsPacksWhenFewerDisksThanShards --- PASS: TestPlanECDestinationsPacksWhenFewerDisksThanShards (0.05s) === RUN TestCopyVolumeFilesToWorkerRetriesAfterMidCopyCompaction I1117 09:40:42.687288 task.go:63 Starting volume file copy from source server I1117 09:40:42.725022 task.go:63 Volume index file copied successfully W1117 09:40:42.758319 ec_task.go:502 volume 951 on 127.0.0.1:0.45225 compacted during EC file copy, restarting with fresh file status: failed to copy .dat file: failed to receive file data: rpc error: code = Unknown desc = volume 951 is compacted I1117 09:40:42.775521 task.go:63 Starting volume file copy from source server I1117 09:40:42.785125 task.go:63 Volume index file copied successfully I1117 09:40:42.800238 task.go:63 Volume data file copied successfully --- PASS: TestCopyVolumeFilesToWorkerRetriesAfterMidCopyCompaction (0.37s) === RUN TestCopyVolumeFilesToWorkerStopsAfterRetryLimit I1117 09:40:42.873586 task.go:63 Starting volume file copy from source server I1117 09:40:42.887264 task.go:63 Volume index file copied successfully W1117 09:40:42.902692 ec_task.go:502 volume 951 on 127.0.0.1:0.36763 compacted during EC file copy, restarting with fresh file status: failed to copy .dat file: failed to receive file data: rpc error: code = Unknown desc = volume 951 is compacted I1117 09:40:42.906990 task.go:63 Starting volume file copy from source server I1117 09:40:42.917905 task.go:63 Volume index file copied successfully W1117 09:40:42.924723 ec_task.go:502 volume 951 on 127.0.0.1:0.36763 compacted during EC file copy, restarting with fresh file status: failed to copy .dat file: failed to receive file data: rpc error: code = Unknown desc = volume 951 is compacted I1117 09:40:42.928587 task.go:63 Starting volume file copy from source server I1117 09:40:42.932720 task.go:63 Volume index file copied successfully W1117 09:40:42.937153 ec_task.go:502 volume 951 on 127.0.0.1:0.36763 compacted during EC file copy, restarting with fresh file status: failed to copy .dat file: failed to receive file data: rpc error: code = Unknown desc = volume 951 is compacted --- PASS: TestCopyVolumeFilesToWorkerStopsAfterRetryLimit (0.12s) === RUN TestCopyVolumeFilesToWorkerReturnsNonCompactionErrors I1117 09:40:42.964299 task.go:63 Starting volume file copy from source server --- PASS: TestCopyVolumeFilesToWorkerReturnsNonCompactionErrors (0.03s) === RUN TestDeleteOriginalVolumeSurfacesReplicaFailures I1117 09:53:58.585994 task.go:63 Starting original volume deletion from replica servers I1117 09:53:58.586480 task.go:63 Deleting volume from replica server I1117 09:53:58.616824 task.go:63 Successfully deleted volume from replica server I1117 09:53:58.617357 task.go:63 Deleting volume from replica server E1117 09:53:58.630182 task.go:79 Failed to delete volume from replica server E1117 09:53:58.636319 task.go:79 Failed to delete some original volume replicas after EC encoding --- PASS: TestDeleteOriginalVolumeSurfacesReplicaFailures (795.73s) === RUN TestDeleteOriginalVolumeSucceedsWhenAllReplicasReachable I1117 09:54:12.748387 task.go:63 Starting original volume deletion from replica servers I1117 09:54:12.748630 task.go:63 Deleting volume from replica server I1117 09:54:12.777126 task.go:63 Successfully deleted volume from replica server I1117 09:54:12.777483 task.go:63 Successfully deleted volume from all replica servers --- PASS: TestDeleteOriginalVolumeSucceedsWhenAllReplicasReachable (14.14s) === RUN TestReplicasPendingDelete --- PASS: TestReplicasPendingDelete (0.00s) === RUN TestIsExpectedSweepSkip --- PASS: TestIsExpectedSweepSkip (0.00s) === RUN TestSweepEmptyReplicasDeletesStubKeepsData I1117 09:54:26.857580 ec_task.go:1007 EC volume 9479: removed empty stub replica on 127.0.0.1:43465.38605 before distribute --- PASS: TestSweepEmptyReplicasDeletesStubKeepsData (14.16s) === RUN TestEcEncodeRefusesOnEmptyStubReplica I1117 09:54:48.860972 task.go:63 Starting erasure coding task I1117 09:54:48.861510 task.go:63 Target server shard assignment I1117 09:54:48.861653 task.go:63 Target server shard assignment I1117 09:54:48.862121 task.go:63 Source server information I1117 09:54:48.862307 task.go:63 Source server information I1117 09:54:48.862989 task.go:63 Verifying preconditions and clearing stale EC state I1117 09:54:48.863789 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:54:48.900317 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:54:48.938565 task.go:63 Marking volume readonly I1117 09:54:49.154415 ec_task.go:457 restored volume 9490 to writable on 127.0.0.1:34377 after EC task failure I1117 09:54:49.172301 ec_task.go:457 restored volume 9490 to writable on 127.0.0.1:36849 after EC task failure --- PASS: TestEcEncodeRefusesOnEmptyStubReplica (22.26s) === RUN TestEcEncodeAbortsOnEqualFileCountDifferentIds I1117 09:55:10.992468 task.go:63 Starting erasure coding task I1117 09:55:10.992671 task.go:63 Target server shard assignment I1117 09:55:10.992785 task.go:63 Target server shard assignment I1117 09:55:10.992909 task.go:63 Source server information I1117 09:55:10.993034 task.go:63 Source server information I1117 09:55:10.993409 task.go:63 Verifying preconditions and clearing stale EC state I1117 09:55:10.993777 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:55:11.021850 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:55:11.046571 task.go:63 Marking volume readonly I1117 09:55:11.175152 ec_task.go:457 restored volume 9610 to writable on 127.0.0.1:34813 after EC task failure I1117 09:55:11.187987 ec_task.go:457 restored volume 9610 to writable on 127.0.0.1:41483 after EC task failure --- PASS: TestEcEncodeAbortsOnEqualFileCountDifferentIds (22.01s) === RUN TestEcEncodeAllowsVacuumOffsetMismatch I1117 09:55:32.835505 task.go:63 Starting erasure coding task I1117 09:55:32.835802 task.go:63 Target server shard assignment I1117 09:55:32.835952 task.go:63 Target server shard assignment I1117 09:55:32.836097 task.go:63 Source server information I1117 09:55:32.836251 task.go:63 Source server information I1117 09:55:32.836594 task.go:63 Verifying preconditions and clearing stale EC state I1117 09:55:32.836783 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:55:32.870627 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:55:32.898995 task.go:63 Marking volume readonly I1117 09:55:33.075095 ec_task.go:409 EC encode replica idx compare for volume 9611: volume 9611: all 2 data replicas are consistent (matching live idx sets, 2 needles) I1117 09:55:33.075383 task.go:63 Copying volume files to worker I1117 09:55:33.088362 task.go:63 Starting volume file copy from source server I1117 09:55:33.098251 task.go:63 Volume index file copied successfully I1117 09:55:33.111667 task.go:63 Volume data file copied successfully I1117 09:55:33.111880 task.go:63 Generating EC shards locally I1117 09:55:33.133573 ec_encoder.go:225 encodeDatFile /tmp/TestEcEncodeAllowsVacuumOffsetMismatch1915842698/001/vol_9611_1794909332/9611.dat size:200 with EC context 10+4 (total: 14) I1117 09:55:34.402614 task.go:63 EC shard generated I1117 09:55:34.403014 task.go:63 EC shard generated I1117 09:55:34.403208 task.go:63 EC shard generated I1117 09:55:34.403423 task.go:63 EC shard generated I1117 09:55:34.403608 task.go:63 EC shard generated I1117 09:55:34.403793 task.go:63 EC shard generated I1117 09:55:34.403972 task.go:63 EC shard generated I1117 09:55:34.404153 task.go:63 EC shard generated I1117 09:55:34.404377 task.go:63 EC shard generated I1117 09:55:34.404559 task.go:63 EC shard generated I1117 09:55:34.404745 task.go:63 EC shard generated I1117 09:55:34.404925 task.go:63 EC shard generated I1117 09:55:34.405105 task.go:63 EC shard generated I1117 09:55:34.405286 task.go:63 EC shard generated I1117 09:55:34.406563 task.go:63 EC index file generated I1117 09:55:34.415165 task.go:63 Volume info file generated I1117 09:55:34.415551 task.go:63 EC bitrot checksum sidecar generated I1117 09:55:34.415972 task.go:63 EC shard generation completed I1117 09:55:34.416138 task.go:63 Removing empty stub replicas before distribute I1117 09:55:34.472285 task.go:63 Distributing EC shards to destinations I1117 09:55:34.485420 task.go:63 Starting shard distribution to destination server I1117 09:55:34.489935 task.go:63 Starting shard distribution to destination server I1117 09:55:34.493392 task.go:63 Starting shard file transfer I1117 09:55:34.493406 task.go:63 Starting shard file transfer I1117 09:55:34.606018 task.go:63 Shard file transfer completed I1117 09:55:34.606507 task.go:63 Starting shard file transfer I1117 09:55:34.614868 task.go:63 Shard file transfer completed I1117 09:55:34.615238 task.go:63 Starting shard file transfer I1117 09:55:34.709837 task.go:63 Shard file transfer completed I1117 09:55:34.710403 task.go:63 Starting shard file transfer I1117 09:55:34.763975 task.go:63 Shard file transfer completed I1117 09:55:34.764523 task.go:63 Starting shard file transfer I1117 09:55:34.807700 task.go:63 Shard file transfer completed I1117 09:55:34.808067 task.go:63 Starting shard file transfer I1117 09:55:34.858018 task.go:63 Shard file transfer completed I1117 09:55:34.858668 task.go:63 Starting shard file transfer I1117 09:55:34.909335 task.go:63 Shard file transfer completed I1117 09:55:34.909871 task.go:63 Starting shard file transfer I1117 09:55:34.950590 task.go:63 Shard file transfer completed I1117 09:55:34.951086 task.go:63 Starting shard file transfer I1117 09:55:34.955451 task.go:63 Shard file transfer completed I1117 09:55:34.956189 task.go:63 Starting shard file transfer I1117 09:55:34.959925 task.go:63 Shard file transfer completed I1117 09:55:34.960191 task.go:63 Starting shard file transfer I1117 09:55:34.963484 task.go:63 Shard file transfer completed I1117 09:55:35.002877 task.go:63 Shard file transfer completed I1117 09:55:35.003561 task.go:63 Starting shard file transfer I1117 09:55:35.094202 task.go:63 Shard file transfer completed I1117 09:55:35.094590 task.go:63 Starting shard file transfer I1117 09:55:35.204133 task.go:63 Shard file transfer completed I1117 09:55:35.204544 task.go:63 Starting shard file transfer I1117 09:55:35.298134 task.go:63 Shard file transfer completed I1117 09:55:35.298482 task.go:63 Starting shard file transfer I1117 09:55:35.390442 task.go:63 Shard file transfer completed I1117 09:55:35.390917 task.go:63 Starting shard file transfer I1117 09:55:35.482343 task.go:63 Shard file transfer completed I1117 09:55:35.482856 task.go:63 Starting shard file transfer I1117 09:55:35.486975 task.go:63 Shard file transfer completed I1117 09:55:35.487228 task.go:63 Starting shard file transfer I1117 09:55:35.490658 task.go:63 Shard file transfer completed I1117 09:55:35.491091 task.go:63 Starting shard file transfer I1117 09:55:35.494308 task.go:63 Shard file transfer completed I1117 09:55:35.495400 task.go:63 All shards distributed to destination server I1117 09:55:35.495822 task.go:63 All shards distributed to destination server I1117 09:55:35.496139 task.go:63 Mounting EC shards I1117 09:55:35.499629 task.go:63 Starting EC shard mount operation I1117 09:55:35.533942 task.go:63 Successfully mounted EC shards I1117 09:55:35.534599 task.go:63 Starting EC shard mount operation I1117 09:55:35.572185 task.go:63 Successfully mounted EC shards I1117 09:55:35.572496 task.go:63 Verifying EC shards across destinations I1117 09:55:35.594249 task.go:63 EC shard inventory before source deletion I1117 09:55:35.594777 task.go:63 Deleting original volume I1117 09:55:35.595363 task.go:63 Starting original volume deletion from replica servers I1117 09:55:35.595492 task.go:63 Deleting volume from replica server I1117 09:55:35.606828 task.go:63 Successfully deleted volume from replica server I1117 09:55:35.607031 task.go:63 Deleting volume from replica server I1117 09:55:35.617777 task.go:63 Successfully deleted volume from replica server I1117 09:55:35.617963 task.go:63 Successfully deleted volume from all replica servers I1117 09:55:35.618457 ec_task.go:287 EC task completed successfully: volume 9611 from 127.0.0.1:41599.39865 with 17 shards distributed --- PASS: TestEcEncodeAllowsVacuumOffsetMismatch (24.44s) === RUN TestEcEncodeAbortsWhenIdxRpcFails --- PASS: TestEcEncodeAbortsWhenIdxRpcFails (21.47s) === RUN TestEcEncodeSingleReplicaAfterReadonly I1117 09:56:12.032618 ec_task.go:409 EC encode replica idx compare for volume 9613: volume 9613: single replica 127.0.0.1:40039.43561, skipping idx set compare I1117 09:56:12.033613 task.go:63 Starting erasure coding task I1117 09:56:12.033751 task.go:63 Target server shard assignment I1117 09:56:12.033875 task.go:63 Source server information I1117 09:56:12.034247 task.go:63 Verifying preconditions and clearing stale EC state I1117 09:56:12.034498 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:56:12.056269 task.go:63 Marking volume readonly I1117 09:56:12.082245 ec_task.go:409 EC encode replica idx compare for volume 9613: volume 9613: single replica 127.0.0.1:40039.43561, skipping idx set compare I1117 09:56:12.082415 task.go:63 Copying volume files to worker I1117 09:56:12.093549 task.go:63 Starting volume file copy from source server I1117 09:56:12.101426 task.go:63 Volume index file copied successfully I1117 09:56:12.106702 task.go:63 Volume data file copied successfully I1117 09:56:12.106868 task.go:63 Generating EC shards locally I1117 09:56:12.111373 ec_encoder.go:225 encodeDatFile /tmp/TestEcEncodeSingleReplicaAfterReadonly4171837438/001/vol_9613_1794909372/9613.dat size:200 with EC context 10+4 (total: 14) I1117 09:56:12.792213 task.go:63 EC shard generated I1117 09:56:12.792521 task.go:63 EC shard generated I1117 09:56:12.792713 task.go:63 EC shard generated I1117 09:56:12.792941 task.go:63 EC shard generated I1117 09:56:12.793137 task.go:63 EC shard generated I1117 09:56:12.793314 task.go:63 EC shard generated I1117 09:56:12.793911 task.go:63 EC shard generated I1117 09:56:12.794109 task.go:63 EC shard generated I1117 09:56:12.794347 task.go:63 EC shard generated I1117 09:56:12.794530 task.go:63 EC shard generated I1117 09:56:12.794717 task.go:63 EC shard generated I1117 09:56:12.794892 task.go:63 EC shard generated I1117 09:56:12.795069 task.go:63 EC shard generated I1117 09:56:12.795251 task.go:63 EC shard generated I1117 09:56:12.796262 task.go:63 EC index file generated I1117 09:56:12.797595 task.go:63 Volume info file generated I1117 09:56:12.797768 task.go:63 EC bitrot checksum sidecar generated I1117 09:56:12.797962 task.go:63 EC shard generation completed I1117 09:56:12.798068 task.go:63 Removing empty stub replicas before distribute I1117 09:56:12.824437 task.go:63 Distributing EC shards to destinations I1117 09:56:12.825279 task.go:63 Starting shard distribution to destination server I1117 09:56:12.826567 task.go:63 Starting shard file transfer I1117 09:56:12.924251 task.go:63 Shard file transfer completed I1117 09:56:12.924933 task.go:63 Starting shard file transfer I1117 09:56:13.015702 task.go:63 Shard file transfer completed I1117 09:56:13.016299 task.go:63 Starting shard file transfer I1117 09:56:13.119070 task.go:63 Shard file transfer completed I1117 09:56:13.119703 task.go:63 Starting shard file transfer I1117 09:56:13.224610 task.go:63 Shard file transfer completed I1117 09:56:13.224965 task.go:63 Starting shard file transfer I1117 09:56:13.318742 task.go:63 Shard file transfer completed I1117 09:56:13.319237 task.go:63 Starting shard file transfer I1117 09:56:13.416746 task.go:63 Shard file transfer completed I1117 09:56:13.417284 task.go:63 Starting shard file transfer I1117 09:56:13.507081 task.go:63 Shard file transfer completed I1117 09:56:13.507505 task.go:63 Starting shard file transfer I1117 09:56:13.600783 task.go:63 Shard file transfer completed I1117 09:56:13.601245 task.go:63 Starting shard file transfer I1117 09:56:13.690531 task.go:63 Shard file transfer completed I1117 09:56:13.690899 task.go:63 Starting shard file transfer I1117 09:56:13.782598 task.go:63 Shard file transfer completed I1117 09:56:13.783070 task.go:63 Starting shard file transfer I1117 09:56:13.872088 task.go:63 Shard file transfer completed I1117 09:56:13.872461 task.go:63 Starting shard file transfer I1117 09:56:13.964756 task.go:63 Shard file transfer completed I1117 09:56:13.965073 task.go:63 Starting shard file transfer I1117 09:56:14.065823 task.go:63 Shard file transfer completed I1117 09:56:14.066385 task.go:63 Starting shard file transfer I1117 09:56:14.165883 task.go:63 Shard file transfer completed I1117 09:56:14.166248 task.go:63 Starting shard file transfer I1117 09:56:14.170445 task.go:63 Shard file transfer completed I1117 09:56:14.170778 task.go:63 Starting shard file transfer I1117 09:56:14.173967 task.go:63 Shard file transfer completed I1117 09:56:14.174237 task.go:63 Starting shard file transfer I1117 09:56:14.177446 task.go:63 Shard file transfer completed I1117 09:56:14.178324 task.go:63 All shards distributed to destination server I1117 09:56:14.178516 task.go:63 Mounting EC shards I1117 09:56:14.179320 task.go:63 Starting EC shard mount operation I1117 09:56:14.223188 task.go:63 Successfully mounted EC shards I1117 09:56:14.223437 task.go:63 Verifying EC shards across destinations I1117 09:56:14.236152 task.go:63 EC shard inventory before source deletion I1117 09:56:14.236392 task.go:63 Deleting original volume I1117 09:56:14.236568 task.go:63 Starting original volume deletion from replica servers I1117 09:56:14.236711 task.go:63 Deleting volume from replica server I1117 09:56:14.246594 task.go:63 Successfully deleted volume from replica server I1117 09:56:14.246795 task.go:63 Successfully deleted volume from all replica servers I1117 09:56:14.247182 ec_task.go:287 EC task completed successfully: volume 9613 from 127.0.0.1:40039.43561 with 17 shards distributed --- PASS: TestEcEncodeSingleReplicaAfterReadonly (17.13s) === RUN TestHttpWriteAfterReadonlyIsNotCreated --- PASS: TestHttpWriteAfterReadonlyIsNotCreated (14.19s) === RUN TestEcEncodeJulorLayoutRefuses I1117 09:57:00.027127 task.go:63 Starting erasure coding task I1117 09:57:00.027688 task.go:63 Target server shard assignment I1117 09:57:00.027907 task.go:63 Target server shard assignment I1117 09:57:00.028033 task.go:63 Target server shard assignment I1117 09:57:00.028142 task.go:63 Target server shard assignment I1117 09:57:00.028251 task.go:63 Target server shard assignment I1117 09:57:00.028358 task.go:63 Target server shard assignment I1117 09:57:00.028483 task.go:63 Source server information I1117 09:57:00.028595 task.go:63 Source server information I1117 09:57:00.028709 task.go:63 Source server information I1117 09:57:00.029034 task.go:63 Verifying preconditions and clearing stale EC state I1117 09:57:00.029261 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:57:00.061775 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:57:00.101386 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:57:00.156618 task.go:63 Marking volume readonly I1117 09:57:00.337126 ec_task.go:457 restored volume 9500 to writable on 127.0.0.1:42153 after EC task failure I1117 09:57:00.365576 ec_task.go:457 restored volume 9500 to writable on 127.0.0.1:40509 after EC task failure --- PASS: TestEcEncodeJulorLayoutRefuses (32.01s) === RUN TestCleanupOrphanSkipsWritableSourceReplica W1117 09:57:14.501100 detection.go:760 EC Detection: source replica for volume 955 on 127.0.0.1:44831.46397 is writable; not deleting (may hold writes the EC shards lack) --- PASS: TestCleanupOrphanSkipsWritableSourceReplica (14.12s) === RUN TestEnsureCleanEcStartClearsStaleShardsBeforeEncode I1117 09:57:30.010119 task.go:63 Clearing stale EC shards on destination before re-distribute --- PASS: TestEnsureCleanEcStartClearsStaleShardsBeforeEncode (15.47s) === RUN TestRollbackDistributeClearsShardsAndKeepsSource I1117 09:57:45.987871 task.go:63 Clearing stale EC shards on destination before re-distribute I1117 09:57:46.054772 ec_task.go:457 restored volume 94783 to writable on 127.0.0.1:34019 after EC task failure --- PASS: TestRollbackDistributeClearsShardsAndKeepsSource (16.02s) === RUN TestEnsureCleanEcStartRejectsMissingTargets --- PASS: TestEnsureCleanEcStartRejectsMissingTargets (0.00s) === RUN TestEnsureCleanEcStartRejectsMalformedTarget === RUN TestEnsureCleanEcStartRejectsMalformedTarget/nil_target === RUN TestEnsureCleanEcStartRejectsMalformedTarget/empty_node === RUN TestEnsureCleanEcStartRejectsMalformedTarget/no_shards === RUN TestEnsureCleanEcStartRejectsMalformedTarget/one_good_one_bad --- PASS: TestEnsureCleanEcStartRejectsMalformedTarget (0.00s) --- PASS: TestEnsureCleanEcStartRejectsMalformedTarget/nil_target (0.00s) --- PASS: TestEnsureCleanEcStartRejectsMalformedTarget/empty_node (0.00s) --- PASS: TestEnsureCleanEcStartRejectsMalformedTarget/no_shards (0.00s) --- PASS: TestEnsureCleanEcStartRejectsMalformedTarget/one_good_one_bad (0.00s) === RUN TestEnsureCleanEcStartRejectsMissingSource --- PASS: TestEnsureCleanEcStartRejectsMissingSource (0.00s) === RUN TestLateBindSourceToWorkerHostPrefersWorkerHost --- PASS: TestLateBindSourceToWorkerHostPrefersWorkerHost (0.00s) === RUN TestLateBindSourceToWorkerHostNoMatchKeepsCurrent --- PASS: TestLateBindSourceToWorkerHostNoMatchKeepsCurrent (0.00s) === RUN TestCleanupStaleEcShardsBeforeDistribute I1117 09:58:03.635292 task.go:63 Clearing stale EC shards on destination before re-distribute --- PASS: TestCleanupStaleEcShardsBeforeDistribute (17.60s) === RUN TestCleanupStaleEcShardsClearsShardsBeyondSources I1117 09:58:19.697046 task.go:63 Clearing stale EC shards on destination before re-distribute --- PASS: TestCleanupStaleEcShardsClearsShardsBeyondSources (16.08s) === RUN TestCleanupStaleEcShardsCoversTargetsWithoutSources I1117 09:58:35.492626 task.go:63 Clearing stale EC shards on destination before re-distribute --- PASS: TestCleanupStaleEcShardsCoversTargetsWithoutSources (15.78s) === RUN TestCleanupStaleEcShardsSkipsRegularReplicas --- PASS: TestCleanupStaleEcShardsSkipsRegularReplicas (14.01s) === RUN TestCopyVolumeFilesToWorkerUsesCurrentCompactionRevision I1117 09:59:04.000368 task.go:63 Starting volume file copy from source server I1117 09:59:04.017265 task.go:63 Volume index file copied successfully I1117 09:59:04.043534 task.go:63 Volume data file copied successfully --- PASS: TestCopyVolumeFilesToWorkerUsesCurrentCompactionRevision (14.51s) === RUN TestMarkReplicasReadonlyPersists --- PASS: TestMarkReplicasReadonlyPersists (14.17s) === RUN TestGenerateEcShardsLocallyStampsEncodeIdentity I1117 09:59:32.580454 task.go:63 Starting volume file copy from source server I1117 09:59:32.589916 task.go:63 Volume index file copied successfully I1117 09:59:32.596228 task.go:63 Volume data file copied successfully I1117 09:59:32.611983 ec_encoder.go:225 encodeDatFile /tmp/TestGenerateEcShardsLocallyStampsEncodeIdentity1671087933/001/952.dat size:120 with EC context 10+4 (total: 14) I1117 09:59:33.303625 task.go:63 EC shard generated I1117 09:59:33.303967 task.go:63 EC shard generated I1117 09:59:33.304199 task.go:63 EC shard generated I1117 09:59:33.304414 task.go:63 EC shard generated I1117 09:59:33.304665 task.go:63 EC shard generated I1117 09:59:33.304878 task.go:63 EC shard generated I1117 09:59:33.305096 task.go:63 EC shard generated I1117 09:59:33.305305 task.go:63 EC shard generated I1117 09:59:33.305632 task.go:63 EC shard generated I1117 09:59:33.305849 task.go:63 EC shard generated I1117 09:59:33.306060 task.go:63 EC shard generated I1117 09:59:33.306268 task.go:63 EC shard generated I1117 09:59:33.306486 task.go:63 EC shard generated I1117 09:59:33.306698 task.go:63 EC shard generated I1117 09:59:33.307886 task.go:63 EC index file generated I1117 09:59:33.309685 task.go:63 Volume info file generated I1117 09:59:33.309880 task.go:63 EC bitrot checksum sidecar generated I1117 09:59:33.310143 task.go:63 EC shard generation completed --- PASS: TestGenerateEcShardsLocallyStampsEncodeIdentity (15.09s) === RUN TestGenerateEcShardsLocallyUsesAdminGeneration I1117 09:59:47.653958 task.go:63 Starting volume file copy from source server I1117 09:59:47.666595 task.go:63 Volume index file copied successfully I1117 09:59:47.685513 task.go:63 Volume data file copied successfully I1117 09:59:47.690616 ec_encoder.go:225 encodeDatFile /tmp/TestGenerateEcShardsLocallyUsesAdminGeneration3342390411/001/957.dat size:120 with EC context 10+4 (total: 14) I1117 09:59:48.364247 task.go:63 EC shard generated I1117 09:59:48.364734 task.go:63 EC shard generated I1117 09:59:48.364951 task.go:63 EC shard generated I1117 09:59:48.365135 task.go:63 EC shard generated I1117 09:59:48.365341 task.go:63 EC shard generated I1117 09:59:48.365521 task.go:63 EC shard generated I1117 09:59:48.365703 task.go:63 EC shard generated I1117 09:59:48.365884 task.go:63 EC shard generated I1117 09:59:48.366160 task.go:63 EC shard generated I1117 09:59:48.366351 task.go:63 EC shard generated I1117 09:59:48.366531 task.go:63 EC shard generated I1117 09:59:48.366707 task.go:63 EC shard generated I1117 09:59:48.366888 task.go:63 EC shard generated I1117 09:59:48.367067 task.go:63 EC shard generated I1117 09:59:48.368031 task.go:63 EC index file generated I1117 09:59:48.369581 task.go:63 Volume info file generated I1117 09:59:48.369754 task.go:63 EC bitrot checksum sidecar generated I1117 09:59:48.369946 task.go:63 EC shard generation completed --- PASS: TestGenerateEcShardsLocallyUsesAdminGeneration (15.06s) === RUN TestGenerateEcShardsLocallyCarriesExpiry I1117 10:00:03.363775 task.go:63 Starting volume file copy from source server I1117 10:00:03.375296 task.go:63 Volume index file copied successfully I1117 10:00:03.387072 task.go:63 Volume data file copied successfully I1117 10:00:03.392115 ec_encoder.go:225 encodeDatFile /tmp/TestGenerateEcShardsLocallyCarriesExpiry2729878993/001/958.dat size:112 with EC context 10+4 (total: 14) I1117 10:00:04.063787 task.go:63 EC shard generated I1117 10:00:04.064107 task.go:63 EC shard generated I1117 10:00:04.064340 task.go:63 EC shard generated I1117 10:00:04.064524 task.go:63 EC shard generated I1117 10:00:04.064733 task.go:63 EC shard generated I1117 10:00:04.064914 task.go:63 EC shard generated I1117 10:00:04.065096 task.go:63 EC shard generated I1117 10:00:04.065276 task.go:63 EC shard generated I1117 10:00:04.065557 task.go:63 EC shard generated I1117 10:00:04.065742 task.go:63 EC shard generated I1117 10:00:04.065921 task.go:63 EC shard generated I1117 10:00:04.066099 task.go:63 EC shard generated I1117 10:00:04.066280 task.go:63 EC shard generated I1117 10:00:04.066467 task.go:63 EC shard generated I1117 10:00:04.067424 task.go:63 EC index file generated I1117 10:00:04.068949 task.go:63 Volume info file generated I1117 10:00:04.069145 task.go:63 EC bitrot checksum sidecar generated I1117 10:00:04.069346 task.go:63 EC shard generation completed --- PASS: TestGenerateEcShardsLocallyCarriesExpiry (15.70s) === RUN TestIsStubReplica --- PASS: TestIsStubReplica (0.00s) === RUN TestSelectCanonicalMetricPrefersCredibleOverLowServerStub --- PASS: TestSelectCanonicalMetricPrefersCredibleOverLowServerStub (0.00s) === RUN TestSelectCanonicalMetricSkipsECMetrics --- PASS: TestSelectCanonicalMetricSkipsECMetrics (0.00s) === RUN TestSelectCanonicalMetricAllStubsFallsBackToLowestServer --- PASS: TestSelectCanonicalMetricAllStubsFallsBackToLowestServer (0.00s) === RUN TestSelectCanonicalMetricTieBreaksByServerAmongCredible --- PASS: TestSelectCanonicalMetricTieBreaksByServerAmongCredible (0.00s) === RUN TestSelectCanonicalMetricEmpty --- PASS: TestSelectCanonicalMetricEmpty (0.00s) === RUN TestDetectionEncodesDespiteLowServerStub I1117 10:00:04.146796 detection.go:220 EC Detection: Volume 13 meets all criteria, attempting to create task I1117 10:00:04.147412 detection.go:246 EC Detection: ActiveTopology available, planning destinations for volume 13 I1117 10:00:04.157587 detection.go:262 EC Detection: Successfully planned 14 destinations for volume 13 I1117 10:00:04.157987 detection.go:279 EC Detection: Looking for replica locations for volume 13 I1117 10:00:04.158390 detection.go:285 EC Detection: Found 2 replica locations for volume 13 I1117 10:00:04.159725 detection.go:404 EC Detection: Successfully created EC task for volume 13, adding to results --- PASS: TestDetectionEncodesDespiteLowServerStub (0.02s) === RUN TestDecodeErasureCodingTaskParamsFromPayload --- PASS: TestDecodeErasureCodingTaskParamsFromPayload (0.02s) === RUN TestDecodeErasureCodingTaskParamsFallback --- PASS: TestDecodeErasureCodingTaskParamsFallback (0.00s) === RUN TestDeriveErasureCodingWorkerConfig --- PASS: TestDeriveErasureCodingWorkerConfig (0.00s) === RUN TestDeriveErasureCodingWorkerConfigMaxShardTransfers --- PASS: TestDeriveErasureCodingWorkerConfigMaxShardTransfers (0.00s) === RUN TestBuildErasureCodingProposal --- PASS: TestBuildErasureCodingProposal (0.00s) === RUN TestErasureCodingHandlerRejectsUnsupportedJobType --- PASS: TestErasureCodingHandlerRejectsUnsupportedJobType (0.00s) === RUN TestEmitErasureCodingDetectionDecisionTraceNoTasks --- PASS: TestEmitErasureCodingDetectionDecisionTraceNoTasks (0.00s) === RUN TestErasureCodingDescriptorExposesFreeSlotsDeadband --- PASS: TestErasureCodingDescriptorExposesFreeSlotsDeadband (0.00s) === RUN TestErasureCodingDescriptorOmitsLocalExecutionFields --- PASS: TestErasureCodingDescriptorOmitsLocalExecutionFields (0.00s) === RUN TestApplyErasureCodingExecutionDefaultsForcesLocalFields --- PASS: TestApplyErasureCodingExecutionDefaultsForcesLocalFields (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/worker/tasks/erasure_coding 1166.000s === RUN TestCompactDataFilesKeepsInputOrderByBounds --- PASS: TestCompactDataFilesKeepsInputOrderByBounds (1.56s) === RUN TestCompactDataFilesSplitsOrderedRuns --- PASS: TestCompactDataFilesSplitsOrderedRuns (0.67s) === RUN TestCompactDataFilesOrdersPastIneligibleFile --- PASS: TestCompactDataFilesOrdersPastIneligibleFile (0.53s) === RUN TestCompactDataFilesMergesStrandedRun --- PASS: TestCompactDataFilesMergesStrandedRun (0.37s) === RUN TestCompactDataFilesKeepsStrandedRunForSortedTable --- PASS: TestCompactDataFilesKeepsStrandedRunForSortedTable (0.20s) === RUN TestResolveCompactionOrderSkipsUncoveredSortField --- PASS: TestResolveCompactionOrderSkipsUncoveredSortField (0.01s) === RUN TestCompactDataFilesKeepsRunsWhenRepackFails --- PASS: TestCompactDataFilesKeepsRunsWhenRepackFails (0.33s) === RUN TestResolveCompactionOrderSkipsGeometry --- PASS: TestResolveCompactionOrderSkipsGeometry (0.01s) === RUN TestCompactDataFilesWritesSeveralRowGroups --- PASS: TestCompactDataFilesWritesSeveralRowGroups (0.56s) === RUN TestRowsPerRowGroupHonorsConfiguredLimit --- PASS: TestRowsPerRowGroupHonorsConfiguredLimit (0.00s) === RUN TestMergeParquetFilesAddedColumn === RUN TestMergeParquetFilesAddedColumn/narrow_first === RUN TestMergeParquetFilesAddedColumn/wide_first --- PASS: TestMergeParquetFilesAddedColumn (0.15s) --- PASS: TestMergeParquetFilesAddedColumn/narrow_first (0.09s) --- PASS: TestMergeParquetFilesAddedColumn/wide_first (0.06s) === RUN TestMergeParquetFilesRequiredVsOptional --- PASS: TestMergeParquetFilesRequiredVsOptional (0.05s) === RUN TestMergeParquetFilesReaddedColumn --- PASS: TestMergeParquetFilesReaddedColumn (0.06s) === RUN TestMergeParquetFilesSchemaRefusals === RUN TestMergeParquetFilesSchemaRefusals/rename === RUN TestMergeParquetFilesSchemaRefusals/type_change === RUN TestMergeParquetFilesSchemaRefusals/no_field_ids === RUN TestMergeParquetFilesSchemaRefusals/control --- PASS: TestMergeParquetFilesSchemaRefusals (0.18s) --- PASS: TestMergeParquetFilesSchemaRefusals/rename (0.03s) --- PASS: TestMergeParquetFilesSchemaRefusals/type_change (0.04s) --- PASS: TestMergeParquetFilesSchemaRefusals/no_field_ids (0.06s) --- PASS: TestMergeParquetFilesSchemaRefusals/control (0.05s) === RUN TestMergeParquetFilesEvolvedSchemaEqualityDelete --- PASS: TestMergeParquetFilesEvolvedSchemaEqualityDelete (0.09s) === RUN TestMergeParquetFilesUnionWriterSchema === RUN TestMergeParquetFilesUnionWriterSchema/added_column_and_repetition_differ === RUN TestMergeParquetFilesUnionWriterSchema/disjoint_columns === RUN TestMergeParquetFilesUnionWriterSchema/added_required_column --- PASS: TestMergeParquetFilesUnionWriterSchema (0.39s) --- PASS: TestMergeParquetFilesUnionWriterSchema/added_column_and_repetition_differ (0.19s) --- PASS: TestMergeParquetFilesUnionWriterSchema/disjoint_columns (0.11s) --- PASS: TestMergeParquetFilesUnionWriterSchema/added_required_column (0.09s) === RUN TestMergeParquetFilesEqualityDeleteAddedColumn === RUN TestMergeParquetFilesEqualityDeleteAddedColumn/key_matches_no_null === RUN TestMergeParquetFilesEqualityDeleteAddedColumn/null_key_deletes_nulls --- PASS: TestMergeParquetFilesEqualityDeleteAddedColumn (0.29s) --- PASS: TestMergeParquetFilesEqualityDeleteAddedColumn/key_matches_no_null (0.11s) --- PASS: TestMergeParquetFilesEqualityDeleteAddedColumn/null_key_deletes_nulls (0.18s) === RUN TestMergeParquetFilesEqualityDeleteRenamedColumn --- PASS: TestMergeParquetFilesEqualityDeleteRenamedColumn (0.10s) === RUN TestEqualityDeleteFileMissingColumn --- PASS: TestEqualityDeleteFileMissingColumn (0.04s) === RUN TestMergeParquetFilesV3ReaddedColumn --- PASS: TestMergeParquetFilesV3ReaddedColumn (0.05s) === RUN TestCompactDataFilesRecordsColumnStatistics --- PASS: TestCompactDataFilesRecordsColumnStatistics (0.56s) === RUN TestBoundLiteralTypes === RUN TestBoundLiteralTypes/decimal(18,2)_as_INT64 === RUN TestBoundLiteralTypes/decimal(9,2)_as_INT32 === RUN TestBoundLiteralTypes/decimal_at_another_scale:_none === RUN TestBoundLiteralTypes/decimal(38,2)_as_bytes:_none === RUN TestBoundLiteralTypes/time_(us) === RUN TestBoundLiteralTypes/time_(ms)_is_INT32 === RUN TestBoundLiteralTypes/timestamp_ms,_lower === RUN TestBoundLiteralTypes/timestamp_ns_to_us,_upper_rounds_up === RUN TestBoundLiteralTypes/timestamp_ns_to_us,_lower_rounds_down === RUN TestBoundLiteralTypes/negative_timestamp_ns_to_us,_lower_rounds_down === RUN TestBoundLiteralTypes/negative_timestamp_ns_to_us,_upper_rounds_up === RUN TestBoundLiteralTypes/timestamptz_ns_us_rescale === RUN TestBoundLiteralTypes/timestamp_ms_to_us_overflows:_none === RUN TestBoundLiteralTypes/uuid === RUN TestBoundLiteralTypes/fixed[4] === RUN TestBoundLiteralTypes/fixed_of_another_length:_none === RUN TestBoundLiteralTypes/double_from_FLOAT --- PASS: TestBoundLiteralTypes (0.02s) --- PASS: TestBoundLiteralTypes/decimal(18,2)_as_INT64 (0.00s) --- PASS: TestBoundLiteralTypes/decimal(9,2)_as_INT32 (0.00s) --- PASS: TestBoundLiteralTypes/decimal_at_another_scale:_none (0.00s) --- PASS: TestBoundLiteralTypes/decimal(38,2)_as_bytes:_none (0.00s) --- PASS: TestBoundLiteralTypes/time_(us) (0.00s) --- PASS: TestBoundLiteralTypes/time_(ms)_is_INT32 (0.00s) --- PASS: TestBoundLiteralTypes/timestamp_ms,_lower (0.00s) --- PASS: TestBoundLiteralTypes/timestamp_ns_to_us,_upper_rounds_up (0.00s) --- PASS: TestBoundLiteralTypes/timestamp_ns_to_us,_lower_rounds_down (0.00s) --- PASS: TestBoundLiteralTypes/negative_timestamp_ns_to_us,_lower_rounds_down (0.00s) --- PASS: TestBoundLiteralTypes/negative_timestamp_ns_to_us,_upper_rounds_up (0.00s) --- PASS: TestBoundLiteralTypes/timestamptz_ns_us_rescale (0.00s) --- PASS: TestBoundLiteralTypes/timestamp_ms_to_us_overflows:_none (0.00s) --- PASS: TestBoundLiteralTypes/uuid (0.00s) --- PASS: TestBoundLiteralTypes/fixed[4] (0.00s) --- PASS: TestBoundLiteralTypes/fixed_of_another_length:_none (0.00s) --- PASS: TestBoundLiteralTypes/double_from_FLOAT (0.00s) === RUN TestCollectColumnStatsBoundsMoreTypes --- PASS: TestCollectColumnStatsBoundsMoreTypes (0.04s) === RUN TestPositionDeleteFileHasFieldIDsAndDictionaryPaths --- PASS: TestPositionDeleteFileHasFieldIDsAndDictionaryPaths (0.02s) === RUN TestDeletionVectorPathMatching --- PASS: TestDeletionVectorPathMatching (0.00s) === RUN TestCompactDataFilesDeletionVector --- PASS: TestCompactDataFilesDeletionVector (0.62s) === RUN TestDetectSchedulesDeletionVector === RUN TestDetectSchedulesDeletionVector/unaffected_files_stay_eligible === RUN TestDetectSchedulesDeletionVector/all_binable_files_covered --- PASS: TestDetectSchedulesDeletionVector (0.67s) --- PASS: TestDetectSchedulesDeletionVector/unaffected_files_stay_eligible (0.39s) --- PASS: TestDetectSchedulesDeletionVector/all_binable_files_covered (0.28s) === RUN TestCompactionAppliesEqualityDeletesOnlyToOlderDataFiles --- PASS: TestCompactionAppliesEqualityDeletesOnlyToOlderDataFiles (0.45s) === RUN TestEqualityDeletesApplyOnlyWithinTheirPartition --- PASS: TestEqualityDeletesApplyOnlyWithinTheirPartition (0.11s) === RUN TestEqualityDeletesWithoutSequenceNumbersAreRefused --- PASS: TestEqualityDeletesWithoutSequenceNumbersAreRefused (0.07s) === RUN TestEqualityDeleteUnderAnAllVoidSpecAppliesEverywhere --- PASS: TestEqualityDeleteUnderAnAllVoidSpecAppliesEverywhere (0.06s) === RUN TestAWhereFilterKeepsUnpartitionedDeletes --- PASS: TestAWhereFilterKeepsUnpartitionedDeletes (0.00s) === RUN TestEqualityDeletesMatchTheirPartitionByTypedValue --- PASS: TestEqualityDeletesMatchTheirPartitionByTypedValue (0.07s) === RUN TestADeleteWithoutPartitionValuesUnderAPartitionedSpecIsRefused --- PASS: TestADeleteWithoutPartitionValuesUnderAPartitionedSpecIsRefused (0.02s) === RUN TestEqualityDeleteGroupsOfDifferentScopesDoNotCollide --- PASS: TestEqualityDeleteGroupsOfDifferentScopesDoNotCollide (0.11s) === RUN TestExpireSnapshotsExecution exec_test.go:598: expireSnapshots result: expired 2 snapshot(s), deleted 6 unreferenced file(s) --- PASS: TestExpireSnapshotsExecution (0.45s) === RUN TestExpireSnapshotsKeepsTaggedSnapshot --- PASS: TestExpireSnapshotsKeepsTaggedSnapshot (0.42s) === RUN TestExpireSnapshotsHonorsBranchRetention --- PASS: TestExpireSnapshotsHonorsBranchRetention (1.19s) === RUN TestExpireSnapshotsHonorsBranchMaxSnapshotAge --- PASS: TestExpireSnapshotsHonorsBranchMaxSnapshotAge (0.68s) === RUN TestExpireSnapshotsRejectsPlanWhenARefAppears --- PASS: TestExpireSnapshotsRejectsPlanWhenARefAppears (0.65s) === RUN TestExpireSnapshotsNothingToExpire --- PASS: TestExpireSnapshotsNothingToExpire (0.14s) === RUN TestMaintenanceOnExternalTableLocation --- PASS: TestMaintenanceOnExternalTableLocation (0.49s) === RUN TestCompactDataFilesOnExternalTableLocation --- PASS: TestCompactDataFilesOnExternalTableLocation (0.52s) === RUN TestRemoveOrphansExecution --- PASS: TestRemoveOrphansExecution (0.21s) === RUN TestRemoveOrphansPreservesReferencedFiles --- PASS: TestRemoveOrphansPreservesReferencedFiles (0.14s) === RUN TestMaintenanceOnManifestListWithoutFormatVersion --- PASS: TestMaintenanceOnManifestListWithoutFormatVersion (0.21s) === RUN TestRewriteManifestsExecution exec_test.go:1294: rewriteManifests result: rewrote 5 manifests into 1 (5 entries) --- PASS: TestRewriteManifestsExecution (0.73s) === RUN TestRewriteManifestsBelowThreshold --- PASS: TestRewriteManifestsBelowThreshold (0.16s) === RUN TestFullExecuteFlow exec_test.go:1475: Full execution results: expire_snapshots: no snapshots expired; remove_orphans: removed 1 orphan file(s) --- PASS: TestFullExecuteFlow (0.41s) === RUN TestDetectWithFakeFiler --- PASS: TestDetectWithFakeFiler (0.29s) === RUN TestDetectWithFilters --- PASS: TestDetectWithFilters (0.60s) === RUN TestConnectToFilerSkipsUnreachableAddresses --- PASS: TestConnectToFilerSkipsUnreachableAddresses (0.05s) === RUN TestConnectToFilerFailsWhenAllAddressesAreUnreachable --- PASS: TestConnectToFilerFailsWhenAllAddressesAreUnreachable (0.01s) === RUN TestDetectSchedulesCompactionWithoutSnapshotPressure --- PASS: TestDetectSchedulesCompactionWithoutSnapshotPressure (0.26s) === RUN TestDetectSchedulesCompactionWithDeleteManifestPresent --- PASS: TestDetectSchedulesCompactionWithDeleteManifestPresent (0.26s) === RUN TestDetectSchedulesSnapshotExpiryDespiteCompactionEvaluationError --- PASS: TestDetectSchedulesSnapshotExpiryDespiteCompactionEvaluationError (0.20s) === RUN TestDetectSchedulesManifestRewriteWithoutSnapshotPressure --- PASS: TestDetectSchedulesManifestRewriteWithoutSnapshotPressure (0.56s) === RUN TestDetectUsesPlanningIndexForRepeatedCompactionScans --- PASS: TestDetectUsesPlanningIndexForRepeatedCompactionScans (0.35s) === RUN TestDetectInvalidatesPlanningIndexWhenCompactionConfigChanges --- PASS: TestDetectInvalidatesPlanningIndexWhenCompactionConfigChanges (0.37s) === RUN TestDetectPlanningIndexPreservesUnscannedSections --- PASS: TestDetectPlanningIndexPreservesUnscannedSections (0.34s) === RUN TestTableNeedsMaintenanceCachesPlanningIndexBuildError --- PASS: TestTableNeedsMaintenanceCachesPlanningIndexBuildError (0.15s) === RUN TestTableNeedsMaintenanceScopesPlanningIndexBuildErrorsPerOperation --- PASS: TestTableNeedsMaintenanceScopesPlanningIndexBuildErrorsPerOperation (0.25s) === RUN TestPersistPlanningIndexUsesMetadataXattrCASGuard --- PASS: TestPersistPlanningIndexUsesMetadataXattrCASGuard (0.11s) === RUN TestDetectDoesNotScheduleManifestRewriteFromDeleteManifestsOnly --- PASS: TestDetectDoesNotScheduleManifestRewriteFromDeleteManifestsOnly (0.19s) === RUN TestDetectSchedulesOrphanCleanupWithoutSnapshotPressure --- PASS: TestDetectSchedulesOrphanCleanupWithoutSnapshotPressure (0.18s) === RUN TestDetectSchedulesOrphanCleanupWithoutSnapshots --- PASS: TestDetectSchedulesOrphanCleanupWithoutSnapshots (0.05s) === RUN TestStalePlanGuard --- PASS: TestStalePlanGuard (0.11s) === RUN TestMetadataVersionCAS --- PASS: TestMetadataVersionCAS (0.09s) === RUN TestMetadataVersionCASDetectsConcurrentUpdate --- PASS: TestMetadataVersionCASDetectsConcurrentUpdate (0.09s) === RUN TestCompactDataFilesMetrics --- PASS: TestCompactDataFilesMetrics (0.33s) === RUN TestCompactDataFilesRecordsSnapshotTotals --- PASS: TestCompactDataFilesRecordsSnapshotTotals (0.31s) === RUN TestCompactDataFilesLeavesOutTotalsParentNeverRecorded --- PASS: TestCompactDataFilesLeavesOutTotalsParentNeverRecorded (0.28s) === RUN TestRewritePositionDeleteFilesRecordsSnapshotTotals --- PASS: TestRewritePositionDeleteFilesRecordsSnapshotTotals (0.38s) === RUN TestExpireSnapshotsMetrics --- PASS: TestExpireSnapshotsMetrics (0.38s) === RUN TestExecuteCompletionOutputValues --- PASS: TestExecuteCompletionOutputValues (0.38s) === RUN TestCompactDataFilesWithPositionDeletes exec_test.go:3429: result: compacted 2 files into 1 (across 1 bins) --- PASS: TestCompactDataFilesWithPositionDeletes (0.42s) === RUN TestCompactDataFilesWithEqualityDeletes exec_test.go:3529: result: compacted 2 files into 1 (across 1 bins) --- PASS: TestCompactDataFilesWithEqualityDeletes (0.39s) === RUN TestCompactDataFilesApplyDeletesDisabled --- PASS: TestCompactDataFilesApplyDeletesDisabled (0.18s) === RUN TestCompactDataFilesWithMixedDeletes --- PASS: TestCompactDataFilesWithMixedDeletes (0.47s) === RUN TestCompactDataFilesSortStrategyUsesAscendingTableSortOrder --- PASS: TestCompactDataFilesSortStrategyUsesAscendingTableSortOrder (0.33s) === RUN TestCompactDataFilesSortStrategyUsesTableSortOrder --- PASS: TestCompactDataFilesSortStrategyUsesTableSortOrder (0.28s) === RUN TestDetectSkipsSortCompactionBinsAboveCap --- PASS: TestDetectSkipsSortCompactionBinsAboveCap (0.18s) === RUN TestDetectSplitsSortCompactionBinsByCap --- PASS: TestDetectSplitsSortCompactionBinsByCap (0.20s) === RUN TestCompactDataFilesSortStrategyRequiresTableSortOrder --- PASS: TestCompactDataFilesSortStrategyRequiresTableSortOrder (0.12s) === RUN TestRewritePositionDeleteFilesExecution --- PASS: TestRewritePositionDeleteFilesExecution (0.39s) === RUN TestRewritePositionDeleteFilesDetection --- PASS: TestRewritePositionDeleteFilesDetection (0.27s) === RUN TestRewritePositionDeleteFilesSkipsSingleFile --- PASS: TestRewritePositionDeleteFilesSkipsSingleFile (0.23s) === RUN TestRewritePositionDeleteFilesRespectsMinInputFiles --- PASS: TestRewritePositionDeleteFilesRespectsMinInputFiles (0.21s) === RUN TestRewritePositionDeleteFilesPreservesUnsupportedMultiTargetDeletes --- PASS: TestRewritePositionDeleteFilesPreservesUnsupportedMultiTargetDeletes (0.41s) === RUN TestRewritePositionDeleteFilesRebuildsMixedDeleteManifests --- PASS: TestRewritePositionDeleteFilesRebuildsMixedDeleteManifests (0.61s) === RUN TestResolveCompactionRewritePlanFallsBackForUnsupportedSortTransform --- PASS: TestResolveCompactionRewritePlanFallsBackForUnsupportedSortTransform (0.00s) === RUN TestRemoveOrphansKeepsPercentEscapedReferences --- PASS: TestRemoveOrphansKeepsPercentEscapedReferences (0.21s) === RUN TestLookupFileByIcebergPathDecodesEscapedReference --- PASS: TestLookupFileByIcebergPathDecodesEscapedReference (0.03s) === RUN TestExpireSnapshotsDeletesEscapedReferenceAtExistingKey exec_test.go:4664: expireSnapshots result: expired 1 snapshot(s), deleted 3 unreferenced file(s) --- PASS: TestExpireSnapshotsDeletesEscapedReferenceAtExistingKey (0.33s) === RUN TestExpireSnapshotsDeletesLiteralPercentKey exec_test.go:4739: expireSnapshots result: expired 1 snapshot(s), deleted 3 unreferenced file(s) --- PASS: TestExpireSnapshotsDeletesLiteralPercentKey (0.32s) === RUN TestExpireSnapshotsKeepsDoublyEscapedKeptReference --- PASS: TestExpireSnapshotsKeepsDoublyEscapedKeptReference (0.40s) === RUN TestExpireSnapshotsKeepsDecodedParentReference --- PASS: TestExpireSnapshotsKeepsDecodedParentReference (0.40s) === RUN TestLoadCurrentMetadataFollowsMetadataLocation --- PASS: TestLoadCurrentMetadataFollowsMetadataLocation (0.02s) === RUN TestLoadMetadataBoundsOnlyChunkedFiles --- PASS: TestLoadMetadataBoundsOnlyChunkedFiles (0.04s) === RUN TestSaveFilerFileKeepsSmallContentInline --- PASS: TestSaveFilerFileKeepsSmallContentInline (0.05s) === RUN TestSaveFilerFileChunksLargeContent --- PASS: TestSaveFilerFileChunksLargeContent (1.98s) === RUN TestSaveFilerFileFailsWhenUploadFails E1117 09:41:17.002530 upload_chunked.go:283 chunked upload failed: assign volume: rpc error: code = Unavailable desc = no volume server (returning 0 partial chunks for cleanup) --- PASS: TestSaveFilerFileFailsWhenUploadFails (0.15s) === RUN TestOrphanCleanupWouldDeleteAnAdapterRegisteredLanceDataset --- PASS: TestOrphanCleanupWouldDeleteAnAdapterRegisteredLanceDataset (0.02s) === RUN TestScanSkipsAnAdapterRegisteredLanceTable --- PASS: TestScanSkipsAnAdapterRegisteredLanceTable (0.08s) === RUN TestIsIcebergTableEntry === RUN TestIsIcebergTableEntry/plain_table === RUN TestIsIcebergTableEntry/iceberg_table_type_is_honoured_case-insensitively === RUN TestIsIcebergTableEntry/lance_table_registered_through_the_iceberg_adapter === RUN TestIsIcebergTableEntry/view === RUN TestIsIcebergTableEntry/explicit_table_marker --- PASS: TestIsIcebergTableEntry (0.01s) --- PASS: TestIsIcebergTableEntry/plain_table (0.00s) --- PASS: TestIsIcebergTableEntry/iceberg_table_type_is_honoured_case-insensitively (0.00s) --- PASS: TestIsIcebergTableEntry/lance_table_registered_through_the_iceberg_adapter (0.00s) --- PASS: TestIsIcebergTableEntry/view (0.00s) --- PASS: TestIsIcebergTableEntry/explicit_table_marker (0.00s) === RUN TestParseTableMetadataEnvelopeRejectsForeignFormats --- PASS: TestParseTableMetadataEnvelopeRejectsForeignFormats (0.00s) === RUN TestCompactRecordsGeometryBounds --- PASS: TestCompactRecordsGeometryBounds (0.70s) === RUN TestCompactSortedGeometryBoundCoversEveryRow --- PASS: TestCompactSortedGeometryBoundCoversEveryRow (0.62s) === RUN TestCompactAllNullGeometryGetsNoBound --- PASS: TestCompactAllNullGeometryGetsNoBound (0.38s) === RUN TestCompactUnparseableGeometryGivesNoBound --- PASS: TestCompactUnparseableGeometryGivesNoBound (0.42s) === RUN TestCollectColumnStatsGivesGeographyNoBound --- PASS: TestCollectColumnStatsGivesGeographyNoBound (0.02s) === RUN TestGeometryBoundsAggregation --- PASS: TestGeometryBoundsAggregation (0.00s) === RUN TestCompactWritesDefaultCRSGeometryWithoutCRS === RUN TestCompactWritesDefaultCRSGeometryWithoutCRS/binpack === RUN TestCompactWritesDefaultCRSGeometryWithoutCRS/sort --- PASS: TestCompactWritesDefaultCRSGeometryWithoutCRS (1.47s) --- PASS: TestCompactWritesDefaultCRSGeometryWithoutCRS/binpack (0.74s) --- PASS: TestCompactWritesDefaultCRSGeometryWithoutCRS/sort (0.71s) === RUN TestCompactKeepsExplicitGeometryCRS --- PASS: TestCompactKeepsExplicitGeometryCRS (0.72s) === RUN TestDefaultCRSUnsetForNestedGeometry --- PASS: TestDefaultCRSUnsetForNestedGeometry (0.02s) === RUN TestDefaultCRSUnsetWithoutFieldIDs === RUN TestDefaultCRSUnsetWithoutFieldIDs/top_level === RUN TestDefaultCRSUnsetWithoutFieldIDs/list === RUN TestDefaultCRSUnsetWithoutFieldIDs/list_of_structs === RUN TestDefaultCRSUnsetWithoutFieldIDs/map --- PASS: TestDefaultCRSUnsetWithoutFieldIDs (0.03s) --- PASS: TestDefaultCRSUnsetWithoutFieldIDs/top_level (0.00s) --- PASS: TestDefaultCRSUnsetWithoutFieldIDs/list (0.00s) --- PASS: TestDefaultCRSUnsetWithoutFieldIDs/list_of_structs (0.00s) --- PASS: TestDefaultCRSUnsetWithoutFieldIDs/map (0.01s) === RUN TestDefaultCRSUnsetReusesBuffer --- PASS: TestDefaultCRSUnsetReusesBuffer (0.03s) === RUN TestParseConfig --- PASS: TestParseConfig (0.00s) === RUN TestParseOperations --- PASS: TestParseOperations (0.00s) === RUN TestExtractMetadataVersion --- PASS: TestExtractMetadataVersion (0.00s) === RUN TestNeedsMaintenanceNoSnapshots --- PASS: TestNeedsMaintenanceNoSnapshots (0.00s) === RUN TestNeedsMaintenanceExceedsMaxSnapshots --- PASS: TestNeedsMaintenanceExceedsMaxSnapshots (0.01s) === RUN TestNeedsMaintenanceExceedsMaxSnapshotsWithinRetention --- PASS: TestNeedsMaintenanceExceedsMaxSnapshotsWithinRetention (0.00s) === RUN TestNeedsMaintenanceSkipsRefPinnedSnapshots --- PASS: TestNeedsMaintenanceSkipsRefPinnedSnapshots (0.00s) === RUN TestNeedsMaintenanceWithinLimits --- PASS: TestNeedsMaintenanceWithinLimits (0.00s) === RUN TestNeedsMaintenanceOldSnapshot --- PASS: TestNeedsMaintenanceOldSnapshot (0.00s) === RUN TestNeedsMaintenanceSingleSnapshot --- PASS: TestNeedsMaintenanceSingleSnapshot (0.00s) === RUN TestCapabilityAndDescriptor --- PASS: TestCapabilityAndDescriptor (0.01s) === RUN TestBuildMaintenanceProposal --- PASS: TestBuildMaintenanceProposal (0.00s) === RUN TestReadResourceGroupConfig --- PASS: TestReadResourceGroupConfig (0.01s) === RUN TestSelectTablesByResourceGroupRoundRobin --- PASS: TestSelectTablesByResourceGroupRoundRobin (0.00s) === RUN TestSelectTablesByResourceGroupCap --- PASS: TestSelectTablesByResourceGroupCap (0.00s) === RUN TestManifestRewritePathConsistency --- PASS: TestManifestRewritePathConsistency (0.05s) === RUN TestManifestRewriteNestedPathConsistency === RUN TestManifestRewriteNestedPathConsistency/nested_two_levels === RUN TestManifestRewriteNestedPathConsistency/nested_one_level --- PASS: TestManifestRewriteNestedPathConsistency (0.09s) --- PASS: TestManifestRewriteNestedPathConsistency/nested_two_levels (0.05s) --- PASS: TestManifestRewriteNestedPathConsistency/nested_one_level (0.05s) === RUN TestNormalizeIcebergPath === RUN TestNormalizeIcebergPath/relative_metadata_path === RUN TestNormalizeIcebergPath/relative_data_path === RUN TestNormalizeIcebergPath/S3_URL === RUN TestNormalizeIcebergPath/absolute_filer_path === RUN TestNormalizeIcebergPath/nested_data_path === RUN TestNormalizeIcebergPath/S3_URL_nested === RUN TestNormalizeIcebergPath/S3_URL_outside_the_catalog_path === RUN TestNormalizeIcebergPath/S3_URL_wins_over_a_stale_data_path === RUN TestNormalizeIcebergPath/other_bucket === RUN TestNormalizeIcebergPath/traversal_out_of_the_bucket --- PASS: TestNormalizeIcebergPath (0.01s) --- PASS: TestNormalizeIcebergPath/relative_metadata_path (0.00s) --- PASS: TestNormalizeIcebergPath/relative_data_path (0.00s) --- PASS: TestNormalizeIcebergPath/S3_URL (0.00s) --- PASS: TestNormalizeIcebergPath/absolute_filer_path (0.00s) --- PASS: TestNormalizeIcebergPath/nested_data_path (0.00s) --- PASS: TestNormalizeIcebergPath/S3_URL_nested (0.00s) --- PASS: TestNormalizeIcebergPath/S3_URL_outside_the_catalog_path (0.00s) --- PASS: TestNormalizeIcebergPath/S3_URL_wins_over_a_stale_data_path (0.00s) --- PASS: TestNormalizeIcebergPath/other_bucket (0.00s) --- PASS: TestNormalizeIcebergPath/traversal_out_of_the_bucket (0.00s) === RUN TestTableDataPath === RUN TestTableDataPath/catalog_path === RUN TestTableDataPath/location_outside_the_catalog_path === RUN TestTableDataPath/relative_location === RUN TestTableDataPath/missing_location === RUN TestTableDataPath/location_in_another_bucket --- PASS: TestTableDataPath (0.00s) --- PASS: TestTableDataPath/catalog_path (0.00s) --- PASS: TestTableDataPath/location_outside_the_catalog_path (0.00s) --- PASS: TestTableDataPath/relative_location (0.00s) --- PASS: TestTableDataPath/missing_location (0.00s) --- PASS: TestTableDataPath/location_in_another_bucket (0.00s) === RUN TestPartitionKey === RUN TestPartitionKey/empty_partition === RUN TestPartitionKey/nil_partition === RUN TestPartitionKey/single_field === RUN TestPartitionKey/multiple_fields_sorted --- PASS: TestPartitionKey (0.00s) --- PASS: TestPartitionKey/empty_partition (0.00s) --- PASS: TestPartitionKey/nil_partition (0.00s) --- PASS: TestPartitionKey/single_field (0.00s) --- PASS: TestPartitionKey/multiple_fields_sorted (0.00s) === RUN TestBuildCompactionBins --- PASS: TestBuildCompactionBins (0.00s) === RUN TestBuildCompactionBinsFiltersLargeFiles --- PASS: TestBuildCompactionBinsFiltersLargeFiles (0.00s) === RUN TestBuildCompactionBinsLowercaseParquetFormat --- PASS: TestBuildCompactionBinsLowercaseParquetFormat (0.00s) === RUN TestBuildCompactionBinsMinFilesThreshold --- PASS: TestBuildCompactionBinsMinFilesThreshold (0.00s) === RUN TestBuildCompactionBinsMultiplePartitions --- PASS: TestBuildCompactionBinsMultiplePartitions (0.00s) === RUN TestSplitOversizedBinRespectsTargetSize --- PASS: TestSplitOversizedBinRespectsTargetSize (0.00s) === RUN TestSplitOversizedBinDropsImpossibleRunts --- PASS: TestSplitOversizedBinDropsImpossibleRunts (0.00s) === RUN TestBuildCompactionBinsMultipleSpecs --- PASS: TestBuildCompactionBinsMultipleSpecs (0.00s) === RUN TestBuildCompactionBinsSingleSpec --- PASS: TestBuildCompactionBinsSingleSpec (0.00s) === RUN TestParseConfigApplyDeletes --- PASS: TestParseConfigApplyDeletes (0.00s) === RUN TestNormalizeDetectionConfigUsesSharedDefaults --- PASS: TestNormalizeDetectionConfigUsesSharedDefaults (0.00s) === RUN TestParseConfigRewriteStrategy --- PASS: TestParseConfigRewriteStrategy (0.00s) === RUN TestCollectPositionDeletes --- PASS: TestCollectPositionDeletes (0.03s) === RUN TestCollectEqualityDeletes --- PASS: TestCollectEqualityDeletes (0.02s) === RUN TestMergeParquetFilesWithPositionDeletes --- PASS: TestMergeParquetFilesWithPositionDeletes (0.04s) === RUN TestMergeParquetFilesWithEqualityDeletes --- PASS: TestMergeParquetFilesWithEqualityDeletes (0.04s) === RUN TestMergeParquetFilesDictionaryEncodedInput --- PASS: TestMergeParquetFilesDictionaryEncodedInput (0.08s) === RUN TestDetectNilRequest --- PASS: TestDetectNilRequest (0.00s) === RUN TestExecuteNilRequest --- PASS: TestExecuteNilRequest (0.00s) === RUN TestRewriteManifestsNormalizesForeignDayPartitions === RUN TestRewriteManifestsNormalizesForeignDayPartitions/value-first_partition_union === RUN TestRewriteManifestsNormalizesForeignDayPartitions/null-first_partition_union --- PASS: TestRewriteManifestsNormalizesForeignDayPartitions (1.14s) --- PASS: TestRewriteManifestsNormalizesForeignDayPartitions/value-first_partition_union (0.53s) --- PASS: TestRewriteManifestsNormalizesForeignDayPartitions/null-first_partition_union (0.61s) === RUN TestGuardReadTurnsAPanicIntoAnError E1117 09:41:23.153987 read_guard.go:19 iceberg maintenance: recovered panic in data/x.parquet: runtime error: index out of range [3] with length 0 goroutine 3991 [running]: runtime/debug.Stack() /usr/lib/go/src/runtime/debug/stack.go:26 +0x56 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.recoverRead(0x2979b2b83e90, {0x16eb853, 0xe}) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/read_guard.go:19 +0x40 panic({0x3ad5a48?, 0x2979bae102a0?}) /usr/lib/go/src/runtime/panic.go:859 +0xf6 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.TestGuardReadTurnsAPanicIntoAnError.func1() /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/read_guard_test.go:12 +0x1c github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.guardRead[...]({0x16eb853?, 0x862ae?}, 0x2979b32bd8a0?) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/read_guard.go:27 +0x5a github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.TestGuardReadTurnsAPanicIntoAnError(0x2979b3c28908) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/read_guard_test.go:10 +0x40 testing.tRunner(0x2979b3c28908, 0x3c02328) /usr/lib/go/src/testing/testing.go:2195 +0xba created by testing.(*T).Run in goroutine 1 /usr/lib/go/src/testing/testing.go:2260 +0x36c --- PASS: TestGuardReadTurnsAPanicIntoAnError (0.01s) === RUN TestRemoteOnlyFileIsCachedThenReadThroughItsChunks --- PASS: TestRemoteOnlyFileIsCachedThenReadThroughItsChunks (0.10s) === RUN TestRemoteOnlyFileSchemaIsReadThroughItsChunks --- PASS: TestRemoteOnlyFileSchemaIsReadThroughItsChunks (0.03s) === RUN TestACachedFileIsNotCachedAgain --- PASS: TestACachedFileIsNotCachedAgain (0.06s) === RUN TestAFileStillRemoteOnlyAfterCachingIsACacheError --- PASS: TestAFileStillRemoteOnlyAfterCachingIsACacheError (0.02s) === RUN TestAFailedCacheCallIsRetriedOnce --- PASS: TestAFailedCacheCallIsRetriedOnce (0.05s) === RUN TestARemoteOnlyMetadataFileOverTheBoundIsNotCached --- PASS: TestARemoteOnlyMetadataFileOverTheBoundIsNotCached (0.01s) === RUN TestAMetadataFileThatGrewPastTheBoundIsNotDownloaded --- PASS: TestAMetadataFileThatGrewPastTheBoundIsNotDownloaded (0.02s) === RUN TestAReplacedMetadataFileOverTheBoundIsNotRead --- PASS: TestAReplacedMetadataFileOverTheBoundIsNotRead (0.01s) === RUN TestAFileWithNoContentOrChunksIsAnEmptyFileError --- PASS: TestAFileWithNoContentOrChunksIsAnEmptyFileError (0.01s) === RUN TestMergedFileFirstRowIDOnlyWithoutNullIDs === RUN TestMergedFileFirstRowIDOnlyWithoutNullIDs/every_row_materialized === RUN TestMergedFileFirstRowIDOnlyWithoutNullIDs/materialized_first,_a_null_later === RUN TestMergedFileFirstRowIDOnlyWithoutNullIDs/null_first === RUN TestMergedFileFirstRowIDOnlyWithoutNullIDs/all_null --- PASS: TestMergedFileFirstRowIDOnlyWithoutNullIDs (0.02s) --- PASS: TestMergedFileFirstRowIDOnlyWithoutNullIDs/every_row_materialized (0.01s) --- PASS: TestMergedFileFirstRowIDOnlyWithoutNullIDs/materialized_first,_a_null_later (0.00s) --- PASS: TestMergedFileFirstRowIDOnlyWithoutNullIDs/null_first (0.00s) --- PASS: TestMergedFileFirstRowIDOnlyWithoutNullIDs/all_null (0.00s) === RUN TestMergeParquetFilesRowLineage --- PASS: TestMergeParquetFilesRowLineage (0.05s) === RUN TestMergeParquetFilesRowLineagePositionDelete --- PASS: TestMergeParquetFilesRowLineagePositionDelete (0.03s) === RUN TestMergeParquetFilesRowLineageMaterialized --- PASS: TestMergeParquetFilesRowLineageMaterialized (0.05s) === RUN TestWriteManifestListV3RowIDs --- PASS: TestWriteManifestListV3RowIDs (0.09s) === RUN TestCheckRowLineagePlan --- PASS: TestCheckRowLineagePlan (0.00s) === RUN TestLineageLayoutRejectsReservedNameUnderOtherID --- PASS: TestLineageLayoutRejectsReservedNameUnderOtherID (0.00s) === RUN TestCompactDataFilesV3RowLineageManifestRead --- PASS: TestCompactDataFilesV3RowLineageManifestRead (0.28s) === RUN TestCompactCompressesLineageColumns --- PASS: TestCompactCompressesLineageColumns (0.71s) === RUN TestLineageCodecFollowsDataColumns --- PASS: TestLineageCodecFollowsDataColumns (0.00s) === RUN TestDetectSkipsSharedLocation --- PASS: TestDetectSkipsSharedLocation (0.23s) === RUN TestFilesSharedIgnoresAnEntryOverTheRoot --- PASS: TestFilesSharedIgnoresAnEntryOverTheRoot (0.00s) === RUN TestRemoveOrphansSkipsSharedLocation --- PASS: TestRemoveOrphansSkipsSharedLocation (0.09s) === RUN TestCompactDataFilesSortSpillsRunsAndCleansUp --- PASS: TestCompactDataFilesSortSpillsRunsAndCleansUp (0.60s) === RUN TestCompactDataFilesSortSpillDirDecidesOutcome === RUN TestCompactDataFilesSortSpillDirDecidesOutcome/usable === RUN TestCompactDataFilesSortSpillDirDecidesOutcome/unusable W1117 09:41:26.215227 compact.go:302 iceberg compact: failed to merge bin 0 (2 files): close sorting writer: open /tmp/TestCompactDataFilesSortSpillDirDecidesOutcomeunusable3295785429/001/not-created/seaweedfs-iceberg-sort-114553229: no such file or directory --- PASS: TestCompactDataFilesSortSpillDirDecidesOutcome (0.58s) --- PASS: TestCompactDataFilesSortSpillDirDecidesOutcome/usable (0.34s) --- PASS: TestCompactDataFilesSortSpillDirDecidesOutcome/unusable (0.24s) === RUN TestOrphanCleanupKeepsStatisticsFiles --- PASS: TestOrphanCleanupKeepsStatisticsFiles (0.03s) === RUN TestResolveTableConfigNoProperties --- PASS: TestResolveTableConfigNoProperties (0.00s) === RUN TestResolveTableConfigPropertiesWin --- PASS: TestResolveTableConfigPropertiesWin (0.00s) === RUN TestResolveTableConfigSubHourRetention --- PASS: TestResolveTableConfigSubHourRetention (0.00s) === RUN TestResolveTableConfigIgnoresUnusableValues === RUN TestResolveTableConfigIgnoresUnusableValues/not_a_number === RUN TestResolveTableConfigIgnoresUnusableValues/empty === RUN TestResolveTableConfigIgnoresUnusableValues/zero === RUN TestResolveTableConfigIgnoresUnusableValues/negative === RUN TestResolveTableConfigIgnoresUnusableValues/overflow --- PASS: TestResolveTableConfigIgnoresUnusableValues (0.00s) --- PASS: TestResolveTableConfigIgnoresUnusableValues/not_a_number (0.00s) --- PASS: TestResolveTableConfigIgnoresUnusableValues/empty (0.00s) --- PASS: TestResolveTableConfigIgnoresUnusableValues/zero (0.00s) --- PASS: TestResolveTableConfigIgnoresUnusableValues/negative (0.00s) --- PASS: TestResolveTableConfigIgnoresUnusableValues/overflow (0.00s) === RUN TestResolveTableConfigTrimsWhitespace --- PASS: TestResolveTableConfigTrimsWhitespace (0.00s) === RUN TestResolveTableConfigLeavesOtherFields --- PASS: TestResolveTableConfigLeavesOtherFields (0.00s) === RUN TestApplyThresholdDefaultsClampsOrphanCutoff --- PASS: TestApplyThresholdDefaultsClampsOrphanCutoff (0.00s) === RUN TestResolveTableConfigAppliesMaintenanceConfig --- PASS: TestResolveTableConfigAppliesMaintenanceConfig (0.00s) === RUN TestResolveTableConfigPropertyBeatsMaintenanceConfig --- PASS: TestResolveTableConfigPropertyBeatsMaintenanceConfig (0.00s) === RUN TestResolveTableConfigIgnoresDisabledSettings --- PASS: TestResolveTableConfigIgnoresDisabledSettings (0.00s) === RUN TestFilterDisabledOperations --- PASS: TestFilterDisabledOperations (0.00s) === RUN TestMergeMaintenanceConfigurationTableWins --- PASS: TestMergeMaintenanceConfigurationTableWins (0.00s) === RUN TestParseMaintenanceConfiguration --- PASS: TestParseMaintenanceConfiguration (0.01s) === RUN TestResolveTableConfigClampsUnreferencedDays --- PASS: TestResolveTableConfigClampsUnreferencedDays (0.00s) === RUN TestResolveTableConfigAddsNonCurrentWindow --- PASS: TestResolveTableConfigAddsNonCurrentWindow (0.00s) === RUN TestBuildJobStatus --- PASS: TestBuildJobStatus (0.00s) === RUN TestBuildJobStatusFailureWins --- PASS: TestBuildJobStatusFailureWins (0.00s) === RUN TestBuildJobStatusEmpty --- PASS: TestBuildJobStatusEmpty (0.00s) === RUN TestResolveTableConfigAppliesCompactionStrategy --- PASS: TestResolveTableConfigAppliesCompactionStrategy (0.00s) === RUN TestResolveCompactionRewritePlanAuto --- PASS: TestResolveCompactionRewritePlanAuto (0.00s) === RUN TestUnopenableParquetFileIsAnErrorNotAPanic === RUN TestUnopenableParquetFileIsAnErrorNotAPanic/wrong_magic === RUN TestUnopenableParquetFileIsAnErrorNotAPanic/truncated_footer === RUN TestUnopenableParquetFileIsAnErrorNotAPanic/not_parquet === RUN TestUnopenableParquetFileIsAnErrorNotAPanic/empty --- PASS: TestUnopenableParquetFileIsAnErrorNotAPanic (0.07s) --- PASS: TestUnopenableParquetFileIsAnErrorNotAPanic/wrong_magic (0.02s) --- PASS: TestUnopenableParquetFileIsAnErrorNotAPanic/truncated_footer (0.02s) --- PASS: TestUnopenableParquetFileIsAnErrorNotAPanic/not_parquet (0.02s) --- PASS: TestUnopenableParquetFileIsAnErrorNotAPanic/empty (0.02s) === RUN TestCorruptPageIsAnErrorNamingTheFileNotAPanic E1117 09:41:26.414918 read_guard.go:19 iceberg maintenance: recovered panic in data/corrupt-deletes.parquet: runtime error: index out of range [8] with length 8 goroutine 4634 [running]: runtime/debug.Stack() /usr/lib/go/src/runtime/debug/stack.go:26 +0x56 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.recoverRead(0x2979b3585d70, {0x171154c, 0x1c}) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/read_guard.go:19 +0x40 panic({0x3ad5a48?, 0x2979b377c1f8?}) /usr/lib/go/src/runtime/panic.go:859 +0xf6 github.com/parquet-go/parquet-go.(*byteArrayPage).index(...) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/page_byte_array.go:67 github.com/parquet-go/parquet-go.(*byteArrayDictionary).lookupString(0xfb5750?, {0x2979b36f3a90?, 0x4ecb8?, 0x3d897b8?}, {{0x2979b3364008?, 0x32e44?, 0x2979b3585a60?}}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary_purego.go:43 +0xf2 github.com/parquet-go/parquet-go.(*byteArrayDictionary).Lookup(0x2979b304ef00, {0x2979b36f3a90, 0xaa, 0x15c}, {0x2979b3364008, 0xaa, 0x2000?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary_byte_array.go:97 +0xd6 github.com/parquet-go/parquet-go.(*indexedPageValues).ReadValues(0x2979b360b140, {0x2979b3364008?, 0xaa?, 0x0?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary.go:237 +0x90 github.com/parquet-go/parquet-go.(*optionalPageValues).ReadValues(0x2979b3874ea0, {0x2979b3364008, 0xaa, 0xaa}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/page_optional.go:95 +0x15c github.com/parquet-go/parquet-go.(*columnChunkValueReader).ReadValues(0x2979b304ee88, {0x2979b3364008, 0xaa, 0xaa}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/column_chunk.go:138 +0xd8 github.com/parquet-go/parquet-go.(*rowGroupRows).ReadRows(0x2979b3821540, {0x2979b36f9988, 0x100, 0x393cd00?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/row_group.go:315 +0x15e github.com/parquet-go/parquet-go.(*reader).ReadRows(0x2979b3318a10, {0x2979b36f9988?, 0x800?, 0x81?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/reader.go:536 +0x90 github.com/parquet-go/parquet-go.(*Reader).ReadRows(0x2979b3318a00, {0x2979b36f9988, 0x100, 0x100}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/reader.go:452 +0x5c github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.readPositionDeleteFile({0x3bcc9b0, 0x3d8fd20}, {0x3c00980?, 0x2979b9b8c940?}, {0x1821a68?, 0x17?}, {0x16db5d8?, 0x2979b3c28b48?}, {0x171154c, 0x1c}) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/compact.go:890 +0x2ae github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.TestCorruptPageIsAnErrorNamingTheFileNotAPanic.func2() /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:129 +0x58 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.noPanic(0x2979b3c28b48, 0x2979b3585f48) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:46 +0x54 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.TestCorruptPageIsAnErrorNamingTheFileNotAPanic(0x2979b3c28b48) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:128 +0xb6 testing.tRunner(0x2979b3c28b48, 0x3c021b8) /usr/lib/go/src/testing/testing.go:2195 +0xba created by testing.(*T).Run in goroutine 1 /usr/lib/go/src/testing/testing.go:2260 +0x36c --- PASS: TestCorruptPageIsAnErrorNamingTheFileNotAPanic (0.05s) === RUN TestCompactionWithACorruptDeleteFileFailsWithoutCommitting E1117 09:41:26.656666 read_guard.go:19 iceberg maintenance: recovered panic in data/pd1.parquet: runtime error: index out of range [8] with length 8 goroutine 4573 [running]: runtime/debug.Stack() /usr/lib/go/src/runtime/debug/stack.go:26 +0x56 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.recoverRead(0x2979b3be8568, {0x2979b431c000, 0x10}) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/read_guard.go:19 +0x40 panic({0x3ad5a48?, 0x2979b419cf48?}) /usr/lib/go/src/runtime/panic.go:859 +0xf6 github.com/parquet-go/parquet-go.(*byteArrayPage).index(...) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/page_byte_array.go:67 github.com/parquet-go/parquet-go.(*byteArrayDictionary).lookupString(0xfb5750?, {0x2979b3121a90?, 0x4ecb8?, 0x3d897e0?}, {{0x2979b37f8008?, 0x3d8c360?, 0x7f00800001?}}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary_purego.go:43 +0xf2 github.com/parquet-go/parquet-go.(*byteArrayDictionary).Lookup(0x2979b304e300, {0x2979b3121a90, 0xaa, 0x15c}, {0x2979b37f8008, 0xaa, 0x2000?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary_byte_array.go:97 +0xd6 github.com/parquet-go/parquet-go.(*indexedPageValues).ReadValues(0x2979b3461e00, {0x2979b37f8008?, 0xaa?, 0x0?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary.go:237 +0x90 github.com/parquet-go/parquet-go.(*optionalPageValues).ReadValues(0x2979b3874560, {0x2979b37f8008, 0xaa, 0xaa}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/page_optional.go:95 +0x15c github.com/parquet-go/parquet-go.(*columnChunkValueReader).ReadValues(0x2979b304e288, {0x2979b37f8008, 0xaa, 0xaa}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/column_chunk.go:138 +0xd8 github.com/parquet-go/parquet-go.(*rowGroupRows).ReadRows(0x2979b356c500, {0x2979b36fb308, 0x100, 0x393cd00?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/row_group.go:315 +0x15e github.com/parquet-go/parquet-go.(*reader).ReadRows(0x2979b3318470, {0x2979b36fb308?, 0x800?, 0x81?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/reader.go:536 +0x90 github.com/parquet-go/parquet-go.(*Reader).ReadRows(0x2979b3318460, {0x2979b36fb308, 0x100, 0x100}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/reader.go:452 +0x5c github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.readPositionDeleteFile({0x3bcc9b0, 0x3d8fd20}, {0x3c00980?, 0x2979b3d8e810?}, {0x16da9d8?, 0x2979b3be8600?}, {0x2979b2c8c688?, 0x2979b3be85b8?}, {0x2979b431c000, 0x10}) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/compact.go:890 +0x2ae github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.collectPositionDeletes({0x3bcc9b0, 0x3d8fd20}, {0x3c00980, 0x2979b3d8e810}, {0x16da9d8, 0x2}, {0x2979b2c8c688, 0x6}, {0x2979b3be9088, 0x1, ...}) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/compact.go:826 +0x144 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.(*Handler).compactDataFiles(0x2979b3be9e10, {0x3bcc9b0, 0x3d8fd20}, {0x3c00980, 0x2979b3d8e810}, {0x16da9d8, _}, {_, _}, {0x0, ...}, ...) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/compact.go:159 +0x4ab0 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.TestCompactionWithACorruptDeleteFileFailsWithoutCommitting.func1() /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:183 +0x1e8 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.noPanic(0x2979b3cf0fc8, 0x2979b3be9eb8) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:46 +0x54 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.TestCompactionWithACorruptDeleteFileFailsWithoutCommitting(0x2979b3cf0fc8) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:182 +0x78a testing.tRunner(0x2979b3cf0fc8, 0x3c021a0) /usr/lib/go/src/testing/testing.go:2195 +0xba created by testing.(*T).Run in goroutine 1 /usr/lib/go/src/testing/testing.go:2260 +0x36c --- PASS: TestCompactionWithACorruptDeleteFileFailsWithoutCommitting (0.25s) === RUN TestAnUnreadableDataFileSkipsItsBinAndTheOtherBinsCompact W1117 09:41:26.958107 compact.go:302 iceberg compact: failed to merge bin 0 (2 files): schema of data/eu-2.parquet: open parquet file data/eu-2.parquet: invalid magic header of parquet file: "XXXX" --- PASS: TestAnUnreadableDataFileSkipsItsBinAndTheOtherBinsCompact (0.45s) === RUN TestMergeFailsOnACorruptPageNamingTheFile E1117 09:41:27.160400 read_guard.go:19 iceberg maintenance: recovered panic in data/corrupt.parquet: runtime error: index out of range [8] with length 8 goroutine 4685 [running]: runtime/debug.Stack() /usr/lib/go/src/runtime/debug/stack.go:26 +0x56 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.recoverRead(0x2979b3847a98, {0x16fa007, 0x14}) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/read_guard.go:19 +0x40 panic({0x3ad5a48?, 0x2979b3366678?}) /usr/lib/go/src/runtime/panic.go:859 +0xf6 github.com/parquet-go/parquet-go.(*byteArrayPage).index(...) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/page_byte_array.go:67 github.com/parquet-go/parquet-go.(*byteArrayDictionary).lookupString(0xfb5750?, {0x2979b3d75a90?, 0x2?, 0x2?}, {{0x2979b3d68008?, 0x1?, 0x1?}}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary_purego.go:43 +0xf2 github.com/parquet-go/parquet-go.(*byteArrayDictionary).Lookup(0x2979b3577100, {0x2979b3d75a90, 0xaa, 0x15c}, {0x2979b3d68008, 0xaa, 0x2979b2fef5d8?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary_byte_array.go:97 +0xd6 github.com/parquet-go/parquet-go.(*indexedPageValues).ReadValues(0x2979b3515c60, {0x2979b3d68008?, 0xaa?, 0x2979b3a38870?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/dictionary.go:237 +0x90 github.com/parquet-go/parquet-go.(*optionalPageValues).ReadValues(0x2979b3705980, {0x2979b3d68008, 0xaa, 0xaa}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/page_optional.go:95 +0x15c github.com/parquet-go/parquet-go.(*columnChunkValueReader).ReadValues(0x2979b3577088, {0x2979b3d68008, 0xaa, 0xaa}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/column_chunk.go:138 +0xd8 github.com/parquet-go/parquet-go.(*rowGroupRows).ReadRows(0x2979b34c7540, {0x2979b3d31988, 0x100, 0x393cd00?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/row_group.go:315 +0x15e github.com/parquet-go/parquet-go.(*reader).ReadRows(0x2979ba1faf10, {0x2979b3d31988?, 0x100?, 0x100?}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/reader.go:536 +0x90 github.com/parquet-go/parquet-go.(*Reader).ReadRows(0x2979ba1faf00, {0x2979b3d31988, 0x100, 0x100}) /build/seaweedfs/src/pkg/mod/github.com/parquet-go/parquet-go@v0.32.0/reader.go:452 +0x5c github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.visitFilteredParquetRows({0x3bcc9b0, 0x3d8fd20}, 0x2979ba1faf00, {0x16fa007, 0x14}, {0x16e5d18, 0xb}, {0x16dd72f, 0x6}, 0x0, ...) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/compact.go:1455 +0x17c github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.copyFileRows({0x3bcc9b0, 0x3d8fd20}, 0x2979ba1faf00, {0x3bd81d8, 0x2979b3139530}, 0x802e8?, {0x16e5d18, 0xb}, {0x16dd72f, 0x6}, ...) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/row_lineage.go:368 +0x10e github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.mergeParquetFilesInto.func2(0x2979ba1faf00, {0x3bd81d8, 0x2979b3139530}) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/compact.go:1329 +0x14a github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.mergeParquetFilesInto({0x3bcc9b0, 0x3d8fd20}, {0x3c00980, 0x2979b3d8fc50}, {0x16e5d18, 0xb}, {0x16dd72f, 0x6}, {0x2979b3847e78, 0x1, ...}, ...) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/compact.go:1343 +0x3ac github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.TestMergeFailsOnACorruptPageNamingTheFile.func1() /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:264 +0x98 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.noPanic(0x2979b3a90008, 0x2979b3847f50) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:46 +0x54 github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg.TestMergeFailsOnACorruptPageNamingTheFile(0x2979b3a90008) /build/seaweedfs/src/seaweedfs-4.54/weed/worker/tasks/iceberg/unreadable_file_test.go:263 +0xb0 testing.tRunner(0x2979b3a90008, 0x3c02380) /usr/lib/go/src/testing/testing.go:2195 +0xba created by testing.(*T).Run in goroutine 1 /usr/lib/go/src/testing/testing.go:2260 +0x36c --- PASS: TestMergeFailsOnACorruptPageNamingTheFile (0.06s) === RUN TestValidateWhereOperations --- PASS: TestValidateWhereOperations (0.00s) === RUN TestSplitWhereConjunctionQuoteAware --- PASS: TestSplitWhereConjunctionQuoteAware (0.00s) === RUN TestPartitionPredicateMatchesUsesPartitionFieldIDs --- PASS: TestPartitionPredicateMatchesUsesPartitionFieldIDs (0.00s) === RUN TestCompactDataFilesWhereFilter --- PASS: TestCompactDataFilesWhereFilter (0.49s) PASS ok github.com/seaweedfs/seaweedfs/weed/worker/tasks/iceberg 49.450s === RUN TestBuildLimiterFromClusterContext_NilCC --- PASS: TestBuildLimiterFromClusterContext_NilCC (0.00s) === RUN TestBuildLimiterFromClusterContext_NoMetadata --- PASS: TestBuildLimiterFromClusterContext_NoMetadata (0.00s) === RUN TestBuildLimiterFromClusterContext_MissingRateKey --- PASS: TestBuildLimiterFromClusterContext_MissingRateKey (0.00s) === RUN TestBuildLimiterFromClusterContext_NonPositiveRate --- PASS: TestBuildLimiterFromClusterContext_NonPositiveRate (0.00s) === RUN TestBuildLimiterFromClusterContext_PositiveRateBuildsLimiter --- PASS: TestBuildLimiterFromClusterContext_PositiveRateBuildsLimiter (0.00s) === RUN TestBuildLimiterFromClusterContext_BurstMissingDefaultsTo2xRate --- PASS: TestBuildLimiterFromClusterContext_BurstMissingDefaultsTo2xRate (0.00s) === RUN TestBuildLimiterFromClusterContext_TinyRateClampsBurstToOne --- PASS: TestBuildLimiterFromClusterContext_TinyRateClampsBurstToOne (0.00s) === RUN TestParseConfigDefaults --- PASS: TestParseConfigDefaults (0.00s) === RUN TestParseConfigIgnoresWorkerValues --- PASS: TestParseConfigIgnoresWorkerValues (0.00s) === RUN TestParseConfigMetaLogRetentionDefaultsToZero --- PASS: TestParseConfigMetaLogRetentionDefaultsToZero (0.00s) === RUN TestParseConfigMetaLogRetentionDaysConvertsToDuration --- PASS: TestParseConfigMetaLogRetentionDaysConvertsToDuration (0.00s) === RUN TestParseConfigMetaLogRetentionNegativeStaysZero --- PASS: TestParseConfigMetaLogRetentionNegativeStaysZero (0.00s) === RUN TestParseConfigWalkerIntervalDefaultsToZero --- PASS: TestParseConfigWalkerIntervalDefaultsToZero (0.00s) === RUN TestParseConfigWalkerIntervalMinutesConvertsToDuration --- PASS: TestParseConfigWalkerIntervalMinutesConvertsToDuration (0.00s) === RUN TestParseConfigWalkerIntervalNegativeStaysZero --- PASS: TestParseConfigWalkerIntervalNegativeStaysZero (0.00s) === RUN TestParseConfig_DeleteTimeout --- PASS: TestParseConfig_DeleteTimeout (0.00s) === RUN TestSelectS3Front_FirstFrontDownUsesNext --- PASS: TestSelectS3Front_FirstFrontDownUsesNext (0.45s) === RUN TestFailoverClient_FrontLostMidPassResendsSameRequest W1117 09:40:41.807699 failover.go:120 s3 lifecycle: switched to s3 127.0.0.1:37263, s3 127.0.0.1:36353: Unavailable --- PASS: TestFailoverClient_FrontLostMidPassResendsSameRequest (0.34s) === RUN TestFailoverClient_ConcurrentCallersSwitchOnce W1117 09:40:42.149213 failover.go:120 s3 lifecycle: switched to s3 127.0.0.1:41981, s3 127.0.0.1:40729: Unavailable --- PASS: TestFailoverClient_ConcurrentCallersSwitchOnce (0.28s) === RUN TestFailoverClient_NoFrontLeftFailsFast W1117 09:40:42.268947 failover.go:111 s3 lifecycle: no s3 server is ready for lifecycle deletes: s3 127.0.0.1:44949: Unavailable s3 127.0.0.1:45639 readiness check: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:45639: connect: connection refused" s3 127.0.0.1:40275 rejected lifecycle credentials: rpc error: code = Unauthenticated desc = invalid admin token; this worker's jwt.filer_signing.key is set, and it must match the key in the s3 server's security.toml (an s3 server without the key accepts only local callers) --- PASS: TestFailoverClient_NoFrontLeftFailsFast (0.08s) === RUN TestFailoverClient_ParentCancelDoesNotSwitch --- PASS: TestFailoverClient_ParentCancelDoesNotSwitch (0.15s) === RUN TestFailoverClient_SecondFrontLostMovesToThird W1117 09:40:42.478138 failover.go:120 s3 lifecycle: switched to s3 127.0.0.1:33981, s3 127.0.0.1:42355: Unavailable W1117 09:40:42.515492 failover.go:120 s3 lifecycle: switched to s3 127.0.0.1:46329, s3 127.0.0.1:33981: Unavailable --- PASS: TestFailoverClient_SecondFrontLostMovesToThird (0.11s) === RUN TestFailoverClient_SkipsFrontSkippedAtStartup W1117 09:40:42.815603 failover.go:120 s3 lifecycle: switched to s3 127.0.0.1:33371, s3 127.0.0.1:38829: Unavailable --- PASS: TestFailoverClient_SkipsFrontSkippedAtStartup (0.30s) === RUN TestClusterS3Endpoints_NilContext --- PASS: TestClusterS3Endpoints_NilContext (0.00s) === RUN TestClusterS3Endpoints_EmptyList --- PASS: TestClusterS3Endpoints_EmptyList (0.00s) === RUN TestClusterS3Endpoints_FiltersEmptyEntries --- PASS: TestClusterS3Endpoints_FiltersEmptyEntries (0.00s) === RUN TestClusterS3Endpoints_AllValid --- PASS: TestClusterS3Endpoints_AllValid (0.00s) === RUN TestReadString_MissingKeyReturnsFallback --- PASS: TestReadString_MissingKeyReturnsFallback (0.00s) === RUN TestReadString_NilValueReturnsFallback --- PASS: TestReadString_NilValueReturnsFallback (0.00s) === RUN TestReadString_WrongKindReturnsFallback --- PASS: TestReadString_WrongKindReturnsFallback (0.00s) === RUN TestReadString_StringValueReturned --- PASS: TestReadString_StringValueReturned (0.00s) === RUN TestCapability_AdvertisesJobType --- PASS: TestCapability_AdvertisesJobType (0.00s) === RUN TestDetect_NilRequestErrors --- PASS: TestDetect_NilRequestErrors (0.00s) === RUN TestDetect_NilSenderErrors --- PASS: TestDetect_NilSenderErrors (0.00s) === RUN TestDetect_WrongJobTypeErrors --- PASS: TestDetect_WrongJobTypeErrors (0.00s) === RUN TestDetect_NoS3EndpointsCompletesWithSkipActivity --- PASS: TestDetect_NoS3EndpointsCompletesWithSkipActivity (0.00s) === RUN TestDetect_NoFilerAddressesCompletesWithSkipActivity --- PASS: TestDetect_NoFilerAddressesCompletesWithSkipActivity (0.00s) === RUN TestDetect_HappyPathProposesOneJobWithFirstFilerAddress --- PASS: TestDetect_HappyPathProposesOneJobWithFirstFilerAddress (0.00s) === RUN TestDetect_EmptyJobTypeAccepted --- PASS: TestDetect_EmptyJobTypeAccepted (0.00s) === RUN TestDetect_PropagatesProposalsSendError --- PASS: TestDetect_PropagatesProposalsSendError (0.00s) === RUN TestDetect_PropagatesCompleteSendError --- PASS: TestDetect_PropagatesCompleteSendError (0.00s) === RUN TestDescriptor_BasicShape --- PASS: TestDescriptor_BasicShape (0.00s) === RUN TestDescriptor_AdminConfigFormHasNoWorkersField --- PASS: TestDescriptor_AdminConfigFormHasNoWorkersField (0.00s) === RUN TestDescriptor_WorkerConfigFormIsAbsent --- PASS: TestDescriptor_WorkerConfigFormIsAbsent (0.00s) === RUN TestDescriptor_AdminRuntimeDefaultsHaveNoTimeoutInPractice --- PASS: TestDescriptor_AdminRuntimeDefaultsHaveNoTimeoutInPractice (0.00s) === RUN TestDescriptor_AdminRuntimeDefaultsDailyCadence --- PASS: TestDescriptor_AdminRuntimeDefaultsDailyCadence (0.00s) === RUN TestDescriptor_AdminRuntimeDefaultsEnabledByDefault --- PASS: TestDescriptor_AdminRuntimeDefaultsEnabledByDefault (0.00s) === RUN TestExecute_NilRequestErrors --- PASS: TestExecute_NilRequestErrors (0.00s) === RUN TestExecute_NilJobErrors --- PASS: TestExecute_NilJobErrors (0.00s) === RUN TestExecute_NilSenderErrors --- PASS: TestExecute_NilSenderErrors (0.00s) === RUN TestExecute_WrongJobTypeErrors --- PASS: TestExecute_WrongJobTypeErrors (0.00s) === RUN TestExecute_NoS3EndpointsErrors --- PASS: TestExecute_NoS3EndpointsErrors (0.00s) === RUN TestExecute_MissingFilerAddressErrors --- PASS: TestExecute_MissingFilerAddressErrors (0.00s) === RUN TestExecute_EmptyJobTypeAccepted --- PASS: TestExecute_EmptyJobTypeAccepted (0.00s) === RUN TestSendCompletion_EmitsCanonicalCompletion --- PASS: TestSendCompletion_EmitsCanonicalCompletion (0.01s) === RUN TestSendCompletion_PropagatesSendError --- PASS: TestSendCompletion_PropagatesSendError (0.00s) === RUN TestSendCompletion_FailedPassKeepsEveryBucketFailure --- PASS: TestSendCompletion_FailedPassKeepsEveryBucketFailure (0.00s) === RUN TestRunReport_InvalidPolicyIsPartial --- PASS: TestRunReport_InvalidPolicyIsPartial (0.00s) === RUN TestRunReport_CanceledWinsOverError --- PASS: TestRunReport_CanceledWinsOverError (0.00s) === RUN TestRecordFullPass_OnlyACompletePassAdvances === RUN TestRecordFullPass_OnlyACompletePassAdvances/failed === RUN TestRecordFullPass_OnlyACompletePassAdvances/canceled === RUN TestRecordFullPass_OnlyACompletePassAdvances/partial === RUN TestRecordFullPass_OnlyACompletePassAdvances/halted === RUN TestRecordFullPass_OnlyACompletePassAdvances/deferred === RUN TestRecordFullPass_OnlyACompletePassAdvances/complete --- PASS: TestRecordFullPass_OnlyACompletePassAdvances (0.03s) --- PASS: TestRecordFullPass_OnlyACompletePassAdvances/failed (0.01s) --- PASS: TestRecordFullPass_OnlyACompletePassAdvances/canceled (0.01s) --- PASS: TestRecordFullPass_OnlyACompletePassAdvances/partial (0.00s) --- PASS: TestRecordFullPass_OnlyACompletePassAdvances/halted (0.00s) --- PASS: TestRecordFullPass_OnlyACompletePassAdvances/deferred (0.00s) --- PASS: TestRecordFullPass_OnlyACompletePassAdvances/complete (0.00s) === RUN TestLookupBucketsPath_PropagatesGRPCError --- PASS: TestLookupBucketsPath_PropagatesGRPCError (0.00s) === RUN TestLookupBucketsPath_UsesConfiguredDirBuckets --- PASS: TestLookupBucketsPath_UsesConfiguredDirBuckets (0.00s) === RUN TestLookupBucketsPath_EmptyDirBucketsFallsBackToDefault --- PASS: TestLookupBucketsPath_EmptyDirBucketsFallsBackToDefault (0.00s) === RUN TestRecordFullPass_FailedSaveKeepsThePreviousTimestamp W1117 09:40:42.959971 handler.go:412 daily_replay: full pass save: filer unavailable --- PASS: TestRecordFullPass_FailedSaveKeepsThePreviousTimestamp (0.00s) === RUN TestProgressReporter_IdleTicksSendNothing --- PASS: TestProgressReporter_IdleTicksSendNothing (0.10s) === RUN TestProgressReporter_ReportsEachKindOfWork --- PASS: TestProgressReporter_ReportsEachKindOfWork (0.09s) === RUN TestProgressReporter_RetriesAFailedSendWithoutNewWork --- PASS: TestProgressReporter_RetriesAFailedSendWithoutNewWork (0.07s) === RUN TestProgressReporter_NoProgressAfterStop --- PASS: TestProgressReporter_NoProgressAfterStop (0.06s) === RUN TestSelectS3Front_SharedKeyPassesWithoutDeletes --- PASS: TestSelectS3Front_SharedKeyPassesWithoutDeletes (0.02s) === RUN TestSelectS3Front_KeyProblemsNameTheConfig === RUN TestSelectS3Front_KeyProblemsNameTheConfig/missing_worker_key === RUN TestSelectS3Front_KeyProblemsNameTheConfig/mismatched_worker_key --- PASS: TestSelectS3Front_KeyProblemsNameTheConfig (0.04s) --- PASS: TestSelectS3Front_KeyProblemsNameTheConfig/missing_worker_key (0.02s) --- PASS: TestSelectS3Front_KeyProblemsNameTheConfig/mismatched_worker_key (0.02s) === RUN TestSelectS3Front_SkipsFrontWithOtherKey --- PASS: TestSelectS3Front_SkipsFrontWithOtherKey (0.08s) === RUN TestSelectS3Front_OlderFrontUsesEmptyDelete --- PASS: TestSelectS3Front_OlderFrontUsesEmptyDelete (0.05s) === RUN TestSelectS3Front_TimeoutMovesOn --- PASS: TestSelectS3Front_TimeoutMovesOn (0.25s) === RUN TestSelectS3Front_ParentCancelStops --- PASS: TestSelectS3Front_ParentCancelStops (0.11s) === RUN TestExecute_RejectedCredentialsFailBeforeListing --- PASS: TestExecute_RejectedCredentialsFailBeforeListing (0.06s) PASS ok github.com/seaweedfs/seaweedfs/weed/worker/tasks/s3_lifecycle 5.280s ? github.com/seaweedfs/seaweedfs/weed/worker/tasks/util [no test files] === RUN TestLoadConfigFromPersistenceUsesPersistedPolicy --- PASS: TestLoadConfigFromPersistenceUsesPersistedPolicy (0.00s) === RUN TestLoadConfigFromPersistenceFallsBackToDefaults === RUN TestLoadConfigFromPersistenceFallsBackToDefaults/no_store_configured === RUN TestLoadConfigFromPersistenceFallsBackToDefaults/store_without_the_value === RUN TestLoadConfigFromPersistenceFallsBackToDefaults/store_that_errors W1117 09:40:42.186192 config.go:79 Could not read the persisted vacuum configuration, falling back to defaults: disk on fire === RUN TestLoadConfigFromPersistenceFallsBackToDefaults/store_of_the_wrong_type W1117 09:40:42.275255 config.go:93 vacuum.wrongShapedStore cannot provide the persisted vacuum configuration: it has no LoadVacuumTaskPolicy() method, so the compiled-in defaults are used and any saved vacuum settings are ignored --- PASS: TestLoadConfigFromPersistenceFallsBackToDefaults (0.10s) --- PASS: TestLoadConfigFromPersistenceFallsBackToDefaults/no_store_configured (0.00s) --- PASS: TestLoadConfigFromPersistenceFallsBackToDefaults/store_without_the_value (0.00s) --- PASS: TestLoadConfigFromPersistenceFallsBackToDefaults/store_that_errors (0.08s) --- PASS: TestLoadConfigFromPersistenceFallsBackToDefaults/store_of_the_wrong_type (0.00s) === RUN TestPickPrimaryReplicaSkipsTieredReplicas --- PASS: TestPickPrimaryReplicaSkipsTieredReplicas (0.00s) === RUN TestDecodeVacuumTaskParamsFromPayload --- PASS: TestDecodeVacuumTaskParamsFromPayload (0.06s) === RUN TestDecodeVacuumTaskParamsFallback --- PASS: TestDecodeVacuumTaskParamsFallback (0.00s) === RUN TestDeriveVacuumConfigAllowsZeroValues --- PASS: TestDeriveVacuumConfigAllowsZeroValues (0.00s) === RUN TestMasterAddressCandidates --- PASS: TestMasterAddressCandidates (0.00s) === RUN TestShouldSkipDetectionByInterval --- PASS: TestShouldSkipDetectionByInterval (0.00s) === RUN TestVacuumHandlerRejectsUnsupportedJobType --- PASS: TestVacuumHandlerRejectsUnsupportedJobType (0.00s) === RUN TestBuildExecutorActivity --- PASS: TestBuildExecutorActivity (0.00s) === RUN TestEmitVacuumDetectionDecisionTraceNoTasks --- PASS: TestEmitVacuumDetectionDecisionTraceNoTasks (0.00s) === RUN TestVacuumDescriptorHasNewFields --- PASS: TestVacuumDescriptorHasNewFields (0.00s) === RUN TestVacuumFiltersVolumeState === RUN TestVacuumFiltersVolumeState/ALL_returns_all === RUN TestVacuumFiltersVolumeState/ACTIVE_returns_writable === RUN TestVacuumFiltersVolumeState/FULL_returns_read-only --- PASS: TestVacuumFiltersVolumeState (0.00s) --- PASS: TestVacuumFiltersVolumeState/ALL_returns_all (0.00s) --- PASS: TestVacuumFiltersVolumeState/ACTIVE_returns_writable (0.00s) --- PASS: TestVacuumFiltersVolumeState/FULL_returns_read-only (0.00s) === RUN TestVacuumFiltersLocation === RUN TestVacuumFiltersLocation/dc_filter === RUN TestVacuumFiltersLocation/rack_filter === RUN TestVacuumFiltersLocation/node_filter === RUN TestVacuumFiltersLocation/dc_+_rack --- PASS: TestVacuumFiltersLocation (0.01s) --- PASS: TestVacuumFiltersLocation/dc_filter (0.00s) --- PASS: TestVacuumFiltersLocation/rack_filter (0.00s) --- PASS: TestVacuumFiltersLocation/node_filter (0.00s) --- PASS: TestVacuumFiltersLocation/dc_+_rack (0.00s) PASS ok github.com/seaweedfs/seaweedfs/weed/worker/tasks/vacuum 3.075s ? github.com/seaweedfs/seaweedfs/weed/worker/types [no test files] ? github.com/seaweedfs/seaweedfs/weed/worker/types/base [no test files] FAIL ==> ERROR:(B A failure occurred in check().(B  Aborting...(B ]3008;end=0c0f3de5c47e45578c7c086935ee7516\[!p]104\[?7h]3008;end=ce48ffb52c834acb82a91267425e4ec1\==> ERROR:(B Build failed, check /var/lib/archbuild/extra-riscv64/felix-8/build(B [?12l[?25h[?12l[?25h]3008;end=5bc457e1bb254421b8de9a13282eae22\[?12l[?25hreceiving incremental file list seaweedfs-4.54-1-riscv64-build.log seaweedfs-4.54-1-riscv64-check.log seaweedfs-4.54-1-riscv64-prepare.log sent 81 bytes received 690,439 bytes 276,208.00 bytes/sec total size is 6,729,350 speedup is 9.75