== sanity-flr test 70a: flr mode fsx test ================ 15:09:14 (1789067354) Seed set to 7356 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000004 1789067356.374475 mapwrite 0x020ccd thru 0x0244e8 (0x381c bytes) 000005 1789067356.611012 write 0x02916f thru 0x029b54 (0x9e6 bytes) truncating to largest ever: 0x22792 000006 1789067356.614215 trunc from 0x029b55 to 0x022791 (0x73c3 bytes) 000007 1789067356.683831 mapread 0x00d778 thru 0x0172da (0x9b63 bytes) 000009 1789067356.726504 read 0x000ff8 thru 0x006527 (0x5530 bytes) 000010 1789067356.758289 mapread 0x01c485 thru 0x022791 (0x630d bytes) 000013 1789067356.760364 punch from 0x013a78 to 0x01affc (0x7585 bytes) 000014 1789067356.779983 write 0x02aeb8 thru 0x037be5 (0xcd2e bytes) truncating to largest ever: 0x3078b 000016 1789067356.791007 trunc from 0x037be6 to 0x03078a (0x745b bytes) 000017 1789067356.821670 trunc from 0x03078b to 0x0093d2 (0x273b8 bytes) 000018 1789067356.858227 read 0x0022a5 thru 0x0093d2 (0x712e bytes) 000019 1789067356.862211 write 0x022a07 thru 0x031b32 (0xf12c bytes) 000020 1789067356.865817 read 0x0138c5 thru 0x0221e9 (0xe925 bytes) 000021 1789067356.887754 read 0x019ded thru 0x01fd62 (0x5f76 bytes) 000022 1789067356.888429 mapwrite 0x02074e thru 0x02bf7d (0xb830 bytes) 000023 1789067357.006144 trunc from 0x031b33 to 0x0125d2 (0x1f560 bytes) 000027 1789067357.050416 trunc from 0x0125d3 to 0x00b397 (0x723b bytes) 000029 1789067357.078817 mapwrite 0x00b6c3 thru 0x011857 (0x6195 bytes) 000030 1789067357.201479 mapread 0x00c136 thru 0x011857 (0x5722 bytes) 000034 1789067357.210105 read 0x000d46 thru 0x010b23 (0xfdde bytes) 000038 1789067357.215594 write 0x016a9d thru 0x01cfb7 (0x651b bytes) 000040 1789067357.228778 MIRROR_EXTEND to 2 mirrors 000041 1789067358.639639 write 0x01b80a thru 0x0264dd (0xacd4 bytes) 000042 1789067358.813346 write 0x004ba1 thru 0x00b9b4 (0x6e14 bytes) 000043 1789067358.841020 mapread 0x00d2c7 thru 0x01ac38 (0xd972 bytes) 000044 1789067358.891750 write 0x02aeb4 thru 0x0379bf (0xcb0c bytes) 000045 1789067358.893613 trunc from 0x0379c0 to 0x00dcda (0x29ce5 bytes) 000046 1789067358.929213 mapwrite 0x01e3c6 thru 0x02b032 (0xcc6d bytes) 000047 1789067359.242998 mapwrite 0x023a64 thru 0x02ccf1 (0x928e bytes) 000048 1789067359.439963 write 0x0019e9 thru 0x00ae60 (0x9478 bytes) 000049 1789067359.473080 trunc from 0x02ccf2 to 0x00f78f (0x1d562 bytes) 000050 1789067359.494495 punch from 0x00c408 to 0x00f78f (0x3388 bytes) 000051 1789067359.510136 punch from 0x00df0d to 0x00f78f (0x1883 bytes) 000052 1789067359.519647 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xf790): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf790): Mirror 2: 0x5684bdb1 (stale) CRC-32 checksum value for chunk [0, 0xf790): Mirror 1: 0x2e240154 Mirror 3: 0x2e240154 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf790: skipped 000053 1789067360.865303 write 0x035143 thru 0x03f0f8 (0x9fb6 bytes) 000054 1789067360.978029 write 0x01e349 thru 0x02b3d7 (0xd08f bytes) 000055 1789067360.991698 mapread 0x012dc4 thru 0x0149a0 (0x1bdd bytes) 000056 1789067361.013092 mapread 0x025401 thru 0x0334bc (0xe0bc bytes) 000057 1789067361.020572 trunc from 0x03f0f9 to 0x02411a (0x1afde bytes) 000058 1789067361.049139 punch from 0x010dbb to 0x01bc71 (0xaeb7 bytes) 000059 1789067361.069396 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2411b): Mirror 3: 0xb67a30c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2411b): Mirror 3: 0xb67a30c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2411b: skipped 000062 1789067361.481509 mapwrite 0x03e6e8 thru 0x03ffff (0x1918 bytes) 000063 1789067361.549389 read 0x01fb08 thru 0x02b999 (0xbe92 bytes) 000064 1789067361.559752 mapread 0x03f586 thru 0x03ffff (0xa7a bytes) 000066 1789067361.566356 MIRROR_RESYNC 2 mirrors 000067 1789067362.459599 mapread 0x03e322 thru 0x03ffff (0x1cde bytes) 000068 1789067362.480238 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) 000069 1789067362.682452 mapwrite 0x024380 thru 0x030ce8 (0xc969 bytes) 000070 1789067362.812984 write 0x01517f thru 0x019c09 (0x4a8b bytes) 000071 1789067362.827065 mapread 0x0354f9 thru 0x03e489 (0x8f91 bytes) 000073 1789067362.844728 mapwrite 0x02e456 thru 0x03aab7 (0xc662 bytes) 000074 1789067362.912989 write 0x00ea3a thru 0x01b9bc (0xcf83 bytes) 000075 1789067362.927593 punch from 0x00e817 to 0x00f888 (0x1072 bytes) 000076 1789067362.978997 MIRROR_EXTEND to 2 mirrors 000078 1789067364.057643 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) 000079 1789067364.474890 write 0x026e2e thru 0x02bf45 (0x5118 bytes) 000080 1789067364.551064 trunc from 0x040000 to 0x01dad2 (0x2252d bytes) truncating to largest ever: 0x348b6 000085 1789067364.620566 trunc from 0x01dad3 to 0x0348b5 (0x16de3 bytes) 000087 1789067364.646579 write 0x03b4aa thru 0x03c827 (0x137e bytes) 000088 1789067364.648104 read 0x01f238 thru 0x029a32 (0xa7fb bytes) 000089 1789067364.668196 punch from 0x00a381 to 0x00ed8e (0x4a0e bytes) 000091 1789067364.682916 MIRROR_EXTEND to 2 mirrors 000092 1789067365.794463 write 0x03acb8 thru 0x03ffff (0x5348 bytes) 000093 1789067365.902427 punch from 0x030ac6 to 0x037a95 (0x6fd0 bytes) 000094 1789067365.929079 punch from 0x03d59f to 0x03ffff (0x2a61 bytes) 000096 1789067365.941171 mapwrite 0x01ec4d thru 0x026046 (0x73fa bytes) 000097 1789067366.105412 read 0x03bd10 thru 0x03ffff (0x42f0 bytes) 000099 1789067366.124550 trunc from 0x040000 to 0x0079e4 (0x3861b bytes) 000101 1789067366.200702 punch from 0x0059c6 to 0x0079e4 (0x201f bytes) 000103 1789067366.207627 write 0x03704c thru 0x03ffff (0x8fb4 bytes) 000104 1789067366.209109 trunc from 0x040000 to 0x02ec50 (0x113af bytes) 000105 1789067366.243346 write 0x01ee42 thru 0x02d341 (0xe500 bytes) 000106 1789067366.260816 read 0x008845 thru 0x010ee2 (0x869e bytes) 000107 1789067366.281039 read 0x00b627 thru 0x00f5d0 (0x3faa bytes) 000108 1789067366.292215 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2ec51): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ec51): Mirror 2: 0x89066a7 (stale) CRC-32 checksum value for chunk [0, 0x2ec51): Mirror 1: 0x3b49de29 Mirror 3: 0x3b49de29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ec51: skipped 000110 1789067368.292568 punch from 0x026731 to 0x02ec50 (0x8520 bytes) 000111 1789067368.412289 MIRROR_RESYNC 3 mirrors 000112 1789067370.320518 MIRROR_EXTEND to 4 mirrors 000114 1789067370.949313 MIRROR_RESYNC 4 mirrors 000115 1789067371.566766 write 0x009116 thru 0x017f41 (0xee2c bytes) truncating to largest ever: 0x3bb56 000116 1789067371.736762 trunc from 0x02ec51 to 0x03bb55 (0xcf05 bytes) 000117 1789067371.838537 mapwrite 0x024543 thru 0x0269b8 (0x2476 bytes) 000120 1789067372.002758 mapwrite 0x026db5 thru 0x032725 (0xb971 bytes) 000122 1789067372.087548 trunc from 0x03bb56 to 0x00195f (0x3a1f6 bytes) 000123 1789067372.120038 MIRROR_RESYNC 4 mirrors 000124 1789067373.499073 MIRROR_EXTEND to 5 mirrors 000125 1789067375.011295 trunc from 0x001960 to 0x00450c (0x2bad bytes) 000127 1789067375.188428 punch from 0x001e9f to 0x00450c (0x266e bytes) 000129 1789067375.201827 mapwrite 0x01ac88 thru 0x01d7b5 (0x2b2e bytes) 000130 1789067375.441717 write 0x00457c thru 0x010e27 (0xc8ac bytes) 000131 1789067375.471142 trunc from 0x01d7b6 to 0x00942e (0x14387 bytes) 000132 1789067375.488438 read 0x002eca thru 0x00942e (0x6565 bytes) 000134 1789067375.495081 mapread 0x002625 thru 0x00942e (0x6e0a bytes) 000135 1789067375.496235 mapread 0x0052ca thru 0x007aa5 (0x27dc bytes) 000136 1789067375.500937 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x942f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x942f): Mirror 2: 0xb764ad4e (stale) Mirror 3: 0xb764ad4e (stale) Mirror 4: 0xb764ad4e (stale) Mirror 5: 0xb764ad4e (stale) CRC-32 checksum value for chunk [0, 0x942f): Mirror 1: 0xffc58bf1 Mirror 6: 0xffc58bf1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x942f: skipped 000137 1789067377.444691 trunc from 0x00942f to 0x007a26 (0x1a08 bytes) 000138 1789067377.610057 punch from 0x004a79 to 0x00742e (0x29b6 bytes) 000139 1789067377.617013 write 0x019003 thru 0x02162b (0x8629 bytes) 000140 1789067377.619684 punch from 0x01f797 to 0x02158e (0x1df8 bytes) 000142 1789067377.636025 read 0x01c76d thru 0x020213 (0x3aa7 bytes) 000146 1789067377.645829 mapread 0x00748b thru 0x00b9bd (0x4533 bytes) 000147 1789067377.673670 mapwrite 0x01e564 thru 0x02cc7f (0xe71c bytes) truncating to largest ever: 0x3f0f3 000149 1789067377.990057 trunc from 0x02cc80 to 0x03f0f2 (0x12473 bytes) 000150 1789067378.022777 punch from 0x000d48 to 0x00683c (0x5af5 bytes) 000151 1789067378.028036 read 0x03cde9 thru 0x03f0f2 (0x230a bytes) 000152 1789067378.059753 write 0x0117a1 thru 0x01c637 (0xae97 bytes) 000154 1789067378.065626 punch from 0x01f447 to 0x025052 (0x5c0c bytes) 000155 1789067378.102908 trunc from 0x03f0f3 to 0x003bdd (0x3b515 bytes) 000156 1789067378.192511 read 0x0035f2 thru 0x003bdd (0x5ec bytes) 000159 1789067378.201631 punch from 0x00318a to 0x003bdd (0xa54 bytes) 000160 1789067378.263049 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bde): Mirror 2: 0xeda78cba (stale) Mirror 3: 0xeda78cba (stale) Mirror 4: 0xeda78cba (stale) Mirror 6: 0xeda78cba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bde): Mirror 2: 0xeda78cba (stale) Mirror 3: 0xeda78cba (stale) Mirror 4: 0xeda78cba (stale) Mirror 6: 0xeda78cba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bde: skipped 000161 1789067378.842890 mapwrite 0x02d68a thru 0x03abd4 (0xd54b bytes) 000164 1789067378.977027 trunc from 0x03abd5 to 0x00e520 (0x2c6b4 bytes) 000165 1789067379.007558 mapwrite 0x030589 thru 0x0391e9 (0x8c61 bytes) 000166 1789067379.101765 punch from 0x01514d to 0x0234cb (0xe37f bytes) 000167 1789067379.113885 MIRROR_RESYNC 5 mirrors 000168 1789067381.717377 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) 000169 1789067382.304005 read 0x0037de thru 0x003ab2 (0x2d5 bytes) 000172 1789067382.317533 MIRROR_EXTEND to 5 mirrors 000173 1789067383.724732 mapwrite 0x00b4d5 thru 0x01a061 (0xeb8d bytes) 000174 1789067383.934744 punch from 0x00e814 to 0x00f258 (0xa45 bytes) 000175 1789067383.940417 write 0x0150d2 thru 0x01c244 (0x7173 bytes) 000176 1789067383.942818 mapwrite 0x0260a1 thru 0x02ce31 (0x6d91 bytes) 000178 1789067383.997444 trunc from 0x0391ea to 0x00a820 (0x2e9c9 bytes) 000179 1789067384.019717 mapwrite 0x03c6fc thru 0x03ffff (0x3904 bytes) 000180 1789067384.168477 trunc from 0x040000 to 0x02f6f9 (0x10906 bytes) 000182 1789067384.228273 mapwrite 0x035d97 thru 0x03e35a (0x85c4 bytes) 000183 1789067384.376411 mapwrite 0x0231ef thru 0x0241d4 (0xfe6 bytes) 000185 1789067384.474262 punch from 0x02b589 to 0x031205 (0x5c7d bytes) 000188 1789067384.485007 mapwrite 0x031f96 thru 0x033392 (0x13fd bytes) 000189 1789067384.540725 mapread 0x000f7c thru 0x006bad (0x5c32 bytes) 000190 1789067384.574020 mapwrite 0x00afbc thru 0x016c1a (0xbc5f bytes) 000192 1789067384.735945 punch from 0x0280a8 to 0x03800d (0xff66 bytes) 000194 1789067384.764825 mapread 0x0207ba thru 0x0296c9 (0x8f10 bytes) 000195 1789067384.802880 read 0x002c6d thru 0x00faf4 (0xce88 bytes) 000196 1789067384.818805 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e35b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e35b): Mirror 3: 0x440881fb (stale) Mirror 4: 0x440881fb (stale) Mirror 6: 0x440881fb (stale) Mirror 7: 0x440881fb (stale) CRC-32 checksum value for chunk [0, 0x3e35b): Mirror 1: 0x6304783f Mirror 8: 0x6304783f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e35b: skipped 000198 1789067387.304694 punch from 0x027f1a to 0x03224a (0xa331 bytes) 000199 1789067387.508967 MIRROR_RESYNC 6 mirrors 000202 1789067390.061208 MIRROR_RESYNC 6 mirrors 000204 1789067390.528973 MIRROR_EXTEND to 7 mirrors 000205 1789067391.233310 read 0x022705 thru 0x02939d (0x6c99 bytes) 000206 1789067391.244703 mapwrite 0x001244 thru 0x00efcd (0xdd8a bytes) 000207 1789067391.506700 mapread 0x012a71 thru 0x01feb0 (0xd440 bytes) 000208 1789067391.539646 read 0x024158 thru 0x02e98a (0xa833 bytes) 000209 1789067391.550319 write 0x0113e1 thru 0x0159b2 (0x45d2 bytes) 000213 1789067391.558596 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e35b): Mirror 3: 0x6304783f (stale) Mirror 4: 0x6304783f (stale) Mirror 6: 0x6304783f (stale) Mirror 8: 0x6304783f (stale) Mirror 9: 0x6304783f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e35b): Mirror 3: 0x6304783f (stale) Mirror 4: 0x6304783f (stale) Mirror 6: 0x6304783f (stale) Mirror 8: 0x6304783f (stale) Mirror 9: 0x6304783f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e35b: skipped 000214 1789067392.051720 mapwrite 0x00ede9 thru 0x0138e8 (0x4b00 bytes) 000215 1789067392.134880 mapwrite 0x00d8d9 thru 0x010b7b (0x32a3 bytes) 000216 1789067392.182730 trunc from 0x03e35b to 0x03bcec (0x266e bytes) 000218 1789067392.200086 trunc from 0x03bced to 0x02876a (0x13582 bytes) 000219 1789067392.218666 read 0x01db3d thru 0x020d5c (0x3220 bytes) 000220 1789067392.227294 punch from 0x013caf to 0x02069c (0xc9ee bytes) 000221 1789067392.233815 punch from 0x024a4d to 0x02876a (0x3d1e bytes) 000223 1789067392.239532 read 0x012e7a thru 0x02208d (0xf214 bytes) 000225 1789067392.252688 mapwrite 0x002500 thru 0x00d892 (0xb393 bytes) 000226 1789067392.300571 mapread 0x0271d5 thru 0x02876a (0x1596 bytes) 000227 1789067392.302373 write 0x00b591 thru 0x017c88 (0xc6f8 bytes) 000228 1789067392.304972 punch from 0x014645 to 0x01d5fd (0x8fb9 bytes) 000230 1789067392.341238 MIRROR_RESYNC 6 mirrors 000231 1789067395.292703 mapwrite 0x02467f thru 0x033c1a (0xf59c bytes) 000233 1789067395.454826 mapwrite 0x035c3a thru 0x03ffff (0xa3c6 bytes) 000234 1789067395.601209 mapwrite 0x011612 thru 0x01e59e (0xcf8d bytes) 000235 1789067395.733370 read 0x00372f thru 0x00a8c4 (0x7196 bytes) 000236 1789067395.744178 read 0x012699 thru 0x013678 (0xfe0 bytes) 000238 1789067395.745244 mapread 0x00be2f thru 0x012206 (0x63d8 bytes) 000239 1789067395.746213 mapwrite 0x03bf3d thru 0x03ffff (0x40c3 bytes) 000241 1789067395.861169 trunc from 0x040000 to 0x0395e8 (0x6a17 bytes) 000242 1789067395.905718 mapwrite 0x035b3a thru 0x03ca5c (0x6f23 bytes) 000243 1789067396.091112 mapwrite 0x003b6f thru 0x0067f7 (0x2c89 bytes) 000245 1789067396.202786 write 0x005302 thru 0x00c2d3 (0x6fd2 bytes) 000246 1789067396.211886 trunc from 0x03ca5d to 0x01c040 (0x20a1c bytes) 000247 1789067396.235612 write 0x00fa26 thru 0x01f2f6 (0xf8d1 bytes) 000248 1789067396.246220 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1f2f7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f2f7): Mirror 3: 0x6cb47032 (stale) Mirror 4: 0x6cb47032 (stale) Mirror 6: 0x6cb47032 (stale) Mirror 8: 0x6cb47032 (stale) Mirror 9: 0x6cb47032 (stale) CRC-32 checksum value for chunk [0, 0x1f2f7): Mirror 1: 0x8132c18 Mirror 10: 0x8132c18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f2f7: skipped 000250 1789067398.523279 read 0x019905 thru 0x01f2f6 (0x59f2 bytes) 000253 1789067398.643222 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f2f7): Mirror 3: 0x6cb47032 (stale) Mirror 4: 0x6cb47032 (stale) Mirror 6: 0x6cb47032 (stale) Mirror 8: 0x6cb47032 (stale) Mirror 9: 0x6cb47032 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f2f7): Mirror 3: 0x6cb47032 (stale) Mirror 4: 0x6cb47032 (stale) Mirror 6: 0x6cb47032 (stale) Mirror 8: 0x6cb47032 (stale) Mirror 9: 0x6cb47032 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f2f7: skipped 000254 1789067399.383231 trunc from 0x01f2f7 to 0x02e5e7 (0xf2f1 bytes) 000255 1789067399.432722 mapwrite 0x01bc22 thru 0x028c33 (0xd012 bytes) 000256 1789067399.610568 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e5e8): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e5e8): Mirror 3: 0x506ecdb9 (stale) Mirror 4: 0x506ecdb9 (stale) Mirror 6: 0x506ecdb9 (stale) Mirror 8: 0x506ecdb9 (stale) Mirror 9: 0x506ecdb9 (stale) CRC-32 checksum value for chunk [0, 0x2e5e8): Mirror 1: 0xfb9e2f64 Mirror 10: 0xfb9e2f64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e5e8: skipped 000257 1789067401.083221 read 0x00cf5b thru 0x019d26 (0xcdcc bytes) 000258 1789067401.124967 write 0x02bdb7 thru 0x03306f (0x72b9 bytes) 000259 1789067401.359714 MIRROR_RESYNC 7 mirrors 000260 1789067402.932907 punch from 0x02baca to 0x02d261 (0x1798 bytes) 000261 1789067403.107459 mapwrite 0x0132aa thru 0x0139da (0x731 bytes) 000263 1789067403.207589 mapread 0x00e378 thru 0x018003 (0x9c8c bytes) 000265 1789067403.285333 MIRROR_RESYNC 7 mirrors 000267 1789067404.938325 MIRROR_EXTEND to 8 mirrors 000268 1789067406.026272 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) 000269 1789067406.512880 mapread 0x02a503 thru 0x03306f (0x8b6d bytes) 000270 1789067406.538872 mapread 0x02a2db thru 0x03306f (0x8d95 bytes) 000271 1789067406.540137 trunc from 0x033070 to 0x02377c (0xf8f3 bytes) 000272 1789067406.645215 write 0x036ae5 thru 0x03ae57 (0x4373 bytes) 000274 1789067406.649593 mapread 0x007982 thru 0x008b5a (0x11d9 bytes) 000276 1789067406.680171 mapwrite 0x01184a thru 0x012bf6 (0x13ad bytes) 000277 1789067406.786542 trunc from 0x03ae58 to 0x002345 (0x38b12 bytes) 000279 1789067406.817465 mapread 0x001c42 thru 0x002345 (0x704 bytes) 000280 1789067406.818610 punch from 0x0015ef to 0x002345 (0xd57 bytes) 000281 1789067406.823819 mapwrite 0x025704 thru 0x029d87 (0x4684 bytes) 000284 1789067406.896700 punch from 0x020d71 to 0x02297b (0x1c0b bytes) 000285 1789067406.907422 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x29d88): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29d88): Mirror 3: 0xb52d17ef (stale) Mirror 4: 0xb52d17ef (stale) Mirror 6: 0xb52d17ef (stale) Mirror 9: 0xb52d17ef (stale) Mirror 10: 0xb52d17ef (stale) Mirror 11: 0xb52d17ef (stale) CRC-32 checksum value for chunk [0, 0x29d88): Mirror 1: 0xa492faa8 Mirror 12: 0xa492faa8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29d88: skipped 000287 1789067408.713460 punch from 0x027bf8 to 0x029d87 (0x2190 bytes) 000288 1789067408.811697 punch from 0x025b98 to 0x029d87 (0x41f0 bytes) 000289 1789067408.821540 write 0x019508 thru 0x0291b3 (0xfcac bytes) 000290 1789067408.835466 write 0x006684 thru 0x010902 (0xa27f bytes) 000291 1789067408.847232 read 0x02215c thru 0x029d87 (0x7c2c bytes) 000292 1789067408.849318 mapread 0x0161cd thru 0x01cafc (0x6930 bytes) 000294 1789067408.870704 write 0x0231c9 thru 0x02385d (0x695 bytes) 000295 1789067408.871690 punch from 0x00e956 to 0x017116 (0x87c1 bytes) 000297 1789067408.891132 punch from 0x0089b4 to 0x01623f (0xd88c bytes) 000298 1789067408.896376 trunc from 0x029d88 to 0x024639 (0x574e bytes) 000299 1789067408.921271 mapread 0x001b35 thru 0x00a4a9 (0x8975 bytes) 000300 1789067408.931502 mapwrite 0x039057 thru 0x03e71c (0x56c6 bytes) 000301 1789067409.022702 write 0x032520 thru 0x039e92 (0x7973 bytes) 000302 1789067409.025463 read 0x002769 thru 0x0099e1 (0x7279 bytes) 000303 1789067409.026450 mapwrite 0x00a852 thru 0x00b14d (0x8fc bytes) 000304 1789067409.078723 read 0x03d35e thru 0x03e71c (0x13bf bytes) 000305 1789067409.081074 mapread 0x002334 thru 0x01026a (0xdf37 bytes) 000307 1789067409.101629 mapread 0x008117 thru 0x0132b3 (0xb19d bytes) 000308 1789067409.110504 MIRROR_RESYNC 8 mirrors 000311 1789067411.779928 mapread 0x037b0f thru 0x03e71c (0x6c0e bytes) 000313 1789067411.816367 read 0x02ead1 thru 0x02fdd5 (0x1305 bytes) 000314 1789067411.832134 mapwrite 0x034eb6 thru 0x03a0df (0x522a bytes) 000315 1789067412.179794 mapread 0x00e873 thru 0x01587d (0x700b bytes) 000316 1789067412.199905 write 0x0239b8 thru 0x02fd57 (0xc3a0 bytes) 000318 1789067412.215701 read 0x02363d thru 0x02dcee (0xa6b2 bytes) 000319 1789067412.216707 mapread 0x01bfd9 thru 0x02bc33 (0xfc5b bytes) 000321 1789067412.232341 mapread 0x030c66 thru 0x03c838 (0xbbd3 bytes) 000322 1789067412.233399 punch from 0x02426f to 0x033425 (0xf1b7 bytes) 000324 1789067412.272585 punch from 0x0199da to 0x01cf35 (0x355c bytes) 000325 1789067412.287704 mapwrite 0x00fcb7 thru 0x019372 (0x96bc bytes) 000326 1789067412.415918 trunc from 0x03e71d to 0x028d78 (0x159a4 bytes) 000327 1789067412.489682 read 0x0223ff thru 0x028d78 (0x697a bytes) 000330 1789067412.527615 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x28d79): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28d79): Mirror 3: 0xa1e2df64 (stale) Mirror 4: 0xa1e2df64 (stale) Mirror 6: 0xa1e2df64 (stale) Mirror 9: 0xa1e2df64 (stale) Mirror 10: 0xa1e2df64 (stale) Mirror 11: 0xa1e2df64 (stale) Mirror 12: 0xa1e2df64 (stale) CRC-32 checksum value for chunk [0, 0x28d79): Mirror 1: 0xf41427d6 Mirror 13: 0xf41427d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28d79: skipped 000331 1789067414.146502 mapread 0x000013 thru 0x003946 (0x3934 bytes) 000334 1789067414.260288 read 0x025c63 thru 0x028d78 (0x3116 bytes) 000336 1789067414.312997 mapwrite 0x035216 thru 0x038eb6 (0x3ca1 bytes) 000338 1789067414.681451 mapread 0x00bec8 thru 0x015e89 (0x9fc2 bytes) 000339 1789067414.711880 mapwrite 0x039acb thru 0x03ffff (0x6535 bytes) 000340 1789067414.799649 write 0x004917 thru 0x009a99 (0x5183 bytes) 000341 1789067414.802976 mapwrite 0x03f30d thru 0x03ffff (0xcf3 bytes) 000342 1789067414.850651 mapwrite 0x020927 thru 0x027cda (0x73b4 bytes) 000343 1789067414.909699 mapread 0x005904 thru 0x00b0f1 (0x57ee bytes) 000344 1789067414.912553 mapread 0x02700e thru 0x032cd0 (0xbcc3 bytes) 000346 1789067414.926130 punch from 0x00a18c to 0x013425 (0x929a bytes) 000349 1789067414.940641 mapwrite 0x00b024 thru 0x00e179 (0x3156 bytes) 000350 1789067415.006022 trunc from 0x040000 to 0x0151e2 (0x2ae1d bytes) 000351 1789067415.038421 MIRROR_RESYNC 9 mirrors 000353 1789067417.096518 read 0x0132f2 thru 0x0151e2 (0x1ef1 bytes) 000355 1789067417.105513 read 0x006a55 thru 0x011396 (0xa942 bytes) 000356 1789067417.117150 punch from 0x00b08a to 0x00bd75 (0xcec bytes) 000357 1789067417.183551 mapread 0x01363d thru 0x0151e2 (0x1ba6 bytes) 000358 1789067417.200802 read 0x0097f5 thru 0x00a1e0 (0x9ec bytes) 000359 1789067417.211153 punch from 0x00cde8 to 0x0151e2 (0x83fb bytes) 000362 1789067417.218186 write 0x004874 thru 0x011bb9 (0xd346 bytes) 000365 1789067417.227413 MIRROR_RESYNC 9 mirrors 000366 1789067418.664604 mapwrite 0x02b9b3 thru 0x02f9a1 (0x3fef bytes) 000367 1789067418.803425 mapread 0x013b4e thru 0x01bc31 (0x80e4 bytes) 000368 1789067418.820006 write 0x024a8f thru 0x033e52 (0xf3c4 bytes) 000369 1789067418.826429 read 0x01d143 thru 0x02a5dd (0xd49b bytes) 000370 1789067418.837363 trunc from 0x033e53 to 0x0061e7 (0x2dc6b bytes) 000371 1789067418.865283 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x61e8): Mirror 4: 0xa52f5a77 (stale) Mirror 6: 0xa52f5a77 (stale) Mirror 9: 0xa52f5a77 (stale) Mirror 10: 0xa52f5a77 (stale) Mirror 11: 0xa52f5a77 (stale) Mirror 12: 0xa52f5a77 (stale) Mirror 13: 0xa52f5a77 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x61e8): Mirror 4: 0xa52f5a77 (stale) Mirror 6: 0xa52f5a77 (stale) Mirror 9: 0xa52f5a77 (stale) Mirror 10: 0xa52f5a77 (stale) Mirror 11: 0xa52f5a77 (stale) Mirror 12: 0xa52f5a77 (stale) Mirror 13: 0xa52f5a77 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x61e8: skipped 000372 1789067419.331584 write 0x03be4d thru 0x03ffff (0x41b3 bytes) 000373 1789067419.333575 write 0x00865a thru 0x0122aa (0x9c51 bytes) 000375 1789067419.365706 mapread 0x031f42 thru 0x032830 (0x8ef bytes) 000377 1789067419.407768 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5e1ff3d1 (stale) Mirror 6: 0x5e1ff3d1 (stale) Mirror 9: 0x5e1ff3d1 (stale) Mirror 10: 0x5e1ff3d1 (stale) Mirror 11: 0x5e1ff3d1 (stale) Mirror 12: 0x5e1ff3d1 (stale) Mirror 13: 0x5e1ff3d1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x61003d92 Mirror 14: 0x61003d92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000379 1789067421.521187 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5e1ff3d1 (stale) Mirror 6: 0x5e1ff3d1 (stale) Mirror 10: 0x5e1ff3d1 (stale) Mirror 11: 0x5e1ff3d1 (stale) Mirror 12: 0x5e1ff3d1 (stale) Mirror 13: 0x5e1ff3d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5e1ff3d1 (stale) Mirror 6: 0x5e1ff3d1 (stale) Mirror 10: 0x5e1ff3d1 (stale) Mirror 11: 0x5e1ff3d1 (stale) Mirror 12: 0x5e1ff3d1 (stale) Mirror 13: 0x5e1ff3d1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x61003d92 Mirror 14: 0x61003d92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000380 1789067422.319585 read 0x003464 thru 0x006d46 (0x38e3 bytes) 000381 1789067422.326828 punch from 0x03046b to 0x0368dc (0x6472 bytes) 000382 1789067422.439631 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x5e1ff3d1 (stale) Mirror 6: 0x5e1ff3d1 (stale) Mirror 10: 0x5e1ff3d1 (stale) Mirror 11: 0x5e1ff3d1 (stale) Mirror 12: 0x5e1ff3d1 (stale) Mirror 13: 0x5e1ff3d1 (stale) Mirror 14: 0x61003d92 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x61003d92 Mirror 15: 0x61003d92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000383 1789067423.656639 mapread 0x00c215 thru 0x01819c (0xbf88 bytes) 000385 1789067423.705631 mapwrite 0x00e6c6 thru 0x01987f (0xb1ba bytes) 000386 1789067423.902061 write 0x0135de thru 0x018bc8 (0x55eb bytes) 000389 1789067423.907201 mapwrite 0x0230fb thru 0x0248f7 (0x17fd bytes) 000391 1789067423.986263 trunc from 0x040000 to 0x0242ae (0x1bd51 bytes) 000392 1789067424.026369 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x242af): Mirror 6: 0x81435230 (stale) Mirror 10: 0x81435230 (stale) Mirror 11: 0x81435230 (stale) Mirror 12: 0x81435230 (stale) Mirror 13: 0x81435230 (stale) Mirror 14: 0xd69382ec (stale) Mirror 15: 0xd69382ec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x242af): Mirror 6: 0x81435230 (stale) Mirror 10: 0x81435230 (stale) Mirror 11: 0x81435230 (stale) Mirror 12: 0x81435230 (stale) Mirror 13: 0x81435230 (stale) Mirror 14: 0xd69382ec (stale) Mirror 15: 0xd69382ec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x242af: skipped 000393 1789067424.674018 write 0x02c268 thru 0x03827f (0xc018 bytes) 000394 1789067424.675133 write 0x024f7f thru 0x031e5a (0xcedc bytes) 000395 1789067424.679968 trunc from 0x038280 to 0x01fa5a (0x18825 bytes) 000396 1789067424.697708 trunc from 0x01fa5b to 0x022bec (0x3192 bytes) 000398 1789067424.722021 mapwrite 0x031cc4 thru 0x03ffff (0xe33c bytes) 000399 1789067424.828121 write 0x02cdf1 thru 0x03a71b (0xd92b bytes) 000400 1789067424.830441 write 0x02ef88 thru 0x0394cf (0xa548 bytes) 000401 1789067424.832181 trunc from 0x040000 to 0x032f58 (0xd0a7 bytes) 000402 1789067424.849774 trunc from 0x032f59 to 0x007fb5 (0x2afa3 bytes) 000403 1789067424.878786 write 0x01fe77 thru 0x0258fb (0x5a85 bytes) 000408 1789067424.885348 trunc from 0x0258fc to 0x007b31 (0x1ddca bytes) 000409 1789067424.913132 write 0x023a75 thru 0x0262c4 (0x2850 bytes) 000410 1789067424.915350 read 0x0171e8 thru 0x01c160 (0x4f79 bytes) 000413 1789067424.924239 punch from 0x0064f3 to 0x01271a (0xc228 bytes) 000415 1789067424.934904 read 0x0007d2 thru 0x0054e4 (0x4d13 bytes) 000416 1789067424.949091 read 0x0209d3 thru 0x0259c8 (0x4ff6 bytes) 000417 1789067424.950396 mapread 0x01b284 thru 0x0262c4 (0xb041 bytes) 000418 1789067424.951609 write 0x02158d thru 0x0283f4 (0x6e68 bytes) 000421 1789067424.959609 trunc from 0x0283f5 to 0x0060c5 (0x2232f bytes) 000422 1789067424.982405 trunc from 0x0060c6 to 0x039ebd (0x33df8 bytes) 000423 1789067425.011383 mapread 0x00dbe7 thru 0x00dd22 (0x13c bytes) 000424 1789067425.026211 read 0x035c66 thru 0x037cb4 (0x204f bytes) 000425 1789067425.027242 mapread 0x00b374 thru 0x00fb50 (0x47dd bytes) 000426 1789067425.028403 mapwrite 0x00b224 thru 0x00d5f0 (0x23cd bytes) 000428 1789067425.141194 trunc from 0x039ebe to 0x032023 (0x7e9a bytes) 000429 1789067425.179482 write 0x020bfd thru 0x024b0f (0x3f13 bytes) 000430 1789067425.180511 read 0x022828 thru 0x02bf54 (0x972d bytes) 000431 1789067425.181142 punch from 0x008a0f to 0x00b83a (0x2e2c bytes) 000432 1789067425.195630 read 0x0272f1 thru 0x032023 (0xad33 bytes) 000433 1789067425.196353 write 0x01615e thru 0x022833 (0xc6d6 bytes) 000437 1789067425.210979 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x32024): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32024): Mirror 6: 0x1ba9ac8 (stale) Mirror 10: 0x1ba9ac8 (stale) Mirror 11: 0x1ba9ac8 (stale) Mirror 12: 0x1ba9ac8 (stale) Mirror 13: 0x1ba9ac8 (stale) Mirror 14: 0x4e948c42 (stale) Mirror 15: 0x4e948c42 (stale) CRC-32 checksum value for chunk [0, 0x32024): Mirror 1: 0xb87936dc Mirror 16: 0xb87936dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32024: skipped 000439 1789067426.774440 punch from 0x02f2cf to 0x032023 (0x2d55 bytes) 000440 1789067426.910749 mapwrite 0x01cfb9 thru 0x02611d (0x9165 bytes) 000441 1789067427.074626 read 0x00b4bf thru 0x00b72a (0x26c bytes) 000442 1789067427.088514 punch from 0x02376c to 0x029fdc (0x6871 bytes) 000443 1789067427.106675 read 0x013bac thru 0x02021d (0xc672 bytes) 000444 1789067427.124474 trunc from 0x032024 to 0x019cdc (0x18347 bytes) 000445 1789067427.198511 mapread 0x000b88 thru 0x005217 (0x4690 bytes) 000447 1789067427.202261 write 0x012da8 thru 0x01a3bd (0x7616 bytes) 000448 1789067427.203815 punch from 0x00ad6b to 0x00bb4a (0xde0 bytes) 000449 1789067427.261369 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1a3be): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a3be): Mirror 6: 0xba13aa08 (stale) Mirror 10: 0xba13aa08 (stale) Mirror 11: 0xba13aa08 (stale) Mirror 12: 0xba13aa08 (stale) Mirror 13: 0xba13aa08 (stale) Mirror 14: 0x5f671d8f (stale) Mirror 15: 0x5f671d8f (stale) Mirror 16: 0x8bb52bbb (stale) CRC-32 checksum value for chunk [0, 0x1a3be): Mirror 1: 0x8e0431b5 Mirror 17: 0x8e0431b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a3be: skipped 000450 1789067428.559416 mapwrite 0x00ac21 thru 0x00d256 (0x2636 bytes) 000453 1789067428.761191 write 0x03a0d0 thru 0x03ffff (0x5f30 bytes) 000454 1789067428.765358 mapwrite 0x012d18 thru 0x01947b (0x6764 bytes) 000455 1789067428.842529 mapread 0x027788 thru 0x03397a (0xc1f3 bytes) 000458 1789067428.870691 mapwrite 0x022f29 thru 0x032e1f (0xfef7 bytes) 000459 1789067428.972688 mapwrite 0x01067d thru 0x01099d (0x321 bytes) 000460 1789067429.027767 mapwrite 0x02a396 thru 0x039ba9 (0xf814 bytes) 000461 1789067429.207940 trunc from 0x040000 to 0x02d24e (0x12db1 bytes) 000462 1789067429.384269 mapwrite 0x033aeb thru 0x03f587 (0xba9d bytes) 000464 1789067429.537185 read 0x0111f7 thru 0x01f991 (0xe79b bytes) 000466 1789067429.551224 write 0x02dab7 thru 0x03609c (0x85e6 bytes) 000467 1789067429.562205 mapread 0x02e37f thru 0x033cdc (0x595e bytes) 000468 1789067429.574308 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f588): Mirror 6: 0x3c9dcd3f (stale) Mirror 10: 0x3c9dcd3f (stale) Mirror 12: 0x3c9dcd3f (stale) Mirror 13: 0x3c9dcd3f (stale) Mirror 14: 0x7d8cd82c (stale) Mirror 15: 0x7d8cd82c (stale) Mirror 16: 0xca2cc27a (stale) Mirror 17: 0x7907ac10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f588): Mirror 6: 0x3c9dcd3f (stale) Mirror 10: 0x3c9dcd3f (stale) Mirror 12: 0x3c9dcd3f (stale) Mirror 13: 0x3c9dcd3f (stale) Mirror 14: 0x7d8cd82c (stale) Mirror 15: 0x7d8cd82c (stale) Mirror 16: 0xca2cc27a (stale) Mirror 17: 0x7907ac10 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f588: skipped 000469 1789067430.282484 punch from 0x009228 to 0x01808a (0xee63 bytes) 000470 1789067430.296885 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f588): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f588): Mirror 6: 0x3c9dcd3f (stale) Mirror 10: 0x3c9dcd3f (stale) Mirror 12: 0x3c9dcd3f (stale) Mirror 13: 0x3c9dcd3f (stale) Mirror 14: 0x7d8cd82c (stale) Mirror 15: 0x7d8cd82c (stale) Mirror 16: 0xca2cc27a (stale) Mirror 17: 0x7907ac10 (stale) CRC-32 checksum value for chunk [0, 0x3f588): Mirror 1: 0x97be9a38 Mirror 18: 0x97be9a38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f588: skipped 000471 1789067432.273455 mapwrite 0x00a266 thru 0x012197 (0x7f32 bytes) 000474 1789067432.516404 mapwrite 0x02a925 thru 0x02c37b (0x1a57 bytes) 000475 1789067432.562979 mapread 0x002a6b thru 0x012057 (0xf5ed bytes) 000477 1789067432.570960 mapwrite 0x02ab69 thru 0x039c04 (0xf09c bytes) 000478 1789067432.609258 mapread 0x019259 thru 0x01dd47 (0x4aef bytes) 000480 1789067432.619284 read 0x0073e4 thru 0x00c126 (0x4d43 bytes) 000482 1789067432.620450 punch from 0x0391cd to 0x03f587 (0x63bb bytes) 000483 1789067432.624336 punch from 0x00a68c to 0x00bcc8 (0x163d bytes) 000484 1789067432.628726 punch from 0x02e91d to 0x039893 (0xaf77 bytes) 000485 1789067432.635579 read 0x034885 thru 0x03a362 (0x5ade bytes) 000486 1789067432.650265 write 0x0369c2 thru 0x03ffff (0x963e bytes) 000488 1789067432.653496 read 0x0378b1 thru 0x039db4 (0x2504 bytes) 000490 1789067432.655711 read 0x0034e6 thru 0x00a5fa (0x7115 bytes) 000491 1789067432.656799 read 0x02bfe4 thru 0x0366fb (0xa718 bytes) 000492 1789067432.658453 mapwrite 0x028995 thru 0x0296c5 (0xd31 bytes) 000493 1789067432.742352 mapread 0x014942 thru 0x01d609 (0x8cc8 bytes) 000494 1789067432.745273 mapwrite 0x02fa6c thru 0x037b65 (0x80fa bytes) 000495 1789067432.818204 write 0x00708c thru 0x00961e (0x2593 bytes) 000496 1789067432.820635 mapwrite 0x008464 thru 0x00ece7 (0x6884 bytes) 000498 1789067432.879305 read 0x03efb7 thru 0x03ffff (0x1049 bytes) 000499 1789067432.880341 mapread 0x00bdc3 thru 0x00c6ef (0x92d bytes) 000501 1789067432.884725 mapwrite 0x022ac1 thru 0x02b413 (0x8953 bytes) 000503 1789067432.944203 MIRROR_RESYNC 10 mirrors 000505 1789067434.607787 mapwrite 0x01b388 thru 0x01cd42 (0x19bb bytes) 000506 1789067434.772444 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x68bb078e (stale) Mirror 10: 0x68bb078e (stale) Mirror 12: 0x68bb078e (stale) Mirror 13: 0x68bb078e (stale) Mirror 14: 0x68bb078e (stale) Mirror 15: 0x68bb078e (stale) Mirror 16: 0x68bb078e (stale) Mirror 17: 0x68bb078e (stale) Mirror 18: 0x68bb078e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7581286 Mirror 19: 0x7581286 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000508 1789067436.038176 punch from 0x0083a0 to 0x014155 (0xbdb6 bytes) 000510 1789067436.131091 write 0x02f3cd thru 0x0314dc (0x2110 bytes) 000511 1789067436.141054 trunc from 0x040000 to 0x00cd86 (0x33279 bytes) 000512 1789067436.157311 punch from 0x0030ea to 0x0042b8 (0x11cf bytes) 000514 1789067436.163225 mapwrite 0x027073 thru 0x028b0c (0x1a9a bytes) 000516 1789067436.240347 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x28b0d): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28b0d): Mirror 6: 0xf4ac546c (stale) Mirror 10: 0xf4ac546c (stale) Mirror 12: 0xf4ac546c (stale) Mirror 13: 0xf4ac546c (stale) Mirror 14: 0xf4ac546c (stale) Mirror 15: 0xf4ac546c (stale) Mirror 16: 0xf4ac546c (stale) Mirror 17: 0xf4ac546c (stale) Mirror 18: 0xf4ac546c (stale) Mirror 19: 0x2f1aeefd (stale) CRC-32 checksum value for chunk [0, 0x28b0d): Mirror 1: 0x99b7d272 Mirror 20: 0x99b7d272 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28b0d: skipped 000517 1789067437.419783 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28b0d): Mirror 6: 0xf4ac546c (stale) Mirror 10: 0xf4ac546c (stale) Mirror 12: 0xf4ac546c (stale) Mirror 13: 0xf4ac546c (stale) Mirror 14: 0xf4ac546c (stale) Mirror 15: 0xf4ac546c (stale) Mirror 17: 0xf4ac546c (stale) Mirror 18: 0xf4ac546c (stale) Mirror 19: 0x2f1aeefd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28b0d): Mirror 6: 0xf4ac546c (stale) Mirror 10: 0xf4ac546c (stale) Mirror 12: 0xf4ac546c (stale) Mirror 13: 0xf4ac546c (stale) Mirror 14: 0xf4ac546c (stale) Mirror 15: 0xf4ac546c (stale) Mirror 17: 0xf4ac546c (stale) Mirror 18: 0xf4ac546c (stale) Mirror 19: 0x2f1aeefd (stale) CRC-32 checksum value for chunk [0, 0x28b0d): Mirror 1: 0x99b7d272 Mirror 20: 0x99b7d272 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28b0d: skipped 000519 1789067438.768825 write 0x00ae90 thru 0x00ba3e (0xbaf bytes) 000521 1789067438.875132 mapwrite 0x012fe4 thru 0x022068 (0xf085 bytes) 000525 1789067438.973412 mapread 0x00c137 thru 0x00d813 (0x16dd bytes) 000526 1789067438.983530 trunc from 0x028b0d to 0x0217f5 (0x7317 bytes) 000527 1789067439.027038 mapwrite 0x00ab30 thru 0x018cdb (0xe1ac bytes) 000528 1789067439.073575 punch from 0x001d0d to 0x00c4c2 (0xa7b6 bytes) 000529 1789067439.078688 write 0x014f3a thru 0x01569c (0x763 bytes) 000530 1789067439.079735 punch from 0x01dafe to 0x01dd8d (0x290 bytes) 000532 1789067439.090521 mapwrite 0x001aa6 thru 0x003d51 (0x22ac bytes) 000534 1789067439.137117 punch from 0x017ee0 to 0x01df52 (0x6073 bytes) 000535 1789067439.143450 read 0x00fc90 thru 0x01fc03 (0xff74 bytes) 000537 1789067439.153592 write 0x01bf0b thru 0x02940a (0xd500 bytes) 000540 1789067439.157813 write 0x031470 thru 0x03796b (0x64fc bytes) 000541 1789067439.159442 write 0x03f2e1 thru 0x03ffff (0xd1f bytes) 000544 1789067439.163223 punch from 0x0323ec to 0x033539 (0x114e bytes) 000546 1789067439.185293 trunc from 0x040000 to 0x008323 (0x37cdc bytes) 000547 1789067439.207628 punch from 0x003bdc to 0x008323 (0x4748 bytes) 000548 1789067439.214479 read 0x0054f2 thru 0x008323 (0x2e32 bytes) 000549 1789067439.244813 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8324): Mirror 10: 0xa415bfc3 (stale) Mirror 12: 0xa415bfc3 (stale) Mirror 13: 0xa415bfc3 (stale) Mirror 14: 0xa415bfc3 (stale) Mirror 15: 0xa415bfc3 (stale) Mirror 17: 0xa415bfc3 (stale) Mirror 18: 0xa415bfc3 (stale) Mirror 19: 0xa415bfc3 (stale) Mirror 20: 0xa415bfc3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8324): Mirror 10: 0xa415bfc3 (stale) Mirror 12: 0xa415bfc3 (stale) Mirror 13: 0xa415bfc3 (stale) Mirror 14: 0xa415bfc3 (stale) Mirror 15: 0xa415bfc3 (stale) Mirror 17: 0xa415bfc3 (stale) Mirror 18: 0xa415bfc3 (stale) Mirror 19: 0xa415bfc3 (stale) Mirror 20: 0xa415bfc3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8324: skipped 000550 1789067440.068156 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8324): Mirror 10: 0xa415bfc3 (stale) Mirror 12: 0xa415bfc3 (stale) Mirror 13: 0xa415bfc3 (stale) Mirror 14: 0xa415bfc3 (stale) Mirror 15: 0xa415bfc3 (stale) Mirror 18: 0xa415bfc3 (stale) Mirror 19: 0xa415bfc3 (stale) Mirror 20: 0xa415bfc3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8324): Mirror 10: 0xa415bfc3 (stale) Mirror 12: 0xa415bfc3 (stale) Mirror 13: 0xa415bfc3 (stale) Mirror 14: 0xa415bfc3 (stale) Mirror 15: 0xa415bfc3 (stale) Mirror 18: 0xa415bfc3 (stale) Mirror 19: 0xa415bfc3 (stale) Mirror 20: 0xa415bfc3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8324: skipped 000551 1789067440.607672 mapread 0x0051ef thru 0x008323 (0x3135 bytes) 000552 1789067440.647623 mapread 0x004351 thru 0x008323 (0x3fd3 bytes) 000553 1789067440.648748 mapread 0x002f62 thru 0x008323 (0x53c2 bytes) 000554 1789067440.654343 trunc from 0x008324 to 0x015598 (0xd275 bytes) 000555 1789067440.683284 punch from 0x00e078 to 0x015598 (0x7521 bytes) 000557 1789067440.693090 punch from 0x0095bb to 0x00a00e (0xa54 bytes) 000558 1789067440.700299 mapwrite 0x024f36 thru 0x032ab9 (0xdb84 bytes) 000560 1789067440.940403 write 0x0306fc thru 0x036981 (0x6286 bytes) 000561 1789067440.946559 mapwrite 0x01b2c7 thru 0x023903 (0x863d bytes) 000562 1789067441.070426 write 0x03bba3 thru 0x03ffff (0x445d bytes) 000565 1789067441.072668 punch from 0x00200d to 0x01172c (0xf720 bytes) 000569 1789067441.099439 trunc from 0x040000 to 0x03e743 (0x18bc bytes) 000570 1789067441.118699 mapwrite 0x03aee0 thru 0x03ffff (0x5120 bytes) 000571 1789067441.282097 mapread 0x02213e thru 0x025fdc (0x3e9f bytes) 000572 1789067441.283169 write 0x001dd2 thru 0x003ba9 (0x1dd8 bytes) 000573 1789067441.294808 trunc from 0x040000 to 0x03a355 (0x5caa bytes) 000574 1789067441.335827 write 0x02ae81 thru 0x031690 (0x6810 bytes) 000576 1789067441.339552 mapread 0x02ad63 thru 0x02e7e7 (0x3a85 bytes) 000577 1789067441.340825 punch from 0x0100b6 to 0x01b69d (0xb5e8 bytes) 000578 1789067441.358238 read 0x007392 thru 0x008955 (0x15c4 bytes) 000579 1789067441.365832 write 0x010fda thru 0x01c3e7 (0xb40e bytes) 000580 1789067441.374289 trunc from 0x03a356 to 0x00eb58 (0x2b7fd bytes) 000581 1789067441.394330 mapread 0x002c2e thru 0x00eb58 (0xbf2b bytes) 000582 1789067441.411951 mapread 0x00262a thru 0x00eb58 (0xc52f bytes) 000584 1789067441.415368 read 0x00c454 thru 0x00eb58 (0x2705 bytes) 000586 1789067441.417761 mapread 0x002686 thru 0x0081e6 (0x5b61 bytes) 000588 1789067441.420795 mapread 0x00cf1e thru 0x00eb58 (0x1c3b bytes) 000589 1789067441.423473 write 0x01f7f5 thru 0x029321 (0x9b2d bytes) 000590 1789067441.426234 trunc from 0x029322 to 0x02e130 (0x4e0f bytes) 000592 1789067441.451408 write 0x012cdf thru 0x01aa80 (0x7da2 bytes) 000593 1789067441.464307 punch from 0x0099e5 to 0x00bad1 (0x20ed bytes) 000594 1789067441.486642 MIRROR_RESYNC 9 mirrors 000596 1789067443.819452 mapwrite 0x026b5e thru 0x030c2f (0xa0d2 bytes) 000599 1789067443.986399 mapread 0x0230d5 thru 0x02da58 (0xa984 bytes) 000600 1789067443.987591 mapwrite 0x012b29 thru 0x021770 (0xec48 bytes) 000601 1789067444.063790 mapwrite 0x00d6e1 thru 0x00dc03 (0x523 bytes) 000602 1789067444.108511 write 0x002893 thru 0x00b97a (0x90e8 bytes) 000605 1789067444.120805 read 0x02e012 thru 0x030c2f (0x2c1e bytes) 000608 1789067444.122733 write 0x03a7c2 thru 0x03ffff (0x583e bytes) 000609 1789067444.124675 mapwrite 0x0004a0 thru 0x00aa38 (0xa599 bytes) 000610 1789067444.181892 read 0x01d427 thru 0x0271c7 (0x9da1 bytes) 000612 1789067444.183476 trunc from 0x040000 to 0x036170 (0x9e8f bytes) 000616 1789067444.208582 read 0x0293e3 thru 0x02bfe1 (0x2bff bytes) 000618 1789067444.210182 read 0x0283a6 thru 0x036170 (0xddcb bytes) 000620 1789067444.220620 mapwrite 0x01b42a thru 0x021382 (0x5f59 bytes) 000621 1789067444.274707 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36171): Mirror 10: 0x54da104 (stale) Mirror 12: 0x54da104 (stale) Mirror 13: 0x54da104 (stale) Mirror 14: 0x54da104 (stale) Mirror 18: 0x54da104 (stale) Mirror 19: 0x54da104 (stale) Mirror 20: 0x54da104 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36171): Mirror 10: 0x54da104 (stale) Mirror 12: 0x54da104 (stale) Mirror 13: 0x54da104 (stale) Mirror 14: 0x54da104 (stale) Mirror 18: 0x54da104 (stale) Mirror 19: 0x54da104 (stale) Mirror 20: 0x54da104 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36171: skipped 000624 1789067444.755649 mapwrite 0x03918f thru 0x03ed96 (0x5c08 bytes) 000625 1789067444.850253 mapread 0x02dcec thru 0x02fffa (0x230f bytes) 000626 1789067444.866369 mapread 0x023b37 thru 0x033564 (0xfa2e bytes) 000627 1789067444.883306 mapread 0x001ade thru 0x00ace0 (0x9203 bytes) 000629 1789067444.904909 write 0x034392 thru 0x03ffff (0xbc6e bytes) 000630 1789067444.906231 punch from 0x03090b to 0x036f03 (0x65f9 bytes) 000632 1789067444.935773 trunc from 0x040000 to 0x008b2c (0x374d3 bytes) 000633 1789067444.953753 read 0x001ce7 thru 0x008b2c (0x6e46 bytes) 000634 1789067444.955938 mapread 0x005368 thru 0x008b2c (0x37c5 bytes) 000635 1789067444.962250 MIRROR_RESYNC 8 mirrors 000636 1789067446.603286 mapwrite 0x02ea4b thru 0x037c66 (0x921c bytes) 000639 1789067446.770576 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37c67): Mirror 10: 0x5af82e8f (stale) Mirror 13: 0x5af82e8f (stale) Mirror 14: 0x5af82e8f (stale) Mirror 18: 0x5af82e8f (stale) Mirror 19: 0x5af82e8f (stale) Mirror 20: 0x5af82e8f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c67): Mirror 10: 0x5af82e8f (stale) Mirror 13: 0x5af82e8f (stale) Mirror 14: 0x5af82e8f (stale) Mirror 18: 0x5af82e8f (stale) Mirror 19: 0x5af82e8f (stale) Mirror 20: 0x5af82e8f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c67: skipped 000641 1789067447.395808 write 0x0284de thru 0x037fa9 (0xfacc bytes) 000642 1789067447.414695 read 0x0154c6 thru 0x01a06f (0x4baa bytes) 000643 1789067447.426451 mapwrite 0x022f77 thru 0x02ea02 (0xba8c bytes) 000644 1789067447.514245 punch from 0x021688 to 0x02b582 (0x9efb bytes) 000648 1789067447.521654 trunc from 0x037faa to 0x00e59d (0x29a0c bytes) 000649 1789067447.546585 read 0x0088c3 thru 0x00dfb6 (0x56f4 bytes) 000651 1789067447.556598 mapread 0x000afa thru 0x00a58a (0x9a91 bytes) 000655 1789067447.562253 trunc from 0x00e59e to 0x0011ab (0xd3f2 bytes) 000656 1789067447.580378 mapread 0x001138 thru 0x0011ab (0x74 bytes) 000658 1789067447.582974 trunc from 0x0011ac to 0x01fbfa (0x1ea4f bytes) 000659 1789067447.603433 trunc from 0x01fbfb to 0x022305 (0x270b bytes) 000661 1789067447.626689 trunc from 0x022306 to 0x025261 (0x2f5c bytes) 000663 1789067447.650488 trunc from 0x025262 to 0x01fa88 (0x57d9 bytes) 000664 1789067447.670439 mapread 0x013148 thru 0x01b19b (0x8054 bytes) 000666 1789067447.689006 trunc from 0x01fa89 to 0x0284a9 (0x8a21 bytes) 000668 1789067447.728903 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x284aa): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x284aa): Mirror 10: 0x2dbff15e (stale) Mirror 13: 0x2dbff15e (stale) Mirror 14: 0x2dbff15e (stale) Mirror 18: 0x2dbff15e (stale) Mirror 19: 0x2dbff15e (stale) Mirror 20: 0x2dbff15e (stale) CRC-32 checksum value for chunk [0, 0x284aa): Mirror 1: 0xd059c33a Mirror 21: 0xd059c33a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x284aa: skipped 000670 1789067449.566492 trunc from 0x0284aa to 0x01621d (0x1228c bytes) 000671 1789067449.675177 mapwrite 0x02fe8e thru 0x0318b1 (0x1a24 bytes) 000675 1789067449.798115 mapread 0x015db2 thru 0x01f2ad (0x94fc bytes) 000676 1789067449.816599 write 0x007884 thru 0x00afd7 (0x3754 bytes) 000677 1789067449.828800 mapread 0x0126af thru 0x014301 (0x1c53 bytes) 000678 1789067449.830163 mapread 0x021759 thru 0x02b8bc (0xa164 bytes) 000679 1789067449.836633 mapwrite 0x0299cc thru 0x02e831 (0x4e66 bytes) 000682 1789067449.891147 write 0x025cdd thru 0x02cdf9 (0x711d bytes) 000683 1789067449.892467 mapread 0x0081ca thru 0x010c57 (0x8a8e bytes) 000684 1789067449.903766 punch from 0x02501b to 0x03020e (0xb1f4 bytes) 000686 1789067449.916522 punch from 0x019ad0 to 0x02185b (0x7d8c bytes) 000687 1789067449.922739 write 0x03ec6c thru 0x03ffff (0x1394 bytes) 000688 1789067449.924371 write 0x037ae6 thru 0x03ffff (0x851a bytes) 000689 1789067449.930913 read 0x0359c6 thru 0x03fa67 (0xa0a2 bytes) 000690 1789067449.937542 read 0x00f198 thru 0x0125b6 (0x341f bytes) 000691 1789067449.938516 read 0x0356d7 thru 0x03db27 (0x8451 bytes) 000692 1789067449.939784 read 0x024fde thru 0x02c945 (0x7968 bytes) 000693 1789067449.951026 mapread 0x026e38 thru 0x030691 (0x985a bytes) 000694 1789067449.952294 read 0x0186e4 thru 0x01b3f1 (0x2d0e bytes) 000695 1789067449.953927 punch from 0x0012d6 to 0x00c9ef (0xb71a bytes) 000696 1789067449.966913 read 0x00fdc8 thru 0x015a26 (0x5c5f bytes) 000698 1789067449.969222 punch from 0x01603d to 0x019773 (0x3737 bytes) 000701 1789067449.975461 trunc from 0x040000 to 0x00464e (0x3b9b1 bytes) 000702 1789067449.997977 mapread 0x000748 thru 0x00464e (0x3f07 bytes) 000703 1789067450.006753 read 0x0018ac thru 0x00464e (0x2da3 bytes) 000704 1789067450.009061 read 0x004536 thru 0x00464e (0x119 bytes) 000705 1789067450.010062 mapwrite 0x007577 thru 0x0159dd (0xe467 bytes) 000706 1789067450.087381 mapread 0x00d45e thru 0x013a6a (0x660d bytes) 000707 1789067450.093906 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x159de): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x159de): Mirror 10: 0xd8989cfe (stale) Mirror 13: 0xd8989cfe (stale) Mirror 14: 0xd8989cfe (stale) Mirror 18: 0xd8989cfe (stale) Mirror 19: 0xd8989cfe (stale) Mirror 20: 0xd8989cfe (stale) Mirror 21: 0x17287cdc (stale) CRC-32 checksum value for chunk [0, 0x159de): Mirror 1: 0x8600b0bc Mirror 22: 0x8600b0bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x159de: skipped 000708 1789067450.825820 mapwrite 0x03e706 thru 0x03ffff (0x18fa bytes) 000709 1789067450.974984 punch from 0x038b15 to 0x03f519 (0x6a05 bytes) 000710 1789067450.981454 write 0x03444a thru 0x03ffff (0xbbb6 bytes) 000712 1789067450.990477 punch from 0x009b65 to 0x0144d1 (0xa96d bytes) 000713 1789067450.999796 punch from 0x0119fa to 0x013329 (0x1930 bytes) 000716 1789067451.005626 mapread 0x01e184 thru 0x0260c1 (0x7f3e bytes) 000717 1789067451.020436 write 0x025658 thru 0x02a357 (0x4d00 bytes) 000718 1789067451.024740 write 0x019bf9 thru 0x024755 (0xab5d bytes) 000719 1789067451.026042 read 0x013834 thru 0x018a6a (0x5237 bytes) 000720 1789067451.030317 trunc from 0x040000 to 0x02ce57 (0x131a8 bytes) 000721 1789067451.047725 read 0x0116cc thru 0x0182fe (0x6c33 bytes) 000722 1789067451.058073 mapwrite 0x02a8f3 thru 0x031695 (0x6da3 bytes) 000724 1789067451.106152 trunc from 0x031696 to 0x0143dd (0x1d2b8 bytes) 000725 1789067451.123112 MIRROR_RESYNC 9 mirrors 000726 1789067452.477265 mapwrite 0x000040 thru 0x00fc01 (0xfbc2 bytes) 000727 1789067452.751826 trunc from 0x0143de to 0x01df6a (0x9b8d bytes) 000728 1789067452.826286 punch from 0x003391 to 0x00aa8b (0x76fb bytes) 000730 1789067452.836308 punch from 0x0103cd to 0x01c834 (0xc468 bytes) 000731 1789067452.848958 trunc from 0x01df6b to 0x00aa48 (0x13522 bytes) 000732 1789067452.880481 mapread 0x0099ce thru 0x00a79c (0xdcf bytes) 000733 1789067452.890482 mapread 0x0026eb thru 0x00aa48 (0x835e bytes) 000734 1789067452.892329 punch from 0x000847 to 0x008809 (0x7fc3 bytes) 000735 1789067452.898366 punch from 0x003e4f to 0x00aa48 (0x6bfa bytes) 000738 1789067452.908657 trunc from 0x00aa49 to 0x0022d0 (0x8778 bytes) 000739 1789067452.935222 mapwrite 0x02b865 thru 0x02c142 (0x8de bytes) 000741 1789067453.077665 read 0x01c903 thru 0x026d4e (0xa44c bytes) 000742 1789067453.091886 mapwrite 0x0326b1 thru 0x036372 (0x3cc2 bytes) 000743 1789067453.200050 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36373): Mirror 10: 0xc7f26b96 (stale) Mirror 13: 0xc7f26b96 (stale) Mirror 18: 0xc7f26b96 (stale) Mirror 19: 0xc7f26b96 (stale) Mirror 20: 0xc7f26b96 (stale) Mirror 21: 0xc7f26b96 (stale) Mirror 22: 0xc7f26b96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36373): Mirror 10: 0xc7f26b96 (stale) Mirror 13: 0xc7f26b96 (stale) Mirror 18: 0xc7f26b96 (stale) Mirror 19: 0xc7f26b96 (stale) Mirror 20: 0xc7f26b96 (stale) Mirror 21: 0xc7f26b96 (stale) Mirror 22: 0xc7f26b96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36373: skipped 000745 1789067453.874523 punch from 0x009332 to 0x00dae7 (0x47b6 bytes) 000746 1789067453.883703 write 0x035fa3 thru 0x03c7d5 (0x6833 bytes) 000749 1789067453.893107 trunc from 0x03c7d6 to 0x00ead7 (0x2dcfe bytes) 000751 1789067453.924684 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xead8): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xead8): Mirror 10: 0xf517f350 (stale) Mirror 13: 0xf517f350 (stale) Mirror 18: 0xf517f350 (stale) Mirror 19: 0xf517f350 (stale) Mirror 20: 0xf517f350 (stale) Mirror 21: 0xf517f350 (stale) Mirror 22: 0xf517f350 (stale) CRC-32 checksum value for chunk [0, 0xead8): Mirror 1: 0x77053186 Mirror 23: 0x77053186 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xead8: skipped 000752 1789067455.274452 trunc from 0x00ead8 to 0x0134c1 (0x49ea bytes) 000753 1789067455.459047 write 0x03aefb thru 0x03e395 (0x349b bytes) 000755 1789067455.466178 punch from 0x02f0ea to 0x03139d (0x22b4 bytes) 000756 1789067455.488103 read 0x03817e thru 0x03e395 (0x6218 bytes) 000757 1789067455.499134 mapread 0x011697 thru 0x011a29 (0x393 bytes) 000759 1789067455.518935 mapwrite 0x0004a2 thru 0x00ec3a (0xe799 bytes) 000760 1789067455.670468 punch from 0x01fdb8 to 0x02aab6 (0xacff bytes) 000762 1789067455.677313 mapwrite 0x0080ea thru 0x01005d (0x7f74 bytes) 000763 1789067455.823213 MIRROR_RESYNC 9 mirrors 000764 1789067457.836149 trunc from 0x03e396 to 0x01a5ad (0x23de8 bytes) 000765 1789067457.923773 read 0x007d03 thru 0x009ac3 (0x1dc1 bytes) 000766 1789067457.930590 mapwrite 0x018504 thru 0x025a6b (0xd568 bytes) 000767 1789067458.065815 mapread 0x0076b8 thru 0x01103a (0x9983 bytes) 000771 1789067458.085277 mapwrite 0x0106aa thru 0x018873 (0x81ca bytes) 000772 1789067458.167724 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 10: 0xf8bd4740 (stale) Mirror 13: 0xf8bd4740 (stale) Mirror 18: 0xf8bd4740 (stale) Mirror 19: 0xf8bd4740 (stale) Mirror 20: 0xf8bd4740 (stale) Mirror 21: 0xf8bd4740 (stale) Mirror 22: 0xf8bd4740 (stale) Mirror 23: 0xf8bd4740 (stale) CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 1: 0xeb449a56 Mirror 24: 0xeb449a56 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a6c: skipped 000774 1789067459.109484 read 0x001245 thru 0x00f651 (0xe40d bytes) 000776 1789067459.146478 read 0x016148 thru 0x01f8e1 (0x979a bytes) 000777 1789067459.170784 mapread 0x0054f7 thru 0x005712 (0x21c bytes) 000778 1789067459.193815 mapwrite 0x00469f thru 0x00d1c7 (0x8b29 bytes) 000779 1789067459.489422 read 0x007346 thru 0x00b08f (0x3d4a bytes) 000780 1789067459.490224 punch from 0x0017cf to 0x009051 (0x7883 bytes) 000781 1789067459.501004 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 10: 0xf8bd4740 (stale) Mirror 13: 0xf8bd4740 (stale) Mirror 18: 0xf8bd4740 (stale) Mirror 19: 0xf8bd4740 (stale) Mirror 20: 0xf8bd4740 (stale) Mirror 21: 0xf8bd4740 (stale) Mirror 22: 0xf8bd4740 (stale) Mirror 23: 0xf8bd4740 (stale) Mirror 24: 0xeb449a56 (stale) CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 1: 0x1ac8bf73 Mirror 25: 0x1ac8bf73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a6c: skipped 000783 1789067460.587668 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 10: 0xf8bd4740 (stale) Mirror 13: 0xf8bd4740 (stale) Mirror 18: 0xf8bd4740 (stale) Mirror 19: 0xf8bd4740 (stale) Mirror 20: 0xf8bd4740 (stale) Mirror 21: 0xf8bd4740 (stale) Mirror 22: 0xf8bd4740 (stale) Mirror 23: 0xf8bd4740 (stale) Mirror 24: 0xeb449a56 (stale) CRC-32 checksum value for chunk [0, 0x25a6c): Mirror 1: 0x1ac8bf73 Mirror 25: 0x1ac8bf73 Mirror 26: 0x1ac8bf73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a6c: skipped 000784 1789067461.563595 read 0x017aeb thru 0x023224 (0xb73a bytes) 000787 1789067461.578199 trunc from 0x025a6c to 0x024081 (0x19ea bytes) 000790 1789067461.744813 mapread 0x01b9d0 thru 0x021046 (0x5677 bytes) 000791 1789067461.803623 write 0x0351f0 thru 0x03bb91 (0x69a2 bytes) 000793 1789067461.807358 read 0x038a4b thru 0x03bb91 (0x3147 bytes) 000794 1789067461.815036 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3bb92): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bb92): Mirror 10: 0xfc51da20 (stale) Mirror 13: 0xfc51da20 (stale) Mirror 18: 0xfc51da20 (stale) Mirror 19: 0xfc51da20 (stale) Mirror 20: 0xfc51da20 (stale) Mirror 21: 0xfc51da20 (stale) Mirror 22: 0xfc51da20 (stale) Mirror 23: 0xfc51da20 (stale) Mirror 24: 0xc4b71515 (stale) Mirror 25: 0x6b4d0ab9 (stale) Mirror 26: 0x6b4d0ab9 (stale) CRC-32 checksum value for chunk [0, 0x3bb92): Mirror 1: 0x3bd5bf4d Mirror 27: 0x3bd5bf4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bb92: skipped 000795 1789067463.059091 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3bb92): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bb92): Mirror 10: 0xfc51da20 (stale) Mirror 13: 0xfc51da20 (stale) Mirror 18: 0xfc51da20 (stale) Mirror 19: 0xfc51da20 (stale) Mirror 20: 0xfc51da20 (stale) Mirror 21: 0xfc51da20 (stale) Mirror 22: 0xfc51da20 (stale) Mirror 23: 0xfc51da20 (stale) Mirror 24: 0xc4b71515 (stale) Mirror 25: 0x6b4d0ab9 (stale) Mirror 26: 0x6b4d0ab9 (stale) CRC-32 checksum value for chunk [0, 0x3bb92): Mirror 1: 0x3bd5bf4d Mirror 27: 0x3bd5bf4d Mirror 28: 0x3bd5bf4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bb92: skipped 000796 1789067464.904799 read 0x000f84 thru 0x00a43f (0x94bc bytes) 000797 1789067464.915347 mapwrite 0x01b8a2 thru 0x026ff9 (0xb758 bytes) 000798 1789067465.121701 punch from 0x03a2ae to 0x03bb91 (0x18e4 bytes) 000799 1789067465.129184 write 0x02de6a thru 0x034e7d (0x7014 bytes) 000800 1789067465.142361 trunc from 0x03bb92 to 0x034dfb (0x6d96 bytes) 000803 1789067465.198790 write 0x000194 thru 0x00fd1d (0xfb8a bytes) 000804 1789067465.215683 mapwrite 0x0230bd thru 0x0299a7 (0x68eb bytes) 000805 1789067465.319781 trunc from 0x034dfc to 0x03ec62 (0x9e67 bytes) 000807 1789067465.360153 trunc from 0x03ec63 to 0x0300ba (0xeba8 bytes) 000808 1789067465.392136 trunc from 0x0300bb to 0x035612 (0x5558 bytes) 000809 1789067465.420479 read 0x00926c thru 0x00de51 (0x4be6 bytes) 000811 1789067465.423421 write 0x001094 thru 0x001ddb (0xd48 bytes) 000812 1789067465.425195 trunc from 0x035613 to 0x03b17b (0x5b69 bytes) 000813 1789067465.453540 trunc from 0x03b17c to 0x000da2 (0x3a3d9 bytes) 000814 1789067465.476412 read 0x000d41 thru 0x000da2 (0x62 bytes) 000815 1789067465.483627 mapwrite 0x0230c0 thru 0x024024 (0xf65 bytes) 000816 1789067465.585694 trunc from 0x024025 to 0x01c2f9 (0x7d2b bytes) 000817 1789067465.619428 write 0x010886 thru 0x0155ed (0x4d68 bytes) 000818 1789067465.632624 mapwrite 0x0266c4 thru 0x033164 (0xcaa1 bytes) 000819 1789067465.800263 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x33165): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33165): Mirror 10: 0x84380e74 (stale) Mirror 13: 0x84380e74 (stale) Mirror 18: 0x84380e74 (stale) Mirror 19: 0x84380e74 (stale) Mirror 20: 0x84380e74 (stale) Mirror 21: 0x84380e74 (stale) Mirror 22: 0x84380e74 (stale) Mirror 23: 0x84380e74 (stale) Mirror 24: 0x71e82ba3 (stale) Mirror 25: 0x31962c2d (stale) Mirror 26: 0x31962c2d (stale) Mirror 27: 0x314a0185 (stale) Mirror 28: 0x314a0185 (stale) CRC-32 checksum value for chunk [0, 0x33165): Mirror 1: 0x487f3885 Mirror 29: 0x487f3885 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33165: skipped 000820 1789067467.389633 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x33165): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33165): Mirror 10: 0x84380e74 (stale) Mirror 13: 0x84380e74 (stale) Mirror 18: 0x84380e74 (stale) Mirror 19: 0x84380e74 (stale) Mirror 20: 0x84380e74 (stale) Mirror 21: 0x84380e74 (stale) Mirror 22: 0x84380e74 (stale) Mirror 23: 0x84380e74 (stale) Mirror 24: 0x71e82ba3 (stale) Mirror 25: 0x31962c2d (stale) Mirror 26: 0x31962c2d (stale) Mirror 27: 0x314a0185 (stale) Mirror 28: 0x314a0185 (stale) CRC-32 checksum value for chunk [0, 0x33165): Mirror 1: 0x487f3885 Mirror 29: 0x487f3885 Mirror 30: 0x487f3885 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33165: skipped 000821 1789067469.300665 write 0x019375 thru 0x01b634 (0x22c0 bytes) 000823 1789067469.403620 MIRROR_RESYNC 16 mirrors 000824 1789067473.720639 trunc from 0x033165 to 0x009b5f (0x29605 bytes) 000826 1789067473.808543 write 0x0000ab thru 0x002bcf (0x2b25 bytes) 000827 1789067473.818647 punch from 0x0086d3 to 0x009b5f (0x148d bytes) 000828 1789067473.827982 mapwrite 0x011769 thru 0x014196 (0x2a2e bytes) 000830 1789067473.931545 mapread 0x00610f thru 0x00fa31 (0x9923 bytes) 000832 1789067473.947678 trunc from 0x014197 to 0x00aaef (0x96a7 bytes) 000833 1789067473.970256 read 0x005c81 thru 0x00aaef (0x4e6f bytes) 000835 1789067473.972034 punch from 0x0089c4 to 0x00aaef (0x212c bytes) 000836 1789067473.977530 write 0x00d72f thru 0x00dbc9 (0x49b bytes) 000837 1789067473.979662 trunc from 0x00dbca to 0x00abb2 (0x3017 bytes) 000839 1789067473.996465 mapread 0x00723d thru 0x0095b8 (0x237c bytes) 000840 1789067474.008440 read 0x008f88 thru 0x00abb2 (0x1c2b bytes) 000841 1789067474.009330 punch from 0x000a05 to 0x00a79d (0x9d99 bytes) 000843 1789067474.016102 mapwrite 0x01aaeb thru 0x01d6d8 (0x2bee bytes) 000845 1789067474.081327 write 0x014079 thru 0x0189de (0x4966 bytes) 000846 1789067474.083554 mapread 0x00e0c9 thru 0x015e15 (0x7d4d bytes) 000847 1789067474.084880 mapread 0x017c23 thru 0x01c44b (0x4829 bytes) 000849 1789067474.087604 mapwrite 0x02543c thru 0x02f30a (0x9ecf bytes) 000850 1789067474.158900 mapread 0x00fbcb thru 0x01b4ce (0xb904 bytes) 000851 1789067474.160108 mapread 0x010d5e thru 0x01eca6 (0xdf49 bytes) 000852 1789067474.163091 trunc from 0x02f30b to 0x01ad6d (0x1459d bytes) 000853 1789067474.181340 punch from 0x0055a7 to 0x011bbf (0xc619 bytes) 000855 1789067474.187959 mapwrite 0x006fc3 thru 0x007af6 (0xb34 bytes) 000856 1789067474.238029 write 0x03e88f thru 0x03ffff (0x1771 bytes) 000858 1789067474.242536 mapread 0x01c69b thru 0x01dca2 (0x1608 bytes) 000859 1789067474.254975 read 0x017ade thru 0x022caf (0xb1d2 bytes) 000860 1789067474.266137 read 0x01ef57 thru 0x0228f3 (0x399d bytes) 000862 1789067474.267676 mapread 0x018a14 thru 0x01a963 (0x1f50 bytes) 000863 1789067474.274497 MIRROR_RESYNC 16 mirrors 000864 1789067479.608254 read 0x029e4b thru 0x032667 (0x881d bytes) 000865 1789067479.626820 punch from 0x03aca0 to 0x03ffff (0x5360 bytes) 000866 1789067479.848566 punch from 0x01fc60 to 0x026d2a (0x70cb bytes) 000868 1789067479.859791 write 0x0002cd thru 0x00495e (0x4692 bytes) 000869 1789067479.880377 MIRROR_SPLIT mirror 7 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x13cc898f (stale) Mirror 13: 0x13cc898f (stale) Mirror 18: 0x13cc898f (stale) Mirror 19: 0x13cc898f (stale) Mirror 20: 0x13cc898f (stale) Mirror 21: 0x13cc898f (stale) Mirror 23: 0x13cc898f (stale) Mirror 24: 0x13cc898f (stale) Mirror 25: 0x13cc898f (stale) Mirror 26: 0x13cc898f (stale) Mirror 27: 0x13cc898f (stale) Mirror 28: 0x13cc898f (stale) Mirror 29: 0x13cc898f (stale) Mirror 30: 0x13cc898f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x13cc898f (stale) Mirror 13: 0x13cc898f (stale) Mirror 18: 0x13cc898f (stale) Mirror 19: 0x13cc898f (stale) Mirror 20: 0x13cc898f (stale) Mirror 21: 0x13cc898f (stale) Mirror 23: 0x13cc898f (stale) Mirror 24: 0x13cc898f (stale) Mirror 25: 0x13cc898f (stale) Mirror 26: 0x13cc898f (stale) Mirror 27: 0x13cc898f (stale) Mirror 28: 0x13cc898f (stale) Mirror 29: 0x13cc898f (stale) Mirror 30: 0x13cc898f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000870 1789067480.957634 read 0x0088b0 thru 0x015525 (0xcc76 bytes) 000871 1789067480.969526 mapwrite 0x01ac55 thru 0x023ea5 (0x9251 bytes) 000873 1789067481.037942 trunc from 0x040000 to 0x03348c (0xcb73 bytes) 000874 1789067481.062443 mapread 0x0301cc thru 0x03348c (0x32c1 bytes) 000875 1789067481.081268 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3348d): Mirror 13: 0x404fae2b (stale) Mirror 18: 0x404fae2b (stale) Mirror 19: 0x404fae2b (stale) Mirror 20: 0x404fae2b (stale) Mirror 21: 0x404fae2b (stale) Mirror 23: 0x404fae2b (stale) Mirror 24: 0x404fae2b (stale) Mirror 25: 0x404fae2b (stale) Mirror 26: 0x404fae2b (stale) Mirror 27: 0x404fae2b (stale) Mirror 28: 0x404fae2b (stale) Mirror 29: 0x404fae2b (stale) Mirror 30: 0x404fae2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3348d): Mirror 13: 0x404fae2b (stale) Mirror 18: 0x404fae2b (stale) Mirror 19: 0x404fae2b (stale) Mirror 20: 0x404fae2b (stale) Mirror 21: 0x404fae2b (stale) Mirror 23: 0x404fae2b (stale) Mirror 24: 0x404fae2b (stale) Mirror 25: 0x404fae2b (stale) Mirror 26: 0x404fae2b (stale) Mirror 27: 0x404fae2b (stale) Mirror 28: 0x404fae2b (stale) Mirror 29: 0x404fae2b (stale) Mirror 30: 0x404fae2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3348d: skipped 000876 1789067481.849206 mapread 0x02c15a thru 0x03348c (0x7333 bytes) 000877 1789067481.880193 mapread 0x0279c0 thru 0x031939 (0x9f7a bytes) 000879 1789067481.883047 mapread 0x02f76a thru 0x03348c (0x3d23 bytes) 000880 1789067481.888319 mapread 0x01bcce thru 0x026b28 (0xae5b bytes) 000881 1789067481.930000 read 0x0224da thru 0x024ad3 (0x25fa bytes) 000882 1789067481.931982 write 0x01df64 thru 0x02862d (0xa6ca bytes) 000883 1789067481.935390 punch from 0x0151bf to 0x01fc77 (0xaab9 bytes) 000885 1789067481.962604 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3348d): Mirror 18: 0x404fae2b (stale) Mirror 19: 0x404fae2b (stale) Mirror 20: 0x404fae2b (stale) Mirror 21: 0x404fae2b (stale) Mirror 23: 0x404fae2b (stale) Mirror 24: 0x404fae2b (stale) Mirror 25: 0x404fae2b (stale) Mirror 26: 0x404fae2b (stale) Mirror 27: 0x404fae2b (stale) Mirror 28: 0x404fae2b (stale) Mirror 29: 0x404fae2b (stale) Mirror 30: 0x404fae2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3348d): Mirror 18: 0x404fae2b (stale) Mirror 19: 0x404fae2b (stale) Mirror 20: 0x404fae2b (stale) Mirror 21: 0x404fae2b (stale) Mirror 23: 0x404fae2b (stale) Mirror 24: 0x404fae2b (stale) Mirror 25: 0x404fae2b (stale) Mirror 26: 0x404fae2b (stale) Mirror 27: 0x404fae2b (stale) Mirror 28: 0x404fae2b (stale) Mirror 29: 0x404fae2b (stale) Mirror 30: 0x404fae2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3348d: skipped 000886 1789067482.787990 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3348d): Mirror 18: 0x404fae2b (stale) Mirror 19: 0x404fae2b (stale) Mirror 20: 0x404fae2b (stale) Mirror 23: 0x404fae2b (stale) Mirror 24: 0x404fae2b (stale) Mirror 25: 0x404fae2b (stale) Mirror 26: 0x404fae2b (stale) Mirror 27: 0x404fae2b (stale) Mirror 28: 0x404fae2b (stale) Mirror 29: 0x404fae2b (stale) Mirror 30: 0x404fae2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3348d): Mirror 18: 0x404fae2b (stale) Mirror 19: 0x404fae2b (stale) Mirror 20: 0x404fae2b (stale) Mirror 23: 0x404fae2b (stale) Mirror 24: 0x404fae2b (stale) Mirror 25: 0x404fae2b (stale) Mirror 26: 0x404fae2b (stale) Mirror 27: 0x404fae2b (stale) Mirror 28: 0x404fae2b (stale) Mirror 29: 0x404fae2b (stale) Mirror 30: 0x404fae2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3348d: skipped 000887 1789067483.415767 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3348d): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3348d): Mirror 18: 0x404fae2b (stale) Mirror 19: 0x404fae2b (stale) Mirror 20: 0x404fae2b (stale) Mirror 23: 0x404fae2b (stale) Mirror 24: 0x404fae2b (stale) Mirror 25: 0x404fae2b (stale) Mirror 26: 0x404fae2b (stale) Mirror 27: 0x404fae2b (stale) Mirror 28: 0x404fae2b (stale) Mirror 29: 0x404fae2b (stale) Mirror 30: 0x404fae2b (stale) CRC-32 checksum value for chunk [0, 0x3348d): Mirror 1: 0x9c8ac04b Mirror 31: 0x9c8ac04b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3348d: skipped 000888 1789067485.311047 read 0x002383 thru 0x0094f7 (0x7175 bytes) 000889 1789067485.340004 mapread 0x02c441 thru 0x02f458 (0x3018 bytes) 000891 1789067485.405755 punch from 0x01142e to 0x019e7c (0x8a4f bytes) 000892 1789067485.514509 trunc from 0x03348d to 0x008018 (0x2b474 bytes) 000894 1789067485.541605 trunc from 0x008019 to 0x000048 (0x7fd0 bytes) 000895 1789067485.559896 trunc from 0x000049 to 0x011648 (0x11600 bytes) 000896 1789067485.577777 trunc from 0x011649 to 0x02ae23 (0x197db bytes) 000897 1789067485.600988 trunc from 0x02ae24 to 0x02dbf4 (0x2dd1 bytes) 000899 1789067485.621607 read 0x02c757 thru 0x02dbf4 (0x149e bytes) 000900 1789067485.645726 trunc from 0x02dbf5 to 0x019de7 (0x13e0d bytes) 000901 1789067485.676037 read 0x01249b thru 0x019de7 (0x794d bytes) 000902 1789067485.677145 trunc from 0x019de8 to 0x001806 (0x185e1 bytes) 000905 1789067485.698514 mapread 0x000417 thru 0x001806 (0x13f0 bytes) 000907 1789067485.702236 mapread 0x000662 thru 0x001806 (0x11a5 bytes) 000908 1789067485.703707 read 0x000b16 thru 0x001806 (0xcf1 bytes) 000909 1789067485.705317 mapread 0x000c8c thru 0x000ef0 (0x265 bytes) 000910 1789067485.716655 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1807): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1807): Mirror 18: 0x3556adba (stale) Mirror 19: 0x3556adba (stale) Mirror 20: 0x3556adba (stale) Mirror 23: 0x3556adba (stale) Mirror 24: 0x3556adba (stale) Mirror 25: 0x3556adba (stale) Mirror 26: 0x3556adba (stale) Mirror 27: 0x3556adba (stale) Mirror 28: 0x3556adba (stale) Mirror 29: 0x3556adba (stale) Mirror 30: 0x3556adba (stale) Mirror 31: 0x3f44d8e (stale) CRC-32 checksum value for chunk [0, 0x1807): Mirror 1: 0xb0408192 Mirror 32: 0xb0408192 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1807: skipped 000912 1789067486.814771 mapread 0x00027d thru 0x001806 (0x158a bytes) 000913 1789067486.845990 read 0x00126e thru 0x001806 (0x599 bytes) 000916 1789067486.862011 mapwrite 0x02a613 thru 0x03176b (0x7159 bytes) 000917 1789067486.973773 mapread 0x031168 thru 0x03130b (0x1a4 bytes) 000919 1789067486.975465 trunc from 0x03176c to 0x01f137 (0x12634 bytes) 000920 1789067486.996887 trunc from 0x01f138 to 0x0013e0 (0x1dd57 bytes) 000922 1789067487.015461 mapwrite 0x004074 thru 0x0122a3 (0xe230 bytes) 000923 1789067487.088608 mapread 0x00da10 thru 0x0122a3 (0x4894 bytes) 000924 1789067487.090193 trunc from 0x0122a4 to 0x03b407 (0x29164 bytes) 000925 1789067487.107676 write 0x03aae5 thru 0x03ea71 (0x3f8d bytes) 000927 1789067487.119119 mapwrite 0x0219aa thru 0x022a14 (0x106b bytes) 000928 1789067487.165527 punch from 0x01a8b8 to 0x01e301 (0x3a4a bytes) 000929 1789067487.173211 mapread 0x020361 thru 0x021b6a (0x180a bytes) 000930 1789067487.174143 mapwrite 0x00d390 thru 0x015688 (0x82f9 bytes) 000931 1789067487.235947 punch from 0x03549b to 0x0359e9 (0x54f bytes) 000932 1789067487.243570 write 0x01e92c thru 0x0260a5 (0x777a bytes) 000933 1789067487.249682 mapwrite 0x0313fc thru 0x03db1d (0xc722 bytes) 000938 1789067487.317290 read 0x02b4e6 thru 0x030de0 (0x58fb bytes) 000939 1789067487.321498 read 0x02f25b thru 0x036a1b (0x77c1 bytes) 000940 1789067487.323033 mapread 0x02d00e thru 0x02daa3 (0xa96 bytes) 000941 1789067487.324372 punch from 0x038719 to 0x03ea71 (0x6359 bytes) 000946 1789067487.349337 mapread 0x039349 thru 0x03ea71 (0x5729 bytes) 000947 1789067487.360581 trunc from 0x03ea72 to 0x01f0bd (0x1f9b4 bytes) 000949 1789067487.401526 read 0x006222 thru 0x00f36a (0x9149 bytes) 000950 1789067487.402384 mapread 0x011564 thru 0x01f0bd (0xdb5a bytes) 000951 1789067487.405412 write 0x002ddf thru 0x00b60f (0x8831 bytes) 000952 1789067487.410151 trunc from 0x01f0be to 0x00fdbe (0xf2ff bytes) 000953 1789067487.449350 trunc from 0x00fdbf to 0x01e678 (0xe8ba bytes) 000954 1789067487.480720 mapwrite 0x02d499 thru 0x036d52 (0x98ba bytes) 000955 1789067487.652088 read 0x000ecb thru 0x003d62 (0x2e98 bytes) 000957 1789067487.653213 mapwrite 0x018e09 thru 0x0203e9 (0x75e1 bytes) 000958 1789067487.726051 punch from 0x010bf3 to 0x01c4ec (0xb8fa bytes) 000959 1789067487.739441 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36d53): Mirror 18: 0x6b05e06 (stale) Mirror 19: 0x6b05e06 (stale) Mirror 20: 0x6b05e06 (stale) Mirror 23: 0x6b05e06 (stale) Mirror 24: 0x6b05e06 (stale) Mirror 25: 0x6b05e06 (stale) Mirror 26: 0x6b05e06 (stale) Mirror 28: 0x6b05e06 (stale) Mirror 29: 0x6b05e06 (stale) Mirror 30: 0x6b05e06 (stale) Mirror 31: 0xf8d60d61 (stale) Mirror 32: 0x823f5174 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d53): Mirror 18: 0x6b05e06 (stale) Mirror 19: 0x6b05e06 (stale) Mirror 20: 0x6b05e06 (stale) Mirror 23: 0x6b05e06 (stale) Mirror 24: 0x6b05e06 (stale) Mirror 25: 0x6b05e06 (stale) Mirror 26: 0x6b05e06 (stale) Mirror 28: 0x6b05e06 (stale) Mirror 29: 0x6b05e06 (stale) Mirror 30: 0x6b05e06 (stale) Mirror 31: 0xf8d60d61 (stale) Mirror 32: 0x823f5174 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d53: skipped 000960 1789067488.834510 read 0x012aeb thru 0x0138f6 (0xe0c bytes) 000961 1789067488.842903 punch from 0x01bd78 to 0x026bdd (0xae66 bytes) 000962 1789067488.857178 mapread 0x0363b1 thru 0x036d52 (0x9a2 bytes) 000963 1789067488.876690 trunc from 0x036d53 to 0x036324 (0xa2e bytes) 000967 1789067488.913517 write 0x002ee6 thru 0x005afb (0x2c16 bytes) 000969 1789067488.938653 mapread 0x01a6b4 thru 0x01c5f0 (0x1f3d bytes) 000970 1789067488.977536 mapwrite 0x02ccb8 thru 0x039354 (0xc69d bytes) 000971 1789067489.174190 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39355): Mirror 18: 0x3d3953ab (stale) Mirror 19: 0x3d3953ab (stale) Mirror 23: 0x3d3953ab (stale) Mirror 24: 0x3d3953ab (stale) Mirror 25: 0x3d3953ab (stale) Mirror 26: 0x3d3953ab (stale) Mirror 28: 0x3d3953ab (stale) Mirror 29: 0x3d3953ab (stale) Mirror 30: 0x3d3953ab (stale) Mirror 31: 0xa3929f45 (stale) Mirror 32: 0xa9eafb0f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39355): Mirror 18: 0x3d3953ab (stale) Mirror 19: 0x3d3953ab (stale) Mirror 23: 0x3d3953ab (stale) Mirror 24: 0x3d3953ab (stale) Mirror 25: 0x3d3953ab (stale) Mirror 26: 0x3d3953ab (stale) Mirror 28: 0x3d3953ab (stale) Mirror 29: 0x3d3953ab (stale) Mirror 30: 0x3d3953ab (stale) Mirror 31: 0xa3929f45 (stale) Mirror 32: 0xa9eafb0f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39355: skipped 000974 1789067489.988314 mapread 0x00641d thru 0x00688b (0x46f bytes) 000975 1789067489.997317 trunc from 0x039355 to 0x01b50e (0x1de46 bytes) 000977 1789067490.030643 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1b50f): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b50f): Mirror 18: 0x97851a92 (stale) Mirror 19: 0x97851a92 (stale) Mirror 23: 0x97851a92 (stale) Mirror 24: 0x97851a92 (stale) Mirror 25: 0x97851a92 (stale) Mirror 26: 0x97851a92 (stale) Mirror 28: 0x97851a92 (stale) Mirror 29: 0x97851a92 (stale) Mirror 30: 0x97851a92 (stale) Mirror 31: 0x589399ba (stale) Mirror 32: 0x186e6138 (stale) CRC-32 checksum value for chunk [0, 0x1b50f): Mirror 1: 0x5e0df941 Mirror 33: 0x5e0df941 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b50f: skipped 000979 1789067491.421436 mapwrite 0x0097ef thru 0x00a59b (0xdad bytes) 000980 1789067491.808408 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1b50f): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b50f): Mirror 18: 0x97851a92 (stale) Mirror 19: 0x97851a92 (stale) Mirror 23: 0x97851a92 (stale) Mirror 24: 0x97851a92 (stale) Mirror 25: 0x97851a92 (stale) Mirror 26: 0x97851a92 (stale) Mirror 28: 0x97851a92 (stale) Mirror 29: 0x97851a92 (stale) Mirror 30: 0x97851a92 (stale) Mirror 31: 0x589399ba (stale) Mirror 32: 0x186e6138 (stale) Mirror 33: 0x5e0df941 (stale) CRC-32 checksum value for chunk [0, 0x1b50f): Mirror 1: 0x6241f9b9 Mirror 34: 0x6241f9b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b50f: skipped 000982 1789067493.586287 MIRROR_RESYNC 14 mirrors 000983 1789067496.590354 mapwrite 0x017584 thru 0x0263c6 (0xee43 bytes) 000984 1789067496.813372 read 0x01360f thru 0x0220e8 (0xeada bytes) 000985 1789067496.814546 read 0x01e0db thru 0x01fb7c (0x1aa2 bytes) 000986 1789067496.816398 trunc from 0x0263c7 to 0x019085 (0xd341 bytes) 000989 1789067496.845035 write 0x03922a thru 0x03ffff (0x6dd6 bytes) 000991 1789067496.849433 trunc from 0x040000 to 0x00a198 (0x35e67 bytes) 000993 1789067496.872787 read 0x006068 thru 0x00a198 (0x4131 bytes) 000994 1789067496.884375 mapwrite 0x021aba thru 0x025bc2 (0x4109 bytes) 000995 1789067496.985483 write 0x01905c thru 0x01fa51 (0x69f6 bytes) 000997 1789067496.992809 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25bc3): Mirror 18: 0x896f7794 (stale) Mirror 19: 0x896f7794 (stale) Mirror 23: 0x896f7794 (stale) Mirror 24: 0x896f7794 (stale) Mirror 25: 0x896f7794 (stale) Mirror 26: 0x896f7794 (stale) Mirror 29: 0x896f7794 (stale) Mirror 30: 0x896f7794 (stale) Mirror 31: 0x896f7794 (stale) Mirror 32: 0x896f7794 (stale) Mirror 33: 0x896f7794 (stale) Mirror 34: 0x896f7794 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25bc3): Mirror 18: 0x896f7794 (stale) Mirror 19: 0x896f7794 (stale) Mirror 23: 0x896f7794 (stale) Mirror 24: 0x896f7794 (stale) Mirror 25: 0x896f7794 (stale) Mirror 26: 0x896f7794 (stale) Mirror 29: 0x896f7794 (stale) Mirror 30: 0x896f7794 (stale) Mirror 31: 0x896f7794 (stale) Mirror 32: 0x896f7794 (stale) Mirror 33: 0x896f7794 (stale) Mirror 34: 0x896f7794 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25bc3: skipped 000998 1789067497.963578 mapread 0x020981 thru 0x024961 (0x3fe1 bytes) 000999 1789067497.986666 mapread 0x011c35 thru 0x01f4b1 (0xd87d bytes) 001000 1789067498.003769 mapread 0x005094 thru 0x006f08 (0x1e75 bytes) All operations completed A-OK!