== sanity-flr test 70a: flr mode fsx test ================ 10:52:10 (1775832730) Seed set to 2731 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read 000007 1775832731.486433 mapwrite 0x01d9c2 thru 0x02941b (0xba5a bytes) truncating to largest ever: 0xcbc1 000008 1775832731.550621 trunc from 0x02941c to 0x00cbc0 (0x1c85b bytes) 000009 1775832731.558509 write 0x0393ea thru 0x03a17e (0xd95 bytes) 000010 1775832731.559666 trunc from 0x03a17f to 0x002ffe (0x37180 bytes) 000012 1775832731.568199 mapread 0x000248 thru 0x002ffe (0x2db7 bytes) 000013 1775832731.572570 read 0x001ae7 thru 0x002ffe (0x1518 bytes) 000014 1775832731.573188 read 0x000651 thru 0x002ffe (0x29ae bytes) 000016 1775832731.574245 write 0x039eb3 thru 0x03ffff (0x614d bytes) 000017 1775832731.577884 MIRROR_EXTEND to 2 mirrors 000018 1775832731.834204 read 0x03f43b thru 0x03ffff (0xbc5 bytes) truncating to largest ever: 0x2668f 000019 1775832731.839561 trunc from 0x040000 to 0x02668e (0x19971 bytes) 000021 1775832731.883833 trunc from 0x02668f to 0x020fbf (0x56cf bytes) 000023 1775832731.897542 write 0x02b00e thru 0x03522f (0xa222 bytes) 000026 1775832731.899873 write 0x00eaf9 thru 0x01a705 (0xbc0d bytes) 000027 1775832731.906717 mapread 0x0235ea thru 0x02efde (0xb9f5 bytes) 000028 1775832731.913271 mapwrite 0x00b350 thru 0x00c33b (0xfec bytes) 000031 1775832731.952061 trunc from 0x035230 to 0x0251fa (0x10035 bytes) 000032 1775832731.965770 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x251fb): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x251fb): Mirror 2: 0x84377786 (stale) CRC-32 checksum value for chunk [0, 0x251fb): Mirror 1: 0xac4cbb6c Mirror 3: 0xac4cbb6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x251fb: skipped truncating to largest ever: 0x2a46c 000033 1775832732.394890 trunc from 0x0251fb to 0x02a46b (0x5271 bytes) 000034 1775832732.442513 trunc from 0x02a46c to 0x002dd6 (0x27695 bytes) 000035 1775832732.453753 read 0x00121f thru 0x002dd6 (0x1bb8 bytes) 000036 1775832732.457884 mapread 0x000246 thru 0x000759 (0x514 bytes) 000038 1775832732.464328 mapwrite 0x027e5d thru 0x033b33 (0xbcd7 bytes) 000039 1775832732.525835 mapread 0x00723f thru 0x00e044 (0x6e06 bytes) 000041 1775832732.533569 trunc from 0x033b34 to 0x01e38c (0x157a7 bytes) 000042 1775832732.544371 mapread 0x0123c0 thru 0x01da28 (0xb669 bytes) 000046 1775832732.557821 mapwrite 0x03c2d2 thru 0x03ffff (0x3d2e bytes) 000048 1775832732.602482 mapread 0x024bfb thru 0x02571a (0xb20 bytes) 000050 1775832732.609504 trunc from 0x040000 to 0x00c50d (0x33af2 bytes) 000052 1775832732.620561 write 0x006369 thru 0x01177b (0xb413 bytes) 000054 1775832732.621933 write 0x026971 thru 0x02f94c (0x8fdc bytes) 000055 1775832732.622944 mapread 0x0142b1 thru 0x016689 (0x23d9 bytes) 000057 1775832732.630079 write 0x01e484 thru 0x020375 (0x1ef2 bytes) 000058 1775832732.640152 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f94d): Mirror 3: 0x3a1bc308 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f94d): Mirror 3: 0x3a1bc308 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f94d: skipped 000060 1775832732.785460 read 0x02c54e thru 0x02f94c (0x33ff bytes) 000061 1775832732.789811 mapwrite 0x028a6b thru 0x02b11e (0x26b4 bytes) 000064 1775832732.830269 read 0x015af2 thru 0x018ca8 (0x31b7 bytes) 000065 1775832732.840530 trunc from 0x02f94d to 0x023180 (0xc7cc bytes) 000067 1775832732.853795 write 0x02ea4b thru 0x03de7e (0xf434 bytes) 000068 1775832732.855543 mapwrite 0x01eee2 thru 0x02c129 (0xd248 bytes) 000070 1775832732.946859 read 0x01c75b thru 0x0267ed (0xa093 bytes) 000073 1775832732.950587 mapwrite 0x023dfe thru 0x02b1e0 (0x73e3 bytes) 000075 1775832732.975545 write 0x00cb8a thru 0x016a9c (0x9f13 bytes) 000076 1775832732.976906 read 0x031cd4 thru 0x03a27e (0x85ab bytes) 000080 1775832732.979521 read 0x0312a0 thru 0x03dc5a (0xc9bb bytes) 000081 1775832732.980363 mapread 0x0132ef thru 0x0165d8 (0x32ea bytes) 000082 1775832732.981390 mapwrite 0x016703 thru 0x01c524 (0x5e22 bytes) 000083 1775832733.015446 trunc from 0x03de7f to 0x02890a (0x15574 bytes) 000085 1775832733.033017 MIRROR_RESYNC 2 mirrors 000088 1775832733.359794 mapread 0x015303 thru 0x01c4cd (0x71cb bytes) 000089 1775832733.370815 trunc from 0x02890b to 0x0229d6 (0x5f34 bytes) 000092 1775832733.409989 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) truncating to largest ever: 0x2ecd7 000093 1775832733.489365 trunc from 0x0229d7 to 0x02ecd6 (0xc300 bytes) 000094 1775832733.501263 trunc from 0x02ecd7 to 0x012f2c (0x1bdaa bytes) 000095 1775832733.510073 read 0x01102a thru 0x012f2c (0x1f03 bytes) 000099 1775832733.516689 read 0x005760 thru 0x00d670 (0x7f11 bytes) 000100 1775832733.523246 mapwrite 0x01ed46 thru 0x02c848 (0xdb03 bytes) 000101 1775832733.576688 mapread 0x00e872 thru 0x01bf03 (0xd692 bytes) 000103 1775832733.578556 read 0x01cf48 thru 0x01fb5a (0x2c13 bytes) 000104 1775832733.579142 read 0x004596 thru 0x0122a1 (0xdd0c bytes) 000108 1775832733.581514 write 0x0162b6 thru 0x01848f (0x21da bytes) 000109 1775832733.582462 read 0x01db53 thru 0x0244e5 (0x6993 bytes) 000110 1775832733.583068 mapread 0x00acfe thru 0x01327f (0x8582 bytes) 000113 1775832733.585269 mapread 0x0250f4 thru 0x02c848 (0x7755 bytes) truncating to largest ever: 0x3285d 000114 1775832733.586266 trunc from 0x02c849 to 0x03285c (0x6014 bytes) 000116 1775832733.599402 mapread 0x005209 thru 0x005bf8 (0x9f0 bytes) 000117 1775832733.600318 trunc from 0x03285d to 0x01268b (0x201d1 bytes) 000118 1775832733.614247 mapwrite 0x022230 thru 0x027545 (0x5316 bytes) 000120 1775832733.670783 trunc from 0x027546 to 0x00056e (0x26fd7 bytes) 000121 1775832733.690239 write 0x0325fd thru 0x03ffff (0xda03 bytes) 000122 1775832733.696684 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x38f61 000123 1775832733.979542 trunc from 0x040000 to 0x038f60 (0x709f bytes) 000124 1775832734.036594 mapread 0x02cf30 thru 0x0308df (0x39b0 bytes) 000125 1775832734.058666 mapread 0x032c32 thru 0x036631 (0x3a00 bytes) 000127 1775832734.060354 trunc from 0x038f61 to 0x00ce3c (0x2c124 bytes) 000128 1775832734.086075 read 0x00c700 thru 0x00ce3c (0x73d bytes) 000129 1775832734.091942 read 0x008c5f thru 0x00ce3c (0x41de bytes) 000138 1775832734.105492 mapread 0x0076a3 thru 0x00ce3c (0x579a bytes) 000139 1775832734.110125 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) 000142 1775832734.209220 mapwrite 0x03c8f7 thru 0x03d380 (0xa8a bytes) 000143 1775832734.253809 mapwrite 0x037524 thru 0x03ffff (0x8adc bytes) 000144 1775832734.314560 mapread 0x000162 thru 0x003c6f (0x3b0e bytes) 000146 1775832734.325741 MIRROR_EXTEND to 2 mirrors 000147 1775832734.636032 MIRROR_EXTEND to 3 mirrors 000148 1775832734.921433 read 0x030c5a thru 0x036d9f (0x6146 bytes) 000149 1775832734.931113 mapwrite 0x01c84f thru 0x01e5e1 (0x1d93 bytes) 000150 1775832735.076989 MIRROR_RESYNC 3 mirrors 000151 1775832735.456379 mapread 0x012635 thru 0x0149c3 (0x238f bytes) 000152 1775832735.471444 MIRROR_EXTEND to 4 mirrors 000154 1775832735.794170 trunc from 0x040000 to 0x0210b3 (0x1ef4c bytes) 000157 1775832735.838090 mapread 0x00b301 thru 0x01232a (0x702a bytes) 000158 1775832735.849416 read 0x00dcb8 thru 0x01ad61 (0xd0aa bytes) 000159 1775832735.853701 write 0x03111f thru 0x03191e (0x800 bytes) 000160 1775832735.858226 MIRROR_RESYNC 4 mirrors 000161 1775832736.280119 mapread 0x008ffd thru 0x009611 (0x615 bytes) 000163 1775832736.288103 mapwrite 0x01f760 thru 0x01f9cb (0x26c bytes) 000164 1775832736.387869 mapwrite 0x017455 thru 0x0235ce (0xc17a bytes) 000165 1775832736.422975 read 0x0072f8 thru 0x00b41f (0x4128 bytes) 000167 1775832736.428536 read 0x00796d thru 0x008970 (0x1004 bytes) 000169 1775832736.429760 mapwrite 0x036803 thru 0x03ffff (0x97fd bytes) 000170 1775832736.475806 trunc from 0x040000 to 0x01d532 (0x22acd bytes) 000172 1775832736.488213 read 0x004b7e thru 0x0118e5 (0xcd68 bytes) 000173 1775832736.488982 write 0x025f6e thru 0x030a31 (0xaac4 bytes) 000175 1775832736.495071 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x30a32): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30a32): Mirror 2: 0x9f978783 (stale) Mirror 3: 0x9f978783 (stale) Mirror 4: 0x9f978783 (stale) CRC-32 checksum value for chunk [0, 0x30a32): Mirror 1: 0x9e1e1ec4 Mirror 5: 0x9e1e1ec4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30a32: skipped 000178 1775832736.915268 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x30a32): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30a32): Mirror 2: 0x9f978783 (stale) Mirror 3: 0x9f978783 (stale) Mirror 4: 0x9f978783 (stale) CRC-32 checksum value for chunk [0, 0x30a32): Mirror 1: 0x9e1e1ec4 Mirror 5: 0x9e1e1ec4 Mirror 6: 0x9e1e1ec4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30a32: skipped 000179 1775832737.415977 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x30a32): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30a32): Mirror 2: 0x9f978783 (stale) Mirror 3: 0x9f978783 (stale) Mirror 4: 0x9f978783 (stale) CRC-32 checksum value for chunk [0, 0x30a32): Mirror 1: 0x9e1e1ec4 Mirror 5: 0x9e1e1ec4 Mirror 6: 0x9e1e1ec4 Mirror 7: 0x9e1e1ec4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30a32: skipped 000181 1775832737.879425 mapread 0x024adb thru 0x0262f9 (0x181f bytes) 000182 1775832737.894126 write 0x0335aa thru 0x034cdc (0x1733 bytes) 000183 1775832737.943542 read 0x025fbe thru 0x0313b9 (0xb3fc bytes) 000185 1775832737.955015 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x34cdd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34cdd): Mirror 2: 0xb3bcaf6 (stale) Mirror 3: 0xb3bcaf6 (stale) Mirror 4: 0xb3bcaf6 (stale) Mirror 5: 0x1c6ae1c2 (stale) Mirror 6: 0x1c6ae1c2 (stale) Mirror 7: 0x1c6ae1c2 (stale) CRC-32 checksum value for chunk [0, 0x34cdd): Mirror 1: 0x6ef2a523 Mirror 8: 0x6ef2a523 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34cdd: skipped 000186 1775832738.553880 mapread 0x00e0ff thru 0x00f48c (0x138e bytes) 000187 1775832738.582244 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x34cdd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34cdd): Mirror 2: 0xb3bcaf6 (stale) Mirror 3: 0xb3bcaf6 (stale) Mirror 4: 0xb3bcaf6 (stale) Mirror 5: 0x1c6ae1c2 (stale) Mirror 6: 0x1c6ae1c2 (stale) Mirror 7: 0x1c6ae1c2 (stale) CRC-32 checksum value for chunk [0, 0x34cdd): Mirror 1: 0x6ef2a523 Mirror 8: 0x6ef2a523 Mirror 9: 0x6ef2a523 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34cdd: skipped 000188 1775832739.143519 write 0x038e0e thru 0x03e1b9 (0x53ac bytes) 000190 1775832739.183869 read 0x013521 thru 0x01ae9e (0x797e bytes) 000191 1775832739.193576 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3e1ba): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e1ba): Mirror 2: 0xddb0ad35 (stale) Mirror 3: 0xddb0ad35 (stale) Mirror 4: 0xddb0ad35 (stale) Mirror 5: 0x9d14b396 (stale) Mirror 6: 0x9d14b396 (stale) Mirror 7: 0x9d14b396 (stale) Mirror 8: 0xc295da0c (stale) Mirror 9: 0xc295da0c (stale) CRC-32 checksum value for chunk [0, 0x3e1ba): Mirror 1: 0xa7187ad6 Mirror 10: 0xa7187ad6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e1ba: skipped 000192 1775832739.694054 trunc from 0x03e1ba to 0x0348b2 (0x9907 bytes) 000193 1775832739.783035 trunc from 0x0348b3 to 0x00f920 (0x24f92 bytes) 000194 1775832739.798773 write 0x002953 thru 0x0081e6 (0x5894 bytes) 000195 1775832739.806953 mapwrite 0x03566b thru 0x03e9b2 (0x9348 bytes) 000199 1775832739.872598 trunc from 0x03e9b3 to 0x001114 (0x3d89e bytes) 000201 1775832739.888477 mapwrite 0x03e23b thru 0x03ffff (0x1dc5 bytes) 000205 1775832739.945338 read 0x002cec thru 0x00e743 (0xba58 bytes) 000206 1775832739.954929 read 0x02c292 thru 0x03477a (0x84e9 bytes) 000208 1775832739.963010 mapread 0x00bdcd thru 0x00e8fc (0x2b30 bytes) 000210 1775832739.964869 mapread 0x038228 thru 0x03ffff (0x7dd8 bytes) 000211 1775832739.965938 mapwrite 0x039edd thru 0x03ffff (0x6123 bytes) 000212 1775832739.999125 trunc from 0x040000 to 0x035c0c (0xa3f3 bytes) 000213 1775832740.013520 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x35c0d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c0d): Mirror 2: 0x478fc6f6 (stale) Mirror 3: 0x478fc6f6 (stale) Mirror 4: 0x478fc6f6 (stale) Mirror 5: 0x7a035021 (stale) Mirror 6: 0x7a035021 (stale) Mirror 7: 0x7a035021 (stale) Mirror 8: 0xdb138bf5 (stale) Mirror 9: 0xdb138bf5 (stale) Mirror 10: 0xdb138bf5 (stale) CRC-32 checksum value for chunk [0, 0x35c0d): Mirror 1: 0xc517cbbe Mirror 11: 0xc517cbbe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c0d: skipped 000215 1775832740.562976 write 0x001842 thru 0x00185a (0x19 bytes) 000216 1775832740.600037 mapwrite 0x00c3a3 thru 0x0196b3 (0xd311 bytes) 000217 1775832740.652979 read 0x024b76 thru 0x029d84 (0x520f bytes) 000218 1775832740.661674 read 0x01b8f4 thru 0x025e1b (0xa528 bytes) 000219 1775832740.670367 mapread 0x025ecd thru 0x031d23 (0xbe57 bytes) 000223 1775832740.677809 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x35c0d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c0d): Mirror 2: 0x478fc6f6 (stale) Mirror 3: 0x478fc6f6 (stale) Mirror 4: 0x478fc6f6 (stale) Mirror 5: 0x7a035021 (stale) Mirror 6: 0x7a035021 (stale) Mirror 7: 0x7a035021 (stale) Mirror 8: 0xdb138bf5 (stale) Mirror 9: 0xdb138bf5 (stale) Mirror 10: 0xdb138bf5 (stale) Mirror 11: 0xc517cbbe (stale) CRC-32 checksum value for chunk [0, 0x35c0d): Mirror 1: 0x225598be Mirror 12: 0x225598be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c0d: skipped 000225 1775832741.175110 mapread 0x00612b thru 0x011b93 (0xba69 bytes) 000226 1775832741.203857 MIRROR_RESYNC 12 mirrors 000228 1775832742.157531 read 0x016f00 thru 0x0184d9 (0x15da bytes) 000230 1775832742.163250 mapread 0x008a19 thru 0x00e2c3 (0x58ab bytes) 000234 1775832742.181962 mapwrite 0x00824d thru 0x010bec (0x89a0 bytes) 000235 1775832742.284775 write 0x00bcd4 thru 0x0179ad (0xbcda bytes) 000236 1775832742.291690 mapread 0x014c21 thru 0x01bf0c (0x72ec bytes) 000241 1775832742.306209 trunc from 0x035c0d to 0x02828b (0xd981 bytes) 000242 1775832742.339995 mapwrite 0x025e92 thru 0x03318e (0xd2fd bytes) 000243 1775832742.408612 mapread 0x013659 thru 0x01bcd0 (0x8678 bytes) 000244 1775832742.409712 read 0x031e17 thru 0x03318e (0x1378 bytes) 000247 1775832742.411238 mapwrite 0x029a14 thru 0x036291 (0xc87e bytes) 000248 1775832742.459781 trunc from 0x036292 to 0x00c473 (0x29e1e bytes) 000251 1775832742.474260 write 0x03d36d thru 0x03ffff (0x2c93 bytes) 000253 1775832742.477104 write 0x006192 thru 0x012eff (0xcd6e bytes) 000254 1775832742.482564 mapread 0x03b83f thru 0x03ffff (0x47c1 bytes) 000256 1775832742.484067 write 0x009dfb thru 0x00e8ea (0x4af0 bytes) 000257 1775832742.485091 trunc from 0x040000 to 0x0252d5 (0x1ad2a bytes) 000258 1775832742.496053 trunc from 0x0252d6 to 0x0014d5 (0x23e00 bytes) 000259 1775832742.514826 mapwrite 0x00a0c5 thru 0x018273 (0xe1af bytes) 000260 1775832742.608763 mapwrite 0x0380e0 thru 0x03ffff (0x7f20 bytes) 000261 1775832742.678132 write 0x02add0 thru 0x03733c (0xc56d bytes) 000264 1775832742.691918 read 0x027852 thru 0x02faa3 (0x8252 bytes) 000265 1775832742.701321 write 0x017f15 thru 0x018d7b (0xe67 bytes) 000267 1775832742.702589 mapwrite 0x036edd thru 0x03ffff (0x9123 bytes) 000269 1775832742.740329 mapread 0x036ba1 thru 0x03ffff (0x945f bytes) 000271 1775832742.744840 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x665f8d95 (stale) Mirror 4: 0x665f8d95 (stale) Mirror 5: 0x665f8d95 (stale) Mirror 6: 0x665f8d95 (stale) Mirror 7: 0x665f8d95 (stale) Mirror 8: 0x665f8d95 (stale) Mirror 9: 0x665f8d95 (stale) Mirror 10: 0x665f8d95 (stale) Mirror 11: 0x665f8d95 (stale) Mirror 12: 0x665f8d95 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x665f8d95 (stale) Mirror 4: 0x665f8d95 (stale) Mirror 5: 0x665f8d95 (stale) Mirror 6: 0x665f8d95 (stale) Mirror 7: 0x665f8d95 (stale) Mirror 8: 0x665f8d95 (stale) Mirror 9: 0x665f8d95 (stale) Mirror 10: 0x665f8d95 (stale) Mirror 11: 0x665f8d95 (stale) Mirror 12: 0x665f8d95 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000272 1775832743.130495 mapwrite 0x016da2 thru 0x022fc2 (0xc221 bytes) 000274 1775832743.190383 read 0x00cf6b thru 0x015485 (0x851b bytes) 000275 1775832743.197548 mapwrite 0x03c3ca thru 0x03cf4f (0xb86 bytes) 000277 1775832743.247172 trunc from 0x040000 to 0x00bd46 (0x342b9 bytes) 000278 1775832743.258104 read 0x0097f5 thru 0x00bd46 (0x2552 bytes) 000279 1775832743.266027 mapwrite 0x03ebd3 thru 0x03ffff (0x142d bytes) 000281 1775832743.309956 mapwrite 0x0104fe thru 0x01e84b (0xe34e bytes) 000283 1775832743.344903 mapread 0x01bc82 thru 0x02486b (0x8bea bytes) 000284 1775832743.346004 mapwrite 0x027dc1 thru 0x034062 (0xc2a2 bytes) 000285 1775832743.396346 write 0x016f58 thru 0x01b729 (0x47d2 bytes) 000286 1775832743.397494 write 0x03a0ce thru 0x03ffff (0x5f32 bytes) 000288 1775832743.399736 mapread 0x02f054 thru 0x0300d9 (0x1086 bytes) 000292 1775832743.402362 mapwrite 0x02e18d thru 0x03ac48 (0xcabc bytes) 000294 1775832743.450465 read 0x014798 thru 0x01a784 (0x5fed bytes) 000295 1775832743.458447 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x665f8d95 (stale) Mirror 4: 0x665f8d95 (stale) Mirror 5: 0x665f8d95 (stale) Mirror 6: 0x665f8d95 (stale) Mirror 7: 0x665f8d95 (stale) Mirror 8: 0x665f8d95 (stale) Mirror 9: 0x665f8d95 (stale) Mirror 10: 0x665f8d95 (stale) Mirror 11: 0x665f8d95 (stale) Mirror 12: 0x665f8d95 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfc8350f9 Mirror 13: 0xfc8350f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000296 1775832743.938402 write 0x01b623 thru 0x01c63b (0x1019 bytes) 000299 1775832743.978609 write 0x039c12 thru 0x03ffff (0x63ee bytes) 000301 1775832743.988903 mapread 0x03431c thru 0x03ce88 (0x8b6d bytes) 000304 1775832743.990947 write 0x00de66 thru 0x016607 (0x87a2 bytes) 000306 1775832743.999083 mapwrite 0x00a045 thru 0x00abc5 (0xb81 bytes) 000308 1775832744.030181 MIRROR_RESYNC 12 mirrors 000310 1775832744.884798 read 0x03499a thru 0x03e7e9 (0x9e50 bytes) 000311 1775832744.893553 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) 000312 1775832745.154025 mapwrite 0x01f5f2 thru 0x02b6aa (0xc0b9 bytes) 000313 1775832745.255505 mapwrite 0x03a1c1 thru 0x03ffff (0x5e3f bytes) 000315 1775832745.295978 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc01bc501 (stale) Mirror 4: 0xc01bc501 (stale) Mirror 5: 0xc01bc501 (stale) Mirror 6: 0xc01bc501 (stale) Mirror 8: 0xc01bc501 (stale) Mirror 9: 0xc01bc501 (stale) Mirror 10: 0xc01bc501 (stale) Mirror 12: 0xc01bc501 (stale) Mirror 13: 0xc01bc501 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc01bc501 (stale) Mirror 4: 0xc01bc501 (stale) Mirror 5: 0xc01bc501 (stale) Mirror 6: 0xc01bc501 (stale) Mirror 8: 0xc01bc501 (stale) Mirror 9: 0xc01bc501 (stale) Mirror 10: 0xc01bc501 (stale) Mirror 12: 0xc01bc501 (stale) Mirror 13: 0xc01bc501 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000316 1775832745.596659 trunc from 0x040000 to 0x00d7e2 (0x3281d bytes) 000318 1775832745.606513 read 0x004c20 thru 0x00d7e2 (0x8bc3 bytes) 000319 1775832745.611670 trunc from 0x00d7e3 to 0x00f28f (0x1aad bytes) 000320 1775832745.619858 trunc from 0x00f290 to 0x0143e0 (0x5151 bytes) 000321 1775832745.629009 mapread 0x004b3c thru 0x010464 (0xb929 bytes) 000325 1775832745.644807 read 0x003b02 thru 0x0108a9 (0xcda8 bytes) 000327 1775832745.650600 write 0x03dc09 thru 0x03ffff (0x23f7 bytes) 000329 1775832745.655390 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc01bc501 (stale) Mirror 4: 0xc01bc501 (stale) Mirror 5: 0xc01bc501 (stale) Mirror 6: 0xc01bc501 (stale) Mirror 8: 0xc01bc501 (stale) Mirror 9: 0xc01bc501 (stale) Mirror 10: 0xc01bc501 (stale) Mirror 12: 0xc01bc501 (stale) Mirror 13: 0xc01bc501 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xffa8508 Mirror 14: 0xffa8508 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000330 1775832746.194974 mapwrite 0x03d23a thru 0x03ffff (0x2dc6 bytes) 000334 1775832746.324012 MIRROR_RESYNC 11 mirrors 000337 1775832747.168049 trunc from 0x040000 to 0x00938d (0x36c72 bytes) 000338 1775832747.219246 mapread 0x000705 thru 0x005178 (0x4a74 bytes) 000341 1775832747.232487 mapread 0x00307e thru 0x00938d (0x6310 bytes) 000344 1775832747.234214 trunc from 0x00938e to 0x00a591 (0x1204 bytes) 000345 1775832747.248042 mapread 0x008ed2 thru 0x00a591 (0x16c0 bytes) 000349 1775832747.252880 mapwrite 0x03ed57 thru 0x03ffff (0x12a9 bytes) 000350 1775832747.301934 read 0x01cd48 thru 0x02351e (0x67d7 bytes) 000353 1775832747.309158 mapwrite 0x021dbc thru 0x02365f (0x18a4 bytes) 000355 1775832747.337181 read 0x03f33a thru 0x03ffff (0xcc6 bytes) 000356 1775832747.337939 read 0x0196f5 thru 0x023c2d (0xa539 bytes) 000360 1775832747.350544 mapwrite 0x0222e0 thru 0x02a870 (0x8591 bytes) 000361 1775832747.374676 mapwrite 0x031645 thru 0x03ffff (0xe9bb bytes) 000362 1775832747.410529 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa687a26a (stale) Mirror 5: 0xa687a26a (stale) Mirror 6: 0xa687a26a (stale) Mirror 8: 0xa687a26a (stale) Mirror 9: 0xa687a26a (stale) Mirror 10: 0xa687a26a (stale) Mirror 12: 0xa687a26a (stale) Mirror 13: 0xa687a26a (stale) Mirror 14: 0xa687a26a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa687a26a (stale) Mirror 5: 0xa687a26a (stale) Mirror 6: 0xa687a26a (stale) Mirror 8: 0xa687a26a (stale) Mirror 9: 0xa687a26a (stale) Mirror 10: 0xa687a26a (stale) Mirror 12: 0xa687a26a (stale) Mirror 13: 0xa687a26a (stale) Mirror 14: 0xa687a26a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000363 1775832747.763516 mapread 0x00982d thru 0x018803 (0xefd7 bytes) 000367 1775832747.788838 MIRROR_RESYNC 10 mirrors 000369 1775832748.668222 trunc from 0x040000 to 0x02782d (0x187d2 bytes) 000370 1775832748.722718 read 0x0129f1 thru 0x01d119 (0xa729 bytes) 000371 1775832748.729138 mapread 0x002df8 thru 0x00f8f4 (0xcafd bytes) 000372 1775832748.744751 read 0x01de32 thru 0x02782d (0x99fc bytes) 000373 1775832748.752637 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2782e): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2782e): Mirror 3: 0x8ec62e09 (stale) Mirror 5: 0x8ec62e09 (stale) Mirror 6: 0x8ec62e09 (stale) Mirror 8: 0x8ec62e09 (stale) Mirror 9: 0x8ec62e09 (stale) Mirror 10: 0x8ec62e09 (stale) Mirror 12: 0x8ec62e09 (stale) Mirror 13: 0x8ec62e09 (stale) Mirror 14: 0x8ec62e09 (stale) CRC-32 checksum value for chunk [0, 0x2782e): Mirror 1: 0x8ec62e09 Mirror 15: 0x8ec62e09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2782e: skipped 000374 1775832749.264577 mapwrite 0x03c9b1 thru 0x03ffff (0x364f bytes) 000376 1775832749.366583 write 0x015d35 thru 0x01f4ac (0x9778 bytes) truncating to largest ever: 0x3d25c 000377 1775832749.383907 trunc from 0x040000 to 0x03d25b (0x2da4 bytes) 000378 1775832749.397956 trunc from 0x03d25c to 0x039cd9 (0x3582 bytes) 000384 1775832749.416348 trunc from 0x039cda to 0x01493f (0x2539a bytes) 000386 1775832749.428255 write 0x0051fd thru 0x00bffd (0x6e01 bytes) 000389 1775832749.441179 mapread 0x00ff32 thru 0x01493f (0x4a0e bytes) 000390 1775832749.442441 write 0x032bbd thru 0x03861c (0x5a60 bytes) 000393 1775832749.445046 write 0x01aed9 thru 0x0288f3 (0xda1b bytes) 000394 1775832749.458811 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3861d): Mirror 5: 0x6649a551 (stale) Mirror 6: 0x6649a551 (stale) Mirror 8: 0x6649a551 (stale) Mirror 9: 0x6649a551 (stale) Mirror 10: 0x6649a551 (stale) Mirror 12: 0x6649a551 (stale) Mirror 13: 0x6649a551 (stale) Mirror 14: 0x6649a551 (stale) Mirror 15: 0x8986d3d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3861d): Mirror 5: 0x6649a551 (stale) Mirror 6: 0x6649a551 (stale) Mirror 8: 0x6649a551 (stale) Mirror 9: 0x6649a551 (stale) Mirror 10: 0x6649a551 (stale) Mirror 12: 0x6649a551 (stale) Mirror 13: 0x6649a551 (stale) Mirror 14: 0x6649a551 (stale) Mirror 15: 0x8986d3d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3861d: skipped 000395 1775832749.777858 mapread 0x031281 thru 0x03861c (0x739c bytes) 000396 1775832749.800023 trunc from 0x03861d to 0x0201af (0x1846d bytes) 000397 1775832749.809610 mapwrite 0x0036f5 thru 0x00932c (0x5c38 bytes) 000398 1775832749.841991 mapwrite 0x039b63 thru 0x03d67e (0x3b1c bytes) 000399 1775832749.882365 trunc from 0x03d67f to 0x031140 (0xc53e bytes) 000400 1775832749.891393 write 0x009331 thru 0x016eb1 (0xdb81 bytes) 000403 1775832749.901731 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31141): Mirror 5: 0x4f43721e (stale) Mirror 8: 0x4f43721e (stale) Mirror 9: 0x4f43721e (stale) Mirror 10: 0x4f43721e (stale) Mirror 12: 0x4f43721e (stale) Mirror 13: 0x4f43721e (stale) Mirror 14: 0x4f43721e (stale) Mirror 15: 0x3d2d65d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31141): Mirror 5: 0x4f43721e (stale) Mirror 8: 0x4f43721e (stale) Mirror 9: 0x4f43721e (stale) Mirror 10: 0x4f43721e (stale) Mirror 12: 0x4f43721e (stale) Mirror 13: 0x4f43721e (stale) Mirror 14: 0x4f43721e (stale) Mirror 15: 0x3d2d65d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31141: skipped 000405 1775832750.243384 write 0x00c404 thru 0x010f23 (0x4b20 bytes) 000407 1775832750.251525 mapread 0x02ded8 thru 0x0302e7 (0x2410 bytes) 000408 1775832750.258452 mapwrite 0x021d45 thru 0x02bf21 (0xa1dd bytes) 000409 1775832750.302068 mapread 0x011d45 thru 0x01824b (0x6507 bytes) 000411 1775832750.314891 mapread 0x0067f1 thru 0x0127d9 (0xbfe9 bytes) 000412 1775832750.327524 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31141): Mirror 5: 0x4f43721e (stale) Mirror 8: 0x4f43721e (stale) Mirror 9: 0x4f43721e (stale) Mirror 10: 0x4f43721e (stale) Mirror 12: 0x4f43721e (stale) Mirror 13: 0x4f43721e (stale) Mirror 15: 0x3d2d65d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31141): Mirror 5: 0x4f43721e (stale) Mirror 8: 0x4f43721e (stale) Mirror 9: 0x4f43721e (stale) Mirror 10: 0x4f43721e (stale) Mirror 12: 0x4f43721e (stale) Mirror 13: 0x4f43721e (stale) Mirror 15: 0x3d2d65d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31141: skipped 000414 1775832750.595481 trunc from 0x031141 to 0x027a94 (0x96ac bytes) 000415 1775832750.606047 trunc from 0x027a95 to 0x0166cb (0x113c9 bytes) 000416 1775832750.617651 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x166cc): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x166cc): Mirror 5: 0xb439e74c (stale) Mirror 8: 0xb439e74c (stale) Mirror 9: 0xb439e74c (stale) Mirror 10: 0xb439e74c (stale) Mirror 12: 0xb439e74c (stale) Mirror 13: 0xb439e74c (stale) Mirror 15: 0xb439e74c (stale) CRC-32 checksum value for chunk [0, 0x166cc): Mirror 1: 0xf37cd31d Mirror 16: 0xf37cd31d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x166cc: skipped 000417 1775832751.121708 read 0x0134b5 thru 0x0166cb (0x3217 bytes) 000418 1775832751.139081 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x166cc): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x166cc): Mirror 5: 0xb439e74c (stale) Mirror 8: 0xb439e74c (stale) Mirror 9: 0xb439e74c (stale) Mirror 10: 0xb439e74c (stale) Mirror 12: 0xb439e74c (stale) Mirror 13: 0xb439e74c (stale) Mirror 15: 0xb439e74c (stale) CRC-32 checksum value for chunk [0, 0x166cc): Mirror 1: 0xf37cd31d Mirror 16: 0xf37cd31d Mirror 17: 0xf37cd31d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x166cc: skipped 000419 1775832751.560662 write 0x02a094 thru 0x02f961 (0x58ce bytes) 000421 1775832751.593046 trunc from 0x02f962 to 0x0334dc (0x3b7b bytes) 000424 1775832751.605371 mapread 0x000846 thru 0x00d528 (0xcce3 bytes) 000426 1775832751.619155 read 0x01529a thru 0x01fa81 (0xa7e8 bytes) 000427 1775832751.624231 mapwrite 0x0021ba thru 0x01041d (0xe264 bytes) 000429 1775832751.660843 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x334dd): Mirror 5: 0xf0caaf3d (stale) Mirror 9: 0xf0caaf3d (stale) Mirror 10: 0xf0caaf3d (stale) Mirror 12: 0xf0caaf3d (stale) Mirror 13: 0xf0caaf3d (stale) Mirror 15: 0xbcbe33ea (stale) Mirror 16: 0xef437d77 (stale) Mirror 17: 0xef437d77 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x334dd): Mirror 5: 0xf0caaf3d (stale) Mirror 9: 0xf0caaf3d (stale) Mirror 10: 0xf0caaf3d (stale) Mirror 12: 0xf0caaf3d (stale) Mirror 13: 0xf0caaf3d (stale) Mirror 15: 0xbcbe33ea (stale) Mirror 16: 0xef437d77 (stale) Mirror 17: 0xef437d77 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x334dd: skipped 000430 1775832751.932931 trunc from 0x0334dd to 0x0008c0 (0x32c1c bytes) 000432 1775832751.941052 read 0x0006eb thru 0x0008c0 (0x1d6 bytes) 000436 1775832751.946018 mapwrite 0x0389e5 thru 0x03fae3 (0x70ff bytes) 000437 1775832752.000604 mapread 0x0390e9 thru 0x03d3c7 (0x42df bytes) 000438 1775832752.001908 write 0x00db2e thru 0x00ddae (0x281 bytes) 000439 1775832752.008091 mapwrite 0x004dc9 thru 0x00f93e (0xab76 bytes) 000441 1775832752.041096 write 0x01b982 thru 0x028e14 (0xd493 bytes) 000443 1775832752.050091 trunc from 0x03fae4 to 0x0383c0 (0x7723 bytes) 000444 1775832752.060222 mapwrite 0x018673 thru 0x019c3e (0x15cc bytes) 000446 1775832752.089444 trunc from 0x0383c1 to 0x008ff6 (0x2f3ca bytes) 000448 1775832752.101488 trunc from 0x008ff7 to 0x0304e8 (0x274f2 bytes) 000449 1775832752.113863 mapread 0x0291b6 thru 0x029253 (0x9e bytes) 000450 1775832752.119221 write 0x0140c2 thru 0x020e0c (0xcd4b bytes) 000454 1775832752.131940 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x304e9): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x304e9): Mirror 5: 0x4e587227 (stale) Mirror 9: 0x4e587227 (stale) Mirror 10: 0x4e587227 (stale) Mirror 12: 0x4e587227 (stale) Mirror 13: 0x4e587227 (stale) Mirror 15: 0x8ebe87e9 (stale) Mirror 16: 0xd39d13e4 (stale) Mirror 17: 0xd39d13e4 (stale) CRC-32 checksum value for chunk [0, 0x304e9): Mirror 1: 0x1ca92865 Mirror 18: 0x1ca92865 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x304e9: skipped 000456 1775832752.541320 mapwrite 0x01b135 thru 0x021d14 (0x6be0 bytes) 000457 1775832752.639235 read 0x020c04 thru 0x023a1e (0x2e1b bytes) 000458 1775832752.639898 write 0x01599e thru 0x018c69 (0x32cc bytes) 000459 1775832752.640766 write 0x02b174 thru 0x03067c (0x5509 bytes) 000460 1775832752.647653 write 0x025e09 thru 0x03448f (0xe687 bytes) 000461 1775832752.649011 mapwrite 0x03f670 thru 0x03ffff (0x990 bytes) 000462 1775832752.692856 write 0x0103e4 thru 0x018c3d (0x885a bytes) 000465 1775832752.699934 mapwrite 0x027096 thru 0x027ebe (0xe29 bytes) 000466 1775832752.724934 trunc from 0x040000 to 0x002317 (0x3dce8 bytes) 000467 1775832752.732456 trunc from 0x002318 to 0x02b358 (0x29041 bytes) 000469 1775832752.740507 read 0x0283b7 thru 0x02b358 (0x2fa2 bytes) 000471 1775832752.747228 write 0x00c500 thru 0x011429 (0x4f2a bytes) 000473 1775832752.749014 read 0x023db6 thru 0x02b358 (0x75a3 bytes) 000474 1775832752.749557 trunc from 0x02b359 to 0x0262e3 (0x5075 bytes) 000475 1775832752.757832 read 0x016673 thru 0x01fb50 (0x94de bytes) 000477 1775832752.761585 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x262e4): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262e4): Mirror 5: 0x1dbad63a (stale) Mirror 9: 0x1dbad63a (stale) Mirror 10: 0x1dbad63a (stale) Mirror 12: 0x1dbad63a (stale) Mirror 13: 0x1dbad63a (stale) Mirror 15: 0x1dbad63a (stale) Mirror 16: 0x8664000e (stale) Mirror 17: 0x8664000e (stale) Mirror 18: 0x2487dd1 (stale) CRC-32 checksum value for chunk [0, 0x262e4): Mirror 1: 0x82a1c6ef Mirror 19: 0x82a1c6ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262e4: skipped 000478 1775832753.115845 mapwrite 0x0268ab thru 0x035df4 (0xf54a bytes) 000479 1775832753.208857 MIRROR_RESYNC 11 mirrors 000482 1775832753.839897 write 0x02049c thru 0x0216bc (0x1221 bytes) 000483 1775832753.878005 mapwrite 0x002986 thru 0x00b00f (0x868a bytes) 000484 1775832753.919789 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x35df5): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35df5): Mirror 5: 0x3dcee005 (stale) Mirror 9: 0x3dcee005 (stale) Mirror 10: 0x3dcee005 (stale) Mirror 12: 0x3dcee005 (stale) Mirror 13: 0x3dcee005 (stale) Mirror 15: 0x3dcee005 (stale) Mirror 16: 0x3dcee005 (stale) Mirror 17: 0x3dcee005 (stale) Mirror 18: 0x3dcee005 (stale) Mirror 19: 0x3dcee005 (stale) CRC-32 checksum value for chunk [0, 0x35df5): Mirror 1: 0xdd53f70d Mirror 20: 0xdd53f70d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35df5: skipped 000485 1775832754.381664 write 0x008e94 thru 0x014a79 (0xbbe6 bytes) 000486 1775832754.442693 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35df5): Mirror 9: 0x3dcee005 (stale) Mirror 10: 0x3dcee005 (stale) Mirror 12: 0x3dcee005 (stale) Mirror 13: 0x3dcee005 (stale) Mirror 15: 0x3dcee005 (stale) Mirror 16: 0x3dcee005 (stale) Mirror 17: 0x3dcee005 (stale) Mirror 18: 0x3dcee005 (stale) Mirror 19: 0x3dcee005 (stale) Mirror 20: 0xdd53f70d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35df5): Mirror 9: 0x3dcee005 (stale) Mirror 10: 0x3dcee005 (stale) Mirror 12: 0x3dcee005 (stale) Mirror 13: 0x3dcee005 (stale) Mirror 15: 0x3dcee005 (stale) Mirror 16: 0x3dcee005 (stale) Mirror 17: 0x3dcee005 (stale) Mirror 18: 0x3dcee005 (stale) Mirror 19: 0x3dcee005 (stale) Mirror 20: 0xdd53f70d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35df5: skipped 000487 1775832754.721907 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35df5): Mirror 9: 0x3dcee005 (stale) Mirror 10: 0x3dcee005 (stale) Mirror 12: 0x3dcee005 (stale) Mirror 13: 0x3dcee005 (stale) Mirror 15: 0x3dcee005 (stale) Mirror 17: 0x3dcee005 (stale) Mirror 18: 0x3dcee005 (stale) Mirror 19: 0x3dcee005 (stale) Mirror 20: 0xdd53f70d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35df5): Mirror 9: 0x3dcee005 (stale) Mirror 10: 0x3dcee005 (stale) Mirror 12: 0x3dcee005 (stale) Mirror 13: 0x3dcee005 (stale) Mirror 15: 0x3dcee005 (stale) Mirror 17: 0x3dcee005 (stale) Mirror 18: 0x3dcee005 (stale) Mirror 19: 0x3dcee005 (stale) Mirror 20: 0xdd53f70d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35df5: skipped 000488 1775832754.950720 mapwrite 0x0213ea thru 0x02d445 (0xc05c bytes) 000490 1775832754.983643 write 0x01b2de thru 0x01f4bb (0x41de bytes) 000491 1775832754.991061 mapread 0x0093ed thru 0x00cf4e (0x3b62 bytes) 000492 1775832754.997421 mapread 0x012592 thru 0x022501 (0xff70 bytes) 000495 1775832755.002771 trunc from 0x035df5 to 0x020bd2 (0x15222 bytes) 000497 1775832755.012981 mapwrite 0x001cf5 thru 0x00916d (0x7479 bytes) 000498 1775832755.039218 mapwrite 0x03a60e thru 0x03ffff (0x59f2 bytes) 000499 1775832755.075536 mapwrite 0x030261 thru 0x037a1f (0x77bf bytes) 000500 1775832755.101479 read 0x01f54f thru 0x02562a (0x60dc bytes) 000501 1775832755.105813 write 0x00b151 thru 0x014436 (0x92e6 bytes) 000502 1775832755.109080 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xd3d43a98 (stale) Mirror 10: 0xd3d43a98 (stale) Mirror 12: 0xd3d43a98 (stale) Mirror 13: 0xd3d43a98 (stale) Mirror 15: 0xd3d43a98 (stale) Mirror 17: 0xd3d43a98 (stale) Mirror 18: 0xd3d43a98 (stale) Mirror 19: 0xd3d43a98 (stale) Mirror 20: 0xa06f42c3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x68540d08 Mirror 21: 0x68540d08 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000503 1775832755.484888 trunc from 0x040000 to 0x011d2f (0x2e2d0 bytes) 000505 1775832755.533737 MIRROR_RESYNC 11 mirrors 000507 1775832756.099271 read 0x004ee0 thru 0x00e00c (0x912d bytes) 000508 1775832756.102711 trunc from 0x011d30 to 0x011a37 (0x2f8 bytes) 000509 1775832756.139613 mapread 0x0117db thru 0x011a37 (0x25d bytes) 000510 1775832756.143059 trunc from 0x011a38 to 0x026bb1 (0x1517a bytes) 000511 1775832756.150844 trunc from 0x026bb2 to 0x032fe0 (0xc42f bytes) 000512 1775832756.159047 MIRROR_RESYNC 11 mirrors 000515 1775832756.684916 trunc from 0x032fe1 to 0x02bc9f (0x7341 bytes) 000516 1775832756.710005 read 0x00eafc thru 0x015dbd (0x72c2 bytes) 000517 1775832756.714542 trunc from 0x02bca0 to 0x00d036 (0x1ec69 bytes) 000518 1775832756.724490 write 0x00dc2b thru 0x012aa4 (0x4e7a bytes) 000520 1775832756.728130 mapwrite 0x00b2c8 thru 0x01483e (0x9577 bytes) 000521 1775832756.761252 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1483f): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1483f): Mirror 9: 0x30e5a134 (stale) Mirror 10: 0x30e5a134 (stale) Mirror 12: 0x30e5a134 (stale) Mirror 13: 0x30e5a134 (stale) Mirror 15: 0x30e5a134 (stale) Mirror 17: 0x30e5a134 (stale) Mirror 18: 0x30e5a134 (stale) Mirror 19: 0x30e5a134 (stale) Mirror 20: 0x30e5a134 (stale) Mirror 21: 0x30e5a134 (stale) CRC-32 checksum value for chunk [0, 0x1483f): Mirror 1: 0x2df29b59 Mirror 22: 0x2df29b59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1483f: skipped 000522 1775832757.081543 write 0x02d648 thru 0x0304b0 (0x2e69 bytes) 000524 1775832757.111778 read 0x028d68 thru 0x02b65e (0x28f7 bytes) 000526 1775832757.118552 MIRROR_RESYNC 12 mirrors 000527 1775832757.645948 mapread 0x01e8b7 thru 0x02d300 (0xea4a bytes) 000528 1775832757.657620 trunc from 0x0304b1 to 0x00a4ab (0x26005 bytes) 000529 1775832757.693896 MIRROR_RESYNC 12 mirrors 000530 1775832758.237962 write 0x017544 thru 0x01b526 (0x3fe3 bytes) 000532 1775832758.262155 write 0x01cdbc thru 0x0258ec (0x8b31 bytes) 000535 1775832758.266215 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x258ed): Mirror 10: 0xec052090 (stale) Mirror 12: 0xec052090 (stale) Mirror 13: 0xec052090 (stale) Mirror 15: 0xec052090 (stale) Mirror 17: 0xec052090 (stale) Mirror 18: 0xec052090 (stale) Mirror 19: 0xec052090 (stale) Mirror 20: 0xec052090 (stale) Mirror 21: 0xec052090 (stale) Mirror 22: 0xec052090 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x258ed): Mirror 10: 0xec052090 (stale) Mirror 12: 0xec052090 (stale) Mirror 13: 0xec052090 (stale) Mirror 15: 0xec052090 (stale) Mirror 17: 0xec052090 (stale) Mirror 18: 0xec052090 (stale) Mirror 19: 0xec052090 (stale) Mirror 20: 0xec052090 (stale) Mirror 21: 0xec052090 (stale) Mirror 22: 0xec052090 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x258ed: skipped 000536 1775832758.480451 mapread 0x00f21d thru 0x01b8d9 (0xc6bd bytes) 000537 1775832758.497039 mapwrite 0x02b2e2 thru 0x02bea6 (0xbc5 bytes) 000538 1775832758.531597 read 0x026a9a thru 0x02bea6 (0x540d bytes) 000541 1775832758.533182 read 0x01eedb thru 0x02bea6 (0xcfcc bytes) 000546 1775832758.539693 read 0x018a5a thru 0x02023f (0x77e6 bytes) 000547 1775832758.542664 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2bea7): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bea7): Mirror 10: 0xd5be675d (stale) Mirror 12: 0xd5be675d (stale) Mirror 13: 0xd5be675d (stale) Mirror 15: 0xd5be675d (stale) Mirror 17: 0xd5be675d (stale) Mirror 18: 0xd5be675d (stale) Mirror 19: 0xd5be675d (stale) Mirror 20: 0xd5be675d (stale) Mirror 21: 0xd5be675d (stale) Mirror 22: 0xd5be675d (stale) CRC-32 checksum value for chunk [0, 0x2bea7): Mirror 1: 0xc9f0e12c Mirror 23: 0xc9f0e12c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bea7: skipped 000548 1775832758.874136 read 0x026ef2 thru 0x0282a9 (0x13b8 bytes) 000550 1775832758.879132 mapread 0x0125da thru 0x0127a9 (0x1d0 bytes) 000551 1775832758.883952 mapwrite 0x00cc35 thru 0x00d9ed (0xdb9 bytes) 000554 1775832758.948515 mapwrite 0x000fbe thru 0x010a42 (0xfa85 bytes) 000557 1775832758.973701 mapwrite 0x022140 thru 0x02efcb (0xce8c bytes) 000561 1775832759.010265 trunc from 0x02efcc to 0x039710 (0xa745 bytes) 000562 1775832759.016665 write 0x0062a3 thru 0x01170b (0xb469 bytes) 000564 1775832759.018272 mapwrite 0x0329b5 thru 0x039f0d (0x7559 bytes) 000565 1775832759.049411 trunc from 0x039f0e to 0x00e2d5 (0x2bc38 bytes) 000569 1775832759.057506 read 0x004bbb thru 0x008b63 (0x3fa9 bytes) 000570 1775832759.058159 write 0x01da37 thru 0x023675 (0x5c3f bytes) 000571 1775832759.059497 trunc from 0x023676 to 0x0030c9 (0x205ac bytes) 000577 1775832759.071111 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30ca): Mirror 10: 0xc9402172 (stale) Mirror 12: 0xc9402172 (stale) Mirror 13: 0xc9402172 (stale) Mirror 15: 0xc9402172 (stale) Mirror 17: 0xc9402172 (stale) Mirror 18: 0xc9402172 (stale) Mirror 19: 0xc9402172 (stale) Mirror 20: 0xc9402172 (stale) Mirror 21: 0xc9402172 (stale) Mirror 23: 0xc9402172 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ca): Mirror 10: 0xc9402172 (stale) Mirror 12: 0xc9402172 (stale) Mirror 13: 0xc9402172 (stale) Mirror 15: 0xc9402172 (stale) Mirror 17: 0xc9402172 (stale) Mirror 18: 0xc9402172 (stale) Mirror 19: 0xc9402172 (stale) Mirror 20: 0xc9402172 (stale) Mirror 21: 0xc9402172 (stale) Mirror 23: 0xc9402172 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ca: skipped 000579 1775832759.217730 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30ca): Mirror 10: 0xc9402172 (stale) Mirror 12: 0xc9402172 (stale) Mirror 13: 0xc9402172 (stale) Mirror 15: 0xc9402172 (stale) Mirror 17: 0xc9402172 (stale) Mirror 18: 0xc9402172 (stale) Mirror 19: 0xc9402172 (stale) Mirror 20: 0xc9402172 (stale) Mirror 21: 0xc9402172 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ca): Mirror 10: 0xc9402172 (stale) Mirror 12: 0xc9402172 (stale) Mirror 13: 0xc9402172 (stale) Mirror 15: 0xc9402172 (stale) Mirror 17: 0xc9402172 (stale) Mirror 18: 0xc9402172 (stale) Mirror 19: 0xc9402172 (stale) Mirror 20: 0xc9402172 (stale) Mirror 21: 0xc9402172 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ca: skipped 000582 1775832759.354857 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x30ca): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ca): Mirror 10: 0xc9402172 (stale) Mirror 12: 0xc9402172 (stale) Mirror 13: 0xc9402172 (stale) Mirror 15: 0xc9402172 (stale) Mirror 17: 0xc9402172 (stale) Mirror 18: 0xc9402172 (stale) Mirror 19: 0xc9402172 (stale) Mirror 20: 0xc9402172 (stale) Mirror 21: 0xc9402172 (stale) CRC-32 checksum value for chunk [0, 0x30ca): Mirror 1: 0x6cf5fe44 Mirror 22: 0x6cf5fe44 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ca: skipped 000583 1775832759.692514 write 0x03c596 thru 0x03ee34 (0x289f bytes) truncating to largest ever: 0x3de56 000585 1775832759.720156 trunc from 0x03ee35 to 0x03de55 (0xfdf bytes) 000588 1775832759.729858 mapwrite 0x01c7e9 thru 0x01f90f (0x3127 bytes) 000589 1775832759.757703 mapread 0x02f346 thru 0x03790b (0x85c6 bytes) 000591 1775832759.762815 mapwrite 0x0295b8 thru 0x032b8a (0x95d3 bytes) 000592 1775832759.786328 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3de56): Mirror 10: 0x1f8dfeb1 (stale) Mirror 12: 0x1f8dfeb1 (stale) Mirror 13: 0x1f8dfeb1 (stale) Mirror 15: 0x1f8dfeb1 (stale) Mirror 17: 0x1f8dfeb1 (stale) Mirror 18: 0x1f8dfeb1 (stale) Mirror 19: 0x1f8dfeb1 (stale) Mirror 20: 0x1f8dfeb1 (stale) Mirror 22: 0x2629db26 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de56): Mirror 10: 0x1f8dfeb1 (stale) Mirror 12: 0x1f8dfeb1 (stale) Mirror 13: 0x1f8dfeb1 (stale) Mirror 15: 0x1f8dfeb1 (stale) Mirror 17: 0x1f8dfeb1 (stale) Mirror 18: 0x1f8dfeb1 (stale) Mirror 19: 0x1f8dfeb1 (stale) Mirror 20: 0x1f8dfeb1 (stale) Mirror 22: 0x2629db26 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de56: skipped 000593 1775832759.979570 read 0x03a333 thru 0x03de55 (0x3b23 bytes) 000595 1775832759.984617 read 0x023e2b thru 0x02f564 (0xb73a bytes) 000596 1775832759.990666 write 0x00878e thru 0x00ab72 (0x23e5 bytes) 000597 1775832759.993526 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3de56): Mirror 12: 0x1f8dfeb1 (stale) Mirror 13: 0x1f8dfeb1 (stale) Mirror 15: 0x1f8dfeb1 (stale) Mirror 17: 0x1f8dfeb1 (stale) Mirror 18: 0x1f8dfeb1 (stale) Mirror 19: 0x1f8dfeb1 (stale) Mirror 20: 0x1f8dfeb1 (stale) Mirror 22: 0x2629db26 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de56): Mirror 12: 0x1f8dfeb1 (stale) Mirror 13: 0x1f8dfeb1 (stale) Mirror 15: 0x1f8dfeb1 (stale) Mirror 17: 0x1f8dfeb1 (stale) Mirror 18: 0x1f8dfeb1 (stale) Mirror 19: 0x1f8dfeb1 (stale) Mirror 20: 0x1f8dfeb1 (stale) Mirror 22: 0x2629db26 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de56: skipped 000599 1775832760.191305 trunc from 0x03de56 to 0x02bbc0 (0x12295 bytes) 000600 1775832760.196937 read 0x015f3d thru 0x02273d (0xc801 bytes) 000603 1775832760.201725 write 0x039f08 thru 0x03ffff (0x60f8 bytes) 000604 1775832760.202625 read 0x01da70 thru 0x024018 (0x65a9 bytes) 000606 1775832760.208336 mapwrite 0x03245d thru 0x03c710 (0xa2b4 bytes) 000607 1775832760.233858 mapread 0x012107 thru 0x01eb1c (0xca16 bytes) 000609 1775832760.235659 trunc from 0x040000 to 0x036f3b (0x90c4 bytes) 000610 1775832760.245472 write 0x028cbe thru 0x02c1eb (0x352e bytes) 000611 1775832760.246701 mapwrite 0x031224 thru 0x03e7eb (0xd5c8 bytes) 000612 1775832760.310863 MIRROR_RESYNC 9 mirrors 000613 1775832760.794006 MIRROR_EXTEND to 10 mirrors 000615 1775832761.063912 write 0x02ba87 thru 0x0351ec (0x9766 bytes) 000617 1775832761.099705 mapwrite 0x025636 thru 0x0282d4 (0x2c9f bytes) 000618 1775832761.124187 read 0x0348d2 thru 0x03e7eb (0x9f1a bytes) 000619 1775832761.128260 write 0x02ae95 thru 0x031005 (0x6171 bytes) 000621 1775832761.129797 trunc from 0x03e7ec to 0x02cac3 (0x11d28 bytes) 000622 1775832761.144695 mapwrite 0x03089d thru 0x03c607 (0xbd6b bytes) 000624 1775832761.183493 write 0x025097 thru 0x02e85a (0x97c4 bytes) 000625 1775832761.184472 trunc from 0x03c608 to 0x018f97 (0x23670 bytes) 000626 1775832761.193055 read 0x01301c thru 0x013992 (0x977 bytes) 000627 1775832761.198456 mapread 0x006487 thru 0x007a04 (0x157e bytes) 000629 1775832761.201970 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18f98): Mirror 12: 0xfd490132 (stale) Mirror 13: 0xfd490132 (stale) Mirror 15: 0xfd490132 (stale) Mirror 17: 0xfd490132 (stale) Mirror 18: 0xfd490132 (stale) Mirror 20: 0xfd490132 (stale) Mirror 22: 0xfd490132 (stale) Mirror 23: 0xfd490132 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18f98): Mirror 12: 0xfd490132 (stale) Mirror 13: 0xfd490132 (stale) Mirror 15: 0xfd490132 (stale) Mirror 17: 0xfd490132 (stale) Mirror 18: 0xfd490132 (stale) Mirror 20: 0xfd490132 (stale) Mirror 22: 0xfd490132 (stale) Mirror 23: 0xfd490132 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18f98: skipped 000630 1775832761.405466 write 0x01b2a0 thru 0x024491 (0x91f2 bytes) 000632 1775832761.407651 mapwrite 0x009536 thru 0x0182a4 (0xed6f bytes) 000634 1775832761.453341 mapread 0x006487 thru 0x00b946 (0x54c0 bytes) 000636 1775832761.457075 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x24492): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24492): Mirror 12: 0x9e00753b (stale) Mirror 13: 0x9e00753b (stale) Mirror 15: 0x9e00753b (stale) Mirror 17: 0x9e00753b (stale) Mirror 18: 0x9e00753b (stale) Mirror 20: 0x9e00753b (stale) Mirror 22: 0x9e00753b (stale) Mirror 23: 0x9e00753b (stale) CRC-32 checksum value for chunk [0, 0x24492): Mirror 1: 0x9f4413c7 Mirror 24: 0x9f4413c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24492: skipped 000637 1775832761.818956 trunc from 0x024492 to 0x00273a (0x21d57 bytes) 000639 1775832761.864546 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x273b): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x273b): Mirror 12: 0xd3a846a1 (stale) Mirror 13: 0xd3a846a1 (stale) Mirror 15: 0xd3a846a1 (stale) Mirror 17: 0xd3a846a1 (stale) Mirror 18: 0xd3a846a1 (stale) Mirror 20: 0xd3a846a1 (stale) Mirror 22: 0xd3a846a1 (stale) Mirror 23: 0xd3a846a1 (stale) Mirror 24: 0xd3a846a1 (stale) CRC-32 checksum value for chunk [0, 0x273b): Mirror 1: 0xd3a846a1 Mirror 25: 0xd3a846a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x273b: skipped 000641 1775832762.217001 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x273b): Mirror 12: 0xd3a846a1 (stale) Mirror 13: 0xd3a846a1 (stale) Mirror 15: 0xd3a846a1 (stale) Mirror 17: 0xd3a846a1 (stale) Mirror 18: 0xd3a846a1 (stale) Mirror 20: 0xd3a846a1 (stale) Mirror 23: 0xd3a846a1 (stale) Mirror 24: 0xd3a846a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x273b): Mirror 12: 0xd3a846a1 (stale) Mirror 13: 0xd3a846a1 (stale) Mirror 15: 0xd3a846a1 (stale) Mirror 17: 0xd3a846a1 (stale) Mirror 18: 0xd3a846a1 (stale) Mirror 20: 0xd3a846a1 (stale) Mirror 23: 0xd3a846a1 (stale) Mirror 24: 0xd3a846a1 (stale) CRC-32 checksum value for chunk [0, 0x273b): Mirror 1: 0xd3a846a1 Mirror 25: 0xd3a846a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x273b: skipped 000642 1775832762.519096 trunc from 0x00273b to 0x0057b2 (0x3078 bytes) 000644 1775832762.562749 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x57b3): Mirror 12: 0x637eb3ef (stale) Mirror 15: 0x637eb3ef (stale) Mirror 17: 0x637eb3ef (stale) Mirror 18: 0x637eb3ef (stale) Mirror 20: 0x637eb3ef (stale) Mirror 23: 0x637eb3ef (stale) Mirror 24: 0x637eb3ef (stale) Mirror 25: 0x1caf77e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x57b3): Mirror 12: 0x637eb3ef (stale) Mirror 15: 0x637eb3ef (stale) Mirror 17: 0x637eb3ef (stale) Mirror 18: 0x637eb3ef (stale) Mirror 20: 0x637eb3ef (stale) Mirror 23: 0x637eb3ef (stale) Mirror 24: 0x637eb3ef (stale) Mirror 25: 0x1caf77e2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x57b3: skipped 000645 1775832762.805224 mapwrite 0x01ecd7 thru 0x0213e9 (0x2713 bytes) 000646 1775832762.844263 mapread 0x01f9a3 thru 0x021264 (0x18c2 bytes) 000647 1775832762.845419 write 0x015bfc thru 0x0224a8 (0xc8ad bytes) 000648 1775832762.851392 mapread 0x018713 thru 0x0224a8 (0x9d96 bytes) 000649 1775832762.855202 MIRROR_RESYNC 9 mirrors 000650 1775832763.432495 mapread 0x009440 thru 0x009598 (0x159 bytes) 000651 1775832763.436057 mapwrite 0x01a5f5 thru 0x01e8b4 (0x42c0 bytes) 000653 1775832763.517916 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x224a9): Mirror 15: 0xffe87e15 (stale) Mirror 17: 0xffe87e15 (stale) Mirror 18: 0xffe87e15 (stale) Mirror 20: 0xffe87e15 (stale) Mirror 23: 0xffe87e15 (stale) Mirror 24: 0xffe87e15 (stale) Mirror 25: 0xffe87e15 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x224a9): Mirror 15: 0xffe87e15 (stale) Mirror 17: 0xffe87e15 (stale) Mirror 18: 0xffe87e15 (stale) Mirror 20: 0xffe87e15 (stale) Mirror 23: 0xffe87e15 (stale) Mirror 24: 0xffe87e15 (stale) Mirror 25: 0xffe87e15 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x224a9: skipped 000654 1775832763.694922 trunc from 0x0224a9 to 0x02a0cb (0x7c23 bytes) 000655 1775832763.703138 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2a0cc): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a0cc): Mirror 15: 0x23bc8fd2 (stale) Mirror 17: 0x23bc8fd2 (stale) Mirror 18: 0x23bc8fd2 (stale) Mirror 20: 0x23bc8fd2 (stale) Mirror 23: 0x23bc8fd2 (stale) Mirror 24: 0x23bc8fd2 (stale) Mirror 25: 0x23bc8fd2 (stale) CRC-32 checksum value for chunk [0, 0x2a0cc): Mirror 1: 0xd6fa825c Mirror 26: 0xd6fa825c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a0cc: skipped 000656 1775832764.125693 trunc from 0x02a0cc to 0x02ff05 (0x5e3a bytes) 000658 1775832764.163892 write 0x029609 thru 0x034bad (0xb5a5 bytes) 000662 1775832764.169554 write 0x037301 thru 0x038076 (0xd76 bytes) 000663 1775832764.170594 mapwrite 0x033c4f thru 0x0355d8 (0x198a bytes) 000664 1775832764.197934 mapwrite 0x03d9aa thru 0x03ffff (0x2656 bytes) 000665 1775832764.239386 write 0x020abc thru 0x02750b (0x6a50 bytes) 000666 1775832764.250006 trunc from 0x040000 to 0x011460 (0x2eb9f bytes) 000667 1775832764.259106 read 0x002c13 thru 0x00d654 (0xaa42 bytes) 000668 1775832764.265213 trunc from 0x011461 to 0x01f9a9 (0xe549 bytes) 000669 1775832764.274407 trunc from 0x01f9aa to 0x009361 (0x16648 bytes) 000672 1775832764.285043 mapwrite 0x00905b thru 0x012e21 (0x9dc7 bytes) 000674 1775832764.326331 read 0x00e55d thru 0x012e21 (0x48c5 bytes) 000675 1775832764.326895 mapwrite 0x018d05 thru 0x024224 (0xb520 bytes) 000679 1775832764.392501 mapread 0x0020a8 thru 0x011d4b (0xfca4 bytes) 000680 1775832764.394204 read 0x019c26 thru 0x01d121 (0x34fc bytes) 000681 1775832764.398273 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x24225): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24225): Mirror 15: 0x5c0b70d2 (stale) Mirror 17: 0x5c0b70d2 (stale) Mirror 18: 0x5c0b70d2 (stale) Mirror 20: 0x5c0b70d2 (stale) Mirror 23: 0x5c0b70d2 (stale) Mirror 24: 0x5c0b70d2 (stale) Mirror 25: 0x5c0b70d2 (stale) Mirror 26: 0xfde5a178 (stale) CRC-32 checksum value for chunk [0, 0x24225): Mirror 1: 0xeae38d56 Mirror 27: 0xeae38d56 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24225: skipped 000682 1775832764.783990 mapwrite 0x005932 thru 0x009ab3 (0x4182 bytes) 000683 1775832764.886227 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24225): Mirror 15: 0x5c0b70d2 (stale) Mirror 17: 0x5c0b70d2 (stale) Mirror 18: 0x5c0b70d2 (stale) Mirror 23: 0x5c0b70d2 (stale) Mirror 24: 0x5c0b70d2 (stale) Mirror 25: 0x5c0b70d2 (stale) Mirror 26: 0xfde5a178 (stale) Mirror 27: 0xeae38d56 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24225): Mirror 15: 0x5c0b70d2 (stale) Mirror 17: 0x5c0b70d2 (stale) Mirror 18: 0x5c0b70d2 (stale) Mirror 23: 0x5c0b70d2 (stale) Mirror 24: 0x5c0b70d2 (stale) Mirror 25: 0x5c0b70d2 (stale) Mirror 26: 0xfde5a178 (stale) Mirror 27: 0xeae38d56 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24225: skipped 000685 1775832765.164341 read 0x001d4b thru 0x0092a4 (0x755a bytes) 000686 1775832765.175380 MIRROR_RESYNC 9 mirrors 000687 1775832765.861030 mapwrite 0x0270f5 thru 0x028b47 (0x1a53 bytes) 000689 1775832765.939783 trunc from 0x028b48 to 0x020d22 (0x7e25 bytes) 000690 1775832765.952189 read 0x00a48c thru 0x012c47 (0x87bc bytes) 000691 1775832765.957233 mapread 0x004592 thru 0x00b76f (0x71de bytes) 000693 1775832765.963465 write 0x0214e6 thru 0x02e3e4 (0xceff bytes) 000695 1775832765.966524 write 0x0101db thru 0x012343 (0x2169 bytes) 000697 1775832765.968458 read 0x02429b thru 0x0248dc (0x642 bytes) 000701 1775832765.970363 mapwrite 0x038705 thru 0x03ffff (0x78fb bytes) 000702 1775832766.022324 write 0x01755f thru 0x02431f (0xcdc1 bytes) 000703 1775832766.023833 trunc from 0x040000 to 0x0097a3 (0x3685c bytes) 000704 1775832766.035848 trunc from 0x0097a4 to 0x019286 (0xfae3 bytes) 000706 1775832766.045731 write 0x002ad2 thru 0x00b159 (0x8688 bytes) 000707 1775832766.050946 mapwrite 0x00ce6c thru 0x00e451 (0x15e6 bytes) 000709 1775832766.090429 mapwrite 0x00d1c1 thru 0x01caea (0xf92a bytes) 000711 1775832766.194173 trunc from 0x01caeb to 0x01cc2a (0x140 bytes) 000712 1775832766.203964 write 0x000971 thru 0x00211b (0x17ab bytes) 000714 1775832766.205589 read 0x0079ec thru 0x014e4e (0xd463 bytes) 000715 1775832766.206586 trunc from 0x01cc2b to 0x007808 (0x15422 bytes) 000718 1775832766.219397 write 0x038f74 thru 0x03a2ed (0x137a bytes) 000719 1775832766.220503 read 0x017f75 thru 0x0180ab (0x137 bytes) 000721 1775832766.227904 read 0x020bbb thru 0x027fe5 (0x742b bytes) 000722 1775832766.228639 read 0x01c3fb thru 0x023aef (0x76f5 bytes) 000723 1775832766.232907 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a2ee): Mirror 15: 0x83528d5d (stale) Mirror 17: 0x83528d5d (stale) Mirror 18: 0x83528d5d (stale) Mirror 23: 0x83528d5d (stale) Mirror 24: 0x83528d5d (stale) Mirror 25: 0x83528d5d (stale) Mirror 27: 0x83528d5d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a2ee): Mirror 15: 0x83528d5d (stale) Mirror 17: 0x83528d5d (stale) Mirror 18: 0x83528d5d (stale) Mirror 23: 0x83528d5d (stale) Mirror 24: 0x83528d5d (stale) Mirror 25: 0x83528d5d (stale) Mirror 27: 0x83528d5d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a2ee: skipped 000725 1775832766.482095 mapwrite 0x0382a7 thru 0x03ffff (0x7d59 bytes) 000728 1775832766.533324 MIRROR_RESYNC 8 mirrors 000730 1775832767.078533 mapread 0x035bf2 thru 0x03ffff (0xa40e bytes) 000731 1775832767.097774 read 0x030413 thru 0x031b28 (0x1716 bytes) 000734 1775832767.098735 mapwrite 0x03a528 thru 0x03c744 (0x221d bytes) 000736 1775832767.187184 mapread 0x00aa39 thru 0x00e027 (0x35ef bytes) 000737 1775832767.196604 mapread 0x039d40 thru 0x03ffff (0x62c0 bytes) 000739 1775832767.198302 read 0x010277 thru 0x012db4 (0x2b3e bytes) 000740 1775832767.201864 MIRROR_RESYNC 8 mirrors 000744 1775832767.685031 mapwrite 0x033586 thru 0x03ffff (0xca7a bytes) 000745 1775832767.784108 read 0x02bb11 thru 0x02f88a (0x3d7a bytes) 000746 1775832767.789331 read 0x01f38b thru 0x02c624 (0xd29a bytes) 000747 1775832767.796140 read 0x0129b7 thru 0x01905b (0x66a5 bytes) 000750 1775832767.798343 trunc from 0x040000 to 0x027185 (0x18e7a bytes) 000752 1775832767.821216 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27186): Mirror 15: 0x4e4b288f (stale) Mirror 17: 0x4e4b288f (stale) Mirror 23: 0x4e4b288f (stale) Mirror 24: 0x4e4b288f (stale) Mirror 25: 0x4e4b288f (stale) Mirror 27: 0x4e4b288f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27186): Mirror 15: 0x4e4b288f (stale) Mirror 17: 0x4e4b288f (stale) Mirror 23: 0x4e4b288f (stale) Mirror 24: 0x4e4b288f (stale) Mirror 25: 0x4e4b288f (stale) Mirror 27: 0x4e4b288f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27186: skipped 000754 1775832768.019558 write 0x0210d6 thru 0x0254fc (0x4427 bytes) 000756 1775832768.025512 trunc from 0x027186 to 0x01c5f5 (0xab90 bytes) 000758 1775832768.035682 mapread 0x00d7e2 thru 0x018f37 (0xb756 bytes) 000762 1775832768.046933 write 0x03e827 thru 0x03ffff (0x17d9 bytes) 000764 1775832768.048483 read 0x03a8ef thru 0x03ffff (0x5711 bytes) 000766 1775832768.054604 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x79e20a12 (stale) Mirror 17: 0x79e20a12 (stale) Mirror 23: 0x79e20a12 (stale) Mirror 24: 0x79e20a12 (stale) Mirror 25: 0x79e20a12 (stale) Mirror 27: 0x79e20a12 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3e2684f2 Mirror 28: 0x3e2684f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000770 1775832768.413889 mapread 0x012de9 thru 0x01e868 (0xba80 bytes) 000773 1775832768.434456 mapwrite 0x024c87 thru 0x0291a8 (0x4522 bytes) 000774 1775832768.507130 trunc from 0x040000 to 0x03bd4f (0x42b0 bytes) 000776 1775832768.525654 read 0x022210 thru 0x02b05f (0x8e50 bytes) 000778 1775832768.530711 MIRROR_RESYNC 8 mirrors 000779 1775832769.072071 mapread 0x02e5ad thru 0x036373 (0x7dc7 bytes) 000780 1775832769.084273 trunc from 0x03bd50 to 0x0194e1 (0x2286e bytes) 000782 1775832769.127037 trunc from 0x0194e2 to 0x0035cc (0x15f15 bytes) 000783 1775832769.138141 write 0x03b4b0 thru 0x03ffff (0x4b50 bytes) 000784 1775832769.143719 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x431a51e2 (stale) Mirror 17: 0x431a51e2 (stale) Mirror 23: 0x431a51e2 (stale) Mirror 24: 0x431a51e2 (stale) Mirror 25: 0x431a51e2 (stale) Mirror 27: 0x431a51e2 (stale) Mirror 28: 0x431a51e2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa75909c4 Mirror 29: 0xa75909c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000785 1775832769.528682 mapread 0x03825a thru 0x03c18a (0x3f31 bytes) 000788 1775832769.553741 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x431a51e2 (stale) Mirror 23: 0x431a51e2 (stale) Mirror 24: 0x431a51e2 (stale) Mirror 25: 0x431a51e2 (stale) Mirror 27: 0x431a51e2 (stale) Mirror 28: 0x431a51e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x431a51e2 (stale) Mirror 23: 0x431a51e2 (stale) Mirror 24: 0x431a51e2 (stale) Mirror 25: 0x431a51e2 (stale) Mirror 27: 0x431a51e2 (stale) Mirror 28: 0x431a51e2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa75909c4 Mirror 29: 0xa75909c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000789 1775832769.940817 mapread 0x01f9df thru 0x024b15 (0x5137 bytes) 000791 1775832769.964733 trunc from 0x040000 to 0x01935d (0x26ca2 bytes) 000792 1775832770.002102 trunc from 0x01935e to 0x013f06 (0x5457 bytes) 000793 1775832770.014227 write 0x0338a5 thru 0x038e80 (0x55dc bytes) 000794 1775832770.015370 trunc from 0x038e81 to 0x02b536 (0xd94a bytes) 000795 1775832770.024323 mapwrite 0x0387e1 thru 0x0388ee (0x10e bytes) 000798 1775832770.069818 MIRROR_RESYNC 8 mirrors 000800 1775832770.612786 mapwrite 0x02c7ea thru 0x039164 (0xc97b bytes) 000801 1775832770.695421 write 0x01e2f7 thru 0x02ba53 (0xd75d bytes) 000806 1775832770.704461 mapwrite 0x039c1c thru 0x03ffff (0x63e4 bytes) 000807 1775832770.756405 write 0x024dc3 thru 0x03185c (0xca9a bytes) 000808 1775832770.757881 write 0x0023d2 thru 0x004b02 (0x2731 bytes) 000811 1775832770.765695 trunc from 0x040000 to 0x022812 (0x1d7ed bytes) 000812 1775832770.776757 read 0x001cfb thru 0x005569 (0x386f bytes) 000814 1775832770.781817 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22813): Mirror 23: 0x697724bc (stale) Mirror 24: 0x697724bc (stale) Mirror 25: 0x697724bc (stale) Mirror 27: 0x697724bc (stale) Mirror 28: 0x697724bc (stale) Mirror 29: 0x697724bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22813): Mirror 23: 0x697724bc (stale) Mirror 24: 0x697724bc (stale) Mirror 25: 0x697724bc (stale) Mirror 27: 0x697724bc (stale) Mirror 28: 0x697724bc (stale) Mirror 29: 0x697724bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22813: skipped 000815 1775832770.951364 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x22813): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22813): Mirror 23: 0x697724bc (stale) Mirror 24: 0x697724bc (stale) Mirror 25: 0x697724bc (stale) Mirror 27: 0x697724bc (stale) Mirror 28: 0x697724bc (stale) Mirror 29: 0x697724bc (stale) CRC-32 checksum value for chunk [0, 0x22813): Mirror 1: 0x89f8c3d8 Mirror 30: 0x89f8c3d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22813: skipped 000816 1775832771.297247 mapread 0x000094 thru 0x00d58f (0xd4fc bytes) 000817 1775832771.314715 read 0x01e5b3 thru 0x022812 (0x4260 bytes) 000818 1775832771.321132 mapread 0x01add6 thru 0x022812 (0x7a3d bytes) 000819 1775832771.334903 MIRROR_RESYNC 8 mirrors 000820 1775832771.758729 mapwrite 0x02d792 thru 0x0314f6 (0x3d65 bytes) 000823 1775832771.828409 MIRROR_RESYNC 8 mirrors 000824 1775832772.212888 mapwrite 0x00767f thru 0x00cb8b (0x550d bytes) 000825 1775832772.278378 MIRROR_RESYNC 8 mirrors 000827 1775832772.660539 read 0x003791 thru 0x009986 (0x61f6 bytes) 000828 1775832772.663972 read 0x0044eb thru 0x008f0e (0x4a24 bytes) 000829 1775832772.664269 trunc from 0x0314f7 to 0x01f666 (0x11e90 bytes) 000831 1775832772.696394 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1f667): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f667): Mirror 23: 0x239b0f51 (stale) Mirror 24: 0x239b0f51 (stale) Mirror 25: 0x239b0f51 (stale) Mirror 27: 0x239b0f51 (stale) Mirror 28: 0x239b0f51 (stale) Mirror 29: 0x239b0f51 (stale) Mirror 30: 0x239b0f51 (stale) CRC-32 checksum value for chunk [0, 0x1f667): Mirror 1: 0x239b0f51 Mirror 31: 0x239b0f51 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f667: skipped 000834 1775832773.044539 trunc from 0x01f667 to 0x03bfee (0x1c988 bytes) 000836 1775832773.080112 trunc from 0x03bfef to 0x0273fa (0x14bf4 bytes) 000837 1775832773.091401 MIRROR_RESYNC 9 mirrors 000838 1775832773.605405 write 0x0005be thru 0x00b60c (0xb04f bytes) 000839 1775832773.637153 MIRROR_RESYNC 9 mirrors 000840 1775832774.178875 read 0x0217d6 thru 0x0273fa (0x5c25 bytes) 000842 1775832774.183861 read 0x005c27 thru 0x00ecde (0x90b8 bytes) 000843 1775832774.190533 read 0x0032a2 thru 0x011ce6 (0xea45 bytes) 000844 1775832774.190895 read 0x016feb thru 0x01ae6a (0x3e80 bytes) 000845 1775832774.193205 MIRROR_RESYNC 9 mirrors 000846 1775832774.413716 read 0x00f886 thru 0x0145e6 (0x4d61 bytes) 000848 1775832774.414394 read 0x00430f thru 0x009544 (0x5236 bytes) 000849 1775832774.414695 mapwrite 0x00362f thru 0x004018 (0x9ea bytes) 000852 1775832774.487580 mapread 0x0191e3 thru 0x02180c (0x862a bytes) 000853 1775832774.488627 trunc from 0x0273fb to 0x017eab (0xf54f bytes) 000855 1775832774.501395 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17eac): Mirror 23: 0x4012a873 (stale) Mirror 24: 0x4012a873 (stale) Mirror 27: 0x4012a873 (stale) Mirror 28: 0x4012a873 (stale) Mirror 29: 0x4012a873 (stale) Mirror 30: 0x4012a873 (stale) Mirror 31: 0x4012a873 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17eac): Mirror 23: 0x4012a873 (stale) Mirror 24: 0x4012a873 (stale) Mirror 27: 0x4012a873 (stale) Mirror 28: 0x4012a873 (stale) Mirror 29: 0x4012a873 (stale) Mirror 30: 0x4012a873 (stale) Mirror 31: 0x4012a873 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17eac: skipped 000856 1775832774.695970 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x17eac): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17eac): Mirror 23: 0x4012a873 (stale) Mirror 24: 0x4012a873 (stale) Mirror 27: 0x4012a873 (stale) Mirror 28: 0x4012a873 (stale) Mirror 29: 0x4012a873 (stale) Mirror 30: 0x4012a873 (stale) Mirror 31: 0x4012a873 (stale) CRC-32 checksum value for chunk [0, 0x17eac): Mirror 1: 0xfc42b228 Mirror 32: 0xfc42b228 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17eac: skipped 000859 1775832775.067278 mapwrite 0x004943 thru 0x00d5c4 (0x8c82 bytes) 000860 1775832775.161232 trunc from 0x017eac to 0x001d5c (0x1614f bytes) 000861 1775832775.172789 write 0x0128bf thru 0x0206e8 (0xde2a bytes) 000864 1775832775.178255 MIRROR_RESYNC 9 mirrors 000865 1775832775.785413 mapwrite 0x024a3a thru 0x031dfe (0xd3c5 bytes) 000866 1775832775.871624 mapread 0x016cb5 thru 0x01cd85 (0x60d1 bytes) 000867 1775832775.877329 mapwrite 0x00fd15 thru 0x0146a6 (0x4992 bytes) 000868 1775832775.909493 read 0x02040c thru 0x02e239 (0xde2e bytes) 000869 1775832775.914356 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31dff): Mirror 23: 0x62c0eea2 (stale) Mirror 24: 0x62c0eea2 (stale) Mirror 27: 0x62c0eea2 (stale) Mirror 29: 0x62c0eea2 (stale) Mirror 30: 0x62c0eea2 (stale) Mirror 31: 0x62c0eea2 (stale) Mirror 32: 0x62c0eea2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31dff): Mirror 23: 0x62c0eea2 (stale) Mirror 24: 0x62c0eea2 (stale) Mirror 27: 0x62c0eea2 (stale) Mirror 29: 0x62c0eea2 (stale) Mirror 30: 0x62c0eea2 (stale) Mirror 31: 0x62c0eea2 (stale) Mirror 32: 0x62c0eea2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31dff: skipped 000870 1775832776.152195 mapwrite 0x0349c1 thru 0x03c1bf (0x77ff bytes) 000872 1775832776.191060 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3c1c0): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1c0): Mirror 23: 0x16f15f45 (stale) Mirror 24: 0x16f15f45 (stale) Mirror 27: 0x16f15f45 (stale) Mirror 29: 0x16f15f45 (stale) Mirror 30: 0x16f15f45 (stale) Mirror 31: 0x16f15f45 (stale) Mirror 32: 0x16f15f45 (stale) CRC-32 checksum value for chunk [0, 0x3c1c0): Mirror 1: 0x53af9fc2 Mirror 33: 0x53af9fc2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1c0: skipped 000874 1775832776.535997 mapwrite 0x0167ee thru 0x017bfe (0x1411 bytes) 000876 1775832776.615001 trunc from 0x03c1c0 to 0x03ac45 (0x157a bytes) 000877 1775832776.632667 MIRROR_RESYNC 9 mirrors 000879 1775832777.216664 read 0x039875 thru 0x03ac45 (0x13d1 bytes) 000880 1775832777.219597 mapwrite 0x025df2 thru 0x029a4f (0x3c5e bytes) 000881 1775832777.317789 mapread 0x029cdc thru 0x0395ab (0xf8d0 bytes) 000882 1775832777.339095 MIRROR_RESYNC 9 mirrors 000883 1775832777.875975 read 0x0318ee thru 0x031f27 (0x63a bytes) 000884 1775832777.878745 read 0x02f07e thru 0x0323bb (0x333e bytes) 000885 1775832777.886254 MIRROR_EXTEND to 10 mirrors 000888 1775832778.193840 trunc from 0x03ac46 to 0x033400 (0x7845 bytes) 000889 1775832778.237087 mapread 0x005063 thru 0x0057ba (0x758 bytes) 000890 1775832778.240654 write 0x0336dc thru 0x038101 (0x4a26 bytes) 000891 1775832778.243944 write 0x03ec1f thru 0x03ffff (0x13e1 bytes) 000893 1775832778.245420 mapwrite 0x036028 thru 0x03ae1d (0x4df6 bytes) 000895 1775832778.275382 read 0x01c4a4 thru 0x02ad43 (0xe8a0 bytes) 000896 1775832778.281952 MIRROR_RESYNC 10 mirrors 000897 1775832778.844312 mapread 0x032994 thru 0x039ef5 (0x7562 bytes) 000898 1775832778.856165 mapread 0x02e9e8 thru 0x03137c (0x2995 bytes) 000899 1775832778.856839 read 0x02e582 thru 0x03914c (0xabcb bytes) 000901 1775832778.860035 MIRROR_EXTEND to 11 mirrors 000902 1775832779.271352 MIRROR_RESYNC 11 mirrors 000903 1775832779.613369 mapwrite 0x038273 thru 0x03ffff (0x7d8d bytes) 000904 1775832779.741943 write 0x0396c2 thru 0x03f007 (0x5946 bytes) 000907 1775832779.744359 trunc from 0x040000 to 0x02a41e (0x15be1 bytes) 000908 1775832779.779125 trunc from 0x02a41f to 0x02bc4d (0x182f bytes) 000909 1775832779.792642 mapread 0x01cb93 thru 0x02bc4d (0xf0bb bytes) 000911 1775832779.807722 mapwrite 0x0152c5 thru 0x01ab51 (0x588d bytes) 000912 1775832779.839483 read 0x02526b thru 0x02bc4d (0x69e3 bytes) 000913 1775832779.840093 write 0x01c6f9 thru 0x01d1ce (0xad6 bytes) truncating to largest ever: 0x3f03d 000914 1775832779.840948 trunc from 0x02bc4e to 0x03f03c (0x133ef bytes) 000917 1775832779.850069 trunc from 0x03f03d to 0x0112d8 (0x2dd64 bytes) 000918 1775832779.861135 MIRROR_RESYNC 11 mirrors 000919 1775832780.574992 trunc from 0x0112d9 to 0x024e2a (0x13b52 bytes) 000920 1775832780.614620 trunc from 0x024e2b to 0x00d429 (0x17a01 bytes) 000921 1775832780.631174 read 0x003461 thru 0x00d429 (0x9fc9 bytes) 000924 1775832780.638606 mapwrite 0x00ec60 thru 0x0185f2 (0x9993 bytes) 000925 1775832780.715629 read 0x013aaa thru 0x01574a (0x1ca1 bytes) 000927 1775832780.716888 mapread 0x016a74 thru 0x0185f2 (0x1b7f bytes) 000928 1775832780.717869 mapread 0x0080be thru 0x014370 (0xc2b3 bytes) 000930 1775832780.719678 mapwrite 0x03f67d thru 0x03ffff (0x983 bytes) 000933 1775832780.777693 trunc from 0x040000 to 0x007a47 (0x385b8 bytes) 000934 1775832780.796695 write 0x01e0d5 thru 0x0222ea (0x4216 bytes) 000935 1775832780.797837 trunc from 0x0222eb to 0x0165b9 (0xbd31 bytes) 000937 1775832780.811577 trunc from 0x0165ba to 0x02235c (0xbda3 bytes) 000940 1775832780.824086 write 0x01bd6f thru 0x022cc1 (0x6f53 bytes) 000941 1775832780.837095 MIRROR_RESYNC 11 mirrors 000942 1775832781.647397 MIRROR_EXTEND to 12 mirrors 000944 1775832782.068601 write 0x03c037 thru 0x03f0cf (0x3099 bytes) 000945 1775832782.112268 MIRROR_RESYNC 12 mirrors 000946 1775832782.961982 MIRROR_EXTEND to 13 mirrors 000947 1775832783.394263 mapwrite 0x03fe3e thru 0x03ffff (0x1c2 bytes) 000949 1775832783.466891 trunc from 0x040000 to 0x030143 (0xfebc bytes) 000951 1775832783.482172 read 0x01e18e thru 0x01f23c (0x10af bytes) 000952 1775832783.486411 write 0x0374b0 thru 0x03ffff (0x8b50 bytes) 000953 1775832783.495176 MIRROR_RESYNC 13 mirrors 000954 1775832784.301845 mapwrite 0x02ac2e thru 0x034411 (0x97e4 bytes) 000956 1775832784.417716 read 0x00f1b6 thru 0x01bb0e (0xc959 bytes) 000964 1775832784.427953 trunc from 0x040000 to 0x00917a (0x36e85 bytes) 000965 1775832784.442604 read 0x00437f thru 0x00917a (0x4dfc bytes) 000969 1775832784.449142 write 0x00a6e3 thru 0x01701d (0xc93b bytes) 000970 1775832784.450376 mapwrite 0x013d02 thru 0x014090 (0x38f bytes) 000971 1775832784.473207 write 0x009ed9 thru 0x00beb9 (0x1fe1 bytes) 000973 1775832784.477976 MIRROR_RESYNC 13 mirrors 000974 1775832785.362671 write 0x01ef6c thru 0x021089 (0x211e bytes) 000979 1775832785.412760 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2108a): Mirror 23: 0x3b2a6ad6 (stale) Mirror 24: 0x3b2a6ad6 (stale) Mirror 27: 0x3b2a6ad6 (stale) Mirror 29: 0x3b2a6ad6 (stale) Mirror 30: 0x3b2a6ad6 (stale) Mirror 31: 0x3b2a6ad6 (stale) Mirror 32: 0x3b2a6ad6 (stale) Mirror 34: 0x3b2a6ad6 (stale) Mirror 35: 0x3b2a6ad6 (stale) Mirror 36: 0x3b2a6ad6 (stale) Mirror 37: 0x3b2a6ad6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2108a): Mirror 23: 0x3b2a6ad6 (stale) Mirror 24: 0x3b2a6ad6 (stale) Mirror 27: 0x3b2a6ad6 (stale) Mirror 29: 0x3b2a6ad6 (stale) Mirror 30: 0x3b2a6ad6 (stale) Mirror 31: 0x3b2a6ad6 (stale) Mirror 32: 0x3b2a6ad6 (stale) Mirror 34: 0x3b2a6ad6 (stale) Mirror 35: 0x3b2a6ad6 (stale) Mirror 36: 0x3b2a6ad6 (stale) Mirror 37: 0x3b2a6ad6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2108a: skipped 000980 1775832785.760203 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x3a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2108a): Mirror 23: 0x3b2a6ad6 (stale) Mirror 24: 0x3b2a6ad6 (stale) Mirror 27: 0x3b2a6ad6 (stale) Mirror 29: 0x3b2a6ad6 (stale) Mirror 30: 0x3b2a6ad6 (stale) Mirror 31: 0x3b2a6ad6 (stale) Mirror 32: 0x3b2a6ad6 (stale) Mirror 35: 0x3b2a6ad6 (stale) Mirror 36: 0x3b2a6ad6 (stale) Mirror 37: 0x3b2a6ad6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2108a): Mirror 23: 0x3b2a6ad6 (stale) Mirror 24: 0x3b2a6ad6 (stale) Mirror 27: 0x3b2a6ad6 (stale) Mirror 29: 0x3b2a6ad6 (stale) Mirror 30: 0x3b2a6ad6 (stale) Mirror 31: 0x3b2a6ad6 (stale) Mirror 32: 0x3b2a6ad6 (stale) Mirror 35: 0x3b2a6ad6 (stale) Mirror 36: 0x3b2a6ad6 (stale) Mirror 37: 0x3b2a6ad6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2108a: skipped 000982 1775832786.065320 mapread 0x016bd0 thru 0x021089 (0xa4ba bytes) 000983 1775832786.085533 MIRROR_RESYNC 11 mirrors 000986 1775832786.809645 mapread 0x01e5ed thru 0x021089 (0x2a9d bytes) 000988 1775832786.822537 read 0x01c99d thru 0x021089 (0x46ed bytes) 000989 1775832786.823061 mapwrite 0x0284bf thru 0x02c75a (0x429c bytes) 000991 1775832786.897088 read 0x0299a9 thru 0x02c75a (0x2db2 bytes) 000992 1775832786.897747 mapwrite 0x009e18 thru 0x00e916 (0x4aff bytes) 000995 1775832786.940007 read 0x003f54 thru 0x00933b (0x53e8 bytes) 000996 1775832786.940742 write 0x0121ad thru 0x01c1d2 (0xa026 bytes) 000997 1775832786.942842 write 0x035c4f thru 0x03ffff (0xa3b1 bytes) 000998 1775832786.944317 write 0x0184fa thru 0x0244a6 (0xbfad bytes) 001000 1775832786.945761 mapread 0x03a00d thru 0x03ffff (0x5ff3 bytes) All operations completed A-OK!