== sanity-flr test 70a: flr mode fsx test ================ 16:23:38 (1784233418) Seed set to 3419 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1784233419.718975 write 0x00784a thru 0x01113f (0x98f6 bytes) truncating to largest ever: 0x36e5c 000002 1784233419.744506 trunc from 0x011140 to 0x036e5b (0x25d1c bytes) 000006 1784233419.759032 mapwrite 0x003c16 thru 0x011a39 (0xde24 bytes) 000010 1784233419.865556 trunc from 0x036e5c to 0x02425d (0x12bfe bytes) 000013 1784233419.899825 read 0x0052e8 thru 0x0107da (0xb4f3 bytes) 000014 1784233419.913508 MIRROR_EXTEND to 2 mirrors 000015 1784233420.412058 mapread 0x01b18b thru 0x01f849 (0x46bf bytes) 000016 1784233420.444520 read 0x01a5ec thru 0x01d7d5 (0x31ea bytes) 000017 1784233420.450904 mapwrite 0x03c5eb thru 0x03ffff (0x3a15 bytes) 000018 1784233420.618582 trunc from 0x040000 to 0x0249f6 (0x1b609 bytes) 000019 1784233420.658924 write 0x025642 thru 0x02b66b (0x602a bytes) 000022 1784233420.671089 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x3b7db 000023 1784233421.129198 trunc from 0x02b66c to 0x03b7da (0x1016f bytes) 000024 1784233421.174910 mapwrite 0x02b6f6 thru 0x03957b (0xde86 bytes) 000025 1784233421.255426 mapwrite 0x00c81c thru 0x0169e9 (0xa1ce bytes) 000028 1784233421.308282 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b7db): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7db): Mirror 2: 0xcf5c3045 (stale) CRC-32 checksum value for chunk [0, 0x3b7db): Mirror 1: 0xdffa4fa8 Mirror 3: 0xdffa4fa8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7db: skipped 000029 1784233421.802518 mapwrite 0x03953e thru 0x039869 (0x32c bytes) 000031 1784233421.910876 write 0x01e647 thru 0x0265a0 (0x7f5a bytes) 000032 1784233421.916238 mapread 0x02066d thru 0x02f4ca (0xee5e bytes) 000033 1784233421.921883 mapwrite 0x023936 thru 0x02b25e (0x7929 bytes) 000035 1784233421.962593 read 0x02b460 thru 0x03704d (0xbbee bytes) 000036 1784233421.970924 trunc from 0x03b7db to 0x00891f (0x32ebb bytes) 000037 1784233422.014696 read 0x00205c thru 0x00891f (0x68c4 bytes) 000038 1784233422.020363 read 0x0018f0 thru 0x00891f (0x7030 bytes) 000039 1784233422.021161 write 0x00a81d thru 0x00abab (0x38f bytes) 000041 1784233422.023516 mapread 0x00086c thru 0x004f9d (0x4732 bytes) 000042 1784233422.032355 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xabac): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xabac): Mirror 2: 0x3d14d144 (stale) Mirror 3: 0x3d14d144 (stale) CRC-32 checksum value for chunk [0, 0xabac): Mirror 1: 0x5d502715 Mirror 4: 0x5d502715 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xabac: skipped 000044 1784233422.610496 mapread 0x00608d thru 0x00abab (0x4b1f bytes) 000045 1784233422.637209 trunc from 0x00abac to 0x018c6f (0xe0c4 bytes) 000046 1784233422.731678 write 0x00f5cf thru 0x014e0e (0x5840 bytes) 000049 1784233422.742016 read 0x00660c thru 0x011e73 (0xb868 bytes) 000050 1784233422.750202 trunc from 0x018c70 to 0x00fe64 (0x8e0b bytes) 000051 1784233422.765717 write 0x00d378 thru 0x01397e (0x6607 bytes) 000052 1784233422.767274 trunc from 0x01397f to 0x03a827 (0x26ea9 bytes) 000053 1784233422.784214 write 0x019aba thru 0x028a4f (0xef96 bytes) 000054 1784233422.796257 MIRROR_RESYNC 4 mirrors 000056 1784233423.384193 mapread 0x01616a thru 0x025466 (0xf2fd bytes) 000057 1784233423.412510 read 0x0042cb thru 0x012f42 (0xec78 bytes) 000058 1784233423.420341 trunc from 0x03a828 to 0x00c615 (0x2e212 bytes) 000060 1784233423.508016 MIRROR_RESYNC 4 mirrors 000062 1784233424.006594 MIRROR_RESYNC 4 mirrors 000064 1784233424.280231 mapwrite 0x032dd8 thru 0x03c7d7 (0x9a00 bytes) 000066 1784233424.409959 mapread 0x01665c thru 0x01ca48 (0x63ed bytes) 000067 1784233424.424804 write 0x03f04a thru 0x03ffff (0xfb6 bytes) 000069 1784233424.431384 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x81803615 (stale) Mirror 3: 0x81803615 (stale) Mirror 4: 0x81803615 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2a34fbb5 Mirror 5: 0x2a34fbb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000070 1784233425.091850 MIRROR_RESYNC 5 mirrors 000072 1784233425.760195 mapread 0x0160ae thru 0x021178 (0xb0cb bytes) 000073 1784233425.783141 write 0x03437e thru 0x03ffff (0xbc82 bytes) 000074 1784233425.829397 mapread 0x01eef8 thru 0x020265 (0x136e bytes) 000075 1784233425.835512 trunc from 0x040000 to 0x00db75 (0x3248a bytes) 000076 1784233425.872408 write 0x03b584 thru 0x03ffff (0x4a7c bytes) 000077 1784233425.873720 write 0x000d83 thru 0x00a8a9 (0x9b27 bytes) 000080 1784233425.885303 read 0x03a2fa thru 0x03ffff (0x5d06 bytes) 000084 1784233425.897602 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2a34fbb5 (stale) Mirror 3: 0x2a34fbb5 (stale) Mirror 4: 0x2a34fbb5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2a34fbb5 (stale) Mirror 3: 0x2a34fbb5 (stale) Mirror 4: 0x2a34fbb5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000086 1784233426.248122 write 0x004716 thru 0x005f42 (0x182d bytes) 000087 1784233426.274313 mapread 0x025301 thru 0x03482d (0xf52d bytes) 000088 1784233426.301488 read 0x001d3d thru 0x00266d (0x931 bytes) truncating to largest ever: 0x3fbc7 000091 1784233426.310867 trunc from 0x040000 to 0x03fbc6 (0x439 bytes) 000094 1784233426.329191 mapwrite 0x036342 thru 0x038afa (0x27b9 bytes) 000096 1784233426.372215 mapwrite 0x0383c7 thru 0x038641 (0x27b bytes) 000099 1784233426.417929 mapwrite 0x02471f thru 0x02581d (0x10ff bytes) 000103 1784233426.441720 mapread 0x0029bd thru 0x01207e (0xf6c2 bytes) 000106 1784233426.453000 mapwrite 0x014856 thru 0x019bd7 (0x5382 bytes) 000107 1784233426.493975 read 0x03a017 thru 0x03b016 (0x1000 bytes) 000108 1784233426.508849 read 0x01fb2e thru 0x02a31a (0xa7ed bytes) 000109 1784233426.509699 read 0x000bc9 thru 0x00ae0e (0xa246 bytes) 000111 1784233426.512225 mapwrite 0x0110f6 thru 0x01eb79 (0xda84 bytes) 000112 1784233426.551711 read 0x0202e0 thru 0x02ba99 (0xb7ba bytes) 000113 1784233426.552464 write 0x02663b thru 0x031b21 (0xb4e7 bytes) 000114 1784233426.553849 mapwrite 0x00178e thru 0x0077be (0x6031 bytes) 000115 1784233426.608211 mapwrite 0x02031f thru 0x0251c0 (0x4ea2 bytes) 000116 1784233426.651473 mapread 0x009875 thru 0x00b3a7 (0x1b33 bytes) 000118 1784233426.655276 mapread 0x01a83d thru 0x02a60e (0xfdd2 bytes) 000120 1784233426.666381 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fbc7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbc7): Mirror 2: 0xb28011c8 (stale) Mirror 3: 0xb28011c8 (stale) Mirror 4: 0xb28011c8 (stale) CRC-32 checksum value for chunk [0, 0x3fbc7): Mirror 1: 0x9b4a1f43 Mirror 5: 0x9b4a1f43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbc7: skipped 000123 1784233427.345111 mapwrite 0x007676 thru 0x00a785 (0x3110 bytes) 000124 1784233427.509508 write 0x03eb5a thru 0x03ffff (0x14a6 bytes) 000125 1784233427.513974 mapread 0x031620 thru 0x036a97 (0x5478 bytes) 000126 1784233427.523160 read 0x004c16 thru 0x00d66a (0x8a55 bytes) 000127 1784233427.523688 mapread 0x038f0e thru 0x03abf8 (0x1ceb bytes) 000129 1784233427.534344 MIRROR_RESYNC 5 mirrors 000131 1784233428.332859 mapwrite 0x01e2b8 thru 0x02b1af (0xcef8 bytes) 000132 1784233428.479315 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x734bf10c (stale) Mirror 4: 0x734bf10c (stale) Mirror 5: 0x734bf10c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x734bf10c (stale) Mirror 4: 0x734bf10c (stale) Mirror 5: 0x734bf10c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000133 1784233428.783217 trunc from 0x040000 to 0x00d551 (0x32aae bytes) 000134 1784233428.815891 read 0x00915f thru 0x00d551 (0x43f3 bytes) 000136 1784233428.827552 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd552): Mirror 4: 0xcf0c7481 (stale) Mirror 5: 0xcf0c7481 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd552): Mirror 4: 0xcf0c7481 (stale) Mirror 5: 0xcf0c7481 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd552: skipped 000137 1784233429.050532 trunc from 0x00d552 to 0x02e3b9 (0x20e68 bytes) 000138 1784233429.066425 mapread 0x02d0f1 thru 0x02d41c (0x32c bytes) 000139 1784233429.071965 trunc from 0x02e3ba to 0x036434 (0x807b bytes) 000141 1784233429.086425 write 0x030048 thru 0x031cb6 (0x1c6f bytes) 000143 1784233429.094130 mapread 0x02f4da thru 0x036434 (0x6f5b bytes) 000144 1784233429.116062 MIRROR_RESYNC 3 mirrors 000147 1784233429.861422 read 0x00fe61 thru 0x01f755 (0xf8f5 bytes) 000148 1784233429.874654 write 0x03fc16 thru 0x03ffff (0x3ea bytes) 000149 1784233429.936634 MIRROR_RESYNC 3 mirrors 000150 1784233430.561679 trunc from 0x040000 to 0x002101 (0x3defe bytes) 000152 1784233430.649472 read 0x0012fd thru 0x002101 (0xe05 bytes) 000154 1784233430.654943 read 0x0017a7 thru 0x002101 (0x95b bytes) 000155 1784233430.655721 trunc from 0x002102 to 0x012d5a (0x10c59 bytes) 000158 1784233430.677954 MIRROR_RESYNC 3 mirrors 000162 1784233431.134344 trunc from 0x012d5b to 0x0361b0 (0x23456 bytes) 000163 1784233431.194120 mapwrite 0x017312 thru 0x01adb9 (0x3aa8 bytes) 000165 1784233431.249611 mapread 0x031bca thru 0x0361b0 (0x45e7 bytes) 000166 1784233431.261839 mapread 0x0016fe thru 0x0082a3 (0x6ba6 bytes) 000167 1784233431.274336 write 0x008faf thru 0x00ac77 (0x1cc9 bytes) 000168 1784233431.275308 mapwrite 0x01a92a thru 0x020e0c (0x64e3 bytes) 000169 1784233431.323716 mapread 0x024fdd thru 0x02f4f8 (0xa51c bytes) 000171 1784233431.340538 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x361b1): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x361b1): Mirror 4: 0xc1ed9f21 (stale) Mirror 5: 0xc1ed9f21 (stale) CRC-32 checksum value for chunk [0, 0x361b1): Mirror 1: 0x5d677af7 Mirror 6: 0x5d677af7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x361b1: skipped 000172 1784233431.921445 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x361b1): Mirror 5: 0xc1ed9f21 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x361b1): Mirror 5: 0xc1ed9f21 (stale) CRC-32 checksum value for chunk [0, 0x361b1): Mirror 1: 0x5d677af7 Mirror 6: 0x5d677af7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x361b1: skipped 000175 1784233432.286892 MIRROR_RESYNC 3 mirrors 000176 1784233432.735518 trunc from 0x0361b1 to 0x01cec2 (0x192ee bytes) 000177 1784233432.831902 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1cec3): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cec3): Mirror 5: 0xf7509c85 (stale) Mirror 6: 0xf7509c85 (stale) CRC-32 checksum value for chunk [0, 0x1cec3): Mirror 1: 0xf7509c85 Mirror 7: 0xf7509c85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cec3: skipped 000178 1784233433.398057 trunc from 0x01cec3 to 0x028e30 (0xbf6e bytes) 000179 1784233433.455881 read 0x01e706 thru 0x028d8a (0xa685 bytes) 000180 1784233433.465687 read 0x00930a thru 0x00dd49 (0x4a40 bytes) 000182 1784233433.474700 write 0x00bf47 thru 0x0106bd (0x4777 bytes) 000184 1784233433.477195 write 0x0233b8 thru 0x028bd6 (0x581f bytes) 000187 1784233433.483997 MIRROR_RESYNC 4 mirrors 000189 1784233433.987437 mapread 0x00e1dd thru 0x00e2fd (0x121 bytes) 000190 1784233433.990475 write 0x00bbba thru 0x01068f (0x4ad6 bytes) 000191 1784233434.045828 trunc from 0x028e31 to 0x03413d (0xb30d bytes) 000192 1784233434.080702 MIRROR_RESYNC 4 mirrors 000196 1784233434.729223 write 0x0190ae thru 0x01f4df (0x6432 bytes) 000197 1784233434.799250 mapwrite 0x00c030 thru 0x011ffc (0x5fcd bytes) 000199 1784233434.839234 mapwrite 0x014f65 thru 0x0193b8 (0x4454 bytes) 000201 1784233434.865372 read 0x0271f0 thru 0x02886a (0x167b bytes) 000206 1784233434.872898 mapwrite 0x01a543 thru 0x02789a (0xd358 bytes) 000207 1784233434.967982 mapwrite 0x010a62 thru 0x015725 (0x4cc4 bytes) 000208 1784233435.009258 trunc from 0x03413e to 0x030f0c (0x3231 bytes) 000212 1784233435.030220 mapread 0x0247ee thru 0x030f0c (0xc71f bytes) 000214 1784233435.040570 read 0x023a0b thru 0x024e60 (0x1456 bytes) 000217 1784233435.046340 MIRROR_RESYNC 4 mirrors 000218 1784233435.695190 mapread 0x00a9f5 thru 0x0148c3 (0x9ecf bytes) 000219 1784233435.717376 trunc from 0x030f0d to 0x009f55 (0x26fb7 bytes) 000221 1784233435.802447 MIRROR_RESYNC 4 mirrors 000222 1784233436.324554 mapread 0x001101 thru 0x001f85 (0xe85 bytes) 000223 1784233436.327697 trunc from 0x009f56 to 0x003420 (0x6b35 bytes) 000224 1784233436.389220 trunc from 0x003421 to 0x00d8d6 (0xa4b6 bytes) 000225 1784233436.408363 mapread 0x00d7da thru 0x00d8d6 (0xfd bytes) 000227 1784233436.416100 mapread 0x00451a thru 0x00ceb1 (0x8998 bytes) 000228 1784233436.424170 mapwrite 0x0126bd thru 0x01af70 (0x88b4 bytes) 000231 1784233436.510978 write 0x0204f5 thru 0x025937 (0x5443 bytes) 000234 1784233436.513422 trunc from 0x025938 to 0x0304ec (0xabb5 bytes) 000235 1784233436.526635 mapwrite 0x00e680 thru 0x01e071 (0xf9f2 bytes) 000236 1784233436.610540 trunc from 0x0304ed to 0x03f307 (0xee1b bytes) 000237 1784233436.630127 trunc from 0x03f308 to 0x0135c9 (0x2bd3e bytes) 000238 1784233436.646114 trunc from 0x0135ca to 0x02587a (0x122b1 bytes) 000239 1784233436.666183 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2587b): Mirror 6: 0x16d8e6b9 (stale) Mirror 7: 0x16d8e6b9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2587b): Mirror 6: 0x16d8e6b9 (stale) Mirror 7: 0x16d8e6b9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2587b: skipped 000241 1784233436.975482 trunc from 0x02587b to 0x02710e (0x1894 bytes) 000242 1784233437.005518 mapwrite 0x036d8f thru 0x0387aa (0x1a1c bytes) 000244 1784233437.102481 write 0x0010c7 thru 0x009914 (0x884e bytes) 000245 1784233437.113166 trunc from 0x0387ab to 0x005f5b (0x3284f bytes) 000246 1784233437.128687 mapwrite 0x030a20 thru 0x0339d8 (0x2fb9 bytes) 000247 1784233437.191947 mapread 0x02b985 thru 0x0339d8 (0x8054 bytes) 000248 1784233437.193205 write 0x0270a0 thru 0x0281d4 (0x1135 bytes) 000249 1784233437.206060 read 0x00d785 thru 0x00ecca (0x1546 bytes) 000251 1784233437.216281 trunc from 0x0339d9 to 0x011df5 (0x21be3 bytes) 000252 1784233437.233503 mapread 0x009791 thru 0x00d1a1 (0x3a11 bytes) 000253 1784233437.244317 mapread 0x00f58d thru 0x011df5 (0x2869 bytes) 000254 1784233437.250851 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x11df6): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11df6): Mirror 6: 0x7518511f (stale) Mirror 7: 0x7518511f (stale) CRC-32 checksum value for chunk [0, 0x11df6): Mirror 1: 0x63e6ee58 Mirror 8: 0x63e6ee58 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11df6: skipped 000256 1784233437.790038 mapwrite 0x0094c5 thru 0x01254d (0x9089 bytes) 000257 1784233437.958595 mapwrite 0x02dc97 thru 0x03d0f0 (0xf45a bytes) 000258 1784233438.048624 write 0x02d760 thru 0x03901b (0xb8bc bytes) 000259 1784233438.052818 trunc from 0x03d0f1 to 0x036658 (0x6a98 bytes) 000262 1784233438.073942 read 0x01caff thru 0x026445 (0x9947 bytes) 000265 1784233438.097292 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36659): Mirror 6: 0xaa898380 (stale) Mirror 7: 0xaa898380 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36659): Mirror 6: 0xaa898380 (stale) Mirror 7: 0xaa898380 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36659: skipped 000266 1784233438.421891 trunc from 0x036659 to 0x006631 (0x30027 bytes) 000269 1784233438.437409 mapread 0x003dc1 thru 0x00612e (0x236e bytes) 000273 1784233438.457460 mapread 0x004821 thru 0x006631 (0x1e11 bytes) 000274 1784233438.459802 mapread 0x001039 thru 0x006631 (0x55f9 bytes) 000275 1784233438.461935 mapwrite 0x03208e thru 0x033bd8 (0x1b4b bytes) 000276 1784233438.554569 read 0x0264c2 thru 0x03134b (0xae8a bytes) 000277 1784233438.569980 mapwrite 0x00c6ef thru 0x017646 (0xaf58 bytes) 000278 1784233438.632190 trunc from 0x033bd9 to 0x03a18e (0x65b6 bytes) 000279 1784233438.643714 mapwrite 0x02f0c2 thru 0x03d85b (0xe79a bytes) 000280 1784233438.712704 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d85c): Mirror 7: 0x674dfddd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d85c): Mirror 7: 0x674dfddd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d85c: skipped 000281 1784233438.922272 mapwrite 0x02e546 thru 0x03432f (0x5dea bytes) 000283 1784233438.982924 mapread 0x028fd4 thru 0x02b71b (0x2748 bytes) 000284 1784233438.992004 mapread 0x0271b1 thru 0x02bab2 (0x4902 bytes) 000285 1784233438.993276 mapread 0x02e631 thru 0x02f033 (0xa03 bytes) 000286 1784233439.002543 MIRROR_RESYNC 2 mirrors 000288 1784233439.595274 trunc from 0x03d85c to 0x03387d (0x9fde bytes) 000290 1784233439.653623 write 0x03cac3 thru 0x03ffff (0x353d bytes) 000291 1784233439.655943 trunc from 0x040000 to 0x0196c1 (0x2693e bytes) 000292 1784233439.690350 mapwrite 0x0095e4 thru 0x00bd3a (0x2757 bytes) 000293 1784233439.759255 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x196c2): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x196c2): Mirror 7: 0x3f8b17a9 (stale) CRC-32 checksum value for chunk [0, 0x196c2): Mirror 1: 0x86883db9 Mirror 8: 0x86883db9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x196c2: skipped 000294 1784233440.451564 mapread 0x001c4b thru 0x00a51b (0x88d1 bytes) 000295 1784233440.482915 mapread 0x007096 thru 0x00e3b0 (0x731b bytes) 000296 1784233440.499564 read 0x008fee thru 0x012547 (0x955a bytes) 000298 1784233440.522938 MIRROR_RESYNC 3 mirrors 000301 1784233440.998550 mapread 0x012873 thru 0x0196c1 (0x6e4f bytes) 000303 1784233441.018732 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) 000304 1784233441.180669 read 0x015694 thru 0x0196c1 (0x402e bytes) 000306 1784233441.186263 write 0x03f656 thru 0x03ffff (0x9aa bytes) 000307 1784233441.226672 mapwrite 0x006084 thru 0x011722 (0xb69f bytes) 000309 1784233441.292337 read 0x005a83 thru 0x013056 (0xd5d4 bytes) 000311 1784233441.293608 read 0x02ef5c thru 0x03c3cc (0xd471 bytes) 000313 1784233441.306791 mapread 0x02bf0c thru 0x035788 (0x987d bytes) 000314 1784233441.311483 MIRROR_RESYNC 2 mirrors 000316 1784233441.747043 mapread 0x00745b thru 0x011702 (0xa2a8 bytes) 000317 1784233441.757331 trunc from 0x040000 to 0x023d67 (0x1c298 bytes) 000318 1784233441.825588 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x23d68): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23d68): Mirror 8: 0xa694809c (stale) CRC-32 checksum value for chunk [0, 0x23d68): Mirror 1: 0xa694809c Mirror 9: 0xa694809c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23d68: skipped 000319 1784233442.394301 read 0x01c85b thru 0x023d67 (0x750d bytes) 000324 1784233442.434845 mapread 0x01c23e thru 0x022770 (0x6533 bytes) 000325 1784233442.449344 write 0x0337bd thru 0x03618a (0x29ce bytes) 000326 1784233442.519510 read 0x024e20 thru 0x02eb8e (0x9d6f bytes) 000327 1784233442.529286 write 0x03d9aa thru 0x03ffff (0x2656 bytes) 000328 1784233442.530434 mapwrite 0x02266f thru 0x0319be (0xf350 bytes) 000329 1784233442.588569 MIRROR_RESYNC 3 mirrors 000330 1784233443.376572 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) 000331 1784233443.672487 mapwrite 0x03725e thru 0x03d2d2 (0x6075 bytes) 000333 1784233443.841451 trunc from 0x040000 to 0x0124af (0x2db50 bytes) 000334 1784233443.870008 mapread 0x00d693 thru 0x0124af (0x4e1d bytes) 000335 1784233443.885960 trunc from 0x0124b0 to 0x02ebb4 (0x1c705 bytes) 000337 1784233443.904134 MIRROR_RESYNC 2 mirrors 000339 1784233444.417259 read 0x00df19 thru 0x01d8d2 (0xf9ba bytes) 000340 1784233444.429252 mapread 0x003511 thru 0x00d1b4 (0x9ca4 bytes) 000341 1784233444.454066 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) 000342 1784233444.588591 mapwrite 0x00da35 thru 0x01bf50 (0xe51c bytes) 000344 1784233444.661578 mapwrite 0x01d86a thru 0x01e4d2 (0xc69 bytes) 000346 1784233444.710700 write 0x03bcfe thru 0x03ffff (0x4302 bytes) 000347 1784233444.713471 write 0x008a4e thru 0x016822 (0xddd5 bytes) 000350 1784233444.718184 write 0x01c465 thru 0x02bbf2 (0xf78e bytes) 000353 1784233444.728673 read 0x010233 thru 0x015358 (0x5126 bytes) 000356 1784233444.731566 write 0x02cbff thru 0x03b08c (0xe48e bytes) 000358 1784233444.743661 mapread 0x03925f thru 0x03bf89 (0x2d2b bytes) 000359 1784233444.745463 mapread 0x022fc8 thru 0x029767 (0x67a0 bytes) 000360 1784233444.747394 write 0x008650 thru 0x00b049 (0x29fa bytes) 000361 1784233444.749107 mapread 0x029b3f thru 0x0370ea (0xd5ac bytes) 000362 1784233444.751218 read 0x012103 thru 0x01e459 (0xc357 bytes) 000363 1784233444.752724 trunc from 0x040000 to 0x0080b2 (0x37f4d bytes) 000364 1784233444.770213 read 0x003474 thru 0x0080b2 (0x4c3f bytes) 000366 1784233444.784240 MIRROR_EXTEND to 2 mirrors 000367 1784233445.295881 write 0x00d71f thru 0x0179ba (0xa29c bytes) 000369 1784233445.349561 write 0x02635c thru 0x027e01 (0x1aa6 bytes) 000371 1784233445.356362 MIRROR_RESYNC 2 mirrors 000375 1784233446.015466 mapwrite 0x03dd20 thru 0x03f735 (0x1a16 bytes) 000377 1784233446.166502 trunc from 0x03f736 to 0x008725 (0x37010 bytes) 000378 1784233446.197389 mapwrite 0x01b0b9 thru 0x01ee6d (0x3db5 bytes) 000381 1784233446.265003 read 0x00b84b thru 0x018dab (0xd561 bytes) 000382 1784233446.276132 trunc from 0x01ee6e to 0x01928a (0x5be3 bytes) 000384 1784233446.293405 read 0x01770c thru 0x01928a (0x1b7f bytes) 000386 1784233446.299082 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) 000389 1784233446.432626 mapread 0x017ec9 thru 0x01928a (0x13c2 bytes) 000390 1784233446.449651 mapread 0x013fa7 thru 0x01928a (0x52e4 bytes) 000391 1784233446.450601 write 0x008a01 thru 0x014749 (0xbd49 bytes) 000394 1784233446.463312 write 0x018a19 thru 0x01ed1c (0x6304 bytes) 000396 1784233446.469441 read 0x003395 thru 0x007b8a (0x47f6 bytes) 000397 1784233446.483187 trunc from 0x01ed1d to 0x035b74 (0x16e58 bytes) 000399 1784233446.501959 trunc from 0x035b75 to 0x0088b1 (0x2d2c3 bytes) 000401 1784233446.525292 mapread 0x00101a thru 0x0088b1 (0x7898 bytes) 000402 1784233446.535270 trunc from 0x0088b2 to 0x034223 (0x2b972 bytes) 000403 1784233446.550974 mapread 0x003082 thru 0x00e669 (0xb5e8 bytes) 000404 1784233446.560847 mapwrite 0x00ca8b thru 0x014b30 (0x80a6 bytes) 000405 1784233446.650908 read 0x028cfe thru 0x02bfcf (0x32d2 bytes) 000406 1784233446.663735 mapwrite 0x03a5dc thru 0x03b661 (0x1086 bytes) 000407 1784233446.739553 mapwrite 0x012d46 thru 0x01319b (0x456 bytes) 000408 1784233446.766918 write 0x025ab5 thru 0x032c57 (0xd1a3 bytes) 000409 1784233446.768311 trunc from 0x03b662 to 0x008c4e (0x32a13 bytes) 000411 1784233446.783204 mapread 0x0071e6 thru 0x008c4e (0x1a69 bytes) 000414 1784233446.786202 mapwrite 0x02a90e thru 0x02b2a8 (0x99b bytes) 000415 1784233446.841474 trunc from 0x02b2a9 to 0x00daf1 (0x1d7b7 bytes) 000417 1784233446.859810 mapwrite 0x0173f8 thru 0x01d6e3 (0x62ec bytes) 000418 1784233447.002288 write 0x037a79 thru 0x03a0eb (0x2673 bytes) 000420 1784233447.005111 read 0x0122fb thru 0x0129ec (0x6f2 bytes) 000422 1784233447.024165 trunc from 0x03a0ec to 0x001b54 (0x38597 bytes) 000425 1784233447.038398 mapwrite 0x03e4f8 thru 0x03ffff (0x1b08 bytes) 000426 1784233447.092474 write 0x0168dd thru 0x020b0e (0xa232 bytes) 000427 1784233447.101183 mapread 0x00a40d thru 0x0177bf (0xd3b3 bytes) 000429 1784233447.150480 read 0x00ec66 thru 0x018504 (0x989f bytes) 000432 1784233447.154405 mapwrite 0x02bb92 thru 0x02c820 (0xc8f bytes) 000436 1784233447.200314 mapwrite 0x03d7b0 thru 0x03ffff (0x2850 bytes) 000437 1784233447.237297 mapwrite 0x038a80 thru 0x03ffff (0x7580 bytes) 000439 1784233447.277712 write 0x01f67d thru 0x025925 (0x62a9 bytes) 000441 1784233447.279719 trunc from 0x040000 to 0x025845 (0x1a7ba bytes) 000443 1784233447.295008 mapread 0x00324d thru 0x006ba1 (0x3955 bytes) 000445 1784233447.296250 trunc from 0x025846 to 0x01f191 (0x66b4 bytes) 000446 1784233447.307983 write 0x011d70 thru 0x017938 (0x5bc9 bytes) 000447 1784233447.310305 mapwrite 0x02f172 thru 0x0358f4 (0x6783 bytes) 000448 1784233447.390932 trunc from 0x0358f5 to 0x02df9a (0x795a bytes) 000449 1784233447.406932 write 0x016da9 thru 0x02012d (0x9385 bytes) 000450 1784233447.413160 mapread 0x0031e8 thru 0x00817f (0x4f98 bytes) 000451 1784233447.415095 mapwrite 0x022f98 thru 0x02663c (0x36a5 bytes) 000452 1784233447.510847 mapwrite 0x00a433 thru 0x0146a9 (0xa277 bytes) 000453 1784233447.584930 read 0x022290 thru 0x024f27 (0x2c98 bytes) 000454 1784233447.585725 mapwrite 0x00429d thru 0x00f36a (0xb0ce bytes) 000458 1784233447.658935 write 0x016edb thru 0x018114 (0x123a bytes) 000459 1784233447.660129 read 0x00c92b thru 0x015eda (0x95b0 bytes) 000460 1784233447.662516 trunc from 0x02df9b to 0x0378b7 (0x991d bytes) 000461 1784233447.692320 write 0x036e4f thru 0x03ed1a (0x7ecc bytes) 000464 1784233447.726145 read 0x027593 thru 0x02a120 (0x2b8e bytes) 000465 1784233447.727045 mapread 0x0134cb thru 0x0229f7 (0xf52d bytes) 000466 1784233447.734524 read 0x006bfb thru 0x00ea15 (0x7e1b bytes) 000469 1784233447.737942 mapwrite 0x03760c thru 0x0396cd (0x20c2 bytes) 000470 1784233447.775329 read 0x028817 thru 0x02bac0 (0x32aa bytes) 000471 1784233447.776065 mapwrite 0x030aa6 thru 0x03888c (0x7de7 bytes) 000474 1784233447.819684 mapread 0x0393d6 thru 0x03ed1a (0x5945 bytes) 000475 1784233447.830720 MIRROR_EXTEND to 2 mirrors 000477 1784233448.363453 write 0x01dadc thru 0x02c4c8 (0xe9ed bytes) 000479 1784233448.422948 mapread 0x026184 thru 0x027733 (0x15b0 bytes) 000480 1784233448.423601 write 0x00d943 thru 0x010546 (0x2c04 bytes) 000481 1784233448.432736 MIRROR_RESYNC 2 mirrors 000486 1784233448.999367 trunc from 0x03ed1b to 0x024cdf (0x1a03b bytes) 000487 1784233449.079370 trunc from 0x024ce0 to 0x032742 (0xda63 bytes) 000488 1784233449.095917 mapread 0x0055dd thru 0x01249c (0xcec0 bytes) 000489 1784233449.118737 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) 000490 1784233449.219592 mapread 0x00919b thru 0x0123cf (0x9235 bytes) 000494 1784233449.242941 MIRROR_EXTEND to 2 mirrors 000496 1784233449.982591 read 0x01985f thru 0x028e05 (0xf5a7 bytes) 000497 1784233449.996011 write 0x031b51 thru 0x0351ef (0x369f bytes) 000499 1784233450.070318 mapread 0x0304fa thru 0x0351ef (0x4cf6 bytes) 000500 1784233450.078637 read 0x02f359 thru 0x03276c (0x3414 bytes) 000501 1784233450.089361 mapread 0x01c89f thru 0x01d8eb (0x104d bytes) 000502 1784233450.092196 write 0x016ae3 thru 0x01fadd (0x8ffb bytes) 000506 1784233450.111414 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x351f0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351f0): Mirror 2: 0xc1a46610 (stale) CRC-32 checksum value for chunk [0, 0x351f0): Mirror 1: 0x9cd9c66d Mirror 3: 0x9cd9c66d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351f0: skipped 000507 1784233451.009265 trunc from 0x0351f0 to 0x01fc4f (0x155a0 bytes) 000508 1784233451.135619 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1fc50): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fc50): Mirror 2: 0xdf22f784 (stale) Mirror 3: 0x4fdb051b (stale) CRC-32 checksum value for chunk [0, 0x1fc50): Mirror 1: 0x4fdb051b Mirror 4: 0x4fdb051b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fc50: skipped 000512 1784233451.961086 MIRROR_RESYNC 4 mirrors 000513 1784233452.617714 MIRROR_EXTEND to 5 mirrors 000515 1784233453.090712 mapwrite 0x02823e thru 0x03275a (0xa51d bytes) 000519 1784233453.211269 mapread 0x00251d thru 0x00f7a9 (0xd28d bytes) 000520 1784233453.220207 read 0x01398e thru 0x014a60 (0x10d3 bytes) 000522 1784233453.228517 trunc from 0x03275b to 0x02678f (0xbfcb bytes) 000527 1784233453.254989 mapread 0x009668 thru 0x01437b (0xad14 bytes) 000529 1784233453.267563 mapread 0x018612 thru 0x020dff (0x87ee bytes) 000530 1784233453.279401 mapwrite 0x037c36 thru 0x03ffff (0x83ca bytes) 000533 1784233453.377710 mapread 0x038989 thru 0x03e308 (0x5980 bytes) 000534 1784233453.380572 read 0x02932b thru 0x0295d0 (0x2a6 bytes) 000536 1784233453.389197 mapwrite 0x021ade thru 0x0304c9 (0xe9ec bytes) 000538 1784233453.482191 read 0x01ad49 thru 0x01b4c9 (0x781 bytes) 000540 1784233453.488507 mapread 0x00f240 thru 0x01bbcc (0xc98d bytes) 000542 1784233453.494349 read 0x013fed thru 0x01f38f (0xb3a3 bytes) 000543 1784233453.496524 write 0x039333 thru 0x03ffff (0x6ccd bytes) 000544 1784233453.499670 read 0x0095c6 thru 0x014471 (0xaeac bytes) 000545 1784233453.506868 write 0x02ea4a thru 0x031de6 (0x339d bytes) 000548 1784233453.510409 write 0x03ea4b thru 0x03ffff (0x15b5 bytes) 000549 1784233453.511881 mapread 0x025dae thru 0x028691 (0x28e4 bytes) 000552 1784233453.516068 mapwrite 0x03bd1f thru 0x03ffff (0x42e1 bytes) 000553 1784233453.586848 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5de1895d (stale) Mirror 4: 0x5de1895d (stale) Mirror 5: 0x5de1895d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5de1895d (stale) Mirror 4: 0x5de1895d (stale) Mirror 5: 0x5de1895d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000556 1784233453.886843 mapwrite 0x03094b thru 0x03b90f (0xafc5 bytes) 000557 1784233453.940522 MIRROR_RESYNC 4 mirrors 000558 1784233454.494067 read 0x01b74b thru 0x0286d6 (0xcf8c bytes) 000559 1784233454.505850 MIRROR_EXTEND to 5 mirrors 000560 1784233454.978414 read 0x0289be thru 0x035176 (0xc7b9 bytes) 000563 1784233455.006861 write 0x016c95 thru 0x024267 (0xd5d3 bytes) 000566 1784233455.082827 read 0x016717 thru 0x01f127 (0x8a11 bytes) 000567 1784233455.084015 mapread 0x020637 thru 0x02af81 (0xa94b bytes) 000569 1784233455.095040 mapread 0x01a478 thru 0x01c134 (0x1cbd bytes) 000570 1784233455.096065 trunc from 0x040000 to 0x03eb44 (0x14bb bytes) 000572 1784233455.111004 read 0x00662f thru 0x01614c (0xfb1e bytes) 000574 1784233455.112916 trunc from 0x03eb45 to 0x0310a5 (0xda9f bytes) 000575 1784233455.123000 trunc from 0x0310a6 to 0x01d182 (0x13f23 bytes) 000577 1784233455.137155 mapread 0x005fe7 thru 0x015d16 (0xfd30 bytes) 000578 1784233455.138549 mapwrite 0x031aba thru 0x03c020 (0xa567 bytes) 000579 1784233455.218562 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c021): Mirror 4: 0xed9ffae9 (stale) Mirror 5: 0xed9ffae9 (stale) Mirror 6: 0xed9ffae9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c021): Mirror 4: 0xed9ffae9 (stale) Mirror 5: 0xed9ffae9 (stale) Mirror 6: 0xed9ffae9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c021: skipped 000580 1784233455.530710 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c021): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c021): Mirror 4: 0xed9ffae9 (stale) Mirror 5: 0xed9ffae9 (stale) Mirror 6: 0xed9ffae9 (stale) CRC-32 checksum value for chunk [0, 0x3c021): Mirror 1: 0xc22554b2 Mirror 7: 0xc22554b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c021: skipped 000583 1784233456.256055 write 0x031caf thru 0x03ffff (0xe351 bytes) 000584 1784233456.300986 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x740d88fe (stale) Mirror 5: 0x740d88fe (stale) Mirror 6: 0x740d88fe (stale) Mirror 7: 0xe0a98a8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xefb2ca5b Mirror 8: 0xefb2ca5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000591 1784233457.033980 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x740d88fe (stale) Mirror 5: 0x740d88fe (stale) Mirror 6: 0x740d88fe (stale) Mirror 7: 0xe0a98a8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xefb2ca5b Mirror 8: 0xefb2ca5b Mirror 9: 0xefb2ca5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000593 1784233457.638541 trunc from 0x040000 to 0x030918 (0xf6e7 bytes) 000595 1784233457.720053 mapwrite 0x030097 thru 0x039356 (0x92c0 bytes) 000597 1784233457.879054 read 0x002cdc thru 0x00d233 (0xa558 bytes) 000600 1784233457.893577 write 0x02c5f7 thru 0x02f558 (0x2f62 bytes) 000601 1784233457.895169 mapwrite 0x00c9b1 thru 0x01330a (0x695a bytes) 000602 1784233457.949198 mapread 0x00462b thru 0x0059ae (0x1384 bytes) 000603 1784233457.949978 read 0x0348a4 thru 0x039356 (0x4ab3 bytes) 000606 1784233457.951206 mapwrite 0x01a428 thru 0x01bf8f (0x1b68 bytes) 000607 1784233457.996002 mapread 0x01d919 thru 0x02581d (0x7f05 bytes) 000609 1784233457.997435 trunc from 0x039357 to 0x036644 (0x2d12 bytes) 000610 1784233458.014744 mapwrite 0x03c3d6 thru 0x03ffff (0x3c2a bytes) 000611 1784233458.071958 mapread 0x01fe82 thru 0x02d84e (0xd9cd bytes) 000612 1784233458.074188 mapwrite 0x0175e5 thru 0x027387 (0xfda3 bytes) 000613 1784233458.123219 write 0x010517 thru 0x013e75 (0x395f bytes) 000614 1784233458.124150 trunc from 0x040000 to 0x01418b (0x2be74 bytes) 000615 1784233458.133247 write 0x01da92 thru 0x029e9f (0xc40e bytes) 000617 1784233458.139147 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x29ea0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ea0): Mirror 4: 0xd6a3254b (stale) Mirror 5: 0xd6a3254b (stale) Mirror 6: 0xd6a3254b (stale) Mirror 7: 0x91e0b938 (stale) Mirror 8: 0x91e0b938 (stale) Mirror 9: 0x91e0b938 (stale) CRC-32 checksum value for chunk [0, 0x29ea0): Mirror 1: 0x4c99341c Mirror 10: 0x4c99341c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ea0: skipped 000618 1784233458.935138 MIRROR_RESYNC 8 mirrors 000619 1784233459.899431 trunc from 0x029ea0 to 0x027dbb (0x20e4 bytes) 000624 1784233459.973316 trunc from 0x027dbc to 0x0269a6 (0x1415 bytes) 000625 1784233459.996583 trunc from 0x0269a7 to 0x03d771 (0x16dcb bytes) 000626 1784233460.009957 read 0x030e4e thru 0x039199 (0x834c bytes) 000628 1784233460.020287 write 0x020a46 thru 0x025223 (0x47de bytes) 000629 1784233460.031303 mapread 0x039cde thru 0x03d771 (0x3a94 bytes) 000630 1784233460.044455 write 0x016e71 thru 0x01f590 (0x8720 bytes) 000631 1784233460.055405 write 0x0208eb thru 0x023241 (0x2957 bytes) 000632 1784233460.060548 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d772): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d772): Mirror 4: 0x303594e2 (stale) Mirror 5: 0x303594e2 (stale) Mirror 6: 0x303594e2 (stale) Mirror 7: 0x303594e2 (stale) Mirror 8: 0x303594e2 (stale) Mirror 9: 0x303594e2 (stale) Mirror 10: 0x303594e2 (stale) CRC-32 checksum value for chunk [0, 0x3d772): Mirror 1: 0x310592a2 Mirror 11: 0x310592a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d772: skipped 000633 1784233460.728174 read 0x02ad80 thru 0x0314cc (0x674d bytes) 000635 1784233460.738413 mapwrite 0x0263d4 thru 0x03345e (0xd08b bytes) 000636 1784233460.926234 mapread 0x00a026 thru 0x0117da (0x77b5 bytes) 000637 1784233460.941669 read 0x01d55b thru 0x02c2b7 (0xed5d bytes) 000638 1784233460.954621 read 0x03ccae thru 0x03d771 (0xac4 bytes) 000641 1784233460.956532 mapwrite 0x01d0f0 thru 0x026733 (0x9644 bytes) 000642 1784233461.043839 mapwrite 0x007da3 thru 0x009063 (0x12c1 bytes) 000643 1784233461.103345 read 0x007bec thru 0x013ad9 (0xbeee bytes) 000644 1784233461.109676 MIRROR_RESYNC 9 mirrors 000645 1784233462.058351 trunc from 0x03d772 to 0x018249 (0x25528 bytes) 000646 1784233462.137111 trunc from 0x01824a to 0x0262a0 (0xe057 bytes) 000647 1784233462.152400 read 0x0027b5 thru 0x00451b (0x1d67 bytes) 000652 1784233462.160987 mapwrite 0x02ae46 thru 0x039563 (0xe71e bytes) 000654 1784233462.230683 write 0x01b163 thru 0x01c862 (0x1700 bytes) 000656 1784233462.236933 mapwrite 0x012f29 thru 0x01d661 (0xa739 bytes) 000658 1784233462.285421 mapwrite 0x0196cd thru 0x02181b (0x814f bytes) 000659 1784233462.330191 mapwrite 0x017fcf thru 0x020326 (0x8358 bytes) 000660 1784233462.361437 read 0x030584 thru 0x039563 (0x8fe0 bytes) 000661 1784233462.362341 read 0x02b859 thru 0x033f9b (0x8743 bytes) 000662 1784233462.375182 MIRROR_RESYNC 9 mirrors 000664 1784233463.133244 trunc from 0x039564 to 0x03dd5d (0x47fa bytes) 000666 1784233463.240253 read 0x00ed89 thru 0x0199f5 (0xac6d bytes) 000668 1784233463.251926 mapwrite 0x035379 thru 0x03ffff (0xac87 bytes) 000670 1784233463.327072 mapread 0x009dd5 thru 0x0169e6 (0xcc12 bytes) 000672 1784233463.335517 trunc from 0x040000 to 0x03bc5f (0x43a0 bytes) 000673 1784233463.344576 mapwrite 0x012891 thru 0x0137eb (0xf5b bytes) 000674 1784233463.380049 write 0x02a472 thru 0x039352 (0xeee1 bytes) 000678 1784233463.392283 trunc from 0x03bc60 to 0x009448 (0x32817 bytes) 000679 1784233463.416233 trunc from 0x009449 to 0x026ca5 (0x1d85d bytes) 000681 1784233463.441213 mapread 0x022609 thru 0x026ca5 (0x469d bytes) 000687 1784233463.453022 mapread 0x00eafb thru 0x01ab68 (0xc06e bytes) 000694 1784233463.471559 mapwrite 0x02d4c5 thru 0x033516 (0x6052 bytes) 000696 1784233463.527753 mapread 0x012b11 thru 0x018e08 (0x62f8 bytes) 000697 1784233463.532564 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x33517): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33517): Mirror 4: 0xeb22e221 (stale) Mirror 5: 0xeb22e221 (stale) Mirror 6: 0xeb22e221 (stale) Mirror 7: 0xeb22e221 (stale) Mirror 8: 0xeb22e221 (stale) Mirror 9: 0xeb22e221 (stale) Mirror 10: 0xeb22e221 (stale) Mirror 11: 0xeb22e221 (stale) CRC-32 checksum value for chunk [0, 0x33517): Mirror 1: 0x81cd1daa Mirror 12: 0x81cd1daa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33517: skipped 000698 1784233464.161034 mapwrite 0x02ec0c thru 0x034b4c (0x5f41 bytes) 000699 1784233464.305243 write 0x0270a5 thru 0x034462 (0xd3be bytes) 000700 1784233464.308920 trunc from 0x034b4d to 0x00290b (0x32241 bytes) 000702 1784233464.322155 trunc from 0x00290c to 0x01fd51 (0x1d446 bytes) 000706 1784233464.332691 mapread 0x01c764 thru 0x01fd51 (0x35ee bytes) 000709 1784233464.341473 mapwrite 0x03323d thru 0x03d4b7 (0xa27b bytes) 000710 1784233464.390728 mapread 0x0126ac thru 0x016e25 (0x477a bytes) 000715 1784233464.399384 mapread 0x0275a7 thru 0x0353b8 (0xde12 bytes) 000717 1784233464.406368 write 0x0002f2 thru 0x00abed (0xa8fc bytes) 000720 1784233464.417121 write 0x00daa9 thru 0x014b44 (0x709c bytes) 000721 1784233464.419099 mapwrite 0x021601 thru 0x030a0b (0xf40b bytes) 000722 1784233464.474240 mapread 0x029e99 thru 0x02ef4a (0x50b2 bytes) 000724 1784233464.476267 mapread 0x020236 thru 0x028f07 (0x8cd2 bytes) 000727 1784233464.479229 mapwrite 0x00914d thru 0x012716 (0x95ca bytes) 000728 1784233464.521314 MIRROR_RESYNC 10 mirrors 000729 1784233465.589686 trunc from 0x03d4b8 to 0x01f3a8 (0x1e10f bytes) 000730 1784233465.628319 MIRROR_RESYNC 10 mirrors 000731 1784233466.872071 mapwrite 0x019cdf thru 0x01a29c (0x5be bytes) 000732 1784233467.098903 mapread 0x019098 thru 0x01a813 (0x177c bytes) 000737 1784233467.109180 write 0x01c16b thru 0x0229a8 (0x683e bytes) 000738 1784233467.115142 write 0x0067a4 thru 0x015463 (0xecc0 bytes) 000739 1784233467.130228 trunc from 0x0229a9 to 0x000c61 (0x21d47 bytes) 000740 1784233467.171107 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xc62): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc62): Mirror 4: 0x6e4a7265 (stale) Mirror 5: 0x6e4a7265 (stale) Mirror 6: 0x6e4a7265 (stale) Mirror 7: 0x6e4a7265 (stale) Mirror 8: 0x6e4a7265 (stale) Mirror 9: 0x6e4a7265 (stale) Mirror 10: 0x6e4a7265 (stale) Mirror 11: 0x6e4a7265 (stale) Mirror 12: 0x6e4a7265 (stale) CRC-32 checksum value for chunk [0, 0xc62): Mirror 1: 0x6e4a7265 Mirror 13: 0x6e4a7265 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc62: skipped 000741 1784233467.864681 mapread 0x000518 thru 0x000c61 (0x74a bytes) 000743 1784233467.928312 trunc from 0x000c62 to 0x0058ac (0x4c4b bytes) 000747 1784233468.009721 mapwrite 0x03544a thru 0x037f0f (0x2ac6 bytes) 000749 1784233468.093221 write 0x012ad8 thru 0x01bf24 (0x944d bytes) 000750 1784233468.100755 mapwrite 0x00185e thru 0x0065a9 (0x4d4c bytes) 000751 1784233468.141855 write 0x02cc1e thru 0x038798 (0xbb7b bytes) 000752 1784233468.148574 write 0x005e5c thru 0x00f817 (0x99bc bytes) 000753 1784233468.149698 trunc from 0x038799 to 0x009103 (0x2f695 bytes) 000755 1784233468.162062 read 0x0066d0 thru 0x009103 (0x2a34 bytes) 000758 1784233468.164041 trunc from 0x009104 to 0x039368 (0x30265 bytes) 000759 1784233468.189894 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x39369): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39369): Mirror 4: 0x26da3ed2 (stale) Mirror 5: 0x26da3ed2 (stale) Mirror 6: 0x26da3ed2 (stale) Mirror 7: 0x26da3ed2 (stale) Mirror 8: 0x26da3ed2 (stale) Mirror 9: 0x26da3ed2 (stale) Mirror 10: 0x26da3ed2 (stale) Mirror 11: 0x26da3ed2 (stale) Mirror 12: 0x26da3ed2 (stale) Mirror 13: 0x6d2ea4de (stale) CRC-32 checksum value for chunk [0, 0x39369): Mirror 1: 0x6c4b92e2 Mirror 14: 0x6c4b92e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39369: skipped 000760 1784233469.034402 mapread 0x0030b0 thru 0x003af2 (0xa43 bytes) 000761 1784233469.050717 write 0x01af03 thru 0x026986 (0xba84 bytes) 000763 1784233469.118546 write 0x005ee3 thru 0x00f4b3 (0x95d1 bytes) 000764 1784233469.128930 MIRROR_RESYNC 12 mirrors 000765 1784233470.611381 MIRROR_RESYNC 12 mirrors 000766 1784233471.272920 mapread 0x0265c0 thru 0x033377 (0xcdb8 bytes) 000768 1784233471.305243 mapread 0x01c624 thru 0x02a57b (0xdf58 bytes) 000769 1784233471.317055 mapwrite 0x01eab4 thru 0x028195 (0x96e2 bytes) 000770 1784233471.483535 mapwrite 0x01db78 thru 0x027b5d (0x9fe6 bytes) 000771 1784233471.579144 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39369): Mirror 4: 0x48333cef (stale) Mirror 5: 0x48333cef (stale) Mirror 6: 0x48333cef (stale) Mirror 7: 0x48333cef (stale) Mirror 8: 0x48333cef (stale) Mirror 9: 0x48333cef (stale) Mirror 10: 0x48333cef (stale) Mirror 12: 0x48333cef (stale) Mirror 13: 0x48333cef (stale) Mirror 14: 0x48333cef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39369): Mirror 4: 0x48333cef (stale) Mirror 5: 0x48333cef (stale) Mirror 6: 0x48333cef (stale) Mirror 7: 0x48333cef (stale) Mirror 8: 0x48333cef (stale) Mirror 9: 0x48333cef (stale) Mirror 10: 0x48333cef (stale) Mirror 12: 0x48333cef (stale) Mirror 13: 0x48333cef (stale) Mirror 14: 0x48333cef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39369: skipped 000772 1784233472.149238 mapwrite 0x03c4a5 thru 0x03c53d (0x99 bytes) 000773 1784233472.204902 mapread 0x0026dd thru 0x00bcd0 (0x95f4 bytes) 000774 1784233472.216423 write 0x026c73 thru 0x028ade (0x1e6c bytes) 000775 1784233472.229010 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3c53e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c53e): Mirror 4: 0x8518ee57 (stale) Mirror 5: 0x8518ee57 (stale) Mirror 6: 0x8518ee57 (stale) Mirror 7: 0x8518ee57 (stale) Mirror 8: 0x8518ee57 (stale) Mirror 9: 0x8518ee57 (stale) Mirror 10: 0x8518ee57 (stale) Mirror 12: 0x8518ee57 (stale) Mirror 13: 0x8518ee57 (stale) Mirror 14: 0x8518ee57 (stale) CRC-32 checksum value for chunk [0, 0x3c53e): Mirror 1: 0x31f3687c Mirror 15: 0x31f3687c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c53e: skipped 000777 1784233472.958968 trunc from 0x03c53e to 0x025b71 (0x169cc bytes) 000778 1784233473.043352 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x25b72): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25b72): Mirror 4: 0xd8de18f6 (stale) Mirror 5: 0xd8de18f6 (stale) Mirror 6: 0xd8de18f6 (stale) Mirror 7: 0xd8de18f6 (stale) Mirror 8: 0xd8de18f6 (stale) Mirror 9: 0xd8de18f6 (stale) Mirror 10: 0xd8de18f6 (stale) Mirror 12: 0xd8de18f6 (stale) Mirror 13: 0xd8de18f6 (stale) Mirror 14: 0xd8de18f6 (stale) Mirror 15: 0x8c41c42d (stale) CRC-32 checksum value for chunk [0, 0x25b72): Mirror 1: 0x8c41c42d Mirror 16: 0x8c41c42d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25b72: skipped 000779 1784233473.880434 MIRROR_RESYNC 13 mirrors 000780 1784233475.136407 write 0x030726 thru 0x036861 (0x613c bytes) 000781 1784233475.185316 write 0x023e0e thru 0x029ca9 (0x5e9c bytes) 000782 1784233475.198037 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36862): Mirror 4: 0xa388a57c (stale) Mirror 5: 0xa388a57c (stale) Mirror 6: 0xa388a57c (stale) Mirror 7: 0xa388a57c (stale) Mirror 8: 0xa388a57c (stale) Mirror 9: 0xa388a57c (stale) Mirror 10: 0xa388a57c (stale) Mirror 12: 0xa388a57c (stale) Mirror 13: 0xa388a57c (stale) Mirror 14: 0xa388a57c (stale) Mirror 16: 0xa388a57c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36862): Mirror 4: 0xa388a57c (stale) Mirror 5: 0xa388a57c (stale) Mirror 6: 0xa388a57c (stale) Mirror 7: 0xa388a57c (stale) Mirror 8: 0xa388a57c (stale) Mirror 9: 0xa388a57c (stale) Mirror 10: 0xa388a57c (stale) Mirror 12: 0xa388a57c (stale) Mirror 13: 0xa388a57c (stale) Mirror 14: 0xa388a57c (stale) Mirror 16: 0xa388a57c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36862: skipped 000783 1784233475.651863 read 0x02a692 thru 0x02e383 (0x3cf2 bytes) 000784 1784233475.656095 mapread 0x0130b6 thru 0x01a910 (0x785b bytes) 000785 1784233475.670653 mapread 0x02f134 thru 0x036861 (0x772e bytes) 000786 1784233475.679709 trunc from 0x036862 to 0x02c94a (0x9f17 bytes) 000787 1784233475.700962 write 0x00b297 thru 0x00ff1a (0x4c84 bytes) 000788 1784233475.709959 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c94b): Mirror 4: 0x511cb106 (stale) Mirror 5: 0x511cb106 (stale) Mirror 6: 0x511cb106 (stale) Mirror 7: 0x511cb106 (stale) Mirror 8: 0x511cb106 (stale) Mirror 9: 0x511cb106 (stale) Mirror 10: 0x511cb106 (stale) Mirror 12: 0x511cb106 (stale) Mirror 13: 0x511cb106 (stale) Mirror 16: 0x511cb106 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c94b): Mirror 4: 0x511cb106 (stale) Mirror 5: 0x511cb106 (stale) Mirror 6: 0x511cb106 (stale) Mirror 7: 0x511cb106 (stale) Mirror 8: 0x511cb106 (stale) Mirror 9: 0x511cb106 (stale) Mirror 10: 0x511cb106 (stale) Mirror 12: 0x511cb106 (stale) Mirror 13: 0x511cb106 (stale) Mirror 16: 0x511cb106 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c94b: skipped 000790 1784233476.226267 write 0x013178 thru 0x01b27c (0x8105 bytes) 000792 1784233476.231969 mapwrite 0x02a1c4 thru 0x032f65 (0x8da2 bytes) 000794 1784233476.296570 write 0x01ce4a thru 0x0228ce (0x5a85 bytes) 000795 1784233476.301709 mapwrite 0x01a70f thru 0x01d725 (0x3017 bytes) 000796 1784233476.322557 mapwrite 0x02f341 thru 0x034af1 (0x57b1 bytes) 000801 1784233476.360069 read 0x02c4ed thru 0x032ede (0x69f2 bytes) 000802 1784233476.361001 trunc from 0x034af2 to 0x02977a (0xb377 bytes) 000804 1784233476.372179 mapwrite 0x010583 thru 0x012646 (0x20c4 bytes) 000805 1784233476.410505 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2977b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2977b): Mirror 4: 0xadb7fcaa (stale) Mirror 5: 0xadb7fcaa (stale) Mirror 6: 0xadb7fcaa (stale) Mirror 7: 0xadb7fcaa (stale) Mirror 8: 0xadb7fcaa (stale) Mirror 9: 0xadb7fcaa (stale) Mirror 10: 0xadb7fcaa (stale) Mirror 12: 0xadb7fcaa (stale) Mirror 13: 0xadb7fcaa (stale) Mirror 16: 0xadb7fcaa (stale) CRC-32 checksum value for chunk [0, 0x2977b): Mirror 1: 0x480742f9 Mirror 17: 0x480742f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2977b: skipped 000806 1784233477.075222 mapread 0x016c5e thru 0x026987 (0xfd2a bytes) 000807 1784233477.109116 mapread 0x017721 thru 0x022720 (0xb000 bytes) 000810 1784233477.125870 mapread 0x026b78 thru 0x02977a (0x2c03 bytes) 000812 1784233477.144830 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2977b): Mirror 4: 0xadb7fcaa (stale) Mirror 5: 0xadb7fcaa (stale) Mirror 6: 0xadb7fcaa (stale) Mirror 7: 0xadb7fcaa (stale) Mirror 8: 0xadb7fcaa (stale) Mirror 9: 0xadb7fcaa (stale) Mirror 10: 0xadb7fcaa (stale) Mirror 12: 0xadb7fcaa (stale) Mirror 13: 0xadb7fcaa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2977b): Mirror 4: 0xadb7fcaa (stale) Mirror 5: 0xadb7fcaa (stale) Mirror 6: 0xadb7fcaa (stale) Mirror 7: 0xadb7fcaa (stale) Mirror 8: 0xadb7fcaa (stale) Mirror 9: 0xadb7fcaa (stale) Mirror 10: 0xadb7fcaa (stale) Mirror 12: 0xadb7fcaa (stale) Mirror 13: 0xadb7fcaa (stale) CRC-32 checksum value for chunk [0, 0x2977b): Mirror 1: 0x480742f9 Mirror 17: 0x480742f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2977b: skipped 000813 1784233477.830038 write 0x0356a3 thru 0x03bf6d (0x68cb bytes) 000815 1784233477.919160 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 4: 0x3a015735 (stale) Mirror 5: 0x3a015735 (stale) Mirror 6: 0x3a015735 (stale) Mirror 7: 0x3a015735 (stale) Mirror 8: 0x3a015735 (stale) Mirror 9: 0x3a015735 (stale) Mirror 10: 0x3a015735 (stale) Mirror 12: 0x3a015735 (stale) Mirror 13: 0x3a015735 (stale) Mirror 17: 0xf8ee1b0c (stale) CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 1: 0x176592c6 Mirror 18: 0x176592c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf6e: skipped 000817 1784233478.640257 mapread 0x0134d5 thru 0x013d28 (0x854 bytes) 000818 1784233478.659093 mapwrite 0x01b741 thru 0x02806e (0xc92e bytes) 000819 1784233478.797808 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 4: 0x3a015735 (stale) Mirror 5: 0x3a015735 (stale) Mirror 6: 0x3a015735 (stale) Mirror 7: 0x3a015735 (stale) Mirror 8: 0x3a015735 (stale) Mirror 9: 0x3a015735 (stale) Mirror 10: 0x3a015735 (stale) Mirror 12: 0x3a015735 (stale) Mirror 13: 0x3a015735 (stale) Mirror 17: 0xf8ee1b0c (stale) Mirror 18: 0x176592c6 (stale) CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 1: 0xe4fcab05 Mirror 19: 0xe4fcab05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf6e: skipped 000820 1784233479.712509 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 4: 0x3a015735 (stale) Mirror 5: 0x3a015735 (stale) Mirror 6: 0x3a015735 (stale) Mirror 7: 0x3a015735 (stale) Mirror 9: 0x3a015735 (stale) Mirror 10: 0x3a015735 (stale) Mirror 12: 0x3a015735 (stale) Mirror 13: 0x3a015735 (stale) Mirror 17: 0xf8ee1b0c (stale) Mirror 18: 0x176592c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 4: 0x3a015735 (stale) Mirror 5: 0x3a015735 (stale) Mirror 6: 0x3a015735 (stale) Mirror 7: 0x3a015735 (stale) Mirror 9: 0x3a015735 (stale) Mirror 10: 0x3a015735 (stale) Mirror 12: 0x3a015735 (stale) Mirror 13: 0x3a015735 (stale) Mirror 17: 0xf8ee1b0c (stale) Mirror 18: 0x176592c6 (stale) CRC-32 checksum value for chunk [0, 0x3bf6e): Mirror 1: 0xe4fcab05 Mirror 19: 0xe4fcab05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf6e: skipped 000821 1784233480.646427 MIRROR_RESYNC 12 mirrors 000823 1784233481.882332 MIRROR_RESYNC 12 mirrors 000825 1784233482.378924 trunc from 0x03bf6e to 0x0021df (0x39d8e bytes) 000827 1784233482.450199 mapread 0x000cc0 thru 0x0021df (0x1520 bytes) 000829 1784233482.475646 mapwrite 0x020c7c thru 0x02f65a (0xe9df bytes) 000831 1784233482.588462 read 0x01ba93 thru 0x025359 (0x98c7 bytes) 000832 1784233482.589235 write 0x03e575 thru 0x03ffff (0x1a8b bytes) 000833 1784233482.590272 trunc from 0x040000 to 0x011b5d (0x2e4a2 bytes) 000834 1784233482.605517 mapwrite 0x01eb0e thru 0x02c45c (0xd94f bytes) 000835 1784233482.675105 mapread 0x02bf9f thru 0x02c45c (0x4be bytes) 000836 1784233482.676354 write 0x009e11 thru 0x00e3ee (0x45de bytes) 000838 1784233482.685270 write 0x00374a thru 0x012109 (0xe9c0 bytes) 000839 1784233482.692051 read 0x024277 thru 0x02c45c (0x81e6 bytes) 000841 1784233482.693497 write 0x00d354 thru 0x01cb9b (0xf848 bytes) 000842 1784233482.695266 mapread 0x01057d thru 0x01a2bd (0x9d41 bytes) 000843 1784233482.696838 trunc from 0x02c45d to 0x01b1d4 (0x11288 bytes) 000844 1784233482.709206 mapread 0x01473a thru 0x01a248 (0x5b0f bytes) 000845 1784233482.717415 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b1d5): Mirror 4: 0x1f4664ed (stale) Mirror 5: 0x1f4664ed (stale) Mirror 6: 0x1f4664ed (stale) Mirror 7: 0x1f4664ed (stale) Mirror 10: 0x1f4664ed (stale) Mirror 12: 0x1f4664ed (stale) Mirror 13: 0x1f4664ed (stale) Mirror 17: 0x1f4664ed (stale) Mirror 18: 0x1f4664ed (stale) Mirror 19: 0x1f4664ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b1d5): Mirror 4: 0x1f4664ed (stale) Mirror 5: 0x1f4664ed (stale) Mirror 6: 0x1f4664ed (stale) Mirror 7: 0x1f4664ed (stale) Mirror 10: 0x1f4664ed (stale) Mirror 12: 0x1f4664ed (stale) Mirror 13: 0x1f4664ed (stale) Mirror 17: 0x1f4664ed (stale) Mirror 18: 0x1f4664ed (stale) Mirror 19: 0x1f4664ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b1d5: skipped 000847 1784233483.205407 mapread 0x00489b thru 0x00842c (0x3b92 bytes) 000848 1784233483.220555 mapwrite 0x002f2e thru 0x00f1e9 (0xc2bc bytes) 000849 1784233483.269361 mapread 0x0180b2 thru 0x01b1d4 (0x3123 bytes) 000850 1784233483.277024 mapread 0x018fa1 thru 0x019209 (0x269 bytes) 000852 1784233483.278647 mapwrite 0x00dc1d thru 0x01ae3f (0xd223 bytes) 000853 1784233483.313387 trunc from 0x01b1d5 to 0x00f4f8 (0xbcdc bytes) 000855 1784233483.332020 trunc from 0x00f4f9 to 0x008661 (0x6e97 bytes) 000856 1784233483.347607 mapread 0x0074c7 thru 0x008661 (0x119b bytes) 000857 1784233483.348546 read 0x007be9 thru 0x008661 (0xa79 bytes) 000858 1784233483.349176 mapwrite 0x007cd8 thru 0x015087 (0xd3b0 bytes) 000859 1784233483.412044 trunc from 0x015088 to 0x0320a1 (0x1d01a bytes) 000860 1784233483.426804 MIRROR_RESYNC 11 mirrors 000861 1784233484.790557 trunc from 0x0320a2 to 0x008b66 (0x2953b bytes) 000862 1784233484.860989 read 0x005a7a thru 0x007528 (0x1aaf bytes) 000863 1784233484.870516 mapwrite 0x022e4a thru 0x02d74d (0xa904 bytes) 000865 1784233484.967324 MIRROR_RESYNC 11 mirrors 000866 1784233486.068534 write 0x02d527 thru 0x02f174 (0x1c4e bytes) 000867 1784233486.146225 mapread 0x007426 thru 0x00c119 (0x4cf4 bytes) 000868 1784233486.185670 mapread 0x01e6ff thru 0x020386 (0x1c88 bytes) 000871 1784233486.203980 mapwrite 0x00ef70 thru 0x00efa9 (0x3a bytes) 000873 1784233486.288865 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f175): Mirror 4: 0xdd9a544d (stale) Mirror 5: 0xdd9a544d (stale) Mirror 7: 0xdd9a544d (stale) Mirror 10: 0xdd9a544d (stale) Mirror 12: 0xdd9a544d (stale) Mirror 13: 0xdd9a544d (stale) Mirror 17: 0xdd9a544d (stale) Mirror 18: 0xdd9a544d (stale) Mirror 19: 0xdd9a544d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f175): Mirror 4: 0xdd9a544d (stale) Mirror 5: 0xdd9a544d (stale) Mirror 7: 0xdd9a544d (stale) Mirror 10: 0xdd9a544d (stale) Mirror 12: 0xdd9a544d (stale) Mirror 13: 0xdd9a544d (stale) Mirror 17: 0xdd9a544d (stale) Mirror 18: 0xdd9a544d (stale) Mirror 19: 0xdd9a544d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f175: skipped 000875 1784233486.787550 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2f175): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f175): Mirror 4: 0xdd9a544d (stale) Mirror 5: 0xdd9a544d (stale) Mirror 7: 0xdd9a544d (stale) Mirror 10: 0xdd9a544d (stale) Mirror 12: 0xdd9a544d (stale) Mirror 13: 0xdd9a544d (stale) Mirror 17: 0xdd9a544d (stale) Mirror 18: 0xdd9a544d (stale) Mirror 19: 0xdd9a544d (stale) CRC-32 checksum value for chunk [0, 0x2f175): Mirror 1: 0x7037be88 Mirror 20: 0x7037be88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f175: skipped 000877 1784233487.537150 MIRROR_RESYNC 11 mirrors 000879 1784233488.834037 write 0x007e96 thru 0x0137a1 (0xb90c bytes) 000880 1784233488.904289 trunc from 0x02f175 to 0x039a12 (0xa89e bytes) 000881 1784233488.934547 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x39a13): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a13): Mirror 4: 0xa22e084f (stale) Mirror 5: 0xa22e084f (stale) Mirror 7: 0xa22e084f (stale) Mirror 10: 0xa22e084f (stale) Mirror 12: 0xa22e084f (stale) Mirror 13: 0xa22e084f (stale) Mirror 17: 0xa22e084f (stale) Mirror 18: 0xa22e084f (stale) Mirror 19: 0xa22e084f (stale) Mirror 20: 0xa22e084f (stale) CRC-32 checksum value for chunk [0, 0x39a13): Mirror 1: 0x279c2e87 Mirror 21: 0x279c2e87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a13: skipped 000885 1784233489.955407 mapread 0x03591a thru 0x039a12 (0x40f9 bytes) 000889 1784233490.039083 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x267:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39a13): Mirror 4: 0xa22e084f (stale) Mirror 5: 0xa22e084f (stale) Mirror 7: 0xa22e084f (stale) Mirror 10: 0xa22e084f (stale) Mirror 12: 0xa22e084f (stale) Mirror 13: 0xa22e084f (stale) Mirror 17: 0xa22e084f (stale) Mirror 18: 0xa22e084f (stale) Mirror 19: 0xa22e084f (stale) Mirror 20: 0xa22e084f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a13): Mirror 4: 0xa22e084f (stale) Mirror 5: 0xa22e084f (stale) Mirror 7: 0xa22e084f (stale) Mirror 10: 0xa22e084f (stale) Mirror 12: 0xa22e084f (stale) Mirror 13: 0xa22e084f (stale) Mirror 17: 0xa22e084f (stale) Mirror 18: 0xa22e084f (stale) Mirror 19: 0xa22e084f (stale) Mirror 20: 0xa22e084f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a13: skipped 000890 1784233490.524832 mapwrite 0x03f6a3 thru 0x03ffff (0x95d bytes) 000891 1784233490.604852 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9ed071a8 (stale) Mirror 5: 0x9ed071a8 (stale) Mirror 7: 0x9ed071a8 (stale) Mirror 10: 0x9ed071a8 (stale) Mirror 12: 0x9ed071a8 (stale) Mirror 13: 0x9ed071a8 (stale) Mirror 17: 0x9ed071a8 (stale) Mirror 18: 0x9ed071a8 (stale) Mirror 19: 0x9ed071a8 (stale) Mirror 20: 0x9ed071a8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5b32e552 Mirror 21: 0x5b32e552 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000892 1784233491.237161 read 0x02e0ab thru 0x03639a (0x82f0 bytes) 000893 1784233491.250327 mapwrite 0x005706 thru 0x00dab9 (0x83b4 bytes) 000896 1784233491.476912 trunc from 0x040000 to 0x026c41 (0x193be bytes) 000899 1784233491.532383 read 0x004c1a thru 0x0149f7 (0xfdde bytes) 000904 1784233491.546876 read 0x006ef1 thru 0x0122b2 (0xb3c2 bytes) 000905 1784233491.547478 read 0x01e58d thru 0x026c41 (0x86b5 bytes) 000907 1784233491.550030 mapwrite 0x036cec thru 0x03ffff (0x9314 bytes) 000909 1784233491.615910 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9ed071a8 (stale) Mirror 5: 0x9ed071a8 (stale) Mirror 7: 0x9ed071a8 (stale) Mirror 10: 0x9ed071a8 (stale) Mirror 12: 0x9ed071a8 (stale) Mirror 13: 0x9ed071a8 (stale) Mirror 17: 0x9ed071a8 (stale) Mirror 18: 0x9ed071a8 (stale) Mirror 19: 0x9ed071a8 (stale) Mirror 20: 0x9ed071a8 (stale) Mirror 21: 0x5b32e552 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd66c4dd3 Mirror 22: 0xd66c4dd3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000910 1784233492.320098 write 0x003a10 thru 0x0104b4 (0xcaa5 bytes) 000911 1784233492.406313 read 0x003cf3 thru 0x0133d2 (0xf6e0 bytes) 000913 1784233492.412322 read 0x01d11d thru 0x01d149 (0x2d bytes) 000917 1784233492.427724 trunc from 0x040000 to 0x008365 (0x37c9a bytes) 000919 1784233492.464342 read 0x0052d4 thru 0x008365 (0x3092 bytes) 000923 1784233492.466824 read 0x000c89 thru 0x008365 (0x76dd bytes) 000928 1784233492.469341 write 0x03cce1 thru 0x03ffff (0x331f bytes) 000929 1784233492.470751 mapread 0x01e708 thru 0x01f133 (0xa2c bytes) 000930 1784233492.480112 read 0x020347 thru 0x022f60 (0x2c1a bytes) 000931 1784233492.480891 mapwrite 0x03c2c6 thru 0x03c482 (0x1bd bytes) 000932 1784233492.543176 read 0x004b53 thru 0x00f91c (0xadca bytes) 000934 1784233492.557679 MIRROR_RESYNC 13 mirrors 000936 1784233494.010504 write 0x039cdb thru 0x03ffff (0x6325 bytes) 000938 1784233494.078829 read 0x003742 thru 0x007cc6 (0x4585 bytes) 000939 1784233494.086555 trunc from 0x040000 to 0x033c7c (0xc383 bytes) 000940 1784233494.109472 mapread 0x01c8f4 thru 0x02656a (0x9c77 bytes) 000941 1784233494.125021 mapwrite 0x03750b thru 0x03ffff (0x8af5 bytes) 000943 1784233494.209045 write 0x027943 thru 0x02f3f7 (0x7ab5 bytes) 000944 1784233494.219498 read 0x003bbd thru 0x00c697 (0x8adb bytes) 000945 1784233494.229616 mapwrite 0x0206ae thru 0x02ff6c (0xf8bf bytes) 000946 1784233494.289899 trunc from 0x040000 to 0x015f08 (0x2a0f7 bytes) 000947 1784233494.325907 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x15f09): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15f09): Mirror 4: 0xdecd8d84 (stale) Mirror 5: 0xdecd8d84 (stale) Mirror 7: 0xdecd8d84 (stale) Mirror 10: 0xdecd8d84 (stale) Mirror 12: 0xdecd8d84 (stale) Mirror 13: 0xdecd8d84 (stale) Mirror 17: 0xdecd8d84 (stale) Mirror 18: 0xdecd8d84 (stale) Mirror 19: 0xdecd8d84 (stale) Mirror 20: 0xdecd8d84 (stale) Mirror 21: 0xdecd8d84 (stale) Mirror 22: 0xdecd8d84 (stale) CRC-32 checksum value for chunk [0, 0x15f09): Mirror 1: 0xdecd8d84 Mirror 23: 0xdecd8d84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15f09: skipped 000950 1784233495.139226 trunc from 0x015f09 to 0x0169c7 (0xabf bytes) 000951 1784233495.263264 MIRROR_RESYNC 14 mirrors 000952 1784233496.833634 MIRROR_EXTEND to 15 mirrors 000953 1784233497.594162 write 0x01d8e1 thru 0x026779 (0x8e99 bytes) 000954 1784233497.698815 mapread 0x016709 thru 0x018d8e (0x2686 bytes) 000955 1784233497.743101 read 0x025bab thru 0x026779 (0xbcf bytes) 000956 1784233497.745065 trunc from 0x02677a to 0x009fde (0x1c79b bytes) 000957 1784233497.771793 MIRROR_RESYNC 15 mirrors 000958 1784233498.951425 mapwrite 0x030074 thru 0x03cfd9 (0xcf66 bytes) 000959 1784233499.095089 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 4: 0x4b2e8e96 (stale) Mirror 5: 0x4b2e8e96 (stale) Mirror 7: 0x4b2e8e96 (stale) Mirror 10: 0x4b2e8e96 (stale) Mirror 12: 0x4b2e8e96 (stale) Mirror 13: 0x4b2e8e96 (stale) Mirror 17: 0x4b2e8e96 (stale) Mirror 18: 0x4b2e8e96 (stale) Mirror 19: 0x4b2e8e96 (stale) Mirror 20: 0x4b2e8e96 (stale) Mirror 21: 0x4b2e8e96 (stale) Mirror 22: 0x4b2e8e96 (stale) Mirror 23: 0x4b2e8e96 (stale) Mirror 24: 0x4b2e8e96 (stale) CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 1: 0x96728c4c Mirror 25: 0x96728c4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfda: skipped 000960 1784233499.763319 mapwrite 0x001844 thru 0x0035ce (0x1d8b bytes) 000961 1784233499.964737 write 0x00a92b thru 0x0152ae (0xa984 bytes) 000964 1784233499.975286 mapwrite 0x026c9b thru 0x029978 (0x2cde bytes) 000965 1784233500.030393 mapread 0x012a71 thru 0x019661 (0x6bf1 bytes) 000967 1784233500.053474 MIRROR_RESYNC 16 mirrors 000968 1784233501.551212 mapread 0x00f28f thru 0x014c0f (0x5981 bytes) 000970 1784233501.565202 read 0x0372b3 thru 0x03cfd9 (0x5d27 bytes) 000973 1784233501.571801 mapread 0x032fd5 thru 0x035b44 (0x2b70 bytes) 000978 1784233501.581615 MIRROR_RESYNC 16 mirrors 000979 1784233502.066859 trunc from 0x03cfda to 0x0031a1 (0x39e38 bytes) 000980 1784233502.126496 mapread 0x00063e thru 0x0031a1 (0x2b64 bytes) 000981 1784233502.145471 mapread 0x001b5d thru 0x0031a1 (0x1645 bytes) 000989 1784233502.150675 write 0x0201a2 thru 0x024b41 (0x49a0 bytes) 000991 1784233502.152652 trunc from 0x024b42 to 0x00c900 (0x18241 bytes) 000993 1784233502.187022 read 0x005b86 thru 0x0073c6 (0x1841 bytes) 000995 1784233502.196527 mapwrite 0x032486 thru 0x03d899 (0xb414 bytes) 000996 1784233502.275558 mapread 0x039cf0 thru 0x03d899 (0x3baa bytes) 000997 1784233502.277870 read 0x0310de thru 0x031a68 (0x98b bytes) 000998 1784233502.278594 trunc from 0x03d89a to 0x02ae63 (0x12a36 bytes) 001000 1784233502.295687 read 0x0223ee thru 0x0264b4 (0x40c7 bytes) All operations completed A-OK!