== sanity-flr test 70a: flr mode fsx test ================ 17:49:16 (1788212956) Seed set to 2958 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x130c3 000001 1788212958.528722 trunc from 00000000 to 0x0130c2 (0x130c3 bytes) truncating to largest ever: 0x224ed 000005 1788212958.553267 trunc from 0x0130c3 to 0x0224ec (0xf42a bytes) 000007 1788212958.575921 write 0x035905 thru 0x03ffff (0xa6fb bytes) 000008 1788212958.592553 MIRROR_EXTEND to 2 mirrors 000009 1788212959.505442 mapwrite 0x03618f thru 0x03ffff (0x9e71 bytes) 000011 1788212959.691361 trunc from 0x040000 to 0x00b679 (0x34986 bytes) 000012 1788212959.721008 mapread 0x005206 thru 0x00b679 (0x6474 bytes) 000013 1788212959.744979 MIRROR_RESYNC 2 mirrors 000014 1788212960.422078 MIRROR_RESYNC 2 mirrors 000015 1788212960.781934 mapwrite 0x03d443 thru 0x03ffff (0x2bbd bytes) 000016 1788212961.064498 mapwrite 0x035101 thru 0x03ebf0 (0x9af0 bytes) 000017 1788212961.121387 read 0x002464 thru 0x01219c (0xfd39 bytes) 000018 1788212961.132395 mapread 0x00e484 thru 0x016afb (0x8678 bytes) truncating to largest ever: 0x31ffd 000019 1788212961.142227 trunc from 0x040000 to 0x031ffc (0xe003 bytes) 000020 1788212961.180854 read 0x004d10 thru 0x005e70 (0x1161 bytes) 000021 1788212961.181474 mapread 0x00364d thru 0x009151 (0x5b05 bytes) 000022 1788212961.189183 trunc from 0x031ffd to 0x011ef2 (0x2010a bytes) 000023 1788212961.204250 mapread 0x0077a2 thru 0x011d0e (0xa56d bytes) 000024 1788212961.208810 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x11ef3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11ef3): Mirror 2: 0x1a48e605 (stale) CRC-32 checksum value for chunk [0, 0x11ef3): Mirror 1: 0x1a48e605 Mirror 3: 0x1a48e605 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11ef3: skipped 000026 1788212962.033005 mapread 0x000f37 thru 0x00b349 (0xa413 bytes) 000027 1788212962.106836 write 0x02251f thru 0x026be9 (0x46cb bytes) 000029 1788212962.183538 mapwrite 0x01ab72 thru 0x0268c6 (0xbd55 bytes) 000030 1788212962.255416 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26bea): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26bea): Mirror 2: 0x71bd3170 (stale) Mirror 3: 0x71bd3170 (stale) CRC-32 checksum value for chunk [0, 0x26bea): Mirror 1: 0xdf01b836 Mirror 4: 0xdf01b836 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26bea: skipped 000031 1788212963.042494 read 0x01b023 thru 0x01cbb8 (0x1b96 bytes) 000032 1788212963.069536 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x26bea): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26bea): Mirror 2: 0x71bd3170 (stale) Mirror 3: 0x71bd3170 (stale) CRC-32 checksum value for chunk [0, 0x26bea): Mirror 1: 0xdf01b836 Mirror 4: 0xdf01b836 Mirror 5: 0xdf01b836 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26bea: skipped 000033 1788212964.159111 MIRROR_RESYNC 5 mirrors 000034 1788212964.957862 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) 000035 1788212965.496068 write 0x02617d thru 0x0290ef (0x2f73 bytes) 000037 1788212965.652438 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x290f0): Mirror 3: 0x838a20ed (stale) Mirror 4: 0x838a20ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x290f0): Mirror 3: 0x838a20ed (stale) Mirror 4: 0x838a20ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x290f0: skipped 000038 1788212966.098701 trunc from 0x0290f0 to 0x00bec8 (0x1d227 bytes) 000039 1788212966.143940 mapwrite 0x022a5d thru 0x031964 (0xef08 bytes) 000042 1788212966.244306 trunc from 0x031965 to 0x012c00 (0x1ed64 bytes) 000049 1788212966.263567 write 0x031d66 thru 0x0388e3 (0x6b7e bytes) 000050 1788212966.265024 write 0x016d12 thru 0x017b48 (0xe37 bytes) 000052 1788212966.278338 mapwrite 0x0144eb thru 0x018da8 (0x48be bytes) 000053 1788212966.369248 mapwrite 0x036ceb thru 0x03ad5c (0x4072 bytes) 000054 1788212966.452956 mapread 0x015bff thru 0x01ec5e (0x9060 bytes) 000057 1788212966.467079 read 0x0137d5 thru 0x01bccc (0x84f8 bytes) 000058 1788212966.469235 read 0x021a77 thru 0x02947a (0x7a04 bytes) 000059 1788212966.498969 write 0x030191 thru 0x036005 (0x5e75 bytes) 000061 1788212966.500488 write 0x01684c thru 0x016e33 (0x5e8 bytes) truncating to largest ever: 0x3f58a 000065 1788212966.503698 trunc from 0x03ad5d to 0x03f589 (0x482d bytes) 000066 1788212966.531428 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f58a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f58a): Mirror 3: 0x5e711715 (stale) Mirror 4: 0x5e711715 (stale) CRC-32 checksum value for chunk [0, 0x3f58a): Mirror 1: 0xa61faa2d Mirror 5: 0xa61faa2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f58a: skipped truncating to largest ever: 0x3f89d 000067 1788212967.573581 trunc from 0x03f58a to 0x03f89c (0x313 bytes) 000068 1788212967.787791 read 0x0072ee thru 0x0164c8 (0xf1db bytes) 000071 1788212967.797778 read 0x00ab9f thru 0x0145cc (0x9a2e bytes) 000072 1788212967.798377 trunc from 0x03f89d to 0x036078 (0x9824 bytes) 000073 1788212967.826234 MIRROR_RESYNC 4 mirrors 000074 1788212969.527994 write 0x028133 thru 0x0345e0 (0xc4ae bytes) 000075 1788212969.643448 read 0x0016b4 thru 0x00d6c4 (0xc011 bytes) 000076 1788212969.656873 read 0x022af3 thru 0x0315eb (0xeaf9 bytes) 000077 1788212969.679496 read 0x02485c thru 0x025edf (0x1684 bytes) 000078 1788212969.680342 trunc from 0x036079 to 0x0141cc (0x21eac bytes) 000080 1788212969.725928 MIRROR_RESYNC 4 mirrors 000081 1788212971.154876 mapwrite 0x032849 thru 0x036049 (0x3801 bytes) 000082 1788212971.336015 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3604a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3604a): Mirror 3: 0xf7d0943b (stale) Mirror 4: 0xf7d0943b (stale) Mirror 5: 0xf7d0943b (stale) CRC-32 checksum value for chunk [0, 0x3604a): Mirror 1: 0x8e69fb5a Mirror 6: 0x8e69fb5a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3604a: skipped 000083 1788212972.428998 mapwrite 0x01f459 thru 0x022159 (0x2d01 bytes) 000084 1788212972.677558 mapread 0x030b8c thru 0x036049 (0x54be bytes) 000085 1788212972.687340 trunc from 0x03604a to 0x03a6ce (0x4685 bytes) 000086 1788212972.732700 mapread 0x02f3c2 thru 0x030231 (0xe70 bytes) 000087 1788212972.733571 mapread 0x00efcc thru 0x01a771 (0xb7a6 bytes) 000088 1788212972.754498 mapread 0x01b8e3 thru 0x02b16b (0xf889 bytes) 000092 1788212972.760782 mapread 0x021478 thru 0x02e614 (0xd19d bytes) 000093 1788212972.762450 mapwrite 0x01efa9 thru 0x02e53b (0xf593 bytes) 000095 1788212972.855191 mapread 0x011f73 thru 0x019496 (0x7524 bytes) 000096 1788212972.863209 trunc from 0x03a6cf to 0x011b40 (0x28b8e bytes) 000097 1788212972.882484 write 0x02d907 thru 0x02fa7b (0x2175 bytes) 000098 1788212972.883520 mapwrite 0x003084 thru 0x00552f (0x24ac bytes) 000099 1788212972.959489 mapread 0x01e8f2 thru 0x02cf3e (0xe64d bytes) 000100 1788212972.994850 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa7c): Mirror 3: 0x65eebb0c (stale) Mirror 4: 0x65eebb0c (stale) Mirror 5: 0x65eebb0c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa7c): Mirror 3: 0x65eebb0c (stale) Mirror 4: 0x65eebb0c (stale) Mirror 5: 0x65eebb0c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa7c: skipped 000102 1788212973.362599 trunc from 0x02fa7c to 0x0096e4 (0x26397 bytes) 000104 1788212973.396047 read 0x005ed4 thru 0x0096e4 (0x3811 bytes) 000105 1788212973.404734 trunc from 0x0096e5 to 0x02b3f4 (0x21d10 bytes) 000106 1788212973.426731 mapwrite 0x024a51 thru 0x028633 (0x3be3 bytes) 000111 1788212973.544263 mapread 0x0214a0 thru 0x026555 (0x50b6 bytes) 000112 1788212973.545521 mapread 0x001163 thru 0x003294 (0x2132 bytes) 000114 1788212973.565050 mapwrite 0x031ce7 thru 0x03a0f4 (0x840e bytes) 000116 1788212973.666250 read 0x021e2e thru 0x02e1d6 (0xc3a9 bytes) 000117 1788212973.667058 write 0x00355a thru 0x0049e7 (0x148e bytes) 000118 1788212973.669337 write 0x02a770 thru 0x02c46f (0x1d00 bytes) 000119 1788212973.671339 trunc from 0x03a0f5 to 0x03a445 (0x351 bytes) 000120 1788212973.690067 trunc from 0x03a446 to 0x018b6c (0x218d9 bytes) 000122 1788212973.712842 read 0x00b90e thru 0x012d5a (0x744d bytes) 000123 1788212973.724501 read 0x002975 thru 0x00c46c (0x9af8 bytes) 000126 1788212973.725998 write 0x014042 thru 0x01ac61 (0x6c20 bytes) 000129 1788212973.729277 read 0x01a6e0 thru 0x01ac61 (0x582 bytes) 000130 1788212973.735036 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ac62): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ac62): Mirror 3: 0x5bb25ae6 (stale) Mirror 4: 0x5bb25ae6 (stale) Mirror 5: 0x5bb25ae6 (stale) CRC-32 checksum value for chunk [0, 0x1ac62): Mirror 1: 0xc65cb28 Mirror 6: 0xc65cb28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ac62: skipped 000131 1788212974.554287 trunc from 0x01ac62 to 0x02e6ab (0x13a4a bytes) 000134 1788212974.645270 mapwrite 0x01a70e thru 0x029a2f (0xf322 bytes) 000135 1788212974.722387 read 0x00123c thru 0x00860d (0x73d2 bytes) 000137 1788212974.740578 MIRROR_RESYNC 5 mirrors 000139 1788212975.614770 mapread 0x017444 thru 0x01a0fd (0x2cba bytes) 000141 1788212975.632327 mapwrite 0x039c10 thru 0x03ffff (0x63f0 bytes) 000142 1788212975.756562 write 0x00a2b9 thru 0x019036 (0xed7e bytes) 000144 1788212975.767448 write 0x022bb4 thru 0x022ea9 (0x2f6 bytes) 000145 1788212975.776133 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xccda4d73 (stale) Mirror 4: 0xccda4d73 (stale) Mirror 5: 0xccda4d73 (stale) Mirror 6: 0xccda4d73 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x26cb4c79 Mirror 7: 0x26cb4c79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000146 1788212976.893987 read 0x01e2bb thru 0x029992 (0xb6d8 bytes) 000148 1788212976.919674 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xccda4d73 (stale) Mirror 4: 0xccda4d73 (stale) Mirror 5: 0xccda4d73 (stale) Mirror 6: 0xccda4d73 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x26cb4c79 Mirror 7: 0x26cb4c79 Mirror 8: 0x26cb4c79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000149 1788212978.099262 trunc from 0x040000 to 0x03a84d (0x57b2 bytes) 000150 1788212978.240434 trunc from 0x03a84e to 0x01104b (0x29802 bytes) 000151 1788212978.274971 mapread 0x00c857 thru 0x01104b (0x47f5 bytes) 000152 1788212978.301366 read 0x004fcd thru 0x0053dd (0x411 bytes) 000154 1788212978.307517 read 0x00d993 thru 0x01104b (0x36b9 bytes) 000156 1788212978.320253 trunc from 0x01104c to 0x036398 (0x2534d bytes) 000158 1788212978.351059 write 0x026c83 thru 0x027d78 (0x10f6 bytes) 000161 1788212978.362942 read 0x008ded thru 0x012c6c (0x9e80 bytes) 000163 1788212978.364430 mapwrite 0x03049e thru 0x03b6b3 (0xb216 bytes) 000165 1788212978.472543 write 0x03c1af thru 0x03ffff (0x3e51 bytes) 000166 1788212978.473593 mapread 0x03040c thru 0x036a1d (0x6612 bytes) 000167 1788212978.476710 mapread 0x01ac0c thru 0x028f21 (0xe316 bytes) 000169 1788212978.487418 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xccda4d73 (stale) Mirror 4: 0xccda4d73 (stale) Mirror 5: 0xccda4d73 (stale) Mirror 7: 0x26cb4c79 (stale) Mirror 8: 0x26cb4c79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xccda4d73 (stale) Mirror 4: 0xccda4d73 (stale) Mirror 5: 0xccda4d73 (stale) Mirror 7: 0x26cb4c79 (stale) Mirror 8: 0x26cb4c79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000172 1788212978.983520 mapread 0x037321 thru 0x03ffff (0x8cdf bytes) 000173 1788212979.019198 MIRROR_RESYNC 6 mirrors 000177 1788212980.370517 trunc from 0x040000 to 0x01d869 (0x22796 bytes) 000178 1788212980.482524 mapread 0x012624 thru 0x018de6 (0x67c3 bytes) 000181 1788212980.509484 write 0x01b90b thru 0x0256d1 (0x9dc7 bytes) 000184 1788212980.514732 trunc from 0x0256d2 to 0x02bb35 (0x6464 bytes) 000185 1788212980.548378 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bb36): Mirror 3: 0x60aa37f5 (stale) Mirror 4: 0x60aa37f5 (stale) Mirror 5: 0x60aa37f5 (stale) Mirror 7: 0x60aa37f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bb36): Mirror 3: 0x60aa37f5 (stale) Mirror 4: 0x60aa37f5 (stale) Mirror 5: 0x60aa37f5 (stale) Mirror 7: 0x60aa37f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bb36: skipped 000186 1788212980.957493 mapwrite 0x03a189 thru 0x03ffff (0x5e77 bytes) 000187 1788212981.109529 write 0x018c06 thru 0x022d9a (0xa195 bytes) 000188 1788212981.142210 write 0x02d3dd thru 0x034b05 (0x7729 bytes) 000189 1788212981.161184 mapread 0x0067e5 thru 0x00b0e9 (0x4905 bytes) 000190 1788212981.181049 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x95f7dd3b (stale) Mirror 4: 0x95f7dd3b (stale) Mirror 5: 0x95f7dd3b (stale) Mirror 7: 0x95f7dd3b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xda3700fb Mirror 8: 0xda3700fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000191 1788212982.224547 mapread 0x00c693 thru 0x0169a0 (0xa30e bytes) 000192 1788212982.272160 mapwrite 0x03e0f7 thru 0x03ffff (0x1f09 bytes) 000194 1788212982.517908 mapwrite 0x01d985 thru 0x028067 (0xa6e3 bytes) 000197 1788212982.591817 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x95f7dd3b (stale) Mirror 5: 0x95f7dd3b (stale) Mirror 7: 0x95f7dd3b (stale) Mirror 8: 0xda3700fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x95f7dd3b (stale) Mirror 5: 0x95f7dd3b (stale) Mirror 7: 0x95f7dd3b (stale) Mirror 8: 0xda3700fb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000198 1788212983.006181 mapread 0x034d6b thru 0x03f0d0 (0xa366 bytes) 000199 1788212983.069077 MIRROR_RESYNC 5 mirrors 000200 1788212984.305827 mapwrite 0x02f787 thru 0x036bec (0x7466 bytes) 000201 1788212984.534715 mapread 0x026bf8 thru 0x02e97d (0x7d86 bytes) 000202 1788212984.558061 write 0x02a7c6 thru 0x02f2de (0x4b19 bytes) 000203 1788212984.559158 read 0x03a118 thru 0x03ea97 (0x4980 bytes) 000204 1788212984.582939 trunc from 0x040000 to 0x0234e8 (0x1cb17 bytes) 000205 1788212984.618501 mapread 0x0055c5 thru 0x009504 (0x3f40 bytes) 000209 1788212984.631433 trunc from 0x0234e9 to 0x021c60 (0x1888 bytes) 000210 1788212984.658197 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x21c61): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21c61): Mirror 4: 0x1af2b266 (stale) Mirror 5: 0x1af2b266 (stale) Mirror 7: 0x1af2b266 (stale) Mirror 8: 0x1af2b266 (stale) CRC-32 checksum value for chunk [0, 0x21c61): Mirror 1: 0x1af2b266 Mirror 9: 0x1af2b266 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21c61: skipped 000211 1788212985.776132 write 0x03c2bf thru 0x03ffff (0x3d41 bytes) 000212 1788212985.899654 trunc from 0x040000 to 0x0181e6 (0x27e19 bytes) 000213 1788212985.934384 mapwrite 0x03145f thru 0x032e87 (0x1a29 bytes) 000214 1788212986.063158 trunc from 0x032e88 to 0x000cb6 (0x321d1 bytes) 000216 1788212986.085576 read 0x000a42 thru 0x000cb6 (0x275 bytes) 000218 1788212986.091548 read 0x000ac5 thru 0x000cb6 (0x1f2 bytes) 000219 1788212986.092225 write 0x0184d6 thru 0x01b7ce (0x32f9 bytes) 000220 1788212986.094452 write 0x0188e1 thru 0x023013 (0xa733 bytes) 000222 1788212986.097431 mapread 0x0080ec thru 0x0124ed (0xa402 bytes) 000223 1788212986.110984 MIRROR_RESYNC 6 mirrors 000224 1788212987.432704 write 0x03684b thru 0x03ffff (0x97b5 bytes) 000225 1788212987.553905 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe01a2878 (stale) Mirror 5: 0xe01a2878 (stale) Mirror 7: 0xe01a2878 (stale) Mirror 8: 0xe01a2878 (stale) Mirror 9: 0xe01a2878 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3c996344 Mirror 10: 0x3c996344 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000227 1788212988.456869 write 0x026f69 thru 0x030f15 (0x9fad bytes) 000229 1788212988.557635 trunc from 0x040000 to 0x03f37d (0xc82 bytes) 000230 1788212988.593489 write 0x03f512 thru 0x03ffff (0xaee bytes) 000231 1788212988.603399 read 0x03098e thru 0x0338b9 (0x2f2c bytes) 000232 1788212988.615148 trunc from 0x040000 to 0x014903 (0x2b6fc bytes) 000233 1788212988.639408 write 0x001e4d thru 0x00bb3a (0x9cee bytes) 000234 1788212988.653939 read 0x00a8bd thru 0x014412 (0x9b56 bytes) 000235 1788212988.670233 mapwrite 0x01701a thru 0x01a6ee (0x36d5 bytes) 000236 1788212988.750980 mapwrite 0x0163d1 thru 0x0175f6 (0x1226 bytes) 000237 1788212988.794851 mapwrite 0x001222 thru 0x00c497 (0xb276 bytes) 000238 1788212988.855910 trunc from 0x01a6ef to 0x03d275 (0x22b87 bytes) 000239 1788212988.885647 mapwrite 0x038c89 thru 0x03ffff (0x7377 bytes) 000241 1788212989.061321 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe01a2878 (stale) Mirror 5: 0xe01a2878 (stale) Mirror 7: 0xe01a2878 (stale) Mirror 8: 0xe01a2878 (stale) Mirror 9: 0xe01a2878 (stale) Mirror 10: 0x3c996344 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb2f3a0e3 Mirror 11: 0xb2f3a0e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000242 1788212990.134655 write 0x019f72 thru 0x020565 (0x65f4 bytes) 000245 1788212990.244392 write 0x022eba thru 0x031bfa (0xed41 bytes) 000246 1788212990.258853 read 0x03cf23 thru 0x03ffff (0x30dd bytes) 000248 1788212990.281493 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe01a2878 (stale) Mirror 5: 0xe01a2878 (stale) Mirror 7: 0xe01a2878 (stale) Mirror 8: 0xe01a2878 (stale) Mirror 9: 0xe01a2878 (stale) Mirror 10: 0x3c996344 (stale) Mirror 11: 0xb2f3a0e3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x32674d49 Mirror 12: 0x32674d49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000249 1788212991.328079 mapread 0x010d15 thru 0x01f6ac (0xe998 bytes) 000250 1788212991.382136 mapread 0x00cd44 thru 0x016b83 (0x9e40 bytes) 000251 1788212991.393170 trunc from 0x040000 to 0x009a02 (0x365fd bytes) 000253 1788212991.515280 mapwrite 0x00b8c3 thru 0x01a6dd (0xee1b bytes) 000254 1788212991.619594 mapwrite 0x009b19 thru 0x017df8 (0xe2e0 bytes) 000257 1788212991.747460 mapwrite 0x0322eb thru 0x035288 (0x2f9e bytes) 000258 1788212991.931412 write 0x03591b thru 0x037281 (0x1967 bytes) 000259 1788212991.942117 mapwrite 0x0306ee thru 0x03d97b (0xd28e bytes) 000261 1788212992.110901 mapwrite 0x004805 thru 0x01081f (0xc01b bytes) 000265 1788212992.169798 mapwrite 0x02b987 thru 0x0360a7 (0xa721 bytes) 000266 1788212992.227371 read 0x01dbc0 thru 0x028a9b (0xaedc bytes) 000267 1788212992.236280 mapwrite 0x02b6dd thru 0x02bd68 (0x68c bytes) 000268 1788212992.283063 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d97c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d97c): Mirror 4: 0x398f5843 (stale) Mirror 5: 0x398f5843 (stale) Mirror 7: 0x398f5843 (stale) Mirror 8: 0x398f5843 (stale) Mirror 9: 0x398f5843 (stale) Mirror 10: 0x3b041d15 (stale) Mirror 11: 0xf5055601 (stale) Mirror 12: 0x789b7970 (stale) CRC-32 checksum value for chunk [0, 0x3d97c): Mirror 1: 0xbbd997f8 Mirror 13: 0xbbd997f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d97c: skipped 000269 1788212993.471579 mapwrite 0x0312ac thru 0x03ffa9 (0xecfe bytes) 000270 1788212993.683903 mapwrite 0x025593 thru 0x0258ee (0x35c bytes) 000271 1788212993.731757 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3ffaa): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffaa): Mirror 4: 0x601e6c3b (stale) Mirror 5: 0x601e6c3b (stale) Mirror 7: 0x601e6c3b (stale) Mirror 8: 0x601e6c3b (stale) Mirror 9: 0x601e6c3b (stale) Mirror 10: 0xcfebceb3 (stale) Mirror 11: 0x226da225 (stale) Mirror 12: 0xf1d6c06d (stale) Mirror 13: 0x497f47e (stale) CRC-32 checksum value for chunk [0, 0x3ffaa): Mirror 1: 0x8dcc929e Mirror 14: 0x8dcc929e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffaa: skipped 000272 1788212995.032307 trunc from 0x03ffaa to 0x0390d6 (0x6ed3 bytes) 000273 1788212995.123991 trunc from 0x0390d7 to 0x01ff1e (0x191b8 bytes) 000274 1788212995.142581 mapwrite 0x02decc thru 0x034b6c (0x6ca1 bytes) 000275 1788212995.238431 mapread 0x004923 thru 0x01076f (0xbe4d bytes) 000276 1788212995.252070 write 0x03b3ee thru 0x03ffff (0x4c12 bytes) 000277 1788212995.254650 mapread 0x0029a4 thru 0x010a5e (0xe0bb bytes) 000278 1788212995.257886 mapread 0x03b9cc thru 0x03ffff (0x4634 bytes) 000281 1788212995.261169 mapwrite 0x00d6d1 thru 0x017f08 (0xa838 bytes) 000282 1788212995.324586 mapwrite 0x03a2cb thru 0x03ffff (0x5d35 bytes) 000284 1788212995.381526 read 0x0134b0 thru 0x0233c5 (0xff16 bytes) 000285 1788212995.394374 read 0x03c716 thru 0x03ffff (0x38ea bytes) 000287 1788212995.396346 write 0x028179 thru 0x030d98 (0x8c20 bytes) 000289 1788212995.399256 trunc from 0x040000 to 0x019329 (0x26cd6 bytes) 000290 1788212995.418943 write 0x030b95 thru 0x0310a1 (0x50d bytes) 000291 1788212995.420719 mapread 0x01c9c7 thru 0x027ccd (0xb307 bytes) 000293 1788212995.434596 mapread 0x01be6f thru 0x022afc (0x6c8e bytes) 000294 1788212995.436779 write 0x03fd90 thru 0x03ffff (0x270 bytes) 000297 1788212995.439954 read 0x03208f thru 0x03b4e1 (0x9453 bytes) 000299 1788212995.449989 mapread 0x00c7b6 thru 0x014bc5 (0x8410 bytes) 000300 1788212995.451020 trunc from 0x040000 to 0x00f7d3 (0x3082c bytes) 000301 1788212995.469477 trunc from 0x00f7d4 to 0x0278b3 (0x180e0 bytes) 000302 1788212995.497083 trunc from 0x0278b4 to 0x02fe72 (0x85bf bytes) 000303 1788212995.528356 mapread 0x0264d8 thru 0x029e1c (0x3945 bytes) 000304 1788212995.556874 MIRROR_RESYNC 11 mirrors 000305 1788212997.867899 write 0x020de4 thru 0x024d55 (0x3f72 bytes) 000309 1788212997.937593 mapread 0x00fff7 thru 0x01f25a (0xf264 bytes) 000310 1788212997.989098 mapread 0x00d191 thru 0x011f4a (0x4dba bytes) 000311 1788212997.991390 write 0x015be5 thru 0x023c20 (0xe03c bytes) 000312 1788212997.999116 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fe73): Mirror 4: 0x652345d7 (stale) Mirror 5: 0x652345d7 (stale) Mirror 8: 0x652345d7 (stale) Mirror 9: 0x652345d7 (stale) Mirror 10: 0x652345d7 (stale) Mirror 11: 0x652345d7 (stale) Mirror 12: 0x652345d7 (stale) Mirror 13: 0x652345d7 (stale) Mirror 14: 0x652345d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fe73): Mirror 4: 0x652345d7 (stale) Mirror 5: 0x652345d7 (stale) Mirror 8: 0x652345d7 (stale) Mirror 9: 0x652345d7 (stale) Mirror 10: 0x652345d7 (stale) Mirror 11: 0x652345d7 (stale) Mirror 12: 0x652345d7 (stale) Mirror 13: 0x652345d7 (stale) Mirror 14: 0x652345d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fe73: skipped 000314 1788212998.622886 trunc from 0x02fe73 to 0x031bd3 (0x1d61 bytes) 000315 1788212998.643367 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31bd4): Mirror 4: 0xa11db68e (stale) Mirror 5: 0xa11db68e (stale) Mirror 8: 0xa11db68e (stale) Mirror 9: 0xa11db68e (stale) Mirror 10: 0xa11db68e (stale) Mirror 11: 0xa11db68e (stale) Mirror 12: 0xa11db68e (stale) Mirror 14: 0xa11db68e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31bd4): Mirror 4: 0xa11db68e (stale) Mirror 5: 0xa11db68e (stale) Mirror 8: 0xa11db68e (stale) Mirror 9: 0xa11db68e (stale) Mirror 10: 0xa11db68e (stale) Mirror 11: 0xa11db68e (stale) Mirror 12: 0xa11db68e (stale) Mirror 14: 0xa11db68e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31bd4: skipped 000318 1788212999.152977 mapwrite 0x0022ce thru 0x00f98d (0xd6c0 bytes) 000319 1788212999.254847 write 0x00d24f thru 0x01472b (0x74dd bytes) 000320 1788212999.278726 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31bd4): Mirror 4: 0xa11db68e (stale) Mirror 5: 0xa11db68e (stale) Mirror 8: 0xa11db68e (stale) Mirror 10: 0xa11db68e (stale) Mirror 11: 0xa11db68e (stale) Mirror 12: 0xa11db68e (stale) Mirror 14: 0xa11db68e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31bd4): Mirror 4: 0xa11db68e (stale) Mirror 5: 0xa11db68e (stale) Mirror 8: 0xa11db68e (stale) Mirror 10: 0xa11db68e (stale) Mirror 11: 0xa11db68e (stale) Mirror 12: 0xa11db68e (stale) Mirror 14: 0xa11db68e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31bd4: skipped 000321 1788212999.827873 trunc from 0x031bd4 to 0x024fa4 (0xcc2f bytes) 000322 1788212999.845435 trunc from 0x024fa5 to 0x035aa8 (0x10b04 bytes) 000323 1788212999.866922 trunc from 0x035aa9 to 0x007066 (0x2ea42 bytes) 000325 1788212999.900788 read 0x006681 thru 0x007066 (0x9e6 bytes) 000326 1788212999.906536 mapread 0x0047db thru 0x007066 (0x288c bytes) 000331 1788212999.931090 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x7067): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7067): Mirror 4: 0xed722c22 (stale) Mirror 5: 0xed722c22 (stale) Mirror 8: 0xed722c22 (stale) Mirror 10: 0xed722c22 (stale) Mirror 11: 0xed722c22 (stale) Mirror 12: 0xed722c22 (stale) Mirror 14: 0xed722c22 (stale) CRC-32 checksum value for chunk [0, 0x7067): Mirror 1: 0xdeb2a23f Mirror 15: 0xdeb2a23f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7067: skipped 000332 1788213000.856189 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x7067): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7067): Mirror 4: 0xed722c22 (stale) Mirror 5: 0xed722c22 (stale) Mirror 8: 0xed722c22 (stale) Mirror 10: 0xed722c22 (stale) Mirror 11: 0xed722c22 (stale) Mirror 12: 0xed722c22 (stale) Mirror 14: 0xed722c22 (stale) CRC-32 checksum value for chunk [0, 0x7067): Mirror 1: 0xdeb2a23f Mirror 15: 0xdeb2a23f Mirror 16: 0xdeb2a23f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7067: skipped 000334 1788213001.781439 mapread 0x00641e thru 0x007066 (0xc49 bytes) 000335 1788213001.807315 write 0x01c390 thru 0x02930e (0xcf7f bytes) 000336 1788213001.909994 mapwrite 0x00c672 thru 0x0164cb (0x9e5a bytes) 000337 1788213002.012561 write 0x006412 thru 0x00c4ea (0x60d9 bytes) 000338 1788213002.015825 write 0x01d542 thru 0x02405e (0x6b1d bytes) 000339 1788213002.019350 read 0x01d0e2 thru 0x01ec8a (0x1ba9 bytes) 000340 1788213002.020447 write 0x031ff9 thru 0x037405 (0x540d bytes) 000342 1788213002.029679 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x37406): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37406): Mirror 4: 0xc4b55e24 (stale) Mirror 5: 0xc4b55e24 (stale) Mirror 8: 0xc4b55e24 (stale) Mirror 10: 0xc4b55e24 (stale) Mirror 11: 0xc4b55e24 (stale) Mirror 12: 0xc4b55e24 (stale) Mirror 14: 0xc4b55e24 (stale) Mirror 15: 0x6bcd1cde (stale) Mirror 16: 0x6bcd1cde (stale) CRC-32 checksum value for chunk [0, 0x37406): Mirror 1: 0xd125378a Mirror 17: 0xd125378a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37406: skipped 000343 1788213003.004882 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x37406): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37406): Mirror 4: 0xc4b55e24 (stale) Mirror 5: 0xc4b55e24 (stale) Mirror 8: 0xc4b55e24 (stale) Mirror 10: 0xc4b55e24 (stale) Mirror 11: 0xc4b55e24 (stale) Mirror 12: 0xc4b55e24 (stale) Mirror 14: 0xc4b55e24 (stale) Mirror 15: 0x6bcd1cde (stale) Mirror 16: 0x6bcd1cde (stale) CRC-32 checksum value for chunk [0, 0x37406): Mirror 1: 0xd125378a Mirror 17: 0xd125378a Mirror 18: 0xd125378a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37406: skipped 000345 1788213004.096826 write 0x0000c0 thru 0x0006a3 (0x5e4 bytes) 000346 1788213004.203884 trunc from 0x037406 to 0x00dfdb (0x2942a bytes) 000347 1788213004.274095 read 0x009f5e thru 0x00dfdb (0x407e bytes) 000348 1788213004.287749 mapwrite 0x02753b thru 0x0280b8 (0xb7e bytes) 000351 1788213004.380168 read 0x026d0c thru 0x0280b8 (0x13ad bytes) 000354 1788213004.419146 mapwrite 0x03eca2 thru 0x03ffff (0x135e bytes) 000356 1788213004.484969 write 0x00e0dd thru 0x01a072 (0xbf96 bytes) 000357 1788213004.486413 write 0x018970 thru 0x02757b (0xec0c bytes) 000359 1788213004.488924 mapwrite 0x02d745 thru 0x03ca60 (0xf31c bytes) 000362 1788213004.542699 mapread 0x016a89 thru 0x024f14 (0xe48c bytes) 000363 1788213004.544575 read 0x00d7cf thru 0x01119d (0x39cf bytes) 000366 1788213004.553410 MIRROR_RESYNC 12 mirrors 000368 1788213006.472527 MIRROR_EXTEND to 13 mirrors 000369 1788213007.412341 write 0x004c56 thru 0x00cd8e (0x8139 bytes) 000370 1788213007.528420 read 0x024e65 thru 0x0281f3 (0x338f bytes) 000371 1788213007.567410 trunc from 0x040000 to 0x03af78 (0x5087 bytes) 000372 1788213007.631502 write 0x01b69b thru 0x01d89b (0x2201 bytes) 000373 1788213007.650821 mapread 0x0352f7 thru 0x037f30 (0x2c3a bytes) 000375 1788213007.685712 trunc from 0x03af79 to 0x03c739 (0x17c1 bytes) 000376 1788213007.725710 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3c73a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c73a): Mirror 4: 0x4317918e (stale) Mirror 5: 0x4317918e (stale) Mirror 8: 0x4317918e (stale) Mirror 10: 0x4317918e (stale) Mirror 11: 0x4317918e (stale) Mirror 12: 0x4317918e (stale) Mirror 14: 0x4317918e (stale) Mirror 15: 0x4317918e (stale) Mirror 16: 0x4317918e (stale) Mirror 17: 0x4317918e (stale) Mirror 18: 0x4317918e (stale) Mirror 19: 0x4317918e (stale) CRC-32 checksum value for chunk [0, 0x3c73a): Mirror 1: 0x47534f33 Mirror 20: 0x47534f33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c73a: skipped 000380 1788213009.112169 read 0x01c2bc thru 0x02afc7 (0xed0c bytes) 000382 1788213009.160148 trunc from 0x03c73a to 0x00ebb0 (0x2db89 bytes) 000383 1788213009.272533 read 0x00e6bc thru 0x00ebb0 (0x4f5 bytes) 000384 1788213009.285781 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0xebb1): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xebb1): Mirror 4: 0x18486ba6 (stale) Mirror 5: 0x18486ba6 (stale) Mirror 8: 0x18486ba6 (stale) Mirror 10: 0x18486ba6 (stale) Mirror 11: 0x18486ba6 (stale) Mirror 12: 0x18486ba6 (stale) Mirror 14: 0x18486ba6 (stale) Mirror 15: 0x18486ba6 (stale) Mirror 16: 0x18486ba6 (stale) Mirror 17: 0x18486ba6 (stale) Mirror 18: 0x18486ba6 (stale) Mirror 19: 0x18486ba6 (stale) Mirror 20: 0x7e6d7ed2 (stale) CRC-32 checksum value for chunk [0, 0xebb1): Mirror 1: 0x7e6d7ed2 Mirror 21: 0x7e6d7ed2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xebb1: skipped 000386 1788213010.227395 write 0x02adc1 thru 0x0324a1 (0x76e1 bytes) 000387 1788213010.334473 mapwrite 0x0002f4 thru 0x00fb07 (0xf814 bytes) 000388 1788213010.467363 trunc from 0x0324a2 to 0x01f648 (0x12e59 bytes) 000390 1788213010.518247 mapread 0x00904d thru 0x00bea1 (0x2e55 bytes) 000391 1788213010.519863 write 0x036fbb thru 0x03ffff (0x9045 bytes) 000392 1788213010.522052 trunc from 0x040000 to 0x021f1f (0x1e0e0 bytes) 000395 1788213010.539740 write 0x015c91 thru 0x0236d5 (0xda45 bytes) 000397 1788213010.547287 trunc from 0x0236d6 to 0x00e7f3 (0x14ee2 bytes) 000399 1788213010.574807 write 0x0082fb thru 0x01471c (0xc422 bytes) 000400 1788213010.577092 mapread 0x00e39c thru 0x01471c (0x6381 bytes) 000402 1788213010.579531 mapwrite 0x024154 thru 0x033a43 (0xf8f0 bytes) 000403 1788213010.739167 trunc from 0x033a44 to 0x02898e (0xb0b5 bytes) 000404 1788213010.762254 read 0x020b97 thru 0x02898e (0x7df8 bytes) 000410 1788213010.769064 mapread 0x0055f3 thru 0x00ac97 (0x56a5 bytes) 000411 1788213010.773035 read 0x00d2b3 thru 0x016296 (0x8fe4 bytes) 000412 1788213010.786350 mapread 0x01dce2 thru 0x027bcb (0x9eea bytes) 000413 1788213010.787486 write 0x031fa1 thru 0x033e4f (0x1eaf bytes) 000415 1788213010.792806 mapread 0x028d62 thru 0x02a7c8 (0x1a67 bytes) 000416 1788213010.803986 trunc from 0x033e50 to 0x005a15 (0x2e43a bytes) 000417 1788213010.817957 trunc from 0x005a16 to 0x0035b4 (0x2461 bytes) 000418 1788213010.837832 trunc from 0x0035b5 to 0x035a95 (0x324e1 bytes) 000420 1788213010.859362 mapread 0x00e9e9 thru 0x013315 (0x492d bytes) 000421 1788213010.894268 MIRROR_RESYNC 15 mirrors 000423 1788213013.731330 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) 000424 1788213014.235201 mapwrite 0x003565 thru 0x00ef54 (0xb9f0 bytes) 000425 1788213014.600328 read 0x02b985 thru 0x02ebea (0x3266 bytes) 000427 1788213014.610971 mapread 0x0038f5 thru 0x005853 (0x1f5f bytes) 000432 1788213014.615207 trunc from 0x035a96 to 0x03ea2d (0x8f98 bytes) 000433 1788213014.658514 mapread 0x02d613 thru 0x0351c6 (0x7bb4 bytes) 000435 1788213014.682267 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3ea2e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea2e): Mirror 4: 0x35d6e38e (stale) Mirror 5: 0x35d6e38e (stale) Mirror 8: 0x35d6e38e (stale) Mirror 11: 0x35d6e38e (stale) Mirror 12: 0x35d6e38e (stale) Mirror 14: 0x35d6e38e (stale) Mirror 15: 0x35d6e38e (stale) Mirror 16: 0x35d6e38e (stale) Mirror 17: 0x35d6e38e (stale) Mirror 18: 0x35d6e38e (stale) Mirror 19: 0x35d6e38e (stale) Mirror 20: 0x35d6e38e (stale) Mirror 21: 0x35d6e38e (stale) CRC-32 checksum value for chunk [0, 0x3ea2e): Mirror 1: 0x1edbaeca Mirror 22: 0x1edbaeca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea2e: skipped 000437 1788213016.128027 write 0x000d1f thru 0x01033b (0xf61d bytes) 000440 1788213016.256300 MIRROR_RESYNC 15 mirrors 000441 1788213019.281378 trunc from 0x03ea2e to 0x0291cf (0x1585e bytes) 000442 1788213019.382167 mapwrite 0x03848e thru 0x03f079 (0x6bec bytes) 000444 1788213019.519700 mapread 0x01c7fe thru 0x02b581 (0xed84 bytes) 000445 1788213019.543329 mapread 0x021bd0 thru 0x02ce56 (0xb287 bytes) 000446 1788213019.544579 write 0x039178 thru 0x03a407 (0x1290 bytes) 000447 1788213019.546206 trunc from 0x03f07a to 0x02e90c (0x1076d bytes) 000450 1788213019.565740 write 0x01f62d thru 0x020568 (0xf3c bytes) 000451 1788213019.567101 read 0x00af35 thru 0x0158fc (0xa9c8 bytes) 000453 1788213019.581488 MIRROR_RESYNC 15 mirrors 000454 1788213022.293038 MIRROR_RESYNC 15 mirrors 000455 1788213023.322866 MIRROR_EXTEND to 16 mirrors 000456 1788213024.290399 write 0x024ac2 thru 0x028b51 (0x4090 bytes) 000459 1788213024.425079 MIRROR_RESYNC 16 mirrors 000460 1788213027.352746 mapwrite 0x008a8a thru 0x013756 (0xaccd bytes) 000461 1788213027.519252 mapwrite 0x022412 thru 0x0296b4 (0x72a3 bytes) 000463 1788213027.577110 mapread 0x02d523 thru 0x02e90c (0x13ea bytes) 000464 1788213027.585379 read 0x026079 thru 0x02e90c (0x8894 bytes) 000465 1788213027.586107 write 0x023afa thru 0x02fcf7 (0xc1fe bytes) 000468 1788213027.590130 write 0x00ad4b thru 0x010c45 (0x5efb bytes) 000469 1788213027.591956 write 0x02d3f0 thru 0x03506c (0x7c7d bytes) 000470 1788213027.593988 mapwrite 0x03f48e thru 0x03ffff (0xb72 bytes) 000472 1788213027.726000 mapwrite 0x00b179 thru 0x00ba0c (0x894 bytes) 000475 1788213027.830098 mapread 0x000e03 thru 0x00facd (0xeccb bytes) 000477 1788213027.837367 read 0x0293a5 thru 0x035049 (0xbca5 bytes) 000479 1788213027.839314 read 0x0252ce thru 0x02ffa4 (0xacd7 bytes) 000487 1788213027.845160 write 0x006eea thru 0x007a74 (0xb8b bytes) 000488 1788213027.846328 mapwrite 0x025e6e thru 0x032a04 (0xcb97 bytes) 000491 1788213027.953902 mapread 0x020bab thru 0x03007f (0xf4d5 bytes) 000492 1788213027.964471 MIRROR_RESYNC 16 mirrors 000493 1788213030.293700 mapread 0x03dfb3 thru 0x03ffff (0x204d bytes) 000497 1788213030.311736 read 0x01ef80 thru 0x02557a (0x65fb bytes) 000498 1788213030.321410 read 0x012a5f thru 0x01e3d7 (0xb979 bytes) 000499 1788213030.337187 mapwrite 0x02f606 thru 0x03c51b (0xcf16 bytes) 000502 1788213030.525370 mapread 0x013165 thru 0x01fba6 (0xca42 bytes) 000503 1788213030.590099 trunc from 0x040000 to 0x0240a7 (0x1bf58 bytes) 000504 1788213030.629780 MIRROR_SPLIT mirror 10 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x240a8): Mirror 4: 0xea2a6e8b (stale) Mirror 5: 0xea2a6e8b (stale) Mirror 8: 0xea2a6e8b (stale) Mirror 11: 0xea2a6e8b (stale) Mirror 12: 0xea2a6e8b (stale) Mirror 14: 0xea2a6e8b (stale) Mirror 15: 0xea2a6e8b (stale) Mirror 16: 0xea2a6e8b (stale) Mirror 17: 0xea2a6e8b (stale) Mirror 19: 0xea2a6e8b (stale) Mirror 20: 0xea2a6e8b (stale) Mirror 21: 0xea2a6e8b (stale) Mirror 22: 0xea2a6e8b (stale) Mirror 23: 0xea2a6e8b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x240a8): Mirror 4: 0xea2a6e8b (stale) Mirror 5: 0xea2a6e8b (stale) Mirror 8: 0xea2a6e8b (stale) Mirror 11: 0xea2a6e8b (stale) Mirror 12: 0xea2a6e8b (stale) Mirror 14: 0xea2a6e8b (stale) Mirror 15: 0xea2a6e8b (stale) Mirror 16: 0xea2a6e8b (stale) Mirror 17: 0xea2a6e8b (stale) Mirror 19: 0xea2a6e8b (stale) Mirror 20: 0xea2a6e8b (stale) Mirror 21: 0xea2a6e8b (stale) Mirror 22: 0xea2a6e8b (stale) Mirror 23: 0xea2a6e8b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x240a8: skipped 000505 1788213031.387986 write 0x01ca61 thru 0x02420d (0x77ad bytes) 000506 1788213031.420432 trunc from 0x02420e to 0x028cf5 (0x4ae8 bytes) 000507 1788213031.450466 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x28cf6): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28cf6): Mirror 4: 0x5a0de95b (stale) Mirror 5: 0x5a0de95b (stale) Mirror 8: 0x5a0de95b (stale) Mirror 11: 0x5a0de95b (stale) Mirror 12: 0x5a0de95b (stale) Mirror 14: 0x5a0de95b (stale) Mirror 15: 0x5a0de95b (stale) Mirror 16: 0x5a0de95b (stale) Mirror 17: 0x5a0de95b (stale) Mirror 19: 0x5a0de95b (stale) Mirror 20: 0x5a0de95b (stale) Mirror 21: 0x5a0de95b (stale) Mirror 22: 0x5a0de95b (stale) Mirror 23: 0x5a0de95b (stale) CRC-32 checksum value for chunk [0, 0x28cf6): Mirror 1: 0xcb8545c6 Mirror 24: 0xcb8545c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28cf6: skipped 000508 1788213032.742031 trunc from 0x028cf6 to 0x03d09a (0x143a5 bytes) 000509 1788213032.860215 mapwrite 0x008d50 thru 0x009884 (0xb35 bytes) 000510 1788213032.957074 mapwrite 0x034fe5 thru 0x03ffff (0xb01b bytes) 000511 1788213033.160977 mapwrite 0x03ad90 thru 0x03ffff (0x5270 bytes) 000513 1788213033.228186 mapread 0x017eec thru 0x01e5ea (0x66ff bytes) 000517 1788213033.250891 read 0x011e0d thru 0x020701 (0xe8f5 bytes) 000518 1788213033.257505 mapread 0x001504 thru 0x004014 (0x2b11 bytes) 000519 1788213033.269702 mapread 0x0263cb thru 0x02f74a (0x9380 bytes) 000523 1788213033.293523 trunc from 0x040000 to 0x00b563 (0x34a9c bytes) 000524 1788213033.320409 mapwrite 0x034c01 thru 0x03ffff (0xb3ff bytes) 000525 1788213033.427270 MIRROR_SPLIT mirror 14 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x188f9ca8 (stale) Mirror 5: 0x188f9ca8 (stale) Mirror 8: 0x188f9ca8 (stale) Mirror 11: 0x188f9ca8 (stale) Mirror 12: 0x188f9ca8 (stale) Mirror 14: 0x188f9ca8 (stale) Mirror 15: 0x188f9ca8 (stale) Mirror 16: 0x188f9ca8 (stale) Mirror 17: 0x188f9ca8 (stale) Mirror 19: 0x188f9ca8 (stale) Mirror 20: 0x188f9ca8 (stale) Mirror 21: 0x188f9ca8 (stale) Mirror 22: 0x188f9ca8 (stale) Mirror 24: 0x55540c07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x188f9ca8 (stale) Mirror 5: 0x188f9ca8 (stale) Mirror 8: 0x188f9ca8 (stale) Mirror 11: 0x188f9ca8 (stale) Mirror 12: 0x188f9ca8 (stale) Mirror 14: 0x188f9ca8 (stale) Mirror 15: 0x188f9ca8 (stale) Mirror 16: 0x188f9ca8 (stale) Mirror 17: 0x188f9ca8 (stale) Mirror 19: 0x188f9ca8 (stale) Mirror 20: 0x188f9ca8 (stale) Mirror 21: 0x188f9ca8 (stale) Mirror 22: 0x188f9ca8 (stale) Mirror 24: 0x55540c07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000526 1788213034.558423 trunc from 0x040000 to 0x00a057 (0x35fa8 bytes) 000529 1788213034.618183 mapwrite 0x008869 thru 0x00e6d0 (0x5e68 bytes) 000530 1788213034.797494 mapread 0x002a40 thru 0x00e6d0 (0xbc91 bytes) 000532 1788213034.813333 read 0x0064ad thru 0x00ad71 (0x48c5 bytes) 000535 1788213034.817726 mapwrite 0x011904 thru 0x01fe60 (0xe55d bytes) 000536 1788213034.989919 read 0x0116ca thru 0x019e51 (0x8788 bytes) 000538 1788213034.997734 MIRROR_RESYNC 15 mirrors 000539 1788213037.631179 MIRROR_EXTEND to 16 mirrors 000540 1788213038.820493 mapwrite 0x02070d thru 0x02e240 (0xdb34 bytes) 000541 1788213038.997006 mapread 0x00a87a thru 0x019d18 (0xf49f bytes) 000542 1788213039.017144 mapread 0x00b335 thru 0x00d7e8 (0x24b4 bytes) 000543 1788213039.018193 mapwrite 0x035f0e thru 0x03d6b3 (0x77a6 bytes) 000544 1788213039.092569 mapread 0x00c56e thru 0x01333c (0x6dcf bytes) 000545 1788213039.093568 read 0x028135 thru 0x034784 (0xc650 bytes) 000546 1788213039.094209 write 0x02e490 thru 0x0324a1 (0x4012 bytes) 000551 1788213039.098534 trunc from 0x03d6b4 to 0x02b4be (0x121f5 bytes) 000552 1788213039.128861 MIRROR_SPLIT mirror 11 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b4bf): Mirror 4: 0x6b992a62 (stale) Mirror 5: 0x6b992a62 (stale) Mirror 8: 0x6b992a62 (stale) Mirror 11: 0x6b992a62 (stale) Mirror 12: 0x6b992a62 (stale) Mirror 14: 0x6b992a62 (stale) Mirror 15: 0x6b992a62 (stale) Mirror 16: 0x6b992a62 (stale) Mirror 17: 0x6b992a62 (stale) Mirror 19: 0x6b992a62 (stale) Mirror 21: 0x6b992a62 (stale) Mirror 22: 0x6b992a62 (stale) Mirror 24: 0x6b992a62 (stale) Mirror 25: 0x6b992a62 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b4bf): Mirror 4: 0x6b992a62 (stale) Mirror 5: 0x6b992a62 (stale) Mirror 8: 0x6b992a62 (stale) Mirror 11: 0x6b992a62 (stale) Mirror 12: 0x6b992a62 (stale) Mirror 14: 0x6b992a62 (stale) Mirror 15: 0x6b992a62 (stale) Mirror 16: 0x6b992a62 (stale) Mirror 17: 0x6b992a62 (stale) Mirror 19: 0x6b992a62 (stale) Mirror 21: 0x6b992a62 (stale) Mirror 22: 0x6b992a62 (stale) Mirror 24: 0x6b992a62 (stale) Mirror 25: 0x6b992a62 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b4bf: skipped 000553 1788213039.857015 MIRROR_RESYNC 15 mirrors 000555 1788213042.825422 mapwrite 0x025288 thru 0x030f1e (0xbc97 bytes) 000556 1788213043.180490 trunc from 0x030f1f to 0x001e26 (0x2f0f8 bytes) 000559 1788213043.235081 mapwrite 0x02b631 thru 0x034d1a (0x96ea bytes) 000560 1788213043.398243 mapread 0x00d984 thru 0x01ceaa (0xf527 bytes) 000561 1788213043.436513 write 0x02e1fd thru 0x0304fa (0x22fe bytes) 000564 1788213043.438453 mapwrite 0x01afa3 thru 0x01f38c (0x43ea bytes) 000565 1788213043.560483 write 0x002922 thru 0x00f2c1 (0xc9a0 bytes) 000566 1788213043.577443 trunc from 0x034d1b to 0x03c499 (0x777f bytes) 000567 1788213043.610183 trunc from 0x03c49a to 0x034ed1 (0x75c8 bytes) 000568 1788213043.659988 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34ed2): Mirror 5: 0xb7e3e2c (stale) Mirror 8: 0xb7e3e2c (stale) Mirror 11: 0xb7e3e2c (stale) Mirror 12: 0xb7e3e2c (stale) Mirror 14: 0xb7e3e2c (stale) Mirror 15: 0xb7e3e2c (stale) Mirror 16: 0xb7e3e2c (stale) Mirror 17: 0xb7e3e2c (stale) Mirror 19: 0xb7e3e2c (stale) Mirror 21: 0xb7e3e2c (stale) Mirror 22: 0xb7e3e2c (stale) Mirror 24: 0xb7e3e2c (stale) Mirror 25: 0xb7e3e2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34ed2): Mirror 5: 0xb7e3e2c (stale) Mirror 8: 0xb7e3e2c (stale) Mirror 11: 0xb7e3e2c (stale) Mirror 12: 0xb7e3e2c (stale) Mirror 14: 0xb7e3e2c (stale) Mirror 15: 0xb7e3e2c (stale) Mirror 16: 0xb7e3e2c (stale) Mirror 17: 0xb7e3e2c (stale) Mirror 19: 0xb7e3e2c (stale) Mirror 21: 0xb7e3e2c (stale) Mirror 22: 0xb7e3e2c (stale) Mirror 24: 0xb7e3e2c (stale) Mirror 25: 0xb7e3e2c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34ed2: skipped 000569 1788213044.528340 write 0x03f67d thru 0x03ffff (0x983 bytes) 000570 1788213044.529982 write 0x013d77 thru 0x0194ea (0x5774 bytes) 000571 1788213044.544816 mapread 0x013008 thru 0x0133f5 (0x3ee bytes) 000572 1788213044.545813 read 0x000b1d thru 0x00801d (0x7501 bytes) 000573 1788213044.570048 MIRROR_RESYNC 14 mirrors 000574 1788213047.218634 mapwrite 0x019619 thru 0x023436 (0x9e1e bytes) 000575 1788213047.564152 read 0x00d171 thru 0x017650 (0xa4e0 bytes) 000576 1788213047.579351 mapwrite 0x00776c thru 0x0120d8 (0xa96d bytes) 000577 1788213047.676134 read 0x02a33f thru 0x0352cc (0xaf8e bytes) 000579 1788213047.694172 read 0x03f467 thru 0x03ffff (0xb99 bytes) 000581 1788213047.702391 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x598249e8 (stale) Mirror 11: 0x598249e8 (stale) Mirror 12: 0x598249e8 (stale) Mirror 14: 0x598249e8 (stale) Mirror 15: 0x598249e8 (stale) Mirror 16: 0x598249e8 (stale) Mirror 17: 0x598249e8 (stale) Mirror 19: 0x598249e8 (stale) Mirror 21: 0x598249e8 (stale) Mirror 22: 0x598249e8 (stale) Mirror 24: 0x598249e8 (stale) Mirror 25: 0x598249e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x598249e8 (stale) Mirror 11: 0x598249e8 (stale) Mirror 12: 0x598249e8 (stale) Mirror 14: 0x598249e8 (stale) Mirror 15: 0x598249e8 (stale) Mirror 16: 0x598249e8 (stale) Mirror 17: 0x598249e8 (stale) Mirror 19: 0x598249e8 (stale) Mirror 21: 0x598249e8 (stale) Mirror 22: 0x598249e8 (stale) Mirror 24: 0x598249e8 (stale) Mirror 25: 0x598249e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000582 1788213048.524172 trunc from 0x040000 to 0x036258 (0x9da7 bytes) 000583 1788213048.544653 mapwrite 0x009dec thru 0x0146a9 (0xa8be bytes) 000586 1788213048.668908 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36259): Mirror 11: 0x1f95621b (stale) Mirror 12: 0x1f95621b (stale) Mirror 14: 0x1f95621b (stale) Mirror 15: 0x1f95621b (stale) Mirror 16: 0x1f95621b (stale) Mirror 17: 0x1f95621b (stale) Mirror 19: 0x1f95621b (stale) Mirror 21: 0x1f95621b (stale) Mirror 22: 0x1f95621b (stale) Mirror 24: 0x1f95621b (stale) Mirror 25: 0x1f95621b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36259): Mirror 11: 0x1f95621b (stale) Mirror 12: 0x1f95621b (stale) Mirror 14: 0x1f95621b (stale) Mirror 15: 0x1f95621b (stale) Mirror 16: 0x1f95621b (stale) Mirror 17: 0x1f95621b (stale) Mirror 19: 0x1f95621b (stale) Mirror 21: 0x1f95621b (stale) Mirror 22: 0x1f95621b (stale) Mirror 24: 0x1f95621b (stale) Mirror 25: 0x1f95621b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36259: skipped 000587 1788213049.552097 mapwrite 0x00a239 thru 0x0153fc (0xb1c4 bytes) 000588 1788213049.626031 mapwrite 0x0265ca thru 0x033910 (0xd347 bytes) 000589 1788213049.702164 mapread 0x02137c thru 0x027870 (0x64f5 bytes) 000591 1788213049.703828 mapread 0x0018a9 thru 0x00c04d (0xa7a5 bytes) 000592 1788213049.711258 read 0x02fb2f thru 0x036258 (0x672a bytes) 000594 1788213049.714174 mapwrite 0x03ab7b thru 0x03eb7b (0x4001 bytes) 000595 1788213049.791172 MIRROR_RESYNC 12 mirrors 000596 1788213052.055999 read 0x0243de thru 0x02452b (0x14e bytes) 000598 1788213052.061750 trunc from 0x03eb7c to 0x01739b (0x277e0 bytes) 000599 1788213052.178822 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1739c): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1739c): Mirror 11: 0xc6a73209 (stale) Mirror 12: 0xc6a73209 (stale) Mirror 14: 0xc6a73209 (stale) Mirror 15: 0xc6a73209 (stale) Mirror 16: 0xc6a73209 (stale) Mirror 17: 0xc6a73209 (stale) Mirror 19: 0xc6a73209 (stale) Mirror 21: 0xc6a73209 (stale) Mirror 22: 0xc6a73209 (stale) Mirror 24: 0xc6a73209 (stale) Mirror 25: 0xc6a73209 (stale) CRC-32 checksum value for chunk [0, 0x1739c): Mirror 1: 0xc6a73209 Mirror 26: 0xc6a73209 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1739c: skipped 000601 1788213053.418431 mapwrite 0x007c30 thru 0x015f74 (0xe345 bytes) 000602 1788213053.671185 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1739c): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1739c): Mirror 11: 0xc6a73209 (stale) Mirror 12: 0xc6a73209 (stale) Mirror 14: 0xc6a73209 (stale) Mirror 15: 0xc6a73209 (stale) Mirror 16: 0xc6a73209 (stale) Mirror 17: 0xc6a73209 (stale) Mirror 19: 0xc6a73209 (stale) Mirror 21: 0xc6a73209 (stale) Mirror 22: 0xc6a73209 (stale) Mirror 24: 0xc6a73209 (stale) Mirror 25: 0xc6a73209 (stale) Mirror 26: 0xc6a73209 (stale) CRC-32 checksum value for chunk [0, 0x1739c): Mirror 1: 0x142a8878 Mirror 27: 0x142a8878 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1739c: skipped 000603 1788213054.751407 trunc from 0x01739c to 0x011bfc (0x579f bytes) 000604 1788213054.902334 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11bfd): Mirror 11: 0xa21e3b9c (stale) Mirror 12: 0xa21e3b9c (stale) Mirror 14: 0xa21e3b9c (stale) Mirror 15: 0xa21e3b9c (stale) Mirror 16: 0xa21e3b9c (stale) Mirror 17: 0xa21e3b9c (stale) Mirror 19: 0xa21e3b9c (stale) Mirror 21: 0xa21e3b9c (stale) Mirror 24: 0xa21e3b9c (stale) Mirror 25: 0xa21e3b9c (stale) Mirror 26: 0xa21e3b9c (stale) Mirror 27: 0xffb06e59 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11bfd): Mirror 11: 0xa21e3b9c (stale) Mirror 12: 0xa21e3b9c (stale) Mirror 14: 0xa21e3b9c (stale) Mirror 15: 0xa21e3b9c (stale) Mirror 16: 0xa21e3b9c (stale) Mirror 17: 0xa21e3b9c (stale) Mirror 19: 0xa21e3b9c (stale) Mirror 21: 0xa21e3b9c (stale) Mirror 24: 0xa21e3b9c (stale) Mirror 25: 0xa21e3b9c (stale) Mirror 26: 0xa21e3b9c (stale) Mirror 27: 0xffb06e59 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11bfd: skipped 000605 1788213056.082449 write 0x00860b thru 0x00ebf4 (0x65ea bytes) 000608 1788213056.102592 MIRROR_RESYNC 13 mirrors 000609 1788213058.060227 read 0x00f8ae thru 0x011bfc (0x234f bytes) 000612 1788213058.067387 trunc from 0x011bfd to 0x00616d (0xba8f bytes) 000613 1788213058.197728 mapwrite 0x01f876 thru 0x028c08 (0x9393 bytes) 000614 1788213058.292406 write 0x01739e thru 0x025917 (0xe57a bytes) 000615 1788213058.302221 write 0x0179db thru 0x01cd9a (0x53c0 bytes) 000617 1788213058.309700 read 0x01d292 thru 0x023868 (0x65d7 bytes) 000619 1788213058.311258 write 0x01c4cd thru 0x028450 (0xbf84 bytes) 000621 1788213058.314457 read 0x00f6d0 thru 0x012e92 (0x37c3 bytes) 000622 1788213058.323454 read 0x019c33 thru 0x028c08 (0xefd6 bytes) 000623 1788213058.324829 read 0x0025c4 thru 0x0051ca (0x2c07 bytes) 000624 1788213058.325450 mapread 0x00ec6a thru 0x01c161 (0xd4f8 bytes) 000625 1788213058.327391 read 0x020be0 thru 0x022de6 (0x2207 bytes) 000626 1788213058.328130 trunc from 0x028c09 to 0x027314 (0x18f4 bytes) 000628 1788213058.346800 write 0x01f608 thru 0x0243e4 (0x4ddd bytes) 000629 1788213058.348121 write 0x027d21 thru 0x02df64 (0x6244 bytes) 000631 1788213058.355216 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2df65): Mirror 11: 0xf6d66a98 (stale) Mirror 12: 0xf6d66a98 (stale) Mirror 14: 0xf6d66a98 (stale) Mirror 15: 0xf6d66a98 (stale) Mirror 16: 0xf6d66a98 (stale) Mirror 17: 0xf6d66a98 (stale) Mirror 19: 0xf6d66a98 (stale) Mirror 21: 0xf6d66a98 (stale) Mirror 24: 0xf6d66a98 (stale) Mirror 26: 0xf6d66a98 (stale) Mirror 27: 0xf6d66a98 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df65): Mirror 11: 0xf6d66a98 (stale) Mirror 12: 0xf6d66a98 (stale) Mirror 14: 0xf6d66a98 (stale) Mirror 15: 0xf6d66a98 (stale) Mirror 16: 0xf6d66a98 (stale) Mirror 17: 0xf6d66a98 (stale) Mirror 19: 0xf6d66a98 (stale) Mirror 21: 0xf6d66a98 (stale) Mirror 24: 0xf6d66a98 (stale) Mirror 26: 0xf6d66a98 (stale) Mirror 27: 0xf6d66a98 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df65: skipped 000632 1788213059.060039 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2df65): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df65): Mirror 11: 0xf6d66a98 (stale) Mirror 12: 0xf6d66a98 (stale) Mirror 14: 0xf6d66a98 (stale) Mirror 15: 0xf6d66a98 (stale) Mirror 16: 0xf6d66a98 (stale) Mirror 17: 0xf6d66a98 (stale) Mirror 19: 0xf6d66a98 (stale) Mirror 21: 0xf6d66a98 (stale) Mirror 24: 0xf6d66a98 (stale) Mirror 26: 0xf6d66a98 (stale) Mirror 27: 0xf6d66a98 (stale) CRC-32 checksum value for chunk [0, 0x2df65): Mirror 1: 0x7927fbbe Mirror 28: 0x7927fbbe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df65: skipped 000633 1788213060.461825 trunc from 0x02df65 to 0x026aae (0x74b6 bytes) 000635 1788213060.620495 trunc from 0x026aaf to 0x02b996 (0x4ee8 bytes) 000637 1788213060.655523 write 0x03b299 thru 0x03fdca (0x4b32 bytes) 000638 1788213060.656694 mapread 0x00d611 thru 0x010af7 (0x34e7 bytes) 000639 1788213060.685279 trunc from 0x03fdcb to 0x00b11d (0x34cad bytes) 000640 1788213060.703502 trunc from 0x00b11e to 0x004a8f (0x668e bytes) 000641 1788213060.720523 mapread 0x002788 thru 0x004a8f (0x2308 bytes) 000642 1788213060.727526 mapread 0x004587 thru 0x004a8f (0x509 bytes) 000643 1788213060.729238 write 0x02f857 thru 0x03d806 (0xdfb0 bytes) 000649 1788213060.734356 mapread 0x02a9d5 thru 0x02ebcf (0x41fb bytes) 000651 1788213060.745464 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d807): Mirror 12: 0x7ef60dc9 (stale) Mirror 14: 0x7ef60dc9 (stale) Mirror 15: 0x7ef60dc9 (stale) Mirror 16: 0x7ef60dc9 (stale) Mirror 17: 0x7ef60dc9 (stale) Mirror 19: 0x7ef60dc9 (stale) Mirror 21: 0x7ef60dc9 (stale) Mirror 24: 0x7ef60dc9 (stale) Mirror 26: 0x7ef60dc9 (stale) Mirror 27: 0x7ef60dc9 (stale) Mirror 28: 0xded59245 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d807): Mirror 12: 0x7ef60dc9 (stale) Mirror 14: 0x7ef60dc9 (stale) Mirror 15: 0x7ef60dc9 (stale) Mirror 16: 0x7ef60dc9 (stale) Mirror 17: 0x7ef60dc9 (stale) Mirror 19: 0x7ef60dc9 (stale) Mirror 21: 0x7ef60dc9 (stale) Mirror 24: 0x7ef60dc9 (stale) Mirror 26: 0x7ef60dc9 (stale) Mirror 27: 0x7ef60dc9 (stale) Mirror 28: 0xded59245 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d807: skipped 000652 1788213061.445584 write 0x03c4c8 thru 0x03ffff (0x3b38 bytes) 000654 1788213061.454456 write 0x003f63 thru 0x0085e9 (0x4687 bytes) 000655 1788213061.474303 mapread 0x016fdb thru 0x01a948 (0x396e bytes) 000656 1788213061.522806 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xd595d840 (stale) Mirror 14: 0xd595d840 (stale) Mirror 15: 0xd595d840 (stale) Mirror 16: 0xd595d840 (stale) Mirror 17: 0xd595d840 (stale) Mirror 21: 0xd595d840 (stale) Mirror 24: 0xd595d840 (stale) Mirror 26: 0xd595d840 (stale) Mirror 27: 0xd595d840 (stale) Mirror 28: 0x26ea0646 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xd595d840 (stale) Mirror 14: 0xd595d840 (stale) Mirror 15: 0xd595d840 (stale) Mirror 16: 0xd595d840 (stale) Mirror 17: 0xd595d840 (stale) Mirror 21: 0xd595d840 (stale) Mirror 24: 0xd595d840 (stale) Mirror 26: 0xd595d840 (stale) Mirror 27: 0xd595d840 (stale) Mirror 28: 0x26ea0646 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000657 1788213062.294033 trunc from 0x040000 to 0x03bc77 (0x4388 bytes) 000658 1788213062.311016 write 0x023da3 thru 0x02c56d (0x87cb bytes) 000662 1788213062.323954 read 0x0205e3 thru 0x02739d (0x6dbb bytes) 000663 1788213062.330100 write 0x0003d8 thru 0x005c9e (0x58c7 bytes) 000666 1788213062.345504 mapread 0x01a047 thru 0x01f31e (0x52d8 bytes) 000667 1788213062.370341 trunc from 0x03bc78 to 0x03aaf4 (0x1183 bytes) 000670 1788213062.389540 mapwrite 0x024d02 thru 0x03252b (0xd82a bytes) 000671 1788213062.493928 write 0x015cbb thru 0x01f59e (0x98e4 bytes) 000672 1788213062.495769 write 0x032d90 thru 0x033d82 (0xff3 bytes) 000673 1788213062.497064 mapread 0x0272d6 thru 0x036774 (0xf49f bytes) 000674 1788213062.528772 read 0x005faf thru 0x009884 (0x38d6 bytes) 000676 1788213062.560577 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aaf5): Mirror 12: 0xf2dd372c (stale) Mirror 14: 0xf2dd372c (stale) Mirror 15: 0xf2dd372c (stale) Mirror 16: 0xf2dd372c (stale) Mirror 17: 0xf2dd372c (stale) Mirror 24: 0xf2dd372c (stale) Mirror 26: 0xf2dd372c (stale) Mirror 27: 0xf2dd372c (stale) Mirror 28: 0x40d5b311 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aaf5): Mirror 12: 0xf2dd372c (stale) Mirror 14: 0xf2dd372c (stale) Mirror 15: 0xf2dd372c (stale) Mirror 16: 0xf2dd372c (stale) Mirror 17: 0xf2dd372c (stale) Mirror 24: 0xf2dd372c (stale) Mirror 26: 0xf2dd372c (stale) Mirror 27: 0xf2dd372c (stale) Mirror 28: 0x40d5b311 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aaf5: skipped 000677 1788213063.294205 mapwrite 0x015fcd thru 0x021529 (0xb55d bytes) 000678 1788213063.427540 read 0x018294 thru 0x0199a0 (0x170d bytes) 000680 1788213063.430091 trunc from 0x03aaf5 to 0x03f38f (0x489b bytes) 000681 1788213063.449044 mapwrite 0x00b4a5 thru 0x014926 (0x9482 bytes) 000684 1788213063.510043 read 0x0073f2 thru 0x014056 (0xcc65 bytes) 000688 1788213063.513524 read 0x03d44d thru 0x03f38f (0x1f43 bytes) 000689 1788213063.525868 trunc from 0x03f390 to 0x006ac6 (0x388c9 bytes) 000690 1788213063.550447 mapwrite 0x00ba78 thru 0x013a1c (0x7fa5 bytes) 000691 1788213063.768256 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x13a1d): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13a1d): Mirror 12: 0xc36ae1ed (stale) Mirror 14: 0xc36ae1ed (stale) Mirror 15: 0xc36ae1ed (stale) Mirror 16: 0xc36ae1ed (stale) Mirror 17: 0xc36ae1ed (stale) Mirror 24: 0xc36ae1ed (stale) Mirror 26: 0xc36ae1ed (stale) Mirror 27: 0xc36ae1ed (stale) Mirror 28: 0xca5de143 (stale) CRC-32 checksum value for chunk [0, 0x13a1d): Mirror 1: 0x4e471f6b Mirror 29: 0x4e471f6b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13a1d: skipped 000694 1788213064.984702 trunc from 0x013a1d to 0x03304d (0x1f631 bytes) 000695 1788213065.085227 mapwrite 0x021e9a thru 0x02751e (0x5685 bytes) 000696 1788213065.233015 mapread 0x009678 thru 0x0100d4 (0x6a5d bytes) 000697 1788213065.250587 read 0x032d6b thru 0x03304d (0x2e3 bytes) 000699 1788213065.262556 MIRROR_RESYNC 11 mirrors 000700 1788213068.474191 mapwrite 0x011ba8 thru 0x01e709 (0xcb62 bytes) 000701 1788213068.671028 mapwrite 0x0137f5 thru 0x0159b4 (0x21c0 bytes) 000703 1788213068.714411 read 0x000315 thru 0x00b35a (0xb046 bytes) 000704 1788213068.725459 mapwrite 0x0011fe thru 0x00c74c (0xb54f bytes) 000706 1788213068.795034 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3304e): Mirror 12: 0xae1d3364 (stale) Mirror 14: 0xae1d3364 (stale) Mirror 16: 0xae1d3364 (stale) Mirror 17: 0xae1d3364 (stale) Mirror 24: 0xae1d3364 (stale) Mirror 26: 0xae1d3364 (stale) Mirror 27: 0xae1d3364 (stale) Mirror 28: 0xae1d3364 (stale) Mirror 29: 0xae1d3364 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3304e): Mirror 12: 0xae1d3364 (stale) Mirror 14: 0xae1d3364 (stale) Mirror 16: 0xae1d3364 (stale) Mirror 17: 0xae1d3364 (stale) Mirror 24: 0xae1d3364 (stale) Mirror 26: 0xae1d3364 (stale) Mirror 27: 0xae1d3364 (stale) Mirror 28: 0xae1d3364 (stale) Mirror 29: 0xae1d3364 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3304e: skipped 000707 1788213069.583358 write 0x0203c7 thru 0x0235b5 (0x31ef bytes) 000708 1788213069.593404 read 0x0180e2 thru 0x01b61d (0x353c bytes) 000709 1788213069.599130 trunc from 0x03304e to 0x00c192 (0x26ebb bytes) 000711 1788213069.617273 mapwrite 0x02ea5f thru 0x02fa48 (0xfea bytes) 000712 1788213069.698204 trunc from 0x02fa49 to 0x01642e (0x1961a bytes) 000713 1788213069.717667 write 0x002f6f thru 0x010ec9 (0xdf5b bytes) 000716 1788213069.729983 read 0x012df6 thru 0x01642e (0x3639 bytes) 000717 1788213069.738960 mapread 0x01285c thru 0x01642e (0x3bd3 bytes) 000718 1788213069.740134 read 0x00caa5 thru 0x012888 (0x5de4 bytes) 000719 1788213069.741442 write 0x03dea4 thru 0x03ffff (0x215c bytes) 000720 1788213069.743078 mapread 0x000a7b thru 0x00421c (0x37a2 bytes) 000721 1788213069.744274 mapwrite 0x007ade thru 0x008579 (0xa9c bytes) 000724 1788213069.794570 read 0x02dfe6 thru 0x0357fb (0x7816 bytes) 000725 1788213069.804890 read 0x02e8d3 thru 0x0347d2 (0x5f00 bytes) 000726 1788213069.805845 trunc from 0x040000 to 0x03b438 (0x4bc7 bytes) 000729 1788213069.836535 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b439): Mirror 12: 0xa866d473 (stale) Mirror 14: 0xa866d473 (stale) Mirror 16: 0xa866d473 (stale) Mirror 17: 0xa866d473 (stale) Mirror 24: 0xa866d473 (stale) Mirror 27: 0xa866d473 (stale) Mirror 28: 0xa866d473 (stale) Mirror 29: 0xa866d473 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b439): Mirror 12: 0xa866d473 (stale) Mirror 14: 0xa866d473 (stale) Mirror 16: 0xa866d473 (stale) Mirror 17: 0xa866d473 (stale) Mirror 24: 0xa866d473 (stale) Mirror 27: 0xa866d473 (stale) Mirror 28: 0xa866d473 (stale) Mirror 29: 0xa866d473 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b439: skipped 000733 1788213070.443427 read 0x018f85 thru 0x024b7b (0xbbf7 bytes) 000740 1788213070.465263 read 0x031f0f thru 0x0391ff (0x72f1 bytes) 000741 1788213070.476670 trunc from 0x03b439 to 0x021551 (0x19ee7 bytes) 000742 1788213070.493467 write 0x02eae9 thru 0x03117f (0x2697 bytes) 000744 1788213070.496843 read 0x030047 thru 0x030e2f (0xde9 bytes) 000746 1788213070.498960 write 0x03b8c0 thru 0x03e5f9 (0x2d3a bytes) 000747 1788213070.501024 read 0x00f5ef thru 0x019623 (0xa035 bytes) 000749 1788213070.502224 mapwrite 0x008c34 thru 0x01558e (0xc95b bytes) 000752 1788213070.564095 mapwrite 0x01eb35 thru 0x027917 (0x8de3 bytes) 000754 1788213070.623020 read 0x0047e5 thru 0x0080d3 (0x38ef bytes) 000755 1788213070.624090 write 0x0242a8 thru 0x026b9a (0x28f3 bytes) 000756 1788213070.625569 read 0x034b3b thru 0x03e48e (0x9954 bytes) 000758 1788213070.630202 read 0x00f81e thru 0x012d3f (0x3522 bytes) 000759 1788213070.634312 mapwrite 0x01d0aa thru 0x0223a4 (0x52fb bytes) 000760 1788213070.688914 read 0x007f5d thru 0x00f94a (0x79ee bytes) 000765 1788213070.704142 MIRROR_RESYNC 9 mirrors 000766 1788213072.353809 mapwrite 0x0376df thru 0x03ffff (0x8921 bytes) 000768 1788213072.544825 read 0x03c707 thru 0x03d145 (0xa3f bytes) 000770 1788213072.546021 write 0x02c9b0 thru 0x03c4d1 (0xfb22 bytes) 000772 1788213072.552068 trunc from 0x040000 to 0x00ac33 (0x353cc bytes) 000773 1788213072.570315 read 0x003162 thru 0x008598 (0x5437 bytes) 000774 1788213072.579007 write 0x00595b thru 0x009c11 (0x42b7 bytes) 000775 1788213072.579978 mapwrite 0x014734 thru 0x015a44 (0x1311 bytes) 000776 1788213072.676046 write 0x02c88a thru 0x037f56 (0xb6cd bytes) 000778 1788213072.679460 mapread 0x02f002 thru 0x034f12 (0x5f11 bytes) 000779 1788213072.681013 write 0x03ab5e thru 0x03dd4c (0x31ef bytes) 000781 1788213072.683500 mapwrite 0x01c880 thru 0x01cbeb (0x36c bytes) 000782 1788213072.738516 read 0x010257 thru 0x013457 (0x3201 bytes) 000783 1788213072.739491 mapread 0x02cc9f thru 0x0384d4 (0xb836 bytes) 000786 1788213072.743014 read 0x022f64 thru 0x0320f3 (0xf190 bytes) 000787 1788213072.748138 MIRROR_RESYNC 9 mirrors 000791 1788213074.463465 read 0x00989a thru 0x00f374 (0x5adb bytes) 000792 1788213074.475888 mapread 0x01fee5 thru 0x0205fb (0x717 bytes) 000793 1788213074.487227 mapread 0x00b809 thru 0x010647 (0x4e3f bytes) 000794 1788213074.502034 MIRROR_EXTEND to 10 mirrors 000796 1788213075.522186 read 0x02511d thru 0x032147 (0xd02b bytes) 000798 1788213075.540171 read 0x037a24 thru 0x03dd4c (0x6329 bytes) 000800 1788213075.552328 mapread 0x037261 thru 0x03d847 (0x65e7 bytes) 000802 1788213075.553866 trunc from 0x03dd4d to 0x01eded (0x1ef5f bytes) 000805 1788213075.802684 write 0x022f6b thru 0x02a918 (0x79ae bytes) 000806 1788213075.814710 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a919): Mirror 12: 0x3ecafdcd (stale) Mirror 14: 0x3ecafdcd (stale) Mirror 16: 0x3ecafdcd (stale) Mirror 17: 0x3ecafdcd (stale) Mirror 24: 0x3ecafdcd (stale) Mirror 27: 0x3ecafdcd (stale) Mirror 29: 0x3ecafdcd (stale) Mirror 30: 0x3ecafdcd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a919): Mirror 12: 0x3ecafdcd (stale) Mirror 14: 0x3ecafdcd (stale) Mirror 16: 0x3ecafdcd (stale) Mirror 17: 0x3ecafdcd (stale) Mirror 24: 0x3ecafdcd (stale) Mirror 27: 0x3ecafdcd (stale) Mirror 29: 0x3ecafdcd (stale) Mirror 30: 0x3ecafdcd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a919: skipped 000807 1788213076.569387 trunc from 0x02a919 to 0x03cc38 (0x12320 bytes) 000809 1788213076.594136 mapread 0x016cbb thru 0x01a886 (0x3bcc bytes) 000810 1788213076.615215 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3cc39): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc39): Mirror 12: 0xcdbd02a (stale) Mirror 14: 0xcdbd02a (stale) Mirror 16: 0xcdbd02a (stale) Mirror 17: 0xcdbd02a (stale) Mirror 24: 0xcdbd02a (stale) Mirror 27: 0xcdbd02a (stale) Mirror 29: 0xcdbd02a (stale) Mirror 30: 0xcdbd02a (stale) CRC-32 checksum value for chunk [0, 0x3cc39): Mirror 1: 0xebb296f4 Mirror 31: 0xebb296f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc39: skipped 000812 1788213078.314257 read 0x0036e9 thru 0x005bab (0x24c3 bytes) 000815 1788213078.346667 mapread 0x026e62 thru 0x02be69 (0x5008 bytes) 000816 1788213078.387135 mapwrite 0x02b29f thru 0x0330dd (0x7e3f bytes) 000817 1788213078.595186 MIRROR_RESYNC 10 mirrors 000818 1788213080.836319 read 0x03932d thru 0x03cc38 (0x390c bytes) 000823 1788213080.843684 write 0x002310 thru 0x002637 (0x328 bytes) 000824 1788213080.922593 mapread 0x024d85 thru 0x02d9ca (0x8c46 bytes) 000825 1788213080.943308 mapwrite 0x025d86 thru 0x028ad3 (0x2d4e bytes) 000827 1788213081.045173 mapwrite 0x032afa thru 0x03df23 (0xb42a bytes) 000828 1788213081.256762 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3df24): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df24): Mirror 12: 0xd9667301 (stale) Mirror 14: 0xd9667301 (stale) Mirror 16: 0xd9667301 (stale) Mirror 17: 0xd9667301 (stale) Mirror 24: 0xd9667301 (stale) Mirror 27: 0xd9667301 (stale) Mirror 29: 0xd9667301 (stale) Mirror 30: 0xd9667301 (stale) Mirror 31: 0xd9667301 (stale) CRC-32 checksum value for chunk [0, 0x3df24): Mirror 1: 0xb4315762 Mirror 32: 0xb4315762 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df24: skipped 000830 1788213082.306964 trunc from 0x03df24 to 0x0227b1 (0x1b772 bytes) 000832 1788213082.484302 mapread 0x00a7cd thru 0x00d7ae (0x2fe2 bytes) 000833 1788213082.510776 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x227b2): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x227b2): Mirror 12: 0xf199cd8a (stale) Mirror 14: 0xf199cd8a (stale) Mirror 16: 0xf199cd8a (stale) Mirror 17: 0xf199cd8a (stale) Mirror 24: 0xf199cd8a (stale) Mirror 27: 0xf199cd8a (stale) Mirror 29: 0xf199cd8a (stale) Mirror 30: 0xf199cd8a (stale) Mirror 31: 0xf199cd8a (stale) Mirror 32: 0xe2a8c7f7 (stale) CRC-32 checksum value for chunk [0, 0x227b2): Mirror 1: 0xe2a8c7f7 Mirror 33: 0xe2a8c7f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x227b2: skipped 000834 1788213083.492247 mapwrite 0x03e30b thru 0x03ffff (0x1cf5 bytes) 000835 1788213083.713317 mapwrite 0x035065 thru 0x03ffff (0xaf9b bytes) 000836 1788213083.860402 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2f6786eb (stale) Mirror 14: 0x2f6786eb (stale) Mirror 16: 0x2f6786eb (stale) Mirror 17: 0x2f6786eb (stale) Mirror 27: 0x2f6786eb (stale) Mirror 29: 0x2f6786eb (stale) Mirror 30: 0x2f6786eb (stale) Mirror 31: 0x2f6786eb (stale) Mirror 32: 0xeaf91a5a (stale) Mirror 33: 0xacfda514 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2f6786eb (stale) Mirror 14: 0x2f6786eb (stale) Mirror 16: 0x2f6786eb (stale) Mirror 17: 0x2f6786eb (stale) Mirror 27: 0x2f6786eb (stale) Mirror 29: 0x2f6786eb (stale) Mirror 30: 0x2f6786eb (stale) Mirror 31: 0x2f6786eb (stale) Mirror 32: 0xeaf91a5a (stale) Mirror 33: 0xacfda514 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000837 1788213084.660834 trunc from 0x040000 to 0x00ed7c (0x31283 bytes) 000838 1788213084.685154 write 0x01d000 thru 0x0236c7 (0x66c8 bytes) 000843 1788213084.690993 mapread 0x011c1f thru 0x021067 (0xf449 bytes) 000844 1788213084.723589 MIRROR_RESYNC 11 mirrors 000845 1788213086.756942 MIRROR_RESYNC 11 mirrors 000846 1788213087.368036 trunc from 0x0236c8 to 0x0084c2 (0x1b205 bytes) 000849 1788213087.487357 mapwrite 0x024caf thru 0x02602a (0x137c bytes) 000852 1788213087.642131 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2602b): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2602b): Mirror 12: 0xa4e99916 (stale) Mirror 14: 0xa4e99916 (stale) Mirror 16: 0xa4e99916 (stale) Mirror 17: 0xa4e99916 (stale) Mirror 27: 0xa4e99916 (stale) Mirror 29: 0xa4e99916 (stale) Mirror 30: 0xa4e99916 (stale) Mirror 31: 0xa4e99916 (stale) Mirror 32: 0xa4e99916 (stale) Mirror 33: 0xa4e99916 (stale) CRC-32 checksum value for chunk [0, 0x2602b): Mirror 1: 0x7af54dfa Mirror 34: 0x7af54dfa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2602b: skipped 000853 1788213088.992890 mapwrite 0x001dbc thru 0x01071a (0xe95f bytes) 000854 1788213089.262900 mapwrite 0x031943 thru 0x0385f7 (0x6cb5 bytes) 000856 1788213089.349438 read 0x0049ce thru 0x007490 (0x2ac3 bytes) 000857 1788213089.354331 MIRROR_RESYNC 12 mirrors 000861 1788213091.481250 mapwrite 0x000b0e thru 0x0067a7 (0x5c9a bytes) 000863 1788213091.735253 mapwrite 0x02b3f8 thru 0x036338 (0xaf41 bytes) 000865 1788213091.908718 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x385f8): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x385f8): Mirror 12: 0x7f66436c (stale) Mirror 14: 0x7f66436c (stale) Mirror 16: 0x7f66436c (stale) Mirror 17: 0x7f66436c (stale) Mirror 27: 0x7f66436c (stale) Mirror 29: 0x7f66436c (stale) Mirror 30: 0x7f66436c (stale) Mirror 31: 0x7f66436c (stale) Mirror 32: 0x7f66436c (stale) Mirror 33: 0x7f66436c (stale) Mirror 34: 0x7f66436c (stale) CRC-32 checksum value for chunk [0, 0x385f8): Mirror 1: 0x9f66d2d2 Mirror 35: 0x9f66d2d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x385f8: skipped 000866 1788213093.189575 trunc from 0x0385f8 to 0x0392ee (0xcf7 bytes) 000867 1788213093.294770 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x392ef): Mirror 12: 0x499a2d91 (stale) Mirror 14: 0x499a2d91 (stale) Mirror 17: 0x499a2d91 (stale) Mirror 27: 0x499a2d91 (stale) Mirror 29: 0x499a2d91 (stale) Mirror 30: 0x499a2d91 (stale) Mirror 31: 0x499a2d91 (stale) Mirror 32: 0x499a2d91 (stale) Mirror 33: 0x499a2d91 (stale) Mirror 34: 0x499a2d91 (stale) Mirror 35: 0x48b03a16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392ef): Mirror 12: 0x499a2d91 (stale) Mirror 14: 0x499a2d91 (stale) Mirror 17: 0x499a2d91 (stale) Mirror 27: 0x499a2d91 (stale) Mirror 29: 0x499a2d91 (stale) Mirror 30: 0x499a2d91 (stale) Mirror 31: 0x499a2d91 (stale) Mirror 32: 0x499a2d91 (stale) Mirror 33: 0x499a2d91 (stale) Mirror 34: 0x499a2d91 (stale) Mirror 35: 0x48b03a16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392ef: skipped 000868 1788213093.955747 mapread 0x013057 thru 0x014ec0 (0x1e6a bytes) 000869 1788213093.968534 write 0x0276d9 thru 0x03660f (0xef37 bytes) 000870 1788213093.983034 trunc from 0x0392ef to 0x005234 (0x340ba bytes) 000872 1788213094.000397 mapwrite 0x007366 thru 0x00c9f5 (0x5690 bytes) 000873 1788213094.148463 mapwrite 0x02c18a thru 0x031385 (0x51fc bytes) 000874 1788213094.304182 write 0x00706c thru 0x00dd53 (0x6ce8 bytes) 000875 1788213094.309579 write 0x01d621 thru 0x02d294 (0xfc74 bytes) 000876 1788213094.317737 mapread 0x003245 thru 0x0129b0 (0xf76c bytes) 000881 1788213094.336926 write 0x01527a thru 0x018bc3 (0x394a bytes) 000882 1788213094.352733 write 0x01c85c thru 0x01d33f (0xae4 bytes) 000884 1788213094.366971 read 0x009d61 thru 0x017a22 (0xdcc2 bytes) 000885 1788213094.368089 mapread 0x015ac4 thru 0x0200f2 (0xa62f bytes) 000887 1788213094.378499 write 0x03aa35 thru 0x03ffff (0x55cb bytes) 000888 1788213094.382525 write 0x00aa87 thru 0x00d24e (0x27c8 bytes) 000889 1788213094.389812 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x9e6947bd (stale) Mirror 14: 0x9e6947bd (stale) Mirror 17: 0x9e6947bd (stale) Mirror 27: 0x9e6947bd (stale) Mirror 29: 0x9e6947bd (stale) Mirror 30: 0x9e6947bd (stale) Mirror 31: 0x9e6947bd (stale) Mirror 32: 0x9e6947bd (stale) Mirror 33: 0x9e6947bd (stale) Mirror 34: 0x9e6947bd (stale) Mirror 35: 0x656002fe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc37b9f3 Mirror 36: 0xc37b9f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000892 1788213095.541163 write 0x03a957 thru 0x03ffff (0x56a9 bytes) 000895 1788213095.690793 read 0x035bf7 thru 0x03736d (0x1777 bytes) 000896 1788213095.700782 trunc from 0x040000 to 0x03ef32 (0x10cd bytes) 000898 1788213095.752708 read 0x030ed0 thru 0x0329f7 (0x1b28 bytes) 000899 1788213095.774070 write 0x0074fb thru 0x015b43 (0xe649 bytes) 000901 1788213095.778321 trunc from 0x03ef33 to 0x00d571 (0x319c1 bytes) 000902 1788213095.794599 write 0x03accf thru 0x03b589 (0x8bb bytes) 000903 1788213095.796259 mapread 0x0245e7 thru 0x0259d3 (0x13ed bytes) 000904 1788213095.810745 read 0x01d055 thru 0x02b987 (0xe933 bytes) 000905 1788213095.820401 mapwrite 0x0173f1 thru 0x02218c (0xad9c bytes) 000907 1788213095.921097 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3b58a): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b58a): Mirror 12: 0x99b220eb (stale) Mirror 14: 0x99b220eb (stale) Mirror 17: 0x99b220eb (stale) Mirror 27: 0x99b220eb (stale) Mirror 29: 0x99b220eb (stale) Mirror 30: 0x99b220eb (stale) Mirror 31: 0x99b220eb (stale) Mirror 32: 0x99b220eb (stale) Mirror 33: 0x99b220eb (stale) Mirror 34: 0x99b220eb (stale) Mirror 35: 0x792e641e (stale) Mirror 36: 0x1c36d708 (stale) CRC-32 checksum value for chunk [0, 0x3b58a): Mirror 1: 0x7751c62c Mirror 37: 0x7751c62c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b58a: skipped 000908 1788213097.001486 trunc from 0x03b58a to 0x0357f9 (0x5d90 bytes) 000912 1788213097.129904 write 0x02964c thru 0x033afc (0xa4b1 bytes) 000913 1788213097.140085 trunc from 0x0357fa to 0x0348d4 (0xf25 bytes) 000914 1788213097.158982 mapwrite 0x020d21 thru 0x021c78 (0xf58 bytes) 000915 1788213097.215957 mapwrite 0x0233bf thru 0x02a94d (0x758f bytes) 000917 1788213097.270898 write 0x02f67f thru 0x033037 (0x39b9 bytes) 000918 1788213097.272161 trunc from 0x0348d5 to 0x0253c3 (0xf511 bytes) 000919 1788213097.309254 read 0x007f05 thru 0x00eac9 (0x6bc5 bytes) 000921 1788213097.327060 read 0x00e3ac thru 0x010562 (0x21b7 bytes) 000922 1788213097.339738 write 0x0128eb thru 0x019413 (0x6b29 bytes) 000923 1788213097.342337 mapread 0x01a041 thru 0x01eb77 (0x4b37 bytes) 000924 1788213097.345075 write 0x02d530 thru 0x02dc8f (0x760 bytes) 000925 1788213097.346170 trunc from 0x02dc90 to 0x0156c4 (0x185cb bytes) 000928 1788213097.362836 read 0x011206 thru 0x0156c4 (0x44bf bytes) 000929 1788213097.363884 mapread 0x01295c thru 0x0156c4 (0x2d69 bytes) 000930 1788213097.364736 write 0x00eab9 thru 0x012279 (0x37c1 bytes) 000931 1788213097.365845 write 0x03f726 thru 0x03ffff (0x8da bytes) 000932 1788213097.366697 read 0x0012b2 thru 0x00f5d1 (0xe320 bytes) 000933 1788213097.367335 read 0x035d35 thru 0x03ffff (0xa2cb bytes) 000934 1788213097.375345 read 0x00bbbb thru 0x0123f5 (0x683b bytes) 000936 1788213097.377129 write 0x038463 thru 0x03ffff (0x7b9d bytes) 000937 1788213097.379353 trunc from 0x040000 to 0x001cc0 (0x3e33f bytes) 000940 1788213097.396571 mapread 0x0002db thru 0x001cc0 (0x19e6 bytes) 000941 1788213097.398151 mapread 0x000f46 thru 0x001cc0 (0xd7b bytes) 000942 1788213097.399534 write 0x0357c6 thru 0x0369e2 (0x121d bytes) 000943 1788213097.404506 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x369e3): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x369e3): Mirror 12: 0x264d4a03 (stale) Mirror 14: 0x264d4a03 (stale) Mirror 17: 0x264d4a03 (stale) Mirror 27: 0x264d4a03 (stale) Mirror 29: 0x264d4a03 (stale) Mirror 30: 0x264d4a03 (stale) Mirror 31: 0x264d4a03 (stale) Mirror 32: 0x264d4a03 (stale) Mirror 33: 0x264d4a03 (stale) Mirror 34: 0x264d4a03 (stale) Mirror 35: 0x25e33fd8 (stale) Mirror 36: 0x1ed9804c (stale) Mirror 37: 0xcdc9c769 (stale) CRC-32 checksum value for chunk [0, 0x369e3): Mirror 1: 0xea878a48 Mirror 38: 0xea878a48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x369e3: skipped 000944 1788213098.476847 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x369e3): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x369e3): Mirror 12: 0x264d4a03 (stale) Mirror 14: 0x264d4a03 (stale) Mirror 17: 0x264d4a03 (stale) Mirror 27: 0x264d4a03 (stale) Mirror 29: 0x264d4a03 (stale) Mirror 30: 0x264d4a03 (stale) Mirror 31: 0x264d4a03 (stale) Mirror 32: 0x264d4a03 (stale) Mirror 33: 0x264d4a03 (stale) Mirror 34: 0x264d4a03 (stale) Mirror 35: 0x25e33fd8 (stale) Mirror 36: 0x1ed9804c (stale) Mirror 37: 0xcdc9c769 (stale) CRC-32 checksum value for chunk [0, 0x369e3): Mirror 1: 0xea878a48 Mirror 38: 0xea878a48 Mirror 39: 0xea878a48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x369e3: skipped 000945 1788213100.182043 write 0x0068c9 thru 0x00baed (0x5225 bytes) 000946 1788213100.303205 write 0x024dfd thru 0x0305c8 (0xb7cc bytes) 000947 1788213100.314511 mapread 0x004196 thru 0x00a068 (0x5ed3 bytes) 000950 1788213100.328660 mapwrite 0x03a892 thru 0x03ffff (0x576e bytes) 000951 1788213100.461431 mapread 0x00ee13 thru 0x0195fc (0xa7ea bytes) 000952 1788213100.478787 write 0x016246 thru 0x018acd (0x2888 bytes) 000953 1788213100.479724 read 0x02d705 thru 0x035096 (0x7992 bytes) 000954 1788213100.484463 write 0x00dbd9 thru 0x01548b (0x78b3 bytes) 000957 1788213100.487520 read 0x024676 thru 0x02ecfa (0xa685 bytes) 000958 1788213100.496147 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x9e6947bd (stale) Mirror 14: 0x9e6947bd (stale) Mirror 17: 0x9e6947bd (stale) Mirror 27: 0x9e6947bd (stale) Mirror 29: 0x9e6947bd (stale) Mirror 30: 0x9e6947bd (stale) Mirror 31: 0x9e6947bd (stale) Mirror 32: 0x9e6947bd (stale) Mirror 33: 0x9e6947bd (stale) Mirror 34: 0x9e6947bd (stale) Mirror 35: 0x656002fe (stale) Mirror 36: 0xc37b9f3 (stale) Mirror 38: 0x9495ae32 (stale) Mirror 39: 0x9495ae32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x9e6947bd (stale) Mirror 14: 0x9e6947bd (stale) Mirror 17: 0x9e6947bd (stale) Mirror 27: 0x9e6947bd (stale) Mirror 29: 0x9e6947bd (stale) Mirror 30: 0x9e6947bd (stale) Mirror 31: 0x9e6947bd (stale) Mirror 32: 0x9e6947bd (stale) Mirror 33: 0x9e6947bd (stale) Mirror 34: 0x9e6947bd (stale) Mirror 35: 0x656002fe (stale) Mirror 36: 0xc37b9f3 (stale) Mirror 38: 0x9495ae32 (stale) Mirror 39: 0x9495ae32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000961 1788213101.584754 trunc from 0x040000 to 0x023f4f (0x1c0b0 bytes) 000962 1788213101.601101 mapread 0x0104f1 thru 0x01e467 (0xdf77 bytes) 000964 1788213101.673294 write 0x00217b thru 0x002536 (0x3bc bytes) 000968 1788213101.682051 mapread 0x01fcbf thru 0x022abf (0x2e01 bytes) 000970 1788213101.690229 read 0x021c12 thru 0x023f4f (0x233e bytes) 000972 1788213101.691411 trunc from 0x023f50 to 0x006bef (0x1d360 bytes) 000974 1788213101.733766 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6bf0): Mirror 12: 0xa62c2427 (stale) Mirror 14: 0xa62c2427 (stale) Mirror 17: 0xa62c2427 (stale) Mirror 27: 0xa62c2427 (stale) Mirror 29: 0xa62c2427 (stale) Mirror 30: 0xa62c2427 (stale) Mirror 31: 0xa62c2427 (stale) Mirror 32: 0xa62c2427 (stale) Mirror 33: 0xa62c2427 (stale) Mirror 34: 0xa62c2427 (stale) Mirror 36: 0xc151170f (stale) Mirror 38: 0xdfe737c9 (stale) Mirror 39: 0xdfe737c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6bf0): Mirror 12: 0xa62c2427 (stale) Mirror 14: 0xa62c2427 (stale) Mirror 17: 0xa62c2427 (stale) Mirror 27: 0xa62c2427 (stale) Mirror 29: 0xa62c2427 (stale) Mirror 30: 0xa62c2427 (stale) Mirror 31: 0xa62c2427 (stale) Mirror 32: 0xa62c2427 (stale) Mirror 33: 0xa62c2427 (stale) Mirror 34: 0xa62c2427 (stale) Mirror 36: 0xc151170f (stale) Mirror 38: 0xdfe737c9 (stale) Mirror 39: 0xdfe737c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6bf0: skipped 000977 1788213102.514322 mapwrite 0x0287b5 thru 0x028e14 (0x660 bytes) 000978 1788213102.615365 write 0x02e432 thru 0x038c6b (0xa83a bytes) 000979 1788213102.616669 mapwrite 0x03b915 thru 0x03ffff (0x46eb bytes) 000984 1788213102.778304 trunc from 0x040000 to 0x02e53a (0x11ac5 bytes) 000985 1788213102.807470 mapwrite 0x02af05 thru 0x03a48f (0xf58b bytes) 000987 1788213102.928149 mapread 0x0053b2 thru 0x00d28d (0x7edc bytes) 000988 1788213102.938898 write 0x020317 thru 0x0211b8 (0xea2 bytes) 000990 1788213102.960079 mapwrite 0x002b84 thru 0x003858 (0xcd5 bytes) 000991 1788213103.054281 write 0x00dee6 thru 0x0186be (0xa7d9 bytes) 000994 1788213103.068179 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a490): Mirror 12: 0xfa889bd7 (stale) Mirror 14: 0xfa889bd7 (stale) Mirror 27: 0xfa889bd7 (stale) Mirror 29: 0xfa889bd7 (stale) Mirror 30: 0xfa889bd7 (stale) Mirror 31: 0xfa889bd7 (stale) Mirror 32: 0xfa889bd7 (stale) Mirror 33: 0xfa889bd7 (stale) Mirror 34: 0xfa889bd7 (stale) Mirror 36: 0x7cb36503 (stale) Mirror 38: 0x9d42081f (stale) Mirror 39: 0x9d42081f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a490): Mirror 12: 0xfa889bd7 (stale) Mirror 14: 0xfa889bd7 (stale) Mirror 27: 0xfa889bd7 (stale) Mirror 29: 0xfa889bd7 (stale) Mirror 30: 0xfa889bd7 (stale) Mirror 31: 0xfa889bd7 (stale) Mirror 32: 0xfa889bd7 (stale) Mirror 33: 0xfa889bd7 (stale) Mirror 34: 0xfa889bd7 (stale) Mirror 36: 0x7cb36503 (stale) Mirror 38: 0x9d42081f (stale) Mirror 39: 0x9d42081f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a490: skipped 000996 1788213103.936274 trunc from 0x03a490 to 0x0384ae (0x1fe1 bytes) 000998 1788213103.968572 write 0x029062 thru 0x02c819 (0x37b8 bytes) All operations completed A-OK!