== sanity-flr test 70a: flr mode fsx test ================ 07:20:05 (1787570405) Seed set to 407 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000007 1787570407.732181 mapwrite 0x01c3bf thru 0x0289ce (0xc610 bytes) 000009 1787570407.963129 mapwrite 0x02b3ee thru 0x02d3f0 (0x2003 bytes) 000013 1787570408.089600 write 0x02c13d thru 0x03184b (0x570f bytes) 000018 1787570408.120787 write 0x0370a2 thru 0x03ac61 (0x3bc0 bytes) 000019 1787570408.123661 write 0x0113fa thru 0x016efc (0x5b03 bytes) 000020 1787570408.147423 read 0x0096a1 thru 0x01877a (0xf0da bytes) 000023 1787570408.187994 mapread 0x032413 thru 0x039dab (0x7999 bytes) 000024 1787570408.211355 write 0x0362da thru 0x03ffff (0x9d26 bytes) truncating to largest ever: 0x5e2 000026 1787570408.213299 trunc from 0x040000 to 0x0005e1 (0x3fa1e bytes) 000028 1787570408.236062 write 0x01632a thru 0x01a770 (0x4447 bytes) 000030 1787570408.249037 mapwrite 0x002add thru 0x004cb8 (0x21dc bytes) truncating to largest ever: 0x2404a 000031 1787570408.370489 trunc from 0x01a771 to 0x024049 (0x98d9 bytes) 000032 1787570408.403834 read 0x02271c thru 0x023c2f (0x1514 bytes) 000033 1787570408.426961 write 0x02852c thru 0x028ee4 (0x9b9 bytes) 000034 1787570408.430832 mapread 0x01f6e7 thru 0x028ee4 (0x97fe bytes) 000038 1787570408.449260 read 0x014129 thru 0x014903 (0x7db bytes) 000044 1787570408.466995 mapwrite 0x009ea3 thru 0x012cbf (0x8e1d bytes) 000046 1787570408.577730 trunc from 0x028ee5 to 0x0022d0 (0x26c14 bytes) 000048 1787570408.610312 read 0x0002da thru 0x0022d0 (0x1ff7 bytes) 000050 1787570408.613986 mapwrite 0x0074f9 thru 0x0135bd (0xc0c5 bytes) 000051 1787570408.728915 mapwrite 0x022dbd thru 0x02e139 (0xb37d bytes) truncating to largest ever: 0x363dd 000052 1787570408.891942 trunc from 0x02e13a to 0x0363dc (0x82a3 bytes) 000055 1787570408.954220 mapread 0x013ff8 thru 0x022713 (0xe71c bytes) 000056 1787570408.962304 MIRROR_EXTEND to 2 mirrors 000057 1787570410.601886 write 0x00d0b3 thru 0x01a770 (0xd6be bytes) 000058 1787570410.764181 MIRROR_RESYNC 2 mirrors 000059 1787570412.011086 mapwrite 0x017d69 thru 0x01a6e7 (0x297f bytes) 000062 1787570412.258612 read 0x00a803 thru 0x00d600 (0x2dfe bytes) 000064 1787570412.270259 write 0x0380c6 thru 0x03f294 (0x71cf bytes) 000065 1787570412.274021 mapwrite 0x02b924 thru 0x03760f (0xbcec bytes) 000066 1787570412.353705 mapread 0x03ba48 thru 0x03f294 (0x384d bytes) 000067 1787570412.355286 read 0x00d9a6 thru 0x01848d (0xaae8 bytes) 000070 1787570412.368890 mapwrite 0x020738 thru 0x02caa5 (0xc36e bytes) 000071 1787570412.417785 mapread 0x025553 thru 0x032f50 (0xd9fe bytes) 000072 1787570412.419298 write 0x00ac02 thru 0x018e0d (0xe20c bytes) 000074 1787570412.433539 MIRROR_RESYNC 2 mirrors 000076 1787570413.576265 read 0x022d10 thru 0x02ab13 (0x7e04 bytes) 000077 1787570413.586680 mapread 0x02691a thru 0x036008 (0xf6ef bytes) 000078 1787570413.637933 trunc from 0x03f295 to 0x006b7c (0x38718 bytes) 000079 1787570413.721139 mapread 0x00379a thru 0x006b7c (0x33e3 bytes) 000080 1787570413.732202 mapwrite 0x039e96 thru 0x03ffff (0x616a bytes) 000081 1787570413.836465 MIRROR_RESYNC 2 mirrors 000083 1787570415.134030 mapwrite 0x01fc0a thru 0x02486f (0x4c66 bytes) 000084 1787570415.382576 trunc from 0x040000 to 0x01ac7d (0x25382 bytes) 000086 1787570415.409292 read 0x005ca3 thru 0x005fa8 (0x306 bytes) truncating to largest ever: 0x38a0f 000088 1787570415.417252 trunc from 0x01ac7e to 0x038a0e (0x1dd91 bytes) 000089 1787570415.466039 write 0x014089 thru 0x0174f6 (0x346e bytes) 000091 1787570415.485232 write 0x037297 thru 0x03ffff (0x8d69 bytes) 000093 1787570415.493411 trunc from 0x040000 to 0x00fc90 (0x3036f bytes) 000094 1787570415.516789 read 0x006184 thru 0x00fc90 (0x9b0d bytes) 000096 1787570415.532006 write 0x031260 thru 0x038f9b (0x7d3c bytes) 000097 1787570415.533917 trunc from 0x038f9c to 0x022916 (0x16685 bytes) 000099 1787570415.551441 read 0x000f4d thru 0x00fd41 (0xedf5 bytes) 000100 1787570415.552247 write 0x01e30c thru 0x025e03 (0x7af8 bytes) 000102 1787570415.574230 mapread 0x0129b0 thru 0x01ef9d (0xc5ee bytes) 000105 1787570415.582310 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x25e04): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25e04): Mirror 2: 0x5b8ffd5 (stale) CRC-32 checksum value for chunk [0, 0x25e04): Mirror 1: 0x6b2f8ed2 Mirror 3: 0x6b2f8ed2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25e04: skipped 000106 1787570416.563528 read 0x000a96 thru 0x006cbf (0x622a bytes) 000107 1787570416.579351 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25e04): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25e04): Mirror 2: 0x5b8ffd5 (stale) CRC-32 checksum value for chunk [0, 0x25e04): Mirror 1: 0x6b2f8ed2 Mirror 3: 0x6b2f8ed2 Mirror 4: 0x6b2f8ed2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25e04: skipped 000108 1787570417.669352 mapwrite 0x0304b7 thru 0x03bbb0 (0xb6fa bytes) 000109 1787570417.928197 write 0x01b7d1 thru 0x026ab8 (0xb2e8 bytes) 000110 1787570417.959936 mapwrite 0x010771 thru 0x016272 (0x5b02 bytes) 000113 1787570418.014862 mapwrite 0x016b45 thru 0x025b26 (0xefe2 bytes) 000115 1787570418.104052 read 0x008206 thru 0x010bab (0x89a6 bytes) 000116 1787570418.133903 write 0x005a6f thru 0x00e01e (0x85b0 bytes) 000117 1787570418.163707 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bbb1): Mirror 3: 0xc892415c (stale) Mirror 4: 0xc892415c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bbb1): Mirror 3: 0xc892415c (stale) Mirror 4: 0xc892415c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bbb1: skipped 000119 1787570418.746889 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3bbb1): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bbb1): Mirror 3: 0xc892415c (stale) Mirror 4: 0xc892415c (stale) CRC-32 checksum value for chunk [0, 0x3bbb1): Mirror 1: 0x91242ea7 Mirror 5: 0x91242ea7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bbb1: skipped 000121 1787570420.046905 mapread 0x0324b4 thru 0x0349d1 (0x251e bytes) 000122 1787570420.111518 read 0x01eb0c thru 0x027078 (0x856d bytes) 000123 1787570420.145143 mapwrite 0x039743 thru 0x03ffff (0x68bd bytes) 000125 1787570420.443668 trunc from 0x040000 to 0x005d29 (0x3a2d6 bytes) truncating to largest ever: 0x3a643 000127 1787570420.504195 trunc from 0x005d2a to 0x03a642 (0x34919 bytes) 000130 1787570420.525353 write 0x021871 thru 0x02363d (0x1dcd bytes) 000131 1787570420.548198 trunc from 0x03a643 to 0x02eee7 (0xb75b bytes) 000132 1787570420.573261 write 0x02cb51 thru 0x02fc9b (0x314b bytes) 000133 1787570420.580063 mapwrite 0x021fe0 thru 0x02d525 (0xb546 bytes) truncating to largest ever: 0x3ccf8 000134 1787570420.678330 trunc from 0x02fc9c to 0x03ccf7 (0xd05c bytes) 000135 1787570420.712576 MIRROR_RESYNC 4 mirrors 000136 1787570422.598172 trunc from 0x03ccf8 to 0x035418 (0x78df bytes) 000137 1787570422.688346 MIRROR_RESYNC 4 mirrors 000138 1787570424.262455 mapwrite 0x0055b4 thru 0x014ad0 (0xf51d bytes) 000140 1787570424.530834 write 0x03ac40 thru 0x03ffff (0x53c0 bytes) 000141 1787570424.540121 MIRROR_RESYNC 4 mirrors 000144 1787570425.716074 mapread 0x027316 thru 0x0363ea (0xf0d5 bytes) 000148 1787570425.753761 mapread 0x01158e thru 0x0162ee (0x4d61 bytes) 000149 1787570425.774364 write 0x027390 thru 0x032eba (0xbb2b bytes) 000150 1787570425.869243 mapwrite 0x0175fe thru 0x02002b (0x8a2e bytes) 000151 1787570425.959585 trunc from 0x040000 to 0x02fe4b (0x101b4 bytes) 000152 1787570425.990050 MIRROR_RESYNC 4 mirrors 000153 1787570427.168078 mapwrite 0x03fcd5 thru 0x03ffff (0x32b bytes) 000154 1787570427.481727 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9b294991 (stale) Mirror 4: 0x9b294991 (stale) Mirror 5: 0x9b294991 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x41e359bc Mirror 6: 0x41e359bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000155 1787570428.749480 read 0x00fe6a thru 0x016b6a (0x6d01 bytes) 000157 1787570428.773011 MIRROR_RESYNC 5 mirrors 000159 1787570430.279622 trunc from 0x040000 to 0x02eafc (0x11503 bytes) 000160 1787570430.421709 trunc from 0x02eafd to 0x0320d4 (0x35d8 bytes) 000162 1787570430.449694 trunc from 0x0320d5 to 0x01e688 (0x13a4c bytes) 000163 1787570430.473538 mapwrite 0x00b730 thru 0x0180e0 (0xc9b1 bytes) 000166 1787570430.619369 MIRROR_RESYNC 5 mirrors 000167 1787570431.999291 mapread 0x0194df thru 0x01e688 (0x51aa bytes) 000168 1787570432.042986 trunc from 0x01e689 to 0x004073 (0x1a615 bytes) 000170 1787570432.160492 read 0x001d1c thru 0x004073 (0x2358 bytes) 000171 1787570432.169011 mapread 0x0005b4 thru 0x002aa4 (0x24f1 bytes) 000172 1787570432.177644 mapwrite 0x001f7c thru 0x00b93d (0x99c2 bytes) 000174 1787570432.321193 mapread 0x005aed thru 0x00b93d (0x5e51 bytes) 000175 1787570432.323149 mapwrite 0x03ec8e thru 0x03ffff (0x1372 bytes) 000176 1787570432.387710 mapwrite 0x01bcce thru 0x02080a (0x4b3d bytes) 000178 1787570432.437019 trunc from 0x040000 to 0x03446d (0xbb92 bytes) 000180 1787570432.455051 write 0x023eae thru 0x03038a (0xc4dd bytes) 000181 1787570432.478546 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3446e): Mirror 3: 0xc18edc1b (stale) Mirror 4: 0xc18edc1b (stale) Mirror 6: 0xc18edc1b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3446e): Mirror 3: 0xc18edc1b (stale) Mirror 4: 0xc18edc1b (stale) Mirror 6: 0xc18edc1b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3446e: skipped 000182 1787570432.975809 write 0x03142b thru 0x0368aa (0x5480 bytes) truncating to largest ever: 0x3d9e8 000183 1787570432.982581 trunc from 0x0368ab to 0x03d9e7 (0x713d bytes) 000185 1787570433.006300 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d9e8): Mirror 4: 0xf3e513d8 (stale) Mirror 6: 0xf3e513d8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d9e8): Mirror 4: 0xf3e513d8 (stale) Mirror 6: 0xf3e513d8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d9e8: skipped 000186 1787570433.402477 trunc from 0x03d9e8 to 0x01dab5 (0x1ff32 bytes) 000187 1787570433.431250 read 0x00172c thru 0x007a6c (0x6341 bytes) 000189 1787570433.444236 trunc from 0x01dab6 to 0x004e51 (0x18c64 bytes) 000190 1787570433.472478 trunc from 0x004e52 to 0x012d08 (0xdeb7 bytes) 000191 1787570433.526691 mapread 0x00dc00 thru 0x0116b3 (0x3ab4 bytes) 000194 1787570433.578212 MIRROR_RESYNC 3 mirrors 000197 1787570434.600483 read 0x00e413 thru 0x010614 (0x2202 bytes) 000198 1787570434.610968 write 0x02dfc3 thru 0x03a90f (0xc94d bytes) 000202 1787570434.691342 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a910): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a910): Mirror 4: 0xa3a423dc (stale) Mirror 6: 0xa3a423dc (stale) CRC-32 checksum value for chunk [0, 0x3a910): Mirror 1: 0x132a7dd0 Mirror 7: 0x132a7dd0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a910: skipped 000203 1787570435.785209 trunc from 0x03a910 to 0x01ebc3 (0x1bd4c bytes) 000204 1787570435.877839 mapwrite 0x01b3c5 thru 0x025e59 (0xaa95 bytes) 000207 1787570436.036464 trunc from 0x025e5a to 0x02f774 (0x991b bytes) 000208 1787570436.086425 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f775): Mirror 4: 0xb8ed2503 (stale) Mirror 7: 0xc0377f48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f775): Mirror 4: 0xb8ed2503 (stale) Mirror 7: 0xc0377f48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f775: skipped 000209 1787570436.523368 MIRROR_RESYNC 3 mirrors 000210 1787570437.528230 trunc from 0x02f775 to 0x031704 (0x1f90 bytes) 000211 1787570437.615144 read 0x020f62 thru 0x02f61e (0xe6bd bytes) 000212 1787570437.628689 mapwrite 0x026f9f thru 0x02aaae (0x3b10 bytes) 000213 1787570437.688704 mapread 0x013779 thru 0x01435f (0xbe7 bytes) 000214 1787570437.702100 read 0x0013cc thru 0x0083cf (0x7004 bytes) 000215 1787570437.731083 write 0x00aaac thru 0x011ed5 (0x742a bytes) 000216 1787570437.742298 MIRROR_RESYNC 3 mirrors 000220 1787570438.771846 mapread 0x001177 thru 0x0019b7 (0x841 bytes) 000222 1787570438.780095 write 0x03a09b thru 0x03dfb8 (0x3f1e bytes) 000223 1787570438.854227 write 0x01c6b6 thru 0x02089e (0x41e9 bytes) 000225 1787570438.887412 mapwrite 0x012ff9 thru 0x0179d8 (0x49e0 bytes) 000227 1787570438.990524 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3dfb9): Mirror 4: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dfb9): Mirror 4: 0x23792804 (stale) Mirror 7: 0x23792804 (stale) CRC-32 checksum value for chunk [0, 0x3dfb9): Mirror 1: 0x38ea697b Mirror 8: 0x38ea697b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dfb9: skipped 000230 1787570440.215294 trunc from 0x03dfb9 to 0x0261b2 (0x17e06 bytes) 000231 1787570440.378207 write 0x010135 thru 0x012c94 (0x2b60 bytes) 000232 1787570440.402178 mapread 0x0016a5 thru 0x0103b0 (0xed0c bytes) 000233 1787570440.449025 read 0x00b77b thru 0x019da5 (0xe62b bytes) 000234 1787570440.478972 read 0x002d4e thru 0x003712 (0x9c5 bytes) 000235 1787570440.479785 write 0x02b531 thru 0x03a3f2 (0xeec2 bytes) 000237 1787570440.483856 read 0x00c873 thru 0x0106dd (0x3e6b bytes) 000238 1787570440.484751 write 0x025d45 thru 0x0318d5 (0xbb91 bytes) 000239 1787570440.500710 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a3f3): Mirror 4: 0x73b7a738 (stale) Mirror 7: 0x73b7a738 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3f3): Mirror 4: 0x73b7a738 (stale) Mirror 7: 0x73b7a738 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3f3: skipped 000243 1787570441.081588 write 0x00c15c thru 0x014df9 (0x8c9e bytes) 000244 1787570441.104618 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a3f3): Mirror 4: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3f3): Mirror 4: 0x73b7a738 (stale) Mirror 7: 0x73b7a738 (stale) CRC-32 checksum value for chunk [0, 0x3a3f3): Mirror 1: 0x8e218fef Mirror 8: 0x8e218fef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3f3: skipped 000245 1787570442.366586 trunc from 0x03a3f3 to 0x0184c0 (0x21f32 bytes) 000246 1787570442.487035 write 0x0113bc thru 0x016d29 (0x596e bytes) 000247 1787570442.503236 read 0x00565c thru 0x006291 (0xc36 bytes) 000248 1787570442.512461 mapwrite 0x0030a1 thru 0x00cce1 (0x9c41 bytes) 000251 1787570442.619891 read 0x015de1 thru 0x016ae1 (0xd01 bytes) 000252 1787570442.637258 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x184c1): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x184c1): Mirror 4: 0xbf87198 (stale) Mirror 7: 0xbf87198 (stale) Mirror 8: 0x26b0eac2 (stale) CRC-32 checksum value for chunk [0, 0x184c1): Mirror 1: 0x169223f2 Mirror 9: 0x169223f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x184c1: skipped 000254 1787570444.022588 mapread 0x013f2e thru 0x0184c0 (0x4593 bytes) 000256 1787570444.109206 trunc from 0x0184c1 to 0x0002a7 (0x18219 bytes) 000257 1787570444.205431 write 0x0389e2 thru 0x03ffff (0x761e bytes) 000259 1787570444.210101 write 0x00242a thru 0x00641c (0x3ff3 bytes) 000261 1787570444.226313 read 0x030810 thru 0x03c860 (0xc051 bytes) 000262 1787570444.243686 MIRROR_RESYNC 5 mirrors 000263 1787570446.114701 trunc from 0x040000 to 0x02dfdf (0x12020 bytes) 000264 1787570446.196185 mapwrite 0x022d59 thru 0x02e0bc (0xb364 bytes) 000265 1787570446.304279 mapread 0x022731 thru 0x024e2a (0x26fa bytes) 000266 1787570446.305298 read 0x01a986 thru 0x024e4a (0xa4c5 bytes) 000267 1787570446.318076 mapread 0x0199be thru 0x0201a2 (0x67e5 bytes) 000268 1787570446.332418 write 0x01b617 thru 0x01e396 (0x2d80 bytes) 000269 1787570446.334648 read 0x00c516 thru 0x01c163 (0xfc4e bytes) 000271 1787570446.344119 read 0x013d23 thru 0x023408 (0xf6e6 bytes) 000272 1787570446.354763 MIRROR_RESYNC 5 mirrors 000273 1787570447.423329 trunc from 0x02e0bd to 0x0263d2 (0x7cea bytes) 000276 1787570447.599599 write 0x0060b7 thru 0x009056 (0x2fa0 bytes) 000278 1787570447.615284 write 0x010911 thru 0x015e76 (0x5566 bytes) 000279 1787570447.627790 mapwrite 0x01d860 thru 0x01f5de (0x1d7f bytes) 000280 1787570447.698557 trunc from 0x0263d3 to 0x00e172 (0x18260 bytes) 000282 1787570447.733151 mapwrite 0x031c62 thru 0x03ffff (0xe39e bytes) 000283 1787570447.857110 write 0x00ac57 thru 0x00e162 (0x350c bytes) 000284 1787570447.866623 read 0x001276 thru 0x001b46 (0x8d1 bytes) 000285 1787570447.875616 read 0x0105a2 thru 0x0197e0 (0x923f bytes) 000287 1787570447.912754 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf1a7a64b (stale) Mirror 8: 0xf1a7a64b (stale) Mirror 9: 0xf1a7a64b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf1a7a64b (stale) Mirror 8: 0xf1a7a64b (stale) Mirror 9: 0xf1a7a64b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000288 1787570448.294531 mapwrite 0x009e56 thru 0x013de7 (0x9f92 bytes) 000289 1787570448.387950 read 0x0351a9 thru 0x035da0 (0xbf8 bytes) 000291 1787570448.399126 mapwrite 0x026b56 thru 0x02b235 (0x46e0 bytes) 000292 1787570448.514563 mapread 0x03e192 thru 0x03ffff (0x1e6e bytes) 000294 1787570448.528538 mapread 0x03e426 thru 0x03ef1c (0xaf7 bytes) 000295 1787570448.530433 read 0x00d38a thru 0x011f54 (0x4bcb bytes) 000296 1787570448.531689 mapwrite 0x026492 thru 0x034b69 (0xe6d8 bytes) 000297 1787570448.635898 write 0x02be6a thru 0x0380a7 (0xc23e bytes) 000300 1787570448.654959 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf1a7a64b (stale) Mirror 9: 0xf1a7a64b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf1a7a64b (stale) Mirror 9: 0xf1a7a64b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000301 1787570449.037210 mapread 0x0083bb thru 0x00b24a (0x2e90 bytes) 000302 1787570449.069069 trunc from 0x040000 to 0x023e96 (0x1c169 bytes) 000310 1787570449.131363 MIRROR_RESYNC 3 mirrors 000312 1787570450.025690 trunc from 0x023e97 to 0x02756d (0x36d7 bytes) 000313 1787570450.174650 trunc from 0x02756e to 0x009dbd (0x1d7b0 bytes) 000318 1787570450.224251 mapread 0x0039b2 thru 0x009dbd (0x640c bytes) 000319 1787570450.280019 mapread 0x003f3a thru 0x009dbd (0x5e84 bytes) 000322 1787570450.288369 read 0x0070b2 thru 0x00815b (0x10aa bytes) 000323 1787570450.289586 mapread 0x000a31 thru 0x004e68 (0x4438 bytes) 000324 1787570450.307625 mapwrite 0x018469 thru 0x0223d7 (0x9f6f bytes) 000325 1787570450.502261 read 0x01abd3 thru 0x01fd6c (0x519a bytes) 000326 1787570450.503035 trunc from 0x0223d8 to 0x023b04 (0x172d bytes) 000327 1787570450.544839 write 0x029100 thru 0x0306a5 (0x75a6 bytes) 000328 1787570450.550546 trunc from 0x0306a6 to 0x02ad70 (0x5935 bytes) 000330 1787570450.576013 trunc from 0x02ad71 to 0x030402 (0x5692 bytes) 000332 1787570450.596229 mapread 0x011990 thru 0x01a733 (0x8da4 bytes) 000334 1787570450.598729 read 0x021e26 thru 0x02fc0d (0xdde8 bytes) 000337 1787570450.618717 write 0x00d78f thru 0x01ba78 (0xe2ea bytes) 000340 1787570450.622309 write 0x035433 thru 0x03d67f (0x824d bytes) 000341 1787570450.628117 trunc from 0x03d680 to 0x00ba6b (0x31c14 bytes) 000343 1787570450.681515 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xba6c): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xba6c): Mirror 8: 0x9a2d78c (stale) Mirror 9: 0x9a2d78c (stale) CRC-32 checksum value for chunk [0, 0xba6c): Mirror 1: 0xb6d30616 Mirror 10: 0xb6d30616 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xba6c: skipped 000344 1787570451.830918 mapwrite 0x03e5e5 thru 0x03ffff (0x1a1b bytes) 000346 1787570451.985036 mapwrite 0x035df9 thru 0x03fa29 (0x9c31 bytes) 000348 1787570452.057321 write 0x0228c6 thru 0x02d960 (0xb09b bytes) 000351 1787570452.072162 MIRROR_RESYNC 4 mirrors 000352 1787570453.595155 read 0x029ec0 thru 0x039dfa (0xff3b bytes) 000353 1787570453.612169 trunc from 0x040000 to 0x017098 (0x28f67 bytes) 000355 1787570453.707194 MIRROR_RESYNC 4 mirrors 000356 1787570454.995812 mapread 0x00a23d thru 0x017098 (0xce5c bytes) 000357 1787570455.025129 MIRROR_EXTEND to 5 mirrors 000359 1787570455.823023 mapwrite 0x02d2e0 thru 0x036b79 (0x989a bytes) 000360 1787570456.052085 mapwrite 0x02821d thru 0x0311f7 (0x8fdb bytes) 000362 1787570456.094478 write 0x030044 thru 0x039efd (0x9eba bytes) 000364 1787570456.105829 mapread 0x034819 thru 0x039efd (0x56e5 bytes) 000365 1787570456.122649 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39efe): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39efe): Mirror 8: 0x93eca9ad (stale) Mirror 9: 0x93eca9ad (stale) Mirror 10: 0x93eca9ad (stale) Mirror 11: 0x93eca9ad (stale) CRC-32 checksum value for chunk [0, 0x39efe): Mirror 1: 0xc2876e71 Mirror 12: 0xc2876e71 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39efe: skipped 000367 1787570457.392800 mapwrite 0x02c3b6 thru 0x035275 (0x8ec0 bytes) 000369 1787570457.597101 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39efe): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39efe): Mirror 8: 0x93eca9ad (stale) Mirror 9: 0x93eca9ad (stale) Mirror 10: 0x93eca9ad (stale) Mirror 11: 0x93eca9ad (stale) Mirror 12: 0xc2876e71 (stale) CRC-32 checksum value for chunk [0, 0x39efe): Mirror 1: 0xeb7bad6e Mirror 13: 0xeb7bad6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39efe: skipped 000370 1787570458.781880 write 0x033db0 thru 0x03cc47 (0x8e98 bytes) 000371 1787570458.919357 mapread 0x037fd0 thru 0x03cc47 (0x4c78 bytes) 000376 1787570458.925028 trunc from 0x03cc48 to 0x01f576 (0x1d6d1 bytes) 000379 1787570458.954146 mapread 0x01b8fe thru 0x01dd66 (0x2469 bytes) 000381 1787570458.977064 MIRROR_RESYNC 7 mirrors 000385 1787570460.906114 trunc from 0x01f577 to 0x012916 (0xcc60 bytes) 000386 1787570460.995156 mapread 0x00e148 thru 0x012916 (0x47cf bytes) 000388 1787570461.031996 write 0x02ff30 thru 0x03f491 (0xf562 bytes) 000389 1787570461.044874 MIRROR_RESYNC 7 mirrors 000390 1787570463.481832 MIRROR_RESYNC 7 mirrors 000392 1787570464.059654 trunc from 0x03f492 to 0x0080bf (0x373d2 bytes) 000396 1787570464.143072 write 0x0173b8 thru 0x021e74 (0xaabd bytes) 000397 1787570464.145745 read 0x0019d5 thru 0x00c721 (0xad4d bytes) 000400 1787570464.157671 mapwrite 0x00a9be thru 0x00e46a (0x3aad bytes) 000404 1787570464.219516 mapread 0x0116c4 thru 0x01ce27 (0xb764 bytes) 000405 1787570464.233500 mapwrite 0x02be58 thru 0x03395f (0x7b08 bytes) 000407 1787570464.329250 mapwrite 0x020dfd thru 0x0234b9 (0x26bd bytes) 000408 1787570464.378694 write 0x0103d2 thru 0x019de8 (0x9a17 bytes) 000409 1787570464.381144 trunc from 0x033960 to 0x00bad8 (0x27e87 bytes) 000410 1787570464.419168 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xbad9): Mirror 8: 0xee4f9b30 (stale) Mirror 10: 0xee4f9b30 (stale) Mirror 11: 0xee4f9b30 (stale) Mirror 12: 0xee4f9b30 (stale) Mirror 13: 0xee4f9b30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbad9): Mirror 8: 0xee4f9b30 (stale) Mirror 10: 0xee4f9b30 (stale) Mirror 11: 0xee4f9b30 (stale) Mirror 12: 0xee4f9b30 (stale) Mirror 13: 0xee4f9b30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbad9: skipped 000411 1787570464.919815 mapwrite 0x03ddfb thru 0x03ffff (0x2205 bytes) 000412 1787570465.009619 trunc from 0x040000 to 0x01985b (0x267a4 bytes) 000414 1787570465.030218 read 0x009394 thru 0x015a50 (0xc6bd bytes) 000417 1787570465.048863 trunc from 0x01985c to 0x038471 (0x1ec16 bytes) 000418 1787570465.076096 read 0x023e2a thru 0x029316 (0x54ed bytes) 000420 1787570465.089704 mapread 0x0264ee thru 0x033a7a (0xd58d bytes) 000421 1787570465.090549 write 0x02439e thru 0x02a0f0 (0x5d53 bytes) 000422 1787570465.091340 mapread 0x0356a6 thru 0x036804 (0x115f bytes) 000423 1787570465.092825 read 0x009968 thru 0x011d9e (0x8437 bytes) 000425 1787570465.093940 mapwrite 0x01466e thru 0x01d9e5 (0x9378 bytes) 000430 1787570465.170126 trunc from 0x038472 to 0x003035 (0x3543c bytes) 000433 1787570465.206801 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3036): Mirror 10: 0x8ca21a3a (stale) Mirror 11: 0x8ca21a3a (stale) Mirror 12: 0x8ca21a3a (stale) Mirror 13: 0x8ca21a3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3036): Mirror 10: 0x8ca21a3a (stale) Mirror 11: 0x8ca21a3a (stale) Mirror 12: 0x8ca21a3a (stale) Mirror 13: 0x8ca21a3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3036: skipped 000438 1787570465.689154 read 0x0016c6 thru 0x003035 (0x1970 bytes) 000440 1787570465.701324 write 0x00a2ef thru 0x0160e2 (0xbdf4 bytes) 000441 1787570465.705670 read 0x00041a thru 0x0062b3 (0x5e9a bytes) 000442 1787570465.729029 trunc from 0x0160e3 to 0x03ad52 (0x24c70 bytes) 000443 1787570465.763982 mapread 0x016fd8 thru 0x01f385 (0x83ae bytes) 000444 1787570465.781584 write 0x028745 thru 0x02edb8 (0x6674 bytes) 000445 1787570465.798246 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ad53): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad53): Mirror 10: 0x773aa8d9 (stale) Mirror 11: 0x773aa8d9 (stale) Mirror 12: 0x773aa8d9 (stale) Mirror 13: 0x773aa8d9 (stale) CRC-32 checksum value for chunk [0, 0x3ad53): Mirror 1: 0xf7ffbed9 Mirror 14: 0xf7ffbed9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad53: skipped 000446 1787570467.225783 mapwrite 0x03a096 thru 0x03ffff (0x5f6a bytes) 000449 1787570467.439937 mapread 0x026ae8 thru 0x027a10 (0xf29 bytes) 000451 1787570467.452058 trunc from 0x040000 to 0x01a3f7 (0x25c08 bytes) 000452 1787570467.526066 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1a3f8): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a3f8): Mirror 10: 0x57ee928 (stale) Mirror 11: 0x57ee928 (stale) Mirror 12: 0x57ee928 (stale) Mirror 13: 0x57ee928 (stale) Mirror 14: 0x8e6f4be2 (stale) CRC-32 checksum value for chunk [0, 0x1a3f8): Mirror 1: 0x8e6f4be2 Mirror 15: 0x8e6f4be2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a3f8: skipped 000453 1787570468.914860 write 0x013e53 thru 0x023628 (0xf7d6 bytes) 000455 1787570469.039988 mapwrite 0x02b294 thru 0x038364 (0xd0d1 bytes) 000456 1787570469.256836 write 0x00e7ce thru 0x017eb6 (0x96e9 bytes) 000460 1787570469.267884 mapwrite 0x01dfc8 thru 0x02cd86 (0xedbf bytes) 000461 1787570469.348958 trunc from 0x038365 to 0x01ccd7 (0x1b68d bytes) 000462 1787570469.405151 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ccd8): Mirror 11: 0xe523ac88 (stale) Mirror 12: 0xe523ac88 (stale) Mirror 13: 0xe523ac88 (stale) Mirror 14: 0x3ef05254 (stale) Mirror 15: 0x3ef05254 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ccd8): Mirror 11: 0xe523ac88 (stale) Mirror 12: 0xe523ac88 (stale) Mirror 13: 0xe523ac88 (stale) Mirror 14: 0x3ef05254 (stale) Mirror 15: 0x3ef05254 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ccd8: skipped 000463 1787570470.039193 read 0x003c05 thru 0x00f3ea (0xb7e6 bytes) 000467 1787570470.085063 MIRROR_RESYNC 6 mirrors 000469 1787570471.742663 mapwrite 0x0075d6 thru 0x012e04 (0xb82f bytes) 000470 1787570471.905944 read 0x014113 thru 0x018d5b (0x4c49 bytes) 000471 1787570471.907552 write 0x005ae0 thru 0x008336 (0x2857 bytes) 000473 1787570471.909861 mapwrite 0x0321e6 thru 0x03c9f2 (0xa80d bytes) 000474 1787570471.995818 mapwrite 0x026f76 thru 0x02b69f (0x472a bytes) 000476 1787570472.062490 read 0x01d8b1 thru 0x01e346 (0xa96 bytes) 000477 1787570472.072872 write 0x000f05 thru 0x0047cf (0x38cb bytes) 000478 1787570472.074201 read 0x030c76 thru 0x0344dc (0x3867 bytes) 000482 1787570472.077661 write 0x03bfc2 thru 0x03ffff (0x403e bytes) 000483 1787570472.079076 write 0x0029e0 thru 0x00a80b (0x7e2c bytes) 000485 1787570472.081490 read 0x03eaa1 thru 0x03ffff (0x155f bytes) 000486 1787570472.082107 mapwrite 0x01691b thru 0x01d6eb (0x6dd1 bytes) 000491 1787570472.137867 mapread 0x028979 thru 0x0384e0 (0xfb68 bytes) 000492 1787570472.142266 trunc from 0x040000 to 0x00e1ab (0x31e54 bytes) 000493 1787570472.184815 MIRROR_RESYNC 6 mirrors 000494 1787570473.657886 write 0x0354bc thru 0x03bc2c (0x6771 bytes) 000495 1787570473.752082 mapwrite 0x03bd41 thru 0x03ffff (0x42bf bytes) 000496 1787570473.863076 mapread 0x0158ce thru 0x0163c2 (0xaf5 bytes) 000497 1787570473.875240 read 0x017865 thru 0x01b935 (0x40d1 bytes) 000499 1787570473.876588 trunc from 0x040000 to 0x002245 (0x3ddba bytes) 000500 1787570473.913877 MIRROR_RESYNC 6 mirrors 000502 1787570475.029730 write 0x019b32 thru 0x01e79d (0x4c6c bytes) 000503 1787570475.105026 read 0x007dcb thru 0x00cbac (0x4de2 bytes) 000506 1787570475.116595 write 0x035932 thru 0x038024 (0x26f3 bytes) 000508 1787570475.118168 trunc from 0x038025 to 0x00bb6f (0x2c4b5 bytes) 000509 1787570475.134995 read 0x00891e thru 0x00bb6f (0x3252 bytes) 000512 1787570475.136572 trunc from 0x00bb70 to 0x016c31 (0xb0c2 bytes) 000513 1787570475.154164 write 0x035af5 thru 0x03ffff (0xa50b bytes) 000515 1787570475.164029 read 0x02f5e9 thru 0x030149 (0xb61 bytes) 000519 1787570475.184196 write 0x037e4d thru 0x03ffff (0x81b3 bytes) 000523 1787570475.192198 mapwrite 0x02712e thru 0x02e061 (0x6f34 bytes) 000524 1787570475.296233 read 0x033b25 thru 0x03d7c6 (0x9ca2 bytes) 000525 1787570475.296904 read 0x0007fa thru 0x001610 (0xe17 bytes) 000526 1787570475.297432 write 0x0137ce thru 0x01c895 (0x90c8 bytes) 000527 1787570475.298515 write 0x00625a thru 0x007f53 (0x1cfa bytes) 000528 1787570475.299289 write 0x024c63 thru 0x02f4f4 (0xa892 bytes) 000531 1787570475.305478 write 0x00bf6d thru 0x0185a8 (0xc63c bytes) 000532 1787570475.308501 mapread 0x033e35 thru 0x03ffff (0xc1cb bytes) 000534 1787570475.316629 mapwrite 0x01d03c thru 0x025b2a (0x8aef bytes) 000536 1787570475.418914 MIRROR_RESYNC 6 mirrors 000538 1787570476.717413 trunc from 0x040000 to 0x01a24f (0x25db0 bytes) 000539 1787570476.798862 trunc from 0x01a250 to 0x02dbf8 (0x139a9 bytes) 000542 1787570476.825799 mapwrite 0x021796 thru 0x022e61 (0x16cc bytes) 000544 1787570476.902684 trunc from 0x02dbf9 to 0x031fb2 (0x43ba bytes) 000545 1787570476.947627 mapwrite 0x006ce5 thru 0x01548c (0xe7a8 bytes) 000546 1787570477.091746 MIRROR_RESYNC 6 mirrors 000547 1787570478.649865 trunc from 0x031fb3 to 0x01dc0f (0x143a3 bytes) 000548 1787570478.764603 trunc from 0x01dc10 to 0x01ef41 (0x1332 bytes) 000549 1787570478.798199 MIRROR_RESYNC 6 mirrors 000550 1787570480.158593 MIRROR_EXTEND to 7 mirrors 000552 1787570480.934749 read 0x002dde thru 0x00b9eb (0x8c0e bytes) 000553 1787570480.945747 mapwrite 0x03b008 thru 0x03b00e (0x7 bytes) 000555 1787570481.117513 write 0x03c074 thru 0x03ffff (0x3f8c bytes) 000556 1787570481.118737 trunc from 0x040000 to 0x011185 (0x2ee7a bytes) 000558 1787570481.147650 mapwrite 0x01012b thru 0x010d5a (0xc30 bytes) 000560 1787570481.195364 mapwrite 0x015c4e thru 0x01c1a7 (0x655a bytes) 000565 1787570481.398951 trunc from 0x01c1a8 to 0x03aa59 (0x1e8b2 bytes) 000566 1787570481.423932 trunc from 0x03aa5a to 0x0144ed (0x2656c bytes) 000567 1787570481.458063 mapwrite 0x01f31e thru 0x022cca (0x39ad bytes) 000568 1787570481.587556 mapread 0x00b063 thru 0x00d73c (0x26da bytes) 000569 1787570481.610896 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x22ccb): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22ccb): Mirror 11: 0xdc4e9629 (stale) Mirror 12: 0xdc4e9629 (stale) Mirror 13: 0xdc4e9629 (stale) Mirror 14: 0xdc4e9629 (stale) Mirror 15: 0xdc4e9629 (stale) Mirror 16: 0xdc4e9629 (stale) CRC-32 checksum value for chunk [0, 0x22ccb): Mirror 1: 0x5e943aac Mirror 17: 0x5e943aac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22ccb: skipped 000572 1787570482.619706 read 0x01542f thru 0x01d39d (0x7f6f bytes) 000573 1787570482.632195 mapwrite 0x03f73a thru 0x03ffff (0x8c6 bytes) 000574 1787570482.787714 mapwrite 0x02325c thru 0x02f245 (0xbfea bytes) 000575 1787570482.880759 mapwrite 0x036570 thru 0x037a7b (0x150c bytes) 000578 1787570482.959162 read 0x00aaa9 thru 0x0161d1 (0xb729 bytes) 000579 1787570482.978516 trunc from 0x040000 to 0x02bcdb (0x14324 bytes) 000580 1787570483.026560 mapwrite 0x03ab44 thru 0x03ffff (0x54bc bytes) 000581 1787570483.138635 write 0x014833 thru 0x020e2d (0xc5fb bytes) 000584 1787570483.142184 read 0x00545b thru 0x0146e3 (0xf289 bytes) 000585 1787570483.147153 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xb902d3f2 (stale) Mirror 12: 0xb902d3f2 (stale) Mirror 13: 0xb902d3f2 (stale) Mirror 14: 0xb902d3f2 (stale) Mirror 15: 0xb902d3f2 (stale) Mirror 16: 0xb902d3f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xb902d3f2 (stale) Mirror 12: 0xb902d3f2 (stale) Mirror 13: 0xb902d3f2 (stale) Mirror 14: 0xb902d3f2 (stale) Mirror 15: 0xb902d3f2 (stale) Mirror 16: 0xb902d3f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000586 1787570483.750661 write 0x0281d4 thru 0x02f02b (0x6e58 bytes) 000587 1787570483.768663 mapwrite 0x0204b7 thru 0x020b51 (0x69b bytes) 000593 1787570483.840367 mapwrite 0x0205d1 thru 0x0291fa (0x8c2a bytes) 000597 1787570483.903196 write 0x015846 thru 0x01f779 (0x9f34 bytes) 000599 1787570483.909672 read 0x034acc thru 0x034bd1 (0x106 bytes) 000600 1787570483.918244 mapread 0x034c0d thru 0x03fc3c (0xb030 bytes) 000602 1787570483.945483 read 0x02425d thru 0x0297be (0x5562 bytes) 000604 1787570483.946666 read 0x02ca3e thru 0x03b07d (0xe640 bytes) 000608 1787570483.961055 mapread 0x022e45 thru 0x02675e (0x391a bytes) 000609 1787570483.962177 trunc from 0x040000 to 0x011354 (0x2ecab bytes) 000615 1787570483.997313 write 0x03bd9b thru 0x03ffff (0x4265 bytes) 000618 1787570484.001185 write 0x03cad9 thru 0x03e060 (0x1588 bytes) 000619 1787570484.002701 mapwrite 0x02c503 thru 0x03b044 (0xeb42 bytes) 000620 1787570484.058676 trunc from 0x040000 to 0x019f85 (0x2607a bytes) 000621 1787570484.078541 read 0x014a2a thru 0x019f85 (0x555c bytes) 000623 1787570484.079909 mapwrite 0x01e36b thru 0x023007 (0x4c9d bytes) 000625 1787570484.159715 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23008): Mirror 11: 0x3b936bcb (stale) Mirror 12: 0x3b936bcb (stale) Mirror 13: 0x3b936bcb (stale) Mirror 14: 0x3b936bcb (stale) Mirror 16: 0x3b936bcb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23008): Mirror 11: 0x3b936bcb (stale) Mirror 12: 0x3b936bcb (stale) Mirror 13: 0x3b936bcb (stale) Mirror 14: 0x3b936bcb (stale) Mirror 16: 0x3b936bcb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23008: skipped 000626 1787570484.645134 mapwrite 0x009623 thru 0x01333f (0x9d1d bytes) 000627 1787570484.755438 mapread 0x016715 thru 0x018303 (0x1bef bytes) 000630 1787570484.802065 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x23008): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23008): Mirror 11: 0x3b936bcb (stale) Mirror 12: 0x3b936bcb (stale) Mirror 13: 0x3b936bcb (stale) Mirror 14: 0x3b936bcb (stale) Mirror 16: 0x3b936bcb (stale) CRC-32 checksum value for chunk [0, 0x23008): Mirror 1: 0xbd6778c9 Mirror 17: 0xbd6778c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23008: skipped 000631 1787570486.015770 mapwrite 0x00a301 thru 0x010f12 (0x6c12 bytes) 000632 1787570486.255355 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23008): Mirror 11: 0x3b936bcb (stale) Mirror 12: 0x3b936bcb (stale) Mirror 14: 0x3b936bcb (stale) Mirror 16: 0x3b936bcb (stale) Mirror 17: 0xbd6778c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23008): Mirror 11: 0x3b936bcb (stale) Mirror 12: 0x3b936bcb (stale) Mirror 14: 0x3b936bcb (stale) Mirror 16: 0x3b936bcb (stale) Mirror 17: 0xbd6778c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23008: skipped 000633 1787570486.910067 write 0x035be1 thru 0x03ffff (0xa41f bytes) 000634 1787570486.914551 read 0x02b943 thru 0x02ba6c (0x12a bytes) 000635 1787570486.922831 mapread 0x00c834 thru 0x01829f (0xba6c bytes) 000636 1787570486.992739 trunc from 0x040000 to 0x029f43 (0x160bc bytes) 000637 1787570487.011763 trunc from 0x029f44 to 0x0101ae (0x19d95 bytes) 000638 1787570487.065008 mapwrite 0x030c03 thru 0x03ffff (0xf3fd bytes) 000639 1787570487.196861 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xb902d3f2 (stale) Mirror 14: 0xb902d3f2 (stale) Mirror 16: 0xb902d3f2 (stale) Mirror 17: 0x2cd19fd3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xb902d3f2 (stale) Mirror 14: 0xb902d3f2 (stale) Mirror 16: 0xb902d3f2 (stale) Mirror 17: 0x2cd19fd3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000640 1787570487.965673 write 0x033d89 thru 0x03ffff (0xc277 bytes) 000641 1787570487.982746 write 0x012a8a thru 0x018c87 (0x61fe bytes) 000643 1787570488.021576 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xb902d3f2 (stale) Mirror 16: 0xb902d3f2 (stale) Mirror 17: 0x2cd19fd3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xb902d3f2 (stale) Mirror 16: 0xb902d3f2 (stale) Mirror 17: 0x2cd19fd3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000644 1787570488.571182 mapread 0x038f7d thru 0x039126 (0x1aa bytes) 000646 1787570488.613622 MIRROR_RESYNC 4 mirrors 000647 1787570490.192967 MIRROR_EXTEND to 5 mirrors 000649 1787570491.129542 MIRROR_RESYNC 5 mirrors 000650 1787570491.802935 mapread 0x008c95 thru 0x00df00 (0x526c bytes) 000651 1787570491.848272 read 0x0063c7 thru 0x00c817 (0x6451 bytes) 000653 1787570491.848977 mapread 0x0106b2 thru 0x019c32 (0x9581 bytes) 000655 1787570491.859645 read 0x02d94a thru 0x030ad0 (0x3187 bytes) 000656 1787570491.877167 mapread 0x02d2ad thru 0x02d741 (0x495 bytes) 000657 1787570491.885145 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000658 1787570492.448141 read 0x00b898 thru 0x01b438 (0xfba1 bytes) 000659 1787570492.460675 write 0x00b390 thru 0x017fc3 (0xcc34 bytes) 000660 1787570492.606880 write 0x01f9a8 thru 0x021a6e (0x20c7 bytes) 000666 1787570492.643328 mapwrite 0x02f51b thru 0x038ee6 (0x99cc bytes) 000667 1787570492.816209 MIRROR_RESYNC 4 mirrors 000668 1787570494.167735 read 0x036e7e thru 0x03ffff (0x9182 bytes) 000669 1787570494.183727 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000671 1787570494.808203 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) 000672 1787570495.220644 trunc from 0x040000 to 0x02acb7 (0x15348 bytes) 000674 1787570495.291707 mapwrite 0x012a67 thru 0x01f7db (0xcd75 bytes) 000675 1787570495.393430 trunc from 0x02acb8 to 0x02cae5 (0x1e2e bytes) 000676 1787570495.432532 read 0x01c88a thru 0x027135 (0xa8ac bytes) 000677 1787570495.453717 mapwrite 0x01ae41 thru 0x02726a (0xc42a bytes) 000678 1787570495.539759 trunc from 0x02cae6 to 0x00b7fa (0x212eb bytes) 000679 1787570495.584757 mapread 0x00a7ed thru 0x00b7fa (0x100e bytes) 000680 1787570495.601526 trunc from 0x00b7fb to 0x0380a9 (0x2c8af bytes) 000681 1787570495.649849 read 0x0186a8 thru 0x019cf6 (0x164f bytes) 000682 1787570495.690757 write 0x038a94 thru 0x03a32f (0x189c bytes) 000685 1787570495.692932 mapwrite 0x02a53a thru 0x02e0ae (0x3b75 bytes) 000687 1787570495.740117 mapwrite 0x039b48 thru 0x03ffff (0x64b8 bytes) 000688 1787570495.844470 mapread 0x02444c thru 0x027a41 (0x35f6 bytes) 000689 1787570495.845568 read 0x0200cb thru 0x027ff7 (0x7f2d bytes) 000690 1787570495.846092 mapwrite 0x027bf1 thru 0x029130 (0x1540 bytes) 000691 1787570495.920491 trunc from 0x040000 to 0x031c7e (0xe381 bytes) 000695 1787570495.937598 mapread 0x020846 thru 0x0244fc (0x3cb7 bytes) 000696 1787570495.938868 trunc from 0x031c7f to 0x03683a (0x4bbc bytes) 000700 1787570495.962703 trunc from 0x03683b to 0x032c92 (0x3ba8 bytes) 000703 1787570495.983903 read 0x02b4df thru 0x02ec60 (0x3782 bytes) 000704 1787570495.995788 MIRROR_RESYNC 2 mirrors 000705 1787570496.957821 mapread 0x0027fd thru 0x00744e (0x4c52 bytes) 000706 1787570496.981166 write 0x031159 thru 0x03d547 (0xc3ef bytes) 000707 1787570497.065243 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d548): Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d548): Mirror 14: 0x98167a87 (stale) CRC-32 checksum value for chunk [0, 0x3d548): Mirror 1: 0xace2a053 Mirror 15: 0xace2a053 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d548: skipped 000709 1787570498.285194 write 0x03cf40 thru 0x03ffff (0x30c0 bytes) 000710 1787570498.452611 trunc from 0x040000 to 0x01341a (0x2cbe5 bytes) 000711 1787570498.480537 trunc from 0x01341b to 0x032590 (0x1f176 bytes) 000712 1787570498.520262 write 0x02698b thru 0x035e65 (0xf4db bytes) 000714 1787570498.536184 read 0x028398 thru 0x035169 (0xcdd2 bytes) 000715 1787570498.537427 mapread 0x029ca0 thru 0x0327e7 (0x8b48 bytes) 000717 1787570498.540780 mapread 0x01a245 thru 0x025f72 (0xbd2e bytes) 000718 1787570498.602210 write 0x025cdc thru 0x029cac (0x3fd1 bytes) 000719 1787570498.610450 mapwrite 0x03e0c7 thru 0x03ffff (0x1f39 bytes) 000720 1787570498.744209 write 0x03f779 thru 0x03ffff (0x887 bytes) 000721 1787570498.747804 trunc from 0x040000 to 0x00e9fd (0x31602 bytes) 000722 1787570498.771760 mapwrite 0x00b233 thru 0x011042 (0x5e10 bytes) 000723 1787570498.867579 mapread 0x0099b8 thru 0x011042 (0x768b bytes) 000725 1787570498.875721 read 0x00610f thru 0x006a82 (0x974 bytes) 000728 1787570498.879825 read 0x00aa96 thru 0x011042 (0x65ad bytes) 000731 1787570498.883006 read 0x007018 thru 0x011042 (0xa02b bytes) 000732 1787570498.884064 read 0x009293 thru 0x00f408 (0x6176 bytes) 000733 1787570498.885065 mapread 0x00b2cf thru 0x00f259 (0x3f8b bytes) 000734 1787570498.886186 trunc from 0x011043 to 0x013670 (0x262e bytes) 000735 1787570498.903775 write 0x007487 thru 0x009680 (0x21fa bytes) 000736 1787570498.916880 read 0x002ffc thru 0x005598 (0x259d bytes) 000739 1787570498.935323 write 0x01f61a thru 0x026fbd (0x79a4 bytes) 000740 1787570498.937270 write 0x03c0c2 thru 0x03ffff (0x3f3e bytes) 000742 1787570498.939819 mapread 0x00cadd thru 0x015913 (0x8e37 bytes) 000743 1787570498.956671 mapwrite 0x03f434 thru 0x03ffff (0xbcc bytes) 000744 1787570499.016583 trunc from 0x040000 to 0x02f960 (0x1069f bytes) 000745 1787570499.053626 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2f961): Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f961): Mirror 14: 0x9f0fadb4 (stale) Mirror 15: 0x9f0fadb4 (stale) CRC-32 checksum value for chunk [0, 0x2f961): Mirror 1: 0x5a8c535 Mirror 16: 0x5a8c535 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f961: skipped 000748 1787570500.228019 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f961): Mirror 14: 0x9f0fadb4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f961): Mirror 14: 0x9f0fadb4 (stale) CRC-32 checksum value for chunk [0, 0x2f961): Mirror 1: 0x5a8c535 Mirror 16: 0x5a8c535 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f961: skipped 000749 1787570501.016652 mapwrite 0x023e12 thru 0x02470a (0x8f9 bytes) 000750 1787570501.287479 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f961): Mirror 16: 0x5a8c535 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f961): Mirror 16: 0x5a8c535 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f961: skipped 000753 1787570501.679794 read 0x025c36 thru 0x02e192 (0x855d bytes) 000754 1787570501.694372 mapread 0x02d9aa thru 0x02f960 (0x1fb7 bytes) 000756 1787570501.708572 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f961): Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f961): Mirror 16: 0x5a8c535 (stale) CRC-32 checksum value for chunk [0, 0x2f961): Mirror 1: 0x67fdecfc Mirror 17: 0x67fdecfc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f961: skipped 000757 1787570502.816672 mapwrite 0x01bae4 thru 0x021572 (0x5a8f bytes) 000759 1787570503.031639 trunc from 0x02f961 to 0x00624e (0x29712 bytes) 000761 1787570503.068290 trunc from 0x00624f to 0x01aedd (0x14c8f bytes) 000762 1787570503.084694 write 0x024c2f thru 0x03078e (0xbb60 bytes) 000763 1787570503.086045 trunc from 0x03078f to 0x0302e3 (0x4ab bytes) 000764 1787570503.102286 mapread 0x00b04c thru 0x0108d7 (0x588c bytes) 000765 1787570503.114854 trunc from 0x0302e4 to 0x025005 (0xb2de bytes) 000766 1787570503.135040 write 0x011fd0 thru 0x01fc7d (0xdcae bytes) 000767 1787570503.149053 MIRROR_RESYNC 3 mirrors 000768 1787570504.349747 trunc from 0x025006 to 0x00fe4b (0x151ba bytes) 000770 1787570504.447166 mapread 0x005a68 thru 0x00fe4b (0xa3e4 bytes) 000771 1787570504.476949 trunc from 0x00fe4c to 0x03a983 (0x2ab38 bytes) 000772 1787570504.510697 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a984): Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a984): Mirror 16: 0x7f4ba2da (stale) Mirror 17: 0x7f4ba2da (stale) CRC-32 checksum value for chunk [0, 0x3a984): Mirror 1: 0x52521ccb Mirror 18: 0x52521ccb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a984: skipped 000773 1787570506.036194 trunc from 0x03a984 to 0x021fb8 (0x189cb bytes) 000774 1787570506.226281 trunc from 0x021fb9 to 0x011523 (0x10a95 bytes) 000775 1787570506.278743 mapwrite 0x0169b6 thru 0x0252b2 (0xe8fd bytes) 000776 1787570506.473006 read 0x00044c thru 0x00c425 (0xbfda bytes) 000783 1787570506.492472 trunc from 0x0252b3 to 0x006b97 (0x1e71b bytes) 000784 1787570506.510441 write 0x03125f thru 0x03484e (0x35f0 bytes) 000785 1787570506.511800 write 0x008901 thru 0x009542 (0xc42 bytes) 000787 1787570506.522198 mapwrite 0x03d15a thru 0x03ffff (0x2ea6 bytes) 000788 1787570506.646323 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x74276bab (stale) Mirror 17: 0x74276bab (stale) Mirror 18: 0xf5d5e2a3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x418add59 Mirror 19: 0x418add59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000790 1787570508.535683 write 0x03e322 thru 0x03ffff (0x1cde bytes) 000791 1787570508.695346 read 0x00161f thru 0x007df8 (0x67da bytes) 000792 1787570508.705161 trunc from 0x040000 to 0x025e33 (0x1a1cc bytes) 000793 1787570508.730553 trunc from 0x025e34 to 0x009a3b (0x1c3f8 bytes) 000794 1787570508.745627 mapwrite 0x017450 thru 0x01b564 (0x4115 bytes) 000796 1787570508.941330 read 0x001d02 thru 0x002ae4 (0xde3 bytes) 000797 1787570508.942612 read 0x000936 thru 0x004b72 (0x423d bytes) 000798 1787570508.953586 read 0x010345 thru 0x018fb8 (0x8c74 bytes) 000801 1787570508.961532 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b565): Mirror 16: 0xaadada53 (stale) Mirror 17: 0xaadada53 (stale) Mirror 18: 0x928bca19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b565): Mirror 16: 0xaadada53 (stale) Mirror 17: 0xaadada53 (stale) Mirror 18: 0x928bca19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b565: skipped 000803 1787570509.722793 read 0x01237e thru 0x018c59 (0x68dc bytes) 000804 1787570509.771069 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b565): Mirror 17: 0xaadada53 (stale) Mirror 18: 0x928bca19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b565): Mirror 17: 0xaadada53 (stale) Mirror 18: 0x928bca19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b565: skipped 000805 1787570510.287051 read 0x008926 thru 0x016ab2 (0xe18d bytes) 000806 1787570510.300814 trunc from 0x01b565 to 0x01641a (0x514a bytes) 000807 1787570510.341537 mapwrite 0x02bdf4 thru 0x02ca69 (0xc76 bytes) 000808 1787570510.435272 trunc from 0x02ca6a to 0x00328c (0x297dd bytes) 000810 1787570510.457810 mapwrite 0x00430f thru 0x012f87 (0xec79 bytes) 000811 1787570510.535297 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12f88): Mirror 18: 0xdd2dccc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12f88): Mirror 18: 0xdd2dccc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12f88: skipped 000812 1787570510.863232 read 0x0093ca thru 0x012dc5 (0x99fc bytes) 000813 1787570510.893629 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x12f88): Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12f88): Mirror 18: 0xdd2dccc1 (stale) CRC-32 checksum value for chunk [0, 0x12f88): Mirror 1: 0xe6220fc9 Mirror 19: 0xe6220fc9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12f88: skipped 000814 1787570512.031087 mapread 0x002300 thru 0x003f1b (0x1c1c bytes) 000815 1787570512.086336 read 0x006ea9 thru 0x00e042 (0x719a bytes) 000816 1787570512.104145 mapwrite 0x0257db thru 0x025962 (0x188 bytes) 000817 1787570512.287784 trunc from 0x025963 to 0x01cc4f (0x8d13 bytes) 000818 1787570512.328764 trunc from 0x01cc50 to 0x00216d (0x1aae2 bytes) 000819 1787570512.357699 mapread 0x001b9c thru 0x00216d (0x5d2 bytes) 000821 1787570512.373723 trunc from 0x00216e to 0x01469a (0x1252d bytes) 000822 1787570512.407823 mapwrite 0x030e30 thru 0x03458a (0x375b bytes) 000823 1787570512.558661 mapwrite 0x015ea6 thru 0x01c2b2 (0x640d bytes) 000825 1787570512.685438 write 0x03f668 thru 0x03ffff (0x998 bytes) 000826 1787570512.686781 mapread 0x01d142 thru 0x01f6aa (0x2569 bytes) 000829 1787570512.709132 write 0x00796d thru 0x00ed81 (0x7415 bytes) 000830 1787570512.719616 mapwrite 0x02383c thru 0x02daa2 (0xa267 bytes) 000831 1787570512.880433 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x10bf1f81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x10bf1f81 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000832 1787570513.404837 mapwrite 0x00cba4 thru 0x01a0e3 (0xd540 bytes) 000834 1787570513.510017 mapwrite 0x02b61b thru 0x03a384 (0xed6a bytes) 000836 1787570513.602807 read 0x026532 thru 0x02ddba (0x7889 bytes) 000837 1787570513.604147 mapread 0x010958 thru 0x0130eb (0x2794 bytes) 000838 1787570513.606093 trunc from 0x040000 to 0x0044a8 (0x3bb57 bytes) 000840 1787570513.634758 mapread 0x00226e thru 0x003ed9 (0x1c6c bytes) 000842 1787570513.643306 mapwrite 0x015831 thru 0x01f537 (0x9d07 bytes) 000846 1787570513.761533 write 0x016d4c thru 0x01b6af (0x4964 bytes) 000847 1787570513.763517 read 0x017a40 thru 0x01f537 (0x7af8 bytes) 000852 1787570513.767627 mapread 0x014c7b thru 0x01f537 (0xa8bd bytes) 000853 1787570513.768799 mapread 0x009d84 thru 0x018f90 (0xf20d bytes) 000855 1787570513.781219 write 0x02366c thru 0x02caf8 (0x948d bytes) 000858 1787570513.784590 mapwrite 0x02545a thru 0x032a2d (0xd5d4 bytes) 000859 1787570513.894060 mapread 0x00224c thru 0x00390a (0x16bf bytes) 000860 1787570513.914704 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x32a2e): Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a2e): Mirror 19: 0x780a8d83 (stale) CRC-32 checksum value for chunk [0, 0x32a2e): Mirror 1: 0x9a57ce11 Mirror 20: 0x9a57ce11 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a2e: skipped 000862 1787570515.322661 trunc from 0x032a2e to 0x00673d (0x2c2f0 bytes) 000863 1787570515.479023 read 0x0012de thru 0x00187c (0x59f bytes) 000864 1787570515.488459 trunc from 0x00673e to 0x0379cf (0x31292 bytes) 000865 1787570515.514428 mapread 0x00470c thru 0x00e03c (0x9931 bytes) 000866 1787570515.535576 write 0x0012d5 thru 0x008271 (0x6f9d bytes) 000867 1787570515.537097 read 0x02342c thru 0x0241cf (0xda4 bytes) 000868 1787570515.564109 MIRROR_RESYNC 3 mirrors 000870 1787570516.874172 write 0x005aaf thru 0x005cad (0x1ff bytes) 000871 1787570517.018123 mapread 0x009dce thru 0x019ac6 (0xfcf9 bytes) 000873 1787570517.069873 write 0x021843 thru 0x02d72d (0xbeeb bytes) 000882 1787570517.107289 trunc from 0x0379d0 to 0x01237f (0x25650 bytes) 000883 1787570517.164065 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x12380): Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12380): Mirror 19: 0xb72b868f (stale) Mirror 20: 0xb72b868f (stale) CRC-32 checksum value for chunk [0, 0x12380): Mirror 1: 0xc031e797 Mirror 21: 0xc031e797 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12380: skipped 000884 1787570519.314689 read 0x011430 thru 0x01237f (0xf50 bytes) 000885 1787570519.330822 mapwrite 0x03d1c7 thru 0x03ffff (0x2e39 bytes) 000886 1787570519.506321 mapwrite 0x0193a4 thru 0x01ae8e (0x1aeb bytes) 000887 1787570519.566455 read 0x0264f5 thru 0x02da73 (0x757f bytes) 000888 1787570519.575932 mapwrite 0x0378b4 thru 0x03dbc4 (0x6311 bytes) 000891 1787570519.620163 write 0x017547 thru 0x025148 (0xdc02 bytes) 000892 1787570519.621440 trunc from 0x040000 to 0x033d49 (0xc2b6 bytes) 000894 1787570519.642713 mapwrite 0x03198d thru 0x0328ce (0xf42 bytes) 000895 1787570519.705274 write 0x0139b3 thru 0x01b802 (0x7e50 bytes) 000896 1787570519.711517 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33d4a): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d4a): Mirror 19: 0xebbe9d73 (stale) Mirror 20: 0xebbe9d73 (stale) Mirror 21: 0x887faf67 (stale) CRC-32 checksum value for chunk [0, 0x33d4a): Mirror 1: 0x9660276f Mirror 22: 0x9660276f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d4a: skipped 000898 1787570520.504816 mapwrite 0x01771c thru 0x01d8f6 (0x61db bytes) 000900 1787570520.709579 write 0x00f6d5 thru 0x01807c (0x89a8 bytes) 000901 1787570520.715237 write 0x019c10 thru 0x02177d (0x7b6e bytes) 000903 1787570520.720257 mapread 0x001365 thru 0x009702 (0x839e bytes) 000906 1787570520.730943 mapread 0x01a39c thru 0x01ae50 (0xab5 bytes) 000907 1787570520.731884 write 0x021745 thru 0x023936 (0x21f2 bytes) 000908 1787570520.736514 read 0x00e35e thru 0x01b51a (0xd1bd bytes) 000911 1787570520.738131 trunc from 0x033d4a to 0x0223e3 (0x11966 bytes) 000913 1787570520.760984 write 0x014994 thru 0x01bd28 (0x7395 bytes) 000916 1787570520.764078 read 0x02009e thru 0x0223e3 (0x2346 bytes) 000918 1787570520.769056 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x223e4): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x223e4): Mirror 19: 0xf5cce481 (stale) Mirror 20: 0xf5cce481 (stale) Mirror 21: 0xee9cdc35 (stale) Mirror 22: 0xdbe9f3bb (stale) CRC-32 checksum value for chunk [0, 0x223e4): Mirror 1: 0x229c7fb7 Mirror 23: 0x229c7fb7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x223e4: skipped 000919 1787570522.293583 trunc from 0x0223e4 to 0x007db2 (0x1a631 bytes) 000920 1787570522.491122 trunc from 0x007db3 to 0x01c3d2 (0x14620 bytes) 000922 1787570522.525862 mapread 0x019688 thru 0x01c3d2 (0x2d4b bytes) 000923 1787570522.559232 mapread 0x00f59c thru 0x00ff52 (0x9b7 bytes) 000927 1787570522.572883 mapread 0x00c30a thru 0x01a2b1 (0xdfa8 bytes) 000930 1787570522.575745 trunc from 0x01c3d3 to 0x01c508 (0x136 bytes) 000931 1787570522.592246 mapread 0x019d9e thru 0x01b488 (0x16eb bytes) 000932 1787570522.594247 write 0x004424 thru 0x005a43 (0x1620 bytes) 000935 1787570522.606109 read 0x00875b thru 0x015e92 (0xd738 bytes) 000937 1787570522.607743 trunc from 0x01c509 to 0x03c335 (0x1fe2d bytes) 000940 1787570522.638160 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c336): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c336): Mirror 19: 0x9c81027f (stale) Mirror 20: 0x9c81027f (stale) Mirror 21: 0x9c3a991e (stale) Mirror 22: 0x494ceddc (stale) Mirror 23: 0x7fce3bf8 (stale) CRC-32 checksum value for chunk [0, 0x3c336): Mirror 1: 0xc65a0397 Mirror 24: 0xc65a0397 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c336: skipped 000941 1787570523.837861 trunc from 0x03c336 to 0x026a6c (0x158c9 bytes) 000942 1787570523.935154 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x26a6d): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26a6d): Mirror 19: 0x99361700 (stale) Mirror 20: 0x99361700 (stale) Mirror 21: 0x6b01fc93 (stale) Mirror 22: 0x1ef80325 (stale) Mirror 23: 0xf578f3d1 (stale) Mirror 24: 0x1b392d7e (stale) CRC-32 checksum value for chunk [0, 0x26a6d): Mirror 1: 0x1b392d7e Mirror 25: 0x1b392d7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26a6d: skipped 000945 1787570525.416046 mapread 0x00d844 thru 0x013f28 (0x66e5 bytes) 000946 1787570525.511005 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x26a6d): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26a6d): Mirror 19: 0x99361700 (stale) Mirror 20: 0x99361700 (stale) Mirror 21: 0x6b01fc93 (stale) Mirror 22: 0x1ef80325 (stale) Mirror 23: 0xf578f3d1 (stale) Mirror 24: 0x1b392d7e (stale) CRC-32 checksum value for chunk [0, 0x26a6d): Mirror 1: 0x1b392d7e Mirror 25: 0x1b392d7e Mirror 26: 0x1b392d7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26a6d: skipped 000949 1787570527.123656 trunc from 0x026a6d to 0x0329a9 (0xbf3d bytes) 000950 1787570527.354748 trunc from 0x0329aa to 0x02842a (0xa57f bytes) 000952 1787570527.434285 mapwrite 0x031400 thru 0x03925a (0x7e5b bytes) 000953 1787570527.625117 write 0x01d306 thru 0x029ead (0xcba8 bytes) 000956 1787570527.663581 write 0x00cc51 thru 0x013993 (0x6d43 bytes) 000957 1787570527.685867 mapwrite 0x03e94d thru 0x03ffff (0x16b3 bytes) 000958 1787570527.805796 MIRROR_RESYNC 9 mirrors 000959 1787570530.487968 mapwrite 0x006bd6 thru 0x00ce46 (0x6271 bytes) 000960 1787570530.881748 mapwrite 0x0138ba thru 0x017eb0 (0x45f7 bytes) 000964 1787570530.974227 mapread 0x01ef57 thru 0x027c0b (0x8cb5 bytes) 000965 1787570531.042570 read 0x025b2e thru 0x034230 (0xe703 bytes) 000966 1787570531.058494 trunc from 0x040000 to 0x00df5b (0x320a4 bytes) 000967 1787570531.087003 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xdf5c): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdf5c): Mirror 19: 0xc75e8cf8 (stale) Mirror 20: 0xc75e8cf8 (stale) Mirror 21: 0xc75e8cf8 (stale) Mirror 22: 0xc75e8cf8 (stale) Mirror 23: 0xc75e8cf8 (stale) Mirror 24: 0xc75e8cf8 (stale) Mirror 25: 0xc75e8cf8 (stale) Mirror 26: 0xc75e8cf8 (stale) CRC-32 checksum value for chunk [0, 0xdf5c): Mirror 1: 0xd6522dd5 Mirror 27: 0xd6522dd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdf5c: skipped 000970 1787570532.485066 mapwrite 0x029733 thru 0x034388 (0xac56 bytes) 000971 1787570532.948491 trunc from 0x034389 to 0x02132a (0x1305e bytes) 000972 1787570532.995577 mapwrite 0x00c20d thru 0x018e8a (0xcc7e bytes) 000976 1787570533.175250 mapwrite 0x034417 thru 0x037d20 (0x390a bytes) 000977 1787570533.425570 trunc from 0x037d21 to 0x0246c3 (0x1365d bytes) 000981 1787570533.460546 mapread 0x0144e0 thru 0x01e105 (0x9c26 bytes) 000984 1787570533.487447 trunc from 0x0246c4 to 0x024d9f (0x6dc bytes) 000986 1787570533.569082 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x24da0): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24da0): Mirror 19: 0xa230bdf8 (stale) Mirror 20: 0xa230bdf8 (stale) Mirror 21: 0xa230bdf8 (stale) Mirror 22: 0xa230bdf8 (stale) Mirror 23: 0xa230bdf8 (stale) Mirror 24: 0xa230bdf8 (stale) Mirror 25: 0xa230bdf8 (stale) Mirror 26: 0xa230bdf8 (stale) Mirror 27: 0x58cda3ff (stale) CRC-32 checksum value for chunk [0, 0x24da0): Mirror 1: 0x6e962f05 Mirror 28: 0x6e962f05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24da0: skipped 000987 1787570534.975638 mapread 0x011090 thru 0x011a9f (0xa10 bytes) 000988 1787570535.003867 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x24da0): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24da0): Mirror 19: 0xa230bdf8 (stale) Mirror 20: 0xa230bdf8 (stale) Mirror 21: 0xa230bdf8 (stale) Mirror 22: 0xa230bdf8 (stale) Mirror 23: 0xa230bdf8 (stale) Mirror 24: 0xa230bdf8 (stale) Mirror 25: 0xa230bdf8 (stale) Mirror 26: 0xa230bdf8 (stale) Mirror 27: 0x58cda3ff (stale) CRC-32 checksum value for chunk [0, 0x24da0): Mirror 1: 0x6e962f05 Mirror 28: 0x6e962f05 Mirror 29: 0x6e962f05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24da0: skipped 000990 1787570537.034231 MIRROR_RESYNC 12 mirrors 000991 1787570539.392578 write 0x017554 thru 0x0234ac (0xbf59 bytes) 000992 1787570539.504445 mapwrite 0x0055fa thru 0x00fa81 (0xa488 bytes) 000993 1787570539.713587 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x24da0): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24da0): Mirror 19: 0x6e962f05 (stale) Mirror 20: 0x6e962f05 (stale) Mirror 21: 0x6e962f05 (stale) Mirror 22: 0x6e962f05 (stale) Mirror 23: 0x6e962f05 (stale) Mirror 24: 0x6e962f05 (stale) Mirror 25: 0x6e962f05 (stale) Mirror 26: 0x6e962f05 (stale) Mirror 27: 0x6e962f05 (stale) Mirror 28: 0x6e962f05 (stale) Mirror 29: 0x6e962f05 (stale) CRC-32 checksum value for chunk [0, 0x24da0): Mirror 1: 0x8670856 Mirror 30: 0x8670856 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24da0: skipped 000995 1787570541.720710 mapread 0x019769 thru 0x02003c (0x68d4 bytes) 000996 1787570541.804652 mapwrite 0x029101 thru 0x02f5e1 (0x64e1 bytes) 000999 1787570542.159692 read 0x02e418 thru 0x02f5e1 (0x11ca bytes) 001000 1787570542.160327 mapread 0x0167ca thru 0x021ca8 (0xb4df bytes) All operations completed A-OK!