== sanity-flr test 70a: flr mode fsx test ================ 04:00:29 (1785398429) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 8432 fallocating to largest ever: 0x218dc 000001 1785398433.142886 fallocate 0x017cb1 thru 0x0218db (0x9c2b bytes) 000002 1785398433.176752 trunc from 0x01e52c to 0x0208b3 (0x2388 bytes) 000003 1785398433.197533 mapwrite 0x034c43 thru 0x03f868 (0xac26 bytes) 000004 1785398433.357786 mapwrite 0x00c41a thru 0x014527 (0x810e bytes) 000005 1785398433.428303 trunc from 0x0129cc to 0x01bd64 (0x9399 bytes) 000006 1785398433.439666 mapwrite 0x016f30 thru 0x017fab (0x107c bytes) 000007 1785398433.485505 read 0x01b5ab thru 0x0227d7 (0x722d bytes) fallocating to largest ever: 0x40000 000008 1785398433.503906 fallocate 0x03a14c thru 0x03ffff (0x5eb4 bytes) 000010 1785398433.515399 fallocate 0x004bde thru 0x011cea (0xd10d bytes) 000011 1785398433.524103 trunc from 0x03f869 to 0x039ff0 (0x5878 bytes) 000013 1785398433.567326 write 0x0005ec thru 0x000afd (0x512 bytes) 000014 1785398433.574635 punch from 0x037e43 to 0x039ff0 (0x21ae bytes) 000015 1785398433.585665 trunc from 0x0193ba to 0x023535 (0xa17c bytes) 000016 1785398433.596254 mapread 0x036a96 thru 0x039ff0 (0x355b bytes) 000017 1785398433.618042 trunc from 0x00afce to 0x018cbb (0xdcee bytes) 000018 1785398433.641500 punch from 0x007161 to 0x00ab58 (0x39f8 bytes) 000019 1785398433.657932 MIRROR_EXTEND to 2 mirrors 000020 1785398435.391172 trunc from 0x039513 to 0x039ff0 (0xade bytes) 000021 1785398435.460512 read 0x014fab thru 0x024a3f (0xfa95 bytes) 000022 1785398435.502050 fallocate 0x01cf0d thru 0x024255 (0x7349 bytes) 000023 1785398435.520541 mapread 0x034b09 thru 0x038c36 (0x412e bytes) 000024 1785398435.597292 trunc from 0x031365 to 0x039ff0 (0x8c8c bytes) 000025 1785398435.611431 fallocate 0x011815 thru 0x018e6d (0x7659 bytes) 000026 1785398435.627020 read 0x021868 thru 0x024f00 (0x3699 bytes) 000027 1785398435.631530 fallocate 0x004112 thru 0x009014 (0x4f03 bytes) 000028 1785398435.649148 punch from 0x02e290 to 0x034644 (0x63b5 bytes) 000029 1785398435.676018 mapwrite 0x032ae4 thru 0x03b702 (0x8c1f bytes) 000030 1785398435.834275 read 0x00dcf0 thru 0x01c697 (0xe9a8 bytes) 000031 1785398435.839072 read 0x03746e thru 0x03b702 (0x4295 bytes) 000032 1785398435.845492 fallocate 0x01038f thru 0x011f1e (0x1b90 bytes) 000033 1785398435.863080 read 0x01e73c thru 0x022785 (0x404a bytes) 000034 1785398435.865504 punch from 0x01c372 to 0x023b9d (0x782c bytes) 000035 1785398435.889641 mapwrite 0x002415 thru 0x003fdc (0x1bc8 bytes) 000036 1785398435.913121 trunc from 0x03b703 to 0x0009cb (0x3ad37 bytes) 000037 1785398435.942341 fallocate 0x006844 thru 0x00a1da (0x3997 bytes) 000038 1785398435.951909 fallocate 0x029ac8 thru 0x03388c (0x9dc5 bytes) 000039 1785398435.973357 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3388d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3388d): Mirror 2: 0x5c2439da (stale) CRC-32 checksum value for chunk [0, 0x3388d): Mirror 1: 0x8d342d7c Mirror 3: 0x8d342d7c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3388d: skipped 000041 1785398436.890098 read 0x01edbb thru 0x029e8c (0xb0d2 bytes) 000042 1785398436.935171 trunc from 0x00d9ed to 0x01119a (0x37ae bytes) 000043 1785398437.017247 trunc from 0x029f66 to 0x02a9d6 (0xa71 bytes) 000044 1785398437.027924 mapread 0x008d71 thru 0x011a7d (0x8d0d bytes) 000045 1785398437.097731 fallocate 0x01e58c thru 0x02a830 (0xc2a5 bytes) 000046 1785398437.114815 punch from 0x0261b0 to 0x03388c (0xd6dd bytes) 000047 1785398437.123232 fallocate 0x024ee2 thru 0x027ce6 (0x2e05 bytes) 000048 1785398437.133010 trunc from 0x03388d to 0x012d30 (0x20b5c bytes) 000049 1785398437.223330 trunc from 0x012d31 to 0x00d7f7 (0x5539 bytes) 000050 1785398437.244460 mapread 0x005d19 thru 0x00d7f7 (0x7adf bytes) 000051 1785398437.245654 mapread 0x002ccd thru 0x005d33 (0x3067 bytes) 000052 1785398437.266909 punch from 0x00702b to 0x00d7f7 (0x67cd bytes) 000054 1785398437.278398 mapread 0x0099be thru 0x00d7f7 (0x3e3a bytes) 000055 1785398437.305652 fallocate 0x018c3e thru 0x01f9ed (0x6db0 bytes) 000056 1785398437.319562 write 0x03aed1 thru 0x03ffff (0x512f bytes) 000057 1785398437.325467 write 0x0113e6 thru 0x014c52 (0x386d bytes) 000058 1785398437.353039 trunc from 0x031fbb to 0x03ffff (0xe045 bytes) 000059 1785398437.397614 trunc from 0x0261b1 to 0x02dd54 (0x7ba4 bytes) 000060 1785398437.417976 read 0x00314e thru 0x00d409 (0xa2bc bytes) 000061 1785398437.418738 mapwrite 0x01ce7f thru 0x028a11 (0xbb93 bytes) 000062 1785398437.504521 trunc from 0x040000 to 0x01e228 (0x21dd7 bytes) 000063 1785398437.562041 fallocate 0x025ad4 thru 0x034560 (0xea8d bytes) 000064 1785398437.574124 trunc from 0x01e229 to 0x018911 (0x5917 bytes) 000065 1785398437.602068 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18912): Mirror 3: 0xc0b27df5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18912): Mirror 3: 0xc0b27df5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18912: skipped 000066 1785398438.154283 mapread 0x010ddc thru 0x018911 (0x7b36 bytes) 000067 1785398438.216278 punch from 0x0003f4 to 0x000935 (0x542 bytes) 000068 1785398438.238439 mapwrite 0x024cdf thru 0x034503 (0xf825 bytes) 000069 1785398438.425545 fallocate 0x038249 thru 0x03d782 (0x553a bytes) 000070 1785398438.439135 mapread 0x01fa43 thru 0x0279ce (0x7f8c bytes) 000071 1785398438.440507 read 0x029cf1 thru 0x02c58c (0x289c bytes) 000073 1785398438.441535 mapread 0x0144c4 thru 0x024385 (0xfec2 bytes) 000074 1785398438.455906 punch from 0x01eb8f to 0x0249b5 (0x5e27 bytes) 000075 1785398438.462544 trunc from 0x02bcbc to 0x0327db (0x6b20 bytes) 000076 1785398438.471480 read 0x01e0fb thru 0x024515 (0x641b bytes) 000077 1785398438.496945 trunc from 0x034504 to 0x0261e6 (0xe31d bytes) 000078 1785398438.547104 punch from 0x001219 to 0x00dd72 (0xcb5a bytes) 000079 1785398438.554950 punch from 0x00e90c to 0x00eca7 (0x39c bytes) 000080 1785398438.572039 write 0x03004b thru 0x034c46 (0x4bfc bytes) 000081 1785398438.573336 read 0x00bd28 thru 0x01621e (0xa4f7 bytes) 000083 1785398438.619892 mapread 0x033edc thru 0x034c46 (0xd6b bytes) 000084 1785398438.620821 trunc from 0x01db22 to 0x028548 (0xaa27 bytes) 000085 1785398438.633610 read 0x01d23e thru 0x02641c (0x91df bytes) 000086 1785398438.655577 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34c47): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34c47): Mirror 3: 0x991d4fc1 (stale) CRC-32 checksum value for chunk [0, 0x34c47): Mirror 1: 0x18aba6c0 Mirror 4: 0x18aba6c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34c47: skipped 000087 1785398440.277798 mapread 0x023331 thru 0x02d693 (0xa363 bytes) 000088 1785398440.344522 mapread 0x01e180 thru 0x01eb4a (0x9cb bytes) 000090 1785398440.392813 mapwrite 0x0167eb thru 0x01cacd (0x62e3 bytes) 000091 1785398440.600938 trunc from 0x00e2e3 to 0x01dfd6 (0xfcf4 bytes) 000094 1785398440.627518 mapread 0x0317e9 thru 0x034c46 (0x345e bytes) 000095 1785398440.698395 trunc from 0x027b94 to 0x029026 (0x1493 bytes) 000096 1785398440.713393 mapwrite 0x009659 thru 0x011e9f (0x8847 bytes) 000097 1785398440.832126 write 0x03fdd4 thru 0x03ffff (0x22c bytes) 000098 1785398440.851137 mapread 0x0209f4 thru 0x029ce6 (0x92f3 bytes) 000099 1785398440.888180 trunc from 0x040000 to 0x01867e (0x27981 bytes) 000100 1785398440.946808 punch from 0x000569 to 0x00204f (0x1ae7 bytes) 000101 1785398440.956304 punch from 0x0116d2 to 0x0120b4 (0x9e3 bytes) 000102 1785398440.966925 trunc from 0x00518f to 0x012305 (0xd177 bytes) 000104 1785398440.979775 read 0x01667a thru 0x01867e (0x2005 bytes) 000105 1785398440.987540 trunc from 0x01867f to 0x0370b4 (0x1ea36 bytes) 000106 1785398441.023382 trunc from 0x0370b5 to 0x033746 (0x396e bytes) 000107 1785398441.073003 trunc from 0x016cf7 to 0x0173b8 (0x6c2 bytes) 000108 1785398441.118379 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33747): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33747): Mirror 3: 0xca9ffdb4 (stale) Mirror 4: 0xbdbcfa76 (stale) CRC-32 checksum value for chunk [0, 0x33747): Mirror 1: 0xf851670e Mirror 5: 0xf851670e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33747: skipped 000109 1785398442.730111 mapwrite 0x013afc thru 0x018e9e (0x53a3 bytes) 000110 1785398442.996092 MIRROR_RESYNC 4 mirrors 000111 1785398444.696943 read 0x012389 thru 0x017543 (0x51bb bytes) 000112 1785398444.721949 fallocate 0x03d137 thru 0x03ffff (0x2ec9 bytes) 000113 1785398444.811806 mapread 0x00f1b7 thru 0x01e211 (0xf05b bytes) 000114 1785398444.892484 mapread 0x024fdc thru 0x02b9b4 (0x69d9 bytes) 000116 1785398444.907897 mapwrite 0x02dea5 thru 0x03a1c9 (0xc325 bytes) 000117 1785398445.026024 trunc from 0x02f6aa to 0x035b0d (0x6464 bytes) 000118 1785398445.035068 fallocate 0x01b8e3 thru 0x028919 (0xd037 bytes) 000119 1785398445.049654 trunc from 0x024031 to 0x02a4aa (0x647a bytes) 000120 1785398445.086024 mapread 0x022e04 thru 0x02f462 (0xc65f bytes) 000121 1785398445.141445 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a1ca): Mirror 3: 0x48f3e0fb (stale) Mirror 4: 0x48f3e0fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a1ca): Mirror 3: 0x48f3e0fb (stale) Mirror 4: 0x48f3e0fb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a1ca: skipped 000122 1785398445.719761 mapread 0x013ed0 thru 0x01c8e6 (0x8a17 bytes) 000124 1785398445.761749 write 0x024a01 thru 0x026a8f (0x208f bytes) 000125 1785398445.799299 write 0x01e245 thru 0x01fac9 (0x1885 bytes) 000126 1785398445.806579 mapwrite 0x005634 thru 0x01284c (0xd219 bytes) 000127 1785398445.849509 trunc from 0x02a3a1 to 0x0372dc (0xcf3c bytes) 000128 1785398445.854493 read 0x0250bd thru 0x025925 (0x869 bytes) 000129 1785398445.855149 punch from 0x01bf6e to 0x029d3c (0xddcf bytes) 000130 1785398445.865618 mapwrite 0x02101b thru 0x02feac (0xee92 bytes) 000131 1785398445.949248 trunc from 0x0318f3 to 0x03317f (0x188d bytes) 000132 1785398445.962371 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a1ca): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a1ca): Mirror 3: 0x48f3e0fb (stale) Mirror 4: 0x48f3e0fb (stale) CRC-32 checksum value for chunk [0, 0x3a1ca): Mirror 1: 0xf4d07fe5 Mirror 5: 0xf4d07fe5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a1ca: skipped 000133 1785398447.623151 trunc from 0x013877 to 0x01da84 (0xa20e bytes) 000134 1785398447.680348 mapread 0x02d537 thru 0x0368f6 (0x93c0 bytes) 000135 1785398447.753661 read 0x03533c thru 0x03a1c9 (0x4e8e bytes) 000136 1785398447.762995 fallocate 0x017285 thru 0x0195b1 (0x232d bytes) 000137 1785398447.775991 trunc from 0x01c01c to 0x02a430 (0xe415 bytes) 000138 1785398447.790947 fallocate 0x03e181 thru 0x03ffff (0x1e7f bytes) 000139 1785398447.794602 punch from 0x01656d to 0x019308 (0x2d9c bytes) 000142 1785398447.801440 trunc from 0x0197cd to 0x01b865 (0x2099 bytes) 000143 1785398447.807140 fallocate 0x03f346 thru 0x03ffff (0xcba bytes) 000144 1785398447.817882 trunc from 0x011ade to 0x01fc07 (0xe12a bytes) 000145 1785398447.832368 mapread 0x00ccb0 thru 0x00d6a1 (0x9f2 bytes) 000146 1785398447.896989 mapread 0x025e4d thru 0x02ea39 (0x8bed bytes) 000147 1785398447.914841 punch from 0x02f96c to 0x03a7e3 (0xae78 bytes) 000148 1785398447.927976 mapread 0x02e501 thru 0x039f88 (0xba88 bytes) 000149 1785398447.983956 mapread 0x031e49 thru 0x03ff58 (0xe110 bytes) 000150 1785398447.986752 fallocate 0x015281 thru 0x01e6a6 (0x9426 bytes) 000151 1785398448.000226 punch from 0x0017b8 to 0x00edee (0xd637 bytes) 000152 1785398448.008972 mapread 0x03559b thru 0x036dc8 (0x182e bytes) 000153 1785398448.010827 fallocate 0x0114d6 thru 0x017b35 (0x6660 bytes) 000154 1785398448.022531 fallocate 0x02b691 thru 0x03b217 (0xfb87 bytes) 000155 1785398448.031622 mapread 0x0299eb thru 0x031401 (0x7a17 bytes) 000156 1785398448.058257 MIRROR_RESYNC 4 mirrors 000157 1785398450.132870 mapwrite 0x01bbda thru 0x0234bc (0x78e3 bytes) 000158 1785398450.337418 mapwrite 0x01f78b thru 0x0259e3 (0x6259 bytes) 000159 1785398450.390003 write 0x02c075 thru 0x02ddc0 (0x1d4c bytes) 000160 1785398450.391728 punch from 0x01e541 to 0x02612b (0x7beb bytes) 000161 1785398450.408622 trunc from 0x02cdea to 0x02e0f4 (0x130b bytes) 000162 1785398450.426543 trunc from 0x0163fb to 0x01956e (0x3174 bytes) 000163 1785398450.447672 fallocate 0x038022 thru 0x03ffff (0x7fde bytes) 000164 1785398450.461374 read 0x0399a1 thru 0x03ffff (0x665f bytes) 000165 1785398450.494743 trunc from 0x03fc41 to 0x03ffff (0x3bf bytes) 000166 1785398450.508828 MIRROR_RESYNC 4 mirrors 000167 1785398453.918719 mapwrite 0x02ef5e thru 0x03bee0 (0xcf83 bytes) 000168 1785398454.162602 MIRROR_RESYNC 4 mirrors 000169 1785398456.835301 trunc from 0x01f859 to 0x02caa7 (0xd24f bytes) 000170 1785398456.860541 mapread 0x011cd8 thru 0x014e38 (0x3161 bytes) 000171 1785398456.875404 punch from 0x034608 to 0x03ffff (0xb9f8 bytes) 000172 1785398456.882179 MIRROR_RESYNC 4 mirrors 000173 1785398458.563381 fallocate 0x016bd5 thru 0x01838e (0x17ba bytes) 000174 1785398458.649265 write 0x01e027 thru 0x02d2e2 (0xf2bc bytes) 000175 1785398458.677615 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa8fdee8d (stale) Mirror 4: 0xa8fdee8d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa8fdee8d (stale) Mirror 4: 0xa8fdee8d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000176 1785398459.091798 mapwrite 0x0082ba thru 0x009ee5 (0x1c2c bytes) 000177 1785398459.121716 trunc from 0x040000 to 0x01d5f2 (0x22a0d bytes) 000178 1785398459.163354 trunc from 0x00fe97 to 0x0157ac (0x5916 bytes) 000179 1785398459.183225 fallocate 0x011746 thru 0x01610e (0x49c9 bytes) 000180 1785398459.197814 write 0x03bb32 thru 0x03f69b (0x3b6a bytes) 000181 1785398459.206091 mapwrite 0x038565 thru 0x03ffff (0x7a9b bytes) 000182 1785398459.297251 punch from 0x018e57 to 0x01e9c1 (0x5b6b bytes) 000183 1785398459.310345 trunc from 0x01a1a2 to 0x01c686 (0x24e5 bytes) 000184 1785398459.316950 fallocate 0x02b571 thru 0x02c6d8 (0x1168 bytes) 000185 1785398459.321051 punch from 0x03cab7 to 0x03f19f (0x26e9 bytes) 000187 1785398459.326141 read 0x03064b thru 0x030dfc (0x7b2 bytes) 000189 1785398459.332621 mapwrite 0x0169f7 thru 0x01de2a (0x7434 bytes) 000191 1785398459.361485 punch from 0x012066 to 0x014c72 (0x2c0d bytes) 000192 1785398459.370544 MIRROR_RESYNC 3 mirrors 000193 1785398460.938669 fallocate 0x0079c2 thru 0x016ed3 (0xf512 bytes) 000197 1785398461.046832 punch from 0x01f48f to 0x0265a6 (0x7118 bytes) 000198 1785398461.058752 trunc from 0x025668 to 0x0283e6 (0x2d7f bytes) 000199 1785398461.085480 punch from 0x031b8c to 0x03cd6f (0xb1e4 bytes) 000200 1785398461.103646 trunc from 0x01c0c0 to 0x01fc37 (0x3b78 bytes) 000201 1785398461.134911 punch from 0x011b0b to 0x01497f (0x2e75 bytes) 000202 1785398461.151248 mapread 0x0060ac thru 0x00b534 (0x5489 bytes) 000203 1785398461.205178 punch from 0x02985e to 0x02e23b (0x49de bytes) 000204 1785398461.214643 mapwrite 0x014a3a thru 0x01f4b9 (0xaa80 bytes) 000205 1785398461.357676 trunc from 0x040000 to 0x018fcc (0x27033 bytes) 000206 1785398461.424509 MIRROR_RESYNC 3 mirrors 000207 1785398462.619445 trunc from 0x01689d to 0x018fcc (0x2730 bytes) 000208 1785398462.648251 write 0x0341fc thru 0x034b6f (0x974 bytes) 000209 1785398462.654135 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34b70): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b70): Mirror 3: 0x6a1b2d65 (stale) Mirror 4: 0x6a1b2d65 (stale) CRC-32 checksum value for chunk [0, 0x34b70): Mirror 1: 0xf664f986 Mirror 5: 0xf664f986 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b70: skipped 000210 1785398464.276436 read 0x00d962 thru 0x018cb1 (0xb350 bytes) 000211 1785398464.297110 fallocate 0x025642 thru 0x03029c (0xac5b bytes) 000212 1785398464.382568 punch from 0x02c72e to 0x02ff46 (0x3819 bytes) 000214 1785398464.403386 read 0x00c75e thru 0x00fd83 (0x3626 bytes) 000215 1785398464.432617 trunc from 0x002414 to 0x0087d0 (0x63bd bytes) 000216 1785398464.446408 mapread 0x00dbf6 thru 0x01c42c (0xe837 bytes) 000217 1785398464.454383 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34b70): Mirror 4: 0x6a1b2d65 (stale) Mirror 5: 0xf664f986 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b70): Mirror 4: 0x6a1b2d65 (stale) Mirror 5: 0xf664f986 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b70: skipped 000218 1785398464.925149 fallocate 0x02b0a9 thru 0x034004 (0x8f5c bytes) 000219 1785398464.936569 MIRROR_RESYNC 3 mirrors 000220 1785398466.570283 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000221 1785398467.119018 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000222 1785398467.507910 trunc from 0x01feee to 0x02badb (0xbbee bytes) 000223 1785398467.536578 read 0x034358 thru 0x034b6f (0x818 bytes) 000224 1785398467.558818 mapwrite 0x01e36c thru 0x02d23e (0xeed3 bytes) 000226 1785398467.747391 punch from 0x0015e0 to 0x008cdb (0x76fc bytes) 000227 1785398467.769627 read 0x02f4c4 thru 0x034b6f (0x56ac bytes) 000228 1785398467.811666 trunc from 0x034b70 to 0x00d042 (0x27b2d bytes) 000230 1785398467.905665 mapwrite 0x02ba85 thru 0x02f730 (0x3cac bytes) 000231 1785398468.097129 trunc from 0x00801b to 0x01466a (0xc650 bytes) 000232 1785398468.103223 read 0x0089f6 thru 0x009cc3 (0x12ce bytes) 000234 1785398468.126606 trunc from 0x00c8fb to 0x016c73 (0xa379 bytes) 000235 1785398468.139273 mapwrite 0x00dbd0 thru 0x00f9f1 (0x1e22 bytes) 000236 1785398468.198882 punch from 0x0162cb to 0x01aecd (0x4c03 bytes) 000237 1785398468.205635 read 0x00ecf7 thru 0x014b24 (0x5e2e bytes) 000238 1785398468.231603 trunc from 0x0251d9 to 0x02f730 (0xa558 bytes) 000239 1785398468.242157 read 0x00c14d thru 0x014934 (0x87e8 bytes) 000240 1785398468.245387 read 0x011a8c thru 0x0181c1 (0x6736 bytes) 000241 1785398468.246188 write 0x01ad61 thru 0x021ff9 (0x7299 bytes) 000242 1785398468.252519 write 0x023591 thru 0x02ca2a (0x949a bytes) 000244 1785398468.270222 mapwrite 0x03956e thru 0x03e37d (0x4e10 bytes) 000245 1785398468.366225 mapread 0x024804 thru 0x02ccbf (0x84bc bytes) 000246 1785398468.367366 read 0x01dcda thru 0x02abe6 (0xcf0d bytes) 000247 1785398468.368054 mapwrite 0x024105 thru 0x02923f (0x513b bytes) 000248 1785398468.438181 mapwrite 0x00f885 thru 0x0123fc (0x2b78 bytes) 000249 1785398468.483978 MIRROR_EXTEND to 2 mirrors 000250 1785398469.684106 trunc from 0x014286 to 0x01a013 (0x5d8e bytes) 000251 1785398469.740310 mapread 0x02a008 thru 0x02afd7 (0xfd0 bytes) 000252 1785398469.748672 trunc from 0x03e37e to 0x03ea52 (0x6d5 bytes) 000253 1785398469.809444 read 0x02bcba thru 0x02be3d (0x184 bytes) 000254 1785398469.825486 mapread 0x000154 thru 0x009b9d (0x9a4a bytes) 000255 1785398469.877449 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ea53): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea53): Mirror 2: 0xfcbbe187 (stale) CRC-32 checksum value for chunk [0, 0x3ea53): Mirror 1: 0xfcbbe187 Mirror 3: 0xfcbbe187 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea53: skipped 000256 1785398471.748836 mapread 0x00b1f4 thru 0x012975 (0x7782 bytes) 000257 1785398471.829319 trunc from 0x00ead1 to 0x01d8bf (0xedef bytes) 000258 1785398471.896481 punch from 0x02a330 to 0x034087 (0x9d58 bytes) 000259 1785398471.902915 mapread 0x034e11 thru 0x03692c (0x1b1c bytes) 000260 1785398471.930607 mapread 0x017637 thru 0x021260 (0x9c2a bytes) 000262 1785398471.966191 trunc from 0x03ea53 to 0x030c46 (0xde0c bytes) 000264 1785398472.048272 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30c47): Mirror 3: 0x83920579 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30c47): Mirror 3: 0x83920579 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30c47: skipped 000266 1785398472.703068 mapwrite 0x011ee7 thru 0x021c4d (0xfd67 bytes) 000267 1785398472.826562 fallocate 0x0213b6 thru 0x02ae65 (0x9ab0 bytes) 000268 1785398472.847408 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000270 1785398473.218368 fallocate 0x00b6ca thru 0x018a2c (0xd363 bytes) 000271 1785398473.234517 mapread 0x002a08 thru 0x008d43 (0x633c bytes) 000272 1785398473.293292 punch from 0x002131 to 0x00daf8 (0xb9c8 bytes) 000273 1785398473.313451 read 0x012e5d thru 0x018a7d (0x5c21 bytes) 000275 1785398473.354988 mapread 0x025f2b thru 0x02dd18 (0x7dee bytes) 000276 1785398473.370841 fallocate 0x03816e thru 0x038de5 (0xc78 bytes) 000277 1785398473.381237 read 0x022560 thru 0x02a26a (0x7d0b bytes) 000278 1785398473.382576 fallocate 0x02883e thru 0x02bcda (0x349d bytes) 000279 1785398473.397227 read 0x036d7b thru 0x0388c9 (0x1b4f bytes) 000280 1785398473.484565 trunc from 0x038de6 to 0x036e8e (0x1f57 bytes) 000281 1785398473.530916 write 0x02c87a thru 0x032e8e (0x6615 bytes) 000283 1785398473.537391 write 0x01bc07 thru 0x0241b0 (0x85aa bytes) 000286 1785398473.543588 trunc from 0x0267c3 to 0x029c76 (0x34b4 bytes) 000288 1785398473.559321 mapwrite 0x038577 thru 0x03a8d0 (0x235a bytes) 000289 1785398473.635027 trunc from 0x03a8d1 to 0x02c2d5 (0xe5fb bytes) 000290 1785398473.667923 read 0x006a1d thru 0x014753 (0xdd37 bytes) 000291 1785398473.668609 fallocate 0x00ef17 thru 0x017505 (0x85ef bytes) 000292 1785398473.679298 mapwrite 0x02cee0 thru 0x032765 (0x5886 bytes) 000293 1785398473.760254 fallocate 0x038fa5 thru 0x03edba (0x5e16 bytes) 000294 1785398473.767025 mapread 0x014983 thru 0x02174b (0xcdc9 bytes) 000295 1785398473.775877 mapread 0x029a74 thru 0x02d5dc (0x3b69 bytes) 000296 1785398473.781806 trunc from 0x032766 to 0x016209 (0x1c55c bytes) 000297 1785398473.808505 read 0x003c33 thru 0x0049ae (0xd7c bytes) 000298 1785398473.811294 trunc from 0x00fb67 to 0x016209 (0x66a3 bytes) 000299 1785398473.818564 mapwrite 0x01a3c7 thru 0x0288c6 (0xe500 bytes) 000300 1785398473.925485 trunc from 0x0288c7 to 0x001eb4 (0x26a12 bytes) 000301 1785398473.959858 trunc from 0x001eb5 to 0x035efe (0x3404a bytes) 000302 1785398474.007567 trunc from 0x01e72a to 0x0220a4 (0x397b bytes) 000303 1785398474.016820 read 0x02419a thru 0x03089e (0xc705 bytes) 000304 1785398474.111505 trunc from 0x035eff to 0x03bf59 (0x605b bytes) 000305 1785398474.135207 read 0x006d4f thru 0x006e1d (0xcf bytes) 000306 1785398474.135847 punch from 0x02c034 to 0x036e2a (0xadf7 bytes) 000308 1785398474.146432 trunc from 0x0099c9 to 0x009d78 (0x3b0 bytes) 000311 1785398474.156425 mapwrite 0x02adab thru 0x038055 (0xd2ab bytes) 000312 1785398474.281961 mapread 0x02bb05 thru 0x03281c (0x6d18 bytes) 000314 1785398474.287654 trunc from 0x03bf5a to 0x00e2b7 (0x2dca2 bytes) 000316 1785398474.340008 fallocate 0x01b5e7 thru 0x0263cc (0xade6 bytes) 000317 1785398474.361057 MIRROR_EXTEND to 2 mirrors 000318 1785398475.582117 write 0x0156e2 thru 0x01e545 (0x8e64 bytes) 000319 1785398475.646831 MIRROR_RESYNC 2 mirrors 000320 1785398476.770086 read 0x01b507 thru 0x01e545 (0x303f bytes) 000321 1785398476.783837 mapread 0x0117f0 thru 0x0155f9 (0x3e0a bytes) 000322 1785398476.840314 MIRROR_RESYNC 2 mirrors 000323 1785398477.450398 punch from 0x00503f to 0x00b1d7 (0x6199 bytes) 000324 1785398477.495335 fallocate 0x00b6a7 thru 0x011940 (0x629a bytes) 000325 1785398477.505064 read 0x00fb61 thru 0x01a4e1 (0xa981 bytes) 000327 1785398477.538350 fallocate 0x03c731 thru 0x03ffff (0x38cf bytes) 000328 1785398477.546866 mapread 0x0386d5 thru 0x03d713 (0x503f bytes) 000329 1785398477.582347 read 0x02f34a thru 0x036cce (0x7985 bytes) 000330 1785398477.723517 fallocate 0x00b47b thru 0x00fff5 (0x4b7b bytes) 000331 1785398477.735176 trunc from 0x03eb20 to 0x03ffff (0x14e0 bytes) 000332 1785398477.745896 read 0x00bed7 thru 0x0169a2 (0xaacc bytes) 000333 1785398477.747209 trunc from 0x008e2f to 0x0124b6 (0x9688 bytes) 000334 1785398477.760356 mapread 0x02052d thru 0x0206a4 (0x178 bytes) 000335 1785398477.761316 write 0x01db80 thru 0x027eee (0xa36f bytes) 000336 1785398477.767264 fallocate 0x024e78 thru 0x02c357 (0x74e0 bytes) 000337 1785398477.785943 mapwrite 0x00c9d0 thru 0x0117c7 (0x4df8 bytes) 000338 1785398477.877934 read 0x006c8d thru 0x00852d (0x18a1 bytes) 000339 1785398477.878554 read 0x033994 thru 0x03ffff (0xc66c bytes) 000340 1785398477.879210 trunc from 0x03b5ad to 0x03e6ee (0x3142 bytes) 000341 1785398477.895941 trunc from 0x040000 to 0x0115d6 (0x2ea29 bytes) 000342 1785398477.950938 MIRROR_RESYNC 2 mirrors 000343 1785398478.853252 mapread 0x003a61 thru 0x00a677 (0x6c17 bytes) 000344 1785398478.928324 mapwrite 0x0289cb thru 0x036637 (0xdc6d bytes) 000345 1785398479.100134 read 0x011761 thru 0x0154c0 (0x3d60 bytes) 000346 1785398479.117660 punch from 0x00b578 to 0x017c63 (0xc6ec bytes) 000348 1785398479.134722 trunc from 0x01f693 to 0x020caa (0x1618 bytes) 000349 1785398479.141237 mapwrite 0x02a1a7 thru 0x02c1ea (0x2044 bytes) 000350 1785398479.161745 trunc from 0x006ff1 to 0x00b1e2 (0x41f2 bytes) 000351 1785398479.173898 write 0x0185d8 thru 0x01c4a0 (0x3ec9 bytes) 000352 1785398479.194104 read 0x0208bf thru 0x02e483 (0xdbc5 bytes) 000353 1785398479.291220 read 0x00835e thru 0x00dc5b (0x58fe bytes) 000355 1785398479.292435 trunc from 0x01e64f to 0x02836e (0x9d20 bytes) 000356 1785398479.310401 write 0x0221c9 thru 0x02bbc3 (0x99fb bytes) 000357 1785398479.345347 write 0x03a290 thru 0x03ffff (0x5d70 bytes) 000358 1785398479.348844 mapwrite 0x0033a4 thru 0x01155d (0xe1ba bytes) 000359 1785398479.395796 punch from 0x0209b7 to 0x025e52 (0x549c bytes) 000360 1785398479.402964 punch from 0x002b30 to 0x005167 (0x2638 bytes) 000361 1785398479.414260 mapread 0x01d8c3 thru 0x020ba3 (0x32e1 bytes) 000362 1785398479.440997 write 0x024c4a thru 0x02d40e (0x87c5 bytes) 000363 1785398479.458362 mapread 0x0245f6 thru 0x02ebf5 (0xa600 bytes) 000364 1785398479.462675 trunc from 0x01382c to 0x015ac2 (0x2297 bytes) 000365 1785398479.478204 write 0x01c167 thru 0x029cb7 (0xdb51 bytes) 000366 1785398479.493194 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf6f385ee (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfeaea4af Mirror 3: 0xfeaea4af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000367 1785398481.216224 mapread 0x006cb5 thru 0x00b678 (0x49c4 bytes) 000368 1785398481.270420 mapread 0x01d5cf thru 0x0262c9 (0x8cfb bytes) 000369 1785398481.342586 trunc from 0x040000 to 0x021722 (0x1e8dd bytes) 000371 1785398481.497574 punch from 0x011e35 to 0x01a175 (0x8341 bytes) 000372 1785398481.512878 mapread 0x00cd37 thru 0x0181ac (0xb476 bytes) 000373 1785398481.539881 trunc from 0x00b988 to 0x00c4a9 (0xb22 bytes) 000374 1785398481.554638 mapread 0x012175 thru 0x016348 (0x41d4 bytes) 000375 1785398481.558312 punch from 0x015409 to 0x021722 (0xc31a bytes) 000376 1785398481.581176 punch from 0x0187b8 to 0x018d63 (0x5ac bytes) 000377 1785398481.630911 MIRROR_RESYNC 3 mirrors 000378 1785398483.961079 trunc from 0x0132a0 to 0x021393 (0xe0f4 bytes) 000379 1785398484.044127 MIRROR_RESYNC 3 mirrors 000380 1785398485.996778 mapwrite 0x0033a5 thru 0x00e157 (0xadb3 bytes) 000381 1785398486.248555 write 0x03df17 thru 0x03ffff (0x20e9 bytes) 000382 1785398486.261482 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x11115683 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x11115683 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000383 1785398487.037293 punch from 0x0115b9 to 0x01a00a (0x8a52 bytes) 000384 1785398487.047608 trunc from 0x01e733 to 0x02a686 (0xbf54 bytes) 000385 1785398487.056027 trunc from 0x040000 to 0x03d766 (0x2899 bytes) 000386 1785398487.088014 fallocate 0x006a9c thru 0x014337 (0xd89c bytes) 000387 1785398487.102982 punch from 0x00dc92 to 0x0147f0 (0x6b5f bytes) 000388 1785398487.111460 fallocate 0x0260f6 thru 0x0268c8 (0x7d3 bytes) 000389 1785398487.144323 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000390 1785398487.412739 trunc from 0x03cf58 to 0x03d766 (0x80f bytes) 000391 1785398487.427281 trunc from 0x033dbe to 0x03d766 (0x99a9 bytes) 000392 1785398487.439450 write 0x02c43e thru 0x03aeff (0xeac2 bytes) 000393 1785398487.483193 mapread 0x00341a thru 0x005c96 (0x287d bytes) 000394 1785398487.538479 mapread 0x03bd20 thru 0x03d766 (0x1a47 bytes) 000396 1785398487.548481 write 0x019de3 thru 0x027d3c (0xdf5a bytes) 000397 1785398487.580434 mapread 0x03d364 thru 0x03d766 (0x403 bytes) 000398 1785398487.581367 mapread 0x007d7a thru 0x0159d0 (0xdc57 bytes) 000399 1785398487.598154 punch from 0x02ebe5 to 0x031197 (0x25b3 bytes) 000401 1785398487.633224 mapread 0x026321 thru 0x0318bd (0xb59d bytes) 000402 1785398487.678769 punch from 0x0134d0 to 0x01c964 (0x9495 bytes) 000403 1785398487.702265 mapread 0x01fcf8 thru 0x020e43 (0x114c bytes) 000404 1785398487.709281 trunc from 0x00913f to 0x01248c (0x934e bytes) 000405 1785398487.718378 read 0x001754 thru 0x010721 (0xefce bytes) 000406 1785398487.744873 punch from 0x007e97 to 0x01423a (0xc3a4 bytes) 000407 1785398487.773032 trunc from 0x03d767 to 0x0279e0 (0x15d86 bytes) 000409 1785398487.845557 mapwrite 0x02d066 thru 0x035990 (0x892b bytes) 000410 1785398487.956083 fallocate 0x029772 thru 0x02e5e1 (0x4e70 bytes) 000413 1785398487.965720 read 0x021daf thru 0x0275e1 (0x5833 bytes) 000414 1785398487.966501 punch from 0x01d589 to 0x02d37c (0xfdf4 bytes) 000416 1785398487.984487 trunc from 0x035991 to 0x0205f1 (0x1539f bytes) 000417 1785398488.033083 trunc from 0x020510 to 0x0205f1 (0xe2 bytes) 000418 1785398488.043484 punch from 0x0113ce to 0x01dd6a (0xc99d bytes) 000419 1785398488.048315 write 0x03fa15 thru 0x03ffff (0x5eb bytes) 000420 1785398488.050292 punch from 0x039814 to 0x03e3b7 (0x4ba4 bytes) 000421 1785398488.066215 mapread 0x034f61 thru 0x03ffff (0xb09f bytes) 000422 1785398488.109251 read 0x03e438 thru 0x03ffff (0x1bc8 bytes) 000424 1785398488.123633 read 0x018162 thru 0x025f5b (0xddfa bytes) 000425 1785398488.126077 punch from 0x01d70f to 0x02496b (0x725d bytes) 000428 1785398488.152275 punch from 0x012faa to 0x013497 (0x4ee bytes) 000430 1785398488.164388 mapread 0x01ae09 thru 0x02384d (0x8a45 bytes) 000431 1785398488.192212 trunc from 0x040000 to 0x03b2ae (0x4d51 bytes) 000432 1785398488.218973 fallocate 0x02f76f thru 0x03891d (0x91af bytes) 000433 1785398488.226039 write 0x009442 thru 0x0167be (0xd37d bytes) 000435 1785398488.237631 write 0x028977 thru 0x02f583 (0x6c0d bytes) 000436 1785398488.249989 mapread 0x0079b9 thru 0x00fb59 (0x81a1 bytes) 000437 1785398488.269446 fallocate 0x038eff thru 0x03ffff (0x7101 bytes) 000439 1785398488.278636 mapread 0x026600 thru 0x02d894 (0x7295 bytes) 000440 1785398488.279819 write 0x00957a thru 0x013138 (0x9bbf bytes) 000444 1785398488.318821 punch from 0x026933 to 0x028a47 (0x2115 bytes) 000445 1785398488.361575 trunc from 0x03b2af to 0x000de4 (0x3a4ca bytes) 000446 1785398488.431871 trunc from 0x000a8e to 0x000de4 (0x357 bytes) 000447 1785398488.446563 mapwrite 0x023a97 thru 0x02779a (0x3d04 bytes) 000449 1785398488.604855 trunc from 0x02779b to 0x03ecb9 (0x1751f bytes) 000450 1785398488.640443 trunc from 0x00b411 to 0x00f8ae (0x449e bytes) 000451 1785398488.661020 punch from 0x000e3f to 0x009a11 (0x8bd3 bytes) 000452 1785398488.680490 mapread 0x031acf thru 0x0340b6 (0x25e8 bytes) 000453 1785398488.736110 fallocate 0x00c4a2 thru 0x00e04f (0x1bae bytes) 000454 1785398488.755048 read 0x02fc01 thru 0x03e890 (0xec90 bytes) 000455 1785398488.794188 mapwrite 0x02ab8e thru 0x02e1df (0x3652 bytes) 000458 1785398488.867171 MIRROR_EXTEND to 2 mirrors 000459 1785398490.860668 write 0x02e0a9 thru 0x031aff (0x3a57 bytes) 000461 1785398490.958028 trunc from 0x03ecba to 0x005f61 (0x38d58 bytes) 000462 1785398491.004980 read 0x005b58 thru 0x005f61 (0x40a bytes) 000463 1785398491.032424 read 0x0029af thru 0x005f61 (0x35b3 bytes) 000464 1785398491.048278 trunc from 0x005f62 to 0x0191e0 (0x1327f bytes) 000465 1785398491.104229 mapwrite 0x008780 thru 0x0103ec (0x7c6d bytes) 000466 1785398491.274506 punch from 0x00e037 to 0x0191e0 (0xb1aa bytes) 000468 1785398491.300075 mapread 0x0030da thru 0x00bf77 (0x8e9e bytes) 000469 1785398491.312992 trunc from 0x0191e1 to 0x03e537 (0x25357 bytes) 000471 1785398491.353078 trunc from 0x032eb2 to 0x036756 (0x38a5 bytes) 000472 1785398491.373497 fallocate 0x00c9e2 thru 0x00e488 (0x1aa7 bytes) 000473 1785398491.387515 punch from 0x038822 to 0x03e537 (0x5d16 bytes) 000474 1785398491.393215 fallocate 0x0040f5 thru 0x007930 (0x383c bytes) 000475 1785398491.418494 mapwrite 0x00db91 thru 0x00fe9d (0x230d bytes) 000476 1785398491.474474 mapread 0x019676 thru 0x020fce (0x7959 bytes) 000477 1785398491.498497 read 0x03b030 thru 0x03e537 (0x3508 bytes) 000478 1785398491.500094 write 0x019d05 thru 0x0278d7 (0xdbd3 bytes) 000479 1785398491.507542 mapread 0x010a2b thru 0x01af3b (0xa511 bytes) 000480 1785398491.531240 fallocate 0x01942b thru 0x01dc36 (0x480c bytes) 000481 1785398491.546154 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000484 1785398491.941174 write 0x018266 thru 0x023650 (0xb3eb bytes) 000486 1785398491.977528 mapread 0x018145 thru 0x01ff96 (0x7e52 bytes) 000487 1785398491.980092 mapread 0x036f1a thru 0x03e537 (0x761e bytes) 000488 1785398492.047004 mapread 0x02c63c thru 0x033948 (0x730d bytes) 000489 1785398492.095026 mapwrite 0x03e955 thru 0x03ffff (0x16ab bytes) 000490 1785398492.207901 trunc from 0x040000 to 0x019535 (0x26aca bytes) 000491 1785398492.260040 MIRROR_EXTEND to 2 mirrors 000492 1785398493.785880 write 0x035e36 thru 0x03c782 (0x694d bytes) 000493 1785398493.843755 mapread 0x0126dd thru 0x01fdc4 (0xd6e8 bytes) 000494 1785398493.945442 write 0x003178 thru 0x00e419 (0xb2a2 bytes) 000495 1785398493.978353 trunc from 0x03c783 to 0x007909 (0x34e79 bytes) 000497 1785398494.073830 trunc from 0x00790a to 0x03ec8e (0x37385 bytes) 000498 1785398494.126858 trunc from 0x03ec8f to 0x0243c3 (0x1a8cb bytes) 000499 1785398494.188005 fallocate 0x023750 thru 0x031d75 (0xe626 bytes) 000500 1785398494.204068 write 0x03f6db thru 0x03ffff (0x925 bytes) 000501 1785398494.205377 read 0x030ff8 thru 0x03b2c4 (0xa2cd bytes) 000502 1785398494.223961 trunc from 0x0341bf to 0x0396db (0x551d bytes) 000503 1785398494.255123 trunc from 0x00ce26 to 0x0121e2 (0x53bd bytes) 000504 1785398494.275875 write 0x014b31 thru 0x016635 (0x1b05 bytes) 000505 1785398494.319754 fallocate 0x01eefe thru 0x0266b7 (0x77ba bytes) 000506 1785398494.333636 read 0x03ec14 thru 0x03ffff (0x13ec bytes) 000507 1785398494.384644 punch from 0x02a26b to 0x035164 (0xaefa bytes) 000508 1785398494.417260 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000509 1785398494.884268 write 0x0122ad thru 0x01d8cc (0xb620 bytes) 000510 1785398494.922891 mapread 0x00c0b7 thru 0x011475 (0x53bf bytes) 000511 1785398494.951634 trunc from 0x02038b to 0x02733b (0x6fb1 bytes) 000512 1785398494.957191 punch from 0x03dcc4 to 0x03ffff (0x233c bytes) 000513 1785398494.981931 mapwrite 0x010793 thru 0x013846 (0x30b4 bytes) 000514 1785398495.089894 trunc from 0x007404 to 0x014f86 (0xdb83 bytes) 000515 1785398495.119191 trunc from 0x040000 to 0x00a0b2 (0x35f4d bytes) 000517 1785398495.143477 read 0x0034f2 thru 0x00a0b2 (0x6bc1 bytes) 000518 1785398495.206175 mapread 0x00406e thru 0x00a0b2 (0x6045 bytes) 000520 1785398495.234613 read 0x009725 thru 0x00a0b2 (0x98e bytes) 000522 1785398495.247237 mapwrite 0x032416 thru 0x037545 (0x5130 bytes) 000525 1785398495.414034 fallocate 0x0256d9 thru 0x02eca8 (0x95d0 bytes) 000526 1785398495.421294 punch from 0x028200 to 0x02bc1a (0x3a1b bytes) 000527 1785398495.441485 mapread 0x023e8a thru 0x02a8c1 (0x6a38 bytes) 000530 1785398495.537869 trunc from 0x00632a to 0x0102ba (0x9f91 bytes) 000531 1785398495.548724 read 0x0267fb thru 0x0327b0 (0xbfb6 bytes) 000532 1785398495.565480 fallocate 0x013028 thru 0x0148bc (0x1895 bytes) 000533 1785398495.594393 mapread 0x013c44 thru 0x017eb1 (0x426e bytes) 000534 1785398495.607442 write 0x002f3c thru 0x00a718 (0x77dd bytes) 000536 1785398495.609380 punch from 0x0350a9 to 0x037545 (0x249d bytes) 000538 1785398495.618160 write 0x03ca7e thru 0x03f907 (0x2e8a bytes) 000539 1785398495.619509 fallocate 0x028ef0 thru 0x029403 (0x514 bytes) 000540 1785398495.649881 write 0x0149e8 thru 0x016f9f (0x25b8 bytes) 000541 1785398495.650878 punch from 0x01a70a to 0x023004 (0x88fb bytes) 000542 1785398495.682060 punch from 0x036df0 to 0x03dded (0x6ffe bytes) 000543 1785398495.711429 fallocate 0x025248 thru 0x0333b9 (0xe172 bytes) 000545 1785398495.748621 fallocate 0x0225eb thru 0x02c3ea (0x9e00 bytes) 000546 1785398495.793761 read 0x00c323 thru 0x00de39 (0x1b17 bytes) 000547 1785398495.803824 trunc from 0x0076f2 to 0x00cc25 (0x5534 bytes) 000548 1785398495.845742 MIRROR_EXTEND to 2 mirrors 000549 1785398497.723980 mapwrite 0x00ecdf thru 0x01b6f6 (0xca18 bytes) 000550 1785398498.059250 mapwrite 0x02709b thru 0x02b774 (0x46da bytes) 000551 1785398498.148591 mapwrite 0x037ce7 thru 0x03eeaf (0x71c9 bytes) 000552 1785398498.273416 mapread 0x01fc63 thru 0x027498 (0x7836 bytes) 000553 1785398498.299400 MIRROR_RESYNC 2 mirrors 000554 1785398500.268563 trunc from 0x03f908 to 0x023ce1 (0x1bc26 bytes) 000555 1785398500.312613 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000557 1785398500.566565 mapwrite 0x0063e9 thru 0x00ad29 (0x4941 bytes) 000558 1785398500.614357 write 0x01fe5b thru 0x02f31f (0xf4c5 bytes) 000559 1785398500.629183 write 0x033c12 thru 0x033eea (0x2d9 bytes) 000561 1785398500.631109 mapwrite 0x01cec5 thru 0x01df09 (0x1045 bytes) 000562 1785398500.673294 punch from 0x02b239 to 0x02bada (0x8a2 bytes) 000563 1785398500.683055 fallocate 0x0016a2 thru 0x003215 (0x1b74 bytes) 000564 1785398500.712068 MIRROR_EXTEND to 2 mirrors 000565 1785398502.709034 write 0x026428 thru 0x026b93 (0x76c bytes) 000566 1785398502.930069 mapread 0x02fb9f thru 0x033eea (0x434c bytes) 000567 1785398503.037928 trunc from 0x033eeb to 0x0334fb (0x9ef bytes) 000568 1785398503.184920 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x334fc): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x334fc): Mirror 2: 0xf7dcff08 (stale) CRC-32 checksum value for chunk [0, 0x334fc): Mirror 1: 0x3a7d5780 Mirror 3: 0x3a7d5780 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x334fc: skipped 000570 1785398506.175833 punch from 0x019e7b to 0x01dc1a (0x3da0 bytes) 000571 1785398506.316303 mapwrite 0x0378c4 thru 0x03ffff (0x873c bytes) 000572 1785398506.574140 trunc from 0x0241f1 to 0x02fb24 (0xb934 bytes) 000573 1785398506.582596 write 0x03ff93 thru 0x03ffff (0x6d bytes) 000574 1785398506.587773 punch from 0x02f6c6 to 0x037397 (0x7cd2 bytes) 000575 1785398506.643676 trunc from 0x035c1f to 0x03c347 (0x6729 bytes) 000576 1785398506.671661 read 0x003774 thru 0x00c978 (0x9205 bytes) 000577 1785398506.770314 trunc from 0x040000 to 0x00fa6b (0x30594 bytes) 000578 1785398506.847266 read 0x0018ca thru 0x005fc8 (0x46ff bytes) 000579 1785398506.896964 punch from 0x009fb5 to 0x00fa6b (0x5ab7 bytes) 000580 1785398506.924241 MIRROR_RESYNC 3 mirrors 000581 1785398510.294365 write 0x0232b2 thru 0x023c30 (0x97f bytes) 000582 1785398510.493478 MIRROR_RESYNC 3 mirrors 000583 1785398513.560635 trunc from 0x0088ef to 0x00d5e1 (0x4cf3 bytes) 000584 1785398513.692510 write 0x002193 thru 0x00445c (0x22ca bytes) 000585 1785398513.734459 read 0x014536 thru 0x01c282 (0x7d4d bytes) 000586 1785398513.761433 write 0x031577 thru 0x0345ae (0x3038 bytes) 000587 1785398513.770446 trunc from 0x01cc52 to 0x02ad56 (0xe105 bytes) 000588 1785398513.794943 trunc from 0x0345af to 0x00468d (0x2ff21 bytes) 000589 1785398513.896540 read 0x001802 thru 0x00468d (0x2e8c bytes) 000590 1785398513.911061 fallocate 0x027a2a thru 0x02fd08 (0x82df bytes) 000591 1785398513.935086 fallocate 0x013bbb thru 0x01f7ac (0xbbf2 bytes) 000592 1785398513.960501 fallocate 0x030632 thru 0x03cf46 (0xc915 bytes) 000593 1785398513.977697 read 0x00141f thru 0x00468d (0x326f bytes) 000594 1785398513.999060 MIRROR_RESYNC 3 mirrors 000595 1785398515.450627 read 0x000c2d thru 0x00468d (0x3a61 bytes) 000596 1785398515.466409 fallocate 0x01a3d9 thru 0x0290e4 (0xed0c bytes) 000597 1785398515.543100 MIRROR_RESYNC 3 mirrors 000598 1785398517.139825 punch from 0x025175 to 0x0290e4 (0x3f70 bytes) 000599 1785398517.201193 fallocate 0x001bb2 thru 0x00ab8a (0x8fd9 bytes) 000600 1785398517.215754 write 0x0202fa thru 0x025aa5 (0x57ac bytes) 000601 1785398517.232143 fallocate 0x0296c4 thru 0x02dae9 (0x4426 bytes) 000602 1785398517.247272 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2daea): Mirror 2: 0xb8f42a70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2daea): Mirror 2: 0xb8f42a70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2daea: skipped 000603 1785398517.535066 trunc from 0x02daea to 0x008873 (0x25276 bytes) 000604 1785398517.559916 mapwrite 0x01a3a8 thru 0x02826a (0xdec3 bytes) 000605 1785398517.740423 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000606 1785398518.013864 fallocate 0x017bc7 thru 0x0183dd (0x817 bytes) 000608 1785398518.026889 read 0x01d65b thru 0x02826a (0xac10 bytes) 000609 1785398518.059054 write 0x021d2b thru 0x02ba30 (0x9d06 bytes) 000610 1785398518.071968 fallocate 0x03030f thru 0x033ad5 (0x37c7 bytes) 000611 1785398518.097727 trunc from 0x02ba31 to 0x030b71 (0x5141 bytes) 000612 1785398518.130492 fallocate 0x03cb70 thru 0x03ffff (0x3490 bytes) 000613 1785398518.161657 fallocate 0x009a53 thru 0x0144a2 (0xaa50 bytes) 000615 1785398518.189514 trunc from 0x024d24 to 0x030165 (0xb442 bytes) 000618 1785398518.249659 punch from 0x03666e to 0x03b0b1 (0x4a44 bytes) 000619 1785398518.256411 fallocate 0x015cd7 thru 0x0194ad (0x37d7 bytes) 000620 1785398518.268873 trunc from 0x01c735 to 0x020559 (0x3e25 bytes) 000621 1785398518.287731 write 0x0230b3 thru 0x027fbd (0x4f0b bytes) 000622 1785398518.306951 fallocate 0x01bd4e thru 0x01c809 (0xabc bytes) 000623 1785398518.342732 MIRROR_EXTEND to 2 mirrors 000624 1785398519.985075 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000626 1785398520.164108 trunc from 0x010635 to 0x016a04 (0x63d0 bytes) 000627 1785398520.179667 read 0x02e8c4 thru 0x0366b3 (0x7df0 bytes) 000628 1785398520.190096 trunc from 0x040000 to 0x038e89 (0x7176 bytes) 000629 1785398520.211385 read 0x01e19b thru 0x01e4ec (0x352 bytes) 000631 1785398520.225674 mapwrite 0x00c234 thru 0x01811c (0xbee9 bytes) 000632 1785398520.245370 mapwrite 0x01ad9a thru 0x026a1c (0xbc83 bytes) 000634 1785398520.269310 trunc from 0x029ede to 0x032906 (0x8a29 bytes) 000636 1785398520.281958 MIRROR_EXTEND to 2 mirrors 000637 1785398521.701090 punch from 0x000d6f to 0x00d388 (0xc61a bytes) 000638 1785398521.735023 trunc from 0x038e8a to 0x016dfb (0x2208e bytes) 000639 1785398521.756114 punch from 0x001640 to 0x00421e (0x2bdf bytes) 000640 1785398521.759752 punch from 0x002b22 to 0x011dc0 (0xf29f bytes) 000641 1785398521.764680 read 0x00f471 thru 0x011941 (0x24d1 bytes) 000642 1785398521.769066 trunc from 0x01418b to 0x016dfb (0x2c71 bytes) 000643 1785398521.773034 punch from 0x014c58 to 0x014e5c (0x205 bytes) 000644 1785398521.777073 trunc from 0x016dfc to 0x02358b (0xc790 bytes) 000645 1785398521.790629 fallocate 0x03a559 thru 0x03ffff (0x5aa7 bytes) 000646 1785398521.794924 punch from 0x01d2a8 to 0x02358b (0x62e4 bytes) 000647 1785398521.798597 write 0x036eb8 thru 0x03d26f (0x63b8 bytes) 000648 1785398521.800152 write 0x02c501 thru 0x02e173 (0x1c73 bytes) 000649 1785398521.807071 mapread 0x00ed55 thru 0x011958 (0x2c04 bytes) 000650 1785398521.814110 trunc from 0x00c0e6 to 0x016db4 (0xaccf bytes) 000651 1785398521.818978 read 0x024af1 thru 0x0273db (0x28eb bytes) 000652 1785398521.830552 MIRROR_RESYNC 2 mirrors 000653 1785398522.326914 write 0x0181e6 thru 0x01d9fe (0x5819 bytes) 000654 1785398522.351573 mapread 0x034496 thru 0x0389e9 (0x4554 bytes) 000655 1785398522.364955 read 0x030bb3 thru 0x03315a (0x25a8 bytes) 000656 1785398522.365635 write 0x01724a thru 0x018bfb (0x19b2 bytes) 000657 1785398522.369631 trunc from 0x03d270 to 0x002dc1 (0x3a4ae bytes) 000658 1785398522.412950 punch from 0x0002f6 to 0x002dc1 (0x2acc bytes) 000659 1785398522.436506 mapwrite 0x03a2e3 thru 0x03ffff (0x5d1d bytes) 000660 1785398522.541988 punch from 0x00755b to 0x00ce32 (0x58d8 bytes) 000661 1785398522.551464 trunc from 0x040000 to 0x009876 (0x36789 bytes) 000662 1785398522.601531 fallocate 0x01a4db thru 0x0273ba (0xcee0 bytes) 000663 1785398522.605954 fallocate 0x01948a thru 0x01eaec (0x5663 bytes) 000664 1785398522.631835 mapread 0x01210c thru 0x018a93 (0x6988 bytes) 000666 1785398522.685948 fallocate 0x001c9a thru 0x0083d7 (0x673e bytes) 000668 1785398522.711050 mapread 0x00e018 thru 0x01d04e (0xf037 bytes) 000669 1785398522.773236 mapread 0x01ff1a thru 0x024895 (0x497c bytes) 000670 1785398522.793621 trunc from 0x017e3c to 0x0234b5 (0xb67a bytes) 000671 1785398522.806072 punch from 0x005c6f to 0x006779 (0xb0b bytes) 000672 1785398522.819470 mapread 0x023fd2 thru 0x0270f1 (0x3120 bytes) 000673 1785398522.915560 MIRROR_RESYNC 2 mirrors 000674 1785398523.688341 read 0x00afa0 thru 0x01acc9 (0xfd2a bytes) 000676 1785398523.695608 fallocate 0x035791 thru 0x03ca7c (0x72ec bytes) 000677 1785398523.721073 trunc from 0x03ca7d to 0x03058e (0xc4ee bytes) 000678 1785398523.742082 mapread 0x018a46 thru 0x025baa (0xd165 bytes) 000679 1785398523.773983 trunc from 0x03058f to 0x030b6b (0x5dd bytes) 000680 1785398523.825540 trunc from 0x01f3af to 0x025726 (0x6378 bytes) 000682 1785398523.839995 mapread 0x02b61b thru 0x030b6b (0x5551 bytes) 000683 1785398523.884176 punch from 0x02eb3f to 0x030b6b (0x202d bytes) 000684 1785398523.892153 write 0x027768 thru 0x03431e (0xcbb7 bytes) 000685 1785398523.893815 mapwrite 0x03f341 thru 0x03ffff (0xcbf bytes) 000686 1785398523.932014 mapwrite 0x02d4cd thru 0x033186 (0x5cba bytes) 000687 1785398523.946403 read 0x028998 thru 0x033517 (0xab80 bytes) 000688 1785398523.947767 write 0x036c6a thru 0x0374eb (0x882 bytes) 000689 1785398523.964940 mapread 0x016dbc thru 0x025dd4 (0xf019 bytes) 000690 1785398523.967639 trunc from 0x006156 to 0x007e7c (0x1d27 bytes) 000691 1785398523.970878 mapwrite 0x00c4e0 thru 0x01c1bf (0xfce0 bytes) 000694 1785398523.996442 mapread 0x0174d6 thru 0x0196a7 (0x21d2 bytes) 000695 1785398523.998401 mapwrite 0x010b64 thru 0x01368c (0x2b29 bytes) 000696 1785398524.019425 fallocate 0x02994d thru 0x0396b9 (0xfd6d bytes) 000697 1785398524.036920 read 0x014727 thru 0x01f857 (0xb131 bytes) 000699 1785398524.050555 fallocate 0x008ff1 thru 0x00b462 (0x2472 bytes) 000700 1785398524.056896 punch from 0x028582 to 0x033d4d (0xb7cc bytes) 000701 1785398524.088536 write 0x03a41b thru 0x03d385 (0x2f6b bytes) 000702 1785398524.093635 read 0x01a320 thru 0x0269e8 (0xc6c9 bytes) 000705 1785398524.105440 mapwrite 0x0137d9 thru 0x015d38 (0x2560 bytes) 000707 1785398524.169240 read 0x02d24e thru 0x03186c (0x461f bytes) 000708 1785398524.199147 fallocate 0x01d273 thru 0x02bef6 (0xec84 bytes) 000709 1785398524.218183 mapread 0x02ea66 thru 0x031e3d (0x33d8 bytes) 000710 1785398524.219328 trunc from 0x03d5bd to 0x03ffff (0x2a43 bytes) 000711 1785398524.232393 punch from 0x008243 to 0x00a1c7 (0x1f85 bytes) 000712 1785398524.267029 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x32b647a5 Mirror 3: 0x32b647a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000713 1785398526.936426 MIRROR_RESYNC 3 mirrors 000714 1785398529.138241 mapread 0x010a0a thru 0x02017d (0xf774 bytes) 000715 1785398529.166766 MIRROR_EXTEND to 4 mirrors 000716 1785398530.048369 trunc from 0x040000 to 0x024ef3 (0x1b10c bytes) 000717 1785398530.108075 read 0x0212ad thru 0x024a92 (0x37e6 bytes) 000718 1785398530.117737 fallocate 0x00d968 thru 0x00ee5c (0x14f5 bytes) 000719 1785398530.123228 read 0x01bad5 thru 0x024ef3 (0x941f bytes) 000720 1785398530.136928 mapwrite 0x0141a0 thru 0x018e47 (0x4ca8 bytes) 000722 1785398530.165024 read 0x000cef thru 0x0081e6 (0x74f8 bytes) 000723 1785398530.165621 read 0x003d90 thru 0x013a2b (0xfc9c bytes) 000725 1785398530.169494 trunc from 0x024ef4 to 0x006899 (0x1e65a bytes) 000726 1785398530.213243 trunc from 0x00689a to 0x0264f1 (0x1fc58 bytes) 000728 1785398530.260197 punch from 0x0061d9 to 0x00b305 (0x512d bytes) 000729 1785398530.269294 mapread 0x01883a thru 0x01a125 (0x18ec bytes) 000730 1785398530.290528 mapwrite 0x01ed5d thru 0x02941e (0xa6c2 bytes) 000731 1785398530.392702 mapread 0x001053 thru 0x00cb1e (0xbacc bytes) 000733 1785398530.412473 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2941f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2941f): Mirror 2: 0x466d5a23 (stale) Mirror 3: 0x466d5a23 (stale) Mirror 4: 0x466d5a23 (stale) CRC-32 checksum value for chunk [0, 0x2941f): Mirror 1: 0xd937adae Mirror 5: 0xd937adae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2941f: skipped 000734 1785398531.369155 mapwrite 0x019403 thru 0x022fce (0x9bcc bytes) 000735 1785398531.518115 punch from 0x0062b6 to 0x007238 (0xf83 bytes) 000736 1785398531.537341 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2941f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2941f): Mirror 2: 0x466d5a23 (stale) Mirror 3: 0x466d5a23 (stale) Mirror 4: 0x466d5a23 (stale) Mirror 5: 0xd937adae (stale) CRC-32 checksum value for chunk [0, 0x2941f): Mirror 1: 0xbb224532 Mirror 6: 0xbb224532 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2941f: skipped 000737 1785398533.350643 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2941f): Mirror 3: 0x466d5a23 (stale) Mirror 4: 0x466d5a23 (stale) Mirror 5: 0xd937adae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2941f): Mirror 3: 0x466d5a23 (stale) Mirror 4: 0x466d5a23 (stale) Mirror 5: 0xd937adae (stale) CRC-32 checksum value for chunk [0, 0x2941f): Mirror 1: 0xbb224532 Mirror 6: 0xbb224532 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2941f: skipped 000738 1785398534.827153 trunc from 0x026005 to 0x02941e (0x341a bytes) 000739 1785398534.962867 read 0x01e926 thru 0x02941e (0xaaf9 bytes) 000741 1785398535.017808 trunc from 0x0102cf to 0x0129c5 (0x26f7 bytes) 000742 1785398535.027932 read 0x0234e5 thru 0x02941e (0x5f3a bytes) 000743 1785398535.046096 MIRROR_RESYNC 5 mirrors 000744 1785398537.092088 write 0x03747d thru 0x03ffff (0x8b83 bytes) 000745 1785398537.130859 read 0x02c518 thru 0x03bea5 (0xf98e bytes) 000746 1785398537.158635 MIRROR_RESYNC 5 mirrors 000747 1785398539.787264 MIRROR_RESYNC 5 mirrors 000748 1785398540.686135 fallocate 0x02c721 thru 0x0355d4 (0x8eb4 bytes) 000749 1785398540.773479 fallocate 0x00c532 thru 0x00eb21 (0x25f0 bytes) 000750 1785398540.796606 read 0x0004e3 thru 0x00e20a (0xdd28 bytes) 000751 1785398540.821534 trunc from 0x011145 to 0x018f1c (0x7dd8 bytes) 000752 1785398540.836168 write 0x01b122 thru 0x020134 (0x5013 bytes) 000753 1785398540.855549 read 0x013d35 thru 0x017479 (0x3745 bytes) 000754 1785398540.891513 trunc from 0x040000 to 0x00cb4f (0x334b0 bytes) 000755 1785398540.946409 fallocate 0x03d6d7 thru 0x03ffff (0x2929 bytes) 000756 1785398540.962598 read 0x005047 thru 0x011322 (0xc2dc bytes) 000757 1785398540.987977 punch from 0x03ea0f to 0x03ffff (0x15f1 bytes) 000758 1785398540.998497 mapwrite 0x02ee61 thru 0x035cb6 (0x6e56 bytes) 000759 1785398541.066531 fallocate 0x03d87c thru 0x03ffff (0x2784 bytes) 000760 1785398541.076113 mapwrite 0x027ef8 thru 0x028a17 (0xb20 bytes) 000763 1785398541.101566 mapwrite 0x0132da thru 0x01af80 (0x7ca7 bytes) 000764 1785398541.156429 write 0x0293de thru 0x036c1a (0xd83d bytes) 000765 1785398541.164054 mapwrite 0x03c53a thru 0x03ffff (0x3ac6 bytes) 000766 1785398541.230510 fallocate 0x004351 thru 0x006f71 (0x2c21 bytes) 000767 1785398541.246393 mapread 0x00cc1a thru 0x01bcf9 (0xf0e0 bytes) 000768 1785398541.261106 write 0x00ca8f thru 0x01b4ae (0xea20 bytes) 000769 1785398541.269077 mapwrite 0x015aef thru 0x025a6c (0xff7e bytes) 000770 1785398541.346959 mapwrite 0x03fef0 thru 0x03ffff (0x110 bytes) 000771 1785398541.405657 trunc from 0x00119c to 0x00dbb1 (0xca16 bytes) 000772 1785398541.425638 fallocate 0x0283db thru 0x02ed77 (0x699d bytes) 000773 1785398541.436755 mapwrite 0x024aac thru 0x02a57a (0x5acf bytes) 000774 1785398541.513204 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x4f7c1c84 (stale) Mirror 5: 0x4f7c1c84 (stale) Mirror 6: 0x4f7c1c84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x4f7c1c84 (stale) Mirror 5: 0x4f7c1c84 (stale) Mirror 6: 0x4f7c1c84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000775 1785398542.091494 mapread 0x005d10 thru 0x009bb6 (0x3ea7 bytes) 000776 1785398542.187627 read 0x02a292 thru 0x02d65d (0x33cc bytes) 000777 1785398542.203428 punch from 0x009335 to 0x00e466 (0x5132 bytes) 000778 1785398542.229973 fallocate 0x03c0ff thru 0x03ffff (0x3f01 bytes) 000779 1785398542.248151 trunc from 0x040000 to 0x03bbd1 (0x442e bytes) 000780 1785398542.301273 trunc from 0x03bbd2 to 0x022cde (0x18ef3 bytes) 000782 1785398542.361873 trunc from 0x022cdf to 0x00af3b (0x17da3 bytes) 000783 1785398542.387527 write 0x01d98f thru 0x022386 (0x49f8 bytes) 000784 1785398542.389610 punch from 0x0069b1 to 0x009e5f (0x34af bytes) 000786 1785398542.396989 fallocate 0x023634 thru 0x02c5fd (0x8fca bytes) 000787 1785398542.403276 mapwrite 0x02e1a8 thru 0x03097d (0x27d6 bytes) 000788 1785398542.461180 read 0x00b4bc thru 0x00fc6b (0x47b0 bytes) 000789 1785398542.476213 mapwrite 0x0066f4 thru 0x00cc9c (0x65a9 bytes) 000790 1785398542.505668 punch from 0x020b55 to 0x02e733 (0xdbdf bytes) 000791 1785398542.517478 punch from 0x007ec0 to 0x00f3ee (0x752f bytes) 000793 1785398542.535776 trunc from 0x001526 to 0x00a1bd (0x8c98 bytes) 000794 1785398542.542788 mapwrite 0x03f5d5 thru 0x03ffff (0xa2b bytes) 000795 1785398542.647091 mapwrite 0x00d157 thru 0x010d94 (0x3c3e bytes) 000796 1785398542.716395 read 0x008862 thru 0x008cb0 (0x44f bytes) 000798 1785398542.747474 punch from 0x0364a9 to 0x03fa55 (0x95ad bytes) 000799 1785398542.768218 MIRROR_RESYNC 4 mirrors 000801 1785398544.893923 fallocate 0x01ae32 thru 0x0218ce (0x6a9d bytes) 000804 1785398545.021894 mapwrite 0x018923 thru 0x01e99e (0x607c bytes) 000806 1785398545.113133 mapread 0x01c48c thru 0x029f3e (0xdab3 bytes) 000807 1785398545.146024 write 0x008327 thru 0x012193 (0x9e6d bytes) 000808 1785398545.184510 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x4bed9b05 (stale) Mirror 5: 0x4bed9b05 (stale) Mirror 6: 0x4bed9b05 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcfd103d9 Mirror 7: 0xcfd103d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000809 1785398546.968876 trunc from 0x0083fd to 0x0134d7 (0xb0db bytes) 000810 1785398547.074948 read 0x005e6c thru 0x00f107 (0x929c bytes) 000811 1785398547.102922 mapread 0x0397a2 thru 0x03ae43 (0x16a2 bytes) 000812 1785398547.137426 trunc from 0x040000 to 0x02a9ff (0x15600 bytes) 000813 1785398547.169427 trunc from 0x02aa00 to 0x013ad8 (0x16f27 bytes) 000814 1785398547.242091 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x13ad9): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13ad9): Mirror 4: 0x536b4b22 (stale) Mirror 5: 0x536b4b22 (stale) Mirror 6: 0x536b4b22 (stale) Mirror 7: 0xb05644a8 (stale) CRC-32 checksum value for chunk [0, 0x13ad9): Mirror 1: 0x78772e04 Mirror 8: 0x78772e04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13ad9: skipped 000815 1785398549.243521 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x13ad9): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13ad9): Mirror 4: 0x536b4b22 (stale) Mirror 5: 0x536b4b22 (stale) Mirror 6: 0x536b4b22 (stale) Mirror 7: 0xb05644a8 (stale) CRC-32 checksum value for chunk [0, 0x13ad9): Mirror 1: 0x78772e04 Mirror 8: 0x78772e04 Mirror 9: 0x78772e04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13ad9: skipped 000816 1785398550.765872 trunc from 0x013ad9 to 0x02d76c (0x19c94 bytes) 000817 1785398550.869217 trunc from 0x02d76d to 0x00241b (0x2b351 bytes) 000818 1785398550.893376 trunc from 0x00241c to 0x022f6b (0x20b50 bytes) 000819 1785398550.912095 mapwrite 0x0387cb thru 0x03e917 (0x614d bytes) 000820 1785398550.972109 write 0x02858e thru 0x034965 (0xc3d8 bytes) 000821 1785398550.984352 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e918): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e918): Mirror 4: 0x1a8ff64 (stale) Mirror 5: 0x1a8ff64 (stale) Mirror 6: 0x1a8ff64 (stale) Mirror 7: 0x2a25aabc (stale) Mirror 8: 0xbfcd5119 (stale) Mirror 9: 0xbfcd5119 (stale) CRC-32 checksum value for chunk [0, 0x3e918): Mirror 1: 0x53f5dc28 Mirror 10: 0x53f5dc28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e918: skipped 000823 1785398552.476548 read 0x02c11b thru 0x039a4a (0xd930 bytes) 000824 1785398552.527797 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e918): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e918): Mirror 4: 0x1a8ff64 (stale) Mirror 5: 0x1a8ff64 (stale) Mirror 6: 0x1a8ff64 (stale) Mirror 7: 0x2a25aabc (stale) Mirror 8: 0xbfcd5119 (stale) Mirror 9: 0xbfcd5119 (stale) CRC-32 checksum value for chunk [0, 0x3e918): Mirror 1: 0x53f5dc28 Mirror 10: 0x53f5dc28 Mirror 11: 0x53f5dc28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e918: skipped 000825 1785398554.594877 write 0x015a10 thru 0x0234d1 (0xdac2 bytes) 000826 1785398554.732272 punch from 0x0151aa to 0x023f36 (0xed8d bytes) 000827 1785398554.766274 fallocate 0x005ffc thru 0x010254 (0xa259 bytes) 000828 1785398554.771782 trunc from 0x03e918 to 0x0355f5 (0x9322 bytes) 000829 1785398554.821599 MIRROR_RESYNC 9 mirrors 000830 1785398559.947625 punch from 0x026432 to 0x02ac96 (0x4865 bytes) 000831 1785398560.040345 trunc from 0x0355f6 to 0x0023ee (0x33207 bytes) 000833 1785398560.113016 mapread 0x0000b2 thru 0x0023ee (0x233d bytes) 000834 1785398560.174916 trunc from 0x0023ef to 0x026a4f (0x24661 bytes) 000835 1785398560.193716 write 0x033576 thru 0x038c56 (0x56e1 bytes) 000836 1785398560.198935 write 0x03718c thru 0x03ffff (0x8e74 bytes) 000837 1785398560.206636 trunc from 0x03d27e to 0x03ffff (0x2d82 bytes) 000838 1785398560.251370 fallocate 0x00c6e7 thru 0x010538 (0x3e52 bytes) 000839 1785398560.277028 MIRROR_RESYNC 9 mirrors 000840 1785398563.730670 punch from 0x00ed4d to 0x010cc6 (0x1f7a bytes) 000841 1785398563.813595 fallocate 0x0212b4 thru 0x021651 (0x39e bytes) 000842 1785398563.829756 fallocate 0x026d91 thru 0x02fc3b (0x8eab bytes) 000843 1785398563.844549 trunc from 0x040000 to 0x01cb06 (0x234f9 bytes) 000844 1785398563.917109 write 0x008e3c thru 0x013283 (0xa448 bytes) 000845 1785398563.960515 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1cb07): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cb07): Mirror 4: 0xaa1aa657 (stale) Mirror 5: 0xaa1aa657 (stale) Mirror 6: 0xaa1aa657 (stale) Mirror 7: 0xaa1aa657 (stale) Mirror 8: 0xaa1aa657 (stale) Mirror 9: 0xaa1aa657 (stale) Mirror 10: 0xaa1aa657 (stale) Mirror 11: 0xaa1aa657 (stale) CRC-32 checksum value for chunk [0, 0x1cb07): Mirror 1: 0xb9baa5a5 Mirror 12: 0xb9baa5a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cb07: skipped 000846 1785398565.246299 fallocate 0x02c827 thru 0x02dec8 (0x16a2 bytes) 000847 1785398565.311221 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dec9): Mirror 4: 0x9feaaafa (stale) Mirror 5: 0x9feaaafa (stale) Mirror 6: 0x9feaaafa (stale) Mirror 7: 0x9feaaafa (stale) Mirror 8: 0x9feaaafa (stale) Mirror 9: 0x9feaaafa (stale) Mirror 11: 0x9feaaafa (stale) Mirror 12: 0xda30148d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dec9): Mirror 4: 0x9feaaafa (stale) Mirror 5: 0x9feaaafa (stale) Mirror 6: 0x9feaaafa (stale) Mirror 7: 0x9feaaafa (stale) Mirror 8: 0x9feaaafa (stale) Mirror 9: 0x9feaaafa (stale) Mirror 11: 0x9feaaafa (stale) Mirror 12: 0xda30148d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dec9: skipped 000848 1785398565.959277 trunc from 0x02dec9 to 0x01d737 (0x10791 bytes) 000849 1785398565.987750 MIRROR_RESYNC 9 mirrors 000850 1785398568.129182 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000851 1785398568.917120 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) 000852 1785398569.836127 fallocate 0x010fed thru 0x0164c9 (0x54dd bytes) 000853 1785398569.939219 trunc from 0x01d738 to 0x01d98a (0x253 bytes) 000856 1785398569.992731 mapwrite 0x00f458 thru 0x013b50 (0x46f9 bytes) 000857 1785398570.105874 punch from 0x0017b1 to 0x002ef6 (0x1746 bytes) 000858 1785398570.120390 mapread 0x00b208 thru 0x018e52 (0xdc4b bytes) 000860 1785398570.131667 fallocate 0x00c385 thru 0x00e9e2 (0x265e bytes) 000861 1785398570.166186 mapwrite 0x00f5a4 thru 0x013a02 (0x445f bytes) 000862 1785398570.233726 punch from 0x001ea2 to 0x0084f1 (0x6650 bytes) 000863 1785398570.257951 mapwrite 0x01dcf8 thru 0x02c530 (0xe839 bytes) 000865 1785398570.444133 write 0x002132 thru 0x00c91c (0xa7eb bytes) 000866 1785398570.465136 read 0x013e73 thru 0x0210b3 (0xd241 bytes) 000867 1785398570.467185 fallocate 0x014de6 thru 0x02423e (0xf459 bytes) 000868 1785398570.480703 write 0x01a1fe thru 0x028924 (0xe727 bytes) 000869 1785398570.494222 trunc from 0x00113b to 0x00676c (0x5632 bytes) 000870 1785398570.551492 mapread 0x017c46 thru 0x0268c6 (0xec81 bytes) 000871 1785398570.559631 mapread 0x01a988 thru 0x01badf (0x1158 bytes) 000872 1785398570.560569 trunc from 0x02c531 to 0x0261b4 (0x637c bytes) 000873 1785398570.626412 trunc from 0x02516e to 0x0261b4 (0x1047 bytes) 000874 1785398570.641956 trunc from 0x0261b5 to 0x021de5 (0x43cf bytes) 000875 1785398570.678429 write 0x03194a thru 0x03a09d (0x8754 bytes) 000876 1785398570.692987 trunc from 0x03a09e to 0x032d81 (0x731c bytes) 000877 1785398570.762598 trunc from 0x032d82 to 0x0203c8 (0x129b9 bytes) 000878 1785398570.796677 MIRROR_RESYNC 7 mirrors 000879 1785398573.015310 mapread 0x00e9f7 thru 0x011424 (0x2a2e bytes) 000880 1785398573.062399 mapwrite 0x03b13d thru 0x03ffff (0x4ec3 bytes) 000881 1785398573.266496 read 0x02576f thru 0x032e63 (0xd6f5 bytes) 000882 1785398573.352630 write 0x0239bd thru 0x02bf29 (0x856d bytes) 000883 1785398573.383551 mapread 0x0004b5 thru 0x002864 (0x23b0 bytes) 000885 1785398573.416208 mapwrite 0x02b4c2 thru 0x035503 (0xa042 bytes) 000886 1785398573.487966 punch from 0x03f9a0 to 0x03ffff (0x660 bytes) 000887 1785398573.520541 fallocate 0x01ceb0 thru 0x01ec77 (0x1dc8 bytes) 000888 1785398573.530709 trunc from 0x040000 to 0x02e698 (0x11967 bytes) 000889 1785398573.612626 mapwrite 0x016e2b thru 0x01d5a4 (0x677a bytes) 000890 1785398573.713747 punch from 0x01f7c2 to 0x023098 (0x38d7 bytes) 000891 1785398573.735584 mapread 0x00b2e0 thru 0x019af6 (0xe817 bytes) 000892 1785398573.745575 trunc from 0x0235e2 to 0x02e698 (0xb0b7 bytes) 000893 1785398573.789591 fallocate 0x018a49 thru 0x02250c (0x9ac4 bytes) 000894 1785398573.813915 mapwrite 0x0080ce thru 0x016ca9 (0xebdc bytes) 000895 1785398573.909434 write 0x022495 thru 0x032078 (0xfbe4 bytes) 000896 1785398573.929642 trunc from 0x032079 to 0x023d76 (0xe302 bytes) 000897 1785398573.993963 mapread 0x0222cc thru 0x023d76 (0x1aab bytes) 000898 1785398573.995188 mapread 0x01bcf5 thru 0x022e3c (0x7148 bytes) 000899 1785398574.028965 trunc from 0x012374 to 0x01301f (0xcac bytes) 000900 1785398574.073982 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23d77): Mirror 6: 0x23b4df30 (stale) Mirror 7: 0x23b4df30 (stale) Mirror 8: 0x23b4df30 (stale) Mirror 11: 0x23b4df30 (stale) Mirror 12: 0x23b4df30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23d77): Mirror 6: 0x23b4df30 (stale) Mirror 7: 0x23b4df30 (stale) Mirror 8: 0x23b4df30 (stale) Mirror 11: 0x23b4df30 (stale) Mirror 12: 0x23b4df30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23d77: skipped 000901 1785398575.377604 read 0x01fc81 thru 0x023d76 (0x40f6 bytes) 000902 1785398575.407885 read 0x01de4f thru 0x0202bc (0x246e bytes) 000903 1785398575.455437 punch from 0x021862 to 0x023d76 (0x2515 bytes) 000904 1785398575.472103 mapread 0x01609e thru 0x020dd8 (0xad3b bytes) 000905 1785398575.481523 mapwrite 0x010b4e thru 0x017c91 (0x7144 bytes) 000906 1785398575.542432 mapwrite 0x02424b thru 0x02c91a (0x86d0 bytes) 000907 1785398575.691983 read 0x016083 thru 0x0162ca (0x248 bytes) 000908 1785398575.693923 mapwrite 0x03c378 thru 0x03ffff (0x3c88 bytes) 000909 1785398575.756909 write 0x00b5df thru 0x01a1f0 (0xec12 bytes) 000910 1785398575.760100 trunc from 0x040000 to 0x03cd43 (0x32bc bytes) 000911 1785398575.803487 trunc from 0x0005bd to 0x00e0e3 (0xdb27 bytes) 000912 1785398575.833508 fallocate 0x0121a4 thru 0x01a482 (0x82df bytes) 000913 1785398575.844374 fallocate 0x017b3b thru 0x01c94d (0x4e13 bytes) 000914 1785398575.849630 trunc from 0x03cd44 to 0x02e676 (0xe6cd bytes) 000915 1785398575.896013 read 0x01af99 thru 0x026036 (0xb09e bytes) 000916 1785398575.896873 mapread 0x025e56 thru 0x02e676 (0x8821 bytes) 000917 1785398575.902294 write 0x0308fa thru 0x03729b (0x69a2 bytes) 000918 1785398575.906263 punch from 0x02ed62 to 0x033702 (0x49a1 bytes) 000919 1785398575.923434 mapread 0x01d674 thru 0x029d88 (0xc715 bytes) 000921 1785398575.925152 trunc from 0x03729c to 0x025639 (0x11c62 bytes) 000922 1785398575.957501 mapread 0x00079b thru 0x003a34 (0x329a bytes) 000923 1785398575.982599 fallocate 0x02b3ce thru 0x035c34 (0xa867 bytes) 000924 1785398575.991801 mapwrite 0x0304d4 thru 0x032167 (0x1c94 bytes) 000925 1785398576.080367 mapread 0x025bfa thru 0x02e6f5 (0x8afc bytes) 000927 1785398576.084994 write 0x02a7cd thru 0x0349a9 (0xa1dd bytes) 000928 1785398576.089727 trunc from 0x0349aa to 0x021cf2 (0x12cb7 bytes) 000929 1785398576.116828 trunc from 0x021cf3 to 0x028662 (0x6970 bytes) 000930 1785398576.142733 fallocate 0x02c335 thru 0x02ef8a (0x2c56 bytes) 000931 1785398576.148677 read 0x00e538 thru 0x014cab (0x6774 bytes) 000932 1785398576.149303 fallocate 0x005524 thru 0x00c24a (0x6d27 bytes) 000933 1785398576.161025 read 0x014185 thru 0x0232b9 (0xf135 bytes) 000934 1785398576.194319 trunc from 0x020799 to 0x025a44 (0x52ac bytes) 000935 1785398576.232329 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28663): Mirror 6: 0xe3eedb7d (stale) Mirror 7: 0xe3eedb7d (stale) Mirror 11: 0xe3eedb7d (stale) Mirror 12: 0xe3eedb7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28663): Mirror 6: 0xe3eedb7d (stale) Mirror 7: 0xe3eedb7d (stale) Mirror 11: 0xe3eedb7d (stale) Mirror 12: 0xe3eedb7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28663: skipped 000936 1785398576.913592 mapwrite 0x005876 thru 0x01146c (0xbbf7 bytes) 000937 1785398576.956738 write 0x024432 thru 0x0341d2 (0xfda1 bytes) 000938 1785398576.969956 read 0x0051c6 thru 0x009908 (0x4743 bytes) 000939 1785398576.970837 mapwrite 0x025030 thru 0x032058 (0xd029 bytes) 000940 1785398576.995082 fallocate 0x004ffb thru 0x00a314 (0x531a bytes) 000941 1785398577.005313 fallocate 0x0133a2 thru 0x01e97d (0xb5dc bytes) 000942 1785398577.010457 trunc from 0x0341d3 to 0x02115b (0x13077 bytes) 000943 1785398577.029276 punch from 0x01fdec to 0x02115b (0x1370 bytes) 000944 1785398577.038724 mapwrite 0x01df22 thru 0x029fae (0xc08d bytes) 000945 1785398577.161822 mapread 0x002c06 thru 0x00b12d (0x8528 bytes) 000946 1785398577.163220 write 0x032f6e thru 0x03ffff (0xd092 bytes) 000947 1785398577.171503 write 0x03f96e thru 0x03ffff (0x692 bytes) 000948 1785398577.176034 trunc from 0x040000 to 0x004c5f (0x3b3a0 bytes) 000949 1785398577.210522 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x4c60): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4c60): Mirror 6: 0xd90188e6 (stale) Mirror 7: 0xd90188e6 (stale) Mirror 11: 0xd90188e6 (stale) Mirror 12: 0xd90188e6 (stale) CRC-32 checksum value for chunk [0, 0x4c60): Mirror 1: 0xd90188e6 Mirror 13: 0xd90188e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4c60: skipped 000950 1785398578.799348 trunc from 0x004c60 to 0x006a00 (0x1da1 bytes) 000951 1785398579.059252 trunc from 0x002a1e to 0x0058c5 (0x2ea8 bytes) 000952 1785398579.077082 trunc from 0x002771 to 0x0036a6 (0xf36 bytes) 000953 1785398579.099315 mapwrite 0x00db46 thru 0x01be87 (0xe342 bytes) 000955 1785398579.325312 mapwrite 0x038d61 thru 0x03ffff (0x729f bytes) 000956 1785398579.441297 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x3049d618 (stale) Mirror 7: 0x3049d618 (stale) Mirror 11: 0x3049d618 (stale) Mirror 12: 0x3049d618 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x3049d618 (stale) Mirror 7: 0x3049d618 (stale) Mirror 11: 0x3049d618 (stale) Mirror 12: 0x3049d618 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000957 1785398580.022322 trunc from 0x00f78b to 0x01183d (0x20b3 bytes) 000958 1785398580.032356 mapwrite 0x024b81 thru 0x02b184 (0x6604 bytes) 000959 1785398580.112215 punch from 0x010b1c to 0x0131e5 (0x26ca bytes) 000960 1785398580.120347 read 0x02e8a2 thru 0x031446 (0x2ba5 bytes) 000961 1785398580.150022 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x3049d618 (stale) Mirror 11: 0x3049d618 (stale) Mirror 12: 0x3049d618 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x3049d618 (stale) Mirror 11: 0x3049d618 (stale) Mirror 12: 0x3049d618 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000963 1785398580.836824 mapwrite 0x00abd4 thru 0x01204b (0x7478 bytes) 000965 1785398580.959202 trunc from 0x030868 to 0x037b25 (0x72be bytes) 000966 1785398580.967701 read 0x032974 thru 0x03a2ee (0x797b bytes) 000967 1785398581.001935 trunc from 0x00e5ef to 0x01e458 (0xfe6a bytes) 000968 1785398581.016967 punch from 0x028f48 to 0x0331ea (0xa2a3 bytes) 000970 1785398581.033236 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x124:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3049d618 (stale) Mirror 12: 0x3049d618 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3049d618 (stale) Mirror 12: 0x3049d618 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000971 1785398581.830155 mapread 0x035b60 thru 0x036ff5 (0x1496 bytes) 000972 1785398581.851988 mapread 0x03440e thru 0x03ffff (0xbbf2 bytes) 000973 1785398581.943172 trunc from 0x021170 to 0x02e90f (0xd7a0 bytes) 000974 1785398581.965344 trunc from 0x02d273 to 0x036e94 (0x9c22 bytes) 000975 1785398582.007544 MIRROR_RESYNC 3 mirrors 000976 1785398582.882140 trunc from 0x040000 to 0x02034f (0x1fcb0 bytes) 000978 1785398582.954375 trunc from 0x020350 to 0x029f66 (0x9c17 bytes) 000979 1785398582.989716 mapwrite 0x028820 thru 0x03686a (0xe04b bytes) 000980 1785398583.175180 mapread 0x030034 thru 0x03686a (0x6837 bytes) 000981 1785398583.178130 fallocate 0x00e425 thru 0x019dec (0xb9c8 bytes) 000982 1785398583.192102 punch from 0x00dc7a to 0x01478d (0x6b14 bytes) 000983 1785398583.201425 read 0x02c89c thru 0x03250e (0x5c73 bytes) 000984 1785398583.222746 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3686b): Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3686b): Mirror 11: 0xb50b2f5a (stale) Mirror 12: 0xb50b2f5a (stale) CRC-32 checksum value for chunk [0, 0x3686b): Mirror 1: 0x98fe8fc7 Mirror 13: 0x98fe8fc7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3686b: skipped 000985 1785398584.210279 trunc from 0x02846d to 0x02dc80 (0x5814 bytes) 000986 1785398584.296160 mapread 0x02869d thru 0x03686a (0xe1ce bytes) 000987 1785398584.361935 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3686b): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3686b): Mirror 11: 0xb50b2f5a (stale) Mirror 12: 0xb50b2f5a (stale) Mirror 13: 0x98fe8fc7 (stale) CRC-32 checksum value for chunk [0, 0x3686b): Mirror 1: 0x437d82e7 Mirror 14: 0x437d82e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3686b: skipped 000988 1785398585.942301 mapread 0x012273 thru 0x01c999 (0xa727 bytes) 000990 1785398586.077124 punch from 0x00fe04 to 0x01d9b0 (0xdbad bytes) 000991 1785398586.160190 fallocate 0x00e434 thru 0x0171f6 (0x8dc3 bytes) 000992 1785398586.164766 write 0x03aaab thru 0x03ffff (0x5555 bytes) 000993 1785398586.181298 mapread 0x03ca85 thru 0x03ffff (0x357b bytes) 000994 1785398586.183373 punch from 0x01a0c1 to 0x0229bb (0x88fb bytes) 000995 1785398586.193203 mapread 0x01cba4 thru 0x023970 (0x6dcd bytes) 000996 1785398586.213197 punch from 0x012296 to 0x01cc3d (0xa9a8 bytes) 000997 1785398586.225128 write 0x03e938 thru 0x03ffff (0x16c8 bytes) 000998 1785398586.226112 fallocate 0x0206db thru 0x028649 (0x7f6f bytes) 000999 1785398586.233714 read 0x016016 thru 0x01adab (0x4d96 bytes) 001000 1785398586.248059 trunc from 0x03ba02 to 0x03ffff (0x45fe bytes) All operations completed A-OK!