== sanity-flr test 70a: flr mode fsx test ================ 03:18:09 (1782631089) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 1090 skipping zero size read fallocating to largest ever: 0x2a96b 000004 1782631090.591863 fallocate 0x020b57 thru 0x02a96a (0x9e14 bytes) 000005 1782631090.595498 write 0x0126dd thru 0x01a291 (0x7bb5 bytes) 000006 1782631090.600845 mapread 0x01ccf9 thru 0x0207f1 (0x3af9 bytes) 000007 1782631090.609696 punch from 0x023d47 to 0x02a96a (0x6c24 bytes) 000008 1782631090.611843 trunc from 0x01afa3 to 0x021342 (0x63a0 bytes) truncating to largest ever: 0x30d04 000009 1782631090.617172 trunc from 0x02a96b to 0x030d03 (0x6399 bytes) 000011 1782631090.623244 fallocate 0x004be3 thru 0x00550f (0x92d bytes) 000012 1782631090.626338 fallocate 0x008d9f thru 0x00af7d (0x21df bytes) 000014 1782631090.629536 trunc from 0x030d04 to 0x01b1fa (0x15b09 bytes) 000015 1782631090.635097 write 0x030f51 thru 0x038090 (0x7140 bytes) 000016 1782631090.636464 write 0x024138 thru 0x032a37 (0xe900 bytes) 000017 1782631090.639661 mapread 0x017690 thru 0x025d8b (0xe6fc bytes) 000022 1782631090.647169 mapread 0x00f194 thru 0x01b023 (0xbe90 bytes) 000023 1782631090.653502 MIRROR_EXTEND to 2 mirrors 000024 1782631090.848142 trunc from 0x005929 to 0x01559c (0xfc74 bytes) fallocating to largest ever: 0x40000 000025 1782631090.859538 fallocate 0x03bd26 thru 0x03ffff (0x42da bytes) 000026 1782631090.863593 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000027 1782631090.908252 read 0x033c9f thru 0x036e4c (0x31ae bytes) 000028 1782631090.911349 trunc from 0x038091 to 0x015b4f (0x22541 bytes) 000029 1782631090.923249 write 0x0385a8 thru 0x03a6c9 (0x2122 bytes) 000030 1782631090.924473 write 0x0171a1 thru 0x01b16e (0x3fce bytes) 000031 1782631090.928209 trunc from 0x03a6ca to 0x0290bb (0x1160e bytes) 000032 1782631090.933756 write 0x030e0f thru 0x036051 (0x5243 bytes) 000033 1782631090.934769 write 0x03ac51 thru 0x03ffff (0x53af bytes) 000034 1782631090.935527 fallocate 0x00901a thru 0x0145fd (0xb5e4 bytes) 000035 1782631090.937812 trunc from 0x0004ed to 0x003df8 (0x390c bytes) 000036 1782631090.941743 MIRROR_EXTEND to 2 mirrors 000037 1782631091.183922 mapwrite 0x025aa2 thru 0x027611 (0x1b70 bytes) 000038 1782631091.222725 fallocate 0x014e83 thru 0x02336c (0xe4ea bytes) 000039 1782631091.225049 punch from 0x020f83 to 0x02d7ba (0xc838 bytes) 000040 1782631091.227120 trunc from 0x040000 to 0x031b32 (0xe4cd bytes) 000041 1782631091.234774 trunc from 0x023adc to 0x027db6 (0x42db bytes) 000042 1782631091.236773 mapwrite 0x03df1d thru 0x03ffff (0x20e3 bytes) 000043 1782631091.251724 trunc from 0x027cf0 to 0x02f421 (0x7732 bytes) 000044 1782631091.253839 punch from 0x009a6e to 0x019567 (0xfafa bytes) 000045 1782631091.255839 fallocate 0x01f7fb thru 0x0207b1 (0xfb7 bytes) 000047 1782631091.258402 trunc from 0x0395c8 to 0x03ffff (0x6a38 bytes) 000048 1782631091.260755 mapread 0x00ebb5 thru 0x00f3ab (0x7f7 bytes) 000049 1782631091.264677 mapwrite 0x002978 thru 0x0070e5 (0x476e bytes) 000050 1782631091.273932 mapwrite 0x01080f thru 0x018433 (0x7c25 bytes) 000051 1782631091.285606 read 0x0181bb thru 0x0253ad (0xd1f3 bytes) 000052 1782631091.290129 trunc from 0x003f07 to 0x004690 (0x78a bytes) 000054 1782631091.295498 MIRROR_RESYNC 2 mirrors 000055 1782631091.504658 MIRROR_EXTEND to 3 mirrors 000056 1782631091.691542 mapread 0x037ee1 thru 0x03d5ec (0x570c bytes) 000057 1782631091.697717 trunc from 0x040000 to 0x003167 (0x3ce98 bytes) 000058 1782631091.724342 trunc from 0x002734 to 0x003167 (0xa34 bytes) 000059 1782631091.728343 fallocate 0x03ee83 thru 0x03ffff (0x117d bytes) 000060 1782631091.730696 mapread 0x01f3c9 thru 0x02086b (0x14a3 bytes) 000061 1782631091.734400 trunc from 0x040000 to 0x038936 (0x76c9 bytes) 000062 1782631091.742056 punch from 0x034f0d to 0x035a59 (0xb4d bytes) 000064 1782631091.745030 read 0x037da7 thru 0x038936 (0xb90 bytes) 000065 1782631091.749353 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38937): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38937): Mirror 2: 0x9a8294d3 (stale) Mirror 3: 0x9a8294d3 (stale) CRC-32 checksum value for chunk [0, 0x38937): Mirror 1: 0xf05cef14 Mirror 4: 0xf05cef14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38937: skipped 000066 1782631092.018283 read 0x01e47c thru 0x021dba (0x393f bytes) 000067 1782631092.022738 trunc from 0x025643 to 0x03438e (0xed4c bytes) 000068 1782631092.033183 trunc from 0x038937 to 0x0156a1 (0x23295 bytes) 000069 1782631092.047419 mapread 0x005f9a thru 0x010900 (0xa967 bytes) 000070 1782631092.054816 read 0x0124f9 thru 0x014dfb (0x2903 bytes) 000071 1782631092.059034 mapwrite 0x02bb92 thru 0x035390 (0x97ff bytes) 000073 1782631092.078260 read 0x017964 thru 0x0238b3 (0xbf50 bytes) 000074 1782631092.078796 fallocate 0x01cc70 thru 0x02c2ee (0xf67f bytes) 000075 1782631092.081316 write 0x02adeb thru 0x037b97 (0xcdad bytes) 000076 1782631092.082398 write 0x017ae7 thru 0x0261dc (0xe6f6 bytes) 000077 1782631092.083348 fallocate 0x01655e thru 0x017adc (0x157f bytes) 000078 1782631092.085783 trunc from 0x037b98 to 0x0006ac (0x374eb bytes) 000079 1782631092.092742 mapread 0x0004a9 thru 0x0006ac (0x204 bytes) 000080 1782631092.093465 mapwrite 0x009435 thru 0x018da6 (0xf972 bytes) 000081 1782631092.115073 write 0x022687 thru 0x023668 (0xfe2 bytes) 000082 1782631092.115929 punch from 0x01f191 to 0x023668 (0x44d8 bytes) 000083 1782631092.119968 mapread 0x000ddd thru 0x00b5b8 (0xa7dc bytes) 000084 1782631092.122932 MIRROR_RESYNC 4 mirrors 000085 1782631092.406176 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000086 1782631092.531796 mapwrite 0x02e8f7 thru 0x0357d9 (0x6ee3 bytes) 000088 1782631092.569402 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x357da): Mirror 3: 0x85c0ad7f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x357da): Mirror 3: 0x85c0ad7f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x357da: skipped 000089 1782631092.676524 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x357da): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x357da): Mirror 3: 0x85c0ad7f (stale) CRC-32 checksum value for chunk [0, 0x357da): Mirror 1: 0x767af620 Mirror 4: 0x767af620 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x357da: skipped 000090 1782631092.933748 trunc from 0x00a735 to 0x0145be (0x9e8a bytes) 000091 1782631092.945656 mapread 0x0014d2 thru 0x00c513 (0xb042 bytes) 000092 1782631092.953304 write 0x01f7d3 thru 0x024368 (0x4b96 bytes) 000094 1782631092.960238 read 0x0226a1 thru 0x0251f0 (0x2b50 bytes) 000095 1782631092.963037 mapwrite 0x007e03 thru 0x00dd7c (0x5f7a bytes) 000096 1782631092.972814 trunc from 0x0357da to 0x039eed (0x4714 bytes) 000097 1782631092.988244 MIRROR_RESYNC 3 mirrors 000098 1782631093.323278 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000099 1782631093.437753 punch from 0x024617 to 0x02ba4f (0x7439 bytes) 000100 1782631093.447666 mapwrite 0x0313cd thru 0x03d056 (0xbc8a bytes) 000102 1782631093.471238 punch from 0x00785a to 0x0174ca (0xfc71 bytes) 000103 1782631093.473828 fallocate 0x03a57b thru 0x03a7a8 (0x22e bytes) 000104 1782631093.476539 punch from 0x00a38e to 0x0139bc (0x962f bytes) 000105 1782631093.478783 punch from 0x01dce6 to 0x0227c2 (0x4add bytes) 000106 1782631093.481108 punch from 0x026160 to 0x02abff (0x4aa0 bytes) 000107 1782631093.483027 write 0x003ea6 thru 0x00b63a (0x7795 bytes) 000108 1782631093.487174 read 0x00e095 thru 0x01b720 (0xd68c bytes) 000109 1782631093.490432 mapwrite 0x021b8e thru 0x02a058 (0x84cb bytes) 000110 1782631093.502462 write 0x005b6d thru 0x012b70 (0xd004 bytes) 000111 1782631093.503737 mapread 0x0075ac thru 0x00c55c (0x4fb1 bytes) 000112 1782631093.504657 mapread 0x001d0d thru 0x00549f (0x3793 bytes) 000113 1782631093.509057 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d057): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d057): Mirror 4: 0x9431d26b (stale) CRC-32 checksum value for chunk [0, 0x3d057): Mirror 1: 0xfa78bfdf Mirror 5: 0xfa78bfdf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d057: skipped 000114 1782631093.781015 read 0x02764c thru 0x029826 (0x21db bytes) 000116 1782631093.789443 trunc from 0x008c9a to 0x0093ba (0x721 bytes) 000117 1782631093.803180 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d057): Mirror 5: 0xfa78bfdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d057): Mirror 5: 0xfa78bfdf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d057: skipped 000118 1782631093.892346 mapread 0x012d93 thru 0x01d80b (0xaa79 bytes) 000119 1782631093.903721 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d057): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d057): Mirror 5: 0xfa78bfdf (stale) CRC-32 checksum value for chunk [0, 0x3d057): Mirror 1: 0x10c11d71 Mirror 6: 0x10c11d71 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d057: skipped 000120 1782631094.197843 mapread 0x018d5b thru 0x0226ff (0x99a5 bytes) 000121 1782631094.208584 trunc from 0x0046bd to 0x006e4d (0x2791 bytes) 000122 1782631094.219893 trunc from 0x03d057 to 0x02b489 (0x11bcd bytes) 000123 1782631094.226781 trunc from 0x02b48a to 0x026635 (0x4e54 bytes) 000124 1782631094.231486 mapread 0x01d7ca thru 0x026635 (0x8e6c bytes) 000125 1782631094.239920 fallocate 0x0298c9 thru 0x031bdd (0x8315 bytes) 000126 1782631094.242003 trunc from 0x026636 to 0x02fafd (0x94c8 bytes) 000127 1782631094.246953 fallocate 0x03d922 thru 0x03ffff (0x26de bytes) 000128 1782631094.249065 trunc from 0x02fafe to 0x010c14 (0x1eee9 bytes) 000129 1782631094.254744 mapread 0x00dac9 thru 0x010c14 (0x314c bytes) 000130 1782631094.258486 trunc from 0x009aaf to 0x00ea7a (0x4fcc bytes) 000131 1782631094.260606 mapread 0x00bca5 thru 0x010c14 (0x4f70 bytes) 000132 1782631094.264353 fallocate 0x033e82 thru 0x03b250 (0x73cf bytes) 000133 1782631094.266637 fallocate 0x00b269 thru 0x01a319 (0xf0b1 bytes) 000134 1782631094.268963 trunc from 0x0082c2 to 0x010c14 (0x8953 bytes) 000135 1782631094.271565 read 0x001868 thru 0x009aeb (0x8284 bytes) 000136 1782631094.274888 read 0x0076b9 thru 0x010c14 (0x955c bytes) 000137 1782631094.278557 read 0x00b528 thru 0x010c14 (0x56ed bytes) 000139 1782631094.281725 MIRROR_RESYNC 3 mirrors 000140 1782631094.517095 trunc from 0x010c15 to 0x006af8 (0xa11c bytes) 000141 1782631094.533814 mapwrite 0x035128 thru 0x03ffff (0xaed8 bytes) 000142 1782631094.554010 trunc from 0x040000 to 0x014aa4 (0x2b55b bytes) 000143 1782631094.559744 read 0x009304 thru 0x014aa4 (0xb7a1 bytes) 000144 1782631094.563326 fallocate 0x021fd9 thru 0x02ef6f (0xcf97 bytes) 000145 1782631094.565910 punch from 0x018444 to 0x01a331 (0x1eee bytes) 000146 1782631094.567845 write 0x016b04 thru 0x02203f (0xb53c bytes) 000147 1782631094.572206 punch from 0x0268d8 to 0x02ef6f (0x8698 bytes) 000148 1782631094.574299 fallocate 0x005452 thru 0x0100ee (0xac9d bytes) 000149 1782631094.576444 mapread 0x0022f5 thru 0x00db08 (0xb814 bytes) 000150 1782631094.580207 punch from 0x01064f to 0x020519 (0xfecb bytes) 000151 1782631094.585355 trunc from 0x0131a4 to 0x01ed61 (0xbbbe bytes) 000152 1782631094.587468 punch from 0x00b0b7 to 0x016b42 (0xba8c bytes) 000154 1782631094.590349 mapread 0x019f89 thru 0x0280a5 (0xe11d bytes) 000155 1782631094.599962 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ef70): Mirror 5: 0xde5c416d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef70): Mirror 5: 0xde5c416d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef70: skipped 000156 1782631094.689883 trunc from 0x0250c1 to 0x02ef6f (0x9eaf bytes) 000158 1782631094.692573 mapwrite 0x00166f thru 0x00c625 (0xafb7 bytes) 000159 1782631094.707518 mapread 0x012779 thru 0x01e4d0 (0xbd58 bytes) 000160 1782631094.713476 mapwrite 0x033db5 thru 0x034eed (0x1139 bytes) 000161 1782631094.727191 trunc from 0x034eee to 0x004154 (0x30d99 bytes) 000162 1782631094.732517 fallocate 0x002a13 thru 0x00339c (0x98a bytes) 000163 1782631094.734593 fallocate 0x02b6d0 thru 0x03736d (0xbc9e bytes) 000164 1782631094.736822 trunc from 0x004dff to 0x00c74c (0x794e bytes) 000165 1782631094.738719 fallocate 0x011f7b thru 0x012443 (0x4c9 bytes) 000166 1782631094.741078 read 0x00a13a thru 0x019366 (0xf22d bytes) 000167 1782631094.744375 trunc from 0x015a3a to 0x017e2d (0x23f4 bytes) 000168 1782631094.746484 punch from 0x031473 to 0x03736d (0x5efb bytes) 000170 1782631094.748592 trunc from 0x02ab52 to 0x03736d (0xc81c bytes) 000171 1782631094.750811 punch from 0x01438c to 0x01f401 (0xb076 bytes) 000172 1782631094.753212 trunc from 0x01a6ce to 0x021947 (0x727a bytes) 000173 1782631094.755434 punch from 0x01f856 to 0x020b6f (0x131a bytes) 000174 1782631094.757366 read 0x025415 thru 0x02bfc4 (0x6bb0 bytes) 000175 1782631094.761544 trunc from 0x01a03d to 0x01e49e (0x4462 bytes) 000176 1782631094.763546 fallocate 0x010eef thru 0x0194a3 (0x85b5 bytes) 000177 1782631094.765863 trunc from 0x010b2c to 0x018968 (0x7e3d bytes) 000178 1782631094.769958 MIRROR_RESYNC 2 mirrors 000179 1782631094.944539 trunc from 0x03736e to 0x023773 (0x13bfa bytes) 000180 1782631094.962050 read 0x003c53 thru 0x00ddad (0xa15b bytes) 000181 1782631094.965730 trunc from 0x023774 to 0x038144 (0x149d1 bytes) 000183 1782631094.975025 MIRROR_RESYNC 2 mirrors 000184 1782631095.143412 mapwrite 0x031cdb thru 0x03ffff (0xe325 bytes) 000185 1782631095.168706 trunc from 0x040000 to 0x008cdc (0x37323 bytes) 000186 1782631095.175726 mapwrite 0x004179 thru 0x007c05 (0x3a8d bytes) 000189 1782631095.185753 punch from 0x005df8 to 0x008cdc (0x2ee5 bytes) 000190 1782631095.188464 trunc from 0x008cdd to 0x004ae9 (0x41f3 bytes) 000191 1782631095.194174 trunc from 0x004aea to 0x003cac (0xe3d bytes) 000192 1782631095.199227 read 0x001cf2 thru 0x003cac (0x1fbb bytes) 000193 1782631095.199822 mapwrite 0x021fa3 thru 0x0221bd (0x21b bytes) 000194 1782631095.214444 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x221be): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x221be): Mirror 5: 0xffa79617 (stale) CRC-32 checksum value for chunk [0, 0x221be): Mirror 1: 0x68d861b9 Mirror 6: 0x68d861b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x221be: skipped 000195 1782631095.431279 punch from 0x00405c to 0x005f73 (0x1f18 bytes) 000196 1782631095.443084 fallocate 0x019bca thru 0x01a4d9 (0x910 bytes) 000197 1782631095.445740 trunc from 0x0221be to 0x0214a9 (0xd14 bytes) 000199 1782631095.461919 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x214aa): Mirror 5: 0x977ccc90 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x214aa): Mirror 5: 0x977ccc90 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x214aa: skipped 000200 1782631095.556175 MIRROR_RESYNC 2 mirrors 000201 1782631095.727558 trunc from 0x0214aa to 0x02c2b1 (0xae08 bytes) 000202 1782631095.744852 read 0x008d08 thru 0x00aadb (0x1dd4 bytes) 000203 1782631095.747368 trunc from 0x02c2b2 to 0x00f413 (0x1ce9e bytes) 000204 1782631095.755879 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000205 1782631095.798913 write 0x0236e6 thru 0x02dbef (0xa50a bytes) 000206 1782631095.802061 trunc from 0x0222d9 to 0x0239a6 (0x16ce bytes) 000208 1782631095.807360 read 0x022eb2 thru 0x02b690 (0x87df bytes) 000209 1782631095.809993 punch from 0x00dc2b to 0x01a4ea (0xc8c0 bytes) 000210 1782631095.811973 trunc from 0x005e68 to 0x015109 (0xf2a2 bytes) 000211 1782631095.814023 trunc from 0x025d5b to 0x02dbef (0x7e95 bytes) 000213 1782631095.816561 mapread 0x02ae50 thru 0x02dbef (0x2da0 bytes) 000214 1782631095.823412 read 0x018e46 thru 0x01e0be (0x5279 bytes) 000215 1782631095.827153 trunc from 0x01af4e to 0x0256ad (0xa760 bytes) 000217 1782631095.829946 mapread 0x0157e7 thru 0x01e95b (0x9175 bytes) 000218 1782631095.838875 fallocate 0x013117 thru 0x0167dd (0x36c7 bytes) 000219 1782631095.841316 mapwrite 0x02dde4 thru 0x037e6d (0xa08a bytes) 000220 1782631095.860527 MIRROR_EXTEND to 2 mirrors 000221 1782631096.038932 mapread 0x003ac3 thru 0x01070b (0xcc49 bytes) 000222 1782631096.048981 trunc from 0x037e6e to 0x0273d2 (0x10a9b bytes) 000223 1782631096.068745 fallocate 0x00c182 thru 0x013a90 (0x790f bytes) 000224 1782631096.070672 trunc from 0x0273d3 to 0x01f8a3 (0x7b2f bytes) 000226 1782631096.077242 mapwrite 0x02f6bb thru 0x03c1ce (0xcb14 bytes) 000227 1782631096.098659 mapwrite 0x005d96 thru 0x009803 (0x3a6e bytes) 000228 1782631096.109125 write 0x028f75 thru 0x0322ec (0x9378 bytes) 000229 1782631096.110198 trunc from 0x03c1cf to 0x036fe9 (0x51e5 bytes) 000230 1782631096.118093 trunc from 0x036fea to 0x018724 (0x1e8c5 bytes) 000231 1782631096.127076 MIRROR_RESYNC 2 mirrors 000232 1782631096.331937 punch from 0x004327 to 0x00640e (0x20e8 bytes) 000233 1782631096.344553 trunc from 0x018725 to 0x0224b3 (0x9d8f bytes) 000234 1782631096.352707 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000237 1782631096.390960 read 0x01320b thru 0x0224b3 (0xf2a9 bytes) 000238 1782631096.394086 fallocate 0x01387c thru 0x01c8d7 (0x905c bytes) 000241 1782631096.397470 trunc from 0x01bb66 to 0x021de8 (0x6283 bytes) 000243 1782631096.400072 write 0x009dc2 thru 0x010220 (0x645f bytes) 000244 1782631096.405511 mapread 0x00f08c thru 0x019fff (0xaf74 bytes) 000245 1782631096.409772 read 0x00056b thru 0x0026c4 (0x215a bytes) 000246 1782631096.413437 read 0x009b35 thru 0x00b57a (0x1a46 bytes) 000248 1782631096.414538 punch from 0x01afb2 to 0x0224b3 (0x7502 bytes) 000250 1782631096.417368 read 0x004ebf thru 0x00945c (0x459e bytes) 000251 1782631096.418023 trunc from 0x0224b4 to 0x02edbb (0xc908 bytes) 000253 1782631096.423158 trunc from 0x02edbc to 0x0015db (0x2d7e0 bytes) 000257 1782631096.431093 trunc from 0x001559 to 0x0015db (0x83 bytes) 000258 1782631096.433780 read 0x000ba3 thru 0x000e85 (0x2e3 bytes) 000259 1782631096.434262 punch from 0x000493 to 0x0015db (0x1149 bytes) 000260 1782631096.436169 mapwrite 0x01e7a9 thru 0x02c1a1 (0xd9f9 bytes) 000261 1782631096.454316 trunc from 0x02c1a2 to 0x015109 (0x17098 bytes) 000264 1782631096.460444 write 0x0103f0 thru 0x01d85f (0xd470 bytes) 000265 1782631096.461903 trunc from 0x015c96 to 0x017491 (0x17fc bytes) 000266 1782631096.467340 trunc from 0x01d860 to 0x02b6af (0xde50 bytes) 000267 1782631096.472883 trunc from 0x00d4eb to 0x01b98b (0xe4a1 bytes) 000268 1782631096.475292 read 0x0069b7 thru 0x0114b8 (0xab02 bytes) 000269 1782631096.479284 punch from 0x0111ec to 0x012907 (0x171c bytes) 000270 1782631096.481326 trunc from 0x01aa15 to 0x01f28c (0x4878 bytes) 000271 1782631096.483381 write 0x01a285 thru 0x02736a (0xd0e6 bytes) 000273 1782631096.486427 trunc from 0x0237ff to 0x02b6af (0x7eb1 bytes) 000274 1782631096.492671 MIRROR_EXTEND to 2 mirrors 000275 1782631096.672019 read 0x018c67 thru 0x01bd76 (0x3110 bytes) 000276 1782631096.676465 trunc from 0x02b6b0 to 0x03bade (0x1042f bytes) 000277 1782631096.693954 write 0x02cb2f thru 0x02ec5c (0x212e bytes) 000278 1782631096.697179 fallocate 0x014b7a thru 0x0212ba (0xc741 bytes) 000279 1782631096.699340 punch from 0x03a3b6 to 0x03bade (0x1729 bytes) 000280 1782631096.701247 trunc from 0x03badf to 0x0217ea (0x1a2f4 bytes) 000281 1782631096.707238 mapwrite 0x026419 thru 0x0297a1 (0x3389 bytes) 000283 1782631096.725174 trunc from 0x02101f to 0x0297a1 (0x8783 bytes) 000284 1782631096.729512 MIRROR_RESYNC 2 mirrors 000285 1782631096.925140 write 0x001883 thru 0x01057e (0xecfc bytes) 000287 1782631096.939250 trunc from 0x00aa2c to 0x00e5d5 (0x3baa bytes) 000288 1782631096.944456 punch from 0x02873f to 0x0297a1 (0x1063 bytes) 000289 1782631096.946714 trunc from 0x0020ef to 0x0103c1 (0xe2d3 bytes) 000290 1782631096.948990 mapwrite 0x027958 thru 0x02f95a (0x8003 bytes) 000291 1782631096.977027 fallocate 0x016b12 thru 0x025593 (0xea82 bytes) 000292 1782631096.979535 read 0x00e19b thru 0x019654 (0xb4ba bytes) 000294 1782631096.983854 trunc from 0x0085da to 0x015278 (0xcc9f bytes) 000295 1782631096.986406 mapread 0x02a823 thru 0x02f95a (0x5138 bytes) 000296 1782631096.987324 trunc from 0x02f95b to 0x0150fb (0x1a85f bytes) 000298 1782631096.994913 punch from 0x00e206 to 0x0150fb (0x6ef6 bytes) 000299 1782631096.997100 trunc from 0x014d3e to 0x0150fb (0x3be bytes) 000300 1782631096.998918 fallocate 0x007f1d thru 0x00b242 (0x3326 bytes) 000301 1782631097.001017 trunc from 0x0150fc to 0x01c9c6 (0x78cb bytes) 000302 1782631097.006936 write 0x024e40 thru 0x033590 (0xe751 bytes) 000303 1782631097.008246 fallocate 0x02bf20 thru 0x0382a8 (0xc389 bytes) 000305 1782631097.010944 read 0x0026e8 thru 0x00b942 (0x925b bytes) 000306 1782631097.015744 punch from 0x02d867 to 0x0382a8 (0xaa42 bytes) 000307 1782631097.021354 write 0x0148b3 thru 0x0207d3 (0xbf21 bytes) 000309 1782631097.022993 write 0x018ee7 thru 0x019c33 (0xd4d bytes) 000310 1782631097.023756 read 0x014368 thru 0x01db34 (0x97cd bytes) 000311 1782631097.024214 trunc from 0x01c0f7 to 0x01c858 (0x762 bytes) 000312 1782631097.029829 trunc from 0x0382a9 to 0x03e1ad (0x5f05 bytes) 000313 1782631097.035483 mapwrite 0x0290a8 thru 0x036dfe (0xdd57 bytes) 000315 1782631097.050544 write 0x001ce6 thru 0x0041de (0x24f9 bytes) 000316 1782631097.051634 read 0x0199cb thru 0x022bc1 (0x91f7 bytes) 000317 1782631097.052196 trunc from 0x0298ff to 0x0325b0 (0x8cb2 bytes) 000318 1782631097.055242 mapwrite 0x03a7d2 thru 0x03ffff (0x582e bytes) 000319 1782631097.071823 punch from 0x02f988 to 0x03448a (0x4b03 bytes) 000320 1782631097.073730 trunc from 0x011341 to 0x019438 (0x80f8 bytes) 000321 1782631097.075658 mapread 0x025ff9 thru 0x030a3d (0xaa45 bytes) 000322 1782631097.079437 mapread 0x016ed7 thru 0x025216 (0xe340 bytes) 000323 1782631097.085764 fallocate 0x013921 thru 0x0204c9 (0xcba9 bytes) 000324 1782631097.087803 read 0x00ab60 thru 0x00e85f (0x3d00 bytes) 000326 1782631097.088695 mapwrite 0x0035aa thru 0x009531 (0x5f88 bytes) 000327 1782631097.094750 write 0x036ba5 thru 0x03ffff (0x945b bytes) 000328 1782631097.095705 trunc from 0x040000 to 0x006596 (0x39a69 bytes) 000329 1782631097.101060 mapread 0x0010c2 thru 0x002de1 (0x1d20 bytes) 000330 1782631097.101727 read 0x002cc4 thru 0x006596 (0x38d3 bytes) 000331 1782631097.102174 write 0x02761c thru 0x028c00 (0x15e5 bytes) 000332 1782631097.102912 trunc from 0x01d00a to 0x01e48e (0x1485 bytes) 000333 1782631097.104509 trunc from 0x00102a to 0x003e27 (0x2dfe bytes) 000335 1782631097.106560 fallocate 0x004fa6 thru 0x0096ea (0x4745 bytes) 000336 1782631097.108514 mapwrite 0x01cae9 thru 0x01e979 (0x1e91 bytes) 000337 1782631097.117377 write 0x00b297 thru 0x012042 (0x6dac bytes) 000338 1782631097.120265 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000340 1782631097.170832 write 0x012268 thru 0x01bbe8 (0x9981 bytes) 000341 1782631097.180650 fallocate 0x038ad5 thru 0x03d66e (0x4b9a bytes) 000342 1782631097.183279 mapread 0x01e9d0 thru 0x024914 (0x5f45 bytes) 000343 1782631097.192143 mapwrite 0x02b2b2 thru 0x03849f (0xd1ee bytes) 000344 1782631097.215011 mapread 0x00bc56 thru 0x01446b (0x8816 bytes) 000345 1782631097.220145 trunc from 0x0384a0 to 0x025b3b (0x12964 bytes) 000346 1782631097.226962 mapwrite 0x01d287 thru 0x01d94c (0x6c6 bytes) 000347 1782631097.232404 mapread 0x020421 thru 0x025b3b (0x571b bytes) 000348 1782631097.233456 fallocate 0x017ef8 thru 0x019915 (0x1a1e bytes) 000349 1782631097.236673 mapread 0x00d78f thru 0x0198c1 (0xc133 bytes) 000351 1782631097.238496 read 0x01c146 thru 0x0230b9 (0x6f74 bytes) 000352 1782631097.239063 mapwrite 0x0190ae thru 0x027736 (0xe689 bytes) 000353 1782631097.256827 trunc from 0x027737 to 0x0173b5 (0x10381 bytes) 000354 1782631097.262797 fallocate 0x012049 thru 0x015b6e (0x3b26 bytes) 000355 1782631097.265162 trunc from 0x0173b6 to 0x0203f8 (0x9043 bytes) 000356 1782631097.271004 write 0x019374 thru 0x01b01f (0x1cac bytes) 000358 1782631097.276848 read 0x014028 thru 0x0154a3 (0x147c bytes) 000359 1782631097.277274 mapread 0x00ede2 thru 0x018170 (0x938f bytes) 000360 1782631097.281096 read 0x0095b5 thru 0x00db3f (0x458b bytes) 000361 1782631097.281675 punch from 0x00bf9f to 0x01aae9 (0xeb4b bytes) 000363 1782631097.286141 mapwrite 0x00306b thru 0x00bf2f (0x8ec5 bytes) 000364 1782631097.300099 MIRROR_EXTEND to 2 mirrors 000365 1782631097.498710 read 0x00ec0d thru 0x0119fb (0x2def bytes) 000366 1782631097.503852 read 0x00560d thru 0x00e338 (0x8d2c bytes) 000367 1782631097.510064 fallocate 0x00ba53 thru 0x00c1b7 (0x765 bytes) 000368 1782631097.522125 punch from 0x01ce6f to 0x0203f8 (0x358a bytes) 000369 1782631097.523955 mapwrite 0x020e22 thru 0x022f47 (0x2126 bytes) 000370 1782631097.547393 fallocate 0x034977 thru 0x03ffff (0xb689 bytes) 000371 1782631097.550490 read 0x01d517 thru 0x022f47 (0x5a31 bytes) 000372 1782631097.555366 write 0x000774 thru 0x00e656 (0xdee3 bytes) 000373 1782631097.556693 trunc from 0x022f48 to 0x012610 (0x10937 bytes) 000374 1782631097.564010 punch from 0x00e51b to 0x012610 (0x40f6 bytes) 000375 1782631097.570438 mapwrite 0x012668 thru 0x01d5b5 (0xaf4e bytes) 000376 1782631097.603537 trunc from 0x01d5b6 to 0x02c7dc (0xf227 bytes) 000377 1782631097.609814 MIRROR_RESYNC 2 mirrors 000379 1782631097.795385 read 0x00e3b6 thru 0x01c2f5 (0xdf40 bytes) 000380 1782631097.798384 trunc from 0x02c7dd to 0x00eea1 (0x1d93b bytes) 000382 1782631097.817394 trunc from 0x003e57 to 0x00eea1 (0xb04b bytes) 000383 1782631097.819803 fallocate 0x03d149 thru 0x03f8ae (0x2766 bytes) 000384 1782631097.822365 write 0x036f9e thru 0x0394dc (0x253f bytes) 000385 1782631097.826757 trunc from 0x03f8af to 0x018da1 (0x26b0d bytes) 000386 1782631097.833810 write 0x03611f thru 0x0382ad (0x218f bytes) 000387 1782631097.834689 read 0x02add3 thru 0x03744d (0xc67b bytes) 000388 1782631097.840848 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x382ae): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x382ae): Mirror 2: 0xa8ba24a1 (stale) CRC-32 checksum value for chunk [0, 0x382ae): Mirror 1: 0x358b2ac5 Mirror 3: 0x358b2ac5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x382ae: skipped 000389 1782631098.093612 trunc from 0x0382ae to 0x02e6f9 (0x9bb4 bytes) 000390 1782631098.114995 punch from 0x00344a to 0x00400a (0xbc1 bytes) 000391 1782631098.118180 MIRROR_RESYNC 3 mirrors 000392 1782631098.347987 punch from 0x02e12b to 0x02e6f9 (0x5cf bytes) 000393 1782631098.356485 read 0x012436 thru 0x01cf79 (0xab44 bytes) 000394 1782631098.360086 write 0x003af9 thru 0x013876 (0xfd7e bytes) 000395 1782631098.365360 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e6fa): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e6fa): Mirror 2: 0xb2c56c47 (stale) Mirror 3: 0xb2c56c47 (stale) CRC-32 checksum value for chunk [0, 0x2e6fa): Mirror 1: 0xaa6c9e94 Mirror 4: 0xaa6c9e94 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e6fa: skipped 000396 1782631098.625085 fallocate 0x02cbd9 thru 0x039098 (0xc4c0 bytes) 000397 1782631098.639157 mapwrite 0x02b8e1 thru 0x0360fa (0xa81a bytes) 000398 1782631098.658473 read 0x013fdf thru 0x01584c (0x186e bytes) 000399 1782631098.661228 trunc from 0x020c3e to 0x025537 (0x48fa bytes) 000400 1782631098.663879 trunc from 0x039099 to 0x009a2c (0x2f66c bytes) 000401 1782631098.677586 write 0x002cb6 thru 0x007419 (0x4764 bytes) 000402 1782631098.681541 mapread 0x007206 thru 0x009a2c (0x2827 bytes) 000404 1782631098.685060 mapread 0x0017e3 thru 0x00983d (0x805b bytes) 000405 1782631098.685895 mapwrite 0x017a23 thru 0x0263fe (0xe9dc bytes) 000407 1782631098.708078 trunc from 0x0263ff to 0x0263d0 (0x2e bytes) 000411 1782631098.714915 mapwrite 0x0177b6 thru 0x022cbd (0xb508 bytes) 000412 1782631098.724585 read 0x01d364 thru 0x0207f2 (0x348f bytes) 000413 1782631098.725066 trunc from 0x0263d1 to 0x022efe (0x34d2 bytes) 000414 1782631098.731478 mapread 0x0172bb thru 0x01b02b (0x3d71 bytes) 000415 1782631098.732410 fallocate 0x004f62 thru 0x00f0de (0xa17d bytes) 000416 1782631098.735313 punch from 0x00b57b to 0x012319 (0x6d9f bytes) 000417 1782631098.737886 fallocate 0x0154a7 thru 0x01e89f (0x93f9 bytes) 000418 1782631098.740748 trunc from 0x0187d2 to 0x022efe (0xa72d bytes) 000419 1782631098.743687 mapwrite 0x026145 thru 0x02969a (0x3556 bytes) 000420 1782631098.765363 trunc from 0x02969b to 0x03e63d (0x14fa3 bytes) 000421 1782631098.771997 punch from 0x00037e to 0x008537 (0x81ba bytes) 000422 1782631098.774817 mapwrite 0x00cb92 thru 0x010c21 (0x4090 bytes) 000423 1782631098.782594 write 0x00f769 thru 0x01f23d (0xfad5 bytes) 000424 1782631098.784182 read 0x0281db thru 0x02f89e (0x76c4 bytes) 000425 1782631098.789602 read 0x03bc50 thru 0x03e63d (0x29ee bytes) 000426 1782631098.790219 read 0x028c11 thru 0x02c976 (0x3d66 bytes) 000429 1782631098.791928 mapwrite 0x01c443 thru 0x01cce5 (0x8a3 bytes) 000430 1782631098.800549 fallocate 0x002f85 thru 0x00cc5e (0x9cda bytes) 000431 1782631098.805050 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e63e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e63e): Mirror 2: 0xca52396d (stale) Mirror 3: 0xca52396d (stale) Mirror 4: 0xb161667c (stale) CRC-32 checksum value for chunk [0, 0x3e63e): Mirror 1: 0x5e223bce Mirror 5: 0x5e223bce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e63e: skipped 000432 1782631099.136797 write 0x0392b4 thru 0x03ec99 (0x59e6 bytes) 000433 1782631099.158456 MIRROR_RESYNC 5 mirrors 000435 1782631099.680343 punch from 0x02b382 to 0x02bcfc (0x97b bytes) 000436 1782631099.693036 mapwrite 0x02d8d1 thru 0x03117f (0x38af bytes) 000437 1782631099.707503 write 0x0096f4 thru 0x018059 (0xe966 bytes) 000438 1782631099.712572 trunc from 0x003394 to 0x00eec6 (0xbb33 bytes) 000439 1782631099.720812 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ec9a): Mirror 3: 0x817257b3 (stale) Mirror 4: 0x817257b3 (stale) Mirror 5: 0x817257b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec9a): Mirror 3: 0x817257b3 (stale) Mirror 4: 0x817257b3 (stale) Mirror 5: 0x817257b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec9a: skipped 000440 1782631099.835695 trunc from 0x03ec9a to 0x02aa5d (0x1423c bytes) 000442 1782631099.842691 mapread 0x01c195 thru 0x02aa5d (0xe8c9 bytes) 000443 1782631099.851912 trunc from 0x02aa5e to 0x032408 (0x79ab bytes) 000444 1782631099.857458 mapwrite 0x03920d thru 0x03ffff (0x6df3 bytes) 000445 1782631099.872461 mapread 0x03e6e0 thru 0x03ffff (0x1920 bytes) 000446 1782631099.875216 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdcc2c699 (stale) Mirror 4: 0xdcc2c699 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdcc2c699 (stale) Mirror 4: 0xdcc2c699 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000447 1782631099.979848 read 0x01b226 thru 0x028a47 (0xd822 bytes) 000448 1782631099.983522 mapwrite 0x00ffc4 thru 0x010117 (0x154 bytes) 000449 1782631099.993737 write 0x000959 thru 0x00e47a (0xdb22 bytes) 000450 1782631100.000335 write 0x03b290 thru 0x03ceec (0x1c5d bytes) 000451 1782631100.004498 fallocate 0x00be71 thru 0x019135 (0xd2c5 bytes) 000452 1782631100.007486 read 0x03a940 thru 0x03ffff (0x56c0 bytes) 000453 1782631100.012034 mapread 0x0308df thru 0x030dbf (0x4e1 bytes) 000454 1782631100.012932 trunc from 0x00f1b1 to 0x0143f7 (0x5247 bytes) 000456 1782631100.016167 trunc from 0x040000 to 0x0222b6 (0x1dd49 bytes) 000457 1782631100.023418 trunc from 0x0222b7 to 0x0047a1 (0x1db15 bytes) 000458 1782631100.030248 read 0x00222b thru 0x0047a1 (0x2577 bytes) 000459 1782631100.032799 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x47a2): Mirror 3: 0x74a06c4c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x47a2): Mirror 3: 0x74a06c4c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x47a2: skipped 000460 1782631100.128613 punch from 0x002b2d to 0x0047a1 (0x1c75 bytes) 000461 1782631100.130917 read 0x001ecc thru 0x0047a1 (0x28d6 bytes) 000462 1782631100.133696 trunc from 0x0047a2 to 0x02c310 (0x27b6f bytes) 000463 1782631100.140789 write 0x02c83e thru 0x03ba51 (0xf214 bytes) 000465 1782631100.144482 write 0x0177bc thru 0x02400d (0xc852 bytes) 000466 1782631100.148992 trunc from 0x027047 to 0x0358e3 (0xe89d bytes) 000467 1782631100.154689 trunc from 0x00b0d0 to 0x00b97f (0x8b0 bytes) 000468 1782631100.156495 fallocate 0x0055c6 thru 0x00a4e4 (0x4f1f bytes) 000469 1782631100.159063 mapwrite 0x038c3d thru 0x03ffff (0x73c3 bytes) 000471 1782631100.176110 punch from 0x026b5f to 0x02e768 (0x7c0a bytes) 000472 1782631100.178290 trunc from 0x032298 to 0x03acd3 (0x8a3c bytes) 000474 1782631100.180754 write 0x001087 thru 0x006361 (0x52db bytes) 000476 1782631100.183602 fallocate 0x008254 thru 0x017b38 (0xf8e5 bytes) 000477 1782631100.185782 mapwrite 0x03deb5 thru 0x03ffff (0x214b bytes) 000478 1782631100.192926 fallocate 0x02499f thru 0x032016 (0xd678 bytes) 000479 1782631100.195259 read 0x018c06 thru 0x02016f (0x756a bytes) 000480 1782631100.197473 MIRROR_RESYNC 2 mirrors 000481 1782631100.389206 punch from 0x038bdf to 0x038cd9 (0xfb bytes) 000482 1782631100.401305 trunc from 0x0150b2 to 0x01c620 (0x756f bytes) 000483 1782631100.403890 fallocate 0x032220 thru 0x03adbc (0x8b9d bytes) 000484 1782631100.406711 trunc from 0x01856f to 0x0215dc (0x906e bytes) 000485 1782631100.409505 trunc from 0x024e05 to 0x02ef50 (0xa14c bytes) 000486 1782631100.412075 fallocate 0x020b1d thru 0x025a0a (0x4eee bytes) 000487 1782631100.414655 read 0x0334d9 thru 0x037cb5 (0x47dd bytes) 000488 1782631100.417931 trunc from 0x040000 to 0x02ba84 (0x1457b bytes) 000489 1782631100.430499 trunc from 0x02ba85 to 0x013cc3 (0x17dc1 bytes) 000490 1782631100.435491 mapread 0x000298 thru 0x00515e (0x4ec7 bytes) 000491 1782631100.444524 read 0x00da06 thru 0x013cc3 (0x62be bytes) 000492 1782631100.447443 mapwrite 0x01c75e thru 0x0250c6 (0x8969 bytes) 000493 1782631100.465341 read 0x010b4a thru 0x0140c6 (0x357d bytes) 000494 1782631100.465933 mapread 0x0168c6 thru 0x01c30f (0x5a4a bytes) 000495 1782631100.466721 mapread 0x0001a5 thru 0x00954a (0x93a6 bytes) 000496 1782631100.469486 MIRROR_RESYNC 2 mirrors 000497 1782631100.652530 fallocate 0x0188ea thru 0x0260d8 (0xd7ef bytes) 000498 1782631100.664325 mapwrite 0x00af95 thru 0x00ffe6 (0x5052 bytes) 000499 1782631100.678553 trunc from 0x001e22 to 0x00ee7f (0xd05e bytes) 000500 1782631100.681236 read 0x00de06 thru 0x0120ec (0x42e7 bytes) 000501 1782631100.683756 read 0x01bd20 thru 0x01e857 (0x2b38 bytes) 000502 1782631100.687475 trunc from 0x0260d9 to 0x01338f (0x12d49 bytes) 000503 1782631100.698419 read 0x008a77 thru 0x0116a1 (0x8c2b bytes) 000504 1782631100.698906 write 0x00648b thru 0x01642b (0xffa1 bytes) 000505 1782631100.699880 trunc from 0x003cba to 0x011f66 (0xe2ad bytes) 000506 1782631100.704582 trunc from 0x01642c to 0x01ccf7 (0x68cc bytes) 000507 1782631100.708863 write 0x03df82 thru 0x03ffff (0x207e bytes) 000508 1782631100.709649 punch from 0x0308d5 to 0x03faaa (0xf1d6 bytes) 000509 1782631100.713355 punch from 0x01e1f8 to 0x022078 (0x3e81 bytes) 000510 1782631100.715462 mapwrite 0x0330d4 thru 0x03ffff (0xcf2c bytes) 000511 1782631100.728066 trunc from 0x040000 to 0x031de5 (0xe21a bytes) 000512 1782631100.733968 trunc from 0x0215b1 to 0x02b852 (0xa2a2 bytes) 000513 1782631100.736355 write 0x02d1eb thru 0x038865 (0xb67b bytes) 000515 1782631100.737862 trunc from 0x038866 to 0x03b6ca (0x2e65 bytes) 000516 1782631100.743387 punch from 0x009724 to 0x0168c7 (0xd1a4 bytes) 000517 1782631100.745962 mapwrite 0x026f04 thru 0x02e014 (0x7111 bytes) 000518 1782631100.765576 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b6cb): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b6cb): Mirror 3: 0x3d3a5260 (stale) CRC-32 checksum value for chunk [0, 0x3b6cb): Mirror 1: 0x62d6ad8b Mirror 4: 0x62d6ad8b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b6cb: skipped 000519 1782631101.018656 read 0x02f277 thru 0x03b6ca (0xc454 bytes) 000520 1782631101.024879 fallocate 0x00cd49 thru 0x016e52 (0xa10a bytes) 000521 1782631101.038579 mapwrite 0x007c29 thru 0x0121cd (0xa5a5 bytes) 000522 1782631101.058376 trunc from 0x03b6cb to 0x016b30 (0x24b9a bytes) 000523 1782631101.076559 mapwrite 0x03aa12 thru 0x03fce5 (0x52d4 bytes) 000524 1782631101.094382 fallocate 0x014475 thru 0x021a54 (0xd5e0 bytes) 000526 1782631101.097275 write 0x03c62d thru 0x03ffff (0x39d3 bytes) 000529 1782631101.099387 trunc from 0x02cc69 to 0x038c50 (0xbfe8 bytes) 000530 1782631101.101851 read 0x019df8 thru 0x023889 (0x9a92 bytes) 000531 1782631101.106409 fallocate 0x022c89 thru 0x0327e2 (0xfb5a bytes) 000532 1782631101.108753 write 0x0191c5 thru 0x01a9a4 (0x17e0 bytes) 000534 1782631101.110030 read 0x011ab1 thru 0x01849c (0x69ec bytes) 000536 1782631101.112976 MIRROR_RESYNC 3 mirrors 000537 1782631101.401441 fallocate 0x011872 thru 0x01b1ce (0x995d bytes) 000538 1782631101.411728 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97eba4f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97eba4f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000539 1782631101.500455 fallocate 0x03022e thru 0x030966 (0x739 bytes) 000540 1782631101.503285 punch from 0x022e6f to 0x02ecb5 (0xbe47 bytes) 000541 1782631101.506094 fallocate 0x00255a thru 0x00f287 (0xcd2e bytes) 000542 1782631101.508569 fallocate 0x0011a4 thru 0x001c53 (0xab0 bytes) 000543 1782631101.510662 fallocate 0x00d195 thru 0x011f93 (0x4dff bytes) 000544 1782631101.512555 punch from 0x02eea5 to 0x0397c0 (0xa91c bytes) 000545 1782631101.514566 punch from 0x032256 to 0x037564 (0x530f bytes) 000546 1782631101.516580 trunc from 0x040000 to 0x01319f (0x2ce60 bytes) 000547 1782631101.528372 punch from 0x005420 to 0x00c7f4 (0x73d5 bytes) 000548 1782631101.530718 mapwrite 0x01e353 thru 0x025c5a (0x7908 bytes) 000549 1782631101.550570 fallocate 0x0062db thru 0x00a835 (0x455b bytes) 000550 1782631101.552926 fallocate 0x0116ed thru 0x017e47 (0x675b bytes) 000551 1782631101.555274 write 0x0097ef thru 0x00eb6a (0x537c bytes) 000552 1782631101.559099 mapwrite 0x0246ee thru 0x02eacf (0xa3e2 bytes) 000553 1782631101.577532 mapwrite 0x02eb09 thru 0x03e415 (0xf90d bytes) 000554 1782631101.599718 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e416): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e416): Mirror 3: 0xcecb958b (stale) CRC-32 checksum value for chunk [0, 0x3e416): Mirror 1: 0x37c91834 Mirror 4: 0x37c91834 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e416: skipped 000555 1782631101.880527 fallocate 0x01dcb8 thru 0x02c895 (0xebde bytes) 000556 1782631101.896505 MIRROR_RESYNC 3 mirrors 000557 1782631102.170736 trunc from 0x00d1bf to 0x0169f4 (0x9836 bytes) 000558 1782631102.187589 read 0x01a2bf thru 0x01ee6a (0x4bac bytes) 000559 1782631102.192890 trunc from 0x00ff72 to 0x018102 (0x8191 bytes) 000560 1782631102.196417 trunc from 0x01cfeb to 0x028576 (0xb58c bytes) 000561 1782631102.199563 read 0x016ace thru 0x021c82 (0xb1b5 bytes) 000562 1782631102.205453 mapread 0x00e6ec thru 0x01434e (0x5c63 bytes) 000563 1782631102.206661 trunc from 0x03e416 to 0x015bea (0x2882b bytes) 000564 1782631102.215901 mapwrite 0x037df4 thru 0x03ffff (0x820c bytes) 000565 1782631102.244163 write 0x01de59 thru 0x02d24d (0xf3f5 bytes) 000566 1782631102.248831 mapread 0x0271cb thru 0x02b956 (0x478c bytes) 000567 1782631102.249805 read 0x02f337 thru 0x032fb1 (0x3c7b bytes) 000568 1782631102.253959 fallocate 0x02613e thru 0x0266f9 (0x5bc bytes) 000570 1782631102.257116 trunc from 0x03aef7 to 0x03ffff (0x5109 bytes) 000571 1782631102.259458 fallocate 0x00c228 thru 0x00d343 (0x111c bytes) 000572 1782631102.263428 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1b317a8d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1b317a8d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000573 1782631102.386672 write 0x0168e2 thru 0x01a579 (0x3c98 bytes) 000574 1782631102.390915 trunc from 0x001b61 to 0x004305 (0x27a5 bytes) 000575 1782631102.394869 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000576 1782631102.441371 write 0x005dc4 thru 0x00deaf (0x80ec bytes) 000577 1782631102.446060 read 0x02c5db thru 0x03ab49 (0xe56f bytes) 000578 1782631102.450028 read 0x03f5a1 thru 0x03ffff (0xa5f bytes) 000579 1782631102.454029 mapread 0x024e30 thru 0x03210a (0xd2db bytes) 000580 1782631102.455017 trunc from 0x039b31 to 0x03baa8 (0x1f78 bytes) 000581 1782631102.457386 mapwrite 0x029c71 thru 0x032021 (0x83b1 bytes) 000582 1782631102.467414 trunc from 0x008f0e to 0x015f00 (0xcff3 bytes) 000583 1782631102.469766 trunc from 0x0159c2 to 0x02150a (0xbb49 bytes) 000584 1782631102.472470 punch from 0x025530 to 0x027f51 (0x2a22 bytes) 000585 1782631102.475026 punch from 0x0335ff to 0x037932 (0x4334 bytes) 000586 1782631102.477317 read 0x015546 thru 0x0172bf (0x1d7a bytes) 000587 1782631102.481795 trunc from 0x00e2f2 to 0x01d853 (0xf562 bytes) 000589 1782631102.485090 mapread 0x02cdda thru 0x02ebd3 (0x1dfa bytes) 000591 1782631102.486545 fallocate 0x021782 thru 0x022b42 (0x13c1 bytes) 000592 1782631102.489247 mapwrite 0x03a011 thru 0x03ffff (0x5fef bytes) 000593 1782631102.497588 trunc from 0x02cd83 to 0x02dcec (0xf6a bytes) 000595 1782631102.500435 fallocate 0x028d50 thru 0x032ead (0xa15e bytes) 000596 1782631102.503334 trunc from 0x02fa9d to 0x03887d (0x8de1 bytes) 000597 1782631102.506359 write 0x02fdd1 thru 0x03dc12 (0xde42 bytes) 000598 1782631102.509716 write 0x0359f0 thru 0x03aa8c (0x509d bytes) 000599 1782631102.510761 trunc from 0x040000 to 0x02c38e (0x13c71 bytes) 000600 1782631102.516937 mapread 0x005628 thru 0x00c05f (0x6a38 bytes) 000601 1782631102.517983 fallocate 0x01a8ab thru 0x0260d9 (0xb82f bytes) 000602 1782631102.521095 punch from 0x02b8ee to 0x02ba8a (0x19d bytes) 000603 1782631102.523309 write 0x0048bb thru 0x005ace (0x1214 bytes) 000604 1782631102.524195 read 0x01ae08 thru 0x020243 (0x543c bytes) 000605 1782631102.528282 punch from 0x02a696 to 0x02bc54 (0x15bf bytes) 000606 1782631102.532081 MIRROR_EXTEND to 2 mirrors 000607 1782631102.746948 write 0x03119b thru 0x03ffff (0xee65 bytes) 000608 1782631102.760446 mapread 0x005fcf thru 0x0140a1 (0xe0d3 bytes) 000609 1782631102.771301 trunc from 0x040000 to 0x00190d (0x3e6f2 bytes) 000611 1782631102.790820 write 0x00462c thru 0x007087 (0x2a5c bytes) 000612 1782631102.792150 mapwrite 0x029724 thru 0x034e04 (0xb6e1 bytes) 000613 1782631102.818581 punch from 0x00e987 to 0x0146f2 (0x5d6c bytes) 000614 1782631102.821785 read 0x012234 thru 0x01ddd4 (0xbba1 bytes) 000615 1782631102.826525 punch from 0x0151bc to 0x0244f6 (0xf33b bytes) 000617 1782631102.829992 trunc from 0x011a89 to 0x01e2ac (0xc824 bytes) 000618 1782631102.833103 trunc from 0x020f5f to 0x0299d7 (0x8a79 bytes) 000619 1782631102.835823 punch from 0x034618 to 0x034e04 (0x7ed bytes) 000620 1782631102.838209 trunc from 0x034e05 to 0x00a54f (0x2a8b5 bytes) 000621 1782631102.846715 trunc from 0x0042e3 to 0x00a54f (0x626d bytes) 000622 1782631102.850416 trunc from 0x00a550 to 0x00c158 (0x1c09 bytes) 000623 1782631102.858052 trunc from 0x00c159 to 0x03d64a (0x314f2 bytes) 000624 1782631102.864158 trunc from 0x03d64b to 0x0276e7 (0x15f63 bytes) 000625 1782631102.869809 punch from 0x02705c to 0x0276e7 (0x68c bytes) 000626 1782631102.871845 mapread 0x0242ec thru 0x0276e7 (0x33fc bytes) 000627 1782631102.875351 read 0x024058 thru 0x0276e7 (0x3690 bytes) 000629 1782631102.876346 fallocate 0x02fc3b thru 0x03066c (0xa32 bytes) 000630 1782631102.878771 trunc from 0x03066d to 0x03e2e6 (0xdc7a bytes) 000631 1782631102.885530 trunc from 0x00fabd to 0x01934d (0x9891 bytes) 000632 1782631102.887939 mapwrite 0x01c874 thru 0x01e8d4 (0x2061 bytes) 000633 1782631102.900541 trunc from 0x03e2e7 to 0x037f1b (0x63cb bytes) 000634 1782631102.907386 trunc from 0x037f1c to 0x0252e6 (0x12c35 bytes) 000636 1782631102.915087 write 0x01c11c thru 0x02a497 (0xe37c bytes) 000637 1782631102.916486 write 0x0209a2 thru 0x024ee0 (0x453f bytes) 000639 1782631102.917831 punch from 0x0255f9 to 0x02a497 (0x4e9f bytes) 000640 1782631102.924000 mapwrite 0x02f369 thru 0x03d38d (0xe025 bytes) 000641 1782631102.970880 fallocate 0x038cc8 thru 0x03ed03 (0x603c bytes) 000642 1782631102.973184 write 0x0111a8 thru 0x0117a5 (0x5fe bytes) 000644 1782631102.974559 mapread 0x00de54 thru 0x01b510 (0xd6bd bytes) 000645 1782631102.975794 write 0x02df20 thru 0x036baf (0x8c90 bytes) 000646 1782631102.978881 punch from 0x00381c to 0x00ed76 (0xb55b bytes) 000647 1782631102.982083 punch from 0x028bac to 0x032d42 (0xa197 bytes) 000648 1782631102.989045 trunc from 0x03ed04 to 0x026f7e (0x17d85 bytes) 000650 1782631102.999440 write 0x017b5e thru 0x01e953 (0x6df6 bytes) 000651 1782631103.000592 fallocate 0x03b978 thru 0x03ffff (0x4688 bytes) 000653 1782631103.005836 read 0x0222d2 thru 0x025707 (0x3436 bytes) 000654 1782631103.011126 trunc from 0x040000 to 0x031ed1 (0xe12e bytes) 000655 1782631103.019558 read 0x030e85 thru 0x031ed1 (0x104d bytes) 000656 1782631103.020232 trunc from 0x006c53 to 0x00af4e (0x42fc bytes) 000657 1782631103.022947 write 0x03033d thru 0x037a20 (0x76e4 bytes) 000658 1782631103.024114 trunc from 0x037a21 to 0x0264e8 (0x11538 bytes) 000660 1782631103.033518 mapread 0x018caf thru 0x0264e8 (0xd83a bytes) 000661 1782631103.034715 fallocate 0x0263dd thru 0x0298aa (0x34ce bytes) 000662 1782631103.038302 write 0x02dfd4 thru 0x037d00 (0x9d2d bytes) 000664 1782631103.040080 trunc from 0x037d01 to 0x00a595 (0x2d76b bytes) 000665 1782631103.047150 trunc from 0x00a596 to 0x012705 (0x8170 bytes) 000666 1782631103.054635 fallocate 0x007f05 thru 0x00b997 (0x3a93 bytes) 000667 1782631103.057490 trunc from 0x012706 to 0x033b8e (0x21489 bytes) 000668 1782631103.063136 punch from 0x02282d to 0x029352 (0x6b26 bytes) 000669 1782631103.065221 mapwrite 0x0107c6 thru 0x015c99 (0x54d4 bytes) 000670 1782631103.078198 read 0x026cdc thru 0x033b8e (0xceb3 bytes) 000671 1782631103.078930 read 0x032e43 thru 0x033996 (0xb54 bytes) 000672 1782631103.079386 read 0x022cf5 thru 0x03090f (0xdc1b bytes) 000673 1782631103.080044 mapwrite 0x00b934 thru 0x01ab79 (0xf246 bytes) 000674 1782631103.091770 write 0x0273b3 thru 0x029b9b (0x27e9 bytes) 000675 1782631103.093054 trunc from 0x033b8f to 0x03cfc7 (0x9439 bytes) 000676 1782631103.099167 mapwrite 0x00c0e2 thru 0x00fafe (0x3a1d bytes) 000677 1782631103.107639 read 0x013c26 thru 0x01f693 (0xba6e bytes) 000678 1782631103.108264 mapread 0x006982 thru 0x01671a (0xfd99 bytes) 000679 1782631103.112017 MIRROR_RESYNC 2 mirrors 000680 1782631103.345091 punch from 0x022e6a to 0x025834 (0x29cb bytes) 000681 1782631103.356367 trunc from 0x00470c to 0x00b3a5 (0x6c9a bytes) 000683 1782631103.359020 trunc from 0x03cfc8 to 0x01b5e6 (0x219e1 bytes) 000684 1782631103.371151 trunc from 0x01b5e7 to 0x03a220 (0x1ec3a bytes) 000685 1782631103.376510 read 0x028846 thru 0x02b3b7 (0x2b72 bytes) 000686 1782631103.379195 mapwrite 0x006802 thru 0x013df9 (0xd5f8 bytes) 000687 1782631103.396909 fallocate 0x01fd98 thru 0x028efe (0x9167 bytes) 000688 1782631103.399690 fallocate 0x03f551 thru 0x03ffff (0xaaf bytes) 000689 1782631103.401982 fallocate 0x036724 thru 0x03ffff (0x98dc bytes) 000690 1782631103.404393 fallocate 0x030ead thru 0x0392dc (0x8430 bytes) 000692 1782631103.409737 MIRROR_RESYNC 2 mirrors 000693 1782631103.620673 mapwrite 0x00cbf2 thru 0x015613 (0x8a22 bytes) 000694 1782631103.675503 trunc from 0x040000 to 0x034ab2 (0xb54d bytes) 000696 1782631103.691046 mapwrite 0x02bc2e thru 0x02c22f (0x602 bytes) 000697 1782631103.702326 trunc from 0x034ab3 to 0x03a301 (0x584f bytes) 000698 1782631103.709845 trunc from 0x03a302 to 0x007ed5 (0x3242c bytes) 000699 1782631103.717642 punch from 0x0036a8 to 0x007ed5 (0x482e bytes) 000700 1782631103.720777 fallocate 0x02f3c7 thru 0x03bcfe (0xc938 bytes) 000701 1782631103.723145 punch from 0x0039aa to 0x007ed5 (0x452c bytes) 000702 1782631103.725542 mapread 0x00065a thru 0x006d4b (0x66f2 bytes) 000703 1782631103.729961 trunc from 0x002571 to 0x007ed5 (0x5965 bytes) 000705 1782631103.735483 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000707 1782631103.795109 MIRROR_EXTEND to 2 mirrors 000708 1782631104.026300 fallocate 0x0398ca thru 0x03ffff (0x6736 bytes) 000709 1782631104.043143 trunc from 0x040000 to 0x028d95 (0x1726a bytes) 000710 1782631104.060073 fallocate 0x0256a3 thru 0x0262cc (0xc2a bytes) 000711 1782631104.062300 mapread 0x0210fc thru 0x028d95 (0x7c9a bytes) 000712 1782631104.069754 write 0x03cf09 thru 0x03e92f (0x1a27 bytes) 000713 1782631104.070657 mapread 0x028218 thru 0x02cd7b (0x4b64 bytes) 000714 1782631104.074262 mapread 0x009347 thru 0x016726 (0xd3e0 bytes) 000715 1782631104.081508 trunc from 0x01cc2e to 0x01fd2f (0x3102 bytes) 000716 1782631104.083813 punch from 0x03e25e to 0x03e92f (0x6d2 bytes) 000717 1782631104.090591 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e930): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e930): Mirror 2: 0x1f2b5df2 (stale) CRC-32 checksum value for chunk [0, 0x3e930): Mirror 1: 0xdb9a1edb Mirror 3: 0xdb9a1edb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e930: skipped 000718 1782631104.383265 mapwrite 0x029f73 thru 0x02c99d (0x2a2b bytes) 000719 1782631104.425046 mapwrite 0x021e96 thru 0x02f867 (0xd9d2 bytes) 000720 1782631104.438933 mapwrite 0x012578 thru 0x01cfa3 (0xaa2c bytes) 000721 1782631104.451899 fallocate 0x02244e thru 0x023c4f (0x1802 bytes) 000723 1782631104.455103 trunc from 0x00f5cf to 0x01f165 (0xfb97 bytes) 000724 1782631104.458842 trunc from 0x023e1d to 0x02f9b2 (0xbb96 bytes) 000725 1782631104.461942 read 0x01e8ef thru 0x025477 (0x6b89 bytes) 000726 1782631104.466277 fallocate 0x03f117 thru 0x03ffff (0xee9 bytes) 000727 1782631104.469022 fallocate 0x0338a7 thru 0x03583d (0x1f97 bytes) 000729 1782631104.471962 trunc from 0x03e930 to 0x021907 (0x1d028 bytes) 000730 1782631104.490704 trunc from 0x021908 to 0x0124af (0xf458 bytes) 000731 1782631104.497564 fallocate 0x010a95 thru 0x0149e4 (0x3f50 bytes) 000732 1782631104.502825 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x149e5): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x149e5): Mirror 2: 0x3430779 (stale) Mirror 3: 0x3430779 (stale) CRC-32 checksum value for chunk [0, 0x149e5): Mirror 1: 0x3430779 Mirror 4: 0x3430779 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x149e5: skipped 000733 1782631104.791870 trunc from 0x0149e5 to 0x00dc6f (0x6d75 bytes) 000734 1782631104.818697 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xdc70): Mirror 3: 0x6a3bc3bf (stale) Mirror 4: 0x6a3bc3bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdc70): Mirror 3: 0x6a3bc3bf (stale) Mirror 4: 0x6a3bc3bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdc70: skipped 000735 1782631104.942910 read 0x007bcd thru 0x00bcf6 (0x412a bytes) 000736 1782631104.946360 read 0x002a5c thru 0x009403 (0x69a8 bytes) 000737 1782631104.950299 trunc from 0x00dc70 to 0x0279bb (0x19d4c bytes) 000738 1782631104.958096 trunc from 0x0279bc to 0x02d40d (0x5a52 bytes) 000739 1782631104.965669 MIRROR_RESYNC 3 mirrors 000740 1782631105.205972 trunc from 0x02d40e to 0x00dfbe (0x1f44f bytes) 000741 1782631105.220973 mapread 0x00d5cf thru 0x00dfbe (0x9f0 bytes) 000742 1782631105.224396 trunc from 0x00dfbf to 0x02876b (0x1a7ad bytes) 000743 1782631105.232150 fallocate 0x01c086 thru 0x0259b0 (0x992b bytes) 000745 1782631105.235504 write 0x036a9e thru 0x03716e (0x6d1 bytes) 000747 1782631105.236986 fallocate 0x007e09 thru 0x0176c6 (0xf8be bytes) 000748 1782631105.240029 mapread 0x006de0 thru 0x014a4c (0xdc6d bytes) 000749 1782631105.250393 trunc from 0x03716f to 0x02444f (0x12d1f bytes) 000752 1782631105.257085 mapwrite 0x018e7c thru 0x02264b (0x97d0 bytes) 000753 1782631105.269883 punch from 0x00c736 to 0x012f4b (0x6816 bytes) 000754 1782631105.272572 write 0x00d0b9 thru 0x01262f (0x5577 bytes) 000755 1782631105.277348 trunc from 0x02438b to 0x02444f (0xc5 bytes) 000756 1782631105.279607 mapread 0x01161e thru 0x01451d (0x2f00 bytes) 000757 1782631105.280686 read 0x00723c thru 0x00b8a5 (0x466a bytes) 000758 1782631105.281220 mapread 0x00f3b4 thru 0x0115d2 (0x221f bytes) 000759 1782631105.282441 mapwrite 0x020dd2 thru 0x028acb (0x7cfa bytes) 000760 1782631105.306674 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28acc): Mirror 3: 0xc5493783 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28acc): Mirror 3: 0xc5493783 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28acc: skipped 000761 1782631105.423071 mapwrite 0x02b03d thru 0x02e1f8 (0x31bc bytes) 000762 1782631105.443478 trunc from 0x00e63c to 0x01b3bf (0xcd84 bytes) 000763 1782631105.445946 trunc from 0x02e1f9 to 0x0044d8 (0x29d20 bytes) 000764 1782631105.453267 write 0x02eb0b thru 0x037732 (0x8c28 bytes) 000765 1782631105.456449 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) 000767 1782631105.497794 trunc from 0x00cfd3 to 0x01558b (0x85b9 bytes) 000769 1782631105.502527 MIRROR_EXTEND to 2 mirrors 000770 1782631105.730832 mapwrite 0x001a33 thru 0x00aab0 (0x907e bytes) 000771 1782631105.774192 trunc from 0x029d94 to 0x037732 (0xd99f bytes) 000772 1782631105.777697 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37733): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37733): Mirror 2: 0xb5068ba0 (stale) CRC-32 checksum value for chunk [0, 0x37733): Mirror 1: 0xe75911ad Mirror 3: 0xe75911ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37733: skipped 000773 1782631106.081469 trunc from 0x000cb6 to 0x006169 (0x54b4 bytes) 000774 1782631106.094303 trunc from 0x01c43a to 0x02b5df (0xf1a6 bytes) 000775 1782631106.096332 punch from 0x024aaf to 0x031157 (0xc6a9 bytes) 000776 1782631106.098593 read 0x00b0ca thru 0x00bf82 (0xeb9 bytes) 000777 1782631106.101974 trunc from 0x0038eb to 0x0073da (0x3af0 bytes) 000778 1782631106.105157 mapread 0x02f903 thru 0x037732 (0x7e30 bytes) 000779 1782631106.112608 trunc from 0x037733 to 0x00fe1d (0x27915 bytes) 000780 1782631106.120481 mapread 0x00573e thru 0x00eaee (0x93b1 bytes) 000781 1782631106.125733 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xfe1e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfe1e): Mirror 2: 0x24460e83 (stale) Mirror 3: 0x7f340ef (stale) CRC-32 checksum value for chunk [0, 0xfe1e): Mirror 1: 0x58ca48c0 Mirror 4: 0x58ca48c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfe1e: skipped 000782 1782631106.409985 punch from 0x00bdb1 to 0x00df44 (0x2194 bytes) 000783 1782631106.423942 fallocate 0x025417 thru 0x029d9e (0x4988 bytes) 000784 1782631106.426444 read 0x0018c3 thru 0x00dbe9 (0xc327 bytes) 000785 1782631106.430290 trunc from 0x0006b6 to 0x009d1a (0x9665 bytes) 000786 1782631106.432667 trunc from 0x002f31 to 0x006747 (0x3817 bytes) 000788 1782631106.434924 read 0x00ae6a thru 0x00dff8 (0x318f bytes) 000789 1782631106.435420 read 0x00f30c thru 0x00fe1d (0xb12 bytes) 000790 1782631106.438736 fallocate 0x01805d thru 0x024333 (0xc2d7 bytes) 000791 1782631106.441135 trunc from 0x0003d9 to 0x00f6fc (0xf324 bytes) 000792 1782631106.443416 write 0x01c112 thru 0x01e11e (0x200d bytes) 000793 1782631106.448468 trunc from 0x024334 to 0x032562 (0xe22f bytes) 000794 1782631106.459461 mapwrite 0x03d4b2 thru 0x03fc6d (0x27bc bytes) 000795 1782631106.472466 MIRROR_RESYNC 4 mirrors 000796 1782631106.759423 fallocate 0x037853 thru 0x0388db (0x1089 bytes) 000797 1782631106.768398 punch from 0x0393fd to 0x03fc6d (0x6871 bytes) 000799 1782631106.770267 read 0x01d4bd thru 0x026242 (0x8d86 bytes) 000800 1782631106.772906 trunc from 0x005409 to 0x006dc8 (0x19c0 bytes) 000801 1782631106.774345 trunc from 0x00758c to 0x0105c1 (0x9036 bytes) 000802 1782631106.777317 MIRROR_RESYNC 4 mirrors 000803 1782631107.063308 write 0x0012c3 thru 0x003258 (0x1f96 bytes) 000804 1782631107.077487 mapwrite 0x022fee thru 0x02a71c (0x772f bytes) 000805 1782631107.091380 mapread 0x03c03d thru 0x03dcc5 (0x1c89 bytes) 000806 1782631107.094780 mapwrite 0x02d27d thru 0x033997 (0x671b bytes) 000807 1782631107.105860 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: 0x91c49c59 (stale) Mirror 3: 0x91c49c59 (stale) Mirror 4: 0x91c49c59 (stale) CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 1: 0x7d027b Mirror 5: 0x7d027b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc6e: skipped 000809 1782631107.438537 write 0x00ec13 thru 0x015e60 (0x724e bytes) 000810 1782631107.454868 punch from 0x017e26 to 0x025f92 (0xe16d bytes) 000811 1782631107.457863 mapread 0x02716e thru 0x02c49c (0x532f bytes) 000812 1782631107.465824 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: 0x91c49c59 (stale) Mirror 3: 0x91c49c59 (stale) Mirror 4: 0x91c49c59 (stale) Mirror 5: 0x7d027b (stale) CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 1: 0x4ac1ebe7 Mirror 6: 0x4ac1ebe7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc6e: skipped 000813 1782631107.767775 mapwrite 0x02cad1 thru 0x02f1b5 (0x26e5 bytes) 000814 1782631107.805735 trunc from 0x011fc5 to 0x014360 (0x239c bytes) 000815 1782631107.809295 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: 0x91c49c59 (stale) Mirror 4: 0x91c49c59 (stale) Mirror 5: 0x7d027b (stale) Mirror 6: 0x4ac1ebe7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: 0x91c49c59 (stale) Mirror 4: 0x91c49c59 (stale) Mirror 5: 0x7d027b (stale) Mirror 6: 0x4ac1ebe7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc6e: skipped 000816 1782631107.951568 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: 0x91c49c59 (stale) Mirror 4: 0x91c49c59 (stale) Mirror 5: 0x7d027b (stale) Mirror 6: 0x4ac1ebe7 (stale) CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 1: 0x96977dc1 Mirror 7: 0x96977dc1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc6e: skipped 000817 1782631108.301768 read 0x03ef1b thru 0x03fc6d (0xd53 bytes) 000818 1782631108.307200 mapread 0x02ce46 thru 0x036c5f (0x9e1a bytes) 000819 1782631108.323237 punch from 0x005d7f to 0x0135b7 (0xd839 bytes) 000820 1782631108.341500 MIRROR_RESYNC 6 mirrors 000821 1782631108.959750 fallocate 0x01b8d0 thru 0x024aac (0x91dd bytes) 000823 1782631108.972660 mapwrite 0x02d74c thru 0x03b88d (0xe142 bytes) 000824 1782631108.992827 punch from 0x0064bf to 0x009648 (0x318a bytes) 000825 1782631108.995933 punch from 0x023b51 to 0x0258a8 (0x1d58 bytes) 000826 1782631108.998321 fallocate 0x01d16e thru 0x02469b (0x752e bytes) 000827 1782631109.001067 fallocate 0x014082 thru 0x021bd1 (0xdb50 bytes) 000828 1782631109.003832 punch from 0x01b54a to 0x023486 (0x7f3d bytes) 000829 1782631109.006382 fallocate 0x034a37 thru 0x03dc59 (0x9223 bytes) 000830 1782631109.008736 fallocate 0x0248f1 thru 0x030baf (0xc2bf bytes) 000831 1782631109.012827 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 2: 0x6214eb6a (stale) Mirror 4: 0x6214eb6a (stale) Mirror 5: 0x6214eb6a (stale) Mirror 6: 0x6214eb6a (stale) Mirror 7: 0x6214eb6a (stale) CRC-32 checksum value for chunk [0, 0x3fc6e): Mirror 1: 0x728d25e1 Mirror 8: 0x728d25e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc6e: skipped 000832 1782631109.393152 trunc from 0x02f77b to 0x037438 (0x7cbe bytes) 000833 1782631109.406692 punch from 0x00fc93 to 0x01f15e (0xf4cc bytes) 000834 1782631109.409736 fallocate 0x01e750 thru 0x020a25 (0x22d6 bytes) 000835 1782631109.412212 trunc from 0x01384d to 0x01a99c (0x7150 bytes) 000836 1782631109.415220 trunc from 0x03fc6e to 0x01468b (0x2b5e2 bytes) 000837 1782631109.426840 mapwrite 0x0015c0 thru 0x009912 (0x8353 bytes) 000838 1782631109.452389 punch from 0x00157f to 0x00416e (0x2bf0 bytes) 000839 1782631109.455716 trunc from 0x01468c to 0x00bcd4 (0x89b7 bytes) 000840 1782631109.464916 mapread 0x001d79 thru 0x00bcd4 (0x9f5c bytes) 000841 1782631109.470917 punch from 0x00824b to 0x00bcd4 (0x3a8a bytes) 000842 1782631109.477937 trunc from 0x003d12 to 0x00893b (0x4c2a bytes) 000843 1782631109.480978 read 0x000678 thru 0x00bcd4 (0xb65d bytes) 000844 1782631109.485542 write 0x0329ca thru 0x037c6f (0x52a6 bytes) 000845 1782631109.487035 mapread 0x02dcff thru 0x036002 (0x8304 bytes) 000846 1782631109.493752 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37c70): Mirror 4: 0x3f0479ec (stale) Mirror 5: 0x3f0479ec (stale) Mirror 6: 0x3f0479ec (stale) Mirror 7: 0x3f0479ec (stale) Mirror 8: 0xe43d951a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c70): Mirror 4: 0x3f0479ec (stale) Mirror 5: 0x3f0479ec (stale) Mirror 6: 0x3f0479ec (stale) Mirror 7: 0x3f0479ec (stale) Mirror 8: 0xe43d951a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c70: skipped 000847 1782631109.671901 fallocate 0x021b5e thru 0x0262be (0x4761 bytes) 000848 1782631109.675021 read 0x01ee73 thru 0x0236c0 (0x484e bytes) 000849 1782631109.680263 mapread 0x0306a6 thru 0x037c6f (0x75ca bytes) 000850 1782631109.690209 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37c70): Mirror 4: 0x3f0479ec (stale) Mirror 6: 0x3f0479ec (stale) Mirror 7: 0x3f0479ec (stale) Mirror 8: 0xe43d951a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c70): Mirror 4: 0x3f0479ec (stale) Mirror 6: 0x3f0479ec (stale) Mirror 7: 0x3f0479ec (stale) Mirror 8: 0xe43d951a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c70: skipped 000851 1782631109.823995 read 0x016be1 thru 0x0222a7 (0xb6c7 bytes) 000852 1782631109.827917 fallocate 0x023885 thru 0x0277a6 (0x3f22 bytes) 000853 1782631109.830449 mapwrite 0x0075e5 thru 0x00af3c (0x3958 bytes) 000855 1782631109.842706 mapread 0x003995 thru 0x0078cf (0x3f3b bytes) 000856 1782631109.843487 trunc from 0x00d9ad to 0x010906 (0x2f5a bytes) 000857 1782631109.845644 fallocate 0x03d9df thru 0x03f76d (0x1d8f bytes) 000858 1782631109.847925 fallocate 0x015252 thru 0x0153f3 (0x1a2 bytes) 000859 1782631109.850054 mapwrite 0x0223aa thru 0x02c626 (0xa27d bytes) 000860 1782631109.863100 mapwrite 0x01f14a thru 0x0210ed (0x1fa4 bytes) 000861 1782631109.868409 mapread 0x01ab3e thru 0x02068d (0x5b50 bytes) 000863 1782631109.869527 read 0x002f37 thru 0x004d07 (0x1dd1 bytes) 000864 1782631109.870185 fallocate 0x034e5b thru 0x03c93d (0x7ae3 bytes) 000865 1782631109.873365 mapread 0x02e0f9 thru 0x0373bb (0x92c3 bytes) 000867 1782631109.879492 punch from 0x002f9b to 0x005d58 (0x2dbe bytes) 000868 1782631109.882245 write 0x03a8e4 thru 0x03b65c (0xd79 bytes) 000869 1782631109.884762 trunc from 0x03c93e to 0x00725c (0x356e1 bytes) 000870 1782631109.891281 write 0x03c3a2 thru 0x03ffff (0x3c5e bytes) 000871 1782631109.892300 trunc from 0x040000 to 0x01fe9b (0x20164 bytes) 000872 1782631109.899496 mapwrite 0x001604 thru 0x006c93 (0x5690 bytes) 000873 1782631109.919290 fallocate 0x02d008 thru 0x03428a (0x7283 bytes) 000874 1782631109.924292 trunc from 0x027667 to 0x031658 (0x9ff2 bytes) 000875 1782631109.927304 write 0x02325a thru 0x023c82 (0xa29 bytes) 000876 1782631109.932685 MIRROR_RESYNC 5 mirrors 000877 1782631110.305370 punch from 0x0078e4 to 0x013a3f (0xc15c bytes) 000878 1782631110.320023 trunc from 0x014c92 to 0x01f2d9 (0xa648 bytes) 000879 1782631110.322636 read 0x0005f7 thru 0x00fe83 (0xf88d bytes) 000880 1782631110.326947 fallocate 0x02713e thru 0x02f0e5 (0x7fa8 bytes) 000881 1782631110.329657 mapwrite 0x037197 thru 0x03ffff (0x8e69 bytes) 000882 1782631110.359050 trunc from 0x03c7b8 to 0x03ffff (0x3848 bytes) 000883 1782631110.361528 read 0x001240 thru 0x00773a (0x64fb bytes) 000884 1782631110.362199 trunc from 0x040000 to 0x03d0a3 (0x2f5c bytes) 000885 1782631110.368414 mapwrite 0x028486 thru 0x034a27 (0xc5a2 bytes) 000886 1782631110.381461 trunc from 0x03d0a4 to 0x034e2f (0x8274 bytes) 000887 1782631110.388872 fallocate 0x00e87d thru 0x01cce6 (0xe46a bytes) 000888 1782631110.391337 trunc from 0x034e30 to 0x03b4d7 (0x66a8 bytes) 000889 1782631110.397796 read 0x018b3e thru 0x01c6f3 (0x3bb6 bytes) 000890 1782631110.398475 mapwrite 0x037271 thru 0x03d133 (0x5ec3 bytes) 000891 1782631110.415732 mapwrite 0x007433 thru 0x00d2ec (0x5eba bytes) 000892 1782631110.424207 trunc from 0x011b14 to 0x02154b (0xfa38 bytes) 000893 1782631110.426950 trunc from 0x0229eb to 0x03003d (0xd653 bytes) 000894 1782631110.429981 trunc from 0x03d134 to 0x026f80 (0x161b3 bytes) 000895 1782631110.437257 write 0x01e55f thru 0x02714a (0x8bec bytes) 000896 1782631110.440687 trunc from 0x015cf6 to 0x018f3b (0x3246 bytes) 000897 1782631110.443771 read 0x010860 thru 0x01a1c4 (0x9965 bytes) 000898 1782631110.448143 mapwrite 0x03190b thru 0x03d7be (0xbeb4 bytes) 000899 1782631110.468599 fallocate 0x03c8e2 thru 0x03ffff (0x371e bytes) 000900 1782631110.471209 punch from 0x03c8dc to 0x03ffff (0x3724 bytes) 000901 1782631110.473712 trunc from 0x0279eb to 0x02839d (0x9b3 bytes) 000902 1782631110.476404 fallocate 0x016274 thru 0x024cc4 (0xea51 bytes) 000903 1782631110.478641 mapread 0x01559d thru 0x01a2f4 (0x4d58 bytes) 000904 1782631110.479642 read 0x039f3e thru 0x03ffff (0x60c2 bytes) 000905 1782631110.483279 mapwrite 0x0134f5 thru 0x015d71 (0x287d bytes) 000906 1782631110.490238 mapwrite 0x02ccc9 thru 0x033b0c (0x6e44 bytes) 000907 1782631110.498794 trunc from 0x00033f to 0x00b14b (0xae0d bytes) 000908 1782631110.501394 read 0x01c6df thru 0x01f5dd (0x2eff bytes) 000909 1782631110.502056 fallocate 0x039766 thru 0x03ffff (0x689a bytes) 000910 1782631110.504904 write 0x00dd13 thru 0x01d5d9 (0xf8c7 bytes) 000911 1782631110.508361 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x95f2d1c0 (stale) Mirror 7: 0x95f2d1c0 (stale) Mirror 8: 0x95f2d1c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x95f2d1c0 (stale) Mirror 7: 0x95f2d1c0 (stale) Mirror 8: 0x95f2d1c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000912 1782631110.649100 trunc from 0x0114b0 to 0x020d7c (0xf8cd bytes) 000913 1782631110.651753 trunc from 0x02ac04 to 0x0307b4 (0x5bb1 bytes) 000914 1782631110.654667 punch from 0x00e1e1 to 0x010643 (0x2463 bytes) 000915 1782631110.657541 mapread 0x02b95d thru 0x030d58 (0x53fc bytes) 000916 1782631110.665585 fallocate 0x00438c thru 0x006353 (0x1fc8 bytes) 000917 1782631110.668291 mapwrite 0x023588 thru 0x02432c (0xda5 bytes) 000918 1782631110.677695 punch from 0x039c3c to 0x03ffff (0x63c4 bytes) 000920 1782631110.681020 read 0x03c2a6 thru 0x03ffff (0x3d5a bytes) 000921 1782631110.686880 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x95f2d1c0 (stale) Mirror 8: 0x95f2d1c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x95f2d1c0 (stale) Mirror 8: 0x95f2d1c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000922 1782631110.814934 trunc from 0x040000 to 0x004933 (0x3b6cc bytes) 000923 1782631110.823246 fallocate 0x000df8 thru 0x0078ba (0x6ac3 bytes) 000924 1782631110.825945 trunc from 0x0078bb to 0x02bcf0 (0x24436 bytes) 000925 1782631110.832802 fallocate 0x02ed4f thru 0x038985 (0x9c37 bytes) 000927 1782631110.836330 fallocate 0x03566a thru 0x037443 (0x1dda bytes) 000928 1782631110.839300 fallocate 0x014590 thru 0x018c56 (0x46c7 bytes) 000929 1782631110.842779 trunc from 0x037444 to 0x018c95 (0x1e7ae bytes) 000930 1782631110.849982 read 0x000515 thru 0x00b06d (0xab59 bytes) 000931 1782631110.854543 write 0x03e17e thru 0x03f54e (0x13d1 bytes) 000932 1782631110.855417 fallocate 0x01b4d2 thru 0x0273e5 (0xbf14 bytes) 000933 1782631110.858957 trunc from 0x03f54f to 0x01745d (0x280f1 bytes) 000934 1782631110.870950 trunc from 0x004682 to 0x011c15 (0xd594 bytes) 000935 1782631110.874392 punch from 0x00b989 to 0x00dc8a (0x2302 bytes) 000936 1782631110.877479 read 0x004a31 thru 0x012f89 (0xe559 bytes) 000937 1782631110.883513 mapwrite 0x029c9d thru 0x02ef2c (0x5290 bytes) 000938 1782631110.903318 mapwrite 0x01776a thru 0x019b05 (0x239c bytes) 000939 1782631110.911290 read 0x020529 thru 0x029043 (0x8b1b bytes) 000940 1782631110.911945 mapread 0x021fec thru 0x0236eb (0x1700 bytes) 000941 1782631110.912821 mapread 0x00d345 thru 0x0164f3 (0x91af bytes) 000943 1782631110.914332 trunc from 0x010c64 to 0x0181af (0x754c bytes) 000944 1782631110.917511 read 0x00282a thru 0x00fa8d (0xd264 bytes) 000945 1782631110.918186 mapwrite 0x00161d thru 0x00420b (0x2bef bytes) 000946 1782631110.925805 write 0x00e175 thru 0x01e129 (0xffb5 bytes) 000947 1782631110.927707 trunc from 0x02ef2d to 0x0154ff (0x19a2d bytes) 000948 1782631110.934247 trunc from 0x015500 to 0x01b015 (0x5b16 bytes) 000949 1782631110.940727 trunc from 0x01b016 to 0x00256a (0x18aab bytes) 000950 1782631110.947210 trunc from 0x0004b6 to 0x00256a (0x20b5 bytes) 000951 1782631110.950271 mapread 0x001ff5 thru 0x00256a (0x576 bytes) 000952 1782631110.953746 mapwrite 0x012ba2 thru 0x019b9c (0x6ffb bytes) 000953 1782631110.973495 trunc from 0x019b9d to 0x037cc9 (0x1e12d bytes) 000954 1782631110.980571 trunc from 0x037cca to 0x0179d8 (0x202f1 bytes) 000955 1782631110.986595 mapwrite 0x03e023 thru 0x03ffff (0x1fdd bytes) 000956 1782631111.004147 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x95f2d1c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x95f2d1c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000957 1782631111.126786 write 0x021cb7 thru 0x02aa07 (0x8d51 bytes) 000958 1782631111.132579 mapread 0x01f1e5 thru 0x02ae20 (0xbc3c bytes) 000959 1782631111.137861 punch from 0x02b5c1 to 0x03b54e (0xff8e bytes) 000960 1782631111.140563 mapwrite 0x033d32 thru 0x03a003 (0x62d2 bytes) 000961 1782631111.154706 punch from 0x01c8ef to 0x02141f (0x4b31 bytes) 000962 1782631111.157608 trunc from 0x040000 to 0x02f39c (0x10c63 bytes) 000964 1782631111.164146 write 0x0375fa thru 0x03ffff (0x8a06 bytes) 000965 1782631111.165349 write 0x02fa88 thru 0x03c6ce (0xcc47 bytes) 000966 1782631111.166433 trunc from 0x040000 to 0x022176 (0x1de89 bytes) 000967 1782631111.172918 write 0x00d05d thru 0x018c2b (0xbbcf bytes) 000968 1782631111.177306 trunc from 0x022177 to 0x036a6a (0x148f4 bytes) 000969 1782631111.182563 read 0x014a73 thru 0x01ab0d (0x609b bytes) 000970 1782631111.185116 mapread 0x018c9d thru 0x0206e7 (0x7a4b bytes) 000971 1782631111.188599 trunc from 0x01f8fc to 0x02e554 (0xec59 bytes) 000972 1782631111.190891 read 0x011fa0 thru 0x021b00 (0xfb61 bytes) 000973 1782631111.194725 mapread 0x009740 thru 0x017afa (0xe3bb bytes) 000974 1782631111.195544 trunc from 0x036a6b to 0x00607b (0x309ef bytes) 000975 1782631111.203027 fallocate 0x00ab45 thru 0x00eb18 (0x3fd4 bytes) 000976 1782631111.206048 mapwrite 0x021e6c thru 0x030ba6 (0xed3b bytes) 000977 1782631111.259440 mapwrite 0x0312e4 thru 0x031f74 (0xc91 bytes) 000978 1782631111.274590 write 0x00e42a thru 0x01a518 (0xc0ef bytes) 000979 1782631111.279284 mapwrite 0x02216b thru 0x0260d5 (0x3f6b bytes) 000980 1782631111.287565 write 0x01963c thru 0x024d77 (0xb73c bytes) 000981 1782631111.290909 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31f75): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31f75): Mirror 8: 0x240b2bf5 (stale) CRC-32 checksum value for chunk [0, 0x31f75): Mirror 1: 0x91713d78 Mirror 9: 0x91713d78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31f75: skipped 000982 1782631111.590759 fallocate 0x036f81 thru 0x0396be (0x273e bytes) 000983 1782631111.604878 read 0x007960 thru 0x00df06 (0x65a7 bytes) 000984 1782631111.609060 mapread 0x010dad thru 0x0175ec (0x6840 bytes) 000985 1782631111.616324 punch from 0x025af9 to 0x032316 (0xc81e bytes) 000986 1782631111.618739 trunc from 0x0396bf to 0x0233f4 (0x162ca bytes) 000987 1782631111.632848 trunc from 0x0233f5 to 0x00b1ae (0x18246 bytes) 000988 1782631111.637526 write 0x03424b thru 0x03a1b6 (0x5f6c bytes) 000989 1782631111.638891 fallocate 0x000d64 thru 0x00e51b (0xd7b8 bytes) 000990 1782631111.641328 trunc from 0x03a1b7 to 0x020d69 (0x1944d bytes) 000991 1782631111.648066 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x20d6a): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20d6a): Mirror 8: 0xbdc85261 (stale) Mirror 9: 0x5cfa5014 (stale) CRC-32 checksum value for chunk [0, 0x20d6a): Mirror 1: 0xab3ba310 Mirror 10: 0xab3ba310 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20d6a: skipped 000992 1782631111.930954 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x69c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20d6a): Mirror 9: 0x5cfa5014 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20d6a): Mirror 9: 0x5cfa5014 (stale) CRC-32 checksum value for chunk [0, 0x20d6a): Mirror 1: 0xab3ba310 Mirror 10: 0xab3ba310 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20d6a: skipped 000993 1782631112.125833 read 0x0109c1 thru 0x01abf8 (0xa238 bytes) 000994 1782631112.136205 read 0x01a241 thru 0x020d69 (0x6b29 bytes) 000996 1782631112.150828 trunc from 0x00cf7e to 0x017a62 (0xaae5 bytes) 000997 1782631112.162751 mapread 0x002528 thru 0x0112b0 (0xed89 bytes) 000998 1782631112.188711 mapwrite 0x028fec thru 0x02b525 (0x253a bytes) 000999 1782631112.213377 trunc from 0x02b526 to 0x026b79 (0x49ac bytes) 001000 1782631112.219753 write 0x03310a thru 0x03ffff (0xcef6 bytes) All operations completed A-OK!