== sanity-flr test 70a: flr mode fsx test ================ 12:30:42 (1784046642) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 6645 skipping zero length punch hole 000002 1784046645.879857 write 0x03953a thru 0x03c32b (0x2df2 bytes) 000004 1784046645.888217 read 0x00a185 thru 0x00f43d (0x52b9 bytes) zero_range to largest ever: 0x35cf3 000005 1784046645.910659 trunc from 0x033bda to 0x035cf2 (0x2119 bytes) 000008 1784046645.938180 punch from 0x020d75 to 0x02ab85 (0x9e11 bytes) 000010 1784046645.968470 read 0x00728b thru 0x00e9dc (0x7752 bytes) 000011 1784046646.007360 read 0x00af45 thru 0x013049 (0x8105 bytes) 000012 1784046646.008138 mapwrite 0x03605c thru 0x036e5d (0xe02 bytes) 000013 1784046646.036777 write 0x030166 thru 0x0351e8 (0x5083 bytes) 000015 1784046646.039603 mapwrite 0x01a725 thru 0x025255 (0xab31 bytes) 000017 1784046646.067517 mapread 0x036e40 thru 0x03c32b (0x54ec bytes) 000018 1784046646.070902 write 0x02adb3 thru 0x031745 (0x6993 bytes) 000019 1784046646.073610 mapwrite 0x031cb2 thru 0x03a812 (0x8b61 bytes) 000021 1784046646.100460 read 0x0058c7 thru 0x00df8d (0x86c7 bytes) 000022 1784046646.102641 trunc from 0x01e23e to 0x02aec5 (0xcc88 bytes) truncating to largest ever: 0x3aefc 000023 1784046646.109698 trunc from 0x03c32c to 0x03aefb (0x1430 bytes) 000024 1784046646.131745 write 0x0084e7 thru 0x00d02e (0x4b48 bytes) 000025 1784046646.136887 trunc from 0x03aefc to 0x017a68 (0x23493 bytes) 000026 1784046646.165934 read 0x00ede7 thru 0x017a68 (0x8c82 bytes) 000028 1784046646.167371 mapwrite 0x019fa0 thru 0x024335 (0xa396 bytes) 000029 1784046646.269328 read 0x00c2fc thru 0x01869a (0xc39f bytes) 000030 1784046646.274438 trunc from 0x00d576 to 0x00ffd8 (0x2a63 bytes) 000031 1784046646.292612 trunc from 0x024336 to 0x01e3f4 (0x5f41 bytes) 000032 1784046646.320365 mapwrite 0x02f522 thru 0x03b030 (0xbb0f bytes) 000033 1784046646.384601 fallocate 0x02466e thru 0x02488e (0x221 bytes) 000034 1784046646.393518 punch from 0x0311f8 to 0x03b030 (0x9e39 bytes) 000035 1784046646.411459 read 0x0168eb thru 0x01fea4 (0x95ba bytes) 000036 1784046646.418560 write 0x03ed0f thru 0x03ffff (0x12f1 bytes) 000037 1784046646.427576 read 0x031bf5 thru 0x036761 (0x4b6d bytes) 000039 1784046646.481372 punch from 0x0381eb to 0x03ffff (0x7e15 bytes) 000041 1784046646.543026 MIRROR_EXTEND to 2 mirrors 000042 1784046647.573960 trunc from 0x02f6ae to 0x03bf35 (0xc888 bytes) 000043 1784046647.621459 read 0x03cc8b thru 0x03ffff (0x3375 bytes) 000044 1784046647.629761 punch from 0x013586 to 0x01fd87 (0xc802 bytes) 000045 1784046647.636536 read 0x00c792 thru 0x00e10f (0x197e bytes) 000046 1784046647.658473 MIRROR_RESYNC 2 mirrors 000047 1784046648.623906 fallocate 0x002e6d thru 0x0072c6 (0x445a bytes) 000048 1784046648.684498 punch from 0x021ce5 to 0x027205 (0x5521 bytes) 000049 1784046648.697840 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa3750ccc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa3750ccc Mirror 3: 0xa3750ccc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000050 1784046649.592200 trunc from 0x009776 to 0x00e46e (0x4cf9 bytes) 000051 1784046649.645857 trunc from 0x040000 to 0x0232ad (0x1cd52 bytes) 000052 1784046649.686320 fallocate 0x00c336 thru 0x00cec9 (0xb94 bytes) 000053 1784046649.692947 read 0x00f8e2 thru 0x01567d (0x5d9c bytes) 000054 1784046649.703579 mapwrite 0x03f45c thru 0x03ffff (0xba4 bytes) 000055 1784046649.753842 MIRROR_RESYNC 3 mirrors 000056 1784046650.584618 mapwrite 0x02e610 thru 0x038d09 (0xa6fa bytes) 000057 1784046650.691707 trunc from 0x0182fe to 0x01f0bf (0x6dc2 bytes) 000058 1784046650.698452 trunc from 0x034079 to 0x035aa2 (0x1a2a bytes) 000059 1784046650.709452 punch from 0x023c55 to 0x02691a (0x2cc6 bytes) 000060 1784046650.715570 mapwrite 0x016872 thru 0x024186 (0xd915 bytes) 000061 1784046650.765023 mapwrite 0x00592c thru 0x00ea1f (0x90f4 bytes) 000062 1784046650.796692 fallocate 0x034065 thru 0x0365ef (0x258b bytes) 000064 1784046650.803804 write 0x00999d thru 0x00d18a (0x37ee bytes) 000066 1784046650.807379 fallocate 0x005d99 thru 0x015d76 (0xffde bytes) 000067 1784046650.813704 trunc from 0x040000 to 0x01f275 (0x20d8a bytes) 000068 1784046650.847713 trunc from 0x00a106 to 0x018200 (0xe0fb bytes) 000070 1784046650.869954 mapread 0x01b600 thru 0x01f275 (0x3c76 bytes) 000071 1784046650.871126 trunc from 0x00be8a to 0x01494c (0x8ac3 bytes) 000072 1784046650.877139 fallocate 0x027088 thru 0x035f33 (0xeeac bytes) 000073 1784046650.886424 read 0x017bc7 thru 0x01c760 (0x4b9a bytes) 000074 1784046650.894750 trunc from 0x01f276 to 0x011dca (0xd4ab bytes) 000075 1784046650.921367 mapread 0x00271b thru 0x005474 (0x2d5a bytes) fallocating to largest ever: 0x40000 000077 1784046650.923121 fallocate 0x03ca8d thru 0x03ffff (0x3573 bytes) 000078 1784046650.931174 write 0x037860 thru 0x03ffff (0x87a0 bytes) 000079 1784046650.942324 MIRROR_RESYNC 3 mirrors 000080 1784046651.909875 mapread 0x03461b thru 0x03916a (0x4b50 bytes) 000081 1784046651.931790 read 0x01836d thru 0x01b66e (0x3302 bytes) 000082 1784046651.939700 write 0x018a1e thru 0x02490b (0xbeee bytes) 000083 1784046651.979534 punch from 0x03656b to 0x03af9c (0x4a32 bytes) 000084 1784046651.986041 write 0x011e02 thru 0x0184d4 (0x66d3 bytes) 000085 1784046651.994935 fallocate 0x023212 thru 0x02caed (0x98dc bytes) 000086 1784046652.001410 mapwrite 0x031383 thru 0x03ffff (0xec7d bytes) 000087 1784046652.084913 write 0x02d0d6 thru 0x02f269 (0x2194 bytes) 000088 1784046652.107640 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc566548 (stale) Mirror 3: 0xc566548 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3bc63393 Mirror 4: 0x3bc63393 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000089 1784046653.021947 write 0x0372c1 thru 0x03ffff (0x8d3f bytes) 000090 1784046653.090264 trunc from 0x0290ec to 0x03846c (0xf381 bytes) 000092 1784046653.119271 trunc from 0x040000 to 0x0324d1 (0xdb2e bytes) 000093 1784046653.204808 mapwrite 0x02e3c5 thru 0x03a7e1 (0xc41d bytes) 000094 1784046653.308973 trunc from 0x01837e to 0x027b14 (0xf797 bytes) 000095 1784046653.325664 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3a7e2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7e2): Mirror 2: 0xe492d5bc (stale) Mirror 3: 0xe492d5bc (stale) Mirror 4: 0xc6cc28b3 (stale) CRC-32 checksum value for chunk [0, 0x3a7e2): Mirror 1: 0xe82a813b Mirror 5: 0xe82a813b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7e2: skipped 000096 1784046654.096303 mapread 0x0265e3 thru 0x02ac61 (0x467f bytes) 000097 1784046654.133395 mapread 0x0079fe thru 0x0150cb (0xd6ce bytes) 000098 1784046654.181903 fallocate 0x01a509 thru 0x01d49d (0x2f95 bytes) 000099 1784046654.283859 punch from 0x02379a to 0x0316bf (0xdf26 bytes) 000100 1784046654.292967 write 0x0167e8 thru 0x0196f7 (0x2f10 bytes) 000101 1784046654.322708 mapread 0x0283cf thru 0x02afa8 (0x2bda bytes) 000102 1784046654.409550 MIRROR_RESYNC 5 mirrors 000103 1784046656.185660 punch from 0x03307b to 0x03a7e1 (0x7767 bytes) 000105 1784046656.224409 write 0x02e224 thru 0x0325e2 (0x43bf bytes) 000106 1784046656.237728 mapwrite 0x020814 thru 0x02c7e3 (0xbfd0 bytes) 000107 1784046656.288235 MIRROR_RESYNC 5 mirrors 000108 1784046658.399699 fallocate 0x003eb8 thru 0x013748 (0xf891 bytes) 000109 1784046658.447153 trunc from 0x03a7e2 to 0x03230e (0x84d3 bytes) 000110 1784046658.487467 write 0x023039 thru 0x030a61 (0xda29 bytes) 000112 1784046658.506929 mapwrite 0x0140d7 thru 0x018f00 (0x4e2a bytes) 000113 1784046658.569901 punch from 0x009905 to 0x00b7d5 (0x1ed1 bytes) 000114 1784046658.575348 trunc from 0x03230f to 0x027050 (0xb2be bytes) 000115 1784046658.606395 write 0x00cc06 thru 0x01a336 (0xd731 bytes) 000116 1784046658.626269 read 0x026289 thru 0x027050 (0xdc8 bytes) 000118 1784046658.628962 write 0x032c29 thru 0x039dd1 (0x71a9 bytes) 000119 1784046658.632680 trunc from 0x011363 to 0x01e544 (0xd1e2 bytes) 000120 1784046658.660459 trunc from 0x039dd2 to 0x036516 (0x38bb bytes) 000121 1784046658.681721 fallocate 0x03d88a thru 0x03ffff (0x2776 bytes) 000122 1784046658.713419 MIRROR_RESYNC 5 mirrors 000123 1784046661.027798 mapwrite 0x038288 thru 0x03df75 (0x5cee bytes) 000124 1784046661.219658 write 0x02690c thru 0x027aef (0x11e4 bytes) 000125 1784046661.253991 fallocate 0x03cd8b thru 0x03fcec (0x2f62 bytes) 000126 1784046661.271217 mapread 0x00ff2b thru 0x01c6ae (0xc784 bytes) 000127 1784046661.338694 read 0x03c52c thru 0x03ffff (0x3ad4 bytes) 000128 1784046661.339676 trunc from 0x038c97 to 0x03d3de (0x4748 bytes) 000129 1784046661.372958 mapread 0x039356 thru 0x03c09a (0x2d45 bytes) 000131 1784046661.396066 punch from 0x033fe6 to 0x0364d7 (0x24f2 bytes) 000132 1784046661.417392 MIRROR_RESYNC 5 mirrors 000133 1784046663.589504 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) 000134 1784046663.929589 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) 000136 1784046664.358847 MIRROR_EXTEND to 4 mirrors 000137 1784046665.323762 fallocate 0x03f26c thru 0x03f708 (0x49d bytes) 000138 1784046665.407476 mapwrite 0x02d114 thru 0x030437 (0x3324 bytes) 000139 1784046665.468017 fallocate 0x02b39b thru 0x02c903 (0x1569 bytes) 000140 1784046665.473766 mapwrite 0x025ea3 thru 0x02602e (0x18c bytes) 000141 1784046665.516268 mapread 0x000012 thru 0x009b80 (0x9b6f bytes) 000142 1784046665.529806 trunc from 0x03d8b0 to 0x03ffff (0x2750 bytes) 000143 1784046665.549806 MIRROR_RESYNC 4 mirrors 000144 1784046667.694842 fallocate 0x009ce9 thru 0x0183da (0xe6f2 bytes) 000145 1784046667.739804 fallocate 0x000fc4 thru 0x00c057 (0xb094 bytes) 000146 1784046667.750481 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1188683f (stale) Mirror 5: 0x1188683f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1188683f (stale) Mirror 5: 0x1188683f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000147 1784046668.138307 fallocate 0x0336af thru 0x03ad02 (0x7654 bytes) 000148 1784046668.144203 read 0x03b50e thru 0x03ffff (0x4af2 bytes) 000149 1784046668.154955 fallocate 0x029b58 thru 0x039600 (0xfaa9 bytes) 000150 1784046668.161717 fallocate 0x014e40 thru 0x016ff4 (0x21b5 bytes) 000151 1784046668.166718 fallocate 0x0177ed thru 0x01fd48 (0x855c bytes) 000152 1784046668.177707 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1188683f (stale) Mirror 5: 0x1188683f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1188683f Mirror 6: 0x1188683f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000154 1784046669.257551 write 0x01f5ab thru 0x02638f (0x6de5 bytes) 000156 1784046669.334180 trunc from 0x03d365 to 0x03ffff (0x2c9b bytes) 000157 1784046669.346692 mapwrite 0x01c97a thru 0x029e36 (0xd4bd bytes) 000158 1784046669.438313 punch from 0x017dd0 to 0x018690 (0x8c1 bytes) 000159 1784046669.445860 write 0x01bc93 thru 0x026693 (0xaa01 bytes) 000160 1784046669.449706 write 0x03bc02 thru 0x03ffff (0x43fe bytes) 000161 1784046669.459129 write 0x026c0c thru 0x032d7f (0xc174 bytes) 000162 1784046669.468858 punch from 0x00cee2 to 0x010f86 (0x40a5 bytes) 000164 1784046669.478674 read 0x02a002 thru 0x0341e1 (0xa1e0 bytes) 000165 1784046669.487779 mapwrite 0x007490 thru 0x0161b8 (0xed29 bytes) 000166 1784046669.579439 trunc from 0x02bd96 to 0x03b641 (0xf8ac bytes) 000167 1784046669.585546 trunc from 0x0358ba to 0x03d6a0 (0x7de7 bytes) 000168 1784046669.596676 fallocate 0x0111fc thru 0x0155a2 (0x43a7 bytes) 000169 1784046669.604672 fallocate 0x014f1d thru 0x01bb62 (0x6c46 bytes) 000170 1784046669.610557 mapread 0x0142b1 thru 0x01a158 (0x5ea8 bytes) 000171 1784046669.612696 trunc from 0x021f37 to 0x0301bf (0xe289 bytes) 000172 1784046669.620206 trunc from 0x01e167 to 0x029fd8 (0xbe72 bytes) 000173 1784046669.626865 mapread 0x00396b thru 0x012231 (0xe8c7 bytes) 000174 1784046669.629538 mapwrite 0x0110af thru 0x013765 (0x26b7 bytes) 000175 1784046669.650559 read 0x022e08 thru 0x0246bb (0x18b4 bytes) 000176 1784046669.662765 mapwrite 0x037400 thru 0x03ffff (0x8c00 bytes) 000177 1784046669.684465 write 0x0251e7 thru 0x03178d (0xc5a7 bytes) 000178 1784046669.689346 mapread 0x006eb1 thru 0x00ad81 (0x3ed1 bytes) 000179 1784046669.697312 punch from 0x029f0d to 0x030862 (0x6956 bytes) 000180 1784046669.716695 mapread 0x027085 thru 0x0335ef (0xc56b bytes) 000181 1784046669.795713 mapwrite 0x037c17 thru 0x038bfe (0xfe8 bytes) 000182 1784046669.829467 trunc from 0x03ab50 to 0x03ffff (0x54b0 bytes) 000183 1784046669.846698 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1188683f (stale) Mirror 6: 0x1188683f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x1188683f (stale) Mirror 6: 0x1188683f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000184 1784046670.313497 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x1188683f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x1188683f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000185 1784046670.706767 fallocate 0x003330 thru 0x00a07d (0x6d4e bytes) 000186 1784046670.713366 mapread 0x00e5f7 thru 0x00fd40 (0x174a bytes) 000187 1784046670.726256 trunc from 0x040000 to 0x0294c0 (0x16b3f bytes) 000188 1784046670.751493 trunc from 0x014323 to 0x021f6a (0xdc48 bytes) 000189 1784046670.756654 mapread 0x007b0a thru 0x012619 (0xab10 bytes) 000190 1784046670.780542 mapwrite 0x027bd6 thru 0x02a736 (0x2b61 bytes) 000191 1784046670.836437 write 0x004e31 thru 0x006c14 (0x1de4 bytes) 000192 1784046670.838464 trunc from 0x019f76 to 0x01e467 (0x44f2 bytes) 000193 1784046670.845324 punch from 0x02015d to 0x02a736 (0xa5da bytes) 000194 1784046670.853461 trunc from 0x02a737 to 0x0352b4 (0xab7e bytes) 000195 1784046670.871809 trunc from 0x00bb2c to 0x00c424 (0x8f9 bytes) 000196 1784046670.879376 mapread 0x028465 thru 0x02e69d (0x6239 bytes) 000197 1784046670.893083 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x352b5): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352b5): Mirror 6: 0x600d0865 (stale) CRC-32 checksum value for chunk [0, 0x352b5): Mirror 1: 0xf088d7e5 Mirror 7: 0xf088d7e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352b5: skipped 000198 1784046671.841954 read 0x023d75 thru 0x025add (0x1d69 bytes) 000199 1784046671.856841 punch from 0x0214b2 to 0x02ef80 (0xdacf bytes) 000200 1784046671.927634 mapread 0x01581f thru 0x017c6e (0x2450 bytes) 000201 1784046671.965447 trunc from 0x031d31 to 0x033527 (0x17f7 bytes) 000202 1784046671.971650 mapread 0x019cc7 thru 0x0206ba (0x69f4 bytes) 000204 1784046671.984706 fallocate 0x004d4f thru 0x00dcb5 (0x8f67 bytes) 000205 1784046671.991503 fallocate 0x0057c4 thru 0x00adf8 (0x5635 bytes) 000206 1784046672.002615 MIRROR_RESYNC 3 mirrors 000207 1784046672.709576 trunc from 0x003b4c to 0x008c9b (0x5150 bytes) 000208 1784046672.739312 mapread 0x02eee3 thru 0x0352b4 (0x63d2 bytes) 000209 1784046672.760965 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x352b5): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352b5): Mirror 6: 0xf088d7e5 (stale) Mirror 7: 0xf088d7e5 (stale) CRC-32 checksum value for chunk [0, 0x352b5): Mirror 1: 0x3995cab4 Mirror 8: 0x3995cab4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352b5: skipped 000210 1784046673.528745 fallocate 0x03f863 thru 0x03ffff (0x79d bytes) 000212 1784046673.583035 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb1785963 (stale) Mirror 8: 0xa0cc1843 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb1785963 (stale) Mirror 8: 0xa0cc1843 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000214 1784046673.977790 read 0x014dea thru 0x01aa54 (0x5c6b bytes) 000215 1784046673.994189 mapwrite 0x03f32d thru 0x03f6e8 (0x3bc bytes) 000217 1784046674.016374 read 0x03e0ea thru 0x03e7e9 (0x700 bytes) 000218 1784046674.029293 fallocate 0x036659 thru 0x03ffff (0x99a7 bytes) 000219 1784046674.039442 MIRROR_RESYNC 3 mirrors 000220 1784046674.650294 fallocate 0x01b83a thru 0x02aa46 (0xf20d bytes) 000222 1784046674.723812 mapwrite 0x0163a5 thru 0x01a783 (0x43df bytes) 000223 1784046674.810728 MIRROR_RESYNC 3 mirrors 000224 1784046675.944245 trunc from 0x00480e to 0x00d83d (0x9030 bytes) 000225 1784046676.050979 fallocate 0x02900d thru 0x02c2f6 (0x32ea bytes) 000226 1784046676.070766 punch from 0x034dc8 to 0x03ffff (0xb238 bytes) 000227 1784046676.087586 mapread 0x01cecf thru 0x02989d (0xc9cf bytes) 000228 1784046676.147478 mapread 0x02918d thru 0x038a73 (0xf8e7 bytes) 000229 1784046676.162939 trunc from 0x040000 to 0x01fa82 (0x2057d bytes) 000232 1784046676.194474 mapwrite 0x0104fb thru 0x013901 (0x3407 bytes) 000233 1784046676.232719 read 0x015eba thru 0x01fa71 (0x9bb8 bytes) 000235 1784046676.235384 read 0x000c9c thru 0x007bd7 (0x6f3c bytes) 000236 1784046676.247462 trunc from 0x01fa83 to 0x02fc27 (0x101a5 bytes) 000237 1784046676.268595 trunc from 0x0153e2 to 0x01b211 (0x5e30 bytes) 000238 1784046676.274652 mapwrite 0x00ed92 thru 0x00f1d7 (0x446 bytes) 000239 1784046676.287162 trunc from 0x0160d6 to 0x01a7d8 (0x4703 bytes) 000240 1784046676.291638 fallocate 0x034793 thru 0x03bbcf (0x743d bytes) 000241 1784046676.298602 write 0x03bb54 thru 0x03c143 (0x5f0 bytes) 000242 1784046676.316550 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c144): Mirror 8: 0x11c463c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c144): Mirror 8: 0x11c463c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c144: skipped 000243 1784046676.633576 trunc from 0x00df08 to 0x019479 (0xb572 bytes) 000245 1784046676.649362 MIRROR_RESYNC 2 mirrors 000246 1784046677.360394 write 0x0362f6 thru 0x039176 (0x2e81 bytes) 000247 1784046677.410216 trunc from 0x03ab0c to 0x03adcb (0x2c0 bytes) 000248 1784046677.417151 fallocate 0x02640e thru 0x032dbf (0xc9b2 bytes) 000249 1784046677.423397 read 0x01ae0e thru 0x02217d (0x7370 bytes) 000250 1784046677.433460 trunc from 0x02b95a to 0x03ab16 (0xf1bd bytes) 000251 1784046677.447356 trunc from 0x03c144 to 0x02f95b (0xc7e8 bytes) 000252 1784046677.466161 punch from 0x01ddd7 to 0x01f4f6 (0x1720 bytes) 000253 1784046677.474457 punch from 0x0217b7 to 0x02f95b (0xe1a5 bytes) 000254 1784046677.479470 mapwrite 0x01eb0a thru 0x02e276 (0xf76d bytes) 000255 1784046677.541669 mapread 0x02544e thru 0x02cc36 (0x77e9 bytes) 000256 1784046677.543406 fallocate 0x00ec68 thru 0x015b15 (0x6eae bytes) 000257 1784046677.559025 MIRROR_RESYNC 2 mirrors 000258 1784046678.125572 trunc from 0x02f95c to 0x000e17 (0x2eb44 bytes) 000259 1784046678.222770 write 0x03e1b5 thru 0x03ffff (0x1e4b bytes) 000260 1784046678.228253 mapread 0x00b551 thru 0x0133e5 (0x7e95 bytes) 000261 1784046678.249073 trunc from 0x0027f5 to 0x00f48b (0xcc97 bytes) 000262 1784046678.257620 write 0x02203b thru 0x025582 (0x3548 bytes) 000263 1784046678.273494 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) 000264 1784046678.415653 trunc from 0x01ee72 to 0x026aea (0x7c79 bytes) 000265 1784046678.420910 fallocate 0x0293e2 thru 0x02f782 (0x63a1 bytes) 000267 1784046678.428710 read 0x027012 thru 0x0279fe (0x9ed bytes) 000268 1784046678.434378 punch from 0x0307f8 to 0x03c384 (0xbb8d bytes) 000269 1784046678.439370 write 0x02943d thru 0x03080d (0x73d1 bytes) 000271 1784046678.456557 write 0x02d905 thru 0x032193 (0x488f bytes) 000272 1784046678.464028 fallocate 0x0366ba thru 0x038010 (0x1957 bytes) 000273 1784046678.469865 trunc from 0x00b293 to 0x010e29 (0x5b97 bytes) 000274 1784046678.474628 fallocate 0x0022e0 thru 0x00ff18 (0xdc39 bytes) 000275 1784046678.480243 read 0x03da01 thru 0x03ffff (0x25ff bytes) 000276 1784046678.508918 mapread 0x00e751 thru 0x01d27d (0xeb2d bytes) 000277 1784046678.514510 MIRROR_EXTEND to 2 mirrors 000278 1784046679.180741 trunc from 0x040000 to 0x02a603 (0x159fc bytes) 000279 1784046679.274309 punch from 0x020115 to 0x027a78 (0x7964 bytes) 000280 1784046679.280393 mapwrite 0x03f654 thru 0x03ffff (0x9ac bytes) 000281 1784046679.318483 mapread 0x0169bf thru 0x018790 (0x1dd2 bytes) 000282 1784046679.338687 MIRROR_RESYNC 2 mirrors 000283 1784046679.922909 mapwrite 0x01975e thru 0x021c45 (0x84e8 bytes) 000284 1784046680.036560 MIRROR_RESYNC 2 mirrors 000285 1784046680.940900 read 0x0005b4 thru 0x0058e9 (0x5336 bytes) 000286 1784046680.950466 trunc from 0x005ae7 to 0x00ffeb (0xa505 bytes) 000288 1784046681.035044 trunc from 0x01908b to 0x025f29 (0xce9f bytes) 000293 1784046681.052945 mapread 0x03b1eb thru 0x03ffff (0x4e15 bytes) 000295 1784046681.091164 mapwrite 0x03246e thru 0x03ffff (0xdb92 bytes) 000296 1784046681.132640 trunc from 0x040000 to 0x00b962 (0x3469d bytes) 000297 1784046681.168303 trunc from 0x00b963 to 0x0146bc (0x8d5a bytes) 000298 1784046681.199132 mapwrite 0x03c1c1 thru 0x03ffff (0x3e3f bytes) 000299 1784046681.277571 read 0x02106e thru 0x0234de (0x2471 bytes) 000300 1784046681.300045 punch from 0x0347ab to 0x03bdd4 (0x762a bytes) 000303 1784046681.334936 MIRROR_RESYNC 2 mirrors 000304 1784046681.973267 punch from 0x0264e8 to 0x02c7d2 (0x62eb bytes) 000306 1784046682.014607 write 0x01a503 thru 0x02294e (0x844c bytes) 000307 1784046682.025442 mapread 0x009104 thru 0x018590 (0xf48d bytes) 000308 1784046682.054587 fallocate 0x02ebc7 thru 0x037412 (0x884c bytes) 000309 1784046682.060488 fallocate 0x0226ac thru 0x023ee4 (0x1839 bytes) 000310 1784046682.066123 write 0x00fec5 thru 0x01f3b1 (0xf4ed bytes) 000312 1784046682.068986 write 0x02685e thru 0x031849 (0xafec bytes) 000313 1784046682.082207 trunc from 0x00e20a to 0x014bd8 (0x69cf bytes) 000314 1784046682.102898 fallocate 0x03baef thru 0x03ffff (0x4511 bytes) 000315 1784046682.108708 trunc from 0x040000 to 0x030b6e (0xf491 bytes) 000316 1784046682.161568 fallocate 0x03a7c6 thru 0x03ffff (0x583a bytes) 000317 1784046682.167433 punch from 0x019508 to 0x026d24 (0xd81d bytes) 000318 1784046682.175473 fallocate 0x0174af thru 0x026077 (0xebc9 bytes) 000319 1784046682.183471 trunc from 0x00d02a to 0x00e0a5 (0x107c bytes) 000320 1784046682.198343 trunc from 0x01be73 to 0x01e7e5 (0x2973 bytes) 000321 1784046682.207335 fallocate 0x028cb9 thru 0x02a344 (0x168c bytes) 000322 1784046682.214666 write 0x011094 thru 0x012272 (0x11df bytes) 000323 1784046682.227203 write 0x002df4 thru 0x0090a7 (0x62b4 bytes) 000325 1784046682.235041 trunc from 0x030b6f to 0x0292e1 (0x788d bytes) 000326 1784046682.251222 trunc from 0x0292e2 to 0x02c826 (0x3545 bytes) 000327 1784046682.267988 mapwrite 0x03ac4c thru 0x03ffff (0x53b4 bytes) 000328 1784046682.327580 trunc from 0x006a25 to 0x010e68 (0xa444 bytes) 000329 1784046682.338251 read 0x025423 thru 0x03103f (0xbc1d bytes) 000330 1784046682.353605 punch from 0x02ef74 to 0x03628a (0x7317 bytes) 000331 1784046682.364369 mapread 0x03b04e thru 0x03da31 (0x29e4 bytes) 000332 1784046682.367983 trunc from 0x001b32 to 0x00e859 (0xcd28 bytes) 000333 1784046682.385861 MIRROR_RESYNC 2 mirrors 000334 1784046683.406755 mapwrite 0x021463 thru 0x022615 (0x11b3 bytes) 000335 1784046683.582243 mapread 0x00e597 thru 0x017c69 (0x96d3 bytes) 000336 1784046683.611632 trunc from 0x02b0e2 to 0x0385ed (0xd50c bytes) 000337 1784046683.617690 write 0x017858 thru 0x0243de (0xcb87 bytes) 000338 1784046683.624226 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x80dc832f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xab1d1236 Mirror 3: 0xab1d1236 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000339 1784046684.780919 mapwrite 0x0389ed thru 0x03ffff (0x7613 bytes) 000342 1784046685.025525 fallocate 0x034d07 thru 0x03b047 (0x6341 bytes) 000343 1784046685.033319 punch from 0x02c808 to 0x030822 (0x401b bytes) 000345 1784046685.041723 mapread 0x01ce46 thru 0x024d3a (0x7ef5 bytes) 000346 1784046685.056719 mapwrite 0x004193 thru 0x005fa5 (0x1e13 bytes) 000347 1784046685.087311 write 0x03ef05 thru 0x03ffff (0x10fb bytes) 000348 1784046685.102177 fallocate 0x00e0d7 thru 0x01a193 (0xc0bd bytes) 000349 1784046685.114269 mapwrite 0x01b7bb thru 0x01e05a (0x28a0 bytes) 000350 1784046685.144332 trunc from 0x029071 to 0x03220b (0x919b bytes) 000351 1784046685.152547 write 0x00cf88 thru 0x01a576 (0xd5ef bytes) 000352 1784046685.155535 mapwrite 0x01a8fc thru 0x027f4a (0xd64f bytes) 000353 1784046685.192854 read 0x00c401 thru 0x012e46 (0x6a46 bytes) 000354 1784046685.193606 mapread 0x01cc9c thru 0x027c84 (0xafe9 bytes) 000355 1784046685.196306 fallocate 0x03f715 thru 0x03ffff (0x8eb bytes) 000356 1784046685.208400 MIRROR_RESYNC 3 mirrors 000357 1784046686.024227 MIRROR_RESYNC 3 mirrors 000358 1784046686.592466 trunc from 0x011ec2 to 0x01fbc3 (0xdd02 bytes) 000359 1784046686.657196 MIRROR_RESYNC 3 mirrors 000360 1784046687.921960 fallocate 0x015a98 thru 0x01fbea (0xa153 bytes) 000361 1784046687.974969 trunc from 0x040000 to 0x00f686 (0x30979 bytes) 000362 1784046688.030875 trunc from 0x00d5d3 to 0x00f399 (0x1dc7 bytes) 000363 1784046688.039133 write 0x02bc50 thru 0x02e047 (0x23f8 bytes) 000365 1784046688.043065 mapwrite 0x030a16 thru 0x03e5ec (0xdbd7 bytes) 000366 1784046688.123328 fallocate 0x0057a4 thru 0x00a0b0 (0x490d bytes) 000367 1784046688.132259 fallocate 0x02525c thru 0x0267f5 (0x159a bytes) 000368 1784046688.141314 read 0x025088 thru 0x029c99 (0x4c12 bytes) 000369 1784046688.160455 read 0x015c71 thru 0x01637e (0x70e bytes) 000370 1784046688.171445 trunc from 0x03e5ed to 0x007ccd (0x3691f bytes) 000371 1784046688.191260 fallocate 0x014535 thru 0x02452c (0xfff8 bytes) 000372 1784046688.197274 write 0x0075fc thru 0x013ef4 (0xc8f9 bytes) 000373 1784046688.200207 trunc from 0x013ef5 to 0x00e9d8 (0x551c bytes) 000374 1784046688.220780 trunc from 0x009bc7 to 0x00ab72 (0xfac bytes) 000375 1784046688.236584 trunc from 0x0005a4 to 0x009afe (0x955b bytes) 000376 1784046688.242394 write 0x037f82 thru 0x03c092 (0x4111 bytes) 000377 1784046688.245697 mapwrite 0x010bdb thru 0x019c78 (0x909e bytes) 000378 1784046688.310409 trunc from 0x03c093 to 0x01c1c4 (0x1fece bytes) 000379 1784046688.326650 trunc from 0x00e3c9 to 0x01679b (0x83d3 bytes) 000380 1784046688.334279 trunc from 0x00babb to 0x01287c (0x6dc2 bytes) 000381 1784046688.347174 trunc from 0x01c1c5 to 0x033cdc (0x17b18 bytes) 000382 1784046688.365389 mapwrite 0x0023a3 thru 0x00d311 (0xaf6f bytes) 000383 1784046688.454851 write 0x009235 thru 0x017525 (0xe2f1 bytes) 000384 1784046688.459329 trunc from 0x033cdd to 0x035fe0 (0x2304 bytes) 000385 1784046688.491024 punch from 0x013e09 to 0x01b555 (0x774d bytes) 000386 1784046688.513581 trunc from 0x035fe1 to 0x021550 (0x14a90 bytes) 000389 1784046688.534749 write 0x005e1b thru 0x015a96 (0xfc7c bytes) 000390 1784046688.540889 punch from 0x002273 to 0x0049a7 (0x2735 bytes) 000391 1784046688.546996 punch from 0x013597 to 0x0187d6 (0x5240 bytes) 000392 1784046688.564391 read 0x01463b thru 0x014ad9 (0x49f bytes) 000395 1784046688.585037 mapread 0x00f361 thru 0x010c55 (0x18f5 bytes) 000396 1784046688.586533 read 0x01bf56 thru 0x021550 (0x55fb bytes) 000397 1784046688.588297 mapread 0x016cae thru 0x01860a (0x195d bytes) 000398 1784046688.590039 punch from 0x01616e to 0x021550 (0xb3e3 bytes) 000399 1784046688.596043 mapwrite 0x015848 thru 0x016ca8 (0x1461 bytes) 000400 1784046688.626644 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x21551): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21551): Mirror 2: 0x308a8295 (stale) Mirror 3: 0x308a8295 (stale) CRC-32 checksum value for chunk [0, 0x21551): Mirror 1: 0x5e44ad38 Mirror 4: 0x5e44ad38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21551: skipped 000401 1784046689.520995 mapread 0x01d4e2 thru 0x021550 (0x406f bytes) 000402 1784046689.541051 mapwrite 0x01129e thru 0x011538 (0x29b bytes) 000403 1784046689.661014 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x21551): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21551): Mirror 2: 0x308a8295 (stale) Mirror 3: 0x308a8295 (stale) Mirror 4: 0x5e44ad38 (stale) CRC-32 checksum value for chunk [0, 0x21551): Mirror 1: 0xbba82e04 Mirror 5: 0xbba82e04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21551: skipped 000404 1784046690.580242 punch from 0x00d6b1 to 0x0182fb (0xac4b bytes) 000406 1784046690.626670 trunc from 0x021551 to 0x002b16 (0x1ea3a bytes) 000407 1784046690.660522 fallocate 0x02f3aa thru 0x031a99 (0x26f0 bytes) 000408 1784046690.666335 fallocate 0x005df7 thru 0x00bd0d (0x5f17 bytes) 000409 1784046690.680698 MIRROR_RESYNC 5 mirrors 000410 1784046692.023982 punch from 0x02c1ca to 0x02c2ae (0xe5 bytes) 000411 1784046692.076478 fallocate 0x027b81 thru 0x031132 (0x95b2 bytes) 000412 1784046692.084968 fallocate 0x016399 thru 0x024800 (0xe468 bytes) 000413 1784046692.092004 trunc from 0x031a9a to 0x011d34 (0x1fd65 bytes) 000414 1784046692.119135 write 0x03ec15 thru 0x03ffff (0x13eb bytes) 000416 1784046692.124076 trunc from 0x02ddf9 to 0x0370e5 (0x92ed bytes) 000417 1784046692.129433 fallocate 0x010ff2 thru 0x016259 (0x5268 bytes) 000418 1784046692.134616 trunc from 0x040000 to 0x02d45b (0x12ba4 bytes) 000419 1784046692.157653 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d45c): Mirror 3: 0x7212401d (stale) Mirror 4: 0x7212401d (stale) Mirror 5: 0x7212401d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d45c): Mirror 3: 0x7212401d (stale) Mirror 4: 0x7212401d (stale) Mirror 5: 0x7212401d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d45c: skipped 000420 1784046692.483057 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d45c): Mirror 4: 0x7212401d (stale) Mirror 5: 0x7212401d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d45c): Mirror 4: 0x7212401d (stale) Mirror 5: 0x7212401d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d45c: skipped 000421 1784046692.806972 read 0x025ef4 thru 0x02d45b (0x7568 bytes) 000422 1784046692.825274 fallocate 0x02fc41 thru 0x0398e7 (0x9ca7 bytes) 000423 1784046692.830487 trunc from 0x0009da to 0x00a6eb (0x9d12 bytes) 000424 1784046692.839162 mapread 0x02b849 thru 0x02d45b (0x1c13 bytes) 000426 1784046692.845651 punch from 0x0072cf to 0x00afbf (0x3cf1 bytes) 000427 1784046692.853085 mapread 0x00e032 thru 0x01906a (0xb039 bytes) 000428 1784046692.889050 fallocate 0x022d22 thru 0x031924 (0xec03 bytes) 000429 1784046692.896771 mapwrite 0x035d75 thru 0x036fe9 (0x1275 bytes) 000430 1784046692.942441 read 0x01d2fe thru 0x020c93 (0x3996 bytes) 000431 1784046692.943269 trunc from 0x007848 to 0x016db5 (0xf56e bytes) 000432 1784046692.948992 fallocate 0x03fdc4 thru 0x03ffff (0x23c bytes) 000433 1784046692.954331 mapwrite 0x038a38 thru 0x03ffff (0x75c8 bytes) 000434 1784046693.012591 punch from 0x028405 to 0x029fe8 (0x1be4 bytes) 000435 1784046693.024740 fallocate 0x01a6de thru 0x025f66 (0xb889 bytes) 000436 1784046693.041583 trunc from 0x040000 to 0x03a87d (0x5782 bytes) 000437 1784046693.065537 fallocate 0x00013b thru 0x00f65f (0xf525 bytes) 000438 1784046693.072601 write 0x017006 thru 0x01ea89 (0x7a84 bytes) 000439 1784046693.073845 punch from 0x00cdd8 to 0x01bb0b (0xed34 bytes) 000440 1784046693.094012 trunc from 0x03a87e to 0x02825e (0x1261f bytes) 000441 1784046693.119813 mapread 0x005337 thru 0x00d4de (0x81a8 bytes) 000442 1784046693.134300 trunc from 0x02825f to 0x022dee (0x5470 bytes) 000443 1784046693.163406 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x22def): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22def): Mirror 4: 0xce796a60 (stale) Mirror 5: 0xce796a60 (stale) CRC-32 checksum value for chunk [0, 0x22def): Mirror 1: 0xa4b8b289 Mirror 6: 0xa4b8b289 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22def: skipped 000444 1784046694.254735 read 0x018290 thru 0x01ffb2 (0x7d23 bytes) 000445 1784046694.266643 punch from 0x018392 to 0x01e0ef (0x5d5e bytes) 000446 1784046694.331955 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x22def): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22def): Mirror 4: 0xce796a60 (stale) Mirror 5: 0xce796a60 (stale) Mirror 6: 0xa4b8b289 (stale) CRC-32 checksum value for chunk [0, 0x22def): Mirror 1: 0xc689e21d Mirror 7: 0xc689e21d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22def: skipped 000448 1784046695.272522 mapread 0x016d73 thru 0x01bea0 (0x512e bytes) 000449 1784046695.311175 trunc from 0x022def to 0x0115ce (0x11820 bytes) 000450 1784046695.366480 write 0x012f91 thru 0x01462c (0x169c bytes) 000451 1784046695.368710 fallocate 0x03fee5 thru 0x03ffff (0x11b bytes) 000452 1784046695.374731 trunc from 0x00b64a to 0x01462c (0x8fe3 bytes) 000453 1784046695.385325 mapread 0x00bc27 thru 0x010522 (0x48fc bytes) 000454 1784046695.394927 punch from 0x0049e5 to 0x004f1c (0x538 bytes) 000455 1784046695.403198 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1462d): Mirror 4: 0x9cd9948b (stale) Mirror 5: 0x9cd9948b (stale) Mirror 6: 0x9cd9948b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1462d): Mirror 4: 0x9cd9948b (stale) Mirror 5: 0x9cd9948b (stale) Mirror 6: 0x9cd9948b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1462d: skipped 000456 1784046695.792031 trunc from 0x000486 to 0x000a4a (0x5c5 bytes) 000457 1784046695.798321 fallocate 0x022468 thru 0x02ecef (0xc888 bytes) 000458 1784046695.805881 mapread 0x011067 thru 0x01a643 (0x95dd bytes) 000459 1784046695.835400 write 0x02d3cf thru 0x02ebff (0x1831 bytes) 000460 1784046695.857417 punch from 0x01e8c2 to 0x024635 (0x5d74 bytes) 000461 1784046695.862838 fallocate 0x008b01 thru 0x016373 (0xd873 bytes) 000462 1784046695.867894 mapread 0x01ed04 thru 0x02a7f7 (0xbaf4 bytes) 000463 1784046695.891110 trunc from 0x028b5c to 0x02ecef (0x6194 bytes) 000464 1784046695.904428 trunc from 0x02ecf0 to 0x01d56f (0x11780 bytes) 000465 1784046695.923631 mapread 0x01925a thru 0x019734 (0x4db bytes) 000466 1784046695.924694 punch from 0x01d238 to 0x01d56f (0x338 bytes) 000467 1784046695.931537 mapwrite 0x029b17 thru 0x02f8da (0x5dc4 bytes) 000469 1784046695.979548 trunc from 0x02f8db to 0x01f598 (0x10342 bytes) 000470 1784046696.004610 read 0x005f16 thru 0x009ede (0x3fc9 bytes) 000471 1784046696.016826 trunc from 0x01f599 to 0x00fcd0 (0xf8c8 bytes) 000472 1784046696.035927 fallocate 0x01f349 thru 0x02364c (0x4304 bytes) 000473 1784046696.041320 fallocate 0x02489c thru 0x026418 (0x1b7d bytes) 000474 1784046696.045874 trunc from 0x00fcd1 to 0x03260c (0x2293c bytes) 000475 1784046696.063499 trunc from 0x03260d to 0x01ba02 (0x16c0a bytes) 000476 1784046696.084367 fallocate 0x01d932 thru 0x02a56a (0xcc39 bytes) 000477 1784046696.089770 trunc from 0x01a3bc to 0x01f45a (0x509f bytes) 000478 1784046696.096535 fallocate 0x01320f thru 0x01ce41 (0x9c33 bytes) 000480 1784046696.101225 trunc from 0x02a56b to 0x01725a (0x13310 bytes) 000481 1784046696.113082 write 0x008599 thru 0x00b4b2 (0x2f1a bytes) 000482 1784046696.119412 punch from 0x01192b to 0x0161fe (0x48d4 bytes) 000483 1784046696.124882 trunc from 0x00dad1 to 0x01725a (0x978a bytes) 000484 1784046696.129549 fallocate 0x025282 thru 0x03139b (0xc11a bytes) 000485 1784046696.145473 mapwrite 0x03937a thru 0x03ffff (0x6c86 bytes) 000486 1784046696.215530 mapread 0x01bb6f thru 0x026985 (0xae17 bytes) 000487 1784046696.233893 fallocate 0x03650e thru 0x039450 (0x2f43 bytes) 000488 1784046696.248062 MIRROR_RESYNC 4 mirrors 000489 1784046697.339531 write 0x01a99d thru 0x029dc0 (0xf424 bytes) 000490 1784046697.392418 trunc from 0x040000 to 0x038515 (0x7aea bytes) 000491 1784046697.415206 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38516): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38516): Mirror 4: 0x6d62290c (stale) Mirror 5: 0x6d62290c (stale) Mirror 6: 0x6d62290c (stale) CRC-32 checksum value for chunk [0, 0x38516): Mirror 1: 0xb1f6a318 Mirror 7: 0xb1f6a318 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38516: skipped 000492 1784046698.322396 mapwrite 0x0361ef thru 0x03ffff (0x9e11 bytes) 000493 1784046698.427935 trunc from 0x02ee04 to 0x03e950 (0xfb4d bytes) 000494 1784046698.440975 MIRROR_RESYNC 5 mirrors 000495 1784046699.975967 write 0x007c52 thru 0x00b70b (0x3aba bytes) 000496 1784046700.020433 write 0x012d6f thru 0x01b67e (0x8910 bytes) 000498 1784046700.035696 trunc from 0x028080 to 0x02d317 (0x5298 bytes) 000500 1784046700.043720 mapread 0x031381 thru 0x0326ae (0x132e bytes) 000501 1784046700.057365 read 0x02e11a thru 0x038ba9 (0xaa90 bytes) 000502 1784046700.067954 read 0x028701 thru 0x02e104 (0x5a04 bytes) 000503 1784046700.079287 trunc from 0x040000 to 0x037a4d (0x85b2 bytes) 000504 1784046700.106469 mapread 0x02d0df thru 0x02e853 (0x1775 bytes) 000505 1784046700.109964 mapread 0x035e08 thru 0x037a4d (0x1c46 bytes) 000506 1784046700.114838 mapread 0x032219 thru 0x037a4d (0x5835 bytes) 000507 1784046700.116468 punch from 0x02819b to 0x037706 (0xf56c bytes) 000508 1784046700.124268 write 0x008bea thru 0x0119ea (0x8e01 bytes) 000509 1784046700.125812 mapwrite 0x006e36 thru 0x013649 (0xc814 bytes) 000510 1784046700.158889 fallocate 0x011206 thru 0x018341 (0x713c bytes) 000511 1784046700.165511 mapwrite 0x00812a thru 0x00fea7 (0x7d7e bytes) 000513 1784046700.199808 read 0x00fdb7 thru 0x01aa79 (0xacc3 bytes) 000514 1784046700.201414 mapread 0x02de11 thru 0x037a4d (0x9c3d bytes) 000515 1784046700.221696 mapread 0x003c2c thru 0x01215e (0xe533 bytes) 000516 1784046700.238366 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37a4e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a4e): Mirror 4: 0xcc465956 (stale) Mirror 5: 0xcc465956 (stale) Mirror 6: 0xcc465956 (stale) Mirror 7: 0xcc465956 (stale) CRC-32 checksum value for chunk [0, 0x37a4e): Mirror 1: 0x3e3343fe Mirror 8: 0x3e3343fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a4e: skipped 000517 1784046701.358397 write 0x00bcee thru 0x015145 (0x9458 bytes) 000518 1784046701.414997 trunc from 0x013cde to 0x020c43 (0xcf66 bytes) 000519 1784046701.438770 mapread 0x016374 thru 0x01d822 (0x74af bytes) 000521 1784046701.493001 write 0x00db72 thru 0x0153e2 (0x7871 bytes) 000522 1784046701.500990 write 0x014d7f thru 0x01e92d (0x9baf bytes) 000523 1784046701.506532 mapread 0x003d54 thru 0x00f2fd (0xb5aa bytes) 000524 1784046701.521252 mapwrite 0x028cc0 thru 0x030b4e (0x7e8f bytes) 000525 1784046701.580671 write 0x0361bb thru 0x03ce5e (0x6ca4 bytes) 000526 1784046701.592132 fallocate 0x013b4e thru 0x016060 (0x2513 bytes) 000527 1784046701.597424 mapread 0x025269 thru 0x03414a (0xeee2 bytes) 000528 1784046701.610243 trunc from 0x03ce5f to 0x02f70a (0xd754 bytes) 000529 1784046701.670238 fallocate 0x0220c0 thru 0x02fc04 (0xdb45 bytes) 000531 1784046701.678823 punch from 0x004241 to 0x00bb6c (0x792c bytes) 000532 1784046701.686025 trunc from 0x0107c4 to 0x01aef8 (0xa735 bytes) 000533 1784046701.692202 write 0x036d22 thru 0x03ffff (0x92de bytes) 000534 1784046701.695259 trunc from 0x024875 to 0x03350f (0xec9b bytes) 000535 1784046701.702360 mapread 0x01bb89 thru 0x024486 (0x88fe bytes) 000536 1784046701.714823 trunc from 0x040000 to 0x038173 (0x7e8c bytes) 000538 1784046701.737924 write 0x005759 thru 0x012cd4 (0xd57c bytes) 000539 1784046701.761867 write 0x03ad20 thru 0x03ffff (0x52e0 bytes) 000540 1784046701.770844 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x3d82fb6a (stale) Mirror 6: 0x3d82fb6a (stale) Mirror 7: 0x3d82fb6a (stale) Mirror 8: 0xad8a58f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x3d82fb6a (stale) Mirror 6: 0x3d82fb6a (stale) Mirror 7: 0x3d82fb6a (stale) Mirror 8: 0xad8a58f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000541 1784046702.296061 punch from 0x034e40 to 0x03a544 (0x5705 bytes) 000542 1784046702.302341 fallocate 0x029fc2 thru 0x037167 (0xd1a6 bytes) 000543 1784046702.309330 trunc from 0x040000 to 0x034a4a (0xb5b5 bytes) 000545 1784046702.325197 mapwrite 0x034db7 thru 0x034eab (0xf5 bytes) 000547 1784046702.373002 mapread 0x0001c7 thru 0x00152d (0x1367 bytes) 000548 1784046702.418082 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x34eac): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34eac): Mirror 5: 0x8f942c81 (stale) Mirror 6: 0x8f942c81 (stale) Mirror 7: 0x8f942c81 (stale) Mirror 8: 0x44b175bb (stale) CRC-32 checksum value for chunk [0, 0x34eac): Mirror 1: 0x4c274f35 Mirror 9: 0x4c274f35 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34eac: skipped 000549 1784046703.496810 fallocate 0x02af7b thru 0x033d7e (0x8e04 bytes) 000550 1784046703.574024 mapwrite 0x02916a thru 0x02b339 (0x21d0 bytes) 000551 1784046703.652555 trunc from 0x01d9b4 to 0x0242de (0x692b bytes) 000552 1784046703.663197 punch from 0x025bd2 to 0x0309e4 (0xae13 bytes) 000553 1784046703.669930 mapwrite 0x03d162 thru 0x03ffff (0x2e9e bytes) 000554 1784046703.823843 mapread 0x023cc0 thru 0x02d016 (0x9357 bytes) 000555 1784046703.853905 MIRROR_RESYNC 6 mirrors 000556 1784046706.535527 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) 000557 1784046707.003999 trunc from 0x040000 to 0x0341dc (0xbe23 bytes) 000558 1784046707.058348 write 0x01b1b0 thru 0x01f10d (0x3f5e bytes) 000559 1784046707.072828 trunc from 0x0341dd to 0x03cd5a (0x8b7e bytes) 000560 1784046707.102529 read 0x02aaad thru 0x0319bd (0x6f11 bytes) 000561 1784046707.121599 trunc from 0x005e2b to 0x008049 (0x221f bytes) 000562 1784046707.128906 mapread 0x02aca5 thru 0x031f7e (0x72da bytes) 000563 1784046707.131454 punch from 0x01499b to 0x015b6e (0x11d4 bytes) 000564 1784046707.141764 read 0x0373e1 thru 0x03cd5a (0x597a bytes) 000565 1784046707.154141 read 0x00b402 thru 0x00ff90 (0x4b8f bytes) 000566 1784046707.154856 read 0x001ce0 thru 0x00c341 (0xa662 bytes) 000567 1784046707.155552 fallocate 0x024a92 thru 0x03194a (0xceb9 bytes) 000568 1784046707.161791 write 0x01c20e thru 0x02a2de (0xe0d1 bytes) 000569 1784046707.163494 read 0x015113 thru 0x0181e6 (0x30d4 bytes) 000570 1784046707.164196 fallocate 0x00e156 thru 0x011288 (0x3133 bytes) 000571 1784046707.171491 trunc from 0x027852 to 0x034513 (0xccc2 bytes) 000572 1784046707.189882 read 0x0180ba thru 0x023155 (0xb09c bytes) 000573 1784046707.190671 write 0x02433e thru 0x024f8d (0xc50 bytes) 000574 1784046707.191682 trunc from 0x03cd5b to 0x03532f (0x7a2b bytes) 000575 1784046707.207833 punch from 0x004b1c to 0x01116d (0xc652 bytes) 000576 1784046707.215162 mapwrite 0x0310bf thru 0x0354a0 (0x43e2 bytes) 000577 1784046707.294543 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x354a1): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x354a1): Mirror 6: 0xcaea8ccf (stale) Mirror 7: 0xcaea8ccf (stale) Mirror 8: 0xcaea8ccf (stale) Mirror 9: 0xcaea8ccf (stale) CRC-32 checksum value for chunk [0, 0x354a1): Mirror 1: 0xbe87bd05 Mirror 10: 0xbe87bd05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x354a1: skipped 000578 1784046708.882590 fallocate 0x02d04d thru 0x0332f3 (0x62a7 bytes) 000579 1784046708.945325 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x354a1): Mirror 6: 0xcaea8ccf (stale) Mirror 7: 0xcaea8ccf (stale) Mirror 9: 0xcaea8ccf (stale) Mirror 10: 0xbe87bd05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x354a1): Mirror 6: 0xcaea8ccf (stale) Mirror 7: 0xcaea8ccf (stale) Mirror 9: 0xcaea8ccf (stale) Mirror 10: 0xbe87bd05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x354a1: skipped 000580 1784046709.541382 trunc from 0x028e11 to 0x033019 (0xa209 bytes) 000581 1784046709.566210 trunc from 0x0354a1 to 0x0257ed (0xfcb3 bytes) 000582 1784046709.647831 punch from 0x004bea to 0x00e250 (0x9667 bytes) 000583 1784046709.664357 mapwrite 0x035db9 thru 0x03b20f (0x5457 bytes) 000585 1784046709.786556 write 0x03535a thru 0x03ffff (0xaca6 bytes) 000586 1784046709.792832 punch from 0x0312c6 to 0x0319a4 (0x6df bytes) 000587 1784046709.799858 trunc from 0x028f49 to 0x034203 (0xb2bb bytes) 000588 1784046709.813695 write 0x005506 thru 0x013cbf (0xe7ba bytes) 000589 1784046709.840344 punch from 0x035e58 to 0x03cc62 (0x6e0b bytes) 000590 1784046709.886678 fallocate 0x0143d9 thru 0x01b1a5 (0x6dcd bytes) 000591 1784046709.897476 fallocate 0x036739 thru 0x03ffff (0x98c7 bytes) 000592 1784046709.910171 trunc from 0x040000 to 0x03f2ab (0xd54 bytes) 000593 1784046709.933698 punch from 0x01329b to 0x0138ea (0x650 bytes) 000594 1784046709.941394 write 0x0383fd thru 0x03ffff (0x7c03 bytes) 000595 1784046709.948924 punch from 0x030fa4 to 0x03acc1 (0x9d1e bytes) 000596 1784046709.984012 read 0x0167da thru 0x021195 (0xa9bc bytes) 000597 1784046710.010597 punch from 0x01b4b1 to 0x021ad0 (0x6620 bytes) 000598 1784046710.026670 fallocate 0x00ad10 thru 0x0131aa (0x849b bytes) 000599 1784046710.053964 punch from 0x021006 to 0x026144 (0x513f bytes) 000600 1784046710.066261 trunc from 0x040000 to 0x009fd2 (0x3602d bytes) 000601 1784046710.110281 fallocate 0x00c7c5 thru 0x0131ef (0x6a2b bytes) 000602 1784046710.125863 mapread 0x004cc1 thru 0x009fd2 (0x5312 bytes) 000603 1784046710.137845 mapread 0x0000c9 thru 0x001b6c (0x1aa4 bytes) 000604 1784046710.159061 read 0x007f34 thru 0x009fd2 (0x209f bytes) 000605 1784046710.160059 fallocate 0x019ab9 thru 0x0206c7 (0x6c0f bytes) 000606 1784046710.183845 fallocate 0x008f9d thru 0x00c0e0 (0x3144 bytes) 000607 1784046710.207203 MIRROR_RESYNC 5 mirrors 000608 1784046712.234888 read 0x001d59 thru 0x0026f7 (0x99f bytes) 000610 1784046712.240794 read 0x008112 thru 0x00c0e0 (0x3fcf bytes) 000611 1784046712.288054 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) 000612 1784046712.836226 mapread 0x004975 thru 0x005d4f (0x13db bytes) 000613 1784046712.863280 trunc from 0x00c0e1 to 0x03d95f (0x3187f bytes) 000614 1784046712.946626 read 0x00e206 thru 0x01bc8f (0xda8a bytes) 000615 1784046712.956941 fallocate 0x02a345 thru 0x02e5da (0x4296 bytes) 000616 1784046712.962065 trunc from 0x03d960 to 0x034a22 (0x8f3d bytes) 000618 1784046713.016542 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34a23): Mirror 7: 0x9a8ec305 (stale) Mirror 10: 0x9a8ec305 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34a23): Mirror 7: 0x9a8ec305 (stale) Mirror 10: 0x9a8ec305 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34a23: skipped 000619 1784046713.465250 trunc from 0x034a23 to 0x025829 (0xf1f9 bytes) 000621 1784046713.488768 trunc from 0x024c72 to 0x025829 (0xbb8 bytes) 000622 1784046713.494174 write 0x018d53 thru 0x026f1b (0xe1c9 bytes) 000623 1784046713.500083 write 0x00c70a thru 0x01a4e0 (0xddd7 bytes) 000624 1784046713.508619 mapread 0x015e42 thru 0x0221b8 (0xc377 bytes) 000625 1784046713.509876 write 0x03f97b thru 0x03ffff (0x685 bytes) 000626 1784046713.513293 mapread 0x0327a2 thru 0x034fef (0x284e bytes) 000627 1784046713.545661 punch from 0x011fc3 to 0x0182ef (0x632d bytes) 000628 1784046713.576739 trunc from 0x004155 to 0x00ed07 (0xabb3 bytes) 000629 1784046713.583146 write 0x022808 thru 0x032640 (0xfe39 bytes) 000630 1784046713.585732 read 0x0372b9 thru 0x03ffff (0x8d47 bytes) 000631 1784046713.598399 write 0x00f1fd thru 0x016dfb (0x7bff bytes) 000632 1784046713.605334 write 0x015aa3 thru 0x01e87e (0x8ddc bytes) 000633 1784046713.606681 mapread 0x03829f thru 0x03cff5 (0x4d57 bytes) 000634 1784046713.608356 mapread 0x0296d5 thru 0x036d19 (0xd645 bytes) 000635 1784046713.610784 punch from 0x01d4f4 to 0x0230a6 (0x5bb3 bytes) 000636 1784046713.632832 MIRROR_RESYNC 3 mirrors 000637 1784046714.732308 mapread 0x035c05 thru 0x03ffff (0xa3fb bytes) 000638 1784046714.776544 MIRROR_EXTEND to 4 mirrors 000639 1784046715.860966 punch from 0x02ca52 to 0x036749 (0x9cf8 bytes) 000640 1784046715.946294 fallocate 0x03e30c thru 0x03ffff (0x1cf4 bytes) 000641 1784046715.959594 read 0x000384 thru 0x00b046 (0xacc3 bytes) 000642 1784046715.974487 fallocate 0x00b8d8 thru 0x018cd9 (0xd402 bytes) 000643 1784046715.991984 MIRROR_RESYNC 4 mirrors 000644 1784046717.448415 write 0x02c238 thru 0x038fc1 (0xcd8a bytes) 000645 1784046717.552344 MIRROR_RESYNC 4 mirrors 000647 1784046718.748972 punch from 0x0072bf to 0x011dee (0xab30 bytes) 000648 1784046718.788463 fallocate 0x014a4e thru 0x01e32e (0x98e1 bytes) 000649 1784046718.799136 mapwrite 0x033408 thru 0x039fe1 (0x6bda bytes) 000650 1784046718.855839 mapwrite 0x006479 thru 0x013667 (0xd1ef bytes) 000651 1784046718.929336 trunc from 0x030bee to 0x034e83 (0x4296 bytes) 000652 1784046718.935197 fallocate 0x01b88f thru 0x01f7de (0x3f50 bytes) 000653 1784046718.944845 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8c32fe79 (stale) Mirror 10: 0x8c32fe79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8c32fe79 (stale) Mirror 10: 0x8c32fe79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000654 1784046719.311004 punch from 0x00ab95 to 0x013c79 (0x90e5 bytes) 000655 1784046719.316694 trunc from 0x040000 to 0x013b2f (0x2c4d0 bytes) 000656 1784046719.335898 punch from 0x00fa0d to 0x013b2f (0x4123 bytes) 000657 1784046719.342442 mapread 0x00f58a thru 0x013b2f (0x45a6 bytes) 000658 1784046719.362275 trunc from 0x013b30 to 0x018753 (0x4c24 bytes) 000661 1784046719.379561 read 0x00f3eb thru 0x014730 (0x5346 bytes) 000662 1784046719.386603 read 0x00bfcf thru 0x00d780 (0x17b2 bytes) 000664 1784046719.387729 write 0x000298 thru 0x001e51 (0x1bba bytes) 000665 1784046719.395190 fallocate 0x00166c thru 0x0051e9 (0x3b7e bytes) 000666 1784046719.401317 trunc from 0x018754 to 0x031851 (0x190fe bytes) 000667 1784046719.422828 read 0x01ac6c thru 0x024bd3 (0x9f68 bytes) 000668 1784046719.433016 mapwrite 0x0139a8 thru 0x0169c3 (0x301c bytes) 000669 1784046719.458848 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31852): Mirror 7: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31852): Mirror 7: 0x22a51d1e (stale) Mirror 10: 0x22a51d1e (stale) CRC-32 checksum value for chunk [0, 0x31852): Mirror 1: 0x1fd050ab Mirror 11: 0x1fd050ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31852: skipped 000670 1784046720.602646 MIRROR_RESYNC 4 mirrors 000671 1784046721.807382 read 0x01d4c9 thru 0x02adbe (0xd8f6 bytes) 000672 1784046721.830739 mapread 0x007616 thru 0x01211f (0xab0a bytes) 000673 1784046721.884148 write 0x021446 thru 0x02d2aa (0xbe65 bytes) 000674 1784046721.947281 read 0x00637d thru 0x012ba3 (0xc827 bytes) 000676 1784046721.963291 fallocate 0x02e5f7 thru 0x02fd3c (0x1746 bytes) 000677 1784046721.968784 trunc from 0x02d041 to 0x031851 (0x4811 bytes) 000678 1784046721.986814 mapread 0x00e3c8 thru 0x012a87 (0x46c0 bytes) 000679 1784046721.989924 read 0x01fa9f thru 0x02af08 (0xb46a bytes) 000680 1784046721.991672 trunc from 0x031852 to 0x01b01b (0x16836 bytes) 000681 1784046722.043256 trunc from 0x00c712 to 0x00f289 (0x2b78 bytes) 000682 1784046722.051835 trunc from 0x01b01c to 0x024d28 (0x9d0d bytes) 000683 1784046722.073944 mapread 0x003009 thru 0x008b45 (0x5b3d bytes) 000684 1784046722.076707 punch from 0x01a88f to 0x024d28 (0xa49a bytes) 000685 1784046722.082876 read 0x010443 thru 0x01430a (0x3ec8 bytes) 000686 1784046722.087645 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24d29): Mirror 7: 0x673230f4 (stale) Mirror 11: 0x673230f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d29): Mirror 7: 0x673230f4 (stale) Mirror 11: 0x673230f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d29: skipped 000687 1784046722.422902 punch from 0x00cdae to 0x018138 (0xb38b bytes) 000688 1784046722.429083 fallocate 0x004756 thru 0x009765 (0x5010 bytes) 000689 1784046722.435762 punch from 0x00d018 to 0x00fda4 (0x2d8d bytes) 000690 1784046722.445224 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24d29): Mirror 7: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d29): Mirror 7: 0x673230f4 (stale) Mirror 11: 0x673230f4 (stale) CRC-32 checksum value for chunk [0, 0x24d29): Mirror 1: 0x20ffb33e Mirror 12: 0x20ffb33e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d29: skipped 000691 1784046723.339258 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24d29): Mirror 11: 0x673230f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d29): Mirror 11: 0x673230f4 (stale) CRC-32 checksum value for chunk [0, 0x24d29): Mirror 1: 0x20ffb33e Mirror 12: 0x20ffb33e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d29: skipped 000692 1784046724.242021 fallocate 0x02cdaf thru 0x034a6a (0x7cbc bytes) 000693 1784046724.298258 MIRROR_RESYNC 3 mirrors 000694 1784046724.965683 mapread 0x026957 thru 0x02d9b7 (0x7061 bytes) 000696 1784046724.981606 MIRROR_EXTEND to 4 mirrors 000697 1784046725.747652 fallocate 0x027673 thru 0x033f20 (0xc8ae bytes) 000698 1784046725.795262 read 0x0070b9 thru 0x008672 (0x15ba bytes) 000701 1784046725.810485 mapread 0x009644 thru 0x0185a6 (0xef63 bytes) 000702 1784046725.844972 trunc from 0x034a6b to 0x037698 (0x2c2e bytes) 000704 1784046725.882898 write 0x02adf8 thru 0x02f1fa (0x4403 bytes) 000705 1784046725.897662 read 0x0327ed thru 0x037698 (0x4eac bytes) 000706 1784046725.908253 mapwrite 0x025ac8 thru 0x031805 (0xbd3e bytes) 000707 1784046725.937023 write 0x00b65c thru 0x013dfa (0x879f bytes) 000708 1784046725.940616 fallocate 0x0399a1 thru 0x03e379 (0x49d9 bytes) 000709 1784046725.946802 trunc from 0x03e37a to 0x026c65 (0x17714 bytes) 000710 1784046725.970534 trunc from 0x00a925 to 0x01a67b (0xfd57 bytes) 000712 1784046725.990670 mapwrite 0x022e8a thru 0x028a1f (0x5b96 bytes) 000714 1784046726.043718 trunc from 0x026864 to 0x028a1f (0x21bc bytes) 000715 1784046726.055887 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28a20): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28a20): Mirror 11: 0x62d5c840 (stale) Mirror 12: 0x62d5c840 (stale) Mirror 13: 0x62d5c840 (stale) CRC-32 checksum value for chunk [0, 0x28a20): Mirror 1: 0x98c53f1d Mirror 14: 0x98c53f1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28a20: skipped 000716 1784046726.948005 fallocate 0x020686 thru 0x02cccd (0xc648 bytes) 000717 1784046727.013911 write 0x01e1e7 thru 0x02c303 (0xe11d bytes) 000718 1784046727.027315 mapread 0x0197fd thru 0x01d889 (0x408d bytes) 000719 1784046727.061319 write 0x01d096 thru 0x02928b (0xc1f6 bytes) 000720 1784046727.065894 punch from 0x018017 to 0x01b692 (0x367c bytes) 000721 1784046727.080007 mapread 0x0182b1 thru 0x0247da (0xc52a bytes) 000722 1784046727.098292 fallocate 0x034d9a thru 0x03ae7a (0x60e1 bytes) 000723 1784046727.107743 mapread 0x00e816 thru 0x011064 (0x284f bytes) 000724 1784046727.126618 mapread 0x005bae thru 0x008e11 (0x3264 bytes) 000725 1784046727.139905 punch from 0x0300fe to 0x03018a (0x8d bytes) 000728 1784046727.166225 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ae7b): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae7b): Mirror 11: 0x8243798b (stale) Mirror 12: 0x8243798b (stale) Mirror 13: 0x8243798b (stale) Mirror 14: 0x71a4ebf8 (stale) CRC-32 checksum value for chunk [0, 0x3ae7b): Mirror 1: 0x77bc6ee1 Mirror 15: 0x77bc6ee1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae7b: skipped 000729 1784046728.360191 read 0x02ee6d thru 0x03ae7a (0xc00e bytes) 000730 1784046728.397598 trunc from 0x029c58 to 0x036479 (0xc822 bytes) 000731 1784046728.440987 mapwrite 0x02878f thru 0x0382a2 (0xfb14 bytes) 000732 1784046728.497923 mapread 0x012710 thru 0x01e4cd (0xbdbe bytes) 000733 1784046728.527772 mapwrite 0x0127c3 thru 0x022087 (0xf8c5 bytes) 000734 1784046728.556389 trunc from 0x03ae7b to 0x00b6e2 (0x2f798 bytes) 000735 1784046728.604784 write 0x01e18a thru 0x024cfe (0x6b75 bytes) 000736 1784046728.608197 write 0x0210ca thru 0x028160 (0x7097 bytes) 000737 1784046728.610898 read 0x00249c thru 0x003e56 (0x19bb bytes) 000738 1784046728.628934 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x28161): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28161): Mirror 11: 0x4fed12e9 (stale) Mirror 12: 0x4fed12e9 (stale) Mirror 13: 0x4fed12e9 (stale) Mirror 14: 0xc4143bef (stale) Mirror 15: 0x614063ce (stale) CRC-32 checksum value for chunk [0, 0x28161): Mirror 1: 0xbb05b70f Mirror 16: 0xbb05b70f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28161: skipped 000739 1784046729.615413 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28161): Mirror 12: 0x4fed12e9 (stale) Mirror 13: 0x4fed12e9 (stale) Mirror 14: 0xc4143bef (stale) Mirror 15: 0x614063ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28161): Mirror 12: 0x4fed12e9 (stale) Mirror 13: 0x4fed12e9 (stale) Mirror 14: 0xc4143bef (stale) Mirror 15: 0x614063ce (stale) CRC-32 checksum value for chunk [0, 0x28161): Mirror 1: 0xbb05b70f Mirror 16: 0xbb05b70f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28161: skipped 000740 1784046730.480915 MIRROR_RESYNC 6 mirrors 000741 1784046731.963544 mapread 0x00907b thru 0x009d68 (0xcee bytes) 000742 1784046731.972562 punch from 0x0111a4 to 0x01cf03 (0xbd60 bytes) 000744 1784046732.030553 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x28161): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28161): Mirror 12: 0xbb05b70f (stale) Mirror 13: 0xbb05b70f (stale) Mirror 14: 0xbb05b70f (stale) Mirror 15: 0xbb05b70f (stale) Mirror 16: 0xbb05b70f (stale) CRC-32 checksum value for chunk [0, 0x28161): Mirror 1: 0xbb05b70f Mirror 17: 0xbb05b70f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28161: skipped 000746 1784046733.432204 write 0x030ee8 thru 0x038ec8 (0x7fe1 bytes) 000747 1784046733.474204 punch from 0x001eef to 0x00be2b (0x9f3d bytes) 000748 1784046733.482844 trunc from 0x037b18 to 0x038ec8 (0x13b1 bytes) 000749 1784046733.503057 trunc from 0x038ec9 to 0x007907 (0x315c1 bytes) 000750 1784046733.542018 read 0x0072ec thru 0x007907 (0x61c bytes) 000752 1784046733.551351 trunc from 0x007908 to 0x0213ad (0x19aa6 bytes) 000753 1784046733.581258 fallocate 0x02db8e thru 0x032a39 (0x4eac bytes) 000754 1784046733.593259 mapwrite 0x028a9d thru 0x038316 (0xf87a bytes) 000755 1784046733.664565 fallocate 0x03159d thru 0x033ead (0x2911 bytes) 000756 1784046733.671893 trunc from 0x038317 to 0x0057cc (0x32b4a bytes) 000758 1784046733.689625 mapwrite 0x030808 thru 0x03ec4e (0xe447 bytes) 000759 1784046733.759074 trunc from 0x03ec4f to 0x02253c (0x1c712 bytes) 000760 1784046733.784046 mapwrite 0x0076df thru 0x013eaf (0xc7d1 bytes) 000761 1784046733.840837 read 0x015379 thru 0x01a94a (0x55d2 bytes) 000763 1784046733.853868 trunc from 0x01dea2 to 0x02253c (0x469b bytes) 000764 1784046733.859920 punch from 0x01f941 to 0x02253c (0x2bfc bytes) 000765 1784046733.875828 trunc from 0x02253d to 0x0145cb (0xdf71 bytes) 000766 1784046733.952691 punch from 0x00021a to 0x002175 (0x1f5c bytes) 000767 1784046733.968549 punch from 0x00a39b to 0x00da63 (0x36c9 bytes) 000768 1784046733.975903 punch from 0x0114a6 to 0x013a4e (0x25a9 bytes) 000769 1784046733.985002 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x145cc): Mirror 12: 0x91e43095 (stale) Mirror 14: 0x91e43095 (stale) Mirror 15: 0x91e43095 (stale) Mirror 16: 0x91e43095 (stale) Mirror 17: 0x91e43095 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x145cc): Mirror 12: 0x91e43095 (stale) Mirror 14: 0x91e43095 (stale) Mirror 15: 0x91e43095 (stale) Mirror 16: 0x91e43095 (stale) Mirror 17: 0x91e43095 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x145cc: skipped 000770 1784046734.525611 trunc from 0x0069ff to 0x00d2c6 (0x68c8 bytes) 000772 1784046734.534565 punch from 0x0003b7 to 0x00bc2f (0xb879 bytes) 000773 1784046734.539024 punch from 0x006ca7 to 0x008047 (0x13a1 bytes) 000774 1784046734.558474 punch from 0x00d017 to 0x0145cb (0x75b5 bytes) 000775 1784046734.570821 fallocate 0x0079d5 thru 0x00e7e3 (0x6e0f bytes) 000776 1784046734.576482 punch from 0x01215f to 0x0145cb (0x246d bytes) 000777 1784046734.587739 trunc from 0x0145cc to 0x037650 (0x23085 bytes) 000779 1784046734.617819 mapwrite 0x03d30e thru 0x03ffff (0x2cf2 bytes) 000780 1784046734.713670 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x67459622 (stale) Mirror 14: 0x67459622 (stale) Mirror 15: 0x67459622 (stale) Mirror 16: 0x67459622 (stale) Mirror 17: 0x67459622 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa754fe2a Mirror 18: 0xa754fe2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000781 1784046735.865154 mapwrite 0x022dfa thru 0x02789f (0x4aa6 bytes) 000782 1784046736.001672 mapwrite 0x01bb4d thru 0x021b63 (0x6017 bytes) 000783 1784046736.033341 write 0x021940 thru 0x02dab5 (0xc176 bytes) 000784 1784046736.045798 mapread 0x01233d thru 0x01395f (0x1623 bytes) 000785 1784046736.057371 trunc from 0x01a1d0 to 0x026126 (0xbf57 bytes) 000786 1784046736.074252 punch from 0x024822 to 0x0254b0 (0xc8f bytes) 000787 1784046736.079986 fallocate 0x004eff thru 0x00e348 (0x944a bytes) 000788 1784046736.086029 mapwrite 0x02b9bd thru 0x0366a8 (0xacec bytes) 000789 1784046736.119080 read 0x030094 thru 0x03d52c (0xd499 bytes) 000790 1784046736.130693 mapread 0x016f4a thru 0x01ee33 (0x7eea bytes) 000791 1784046736.141910 mapread 0x0238d2 thru 0x02b7a7 (0x7ed6 bytes) 000792 1784046736.150224 write 0x029879 thru 0x038503 (0xec8b bytes) 000793 1784046736.153268 write 0x00998d thru 0x017231 (0xd8a5 bytes) 000794 1784046736.160524 trunc from 0x00650a to 0x010a81 (0xa578 bytes) 000795 1784046736.180570 mapread 0x03455d thru 0x03b5ae (0x7052 bytes) 000796 1784046736.183390 trunc from 0x03a10d to 0x03ffff (0x5ef3 bytes) 000797 1784046736.189712 trunc from 0x040000 to 0x03bb54 (0x44ab bytes) 000798 1784046736.215757 fallocate 0x0064ef thru 0x00d23b (0x6d4d bytes) 000799 1784046736.222755 mapread 0x0132d9 thru 0x022d46 (0xfa6e bytes) 000800 1784046736.226058 trunc from 0x02a6d6 to 0x02fc26 (0x5551 bytes) 000801 1784046736.233987 read 0x01b084 thru 0x01d9bb (0x2938 bytes) 000802 1784046736.235234 fallocate 0x0295bd thru 0x035699 (0xc0dd bytes) 000803 1784046736.242227 punch from 0x032eb5 to 0x037002 (0x414e bytes) 000804 1784046736.248397 mapread 0x0232bc thru 0x0328f7 (0xf63c bytes) 000805 1784046736.261910 trunc from 0x018e51 to 0x0205fc (0x77ac bytes) 000806 1784046736.267035 punch from 0x02e08a to 0x030c20 (0x2b97 bytes) 000807 1784046736.273573 write 0x000a84 thru 0x00742c (0x69a9 bytes) 000808 1784046736.275269 write 0x028098 thru 0x0365b5 (0xe51e bytes) 000809 1784046736.279021 trunc from 0x03bb55 to 0x012b57 (0x28ffd bytes) 000810 1784046736.301568 mapwrite 0x006602 thru 0x010326 (0x9d25 bytes) 000812 1784046736.323886 punch from 0x002247 to 0x00f9b3 (0xd76d bytes) 000813 1784046736.330069 read 0x010755 thru 0x012b57 (0x2403 bytes) 000815 1784046736.335136 trunc from 0x006cfd to 0x00c784 (0x5a88 bytes) 000816 1784046736.340796 trunc from 0x01196d to 0x012b57 (0x11eb bytes) 000817 1784046736.345964 fallocate 0x005dbf thru 0x009083 (0x32c5 bytes) 000819 1784046736.357479 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12b58): Mirror 12: 0xd9962894 (stale) Mirror 14: 0xd9962894 (stale) Mirror 15: 0xd9962894 (stale) Mirror 17: 0xd9962894 (stale) Mirror 18: 0xbfec6870 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12b58): Mirror 12: 0xd9962894 (stale) Mirror 14: 0xd9962894 (stale) Mirror 15: 0xd9962894 (stale) Mirror 17: 0xd9962894 (stale) Mirror 18: 0xbfec6870 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12b58: skipped 000820 1784046736.788895 trunc from 0x000762 to 0x007c2a (0x74c9 bytes) 000821 1784046736.795621 trunc from 0x012b58 to 0x01688e (0x3d37 bytes) 000822 1784046736.828570 fallocate 0x021310 thru 0x02c655 (0xb346 bytes) 000823 1784046736.836226 fallocate 0x0150c2 thru 0x01a06d (0x4fac bytes) 000824 1784046736.841943 fallocate 0x02b443 thru 0x037f2c (0xcaea bytes) 000826 1784046736.848515 fallocate 0x01bf51 thru 0x020306 (0x43b6 bytes) 000827 1784046736.853918 write 0x005580 thru 0x00faf9 (0xa57a bytes) 000828 1784046736.864898 trunc from 0x01b2fe to 0x020923 (0x5626 bytes) 000829 1784046736.874708 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c656): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c656): Mirror 12: 0x2a4c5459 (stale) Mirror 14: 0x2a4c5459 (stale) Mirror 15: 0x2a4c5459 (stale) Mirror 17: 0x2a4c5459 (stale) Mirror 18: 0xf8ccb476 (stale) CRC-32 checksum value for chunk [0, 0x2c656): Mirror 1: 0x84396391 Mirror 19: 0x84396391 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c656: skipped 000830 1784046738.203240 read 0x012257 thru 0x018f2e (0x6cd8 bytes) 000831 1784046738.223343 fallocate 0x03071f thru 0x036daa (0x668c bytes) 000832 1784046738.280678 trunc from 0x02c656 to 0x027b2a (0x4b2b bytes) 000833 1784046738.344708 punch from 0x006869 to 0x00e2f5 (0x7a8d bytes) 000834 1784046738.354403 punch from 0x01bf2d to 0x02121f (0x52f3 bytes) 000835 1784046738.364683 mapwrite 0x03cb6f thru 0x03ffff (0x3491 bytes) 000836 1784046738.430357 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x67459622 (stale) Mirror 14: 0x67459622 (stale) Mirror 15: 0x67459622 (stale) Mirror 17: 0x67459622 (stale) Mirror 18: 0xa754fe2a (stale) Mirror 19: 0xb3b80e91 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x772271dc Mirror 20: 0x772271dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000837 1784046739.353554 punch from 0x00516d to 0x01371c (0xe5b0 bytes) 000839 1784046739.415942 fallocate 0x0234b3 thru 0x028e65 (0x59b3 bytes) 000840 1784046739.426860 trunc from 0x02e466 to 0x031aec (0x3687 bytes) 000841 1784046739.441811 trunc from 0x03b37f to 0x03cc9a (0x191c bytes) 000842 1784046739.466662 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x67459622 (stale) Mirror 14: 0x67459622 (stale) Mirror 15: 0x67459622 (stale) Mirror 17: 0x67459622 (stale) Mirror 18: 0xa754fe2a (stale) Mirror 19: 0xb3b80e91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x67459622 (stale) Mirror 14: 0x67459622 (stale) Mirror 15: 0x67459622 (stale) Mirror 17: 0x67459622 (stale) Mirror 18: 0xa754fe2a (stale) Mirror 19: 0xb3b80e91 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000843 1784046740.055555 punch from 0x024795 to 0x02f57b (0xade7 bytes) 000844 1784046740.060928 write 0x01cc16 thru 0x02a4e6 (0xd8d1 bytes) 000845 1784046740.077227 fallocate 0x02644b thru 0x0315c6 (0xb17c bytes) 000846 1784046740.089719 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x67459622 (stale) Mirror 15: 0x67459622 (stale) Mirror 17: 0x67459622 (stale) Mirror 18: 0xa754fe2a (stale) Mirror 19: 0xb3b80e91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x67459622 (stale) Mirror 15: 0x67459622 (stale) Mirror 17: 0x67459622 (stale) Mirror 18: 0xa754fe2a (stale) Mirror 19: 0xb3b80e91 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000847 1784046740.758751 fallocate 0x011c4d thru 0x01c12f (0xa4e3 bytes) 000848 1784046740.774506 trunc from 0x007318 to 0x013e30 (0xcb19 bytes) 000849 1784046740.800050 trunc from 0x040000 to 0x024960 (0x1b69f bytes) 000850 1784046740.889166 trunc from 0x00d184 to 0x0109ed (0x386a bytes) 000851 1784046740.896190 fallocate 0x034590 thru 0x03db37 (0x95a8 bytes) 000852 1784046740.901544 punch from 0x03a36f to 0x03db37 (0x37c9 bytes) 000853 1784046740.907607 fallocate 0x009630 thru 0x00a91c (0x12ed bytes) 000855 1784046740.937596 write 0x003962 thru 0x004984 (0x1023 bytes) 000856 1784046740.962183 write 0x02b04c thru 0x02dd9b (0x2d50 bytes) 000857 1784046740.982655 write 0x03bef1 thru 0x03ffff (0x410f bytes) 000858 1784046740.999531 punch from 0x006dc6 to 0x011d43 (0xaf7e bytes) 000859 1784046741.022068 trunc from 0x01295e to 0x017a73 (0x5116 bytes) 000860 1784046741.052376 MIRROR_RESYNC 6 mirrors 000861 1784046743.968006 fallocate 0x014df8 thru 0x021e58 (0xd061 bytes) 000863 1784046744.070926 mapwrite 0x00adb8 thru 0x010320 (0x5569 bytes) 000864 1784046744.172922 write 0x01f2a6 thru 0x021766 (0x24c1 bytes) 000865 1784046744.205942 trunc from 0x019d9a to 0x0204e8 (0x674f bytes) 000866 1784046744.254142 read 0x03b4a1 thru 0x03ffff (0x4b5f bytes) 000867 1784046744.278297 punch from 0x016b89 to 0x02252e (0xb9a6 bytes) 000868 1784046744.287808 punch from 0x011068 to 0x01cb69 (0xbb02 bytes) 000869 1784046744.297657 mapread 0x0113be thru 0x01d330 (0xbf73 bytes) 000870 1784046744.331887 read 0x00d67e thru 0x012be6 (0x5569 bytes) 000871 1784046744.334549 mapread 0x0215f0 thru 0x02e7e7 (0xd1f8 bytes) 000873 1784046744.355677 punch from 0x00c576 to 0x017a30 (0xb4bb bytes) 000874 1784046744.365665 trunc from 0x040000 to 0x02fce8 (0x10317 bytes) 000875 1784046744.408910 punch from 0x02a84d to 0x02fce8 (0x549c bytes) 000876 1784046744.417064 mapread 0x009ff8 thru 0x00ecb9 (0x4cc2 bytes) 000877 1784046744.446432 punch from 0x010e3f to 0x013880 (0x2a42 bytes) 000880 1784046744.464758 mapread 0x012d91 thru 0x018cc3 (0x5f33 bytes) 000881 1784046744.543640 fallocate 0x009841 thru 0x012b4d (0x930d bytes) 000882 1784046744.559481 trunc from 0x01bc36 to 0x01df63 (0x232e bytes) 000883 1784046744.581688 write 0x02d754 thru 0x0347a5 (0x7052 bytes) 000884 1784046744.592571 mapwrite 0x0138b7 thru 0x01913d (0x5887 bytes) 000885 1784046744.690849 punch from 0x016d72 to 0x01e8bc (0x7b4b bytes) 000887 1784046744.716156 mapwrite 0x011016 thru 0x01f7e1 (0xe7cc bytes) 000888 1784046744.873756 write 0x03e055 thru 0x03ffff (0x1fab bytes) 000889 1784046744.876708 trunc from 0x003b73 to 0x006050 (0x24de bytes) 000890 1784046744.887412 mapread 0x006389 thru 0x015e49 (0xfac1 bytes) 000891 1784046744.923395 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x52b19580 (stale) Mirror 17: 0x52b19580 (stale) Mirror 18: 0x52b19580 (stale) Mirror 19: 0x52b19580 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x52b19580 (stale) Mirror 17: 0x52b19580 (stale) Mirror 18: 0x52b19580 (stale) Mirror 19: 0x52b19580 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000892 1784046745.457441 mapread 0x026fa2 thru 0x036d3c (0xfd9b bytes) 000893 1784046745.515663 mapread 0x02dced thru 0x033def (0x6103 bytes) 000894 1784046745.519548 fallocate 0x02085b thru 0x02341a (0x2bc0 bytes) 000895 1784046745.525688 mapread 0x030ff3 thru 0x0379a0 (0x69ae bytes) 000896 1784046745.527592 mapread 0x01c287 thru 0x02a446 (0xe1c0 bytes) 000897 1784046745.538594 read 0x017696 thru 0x01b83d (0x41a8 bytes) 000898 1784046745.543384 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x52b19580 (stale) Mirror 17: 0x52b19580 (stale) Mirror 18: 0x52b19580 (stale) Mirror 19: 0x52b19580 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6ee75a66 Mirror 20: 0x6ee75a66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000899 1784046747.438983 trunc from 0x040000 to 0x03b54f (0x4ab0 bytes) 000900 1784046747.520646 mapwrite 0x03874a thru 0x03dd5d (0x5614 bytes) 000901 1784046747.698427 fallocate 0x01b63c thru 0x01f39f (0x3d64 bytes) 000902 1784046747.705169 punch from 0x0376c9 to 0x03dd5d (0x6695 bytes) 000903 1784046747.738965 mapwrite 0x01338d thru 0x018a9f (0x5713 bytes) 000904 1784046747.783453 trunc from 0x02d0f3 to 0x0324c2 (0x53d0 bytes) 000905 1784046747.796615 write 0x0164b2 thru 0x025f45 (0xfa94 bytes) 000906 1784046747.808084 read 0x03ba6b thru 0x03dd5d (0x22f3 bytes) 000907 1784046747.837597 read 0x002d85 thru 0x005b6b (0x2de7 bytes) 000908 1784046747.875626 punch from 0x02b7bf to 0x034042 (0x8884 bytes) 000909 1784046747.911224 trunc from 0x003a16 to 0x013482 (0xfa6d bytes) 000910 1784046747.938197 fallocate 0x0320c0 thru 0x03a5e8 (0x8529 bytes) 000911 1784046747.954631 read 0x00b21e thru 0x016fba (0xbd9d bytes) 000912 1784046747.984599 trunc from 0x014101 to 0x0180f5 (0x3ff5 bytes) 000913 1784046748.021844 mapwrite 0x006f3f thru 0x00c70a (0x57cc bytes) 000914 1784046748.114677 mapwrite 0x015e0b thru 0x01600d (0x203 bytes) 000915 1784046748.150268 write 0x031366 thru 0x036a23 (0x56be bytes) 000916 1784046748.153572 mapread 0x036261 thru 0x03dd5d (0x7afd bytes) 000917 1784046748.156256 mapread 0x02f7c2 thru 0x035050 (0x588f bytes) 000919 1784046748.159482 mapread 0x02a529 thru 0x031866 (0x733e bytes) 000920 1784046748.161927 mapread 0x006997 thru 0x00a2bf (0x3929 bytes) 000921 1784046748.172584 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3dd5e): Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd5e): Mirror 12: 0x589b8738 (stale) Mirror 17: 0x589b8738 (stale) Mirror 18: 0x589b8738 (stale) Mirror 19: 0x589b8738 (stale) Mirror 20: 0x418a9b4e (stale) CRC-32 checksum value for chunk [0, 0x3dd5e): Mirror 1: 0xa87cb09 Mirror 21: 0xa87cb09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd5e: skipped 000922 1784046750.323129 mapread 0x00ba6b thru 0x0197fc (0xdd92 bytes) 000923 1784046750.371431 trunc from 0x021d7a to 0x030010 (0xe297 bytes) 000924 1784046750.440918 punch from 0x003247 to 0x004725 (0x14df bytes) 000925 1784046750.447508 write 0x0035bf thru 0x008061 (0x4aa3 bytes) 000926 1784046750.464672 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd5e): Mirror 17: 0x589b8738 (stale) Mirror 18: 0x589b8738 (stale) Mirror 19: 0x589b8738 (stale) Mirror 20: 0x418a9b4e (stale) Mirror 21: 0xa87cb09 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd5e): Mirror 17: 0x589b8738 (stale) Mirror 18: 0x589b8738 (stale) Mirror 19: 0x589b8738 (stale) Mirror 20: 0x418a9b4e (stale) Mirror 21: 0xa87cb09 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd5e: skipped 000927 1784046750.901992 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd5e): Mirror 17: 0x589b8738 (stale) Mirror 18: 0x589b8738 (stale) Mirror 19: 0x589b8738 (stale) Mirror 21: 0xa87cb09 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd5e): Mirror 17: 0x589b8738 (stale) Mirror 18: 0x589b8738 (stale) Mirror 19: 0x589b8738 (stale) Mirror 21: 0xa87cb09 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd5e: skipped 000928 1784046751.223668 fallocate 0x01773c thru 0x018f83 (0x1848 bytes) 000929 1784046751.227477 read 0x020354 thru 0x02f594 (0xf241 bytes) 000930 1784046751.236829 mapread 0x01848e thru 0x0210e1 (0x8c54 bytes) 000931 1784046751.274276 read 0x00bfda thru 0x019af0 (0xdb17 bytes) 000932 1784046751.305840 mapwrite 0x036174 thru 0x03ffff (0x9e8c bytes) 000933 1784046751.364556 mapwrite 0x00aa6f thru 0x011c35 (0x71c7 bytes) 000934 1784046751.389203 read 0x03370f thru 0x03403c (0x92e bytes) 000935 1784046751.392360 read 0x00da68 thru 0x01d6b7 (0xfc50 bytes) 000936 1784046751.394650 trunc from 0x040000 to 0x01ea0b (0x215f4 bytes) 000937 1784046751.418659 write 0x03d67b thru 0x03ffff (0x2985 bytes) 000938 1784046751.420284 trunc from 0x034ba7 to 0x037b9c (0x2ff6 bytes) 000939 1784046751.427961 trunc from 0x040000 to 0x00e693 (0x3196c bytes) 000940 1784046751.476835 mapread 0x007595 thru 0x00b321 (0x3d8d bytes) 000943 1784046751.484377 mapread 0x00d809 thru 0x00e693 (0xe8b bytes) 000944 1784046751.495812 mapwrite 0x027244 thru 0x03023c (0x8ff9 bytes) 000945 1784046751.600678 mapwrite 0x014da7 thru 0x018dd9 (0x4033 bytes) 000946 1784046751.641951 trunc from 0x03023d to 0x03d7a1 (0xd565 bytes) 000947 1784046751.660446 read 0x02db79 thru 0x02ebc7 (0x104f bytes) 000948 1784046751.661243 mapread 0x01ebcd thru 0x021115 (0x2549 bytes) 000949 1784046751.662349 punch from 0x008f94 to 0x00c0ee (0x315b bytes) 000950 1784046751.672244 write 0x03d108 thru 0x03ffff (0x2ef8 bytes) 000951 1784046751.691366 read 0x00de00 thru 0x0139cc (0x5bcd bytes) 000952 1784046751.695313 mapwrite 0x021251 thru 0x025f63 (0x4d13 bytes) 000953 1784046751.736026 MIRROR_RESYNC 5 mirrors 000954 1784046754.981333 read 0x02bd52 thru 0x02fbb5 (0x3e64 bytes) 000955 1784046754.993840 trunc from 0x009760 to 0x00c0c2 (0x2963 bytes) 000956 1784046755.053587 punch from 0x033264 to 0x03ffff (0xcd9c bytes) 000957 1784046755.058759 mapread 0x00e6a3 thru 0x01c1ae (0xdb0c bytes) 000958 1784046755.109252 read 0x003e5f thru 0x011228 (0xd3ca bytes) 000959 1784046755.128843 read 0x03bdc2 thru 0x03faaf (0x3cee bytes) 000960 1784046755.130281 punch from 0x036ed3 to 0x03ffff (0x912d bytes) 000961 1784046755.136564 punch from 0x019fb4 to 0x020dc8 (0x6e15 bytes) 000962 1784046755.141800 write 0x022a70 thru 0x03100d (0xe59e bytes) 000963 1784046755.145683 write 0x018e98 thru 0x023dc5 (0xaf2e bytes) 000965 1784046755.152388 MIRROR_RESYNC 5 mirrors 000966 1784046756.997383 trunc from 0x03817f to 0x038398 (0x21a bytes) 000967 1784046757.036959 write 0x005825 thru 0x007583 (0x1d5f bytes) 000968 1784046757.051008 punch from 0x0288e2 to 0x0320cf (0x97ee bytes) 000969 1784046757.058008 trunc from 0x040000 to 0x0313be (0xec41 bytes) 000970 1784046757.087051 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x313bf): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x313bf): Mirror 17: 0x510ff8c3 (stale) Mirror 18: 0x510ff8c3 (stale) Mirror 19: 0x510ff8c3 (stale) Mirror 21: 0x510ff8c3 (stale) CRC-32 checksum value for chunk [0, 0x313bf): Mirror 1: 0xcaee501 Mirror 22: 0xcaee501 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x313bf: skipped 000972 1784046757.957141 read 0x00e54b thru 0x01b6e1 (0xd197 bytes) 000973 1784046757.979565 write 0x01ff4f thru 0x028b3c (0x8bee bytes) 000974 1784046758.040443 MIRROR_RESYNC 6 mirrors 000975 1784046759.830641 read 0x024f66 thru 0x02c0a6 (0x7141 bytes) 000977 1784046759.846612 punch from 0x00866c to 0x00b044 (0x29d9 bytes) 000978 1784046759.889953 trunc from 0x0313bf to 0x000803 (0x30bbb bytes) 000980 1784046759.914932 trunc from 0x000712 to 0x000803 (0xf2 bytes) 000981 1784046759.920844 fallocate 0x03b7c2 thru 0x03efe3 (0x3822 bytes) 000983 1784046759.927281 fallocate 0x01a481 thru 0x01b1bb (0xd3b bytes) 000984 1784046759.932765 write 0x028b04 thru 0x0355ad (0xcaaa bytes) 000985 1784046759.935466 trunc from 0x0355ae to 0x025639 (0xff74 bytes) 000986 1784046759.957436 trunc from 0x00a41a to 0x00ae2a (0xa11 bytes) 000987 1784046759.962785 mapread 0x007820 thru 0x00e806 (0x6fe7 bytes) 000988 1784046759.989688 MIRROR_RESYNC 6 mirrors 000989 1784046761.081084 punch from 0x00856a to 0x008a39 (0x4d0 bytes) 000990 1784046761.120428 mapwrite 0x001c6e thru 0x0095f8 (0x798b bytes) 000991 1784046761.162397 mapread 0x01ab78 thru 0x01daab (0x2f34 bytes) 000992 1784046761.184024 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x181:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2563a): Mirror 17: 0xc6c5493b (stale) Mirror 18: 0xc6c5493b (stale) Mirror 19: 0xc6c5493b (stale) Mirror 21: 0xc6c5493b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2563a): Mirror 17: 0xc6c5493b (stale) Mirror 18: 0xc6c5493b (stale) Mirror 19: 0xc6c5493b (stale) Mirror 21: 0xc6c5493b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2563a: skipped 000993 1784046761.578377 mapwrite 0x031567 thru 0x0390d0 (0x7b6a bytes) 000994 1784046761.646893 mapread 0x000dd6 thru 0x001f1b (0x1146 bytes) 000995 1784046761.657699 punch from 0x018d8c to 0x01a91f (0x1b94 bytes) 000996 1784046761.662473 trunc from 0x0390d1 to 0x022f37 (0x16199 bytes) 000997 1784046761.676915 read 0x000130 thru 0x00eeaa (0xed7b bytes) 000998 1784046761.677929 fallocate 0x028357 thru 0x034aea (0xc794 bytes) 000999 1784046761.688660 trunc from 0x022f38 to 0x0077bc (0x1b77b bytes) 001000 1784046761.709737 mapwrite 0x013778 thru 0x021f00 (0xe789 bytes) All operations completed A-OK!