== sanity-flr test 70a: flr mode fsx test ================ 01:16:07 (1789449367) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 9370 skipping zero size read fallocating to largest ever: 0x1d4b5 000002 1789449370.438453 fallocate 0x010a72 thru 0x01d4b4 (0xca43 bytes) 000003 1789449370.444786 mapwrite 0x008a9e thru 0x0171b4 (0xe717 bytes) 000005 1789449370.515066 write 0x014606 thru 0x01b646 (0x7041 bytes) 000006 1789449370.518518 mapwrite 0x022077 thru 0x028ddd (0x6d67 bytes) zero_range to largest ever: 0x267c3 000007 1789449370.594870 trunc from 0x02082e to 0x0267c2 (0x5f95 bytes) 000008 1789449370.604672 mapwrite 0x008f04 thru 0x00e5e2 (0x56df bytes) 000009 1789449370.654749 mapread 0x01b792 thru 0x023781 (0x7ff0 bytes) 000010 1789449370.673639 mapread 0x01a6ce thru 0x01a765 (0x98 bytes) 000011 1789449370.674753 punch from 0x013c58 to 0x02398c (0xfd35 bytes) 000012 1789449370.682306 trunc from 0x028dde to 0x016894 (0x12549 bytes) 000013 1789449370.698955 punch from 0x00b941 to 0x01450b (0x8bcb bytes) 000014 1789449370.708194 mapwrite 0x0337ab thru 0x038366 (0x4bbc bytes) 000015 1789449370.756929 mapwrite 0x03b86e thru 0x03ccf1 (0x1484 bytes) 000016 1789449370.789527 mapwrite 0x01debd thru 0x0253fc (0x7540 bytes) 000017 1789449370.815936 trunc from 0x03ccf2 to 0x010f3c (0x2bdb5 bytes) 000019 1789449370.838742 trunc from 0x010f3d to 0x015a3b (0x4aff bytes) 000021 1789449370.856404 read 0x002ccb thru 0x00f9e1 (0xcd17 bytes) truncating to largest ever: 0x2893c 000022 1789449370.865023 trunc from 0x015a3c to 0x02893b (0x12f00 bytes) 000024 1789449370.885409 MIRROR_EXTEND to 2 mirrors 000025 1789449372.035047 read 0x00c4e7 thru 0x019d80 (0xd89a bytes) 000026 1789449372.062979 MIRROR_EXTEND to 3 mirrors 000027 1789449373.081768 trunc from 0x01583e to 0x019844 (0x4007 bytes) 000028 1789449373.167755 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2893c): Mirror 2: 0x45c9daac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2893c): Mirror 2: 0x45c9daac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2893c: skipped 000029 1789449373.746933 write 0x02ef5b thru 0x0354cf (0x6575 bytes) 000030 1789449373.767820 read 0x0281a9 thru 0x032a93 (0xa8eb bytes) 000031 1789449373.782742 fallocate 0x018d3d thru 0x0255eb (0xc8af bytes) 000032 1789449373.787763 punch from 0x009e65 to 0x00fe58 (0x5ff4 bytes) 000033 1789449373.797871 write 0x00bb70 thru 0x0132e2 (0x7773 bytes) 000034 1789449373.816041 mapwrite 0x021787 thru 0x0272f0 (0x5b6a bytes) 000035 1789449373.882736 trunc from 0x019c7c to 0x01e6d5 (0x4a5a bytes) 000036 1789449373.889935 mapread 0x022a8d thru 0x02ab42 (0x80b6 bytes) 000037 1789449373.891681 mapread 0x00f093 thru 0x019adb (0xaa49 bytes) fallocating to largest ever: 0x39cb2 000038 1789449373.904603 fallocate 0x036266 thru 0x039cb1 (0x3a4c bytes) 000039 1789449373.914267 punch from 0x02934f to 0x034348 (0xaffa bytes) 000040 1789449373.923498 write 0x038584 thru 0x03ffff (0x7a7c bytes) 000041 1789449373.931821 trunc from 0x040000 to 0x030439 (0xfbc6 bytes) 000042 1789449373.974992 trunc from 0x024891 to 0x030439 (0xbba9 bytes) 000043 1789449373.995289 write 0x01f60a thru 0x028637 (0x902e bytes) 000044 1789449374.007960 punch from 0x01145b to 0x01d2e4 (0xbe8a bytes) 000045 1789449374.016008 write 0x034919 thru 0x03ffff (0xb6e7 bytes) 000046 1789449374.020153 write 0x01c8ac thru 0x02ae52 (0xe5a7 bytes) 000047 1789449374.052662 write 0x01faaa thru 0x021e26 (0x237d bytes) 000048 1789449374.054880 write 0x0190c2 thru 0x01aa3f (0x197e bytes) 000049 1789449374.068087 punch from 0x01d63b to 0x026e16 (0x97dc bytes) 000051 1789449374.111568 mapread 0x021d5e thru 0x027ee0 (0x6183 bytes) 000052 1789449374.131072 fallocate 0x00ec24 thru 0x014eb7 (0x6294 bytes) fallocating to largest ever: 0x40000 000053 1789449374.153930 fallocate 0x030fa8 thru 0x03ffff (0xf058 bytes) 000054 1789449374.175710 punch from 0x02b036 to 0x02b3c6 (0x391 bytes) 000055 1789449374.188438 read 0x00f2c4 thru 0x018ab2 (0x97ef bytes) 000056 1789449374.214777 trunc from 0x040000 to 0x010e25 (0x2f1da bytes) 000057 1789449374.240045 trunc from 0x007fa9 to 0x00b56b (0x35c3 bytes) 000058 1789449374.250913 trunc from 0x010e26 to 0x0349b1 (0x23b8c bytes) 000059 1789449374.297045 write 0x028c19 thru 0x02ff6b (0x7353 bytes) 000060 1789449374.319941 write 0x03d926 thru 0x03ffff (0x26da bytes) 000061 1789449374.344741 MIRROR_RESYNC 2 mirrors 000062 1789449375.607689 punch from 0x01844e to 0x01e6d0 (0x6283 bytes) 000063 1789449375.692192 mapread 0x026138 thru 0x029d0a (0x3bd3 bytes) 000064 1789449375.763173 fallocate 0x0315fe thru 0x03deb3 (0xc8b6 bytes) 000067 1789449375.783617 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) 000069 1789449375.967289 mapwrite 0x00d091 thru 0x01c215 (0xf185 bytes) 000070 1789449376.035507 trunc from 0x040000 to 0x000320 (0x3fcdf bytes) 000071 1789449376.064580 read 0x00015a thru 0x000320 (0x1c7 bytes) 000072 1789449376.073891 punch from 0x000060 to 0x000320 (0x2c1 bytes) 000073 1789449376.079177 mapread 0x00006c thru 0x000320 (0x2b5 bytes) 000074 1789449376.088543 trunc from 0x000321 to 0x023d74 (0x23a54 bytes) 000075 1789449376.111568 read 0x007654 thru 0x0169dc (0xf389 bytes) 000077 1789449376.154743 fallocate 0x035eb4 thru 0x03f537 (0x9684 bytes) 000078 1789449376.164854 mapwrite 0x02ffad thru 0x03818d (0x81e1 bytes) 000079 1789449376.329434 trunc from 0x018700 to 0x02344d (0xad4e bytes) 000080 1789449376.339524 write 0x034e5e thru 0x03ee4f (0x9ff2 bytes) 000081 1789449376.345558 read 0x00e4b6 thru 0x00e8a1 (0x3ec bytes) 000082 1789449376.347573 mapwrite 0x03629f thru 0x038263 (0x1fc5 bytes) 000084 1789449376.389585 read 0x0248a2 thru 0x02daea (0x9249 bytes) 000085 1789449376.390991 trunc from 0x026e3f to 0x02d17c (0x633e bytes) 000086 1789449376.403957 mapwrite 0x028f43 thru 0x02d4b1 (0x456f bytes) 000088 1789449376.468770 mapread 0x013296 thru 0x01f7fb (0xc566 bytes) 000089 1789449376.469815 mapwrite 0x03bbff thru 0x03ffff (0x4401 bytes) 000090 1789449376.561017 trunc from 0x040000 to 0x02e046 (0x11fb9 bytes) 000091 1789449376.609835 fallocate 0x0078a3 thru 0x014acd (0xd22b bytes) 000092 1789449376.615793 mapread 0x01a440 thru 0x01c546 (0x2107 bytes) 000093 1789449376.616699 mapread 0x027cac thru 0x02d77d (0x5ad2 bytes) 000094 1789449376.617537 trunc from 0x00518c to 0x00fe4d (0xacc2 bytes) 000095 1789449376.626775 trunc from 0x00746e to 0x013e3d (0xc9d0 bytes) 000096 1789449376.643528 punch from 0x00e868 to 0x00e943 (0xdc bytes) 000097 1789449376.664577 punch from 0x02d2f7 to 0x02e046 (0xd50 bytes) 000099 1789449376.687067 punch from 0x0122b5 to 0x01c81d (0xa569 bytes) 000101 1789449376.696505 trunc from 0x02e047 to 0x00c85e (0x217e8 bytes) 000102 1789449376.741948 mapwrite 0x02763e thru 0x02a292 (0x2c55 bytes) 000103 1789449376.849819 fallocate 0x014d1d thru 0x01bd99 (0x707d bytes) 000105 1789449376.867135 trunc from 0x004629 to 0x013eb6 (0xf88e bytes) 000106 1789449376.886524 mapwrite 0x016dfe thru 0x01f345 (0x8548 bytes) 000107 1789449377.039595 MIRROR_EXTEND to 2 mirrors 000108 1789449378.360127 write 0x02ca0d thru 0x037998 (0xaf8c bytes) 000109 1789449378.461328 read 0x00ba8d thru 0x0167e0 (0xad54 bytes) 000110 1789449378.489710 MIRROR_RESYNC 2 mirrors 000111 1789449379.562623 punch from 0x01fccb to 0x0292c6 (0x95fc bytes) 000112 1789449379.658147 read 0x0029d7 thru 0x00cbbf (0xa1e9 bytes) 000113 1789449379.712704 trunc from 0x037999 to 0x0268b9 (0x110df bytes) 000115 1789449379.751686 mapread 0x01f518 thru 0x0268b9 (0x73a2 bytes) 000116 1789449379.789699 trunc from 0x00bd20 to 0x015555 (0x9836 bytes) 000117 1789449379.801246 write 0x03b1a5 thru 0x03daae (0x290a bytes) 000118 1789449379.802799 mapwrite 0x01fdd7 thru 0x0241f7 (0x4421 bytes) 000119 1789449379.869610 fallocate 0x006ce0 thru 0x00d24f (0x6570 bytes) 000120 1789449379.890391 trunc from 0x03daaf to 0x031983 (0xc12b bytes) 000121 1789449379.934414 mapwrite 0x01d2b0 thru 0x02c642 (0xf393 bytes) 000123 1789449380.063652 trunc from 0x031984 to 0x03fe11 (0xe48e bytes) 000124 1789449380.098477 mapwrite 0x01cd1b thru 0x026627 (0x990d bytes) 000125 1789449380.157156 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3fe12): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe12): Mirror 2: 0x2de54cbb (stale) CRC-32 checksum value for chunk [0, 0x3fe12): Mirror 1: 0x83095c0b Mirror 3: 0x83095c0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe12: skipped 000126 1789449381.459193 fallocate 0x039556 thru 0x03ddcf (0x487a bytes) 000128 1789449381.519777 fallocate 0x014bef thru 0x0239dc (0xedee bytes) 000129 1789449381.535402 fallocate 0x036092 thru 0x03f993 (0x9902 bytes) 000132 1789449381.546284 fallocate 0x00baff thru 0x01a76e (0xec70 bytes) 000134 1789449381.563692 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3fe12): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe12): Mirror 2: 0x2de54cbb (stale) Mirror 3: 0x83095c0b (stale) CRC-32 checksum value for chunk [0, 0x3fe12): Mirror 1: 0x83095c0b Mirror 4: 0x83095c0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe12: skipped 000135 1789449383.008883 mapread 0x01e737 thru 0x02c042 (0xd90c bytes) 000136 1789449383.075644 punch from 0x00b994 to 0x00d92a (0x1f97 bytes) 000137 1789449383.122293 trunc from 0x012e29 to 0x01e84b (0xba23 bytes) 000138 1789449383.131630 read 0x00b8c5 thru 0x00e54f (0x2c8b bytes) 000139 1789449383.141757 trunc from 0x03ccbc to 0x03fe11 (0x3156 bytes) 000140 1789449383.148732 read 0x03af31 thru 0x03e0fa (0x31ca bytes) 000142 1789449383.172659 trunc from 0x03fe12 to 0x00ea62 (0x313af bytes) 000143 1789449383.208087 mapread 0x005d8d thru 0x006710 (0x984 bytes) 000145 1789449383.209613 trunc from 0x00ea63 to 0x01effc (0x1059a bytes) 000146 1789449383.232867 read 0x00f320 thru 0x00fb10 (0x7f1 bytes) 000148 1789449383.250019 trunc from 0x01b8d3 to 0x01effc (0x372a bytes) 000152 1789449383.259736 trunc from 0x01effd to 0x01bca2 (0x335a bytes) 000153 1789449383.278820 mapread 0x00ea67 thru 0x017d83 (0x931d bytes) 000154 1789449383.280808 mapread 0x00a7ef thru 0x011315 (0x6b27 bytes) 000155 1789449383.283274 write 0x01ff7f thru 0x026d3e (0x6dc0 bytes) 000156 1789449383.285862 read 0x000a95 thru 0x00232f (0x189b bytes) 000157 1789449383.286953 punch from 0x00c8db to 0x01207b (0x57a1 bytes) 000159 1789449383.295285 read 0x00df3a thru 0x01acad (0xcd74 bytes) 000160 1789449383.306737 punch from 0x01c46a to 0x026d3e (0xa8d5 bytes) 000161 1789449383.323489 punch from 0x02374c to 0x026d3e (0x35f3 bytes) 000162 1789449383.329477 trunc from 0x02381d to 0x026d3e (0x3522 bytes) 000163 1789449383.335643 mapread 0x017cc8 thru 0x01f6ed (0x7a26 bytes) 000165 1789449383.360667 mapwrite 0x007de2 thru 0x00a552 (0x2771 bytes) 000166 1789449383.382526 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x26d3f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26d3f): Mirror 2: 0xa9b72bd7 (stale) Mirror 3: 0xd382b231 (stale) Mirror 4: 0xd382b231 (stale) CRC-32 checksum value for chunk [0, 0x26d3f): Mirror 1: 0xf5e014c Mirror 5: 0xf5e014c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26d3f: skipped 000168 1789449384.754292 write 0x029183 thru 0x03771b (0xe599 bytes) 000169 1789449384.802687 mapwrite 0x01ee9f thru 0x02bdfb (0xcf5d bytes) 000171 1789449384.848519 trunc from 0x0145a4 to 0x01bae4 (0x7541 bytes) 000173 1789449384.854739 trunc from 0x02fb08 to 0x03771b (0x7c14 bytes) 000174 1789449384.860104 read 0x017c0e thru 0x01f191 (0x7584 bytes) 000177 1789449384.869865 punch from 0x017e37 to 0x01b486 (0x3650 bytes) 000178 1789449384.877029 fallocate 0x022ebb thru 0x03108a (0xe1d0 bytes) 000179 1789449384.898587 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3771c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3771c): Mirror 2: 0xfe4f128a (stale) Mirror 3: 0x7dd3c6cf (stale) Mirror 4: 0x7dd3c6cf (stale) Mirror 5: 0x4bb115bc (stale) CRC-32 checksum value for chunk [0, 0x3771c): Mirror 1: 0x85f12b2f Mirror 6: 0x85f12b2f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3771c: skipped 000180 1789449386.653810 mapwrite 0x00bbc4 thru 0x0185b6 (0xc9f3 bytes) 000181 1789449386.849729 mapwrite 0x017ee3 thru 0x01e8f3 (0x6a11 bytes) 000182 1789449386.902175 punch from 0x016dd1 to 0x01c716 (0x5946 bytes) 000184 1789449386.919986 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3771c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3771c): Mirror 2: 0xfe4f128a (stale) Mirror 3: 0x7dd3c6cf (stale) Mirror 4: 0x7dd3c6cf (stale) Mirror 5: 0x4bb115bc (stale) Mirror 6: 0x85f12b2f (stale) CRC-32 checksum value for chunk [0, 0x3771c): Mirror 1: 0xa322904a Mirror 7: 0xa322904a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3771c: skipped 000185 1789449388.917990 mapread 0x0275f5 thru 0x035460 (0xde6c bytes) 000186 1789449388.974624 mapwrite 0x01048d thru 0x01e8cb (0xe43f bytes) 000187 1789449389.202605 trunc from 0x00cfe3 to 0x00d1ec (0x20a bytes) 000188 1789449389.215460 mapread 0x034ecb thru 0x03771b (0x2851 bytes) 000189 1789449389.231680 read 0x027a84 thru 0x02c6bc (0x4c39 bytes) 000190 1789449389.248034 mapwrite 0x01dbad thru 0x0228b4 (0x4d08 bytes) 000191 1789449389.319484 write 0x01c81e thru 0x02a16d (0xd950 bytes) 000192 1789449389.343296 trunc from 0x03771c to 0x02ef19 (0x8802 bytes) 000193 1789449389.416267 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2ef1a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef1a): Mirror 2: 0x6b264064 (stale) Mirror 3: 0x49d4b1ee (stale) Mirror 4: 0x49d4b1ee (stale) Mirror 5: 0x20e8911e (stale) Mirror 6: 0x7e9c52c3 (stale) Mirror 7: 0x51e2f7a8 (stale) CRC-32 checksum value for chunk [0, 0x2ef1a): Mirror 1: 0x491f3f9 Mirror 8: 0x491f3f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef1a: skipped 000194 1789449391.480441 mapwrite 0x0051b1 thru 0x01402c (0xee7c bytes) 000195 1789449391.682322 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2ef1a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef1a): Mirror 2: 0x6b264064 (stale) Mirror 3: 0x49d4b1ee (stale) Mirror 4: 0x49d4b1ee (stale) Mirror 5: 0x20e8911e (stale) Mirror 6: 0x7e9c52c3 (stale) Mirror 7: 0x51e2f7a8 (stale) Mirror 8: 0x491f3f9 (stale) CRC-32 checksum value for chunk [0, 0x2ef1a): Mirror 1: 0xe3ff1107 Mirror 9: 0xe3ff1107 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef1a: skipped 000196 1789449393.082673 mapread 0x0127ef thru 0x01cc4d (0xa45f bytes) 000197 1789449393.124864 MIRROR_RESYNC 9 mirrors 000198 1789449394.919578 trunc from 0x001332 to 0x00a412 (0x90e1 bytes) 000199 1789449394.986963 write 0x02321f thru 0x031bb9 (0xe99b bytes) 000200 1789449394.994954 write 0x03992b thru 0x03ffff (0x66d5 bytes) 000201 1789449395.000303 trunc from 0x016890 to 0x02304e (0xc7bf bytes) 000202 1789449395.041618 trunc from 0x040000 to 0x019aa5 (0x2655a bytes) 000204 1789449395.087131 mapwrite 0x02c7ac thru 0x03199e (0x51f3 bytes) 000205 1789449395.227884 trunc from 0x01865a to 0x0243f7 (0xbd9e bytes) 000206 1789449395.236963 read 0x00c2ee thru 0x019fc7 (0xdcda bytes) 000207 1789449395.256109 punch from 0x019d4b to 0x01cd38 (0x2fee bytes) 000208 1789449395.261325 read 0x02d837 thru 0x03199e (0x4168 bytes) 000209 1789449395.262888 mapread 0x0077fd thru 0x00aa90 (0x3294 bytes) 000211 1789449395.287604 read 0x022619 thru 0x022f8f (0x977 bytes) 000213 1789449395.289102 trunc from 0x03199f to 0x034036 (0x2698 bytes) 000214 1789449395.325978 trunc from 0x034037 to 0x032e96 (0x11a0 bytes) 000215 1789449395.353308 mapread 0x023199 thru 0x02baf6 (0x895e bytes) 000216 1789449395.358120 trunc from 0x01d6d2 to 0x01e960 (0x128f bytes) 000217 1789449395.365384 fallocate 0x0397a8 thru 0x03c80b (0x3064 bytes) 000218 1789449395.376554 mapwrite 0x002205 thru 0x00e191 (0xbf8d bytes) 000219 1789449395.426214 trunc from 0x0030a5 to 0x004325 (0x1281 bytes) 000220 1789449395.436175 fallocate 0x01e686 thru 0x028688 (0xa003 bytes) 000221 1789449395.450771 mapwrite 0x0283f2 thru 0x032c7d (0xa88c bytes) 000223 1789449395.502318 mapread 0x005f04 thru 0x00e5aa (0x86a7 bytes) 000224 1789449395.504243 trunc from 0x000ded to 0x000e9b (0xaf bytes) 000225 1789449395.509615 mapwrite 0x035899 thru 0x036676 (0xdde bytes) 000226 1789449395.539447 punch from 0x027507 to 0x03105b (0x9b55 bytes) 000227 1789449395.575859 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c80c): Mirror 3: 0xdb1acb62 (stale) Mirror 4: 0xdb1acb62 (stale) Mirror 5: 0xdb1acb62 (stale) Mirror 6: 0xdb1acb62 (stale) Mirror 7: 0xdb1acb62 (stale) Mirror 8: 0xdb1acb62 (stale) Mirror 9: 0xdb1acb62 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c80c): Mirror 3: 0xdb1acb62 (stale) Mirror 4: 0xdb1acb62 (stale) Mirror 5: 0xdb1acb62 (stale) Mirror 6: 0xdb1acb62 (stale) Mirror 7: 0xdb1acb62 (stale) Mirror 8: 0xdb1acb62 (stale) Mirror 9: 0xdb1acb62 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c80c: skipped 000228 1789449396.218057 fallocate 0x019a69 thru 0x01bfdd (0x2575 bytes) 000230 1789449396.225640 trunc from 0x03c80c to 0x001ad6 (0x3ad35 bytes) 000231 1789449396.260877 fallocate 0x003bac thru 0x005177 (0x15cc bytes) 000232 1789449396.271871 trunc from 0x001ad7 to 0x029111 (0x2763b bytes) 000233 1789449396.303137 trunc from 0x01082a to 0x014048 (0x381f bytes) 000234 1789449396.308558 mapwrite 0x01d25e thru 0x01ebbb (0x195e bytes) 000235 1789449396.349318 mapread 0x025d46 thru 0x029111 (0x33cc bytes) 000237 1789449396.372201 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x29112): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29112): Mirror 3: 0x156864cd (stale) Mirror 4: 0x156864cd (stale) Mirror 5: 0x156864cd (stale) Mirror 6: 0x156864cd (stale) Mirror 7: 0x156864cd (stale) Mirror 8: 0x156864cd (stale) Mirror 9: 0x156864cd (stale) CRC-32 checksum value for chunk [0, 0x29112): Mirror 1: 0xa21502b3 Mirror 10: 0xa21502b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29112: skipped 000239 1789449397.807785 trunc from 0x00e98b to 0x00eebe (0x534 bytes) 000240 1789449397.856124 trunc from 0x0027b1 to 0x00dd1c (0xb56c bytes) 000241 1789449397.862212 trunc from 0x029112 to 0x035ddc (0xcccb bytes) 000242 1789449397.920055 punch from 0x015e40 to 0x020415 (0xa5d6 bytes) 000243 1789449397.925566 read 0x01262d thru 0x01684e (0x4222 bytes) 000244 1789449397.935933 mapwrite 0x00a47c thru 0x018650 (0xe1d5 bytes) 000245 1789449397.996558 punch from 0x0250e3 to 0x02f50f (0xa42d bytes) 000246 1789449398.004747 trunc from 0x035ddd to 0x0107fa (0x255e2 bytes) 000247 1789449398.023995 mapwrite 0x03a066 thru 0x03ffff (0x5f9a bytes) 000248 1789449398.124141 trunc from 0x040000 to 0x004307 (0x3bcf8 bytes) 000249 1789449398.179220 trunc from 0x002479 to 0x004307 (0x1e8f bytes) 000250 1789449398.191537 mapread 0x00388f thru 0x004307 (0xa79 bytes) 000251 1789449398.200325 fallocate 0x00db76 thru 0x012ff6 (0x5481 bytes) 000252 1789449398.206726 mapwrite 0x037c38 thru 0x037e15 (0x1de bytes) 000253 1789449398.247991 trunc from 0x037e16 to 0x019c04 (0x1e211 bytes) 000254 1789449398.269383 mapwrite 0x01e2b5 thru 0x026937 (0x8683 bytes) 000255 1789449398.346771 mapwrite 0x00fec1 thru 0x01bf06 (0xc046 bytes) 000256 1789449398.391804 fallocate 0x005cb7 thru 0x00f8ec (0x9c36 bytes) 000257 1789449398.397981 trunc from 0x026938 to 0x03b08e (0x14757 bytes) 000258 1789449398.414052 trunc from 0x00df1f to 0x0187c9 (0xa8ab bytes) 000259 1789449398.420538 read 0x02cb02 thru 0x02e702 (0x1c01 bytes) 000260 1789449398.434024 write 0x01a8b9 thru 0x01b152 (0x89a bytes) 000261 1789449398.435654 write 0x03ad7a thru 0x03b28f (0x516 bytes) 000263 1789449398.438836 mapwrite 0x009361 thru 0x016fa0 (0xdc40 bytes) 000264 1789449398.465308 trunc from 0x03b290 to 0x03f941 (0x46b2 bytes) 000265 1789449398.502511 mapwrite 0x03111e thru 0x0380df (0x6fc2 bytes) 000266 1789449398.544328 MIRROR_RESYNC 9 mirrors 000268 1789449402.998802 fallocate 0x0101e4 thru 0x018826 (0x8643 bytes) 000269 1789449403.057065 fallocate 0x01b6ea thru 0x023208 (0x7b1f bytes) 000270 1789449403.062960 read 0x02bd75 thru 0x02e1d8 (0x2464 bytes) 000271 1789449403.071287 trunc from 0x006c6d to 0x0092e6 (0x267a bytes) 000272 1789449403.082108 trunc from 0x03f942 to 0x03fbfd (0x2bc bytes) 000273 1789449403.110259 punch from 0x039339 to 0x03bb5b (0x2823 bytes) 000274 1789449403.117044 trunc from 0x03fbfe to 0x013dbb (0x2be42 bytes) 000275 1789449403.140067 punch from 0x010875 to 0x013dbb (0x3547 bytes) 000276 1789449403.146959 mapread 0x005c4d thru 0x00ebc4 (0x8f78 bytes) 000278 1789449403.168699 mapread 0x007b3a thru 0x013dbb (0xc282 bytes) 000279 1789449403.175951 trunc from 0x013dbc to 0x002c5b (0x11160 bytes) 000280 1789449403.198784 read 0x00061c thru 0x002c5b (0x2640 bytes) 000282 1789449403.210323 fallocate 0x001987 thru 0x00c3c8 (0xaa42 bytes) 000283 1789449403.215800 punch from 0x000b8b to 0x00c3c8 (0xb83e bytes) 000284 1789449403.222723 read 0x009e35 thru 0x00c3c8 (0x2594 bytes) 000285 1789449403.233028 write 0x02c57b thru 0x02ed65 (0x27eb bytes) 000286 1789449403.235282 trunc from 0x02ed66 to 0x03fff7 (0x11292 bytes) 000288 1789449403.256399 punch from 0x013255 to 0x01e884 (0xb630 bytes) 000289 1789449403.262808 fallocate 0x02fb22 thru 0x03e57d (0xea5c bytes) 000290 1789449403.273254 mapread 0x0128ef thru 0x01a1c7 (0x78d9 bytes) 000293 1789449403.294449 trunc from 0x024ded to 0x030239 (0xb44d bytes) 000294 1789449403.312919 mapread 0x01570e thru 0x01a5ca (0x4ebd bytes) 000295 1789449403.319889 punch from 0x02d094 to 0x034873 (0x77e0 bytes) 000296 1789449403.326055 write 0x033dfc thru 0x036421 (0x2626 bytes) 000297 1789449403.346896 fallocate 0x01e793 thru 0x02a507 (0xbd75 bytes) 000298 1789449403.361869 punch from 0x0159b8 to 0x016674 (0xcbd bytes) 000300 1789449403.383004 fallocate 0x030809 thru 0x0332ba (0x2ab2 bytes) 000301 1789449403.389889 fallocate 0x0210f7 thru 0x02db85 (0xca8f bytes) 000302 1789449403.403921 mapread 0x030555 thru 0x0393bd (0x8e69 bytes) 000303 1789449403.443485 trunc from 0x03cdb4 to 0x03fff7 (0x3244 bytes) 000304 1789449403.451403 mapwrite 0x003337 thru 0x011fcb (0xec95 bytes) 000305 1789449403.480159 trunc from 0x03fff8 to 0x02722d (0x18dca bytes) 000306 1789449403.529497 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2722e): Mirror 3: 0xf5f1de19 (stale) Mirror 4: 0xf5f1de19 (stale) Mirror 5: 0xf5f1de19 (stale) Mirror 6: 0xf5f1de19 (stale) Mirror 7: 0xf5f1de19 (stale) Mirror 8: 0xf5f1de19 (stale) Mirror 9: 0xf5f1de19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2722e): Mirror 3: 0xf5f1de19 (stale) Mirror 4: 0xf5f1de19 (stale) Mirror 5: 0xf5f1de19 (stale) Mirror 6: 0xf5f1de19 (stale) Mirror 7: 0xf5f1de19 (stale) Mirror 8: 0xf5f1de19 (stale) Mirror 9: 0xf5f1de19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2722e: skipped 000307 1789449404.307167 mapwrite 0x013e78 thru 0x018d89 (0x4f12 bytes) 000308 1789449404.402689 read 0x01fab4 thru 0x02250f (0x2a5c bytes) 000309 1789449404.416857 trunc from 0x02722e to 0x01f08d (0x81a0 bytes) 000310 1789449404.476895 trunc from 0x01f08e to 0x0199e5 (0x56a8 bytes) 000311 1789449404.500078 punch from 0x00db43 to 0x01509a (0x7558 bytes) 000312 1789449404.508124 mapwrite 0x030b81 thru 0x037527 (0x69a7 bytes) 000313 1789449404.555209 mapread 0x012e5a thru 0x01e74b (0xb8f2 bytes) 000314 1789449404.575114 punch from 0x012618 to 0x014bfe (0x25e7 bytes) 000315 1789449404.579797 write 0x01a924 thru 0x020912 (0x5fef bytes) 000316 1789449404.581565 fallocate 0x0257cb thru 0x02f538 (0x9d6e bytes) 000317 1789449404.587372 mapwrite 0x03e21e thru 0x03ffff (0x1de2 bytes) 000318 1789449404.632211 mapread 0x023684 thru 0x0328fc (0xf279 bytes) 000319 1789449404.644437 mapwrite 0x035dd6 thru 0x035eed (0x118 bytes) 000320 1789449404.658160 trunc from 0x040000 to 0x035b52 (0xa4ad bytes) 000321 1789449404.678906 punch from 0x033ce5 to 0x033ff5 (0x311 bytes) 000322 1789449404.698509 punch from 0x0329a5 to 0x035b52 (0x31ae bytes) 000323 1789449404.720107 punch from 0x00a03a to 0x00bbc1 (0x1b88 bytes) 000325 1789449404.746997 write 0x02d12a thru 0x02d9e3 (0x8ba bytes) 000327 1789449404.765829 punch from 0x01618b to 0x01fef2 (0x9d68 bytes) 000328 1789449404.788796 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35b53): Mirror 3: 0xfd2c7254 (stale) Mirror 4: 0xfd2c7254 (stale) Mirror 5: 0xfd2c7254 (stale) Mirror 6: 0xfd2c7254 (stale) Mirror 8: 0xfd2c7254 (stale) Mirror 9: 0xfd2c7254 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b53): Mirror 3: 0xfd2c7254 (stale) Mirror 4: 0xfd2c7254 (stale) Mirror 5: 0xfd2c7254 (stale) Mirror 6: 0xfd2c7254 (stale) Mirror 8: 0xfd2c7254 (stale) Mirror 9: 0xfd2c7254 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b53: skipped 000329 1789449405.527329 fallocate 0x0272dd thru 0x0274ae (0x1d2 bytes) 000330 1789449405.533276 punch from 0x027733 to 0x027e0c (0x6da bytes) 000332 1789449405.540265 trunc from 0x035b53 to 0x03e2dc (0x878a bytes) 000333 1789449405.567915 write 0x0237f1 thru 0x02b22f (0x7a3f bytes) 000334 1789449405.598670 MIRROR_RESYNC 7 mirrors 000335 1789449408.855614 mapread 0x02c359 thru 0x03aeaf (0xeb57 bytes) 000336 1789449408.902749 trunc from 0x03e2dd to 0x00bb51 (0x3278b bytes) 000337 1789449408.991306 punch from 0x003f85 to 0x00bb51 (0x7bcd bytes) 000338 1789449409.000929 punch from 0x0057dc to 0x00bb51 (0x6376 bytes) 000340 1789449409.020440 mapread 0x0088d4 thru 0x00bb51 (0x327e bytes) 000341 1789449409.062156 trunc from 0x007cad to 0x00bb51 (0x3ea5 bytes) 000342 1789449409.077310 mapwrite 0x027657 thru 0x034b54 (0xd4fe bytes) 000343 1789449409.272187 write 0x010036 thru 0x0157dc (0x57a7 bytes) 000344 1789449409.319026 MIRROR_RESYNC 7 mirrors 000345 1789449412.062267 mapread 0x01e7d6 thru 0x0261bb (0x79e6 bytes) 000346 1789449412.090808 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) 000347 1789449412.679061 punch from 0x02175a to 0x028f09 (0x77b0 bytes) 000348 1789449412.756649 fallocate 0x0210e7 thru 0x025705 (0x461f bytes) 000351 1789449412.766091 mapread 0x00d230 thru 0x01b5c5 (0xe396 bytes) 000352 1789449412.846253 write 0x01ec25 thru 0x02065b (0x1a37 bytes) 000353 1789449412.859068 mapread 0x031d1c thru 0x034b54 (0x2e39 bytes) 000354 1789449412.871037 mapwrite 0x034fb4 thru 0x03ad72 (0x5dbf bytes) 000355 1789449412.994079 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 3: 0x50ed26c7 (stale) Mirror 5: 0x50ed26c7 (stale) Mirror 6: 0x50ed26c7 (stale) Mirror 8: 0x50ed26c7 (stale) Mirror 9: 0x50ed26c7 (stale) CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 1: 0x80edc118 Mirror 10: 0x80edc118 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad73: skipped 000356 1789449414.451767 mapread 0x00d4c6 thru 0x01d3c2 (0xfefd bytes) 000357 1789449414.563143 read 0x01aaf5 thru 0x0252c9 (0xa7d5 bytes) 000358 1789449414.595201 mapwrite 0x00459d thru 0x006fec (0x2a50 bytes) 000359 1789449414.732062 punch from 0x006a08 to 0x00a5df (0x3bd8 bytes) 000360 1789449414.741180 trunc from 0x0152a5 to 0x019171 (0x3ecd bytes) 000361 1789449414.754548 mapread 0x00f5d1 thru 0x011c97 (0x26c7 bytes) 000362 1789449414.801737 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 3: 0x50ed26c7 (stale) Mirror 5: 0x50ed26c7 (stale) Mirror 6: 0x50ed26c7 (stale) Mirror 8: 0x50ed26c7 (stale) Mirror 9: 0x50ed26c7 (stale) Mirror 10: 0x80edc118 (stale) CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 1: 0x59ec6d5f Mirror 11: 0x59ec6d5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad73: skipped 000364 1789449416.302013 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 3: 0x50ed26c7 (stale) Mirror 5: 0x50ed26c7 (stale) Mirror 6: 0x50ed26c7 (stale) Mirror 8: 0x50ed26c7 (stale) Mirror 9: 0x50ed26c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 3: 0x50ed26c7 (stale) Mirror 5: 0x50ed26c7 (stale) Mirror 6: 0x50ed26c7 (stale) Mirror 8: 0x50ed26c7 (stale) Mirror 9: 0x50ed26c7 (stale) CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 1: 0x59ec6d5f Mirror 11: 0x59ec6d5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad73: skipped 000365 1789449417.544914 read 0x02d9f2 thru 0x03689c (0x8eab bytes) 000366 1789449417.572909 mapwrite 0x00ed30 thru 0x011a23 (0x2cf4 bytes) 000367 1789449417.739593 punch from 0x0361be to 0x03ad72 (0x4bb5 bytes) 000368 1789449417.763050 read 0x035f97 thru 0x03ad72 (0x4ddc bytes) 000369 1789449417.797268 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 3: 0x50ed26c7 (stale) Mirror 5: 0x50ed26c7 (stale) Mirror 6: 0x50ed26c7 (stale) Mirror 8: 0x50ed26c7 (stale) Mirror 9: 0x50ed26c7 (stale) Mirror 11: 0x59ec6d5f (stale) CRC-32 checksum value for chunk [0, 0x3ad73): Mirror 1: 0x9b0b47a6 Mirror 12: 0x9b0b47a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad73: skipped 000370 1789449419.514966 mapread 0x028d2b thru 0x02e0f3 (0x53c9 bytes) 000371 1789449419.557810 mapwrite 0x01a202 thru 0x027a19 (0xd818 bytes) 000372 1789449419.681209 trunc from 0x025d83 to 0x02f70b (0x9989 bytes) 000373 1789449419.687135 fallocate 0x022a4a thru 0x023c19 (0x11d0 bytes) 000374 1789449419.692923 trunc from 0x009cab to 0x01868f (0xe9e5 bytes) 000375 1789449419.697766 fallocate 0x0397b3 thru 0x03c6c1 (0x2f0f bytes) 000377 1789449419.704052 trunc from 0x019178 to 0x0227ce (0x9657 bytes) 000378 1789449419.711140 punch from 0x024e2b to 0x028ca1 (0x3e77 bytes) 000379 1789449419.722133 mapwrite 0x02d7df thru 0x03c7a7 (0xefc9 bytes) 000380 1789449419.786826 punch from 0x010dcf to 0x01ad97 (0x9fc9 bytes) 000381 1789449419.792197 trunc from 0x0338d3 to 0x03c7a7 (0x8ed5 bytes) 000382 1789449419.808223 MIRROR_RESYNC 8 mirrors 000383 1789449423.200331 trunc from 0x0024bf to 0x011d89 (0xf8cb bytes) 000385 1789449423.365214 trunc from 0x03c7a8 to 0x006151 (0x36656 bytes) 000386 1789449423.400031 mapwrite 0x007c80 thru 0x00a0f7 (0x2478 bytes) 000387 1789449423.532606 mapread 0x002899 thru 0x00a0f7 (0x785f bytes) 000388 1789449423.533872 write 0x0238b6 thru 0x02722e (0x3979 bytes) 000389 1789449423.540526 trunc from 0x011c89 to 0x0177ae (0x5b26 bytes) 000390 1789449423.573634 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2722f): Mirror 5: 0x9d63efb7 (stale) Mirror 6: 0x9d63efb7 (stale) Mirror 8: 0x9d63efb7 (stale) Mirror 9: 0x9d63efb7 (stale) Mirror 11: 0x9d63efb7 (stale) Mirror 12: 0x9d63efb7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2722f): Mirror 5: 0x9d63efb7 (stale) Mirror 6: 0x9d63efb7 (stale) Mirror 8: 0x9d63efb7 (stale) Mirror 9: 0x9d63efb7 (stale) Mirror 11: 0x9d63efb7 (stale) Mirror 12: 0x9d63efb7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2722f: skipped 000391 1789449424.304153 punch from 0x012f65 to 0x017495 (0x4531 bytes) 000392 1789449424.311540 trunc from 0x017fa2 to 0x020ea4 (0x8f03 bytes) 000393 1789449424.318965 write 0x020136 thru 0x0232c8 (0x3193 bytes) 000394 1789449424.339760 punch from 0x009378 to 0x00bd00 (0x2989 bytes) 000395 1789449424.348060 mapwrite 0x010f96 thru 0x01f931 (0xe99c bytes) 000396 1789449424.447126 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2722f): Mirror 5: 0x9d63efb7 (stale) Mirror 8: 0x9d63efb7 (stale) Mirror 9: 0x9d63efb7 (stale) Mirror 11: 0x9d63efb7 (stale) Mirror 12: 0x9d63efb7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2722f): Mirror 5: 0x9d63efb7 (stale) Mirror 8: 0x9d63efb7 (stale) Mirror 9: 0x9d63efb7 (stale) Mirror 11: 0x9d63efb7 (stale) Mirror 12: 0x9d63efb7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2722f: skipped 000397 1789449424.966925 trunc from 0x02722f to 0x01da75 (0x97b9 bytes) 000398 1789449424.992610 trunc from 0x013e37 to 0x018e02 (0x4fcc bytes) 000399 1789449424.999309 trunc from 0x01da76 to 0x023575 (0x5b00 bytes) 000400 1789449425.018803 fallocate 0x02e5bb thru 0x038fd0 (0xaa16 bytes) 000401 1789449425.025994 punch from 0x019540 to 0x023575 (0xa036 bytes) 000402 1789449425.032488 mapread 0x01a1ea thru 0x01a44a (0x261 bytes) 000403 1789449425.038681 mapread 0x00736e thru 0x0155cf (0xe262 bytes) 000404 1789449425.068898 mapwrite 0x021406 thru 0x0233fb (0x1ff6 bytes) 000405 1789449425.092933 mapread 0x014f61 thru 0x0226e1 (0xd781 bytes) 000406 1789449425.095737 punch from 0x0185d8 to 0x023575 (0xaf9e bytes) 000407 1789449425.102239 mapread 0x00f526 thru 0x01672b (0x7206 bytes) 000408 1789449425.105626 trunc from 0x023576 to 0x0387e0 (0x1526b bytes) 000409 1789449425.125024 trunc from 0x0387e1 to 0x010598 (0x28248 bytes) 000410 1789449425.175068 mapwrite 0x0076be thru 0x0148b2 (0xd1f5 bytes) 000411 1789449425.261794 mapwrite 0x0048ec thru 0x00852f (0x3c44 bytes) 000412 1789449425.279296 punch from 0x0072f1 to 0x010996 (0x96a6 bytes) 000413 1789449425.293016 write 0x00e59e thru 0x0171d9 (0x8c3c bytes) 000414 1789449425.305866 mapread 0x00f1d2 thru 0x0171d9 (0x8008 bytes) 000415 1789449425.307746 read 0x00f549 thru 0x0171d9 (0x7c91 bytes) 000416 1789449425.308804 mapwrite 0x0005b8 thru 0x00827a (0x7cc3 bytes) 000417 1789449425.373386 MIRROR_RESYNC 6 mirrors 000418 1789449426.983867 mapread 0x00d1bc thru 0x0117d8 (0x461d bytes) 000419 1789449427.010541 fallocate 0x031f93 thru 0x03d629 (0xb697 bytes) 000421 1789449427.059563 trunc from 0x025398 to 0x02ee4e (0x9ab7 bytes) 000422 1789449427.068787 mapread 0x01e84e thru 0x021546 (0x2cf9 bytes) 000423 1789449427.083641 trunc from 0x03d62a to 0x020f7a (0x1c6af bytes) 000424 1789449427.112725 write 0x0191fe thru 0x0216ce (0x84d1 bytes) 000425 1789449427.115903 mapwrite 0x01db2b thru 0x02cfab (0xf481 bytes) 000426 1789449427.185328 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cfac): Mirror 5: 0xb88628bc (stale) Mirror 8: 0xb88628bc (stale) Mirror 11: 0xb88628bc (stale) Mirror 12: 0xb88628bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cfac): Mirror 5: 0xb88628bc (stale) Mirror 8: 0xb88628bc (stale) Mirror 11: 0xb88628bc (stale) Mirror 12: 0xb88628bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cfac: skipped 000428 1789449427.758723 mapwrite 0x0081e3 thru 0x008eb9 (0xcd7 bytes) 000429 1789449427.797508 write 0x019bb6 thru 0x024762 (0xabad bytes) 000430 1789449427.818949 mapwrite 0x03eb2b thru 0x03ffff (0x14d5 bytes) 000431 1789449427.918044 trunc from 0x040000 to 0x025962 (0x1a69d bytes) 000432 1789449427.938238 read 0x01f9f8 thru 0x025962 (0x5f6b bytes) 000433 1789449427.944967 trunc from 0x00fa36 to 0x01951c (0x9ae7 bytes) 000434 1789449427.954535 mapread 0x02175c thru 0x025962 (0x4207 bytes) 000435 1789449427.958625 write 0x0207b7 thru 0x02990b (0x9155 bytes) 000436 1789449427.968787 punch from 0x00d688 to 0x015699 (0x8012 bytes) 000437 1789449427.985801 trunc from 0x00bc9b to 0x00fac0 (0x3e26 bytes) 000438 1789449427.997195 read 0x0080f0 thru 0x00cfdd (0x4eee bytes) 000439 1789449428.012579 read 0x0046b6 thru 0x00d0e8 (0x8a33 bytes) 000440 1789449428.029038 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2990c): Mirror 5: 0x43a9e701 (stale) Mirror 11: 0x43a9e701 (stale) Mirror 12: 0x43a9e701 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2990c): Mirror 5: 0x43a9e701 (stale) Mirror 11: 0x43a9e701 (stale) Mirror 12: 0x43a9e701 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2990c: skipped 000441 1789449428.681800 mapread 0x009b5c thru 0x015db1 (0xc256 bytes) 000442 1789449428.715649 write 0x02acdc thru 0x0395aa (0xe8cf bytes) 000443 1789449428.728280 trunc from 0x00e96b to 0x01465b (0x5cf1 bytes) 000444 1789449428.744554 write 0x024cd9 thru 0x0257c5 (0xaed bytes) 000445 1789449428.770777 read 0x02dac1 thru 0x0323bd (0x48fd bytes) 000447 1789449428.782889 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x395ab): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395ab): Mirror 5: 0x66bcbe62 (stale) Mirror 11: 0x66bcbe62 (stale) Mirror 12: 0x66bcbe62 (stale) CRC-32 checksum value for chunk [0, 0x395ab): Mirror 1: 0x796308ea Mirror 13: 0x796308ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395ab: skipped 000448 1789449430.169860 trunc from 0x0395ab to 0x01c02d (0x1d57d bytes) 000450 1789449430.259085 trunc from 0x01c02e to 0x032bec (0x16bbf bytes) 000451 1789449430.315191 trunc from 0x032bed to 0x019f3c (0x18cb0 bytes) 000452 1789449430.379181 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x19f3d): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19f3d): Mirror 5: 0x39cb51b3 (stale) Mirror 11: 0x39cb51b3 (stale) Mirror 12: 0x39cb51b3 (stale) Mirror 13: 0xf72c711a (stale) CRC-32 checksum value for chunk [0, 0x19f3d): Mirror 1: 0xf72c711a Mirror 14: 0xf72c711a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19f3d: skipped 000454 1789449431.966948 write 0x006392 thru 0x013495 (0xd104 bytes) 000455 1789449432.073675 punch from 0x0013b9 to 0x009347 (0x7f8f bytes) 000456 1789449432.111442 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x19f3d): Mirror 5: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19f3d): Mirror 5: 0x39cb51b3 (stale) Mirror 11: 0x39cb51b3 (stale) Mirror 12: 0x39cb51b3 (stale) Mirror 13: 0xf72c711a (stale) Mirror 14: 0xf72c711a (stale) CRC-32 checksum value for chunk [0, 0x19f3d): Mirror 1: 0xb77af17a Mirror 15: 0xb77af17a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19f3d: skipped 000457 1789449433.399778 write 0x0025e7 thru 0x00e0c9 (0xbae3 bytes) 000458 1789449433.471783 mapread 0x007f74 thru 0x00f72c (0x77b9 bytes) 000459 1789449433.481224 trunc from 0x00f564 to 0x012f42 (0x39df bytes) 000460 1789449433.489173 trunc from 0x019f3d to 0x01b20c (0x12d0 bytes) 000461 1789449433.523308 mapwrite 0x02e3e9 thru 0x03b274 (0xce8c bytes) 000462 1789449433.719013 mapread 0x0065de thru 0x01119c (0xabbf bytes) 000463 1789449433.744188 mapwrite 0x02d56c thru 0x03b65b (0xe0f0 bytes) 000465 1789449433.872689 trunc from 0x022937 to 0x02b6c3 (0x8d8d bytes) 000466 1789449433.882861 mapwrite 0x02a303 thru 0x033429 (0x9127 bytes) 000467 1789449433.918478 punch from 0x01e695 to 0x023f19 (0x5885 bytes) 000469 1789449433.937731 MIRROR_RESYNC 7 mirrors 000470 1789449436.499494 read 0x026c14 thru 0x0299f4 (0x2de1 bytes) 000471 1789449436.507096 read 0x01defe thru 0x02425f (0x6362 bytes) 000472 1789449436.519401 mapread 0x02874a thru 0x03233e (0x9bf5 bytes) 000473 1789449436.524695 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) 000474 1789449437.085038 punch from 0x0211e9 to 0x02b959 (0xa771 bytes) 000476 1789449437.142180 mapread 0x02277c thru 0x030239 (0xdabe bytes) 000477 1789449437.200742 write 0x025579 thru 0x0321c5 (0xcc4d bytes) 000478 1789449437.215331 punch from 0x039608 to 0x03b65b (0x2054 bytes) 000479 1789449437.225676 write 0x02d467 thru 0x037b8f (0xa729 bytes) 000480 1789449437.235832 fallocate 0x02da48 thru 0x02f063 (0x161c bytes) 000481 1789449437.242517 read 0x004687 thru 0x00ef2c (0xa8a6 bytes) 000483 1789449437.261746 punch from 0x01d4be to 0x01e3a3 (0xee6 bytes) 000484 1789449437.268640 trunc from 0x03b65c to 0x013a53 (0x27c08 bytes) 000485 1789449437.304817 MIRROR_RESYNC 6 mirrors 000486 1789449438.629527 fallocate 0x00414e thru 0x007d49 (0x3bfc bytes) 000487 1789449438.732921 read 0x00118d thru 0x00fbeb (0xea5f bytes) 000488 1789449438.748020 write 0x015f9f thru 0x01c35c (0x63be bytes) 000489 1789449438.749462 mapread 0x008010 thru 0x0152fe (0xd2ef bytes) 000490 1789449438.794770 read 0x0071c5 thru 0x00f0e9 (0x7f25 bytes) 000491 1789449438.795401 mapwrite 0x01439f thru 0x01fe0d (0xba6f bytes) 000492 1789449438.904383 write 0x01b366 thru 0x020428 (0x50c3 bytes) 000493 1789449438.905722 mapwrite 0x01f611 thru 0x025a71 (0x6461 bytes) 000494 1789449438.992850 mapwrite 0x0390c9 thru 0x03ffff (0x6f37 bytes) 000495 1789449439.080855 MIRROR_RESYNC 6 mirrors 000496 1789449441.149127 read 0x0322f7 thru 0x03ffff (0xdd09 bytes) 000497 1789449441.160028 mapread 0x0387f6 thru 0x03a459 (0x1c64 bytes) 000498 1789449441.164269 MIRROR_EXTEND to 7 mirrors 000499 1789449442.234626 read 0x01de3d thru 0x02b078 (0xd23c bytes) 000500 1789449442.258956 MIRROR_EXTEND to 8 mirrors 000501 1789449443.509734 mapwrite 0x024491 thru 0x03435b (0xfecb bytes) 000502 1789449443.693076 read 0x019bad thru 0x01ad5d (0x11b1 bytes) 000503 1789449443.727874 trunc from 0x040000 to 0x02bce1 (0x1431e bytes) 000504 1789449443.787441 write 0x02f7cf thru 0x03d81a (0xe04c bytes) 000505 1789449443.797399 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 5: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 5: 0xf8dc36fe (stale) Mirror 12: 0xf8dc36fe (stale) Mirror 13: 0xf8dc36fe (stale) Mirror 14: 0xf8dc36fe (stale) Mirror 15: 0xf8dc36fe (stale) Mirror 16: 0xf8dc36fe (stale) Mirror 17: 0xf8dc36fe (stale) CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 1: 0x4877ddb4 Mirror 18: 0x4877ddb4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d81b: skipped 000506 1789449445.207634 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 5: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 5: 0xf8dc36fe (stale) Mirror 12: 0xf8dc36fe (stale) Mirror 13: 0xf8dc36fe (stale) Mirror 14: 0xf8dc36fe (stale) Mirror 15: 0xf8dc36fe (stale) Mirror 16: 0xf8dc36fe (stale) Mirror 17: 0xf8dc36fe (stale) CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 1: 0x4877ddb4 Mirror 18: 0x4877ddb4 Mirror 19: 0x4877ddb4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d81b: skipped 000507 1789449446.490069 MIRROR_RESYNC 10 mirrors 000509 1789449448.846493 write 0x02c31e thru 0x035d18 (0x99fb bytes) 000510 1789449448.905459 mapwrite 0x010a10 thru 0x011212 (0x803 bytes) 000511 1789449448.952114 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 5: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 5: 0x4877ddb4 (stale) Mirror 12: 0x4877ddb4 (stale) Mirror 13: 0x4877ddb4 (stale) Mirror 14: 0x4877ddb4 (stale) Mirror 15: 0x4877ddb4 (stale) Mirror 16: 0x4877ddb4 (stale) Mirror 17: 0x4877ddb4 (stale) Mirror 18: 0x4877ddb4 (stale) Mirror 19: 0x4877ddb4 (stale) CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 1: 0x4c5c6236 Mirror 20: 0x4c5c6236 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d81b: skipped 000512 1789449450.358017 punch from 0x02d484 to 0x0316c0 (0x423d bytes) 000513 1789449450.428452 read 0x033304 thru 0x0373f9 (0x40f6 bytes) 000514 1789449450.449948 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 5: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 5: 0x4877ddb4 (stale) Mirror 12: 0x4877ddb4 (stale) Mirror 13: 0x4877ddb4 (stale) Mirror 14: 0x4877ddb4 (stale) Mirror 15: 0x4877ddb4 (stale) Mirror 16: 0x4877ddb4 (stale) Mirror 17: 0x4877ddb4 (stale) Mirror 18: 0x4877ddb4 (stale) Mirror 19: 0x4877ddb4 (stale) Mirror 20: 0x4c5c6236 (stale) CRC-32 checksum value for chunk [0, 0x3d81b): Mirror 1: 0xe7f02265 Mirror 21: 0xe7f02265 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d81b: skipped 000515 1789449452.224731 write 0x00cf2f thru 0x01bfec (0xf0be bytes) 000516 1789449452.310500 write 0x036929 thru 0x03f70d (0x8de5 bytes) 000517 1789449452.325791 trunc from 0x03f70e to 0x01ba58 (0x23cb5 bytes) 000518 1789449452.366887 punch from 0x007e97 to 0x01760e (0xf778 bytes) 000519 1789449452.393276 write 0x0109de thru 0x01e6cc (0xdcef bytes) 000520 1789449452.408411 fallocate 0x02acfd thru 0x02e738 (0x3a3c bytes) 000521 1789449452.438645 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1e6cd): Mirror 5: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e6cd): Mirror 5: 0xce2f0267 (stale) Mirror 12: 0xce2f0267 (stale) Mirror 13: 0xce2f0267 (stale) Mirror 14: 0xce2f0267 (stale) Mirror 15: 0xce2f0267 (stale) Mirror 16: 0xce2f0267 (stale) Mirror 17: 0xce2f0267 (stale) Mirror 18: 0xce2f0267 (stale) Mirror 19: 0xce2f0267 (stale) Mirror 20: 0x25805db7 (stale) Mirror 21: 0x25805db7 (stale) CRC-32 checksum value for chunk [0, 0x1e6cd): Mirror 1: 0x7dac50a8 Mirror 22: 0x7dac50a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e6cd: skipped 000522 1789449453.932769 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1e6cd): Mirror 5: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e6cd): Mirror 5: 0xce2f0267 (stale) Mirror 12: 0xce2f0267 (stale) Mirror 13: 0xce2f0267 (stale) Mirror 14: 0xce2f0267 (stale) Mirror 15: 0xce2f0267 (stale) Mirror 16: 0xce2f0267 (stale) Mirror 17: 0xce2f0267 (stale) Mirror 18: 0xce2f0267 (stale) Mirror 19: 0xce2f0267 (stale) Mirror 20: 0x25805db7 (stale) Mirror 21: 0x25805db7 (stale) CRC-32 checksum value for chunk [0, 0x1e6cd): Mirror 1: 0x7dac50a8 Mirror 22: 0x7dac50a8 Mirror 23: 0x7dac50a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e6cd: skipped 000523 1789449455.474488 trunc from 0x0171ac to 0x01a047 (0x2e9c bytes) 000524 1789449455.527646 write 0x039b35 thru 0x03ffff (0x64cb bytes) 000525 1789449455.552322 read 0x028c48 thru 0x033818 (0xabd1 bytes) 000526 1789449455.575485 read 0x03616f thru 0x037829 (0x16bb bytes) 000527 1789449455.596023 fallocate 0x00c50e thru 0x0152c3 (0x8db6 bytes) 000529 1789449455.603279 mapwrite 0x00f7c4 thru 0x013295 (0x3ad2 bytes) 000530 1789449455.648917 trunc from 0x040000 to 0x03c392 (0x3c6d bytes) 000531 1789449455.687970 mapread 0x02fed9 thru 0x03c392 (0xc4ba bytes) 000532 1789449455.694671 write 0x00c0ab thru 0x014fa6 (0x8efc bytes) 000534 1789449455.697740 trunc from 0x03c393 to 0x038cf4 (0x369e bytes) 000535 1789449455.744563 MIRROR_SPLIT mirror 2 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38cf5): Mirror 5: 0x61839699 (stale) Mirror 13: 0x61839699 (stale) Mirror 14: 0x61839699 (stale) Mirror 15: 0x61839699 (stale) Mirror 16: 0x61839699 (stale) Mirror 17: 0x61839699 (stale) Mirror 18: 0x61839699 (stale) Mirror 19: 0x61839699 (stale) Mirror 20: 0x84362f73 (stale) Mirror 21: 0x3092a4b8 (stale) Mirror 22: 0x8b4f24d4 (stale) Mirror 23: 0x8b4f24d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cf5): Mirror 5: 0x61839699 (stale) Mirror 13: 0x61839699 (stale) Mirror 14: 0x61839699 (stale) Mirror 15: 0x61839699 (stale) Mirror 16: 0x61839699 (stale) Mirror 17: 0x61839699 (stale) Mirror 18: 0x61839699 (stale) Mirror 19: 0x61839699 (stale) Mirror 20: 0x84362f73 (stale) Mirror 21: 0x3092a4b8 (stale) Mirror 22: 0x8b4f24d4 (stale) Mirror 23: 0x8b4f24d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cf5: skipped 000536 1789449456.924172 trunc from 0x038cf5 to 0x0049a7 (0x3434d bytes) 000537 1789449456.953196 trunc from 0x0003b1 to 0x001e01 (0x1a51 bytes) 000538 1789449456.959187 trunc from 0x0033ce to 0x0049a7 (0x15da bytes) 000539 1789449456.965062 trunc from 0x003390 to 0x0049a7 (0x1618 bytes) 000540 1789449456.971070 trunc from 0x0049a8 to 0x00d1b9 (0x8812 bytes) 000542 1789449456.988434 trunc from 0x000f8e to 0x009762 (0x87d5 bytes) 000543 1789449456.995122 trunc from 0x00315f to 0x004d1c (0x1bbe bytes) 000544 1789449457.000437 fallocate 0x02e9f6 thru 0x03209a (0x36a5 bytes) 000545 1789449457.006270 read 0x0259d9 thru 0x02a140 (0x4768 bytes) 000546 1789449457.021006 punch from 0x012598 to 0x02047c (0xdee5 bytes) 000547 1789449457.043748 trunc from 0x03209b to 0x01fb28 (0x12572 bytes) 000548 1789449457.083842 mapwrite 0x029a0e thru 0x03270d (0x8d00 bytes) 000549 1789449457.220440 fallocate 0x022de6 thru 0x02d755 (0xa970 bytes) 000550 1789449457.233086 trunc from 0x014458 to 0x02205f (0xdc08 bytes) 000551 1789449457.247432 punch from 0x02a591 to 0x03270d (0x817d bytes) 000552 1789449457.268153 trunc from 0x010209 to 0x01d250 (0xd048 bytes) 000553 1789449457.292413 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3270e): Mirror 5: 0x3c4c0063 (stale) Mirror 13: 0x3c4c0063 (stale) Mirror 15: 0x3c4c0063 (stale) Mirror 16: 0x3c4c0063 (stale) Mirror 17: 0x3c4c0063 (stale) Mirror 18: 0x3c4c0063 (stale) Mirror 19: 0x3c4c0063 (stale) Mirror 20: 0xaf9dac75 (stale) Mirror 21: 0xc2f7ca34 (stale) Mirror 22: 0x40edfecc (stale) Mirror 23: 0x40edfecc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3270e): Mirror 5: 0x3c4c0063 (stale) Mirror 13: 0x3c4c0063 (stale) Mirror 15: 0x3c4c0063 (stale) Mirror 16: 0x3c4c0063 (stale) Mirror 17: 0x3c4c0063 (stale) Mirror 18: 0x3c4c0063 (stale) Mirror 19: 0x3c4c0063 (stale) Mirror 20: 0xaf9dac75 (stale) Mirror 21: 0xc2f7ca34 (stale) Mirror 22: 0x40edfecc (stale) Mirror 23: 0x40edfecc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3270e: skipped 000554 1789449458.587825 read 0x018ed8 thru 0x020a77 (0x7ba0 bytes) 000555 1789449458.599178 write 0x018eaa thru 0x023be8 (0xad3f bytes) 000556 1789449458.609436 trunc from 0x03270e to 0x02578d (0xcf80 bytes) 000557 1789449458.638655 trunc from 0x02578e to 0x033035 (0xd8a8 bytes) 000558 1789449458.669997 mapread 0x01f376 thru 0x02751a (0x81a5 bytes) 000560 1789449458.729066 mapread 0x0279c6 thru 0x02d988 (0x5fc3 bytes) 000561 1789449458.731181 fallocate 0x034e88 thru 0x036b81 (0x1cfa bytes) 000562 1789449458.745038 mapread 0x010222 thru 0x013336 (0x3115 bytes) 000563 1789449458.756494 mapwrite 0x0217ff thru 0x025aef (0x42f1 bytes) 000565 1789449458.779739 mapread 0x005547 thru 0x0110b6 (0xbb70 bytes) 000566 1789449458.790392 mapread 0x036a79 thru 0x036b81 (0x109 bytes) 000567 1789449458.800971 trunc from 0x0049b0 to 0x00e64a (0x9c9b bytes) 000568 1789449458.805990 trunc from 0x00a57f to 0x013522 (0x8fa4 bytes) 000569 1789449458.815273 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x36b82): Mirror 5: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b82): Mirror 5: 0xd581f263 (stale) Mirror 13: 0xd581f263 (stale) Mirror 15: 0xd581f263 (stale) Mirror 16: 0xd581f263 (stale) Mirror 17: 0xd581f263 (stale) Mirror 18: 0xd581f263 (stale) Mirror 19: 0xd581f263 (stale) Mirror 20: 0x3e1d6f20 (stale) Mirror 21: 0x5b83cb4b (stale) Mirror 22: 0x7fb4f2f7 (stale) Mirror 23: 0x7fb4f2f7 (stale) CRC-32 checksum value for chunk [0, 0x36b82): Mirror 1: 0x3f587e8a Mirror 24: 0x3f587e8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b82: skipped 000570 1789449460.259903 trunc from 0x0102d4 to 0x013086 (0x2db3 bytes) 000571 1789449460.349247 mapread 0x00d7c1 thru 0x014b45 (0x7385 bytes) 000572 1789449460.374158 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x36b82): Mirror 5: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b82): Mirror 5: 0xd581f263 (stale) Mirror 13: 0xd581f263 (stale) Mirror 15: 0xd581f263 (stale) Mirror 16: 0xd581f263 (stale) Mirror 17: 0xd581f263 (stale) Mirror 18: 0xd581f263 (stale) Mirror 19: 0xd581f263 (stale) Mirror 20: 0x3e1d6f20 (stale) Mirror 21: 0x5b83cb4b (stale) Mirror 22: 0x7fb4f2f7 (stale) Mirror 23: 0x7fb4f2f7 (stale) Mirror 24: 0x3f587e8a (stale) CRC-32 checksum value for chunk [0, 0x36b82): Mirror 1: 0x3f587e8a Mirror 25: 0x3f587e8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b82: skipped 000573 1789449462.036873 trunc from 0x036b82 to 0x0115ac (0x255d5 bytes) 000574 1789449462.113015 fallocate 0x016861 thru 0x022e7b (0xc61b bytes) 000575 1789449462.119667 trunc from 0x00b843 to 0x0115ac (0x5d6a bytes) 000576 1789449462.125983 trunc from 0x0115ad to 0x006fff (0xa5ad bytes) 000577 1789449462.166025 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7000): Mirror 5: 0x93ef74f6 (stale) Mirror 13: 0x93ef74f6 (stale) Mirror 16: 0x93ef74f6 (stale) Mirror 17: 0x93ef74f6 (stale) Mirror 18: 0x93ef74f6 (stale) Mirror 19: 0x93ef74f6 (stale) Mirror 20: 0x93ef74f6 (stale) Mirror 21: 0x93ef74f6 (stale) Mirror 22: 0x93ef74f6 (stale) Mirror 23: 0x93ef74f6 (stale) Mirror 24: 0x1e722ee1 (stale) Mirror 25: 0x1e722ee1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7000): Mirror 5: 0x93ef74f6 (stale) Mirror 13: 0x93ef74f6 (stale) Mirror 16: 0x93ef74f6 (stale) Mirror 17: 0x93ef74f6 (stale) Mirror 18: 0x93ef74f6 (stale) Mirror 19: 0x93ef74f6 (stale) Mirror 20: 0x93ef74f6 (stale) Mirror 21: 0x93ef74f6 (stale) Mirror 22: 0x93ef74f6 (stale) Mirror 23: 0x93ef74f6 (stale) Mirror 24: 0x1e722ee1 (stale) Mirror 25: 0x1e722ee1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7000: skipped 000578 1789449463.002444 fallocate 0x02d723 thru 0x0397d9 (0xc0b7 bytes) 000579 1789449463.014105 trunc from 0x0065de to 0x006fff (0xa22 bytes) 000580 1789449463.021312 write 0x033061 thru 0x03931e (0x62be bytes) 000581 1789449463.027769 read 0x01cb98 thru 0x022ba8 (0x6011 bytes) 000582 1789449463.037714 mapwrite 0x011304 thru 0x01e981 (0xd67e bytes) 000583 1789449463.129577 trunc from 0x03931f to 0x035aef (0x382f bytes) 000585 1789449463.160190 mapwrite 0x03fe5c thru 0x03ffff (0x1a4 bytes) 000586 1789449463.253048 punch from 0x00d9ef to 0x011e97 (0x44a9 bytes) 000587 1789449463.263136 trunc from 0x040000 to 0x037b82 (0x847d bytes) 000588 1789449463.295778 trunc from 0x037b83 to 0x03f3ed (0x786b bytes) 000589 1789449463.318214 read 0x02ecd5 thru 0x03d64c (0xe978 bytes) 000590 1789449463.333669 read 0x0203c6 thru 0x024a24 (0x465f bytes) 000591 1789449463.334632 fallocate 0x02c8e6 thru 0x03b2b7 (0xe9d2 bytes) 000592 1789449463.340403 read 0x02c0ef thru 0x0370c8 (0xafda bytes) 000594 1789449463.342532 punch from 0x00b854 to 0x017350 (0xbafd bytes) 000595 1789449463.349222 read 0x0327b0 thru 0x038c50 (0x64a1 bytes) 000596 1789449463.351466 punch from 0x01dac7 to 0x01e6bd (0xbf7 bytes) 000597 1789449463.356902 mapread 0x00668f thru 0x009034 (0x29a6 bytes) 000598 1789449463.359918 mapwrite 0x019db0 thru 0x028d8d (0xefde bytes) 000599 1789449463.400570 mapwrite 0x025b30 thru 0x02d3df (0x78b0 bytes) 000600 1789449463.423321 write 0x00a86c thru 0x00ed67 (0x44fc bytes) 000601 1789449463.424446 punch from 0x006a2c to 0x00ab4b (0x4120 bytes) 000602 1789449463.441893 read 0x004633 thru 0x007d5a (0x3728 bytes) 000603 1789449463.451941 fallocate 0x022774 thru 0x025d4e (0x35db bytes) 000604 1789449463.457321 mapwrite 0x011c49 thru 0x01a1f9 (0x85b1 bytes) 000605 1789449463.478118 write 0x005ab5 thru 0x00b51b (0x5a67 bytes) 000606 1789449463.485839 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f3ee): Mirror 5: 0x79d9c86b (stale) Mirror 13: 0x79d9c86b (stale) Mirror 16: 0x79d9c86b (stale) Mirror 17: 0x79d9c86b (stale) Mirror 19: 0x79d9c86b (stale) Mirror 20: 0x6112439e (stale) Mirror 21: 0xbbbe3c6 (stale) Mirror 22: 0xa9552c03 (stale) Mirror 23: 0xa9552c03 (stale) Mirror 24: 0xa1868660 (stale) Mirror 25: 0xa1868660 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f3ee): Mirror 5: 0x79d9c86b (stale) Mirror 13: 0x79d9c86b (stale) Mirror 16: 0x79d9c86b (stale) Mirror 17: 0x79d9c86b (stale) Mirror 19: 0x79d9c86b (stale) Mirror 20: 0x6112439e (stale) Mirror 21: 0xbbbe3c6 (stale) Mirror 22: 0xa9552c03 (stale) Mirror 23: 0xa9552c03 (stale) Mirror 24: 0xa1868660 (stale) Mirror 25: 0xa1868660 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f3ee: skipped 000607 1789449464.406023 mapread 0x01eaa4 thru 0x01ff6e (0x14cb bytes) 000608 1789449464.432294 read 0x019f60 thru 0x0262d5 (0xc376 bytes) 000609 1789449464.445127 fallocate 0x029710 thru 0x02a9d3 (0x12c4 bytes) 000610 1789449464.450872 trunc from 0x020846 to 0x02ebd9 (0xe394 bytes) 000612 1789449464.460299 fallocate 0x017172 thru 0x01fb4e (0x89dd bytes) 000613 1789449464.467006 mapread 0x01af21 thru 0x01d75b (0x283b bytes) 000614 1789449464.468001 read 0x010ee8 thru 0x013b4d (0x2c66 bytes) 000615 1789449464.484958 mapwrite 0x0231f4 thru 0x032299 (0xf0a6 bytes) 000616 1789449464.513606 write 0x0297fd thru 0x036069 (0xc86d bytes) 000617 1789449464.522762 trunc from 0x03f3ee to 0x00c2ef (0x330fe bytes) 000618 1789449464.546512 punch from 0x009728 to 0x00c2ef (0x2bc8 bytes) 000619 1789449464.554547 mapwrite 0x0112ec thru 0x01b7d5 (0xa4ea bytes) 000620 1789449464.729955 MIRROR_RESYNC 12 mirrors 000621 1789449468.600956 MIRROR_EXTEND to 13 mirrors 000622 1789449469.673478 punch from 0x003c8e to 0x013009 (0xf37c bytes) 000623 1789449469.733750 trunc from 0x01b7d6 to 0x0239f7 (0x8222 bytes) 000624 1789449469.762709 trunc from 0x00625e to 0x01147b (0xb21e bytes) 000625 1789449469.772245 trunc from 0x00d23f to 0x019206 (0xbfc8 bytes) 000626 1789449469.782695 trunc from 0x01178a to 0x01e0aa (0xc921 bytes) 000627 1789449469.790781 mapread 0x008e38 thru 0x00cb18 (0x3ce1 bytes) 000629 1789449469.820601 mapwrite 0x03c9bf thru 0x03e03c (0x167e bytes) 000630 1789449469.876487 trunc from 0x03e03d to 0x01ea09 (0x1f633 bytes) 000631 1789449469.892260 write 0x022901 thru 0x0291b6 (0x68b6 bytes) 000632 1789449469.896243 mapread 0x021469 thru 0x0291b6 (0x7d4e bytes) 000633 1789449469.913000 write 0x019524 thru 0x025a44 (0xc521 bytes) 000634 1789449469.920522 trunc from 0x0291b7 to 0x01f5b4 (0x9c02 bytes) 000635 1789449469.946491 mapwrite 0x01dbda thru 0x021ad5 (0x3efc bytes) 000636 1789449470.001078 MIRROR_RESYNC 13 mirrors 000637 1789449472.256321 trunc from 0x021ad6 to 0x02cbe7 (0xb112 bytes) 000638 1789449472.343662 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cbe8): Mirror 5: 0x7b065d9e (stale) Mirror 13: 0x7b065d9e (stale) Mirror 16: 0x7b065d9e (stale) Mirror 19: 0x7b065d9e (stale) Mirror 20: 0x7b065d9e (stale) Mirror 21: 0x7b065d9e (stale) Mirror 22: 0x7b065d9e (stale) Mirror 23: 0x7b065d9e (stale) Mirror 24: 0x7b065d9e (stale) Mirror 25: 0x7b065d9e (stale) Mirror 26: 0x7b065d9e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cbe8): Mirror 5: 0x7b065d9e (stale) Mirror 13: 0x7b065d9e (stale) Mirror 16: 0x7b065d9e (stale) Mirror 19: 0x7b065d9e (stale) Mirror 20: 0x7b065d9e (stale) Mirror 21: 0x7b065d9e (stale) Mirror 22: 0x7b065d9e (stale) Mirror 23: 0x7b065d9e (stale) Mirror 24: 0x7b065d9e (stale) Mirror 25: 0x7b065d9e (stale) Mirror 26: 0x7b065d9e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cbe8: skipped 000639 1789449473.151524 punch from 0x012ca3 to 0x01650f (0x386d bytes) 000640 1789449473.159637 punch from 0x013b75 to 0x022d28 (0xf1b4 bytes) 000642 1789449473.168960 read 0x01f6a0 thru 0x024ca0 (0x5601 bytes) 000643 1789449473.192750 fallocate 0x02a260 thru 0x037411 (0xd1b2 bytes) 000644 1789449473.199487 write 0x0171ab thru 0x024d68 (0xdbbe bytes) 000645 1789449473.216131 trunc from 0x0246f3 to 0x025ff2 (0x1900 bytes) 000646 1789449473.237498 trunc from 0x033f56 to 0x037411 (0x34bc bytes) 000647 1789449473.243873 read 0x0171d3 thru 0x025b38 (0xe966 bytes) 000648 1789449473.264461 read 0x008957 thru 0x01578c (0xce36 bytes) 000649 1789449473.271298 MIRROR_RESYNC 12 mirrors 000650 1789449476.546904 punch from 0x0324a8 to 0x037411 (0x4f6a bytes) 000651 1789449476.595816 fallocate 0x0340d1 thru 0x03ffff (0xbf2f bytes) 000652 1789449476.603524 write 0x022570 thru 0x02f7e1 (0xd272 bytes) 000653 1789449476.622672 trunc from 0x0310ef to 0x0386f6 (0x7608 bytes) 000654 1789449476.635693 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d3ee87 (stale) Mirror 13: 0x89d3ee87 (stale) Mirror 16: 0x89d3ee87 (stale) Mirror 19: 0x89d3ee87 (stale) Mirror 20: 0x89d3ee87 (stale) Mirror 21: 0x89d3ee87 (stale) Mirror 22: 0x89d3ee87 (stale) Mirror 23: 0x89d3ee87 (stale) Mirror 24: 0x89d3ee87 (stale) Mirror 25: 0x89d3ee87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d3ee87 (stale) Mirror 13: 0x89d3ee87 (stale) Mirror 16: 0x89d3ee87 (stale) Mirror 19: 0x89d3ee87 (stale) Mirror 20: 0x89d3ee87 (stale) Mirror 21: 0x89d3ee87 (stale) Mirror 22: 0x89d3ee87 (stale) Mirror 23: 0x89d3ee87 (stale) Mirror 24: 0x89d3ee87 (stale) Mirror 25: 0x89d3ee87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000655 1789449477.355131 punch from 0x020a32 to 0x0233bf (0x298e bytes) 000657 1789449477.382324 punch from 0x011b76 to 0x015cec (0x4177 bytes) 000658 1789449477.411843 trunc from 0x040000 to 0x021412 (0x1ebed bytes) 000659 1789449477.477260 mapwrite 0x03e16a thru 0x03ffff (0x1e96 bytes) 000660 1789449477.546299 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d3ee87 (stale) Mirror 13: 0x89d3ee87 (stale) Mirror 16: 0x89d3ee87 (stale) Mirror 19: 0x89d3ee87 (stale) Mirror 20: 0x89d3ee87 (stale) Mirror 21: 0x89d3ee87 (stale) Mirror 22: 0x89d3ee87 (stale) Mirror 23: 0x89d3ee87 (stale) Mirror 24: 0x89d3ee87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89d3ee87 (stale) Mirror 13: 0x89d3ee87 (stale) Mirror 16: 0x89d3ee87 (stale) Mirror 19: 0x89d3ee87 (stale) Mirror 20: 0x89d3ee87 (stale) Mirror 21: 0x89d3ee87 (stale) Mirror 22: 0x89d3ee87 (stale) Mirror 23: 0x89d3ee87 (stale) Mirror 24: 0x89d3ee87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000661 1789449478.288066 mapwrite 0x01d007 thru 0x02af76 (0xdf70 bytes) 000662 1789449478.351296 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x89d3ee87 (stale) Mirror 16: 0x89d3ee87 (stale) Mirror 19: 0x89d3ee87 (stale) Mirror 20: 0x89d3ee87 (stale) Mirror 21: 0x89d3ee87 (stale) Mirror 22: 0x89d3ee87 (stale) Mirror 23: 0x89d3ee87 (stale) Mirror 24: 0x89d3ee87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x89d3ee87 (stale) Mirror 16: 0x89d3ee87 (stale) Mirror 19: 0x89d3ee87 (stale) Mirror 20: 0x89d3ee87 (stale) Mirror 21: 0x89d3ee87 (stale) Mirror 22: 0x89d3ee87 (stale) Mirror 23: 0x89d3ee87 (stale) Mirror 24: 0x89d3ee87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000663 1789449479.074728 MIRROR_RESYNC 9 mirrors 000664 1789449481.419851 read 0x02ccfc thru 0x031e38 (0x513d bytes) 000665 1789449481.440940 trunc from 0x02ccb5 to 0x0365dc (0x9928 bytes) 000666 1789449481.503986 fallocate 0x002f12 thru 0x00e383 (0xb472 bytes) 000667 1789449481.523991 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4450baf3 (stale) Mirror 16: 0x4450baf3 (stale) Mirror 19: 0x4450baf3 (stale) Mirror 20: 0x4450baf3 (stale) Mirror 21: 0x4450baf3 (stale) Mirror 22: 0x4450baf3 (stale) Mirror 24: 0x4450baf3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4450baf3 (stale) Mirror 16: 0x4450baf3 (stale) Mirror 19: 0x4450baf3 (stale) Mirror 20: 0x4450baf3 (stale) Mirror 21: 0x4450baf3 (stale) Mirror 22: 0x4450baf3 (stale) Mirror 24: 0x4450baf3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000668 1789449482.218988 mapwrite 0x02c001 thru 0x039285 (0xd285 bytes) 000669 1789449482.280499 mapread 0x025cbe thru 0x027c79 (0x1fbc bytes) 000670 1789449482.290799 punch from 0x015504 to 0x01ad64 (0x5861 bytes) 000671 1789449482.295480 fallocate 0x000ec8 thru 0x006ead (0x5fe6 bytes) 000672 1789449482.301611 write 0x0193a6 thru 0x02211e (0x8d79 bytes) 000675 1789449482.319469 MIRROR_RESYNC 8 mirrors 000676 1789449485.537146 trunc from 0x040000 to 0x02d9ec (0x12613 bytes) 000677 1789449485.612905 trunc from 0x00f050 to 0x014236 (0x51e7 bytes) 000679 1789449485.623490 read 0x00bf63 thru 0x017959 (0xb9f7 bytes) 000680 1789449485.647864 mapread 0x009167 thru 0x010847 (0x76e1 bytes) 000681 1789449485.662912 punch from 0x0278e1 to 0x02d9ec (0x610c bytes) 000683 1789449485.670098 fallocate 0x00f3a6 thru 0x016a0a (0x7665 bytes) 000684 1789449485.684465 fallocate 0x00a512 thru 0x01081d (0x630c bytes) 000685 1789449485.698915 mapwrite 0x004f58 thru 0x0144c3 (0xf56c bytes) 000686 1789449485.758901 trunc from 0x017071 to 0x01997f (0x290f bytes) 000687 1789449485.774688 read 0x00d1bb thru 0x01d060 (0xfea6 bytes) 000688 1789449485.821468 write 0x023012 thru 0x02c9d1 (0x99c0 bytes) 000689 1789449485.831137 trunc from 0x02d9ed to 0x01a69c (0x13350 bytes) 000690 1789449485.880478 read 0x00e182 thru 0x01a69c (0xc51b bytes) 000691 1789449485.883027 fallocate 0x0089ba thru 0x00a322 (0x1969 bytes) 000692 1789449485.889957 fallocate 0x00373d thru 0x0132cc (0xfb90 bytes) 000693 1789449485.908691 MIRROR_RESYNC 8 mirrors 000694 1789449488.184074 fallocate 0x02098d thru 0x02fb1e (0xf192 bytes) 000695 1789449488.237882 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2fb1f): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fb1f): Mirror 13: 0xdf055f2b (stale) Mirror 16: 0xdf055f2b (stale) Mirror 19: 0xdf055f2b (stale) Mirror 20: 0xdf055f2b (stale) Mirror 21: 0xdf055f2b (stale) Mirror 22: 0xdf055f2b (stale) Mirror 24: 0xdf055f2b (stale) CRC-32 checksum value for chunk [0, 0x2fb1f): Mirror 1: 0xdf055f2b Mirror 25: 0xdf055f2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fb1f: skipped 000696 1789449489.474427 trunc from 0x02fb1f to 0x03e71f (0xec01 bytes) 000698 1789449489.532022 trunc from 0x02e130 to 0x02ed7d (0xc4e bytes) 000699 1789449489.536808 mapwrite 0x001598 thru 0x00fba5 (0xe60e bytes) 000700 1789449489.591259 trunc from 0x03e720 to 0x00ba29 (0x32cf6 bytes) 000701 1789449489.709842 MIRROR_RESYNC 9 mirrors 000702 1789449491.205847 write 0x0276fc thru 0x02d0ed (0x59f2 bytes) 000703 1789449491.271939 trunc from 0x02d0ee to 0x011f7b (0x1b172 bytes) 000704 1789449491.305243 mapwrite 0x0226fb thru 0x03040b (0xdd11 bytes) 000705 1789449491.454583 mapwrite 0x0306a4 thru 0x03c88d (0xc1ea bytes) 000707 1789449491.539092 punch from 0x01da2d to 0x02a9dd (0xcfb1 bytes) 000708 1789449491.547173 mapwrite 0x017fc8 thru 0x01e9d3 (0x6a0c bytes) 000709 1789449491.586702 punch from 0x020e5a to 0x029646 (0x87ed bytes) 000710 1789449491.608987 write 0x0157cc thru 0x01fce2 (0xa517 bytes) 000711 1789449491.620787 write 0x004dec thru 0x005adf (0xcf4 bytes) 000712 1789449491.657946 read 0x02cfc5 thru 0x03bc56 (0xec92 bytes) 000713 1789449491.659648 trunc from 0x03c88e to 0x0064c4 (0x363c9 bytes) 000714 1789449491.688516 mapwrite 0x03d3f6 thru 0x03ffff (0x2c0a bytes) 000715 1789449491.779005 mapwrite 0x03cf52 thru 0x03cfcc (0x7b bytes) 000716 1789449491.803643 punch from 0x023b62 to 0x033a21 (0xfec0 bytes) 000717 1789449491.816262 write 0x028b84 thru 0x02ba33 (0x2eb0 bytes) 000719 1789449491.838582 punch from 0x02b567 to 0x02c29f (0xd39 bytes) 000720 1789449491.855927 fallocate 0x026dbb thru 0x027e28 (0x106e bytes) 000721 1789449491.868220 read 0x02568d thru 0x0321f6 (0xcb6a bytes) 000722 1789449491.893671 write 0x03ee7e thru 0x03ffff (0x1182 bytes) 000723 1789449491.894892 mapread 0x021ee4 thru 0x02c68a (0xa7a7 bytes) 000724 1789449491.897099 fallocate 0x01127e thru 0x011b30 (0x8b3 bytes) 000725 1789449491.905243 trunc from 0x02cf67 to 0x02d1b7 (0x251 bytes) 000726 1789449491.915314 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x35accb (stale) Mirror 16: 0x35accb (stale) Mirror 19: 0x35accb (stale) Mirror 20: 0x35accb (stale) Mirror 21: 0x35accb (stale) Mirror 22: 0x35accb (stale) Mirror 24: 0x35accb (stale) Mirror 25: 0x35accb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x91b5fa54 Mirror 26: 0x91b5fa54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000727 1789449493.418171 read 0x02b1d3 thru 0x03ad13 (0xfb41 bytes) 000728 1789449493.435277 mapread 0x0192aa thru 0x022a38 (0x978f bytes) 000729 1789449493.492156 read 0x00c829 thru 0x01a7cc (0xdfa4 bytes) 000730 1789449493.517250 punch from 0x036549 to 0x03ffff (0x9ab7 bytes) 000731 1789449493.573074 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x35accb (stale) Mirror 16: 0x35accb (stale) Mirror 19: 0x35accb (stale) Mirror 20: 0x35accb (stale) Mirror 21: 0x35accb (stale) Mirror 22: 0x35accb (stale) Mirror 24: 0x35accb (stale) Mirror 26: 0x91b5fa54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x35accb (stale) Mirror 16: 0x35accb (stale) Mirror 19: 0x35accb (stale) Mirror 20: 0x35accb (stale) Mirror 21: 0x35accb (stale) Mirror 22: 0x35accb (stale) Mirror 24: 0x35accb (stale) Mirror 26: 0x91b5fa54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000732 1789449494.283273 trunc from 0x01a362 to 0x027fdb (0xdc7a bytes) 000733 1789449494.297520 trunc from 0x01f1bb to 0x02479f (0x55e5 bytes) 000734 1789449494.308462 write 0x03b841 thru 0x03ffff (0x47bf bytes) 000735 1789449494.326266 fallocate 0x00baa5 thru 0x019ea3 (0xe3ff bytes) 000736 1789449494.348548 mapread 0x005703 thru 0x01282e (0xd12c bytes) 000737 1789449494.403410 mapread 0x0060a8 thru 0x00d388 (0x72e1 bytes) 000738 1789449494.404700 fallocate 0x01b017 thru 0x0224e2 (0x74cc bytes) 000739 1789449494.415308 mapwrite 0x00f6c2 thru 0x01a1c8 (0xab07 bytes) 000741 1789449494.469080 trunc from 0x01c331 to 0x02116e (0x4e3e bytes) 000742 1789449494.479164 fallocate 0x028e33 thru 0x032492 (0x9660 bytes) 000743 1789449494.489172 fallocate 0x008cd8 thru 0x010560 (0x7889 bytes) 000744 1789449494.499844 read 0x0345b9 thru 0x03c770 (0x81b8 bytes) 000745 1789449494.520513 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x35accb (stale) Mirror 16: 0x35accb (stale) Mirror 19: 0x35accb (stale) Mirror 20: 0x35accb (stale) Mirror 21: 0x35accb (stale) Mirror 22: 0x35accb (stale) Mirror 24: 0x35accb (stale) Mirror 26: 0x91b5fa54 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3792394d Mirror 27: 0x3792394d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000746 1789449496.136065 punch from 0x024fea to 0x033ea0 (0xeeb7 bytes) 000747 1789449496.192995 mapwrite 0x00dfa3 thru 0x0168d2 (0x8930 bytes) 000748 1789449496.243915 MIRROR_RESYNC 10 mirrors 000749 1789449499.752725 write 0x0136af thru 0x01b928 (0x827a bytes) 000750 1789449499.806127 mapread 0x03c9c6 thru 0x03ffff (0x363a bytes) 000751 1789449499.842239 trunc from 0x003fce to 0x0102fd (0xc330 bytes) 000752 1789449499.853244 trunc from 0x01b430 to 0x020993 (0x5564 bytes) 000753 1789449499.871877 trunc from 0x016f2a to 0x020979 (0x9a50 bytes) 000754 1789449499.877971 trunc from 0x040000 to 0x0224ff (0x1db00 bytes) 000755 1789449499.918069 read 0x020c16 thru 0x0224ff (0x18ea bytes) 000756 1789449499.933925 trunc from 0x00df85 to 0x011112 (0x318e bytes) 000757 1789449499.945103 trunc from 0x022500 to 0x00a39c (0x18163 bytes) 000758 1789449499.988944 write 0x005cd6 thru 0x010c2f (0xaf5a bytes) 000759 1789449500.001910 fallocate 0x01d539 thru 0x02ca82 (0xf54a bytes) 000760 1789449500.010104 mapread 0x003e7a thru 0x00ead3 (0xac5a bytes) 000761 1789449500.031530 trunc from 0x00e5cc to 0x010c2f (0x2664 bytes) 000762 1789449500.056105 punch from 0x004b94 to 0x010c2f (0xc09c bytes) 000763 1789449500.066552 trunc from 0x010c30 to 0x01f558 (0xe929 bytes) 000764 1789449500.088921 punch from 0x0161e1 to 0x01f558 (0x9378 bytes) 000765 1789449500.098219 fallocate 0x039fde thru 0x03f2c2 (0x52e5 bytes) 000766 1789449500.110649 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f2c3): Mirror 13: 0x4abfde83 (stale) Mirror 16: 0x4abfde83 (stale) Mirror 19: 0x4abfde83 (stale) Mirror 20: 0x4abfde83 (stale) Mirror 21: 0x4abfde83 (stale) Mirror 22: 0x4abfde83 (stale) Mirror 24: 0x4abfde83 (stale) Mirror 27: 0x4abfde83 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f2c3): Mirror 13: 0x4abfde83 (stale) Mirror 16: 0x4abfde83 (stale) Mirror 19: 0x4abfde83 (stale) Mirror 20: 0x4abfde83 (stale) Mirror 21: 0x4abfde83 (stale) Mirror 22: 0x4abfde83 (stale) Mirror 24: 0x4abfde83 (stale) Mirror 27: 0x4abfde83 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f2c3: skipped 000767 1789449500.792989 read 0x01a06f thru 0x028fe4 (0xef76 bytes) 000768 1789449500.809843 write 0x029d3d thru 0x03082f (0x6af3 bytes) 000769 1789449500.825394 trunc from 0x01e92d to 0x0209c1 (0x2095 bytes) 000770 1789449500.830689 write 0x00e086 thru 0x00f750 (0x16cb bytes) 000771 1789449500.841204 mapwrite 0x038137 thru 0x03d9f7 (0x58c1 bytes) 000772 1789449500.876973 trunc from 0x02dd32 to 0x038df5 (0xb0c4 bytes) 000773 1789449500.883267 fallocate 0x033ff9 thru 0x037d52 (0x3d5a bytes) 000774 1789449500.890209 trunc from 0x03f2c3 to 0x017098 (0x2822a bytes) 000775 1789449500.907081 mapread 0x00878b thru 0x016718 (0xdf8e bytes) 000776 1789449500.928145 fallocate 0x008d21 thru 0x00a260 (0x1540 bytes) 000777 1789449500.933252 mapread 0x003298 thru 0x006cab (0x3a14 bytes) 000778 1789449500.935272 mapread 0x00b485 thru 0x017098 (0xbc14 bytes) 000779 1789449500.937147 mapread 0x00a9a5 thru 0x017098 (0xc6f4 bytes) 000780 1789449500.939165 mapwrite 0x01d006 thru 0x027010 (0xa00b bytes) 000781 1789449500.993496 mapwrite 0x0098c0 thru 0x00a574 (0xcb5 bytes) 000782 1789449501.006482 trunc from 0x027011 to 0x01b8fc (0xb714 bytes) 000784 1789449501.028074 punch from 0x00faac to 0x010dec (0x1341 bytes) 000786 1789449501.035906 write 0x02239c thru 0x024106 (0x1d6b bytes) 000787 1789449501.037600 trunc from 0x024107 to 0x03b9f6 (0x178f0 bytes) 000788 1789449501.055687 trunc from 0x030ffb to 0x035219 (0x421f bytes) 000789 1789449501.061122 trunc from 0x03b9f7 to 0x037320 (0x46d6 bytes) 000790 1789449501.078602 mapread 0x030675 thru 0x037320 (0x6cac bytes) 000791 1789449501.091425 trunc from 0x01e70e to 0x026972 (0x8265 bytes) 000793 1789449501.111484 mapwrite 0x018244 thru 0x023c3a (0xb9f7 bytes) 000794 1789449501.207274 mapread 0x02bebd thru 0x02cce7 (0xe2b bytes) 000795 1789449501.208394 trunc from 0x037321 to 0x001ea9 (0x35477 bytes) 000796 1789449501.239449 trunc from 0x001eaa to 0x026fc1 (0x25118 bytes) 000797 1789449501.259271 read 0x015508 thru 0x01f5e0 (0xa0d9 bytes) 000799 1789449501.283467 mapwrite 0x027153 thru 0x036d43 (0xfbf1 bytes) 000800 1789449501.328277 trunc from 0x036d44 to 0x01ac19 (0x1c12a bytes) 000801 1789449501.351191 fallocate 0x00219e thru 0x00a86e (0x86d1 bytes) 000802 1789449501.361119 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ac1a): Mirror 13: 0xb740a1c2 (stale) Mirror 19: 0xb740a1c2 (stale) Mirror 20: 0xb740a1c2 (stale) Mirror 21: 0xb740a1c2 (stale) Mirror 22: 0xb740a1c2 (stale) Mirror 24: 0xb740a1c2 (stale) Mirror 27: 0xb740a1c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ac1a): Mirror 13: 0xb740a1c2 (stale) Mirror 19: 0xb740a1c2 (stale) Mirror 20: 0xb740a1c2 (stale) Mirror 21: 0xb740a1c2 (stale) Mirror 22: 0xb740a1c2 (stale) Mirror 24: 0xb740a1c2 (stale) Mirror 27: 0xb740a1c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ac1a: skipped 000803 1789449501.955125 trunc from 0x013557 to 0x01ac19 (0x76c3 bytes) 000804 1789449501.964565 trunc from 0x00f007 to 0x013885 (0x487f bytes) 000806 1789449501.978393 read 0x016361 thru 0x01ac19 (0x48b9 bytes) 000807 1789449501.989745 read 0x0057f8 thru 0x013834 (0xe03d bytes) 000808 1789449502.010811 mapread 0x001244 thru 0x01115f (0xff1c bytes) 000809 1789449502.034834 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ac1a): Mirror 19: 0xb740a1c2 (stale) Mirror 20: 0xb740a1c2 (stale) Mirror 21: 0xb740a1c2 (stale) Mirror 22: 0xb740a1c2 (stale) Mirror 24: 0xb740a1c2 (stale) Mirror 27: 0xb740a1c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ac1a): Mirror 19: 0xb740a1c2 (stale) Mirror 20: 0xb740a1c2 (stale) Mirror 21: 0xb740a1c2 (stale) Mirror 22: 0xb740a1c2 (stale) Mirror 24: 0xb740a1c2 (stale) Mirror 27: 0xb740a1c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ac1a: skipped 000810 1789449502.609224 write 0x01fb9b thru 0x02bb37 (0xbf9d bytes) 000811 1789449502.616921 mapread 0x00dd76 thru 0x01c2ce (0xe559 bytes) 000812 1789449502.689504 write 0x0008f2 thru 0x00218e (0x189d bytes) 000813 1789449502.701378 write 0x01b784 thru 0x0287a8 (0xd025 bytes) 000814 1789449502.703127 fallocate 0x03298d thru 0x03c924 (0x9f98 bytes) 000815 1789449502.709366 read 0x028742 thru 0x02aa27 (0x22e6 bytes) 000817 1789449502.711168 mapwrite 0x00f998 thru 0x01ecb0 (0xf319 bytes) 000818 1789449502.751058 fallocate 0x02ac3b thru 0x0330e4 (0x84aa bytes) 000819 1789449502.758290 trunc from 0x01d409 to 0x025d35 (0x892d bytes) 000820 1789449502.765691 punch from 0x00dfb9 to 0x016373 (0x83bb bytes) 000821 1789449502.775006 trunc from 0x02bb38 to 0x02b91d (0x21a bytes) 000822 1789449502.795064 trunc from 0x01b603 to 0x02a73d (0xf13b bytes) 000823 1789449502.803529 trunc from 0x02b91e to 0x002f2e (0x289ef bytes) 000824 1789449502.829663 mapwrite 0x030c0f thru 0x03ac76 (0xa068 bytes) 000825 1789449502.902559 punch from 0x0183dc to 0x0196c0 (0x12e5 bytes) 000826 1789449502.908547 mapread 0x0281de thru 0x030460 (0x8283 bytes) 000827 1789449502.924097 mapread 0x022bb8 thru 0x0273d8 (0x4821 bytes) 000828 1789449502.926144 punch from 0x005a38 to 0x0120e0 (0xc6a9 bytes) 000829 1789449502.931721 write 0x020bb8 thru 0x02b84b (0xac94 bytes) 000830 1789449502.940748 fallocate 0x03a0a3 thru 0x03f32a (0x5288 bytes) 000831 1789449502.948545 mapwrite 0x0223db thru 0x026bd7 (0x47fd bytes) 000834 1789449502.971301 trunc from 0x0051b8 to 0x01160a (0xc453 bytes) 000835 1789449502.978379 read 0x01deac thru 0x0261ba (0x830f bytes) 000836 1789449502.989751 punch from 0x01a705 to 0x01dcfa (0x35f6 bytes) 000837 1789449502.999486 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ac77): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ac77): Mirror 19: 0xe58893d3 (stale) Mirror 20: 0xe58893d3 (stale) Mirror 21: 0xe58893d3 (stale) Mirror 22: 0xe58893d3 (stale) Mirror 24: 0xe58893d3 (stale) Mirror 27: 0xe58893d3 (stale) CRC-32 checksum value for chunk [0, 0x3ac77): Mirror 1: 0x6183dd81 Mirror 28: 0x6183dd81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ac77: skipped 000838 1789449504.470148 punch from 0x025dab to 0x02b8bf (0x5b15 bytes) 000839 1789449504.532959 fallocate 0x028687 thru 0x02d3a5 (0x4d1f bytes) 000840 1789449504.543067 write 0x00004d thru 0x00a0dd (0xa091 bytes) 000841 1789449504.567239 punch from 0x0059f0 to 0x0083f7 (0x2a08 bytes) 000842 1789449504.585977 trunc from 0x03ac77 to 0x0313f7 (0x987f bytes) 000843 1789449504.615100 mapread 0x015af9 thru 0x020cca (0xb1d2 bytes) 000844 1789449504.668242 punch from 0x02cd64 to 0x0313f7 (0x4694 bytes) 000845 1789449504.679312 punch from 0x0259d4 to 0x0313f7 (0xba24 bytes) 000846 1789449504.689652 trunc from 0x01122d to 0x019572 (0x8346 bytes) 000847 1789449504.698060 mapread 0x023c74 thru 0x0281ec (0x4579 bytes) 000848 1789449504.715766 trunc from 0x0313f8 to 0x00d38a (0x2406d bytes) 000849 1789449504.742944 punch from 0x00a3b2 to 0x00d38a (0x2fd9 bytes) 000850 1789449504.753075 read 0x000608 thru 0x00c4fa (0xbef3 bytes) 000851 1789449504.768829 write 0x01c415 thru 0x0287bc (0xc3a8 bytes) 000852 1789449504.772861 trunc from 0x00f87f to 0x01cd3f (0xd4c1 bytes) 000853 1789449504.803466 mapread 0x000f4b thru 0x004a43 (0x3af9 bytes) 000854 1789449504.806291 trunc from 0x0287bd to 0x02b18f (0x29d3 bytes) 000855 1789449504.827018 mapwrite 0x018623 thru 0x0280e8 (0xfac6 bytes) 000856 1789449504.875050 fallocate 0x019717 thru 0x02577b (0xc065 bytes) 000857 1789449504.890580 MIRROR_RESYNC 8 mirrors 000858 1789449507.177495 write 0x0381f4 thru 0x03ffff (0x7e0c bytes) 000859 1789449507.213091 write 0x00c02e thru 0x01bd97 (0xfd6a bytes) 000860 1789449507.232051 mapwrite 0x02bee5 thru 0x035c09 (0x9d25 bytes) 000861 1789449507.317687 mapwrite 0x005e30 thru 0x01553a (0xf70b bytes) 000862 1789449507.410818 mapwrite 0x02cdc2 thru 0x038a52 (0xbc91 bytes) 000863 1789449507.478879 punch from 0x03ca71 to 0x03ffff (0x358f bytes) 000865 1789449507.504466 mapwrite 0x00ea52 thru 0x01b01d (0xc5cc bytes) 000866 1789449507.559216 mapwrite 0x01effe thru 0x02da3f (0xea42 bytes) 000867 1789449507.643705 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xd2cd8e87 (stale) Mirror 20: 0xd2cd8e87 (stale) Mirror 21: 0xd2cd8e87 (stale) Mirror 22: 0xd2cd8e87 (stale) Mirror 24: 0xd2cd8e87 (stale) Mirror 28: 0xd2cd8e87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xd2cd8e87 (stale) Mirror 20: 0xd2cd8e87 (stale) Mirror 21: 0xd2cd8e87 (stale) Mirror 22: 0xd2cd8e87 (stale) Mirror 24: 0xd2cd8e87 (stale) Mirror 28: 0xd2cd8e87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000868 1789449508.541386 read 0x02cbb6 thru 0x0308ed (0x3d38 bytes) 000869 1789449508.558851 trunc from 0x001f46 to 0x00e81e (0xc8d9 bytes) 000870 1789449508.566168 trunc from 0x040000 to 0x01ffd8 (0x20027 bytes) 000871 1789449508.593133 mapwrite 0x0033ba thru 0x009843 (0x648a bytes) 000872 1789449508.633679 mapwrite 0x03b0d4 thru 0x03c833 (0x1760 bytes) 000873 1789449508.684053 trunc from 0x019ca7 to 0x022063 (0x83bd bytes) 000874 1789449508.696326 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c834): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c834): Mirror 19: 0x498719e (stale) Mirror 20: 0x498719e (stale) Mirror 21: 0x498719e (stale) Mirror 22: 0x498719e (stale) Mirror 24: 0x498719e (stale) Mirror 28: 0x498719e (stale) CRC-32 checksum value for chunk [0, 0x3c834): Mirror 1: 0xeb261120 Mirror 29: 0xeb261120 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c834: skipped 000875 1789449510.185026 mapread 0x020d09 thru 0x02d0ce (0xc3c6 bytes) 000876 1789449510.246067 trunc from 0x010bd4 to 0x011c01 (0x102e bytes) 000877 1789449510.306933 trunc from 0x0262c3 to 0x033d78 (0xdab6 bytes) 000878 1789449510.311903 trunc from 0x01ab94 to 0x01ad70 (0x1dd bytes) 000879 1789449510.318182 mapwrite 0x03dcc9 thru 0x03ffff (0x2337 bytes) 000880 1789449510.379272 write 0x00d205 thru 0x019455 (0xc251 bytes) 000881 1789449510.392937 punch from 0x02a4fd to 0x02b9f2 (0x14f6 bytes) 000882 1789449510.414136 trunc from 0x0366ed to 0x03ffff (0x9913 bytes) 000883 1789449510.423780 mapread 0x01b9eb thru 0x025eb6 (0xa4cc bytes) 000884 1789449510.452239 write 0x0312f3 thru 0x03bd29 (0xaa37 bytes) 000885 1789449510.467236 write 0x020fc3 thru 0x026d4d (0x5d8b bytes) 000886 1789449510.472849 trunc from 0x040000 to 0x02c41d (0x13be2 bytes) 000888 1789449510.495223 mapread 0x011afe thru 0x018291 (0x6794 bytes) 000889 1789449510.497032 mapread 0x023eb9 thru 0x02c41d (0x8565 bytes) 000890 1789449510.499257 mapwrite 0x00001a thru 0x00a943 (0xa92a bytes) 000891 1789449510.536384 mapwrite 0x0033a6 thru 0x00fe48 (0xcaa3 bytes) 000892 1789449510.561293 punch from 0x0230e1 to 0x027405 (0x4325 bytes) 000893 1789449510.568178 trunc from 0x02c41e to 0x02f991 (0x3574 bytes) 000895 1789449510.586285 trunc from 0x016d35 to 0x026b19 (0xfde5 bytes) 000896 1789449510.592904 read 0x00ece3 thru 0x0139c1 (0x4cdf bytes) 000897 1789449510.595664 trunc from 0x02f992 to 0x00c0eb (0x238a6 bytes) 000898 1789449510.616188 fallocate 0x022610 thru 0x02baf8 (0x94e9 bytes) 000899 1789449510.623307 punch from 0x00337f to 0x00da41 (0xa6c3 bytes) 000900 1789449510.630423 mapwrite 0x006be6 thru 0x009bf1 (0x300c bytes) 000902 1789449510.659157 punch from 0x0028d4 to 0x004a06 (0x2133 bytes) 000903 1789449510.666143 mapwrite 0x032244 thru 0x03f2fa (0xd0b7 bytes) 000904 1789449510.771064 trunc from 0x03f2fb to 0x03be6e (0x348c bytes) 000905 1789449510.800798 mapwrite 0x021033 thru 0x022b2b (0x1af9 bytes) 000906 1789449510.825155 trunc from 0x00f3ce to 0x01dc22 (0xe855 bytes) 000907 1789449510.830884 punch from 0x00e8ad to 0x010844 (0x1f98 bytes) 000908 1789449510.836297 punch from 0x0154fb to 0x015e61 (0x967 bytes) 000909 1789449510.841667 read 0x00a0d6 thru 0x014460 (0xa38b bytes) 000910 1789449510.854228 write 0x00afb7 thru 0x017a57 (0xcaa1 bytes) 000911 1789449510.858054 mapread 0x021d83 thru 0x025e84 (0x4102 bytes) 000912 1789449510.859893 trunc from 0x03be6f to 0x002096 (0x39dd8 bytes) 000913 1789449510.880862 mapwrite 0x00d73d thru 0x01579f (0x8063 bytes) 000914 1789449510.970755 read 0x0090ce thru 0x01579f (0xc6d2 bytes) 000916 1789449510.986249 trunc from 0x0157a0 to 0x00e46a (0x7335 bytes) 000917 1789449511.005118 mapwrite 0x004ccf thru 0x006a83 (0x1db5 bytes) 000918 1789449511.019806 trunc from 0x006c8d to 0x00e46a (0x77de bytes) 000920 1789449511.027848 trunc from 0x00e46b to 0x0370c1 (0x28c57 bytes) 000921 1789449511.050182 fallocate 0x00ef18 thru 0x012add (0x3bc6 bytes) 000922 1789449511.056496 mapread 0x00ce8e thru 0x01722e (0xa3a1 bytes) 000923 1789449511.115104 write 0x036de0 thru 0x03ffff (0x9220 bytes) 000925 1789449511.118298 write 0x03f0c2 thru 0x03ffff (0xf3e bytes) 000926 1789449511.119675 trunc from 0x01dd3f to 0x022e6b (0x512d bytes) 000927 1789449511.129857 MIRROR_RESYNC 8 mirrors 000928 1789449513.538114 fallocate 0x014ca9 thru 0x020275 (0xb5cd bytes) 000929 1789449513.624312 write 0x01d299 thru 0x027341 (0xa0a9 bytes) 000930 1789449513.646127 mapread 0x00d752 thru 0x018558 (0xae07 bytes) 000931 1789449513.685100 punch from 0x015745 to 0x0194b8 (0x3d74 bytes) 000933 1789449513.691636 fallocate 0x0392a2 thru 0x03fbc0 (0x691f bytes) 000934 1789449513.697243 trunc from 0x040000 to 0x029317 (0x16ce8 bytes) 000935 1789449513.727717 fallocate 0x011cdb thru 0x01358f (0x18b5 bytes) 000936 1789449513.742215 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x29318): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29318): Mirror 19: 0x3ff53389 (stale) Mirror 20: 0x3ff53389 (stale) Mirror 21: 0x3ff53389 (stale) Mirror 22: 0x3ff53389 (stale) Mirror 24: 0x3ff53389 (stale) Mirror 28: 0x3ff53389 (stale) Mirror 29: 0x3ff53389 (stale) CRC-32 checksum value for chunk [0, 0x29318): Mirror 1: 0x82cb0aae Mirror 30: 0x82cb0aae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29318: skipped 000937 1789449515.387836 trunc from 0x019a24 to 0x02733f (0xd91c bytes) 000938 1789449515.474960 fallocate 0x0047b9 thru 0x00f644 (0xae8c bytes) 000939 1789449515.480636 punch from 0x0103a7 to 0x01974a (0x93a4 bytes) 000940 1789449515.488206 mapwrite 0x03b35c thru 0x03ffff (0x4ca4 bytes) 000941 1789449515.569308 read 0x035c64 thru 0x03b78c (0x5b29 bytes) 000942 1789449515.576934 write 0x02048a thru 0x020eed (0xa64 bytes) 000943 1789449515.583976 fallocate 0x026d45 thru 0x030542 (0x97fe bytes) 000944 1789449515.589236 trunc from 0x0145f6 to 0x0170e3 (0x2aee bytes) 000945 1789449515.594093 punch from 0x027d40 to 0x02db80 (0x5e41 bytes) 000946 1789449515.599418 write 0x008f92 thru 0x00df83 (0x4ff2 bytes) 000947 1789449515.616010 trunc from 0x0337fa to 0x03e0ec (0xa8f3 bytes) 000948 1789449515.626590 write 0x01a54f thru 0x01e5f2 (0x40a4 bytes) 000949 1789449515.644638 trunc from 0x040000 to 0x03bd9b (0x4264 bytes) 000950 1789449515.669763 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bd9c): Mirror 20: 0xc14e7607 (stale) Mirror 21: 0xc14e7607 (stale) Mirror 22: 0xc14e7607 (stale) Mirror 24: 0xc14e7607 (stale) Mirror 28: 0xc14e7607 (stale) Mirror 29: 0xc14e7607 (stale) Mirror 30: 0xd39abb73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd9c): Mirror 20: 0xc14e7607 (stale) Mirror 21: 0xc14e7607 (stale) Mirror 22: 0xc14e7607 (stale) Mirror 24: 0xc14e7607 (stale) Mirror 28: 0xc14e7607 (stale) Mirror 29: 0xc14e7607 (stale) Mirror 30: 0xd39abb73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd9c: skipped 000951 1789449516.351862 trunc from 0x03bd9c to 0x000fc0 (0x3addb bytes) 000952 1789449516.393646 trunc from 0x0009a7 to 0x000fc0 (0x61a bytes) 000953 1789449516.405665 trunc from 0x00084d to 0x000fc0 (0x774 bytes) 000954 1789449516.418556 write 0x034cf4 thru 0x03ffff (0xb30c bytes) 000956 1789449516.427309 fallocate 0x03bbd8 thru 0x03ffff (0x4428 bytes) 000957 1789449516.437971 read 0x02c00f thru 0x02ed68 (0x2d5a bytes) 000958 1789449516.469322 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xf2a8d46c (stale) Mirror 21: 0xf2a8d46c (stale) Mirror 22: 0xf2a8d46c (stale) Mirror 24: 0xf2a8d46c (stale) Mirror 28: 0xf2a8d46c (stale) Mirror 29: 0xf2a8d46c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xf2a8d46c (stale) Mirror 21: 0xf2a8d46c (stale) Mirror 22: 0xf2a8d46c (stale) Mirror 24: 0xf2a8d46c (stale) Mirror 28: 0xf2a8d46c (stale) Mirror 29: 0xf2a8d46c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000959 1789449517.099705 trunc from 0x040000 to 0x01a26b (0x25d94 bytes) 000960 1789449517.128922 mapread 0x00b791 thru 0x01263b (0x6eab bytes) 000961 1789449517.156623 read 0x011676 thru 0x015333 (0x3cbe bytes) 000963 1789449517.158133 read 0x004665 thru 0x010e3b (0xc7d7 bytes) 000964 1789449517.176172 MIRROR_RESYNC 7 mirrors 000965 1789449518.763612 trunc from 0x01a26c to 0x014a35 (0x5836 bytes) 000966 1789449518.851205 punch from 0x001e15 to 0x00f629 (0xd815 bytes) 000967 1789449518.858101 trunc from 0x014a36 to 0x002690 (0x123a5 bytes) 000968 1789449518.882290 mapread 0x000f46 thru 0x002690 (0x174b bytes) 000969 1789449518.904664 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2691): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2691): Mirror 20: 0xc8f3d9e4 (stale) Mirror 21: 0xc8f3d9e4 (stale) Mirror 22: 0xc8f3d9e4 (stale) Mirror 24: 0xc8f3d9e4 (stale) Mirror 28: 0xc8f3d9e4 (stale) Mirror 29: 0xc8f3d9e4 (stale) CRC-32 checksum value for chunk [0, 0x2691): Mirror 1: 0xc8f3d9e4 Mirror 30: 0xc8f3d9e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2691: skipped 000970 1789449520.135778 trunc from 0x002691 to 0x021e10 (0x1f780 bytes) 000971 1789449520.245261 punch from 0x01b5d0 to 0x021e10 (0x6841 bytes) 000972 1789449520.272294 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21e11): Mirror 20: 0x346685d8 (stale) Mirror 21: 0x346685d8 (stale) Mirror 22: 0x346685d8 (stale) Mirror 24: 0x346685d8 (stale) Mirror 28: 0x346685d8 (stale) Mirror 29: 0x346685d8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21e11): Mirror 20: 0x346685d8 (stale) Mirror 21: 0x346685d8 (stale) Mirror 22: 0x346685d8 (stale) Mirror 24: 0x346685d8 (stale) Mirror 28: 0x346685d8 (stale) Mirror 29: 0x346685d8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21e11: skipped 000973 1789449520.754051 fallocate 0x00a970 thru 0x00fb17 (0x51a8 bytes) 000974 1789449520.761220 mapwrite 0x028779 thru 0x02ab44 (0x23cc bytes) 000975 1789449520.830155 mapread 0x00c823 thru 0x015498 (0x8c76 bytes) 000976 1789449520.856974 fallocate 0x00c123 thru 0x01098c (0x486a bytes) 000977 1789449520.863224 read 0x00be86 thru 0x01730b (0xb486 bytes) 000978 1789449520.864730 mapread 0x01d0e5 thru 0x0219c5 (0x48e1 bytes) 000979 1789449520.875047 trunc from 0x02ab45 to 0x02f2c2 (0x477e bytes) 000980 1789449520.894158 trunc from 0x00e060 to 0x015e89 (0x7e2a bytes) 000981 1789449520.910975 trunc from 0x02f2c3 to 0x03269c (0x33da bytes) 000982 1789449520.938240 punch from 0x028c24 to 0x02fd18 (0x70f5 bytes) 000983 1789449520.943941 write 0x0385b9 thru 0x03c730 (0x4178 bytes) 000984 1789449520.946925 fallocate 0x0241d5 thru 0x0322c0 (0xe0ec bytes) 000986 1789449520.952647 fallocate 0x0197cd thru 0x01f78f (0x5fc3 bytes) 000987 1789449520.958128 trunc from 0x03c731 to 0x002dbe (0x39972 bytes) 000988 1789449520.975190 trunc from 0x0010bb to 0x002dbe (0x1d04 bytes) 000989 1789449520.980799 mapread 0x0027f1 thru 0x002dbe (0x5ce bytes) 000990 1789449520.992970 fallocate 0x03d3d9 thru 0x03ffff (0x2c27 bytes) 000991 1789449520.999024 fallocate 0x027314 thru 0x02d8e7 (0x65d4 bytes) 000992 1789449521.004082 trunc from 0x02d8e8 to 0x01a5d1 (0x13316 bytes) 000993 1789449521.018684 mapwrite 0x02fd88 thru 0x03623f (0x64b8 bytes) 000994 1789449521.070760 mapwrite 0x03a083 thru 0x03ffff (0x5f7d bytes) 000995 1789449521.119224 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x145:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x909d8204 (stale) Mirror 21: 0x909d8204 (stale) Mirror 22: 0x909d8204 (stale) Mirror 24: 0x909d8204 (stale) Mirror 28: 0x909d8204 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0x909d8204 (stale) Mirror 21: 0x909d8204 (stale) Mirror 22: 0x909d8204 (stale) Mirror 24: 0x909d8204 (stale) Mirror 28: 0x909d8204 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000996 1789449521.657995 mapread 0x01d9e0 thru 0x026c1f (0x9240 bytes) 000997 1789449521.690254 read 0x0392cc thru 0x03b32e (0x2063 bytes) 000999 1789449521.699741 punch from 0x02c927 to 0x038855 (0xbf2f bytes) 001000 1789449521.705802 read 0x023a88 thru 0x02b366 (0x78df bytes) All operations completed A-OK!