== sanity-flr test 70a: flr mode fsx test ================ 17:25:04 (1788643504) Seed set to 3506 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1673e 000001 1788643506.917727 trunc from 00000000 to 0x01673d (0x1673e bytes) 000002 1788643506.936944 punch from 0x015ad1 to 0x01673d (0xc6d bytes) 000003 1788643506.946686 MIRROR_EXTEND to 2 mirrors 000004 1788643507.940749 punch from 0x00d80d to 0x01673d (0x8f31 bytes) 000005 1788643508.066163 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000006 1788643508.229148 trunc from 0x01673e to 0x00cbbd (0x9b80 bytes) 000007 1788643508.248153 write 0x01092e thru 0x01d4a4 (0xcb77 bytes) 000008 1788643508.251476 punch from 0x00a637 to 0x00cb01 (0x24cb bytes) 000009 1788643508.268908 read 0x013def thru 0x01d4a4 (0x96b6 bytes) 000010 1788643508.270175 mapread 0x012e68 thru 0x01d4a4 (0xa63d bytes) 000011 1788643508.276675 MIRROR_EXTEND to 2 mirrors 000012 1788643509.220854 read 0x00e484 thru 0x017cca (0x9847 bytes) truncating to largest ever: 0x30f10 000014 1788643509.275967 trunc from 0x01d4a5 to 0x030f0f (0x13a6b bytes) 000015 1788643509.404484 write 0x02d0ed thru 0x035586 (0x849a bytes) 000016 1788643509.413592 write 0x02d24d thru 0x031144 (0x3ef8 bytes) 000019 1788643509.421375 read 0x0085d8 thru 0x00ec4a (0x6673 bytes) truncating to largest ever: 0x366bc 000020 1788643509.445350 trunc from 0x035587 to 0x0366bb (0x1135 bytes) 000022 1788643509.473933 read 0x01ac5e thru 0x020c08 (0x5fab bytes) 000024 1788643509.475094 read 0x02bd86 thru 0x0366bb (0xa936 bytes) 000025 1788643509.490278 read 0x01ffd9 thru 0x0229da (0x2a02 bytes) 000026 1788643509.491464 mapread 0x025a11 thru 0x035288 (0xf878 bytes) 000027 1788643509.493081 mapread 0x007ce7 thru 0x00ba99 (0x3db3 bytes) 000028 1788643509.497425 write 0x00627c thru 0x00cef2 (0x6c77 bytes) 000029 1788643509.499206 mapread 0x02cd0a thru 0x02daf2 (0xde9 bytes) 000033 1788643509.504831 read 0x01c172 thru 0x01d2cc (0x115b bytes) 000034 1788643509.516135 MIRROR_RESYNC 2 mirrors 000036 1788643510.533112 mapread 0x027019 thru 0x02b8e3 (0x48cb bytes) 000037 1788643510.577587 mapread 0x0069de thru 0x014a93 (0xe0b6 bytes) 000038 1788643510.607047 mapread 0x03386d thru 0x036460 (0x2bf4 bytes) 000039 1788643510.634719 MIRROR_RESYNC 2 mirrors 000040 1788643511.200666 MIRROR_RESYNC 2 mirrors 000041 1788643511.661339 read 0x00ab32 thru 0x00f774 (0x4c43 bytes) 000042 1788643511.661704 mapwrite 0x004a79 thru 0x011b75 (0xd0fd bytes) 000043 1788643511.877945 read 0x01a220 thru 0x01ea6b (0x484c bytes) 000048 1788643511.904809 MIRROR_RESYNC 2 mirrors 000049 1788643512.746146 mapwrite 0x02800c thru 0x031d4f (0x9d44 bytes) 000050 1788643512.972301 punch from 0x01d0f5 to 0x0235ff (0x650b bytes) 000052 1788643512.994665 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x366bc): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x366bc): Mirror 2: 0x77f5159f (stale) CRC-32 checksum value for chunk [0, 0x366bc): Mirror 1: 0x39cc57db Mirror 3: 0x39cc57db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x366bc: skipped 000053 1788643514.098079 punch from 0x02a593 to 0x035250 (0xacbe bytes) 000054 1788643514.215762 read 0x032164 thru 0x033a03 (0x18a0 bytes) 000057 1788643514.238505 trunc from 0x0366bc to 0x02168b (0x15030 bytes) 000058 1788643514.267578 punch from 0x01b829 to 0x02168b (0x5e63 bytes) 000059 1788643514.277802 trunc from 0x02168c to 0x0159e4 (0xbca7 bytes) 000060 1788643514.346657 mapread 0x010132 thru 0x0159e4 (0x58b3 bytes) 000061 1788643514.372398 read 0x00f2d3 thru 0x0143e8 (0x5116 bytes) 000063 1788643514.373500 read 0x0158c4 thru 0x0159e4 (0x121 bytes) 000064 1788643514.374020 punch from 0x00287b to 0x010425 (0xdbab bytes) 000065 1788643514.379745 trunc from 0x0159e5 to 0x006067 (0xf97d bytes) 000066 1788643514.400682 trunc from 0x006068 to 0x02687d (0x20816 bytes) 000068 1788643514.421595 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2687e): Mirror 3: 0x484bf40c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2687e): Mirror 3: 0x484bf40c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2687e: skipped 000070 1788643514.739063 write 0x029734 thru 0x03490a (0xb1d7 bytes) 000073 1788643514.742978 punch from 0x02b2b6 to 0x031123 (0x5e6e bytes) 000074 1788643514.791868 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3490b): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3490b): Mirror 3: 0x926a71e9 (stale) CRC-32 checksum value for chunk [0, 0x3490b): Mirror 1: 0xa3890bdb Mirror 4: 0xa3890bdb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3490b: skipped 000075 1788643516.483676 write 0x024a25 thru 0x02a2b1 (0x588d bytes) 000077 1788643516.648644 trunc from 0x03490b to 0x01e6d1 (0x16239 bytes) 000078 1788643516.686808 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1e6d2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e6d2): Mirror 3: 0x4d88f917 (stale) Mirror 4: 0xbc732b76 (stale) CRC-32 checksum value for chunk [0, 0x1e6d2): Mirror 1: 0xbc732b76 Mirror 5: 0xbc732b76 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e6d2: skipped 000080 1788643517.934858 read 0x001fd3 thru 0x00c73f (0xa76d bytes) 000081 1788643517.956527 write 0x00985b thru 0x011e68 (0x860e bytes) 000082 1788643518.072750 mapwrite 0x036f42 thru 0x0375c8 (0x687 bytes) 000083 1788643518.154113 read 0x0342ce thru 0x0375c8 (0x32fb bytes) 000084 1788643518.165006 mapwrite 0x014966 thru 0x0174d6 (0x2b71 bytes) 000085 1788643518.197599 write 0x005dae thru 0x006ef4 (0x1147 bytes) 000086 1788643518.198944 read 0x01d033 thru 0x025884 (0x8852 bytes) 000087 1788643518.200040 mapwrite 0x02a582 thru 0x038fea (0xea69 bytes) 000088 1788643518.264703 read 0x01b8c8 thru 0x01d69a (0x1dd3 bytes) 000089 1788643518.265936 write 0x017b7a thru 0x01806b (0x4f2 bytes) 000090 1788643518.271367 MIRROR_RESYNC 4 mirrors 000091 1788643519.299771 trunc from 0x038feb to 0x00d4fa (0x2baf0 bytes) 000092 1788643519.387929 trunc from 0x00d4fb to 0x00c06d (0x148d bytes) 000094 1788643519.420010 read 0x00a6e3 thru 0x00c06d (0x198b bytes) 000096 1788643519.429726 trunc from 0x00c06e to 0x01b186 (0xf119 bytes) 000099 1788643519.450558 write 0x03a9e6 thru 0x03ffff (0x561a bytes) 000100 1788643519.452320 mapread 0x00eb61 thru 0x013e30 (0x52d0 bytes) 000103 1788643519.485465 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x56262d97 (stale) Mirror 4: 0x56262d97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x56262d97 (stale) Mirror 4: 0x56262d97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000104 1788643519.922762 punch from 0x01cf37 to 0x025e7f (0x8f49 bytes) 000106 1788643519.929092 punch from 0x025b38 to 0x02df75 (0x843e bytes) 000107 1788643519.934419 mapread 0x00059d thru 0x01014a (0xfbae bytes) 000109 1788643519.959735 mapwrite 0x036e48 thru 0x03d621 (0x67da bytes) 000112 1788643520.032071 trunc from 0x040000 to 0x02aebc (0x15143 bytes) 000113 1788643520.053402 punch from 0x017c41 to 0x01ae7c (0x323c bytes) 000114 1788643520.061528 punch from 0x01c5e7 to 0x01ccfd (0x717 bytes) 000115 1788643520.067122 write 0x012942 thru 0x01e29f (0xb95e bytes) 000117 1788643520.079460 punch from 0x026f93 to 0x02aebc (0x3f2a bytes) 000119 1788643520.093341 mapread 0x010f8a thru 0x01a5e1 (0x9658 bytes) 000120 1788643520.105711 MIRROR_RESYNC 3 mirrors 000121 1788643520.979001 write 0x010594 thru 0x014784 (0x41f1 bytes) 000122 1788643521.068043 punch from 0x029af4 to 0x02aebc (0x13c9 bytes) 000123 1788643521.096644 read 0x017f8a thru 0x01bb91 (0x3c08 bytes) 000124 1788643521.112902 write 0x00da59 thru 0x01173a (0x3ce2 bytes) 000128 1788643521.121395 trunc from 0x02aebd to 0x02fb23 (0x4c67 bytes) 000130 1788643521.194026 mapread 0x0121b8 thru 0x017b9e (0x59e7 bytes) 000131 1788643521.205255 write 0x01aa1b thru 0x01d87e (0x2e64 bytes) 000132 1788643521.223067 MIRROR_RESYNC 3 mirrors 000133 1788643521.878684 write 0x018d68 thru 0x028552 (0xf7eb bytes) 000134 1788643522.010636 write 0x020583 thru 0x0205b6 (0x34 bytes) 000136 1788643522.012383 write 0x014b6a thru 0x0199df (0x4e76 bytes) 000137 1788643522.019061 mapread 0x015b6f thru 0x017f24 (0x23b6 bytes) truncating to largest ever: 0x387a0 000138 1788643522.021214 trunc from 0x02fb24 to 0x03879f (0x8c7c bytes) 000140 1788643522.062895 read 0x0006b9 thru 0x00385e (0x31a6 bytes) 000141 1788643522.070336 trunc from 0x0387a0 to 0x019f08 (0x1e897 bytes) 000142 1788643522.089551 mapwrite 0x01b228 thru 0x0237ca (0x85a3 bytes) 000143 1788643522.226378 read 0x0178a5 thru 0x01ddd0 (0x652c bytes) 000145 1788643522.228806 write 0x029d98 thru 0x032751 (0x89ba bytes) 000146 1788643522.231700 mapwrite 0x0242a9 thru 0x030a47 (0xc79f bytes) 000147 1788643522.311376 mapwrite 0x00fbc1 thru 0x010e6d (0x12ad bytes) 000148 1788643522.383845 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32752): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32752): Mirror 3: 0x28c0db68 (stale) Mirror 4: 0x28c0db68 (stale) CRC-32 checksum value for chunk [0, 0x32752): Mirror 1: 0x416c1644 Mirror 5: 0x416c1644 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32752: skipped 000150 1788643523.334511 trunc from 0x032752 to 0x015fec (0x1c765 bytes) 000151 1788643523.548679 punch from 0x00450a to 0x010413 (0xbf0a bytes) 000152 1788643523.555572 trunc from 0x015fed to 0x014844 (0x17a8 bytes) 000153 1788643523.584708 mapwrite 0x016f2e thru 0x01b1fc (0x42cf bytes) 000154 1788643523.667488 punch from 0x0003b9 to 0x008e24 (0x8a6c bytes) 000156 1788643523.677898 read 0x01570a thru 0x01b1fc (0x5af3 bytes) 000157 1788643523.683406 MIRROR_RESYNC 4 mirrors 000159 1788643524.951008 write 0x01dbd6 thru 0x025f76 (0x83a1 bytes) 000160 1788643525.038814 punch from 0x003499 to 0x00af82 (0x7aea bytes) 000161 1788643525.076056 trunc from 0x025f77 to 0x021069 (0x4f0d bytes) 000166 1788643525.130907 punch from 0x00a740 to 0x010bec (0x64ad bytes) 000167 1788643525.144896 write 0x0047fc thru 0x0107e5 (0xbfea bytes) 000168 1788643525.157919 trunc from 0x02106a to 0x01d993 (0x36d6 bytes) 000169 1788643525.185334 mapwrite 0x01759b thru 0x0182ae (0xd14 bytes) 000171 1788643525.266817 mapwrite 0x02a7ab thru 0x02e999 (0x41ef bytes) 000172 1788643525.392169 write 0x0341ae thru 0x035111 (0xf64 bytes) 000175 1788643525.396712 trunc from 0x035112 to 0x038382 (0x3271 bytes) 000179 1788643525.441334 write 0x0367bb thru 0x03ffff (0x9845 bytes) 000182 1788643525.474613 MIRROR_RESYNC 4 mirrors 000183 1788643526.838165 trunc from 0x040000 to 0x006545 (0x39aba bytes) 000184 1788643526.999959 MIRROR_RESYNC 4 mirrors 000185 1788643528.149690 mapread 0x000c61 thru 0x006545 (0x58e5 bytes) 000186 1788643528.183145 mapread 0x0045fd thru 0x006545 (0x1f49 bytes) 000188 1788643528.184035 mapwrite 0x013251 thru 0x01aaf6 (0x78a6 bytes) truncating to largest ever: 0x3e072 000189 1788643528.375175 trunc from 0x01aaf7 to 0x03e071 (0x2357b bytes) 000193 1788643528.460019 write 0x01cc2d thru 0x0298d6 (0xccaa bytes) 000194 1788643528.484080 mapwrite 0x03b3b7 thru 0x03ffff (0x4c49 bytes) 000195 1788643528.668410 punch from 0x027c5b to 0x036ea3 (0xf249 bytes) 000196 1788643528.675906 punch from 0x02d350 to 0x036f45 (0x9bf6 bytes) 000197 1788643528.683367 mapwrite 0x001f8a thru 0x00368d (0x1704 bytes) 000199 1788643528.786522 write 0x00a6ea thru 0x015965 (0xb27c bytes) 000200 1788643528.794018 mapwrite 0x018cb0 thru 0x01f72a (0x6a7b bytes) 000201 1788643528.899879 trunc from 0x040000 to 0x014169 (0x2be96 bytes) 000202 1788643528.926045 mapread 0x00ba2b thru 0x014169 (0x873f bytes) 000203 1788643528.946961 MIRROR_RESYNC 4 mirrors 000204 1788643530.321959 write 0x00a263 thru 0x0112e7 (0x7085 bytes) 000205 1788643530.405029 MIRROR_RESYNC 4 mirrors 000206 1788643531.288083 MIRROR_RESYNC 4 mirrors 000208 1788643531.692984 MIRROR_EXTEND to 5 mirrors 000210 1788643532.660069 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000211 1788643533.161886 write 0x0061cd thru 0x008f65 (0x2d99 bytes) 000212 1788643533.251381 punch from 0x00331e to 0x00511c (0x1dff bytes) 000213 1788643533.276523 punch from 0x00f98c to 0x014169 (0x47de bytes) 000214 1788643533.287917 mapread 0x0089d8 thru 0x014169 (0xb792 bytes) 000216 1788643533.342039 write 0x00cf33 thru 0x0148b5 (0x7983 bytes) 000219 1788643533.349066 trunc from 0x0148b6 to 0x01fd91 (0xb4dc bytes) 000220 1788643533.399812 MIRROR_RESYNC 4 mirrors 000221 1788643534.619872 punch from 0x01807b to 0x01d32f (0x52b5 bytes) 000222 1788643534.691498 mapwrite 0x01662b thru 0x01bdbc (0x5792 bytes) 000225 1788643534.773143 read 0x00e627 thru 0x016906 (0x82e0 bytes) 000227 1788643534.781657 mapwrite 0x007908 thru 0x014fe7 (0xd6e0 bytes) 000229 1788643534.867892 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fd92): Mirror 5: 0x2b5ef10a (stale) Mirror 6: 0x2b5ef10a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fd92): Mirror 5: 0x2b5ef10a (stale) Mirror 6: 0x2b5ef10a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fd92: skipped 000230 1788643535.318573 mapwrite 0x02f514 thru 0x039c78 (0xa765 bytes) 000232 1788643535.409388 write 0x000c0e thru 0x00184a (0xc3d bytes) 000233 1788643535.420765 mapwrite 0x00feb3 thru 0x016367 (0x64b5 bytes) 000234 1788643535.501792 read 0x020748 thru 0x023a9e (0x3357 bytes) 000236 1788643535.512790 trunc from 0x039c79 to 0x0189ae (0x212ca bytes) 000237 1788643535.536801 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x189af): Mirror 6: 0xf49ca15c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x189af): Mirror 6: 0xf49ca15c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x189af: skipped 000238 1788643535.959124 mapread 0x011673 thru 0x013c73 (0x2601 bytes) 000239 1788643536.023765 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000240 1788643536.271262 mapwrite 0x014ff4 thru 0x019770 (0x477d bytes) 000241 1788643536.390600 punch from 0x009be2 to 0x00a3f2 (0x811 bytes) 000242 1788643536.398499 read 0x00ad7c thru 0x0189f1 (0xdc76 bytes) 000245 1788643536.426716 punch from 0x002dd9 to 0x003a46 (0xc6e bytes) 000247 1788643536.444382 trunc from 0x019771 to 0x01e4bc (0x4d4c bytes) 000248 1788643536.476014 write 0x02baf7 thru 0x030f91 (0x549b bytes) 000250 1788643536.480090 mapread 0x004e1e thru 0x00c7c3 (0x79a6 bytes) 000251 1788643536.490338 trunc from 0x030f92 to 0x0304ae (0xae3 bytes) 000252 1788643536.506491 mapwrite 0x03add9 thru 0x03ffff (0x5227 bytes) 000253 1788643536.588421 trunc from 0x040000 to 0x00faca (0x30535 bytes) 000254 1788643536.606483 mapwrite 0x020057 thru 0x02bd46 (0xbcf0 bytes) 000256 1788643536.732491 read 0x023ee4 thru 0x025929 (0x1a46 bytes) 000257 1788643536.733092 write 0x035ce0 thru 0x039861 (0x3b82 bytes) 000258 1788643536.735720 mapread 0x01cb99 thru 0x01e5d0 (0x1a38 bytes) 000259 1788643536.737005 punch from 0x000c8e to 0x00d67a (0xc9ed bytes) 000260 1788643536.753878 mapwrite 0x00d43c thru 0x01567a (0x823f bytes) 000262 1788643536.835478 trunc from 0x039862 to 0x034903 (0x4f5e bytes) 000263 1788643536.859543 mapread 0x014f65 thru 0x020031 (0xb0cd bytes) 000266 1788643536.868553 MIRROR_EXTEND to 2 mirrors 000268 1788643537.827171 mapread 0x001fa8 thru 0x00a3d7 (0x8430 bytes) 000269 1788643537.885908 read 0x018058 thru 0x024cfe (0xcca7 bytes) 000270 1788643537.926409 MIRROR_EXTEND to 3 mirrors 000271 1788643538.809969 mapwrite 0x01267b thru 0x01650e (0x3e94 bytes) 000273 1788643539.005102 mapwrite 0x03592a thru 0x0376c2 (0x1d99 bytes) 000276 1788643539.133534 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x376c3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x376c3): Mirror 2: 0x9f9a67de (stale) Mirror 3: 0x9f9a67de (stale) CRC-32 checksum value for chunk [0, 0x376c3): Mirror 1: 0x4afe0252 Mirror 4: 0x4afe0252 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x376c3: skipped 000277 1788643539.893842 read 0x0284fd thru 0x02c0b2 (0x3bb6 bytes) 000278 1788643539.921355 write 0x03ee9b thru 0x03f028 (0x18e bytes) 000279 1788643540.003603 write 0x00eda4 thru 0x011fa9 (0x3206 bytes) 000281 1788643540.021650 mapread 0x00a9a0 thru 0x01203f (0x76a0 bytes) 000282 1788643540.065769 mapread 0x002d07 thru 0x00717a (0x4474 bytes) 000284 1788643540.074470 mapwrite 0x01616f thru 0x025237 (0xf0c9 bytes) 000285 1788643540.216643 mapread 0x02d09d thru 0x02f07a (0x1fde bytes) 000286 1788643540.253885 punch from 0x02c5d3 to 0x03c5af (0xffdd bytes) 000287 1788643540.260434 read 0x0215b1 thru 0x0271d1 (0x5c21 bytes) 000289 1788643540.266477 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f029): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f029): Mirror 2: 0xc8962ea7 (stale) Mirror 3: 0xc8962ea7 (stale) Mirror 4: 0xc444801a (stale) CRC-32 checksum value for chunk [0, 0x3f029): Mirror 1: 0x1fbbad70 Mirror 5: 0x1fbbad70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f029: skipped 000290 1788643541.288756 mapwrite 0x014342 thru 0x023951 (0xf610 bytes) 000292 1788643541.546914 punch from 0x02bac1 to 0x03833d (0xc87d bytes) 000293 1788643541.552399 write 0x02c890 thru 0x03c45c (0xfbcd bytes) 000294 1788643541.577707 trunc from 0x03f029 to 0x002a6f (0x3c5b9 bytes) 000297 1788643541.638459 read 0x002802 thru 0x002a6f (0x26e bytes) 000298 1788643541.650241 write 0x03a0c4 thru 0x03d074 (0x2fb1 bytes) 000299 1788643541.657948 write 0x024df9 thru 0x027c8a (0x2e92 bytes) 000300 1788643541.678984 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d075): Mirror 2: 0xc85f9280 (stale) Mirror 3: 0xc85f9280 (stale) Mirror 5: 0x9d3e310a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d075): Mirror 2: 0xc85f9280 (stale) Mirror 3: 0xc85f9280 (stale) Mirror 5: 0x9d3e310a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d075: skipped 000301 1788643542.246591 read 0x023d9b thru 0x02df7a (0xa1e0 bytes) 000303 1788643542.279356 mapwrite 0x012490 thru 0x01ccd4 (0xa845 bytes) 000305 1788643542.387835 punch from 0x01cd4c to 0x024fce (0x8283 bytes) 000306 1788643542.397705 punch from 0x023765 to 0x02874a (0x4fe6 bytes) 000307 1788643542.406701 punch from 0x025382 to 0x029e64 (0x4ae3 bytes) 000308 1788643542.411491 read 0x02e6b9 thru 0x0379ff (0x9347 bytes) 000310 1788643542.444127 mapread 0x021055 thru 0x02c274 (0xb220 bytes) 000311 1788643542.445282 trunc from 0x03d075 to 0x0071fc (0x35e78 bytes) 000312 1788643542.461523 trunc from 0x0071fd to 0x026d9a (0x1fb9e bytes) 000315 1788643542.480404 trunc from 0x026d9b to 0x010685 (0x16715 bytes) 000316 1788643542.494728 read 0x004602 thru 0x010685 (0xc084 bytes) 000317 1788643542.504724 mapread 0x0092e7 thru 0x00e5a0 (0x52ba bytes) 000318 1788643542.505824 punch from 0x009629 to 0x010685 (0x705d bytes) 000319 1788643542.509907 read 0x00eeab thru 0x010685 (0x17db bytes) 000320 1788643542.524263 punch from 0x00cb16 to 0x00d891 (0xd7c bytes) 000321 1788643542.529636 write 0x00dcdd thru 0x0198f8 (0xbc1c bytes) 000323 1788643542.543417 punch from 0x0035af to 0x00bf78 (0x89ca bytes) 000325 1788643542.558002 write 0x038fad thru 0x03ffff (0x7053 bytes) 000326 1788643542.561437 punch from 0x01df64 to 0x0283f7 (0xa494 bytes) 000327 1788643542.578266 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3e00c141 (stale) Mirror 3: 0x3e00c141 (stale) Mirror 5: 0x69ca95d7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x53596a70 Mirror 6: 0x53596a70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000328 1788643543.434177 trunc from 0x040000 to 0x00752c (0x38ad3 bytes) 000329 1788643543.553456 write 0x0266eb thru 0x027c3b (0x1551 bytes) 000330 1788643543.554562 punch from 0x021024 to 0x027c3b (0x6c18 bytes) 000331 1788643543.567864 write 0x01c24e thru 0x022c50 (0x6a03 bytes) 000332 1788643543.579313 write 0x019732 thru 0x0295bb (0xfe8a bytes) 000333 1788643543.584799 read 0x00f1f4 thru 0x01a748 (0xb555 bytes) 000335 1788643543.595452 trunc from 0x0295bc to 0x038496 (0xeedb bytes) 000336 1788643543.612526 mapwrite 0x01f511 thru 0x02d459 (0xdf49 bytes) 000337 1788643543.681614 mapwrite 0x00dab5 thru 0x0138fe (0x5e4a bytes) 000339 1788643543.785037 write 0x024cd6 thru 0x025109 (0x434 bytes) 000340 1788643543.785954 punch from 0x02be85 to 0x038496 (0xc612 bytes) 000341 1788643543.800726 read 0x02405d thru 0x02d5d2 (0x9576 bytes) 000342 1788643543.815889 mapread 0x0195b0 thru 0x020c43 (0x7694 bytes) 000344 1788643543.818534 trunc from 0x038497 to 0x018589 (0x1ff0d bytes) 000345 1788643543.844464 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1858a): Mirror 2: 0x1dec7cda (stale) Mirror 3: 0x1dec7cda (stale) Mirror 5: 0x31d94d0c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1858a): Mirror 2: 0x1dec7cda (stale) Mirror 3: 0x1dec7cda (stale) Mirror 5: 0x31d94d0c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1858a: skipped 000348 1788643544.248079 read 0x009569 thru 0x013868 (0xa300 bytes) 000349 1788643544.261293 mapread 0x015cf7 thru 0x018589 (0x2893 bytes) 000351 1788643544.281000 mapwrite 0x03b1b8 thru 0x03ffff (0x4e48 bytes) 000352 1788643544.361792 write 0x033fde thru 0x03ffff (0xc022 bytes) 000353 1788643544.369996 write 0x0377c5 thru 0x03955e (0x1d9a bytes) 000354 1788643544.371688 punch from 0x015fa4 to 0x01ea73 (0x8ad0 bytes) 000355 1788643544.390005 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3e00c141 (stale) Mirror 5: 0x69ca95d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3e00c141 (stale) Mirror 5: 0x69ca95d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000356 1788643544.795002 trunc from 0x040000 to 0x027ed9 (0x18126 bytes) 000357 1788643544.818450 MIRROR_RESYNC 3 mirrors 000358 1788643545.745526 MIRROR_EXTEND to 4 mirrors 000360 1788643546.429923 read 0x01e634 thru 0x02358a (0x4f57 bytes) 000361 1788643546.447296 mapread 0x020bc3 thru 0x027ed9 (0x7317 bytes) 000362 1788643546.473519 mapread 0x01dfd0 thru 0x027ed9 (0x9f0a bytes) 000363 1788643546.502630 write 0x01d77d thru 0x025a26 (0x82aa bytes) 000364 1788643546.573761 trunc from 0x027eda to 0x03b9ae (0x13ad5 bytes) 000365 1788643546.617567 punch from 0x00c394 to 0x0175ac (0xb219 bytes) 000366 1788643546.650994 write 0x022a19 thru 0x02b0c4 (0x86ac bytes) 000367 1788643546.664812 trunc from 0x03b9af to 0x016d65 (0x24c49 bytes) 000368 1788643546.699588 MIRROR_RESYNC 4 mirrors 000369 1788643547.781081 write 0x005040 thru 0x00e1b8 (0x9179 bytes) 000371 1788643547.885410 mapwrite 0x0361f2 thru 0x03dce2 (0x7af1 bytes) 000372 1788643548.017382 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dce3): Mirror 5: 0x6462b46 (stale) Mirror 6: 0x6462b46 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dce3): Mirror 5: 0x6462b46 (stale) Mirror 6: 0x6462b46 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dce3: skipped 000375 1788643548.384887 trunc from 0x03dce3 to 0x01f61c (0x1e6c6 bytes) 000377 1788643548.407506 read 0x0067c9 thru 0x011517 (0xad4f bytes) 000378 1788643548.424223 MIRROR_RESYNC 3 mirrors 000380 1788643549.447282 write 0x0127dd thru 0x018740 (0x5f64 bytes) 000383 1788643549.616022 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f61d): Mirror 6: 0xdf13ae7e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f61d): Mirror 6: 0xdf13ae7e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f61d: skipped 000384 1788643549.935263 read 0x0007c7 thru 0x00d4a6 (0xcce0 bytes) 000385 1788643549.965083 mapread 0x009c83 thru 0x0108c7 (0x6c45 bytes) 000386 1788643550.011153 punch from 0x01c9fa to 0x01f61c (0x2c23 bytes) truncating to largest ever: 0x3e364 000387 1788643550.017118 trunc from 0x01f61d to 0x03e363 (0x1ed47 bytes) 000388 1788643550.047358 read 0x0372b9 thru 0x03e363 (0x70ab bytes) 000389 1788643550.062411 punch from 0x032572 to 0x03d9be (0xb44d bytes) 000391 1788643550.070639 read 0x024309 thru 0x02a2c4 (0x5fbc bytes) 000392 1788643550.072512 write 0x008015 thru 0x015e6f (0xde5b bytes) 000393 1788643550.075481 write 0x00302e thru 0x011196 (0xe169 bytes) 000394 1788643550.089378 MIRROR_RESYNC 2 mirrors 000395 1788643550.955748 MIRROR_EXTEND to 3 mirrors 000396 1788643551.769690 trunc from 0x03e364 to 0x013cfd (0x2a666 bytes) 000398 1788643551.893962 read 0x0053c9 thru 0x00b6a2 (0x62da bytes) 000400 1788643551.906623 mapread 0x00d6c5 thru 0x013cfd (0x6639 bytes) 000402 1788643551.933880 mapread 0x00572e thru 0x00feba (0xa78d bytes) 000403 1788643551.934840 trunc from 0x013cfe to 0x008d5c (0xafa1 bytes) 000404 1788643551.957404 read 0x000b64 thru 0x008d5c (0x81f9 bytes) 000405 1788643551.968605 write 0x037963 thru 0x03ffff (0x869d bytes) 000408 1788643551.977496 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe6897da0 (stale) Mirror 7: 0xe6897da0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd4795efe Mirror 8: 0xd4795efe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000409 1788643553.336068 read 0x0392be thru 0x03ffff (0x6d42 bytes) 000411 1788643553.366517 write 0x00f993 thru 0x0165a9 (0x6c17 bytes) 000413 1788643553.458669 punch from 0x02ae3f to 0x03ab0c (0xfcce bytes) 000414 1788643553.471926 mapread 0x03614a thru 0x03c378 (0x622f bytes) 000419 1788643553.494623 mapwrite 0x007a48 thru 0x01644a (0xea03 bytes) 000423 1788643553.566872 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe6897da0 (stale) Mirror 7: 0xe6897da0 (stale) Mirror 8: 0xd4795efe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x831a1f91 Mirror 9: 0x831a1f91 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000424 1788643554.606893 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe6897da0 (stale) Mirror 7: 0xe6897da0 (stale) Mirror 8: 0xd4795efe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x831a1f91 Mirror 9: 0x831a1f91 Mirror 10: 0x831a1f91 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000425 1788643555.708433 read 0x00c567 thru 0x011efd (0x5997 bytes) 000426 1788643555.729573 mapwrite 0x034552 thru 0x038a51 (0x4500 bytes) 000427 1788643555.895391 punch from 0x022447 to 0x032163 (0xfd1d bytes) 000428 1788643555.903181 read 0x0111f8 thru 0x0182ae (0x70b7 bytes) 000429 1788643555.919089 trunc from 0x040000 to 0x00e09c (0x31f63 bytes) 000431 1788643555.961987 mapwrite 0x01e31e thru 0x02d06d (0xed50 bytes) 000432 1788643556.159743 read 0x00486c thru 0x00f9a5 (0xb13a bytes) 000434 1788643556.180944 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2d06e): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d06e): Mirror 6: 0x23e57eca (stale) Mirror 7: 0x23e57eca (stale) Mirror 8: 0xeebffde5 (stale) Mirror 9: 0xa0a853fd (stale) Mirror 10: 0xa0a853fd (stale) CRC-32 checksum value for chunk [0, 0x2d06e): Mirror 1: 0x46b9e5f8 Mirror 11: 0x46b9e5f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d06e: skipped 000435 1788643557.206656 trunc from 0x02d06e to 0x0251b6 (0x7eb7 bytes) 000436 1788643557.401854 read 0x0170ad thru 0x020552 (0x94a6 bytes) 000437 1788643557.413946 mapread 0x0167ef thru 0x01b9af (0x51c1 bytes) 000438 1788643557.428796 mapwrite 0x02d12d thru 0x03b79b (0xe66f bytes) 000439 1788643557.578586 read 0x023fc3 thru 0x027428 (0x3466 bytes) 000440 1788643557.618531 write 0x00c623 thru 0x00dc4e (0x162c bytes) 000441 1788643557.619618 write 0x005081 thru 0x012534 (0xd4b4 bytes) 000443 1788643557.629503 mapwrite 0x030749 thru 0x032d51 (0x2609 bytes) 000444 1788643557.810620 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b79c): Mirror 6: 0x1c8b7649 (stale) Mirror 7: 0x1c8b7649 (stale) Mirror 8: 0x25ebdcf1 (stale) Mirror 9: 0xff119f82 (stale) Mirror 11: 0xd24306d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b79c): Mirror 6: 0x1c8b7649 (stale) Mirror 7: 0x1c8b7649 (stale) Mirror 8: 0x25ebdcf1 (stale) Mirror 9: 0xff119f82 (stale) Mirror 11: 0xd24306d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b79c: skipped 000445 1788643558.428252 write 0x01ce72 thru 0x027d59 (0xaee8 bytes) 000446 1788643558.443860 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b79c): Mirror 7: 0x1c8b7649 (stale) Mirror 8: 0x25ebdcf1 (stale) Mirror 9: 0xff119f82 (stale) Mirror 11: 0xd24306d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b79c): Mirror 7: 0x1c8b7649 (stale) Mirror 8: 0x25ebdcf1 (stale) Mirror 9: 0xff119f82 (stale) Mirror 11: 0xd24306d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b79c: skipped 000447 1788643558.983790 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b79c): Mirror 7: 0x1c8b7649 (stale) Mirror 9: 0xff119f82 (stale) Mirror 11: 0xd24306d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b79c): Mirror 7: 0x1c8b7649 (stale) Mirror 9: 0xff119f82 (stale) Mirror 11: 0xd24306d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b79c: skipped 000448 1788643559.437862 trunc from 0x03b79c to 0x00a95b (0x30e40 bytes) 000449 1788643559.465816 mapread 0x004d92 thru 0x00a95b (0x5bca bytes) 000452 1788643559.542127 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xa95c): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa95c): Mirror 7: 0x48fe8944 (stale) Mirror 9: 0x2a7c1b1 (stale) Mirror 11: 0x2a7c1b1 (stale) CRC-32 checksum value for chunk [0, 0xa95c): Mirror 1: 0xbbcd75e5 Mirror 12: 0xbbcd75e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa95c: skipped 000453 1788643561.088102 trunc from 0x00a95c to 0x010a62 (0x6107 bytes) 000454 1788643561.210285 MIRROR_RESYNC 5 mirrors 000456 1788643563.161961 write 0x03e42f thru 0x03ffff (0x1bd1 bytes) 000457 1788643563.256789 punch from 0x037fed to 0x03e930 (0x6944 bytes) 000458 1788643563.285495 punch from 0x0092b6 to 0x0112f5 (0x8040 bytes) 000459 1788643563.308377 MIRROR_RESYNC 5 mirrors 000460 1788643565.191302 mapread 0x000feb thru 0x00b5d9 (0xa5ef bytes) 000461 1788643565.226452 trunc from 0x040000 to 0x033132 (0xcecd bytes) 000464 1788643565.347891 trunc from 0x033133 to 0x03d232 (0xa100 bytes) 000469 1788643565.380592 mapread 0x02344d thru 0x0297f4 (0x63a8 bytes) 000471 1788643565.395789 mapread 0x01957c thru 0x01b18b (0x1c10 bytes) 000472 1788643565.406520 trunc from 0x03d233 to 0x030ce8 (0xc54a bytes) 000473 1788643565.432408 mapread 0x01e516 thru 0x023c7e (0x5769 bytes) 000474 1788643565.434160 write 0x01234e thru 0x01b61b (0x92ce bytes) 000475 1788643565.438492 read 0x019f8f thru 0x01c00d (0x207f bytes) 000479 1788643565.441948 trunc from 0x030ce9 to 0x017e03 (0x18ee5 bytes) 000480 1788643565.465051 read 0x007b45 thru 0x008337 (0x7f3 bytes) 000481 1788643565.476319 read 0x003f56 thru 0x008fa7 (0x5052 bytes) 000482 1788643565.477137 mapwrite 0x02e62b thru 0x032512 (0x3ee8 bytes) 000483 1788643565.553118 read 0x011711 thru 0x020be4 (0xf4d4 bytes) 000485 1788643565.556803 read 0x02682b thru 0x0281a1 (0x1977 bytes) 000486 1788643565.557915 punch from 0x0300a0 to 0x032512 (0x2473 bytes) 000489 1788643565.565939 trunc from 0x032513 to 0x02a631 (0x7ee1 bytes) 000491 1788643565.591604 punch from 0x025b8d to 0x02a631 (0x4aa5 bytes) 000492 1788643565.609834 MIRROR_RESYNC 5 mirrors 000493 1788643567.094959 mapwrite 0x033075 thru 0x03805b (0x4fe7 bytes) 000494 1788643567.351456 trunc from 0x03805c to 0x003bd7 (0x34484 bytes) 000495 1788643567.374971 mapwrite 0x021aef thru 0x02e217 (0xc729 bytes) 000497 1788643567.480974 read 0x02c8e4 thru 0x02e217 (0x1934 bytes) 000498 1788643567.482385 mapread 0x02ddbf thru 0x02e217 (0x459 bytes) 000501 1788643567.492616 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e218): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e218): Mirror 7: 0x53594f6b (stale) Mirror 9: 0x53594f6b (stale) Mirror 11: 0x53594f6b (stale) Mirror 12: 0x53594f6b (stale) CRC-32 checksum value for chunk [0, 0x2e218): Mirror 1: 0x142c50e8 Mirror 13: 0x142c50e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e218: skipped 000502 1788643568.833542 trunc from 0x02e218 to 0x0315d5 (0x33be bytes) 000504 1788643568.966350 punch from 0x002b2f to 0x004256 (0x1728 bytes) 000505 1788643568.974083 write 0x0210b3 thru 0x02cbcc (0xbb1a bytes) 000506 1788643568.993037 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x315d6): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x315d6): Mirror 7: 0xde029d8e (stale) Mirror 9: 0xde029d8e (stale) Mirror 11: 0xde029d8e (stale) Mirror 12: 0xde029d8e (stale) Mirror 13: 0x880df889 (stale) CRC-32 checksum value for chunk [0, 0x315d6): Mirror 1: 0xf6be0f50 Mirror 14: 0xf6be0f50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x315d6: skipped 000509 1788643570.703259 write 0x029128 thru 0x03866b (0xf544 bytes) 000510 1788643570.884561 trunc from 0x03866c to 0x000afc (0x37b6f bytes) 000511 1788643570.920138 write 0x029e0e thru 0x02c29b (0x248e bytes) 000512 1788643570.923134 punch from 0x02b055 to 0x02c29b (0x1247 bytes) 000513 1788643570.935952 read 0x011168 thru 0x01f9e1 (0xe87a bytes) truncating to largest ever: 0x3f8ec 000514 1788643570.950092 trunc from 0x02c29c to 0x03f8eb (0x13650 bytes) 000516 1788643570.987538 mapread 0x036f63 thru 0x03f8eb (0x8989 bytes) 000518 1788643571.032759 read 0x00aa03 thru 0x01a05a (0xf658 bytes) 000519 1788643571.055863 trunc from 0x03f8ec to 0x02bc96 (0x13c55 bytes) 000521 1788643571.084710 punch from 0x0006b9 to 0x00312c (0x2a74 bytes) 000522 1788643571.098308 mapwrite 0x0398d1 thru 0x03ffff (0x672f bytes) 000524 1788643571.278684 read 0x01ec74 thru 0x022ca1 (0x402e bytes) 000525 1788643571.279872 write 0x03bd24 thru 0x03ffff (0x42dc bytes) 000526 1788643571.282573 mapread 0x00be89 thru 0x0142ca (0x8442 bytes) 000527 1788643571.290284 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x892f9aef (stale) Mirror 9: 0x892f9aef (stale) Mirror 11: 0x892f9aef (stale) Mirror 12: 0x892f9aef (stale) Mirror 13: 0x8fd7adbf (stale) Mirror 14: 0xc613c87e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa4941983 Mirror 15: 0xa4941983 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000528 1788643573.288704 write 0x00ba44 thru 0x016a34 (0xaff1 bytes) 000529 1788643573.474254 MIRROR_RESYNC 8 mirrors 000531 1788643575.211666 trunc from 0x040000 to 0x0038ff (0x3c700 bytes) 000532 1788643575.297372 read 0x001405 thru 0x0038ff (0x24fb bytes) 000533 1788643575.303136 mapread 0x0000c4 thru 0x0038ff (0x383c bytes) 000536 1788643575.316370 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3900): Mirror 9: 0x8dfc2840 (stale) Mirror 11: 0x8dfc2840 (stale) Mirror 12: 0x8dfc2840 (stale) Mirror 13: 0x8dfc2840 (stale) Mirror 14: 0x8dfc2840 (stale) Mirror 15: 0x8dfc2840 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3900): Mirror 9: 0x8dfc2840 (stale) Mirror 11: 0x8dfc2840 (stale) Mirror 12: 0x8dfc2840 (stale) Mirror 13: 0x8dfc2840 (stale) Mirror 14: 0x8dfc2840 (stale) Mirror 15: 0x8dfc2840 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3900: skipped 000537 1788643575.700393 mapwrite 0x02b592 thru 0x037295 (0xbd04 bytes) 000538 1788643575.795343 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x37296): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37296): Mirror 9: 0x34b8aa97 (stale) Mirror 11: 0x34b8aa97 (stale) Mirror 12: 0x34b8aa97 (stale) Mirror 13: 0x34b8aa97 (stale) Mirror 14: 0x34b8aa97 (stale) Mirror 15: 0x34b8aa97 (stale) CRC-32 checksum value for chunk [0, 0x37296): Mirror 1: 0xc9c180f Mirror 16: 0xc9c180f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37296: skipped 000540 1788643576.832790 write 0x005237 thru 0x00b405 (0x61cf bytes) 000544 1788643576.922866 write 0x015b0f thru 0x01f0d3 (0x95c5 bytes) 000545 1788643576.933088 mapwrite 0x03fe54 thru 0x03ffff (0x1ac bytes) 000546 1788643577.022857 mapread 0x03e20f thru 0x03ffff (0x1df1 bytes) 000548 1788643577.032666 mapwrite 0x01cc26 thru 0x01e79f (0x1b7a bytes) 000550 1788643577.074599 read 0x03e26c thru 0x03ffff (0x1d94 bytes) 000552 1788643577.075934 read 0x01ef3b thru 0x02e982 (0xfa48 bytes) 000554 1788643577.087557 write 0x030677 thru 0x03f719 (0xf0a3 bytes) 000555 1788643577.089789 punch from 0x0100e1 to 0x01eec0 (0xede0 bytes) 000556 1788643577.104709 read 0x00afe6 thru 0x00e52d (0x3548 bytes) 000557 1788643577.105681 mapwrite 0x030ab6 thru 0x0389a7 (0x7ef2 bytes) 000559 1788643577.176397 mapread 0x01a58e thru 0x01e263 (0x3cd6 bytes) 000562 1788643577.198395 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xf2cabca2 (stale) Mirror 11: 0xf2cabca2 (stale) Mirror 12: 0xf2cabca2 (stale) Mirror 13: 0xf2cabca2 (stale) Mirror 14: 0xf2cabca2 (stale) Mirror 15: 0xf2cabca2 (stale) Mirror 16: 0xe18063c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe6946e8d Mirror 17: 0xe6946e8d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000563 1788643578.258735 MIRROR_RESYNC 9 mirrors 000565 1788643580.040345 mapread 0x010a67 thru 0x020a61 (0xfffb bytes) 000566 1788643580.076554 trunc from 0x040000 to 0x02a7b3 (0x1584c bytes) 000567 1788643580.268683 mapwrite 0x037512 thru 0x03ffff (0x8aee bytes) 000568 1788643580.378908 trunc from 0x040000 to 0x01ee2b (0x211d4 bytes) 000569 1788643580.400863 write 0x009115 thru 0x0156b8 (0xc5a4 bytes) 000570 1788643580.428358 read 0x011ff4 thru 0x01b627 (0x9634 bytes) 000571 1788643580.447802 mapread 0x00f872 thru 0x01c2ec (0xca7b bytes) 000574 1788643580.456844 write 0x021915 thru 0x0306ca (0xedb6 bytes) 000575 1788643580.465416 mapwrite 0x03726c thru 0x03dccd (0x6a62 bytes) 000576 1788643580.641235 write 0x02340d thru 0x02ed54 (0xb948 bytes) 000577 1788643580.642581 punch from 0x0174c1 to 0x024496 (0xcfd6 bytes) 000578 1788643580.664654 mapwrite 0x03119f thru 0x03445b (0x32bd bytes) 000579 1788643580.737339 MIRROR_RESYNC 9 mirrors 000581 1788643582.513550 mapwrite 0x00ff50 thru 0x01c06e (0xc11f bytes) 000582 1788643582.754378 trunc from 0x03dcce to 0x00f235 (0x2ea98 bytes) 000583 1788643582.792809 mapwrite 0x02a203 thru 0x035425 (0xb223 bytes) 000584 1788643582.894638 mapwrite 0x00e290 thru 0x015969 (0x76da bytes) 000586 1788643582.956265 mapread 0x02000a thru 0x0228b5 (0x28ac bytes) 000587 1788643582.964256 trunc from 0x035426 to 0x011953 (0x23ad2 bytes) 000588 1788643582.983176 write 0x007a07 thru 0x00a6d8 (0x2cd2 bytes) 000589 1788643582.989591 write 0x01cecf thru 0x0265fb (0x972d bytes) 000590 1788643582.995665 MIRROR_RESYNC 9 mirrors 000591 1788643584.713497 MIRROR_EXTEND to 10 mirrors 000592 1788643585.771404 mapwrite 0x019f74 thru 0x020265 (0x62f2 bytes) 000595 1788643586.042809 punch from 0x0026c0 to 0x00a97b (0x82bc bytes) 000597 1788643586.054736 mapread 0x00c2fe thru 0x019689 (0xd38c bytes) 000599 1788643586.073966 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x265fc): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x265fc): Mirror 9: 0x451804c (stale) Mirror 11: 0x451804c (stale) Mirror 12: 0x451804c (stale) Mirror 13: 0x451804c (stale) Mirror 14: 0x451804c (stale) Mirror 15: 0x451804c (stale) Mirror 16: 0x451804c (stale) Mirror 17: 0x451804c (stale) Mirror 18: 0x451804c (stale) CRC-32 checksum value for chunk [0, 0x265fc): Mirror 1: 0x660e0e9c Mirror 19: 0x660e0e9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x265fc: skipped 000601 1788643587.290975 mapread 0x01ba90 thru 0x0265fb (0xab6c bytes) 000604 1788643587.424068 mapwrite 0x0376f2 thru 0x03ffff (0x890e bytes) 000607 1788643587.638301 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xca114b9e (stale) Mirror 11: 0xca114b9e (stale) Mirror 12: 0xca114b9e (stale) Mirror 13: 0xca114b9e (stale) Mirror 14: 0xca114b9e (stale) Mirror 15: 0xca114b9e (stale) Mirror 16: 0xca114b9e (stale) Mirror 17: 0xca114b9e (stale) Mirror 18: 0xca114b9e (stale) Mirror 19: 0x1fd99422 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa69cb80f Mirror 20: 0xa69cb80f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000608 1788643589.033850 write 0x014043 thru 0x017534 (0x34f2 bytes) 000609 1788643589.148119 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xca114b9e (stale) Mirror 11: 0xca114b9e (stale) Mirror 12: 0xca114b9e (stale) Mirror 13: 0xca114b9e (stale) Mirror 14: 0xca114b9e (stale) Mirror 15: 0xca114b9e (stale) Mirror 16: 0xca114b9e (stale) Mirror 17: 0xca114b9e (stale) Mirror 18: 0xca114b9e (stale) Mirror 19: 0x1fd99422 (stale) Mirror 20: 0xa69cb80f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5bf290a7 Mirror 21: 0x5bf290a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000610 1788643590.526877 write 0x0194e6 thru 0x01ccb9 (0x37d4 bytes) 000612 1788643590.695054 write 0x03deeb thru 0x03e257 (0x36d bytes) 000613 1788643590.703964 write 0x0198a6 thru 0x0240ff (0xa85a bytes) 000614 1788643590.708492 write 0x024808 thru 0x02e1a9 (0x99a2 bytes) 000615 1788643590.714066 mapread 0x00c318 thru 0x014652 (0x833b bytes) 000616 1788643590.757626 punch from 0x02d294 to 0x032a9a (0x5807 bytes) 000617 1788643590.785162 trunc from 0x040000 to 0x01bf56 (0x240a9 bytes) 000618 1788643590.821428 write 0x020ebc thru 0x02fb1e (0xec63 bytes) 000619 1788643590.828664 write 0x012c25 thru 0x018483 (0x585f bytes) 000621 1788643590.846497 write 0x021c55 thru 0x02238c (0x738 bytes) 000622 1788643590.850128 trunc from 0x02fb1f to 0x02edb2 (0xd6c bytes) 000623 1788643590.887292 mapwrite 0x000b14 thru 0x0085c9 (0x7ab6 bytes) 000624 1788643590.987046 read 0x024c60 thru 0x028cdd (0x407e bytes) 000625 1788643590.988720 read 0x00975c thru 0x00a751 (0xff6 bytes) 000627 1788643590.990984 write 0x03fc03 thru 0x03ffff (0x3fd bytes) 000628 1788643590.995138 read 0x02725d thru 0x030df9 (0x9b9d bytes) 000629 1788643591.023895 mapwrite 0x028499 thru 0x031556 (0x90be bytes) 000630 1788643591.107002 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xca114b9e (stale) Mirror 11: 0xca114b9e (stale) Mirror 12: 0xca114b9e (stale) Mirror 13: 0xca114b9e (stale) Mirror 14: 0xca114b9e (stale) Mirror 15: 0xca114b9e (stale) Mirror 16: 0xca114b9e (stale) Mirror 17: 0xca114b9e (stale) Mirror 18: 0xca114b9e (stale) Mirror 19: 0x1fd99422 (stale) Mirror 20: 0xa69cb80f (stale) Mirror 21: 0x5bf290a7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa66b91eb Mirror 22: 0xa66b91eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000631 1788643592.235408 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xca114b9e (stale) Mirror 11: 0xca114b9e (stale) Mirror 12: 0xca114b9e (stale) Mirror 13: 0xca114b9e (stale) Mirror 14: 0xca114b9e (stale) Mirror 15: 0xca114b9e (stale) Mirror 16: 0xca114b9e (stale) Mirror 17: 0xca114b9e (stale) Mirror 18: 0xca114b9e (stale) Mirror 19: 0x1fd99422 (stale) Mirror 20: 0xa69cb80f (stale) Mirror 21: 0x5bf290a7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa66b91eb Mirror 22: 0xa66b91eb Mirror 23: 0xa66b91eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000635 1788643593.475782 mapread 0x0124c9 thru 0x01e182 (0xbcba bytes) 000639 1788643593.536748 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xca114b9e (stale) Mirror 11: 0xca114b9e (stale) Mirror 12: 0xca114b9e (stale) Mirror 13: 0xca114b9e (stale) Mirror 14: 0xca114b9e (stale) Mirror 15: 0xca114b9e (stale) Mirror 16: 0xca114b9e (stale) Mirror 17: 0xca114b9e (stale) Mirror 18: 0xca114b9e (stale) Mirror 19: 0x1fd99422 (stale) Mirror 20: 0xa69cb80f (stale) Mirror 21: 0x5bf290a7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa66b91eb Mirror 22: 0xa66b91eb Mirror 23: 0xa66b91eb Mirror 24: 0xa66b91eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000640 1788643594.952842 trunc from 0x040000 to 0x02bef4 (0x1410b bytes) 000641 1788643595.135626 mapread 0x01a63e thru 0x0205b5 (0x5f78 bytes) 000644 1788643595.177553 punch from 0x024550 to 0x02bef4 (0x79a5 bytes) 000645 1788643595.193863 mapread 0x01f209 thru 0x026e18 (0x7c10 bytes) 000646 1788643595.213761 punch from 0x00123f to 0x0033c5 (0x2187 bytes) 000647 1788643595.221519 mapwrite 0x01a838 thru 0x021a57 (0x7220 bytes) 000651 1788643595.286464 read 0x002c82 thru 0x00c491 (0x9810 bytes) 000652 1788643595.298958 trunc from 0x02bef5 to 0x01b91e (0x105d6 bytes) 000653 1788643595.322370 read 0x01b35e thru 0x01b91e (0x5c1 bytes) 000654 1788643595.323534 trunc from 0x01b91f to 0x02fc40 (0x14322 bytes) 000655 1788643595.350626 mapwrite 0x010979 thru 0x019c03 (0x928b bytes) 000656 1788643595.436283 trunc from 0x02fc41 to 0x01904e (0x16bf2 bytes) 000657 1788643595.465581 mapread 0x013856 thru 0x01904e (0x57f9 bytes) 000658 1788643595.466628 write 0x0250a6 thru 0x02e6a0 (0x95fb bytes) 000661 1788643595.472176 read 0x01f1ba thru 0x0281c2 (0x9009 bytes) 000662 1788643595.487075 mapwrite 0x02c680 thru 0x03a6ce (0xe04f bytes) 000663 1788643595.594502 mapread 0x02aa23 thru 0x02ee5d (0x443b bytes) 000664 1788643595.595694 punch from 0x0341e4 to 0x0367a5 (0x25c2 bytes) 000666 1788643595.610386 trunc from 0x03a6cf to 0x039db3 (0x91b bytes) 000669 1788643595.630764 punch from 0x034d86 to 0x039db3 (0x502e bytes) 000672 1788643595.639364 punch from 0x012a44 to 0x018a25 (0x5fe2 bytes) 000673 1788643595.645142 write 0x00aa1b thru 0x015fdd (0xb5c3 bytes) 000674 1788643595.652554 punch from 0x01cd17 to 0x02551d (0x8807 bytes) 000675 1788643595.672923 mapwrite 0x010ca8 thru 0x020ba3 (0xfefc bytes) 000677 1788643595.790496 mapread 0x03781e thru 0x039db3 (0x2596 bytes) 000679 1788643595.821630 mapread 0x020932 thru 0x0223ae (0x1a7d bytes) 000680 1788643595.837269 trunc from 0x039db4 to 0x016252 (0x23b61 bytes) 000681 1788643595.860772 trunc from 0x016253 to 0x001236 (0x1501c bytes) 000682 1788643595.890260 punch from 0x0006a8 to 0x001236 (0xb8f bytes) 000683 1788643595.895098 mapread 0x00086a thru 0x001236 (0x9cd bytes) 000685 1788643595.914117 read 0x000932 thru 0x001236 (0x905 bytes) 000687 1788643595.915371 punch from 0x000412 to 0x001236 (0xe25 bytes) 000688 1788643595.925672 write 0x00b5a1 thru 0x018d08 (0xd768 bytes) 000689 1788643595.927447 write 0x03f367 thru 0x03ffff (0xc99 bytes) 000692 1788643595.943398 write 0x013323 thru 0x01d84f (0xa52d bytes) 000693 1788643595.959370 mapread 0x0170f8 thru 0x018a04 (0x190d bytes) 000694 1788643595.961867 mapwrite 0x012c50 thru 0x0206b5 (0xda66 bytes) 000696 1788643596.066978 read 0x00e319 thru 0x01dbe9 (0xf8d1 bytes) 000697 1788643596.068054 read 0x011248 thru 0x017ab6 (0x686f bytes) 000698 1788643596.075354 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xca114b9e (stale) Mirror 12: 0xca114b9e (stale) Mirror 13: 0xca114b9e (stale) Mirror 14: 0xca114b9e (stale) Mirror 15: 0xca114b9e (stale) Mirror 16: 0xca114b9e (stale) Mirror 17: 0xca114b9e (stale) Mirror 18: 0xca114b9e (stale) Mirror 19: 0x1fd99422 (stale) Mirror 20: 0xa69cb80f (stale) Mirror 21: 0x5bf290a7 (stale) Mirror 22: 0xa66b91eb (stale) Mirror 23: 0xa66b91eb (stale) Mirror 24: 0xa66b91eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xca114b9e (stale) Mirror 12: 0xca114b9e (stale) Mirror 13: 0xca114b9e (stale) Mirror 14: 0xca114b9e (stale) Mirror 15: 0xca114b9e (stale) Mirror 16: 0xca114b9e (stale) Mirror 17: 0xca114b9e (stale) Mirror 18: 0xca114b9e (stale) Mirror 19: 0x1fd99422 (stale) Mirror 20: 0xa69cb80f (stale) Mirror 21: 0x5bf290a7 (stale) Mirror 22: 0xa66b91eb (stale) Mirror 23: 0xa66b91eb (stale) Mirror 24: 0xa66b91eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000699 1788643596.976217 mapread 0x00685c thru 0x007c02 (0x13a7 bytes) 000700 1788643596.989797 read 0x03373a thru 0x03d8ca (0xa191 bytes) 000701 1788643597.001671 read 0x00ac09 thru 0x010f48 (0x6340 bytes) 000702 1788643597.016127 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xca114b9e (stale) Mirror 12: 0xca114b9e (stale) Mirror 13: 0xca114b9e (stale) Mirror 14: 0xca114b9e (stale) Mirror 15: 0xca114b9e (stale) Mirror 16: 0xca114b9e (stale) Mirror 17: 0xca114b9e (stale) Mirror 18: 0xca114b9e (stale) Mirror 19: 0x1fd99422 (stale) Mirror 20: 0xa69cb80f (stale) Mirror 21: 0x5bf290a7 (stale) Mirror 22: 0xa66b91eb (stale) Mirror 23: 0xa66b91eb (stale) Mirror 24: 0xa66b91eb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5109d096 Mirror 25: 0x5109d096 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000703 1788643598.423162 mapwrite 0x0294ba thru 0x02a1c4 (0xd0b bytes) 000704 1788643598.727777 mapwrite 0x023b26 thru 0x029c8f (0x616a bytes) 000705 1788643598.818336 punch from 0x027697 to 0x032098 (0xaa02 bytes) 000709 1788643598.835441 read 0x03786f thru 0x03ffff (0x8791 bytes) 000711 1788643598.883257 MIRROR_RESYNC 16 mirrors 000712 1788643602.045302 trunc from 0x040000 to 0x033f20 (0xc0df bytes) 000714 1788643602.194601 MIRROR_SPLIT mirror 15 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33f21): Mirror 11: 0x49ccdec (stale) Mirror 12: 0x49ccdec (stale) Mirror 13: 0x49ccdec (stale) Mirror 14: 0x49ccdec (stale) Mirror 15: 0x49ccdec (stale) Mirror 16: 0x49ccdec (stale) Mirror 17: 0x49ccdec (stale) Mirror 18: 0x49ccdec (stale) Mirror 19: 0x49ccdec (stale) Mirror 20: 0x49ccdec (stale) Mirror 21: 0x49ccdec (stale) Mirror 22: 0x49ccdec (stale) Mirror 23: 0x49ccdec (stale) Mirror 24: 0x49ccdec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f21): Mirror 11: 0x49ccdec (stale) Mirror 12: 0x49ccdec (stale) Mirror 13: 0x49ccdec (stale) Mirror 14: 0x49ccdec (stale) Mirror 15: 0x49ccdec (stale) Mirror 16: 0x49ccdec (stale) Mirror 17: 0x49ccdec (stale) Mirror 18: 0x49ccdec (stale) Mirror 19: 0x49ccdec (stale) Mirror 20: 0x49ccdec (stale) Mirror 21: 0x49ccdec (stale) Mirror 22: 0x49ccdec (stale) Mirror 23: 0x49ccdec (stale) Mirror 24: 0x49ccdec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f21: skipped 000715 1788643603.016718 read 0x016910 thru 0x021aa2 (0xb193 bytes) 000716 1788643603.029913 trunc from 0x033f21 to 0x019322 (0x1abfe bytes) 000717 1788643603.050761 MIRROR_SPLIT mirror 9 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19323): Mirror 11: 0x97f8ef66 (stale) Mirror 12: 0x97f8ef66 (stale) Mirror 13: 0x97f8ef66 (stale) Mirror 14: 0x97f8ef66 (stale) Mirror 15: 0x97f8ef66 (stale) Mirror 16: 0x97f8ef66 (stale) Mirror 17: 0x97f8ef66 (stale) Mirror 18: 0x97f8ef66 (stale) Mirror 20: 0x97f8ef66 (stale) Mirror 21: 0x97f8ef66 (stale) Mirror 22: 0x97f8ef66 (stale) Mirror 23: 0x97f8ef66 (stale) Mirror 24: 0x97f8ef66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19323): Mirror 11: 0x97f8ef66 (stale) Mirror 12: 0x97f8ef66 (stale) Mirror 13: 0x97f8ef66 (stale) Mirror 14: 0x97f8ef66 (stale) Mirror 15: 0x97f8ef66 (stale) Mirror 16: 0x97f8ef66 (stale) Mirror 17: 0x97f8ef66 (stale) Mirror 18: 0x97f8ef66 (stale) Mirror 20: 0x97f8ef66 (stale) Mirror 21: 0x97f8ef66 (stale) Mirror 22: 0x97f8ef66 (stale) Mirror 23: 0x97f8ef66 (stale) Mirror 24: 0x97f8ef66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19323: skipped 000719 1788643603.736040 mapwrite 0x005603 thru 0x014a45 (0xf443 bytes) 000720 1788643603.841231 trunc from 0x019323 to 0x00eb31 (0xa7f1 bytes) 000721 1788643603.893226 write 0x00bb63 thru 0x013521 (0x79bf bytes) 000722 1788643603.897290 mapread 0x003097 thru 0x012956 (0xf8c0 bytes) 000723 1788643603.918013 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13522): Mirror 12: 0xb58c1e07 (stale) Mirror 13: 0xb58c1e07 (stale) Mirror 14: 0xb58c1e07 (stale) Mirror 15: 0xb58c1e07 (stale) Mirror 16: 0xb58c1e07 (stale) Mirror 17: 0xb58c1e07 (stale) Mirror 18: 0xb58c1e07 (stale) Mirror 20: 0xb58c1e07 (stale) Mirror 21: 0xb58c1e07 (stale) Mirror 22: 0xb58c1e07 (stale) Mirror 23: 0xb58c1e07 (stale) Mirror 24: 0xb58c1e07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13522): Mirror 12: 0xb58c1e07 (stale) Mirror 13: 0xb58c1e07 (stale) Mirror 14: 0xb58c1e07 (stale) Mirror 15: 0xb58c1e07 (stale) Mirror 16: 0xb58c1e07 (stale) Mirror 17: 0xb58c1e07 (stale) Mirror 18: 0xb58c1e07 (stale) Mirror 20: 0xb58c1e07 (stale) Mirror 21: 0xb58c1e07 (stale) Mirror 22: 0xb58c1e07 (stale) Mirror 23: 0xb58c1e07 (stale) Mirror 24: 0xb58c1e07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13522: skipped 000725 1788643604.662669 punch from 0x009ca3 to 0x013521 (0x987f bytes) 000726 1788643604.667912 punch from 0x0021cd to 0x00567d (0x34b1 bytes) 000728 1788643604.673695 write 0x025380 thru 0x026809 (0x148a bytes) 000729 1788643604.675107 punch from 0x00c52c to 0x01662a (0xa0ff bytes) 000730 1788643604.687297 write 0x00cfdf thru 0x0146da (0x76fc bytes) 000731 1788643604.697389 write 0x00e939 thru 0x01b77b (0xce43 bytes) 000732 1788643604.703942 write 0x03ed98 thru 0x03ffff (0x1268 bytes) 000737 1788643604.708154 punch from 0x004d7a to 0x009f30 (0x51b7 bytes) 000738 1788643604.726630 read 0x00375b thru 0x008011 (0x48b7 bytes) 000740 1788643604.736729 mapread 0x012a53 thru 0x019f33 (0x74e1 bytes) 000741 1788643604.738022 mapread 0x03c4ad thru 0x03c985 (0x4d9 bytes) 000743 1788643604.744965 write 0x023856 thru 0x03016f (0xc91a bytes) 000744 1788643604.760236 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x1c47af23 (stale) Mirror 13: 0x1c47af23 (stale) Mirror 14: 0x1c47af23 (stale) Mirror 15: 0x1c47af23 (stale) Mirror 16: 0x1c47af23 (stale) Mirror 17: 0x1c47af23 (stale) Mirror 18: 0x1c47af23 (stale) Mirror 20: 0x1c47af23 (stale) Mirror 21: 0x1c47af23 (stale) Mirror 22: 0x1c47af23 (stale) Mirror 24: 0x1c47af23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x1c47af23 (stale) Mirror 13: 0x1c47af23 (stale) Mirror 14: 0x1c47af23 (stale) Mirror 15: 0x1c47af23 (stale) Mirror 16: 0x1c47af23 (stale) Mirror 17: 0x1c47af23 (stale) Mirror 18: 0x1c47af23 (stale) Mirror 20: 0x1c47af23 (stale) Mirror 21: 0x1c47af23 (stale) Mirror 22: 0x1c47af23 (stale) Mirror 24: 0x1c47af23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000746 1788643605.576037 trunc from 0x040000 to 0x0043bb (0x3bc44 bytes) 000747 1788643605.599151 write 0x003b2a thru 0x00b6c5 (0x7b9c bytes) 000748 1788643605.604580 write 0x028599 thru 0x033dd5 (0xb83d bytes) 000749 1788643605.606608 trunc from 0x033dd6 to 0x0341c9 (0x3f4 bytes) 000751 1788643605.627102 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x341ca): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x341ca): Mirror 12: 0x69dec4fe (stale) Mirror 13: 0x69dec4fe (stale) Mirror 14: 0x69dec4fe (stale) Mirror 15: 0x69dec4fe (stale) Mirror 16: 0x69dec4fe (stale) Mirror 17: 0x69dec4fe (stale) Mirror 18: 0x69dec4fe (stale) Mirror 20: 0x69dec4fe (stale) Mirror 21: 0x69dec4fe (stale) Mirror 22: 0x69dec4fe (stale) Mirror 24: 0x69dec4fe (stale) CRC-32 checksum value for chunk [0, 0x341ca): Mirror 1: 0xce4a264e Mirror 25: 0xce4a264e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x341ca: skipped 000752 1788643607.287514 read 0x023c9d thru 0x02edf5 (0xb159 bytes) 000756 1788643607.352391 MIRROR_RESYNC 13 mirrors 000758 1788643610.546534 mapread 0x02e1e6 thru 0x02f928 (0x1743 bytes) 000759 1788643610.556245 mapwrite 0x03b74c thru 0x03c1d8 (0xa8d bytes) 000760 1788643610.729264 write 0x01cccf thru 0x020fd8 (0x430a bytes) 000762 1788643610.744417 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c1d9): Mirror 12: 0xd92343d7 (stale) Mirror 13: 0xd92343d7 (stale) Mirror 14: 0xd92343d7 (stale) Mirror 15: 0xd92343d7 (stale) Mirror 16: 0xd92343d7 (stale) Mirror 17: 0xd92343d7 (stale) Mirror 18: 0xd92343d7 (stale) Mirror 20: 0xd92343d7 (stale) Mirror 21: 0xd92343d7 (stale) Mirror 24: 0xd92343d7 (stale) Mirror 25: 0xd92343d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1d9): Mirror 12: 0xd92343d7 (stale) Mirror 13: 0xd92343d7 (stale) Mirror 14: 0xd92343d7 (stale) Mirror 15: 0xd92343d7 (stale) Mirror 16: 0xd92343d7 (stale) Mirror 17: 0xd92343d7 (stale) Mirror 18: 0xd92343d7 (stale) Mirror 20: 0xd92343d7 (stale) Mirror 21: 0xd92343d7 (stale) Mirror 24: 0xd92343d7 (stale) Mirror 25: 0xd92343d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1d9: skipped 000764 1788643611.518424 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c1d9): Mirror 12: 0xd92343d7 (stale) Mirror 13: 0xd92343d7 (stale) Mirror 14: 0xd92343d7 (stale) Mirror 15: 0xd92343d7 (stale) Mirror 17: 0xd92343d7 (stale) Mirror 18: 0xd92343d7 (stale) Mirror 20: 0xd92343d7 (stale) Mirror 21: 0xd92343d7 (stale) Mirror 24: 0xd92343d7 (stale) Mirror 25: 0xd92343d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1d9): Mirror 12: 0xd92343d7 (stale) Mirror 13: 0xd92343d7 (stale) Mirror 14: 0xd92343d7 (stale) Mirror 15: 0xd92343d7 (stale) Mirror 17: 0xd92343d7 (stale) Mirror 18: 0xd92343d7 (stale) Mirror 20: 0xd92343d7 (stale) Mirror 21: 0xd92343d7 (stale) Mirror 24: 0xd92343d7 (stale) Mirror 25: 0xd92343d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1d9: skipped 000765 1788643612.316701 write 0x018937 thru 0x024fd5 (0xc69f bytes) 000766 1788643612.339408 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c1d9): Mirror 12: 0xd92343d7 (stale) Mirror 14: 0xd92343d7 (stale) Mirror 15: 0xd92343d7 (stale) Mirror 17: 0xd92343d7 (stale) Mirror 18: 0xd92343d7 (stale) Mirror 20: 0xd92343d7 (stale) Mirror 21: 0xd92343d7 (stale) Mirror 24: 0xd92343d7 (stale) Mirror 25: 0xd92343d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1d9): Mirror 12: 0xd92343d7 (stale) Mirror 14: 0xd92343d7 (stale) Mirror 15: 0xd92343d7 (stale) Mirror 17: 0xd92343d7 (stale) Mirror 18: 0xd92343d7 (stale) Mirror 20: 0xd92343d7 (stale) Mirror 21: 0xd92343d7 (stale) Mirror 24: 0xd92343d7 (stale) Mirror 25: 0xd92343d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1d9: skipped 000769 1788643613.090427 write 0x01a2d6 thru 0x01a562 (0x28d bytes) 000770 1788643613.097798 read 0x0146ab thru 0x01972f (0x5085 bytes) 000772 1788643613.119755 write 0x0146ce thru 0x0188e8 (0x421b bytes) 000773 1788643613.121920 mapwrite 0x037434 thru 0x0375f2 (0x1bf bytes) 000774 1788643613.215112 mapread 0x008106 thru 0x012233 (0xa12e bytes) 000776 1788643613.264417 trunc from 0x03c1d9 to 0x03b7a4 (0xa34 bytes) 000777 1788643613.283152 trunc from 0x03b7a5 to 0x01b4f6 (0x202ae bytes) 000780 1788643613.304651 mapread 0x00d8cb thru 0x0196bf (0xbdf5 bytes) 000781 1788643613.310913 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b4f7): Mirror 14: 0xdd7c8166 (stale) Mirror 15: 0xdd7c8166 (stale) Mirror 17: 0xdd7c8166 (stale) Mirror 18: 0xdd7c8166 (stale) Mirror 20: 0xdd7c8166 (stale) Mirror 21: 0xdd7c8166 (stale) Mirror 24: 0xdd7c8166 (stale) Mirror 25: 0xdd7c8166 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b4f7): Mirror 14: 0xdd7c8166 (stale) Mirror 15: 0xdd7c8166 (stale) Mirror 17: 0xdd7c8166 (stale) Mirror 18: 0xdd7c8166 (stale) Mirror 20: 0xdd7c8166 (stale) Mirror 21: 0xdd7c8166 (stale) Mirror 24: 0xdd7c8166 (stale) Mirror 25: 0xdd7c8166 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b4f7: skipped 000782 1788643613.783321 write 0x03d18e thru 0x03e4ad (0x1320 bytes) 000784 1788643613.801324 MIRROR_RESYNC 9 mirrors 000789 1788643616.952416 trunc from 0x03e4ae to 0x0316b4 (0xcdf9 bytes) 000790 1788643617.090436 mapwrite 0x02926e thru 0x02b0bb (0x1e4e bytes) 000792 1788643617.269889 mapwrite 0x0388fe thru 0x03ffff (0x7702 bytes) 000793 1788643617.382172 read 0x008116 thru 0x00ea44 (0x692f bytes) 000794 1788643617.398024 read 0x031cf3 thru 0x038358 (0x6666 bytes) 000795 1788643617.399534 mapwrite 0x00e216 thru 0x0139f1 (0x57dc bytes) 000796 1788643617.479269 mapwrite 0x01a633 thru 0x02a21b (0xfbe9 bytes) 000798 1788643617.532226 mapread 0x0103d9 thru 0x0142c2 (0x3eea bytes) 000799 1788643617.533396 read 0x01f676 thru 0x027ce4 (0x866f bytes) 000800 1788643617.535262 mapwrite 0x03637e thru 0x036ce3 (0x966 bytes) 000801 1788643617.594405 mapwrite 0x0188e9 thru 0x01f589 (0x6ca1 bytes) 000802 1788643617.663280 punch from 0x028831 to 0x03753e (0xed0e bytes) 000803 1788643617.672437 mapread 0x00103b thru 0x004f4f (0x3f15 bytes) 000804 1788643617.674632 mapread 0x02d6c4 thru 0x036882 (0x91bf bytes) 000805 1788643617.687644 punch from 0x03ef23 to 0x03ffff (0x10dd bytes) 000806 1788643617.693606 read 0x014084 thru 0x01cf1f (0x8e9c bytes) 000807 1788643617.695160 mapread 0x03e74f thru 0x03ffff (0x18b1 bytes) 000808 1788643617.702579 punch from 0x026e6f to 0x027f90 (0x1122 bytes) 000811 1788643617.711484 read 0x03e1ca thru 0x03ffff (0x1e36 bytes) 000813 1788643617.714360 read 0x00bb24 thru 0x010ae0 (0x4fbd bytes) 000814 1788643617.719323 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x83b13a70 (stale) Mirror 15: 0x83b13a70 (stale) Mirror 17: 0x83b13a70 (stale) Mirror 18: 0x83b13a70 (stale) Mirror 20: 0x83b13a70 (stale) Mirror 21: 0x83b13a70 (stale) Mirror 24: 0x83b13a70 (stale) Mirror 25: 0x83b13a70 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x90e28907 Mirror 26: 0x90e28907 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000817 1788643619.088639 read 0x02e51e thru 0x03a007 (0xbaea bytes) 000819 1788643619.113852 read 0x030441 thru 0x03314e (0x2d0e bytes) 000820 1788643619.120559 punch from 0x020c53 to 0x022395 (0x1743 bytes) 000821 1788643619.187397 mapread 0x027b16 thru 0x028ac0 (0xfab bytes) 000822 1788643619.198986 read 0x02998e thru 0x0311d8 (0x784b bytes) 000825 1788643619.204791 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x83b13a70 (stale) Mirror 15: 0x83b13a70 (stale) Mirror 17: 0x83b13a70 (stale) Mirror 18: 0x83b13a70 (stale) Mirror 21: 0x83b13a70 (stale) Mirror 24: 0x83b13a70 (stale) Mirror 25: 0x83b13a70 (stale) Mirror 26: 0x90e28907 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x83b13a70 (stale) Mirror 15: 0x83b13a70 (stale) Mirror 17: 0x83b13a70 (stale) Mirror 18: 0x83b13a70 (stale) Mirror 21: 0x83b13a70 (stale) Mirror 24: 0x83b13a70 (stale) Mirror 25: 0x83b13a70 (stale) Mirror 26: 0x90e28907 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000826 1788643619.649022 punch from 0x039f34 to 0x03dfdf (0x40ac bytes) 000827 1788643619.653333 punch from 0x0076b0 to 0x013ed6 (0xc827 bytes) 000828 1788643619.658636 mapread 0x030cb5 thru 0x03e9f5 (0xdd41 bytes) 000829 1788643619.686040 punch from 0x030922 to 0x034c33 (0x4312 bytes) 000830 1788643619.693635 MIRROR_RESYNC 9 mirrors 000831 1788643621.656214 mapwrite 0x037e51 thru 0x03ffff (0x81af bytes) 000832 1788643621.831156 mapwrite 0x01f898 thru 0x02f54f (0xfcb8 bytes) 000833 1788643621.955518 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xb2e7d76a (stale) Mirror 15: 0xb2e7d76a (stale) Mirror 17: 0xb2e7d76a (stale) Mirror 18: 0xb2e7d76a (stale) Mirror 21: 0xb2e7d76a (stale) Mirror 24: 0xb2e7d76a (stale) Mirror 25: 0xb2e7d76a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xb2e7d76a (stale) Mirror 15: 0xb2e7d76a (stale) Mirror 17: 0xb2e7d76a (stale) Mirror 18: 0xb2e7d76a (stale) Mirror 21: 0xb2e7d76a (stale) Mirror 24: 0xb2e7d76a (stale) Mirror 25: 0xb2e7d76a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000835 1788643622.447105 read 0x02dcc5 thru 0x036eca (0x9206 bytes) 000838 1788643622.461928 punch from 0x03594e to 0x036a67 (0x111a bytes) 000839 1788643622.468398 punch from 0x00f32e to 0x017d48 (0x8a1b bytes) 000841 1788643622.474546 trunc from 0x040000 to 0x000ac5 (0x3f53a bytes) 000843 1788643622.491180 punch from 0x0009ba to 0x000ac5 (0x10c bytes) 000844 1788643622.497151 trunc from 0x000ac6 to 0x0281fd (0x27738 bytes) 000845 1788643622.512586 trunc from 0x0281fe to 0x026e31 (0x13cc bytes) 000846 1788643622.527110 punch from 0x009b96 to 0x00f752 (0x5bbd bytes) 000847 1788643622.532106 punch from 0x00d5b1 to 0x0101c1 (0x2c11 bytes) 000849 1788643622.536959 mapwrite 0x039928 thru 0x03ffff (0x66d8 bytes) 000851 1788643622.620275 mapread 0x01d263 thru 0x02899a (0xb738 bytes) 000855 1788643622.669033 mapwrite 0x0082e4 thru 0x0143d2 (0xc0ef bytes) 000856 1788643622.820119 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xb2e7d76a (stale) Mirror 15: 0xb2e7d76a (stale) Mirror 17: 0xb2e7d76a (stale) Mirror 18: 0xb2e7d76a (stale) Mirror 21: 0xb2e7d76a (stale) Mirror 25: 0xb2e7d76a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xb2e7d76a (stale) Mirror 15: 0xb2e7d76a (stale) Mirror 17: 0xb2e7d76a (stale) Mirror 18: 0xb2e7d76a (stale) Mirror 21: 0xb2e7d76a (stale) Mirror 25: 0xb2e7d76a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000857 1788643623.407435 write 0x03fe05 thru 0x03ffff (0x1fb bytes) 000858 1788643623.413903 mapread 0x026208 thru 0x02827a (0x2073 bytes) 000859 1788643623.432910 mapread 0x00e310 thru 0x01d3a2 (0xf093 bytes) 000860 1788643623.452569 mapwrite 0x0093ef thru 0x00da01 (0x4613 bytes) 000861 1788643623.493110 read 0x032450 thru 0x03f8cd (0xd47e bytes) 000862 1788643623.505599 mapwrite 0x0002a5 thru 0x001847 (0x15a3 bytes) 000864 1788643623.568504 punch from 0x011f87 to 0x01a2f1 (0x836b bytes) 000865 1788643623.574049 punch from 0x01a276 to 0x020a72 (0x67fd bytes) 000866 1788643623.587066 mapread 0x02dd3e thru 0x031918 (0x3bdb bytes) 000867 1788643623.607330 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xb2e7d76a (stale) Mirror 15: 0xb2e7d76a (stale) Mirror 18: 0xb2e7d76a (stale) Mirror 21: 0xb2e7d76a (stale) Mirror 25: 0xb2e7d76a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xb2e7d76a (stale) Mirror 15: 0xb2e7d76a (stale) Mirror 18: 0xb2e7d76a (stale) Mirror 21: 0xb2e7d76a (stale) Mirror 25: 0xb2e7d76a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000868 1788643624.491704 trunc from 0x040000 to 0x01d489 (0x22b76 bytes) 000869 1788643624.541678 write 0x02cdf2 thru 0x02e00d (0x121c bytes) 000870 1788643624.556540 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e00e): Mirror 14: 0x608506e7 (stale) Mirror 15: 0x608506e7 (stale) Mirror 18: 0x608506e7 (stale) Mirror 25: 0x608506e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e00e): Mirror 14: 0x608506e7 (stale) Mirror 15: 0x608506e7 (stale) Mirror 18: 0x608506e7 (stale) Mirror 25: 0x608506e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e00e: skipped 000872 1788643625.081336 write 0x027285 thru 0x02a6e2 (0x345e bytes) 000873 1788643625.092944 write 0x036525 thru 0x0366df (0x1bb bytes) 000874 1788643625.100633 MIRROR_RESYNC 5 mirrors 000875 1788643626.275509 read 0x01ae1f thru 0x02155b (0x673d bytes) 000876 1788643626.290517 MIRROR_EXTEND to 6 mirrors 000877 1788643627.170718 read 0x0302ab thru 0x032bf1 (0x2947 bytes) 000878 1788643627.182033 mapwrite 0x03792f thru 0x03ffff (0x86d1 bytes) 000879 1788643627.382843 mapwrite 0x00f693 thru 0x01df40 (0xe8ae bytes) 000880 1788643627.467173 mapwrite 0x0066e7 thru 0x01021c (0x9b36 bytes) 000881 1788643627.544052 read 0x0278a8 thru 0x033491 (0xbbea bytes) 000882 1788643627.553938 mapwrite 0x013cf3 thru 0x01ce15 (0x9123 bytes) 000885 1788643627.603149 trunc from 0x040000 to 0x020c25 (0x1f3da bytes) 000886 1788643627.628144 read 0x00f3e8 thru 0x01bd97 (0xc9b0 bytes) 000887 1788643627.629169 punch from 0x01773d to 0x018d58 (0x161c bytes) 000888 1788643627.642852 MIRROR_RESYNC 6 mirrors 000889 1788643628.964467 write 0x009414 thru 0x01327e (0x9e6b bytes) 000891 1788643629.072003 trunc from 0x020c26 to 0x027531 (0x690c bytes) 000892 1788643629.121567 mapwrite 0x036f66 thru 0x03ffff (0x909a bytes) 000893 1788643629.396600 trunc from 0x040000 to 0x00a32b (0x35cd4 bytes) 000894 1788643629.427379 read 0x0046ef thru 0x00a32b (0x5c3d bytes) 000895 1788643629.435422 mapwrite 0x0380aa thru 0x03f9ea (0x7941 bytes) 000898 1788643629.638277 mapwrite 0x0032a7 thru 0x007b7d (0x48d7 bytes) 000899 1788643629.707495 read 0x034ddc thru 0x03baf3 (0x6d18 bytes) 000902 1788643629.714762 punch from 0x006fcf to 0x01386f (0xc8a1 bytes) 000903 1788643629.721493 write 0x005763 thru 0x00ff99 (0xa837 bytes) 000904 1788643629.731356 trunc from 0x03f9eb to 0x0377b5 (0x8235 bytes) 000905 1788643629.750493 write 0x017493 thru 0x024b47 (0xd6b5 bytes) 000906 1788643629.766989 trunc from 0x0377b6 to 0x02fd69 (0x7a4c bytes) 000907 1788643629.796426 mapwrite 0x0320a6 thru 0x03b97a (0x98d5 bytes) 000908 1788643629.902061 write 0x03d05f thru 0x03ffff (0x2fa1 bytes) 000909 1788643629.909333 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x74e91741 (stale) Mirror 15: 0x74e91741 (stale) Mirror 18: 0x74e91741 (stale) Mirror 25: 0x74e91741 (stale) Mirror 26: 0x74e91741 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x392ed2a8 Mirror 27: 0x392ed2a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000910 1788643630.954981 MIRROR_RESYNC 7 mirrors 000911 1788643632.435484 read 0x031d01 thru 0x033386 (0x1686 bytes) 000913 1788643632.442162 trunc from 0x040000 to 0x008231 (0x37dce bytes) 000914 1788643632.532493 punch from 0x00439d to 0x008231 (0x3e95 bytes) 000920 1788643632.541389 trunc from 0x008232 to 0x00b697 (0x3466 bytes) 000922 1788643632.564098 punch from 0x0083ad to 0x00b697 (0x32eb bytes) 000923 1788643632.569148 punch from 0x005f2d to 0x00b697 (0x576b bytes) 000924 1788643632.577515 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb698): Mirror 14: 0x22b1e3c7 (stale) Mirror 15: 0x22b1e3c7 (stale) Mirror 18: 0x22b1e3c7 (stale) Mirror 25: 0x22b1e3c7 (stale) Mirror 27: 0x22b1e3c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb698): Mirror 14: 0x22b1e3c7 (stale) Mirror 15: 0x22b1e3c7 (stale) Mirror 18: 0x22b1e3c7 (stale) Mirror 25: 0x22b1e3c7 (stale) Mirror 27: 0x22b1e3c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb698: skipped 000925 1788643633.157583 mapread 0x002cd9 thru 0x00b697 (0x89bf bytes) 000926 1788643633.209972 punch from 0x007da4 to 0x00b697 (0x38f4 bytes) 000927 1788643633.216067 mapread 0x002dbd thru 0x00b697 (0x88db bytes) 000928 1788643633.229735 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xb698): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb698): Mirror 14: 0x22b1e3c7 (stale) Mirror 15: 0x22b1e3c7 (stale) Mirror 18: 0x22b1e3c7 (stale) Mirror 25: 0x22b1e3c7 (stale) Mirror 27: 0x22b1e3c7 (stale) CRC-32 checksum value for chunk [0, 0xb698): Mirror 1: 0xc3e5cdbe Mirror 28: 0xc3e5cdbe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb698: skipped 000930 1788643634.459903 mapwrite 0x030a20 thru 0x03d233 (0xc814 bytes) 000932 1788643634.710604 mapwrite 0x01cbcb thru 0x0291c7 (0xc5fd bytes) 000934 1788643634.822893 punch from 0x01b384 to 0x0285af (0xd22c bytes) 000937 1788643634.830161 mapwrite 0x0398be thru 0x03f256 (0x5999 bytes) 000938 1788643635.008623 read 0x0317fa thru 0x03c4a3 (0xacaa bytes) 000939 1788643635.013895 punch from 0x0359b4 to 0x03f256 (0x98a3 bytes) 000940 1788643635.023240 read 0x027768 thru 0x027ac8 (0x361 bytes) 000942 1788643635.045379 punch from 0x0009bd to 0x00c1b9 (0xb7fd bytes) 000943 1788643635.058895 write 0x002263 thru 0x011299 (0xf037 bytes) 000944 1788643635.066641 write 0x026a9e thru 0x02c5c7 (0x5b2a bytes) 000946 1788643635.075114 mapread 0x0321dd thru 0x03c176 (0x9f9a bytes) 000947 1788643635.076486 write 0x00aff9 thru 0x014356 (0x935e bytes) 000948 1788643635.087000 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3f257): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f257): Mirror 14: 0x1b3a5e8c (stale) Mirror 15: 0x1b3a5e8c (stale) Mirror 18: 0x1b3a5e8c (stale) Mirror 25: 0x1b3a5e8c (stale) Mirror 27: 0x1b3a5e8c (stale) Mirror 28: 0xde614c1e (stale) CRC-32 checksum value for chunk [0, 0x3f257): Mirror 1: 0x3a5ae088 Mirror 29: 0x3a5ae088 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f257: skipped 000949 1788643635.981682 write 0x02ec1e thru 0x03896a (0x9d4d bytes) 000950 1788643636.065649 mapwrite 0x02e23a thru 0x038061 (0x9e28 bytes) 000951 1788643636.115257 mapread 0x03ca3b thru 0x03f256 (0x281c bytes) 000952 1788643636.132042 punch from 0x00196c to 0x0110f7 (0xf78c bytes) 000954 1788643636.137468 write 0x03f048 thru 0x03ffff (0xfb8 bytes) 000955 1788643636.142031 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x392ed2a8 (stale) Mirror 15: 0x392ed2a8 (stale) Mirror 18: 0x392ed2a8 (stale) Mirror 25: 0x392ed2a8 (stale) Mirror 27: 0x392ed2a8 (stale) Mirror 28: 0xada22137 (stale) Mirror 29: 0xd0a38b1f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1e8507c9 Mirror 30: 0x1e8507c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000957 1788643637.154581 mapwrite 0x0087d0 thru 0x015f1a (0xd74b bytes) 000958 1788643637.352001 mapread 0x033690 thru 0x03ffff (0xc970 bytes) 000959 1788643637.373280 mapwrite 0x013449 thru 0x01fec3 (0xca7b bytes) 000960 1788643637.457456 read 0x0041a0 thru 0x007c8d (0x3aee bytes) 000961 1788643637.458659 mapread 0x03fc7c thru 0x03ffff (0x384 bytes) 000964 1788643637.462451 write 0x001753 thru 0x008fdd (0x788b bytes) 000965 1788643637.474362 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x392ed2a8 (stale) Mirror 15: 0x392ed2a8 (stale) Mirror 18: 0x392ed2a8 (stale) Mirror 25: 0x392ed2a8 (stale) Mirror 27: 0x392ed2a8 (stale) Mirror 28: 0xada22137 (stale) Mirror 29: 0xd0a38b1f (stale) Mirror 30: 0x1e8507c9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4e3cb435 Mirror 31: 0x4e3cb435 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000966 1788643638.540306 trunc from 0x040000 to 0x00618c (0x39e73 bytes) 000970 1788643638.662893 mapread 0x004ec0 thru 0x00618c (0x12cd bytes) 000971 1788643638.691301 mapread 0x0007a7 thru 0x00618c (0x59e6 bytes) 000972 1788643638.701236 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x618d): Mirror 14: 0x85d3243d (stale) Mirror 15: 0x85d3243d (stale) Mirror 25: 0x85d3243d (stale) Mirror 27: 0x85d3243d (stale) Mirror 28: 0xb446ba52 (stale) Mirror 29: 0x34957953 (stale) Mirror 30: 0xe7069a7 (stale) Mirror 31: 0x2c26ad58 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x618d): Mirror 14: 0x85d3243d (stale) Mirror 15: 0x85d3243d (stale) Mirror 25: 0x85d3243d (stale) Mirror 27: 0x85d3243d (stale) Mirror 28: 0xb446ba52 (stale) Mirror 29: 0x34957953 (stale) Mirror 30: 0xe7069a7 (stale) Mirror 31: 0x2c26ad58 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x618d: skipped 000974 1788643639.213576 mapread 0x0026c6 thru 0x00618c (0x3ac7 bytes) 000975 1788643639.240841 trunc from 0x00618d to 0x02a193 (0x24007 bytes) 000976 1788643639.260774 read 0x020e5f thru 0x02a193 (0x9335 bytes) 000977 1788643639.284764 mapwrite 0x031c0b thru 0x03ffff (0xe3f5 bytes) 000978 1788643639.497351 trunc from 0x040000 to 0x0096c2 (0x3693d bytes) 000980 1788643639.529299 mapread 0x0005e0 thru 0x0012ca (0xceb bytes) 000981 1788643639.547898 read 0x0007e2 thru 0x006549 (0x5d68 bytes) 000983 1788643639.551098 mapread 0x000287 thru 0x0096c2 (0x943c bytes) 000984 1788643639.564490 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x96c3): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x96c3): Mirror 14: 0x43e59072 (stale) Mirror 15: 0x43e59072 (stale) Mirror 25: 0x43e59072 (stale) Mirror 27: 0x43e59072 (stale) Mirror 28: 0xdba77112 (stale) Mirror 29: 0x1481bb45 (stale) Mirror 30: 0x161d46f1 (stale) Mirror 31: 0x7cd4b54d (stale) CRC-32 checksum value for chunk [0, 0x96c3): Mirror 1: 0x30d079be Mirror 32: 0x30d079be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x96c3: skipped 000986 1788643641.114356 trunc from 0x0096c3 to 0x02b682 (0x21fc0 bytes) 000987 1788643641.307546 write 0x004a58 thru 0x0068c9 (0x1e72 bytes) 000988 1788643641.327547 write 0x016a29 thru 0x01e715 (0x7ced bytes) 000989 1788643641.343750 mapread 0x0005ab thru 0x007142 (0x6b98 bytes) 000990 1788643641.407377 write 0x031ce7 thru 0x032d5f (0x1079 bytes) 000991 1788643641.410880 write 0x00e5a3 thru 0x012d75 (0x47d3 bytes) 000992 1788643641.418817 mapread 0x019293 thru 0x023b83 (0xa8f1 bytes) 000993 1788643641.452398 read 0x01cc68 thru 0x0213c5 (0x475e bytes) 000994 1788643641.457568 punch from 0x01fcf0 to 0x025bea (0x5efb bytes) 000997 1788643641.494835 write 0x027ff0 thru 0x02d516 (0x5527 bytes) 001000 1788643641.505714 read 0x02e370 thru 0x032d5f (0x49f0 bytes) All operations completed A-OK!