== sanity-flr test 70a: flr mode fsx test ================ 19:26:43 (1789082803) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 2805 truncating to largest ever: 0x12701 000001 1789082805.691967 trunc from 00000000 to 0x012700 (0x12701 bytes) 000002 1789082805.713381 trunc from 0x012701 to 0x00fd91 (0x296f bytes) 000003 1789082805.729753 write 0x022eac thru 0x031561 (0xe6b6 bytes) 000004 1789082805.734003 mapwrite 0x014922 thru 0x024590 (0xfc6f bytes) 000005 1789082805.813106 fallocate 0x0015ca thru 0x00a95e (0x9395 bytes) zero_range to largest ever: 0x1abb5 000006 1789082805.823446 trunc from 0x017f85 to 0x01abb4 (0x2c30 bytes) fallocating to largest ever: 0x40000 000007 1789082805.840496 fallocate 0x03f83a thru 0x03ffff (0x7c6 bytes) 000008 1789082805.847562 punch from 0x034c34 to 0x03ffff (0xb3cc bytes) 000009 1789082805.856479 trunc from 0x0374aa to 0x03a685 (0x31dc bytes) 000010 1789082805.863446 trunc from 0x0354ab to 0x03ac84 (0x57da bytes) 000011 1789082805.871135 mapwrite 0x0350dc thru 0x03bc2c (0x6b51 bytes) 000012 1789082805.922963 write 0x0011f0 thru 0x009722 (0x8533 bytes) 000013 1789082805.946057 write 0x02c666 thru 0x03a50d (0xdea8 bytes) 000014 1789082805.961656 MIRROR_EXTEND to 2 mirrors 000015 1789082807.211472 trunc from 0x040000 to 0x01944e (0x26bb1 bytes) 000016 1789082807.316902 punch from 0x016128 to 0x01944e (0x3327 bytes) 000017 1789082807.339246 fallocate 0x00e15a thru 0x0119dd (0x3884 bytes) 000018 1789082807.362122 trunc from 0x01944f to 0x03693c (0x1d4ee bytes) 000019 1789082807.451402 mapwrite 0x01a0a5 thru 0x025af0 (0xba4c bytes) 000020 1789082807.533708 trunc from 0x015ece to 0x0163c5 (0x4f8 bytes) 000021 1789082807.543192 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) 000022 1789082807.723826 MIRROR_EXTEND to 2 mirrors 000023 1789082808.673042 mapread 0x014b9d thru 0x015309 (0x76d bytes) 000025 1789082808.707678 read 0x007089 thru 0x009417 (0x238f bytes) 000026 1789082808.721212 read 0x0281bb thru 0x0365cb (0xe411 bytes) 000027 1789082808.739766 fallocate 0x03166d thru 0x03e860 (0xd1f4 bytes) 000028 1789082808.772559 mapwrite 0x005dba thru 0x00be41 (0x6088 bytes) 000031 1789082808.859109 trunc from 0x03e861 to 0x009530 (0x35330 bytes) 000033 1789082808.906419 fallocate 0x006474 thru 0x0102cb (0x9e58 bytes) 000034 1789082808.924275 MIRROR_RESYNC 2 mirrors 000036 1789082809.652876 trunc from 0x0102cc to 0x0046b8 (0xbc13 bytes) 000037 1789082809.700074 fallocate 0x026102 thru 0x0333c9 (0xd2c8 bytes) 000038 1789082809.713273 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x46b9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x46b9): Mirror 2: 0x4c0bf7e7 (stale) CRC-32 checksum value for chunk [0, 0x46b9): Mirror 1: 0x4c0bf7e7 Mirror 3: 0x4c0bf7e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x46b9: skipped 000039 1789082810.407614 trunc from 0x00151d to 0x0046b8 (0x319c bytes) 000040 1789082810.484139 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x46b9): Mirror 3: 0x4c0bf7e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x46b9): Mirror 3: 0x4c0bf7e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x46b9: skipped 000042 1789082810.824174 trunc from 0x0046b9 to 0x023a40 (0x1f388 bytes) 000043 1789082810.852314 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) 000044 1789082810.991427 read 0x014014 thru 0x01f0b5 (0xb0a2 bytes) 000045 1789082811.005141 trunc from 0x00533d to 0x014110 (0xedd4 bytes) 000046 1789082811.011932 write 0x02d380 thru 0x031451 (0x40d2 bytes) 000047 1789082811.018258 trunc from 0x031452 to 0x024af7 (0xc95a bytes) 000048 1789082811.034391 mapread 0x020b33 thru 0x024af7 (0x3fc5 bytes) 000049 1789082811.050620 write 0x006924 thru 0x00c899 (0x5f76 bytes) 000050 1789082811.061391 mapwrite 0x0246bb thru 0x031238 (0xcb7e bytes) 000051 1789082811.168146 read 0x0291eb thru 0x031238 (0x804e bytes) 000052 1789082811.171210 mapread 0x018638 thru 0x02704d (0xea16 bytes) 000053 1789082811.173279 write 0x032fc1 thru 0x0361df (0x321f bytes) 000056 1789082811.176310 punch from 0x01f8b1 to 0x01fa2b (0x17b bytes) 000057 1789082811.183302 mapwrite 0x02745a thru 0x0300dd (0x8c84 bytes) 000058 1789082811.216217 fallocate 0x023b79 thru 0x02620d (0x2695 bytes) 000059 1789082811.220777 write 0x0030b8 thru 0x008888 (0x57d1 bytes) 000060 1789082811.233084 trunc from 0x0361e0 to 0x0307a9 (0x5a36 bytes) 000061 1789082811.249374 trunc from 0x0307aa to 0x039d96 (0x95ed bytes) 000062 1789082811.262038 fallocate 0x009cfb thru 0x0111c3 (0x74c9 bytes) 000063 1789082811.268022 mapread 0x030f0f thru 0x03606b (0x515d bytes) 000064 1789082811.324867 read 0x00b241 thru 0x0131c7 (0x7f87 bytes) 000065 1789082811.325901 write 0x030b61 thru 0x037ba4 (0x7044 bytes) 000066 1789082811.332665 punch from 0x032b2e to 0x039794 (0x6c67 bytes) 000067 1789082811.350973 mapwrite 0x031cff thru 0x0376ef (0x59f1 bytes) 000069 1789082811.395220 mapwrite 0x00519a thru 0x00d145 (0x7fac bytes) 000070 1789082811.427051 trunc from 0x036af9 to 0x039d96 (0x329e bytes) 000071 1789082811.433172 trunc from 0x0223cd to 0x025a1c (0x3650 bytes) 000073 1789082811.454064 mapread 0x006435 thru 0x00cd67 (0x6933 bytes) 000074 1789082811.455395 trunc from 0x0243ed to 0x03409b (0xfcaf bytes) 000075 1789082811.464129 read 0x03765e thru 0x039d96 (0x2739 bytes) 000076 1789082811.489368 read 0x013e88 thru 0x01f40c (0xb585 bytes) 000077 1789082811.492969 trunc from 0x039d97 to 0x02b7b8 (0xe5de bytes) 000078 1789082811.523062 punch from 0x0113f0 to 0x01783e (0x644f bytes) 000079 1789082811.531259 trunc from 0x017c6d to 0x022ca8 (0xb03c bytes) 000080 1789082811.538717 fallocate 0x02ac9f thru 0x03047c (0x57de bytes) 000081 1789082811.546051 mapwrite 0x03e241 thru 0x03ffff (0x1dbf bytes) 000082 1789082811.621957 MIRROR_EXTEND to 2 mirrors 000083 1789082812.249539 punch from 0x01bae7 to 0x026c32 (0xb14c bytes) 000084 1789082812.287049 trunc from 0x040000 to 0x00a2c9 (0x35d36 bytes) 000085 1789082812.369593 trunc from 0x0044db to 0x00a2c9 (0x5def bytes) 000086 1789082812.377374 fallocate 0x014ba6 thru 0x01ee37 (0xa292 bytes) 000087 1789082812.383585 write 0x017840 thru 0x027229 (0xf9ea bytes) 000088 1789082812.390752 mapread 0x02453d thru 0x027229 (0x2ced bytes) 000089 1789082812.392434 punch from 0x009d73 to 0x00f666 (0x58f4 bytes) 000090 1789082812.402688 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) 000091 1789082812.720147 write 0x00bb84 thru 0x0131ac (0x7629 bytes) 000092 1789082812.747736 fallocate 0x010079 thru 0x01fac8 (0xfa50 bytes) 000093 1789082812.754366 trunc from 0x020845 to 0x027229 (0x69e5 bytes) 000094 1789082812.772116 punch from 0x026a85 to 0x027229 (0x7a5 bytes) 000095 1789082812.779899 trunc from 0x02722a to 0x02e20d (0x6fe4 bytes) 000096 1789082812.809495 punch from 0x00b97d to 0x00f6be (0x3d42 bytes) 000097 1789082812.845458 read 0x0072a3 thru 0x00d5af (0x630d bytes) 000098 1789082812.860204 read 0x0099d2 thru 0x010de1 (0x7410 bytes) 000099 1789082812.876031 write 0x00802e thru 0x00e413 (0x63e6 bytes) 000103 1789082812.887737 fallocate 0x00795a thru 0x012e50 (0xb4f7 bytes) 000104 1789082812.902118 trunc from 0x02e20e to 0x007456 (0x26db7 bytes) 000105 1789082812.946387 read 0x001a39 thru 0x007006 (0x55ce bytes) 000108 1789082812.963205 MIRROR_EXTEND to 2 mirrors 000109 1789082813.924206 mapwrite 0x02fdf9 thru 0x035082 (0x528a bytes) 000110 1789082814.051242 fallocate 0x013802 thru 0x021b10 (0xe30f bytes) 000111 1789082814.077506 mapwrite 0x005e0c thru 0x00c428 (0x661d bytes) 000112 1789082814.132940 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35083): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35083): Mirror 2: 0xf9eb2c16 (stale) CRC-32 checksum value for chunk [0, 0x35083): Mirror 1: 0x2b1293c5 Mirror 3: 0x2b1293c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35083: skipped 000114 1789082814.965744 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35083): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35083): Mirror 2: 0xf9eb2c16 (stale) CRC-32 checksum value for chunk [0, 0x35083): Mirror 1: 0x2b1293c5 Mirror 3: 0x2b1293c5 Mirror 4: 0x2b1293c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35083: skipped 000115 1789082816.148424 punch from 0x00844a to 0x00a6c9 (0x2280 bytes) 000116 1789082816.181658 write 0x003f09 thru 0x01167c (0xd774 bytes) 000118 1789082816.203293 read 0x02c3ff thru 0x035082 (0x8c84 bytes) 000120 1789082816.211342 mapread 0x02207e thru 0x02772b (0x56ae bytes) 000121 1789082816.231753 write 0x037bfc thru 0x03ffff (0x8404 bytes) 000122 1789082816.234132 punch from 0x024f96 to 0x02f565 (0xa5d0 bytes) 000124 1789082816.242030 mapwrite 0x00d8ce thru 0x0173d0 (0x9b03 bytes) 000125 1789082816.314274 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc81cedbf (stale) Mirror 4: 0xc81cedbf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc81cedbf (stale) Mirror 4: 0xc81cedbf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000126 1789082816.801068 read 0x009183 thru 0x01300e (0x9e8c bytes) 000127 1789082816.815455 read 0x023867 thru 0x027bb5 (0x434f bytes) 000128 1789082816.859598 mapwrite 0x013394 thru 0x013f78 (0xbe5 bytes) 000129 1789082816.879108 mapwrite 0x008762 thru 0x01060c (0x7eab bytes) 000130 1789082816.918372 mapread 0x039f55 thru 0x03a65b (0x707 bytes) 000131 1789082816.931960 MIRROR_RESYNC 3 mirrors 000132 1789082818.060324 fallocate 0x01b142 thru 0x01b2d5 (0x194 bytes) 000133 1789082818.099726 fallocate 0x02d044 thru 0x02d652 (0x60f bytes) 000134 1789082818.106663 trunc from 0x040000 to 0x022b60 (0x1d49f bytes) 000135 1789082818.137635 punch from 0x01e57c to 0x02094a (0x23cf bytes) 000137 1789082818.146133 mapread 0x00552c thru 0x00e168 (0x8c3d bytes) 000138 1789082818.168767 trunc from 0x006397 to 0x010e15 (0xaa7f bytes) 000139 1789082818.179273 write 0x010da6 thru 0x01477c (0x39d7 bytes) 000140 1789082818.195973 write 0x002465 thru 0x00c2a0 (0x9e3c bytes) 000141 1789082818.204748 read 0x01081b thru 0x011f05 (0x16eb bytes) 000142 1789082818.206773 punch from 0x011553 to 0x0181d1 (0x6c7f bytes) 000143 1789082818.225606 write 0x0337e9 thru 0x03b55a (0x7d72 bytes) 000144 1789082818.227303 mapread 0x0082ad thru 0x016833 (0xe587 bytes) 000145 1789082818.252732 read 0x020396 thru 0x027836 (0x74a1 bytes) 000146 1789082818.262686 mapwrite 0x019b4f thru 0x025661 (0xbb13 bytes) 000147 1789082818.285677 read 0x03a43a thru 0x03b55a (0x1121 bytes) 000148 1789082818.291153 MIRROR_RESYNC 3 mirrors 000149 1789082819.333248 trunc from 0x033614 to 0x0384b4 (0x4ea1 bytes) 000150 1789082819.379926 mapwrite 0x030f37 thru 0x037811 (0x68db bytes) 000151 1789082819.418662 mapwrite 0x017889 thru 0x023594 (0xbd0c bytes) 000152 1789082819.448368 trunc from 0x03b55b to 0x015bf0 (0x2596a bytes) 000153 1789082819.475242 mapread 0x0067c4 thru 0x00e932 (0x816f bytes) 000154 1789082819.483616 write 0x01de6a thru 0x024fa1 (0x7138 bytes) 000155 1789082819.489909 MIRROR_RESYNC 3 mirrors 000156 1789082820.209680 mapread 0x018d24 thru 0x0217b1 (0x8a8e bytes) 000157 1789082820.244857 trunc from 0x0244af to 0x024fa1 (0xaf3 bytes) 000159 1789082820.284423 mapwrite 0x032033 thru 0x03448b (0x2459 bytes) 000160 1789082820.394003 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3448c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3448c): Mirror 3: 0x984f5e54 (stale) Mirror 4: 0x984f5e54 (stale) CRC-32 checksum value for chunk [0, 0x3448c): Mirror 1: 0x2223e6ca Mirror 5: 0x2223e6ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3448c: skipped 000161 1789082821.315344 read 0x02b3a4 thru 0x03448b (0x90e8 bytes) 000163 1789082821.372192 trunc from 0x000e6d to 0x00bf51 (0xb0e5 bytes) 000164 1789082821.435092 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3448c): Mirror 4: 0x984f5e54 (stale) Mirror 5: 0x2223e6ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3448c): Mirror 4: 0x984f5e54 (stale) Mirror 5: 0x2223e6ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3448c: skipped 000165 1789082821.774917 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3448c): Mirror 4: 0x984f5e54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3448c): Mirror 4: 0x984f5e54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3448c: skipped 000166 1789082822.020883 write 0x024356 thru 0x029caa (0x5955 bytes) 000168 1789082822.038132 trunc from 0x03448c to 0x0169b8 (0x1dad3 bytes) 000169 1789082822.076319 read 0x002d08 thru 0x00a103 (0x73fc bytes) 000170 1789082822.087438 mapwrite 0x012598 thru 0x014082 (0x1aeb bytes) 000171 1789082822.127498 fallocate 0x03782d thru 0x03ffff (0x87d3 bytes) 000172 1789082822.139559 trunc from 0x0169b9 to 0x015d99 (0xc1f bytes) 000173 1789082822.158771 punch from 0x009bc1 to 0x01416a (0xa5aa bytes) 000175 1789082822.173532 mapread 0x00f8ae thru 0x0148f9 (0x504c bytes) 000176 1789082822.189695 read 0x013e88 thru 0x015d99 (0x1f12 bytes) 000177 1789082822.190676 mapwrite 0x02032c thru 0x02cf9b (0xcc70 bytes) 000178 1789082822.232850 mapread 0x0053a7 thru 0x013add (0xe737 bytes) 000179 1789082822.234313 trunc from 0x02cf9c to 0x0264f5 (0x6aa6 bytes) 000180 1789082822.264560 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x264f6): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x264f6): Mirror 4: 0x9ae5bc40 (stale) CRC-32 checksum value for chunk [0, 0x264f6): Mirror 1: 0xb20afa6c Mirror 5: 0xb20afa6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x264f6: skipped 000181 1789082823.276162 fallocate 0x018c77 thru 0x018ece (0x258 bytes) 000182 1789082823.335161 write 0x0012dd thru 0x004b6b (0x388f bytes) 000183 1789082823.358309 trunc from 0x00544f to 0x009b7f (0x4731 bytes) 000184 1789082823.366960 write 0x00aa84 thru 0x00fcd4 (0x5251 bytes) 000185 1789082823.402626 read 0x011af2 thru 0x01b855 (0x9d64 bytes) 000187 1789082823.416170 read 0x01fc48 thru 0x0264f5 (0x68ae bytes) 000188 1789082823.437408 punch from 0x021315 to 0x02233f (0x102b bytes) 000189 1789082823.445531 fallocate 0x0291f4 thru 0x034ad8 (0xb8e5 bytes) 000191 1789082823.453759 punch from 0x01a646 to 0x01b70d (0x10c8 bytes) 000192 1789082823.466254 read 0x00e7cb thru 0x00ea7a (0x2b0 bytes) 000193 1789082823.485381 MIRROR_RESYNC 3 mirrors 000194 1789082824.729141 mapwrite 0x02d042 thru 0x03588c (0x884b bytes) 000195 1789082824.830615 trunc from 0x020d0a to 0x02cfd7 (0xc2ce bytes) 000196 1789082824.838036 fallocate 0x021d0b thru 0x02644f (0x4745 bytes) 000197 1789082824.862593 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3588d): Mirror 5: 0x5fb51a1d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3588d): Mirror 5: 0x5fb51a1d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3588d: skipped 000201 1789082825.350507 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) 000202 1789082825.502530 trunc from 0x02d5a9 to 0x03588c (0x82e4 bytes) 000203 1789082825.510953 trunc from 0x03588d to 0x0386af (0x2e23 bytes) 000204 1789082825.539549 mapread 0x0152aa thru 0x01c5e9 (0x7340 bytes) 000205 1789082825.557436 mapwrite 0x00a16d thru 0x00e899 (0x472d bytes) 000206 1789082825.582436 punch from 0x028a6e to 0x02bb0a (0x309d bytes) 000207 1789082825.588656 read 0x01af7b thru 0x028d00 (0xdd86 bytes) 000208 1789082825.599348 write 0x03d3e7 thru 0x03ffff (0x2c19 bytes) 000209 1789082825.601006 fallocate 0x006972 thru 0x00984b (0x2eda bytes) 000210 1789082825.608355 trunc from 0x040000 to 0x035c32 (0xa3cd bytes) 000211 1789082825.636643 trunc from 0x035c33 to 0x021c8a (0x13fa8 bytes) 000212 1789082825.655754 write 0x03d5fe thru 0x03ffff (0x2a02 bytes) 000214 1789082825.662394 MIRROR_EXTEND to 2 mirrors 000215 1789082826.307662 punch from 0x00d04b to 0x012cd8 (0x5c8e bytes) 000216 1789082826.341759 trunc from 0x00e769 to 0x00f14f (0x9e7 bytes) 000217 1789082826.349762 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x82ec15d5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8341f7cb Mirror 3: 0x8341f7cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000218 1789082827.656056 read 0x00d4be thru 0x00fff2 (0x2b35 bytes) 000219 1789082827.661959 trunc from 0x03079d to 0x031e87 (0x16eb bytes) 000220 1789082827.718680 fallocate 0x00f814 thru 0x01c63d (0xce2a bytes) 000221 1789082827.730613 trunc from 0x0321f8 to 0x03db87 (0xb990 bytes) 000222 1789082827.738932 trunc from 0x004110 to 0x012f7b (0xee6c bytes) 000223 1789082827.752518 fallocate 0x00b950 thru 0x00c67e (0xd2f bytes) 000224 1789082827.764219 write 0x01fe07 thru 0x02856a (0x8764 bytes) 000225 1789082827.799720 fallocate 0x02f052 thru 0x03498c (0x593b bytes) 000226 1789082827.807229 read 0x0100b8 thru 0x01141d (0x1366 bytes) 000227 1789082827.854425 read 0x01c5b8 thru 0x028130 (0xbb79 bytes) 000228 1789082827.855260 write 0x039cba thru 0x03d26c (0x35b3 bytes) 000229 1789082827.873638 punch from 0x002ee9 to 0x004e12 (0x1f2a bytes) 000230 1789082827.882457 punch from 0x03c874 to 0x03ffff (0x378c bytes) 000231 1789082827.908912 trunc from 0x040000 to 0x00c226 (0x33dd9 bytes) 000232 1789082827.946334 mapread 0x00bc3a thru 0x00c226 (0x5ed bytes) 000233 1789082827.949348 write 0x02cea2 thru 0x02e8ce (0x1a2d bytes) 000234 1789082827.957900 trunc from 0x0069b7 to 0x0112f3 (0xa93d bytes) 000235 1789082827.963059 mapwrite 0x02b36c thru 0x0350a1 (0x9d36 bytes) 000236 1789082828.078244 trunc from 0x009f67 to 0x00f1fd (0x5297 bytes) 000237 1789082828.094146 read 0x03360d thru 0x0350a1 (0x1a95 bytes) 000238 1789082828.100817 mapread 0x01430c thru 0x015396 (0x108b bytes) 000239 1789082828.104766 punch from 0x031446 to 0x032335 (0xef0 bytes) 000240 1789082828.132534 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x350a2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x350a2): Mirror 2: 0xad6b385c (stale) Mirror 3: 0xedfd28cd (stale) CRC-32 checksum value for chunk [0, 0x350a2): Mirror 1: 0xd7d10f81 Mirror 4: 0xd7d10f81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x350a2: skipped 000242 1789082829.067594 MIRROR_RESYNC 4 mirrors 000244 1789082830.288766 punch from 0x00f092 to 0x0151bc (0x612b bytes) 000245 1789082830.398275 fallocate 0x02d2d5 thru 0x034ff3 (0x7d1f bytes) 000246 1789082830.417509 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x350a2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x350a2): Mirror 2: 0xd7d10f81 (stale) Mirror 3: 0xd7d10f81 (stale) Mirror 4: 0xd7d10f81 (stale) CRC-32 checksum value for chunk [0, 0x350a2): Mirror 1: 0xd7d10f81 Mirror 5: 0xd7d10f81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x350a2: skipped 000247 1789082831.476180 write 0x030502 thru 0x0396cc (0x91cb bytes) 000249 1789082831.649366 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x396cd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x396cd): Mirror 2: 0x256673c2 (stale) Mirror 3: 0x256673c2 (stale) Mirror 4: 0x256673c2 (stale) Mirror 5: 0x256673c2 (stale) CRC-32 checksum value for chunk [0, 0x396cd): Mirror 1: 0xd8166a8c Mirror 6: 0xd8166a8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x396cd: skipped 000250 1789082833.039510 mapread 0x010f27 thru 0x01775a (0x6834 bytes) 000251 1789082833.106089 write 0x00d52a thru 0x014528 (0x6fff bytes) 000252 1789082833.162408 mapread 0x01dee8 thru 0x01eea1 (0xfba bytes) 000254 1789082833.174412 mapwrite 0x025011 thru 0x034cde (0xfcce bytes) 000255 1789082833.242056 trunc from 0x0396cd to 0x03aa99 (0x13cd bytes) 000256 1789082833.280319 trunc from 0x03aa9a to 0x02ef81 (0xbb18 bytes) 000258 1789082833.303328 mapwrite 0x01d9eb thru 0x01db8c (0x1a2 bytes) 000259 1789082833.330292 trunc from 0x0017e0 to 0x00f2f9 (0xdb1a bytes) 000260 1789082833.351566 trunc from 0x01b0ea to 0x01b525 (0x43c bytes) 000261 1789082833.370712 mapwrite 0x016dda thru 0x01a6cd (0x38f4 bytes) 000262 1789082833.410750 trunc from 0x00d8e4 to 0x01a6bb (0xcdd8 bytes) 000263 1789082833.417771 trunc from 0x0111e2 to 0x01b37e (0xa19d bytes) 000264 1789082833.423286 mapwrite 0x0202dc thru 0x026734 (0x6459 bytes) 000265 1789082833.467091 punch from 0x020f52 to 0x0283c6 (0x7475 bytes) 000266 1789082833.487556 trunc from 0x017ba8 to 0x01cd6a (0x51c3 bytes) 000267 1789082833.498551 mapwrite 0x02a478 thru 0x02b5f4 (0x117d bytes) 000268 1789082833.519545 mapread 0x008e07 thru 0x00a36c (0x1566 bytes) 000269 1789082833.541761 write 0x0310bf thru 0x034372 (0x32b4 bytes) 000270 1789082833.551105 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34373): Mirror 3: 0x32fddc4d (stale) Mirror 4: 0x32fddc4d (stale) Mirror 5: 0x32fddc4d (stale) Mirror 6: 0x2a6de305 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34373): Mirror 3: 0x32fddc4d (stale) Mirror 4: 0x32fddc4d (stale) Mirror 5: 0x32fddc4d (stale) Mirror 6: 0x2a6de305 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34373: skipped 000271 1789082834.100601 write 0x008c94 thru 0x009cb4 (0x1021 bytes) 000272 1789082834.122468 mapread 0x01cc65 thru 0x0254ab (0x8847 bytes) 000273 1789082834.143482 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x34373): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34373): Mirror 3: 0x32fddc4d (stale) Mirror 4: 0x32fddc4d (stale) Mirror 5: 0x32fddc4d (stale) Mirror 6: 0x2a6de305 (stale) CRC-32 checksum value for chunk [0, 0x34373): Mirror 1: 0x1bbd7f3c Mirror 7: 0x1bbd7f3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34373: skipped 000274 1789082835.027265 trunc from 0x0249cb to 0x033421 (0xea57 bytes) 000275 1789082835.063642 write 0x01449c thru 0x016ff9 (0x2b5e bytes) 000276 1789082835.081019 trunc from 0x00b095 to 0x00b0b6 (0x22 bytes) 000277 1789082835.097189 mapread 0x0009d5 thru 0x00e237 (0xd863 bytes) 000278 1789082835.162578 trunc from 0x002427 to 0x010591 (0xe16b bytes) 000279 1789082835.171413 fallocate 0x037be1 thru 0x0392d5 (0x16f5 bytes) 000280 1789082835.177702 mapwrite 0x00084e thru 0x00dd5e (0xd511 bytes) 000281 1789082835.244132 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x392d6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392d6): Mirror 3: 0xaf42e135 (stale) Mirror 4: 0xaf42e135 (stale) Mirror 5: 0xaf42e135 (stale) Mirror 6: 0x27dfbafa (stale) Mirror 7: 0x7e9e436f (stale) CRC-32 checksum value for chunk [0, 0x392d6): Mirror 1: 0x93e46b00 Mirror 8: 0x93e46b00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392d6: skipped 000282 1789082836.941025 trunc from 0x0392d6 to 0x005d42 (0x33593 bytes) 000284 1789082837.005486 mapwrite 0x02c7ef thru 0x035c8f (0x94a1 bytes) 000286 1789082837.094698 trunc from 0x035c90 to 0x01b560 (0x1a72f bytes) 000287 1789082837.115069 mapread 0x01ab3b thru 0x01b560 (0xa26 bytes) 000288 1789082837.127563 punch from 0x0106a5 to 0x0176e6 (0x7042 bytes) 000289 1789082837.131915 trunc from 0x01b561 to 0x03a880 (0x1f320 bytes) 000290 1789082837.171299 mapread 0x01412a thru 0x01f41e (0xb2f5 bytes) 000291 1789082837.220212 trunc from 0x03a881 to 0x00936f (0x31511 bytes) 000292 1789082837.269074 write 0x01dc4a thru 0x0286bc (0xaa73 bytes) 000293 1789082837.280752 MIRROR_RESYNC 7 mirrors 000294 1789082839.224224 fallocate 0x03453b thru 0x03780c (0x32d2 bytes) 000295 1789082839.285571 trunc from 0x0184ed to 0x0277b6 (0xf2ca bytes) 000296 1789082839.300548 read 0x02141f thru 0x024779 (0x335b bytes) 000297 1789082839.323893 write 0x00e9e7 thru 0x00ed19 (0x333 bytes) 000298 1789082839.344245 fallocate 0x02ff32 thru 0x03b8c7 (0xb996 bytes) 000299 1789082839.363777 mapread 0x013360 thru 0x0219b6 (0xe657 bytes) 000300 1789082839.443729 MIRROR_RESYNC 7 mirrors 000301 1789082841.802581 MIRROR_RESYNC 7 mirrors 000302 1789082842.697644 punch from 0x00cbb0 to 0x017606 (0xaa57 bytes) 000303 1789082842.767612 mapwrite 0x0269c4 thru 0x03063c (0x9c79 bytes) 000304 1789082842.936713 fallocate 0x00d053 thru 0x01a04c (0xcffa bytes) 000305 1789082842.953061 fallocate 0x031ed6 thru 0x03ea71 (0xcb9c bytes) 000307 1789082842.975283 trunc from 0x03063d to 0x03c0c7 (0xba8b bytes) 000308 1789082843.023414 mapread 0x00bae7 thru 0x019ed8 (0xe3f2 bytes) 000309 1789082843.062596 MIRROR_RESYNC 7 mirrors 000310 1789082845.360758 fallocate 0x0241bd thru 0x02db5d (0x99a1 bytes) 000311 1789082845.446323 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c0c8): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0c8): Mirror 3: 0xc9ad411e (stale) Mirror 4: 0xc9ad411e (stale) Mirror 5: 0xc9ad411e (stale) Mirror 6: 0xc9ad411e (stale) Mirror 7: 0xc9ad411e (stale) Mirror 8: 0xc9ad411e (stale) CRC-32 checksum value for chunk [0, 0x3c0c8): Mirror 1: 0xc9ad411e Mirror 9: 0xc9ad411e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0c8: skipped 000313 1789082846.736448 read 0x00b133 thru 0x011461 (0x632f bytes) 000314 1789082846.769048 fallocate 0x00ef14 thru 0x01d266 (0xe353 bytes) 000315 1789082846.831232 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c0c8): Mirror 4: 0xc9ad411e (stale) Mirror 5: 0xc9ad411e (stale) Mirror 6: 0xc9ad411e (stale) Mirror 7: 0xc9ad411e (stale) Mirror 8: 0xc9ad411e (stale) Mirror 9: 0xc9ad411e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0c8): Mirror 4: 0xc9ad411e (stale) Mirror 5: 0xc9ad411e (stale) Mirror 6: 0xc9ad411e (stale) Mirror 7: 0xc9ad411e (stale) Mirror 8: 0xc9ad411e (stale) Mirror 9: 0xc9ad411e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0c8: skipped 000316 1789082847.387617 trunc from 0x03c0c8 to 0x023757 (0x18970 bytes) 000317 1789082847.410026 write 0x017afe thru 0x021573 (0x9a76 bytes) 000318 1789082847.421657 punch from 0x018981 to 0x018f4f (0x5cf bytes) 000319 1789082847.445450 mapread 0x007900 thru 0x0145e7 (0xcce8 bytes) 000320 1789082847.470080 trunc from 0x023758 to 0x005de7 (0x1d970 bytes) 000321 1789082847.492183 mapread 0x005147 thru 0x005de7 (0xca1 bytes) 000322 1789082847.493495 fallocate 0x030b78 thru 0x03a539 (0x99c2 bytes) 000323 1789082847.498706 write 0x02e393 thru 0x0355c3 (0x7231 bytes) 000324 1789082847.508540 punch from 0x00ccbc to 0x0113f1 (0x4736 bytes) 000325 1789082847.522448 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a53a): Mirror 4: 0x55ac656c (stale) Mirror 5: 0x55ac656c (stale) Mirror 6: 0x55ac656c (stale) Mirror 7: 0x55ac656c (stale) Mirror 8: 0x55ac656c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a53a): Mirror 4: 0x55ac656c (stale) Mirror 5: 0x55ac656c (stale) Mirror 6: 0x55ac656c (stale) Mirror 7: 0x55ac656c (stale) Mirror 8: 0x55ac656c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a53a: skipped 000326 1789082847.929223 fallocate 0x008560 thru 0x00cb08 (0x45a9 bytes) 000327 1789082847.935070 fallocate 0x0030aa thru 0x0099cf (0x6926 bytes) 000328 1789082847.943718 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a53a): Mirror 4: 0x55ac656c (stale) Mirror 5: 0x55ac656c (stale) Mirror 7: 0x55ac656c (stale) Mirror 8: 0x55ac656c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a53a): Mirror 4: 0x55ac656c (stale) Mirror 5: 0x55ac656c (stale) Mirror 7: 0x55ac656c (stale) Mirror 8: 0x55ac656c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a53a: skipped 000329 1789082848.367426 mapwrite 0x030da2 thru 0x03bc6d (0xaecc bytes) 000330 1789082848.433142 MIRROR_RESYNC 5 mirrors 000331 1789082849.433214 trunc from 0x03bc6e to 0x0256d5 (0x16598 bytes) 000332 1789082849.475615 trunc from 0x0024b6 to 0x0083bb (0x5f06 bytes) 000333 1789082849.480861 trunc from 0x00bd6d to 0x01243e (0x66d2 bytes) 000334 1789082849.485270 fallocate 0x01042d thru 0x019453 (0x9027 bytes) 000335 1789082849.490192 write 0x026a55 thru 0x02de61 (0x740d bytes) 000336 1789082849.496154 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2de62): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2de62): Mirror 4: 0x5faf66f1 (stale) Mirror 5: 0x5faf66f1 (stale) Mirror 7: 0x5faf66f1 (stale) Mirror 8: 0x5faf66f1 (stale) CRC-32 checksum value for chunk [0, 0x2de62): Mirror 1: 0x66d74870 Mirror 9: 0x66d74870 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2de62: skipped 000337 1789082850.370574 write 0x00e2ba thru 0x01cd68 (0xeaaf bytes) 000338 1789082850.460531 fallocate 0x02ff32 thru 0x03e5ea (0xe6b9 bytes) 000339 1789082850.468663 fallocate 0x02ceb1 thru 0x03149b (0x45eb bytes) 000340 1789082850.495438 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3149c): Mirror 5: 0x841f7b2b (stale) Mirror 7: 0x841f7b2b (stale) Mirror 8: 0x841f7b2b (stale) Mirror 9: 0x9257bdb3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3149c): Mirror 5: 0x841f7b2b (stale) Mirror 7: 0x841f7b2b (stale) Mirror 8: 0x841f7b2b (stale) Mirror 9: 0x9257bdb3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3149c: skipped 000341 1789082850.945100 mapread 0x01bd4b thru 0x01cbc1 (0xe77 bytes) 000342 1789082850.972417 trunc from 0x03149c to 0x00906d (0x2842e bytes) 000343 1789082850.998055 fallocate 0x0195aa thru 0x02594d (0xc3a4 bytes) 000345 1789082851.017773 write 0x0325b8 thru 0x03ffff (0xda48 bytes) 000346 1789082851.022330 mapread 0x03afa8 thru 0x03c438 (0x1491 bytes) 000347 1789082851.024105 punch from 0x033a1a to 0x03db3e (0xa125 bytes) 000348 1789082851.065766 write 0x030e15 thru 0x039ab0 (0x8c9c bytes) 000349 1789082851.099334 trunc from 0x030781 to 0x03e773 (0xdff3 bytes) 000350 1789082851.160757 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc92216aa (stale) Mirror 8: 0xc92216aa (stale) Mirror 9: 0xda954aff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc92216aa (stale) Mirror 8: 0xc92216aa (stale) Mirror 9: 0xda954aff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000351 1789082851.655430 write 0x02bc54 thru 0x03091d (0x4cca bytes) 000352 1789082851.674878 trunc from 0x00a379 to 0x00f849 (0x54d1 bytes) 000353 1789082851.684883 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc92216aa (stale) Mirror 8: 0xc92216aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc92216aa (stale) Mirror 8: 0xc92216aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000354 1789082852.086192 mapwrite 0x0233d7 thru 0x024b19 (0x1743 bytes) 000355 1789082852.129604 read 0x038660 thru 0x03e7ac (0x614d bytes) 000356 1789082852.143621 trunc from 0x01a1da to 0x01fe25 (0x5c4c bytes) 000357 1789082852.150589 mapwrite 0x011c54 thru 0x01e083 (0xc430 bytes) 000358 1789082852.192755 mapwrite 0x0162ba thru 0x0215ba (0xb301 bytes) 000359 1789082852.212749 read 0x03c745 thru 0x03ffff (0x38bb bytes) 000360 1789082852.234451 punch from 0x006f0c to 0x00d438 (0x652d bytes) 000361 1789082852.239785 read 0x02c5b9 thru 0x0304cf (0x3f17 bytes) 000362 1789082852.241091 punch from 0x025a75 to 0x033986 (0xdf12 bytes) 000364 1789082852.250038 trunc from 0x038e11 to 0x03ffff (0x71ef bytes) 000365 1789082852.258287 trunc from 0x010f35 to 0x010fcb (0x97 bytes) 000366 1789082852.268530 mapwrite 0x01779e thru 0x01c06a (0x48cd bytes) 000367 1789082852.317419 read 0x0230a0 thru 0x030720 (0xd681 bytes) 000368 1789082852.334387 trunc from 0x040000 to 0x012050 (0x2dfaf bytes) 000370 1789082852.374016 punch from 0x000557 to 0x000897 (0x341 bytes) 000371 1789082852.389323 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12051): Mirror 8: 0xe0e04206 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12051): Mirror 8: 0xe0e04206 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12051: skipped 000372 1789082852.673282 fallocate 0x00616f thru 0x012031 (0xbec3 bytes) 000373 1789082852.683283 fallocate 0x010e76 thru 0x019dd8 (0x8f63 bytes) 000374 1789082852.697931 read 0x0046c5 thru 0x0110a5 (0xc9e1 bytes) 000376 1789082852.719928 punch from 0x011db6 to 0x012050 (0x29b bytes) 000377 1789082852.729089 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x12051): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12051): Mirror 8: 0xe0e04206 (stale) CRC-32 checksum value for chunk [0, 0x12051): Mirror 1: 0xd0e3a312 Mirror 9: 0xd0e3a312 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12051: skipped 000378 1789082853.681389 punch from 0x00bdd7 to 0x011599 (0x57c3 bytes) 000379 1789082853.732895 mapread 0x002e26 thru 0x00b57f (0x875a bytes) 000380 1789082853.751853 read 0x00b650 thru 0x012050 (0x6a01 bytes) 000381 1789082853.757287 read 0x00fd0a thru 0x012050 (0x2347 bytes) 000382 1789082853.757966 mapwrite 0x0100fd thru 0x018bbe (0x8ac2 bytes) 000383 1789082853.836201 mapwrite 0x009ee5 thru 0x0184f6 (0xe612 bytes) 000384 1789082853.872758 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x18bbf): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18bbf): Mirror 8: 0xadc8fedd (stale) Mirror 9: 0x3c264bc4 (stale) CRC-32 checksum value for chunk [0, 0x18bbf): Mirror 1: 0x28744862 Mirror 10: 0x28744862 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18bbf: skipped 000385 1789082854.843758 read 0x00d951 thru 0x018bbe (0xb26e bytes) 000386 1789082854.889044 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18bbf): Mirror 9: 0x3c264bc4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18bbf): Mirror 9: 0x3c264bc4 (stale) CRC-32 checksum value for chunk [0, 0x18bbf): Mirror 1: 0x28744862 Mirror 10: 0x28744862 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18bbf: skipped 000387 1789082855.294939 MIRROR_RESYNC 3 mirrors 000388 1789082855.990116 read 0x008502 thru 0x0149eb (0xc4ea bytes) 000389 1789082856.014647 fallocate 0x007a16 thru 0x007e75 (0x460 bytes) 000390 1789082856.085134 punch from 0x005c2f to 0x0113b9 (0xb78b bytes) 000391 1789082856.100229 trunc from 0x00df06 to 0x018bbe (0xacb9 bytes) 000392 1789082856.125600 trunc from 0x0149bc to 0x018bbe (0x4203 bytes) 000393 1789082856.135385 read 0x017a59 thru 0x018bbe (0x1166 bytes) 000394 1789082856.159212 fallocate 0x01e739 thru 0x020207 (0x1acf bytes) 000395 1789082856.181487 trunc from 0x018bbf to 0x00dd96 (0xae28 bytes) 000396 1789082856.253050 mapwrite 0x0250ca thru 0x02e050 (0x8f87 bytes) 000397 1789082856.342966 trunc from 0x02e051 to 0x01018b (0x1dec5 bytes) 000398 1789082856.382469 mapwrite 0x03efc7 thru 0x03ffff (0x1039 bytes) 000399 1789082856.481495 punch from 0x01cc98 to 0x020c2a (0x3f93 bytes) 000400 1789082856.499338 fallocate 0x00d319 thru 0x012765 (0x544d bytes) 000401 1789082856.504973 mapread 0x015fd6 thru 0x01fc3a (0x9c65 bytes) 000402 1789082856.610896 write 0x010066 thru 0x01cea6 (0xce41 bytes) 000403 1789082856.616481 fallocate 0x02f409 thru 0x03dd0f (0xe907 bytes) 000404 1789082856.624211 write 0x00dc99 thru 0x01ab27 (0xce8f bytes) 000405 1789082856.630297 trunc from 0x023a9f to 0x032620 (0xeb82 bytes) 000406 1789082856.635413 write 0x03211d thru 0x03f054 (0xcf38 bytes) 000407 1789082856.648474 trunc from 0x040000 to 0x022c19 (0x1d3e6 bytes) 000408 1789082856.689354 trunc from 0x022c1a to 0x03c2f6 (0x196dd bytes) 000409 1789082856.733651 punch from 0x020b05 to 0x026a03 (0x5eff bytes) 000410 1789082856.762599 read 0x00235b thru 0x002abe (0x764 bytes) 000411 1789082856.763337 trunc from 0x01205f to 0x01d28a (0xb22c bytes) 000412 1789082856.774910 trunc from 0x034a06 to 0x039ced (0x52e8 bytes) 000413 1789082856.783546 mapread 0x026e17 thru 0x0356c5 (0xe8af bytes) 000414 1789082856.801326 mapread 0x0399b6 thru 0x03c2f6 (0x2941 bytes) 000415 1789082856.802496 punch from 0x03b220 to 0x03c2f6 (0x10d7 bytes) 000416 1789082856.807778 fallocate 0x003161 thru 0x00435f (0x11ff bytes) 000417 1789082856.812994 mapwrite 0x00c973 thru 0x00e9f7 (0x2085 bytes) 000418 1789082856.830076 MIRROR_RESYNC 3 mirrors 000419 1789082857.715331 mapread 0x02e58b thru 0x03308b (0x4b01 bytes) 000420 1789082857.732777 fallocate 0x024bec thru 0x02917e (0x4593 bytes) 000422 1789082857.763552 fallocate 0x02f2e0 thru 0x03a91e (0xb63f bytes) 000423 1789082857.769437 trunc from 0x03c2f7 to 0x02cf05 (0xf3f1 bytes) 000424 1789082857.785731 fallocate 0x02541f thru 0x02b4ba (0x609c bytes) 000425 1789082857.790905 read 0x006dc4 thru 0x00e593 (0x77d0 bytes) 000426 1789082857.798100 trunc from 0x02cf06 to 0x03b7bd (0xe8b8 bytes) 000427 1789082857.812449 punch from 0x00c541 to 0x00eb6c (0x262c bytes) 000428 1789082857.820919 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b7be): Mirror 10: 0x2c9ad658 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7be): Mirror 10: 0x2c9ad658 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7be: skipped 000430 1789082858.080132 MIRROR_RESYNC 2 mirrors 000431 1789082858.774119 trunc from 0x0064a4 to 0x014df6 (0xe953 bytes) 000432 1789082858.813388 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b7be): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7be): Mirror 10: 0xf87027f4 (stale) CRC-32 checksum value for chunk [0, 0x3b7be): Mirror 1: 0xc6b81d92 Mirror 11: 0xc6b81d92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7be: skipped 000433 1789082859.642321 trunc from 0x0160d4 to 0x01cdf8 (0x6d25 bytes) 000434 1789082859.692248 trunc from 0x03b7be to 0x002889 (0x38f34 bytes) 000435 1789082859.731280 mapwrite 0x0135ec thru 0x018fba (0x59cf bytes) 000436 1789082859.779244 trunc from 0x018fbb to 0x00d153 (0xbe67 bytes) 000437 1789082859.796939 mapread 0x0032d7 thru 0x00d153 (0x9e7d bytes) 000438 1789082859.809347 punch from 0x00a460 to 0x00d153 (0x2cf4 bytes) 000439 1789082859.822953 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd154): Mirror 11: 0x3505221b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd154): Mirror 11: 0x3505221b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd154: skipped 000440 1789082860.097227 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xd154): Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd154): Mirror 11: 0x3505221b (stale) CRC-32 checksum value for chunk [0, 0xd154): Mirror 1: 0x3505221b Mirror 12: 0x3505221b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd154: skipped 000441 1789082860.878524 trunc from 0x00d154 to 0x008ad8 (0x467b bytes) 000442 1789082860.952874 punch from 0x0059c3 to 0x008ad8 (0x3116 bytes) 000443 1789082860.959679 trunc from 0x008ad9 to 0x001f69 (0x6b6f bytes) 000444 1789082860.984562 trunc from 0x0010d6 to 0x001f69 (0xe94 bytes) 000445 1789082860.999610 trunc from 0x001709 to 0x001f69 (0x861 bytes) 000446 1789082861.005067 trunc from 0x001f6a to 0x002776 (0x80d bytes) 000447 1789082861.017664 trunc from 0x00066b to 0x002776 (0x210c bytes) 000448 1789082861.023197 mapread 0x002720 thru 0x002776 (0x57 bytes) 000449 1789082861.029902 write 0x013ed4 thru 0x01e94e (0xaa7b bytes) 000450 1789082861.032058 write 0x01945b thru 0x027b39 (0xe6df bytes) 000451 1789082861.034048 mapread 0x003ea3 thru 0x00a930 (0x6a8e bytes) 000452 1789082861.049964 MIRROR_RESYNC 3 mirrors 000454 1789082861.647509 mapwrite 0x0192c9 thru 0x021892 (0x85ca bytes) 000455 1789082861.755953 fallocate 0x011873 thru 0x016fdb (0x5769 bytes) 000456 1789082861.765177 mapwrite 0x019be2 thru 0x0290b6 (0xf4d5 bytes) 000457 1789082861.897294 trunc from 0x019d1b to 0x0261f0 (0xc4d6 bytes) 000458 1789082861.902495 trunc from 0x0290b7 to 0x0130a1 (0x16015 bytes) 000459 1789082861.934309 trunc from 0x002520 to 0x002fcb (0xaac bytes) 000460 1789082861.942355 punch from 0x004c49 to 0x0091bb (0x4573 bytes) 000461 1789082861.952879 trunc from 0x007a45 to 0x0130a1 (0xb65d bytes) 000462 1789082861.966639 trunc from 0x004b8f to 0x00886c (0x3cde bytes) 000463 1789082861.980051 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x130a2): Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x130a2): Mirror 11: 0xf71b89 (stale) Mirror 12: 0xf71b89 (stale) CRC-32 checksum value for chunk [0, 0x130a2): Mirror 1: 0xf71b89 Mirror 13: 0xf71b89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x130a2: skipped 000464 1789082862.615767 read 0x011f6a thru 0x0130a1 (0x1138 bytes) 000465 1789082862.635238 read 0x002743 thru 0x0067fe (0x40bc bytes) 000466 1789082862.656908 write 0x00c4b3 thru 0x016c22 (0xa770 bytes) 000467 1789082862.694707 punch from 0x0026f6 to 0x00489d (0x21a8 bytes) 000468 1789082862.700718 fallocate 0x02d190 thru 0x0335fe (0x646f bytes) 000469 1789082862.708750 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x335ff): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x335ff): Mirror 11: 0x8d5e45dc (stale) Mirror 12: 0x8d5e45dc (stale) Mirror 13: 0xfdac6662 (stale) CRC-32 checksum value for chunk [0, 0x335ff): Mirror 1: 0xf4a6ebe8 Mirror 14: 0xf4a6ebe8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x335ff: skipped 000470 1789082863.701999 read 0x021776 thru 0x02351f (0x1daa bytes) 000472 1789082863.719206 mapwrite 0x02dddb thru 0x033adc (0x5d02 bytes) 000473 1789082863.830232 mapread 0x020e37 thru 0x023848 (0x2a12 bytes) 000474 1789082863.841196 punch from 0x0186a0 to 0x01c517 (0x3e78 bytes) 000475 1789082863.852895 punch from 0x02373c to 0x02a5e5 (0x6eaa bytes) 000476 1789082863.861573 punch from 0x030f7c to 0x033adc (0x2b61 bytes) 000477 1789082863.870211 trunc from 0x033add to 0x000c75 (0x32e67 bytes) 000478 1789082863.895875 write 0x0047e1 thru 0x00a52e (0x5d4e bytes) 000479 1789082863.897459 fallocate 0x0332c3 thru 0x038785 (0x54c3 bytes) 000480 1789082863.905148 trunc from 0x021964 to 0x02794f (0x5fec bytes) 000481 1789082863.913903 trunc from 0x020490 to 0x02c0b2 (0xbc23 bytes) 000482 1789082863.919681 read 0x025057 thru 0x02d5bd (0x8567 bytes) 000484 1789082863.938048 read 0x01fbb5 thru 0x023a85 (0x3ed1 bytes) 000485 1789082863.938879 mapread 0x006271 thru 0x009c06 (0x3996 bytes) 000486 1789082863.939971 trunc from 0x0364b3 to 0x038785 (0x22d3 bytes) 000487 1789082863.945570 punch from 0x00dd58 to 0x01b46a (0xd713 bytes) 000488 1789082863.955669 mapwrite 0x03713d thru 0x03ffff (0x8ec3 bytes) 000490 1789082864.041022 write 0x0008ae thru 0x004ff1 (0x4744 bytes) 000491 1789082864.043130 trunc from 0x035a67 to 0x03ffff (0xa599 bytes) 000492 1789082864.075460 mapwrite 0x002d9e thru 0x007f01 (0x5164 bytes) 000493 1789082864.125490 trunc from 0x040000 to 0x02f505 (0x10afa bytes) 000494 1789082864.170192 fallocate 0x01e985 thru 0x025af2 (0x716e bytes) 000495 1789082864.183366 fallocate 0x021ab6 thru 0x02b016 (0x9561 bytes) 000496 1789082864.208961 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f506): Mirror 11: 0x58de8d1b (stale) Mirror 12: 0x58de8d1b (stale) Mirror 14: 0xe6fdecc4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f506): Mirror 11: 0x58de8d1b (stale) Mirror 12: 0x58de8d1b (stale) Mirror 14: 0xe6fdecc4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f506: skipped 000497 1789082864.588000 read 0x0225e5 thru 0x026fe2 (0x49fe bytes) 000498 1789082864.597211 fallocate 0x00b5ce thru 0x018103 (0xcb36 bytes) 000499 1789082864.601731 read 0x02d2a2 thru 0x02f505 (0x2264 bytes) 000500 1789082864.610330 write 0x018ff7 thru 0x01b20b (0x2215 bytes) 000501 1789082864.615384 read 0x00ba56 thru 0x010ce7 (0x5292 bytes) 000502 1789082864.616962 write 0x03e50b thru 0x03ffff (0x1af5 bytes) 000504 1789082864.619049 read 0x00b70d thru 0x01b0f4 (0xf9e8 bytes) 000505 1789082864.620772 trunc from 0x02a265 to 0x02f0c1 (0x4e5d bytes) 000507 1789082864.632595 MIRROR_RESYNC 4 mirrors 000508 1789082865.892992 mapwrite 0x0058c9 thru 0x00e419 (0x8b51 bytes) 000509 1789082866.027452 mapread 0x03483f thru 0x0364d6 (0x1c98 bytes) 000510 1789082866.056545 read 0x03b451 thru 0x03ffff (0x4baf bytes) 000511 1789082866.062698 write 0x028830 thru 0x02d1be (0x498f bytes) 000513 1789082866.114550 MIRROR_RESYNC 4 mirrors 000514 1789082867.648367 mapread 0x025cc3 thru 0x02e4f2 (0x8830 bytes) 000515 1789082867.675561 write 0x01b75b thru 0x020926 (0x51cc bytes) 000516 1789082867.740457 mapread 0x00d3a9 thru 0x015d97 (0x89ef bytes) 000517 1789082867.763678 MIRROR_RESYNC 4 mirrors 000518 1789082869.428250 punch from 0x00e6d3 to 0x010b80 (0x24ae bytes) 000519 1789082869.493473 mapwrite 0x0283c5 thru 0x03007f (0x7cbb bytes) 000520 1789082869.598227 trunc from 0x00ae51 to 0x019a78 (0xec28 bytes) 000521 1789082869.605629 fallocate 0x02b528 thru 0x034299 (0x8d72 bytes) 000522 1789082869.621162 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xee0e20a8 (stale) Mirror 14: 0xee0e20a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xee0e20a8 (stale) Mirror 14: 0xee0e20a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000523 1789082870.093256 mapwrite 0x02d9a0 thru 0x02f2df (0x1940 bytes) 000524 1789082870.131233 trunc from 0x040000 to 0x029cae (0x16351 bytes) 000525 1789082870.173888 punch from 0x00c894 to 0x0171e0 (0xa94d bytes) 000526 1789082870.181660 mapwrite 0x01a057 thru 0x026f1c (0xcec6 bytes) 000528 1789082870.312751 trunc from 0x029caf to 0x03d94f (0x13ca1 bytes) 000529 1789082870.335023 fallocate 0x00413a thru 0x008bfd (0x4ac4 bytes) 000531 1789082870.342862 trunc from 0x026c61 to 0x0346b3 (0xda53 bytes) 000532 1789082870.361660 MIRROR_RESYNC 3 mirrors 000533 1789082871.208845 MIRROR_RESYNC 3 mirrors 000534 1789082871.795104 trunc from 0x03d950 to 0x01631f (0x27630 bytes) 000535 1789082871.857642 write 0x030ba3 thru 0x03a52d (0x998b bytes) 000536 1789082871.860427 write 0x0169b6 thru 0x01e875 (0x7ec0 bytes) 000537 1789082871.870129 mapwrite 0x00a3d2 thru 0x018690 (0xe2bf bytes) 000538 1789082871.922902 mapread 0x0398cd thru 0x03a52d (0xc61 bytes) 000539 1789082871.923975 trunc from 0x021da1 to 0x02a5c4 (0x8824 bytes) 000540 1789082871.934671 punch from 0x000bb5 to 0x00d0c9 (0xc515 bytes) 000541 1789082871.940768 trunc from 0x03a52e to 0x01ac05 (0x1f928 bytes) 000542 1789082871.978899 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1ac06): Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ac06): Mirror 12: 0x5e0670fc (stale) Mirror 14: 0x5e0670fc (stale) CRC-32 checksum value for chunk [0, 0x1ac06): Mirror 1: 0xd95d664e Mirror 15: 0xd95d664e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ac06: skipped 000543 1789082873.046560 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ac06): Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ac06): Mirror 12: 0x5e0670fc (stale) Mirror 14: 0x5e0670fc (stale) CRC-32 checksum value for chunk [0, 0x1ac06): Mirror 1: 0xd95d664e Mirror 15: 0xd95d664e Mirror 16: 0xd95d664e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ac06: skipped 000544 1789082874.273291 trunc from 0x01ac06 to 0x0151db (0x5a2a bytes) 000545 1789082874.409745 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x151dc): Mirror 14: 0xff5be84e (stale) Mirror 15: 0x2ff5f9e1 (stale) Mirror 16: 0x2ff5f9e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x151dc): Mirror 14: 0xff5be84e (stale) Mirror 15: 0x2ff5f9e1 (stale) Mirror 16: 0x2ff5f9e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x151dc: skipped 000546 1789082875.145248 read 0x012af9 thru 0x012e7f (0x387 bytes) 000548 1789082875.158188 fallocate 0x023ca6 thru 0x028b88 (0x4ee3 bytes) 000549 1789082875.176069 mapwrite 0x03bdfc thru 0x03e625 (0x282a bytes) 000550 1789082875.337421 read 0x01b134 thru 0x0274b0 (0xc37d bytes) 000551 1789082875.357729 read 0x0093e3 thru 0x0114fd (0x811b bytes) 000553 1789082875.364038 punch from 0x0282e6 to 0x0365cb (0xe2e6 bytes) 000555 1789082875.378134 fallocate 0x004e2b thru 0x00ed07 (0x9edd bytes) 000556 1789082875.386981 mapwrite 0x008ad7 thru 0x016c17 (0xe141 bytes) 000557 1789082875.433447 punch from 0x002611 to 0x00a22c (0x7c1c bytes) 000558 1789082875.439765 mapwrite 0x0210cd thru 0x025a58 (0x498c bytes) 000560 1789082875.471014 fallocate 0x01633c thru 0x0220f4 (0xbdb9 bytes) 000561 1789082875.479847 trunc from 0x01dce7 to 0x01de16 (0x130 bytes) 000563 1789082875.494191 trunc from 0x01d917 to 0x0215d4 (0x3cbe bytes) 000566 1789082875.513374 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e626): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e626): Mirror 14: 0x754c7aae (stale) Mirror 15: 0x9aeb4fba (stale) Mirror 16: 0x9aeb4fba (stale) CRC-32 checksum value for chunk [0, 0x3e626): Mirror 1: 0xf845b14c Mirror 17: 0xf845b14c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e626: skipped 000567 1789082877.010731 write 0x03d03f thru 0x03ffff (0x2fc1 bytes) 000568 1789082877.074777 mapwrite 0x03e0fc thru 0x03ffff (0x1f04 bytes) 000569 1789082877.088440 mapread 0x02e4b4 thru 0x036c70 (0x87bd bytes) 000571 1789082877.115428 mapread 0x016209 thru 0x01b92e (0x5726 bytes) 000572 1789082877.131590 fallocate 0x022f6c thru 0x031a87 (0xeb1c bytes) 000573 1789082877.150627 MIRROR_RESYNC 5 mirrors 000574 1789082879.086752 mapwrite 0x03e84d thru 0x03ffff (0x17b3 bytes) 000575 1789082879.198989 write 0x006332 thru 0x00c6b4 (0x6383 bytes) 000577 1789082879.228104 mapread 0x024dc9 thru 0x02dbdb (0x8e13 bytes) 000578 1789082879.249699 write 0x014d40 thru 0x020807 (0xbac8 bytes) 000579 1789082879.262615 fallocate 0x01eee5 thru 0x02e0b4 (0xf1d0 bytes) 000580 1789082879.292980 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xa72a08d (stale) Mirror 15: 0xa72a08d (stale) Mirror 16: 0xa72a08d (stale) Mirror 17: 0xa72a08d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9e84ce8e Mirror 18: 0x9e84ce8e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000581 1789082880.413663 read 0x004903 thru 0x005c81 (0x137f bytes) 000582 1789082880.429942 fallocate 0x01c66a thru 0x02a2f8 (0xdc8f bytes) 000583 1789082880.492489 trunc from 0x03606e to 0x0373cd (0x1360 bytes) 000584 1789082880.503743 write 0x01386c thru 0x015f29 (0x26be bytes) 000585 1789082880.529286 mapread 0x021a9a thru 0x02e297 (0xc7fe bytes) 000586 1789082880.634971 mapread 0x0233a7 thru 0x028552 (0x51ac bytes) 000587 1789082880.639467 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xa72a08d (stale) Mirror 15: 0xa72a08d (stale) Mirror 16: 0xa72a08d (stale) Mirror 17: 0xa72a08d (stale) Mirror 18: 0x9e84ce8e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc8b3db8d Mirror 19: 0xc8b3db8d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000588 1789082881.889440 trunc from 0x040000 to 0x02c29a (0x13d65 bytes) 000589 1789082881.950996 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2c29b): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c29b): Mirror 14: 0x9b062afb (stale) Mirror 15: 0x9b062afb (stale) Mirror 16: 0x9b062afb (stale) Mirror 17: 0x9b062afb (stale) Mirror 18: 0x7f604e83 (stale) Mirror 19: 0xb79e72f9 (stale) CRC-32 checksum value for chunk [0, 0x2c29b): Mirror 1: 0xb79e72f9 Mirror 20: 0xb79e72f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c29b: skipped 000590 1789082883.026253 mapread 0x01c86a thru 0x01e9c6 (0x215d bytes) 000591 1789082883.055900 write 0x0056d1 thru 0x0095b5 (0x3ee5 bytes) 000592 1789082883.103973 write 0x03d43b thru 0x03ffff (0x2bc5 bytes) 000594 1789082883.106841 read 0x00d3ca thru 0x00d3d8 (0xf bytes) 000595 1789082883.107844 read 0x004fa0 thru 0x009fbb (0x501c bytes) 000597 1789082883.124963 mapwrite 0x00e6cf thru 0x012399 (0x3ccb bytes) 000598 1789082883.161000 punch from 0x008bfa to 0x012ddb (0xa1e2 bytes) 000599 1789082883.168928 punch from 0x030d73 to 0x03a381 (0x960f bytes) 000600 1789082883.182563 MIRROR_RESYNC 8 mirrors 000601 1789082885.448559 fallocate 0x013451 thru 0x0194eb (0x609b bytes) 000603 1789082885.505921 trunc from 0x037e38 to 0x03c848 (0x4a11 bytes) 000604 1789082885.521981 write 0x0099f9 thru 0x00e2de (0x48e6 bytes) 000605 1789082885.545521 mapwrite 0x0200d7 thru 0x026fb7 (0x6ee1 bytes) 000606 1789082885.656678 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x1c9265c4 (stale) Mirror 15: 0x1c9265c4 (stale) Mirror 16: 0x1c9265c4 (stale) Mirror 17: 0x1c9265c4 (stale) Mirror 18: 0x1c9265c4 (stale) Mirror 19: 0x1c9265c4 (stale) Mirror 20: 0x1c9265c4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb94679a3 Mirror 21: 0xb94679a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000607 1789082887.044092 MIRROR_RESYNC 9 mirrors 000608 1789082889.496364 trunc from 0x036859 to 0x03ebf0 (0x8398 bytes) 000610 1789082889.543305 read 0x03d7fb thru 0x03e1ce (0x9d4 bytes) 000611 1789082889.559873 mapread 0x0229bf thru 0x02c6f4 (0x9d36 bytes) 000613 1789082889.598099 punch from 0x032ca8 to 0x0398b7 (0x6c10 bytes) 000614 1789082889.606694 write 0x03c069 thru 0x03ffff (0x3f97 bytes) 000615 1789082889.617332 trunc from 0x02d019 to 0x03315b (0x6143 bytes) 000616 1789082889.626713 punch from 0x0000d6 to 0x004602 (0x452d bytes) 000617 1789082889.669695 MIRROR_RESYNC 9 mirrors 000618 1789082892.195248 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) 000619 1789082892.815581 fallocate 0x02ce8d thru 0x03b49a (0xe60e bytes) 000620 1789082892.855999 trunc from 0x040000 to 0x03f2d6 (0xd29 bytes) 000621 1789082892.898653 trunc from 0x03cc5f to 0x03f2d6 (0x2678 bytes) 000622 1789082892.905543 trunc from 0x00e298 to 0x00f8fd (0x1666 bytes) 000623 1789082892.911139 trunc from 0x03f2d7 to 0x0276a3 (0x17c33 bytes) 000624 1789082892.926067 trunc from 0x020a84 to 0x0276a3 (0x6c20 bytes) 000625 1789082892.931094 read 0x016d1d thru 0x01ad6d (0x4051 bytes) 000626 1789082892.944683 read 0x011cb5 thru 0x016ad3 (0x4e1f bytes) 000627 1789082892.956030 punch from 0x027196 to 0x027305 (0x170 bytes) 000628 1789082892.961502 write 0x0109e4 thru 0x013478 (0x2a95 bytes) 000629 1789082892.963430 mapread 0x0247a2 thru 0x0276a3 (0x2f02 bytes) 000630 1789082892.974353 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x276a4): Mirror 14: 0xefc707ab (stale) Mirror 16: 0xefc707ab (stale) Mirror 17: 0xefc707ab (stale) Mirror 18: 0xefc707ab (stale) Mirror 19: 0xefc707ab (stale) Mirror 21: 0xefc707ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x276a4): Mirror 14: 0xefc707ab (stale) Mirror 16: 0xefc707ab (stale) Mirror 17: 0xefc707ab (stale) Mirror 18: 0xefc707ab (stale) Mirror 19: 0xefc707ab (stale) Mirror 21: 0xefc707ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x276a4: skipped 000631 1789082893.488852 fallocate 0x012f00 thru 0x01831f (0x5420 bytes) 000632 1789082893.500577 punch from 0x01da5a to 0x024fb8 (0x755f bytes) 000633 1789082893.509756 trunc from 0x01aed1 to 0x01d526 (0x2656 bytes) 000634 1789082893.525721 write 0x00358b thru 0x00a609 (0x707f bytes) 000636 1789082893.564652 write 0x039b9f thru 0x03ffff (0x6461 bytes) 000637 1789082893.577517 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x90e50cf9 (stale) Mirror 16: 0x90e50cf9 (stale) Mirror 17: 0x90e50cf9 (stale) Mirror 19: 0x90e50cf9 (stale) Mirror 21: 0x90e50cf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x90e50cf9 (stale) Mirror 16: 0x90e50cf9 (stale) Mirror 17: 0x90e50cf9 (stale) Mirror 19: 0x90e50cf9 (stale) Mirror 21: 0x90e50cf9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000638 1789082894.039049 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x90e50cf9 (stale) Mirror 16: 0x90e50cf9 (stale) Mirror 17: 0x90e50cf9 (stale) Mirror 19: 0x90e50cf9 (stale) Mirror 21: 0x90e50cf9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4adb154e Mirror 22: 0x4adb154e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000639 1789082895.545784 write 0x0024c9 thru 0x00a339 (0x7e71 bytes) 000640 1789082895.586238 mapread 0x00d900 thru 0x010cfd (0x33fe bytes) 000642 1789082895.603879 mapread 0x035fe1 thru 0x03fc17 (0x9c37 bytes) 000643 1789082895.616168 mapwrite 0x03fe1c thru 0x03ffff (0x1e4 bytes) 000645 1789082895.641348 mapread 0x027006 thru 0x03669e (0xf699 bytes) 000646 1789082895.653715 read 0x00d87b thru 0x018d30 (0xb4b6 bytes) 000647 1789082895.658532 write 0x01223f thru 0x01b23b (0x8ffd bytes) 000648 1789082895.672571 mapread 0x034d6f thru 0x03c619 (0x78ab bytes) 000649 1789082895.674387 trunc from 0x040000 to 0x038fb4 (0x704b bytes) 000651 1789082895.707622 mapread 0x02fe7a thru 0x037247 (0x73ce bytes) 000652 1789082895.710622 trunc from 0x00c544 to 0x019c76 (0xd733 bytes) 000653 1789082895.735737 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x38fb5): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38fb5): Mirror 14: 0xfffd6ede (stale) Mirror 16: 0xfffd6ede (stale) Mirror 17: 0xfffd6ede (stale) Mirror 19: 0xfffd6ede (stale) Mirror 21: 0xfffd6ede (stale) Mirror 22: 0xf775b3f3 (stale) CRC-32 checksum value for chunk [0, 0x38fb5): Mirror 1: 0xdb24e29d Mirror 23: 0xdb24e29d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38fb5: skipped 000654 1789082896.792928 fallocate 0x03a400 thru 0x03ffff (0x5c00 bytes) 000655 1789082896.824421 read 0x02cac2 thru 0x036ad7 (0xa016 bytes) 000656 1789082896.840909 mapwrite 0x01ec94 thru 0x02dc95 (0xf002 bytes) 000657 1789082896.916338 trunc from 0x015701 to 0x02324e (0xdb4e bytes) 000658 1789082896.939639 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x38fb5): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38fb5): Mirror 14: 0xfffd6ede (stale) Mirror 16: 0xfffd6ede (stale) Mirror 17: 0xfffd6ede (stale) Mirror 19: 0xfffd6ede (stale) Mirror 21: 0xfffd6ede (stale) Mirror 22: 0xf775b3f3 (stale) Mirror 23: 0xdb24e29d (stale) CRC-32 checksum value for chunk [0, 0x38fb5): Mirror 1: 0x794439c1 Mirror 24: 0x794439c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38fb5: skipped 000659 1789082898.229881 punch from 0x026e66 to 0x030a9f (0x9c3a bytes) 000661 1789082898.318518 trunc from 0x0200a3 to 0x02e105 (0xe063 bytes) 000662 1789082898.323569 trunc from 0x0153ec to 0x023132 (0xdd47 bytes) 000663 1789082898.332064 fallocate 0x02c3df thru 0x038b2f (0xc751 bytes) 000666 1789082898.342215 mapwrite 0x01e4c4 thru 0x02b1e5 (0xcd22 bytes) 000667 1789082898.438372 fallocate 0x01e1fe thru 0x02491b (0x671e bytes) 000669 1789082898.455409 punch from 0x015d5a to 0x01b350 (0x55f7 bytes) 000670 1789082898.467917 mapwrite 0x02dff7 thru 0x036c55 (0x8c5f bytes) 000671 1789082898.493944 trunc from 0x00d5f6 to 0x010f47 (0x3952 bytes) 000672 1789082898.498383 fallocate 0x028a28 thru 0x037a87 (0xf060 bytes) 000675 1789082898.506230 punch from 0x01cca5 to 0x0224e0 (0x583c bytes) 000676 1789082898.511917 trunc from 0x000dbd to 0x004c9a (0x3ede bytes) 000677 1789082898.516980 read 0x006836 thru 0x00afcc (0x4797 bytes) 000678 1789082898.525583 trunc from 0x038fb5 to 0x019ea0 (0x1f114 bytes) 000679 1789082898.554512 mapread 0x00137f thru 0x008489 (0x710b bytes) 000680 1789082898.576167 trunc from 0x019ea1 to 0x02aee1 (0x11041 bytes) 000681 1789082898.608714 mapread 0x0060e0 thru 0x01051d (0xa43e bytes) 000683 1789082898.657043 write 0x00e820 thru 0x01a4a1 (0xbc82 bytes) 000684 1789082898.675961 punch from 0x013d0a to 0x015acd (0x1dc4 bytes) 000685 1789082898.705457 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2aee2): Mirror 14: 0x52e5e8cf (stale) Mirror 16: 0x52e5e8cf (stale) Mirror 19: 0x52e5e8cf (stale) Mirror 21: 0x52e5e8cf (stale) Mirror 22: 0xb6efaffb (stale) Mirror 23: 0x17dd290b (stale) Mirror 24: 0x428a8834 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aee2): Mirror 14: 0x52e5e8cf (stale) Mirror 16: 0x52e5e8cf (stale) Mirror 19: 0x52e5e8cf (stale) Mirror 21: 0x52e5e8cf (stale) Mirror 22: 0xb6efaffb (stale) Mirror 23: 0x17dd290b (stale) Mirror 24: 0x428a8834 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aee2: skipped 000686 1789082899.331896 mapread 0x017542 thru 0x02543c (0xdefb bytes) 000687 1789082899.371359 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2aee2): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aee2): Mirror 14: 0x52e5e8cf (stale) Mirror 16: 0x52e5e8cf (stale) Mirror 19: 0x52e5e8cf (stale) Mirror 21: 0x52e5e8cf (stale) Mirror 22: 0xb6efaffb (stale) Mirror 23: 0x17dd290b (stale) Mirror 24: 0x428a8834 (stale) CRC-32 checksum value for chunk [0, 0x2aee2): Mirror 1: 0x86d5f45d Mirror 25: 0x86d5f45d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aee2: skipped 000689 1789082900.819138 trunc from 0x02aee2 to 0x0013a0 (0x29b41 bytes) 000690 1789082900.893243 mapwrite 0x0394ee thru 0x039679 (0x18c bytes) 000691 1789082900.942308 fallocate 0x01455e thru 0x01478d (0x230 bytes) 000692 1789082900.951662 trunc from 0x0008f7 to 0x00f31e (0xea28 bytes) 000693 1789082900.976991 trunc from 0x03967a to 0x03f832 (0x61b9 bytes) 000694 1789082901.000754 trunc from 0x015208 to 0x0250e6 (0xfedf bytes) 000695 1789082901.006527 fallocate 0x00ce3b thru 0x018627 (0xb7ed bytes) 000696 1789082901.014117 write 0x005368 thru 0x009409 (0x40a2 bytes) 000697 1789082901.024152 punch from 0x025068 to 0x02805f (0x2ff8 bytes) 000698 1789082901.033216 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f833): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f833): Mirror 14: 0x20f19335 (stale) Mirror 16: 0x20f19335 (stale) Mirror 19: 0x20f19335 (stale) Mirror 21: 0x20f19335 (stale) Mirror 22: 0xd4c65719 (stale) Mirror 23: 0x37550e80 (stale) Mirror 24: 0x554b6b6b (stale) Mirror 25: 0x2d17c8d7 (stale) CRC-32 checksum value for chunk [0, 0x3f833): Mirror 1: 0xf55e6cea Mirror 26: 0xf55e6cea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f833: skipped 000700 1789082902.496012 fallocate 0x013041 thru 0x021b8c (0xeb4c bytes) 000701 1789082902.564861 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f833): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f833): Mirror 14: 0x20f19335 (stale) Mirror 16: 0x20f19335 (stale) Mirror 19: 0x20f19335 (stale) Mirror 21: 0x20f19335 (stale) Mirror 22: 0xd4c65719 (stale) Mirror 23: 0x37550e80 (stale) Mirror 24: 0x554b6b6b (stale) Mirror 25: 0x2d17c8d7 (stale) Mirror 26: 0xf55e6cea (stale) CRC-32 checksum value for chunk [0, 0x3f833): Mirror 1: 0xf55e6cea Mirror 27: 0xf55e6cea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f833: skipped 000702 1789082903.885709 trunc from 0x003b17 to 0x012d3d (0xf227 bytes) 000703 1789082903.948047 trunc from 0x007f07 to 0x00b097 (0x3191 bytes) 000704 1789082903.964522 mapread 0x023395 thru 0x02b4d3 (0x813f bytes) 000705 1789082903.992565 mapread 0x018232 thru 0x022b96 (0xa965 bytes) 000706 1789082904.019537 trunc from 0x0056e6 to 0x013ed7 (0xe7f2 bytes) 000707 1789082904.036508 MIRROR_RESYNC 11 mirrors 000708 1789082907.155022 mapread 0x003628 thru 0x007491 (0x3e6a bytes) 000710 1789082907.175740 trunc from 0x03f833 to 0x020da0 (0x1ea92 bytes) 000711 1789082907.228475 trunc from 0x00bf83 to 0x01adb6 (0xee34 bytes) 000712 1789082907.234125 mapwrite 0x038ccd thru 0x03b785 (0x2ab9 bytes) 000713 1789082907.299468 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3b786): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b786): Mirror 14: 0x781a659b (stale) Mirror 16: 0x781a659b (stale) Mirror 19: 0x781a659b (stale) Mirror 21: 0x781a659b (stale) Mirror 22: 0x781a659b (stale) Mirror 23: 0x781a659b (stale) Mirror 24: 0x781a659b (stale) Mirror 25: 0x781a659b (stale) Mirror 26: 0x781a659b (stale) Mirror 27: 0x781a659b (stale) CRC-32 checksum value for chunk [0, 0x3b786): Mirror 1: 0x175c617e Mirror 28: 0x175c617e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b786: skipped 000714 1789082908.828647 trunc from 0x023596 to 0x02cb4a (0x95b5 bytes) 000715 1789082908.949315 MIRROR_RESYNC 12 mirrors 000716 1789082911.955348 trunc from 0x0370e3 to 0x03b785 (0x46a3 bytes) 000717 1789082912.057004 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3b786): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b786): Mirror 14: 0x175c617e (stale) Mirror 16: 0x175c617e (stale) Mirror 19: 0x175c617e (stale) Mirror 21: 0x175c617e (stale) Mirror 22: 0x175c617e (stale) Mirror 23: 0x175c617e (stale) Mirror 24: 0x175c617e (stale) Mirror 25: 0x175c617e (stale) Mirror 26: 0x175c617e (stale) Mirror 27: 0x175c617e (stale) Mirror 28: 0x175c617e (stale) CRC-32 checksum value for chunk [0, 0x3b786): Mirror 1: 0xfa374c9d Mirror 29: 0xfa374c9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b786: skipped 000718 1789082913.924334 trunc from 0x01079c to 0x019d31 (0x9596 bytes) 000719 1789082913.997495 trunc from 0x03b786 to 0x037ab3 (0x3cd2 bytes) 000720 1789082914.069303 mapwrite 0x000970 thru 0x0033b1 (0x2a42 bytes) 000721 1789082914.187274 read 0x01784c thru 0x0263b8 (0xeb6d bytes) 000722 1789082914.216436 mapwrite 0x02f65a thru 0x03788e (0x8235 bytes) 000723 1789082914.305415 write 0x012eb3 thru 0x01555c (0x26aa bytes) 000724 1789082914.335295 fallocate 0x01fc67 thru 0x02f3d1 (0xf76b bytes) 000725 1789082914.355349 mapread 0x01c293 thru 0x0235b3 (0x7321 bytes) 000726 1789082914.356610 mapread 0x022814 thru 0x02c53e (0x9d2b bytes) 000727 1789082914.374363 trunc from 0x02caa7 to 0x03133b (0x4895 bytes) 000728 1789082914.394440 fallocate 0x003420 thru 0x003719 (0x2fa bytes) 000729 1789082914.406512 write 0x00127a thru 0x00a85d (0x95e4 bytes) 000730 1789082914.408072 mapread 0x00de2a thru 0x01bbcf (0xdda6 bytes) 000732 1789082914.439362 fallocate 0x00c527 thru 0x015326 (0x8e00 bytes) 000733 1789082914.454446 write 0x031250 thru 0x0398ca (0x867b bytes) 000734 1789082914.462282 write 0x03459d thru 0x03d483 (0x8ee7 bytes) 000735 1789082914.469007 trunc from 0x00bfc7 to 0x017db3 (0xbded bytes) 000736 1789082914.486247 punch from 0x014d58 to 0x023733 (0xe9dc bytes) 000737 1789082914.508260 fallocate 0x03f7d8 thru 0x03ffff (0x828 bytes) 000738 1789082914.521114 mapread 0x02fdc0 thru 0x02ffb9 (0x1fa bytes) 000739 1789082914.540315 mapread 0x0340cc thru 0x03c556 (0x848b bytes) 000740 1789082914.545339 fallocate 0x03b685 thru 0x03ffff (0x497b bytes) 000741 1789082914.579406 write 0x006f14 thru 0x00fda0 (0x8e8d bytes) 000742 1789082914.592761 trunc from 0x040000 to 0x0282d1 (0x17d2e bytes) 000743 1789082914.613295 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x282d2): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x282d2): Mirror 14: 0x5eebcf54 (stale) Mirror 16: 0x5eebcf54 (stale) Mirror 19: 0x5eebcf54 (stale) Mirror 21: 0x5eebcf54 (stale) Mirror 22: 0x5eebcf54 (stale) Mirror 23: 0x5eebcf54 (stale) Mirror 24: 0x5eebcf54 (stale) Mirror 25: 0x5eebcf54 (stale) Mirror 26: 0x5eebcf54 (stale) Mirror 27: 0x5eebcf54 (stale) Mirror 28: 0x5eebcf54 (stale) Mirror 29: 0x5eebcf54 (stale) CRC-32 checksum value for chunk [0, 0x282d2): Mirror 1: 0xc1616a9e Mirror 30: 0xc1616a9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x282d2: skipped 000744 1789082915.714622 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x282d2): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x282d2): Mirror 14: 0x5eebcf54 (stale) Mirror 16: 0x5eebcf54 (stale) Mirror 19: 0x5eebcf54 (stale) Mirror 21: 0x5eebcf54 (stale) Mirror 22: 0x5eebcf54 (stale) Mirror 23: 0x5eebcf54 (stale) Mirror 24: 0x5eebcf54 (stale) Mirror 25: 0x5eebcf54 (stale) Mirror 26: 0x5eebcf54 (stale) Mirror 27: 0x5eebcf54 (stale) Mirror 28: 0x5eebcf54 (stale) Mirror 29: 0x5eebcf54 (stale) CRC-32 checksum value for chunk [0, 0x282d2): Mirror 1: 0xc1616a9e Mirror 30: 0xc1616a9e Mirror 31: 0xc1616a9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x282d2: skipped 000745 1789082917.279874 mapread 0x01f018 thru 0x024999 (0x5982 bytes) 000746 1789082917.301225 write 0x036c34 thru 0x039671 (0x2a3e bytes) 000747 1789082917.366633 mapread 0x00c2a0 thru 0x010560 (0x42c1 bytes) 000748 1789082917.378063 trunc from 0x0394a6 to 0x039671 (0x1cc bytes) 000749 1789082917.400330 punch from 0x0101c3 to 0x01eee6 (0xed24 bytes) 000750 1789082917.411107 write 0x0306c5 thru 0x03a4cd (0x9e09 bytes) 000751 1789082917.430628 mapread 0x03795d thru 0x03a4cd (0x2b71 bytes) 000752 1789082917.433004 read 0x0385f6 thru 0x03a4cd (0x1ed8 bytes) 000753 1789082917.433934 write 0x02ade5 thru 0x039d91 (0xefad bytes) 000754 1789082917.444950 write 0x010ee2 thru 0x01361b (0x273a bytes) 000755 1789082917.454256 fallocate 0x0356fd thru 0x03c65d (0x6f61 bytes) 000756 1789082917.460856 write 0x004fae thru 0x00ed10 (0x9d63 bytes) 000757 1789082917.467698 read 0x00a45e thru 0x00e5a7 (0x414a bytes) 000758 1789082917.468924 write 0x01e005 thru 0x01e1bb (0x1b7 bytes) 000759 1789082917.479226 write 0x029232 thru 0x02a0c7 (0xe96 bytes) 000760 1789082917.480693 trunc from 0x01e09c to 0x02bc09 (0xdb6e bytes) 000762 1789082917.498542 punch from 0x03634b to 0x036976 (0x62c bytes) 000763 1789082917.503285 mapread 0x021a43 thru 0x02746f (0x5a2d bytes) 000764 1789082917.535620 mapread 0x02f889 thru 0x0389cf (0x9147 bytes) 000765 1789082917.543168 fallocate 0x018339 thru 0x0258df (0xd5a7 bytes) 000766 1789082917.548610 trunc from 0x03a4ce to 0x00206d (0x38460 bytes) 000767 1789082917.591233 trunc from 0x001ae8 to 0x00206d (0x586 bytes) 000769 1789082917.597776 trunc from 0x0007c2 to 0x00206d (0x18ac bytes) 000771 1789082917.605384 punch from 0x001bdf to 0x00206d (0x48f bytes) 000772 1789082917.614670 punch from 0x000187 to 0x00206d (0x1ee7 bytes) 000773 1789082917.619364 write 0x0208e5 thru 0x024939 (0x4055 bytes) 000774 1789082917.622256 mapwrite 0x037640 thru 0x0379c4 (0x385 bytes) 000775 1789082917.664987 read 0x015394 thru 0x0181c0 (0x2e2d bytes) 000776 1789082917.687208 mapread 0x008d49 thru 0x01855b (0xf813 bytes) 000777 1789082917.689096 mapread 0x0150de thru 0x022a47 (0xd96a bytes) 000778 1789082917.690888 mapread 0x02a9ba thru 0x02b803 (0xe4a bytes) 000780 1789082917.697083 MIRROR_RESYNC 15 mirrors 000781 1789082921.776108 read 0x016512 thru 0x025ef0 (0xf9df bytes) 000782 1789082921.790606 punch from 0x028f22 to 0x0379c4 (0xeaa3 bytes) 000783 1789082921.838516 read 0x00370a thru 0x00e8e9 (0xb1e0 bytes) 000784 1789082921.849209 write 0x0044b4 thru 0x00ef34 (0xaa81 bytes) 000785 1789082921.850996 mapwrite 0x01621d thru 0x018f36 (0x2d1a bytes) 000786 1789082921.870419 fallocate 0x033f5d thru 0x035184 (0x1228 bytes) 000787 1789082921.880838 punch from 0x019788 to 0x01ec5c (0x54d5 bytes) 000788 1789082921.898023 read 0x0016c0 thru 0x00559a (0x3edb bytes) 000789 1789082921.899735 read 0x018c63 thru 0x01a76f (0x1b0d bytes) 000790 1789082921.913997 mapread 0x0146ed thru 0x023fc0 (0xf8d4 bytes) 000791 1789082921.917143 mapread 0x0246f7 thru 0x0319e8 (0xd2f2 bytes) 000792 1789082921.922033 write 0x009063 thru 0x00ad22 (0x1cc0 bytes) 000794 1789082921.924916 trunc from 0x0379c5 to 0x0327c9 (0x51fb bytes) 000796 1789082921.961735 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x327ca): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x327ca): Mirror 14: 0x8cb58a76 (stale) Mirror 16: 0x8cb58a76 (stale) Mirror 19: 0x8cb58a76 (stale) Mirror 21: 0x8cb58a76 (stale) Mirror 22: 0x8cb58a76 (stale) Mirror 23: 0x8cb58a76 (stale) Mirror 24: 0x8cb58a76 (stale) Mirror 25: 0x8cb58a76 (stale) Mirror 26: 0x8cb58a76 (stale) Mirror 27: 0x8cb58a76 (stale) Mirror 28: 0x8cb58a76 (stale) Mirror 29: 0x8cb58a76 (stale) Mirror 30: 0x8cb58a76 (stale) Mirror 31: 0x8cb58a76 (stale) CRC-32 checksum value for chunk [0, 0x327ca): Mirror 1: 0xf677f182 Mirror 32: 0xf677f182 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x327ca: skipped 000797 1789082923.688732 punch from 0x0116dc to 0x012495 (0xdba bytes) 000798 1789082923.734588 mapread 0x00b2fe thru 0x01080e (0x5511 bytes) 000799 1789082923.766785 fallocate 0x02d168 thru 0x0390a5 (0xbf3e bytes) 000803 1789082923.792778 trunc from 0x02956b to 0x02adf7 (0x188d bytes) 000804 1789082923.811860 write 0x0063f0 thru 0x011443 (0xb054 bytes) 000805 1789082923.819177 trunc from 0x0390a6 to 0x025e36 (0x1326f bytes) 000806 1789082923.857921 trunc from 0x010845 to 0x010abd (0x279 bytes) 000807 1789082923.875724 trunc from 0x025e37 to 0x0162cc (0xfb6a bytes) 000808 1789082923.905599 mapread 0x0147f6 thru 0x0162cc (0x1ad7 bytes) 000809 1789082923.921729 punch from 0x014de5 to 0x0162cc (0x14e8 bytes) 000810 1789082923.929978 read 0x0015dc thru 0x00e205 (0xcc2a bytes) 000811 1789082923.942160 punch from 0x01503f to 0x0162cc (0x128e bytes) 000812 1789082923.949118 mapwrite 0x0340c3 thru 0x03eea8 (0xade6 bytes) 000813 1789082924.005043 trunc from 0x03eea9 to 0x02780c (0x1769c bytes) 000814 1789082924.020870 fallocate 0x0375c5 thru 0x03ec7d (0x76b9 bytes) 000815 1789082924.026739 write 0x0036d0 thru 0x0112c8 (0xdbf9 bytes) 000816 1789082924.028764 fallocate 0x02159e thru 0x02dbd1 (0xc634 bytes) 000817 1789082924.034093 fallocate 0x0030e5 thru 0x00c4c3 (0x93df bytes) 000819 1789082924.044927 fallocate 0x036cba thru 0x03ffff (0x9346 bytes) 000820 1789082924.053115 MIRROR_SPLIT mirror 8 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ec7e): Mirror 14: 0xb8f01a5a (stale) Mirror 16: 0xb8f01a5a (stale) Mirror 19: 0xb8f01a5a (stale) Mirror 21: 0xb8f01a5a (stale) Mirror 22: 0xb8f01a5a (stale) Mirror 23: 0xb8f01a5a (stale) Mirror 24: 0xb8f01a5a (stale) Mirror 26: 0xb8f01a5a (stale) Mirror 27: 0xb8f01a5a (stale) Mirror 28: 0xb8f01a5a (stale) Mirror 29: 0xb8f01a5a (stale) Mirror 30: 0xb8f01a5a (stale) Mirror 31: 0xb8f01a5a (stale) Mirror 32: 0xa89fd54e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec7e): Mirror 14: 0xb8f01a5a (stale) Mirror 16: 0xb8f01a5a (stale) Mirror 19: 0xb8f01a5a (stale) Mirror 21: 0xb8f01a5a (stale) Mirror 22: 0xb8f01a5a (stale) Mirror 23: 0xb8f01a5a (stale) Mirror 24: 0xb8f01a5a (stale) Mirror 26: 0xb8f01a5a (stale) Mirror 27: 0xb8f01a5a (stale) Mirror 28: 0xb8f01a5a (stale) Mirror 29: 0xb8f01a5a (stale) Mirror 30: 0xb8f01a5a (stale) Mirror 31: 0xb8f01a5a (stale) Mirror 32: 0xa89fd54e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec7e: skipped 000821 1789082925.002042 mapwrite 0x039064 thru 0x03ffff (0x6f9c bytes) 000822 1789082925.058682 trunc from 0x00beb1 to 0x012671 (0x67c1 bytes) 000823 1789082925.066002 mapwrite 0x00093a thru 0x008d2b (0x83f2 bytes) 000824 1789082925.110646 fallocate 0x010ddd thru 0x018a9d (0x7cc1 bytes) 000825 1789082925.118970 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x6ae77104 (stale) Mirror 16: 0x6ae77104 (stale) Mirror 19: 0x6ae77104 (stale) Mirror 21: 0x6ae77104 (stale) Mirror 23: 0x6ae77104 (stale) Mirror 24: 0x6ae77104 (stale) Mirror 26: 0x6ae77104 (stale) Mirror 27: 0x6ae77104 (stale) Mirror 28: 0x6ae77104 (stale) Mirror 29: 0x6ae77104 (stale) Mirror 30: 0x6ae77104 (stale) Mirror 31: 0x6ae77104 (stale) Mirror 32: 0x4302906c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x6ae77104 (stale) Mirror 16: 0x6ae77104 (stale) Mirror 19: 0x6ae77104 (stale) Mirror 21: 0x6ae77104 (stale) Mirror 23: 0x6ae77104 (stale) Mirror 24: 0x6ae77104 (stale) Mirror 26: 0x6ae77104 (stale) Mirror 27: 0x6ae77104 (stale) Mirror 28: 0x6ae77104 (stale) Mirror 29: 0x6ae77104 (stale) Mirror 30: 0x6ae77104 (stale) Mirror 31: 0x6ae77104 (stale) Mirror 32: 0x4302906c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000826 1789082926.204508 punch from 0x01332f to 0x01c50a (0x91dc bytes) 000827 1789082926.220161 mapwrite 0x036346 thru 0x0399a5 (0x3660 bytes) 000828 1789082926.325381 punch from 0x00d26d to 0x016443 (0x91d7 bytes) 000829 1789082926.338128 trunc from 0x040000 to 0x03444f (0xbbb0 bytes) 000830 1789082926.407737 trunc from 0x023a70 to 0x02f0fb (0xb68c bytes) 000831 1789082926.421993 trunc from 0x034450 to 0x007bd3 (0x2c87c bytes) 000832 1789082926.492376 MIRROR_RESYNC 14 mirrors 000833 1789082928.293859 trunc from 0x000f86 to 0x007bd3 (0x6c4e bytes) 000835 1789082928.338863 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7bd4): Mirror 14: 0x32cc99ef (stale) Mirror 16: 0x32cc99ef (stale) Mirror 19: 0x32cc99ef (stale) Mirror 21: 0x32cc99ef (stale) Mirror 23: 0x32cc99ef (stale) Mirror 24: 0x32cc99ef (stale) Mirror 26: 0x32cc99ef (stale) Mirror 27: 0x32cc99ef (stale) Mirror 28: 0x32cc99ef (stale) Mirror 29: 0x32cc99ef (stale) Mirror 30: 0x32cc99ef (stale) Mirror 31: 0x32cc99ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7bd4): Mirror 14: 0x32cc99ef (stale) Mirror 16: 0x32cc99ef (stale) Mirror 19: 0x32cc99ef (stale) Mirror 21: 0x32cc99ef (stale) Mirror 23: 0x32cc99ef (stale) Mirror 24: 0x32cc99ef (stale) Mirror 26: 0x32cc99ef (stale) Mirror 27: 0x32cc99ef (stale) Mirror 28: 0x32cc99ef (stale) Mirror 29: 0x32cc99ef (stale) Mirror 30: 0x32cc99ef (stale) Mirror 31: 0x32cc99ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7bd4: skipped 000836 1789082929.141140 trunc from 0x007bd4 to 0x03c6c8 (0x34af5 bytes) 000837 1789082929.174714 mapwrite 0x0242b4 thru 0x02a457 (0x61a4 bytes) 000838 1789082929.270300 mapwrite 0x00667f thru 0x009845 (0x31c7 bytes) 000839 1789082929.321139 punch from 0x025e16 to 0x02a379 (0x4564 bytes) 000840 1789082929.340364 mapread 0x03752a thru 0x03c6c8 (0x519f bytes) 000841 1789082929.405713 mapread 0x022188 thru 0x02afce (0x8e47 bytes) 000842 1789082929.433708 mapwrite 0x01a080 thru 0x0239cf (0x9950 bytes) 000843 1789082929.506384 punch from 0x0006ec to 0x00222e (0x1b43 bytes) 000845 1789082929.519070 fallocate 0x0209c3 thru 0x02683e (0x5e7c bytes) 000846 1789082929.529351 read 0x00fcc6 thru 0x012fe8 (0x3323 bytes) 000848 1789082929.543427 write 0x025eea thru 0x02d6da (0x77f1 bytes) 000850 1789082929.553114 write 0x02f9c6 thru 0x034719 (0x4d54 bytes) 000851 1789082929.560644 mapread 0x023d14 thru 0x02bb74 (0x7e61 bytes) 000853 1789082929.580972 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3c6c9): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c6c9): Mirror 14: 0x97b973bd (stale) Mirror 16: 0x97b973bd (stale) Mirror 19: 0x97b973bd (stale) Mirror 21: 0x97b973bd (stale) Mirror 23: 0x97b973bd (stale) Mirror 24: 0x97b973bd (stale) Mirror 26: 0x97b973bd (stale) Mirror 27: 0x97b973bd (stale) Mirror 28: 0x97b973bd (stale) Mirror 29: 0x97b973bd (stale) Mirror 30: 0x97b973bd (stale) Mirror 31: 0x97b973bd (stale) CRC-32 checksum value for chunk [0, 0x3c6c9): Mirror 1: 0x82727eb4 Mirror 32: 0x82727eb4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c6c9: skipped 000854 1789082931.795373 mapread 0x030825 thru 0x03c6c8 (0xbea4 bytes) 000855 1789082931.860028 fallocate 0x03c234 thru 0x03ffff (0x3dcc bytes) 000856 1789082931.935434 trunc from 0x00575b to 0x0074fe (0x1da4 bytes) 000857 1789082931.942175 trunc from 0x040000 to 0x0187fe (0x27801 bytes) 000858 1789082931.994842 trunc from 0x00bf84 to 0x014c76 (0x8cf3 bytes) 000859 1789082932.007088 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x187ff): Mirror 14: 0xedd7deb9 (stale) Mirror 16: 0xedd7deb9 (stale) Mirror 19: 0xedd7deb9 (stale) Mirror 21: 0xedd7deb9 (stale) Mirror 23: 0xedd7deb9 (stale) Mirror 26: 0xedd7deb9 (stale) Mirror 27: 0xedd7deb9 (stale) Mirror 28: 0xedd7deb9 (stale) Mirror 29: 0xedd7deb9 (stale) Mirror 30: 0xedd7deb9 (stale) Mirror 31: 0xedd7deb9 (stale) Mirror 32: 0xcad5862d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x187ff): Mirror 14: 0xedd7deb9 (stale) Mirror 16: 0xedd7deb9 (stale) Mirror 19: 0xedd7deb9 (stale) Mirror 21: 0xedd7deb9 (stale) Mirror 23: 0xedd7deb9 (stale) Mirror 26: 0xedd7deb9 (stale) Mirror 27: 0xedd7deb9 (stale) Mirror 28: 0xedd7deb9 (stale) Mirror 29: 0xedd7deb9 (stale) Mirror 30: 0xedd7deb9 (stale) Mirror 31: 0xedd7deb9 (stale) Mirror 32: 0xcad5862d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x187ff: skipped 000860 1789082933.083552 punch from 0x005358 to 0x009d7f (0x4a28 bytes) 000861 1789082933.090546 mapwrite 0x006030 thru 0x0093d2 (0x33a3 bytes) 000862 1789082933.169323 mapread 0x017b4e thru 0x0187fe (0xcb1 bytes) 000863 1789082933.182049 trunc from 0x0187ff to 0x00ca33 (0xbdcb bytes) 000865 1789082933.230295 read 0x003c54 thru 0x00560f (0x19bc bytes) 000866 1789082933.231447 read 0x0037e4 thru 0x00ca33 (0x9250 bytes) 000867 1789082933.233044 trunc from 0x005555 to 0x00ad59 (0x5805 bytes) 000868 1789082933.245380 trunc from 0x00ca34 to 0x028f83 (0x1c550 bytes) 000869 1789082933.273853 mapwrite 0x0332dd thru 0x03ffff (0xcd23 bytes) 000870 1789082933.353442 MIRROR_RESYNC 13 mirrors 000871 1789082936.107259 trunc from 0x03c219 to 0x03ffff (0x3de7 bytes) 000872 1789082936.148420 trunc from 0x020725 to 0x029f98 (0x9874 bytes) 000873 1789082936.161324 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1ad:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x9c17db00 (stale) Mirror 16: 0x9c17db00 (stale) Mirror 19: 0x9c17db00 (stale) Mirror 21: 0x9c17db00 (stale) Mirror 23: 0x9c17db00 (stale) Mirror 26: 0x9c17db00 (stale) Mirror 27: 0x9c17db00 (stale) Mirror 29: 0x9c17db00 (stale) Mirror 30: 0x9c17db00 (stale) Mirror 31: 0x9c17db00 (stale) Mirror 32: 0x9c17db00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x9c17db00 (stale) Mirror 16: 0x9c17db00 (stale) Mirror 19: 0x9c17db00 (stale) Mirror 21: 0x9c17db00 (stale) Mirror 23: 0x9c17db00 (stale) Mirror 26: 0x9c17db00 (stale) Mirror 27: 0x9c17db00 (stale) Mirror 29: 0x9c17db00 (stale) Mirror 30: 0x9c17db00 (stale) Mirror 31: 0x9c17db00 (stale) Mirror 32: 0x9c17db00 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000875 1789082937.065617 read 0x030bb3 thru 0x03cf12 (0xc360 bytes) 000876 1789082937.077482 mapread 0x03ed3c thru 0x03ffff (0x12c4 bytes) 000877 1789082937.105300 punch from 0x00b15e to 0x011b38 (0x69db bytes) 000878 1789082937.115940 MIRROR_RESYNC 12 mirrors 000879 1789082940.362440 mapwrite 0x0350df thru 0x03f895 (0xa7b7 bytes) 000880 1789082940.483087 MIRROR_RESYNC 12 mirrors 000881 1789082942.416405 mapwrite 0x0272a2 thru 0x029f20 (0x2c7f bytes) 000882 1789082942.533688 read 0x014c8d thru 0x0182ab (0x361f bytes) 000884 1789082942.557718 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x4e65a2c2 (stale) Mirror 16: 0x4e65a2c2 (stale) Mirror 19: 0x4e65a2c2 (stale) Mirror 21: 0x4e65a2c2 (stale) Mirror 23: 0x4e65a2c2 (stale) Mirror 26: 0x4e65a2c2 (stale) Mirror 27: 0x4e65a2c2 (stale) Mirror 29: 0x4e65a2c2 (stale) Mirror 30: 0x4e65a2c2 (stale) Mirror 31: 0x4e65a2c2 (stale) Mirror 32: 0x4e65a2c2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x54c28bbe Mirror 33: 0x54c28bbe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000885 1789082943.912637 mapwrite 0x013d39 thru 0x01c012 (0x82da bytes) 000886 1789082944.047451 write 0x03c9b6 thru 0x03ffff (0x364a bytes) 000887 1789082944.056028 mapread 0x0206f5 thru 0x02caeb (0xc3f7 bytes) 000888 1789082944.077418 fallocate 0x03955a thru 0x03d849 (0x42f0 bytes) 000889 1789082944.083981 fallocate 0x031b40 thru 0x03eaf6 (0xcfb7 bytes) 000890 1789082944.090617 mapwrite 0x03a6af thru 0x03e041 (0x3993 bytes) 000891 1789082944.119872 fallocate 0x03bbb1 thru 0x03ffff (0x444f bytes) 000892 1789082944.129919 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x4e65a2c2 (stale) Mirror 16: 0x4e65a2c2 (stale) Mirror 19: 0x4e65a2c2 (stale) Mirror 21: 0x4e65a2c2 (stale) Mirror 23: 0x4e65a2c2 (stale) Mirror 26: 0x4e65a2c2 (stale) Mirror 27: 0x4e65a2c2 (stale) Mirror 29: 0x4e65a2c2 (stale) Mirror 30: 0x4e65a2c2 (stale) Mirror 31: 0x4e65a2c2 (stale) Mirror 32: 0x4e65a2c2 (stale) Mirror 33: 0x54c28bbe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5667dff6 Mirror 34: 0x5667dff6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000893 1789082945.587303 read 0x01a7d4 thru 0x026e95 (0xc6c2 bytes) 000894 1789082945.617750 mapwrite 0x00e022 thru 0x014ea5 (0x6e84 bytes) 000895 1789082945.776331 mapread 0x0375ac thru 0x03ffff (0x8a54 bytes) 000896 1789082945.786333 read 0x01179b thru 0x011932 (0x198 bytes) 000897 1789082945.788565 read 0x03ba39 thru 0x03ffff (0x45c7 bytes) 000898 1789082945.790070 trunc from 0x040000 to 0x036746 (0x98b9 bytes) 000899 1789082945.884537 trunc from 0x036747 to 0x007689 (0x2f0bd bytes) 000900 1789082945.915431 mapread 0x0046dc thru 0x007689 (0x2fae bytes) 000903 1789082945.937193 mapread 0x006850 thru 0x007689 (0xe3a bytes) 000904 1789082945.938395 trunc from 0x00768a to 0x026fc0 (0x1f937 bytes) 000905 1789082945.965932 write 0x006a71 thru 0x011a8f (0xb01f bytes) 000906 1789082945.975629 punch from 0x01524e to 0x024c5c (0xfa0f bytes) 000907 1789082945.982221 mapwrite 0x030730 thru 0x036a06 (0x62d7 bytes) 000908 1789082946.039409 fallocate 0x029f4d thru 0x02b3ed (0x14a1 bytes) 000909 1789082946.045229 write 0x022ee0 thru 0x029a50 (0x6b71 bytes) 000911 1789082946.047618 read 0x02c17b thru 0x02f84f (0x36d5 bytes) 000912 1789082946.049069 trunc from 0x036a07 to 0x034019 (0x29ed bytes) 000913 1789082946.074324 mapwrite 0x03ed36 thru 0x03ffff (0x12ca bytes) 000915 1789082946.164541 mapwrite 0x02051b thru 0x02f0b7 (0xeb9d bytes) 000916 1789082946.214330 MIRROR_RESYNC 14 mirrors 000917 1789082950.273266 mapread 0x027665 thru 0x032524 (0xaec0 bytes) 000920 1789082950.333752 punch from 0x00f067 to 0x0122ba (0x3254 bytes) 000921 1789082950.407372 mapread 0x038509 thru 0x03ffff (0x7af7 bytes) 000922 1789082950.450111 trunc from 0x00a6a5 to 0x00b1fe (0xb5a bytes) 000923 1789082950.461704 trunc from 0x040000 to 0x00ad00 (0x352ff bytes) 000924 1789082950.521224 punch from 0x004788 to 0x00ad00 (0x6579 bytes) 000925 1789082950.527410 write 0x021d7e thru 0x0270e4 (0x5367 bytes) 000926 1789082950.533412 punch from 0x020d0b to 0x0270e4 (0x63da bytes) 000927 1789082950.553966 mapwrite 0x02986e thru 0x02c51b (0x2cae bytes) 000928 1789082950.635908 punch from 0x00d038 to 0x014097 (0x7060 bytes) 000929 1789082950.652291 mapread 0x00b16a thru 0x017c8f (0xcb26 bytes) 000930 1789082950.674235 mapwrite 0x008865 thru 0x009aba (0x1256 bytes) 000931 1789082950.695519 write 0x01df30 thru 0x02bf04 (0xdfd5 bytes) 000932 1789082950.703113 punch from 0x0203de to 0x023fec (0x3c0f bytes) 000933 1789082950.722330 trunc from 0x02c51c to 0x009b20 (0x229fb bytes) 000934 1789082950.746551 punch from 0x001ced to 0x009b20 (0x7e34 bytes) 000936 1789082950.756580 read 0x00719f thru 0x007515 (0x377 bytes) 000937 1789082950.768337 mapwrite 0x02d4b8 thru 0x032d2c (0x5875 bytes) 000938 1789082950.814407 fallocate 0x0380f8 thru 0x03f806 (0x770f bytes) 000939 1789082950.823371 read 0x0106aa thru 0x0142de (0x3c35 bytes) 000940 1789082950.864544 MIRROR_RESYNC 14 mirrors 000941 1789082954.500993 punch from 0x0255b5 to 0x030268 (0xacb4 bytes) 000944 1789082954.569946 mapwrite 0x038573 thru 0x03a7c6 (0x2254 bytes) 000945 1789082954.659511 trunc from 0x02dfe4 to 0x038cf5 (0xad12 bytes) 000946 1789082954.666852 fallocate 0x02f549 thru 0x039195 (0x9c4d bytes) 000947 1789082954.681014 punch from 0x00254a to 0x00a958 (0x840f bytes) 000949 1789082954.689484 write 0x022a84 thru 0x02626a (0x37e7 bytes) 000950 1789082954.715779 mapwrite 0x010258 thru 0x01de2d (0xdbd6 bytes) 000952 1789082954.792847 read 0x005d8b thru 0x013d98 (0xe00e bytes) 000953 1789082954.799446 trunc from 0x03a7c7 to 0x01117e (0x29648 bytes) 000954 1789082954.820475 trunc from 0x01117f to 0x037d04 (0x26b86 bytes) 000955 1789082954.841643 write 0x000c26 thru 0x006a52 (0x5e2d bytes) 000956 1789082954.848660 mapread 0x009c55 thru 0x00ec9d (0x5049 bytes) 000957 1789082954.850221 mapwrite 0x03fea5 thru 0x03ffff (0x15b bytes) 000958 1789082954.890157 mapwrite 0x014984 thru 0x01c52f (0x7bac bytes) 000959 1789082954.914881 mapread 0x00e2ab thru 0x015113 (0x6e69 bytes) 000960 1789082954.916196 trunc from 0x040000 to 0x02d193 (0x12e6c bytes) 000961 1789082954.932231 fallocate 0x0214bb thru 0x022761 (0x12a7 bytes) 000962 1789082954.936935 mapwrite 0x02cbad thru 0x034037 (0x748b bytes) 000963 1789082954.986427 MIRROR_RESYNC 14 mirrors 000964 1789082958.942164 punch from 0x02f7cc to 0x032e03 (0x3638 bytes) 000966 1789082958.979858 MIRROR_RESYNC 14 mirrors 000967 1789082964.045245 mapread 0x00d5e6 thru 0x017d50 (0xa76b bytes) 000968 1789082964.093397 trunc from 0x034038 to 0x037994 (0x395d bytes) 000969 1789082964.196528 write 0x035d75 thru 0x03ffff (0xa28b bytes) 000970 1789082964.222745 read 0x03c3e0 thru 0x03ccf2 (0x913 bytes) 000971 1789082964.229047 trunc from 0x03d902 to 0x03f6ae (0x1dad bytes) 000972 1789082964.275154 trunc from 0x0149eb to 0x0208cc (0xbee2 bytes) 000973 1789082964.288874 mapread 0x0370eb thru 0x03dc08 (0x6b1e bytes) 000974 1789082964.312850 write 0x0065d5 thru 0x0157f5 (0xf221 bytes) 000975 1789082964.364283 punch from 0x033b8d to 0x03b8df (0x7d53 bytes) 000976 1789082964.374471 write 0x003f2f thru 0x00c2e4 (0x83b6 bytes) 000977 1789082964.392783 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x7c101955 (stale) Mirror 16: 0x7c101955 (stale) Mirror 19: 0x7c101955 (stale) Mirror 21: 0x7c101955 (stale) Mirror 23: 0x7c101955 (stale) Mirror 26: 0x7c101955 (stale) Mirror 27: 0x7c101955 (stale) Mirror 29: 0x7c101955 (stale) Mirror 30: 0x7c101955 (stale) Mirror 31: 0x7c101955 (stale) Mirror 32: 0x7c101955 (stale) Mirror 33: 0x7c101955 (stale) Mirror 34: 0x7c101955 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdc1a1c25 Mirror 35: 0xdc1a1c25 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000978 1789082965.664471 MIRROR_RESYNC 15 mirrors 000979 1789082970.400073 MIRROR_RESYNC 15 mirrors 000980 1789082971.131630 mapread 0x03443a thru 0x034ac2 (0x689 bytes) 000981 1789082971.137281 fallocate 0x03fb68 thru 0x03ffff (0x498 bytes) 000983 1789082971.177044 fallocate 0x01f53c thru 0x022c88 (0x374d bytes) 000986 1789082971.184250 read 0x026b3c thru 0x02c30b (0x57d0 bytes) 000987 1789082971.193697 write 0x027274 thru 0x02f2da (0x8067 bytes) 000988 1789082971.198878 punch from 0x0273c1 to 0x033868 (0xc4a8 bytes) 000989 1789082971.215314 trunc from 0x040000 to 0x036610 (0x99ef bytes) 000990 1789082971.237429 trunc from 0x02f379 to 0x034ee6 (0x5b6e bytes) 000992 1789082971.244016 mapwrite 0x01a180 thru 0x022159 (0x7fda bytes) 000993 1789082971.274922 mapread 0x014697 thru 0x024687 (0xfff1 bytes) 000994 1789082971.283400 mapwrite 0x02fc44 thru 0x037cf4 (0x80b1 bytes) 000995 1789082971.331767 trunc from 0x0003a8 to 0x004255 (0x3eae bytes) 000996 1789082971.344225 MIRROR_RESYNC 15 mirrors 000997 1789082976.037352 fallocate 0x0041ec thru 0x00f880 (0xb695 bytes) 001000 1789082976.120962 mapread 0x026868 thru 0x03236e (0xbb07 bytes) All operations completed A-OK!