== sanity-flr test 70a: flr mode fsx test ================ 13:13:12 (1788541992) Seed set to 1994 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1788541994.756483 write 0x03e344 thru 0x03f286 (0xf43 bytes) 000004 1788541994.770006 punch from 0x02f876 to 0x02f96d (0xf8 bytes) 000005 1788541994.781164 read 0x014544 thru 0x01f239 (0xacf6 bytes) 000007 1788541994.793066 punch from 0x0328ab to 0x03f286 (0xc9dc bytes) 000010 1788541994.798864 punch from 0x009b83 to 0x01561c (0xba9a bytes) 000011 1788541994.803033 write 0x032b83 thru 0x037769 (0x4be7 bytes) 000012 1788541994.817605 mapread 0x020dad thru 0x0304da (0xf72e bytes) 000013 1788541994.849991 write 0x0206a1 thru 0x02fd75 (0xf6d5 bytes) 000016 1788541994.854553 mapwrite 0x007fb7 thru 0x0169d0 (0xea1a bytes) 000018 1788541994.946429 mapwrite 0x03e2b8 thru 0x03ffff (0x1d48 bytes) 000020 1788541994.996770 mapread 0x035b26 thru 0x03e296 (0x8771 bytes) truncating to largest ever: 0xce97 000021 1788541994.999015 trunc from 0x040000 to 0x00ce96 (0x33169 bytes) 000022 1788541995.011283 mapread 0x007ddc thru 0x00b1d4 (0x33f9 bytes) 000024 1788541995.013840 punch from 0x000832 to 0x004293 (0x3a62 bytes) 000025 1788541995.018472 read 0x00393a thru 0x00a9df (0x70a6 bytes) 000026 1788541995.025513 mapread 0x0027a8 thru 0x003f15 (0x176e bytes) 000027 1788541995.026623 punch from 0x004983 to 0x009a0f (0x508d bytes) 000030 1788541995.031457 read 0x00b692 thru 0x00b797 (0x106 bytes) 000031 1788541995.032063 write 0x025865 thru 0x028a1f (0x31bb bytes) 000033 1788541995.034339 mapread 0x015745 thru 0x01da66 (0x8322 bytes) 000035 1788541995.041227 punch from 0x0156f2 to 0x01d54f (0x7e5e bytes) 000036 1788541995.051237 mapread 0x00f5ed thru 0x010a4d (0x1461 bytes) 000038 1788541995.054705 read 0x011e49 thru 0x01ef54 (0xd10c bytes) 000040 1788541995.071469 mapwrite 0x017597 thru 0x01a427 (0x2e91 bytes) 000042 1788541995.118509 trunc from 0x028a20 to 0x000cdd (0x27d42 bytes) 000043 1788541995.133982 punch from 0x000654 to 0x000aad (0x45a bytes) 000045 1788541995.139789 punch from 0x000cd4 to 0x000cdd (0xa bytes) 000047 1788541995.145311 read 0x000c2a thru 0x000cdd (0xb4 bytes) truncating to largest ever: 0x25b59 000048 1788541995.151309 trunc from 0x000cde to 0x025b58 (0x24e7b bytes) 000050 1788541995.165349 write 0x0309aa thru 0x03f0af (0xe706 bytes) 000052 1788541995.170128 read 0x03199d thru 0x032677 (0xcdb bytes) 000053 1788541995.174008 MIRROR_EXTEND to 2 mirrors 000054 1788541995.991337 trunc from 0x03f0b0 to 0x005026 (0x3a089 bytes) 000056 1788541996.125821 mapwrite 0x011c94 thru 0x0138e7 (0x1c54 bytes) 000057 1788541996.273754 punch from 0x00caf2 to 0x0138e7 (0x6df6 bytes) 000058 1788541996.279758 punch from 0x009166 to 0x00f18e (0x6029 bytes) 000059 1788541996.290147 read 0x00f321 thru 0x0138e7 (0x45c7 bytes) 000060 1788541996.340229 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000064 1788541996.544319 trunc from 0x0138e8 to 0x00aae7 (0x8e00 bytes) 000065 1788541996.560635 write 0x0352f9 thru 0x03789f (0x25a7 bytes) truncating to largest ever: 0x3619f 000066 1788541996.563471 trunc from 0x0378a0 to 0x03619e (0x1701 bytes) 000070 1788541996.579956 trunc from 0x03619f to 0x015b2f (0x2066f bytes) 000072 1788541996.596040 read 0x014515 thru 0x015b2f (0x161b bytes) 000076 1788541996.602545 trunc from 0x015b30 to 0x012cc9 (0x2e66 bytes) 000077 1788541996.622392 read 0x00a67c thru 0x012cc9 (0x864e bytes) 000078 1788541996.629217 trunc from 0x012cca to 0x007b14 (0xb1b5 bytes) 000079 1788541996.641429 mapread 0x006704 thru 0x007b14 (0x1411 bytes) 000080 1788541996.642246 mapread 0x000a04 thru 0x007b14 (0x7111 bytes) 000081 1788541996.643060 write 0x01f9d8 thru 0x02ddc2 (0xe3eb bytes) 000082 1788541996.648290 mapwrite 0x034d6a thru 0x03b755 (0x69ec bytes) 000083 1788541996.756674 write 0x03845c thru 0x03b909 (0x34ae bytes) 000084 1788541996.759139 write 0x02b503 thru 0x039071 (0xdb6f bytes) 000085 1788541996.761651 read 0x017862 thru 0x025c33 (0xe3d2 bytes) 000086 1788541996.762919 mapread 0x026fe2 thru 0x02ce00 (0x5e1f bytes) 000088 1788541996.764972 mapread 0x0070d8 thru 0x00e65b (0x7584 bytes) 000089 1788541996.774719 mapread 0x01b355 thru 0x01d1f1 (0x1e9d bytes) truncating to largest ever: 0x37023 000090 1788541996.776020 trunc from 0x03b90a to 0x037022 (0x48e7 bytes) 000091 1788541996.797466 mapwrite 0x020799 thru 0x02a741 (0x9fa9 bytes) 000092 1788541996.853428 write 0x0243d0 thru 0x030869 (0xc49a bytes) truncating to largest ever: 0x3ca34 000095 1788541996.857868 trunc from 0x037023 to 0x03ca33 (0x5a11 bytes) 000096 1788541996.871109 punch from 0x034957 to 0x03ca33 (0x80dd bytes) 000097 1788541996.882820 write 0x012b9c thru 0x02056a (0xd9cf bytes) 000098 1788541996.884590 punch from 0x0204df to 0x02bcdb (0xb7fd bytes) 000100 1788541996.912930 write 0x03359d thru 0x0379e8 (0x444c bytes) 000101 1788541996.930702 punch from 0x008e89 to 0x014589 (0xb701 bytes) 000103 1788541996.951217 trunc from 0x03ca34 to 0x023a37 (0x18ffc bytes) 000105 1788541996.967177 trunc from 0x023a38 to 0x02556a (0x1b33 bytes) 000106 1788541996.991439 mapwrite 0x003446 thru 0x005517 (0x20d2 bytes) 000107 1788541997.035169 read 0x018792 thru 0x0252a8 (0xcb17 bytes) 000108 1788541997.045389 write 0x037679 thru 0x03af56 (0x38de bytes) 000110 1788541997.047836 trunc from 0x03af57 to 0x00ecd9 (0x2c27d bytes) 000111 1788541997.065471 punch from 0x005d99 to 0x00ecd9 (0x8f41 bytes) 000112 1788541997.071827 trunc from 0x00ecda to 0x03958b (0x2a8b2 bytes) 000113 1788541997.092533 read 0x025bd6 thru 0x035613 (0xfa3e bytes) 000114 1788541997.106561 trunc from 0x03958c to 0x02c2d1 (0xd2ba bytes) 000115 1788541997.126639 read 0x023fc8 thru 0x02a673 (0x66ac bytes) 000117 1788541997.132318 trunc from 0x02c2d2 to 0x00b552 (0x20d7f bytes) 000118 1788541997.156250 trunc from 0x00b553 to 0x02a750 (0x1f1fe bytes) 000120 1788541997.188157 write 0x02b792 thru 0x033e58 (0x86c7 bytes) 000121 1788541997.193903 mapwrite 0x009490 thru 0x00de93 (0x4a04 bytes) 000123 1788541997.305930 mapwrite 0x01aef2 thru 0x01e5f8 (0x3707 bytes) 000125 1788541997.359489 mapread 0x02f428 thru 0x033e58 (0x4a31 bytes) 000127 1788541997.361501 read 0x001878 thru 0x00c0d9 (0xa862 bytes) 000131 1788541997.364439 trunc from 0x033e59 to 0x0303e4 (0x3a74 bytes) 000132 1788541997.377086 mapwrite 0x0393f3 thru 0x039e30 (0xa3e bytes) 000133 1788541997.435518 write 0x0394df thru 0x03ffff (0x6b21 bytes) 000134 1788541997.437497 mapwrite 0x02b43f thru 0x0390d3 (0xdc95 bytes) 000135 1788541997.482202 mapread 0x02d6c9 thru 0x02df09 (0x841 bytes) 000136 1788541997.483014 mapread 0x03a048 thru 0x03abdb (0xb94 bytes) 000137 1788541997.483688 mapread 0x03165f thru 0x03bf11 (0xa8b3 bytes) 000138 1788541997.485267 trunc from 0x040000 to 0x021745 (0x1e8ba bytes) 000139 1788541997.501124 punch from 0x012c6e to 0x01def3 (0xb286 bytes) 000140 1788541997.505604 mapwrite 0x0178da thru 0x01d2dc (0x5a03 bytes) 000142 1788541997.612248 mapwrite 0x0111fb thru 0x01a309 (0x910f bytes) 000145 1788541997.771042 write 0x03d937 thru 0x03ffff (0x26c9 bytes) 000146 1788541997.773649 mapread 0x02b4c9 thru 0x0322b3 (0x6deb bytes) 000148 1788541997.812557 punch from 0x001686 to 0x00cd19 (0xb694 bytes) 000149 1788541997.833991 mapread 0x00295f thru 0x00b78a (0x8e2c bytes) 000150 1788541997.907046 trunc from 0x040000 to 0x03769c (0x8963 bytes) 000153 1788541997.919602 mapread 0x012147 thru 0x0135cb (0x1485 bytes) 000154 1788541997.920377 punch from 0x00bd22 to 0x012076 (0x6355 bytes) 000155 1788541997.925585 write 0x03803f thru 0x03ffff (0x7fc1 bytes) 000156 1788541997.927187 write 0x0254c1 thru 0x02fd12 (0xa852 bytes) 000157 1788541997.942107 MIRROR_EXTEND to 2 mirrors 000159 1788541999.036461 mapread 0x038edf thru 0x03b3c2 (0x24e4 bytes) 000160 1788541999.079955 trunc from 0x040000 to 0x01b284 (0x24d7b bytes) 000161 1788541999.159234 write 0x000117 thru 0x002786 (0x2670 bytes) 000162 1788541999.167574 write 0x037b5b thru 0x03ffff (0x84a5 bytes) 000163 1788541999.169174 write 0x01396e thru 0x018321 (0x49b4 bytes) 000164 1788541999.178541 read 0x005784 thru 0x00de9c (0x8719 bytes) 000165 1788541999.197974 read 0x013318 thru 0x01b4db (0x81c4 bytes) 000166 1788541999.206281 write 0x007c1d thru 0x016e1a (0xf1fe bytes) 000167 1788541999.207607 write 0x0370dc thru 0x03ffff (0x8f24 bytes) 000168 1788541999.212417 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x316dc93b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcbb70eda Mirror 3: 0xcbb70eda lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000169 1788542000.306162 read 0x0075ff thru 0x00c65a (0x505c bytes) 000170 1788542000.332063 read 0x034e67 thru 0x03ffff (0xb199 bytes) 000171 1788542000.356293 read 0x020838 thru 0x020baa (0x373 bytes) 000172 1788542000.361590 mapread 0x00d4f1 thru 0x019f0c (0xca1c bytes) 000173 1788542000.384133 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x316dc93b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcbb70eda Mirror 3: 0xcbb70eda Mirror 4: 0xcbb70eda lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000174 1788542001.285306 mapread 0x01f1e0 thru 0x01f8c4 (0x6e5 bytes) 000175 1788542001.319592 write 0x001190 thru 0x00ffa4 (0xee15 bytes) 000177 1788542001.410957 mapwrite 0x01e4b5 thru 0x0226f3 (0x423f bytes) 000178 1788542001.467007 read 0x032683 thru 0x03ffff (0xd97d bytes) 000179 1788542001.473443 mapread 0x017e0d thru 0x01d574 (0x5768 bytes) 000180 1788542001.483092 read 0x02c1de thru 0x0342ff (0x8122 bytes) 000182 1788542001.497744 MIRROR_RESYNC 4 mirrors 000183 1788542003.221039 mapwrite 0x004271 thru 0x00c556 (0x82e6 bytes) 000185 1788542003.507588 mapread 0x03d747 thru 0x03ffff (0x28b9 bytes) 000187 1788542003.527126 MIRROR_RESYNC 4 mirrors 000189 1788542004.928694 mapread 0x02b17b thru 0x03a750 (0xf5d6 bytes) 000191 1788542004.959560 MIRROR_RESYNC 4 mirrors 000192 1788542005.294795 trunc from 0x040000 to 0x009ff7 (0x36008 bytes) 000195 1788542005.364423 punch from 0x003af6 to 0x009ff7 (0x6502 bytes) 000196 1788542005.370353 write 0x03fb83 thru 0x03ffff (0x47d bytes) 000197 1788542005.371397 read 0x01e847 thru 0x02a73b (0xbef5 bytes) 000198 1788542005.378282 mapread 0x035006 thru 0x03ffff (0xaffa bytes) 000199 1788542005.396506 MIRROR_RESYNC 4 mirrors 000200 1788542006.256215 mapwrite 0x006368 thru 0x009d7d (0x3a16 bytes) 000201 1788542006.443942 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6069fed9 (stale) Mirror 3: 0x6069fed9 (stale) Mirror 4: 0x6069fed9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3c44a0f3 Mirror 5: 0x3c44a0f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000203 1788542007.390239 read 0x010df5 thru 0x014f25 (0x4131 bytes) 000205 1788542007.399325 read 0x01e999 thru 0x028c95 (0xa2fd bytes) 000207 1788542007.412229 mapwrite 0x023ed6 thru 0x033ea9 (0xffd4 bytes) 000208 1788542007.637794 mapread 0x0295c8 thru 0x030403 (0x6e3c bytes) 000209 1788542007.638792 trunc from 0x040000 to 0x0202bc (0x1fd43 bytes) 000215 1788542007.676388 mapwrite 0x02a960 thru 0x035f48 (0xb5e9 bytes) 000216 1788542007.808571 mapwrite 0x02f21e thru 0x02fa9f (0x882 bytes) 000217 1788542007.874574 mapread 0x0140eb thru 0x015334 (0x124a bytes) 000220 1788542007.893076 punch from 0x0176f9 to 0x01a62c (0x2f34 bytes) 000221 1788542007.896863 write 0x0289e2 thru 0x03357c (0xab9b bytes) 000222 1788542007.904413 punch from 0x003069 to 0x012f26 (0xfebe bytes) 000224 1788542007.933483 read 0x02f0bb thru 0x03454d (0x5493 bytes) 000225 1788542007.934183 trunc from 0x035f49 to 0x02f7b8 (0x6790 bytes) 000226 1788542007.952295 write 0x0275b5 thru 0x03725b (0xfca7 bytes) 000227 1788542007.962264 write 0x018caa thru 0x01e04e (0x53a5 bytes) 000228 1788542007.964226 write 0x007557 thru 0x016767 (0xf211 bytes) 000229 1788542007.967011 mapread 0x01d998 thru 0x02d722 (0xfd8b bytes) 000230 1788542007.968282 mapread 0x01b915 thru 0x02a6e5 (0xedd1 bytes) 000231 1788542007.972908 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3725c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3725c): Mirror 2: 0xa2d53a60 (stale) Mirror 3: 0xa2d53a60 (stale) Mirror 4: 0xa2d53a60 (stale) Mirror 5: 0x19ed1cdf (stale) CRC-32 checksum value for chunk [0, 0x3725c): Mirror 1: 0x2a443ef3 Mirror 6: 0x2a443ef3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3725c: skipped 000232 1788542009.479171 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3725c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3725c): Mirror 2: 0xa2d53a60 (stale) Mirror 3: 0xa2d53a60 (stale) Mirror 4: 0xa2d53a60 (stale) Mirror 5: 0x19ed1cdf (stale) CRC-32 checksum value for chunk [0, 0x3725c): Mirror 1: 0x2a443ef3 Mirror 6: 0x2a443ef3 Mirror 7: 0x2a443ef3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3725c: skipped 000234 1788542010.755210 mapread 0x01ef7b thru 0x0253b1 (0x6437 bytes) 000236 1788542010.787180 write 0x03fba5 thru 0x03ffff (0x45b bytes) 000237 1788542010.879248 punch from 0x034c4d to 0x03668d (0x1a41 bytes) 000242 1788542010.889831 read 0x037356 thru 0x03f981 (0x862c bytes) 000245 1788542010.899253 trunc from 0x040000 to 0x0132e0 (0x2cd1f bytes) 000246 1788542010.920270 read 0x00fca4 thru 0x0132e0 (0x363d bytes) 000248 1788542010.929184 trunc from 0x0132e1 to 0x005a00 (0xd8e0 bytes) 000249 1788542010.941937 write 0x03c65f thru 0x03ebc8 (0x256a bytes) 000251 1788542010.943586 read 0x004576 thru 0x013e91 (0xf91c bytes) 000254 1788542010.957902 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ebc9): Mirror 3: 0x9de858c0 (stale) Mirror 4: 0x9de858c0 (stale) Mirror 5: 0x8ecef21f (stale) Mirror 6: 0x29498949 (stale) Mirror 7: 0x29498949 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebc9): Mirror 3: 0x9de858c0 (stale) Mirror 4: 0x9de858c0 (stale) Mirror 5: 0x8ecef21f (stale) Mirror 6: 0x29498949 (stale) Mirror 7: 0x29498949 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebc9: skipped 000255 1788542011.424941 write 0x00a215 thru 0x00f64b (0x5437 bytes) 000256 1788542011.436352 mapwrite 0x03f057 thru 0x03ffff (0xfa9 bytes) 000262 1788542011.565618 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6069fed9 (stale) Mirror 4: 0x6069fed9 (stale) Mirror 5: 0x3c44a0f3 (stale) Mirror 6: 0xc5fb1c83 (stale) Mirror 7: 0xc5fb1c83 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5a3ca102 Mirror 8: 0x5a3ca102 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1788542012.848204 mapwrite 0x0151f1 thru 0x01ae15 (0x5c25 bytes) 000264 1788542013.092565 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6069fed9 (stale) Mirror 5: 0x3c44a0f3 (stale) Mirror 6: 0xc5fb1c83 (stale) Mirror 7: 0xc5fb1c83 (stale) Mirror 8: 0x5a3ca102 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6069fed9 (stale) Mirror 5: 0x3c44a0f3 (stale) Mirror 6: 0xc5fb1c83 (stale) Mirror 7: 0xc5fb1c83 (stale) Mirror 8: 0x5a3ca102 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000265 1788542013.431205 mapwrite 0x000955 thru 0x002432 (0x1ade bytes) 000267 1788542013.479004 mapwrite 0x037dbc thru 0x03ffff (0x8244 bytes) 000268 1788542013.527591 read 0x000e7f thru 0x00916d (0x82ef bytes) 000269 1788542013.535013 write 0x029faa thru 0x032018 (0x806f bytes) 000270 1788542013.541332 punch from 0x024012 to 0x0337c6 (0xf7b5 bytes) 000272 1788542013.555732 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6069fed9 (stale) Mirror 6: 0xc5fb1c83 (stale) Mirror 7: 0xc5fb1c83 (stale) Mirror 8: 0x5a3ca102 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6069fed9 (stale) Mirror 6: 0xc5fb1c83 (stale) Mirror 7: 0xc5fb1c83 (stale) Mirror 8: 0x5a3ca102 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000275 1788542013.849242 mapwrite 0x0130dd thru 0x01e53c (0xb460 bytes) 000276 1788542013.938379 write 0x03fb4b thru 0x03ffff (0x4b5 bytes) 000278 1788542013.945631 write 0x019d74 thru 0x0210a0 (0x732d bytes) 000280 1788542013.948761 punch from 0x02e211 to 0x0325f7 (0x43e7 bytes) 000281 1788542013.963152 MIRROR_RESYNC 5 mirrors 000285 1788542015.751767 read 0x037799 thru 0x03ffff (0x8867 bytes) 000286 1788542015.760385 mapread 0x023721 thru 0x0318fc (0xe1dc bytes) 000287 1788542015.785341 MIRROR_RESYNC 5 mirrors 000290 1788542016.089860 trunc from 0x040000 to 0x013cf5 (0x2c30a bytes) 000292 1788542016.154482 mapwrite 0x03748b thru 0x03ffff (0x8b75 bytes) 000293 1788542016.234272 write 0x007848 thru 0x00ed04 (0x74bd bytes) 000294 1788542016.242211 mapwrite 0x00c6e2 thru 0x014660 (0x7f7f bytes) 000296 1788542016.294105 mapwrite 0x0363f2 thru 0x03ffff (0x9c0e bytes) 000297 1788542016.417147 punch from 0x030b3f to 0x0348fe (0x3dc0 bytes) 000298 1788542016.427128 write 0x03fe71 thru 0x03ffff (0x18f bytes) 000299 1788542016.428177 read 0x01a8c5 thru 0x01ba89 (0x11c5 bytes) 000301 1788542016.452024 read 0x02d47d thru 0x030a5b (0x35df bytes) 000302 1788542016.483410 trunc from 0x040000 to 0x023790 (0x1c86f bytes) 000306 1788542016.502060 trunc from 0x023791 to 0x0090a3 (0x1a6ed bytes) 000307 1788542016.529824 punch from 0x003ac1 to 0x0090a3 (0x55e3 bytes) 000308 1788542016.537136 write 0x017703 thru 0x02280b (0xb109 bytes) 000310 1788542016.539927 mapwrite 0x01ad93 thru 0x02a623 (0xf891 bytes) 000311 1788542016.708271 trunc from 0x02a624 to 0x016961 (0x13cc2 bytes) 000313 1788542016.722300 mapwrite 0x013f48 thru 0x020e4f (0xcf08 bytes) 000315 1788542016.832238 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20e50): Mirror 4: 0x99b7e3c1 (stale) Mirror 6: 0x99b7e3c1 (stale) Mirror 8: 0x99b7e3c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20e50): Mirror 4: 0x99b7e3c1 (stale) Mirror 6: 0x99b7e3c1 (stale) Mirror 8: 0x99b7e3c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20e50: skipped 000317 1788542017.149536 trunc from 0x020e50 to 0x014e4d (0xc002 bytes) 000320 1788542017.192073 read 0x00c691 thru 0x014e4d (0x87bd bytes) 000321 1788542017.206474 punch from 0x002a39 to 0x007850 (0x4e18 bytes) 000322 1788542017.218390 write 0x01c274 thru 0x0294de (0xd26b bytes) 000323 1788542017.220355 read 0x0270dd thru 0x02745c (0x380 bytes) 000324 1788542017.226394 trunc from 0x0294df to 0x02d3be (0x3ee0 bytes) 000325 1788542017.249799 read 0x012731 thru 0x01e4b2 (0xbd82 bytes) 000326 1788542017.260247 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d3bf): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d3bf): Mirror 4: 0x929effbe (stale) Mirror 6: 0x929effbe (stale) Mirror 8: 0x929effbe (stale) CRC-32 checksum value for chunk [0, 0x2d3bf): Mirror 1: 0x505a7bf3 Mirror 9: 0x505a7bf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d3bf: skipped 000327 1788542018.291542 read 0x00e892 thru 0x01d262 (0xe9d1 bytes) 000328 1788542018.299215 trunc from 0x02d3bf to 0x0321c3 (0x4e05 bytes) 000330 1788542018.398187 punch from 0x0297e9 to 0x0321c3 (0x89db bytes) 000331 1788542018.402096 write 0x01dbb5 thru 0x0292d2 (0xb71e bytes) 000334 1788542018.417332 MIRROR_RESYNC 5 mirrors 000335 1788542019.876310 mapread 0x009289 thru 0x00b9bb (0x2733 bytes) 000337 1788542019.917467 punch from 0x02b0ac to 0x0321c3 (0x7118 bytes) 000338 1788542020.015518 mapread 0x024001 thru 0x030a1d (0xca1d bytes) 000339 1788542020.037979 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x321c4): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321c4): Mirror 4: 0xbfe619f8 (stale) Mirror 6: 0xbfe619f8 (stale) Mirror 8: 0xbfe619f8 (stale) Mirror 9: 0xbfe619f8 (stale) CRC-32 checksum value for chunk [0, 0x321c4): Mirror 1: 0xbfe619f8 Mirror 10: 0xbfe619f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321c4: skipped 000341 1788542021.001433 read 0x001b67 thru 0x003b37 (0x1fd1 bytes) 000342 1788542021.012864 mapread 0x024c18 thru 0x02c3ef (0x77d8 bytes) 000343 1788542021.035930 write 0x0031e5 thru 0x00aeed (0x7d09 bytes) 000344 1788542021.102775 trunc from 0x0321c4 to 0x01b038 (0x1718b bytes) 000345 1788542021.118234 mapread 0x00aa2f thru 0x012c2e (0x8200 bytes) 000346 1788542021.130457 trunc from 0x01b039 to 0x038926 (0x1d8ee bytes) 000347 1788542021.149118 mapread 0x020b46 thru 0x0253ca (0x4885 bytes) 000349 1788542021.161175 MIRROR_RESYNC 6 mirrors 000350 1788542023.247636 MIRROR_EXTEND to 7 mirrors 000351 1788542023.990515 read 0x008802 thru 0x00ca63 (0x4262 bytes) 000353 1788542023.999796 mapwrite 0x01f840 thru 0x02f6ad (0xfe6e bytes) 000355 1788542024.212174 mapread 0x023d9c thru 0x02704b (0x32b0 bytes) 000356 1788542024.213227 mapwrite 0x02c907 thru 0x032e1f (0x6519 bytes) 000359 1788542024.276683 read 0x017a4d thru 0x01c799 (0x4d4d bytes) 000360 1788542024.289945 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x38927): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38927): Mirror 4: 0xfa3c81e (stale) Mirror 6: 0xfa3c81e (stale) Mirror 8: 0xfa3c81e (stale) Mirror 9: 0xfa3c81e (stale) Mirror 10: 0xfa3c81e (stale) Mirror 11: 0xfa3c81e (stale) CRC-32 checksum value for chunk [0, 0x38927): Mirror 1: 0x7ccd5c45 Mirror 12: 0x7ccd5c45 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38927: skipped 000361 1788542025.449877 read 0x02b75b thru 0x03343e (0x7ce4 bytes) 000362 1788542025.467386 write 0x009cd8 thru 0x0160f0 (0xc419 bytes) 000363 1788542025.545934 read 0x0308f4 thru 0x034c87 (0x4394 bytes) 000365 1788542025.563265 write 0x037be0 thru 0x03ffff (0x8420 bytes) 000366 1788542025.567252 mapwrite 0x003f39 thru 0x00d18d (0x9255 bytes) 000369 1788542025.691882 mapread 0x0155d4 thru 0x020ce8 (0xb715 bytes) 000371 1788542025.695023 punch from 0x0155b5 to 0x019e01 (0x484d bytes) 000373 1788542025.709708 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2539ea5 (stale) Mirror 6: 0x2539ea5 (stale) Mirror 8: 0x2539ea5 (stale) Mirror 9: 0x2539ea5 (stale) Mirror 10: 0x2539ea5 (stale) Mirror 11: 0x2539ea5 (stale) Mirror 12: 0xc3057b7b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf06eae6a Mirror 13: 0xf06eae6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000374 1788542027.298587 read 0x01d37b thru 0x021b2d (0x47b3 bytes) 000375 1788542027.310121 punch from 0x03ab0c to 0x03df2d (0x3422 bytes) 000376 1788542027.378914 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x2539ea5 (stale) Mirror 6: 0x2539ea5 (stale) Mirror 8: 0x2539ea5 (stale) Mirror 9: 0x2539ea5 (stale) Mirror 10: 0x2539ea5 (stale) Mirror 11: 0x2539ea5 (stale) Mirror 12: 0xc3057b7b (stale) Mirror 13: 0xf06eae6a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x71f31e55 Mirror 14: 0x71f31e55 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000377 1788542028.670492 write 0x03c062 thru 0x03ffff (0x3f9e bytes) 000378 1788542028.773252 mapwrite 0x0370f6 thru 0x03ef22 (0x7e2d bytes) 000379 1788542028.847848 mapread 0x01ea62 thru 0x021cb2 (0x3251 bytes) 000380 1788542028.857970 punch from 0x03159e to 0x0322fa (0xd5d bytes) 000381 1788542028.867895 write 0x00f79f thru 0x01f552 (0xfdb4 bytes) 000382 1788542028.878977 punch from 0x008ebf to 0x016e25 (0xdf67 bytes) 000384 1788542028.894638 mapwrite 0x02cb08 thru 0x02d896 (0xd8f bytes) 000385 1788542028.944814 write 0x00f628 thru 0x0142ac (0x4c85 bytes) 000389 1788542028.978608 punch from 0x02e70c to 0x03062f (0x1f24 bytes) 000390 1788542028.996018 trunc from 0x040000 to 0x010bc5 (0x2f43a bytes) 000391 1788542029.026240 read 0x008cdb thru 0x00fd07 (0x702d bytes) 000393 1788542029.035479 mapwrite 0x00492a thru 0x00eb7a (0xa251 bytes) 000394 1788542029.087559 trunc from 0x010bc6 to 0x01b610 (0xaa4b bytes) 000396 1788542029.117423 MIRROR_RESYNC 10 mirrors 000397 1788542031.116204 mapread 0x010975 thru 0x01b610 (0xac9c bytes) 000399 1788542031.154692 mapread 0x0007ce thru 0x003979 (0x31ac bytes) 000401 1788542031.166207 punch from 0x00303c to 0x00958a (0x654f bytes) 000402 1788542031.241221 mapread 0x010373 thru 0x013210 (0x2e9e bytes) 000403 1788542031.255383 write 0x03b8f0 thru 0x03ffff (0x4710 bytes) 000404 1788542031.256472 write 0x010951 thru 0x0122f3 (0x19a3 bytes) 000405 1788542031.257295 write 0x02578b thru 0x02ad08 (0x557e bytes) 000409 1788542031.284306 write 0x03bfe9 thru 0x03ffff (0x4017 bytes) 000410 1788542031.286043 write 0x020ace thru 0x02bacb (0xaffe bytes) 000411 1788542031.294440 mapwrite 0x03e98b thru 0x03ffff (0x1675 bytes) 000414 1788542031.351394 punch from 0x039a26 to 0x03ffff (0x65da bytes) 000415 1788542031.355293 mapread 0x03c6b9 thru 0x03d389 (0xcd1 bytes) 000417 1788542031.363159 mapread 0x01c1ca thru 0x02b4d6 (0xf30d bytes) 000418 1788542031.380031 mapread 0x0062e7 thru 0x007f96 (0x1cb0 bytes) 000419 1788542031.401253 write 0x0089ec thru 0x017dc0 (0xf3d5 bytes) 000421 1788542031.411533 MIRROR_RESYNC 10 mirrors 000422 1788542034.826558 write 0x034153 thru 0x03bfe5 (0x7e93 bytes) 000423 1788542034.955735 mapwrite 0x017ca6 thru 0x024b2b (0xce86 bytes) 000424 1788542035.090873 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xd3e9434e (stale) Mirror 8: 0xd3e9434e (stale) Mirror 9: 0xd3e9434e (stale) Mirror 10: 0xd3e9434e (stale) Mirror 11: 0xd3e9434e (stale) Mirror 12: 0xd3e9434e (stale) Mirror 13: 0xd3e9434e (stale) Mirror 14: 0xd3e9434e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xd3e9434e (stale) Mirror 8: 0xd3e9434e (stale) Mirror 9: 0xd3e9434e (stale) Mirror 10: 0xd3e9434e (stale) Mirror 11: 0xd3e9434e (stale) Mirror 12: 0xd3e9434e (stale) Mirror 13: 0xd3e9434e (stale) Mirror 14: 0xd3e9434e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000425 1788542035.493209 write 0x00fcfb thru 0x01c12a (0xc430 bytes) 000426 1788542035.502893 write 0x01b014 thru 0x021392 (0x637f bytes) 000427 1788542035.510743 read 0x019f72 thru 0x023c87 (0x9d16 bytes) 000430 1788542035.534466 MIRROR_RESYNC 9 mirrors 000431 1788542038.330272 read 0x013ad5 thru 0x01df2e (0xa45a bytes) 000432 1788542038.341217 mapwrite 0x019828 thru 0x026153 (0xc92c bytes) 000433 1788542038.526938 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x9ec14187 (stale) Mirror 8: 0x9ec14187 (stale) Mirror 9: 0x9ec14187 (stale) Mirror 10: 0x9ec14187 (stale) Mirror 11: 0x9ec14187 (stale) Mirror 13: 0x9ec14187 (stale) Mirror 14: 0x9ec14187 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x9ec14187 (stale) Mirror 8: 0x9ec14187 (stale) Mirror 9: 0x9ec14187 (stale) Mirror 10: 0x9ec14187 (stale) Mirror 11: 0x9ec14187 (stale) Mirror 13: 0x9ec14187 (stale) Mirror 14: 0x9ec14187 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000434 1788542039.053118 read 0x038711 thru 0x03fe43 (0x7733 bytes) 000435 1788542039.066910 punch from 0x024907 to 0x02b218 (0x6912 bytes) 000436 1788542039.075038 MIRROR_RESYNC 8 mirrors 000437 1788542042.477734 punch from 0x03cb6b to 0x03ffff (0x3495 bytes) 000438 1788542042.540274 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2fc98ad7 (stale) Mirror 8: 0x2fc98ad7 (stale) Mirror 9: 0x2fc98ad7 (stale) Mirror 10: 0x2fc98ad7 (stale) Mirror 11: 0x2fc98ad7 (stale) Mirror 13: 0x2fc98ad7 (stale) Mirror 14: 0x2fc98ad7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2fc98ad7 Mirror 15: 0x2fc98ad7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000439 1788542043.685556 read 0x039f49 thru 0x03ffff (0x60b7 bytes) 000440 1788542043.709627 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2fc98ad7 (stale) Mirror 8: 0x2fc98ad7 (stale) Mirror 9: 0x2fc98ad7 (stale) Mirror 10: 0x2fc98ad7 (stale) Mirror 11: 0x2fc98ad7 (stale) Mirror 14: 0x2fc98ad7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2fc98ad7 (stale) Mirror 8: 0x2fc98ad7 (stale) Mirror 9: 0x2fc98ad7 (stale) Mirror 10: 0x2fc98ad7 (stale) Mirror 11: 0x2fc98ad7 (stale) Mirror 14: 0x2fc98ad7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2fc98ad7 Mirror 15: 0x2fc98ad7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000441 1788542044.556250 mapread 0x024232 thru 0x031bd3 (0xd9a2 bytes) 000442 1788542044.593579 trunc from 0x040000 to 0x0068ff (0x39700 bytes) 000443 1788542044.683502 punch from 0x00517c to 0x0068ff (0x1784 bytes) 000444 1788542044.687172 mapread 0x00680c thru 0x0068ff (0xf4 bytes) 000445 1788542044.694111 mapread 0x00041e thru 0x0068ff (0x64e2 bytes) 000446 1788542044.699006 trunc from 0x006900 to 0x01f368 (0x18a69 bytes) 000448 1788542044.718128 mapwrite 0x0113eb thru 0x02117b (0xfd91 bytes) 000449 1788542044.783488 punch from 0x009c0e to 0x016a5b (0xce4e bytes) 000450 1788542044.788311 mapwrite 0x0152fa thru 0x02301d (0xdd24 bytes) 000451 1788542044.853417 trunc from 0x02301e to 0x0201a8 (0x2e75 bytes) 000456 1788542044.870052 trunc from 0x0201a9 to 0x01d515 (0x2c93 bytes) 000457 1788542044.883536 read 0x01a046 thru 0x01d515 (0x34d0 bytes) 000458 1788542044.884184 read 0x0178ef thru 0x01d515 (0x5c27 bytes) 000459 1788542044.885848 mapwrite 0x006d1b thru 0x011cac (0xaf92 bytes) 000460 1788542044.951967 trunc from 0x01d516 to 0x0360a6 (0x18b91 bytes) 000461 1788542044.983186 read 0x028681 thru 0x02e613 (0x5f93 bytes) 000462 1788542045.000323 mapread 0x0167c6 thru 0x02526e (0xeaa9 bytes) 000463 1788542045.001961 punch from 0x007842 to 0x00f735 (0x7ef4 bytes) 000464 1788542045.009324 trunc from 0x0360a7 to 0x03a1e2 (0x413c bytes) 000465 1788542045.024302 mapwrite 0x031f53 thru 0x032258 (0x306 bytes) 000466 1788542045.073157 punch from 0x038c17 to 0x03a1e2 (0x15cc bytes) 000467 1788542045.084044 trunc from 0x03a1e3 to 0x012e30 (0x273b2 bytes) 000468 1788542045.115005 mapread 0x00b22f thru 0x012b0f (0x78e1 bytes) 000469 1788542045.137166 trunc from 0x012e31 to 0x02102d (0xe1fd bytes) 000470 1788542045.163491 punch from 0x00cff5 to 0x00fcb3 (0x2cbf bytes) 000471 1788542045.176169 punch from 0x017330 to 0x01f888 (0x8559 bytes) 000472 1788542045.188405 mapread 0x0006b1 thru 0x006aef (0x643f bytes) 000473 1788542045.194226 mapread 0x008842 thru 0x00cf85 (0x4744 bytes) 000474 1788542045.231534 write 0x03aa6e thru 0x03ffff (0x5592 bytes) 000475 1788542045.244487 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2fc98ad7 (stale) Mirror 8: 0x2fc98ad7 (stale) Mirror 9: 0x2fc98ad7 (stale) Mirror 10: 0x2fc98ad7 (stale) Mirror 11: 0x2fc98ad7 (stale) Mirror 15: 0x2fc98ad7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x2fc98ad7 (stale) Mirror 8: 0x2fc98ad7 (stale) Mirror 9: 0x2fc98ad7 (stale) Mirror 10: 0x2fc98ad7 (stale) Mirror 11: 0x2fc98ad7 (stale) Mirror 15: 0x2fc98ad7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000476 1788542045.785040 MIRROR_RESYNC 7 mirrors 000477 1788542049.181147 punch from 0x02d854 to 0x0323ae (0x4b5b bytes) 000478 1788542049.265152 mapread 0x03bdee thru 0x03ffff (0x4212 bytes) 000479 1788542049.285348 trunc from 0x040000 to 0x02bfc9 (0x14036 bytes) 000480 1788542049.315033 mapread 0x027eaf thru 0x02bfc9 (0x411b bytes) 000483 1788542049.328778 trunc from 0x02bfca to 0x029f9e (0x202b bytes) 000484 1788542049.351281 punch from 0x00011b to 0x0043ee (0x42d4 bytes) 000485 1788542049.356170 mapwrite 0x0256be thru 0x0294d8 (0x3e1b bytes) 000487 1788542049.395251 trunc from 0x029f9f to 0x01b30c (0xec92 bytes) 000488 1788542049.414918 mapread 0x006e36 thru 0x00c24d (0x5418 bytes) 000490 1788542049.430200 MIRROR_RESYNC 7 mirrors 000491 1788542051.763618 read 0x008911 thru 0x015386 (0xca76 bytes) 000492 1788542051.780420 punch from 0x008d24 to 0x014227 (0xb504 bytes) 000493 1788542051.940504 MIRROR_RESYNC 7 mirrors 000494 1788542054.503130 trunc from 0x01b30d to 0x026347 (0xb03b bytes) 000495 1788542054.592697 write 0x02ed44 thru 0x036371 (0x762e bytes) 000496 1788542054.599647 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x36372): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36372): Mirror 6: 0x7ac472d9 (stale) Mirror 8: 0x7ac472d9 (stale) Mirror 9: 0x7ac472d9 (stale) Mirror 10: 0x7ac472d9 (stale) Mirror 11: 0x7ac472d9 (stale) Mirror 15: 0x7ac472d9 (stale) CRC-32 checksum value for chunk [0, 0x36372): Mirror 1: 0x9ae087b7 Mirror 16: 0x9ae087b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36372: skipped 000497 1788542055.955071 read 0x02e203 thru 0x036371 (0x816f bytes) 000498 1788542055.983275 punch from 0x00b554 to 0x014a58 (0x9505 bytes) 000499 1788542056.098316 trunc from 0x036372 to 0x0334fc (0x2e75 bytes) 000500 1788542056.137553 mapwrite 0x01078d thru 0x01b89f (0xb113 bytes) 000501 1788542056.291738 trunc from 0x0334fd to 0x03483b (0x133f bytes) 000502 1788542056.327397 mapwrite 0x021a06 thru 0x02aa07 (0x9002 bytes) 000503 1788542056.423626 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3483c): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3483c): Mirror 6: 0xcf509eaf (stale) Mirror 8: 0xcf509eaf (stale) Mirror 9: 0xcf509eaf (stale) Mirror 10: 0xcf509eaf (stale) Mirror 11: 0xcf509eaf (stale) Mirror 15: 0xcf509eaf (stale) Mirror 16: 0xdbe1a4e5 (stale) CRC-32 checksum value for chunk [0, 0x3483c): Mirror 1: 0x35731466 Mirror 17: 0x35731466 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3483c: skipped 000504 1788542057.706907 trunc from 0x03483c to 0x003527 (0x31314 bytes) 000506 1788542057.818254 read 0x0001fa thru 0x003527 (0x332e bytes) 000507 1788542057.831181 punch from 0x0010c8 to 0x003527 (0x2460 bytes) 000509 1788542057.851435 write 0x0315df thru 0x0359e8 (0x440a bytes) 000510 1788542057.862825 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x359e9): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x359e9): Mirror 6: 0x4d5eebbf (stale) Mirror 8: 0x4d5eebbf (stale) Mirror 9: 0x4d5eebbf (stale) Mirror 10: 0x4d5eebbf (stale) Mirror 11: 0x4d5eebbf (stale) Mirror 15: 0x4d5eebbf (stale) Mirror 16: 0x3742346 (stale) Mirror 17: 0x51700114 (stale) CRC-32 checksum value for chunk [0, 0x359e9): Mirror 1: 0xf5509dc Mirror 18: 0xf5509dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x359e9: skipped 000512 1788542059.312512 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x359e9): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x359e9): Mirror 6: 0x4d5eebbf (stale) Mirror 8: 0x4d5eebbf (stale) Mirror 9: 0x4d5eebbf (stale) Mirror 10: 0x4d5eebbf (stale) Mirror 11: 0x4d5eebbf (stale) Mirror 15: 0x4d5eebbf (stale) Mirror 16: 0x3742346 (stale) Mirror 17: 0x51700114 (stale) CRC-32 checksum value for chunk [0, 0x359e9): Mirror 1: 0xf5509dc Mirror 18: 0xf5509dc Mirror 19: 0xf5509dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x359e9: skipped 000514 1788542060.445943 trunc from 0x0359e9 to 0x030296 (0x5752 bytes) 000515 1788542060.526242 mapread 0x016354 thru 0x01e00e (0x7cbb bytes) 000516 1788542060.541800 mapread 0x010bac thru 0x0174f0 (0x6945 bytes) 000517 1788542060.548802 write 0x004e13 thru 0x00fb89 (0xad77 bytes) 000520 1788542060.554428 read 0x00a030 thru 0x015594 (0xb565 bytes) 000521 1788542060.559303 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30297): Mirror 6: 0xcd66638 (stale) Mirror 8: 0xcd66638 (stale) Mirror 9: 0xcd66638 (stale) Mirror 10: 0xcd66638 (stale) Mirror 11: 0xcd66638 (stale) Mirror 15: 0xcd66638 (stale) Mirror 16: 0xd6bbdbf9 (stale) Mirror 17: 0xb5e724e4 (stale) Mirror 19: 0x58a34b34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30297): Mirror 6: 0xcd66638 (stale) Mirror 8: 0xcd66638 (stale) Mirror 9: 0xcd66638 (stale) Mirror 10: 0xcd66638 (stale) Mirror 11: 0xcd66638 (stale) Mirror 15: 0xcd66638 (stale) Mirror 16: 0xd6bbdbf9 (stale) Mirror 17: 0xb5e724e4 (stale) Mirror 19: 0x58a34b34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30297: skipped 000522 1788542061.181352 trunc from 0x030297 to 0x01faf1 (0x107a5 bytes) 000523 1788542061.218981 mapwrite 0x0388b4 thru 0x03ffff (0x774c bytes) 000524 1788542061.469119 MIRROR_RESYNC 10 mirrors 000526 1788542064.684813 punch from 0x00a744 to 0x014003 (0x98c0 bytes) 000527 1788542064.769258 mapread 0x02bd41 thru 0x039a46 (0xdd06 bytes) 000528 1788542064.816853 punch from 0x03c287 to 0x03cfe8 (0xd62 bytes) 000529 1788542064.830326 write 0x01e059 thru 0x024241 (0x61e9 bytes) 000530 1788542064.853896 mapread 0x01e294 thru 0x02c0d6 (0xde43 bytes) 000531 1788542064.875644 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb7b710af (stale) Mirror 8: 0xb7b710af (stale) Mirror 9: 0xb7b710af (stale) Mirror 10: 0xb7b710af (stale) Mirror 11: 0xb7b710af (stale) Mirror 16: 0xb7b710af (stale) Mirror 17: 0xb7b710af (stale) Mirror 19: 0xb7b710af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb7b710af (stale) Mirror 8: 0xb7b710af (stale) Mirror 9: 0xb7b710af (stale) Mirror 10: 0xb7b710af (stale) Mirror 11: 0xb7b710af (stale) Mirror 16: 0xb7b710af (stale) Mirror 17: 0xb7b710af (stale) Mirror 19: 0xb7b710af (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000532 1788542065.339962 mapread 0x02eee0 thru 0x03e266 (0xf387 bytes) 000533 1788542065.398400 trunc from 0x040000 to 0x013aca (0x2c535 bytes) 000534 1788542065.427305 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13acb): Mirror 6: 0x4a2a60e4 (stale) Mirror 8: 0x4a2a60e4 (stale) Mirror 9: 0x4a2a60e4 (stale) Mirror 10: 0x4a2a60e4 (stale) Mirror 11: 0x4a2a60e4 (stale) Mirror 16: 0x4a2a60e4 (stale) Mirror 19: 0x4a2a60e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13acb): Mirror 6: 0x4a2a60e4 (stale) Mirror 8: 0x4a2a60e4 (stale) Mirror 9: 0x4a2a60e4 (stale) Mirror 10: 0x4a2a60e4 (stale) Mirror 11: 0x4a2a60e4 (stale) Mirror 16: 0x4a2a60e4 (stale) Mirror 19: 0x4a2a60e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13acb: skipped 000536 1788542065.988850 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x13acb): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13acb): Mirror 6: 0x4a2a60e4 (stale) Mirror 8: 0x4a2a60e4 (stale) Mirror 9: 0x4a2a60e4 (stale) Mirror 10: 0x4a2a60e4 (stale) Mirror 11: 0x4a2a60e4 (stale) Mirror 16: 0x4a2a60e4 (stale) Mirror 19: 0x4a2a60e4 (stale) CRC-32 checksum value for chunk [0, 0x13acb): Mirror 1: 0xee2b9ef0 Mirror 20: 0xee2b9ef0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13acb: skipped 000538 1788542067.155683 read 0x012887 thru 0x013aca (0x1244 bytes) 000542 1788542067.242027 trunc from 0x013acb to 0x00a9fe (0x90cc bytes) 000543 1788542067.377235 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xa9ff): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa9ff): Mirror 6: 0x30fea62a (stale) Mirror 8: 0x30fea62a (stale) Mirror 9: 0x30fea62a (stale) Mirror 10: 0x30fea62a (stale) Mirror 11: 0x30fea62a (stale) Mirror 16: 0x30fea62a (stale) Mirror 19: 0x30fea62a (stale) Mirror 20: 0xe3a92df0 (stale) CRC-32 checksum value for chunk [0, 0xa9ff): Mirror 1: 0xe3a92df0 Mirror 21: 0xe3a92df0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa9ff: skipped 000544 1788542068.507945 trunc from 0x00a9ff to 0x00700b (0x39f3 bytes) 000545 1788542068.622058 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x700c): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x700c): Mirror 6: 0xddb1efb3 (stale) Mirror 8: 0xddb1efb3 (stale) Mirror 9: 0xddb1efb3 (stale) Mirror 10: 0xddb1efb3 (stale) Mirror 11: 0xddb1efb3 (stale) Mirror 16: 0xddb1efb3 (stale) Mirror 19: 0xddb1efb3 (stale) Mirror 20: 0xddb1efb3 (stale) Mirror 21: 0xddb1efb3 (stale) CRC-32 checksum value for chunk [0, 0x700c): Mirror 1: 0xddb1efb3 Mirror 22: 0xddb1efb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x700c: skipped 000547 1788542070.004031 mapread 0x0026af thru 0x00700b (0x495d bytes) 000548 1788542070.077063 trunc from 0x00700c to 0x01fad0 (0x18ac5 bytes) 000549 1788542070.209485 read 0x01a605 thru 0x01fad0 (0x54cc bytes) 000550 1788542070.228794 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fad1): Mirror 6: 0x2c01c943 (stale) Mirror 8: 0x2c01c943 (stale) Mirror 9: 0x2c01c943 (stale) Mirror 10: 0x2c01c943 (stale) Mirror 11: 0x2c01c943 (stale) Mirror 16: 0x2c01c943 (stale) Mirror 19: 0x2c01c943 (stale) Mirror 20: 0x9a4bced5 (stale) Mirror 22: 0xdb45c7cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fad1): Mirror 6: 0x2c01c943 (stale) Mirror 8: 0x2c01c943 (stale) Mirror 9: 0x2c01c943 (stale) Mirror 10: 0x2c01c943 (stale) Mirror 11: 0x2c01c943 (stale) Mirror 16: 0x2c01c943 (stale) Mirror 19: 0x2c01c943 (stale) Mirror 20: 0x9a4bced5 (stale) Mirror 22: 0xdb45c7cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fad1: skipped 000551 1788542070.818777 write 0x01ffe2 thru 0x021bc8 (0x1be7 bytes) 000552 1788542070.826457 trunc from 0x021bc9 to 0x03b901 (0x19d39 bytes) 000553 1788542070.836461 trunc from 0x03b902 to 0x02de0f (0xdaf2 bytes) 000555 1788542070.848930 write 0x020324 thru 0x0219ef (0x16cc bytes) 000557 1788542070.850177 mapread 0x00a66e thru 0x017edb (0xd86e bytes) 000558 1788542070.868398 punch from 0x00ce37 to 0x013592 (0x675c bytes) 000559 1788542070.875022 mapwrite 0x0291e5 thru 0x02c50e (0x332a bytes) 000560 1788542070.927970 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2de10): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2de10): Mirror 6: 0xfab7c8c2 (stale) Mirror 8: 0xfab7c8c2 (stale) Mirror 9: 0xfab7c8c2 (stale) Mirror 10: 0xfab7c8c2 (stale) Mirror 11: 0xfab7c8c2 (stale) Mirror 16: 0xfab7c8c2 (stale) Mirror 19: 0xfab7c8c2 (stale) Mirror 20: 0x51459b8f (stale) Mirror 22: 0xa7d1d659 (stale) CRC-32 checksum value for chunk [0, 0x2de10): Mirror 1: 0x81253b70 Mirror 23: 0x81253b70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2de10: skipped 000561 1788542072.190282 punch from 0x005030 to 0x00a2b3 (0x5284 bytes) 000562 1788542072.315870 mapwrite 0x014718 thru 0x014edb (0x7c4 bytes) 000563 1788542072.417390 mapread 0x0160a7 thru 0x01a5bd (0x4517 bytes) 000564 1788542072.454081 trunc from 0x02de10 to 0x01f6a0 (0xe76f bytes) 000565 1788542072.506444 read 0x000a03 thru 0x00e325 (0xd923 bytes) 000567 1788542072.520061 mapwrite 0x01e9b2 thru 0x02b869 (0xceb8 bytes) 000568 1788542072.704049 mapwrite 0x007522 thru 0x00aed1 (0x39b0 bytes) 000570 1788542072.811013 read 0x0203ff thru 0x02b869 (0xb46b bytes) 000571 1788542072.812967 write 0x005057 thru 0x00ed0c (0x9cb6 bytes) 000572 1788542072.815468 write 0x01769d thru 0x017f02 (0x866 bytes) 000573 1788542072.817256 mapread 0x01f150 thru 0x020dc2 (0x1c73 bytes) 000576 1788542072.824252 write 0x02d360 thru 0x02e142 (0xde3 bytes) 000578 1788542072.833302 trunc from 0x02e143 to 0x01a305 (0x13e3d bytes) 000579 1788542072.879214 write 0x01df4b thru 0x01e849 (0x8ff bytes) 000580 1788542072.880365 mapread 0x0188d4 thru 0x01e849 (0x5f76 bytes) 000582 1788542072.897280 mapwrite 0x03b7da thru 0x03ffff (0x4826 bytes) 000583 1788542073.115168 write 0x02a4b4 thru 0x03a1d6 (0xfd23 bytes) 000584 1788542073.117484 mapwrite 0x015231 thru 0x017087 (0x1e57 bytes) 000585 1788542073.253198 mapwrite 0x00132c thru 0x008265 (0x6f3a bytes) 000587 1788542073.383373 read 0x03bbad thru 0x03ffff (0x4453 bytes) 000588 1788542073.384639 trunc from 0x040000 to 0x00e5be (0x31a41 bytes) 000589 1788542073.416400 mapwrite 0x014c73 thru 0x01b4c5 (0x6853 bytes) 000590 1788542073.593542 write 0x0328d5 thru 0x032e53 (0x57f bytes) 000592 1788542073.600270 trunc from 0x032e54 to 0x00d135 (0x25d1e bytes) 000594 1788542073.631211 mapread 0x0050fd thru 0x00d135 (0x8039 bytes) 000595 1788542073.641068 mapwrite 0x00fe15 thru 0x017ba6 (0x7d92 bytes) 000596 1788542073.885696 read 0x002cf1 thru 0x010654 (0xd964 bytes) 000598 1788542073.908307 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17ba7): Mirror 8: 0x7397fdff (stale) Mirror 9: 0x7397fdff (stale) Mirror 10: 0x7397fdff (stale) Mirror 11: 0x7397fdff (stale) Mirror 16: 0x7397fdff (stale) Mirror 19: 0x7397fdff (stale) Mirror 20: 0x1ad7b92 (stale) Mirror 22: 0x4ed474e5 (stale) Mirror 23: 0x4ed474e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17ba7): Mirror 8: 0x7397fdff (stale) Mirror 9: 0x7397fdff (stale) Mirror 10: 0x7397fdff (stale) Mirror 11: 0x7397fdff (stale) Mirror 16: 0x7397fdff (stale) Mirror 19: 0x7397fdff (stale) Mirror 20: 0x1ad7b92 (stale) Mirror 22: 0x4ed474e5 (stale) Mirror 23: 0x4ed474e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17ba7: skipped 000599 1788542074.677995 read 0x006404 thru 0x010cfa (0xa8f7 bytes) 000600 1788542074.697113 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17ba7): Mirror 9: 0x7397fdff (stale) Mirror 10: 0x7397fdff (stale) Mirror 11: 0x7397fdff (stale) Mirror 16: 0x7397fdff (stale) Mirror 19: 0x7397fdff (stale) Mirror 20: 0x1ad7b92 (stale) Mirror 22: 0x4ed474e5 (stale) Mirror 23: 0x4ed474e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17ba7): Mirror 9: 0x7397fdff (stale) Mirror 10: 0x7397fdff (stale) Mirror 11: 0x7397fdff (stale) Mirror 16: 0x7397fdff (stale) Mirror 19: 0x7397fdff (stale) Mirror 20: 0x1ad7b92 (stale) Mirror 22: 0x4ed474e5 (stale) Mirror 23: 0x4ed474e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17ba7: skipped 000602 1788542075.702757 trunc from 0x017ba7 to 0x023927 (0xbd81 bytes) 000603 1788542075.734911 write 0x01fdbe thru 0x02e8c4 (0xeb07 bytes) 000604 1788542075.752131 read 0x001ac8 thru 0x00cbc4 (0xb0fd bytes) 000606 1788542075.771752 MIRROR_RESYNC 9 mirrors 000608 1788542079.318281 write 0x00169a thru 0x005677 (0x3fde bytes) 000611 1788542079.468713 write 0x01240c thru 0x01fb70 (0xd765 bytes) 000612 1788542079.491069 punch from 0x012931 to 0x020f46 (0xe616 bytes) 000614 1788542079.540346 punch from 0x01fb07 to 0x02cfa3 (0xd49d bytes) 000615 1788542079.547141 read 0x02a0a4 thru 0x02e8c4 (0x4821 bytes) 000616 1788542079.568075 trunc from 0x02e8c5 to 0x00358d (0x2b337 bytes) 000617 1788542079.598000 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x358e): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x358e): Mirror 9: 0xcaeaf3b3 (stale) Mirror 10: 0xcaeaf3b3 (stale) Mirror 11: 0xcaeaf3b3 (stale) Mirror 16: 0xcaeaf3b3 (stale) Mirror 19: 0xcaeaf3b3 (stale) Mirror 20: 0xcaeaf3b3 (stale) Mirror 22: 0xcaeaf3b3 (stale) Mirror 23: 0xcaeaf3b3 (stale) CRC-32 checksum value for chunk [0, 0x358e): Mirror 1: 0xe323d66c Mirror 24: 0xe323d66c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x358e: skipped 000618 1788542080.971649 mapwrite 0x031516 thru 0x03295a (0x1445 bytes) 000619 1788542081.288273 punch from 0x02ba14 to 0x03295a (0x6f47 bytes) 000621 1788542081.326126 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0x2056e227 (stale) Mirror 10: 0x2056e227 (stale) Mirror 11: 0x2056e227 (stale) Mirror 16: 0x2056e227 (stale) Mirror 19: 0x2056e227 (stale) Mirror 20: 0x2056e227 (stale) Mirror 22: 0x2056e227 (stale) Mirror 23: 0x2056e227 (stale) Mirror 24: 0x181377bd (stale) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 1: 0x181377bd Mirror 25: 0x181377bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3295b: skipped 000623 1788542083.343062 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0x2056e227 (stale) Mirror 10: 0x2056e227 (stale) Mirror 11: 0x2056e227 (stale) Mirror 16: 0x2056e227 (stale) Mirror 19: 0x2056e227 (stale) Mirror 20: 0x2056e227 (stale) Mirror 22: 0x2056e227 (stale) Mirror 23: 0x2056e227 (stale) Mirror 24: 0x181377bd (stale) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 1: 0x181377bd Mirror 25: 0x181377bd Mirror 26: 0x181377bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3295b: skipped 000626 1788542084.688964 read 0x027647 thru 0x02f870 (0x822a bytes) 000627 1788542084.701013 write 0x01c317 thru 0x0292a0 (0xcf8a bytes) 000629 1788542084.816979 mapread 0x013a95 thru 0x01cc47 (0x91b3 bytes) 000630 1788542084.839628 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0x2056e227 (stale) Mirror 10: 0x2056e227 (stale) Mirror 11: 0x2056e227 (stale) Mirror 16: 0x2056e227 (stale) Mirror 19: 0x2056e227 (stale) Mirror 20: 0x2056e227 (stale) Mirror 22: 0x2056e227 (stale) Mirror 23: 0x2056e227 (stale) Mirror 24: 0x181377bd (stale) Mirror 25: 0x181377bd (stale) Mirror 26: 0x181377bd (stale) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 1: 0xffa96a0f Mirror 27: 0xffa96a0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3295b: skipped 000631 1788542086.090941 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0x2056e227 (stale) Mirror 10: 0x2056e227 (stale) Mirror 11: 0x2056e227 (stale) Mirror 16: 0x2056e227 (stale) Mirror 19: 0x2056e227 (stale) Mirror 20: 0x2056e227 (stale) Mirror 22: 0x2056e227 (stale) Mirror 23: 0x2056e227 (stale) Mirror 24: 0x181377bd (stale) Mirror 25: 0x181377bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0x2056e227 (stale) Mirror 10: 0x2056e227 (stale) Mirror 11: 0x2056e227 (stale) Mirror 16: 0x2056e227 (stale) Mirror 19: 0x2056e227 (stale) Mirror 20: 0x2056e227 (stale) Mirror 22: 0x2056e227 (stale) Mirror 23: 0x2056e227 (stale) Mirror 24: 0x181377bd (stale) Mirror 25: 0x181377bd (stale) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 1: 0xffa96a0f Mirror 27: 0xffa96a0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3295b: skipped 000634 1788542087.304984 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0x2056e227 (stale) Mirror 10: 0x2056e227 (stale) Mirror 16: 0x2056e227 (stale) Mirror 19: 0x2056e227 (stale) Mirror 20: 0x2056e227 (stale) Mirror 22: 0x2056e227 (stale) Mirror 23: 0x2056e227 (stale) Mirror 24: 0x181377bd (stale) Mirror 25: 0x181377bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0x2056e227 (stale) Mirror 10: 0x2056e227 (stale) Mirror 16: 0x2056e227 (stale) Mirror 19: 0x2056e227 (stale) Mirror 20: 0x2056e227 (stale) Mirror 22: 0x2056e227 (stale) Mirror 23: 0x2056e227 (stale) Mirror 24: 0x181377bd (stale) Mirror 25: 0x181377bd (stale) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 1: 0xffa96a0f Mirror 27: 0xffa96a0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3295b: skipped 000635 1788542088.145138 MIRROR_RESYNC 11 mirrors 000636 1788542090.397737 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000637 1788542090.736126 punch from 0x010858 to 0x01c8f0 (0xc099 bytes) 000641 1788542090.866221 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0xffa96a0f (stale) Mirror 10: 0xffa96a0f (stale) Mirror 16: 0xffa96a0f (stale) Mirror 19: 0xffa96a0f (stale) Mirror 20: 0xffa96a0f (stale) Mirror 22: 0xffa96a0f (stale) Mirror 23: 0xffa96a0f (stale) Mirror 24: 0xffa96a0f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0xffa96a0f (stale) Mirror 10: 0xffa96a0f (stale) Mirror 16: 0xffa96a0f (stale) Mirror 19: 0xffa96a0f (stale) Mirror 20: 0xffa96a0f (stale) Mirror 22: 0xffa96a0f (stale) Mirror 23: 0xffa96a0f (stale) Mirror 24: 0xffa96a0f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3295b: skipped 000642 1788542091.355294 read 0x0123e7 thru 0x018e28 (0x6a42 bytes) 000643 1788542091.363394 read 0x0315b6 thru 0x03295a (0x13a5 bytes) 000644 1788542091.375791 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3295b): Mirror 9: 0xffa96a0f (stale) Mirror 10: 0xffa96a0f (stale) Mirror 16: 0xffa96a0f (stale) Mirror 19: 0xffa96a0f (stale) Mirror 20: 0xffa96a0f (stale) Mirror 22: 0xffa96a0f (stale) Mirror 23: 0xffa96a0f (stale) Mirror 24: 0xffa96a0f (stale) CRC-32 checksum value for chunk [0, 0x3295b): Mirror 1: 0x852ea9e8 Mirror 25: 0x852ea9e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3295b: skipped 000645 1788542092.502627 write 0x03e362 thru 0x03ffff (0x1c9e bytes) 000647 1788542092.606131 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xb181f44c (stale) Mirror 10: 0xb181f44c (stale) Mirror 16: 0xb181f44c (stale) Mirror 19: 0xb181f44c (stale) Mirror 20: 0xb181f44c (stale) Mirror 22: 0xb181f44c (stale) Mirror 23: 0xb181f44c (stale) Mirror 24: 0xb181f44c (stale) Mirror 25: 0x99d6f07f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa0a4ce12 Mirror 26: 0xa0a4ce12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000648 1788542094.428122 write 0x010952 thru 0x0118a2 (0xf51 bytes) 000649 1788542094.607077 write 0x0193c4 thru 0x022d14 (0x9951 bytes) 000650 1788542094.624304 trunc from 0x040000 to 0x008e32 (0x371cd bytes) 000652 1788542094.653763 punch from 0x007a70 to 0x008144 (0x6d5 bytes) 000653 1788542094.660550 mapread 0x000ba7 thru 0x008e32 (0x828c bytes) 000654 1788542094.685356 mapread 0x001f42 thru 0x008e32 (0x6ef1 bytes) 000656 1788542094.696988 MIRROR_RESYNC 11 mirrors 000657 1788542097.097862 write 0x019dbd thru 0x0221b9 (0x83fd bytes) 000659 1788542097.307315 mapwrite 0x017c99 thru 0x0226e9 (0xaa51 bytes) 000660 1788542097.507048 trunc from 0x0226ea to 0x013295 (0xf454 bytes) 000661 1788542097.546316 write 0x03d395 thru 0x03ffff (0x2c6b bytes) 000662 1788542097.549745 punch from 0x0265ba to 0x02ce7b (0x68c2 bytes) 000663 1788542097.571432 mapread 0x026dd5 thru 0x0348f1 (0xdb1d bytes) 000664 1788542097.640125 MIRROR_RESYNC 11 mirrors 000665 1788542101.339050 punch from 0x001ad4 to 0x00ab5a (0x9087 bytes) 000666 1788542101.507497 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x80fb2e52 (stale) Mirror 10: 0x80fb2e52 (stale) Mirror 16: 0x80fb2e52 (stale) Mirror 19: 0x80fb2e52 (stale) Mirror 20: 0x80fb2e52 (stale) Mirror 22: 0x80fb2e52 (stale) Mirror 23: 0x80fb2e52 (stale) Mirror 24: 0x80fb2e52 (stale) Mirror 25: 0x80fb2e52 (stale) Mirror 26: 0x80fb2e52 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xed302e9b Mirror 27: 0xed302e9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000668 1788542102.851213 write 0x002d98 thru 0x00726f (0x44d8 bytes) 000669 1788542103.058180 mapwrite 0x03a3e1 thru 0x03ffff (0x5c1f bytes) 000671 1788542103.152402 read 0x01af3c thru 0x029c02 (0xecc7 bytes) 000673 1788542103.163838 trunc from 0x040000 to 0x00dd36 (0x322c9 bytes) 000674 1788542103.183003 punch from 0x006a3e to 0x00dd36 (0x72f9 bytes) 000675 1788542103.192226 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xdd37): Mirror 9: 0xb0a59c0a (stale) Mirror 10: 0xb0a59c0a (stale) Mirror 16: 0xb0a59c0a (stale) Mirror 19: 0xb0a59c0a (stale) Mirror 20: 0xb0a59c0a (stale) Mirror 22: 0xb0a59c0a (stale) Mirror 23: 0xb0a59c0a (stale) Mirror 24: 0xb0a59c0a (stale) Mirror 26: 0xb0a59c0a (stale) Mirror 27: 0x8b3ad19a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdd37): Mirror 9: 0xb0a59c0a (stale) Mirror 10: 0xb0a59c0a (stale) Mirror 16: 0xb0a59c0a (stale) Mirror 19: 0xb0a59c0a (stale) Mirror 20: 0xb0a59c0a (stale) Mirror 22: 0xb0a59c0a (stale) Mirror 23: 0xb0a59c0a (stale) Mirror 24: 0xb0a59c0a (stale) Mirror 26: 0xb0a59c0a (stale) Mirror 27: 0x8b3ad19a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdd37: skipped 000678 1788542103.607803 read 0x007f40 thru 0x00dd36 (0x5df7 bytes) 000679 1788542103.614493 read 0x002d2f thru 0x0092cd (0x659f bytes) 000681 1788542103.621019 write 0x037df1 thru 0x03ffff (0x820f bytes) 000682 1788542103.623234 trunc from 0x040000 to 0x0389dc (0x7623 bytes) 000683 1788542103.636540 mapread 0x008d63 thru 0x011413 (0x86b1 bytes) 000685 1788542103.646202 punch from 0x021841 to 0x027984 (0x6144 bytes) 000687 1788542103.653999 trunc from 0x0389dd to 0x00412d (0x348af bytes) 000688 1788542103.668604 write 0x03c76d thru 0x03ffff (0x3893 bytes) 000689 1788542103.670594 mapwrite 0x005478 thru 0x0112a3 (0xbe2c bytes) 000690 1788542103.876095 mapread 0x01a68c thru 0x01a9a5 (0x31a bytes) 000691 1788542103.888606 MIRROR_RESYNC 11 mirrors 000692 1788542105.827455 punch from 0x01a90b to 0x02a08f (0xf785 bytes) 000695 1788542105.889358 mapwrite 0x003a3c thru 0x00b86e (0x7e33 bytes) 000696 1788542105.940436 trunc from 0x040000 to 0x03a61e (0x59e1 bytes) 000698 1788542105.960289 punch from 0x00388f to 0x0093d9 (0x5b4b bytes) 000699 1788542105.964618 mapread 0x025409 thru 0x0276ae (0x22a6 bytes) 000701 1788542105.971946 mapread 0x021aa5 thru 0x025acb (0x4027 bytes) 000703 1788542105.973172 punch from 0x022531 to 0x027dc2 (0x5892 bytes) 000705 1788542105.977651 punch from 0x001221 to 0x00e710 (0xd4f0 bytes) 000706 1788542105.981477 mapread 0x00c208 thru 0x01bdc8 (0xfbc1 bytes) 000707 1788542105.996764 MIRROR_RESYNC 11 mirrors 000709 1788542108.580174 punch from 0x025ba5 to 0x0291ac (0x3608 bytes) 000711 1788542108.646920 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3a61f): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a61f): Mirror 9: 0x9dfe3eea (stale) Mirror 10: 0x9dfe3eea (stale) Mirror 16: 0x9dfe3eea (stale) Mirror 19: 0x9dfe3eea (stale) Mirror 20: 0x9dfe3eea (stale) Mirror 22: 0x9dfe3eea (stale) Mirror 23: 0x9dfe3eea (stale) Mirror 24: 0x9dfe3eea (stale) Mirror 26: 0x9dfe3eea (stale) Mirror 27: 0x9dfe3eea (stale) CRC-32 checksum value for chunk [0, 0x3a61f): Mirror 1: 0x9dfe3eea Mirror 28: 0x9dfe3eea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a61f: skipped 000712 1788542109.666069 MIRROR_RESYNC 12 mirrors 000714 1788542111.901318 mapread 0x02be65 thru 0x034ff2 (0x918e bytes) 000718 1788542111.921468 write 0x0084b8 thru 0x00f49e (0x6fe7 bytes) 000722 1788542112.005242 MIRROR_RESYNC 12 mirrors 000723 1788542115.337799 write 0x00d6a6 thru 0x014eee (0x7849 bytes) 000725 1788542115.524521 trunc from 0x03a61f to 0x00b800 (0x2ee1e bytes) truncating to largest ever: 0x3ec8c 000727 1788542115.558717 trunc from 0x00b801 to 0x03ec8b (0x3348b bytes) 000728 1788542115.604464 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3ec8c): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec8c): Mirror 9: 0xdca9bc40 (stale) Mirror 10: 0xdca9bc40 (stale) Mirror 16: 0xdca9bc40 (stale) Mirror 19: 0xdca9bc40 (stale) Mirror 20: 0xdca9bc40 (stale) Mirror 22: 0xdca9bc40 (stale) Mirror 23: 0xdca9bc40 (stale) Mirror 24: 0xdca9bc40 (stale) Mirror 26: 0xdca9bc40 (stale) Mirror 27: 0xdca9bc40 (stale) Mirror 28: 0xdca9bc40 (stale) CRC-32 checksum value for chunk [0, 0x3ec8c): Mirror 1: 0xfd0c79e9 Mirror 29: 0xfd0c79e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec8c: skipped 000729 1788542117.269498 mapread 0x01f5eb thru 0x02a128 (0xab3e bytes) 000730 1788542117.326617 trunc from 0x03ec8c to 0x0196d4 (0x255b7 bytes) 000733 1788542117.479389 trunc from 0x0196d5 to 0x01279c (0x6f38 bytes) 000736 1788542117.508316 mapwrite 0x033e31 thru 0x03b835 (0x7a05 bytes) 000740 1788542117.592999 mapwrite 0x0273cd thru 0x028041 (0xc75 bytes) 000742 1788542117.644555 mapread 0x03316b thru 0x03b835 (0x86cb bytes) 000743 1788542117.646619 mapwrite 0x006229 thru 0x0125c0 (0xc398 bytes) 000745 1788542117.707826 mapwrite 0x02c09e thru 0x03112a (0x508d bytes) 000747 1788542117.754161 read 0x000f95 thru 0x0099b8 (0x8a24 bytes) 000749 1788542117.759408 trunc from 0x03b836 to 0x032703 (0x9132 bytes) 000750 1788542117.776351 trunc from 0x032704 to 0x02f169 (0x359a bytes) 000751 1788542117.795228 mapread 0x01e164 thru 0x026711 (0x85ae bytes) 000752 1788542117.807354 punch from 0x029b7b to 0x02f169 (0x55ef bytes) 000753 1788542117.813339 mapwrite 0x02ae5f thru 0x0356f6 (0xa898 bytes) 000757 1788542117.890505 mapwrite 0x000754 thru 0x00b28d (0xab3a bytes) 000758 1788542117.955878 read 0x02d2d0 thru 0x030186 (0x2eb7 bytes) 000759 1788542117.957455 write 0x009db4 thru 0x017146 (0xd393 bytes) 000760 1788542117.960890 mapwrite 0x0173fb thru 0x02261f (0xb225 bytes) 000761 1788542118.022379 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x356f7): Mirror 9: 0xd1eed8d4 (stale) Mirror 10: 0xd1eed8d4 (stale) Mirror 16: 0xd1eed8d4 (stale) Mirror 19: 0xd1eed8d4 (stale) Mirror 20: 0xd1eed8d4 (stale) Mirror 22: 0xd1eed8d4 (stale) Mirror 23: 0xd1eed8d4 (stale) Mirror 24: 0xd1eed8d4 (stale) Mirror 26: 0xd1eed8d4 (stale) Mirror 27: 0xd1eed8d4 (stale) Mirror 28: 0xd1eed8d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x356f7): Mirror 9: 0xd1eed8d4 (stale) Mirror 10: 0xd1eed8d4 (stale) Mirror 16: 0xd1eed8d4 (stale) Mirror 19: 0xd1eed8d4 (stale) Mirror 20: 0xd1eed8d4 (stale) Mirror 22: 0xd1eed8d4 (stale) Mirror 23: 0xd1eed8d4 (stale) Mirror 24: 0xd1eed8d4 (stale) Mirror 26: 0xd1eed8d4 (stale) Mirror 27: 0xd1eed8d4 (stale) Mirror 28: 0xd1eed8d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x356f7: skipped 000763 1788542118.671712 write 0x03d011 thru 0x03feb8 (0x2ea8 bytes) truncating to largest ever: 0x3f8c8 000765 1788542118.679721 trunc from 0x03feb9 to 0x03f8c7 (0x5f1 bytes) 000766 1788542118.715955 trunc from 0x03f8c8 to 0x00c8aa (0x3301d bytes) 000768 1788542118.738101 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0xc8ab): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc8ab): Mirror 9: 0x57fc33c9 (stale) Mirror 10: 0x57fc33c9 (stale) Mirror 16: 0x57fc33c9 (stale) Mirror 19: 0x57fc33c9 (stale) Mirror 20: 0x57fc33c9 (stale) Mirror 22: 0x57fc33c9 (stale) Mirror 23: 0x57fc33c9 (stale) Mirror 24: 0x57fc33c9 (stale) Mirror 26: 0x57fc33c9 (stale) Mirror 27: 0x57fc33c9 (stale) Mirror 28: 0x57fc33c9 (stale) CRC-32 checksum value for chunk [0, 0xc8ab): Mirror 1: 0x13fc53ab Mirror 29: 0x13fc53ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc8ab: skipped 000772 1788542119.994608 mapwrite 0x007620 thru 0x017508 (0xfee9 bytes) 000773 1788542120.361470 read 0x00f5ed thru 0x012582 (0x2f96 bytes) 000774 1788542120.371000 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17509): Mirror 9: 0x4aca7bef (stale) Mirror 10: 0x4aca7bef (stale) Mirror 16: 0x4aca7bef (stale) Mirror 19: 0x4aca7bef (stale) Mirror 20: 0x4aca7bef (stale) Mirror 22: 0x4aca7bef (stale) Mirror 23: 0x4aca7bef (stale) Mirror 26: 0x4aca7bef (stale) Mirror 27: 0x4aca7bef (stale) Mirror 28: 0x4aca7bef (stale) Mirror 29: 0x6b48c3dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17509): Mirror 9: 0x4aca7bef (stale) Mirror 10: 0x4aca7bef (stale) Mirror 16: 0x4aca7bef (stale) Mirror 19: 0x4aca7bef (stale) Mirror 20: 0x4aca7bef (stale) Mirror 22: 0x4aca7bef (stale) Mirror 23: 0x4aca7bef (stale) Mirror 26: 0x4aca7bef (stale) Mirror 27: 0x4aca7bef (stale) Mirror 28: 0x4aca7bef (stale) Mirror 29: 0x6b48c3dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17509: skipped 000775 1788542121.231181 trunc from 0x017509 to 0x020a04 (0x94fc bytes) 000776 1788542121.252152 mapwrite 0x02e49f thru 0x039a40 (0xb5a2 bytes) 000780 1788542121.334359 trunc from 0x039a41 to 0x03d5a8 (0x3b68 bytes) 000783 1788542121.355291 mapread 0x012cde thru 0x01c946 (0x9c69 bytes) 000784 1788542121.370198 read 0x020924 thru 0x02c391 (0xba6e bytes) 000786 1788542121.378370 punch from 0x01f8c3 to 0x027da1 (0x84df bytes) 000787 1788542121.382736 trunc from 0x03d5a9 to 0x008f87 (0x34621 bytes) 000792 1788542121.403122 mapread 0x004a49 thru 0x008f87 (0x453f bytes) 000793 1788542121.413206 punch from 0x006d4f to 0x008f87 (0x2239 bytes) 000794 1788542121.418854 punch from 0x006a28 to 0x0084ce (0x1aa7 bytes) 000795 1788542121.423956 write 0x033989 thru 0x03ffff (0xc677 bytes) 000798 1788542121.427963 mapwrite 0x03f3db thru 0x03ffff (0xc25 bytes) 000799 1788542121.480355 mapread 0x0367e1 thru 0x03c137 (0x5957 bytes) 000800 1788542121.482136 punch from 0x03e030 to 0x03ffff (0x1fd0 bytes) 000801 1788542121.486957 read 0x01876f thru 0x02626c (0xdafe bytes) 000802 1788542121.498196 write 0x003082 thru 0x005540 (0x24bf bytes) 000803 1788542121.499313 trunc from 0x040000 to 0x02c64c (0x139b3 bytes) 000804 1788542121.521951 write 0x018d1b thru 0x01b08d (0x2373 bytes) 000805 1788542121.524851 write 0x02d2bb thru 0x03a413 (0xd159 bytes) 000806 1788542121.527971 trunc from 0x03a414 to 0x03598b (0x4a88 bytes) 000807 1788542121.549841 mapread 0x02dbd6 thru 0x030c63 (0x308e bytes) 000808 1788542121.552562 trunc from 0x03598c to 0x00cfd0 (0x289bb bytes) 000809 1788542121.572999 trunc from 0x00cfd1 to 0x01cfef (0x1001f bytes) 000810 1788542121.607788 mapwrite 0x03489e thru 0x03ffff (0xb762 bytes) 000812 1788542121.864867 trunc from 0x040000 to 0x031025 (0xefda bytes) 000814 1788542121.893034 read 0x02c7c9 thru 0x031025 (0x485d bytes) 000815 1788542121.910811 mapread 0x0176f6 thru 0x01f5be (0x7ec9 bytes) 000818 1788542121.914509 punch from 0x02d945 to 0x03092f (0x2feb bytes) 000819 1788542121.924116 mapread 0x009c0e thru 0x0191fe (0xf5f1 bytes) 000822 1788542121.929282 mapread 0x003150 thru 0x011cbc (0xeb6d bytes) 000823 1788542121.930469 read 0x024460 thru 0x027d61 (0x3902 bytes) 000824 1788542121.931074 punch from 0x02a68b to 0x02e173 (0x3ae9 bytes) 000826 1788542121.945538 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31026): Mirror 9: 0x4c23f580 (stale) Mirror 10: 0x4c23f580 (stale) Mirror 16: 0x4c23f580 (stale) Mirror 19: 0x4c23f580 (stale) Mirror 22: 0x4c23f580 (stale) Mirror 23: 0x4c23f580 (stale) Mirror 26: 0x4c23f580 (stale) Mirror 27: 0x4c23f580 (stale) Mirror 28: 0x4c23f580 (stale) Mirror 29: 0x42a69103 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31026): Mirror 9: 0x4c23f580 (stale) Mirror 10: 0x4c23f580 (stale) Mirror 16: 0x4c23f580 (stale) Mirror 19: 0x4c23f580 (stale) Mirror 22: 0x4c23f580 (stale) Mirror 23: 0x4c23f580 (stale) Mirror 26: 0x4c23f580 (stale) Mirror 27: 0x4c23f580 (stale) Mirror 28: 0x4c23f580 (stale) Mirror 29: 0x42a69103 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31026: skipped 000827 1788542122.786868 MIRROR_RESYNC 11 mirrors 000828 1788542125.999617 write 0x012223 thru 0x0175a4 (0x5382 bytes) 000829 1788542126.073548 write 0x032929 thru 0x03e03a (0xb712 bytes) 000830 1788542126.083816 MIRROR_RESYNC 11 mirrors 000832 1788542130.572193 mapread 0x00dbb5 thru 0x014f59 (0x73a5 bytes) 000833 1788542130.586992 mapwrite 0x02ce78 thru 0x0342e2 (0x746b bytes) 000834 1788542130.818936 mapwrite 0x02f266 thru 0x032056 (0x2df1 bytes) 000835 1788542130.876998 read 0x0269f4 thru 0x031efd (0xb50a bytes) 000836 1788542130.880643 trunc from 0x03e03b to 0x0015fb (0x3ca3f bytes) 000837 1788542130.927693 write 0x019c3a thru 0x021df3 (0x81ba bytes) 000838 1788542130.933057 mapwrite 0x02ef85 thru 0x03ab23 (0xbb9f bytes) 000839 1788542131.075775 write 0x00c2ff thru 0x00f6e6 (0x33e8 bytes) 000840 1788542131.108612 punch from 0x005d4b to 0x005fa4 (0x25a bytes) 000841 1788542131.133108 trunc from 0x03ab24 to 0x026832 (0x142f1 bytes) 000842 1788542131.156890 write 0x037581 thru 0x03ffff (0x8a7f bytes) 000843 1788542131.158514 read 0x023c21 thru 0x027cfc (0x40dc bytes) 000844 1788542131.183906 trunc from 0x040000 to 0x000485 (0x3fb7a bytes) 000846 1788542131.203917 mapread 0x000021 thru 0x000485 (0x465 bytes) 000847 1788542131.208319 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x486): Mirror 9: 0xe85b1da (stale) Mirror 10: 0xe85b1da (stale) Mirror 16: 0xe85b1da (stale) Mirror 19: 0xe85b1da (stale) Mirror 22: 0xe85b1da (stale) Mirror 26: 0xe85b1da (stale) Mirror 27: 0xe85b1da (stale) Mirror 28: 0xe85b1da (stale) Mirror 29: 0xe85b1da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x486): Mirror 9: 0xe85b1da (stale) Mirror 10: 0xe85b1da (stale) Mirror 16: 0xe85b1da (stale) Mirror 19: 0xe85b1da (stale) Mirror 22: 0xe85b1da (stale) Mirror 26: 0xe85b1da (stale) Mirror 27: 0xe85b1da (stale) Mirror 28: 0xe85b1da (stale) Mirror 29: 0xe85b1da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x486: skipped 000848 1788542131.617090 punch from 0x0002f2 to 0x000485 (0x194 bytes) 000849 1788542131.621877 mapread 0x000078 thru 0x000485 (0x40e bytes) 000850 1788542131.627885 mapwrite 0x03da8a thru 0x03f072 (0x15e9 bytes) 000854 1788542131.717267 write 0x02716a thru 0x02b00a (0x3ea1 bytes) 000856 1788542131.726870 write 0x022ebd thru 0x0311d6 (0xe31a bytes) 000858 1788542131.741692 write 0x018469 thru 0x01ef7e (0x6b16 bytes) 000862 1788542131.764803 punch from 0x0017d3 to 0x003498 (0x1cc6 bytes) 000864 1788542131.792374 punch from 0x02752d to 0x02de60 (0x6934 bytes) 000865 1788542131.797345 trunc from 0x03f073 to 0x01ca52 (0x22620 bytes) 000867 1788542131.833849 mapwrite 0x00a4ec thru 0x00fb0d (0x5622 bytes) 000868 1788542131.893279 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ca53): Mirror 9: 0xf8e13686 (stale) Mirror 16: 0xf8e13686 (stale) Mirror 19: 0xf8e13686 (stale) Mirror 22: 0xf8e13686 (stale) Mirror 26: 0xf8e13686 (stale) Mirror 27: 0xf8e13686 (stale) Mirror 28: 0xf8e13686 (stale) Mirror 29: 0xf8e13686 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ca53): Mirror 9: 0xf8e13686 (stale) Mirror 16: 0xf8e13686 (stale) Mirror 19: 0xf8e13686 (stale) Mirror 22: 0xf8e13686 (stale) Mirror 26: 0xf8e13686 (stale) Mirror 27: 0xf8e13686 (stale) Mirror 28: 0xf8e13686 (stale) Mirror 29: 0xf8e13686 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ca53: skipped 000869 1788542132.320229 trunc from 0x01ca53 to 0x002f1e (0x19b34 bytes) 000871 1788542132.335312 mapwrite 0x02f188 thru 0x035677 (0x64f0 bytes) 000873 1788542132.401503 read 0x00617c thru 0x0087a0 (0x2625 bytes) 000874 1788542132.409143 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x35678): Mirror 9: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35678): Mirror 9: 0x4a22917d (stale) Mirror 16: 0x4a22917d (stale) Mirror 19: 0x4a22917d (stale) Mirror 22: 0x4a22917d (stale) Mirror 26: 0x4a22917d (stale) Mirror 27: 0x4a22917d (stale) Mirror 28: 0x4a22917d (stale) Mirror 29: 0x4a22917d (stale) CRC-32 checksum value for chunk [0, 0x35678): Mirror 1: 0xd83e0e52 Mirror 30: 0xd83e0e52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35678: skipped 000875 1788542133.258005 mapwrite 0x021754 thru 0x024d78 (0x3625 bytes) 000876 1788542133.455212 read 0x019059 thru 0x024a9a (0xba42 bytes) 000878 1788542133.462484 mapwrite 0x014e88 thru 0x019f93 (0x510c bytes) 000879 1788542133.541403 write 0x00874c thru 0x00ea40 (0x62f5 bytes) 000880 1788542133.552729 write 0x031beb thru 0x03de4f (0xc265 bytes) 000882 1788542133.562908 mapwrite 0x01a3ac thru 0x01eaf5 (0x474a bytes) 000883 1788542133.607925 mapread 0x010a53 thru 0x01c188 (0xb736 bytes) 000884 1788542133.609364 trunc from 0x03de50 to 0x01d60a (0x20845 bytes) 000885 1788542133.660908 punch from 0x00c12a to 0x00fd9f (0x3c76 bytes) 000886 1788542133.664564 write 0x03c2ee thru 0x03ffff (0x3d12 bytes) 000890 1788542133.668026 read 0x00a238 thru 0x017a53 (0xd81c bytes) 000892 1788542133.676475 mapread 0x009d4f thru 0x00d850 (0x3b02 bytes) 000893 1788542133.677780 write 0x004417 thru 0x00ed8d (0xa977 bytes) 000894 1788542133.683221 MIRROR_RESYNC 10 mirrors 000895 1788542137.427316 mapwrite 0x0322d0 thru 0x03ffff (0xdd30 bytes) 000897 1788542137.625684 write 0x02f8f2 thru 0x039c2f (0xa33e bytes) 000899 1788542137.628029 punch from 0x002636 to 0x005e67 (0x3832 bytes) 000900 1788542137.652254 trunc from 0x040000 to 0x00196d (0x3e692 bytes) 000901 1788542137.689838 read 0x0016fe thru 0x00196d (0x270 bytes) 000903 1788542137.698140 mapwrite 0x03d794 thru 0x03ffff (0x286c bytes) 000904 1788542137.822429 mapread 0x03163e thru 0x03ffff (0xe9c2 bytes) 000906 1788542137.834675 write 0x020592 thru 0x0262c8 (0x5d37 bytes) 000907 1788542137.842559 mapread 0x0353b6 thru 0x039e60 (0x4aab bytes) 000909 1788542137.844564 write 0x031606 thru 0x03ffff (0xe9fa bytes) 000912 1788542137.847642 trunc from 0x040000 to 0x016d4c (0x292b3 bytes) 000913 1788542137.859583 mapread 0x00bec9 thru 0x016d4c (0xae84 bytes) 000915 1788542137.870881 mapwrite 0x01a420 thru 0x01ff7f (0x5b60 bytes) 000916 1788542137.936552 read 0x0158ca thru 0x01a27a (0x49b1 bytes) 000917 1788542137.937212 write 0x02854a thru 0x02925c (0xd13 bytes) skipping zero length punch hole 000919 1788542137.939750 mapread 0x000d3b thru 0x00f25d (0xe523 bytes) 000921 1788542137.947763 punch from 0x00983a to 0x011d68 (0x852f bytes) 000925 1788542137.957256 punch from 0x0270b1 to 0x02925c (0x21ac bytes) 000926 1788542137.960963 trunc from 0x02925d to 0x00ac4a (0x1e612 bytes) 000927 1788542137.973809 write 0x00a525 thru 0x013e30 (0x990c bytes) 000928 1788542137.979566 trunc from 0x013e31 to 0x033927 (0x1faf7 bytes) 000929 1788542137.993570 mapwrite 0x02f0a5 thru 0x030110 (0x106c bytes) 000930 1788542138.038980 read 0x012913 thru 0x0135af (0xc9d bytes) 000931 1788542138.043997 MIRROR_RESYNC 10 mirrors 000932 1788542141.715377 trunc from 0x033928 to 0x00c45e (0x274c9 bytes) 000933 1788542141.921892 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xc45f): Mirror 9: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc45f): Mirror 9: 0x4026ba04 (stale) Mirror 16: 0x4026ba04 (stale) Mirror 19: 0x4026ba04 (stale) Mirror 22: 0x4026ba04 (stale) Mirror 26: 0x4026ba04 (stale) Mirror 27: 0x4026ba04 (stale) Mirror 28: 0x4026ba04 (stale) Mirror 29: 0x4026ba04 (stale) Mirror 30: 0x4026ba04 (stale) CRC-32 checksum value for chunk [0, 0xc45f): Mirror 1: 0x4026ba04 Mirror 31: 0x4026ba04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc45f: skipped 000934 1788542143.436313 mapread 0x002701 thru 0x00c45e (0x9d5e bytes) 000935 1788542143.470621 mapread 0x003399 thru 0x003498 (0x100 bytes) 000938 1788542143.510813 MIRROR_RESYNC 11 mirrors 000940 1788542146.332074 mapread 0x003df0 thru 0x0053d1 (0x15e2 bytes) 000941 1788542146.383385 mapread 0x003443 thru 0x00bee7 (0x8aa5 bytes) 000942 1788542146.384210 read 0x004b41 thru 0x00c45e (0x791e bytes) 000943 1788542146.386885 trunc from 0x00c45f to 0x0099c8 (0x2a96 bytes) 000944 1788542146.553117 mapwrite 0x017871 thru 0x023ea2 (0xc632 bytes) 000946 1788542146.750141 read 0x018103 thru 0x023ea2 (0xbda0 bytes) 000947 1788542146.751858 mapwrite 0x010b45 thru 0x01cac6 (0xbf82 bytes) 000948 1788542146.834234 trunc from 0x023ea3 to 0x019188 (0xad1a bytes) 000950 1788542146.877984 trunc from 0x019189 to 0x021a19 (0x8891 bytes) 000951 1788542146.897099 read 0x01942d thru 0x021a19 (0x85ed bytes) 000952 1788542146.914187 read 0x015c11 thru 0x01fb3e (0x9f2e bytes) 000953 1788542146.914901 punch from 0x016782 to 0x016cfc (0x57b bytes) 000955 1788542146.938973 mapwrite 0x0333b8 thru 0x03ffff (0xcc48 bytes) 000956 1788542147.095026 mapread 0x02abdb thru 0x0304c3 (0x58e9 bytes) 000957 1788542147.096523 trunc from 0x040000 to 0x02d065 (0x12f9a bytes) 000958 1788542147.133404 write 0x015b4f thru 0x01b1c3 (0x5675 bytes) 000959 1788542147.136606 mapwrite 0x03863b thru 0x03f645 (0x700b bytes) 000960 1788542147.303584 trunc from 0x03f646 to 0x003fe0 (0x3b665 bytes) 000962 1788542147.326550 mapwrite 0x03da7b thru 0x03ffff (0x2585 bytes) 000963 1788542147.417492 trunc from 0x040000 to 0x000ab3 (0x3f54c bytes) 000964 1788542147.439859 mapwrite 0x009e87 thru 0x016530 (0xc6aa bytes) 000967 1788542147.629330 mapread 0x01297a thru 0x016530 (0x3bb7 bytes) 000968 1788542147.630784 mapread 0x000f04 thru 0x00647c (0x5579 bytes) 000969 1788542147.665169 write 0x017350 thru 0x018bbf (0x1870 bytes) 000970 1788542147.671810 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x18bc0): Mirror 9: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18bc0): Mirror 9: 0xff20f5f8 (stale) Mirror 16: 0xff20f5f8 (stale) Mirror 19: 0xff20f5f8 (stale) Mirror 22: 0xff20f5f8 (stale) Mirror 26: 0xff20f5f8 (stale) Mirror 27: 0xff20f5f8 (stale) Mirror 28: 0xff20f5f8 (stale) Mirror 29: 0xff20f5f8 (stale) Mirror 30: 0xff20f5f8 (stale) Mirror 31: 0xff20f5f8 (stale) CRC-32 checksum value for chunk [0, 0x18bc0): Mirror 1: 0xc978bc36 Mirror 32: 0xc978bc36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18bc0: skipped 000971 1788542149.419720 mapwrite 0x023d90 thru 0x0320c6 (0xe337 bytes) 000973 1788542149.761574 read 0x01c151 thru 0x026885 (0xa735 bytes) 000975 1788542149.785301 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x320c7): Mirror 9: 0xc3384d82 (stale) Mirror 16: 0xc3384d82 (stale) Mirror 19: 0xc3384d82 (stale) Mirror 22: 0xc3384d82 (stale) Mirror 26: 0xc3384d82 (stale) Mirror 27: 0xc3384d82 (stale) Mirror 28: 0xc3384d82 (stale) Mirror 30: 0xc3384d82 (stale) Mirror 31: 0xc3384d82 (stale) Mirror 32: 0xda6eae64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x320c7): Mirror 9: 0xc3384d82 (stale) Mirror 16: 0xc3384d82 (stale) Mirror 19: 0xc3384d82 (stale) Mirror 22: 0xc3384d82 (stale) Mirror 26: 0xc3384d82 (stale) Mirror 27: 0xc3384d82 (stale) Mirror 28: 0xc3384d82 (stale) Mirror 30: 0xc3384d82 (stale) Mirror 31: 0xc3384d82 (stale) Mirror 32: 0xda6eae64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x320c7: skipped 000976 1788542150.591578 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x320c7): Mirror 16: 0xc3384d82 (stale) Mirror 19: 0xc3384d82 (stale) Mirror 22: 0xc3384d82 (stale) Mirror 26: 0xc3384d82 (stale) Mirror 27: 0xc3384d82 (stale) Mirror 28: 0xc3384d82 (stale) Mirror 30: 0xc3384d82 (stale) Mirror 31: 0xc3384d82 (stale) Mirror 32: 0xda6eae64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x320c7): Mirror 16: 0xc3384d82 (stale) Mirror 19: 0xc3384d82 (stale) Mirror 22: 0xc3384d82 (stale) Mirror 26: 0xc3384d82 (stale) Mirror 27: 0xc3384d82 (stale) Mirror 28: 0xc3384d82 (stale) Mirror 30: 0xc3384d82 (stale) Mirror 31: 0xc3384d82 (stale) Mirror 32: 0xda6eae64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x320c7: skipped 000977 1788542151.465609 mapwrite 0x037541 thru 0x03ffff (0x8abf bytes) 000978 1788542151.598812 mapwrite 0x026c8d thru 0x02cd75 (0x60e9 bytes) 000980 1788542151.664236 trunc from 0x040000 to 0x028a42 (0x175bd bytes) 000981 1788542151.687366 punch from 0x00be53 to 0x00ee0b (0x2fb9 bytes) 000982 1788542151.693128 read 0x0253a5 thru 0x028a42 (0x369e bytes) 000985 1788542151.697645 trunc from 0x028a43 to 0x0309e9 (0x7fa7 bytes) 000987 1788542151.724239 mapread 0x01d998 thru 0x029c8e (0xc2f7 bytes) 000988 1788542151.762016 mapwrite 0x013b91 thru 0x015a09 (0x1e79 bytes) 000989 1788542151.856843 MIRROR_RESYNC 10 mirrors 000990 1788542158.105558 read 0x01e0fc thru 0x02a91e (0xc823 bytes) 000991 1788542158.123234 punch from 0x023778 to 0x02fa31 (0xc2ba bytes) 000993 1788542158.259373 write 0x01a90a thru 0x020ea7 (0x659e bytes) 000994 1788542158.283904 punch from 0x00a6c7 to 0x018cf0 (0xe62a bytes) 000995 1788542158.312442 mapread 0x000c5d thru 0x0069d6 (0x5d7a bytes) 000996 1788542158.335314 read 0x022240 thru 0x0227ab (0x56c bytes) 000997 1788542158.343815 trunc from 0x0309ea to 0x011ccb (0x1ed1e bytes) 000998 1788542158.363165 mapwrite 0x00196a thru 0x00d946 (0xbfdd bytes) 000999 1788542158.440225 read 0x009e97 thru 0x009f60 (0xca bytes) All operations completed A-OK!