== sanity-flr test 70a: flr mode fsx test ================ 01:22:09 (1783142529) Seed set to 2530 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1783142530.637942 MIRROR_EXTEND to 2 mirrors skipping zero size read 000003 1783142530.906050 write 0x022089 thru 0x022224 (0x19c bytes) 000007 1783142530.952567 write 0x0260ce thru 0x029db3 (0x3ce6 bytes) 000008 1783142530.953701 write 0x0095a0 thru 0x00b4a2 (0x1f03 bytes) 000009 1783142530.965134 mapread 0x026e38 thru 0x029db3 (0x2f7c bytes) 000010 1783142530.966513 mapread 0x019e42 thru 0x0289f9 (0xebb8 bytes) truncating to largest ever: 0x366a2 000012 1783142530.984370 trunc from 0x029db4 to 0x0366a1 (0xc8ee bytes) 000013 1783142531.020779 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x366a2): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x366a2): Mirror 2: 0xecb2b11e (stale) CRC-32 checksum value for chunk [0, 0x366a2): Mirror 1: 0xfc43e1ac Mirror 3: 0xfc43e1ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x366a2: skipped 000014 1783142531.773818 trunc from 0x0366a2 to 0x00b252 (0x2b44f bytes) 000016 1783142531.846304 write 0x023f75 thru 0x027eb7 (0x3f43 bytes) 000017 1783142531.847652 write 0x017625 thru 0x01804a (0xa26 bytes) 000021 1783142531.859899 write 0x0274f5 thru 0x028bfd (0x1709 bytes) 000022 1783142531.861149 trunc from 0x028bfe to 0x00cc81 (0x1bf7c bytes) 000024 1783142531.882141 read 0x00c030 thru 0x00cc81 (0xc52 bytes) 000027 1783142531.887756 write 0x020e5a thru 0x02bdfd (0xafa4 bytes) 000028 1783142531.890046 read 0x0009b8 thru 0x00c317 (0xb960 bytes) 000029 1783142531.900194 MIRROR_RESYNC 3 mirrors 000032 1783142532.477242 mapwrite 0x023191 thru 0x0257a1 (0x2611 bytes) 000034 1783142532.580700 trunc from 0x02bdfe to 0x024bcc (0x7231 bytes) 000035 1783142532.598255 read 0x0036e0 thru 0x00f22b (0xbb4c bytes) 000036 1783142532.603268 mapwrite 0x025544 thru 0x02da08 (0x84c5 bytes) 000037 1783142532.659684 mapwrite 0x0267de thru 0x02e547 (0x7d6a bytes) 000039 1783142532.717571 mapwrite 0x00727f thru 0x00f3cf (0x8151 bytes) 000041 1783142532.758357 trunc from 0x02e548 to 0x01b660 (0x12ee7 bytes) 000044 1783142532.795742 trunc from 0x01b661 to 0x01dcaa (0x264a bytes) 000045 1783142532.821309 mapread 0x006c95 thru 0x01302a (0xc396 bytes) 000047 1783142532.831571 mapread 0x015a32 thru 0x01dcaa (0x8279 bytes) 000049 1783142532.843565 write 0x00efe8 thru 0x01aec6 (0xbedf bytes) 000051 1783142532.855835 mapread 0x01b07c thru 0x01dcaa (0x2c2f bytes) 000055 1783142532.859554 mapwrite 0x021010 thru 0x02515a (0x414b bytes) truncating to largest ever: 0x371b0 000057 1783142532.939774 trunc from 0x02515b to 0x0371af (0x12055 bytes) 000058 1783142532.958671 read 0x02d7b7 thru 0x0367c0 (0x900a bytes) 000063 1783142532.970234 trunc from 0x0371b0 to 0x0108b4 (0x268fb bytes) 000064 1783142532.983957 read 0x0006d1 thru 0x007d36 (0x7666 bytes) 000065 1783142532.984787 mapwrite 0x026bb7 thru 0x02849c (0x18e6 bytes) 000066 1783142533.071909 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2849d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2849d): Mirror 2: 0xf2fbbec5 (stale) Mirror 3: 0xf2fbbec5 (stale) CRC-32 checksum value for chunk [0, 0x2849d): Mirror 1: 0x86ddda27 Mirror 4: 0x86ddda27 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2849d: skipped 000069 1783142533.755416 write 0x019a55 thru 0x020126 (0x66d2 bytes) 000070 1783142533.832095 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2849d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2849d): Mirror 2: 0xf2fbbec5 (stale) Mirror 3: 0xf2fbbec5 (stale) Mirror 4: 0x86ddda27 (stale) CRC-32 checksum value for chunk [0, 0x2849d): Mirror 1: 0xe4ed2afc Mirror 5: 0xe4ed2afc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2849d: skipped 000073 1783142534.529966 read 0x014f22 thru 0x024e72 (0xff51 bytes) 000075 1783142534.557048 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2849d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2849d): Mirror 2: 0xf2fbbec5 (stale) Mirror 3: 0xf2fbbec5 (stale) Mirror 4: 0x86ddda27 (stale) CRC-32 checksum value for chunk [0, 0x2849d): Mirror 1: 0xe4ed2afc Mirror 5: 0xe4ed2afc Mirror 6: 0xe4ed2afc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2849d: skipped 000078 1783142535.033020 write 0x00fb2c thru 0x01bb92 (0xc067 bytes) 000080 1783142535.079086 read 0x00b6d0 thru 0x018c7e (0xd5af bytes) 000081 1783142535.083017 write 0x028779 thru 0x033c18 (0xb4a0 bytes) 000083 1783142535.092461 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33c19): Mirror 2: 0x56988d73 (stale) Mirror 4: 0xe6e3885a (stale) Mirror 5: 0x5d519777 (stale) Mirror 6: 0x5d519777 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c19): Mirror 2: 0x56988d73 (stale) Mirror 4: 0xe6e3885a (stale) Mirror 5: 0x5d519777 (stale) Mirror 6: 0x5d519777 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c19: skipped 000084 1783142535.339930 mapread 0x027a60 thru 0x032bb7 (0xb158 bytes) 000085 1783142535.356576 mapwrite 0x022b0b thru 0x0322e4 (0xf7da bytes) 000086 1783142535.401843 mapread 0x000bf5 thru 0x003d88 (0x3194 bytes) 000087 1783142535.407370 mapwrite 0x021e40 thru 0x02aaa3 (0x8c64 bytes) 000088 1783142535.442528 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33c19): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c19): Mirror 2: 0x56988d73 (stale) Mirror 4: 0xe6e3885a (stale) Mirror 5: 0x5d519777 (stale) Mirror 6: 0x5d519777 (stale) CRC-32 checksum value for chunk [0, 0x33c19): Mirror 1: 0xbe6d521d Mirror 7: 0xbe6d521d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c19: skipped 000089 1783142535.991149 read 0x014f71 thru 0x015bc5 (0xc55 bytes) 000090 1783142536.004511 mapread 0x0321a6 thru 0x033c18 (0x1a73 bytes) 000091 1783142536.035654 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33c19): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c19): Mirror 2: 0x56988d73 (stale) Mirror 4: 0xe6e3885a (stale) Mirror 5: 0x5d519777 (stale) Mirror 6: 0x5d519777 (stale) CRC-32 checksum value for chunk [0, 0x33c19): Mirror 1: 0xbe6d521d Mirror 7: 0xbe6d521d Mirror 8: 0xbe6d521d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c19: skipped 000092 1783142536.812138 read 0x02bfe7 thru 0x033c18 (0x7c32 bytes) 000093 1783142536.824745 read 0x0297d6 thru 0x033c18 (0xa443 bytes) 000094 1783142536.834715 read 0x028a41 thru 0x03345e (0xaa1e bytes) 000097 1783142536.835699 mapwrite 0x028b01 thru 0x02e721 (0x5c21 bytes) 000098 1783142536.987949 trunc from 0x033c19 to 0x0119b3 (0x22265 bytes) 000099 1783142537.022816 mapread 0x00d286 thru 0x00ff47 (0x2cc2 bytes) 000100 1783142537.024581 mapread 0x0106ee thru 0x0110bd (0x9d0 bytes) 000102 1783142537.026025 read 0x010ec3 thru 0x0119b3 (0xaf1 bytes) 000103 1783142537.027008 mapwrite 0x02b5aa thru 0x02c44b (0xea2 bytes) 000104 1783142537.114959 MIRROR_RESYNC 7 mirrors 000105 1783142538.067591 mapwrite 0x02fcd6 thru 0x0334e4 (0x380f bytes) 000106 1783142538.227501 write 0x00751c thru 0x0168ca (0xf3af bytes) 000108 1783142538.248325 MIRROR_RESYNC 7 mirrors 000111 1783142539.212979 trunc from 0x0334e5 to 0x01ab27 (0x189bd bytes) 000112 1783142539.343661 trunc from 0x01ab28 to 0x036659 (0x1bb32 bytes) 000113 1783142539.371352 read 0x00b56a thru 0x016558 (0xafef bytes) 000114 1783142539.381470 MIRROR_RESYNC 7 mirrors 000117 1783142540.300502 read 0x034dbd thru 0x036659 (0x189d bytes) 000118 1783142540.306797 mapread 0x030ca6 thru 0x030eb7 (0x212 bytes) 000119 1783142540.316140 mapread 0x0033e6 thru 0x007223 (0x3e3e bytes) 000120 1783142540.352631 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) 000124 1783142540.787524 trunc from 0x03665a to 0x0287ac (0xdead bytes) 000126 1783142540.883516 mapwrite 0x01681b thru 0x024b5d (0xe343 bytes) 000128 1783142540.949327 mapwrite 0x033f97 thru 0x03ffff (0xc069 bytes) 000132 1783142541.020998 mapread 0x018d52 thru 0x02251c (0x97cb bytes) 000133 1783142541.027998 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1bba9f4 (stale) Mirror 4: 0x1bba9f4 (stale) Mirror 6: 0x1bba9f4 (stale) Mirror 7: 0x1bba9f4 (stale) Mirror 8: 0x1bba9f4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8928319d Mirror 9: 0x8928319d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000137 1783142541.842743 mapread 0x02a406 thru 0x03788c (0xd487 bytes) 000138 1783142541.898520 mapwrite 0x005eef thru 0x0100ea (0xa1fc bytes) 000140 1783142542.077117 read 0x02ba0f thru 0x036fec (0xb5de bytes) 000141 1783142542.089471 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1bba9f4 (stale) Mirror 6: 0x1bba9f4 (stale) Mirror 7: 0x1bba9f4 (stale) Mirror 8: 0x1bba9f4 (stale) Mirror 9: 0x8928319d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x1bba9f4 (stale) Mirror 6: 0x1bba9f4 (stale) Mirror 7: 0x1bba9f4 (stale) Mirror 8: 0x1bba9f4 (stale) Mirror 9: 0x8928319d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000143 1783142542.478266 write 0x03b0e8 thru 0x03ffff (0x4f18 bytes) 000144 1783142542.491833 read 0x010eb1 thru 0x018ed7 (0x8027 bytes) 000145 1783142542.515781 trunc from 0x040000 to 0x01ad97 (0x25268 bytes) 000147 1783142542.558261 MIRROR_RESYNC 6 mirrors 000150 1783142543.442698 mapread 0x00bc65 thru 0x018e04 (0xd1a0 bytes) 000151 1783142543.475025 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) 000152 1783142543.782931 read 0x011f98 thru 0x0175e4 (0x564d bytes) 000155 1783142543.798139 trunc from 0x01ad98 to 0x01a018 (0xd7f bytes) 000156 1783142543.844889 mapwrite 0x024e50 thru 0x028dba (0x3f6b bytes) 000157 1783142543.952222 mapread 0x009555 thru 0x00bd22 (0x27ce bytes) 000158 1783142543.961896 read 0x00f9ce thru 0x016cac (0x72df bytes) 000159 1783142543.970101 mapread 0x01a8e7 thru 0x01aa52 (0x16c bytes) 000160 1783142543.971313 mapread 0x01ba89 thru 0x0253c9 (0x9941 bytes) 000161 1783142543.972971 write 0x0380d9 thru 0x03ffff (0x7f27 bytes) 000162 1783142543.974780 write 0x03eb9d thru 0x03ffff (0x1463 bytes) 000163 1783142543.976330 mapread 0x0004b8 thru 0x00f4fc (0xf045 bytes) 000166 1783142543.978727 trunc from 0x040000 to 0x0146b2 (0x2b94d bytes) 000167 1783142543.994364 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x146b3): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x146b3): Mirror 4: 0xa22ea0a1 (stale) Mirror 6: 0xa22ea0a1 (stale) Mirror 7: 0xa22ea0a1 (stale) Mirror 8: 0xa22ea0a1 (stale) CRC-32 checksum value for chunk [0, 0x146b3): Mirror 1: 0xa22ea0a1 Mirror 9: 0xa22ea0a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x146b3: skipped 000170 1783142544.681464 trunc from 0x0146b3 to 0x02bcfe (0x1764c bytes) 000171 1783142544.753460 write 0x00d870 thru 0x014a28 (0x71b9 bytes) 000173 1783142544.762259 write 0x01468b thru 0x022d10 (0xe686 bytes) 000176 1783142544.769458 write 0x013831 thru 0x019bd3 (0x63a3 bytes) 000177 1783142544.780740 mapwrite 0x03c33d thru 0x03d5cb (0x128f bytes) 000178 1783142544.854491 MIRROR_RESYNC 6 mirrors 000179 1783142545.660085 mapwrite 0x00bae5 thru 0x017621 (0xbb3d bytes) 000182 1783142545.814993 mapwrite 0x02aa17 thru 0x039dfb (0xf3e5 bytes) 000184 1783142545.869063 write 0x02794a thru 0x027962 (0x19 bytes) 000185 1783142545.870027 write 0x03b406 thru 0x03dd9b (0x2996 bytes) 000186 1783142545.874468 mapread 0x024370 thru 0x0253ee (0x107f bytes) 000187 1783142545.875813 write 0x02b64a thru 0x02c2f1 (0xca8 bytes) 000188 1783142545.877056 trunc from 0x03dd9c to 0x02d252 (0x10b49 bytes) 000190 1783142545.892090 mapwrite 0x00ec39 thru 0x018d59 (0xa121 bytes) 000191 1783142545.933368 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d253): Mirror 4: 0x9fb4d222 (stale) Mirror 7: 0x9fb4d222 (stale) Mirror 8: 0x9fb4d222 (stale) Mirror 9: 0x9fb4d222 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d253): Mirror 4: 0x9fb4d222 (stale) Mirror 7: 0x9fb4d222 (stale) Mirror 8: 0x9fb4d222 (stale) Mirror 9: 0x9fb4d222 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d253: skipped 000192 1783142546.277575 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2d253): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d253): Mirror 4: 0x9fb4d222 (stale) Mirror 7: 0x9fb4d222 (stale) Mirror 8: 0x9fb4d222 (stale) Mirror 9: 0x9fb4d222 (stale) CRC-32 checksum value for chunk [0, 0x2d253): Mirror 1: 0xe35e95a Mirror 10: 0xe35e95a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d253: skipped 000193 1783142546.924900 mapwrite 0x0303f1 thru 0x035ffb (0x5c0b bytes) 000194 1783142547.063851 mapwrite 0x0362a2 thru 0x03710b (0xe6a bytes) 000195 1783142547.147719 trunc from 0x03710c to 0x01110b (0x26000 bytes) 000197 1783142547.171794 mapread 0x0066de thru 0x01110b (0xaa2e bytes) 000199 1783142547.192807 read 0x00a97a thru 0x01110b (0x6792 bytes) truncating to largest ever: 0x3a8f6 000201 1783142547.194017 trunc from 0x01110c to 0x03a8f5 (0x297ea bytes) 000207 1783142547.219702 trunc from 0x03a8f6 to 0x02685b (0x1409a bytes) 000210 1783142547.239033 write 0x0080db thru 0x00a180 (0x20a6 bytes) 000211 1783142547.240643 mapread 0x009691 thru 0x014ccc (0xb63c bytes) 000212 1783142547.259562 write 0x019fc2 thru 0x023966 (0x99a5 bytes) 000213 1783142547.269685 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2685c): Mirror 4: 0xec9ed3ec (stale) Mirror 8: 0xec9ed3ec (stale) Mirror 9: 0xec9ed3ec (stale) Mirror 10: 0x20160b97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2685c): Mirror 4: 0xec9ed3ec (stale) Mirror 8: 0xec9ed3ec (stale) Mirror 9: 0xec9ed3ec (stale) Mirror 10: 0x20160b97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2685c: skipped 000215 1783142547.708982 write 0x014dc5 thru 0x021c78 (0xceb4 bytes) 000216 1783142547.720960 read 0x0057a3 thru 0x00f2de (0x9b3c bytes) 000217 1783142547.729249 mapread 0x013881 thru 0x020a20 (0xd1a0 bytes) 000218 1783142547.738308 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2685c): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2685c): Mirror 4: 0xec9ed3ec (stale) Mirror 8: 0xec9ed3ec (stale) Mirror 9: 0xec9ed3ec (stale) Mirror 10: 0x20160b97 (stale) CRC-32 checksum value for chunk [0, 0x2685c): Mirror 1: 0x1592cd2d Mirror 11: 0x1592cd2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2685c: skipped 000224 1783142548.631239 mapwrite 0x0057c9 thru 0x00d40b (0x7c43 bytes) 000228 1783142548.804111 mapwrite 0x02d13b thru 0x02feee (0x2db4 bytes) 000229 1783142548.869102 read 0x01059a thru 0x01743c (0x6ea3 bytes) 000233 1783142548.883827 mapwrite 0x00afac thru 0x019736 (0xe78b bytes) 000234 1783142548.957571 mapread 0x022e60 thru 0x0252ff (0x24a0 bytes) 000236 1783142548.975646 read 0x02909d thru 0x02feee (0x6e52 bytes) 000238 1783142548.977311 read 0x02be44 thru 0x02feee (0x40ab bytes) 000239 1783142548.978090 trunc from 0x02feef to 0x00d641 (0x228ad bytes) 000241 1783142548.999703 read 0x0000d7 thru 0x002d59 (0x2c83 bytes) 000245 1783142549.010529 write 0x0399ca thru 0x03ffff (0x6636 bytes) 000251 1783142549.015971 read 0x01c141 thru 0x027203 (0xb0c3 bytes) 000253 1783142549.030337 trunc from 0x040000 to 0x028aa1 (0x1755e bytes) 000255 1783142549.055211 MIRROR_RESYNC 6 mirrors 000257 1783142549.988755 mapwrite 0x00a604 thru 0x00d573 (0x2f70 bytes) 000263 1783142550.157074 mapread 0x0046d3 thru 0x012d45 (0xe673 bytes) 000268 1783142550.160127 read 0x0030ab thru 0x00dbd7 (0xab2d bytes) 000270 1783142550.165824 write 0x03f14f thru 0x03ffff (0xeb1 bytes) 000271 1783142550.166709 trunc from 0x040000 to 0x01ef02 (0x210fd bytes) 000272 1783142550.191189 mapwrite 0x01d60b thru 0x01e19f (0xb95 bytes) 000273 1783142550.237338 trunc from 0x01ef03 to 0x0104de (0xea24 bytes) 000280 1783142550.275109 MIRROR_RESYNC 6 mirrors 000281 1783142551.109610 read 0x0065b2 thru 0x0104de (0x9f2d bytes) 000285 1783142551.120553 write 0x017164 thru 0x0198dc (0x2779 bytes) 000286 1783142551.173668 MIRROR_RESYNC 6 mirrors 000289 1783142552.104899 mapread 0x01712a thru 0x017a5f (0x936 bytes) 000291 1783142552.110026 mapwrite 0x007429 thru 0x00981e (0x23f6 bytes) 000292 1783142552.290881 mapwrite 0x038111 thru 0x03ffff (0x7eef bytes) 000294 1783142552.368096 write 0x010803 thru 0x012776 (0x1f74 bytes) 000295 1783142552.384149 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x83659f71 (stale) Mirror 8: 0x83659f71 (stale) Mirror 10: 0x83659f71 (stale) Mirror 11: 0x83659f71 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x83659f71 (stale) Mirror 8: 0x83659f71 (stale) Mirror 10: 0x83659f71 (stale) Mirror 11: 0x83659f71 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000297 1783142552.741949 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x83659f71 (stale) Mirror 8: 0x83659f71 (stale) Mirror 10: 0x83659f71 (stale) Mirror 11: 0x83659f71 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4676b0a3 Mirror 12: 0x4676b0a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000298 1783142553.656849 write 0x028b9c thru 0x034967 (0xbdcc bytes) 000299 1783142553.724044 mapread 0x029612 thru 0x02fa32 (0x6421 bytes) 000306 1783142553.732652 write 0x002613 thru 0x01094f (0xe33d bytes) 000307 1783142553.746632 read 0x03d116 thru 0x03ffff (0x2eea bytes) 000308 1783142553.760419 read 0x004e21 thru 0x010788 (0xb968 bytes) 000312 1783142553.764030 write 0x03bebe thru 0x03ffff (0x4142 bytes) 000313 1783142553.779293 write 0x01530c thru 0x0193eb (0x40e0 bytes) 000314 1783142553.781178 mapwrite 0x01bb7f thru 0x02a070 (0xe4f2 bytes) 000317 1783142553.859613 mapwrite 0x03d239 thru 0x03ffff (0x2dc7 bytes) 000319 1783142553.905628 mapread 0x0115f8 thru 0x01f246 (0xdc4f bytes) 000320 1783142553.907192 read 0x00c2c2 thru 0x00d74b (0x148a bytes) 000321 1783142553.912336 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x83659f71 (stale) Mirror 8: 0x83659f71 (stale) Mirror 10: 0x83659f71 (stale) Mirror 11: 0x83659f71 (stale) Mirror 12: 0x4676b0a3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdb550870 Mirror 13: 0xdb550870 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000322 1783142554.544800 mapwrite 0x0326b4 thru 0x03308e (0x9db bytes) 000323 1783142554.654842 trunc from 0x040000 to 0x010e4c (0x2f1b3 bytes) 000324 1783142554.676881 write 0x005f40 thru 0x00e409 (0x84ca bytes) 000329 1783142554.690962 mapread 0x00123a thru 0x00237d (0x1144 bytes) 000330 1783142554.695945 read 0x00ae0d thru 0x010e4c (0x6040 bytes) 000332 1783142554.699574 trunc from 0x010e4d to 0x020fc8 (0x1017c bytes) 000333 1783142554.717722 mapread 0x0087c5 thru 0x00c4c7 (0x3d03 bytes) 000335 1783142554.719554 mapread 0x016e19 thru 0x020fc8 (0xa1b0 bytes) 000336 1783142554.735542 MIRROR_RESYNC 7 mirrors 000337 1783142555.620748 MIRROR_EXTEND to 8 mirrors 000339 1783142556.178025 read 0x013546 thru 0x0191f0 (0x5cab bytes) 000340 1783142556.187327 read 0x01f194 thru 0x0207d3 (0x1640 bytes) 000341 1783142556.199289 MIRROR_RESYNC 8 mirrors 000342 1783142556.544505 mapwrite 0x012ed2 thru 0x01d509 (0xa638 bytes) 000343 1783142556.658130 mapwrite 0x039146 thru 0x03ffff (0x6eba bytes) 000346 1783142556.730482 read 0x004b47 thru 0x011ec9 (0xd383 bytes) 000350 1783142556.743126 trunc from 0x040000 to 0x02d66f (0x12990 bytes) 000351 1783142556.752566 mapwrite 0x03540a thru 0x03ffff (0xabf6 bytes) 000352 1783142556.823588 mapwrite 0x00ae2c thru 0x00b56e (0x743 bytes) 000354 1783142556.867840 mapread 0x03e8d6 thru 0x03ffff (0x172a bytes) 000355 1783142556.869249 read 0x03a58e thru 0x03cc21 (0x2694 bytes) 000357 1783142556.870540 mapread 0x0329bd thru 0x03604f (0x3693 bytes) 000359 1783142556.875088 trunc from 0x040000 to 0x0251b2 (0x1ae4d bytes) 000361 1783142556.891876 mapread 0x00e586 thru 0x013bed (0x5668 bytes) 000363 1783142556.893542 mapread 0x0106f2 thru 0x01383f (0x314e bytes) 000365 1783142556.899659 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x251b3): Mirror 4: 0x5d5dafc6 (stale) Mirror 8: 0x5d5dafc6 (stale) Mirror 10: 0x5d5dafc6 (stale) Mirror 11: 0x5d5dafc6 (stale) Mirror 13: 0x5d5dafc6 (stale) Mirror 14: 0x5d5dafc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x251b3): Mirror 4: 0x5d5dafc6 (stale) Mirror 8: 0x5d5dafc6 (stale) Mirror 10: 0x5d5dafc6 (stale) Mirror 11: 0x5d5dafc6 (stale) Mirror 13: 0x5d5dafc6 (stale) Mirror 14: 0x5d5dafc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x251b3: skipped 000367 1783142557.184075 mapread 0x002ff6 thru 0x012592 (0xf59d bytes) 000368 1783142557.211219 MIRROR_RESYNC 7 mirrors 000373 1783142558.061300 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) 000374 1783142558.293977 MIRROR_RESYNC 6 mirrors 000375 1783142558.569835 read 0x01a2f6 thru 0x01eede (0x4be9 bytes) truncating to largest ever: 0x3ea6f 000377 1783142558.576184 trunc from 0x0251b3 to 0x03ea6e (0x198bc bytes) 000378 1783142558.648524 trunc from 0x03ea6f to 0x01a3d8 (0x24696 bytes) 000380 1783142558.673591 MIRROR_RESYNC 6 mirrors 000382 1783142559.195938 trunc from 0x01a3d9 to 0x01ec44 (0x486c bytes) 000385 1783142559.243221 trunc from 0x01ec45 to 0x0098b0 (0x15394 bytes) 000386 1783142559.260349 trunc from 0x0098b1 to 0x0312e3 (0x27a33 bytes) 000388 1783142559.277707 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x312e4): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x312e4): Mirror 4: 0x23330f82 (stale) Mirror 8: 0x23330f82 (stale) Mirror 10: 0x23330f82 (stale) Mirror 13: 0x23330f82 (stale) Mirror 14: 0x23330f82 (stale) CRC-32 checksum value for chunk [0, 0x312e4): Mirror 1: 0xf23e8408 Mirror 15: 0xf23e8408 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x312e4: skipped 000389 1783142559.861374 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x312e4): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x312e4): Mirror 4: 0x23330f82 (stale) Mirror 8: 0x23330f82 (stale) Mirror 10: 0x23330f82 (stale) Mirror 13: 0x23330f82 (stale) Mirror 14: 0x23330f82 (stale) CRC-32 checksum value for chunk [0, 0x312e4): Mirror 1: 0xf23e8408 Mirror 15: 0xf23e8408 Mirror 16: 0xf23e8408 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x312e4: skipped 000392 1783142560.452437 write 0x01568c thru 0x01f29b (0x9c10 bytes) 000393 1783142560.510102 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x312e4): Mirror 4: 0x23330f82 (stale) Mirror 8: 0x23330f82 (stale) Mirror 10: 0x23330f82 (stale) Mirror 14: 0x23330f82 (stale) Mirror 15: 0xf23e8408 (stale) Mirror 16: 0xf23e8408 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x312e4): Mirror 4: 0x23330f82 (stale) Mirror 8: 0x23330f82 (stale) Mirror 10: 0x23330f82 (stale) Mirror 14: 0x23330f82 (stale) Mirror 15: 0xf23e8408 (stale) Mirror 16: 0xf23e8408 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x312e4: skipped 000394 1783142560.760917 write 0x026536 thru 0x0265da (0xa5 bytes) 000397 1783142560.769107 read 0x026964 thru 0x02e861 (0x7efe bytes) 000398 1783142560.777135 mapread 0x02c6ab thru 0x02cfa3 (0x8f9 bytes) 000399 1783142560.778422 trunc from 0x0312e4 to 0x006c71 (0x2a672 bytes) 000400 1783142560.797153 write 0x003612 thru 0x0052f1 (0x1ce0 bytes) 000403 1783142560.803103 write 0x01cf88 thru 0x02a022 (0xd09b bytes) 000405 1783142560.808688 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2a023): Mirror 4: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a023): Mirror 4: 0xa182bdc5 (stale) Mirror 8: 0xa182bdc5 (stale) Mirror 10: 0xa182bdc5 (stale) Mirror 14: 0xa182bdc5 (stale) Mirror 15: 0x893dc582 (stale) Mirror 16: 0x893dc582 (stale) CRC-32 checksum value for chunk [0, 0x2a023): Mirror 1: 0xf95a6296 Mirror 17: 0xf95a6296 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a023: skipped 000406 1783142561.485612 write 0x01eaa3 thru 0x02a9b7 (0xbf15 bytes) 000407 1783142561.568506 trunc from 0x02a9b8 to 0x007557 (0x23460 bytes) 000410 1783142561.598429 trunc from 0x007558 to 0x02dd88 (0x26831 bytes) 000411 1783142561.627607 read 0x01a7db thru 0x01ae1e (0x644 bytes) 000412 1783142561.640358 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dd89): Mirror 8: 0xaf216bf0 (stale) Mirror 10: 0xaf216bf0 (stale) Mirror 14: 0xaf216bf0 (stale) Mirror 15: 0x5781c9b6 (stale) Mirror 16: 0x5781c9b6 (stale) Mirror 17: 0xed831344 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dd89): Mirror 8: 0xaf216bf0 (stale) Mirror 10: 0xaf216bf0 (stale) Mirror 14: 0xaf216bf0 (stale) Mirror 15: 0x5781c9b6 (stale) Mirror 16: 0x5781c9b6 (stale) Mirror 17: 0xed831344 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dd89: skipped 000413 1783142561.982203 mapwrite 0x017516 thru 0x0200fb (0x8be6 bytes) 000414 1783142562.041985 trunc from 0x02dd89 to 0x002b28 (0x2b260 bytes) 000415 1783142562.057174 mapwrite 0x029130 thru 0x0293e3 (0x2b4 bytes) 000416 1783142562.112186 read 0x005dae thru 0x00b1cc (0x541f bytes) 000417 1783142562.122522 read 0x0175f7 thru 0x018a10 (0x141a bytes) 000421 1783142562.137018 mapread 0x025509 thru 0x0293e3 (0x3edb bytes) 000424 1783142562.141873 write 0x02e2cb thru 0x0396e2 (0xb418 bytes) 000426 1783142562.147330 write 0x02b3f4 thru 0x03b0d4 (0xfce1 bytes) 000427 1783142562.158130 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b0d5): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b0d5): Mirror 8: 0x24b991b8 (stale) Mirror 10: 0x24b991b8 (stale) Mirror 14: 0x24b991b8 (stale) Mirror 15: 0xdfba6b63 (stale) Mirror 16: 0xdfba6b63 (stale) Mirror 17: 0x43c6d990 (stale) CRC-32 checksum value for chunk [0, 0x3b0d5): Mirror 1: 0x221236ce Mirror 18: 0x221236ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b0d5: skipped 000428 1783142562.837545 mapread 0x034842 thru 0x03b0d4 (0x6893 bytes) 000429 1783142562.862741 write 0x00630e thru 0x00b46c (0x515f bytes) 000431 1783142562.957297 mapread 0x03985e thru 0x03b0d4 (0x1877 bytes) 000432 1783142562.973060 mapwrite 0x01630f thru 0x01cc73 (0x6965 bytes) 000433 1783142563.012005 mapread 0x00f4a0 thru 0x012534 (0x3095 bytes) 000435 1783142563.013299 mapwrite 0x02487e thru 0x03319c (0xe91f bytes) 000436 1783142563.046405 mapwrite 0x039fe7 thru 0x03ffff (0x6019 bytes) 000437 1783142563.125131 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa4d60b83 (stale) Mirror 10: 0xa4d60b83 (stale) Mirror 14: 0xa4d60b83 (stale) Mirror 15: 0xa84de599 (stale) Mirror 17: 0xdee5b6b (stale) Mirror 18: 0x912c857f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa4d60b83 (stale) Mirror 10: 0xa4d60b83 (stale) Mirror 14: 0xa4d60b83 (stale) Mirror 15: 0xa84de599 (stale) Mirror 17: 0xdee5b6b (stale) Mirror 18: 0x912c857f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000438 1783142563.456706 mapwrite 0x026160 thru 0x035986 (0xf827 bytes) 000441 1783142563.531581 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa4d60b83 (stale) Mirror 10: 0xa4d60b83 (stale) Mirror 14: 0xa4d60b83 (stale) Mirror 15: 0xa84de599 (stale) Mirror 17: 0xdee5b6b (stale) Mirror 18: 0x912c857f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9f5a53a3 Mirror 19: 0x9f5a53a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000442 1783142564.216066 mapread 0x02d393 thru 0x0308b9 (0x3527 bytes) 000443 1783142564.241198 mapread 0x01b18a thru 0x028a4a (0xd8c1 bytes) 000444 1783142564.268531 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa4d60b83 (stale) Mirror 14: 0xa4d60b83 (stale) Mirror 15: 0xa84de599 (stale) Mirror 17: 0xdee5b6b (stale) Mirror 18: 0x912c857f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa4d60b83 (stale) Mirror 14: 0xa4d60b83 (stale) Mirror 15: 0xa84de599 (stale) Mirror 17: 0xdee5b6b (stale) Mirror 18: 0x912c857f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9f5a53a3 Mirror 19: 0x9f5a53a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000445 1783142564.919140 trunc from 0x040000 to 0x03029d (0xfd62 bytes) 000447 1783142564.989490 trunc from 0x03029e to 0x037f49 (0x7cac bytes) 000448 1783142565.004789 mapread 0x02bd2f thru 0x03520c (0x94de bytes) 000449 1783142565.019839 mapwrite 0x008aae thru 0x00cb06 (0x4059 bytes) 000450 1783142565.057348 read 0x02c1c7 thru 0x037f49 (0xbd83 bytes) 000451 1783142565.063241 mapread 0x023db9 thru 0x030684 (0xc8cc bytes) 000455 1783142565.070843 mapread 0x01fc86 thru 0x02baff (0xbe7a bytes) 000457 1783142565.072835 read 0x020577 thru 0x02dced (0xd777 bytes) 000458 1783142565.074913 trunc from 0x037f4a to 0x029e6b (0xe0de bytes) 000459 1783142565.089222 mapread 0x021952 thru 0x024257 (0x2906 bytes) 000460 1783142565.090981 mapwrite 0x02d005 thru 0x038e49 (0xbe45 bytes) 000461 1783142565.144820 write 0x0091e3 thru 0x00f5d5 (0x63f3 bytes) 000462 1783142565.146221 mapwrite 0x02110b thru 0x02acfc (0x9bf2 bytes) 000464 1783142565.178117 mapwrite 0x02fccb thru 0x037534 (0x786a bytes) 000465 1783142565.212897 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x38e4a): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e4a): Mirror 10: 0x2ef91626 (stale) Mirror 14: 0x2ef91626 (stale) Mirror 15: 0xd9bf80c5 (stale) Mirror 17: 0xad3f6110 (stale) Mirror 18: 0x7daa97f5 (stale) Mirror 19: 0x70d02f99 (stale) CRC-32 checksum value for chunk [0, 0x38e4a): Mirror 1: 0xd3496c69 Mirror 20: 0xd3496c69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e4a: skipped 000467 1783142565.769722 read 0x00a6c6 thru 0x0168c9 (0xc204 bytes) 000469 1783142565.789732 write 0x035ab4 thru 0x03ffff (0xa54c bytes) 000471 1783142565.848969 read 0x039bde thru 0x03ffff (0x6422 bytes) 000472 1783142565.851219 mapwrite 0x031120 thru 0x03ffff (0xeee0 bytes) 000473 1783142565.896626 write 0x019338 thru 0x01a326 (0xfef bytes) 000474 1783142565.901035 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa4d60b83 (stale) Mirror 14: 0xa4d60b83 (stale) Mirror 15: 0xa84de599 (stale) Mirror 17: 0xdee5b6b (stale) Mirror 18: 0x912c857f (stale) Mirror 20: 0x870e9840 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa4d60b83 (stale) Mirror 14: 0xa4d60b83 (stale) Mirror 15: 0xa84de599 (stale) Mirror 17: 0xdee5b6b (stale) Mirror 18: 0x912c857f (stale) Mirror 20: 0x870e9840 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000475 1783142566.218146 mapread 0x0072cd thru 0x007c71 (0x9a5 bytes) 000478 1783142566.224713 write 0x03422a thru 0x03ffff (0xbdd6 bytes) 000482 1783142566.235370 write 0x00d95f thru 0x0168ce (0x8f70 bytes) 000483 1783142566.246539 mapwrite 0x02d32b thru 0x03060e (0x32e4 bytes) 000484 1783142566.293427 read 0x029379 thru 0x036b92 (0xd81a bytes) 000486 1783142566.295206 write 0x023e83 thru 0x030327 (0xc4a5 bytes) 000487 1783142566.301505 read 0x01217e thru 0x01cfcd (0xae50 bytes) 000488 1783142566.318701 MIRROR_RESYNC 7 mirrors 000489 1783142567.148929 mapwrite 0x036ea3 thru 0x03a5f5 (0x3753 bytes) 000490 1783142567.307022 mapread 0x035dea thru 0x03ffff (0xa216 bytes) 000491 1783142567.308673 trunc from 0x040000 to 0x02a187 (0x15e78 bytes) 000493 1783142567.348757 write 0x028178 thru 0x02b62b (0x34b4 bytes) 000498 1783142567.359836 read 0x00b645 thru 0x0198ea (0xe2a6 bytes) 000499 1783142567.367287 mapwrite 0x03ab6e thru 0x03bc73 (0x1106 bytes) 000501 1783142567.449279 trunc from 0x03bc74 to 0x004831 (0x37442 bytes) 000502 1783142567.463414 write 0x03e9e4 thru 0x03ffff (0x161c bytes) 000503 1783142567.464791 trunc from 0x040000 to 0x01e3a6 (0x21c59 bytes) 000504 1783142567.481617 trunc from 0x01e3a7 to 0x02db2d (0xf787 bytes) 000505 1783142567.505919 mapwrite 0x024e92 thru 0x027f47 (0x30b6 bytes) 000506 1783142567.559287 read 0x02b106 thru 0x02db2d (0x2a28 bytes) 000507 1783142567.567751 mapwrite 0x025df4 thru 0x027851 (0x1a5e bytes) 000511 1783142567.629232 write 0x00100f thru 0x00a3a3 (0x9395 bytes) 000512 1783142567.631737 trunc from 0x02db2e to 0x037586 (0x9a59 bytes) 000513 1783142567.660812 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x37587): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37587): Mirror 10: 0x1f85d158 (stale) Mirror 14: 0x1f85d158 (stale) Mirror 15: 0x1f85d158 (stale) Mirror 17: 0x1f85d158 (stale) Mirror 18: 0x1f85d158 (stale) Mirror 20: 0x1f85d158 (stale) CRC-32 checksum value for chunk [0, 0x37587): Mirror 1: 0x67787fb5 Mirror 21: 0x67787fb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37587: skipped 000514 1783142568.257910 mapwrite 0x018c55 thru 0x0261dc (0xd588 bytes) 000515 1783142568.411170 read 0x033d0a thru 0x0354a5 (0x179c bytes) 000516 1783142568.428567 trunc from 0x037587 to 0x004f78 (0x3260e bytes) 000518 1783142568.479866 trunc from 0x004f79 to 0x03493d (0x2f9c5 bytes) 000519 1783142568.497235 mapread 0x0217a2 thru 0x028258 (0x6ab7 bytes) 000520 1783142568.517577 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3493e): Mirror 10: 0x600d2f4e (stale) Mirror 14: 0x600d2f4e (stale) Mirror 15: 0x600d2f4e (stale) Mirror 17: 0x600d2f4e (stale) Mirror 20: 0x600d2f4e (stale) Mirror 21: 0x4ad75097 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3493e): Mirror 10: 0x600d2f4e (stale) Mirror 14: 0x600d2f4e (stale) Mirror 15: 0x600d2f4e (stale) Mirror 17: 0x600d2f4e (stale) Mirror 20: 0x600d2f4e (stale) Mirror 21: 0x4ad75097 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3493e: skipped 000521 1783142568.836925 read 0x0168c8 thru 0x022c43 (0xc37c bytes) 000522 1783142568.849964 write 0x0353fa thru 0x03ad0d (0x5914 bytes) 000524 1783142568.856747 trunc from 0x03ad0e to 0x030878 (0xa495 bytes) 000525 1783142568.884026 mapwrite 0x02d67c thru 0x03974d (0xc0d2 bytes) 000528 1783142569.019452 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3974e): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3974e): Mirror 10: 0x6bb398b (stale) Mirror 14: 0x6bb398b (stale) Mirror 15: 0x6bb398b (stale) Mirror 17: 0x6bb398b (stale) Mirror 20: 0x6bb398b (stale) Mirror 21: 0x71309b24 (stale) CRC-32 checksum value for chunk [0, 0x3974e): Mirror 1: 0xdad50d9e Mirror 22: 0xdad50d9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3974e: skipped 000529 1783142569.647107 read 0x00c0f7 thru 0x00da74 (0x197e bytes) 000530 1783142569.656595 trunc from 0x03974e to 0x002f73 (0x367da bytes) 000532 1783142569.714936 trunc from 0x002f74 to 0x039986 (0x36a13 bytes) 000533 1783142569.727602 mapread 0x0229a0 thru 0x02f0f7 (0xc758 bytes) 000534 1783142569.748576 read 0x033ccf thru 0x039986 (0x5cb8 bytes) 000535 1783142569.753435 mapread 0x008cbf thru 0x00db01 (0x4e43 bytes) 000536 1783142569.754931 mapread 0x000ba9 thru 0x003397 (0x27ef bytes) 000538 1783142569.756331 trunc from 0x039987 to 0x01f2c9 (0x1a6bd bytes) 000539 1783142569.770079 write 0x02a48e thru 0x02bdcd (0x1940 bytes) 000540 1783142569.771511 mapwrite 0x01a6b1 thru 0x023c95 (0x95e5 bytes) 000541 1783142569.830053 read 0x01a45a thru 0x021f66 (0x7b0d bytes) 000542 1783142569.830852 write 0x00e105 thru 0x017b02 (0x99fe bytes) 000544 1783142569.835614 read 0x00a403 thru 0x00b27b (0xe79 bytes) 000546 1783142569.839458 write 0x038796 thru 0x03c814 (0x407f bytes) 000547 1783142569.842449 write 0x0135ce thru 0x02113f (0xdb72 bytes) 000552 1783142569.851244 write 0x033562 thru 0x03765d (0x40fc bytes) 000557 1783142569.863353 write 0x00200d thru 0x00c9be (0xa9b2 bytes) 000559 1783142569.867064 read 0x019e5f thru 0x01ff99 (0x613b bytes) 000561 1783142569.869672 trunc from 0x03c815 to 0x038293 (0x4581 bytes) 000564 1783142569.898348 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x38294): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38294): Mirror 10: 0xc7dc8595 (stale) Mirror 14: 0xc7dc8595 (stale) Mirror 15: 0xc7dc8595 (stale) Mirror 17: 0xc7dc8595 (stale) Mirror 20: 0xc7dc8595 (stale) Mirror 21: 0x7e49191a (stale) Mirror 22: 0xaadf3c47 (stale) CRC-32 checksum value for chunk [0, 0x38294): Mirror 1: 0xa13e7f50 Mirror 23: 0xa13e7f50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38294: skipped 000565 1783142570.571172 trunc from 0x038294 to 0x01e230 (0x1a063 bytes) 000568 1783142570.641906 MIRROR_RESYNC 9 mirrors 000569 1783142571.570206 read 0x017b4b thru 0x01e230 (0x66e6 bytes) 000570 1783142571.579550 write 0x004c40 thru 0x010c29 (0xbfea bytes) 000573 1783142571.641308 mapread 0x00c73f thru 0x0168e6 (0xa1a8 bytes) 000575 1783142571.676409 write 0x03cffc thru 0x03eeb5 (0x1eba bytes) 000576 1783142571.681177 read 0x026e59 thru 0x035af3 (0xec9b bytes) 000577 1783142571.697809 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eeb6): Mirror 10: 0x1c8c4997 (stale) Mirror 14: 0x1c8c4997 (stale) Mirror 15: 0x1c8c4997 (stale) Mirror 17: 0x1c8c4997 (stale) Mirror 21: 0x1c8c4997 (stale) Mirror 22: 0x1c8c4997 (stale) Mirror 23: 0x1c8c4997 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eeb6): Mirror 10: 0x1c8c4997 (stale) Mirror 14: 0x1c8c4997 (stale) Mirror 15: 0x1c8c4997 (stale) Mirror 17: 0x1c8c4997 (stale) Mirror 21: 0x1c8c4997 (stale) Mirror 22: 0x1c8c4997 (stale) Mirror 23: 0x1c8c4997 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eeb6: skipped 000578 1783142572.251081 trunc from 0x03eeb6 to 0x0395c1 (0x58f4 bytes) 000580 1783142572.266143 trunc from 0x0395c2 to 0x00266c (0x36f55 bytes) 000581 1783142572.283761 mapread 0x002562 thru 0x00266c (0x10b bytes) 000583 1783142572.288737 write 0x014c7e thru 0x01863c (0x39bf bytes) 000584 1783142572.295205 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1863d): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1863d): Mirror 10: 0xe0583cc0 (stale) Mirror 14: 0xe0583cc0 (stale) Mirror 15: 0xe0583cc0 (stale) Mirror 17: 0xe0583cc0 (stale) Mirror 21: 0xe0583cc0 (stale) Mirror 22: 0xe0583cc0 (stale) Mirror 23: 0xe0583cc0 (stale) CRC-32 checksum value for chunk [0, 0x1863d): Mirror 1: 0xf51b0611 Mirror 24: 0xf51b0611 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1863d: skipped 000585 1783142572.957861 mapwrite 0x030632 thru 0x034679 (0x4048 bytes) 000587 1783142573.142887 read 0x031591 thru 0x034679 (0x30e9 bytes) 000588 1783142573.143565 mapread 0x025fb6 thru 0x029530 (0x357b bytes) 000589 1783142573.156281 read 0x015933 thru 0x02448b (0xeb59 bytes) 000591 1783142573.165809 mapread 0x001c31 thru 0x005f91 (0x4361 bytes) 000592 1783142573.167160 write 0x02308a thru 0x031880 (0xe7f7 bytes) 000593 1783142573.170812 read 0x0332ca thru 0x034303 (0x103a bytes) 000595 1783142573.172253 trunc from 0x03467a to 0x003f65 (0x30714 bytes) 000597 1783142573.201882 trunc from 0x003f66 to 0x012b9a (0xec35 bytes) 000598 1783142573.220693 write 0x03b977 thru 0x03d11b (0x17a5 bytes) 000602 1783142573.224223 read 0x00e5ae thru 0x012ed4 (0x4927 bytes) 000604 1783142573.236080 write 0x006a1b thru 0x00822a (0x1810 bytes) 000606 1783142573.238244 write 0x024bee thru 0x028ea7 (0x42ba bytes) 000607 1783142573.239682 mapread 0x0325ae thru 0x038998 (0x63eb bytes) 000608 1783142573.240800 trunc from 0x03d11c to 0x03cb1c (0x5ff bytes) 000609 1783142573.252705 write 0x0182f0 thru 0x0280eb (0xfdfc bytes) 000611 1783142573.255191 mapread 0x00239d thru 0x011e73 (0xfad7 bytes) 000612 1783142573.257006 mapread 0x02008d thru 0x0291e1 (0x9155 bytes) 000613 1783142573.258545 mapread 0x0045ef thru 0x009329 (0x4d3b bytes) 000614 1783142573.259531 trunc from 0x03cb1d to 0x02fa5c (0xd0c0 bytes) 000615 1783142573.272627 write 0x03d591 thru 0x03ffff (0x2a6f bytes) 000618 1783142573.274604 mapread 0x034506 thru 0x03ffff (0xbafa bytes) 000619 1783142573.308934 MIRROR_RESYNC 9 mirrors 000621 1783142574.369733 mapwrite 0x010ed2 thru 0x01f9ac (0xeadb bytes) 000622 1783142574.500091 trunc from 0x040000 to 0x02be8f (0x14170 bytes) 000626 1783142574.526663 read 0x0010a1 thru 0x00be38 (0xad98 bytes) 000627 1783142574.532678 write 0x00e1ae thru 0x01bd2f (0xdb82 bytes) 000628 1783142574.538502 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2be90): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2be90): Mirror 10: 0xb6e2b69e (stale) Mirror 14: 0xb6e2b69e (stale) Mirror 15: 0xb6e2b69e (stale) Mirror 17: 0xb6e2b69e (stale) Mirror 21: 0xb6e2b69e (stale) Mirror 22: 0xb6e2b69e (stale) Mirror 23: 0xb6e2b69e (stale) Mirror 24: 0xb6e2b69e (stale) CRC-32 checksum value for chunk [0, 0x2be90): Mirror 1: 0x88f71342 Mirror 25: 0x88f71342 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2be90: skipped 000629 1783142575.251289 trunc from 0x02be90 to 0x028aa0 (0x33ef bytes) 000630 1783142575.390882 mapwrite 0x005592 thru 0x012df1 (0xd860 bytes) 000632 1783142575.495249 write 0x01b45b thru 0x024dd5 (0x997b bytes) 000634 1783142575.513153 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x28aa1): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28aa1): Mirror 10: 0xcf62c777 (stale) Mirror 14: 0xcf62c777 (stale) Mirror 15: 0xcf62c777 (stale) Mirror 17: 0xcf62c777 (stale) Mirror 21: 0xcf62c777 (stale) Mirror 22: 0xcf62c777 (stale) Mirror 23: 0xcf62c777 (stale) Mirror 24: 0xcf62c777 (stale) Mirror 25: 0xda6dd271 (stale) CRC-32 checksum value for chunk [0, 0x28aa1): Mirror 1: 0x10a135ac Mirror 26: 0x10a135ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28aa1: skipped 000635 1783142576.188676 mapread 0x02887a thru 0x028aa0 (0x227 bytes) 000636 1783142576.203492 mapread 0x01e45c thru 0x027bfa (0x979f bytes) 000639 1783142576.225336 write 0x033b61 thru 0x038c2c (0x50cc bytes) 000641 1783142576.293375 write 0x00ef45 thru 0x0114ff (0x25bb bytes) 000642 1783142576.299791 mapread 0x035fd9 thru 0x038c2c (0x2c54 bytes) 000646 1783142576.302655 mapread 0x02cfee thru 0x03286a (0x587d bytes) 000647 1783142576.310012 trunc from 0x038c2d to 0x0013d6 (0x37856 bytes) 000650 1783142576.339655 mapread 0x001156 thru 0x0013d6 (0x281 bytes) 000651 1783142576.343925 write 0x017c70 thru 0x025dea (0xe17b bytes) 000652 1783142576.345411 write 0x003f04 thru 0x00eeb1 (0xafae bytes) 000654 1783142576.352094 write 0x038700 thru 0x03ffff (0x7900 bytes) 000657 1783142576.359728 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x6d4f50 (stale) Mirror 14: 0x6d4f50 (stale) Mirror 15: 0x6d4f50 (stale) Mirror 17: 0x6d4f50 (stale) Mirror 21: 0x6d4f50 (stale) Mirror 22: 0x6d4f50 (stale) Mirror 23: 0x6d4f50 (stale) Mirror 24: 0x6d4f50 (stale) Mirror 25: 0xb9a4d519 (stale) Mirror 26: 0x5c1e8265 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x56cc6bb2 Mirror 27: 0x56cc6bb2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000658 1783142577.039553 write 0x03fde5 thru 0x03ffff (0x21b bytes) 000659 1783142577.128279 write 0x005654 thru 0x00b431 (0x5dde bytes) 000661 1783142577.141738 trunc from 0x040000 to 0x00afd7 (0x35028 bytes) 000662 1783142577.176101 mapwrite 0x001605 thru 0x00ddcc (0xc7c8 bytes) 000665 1783142577.304807 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0xddcd): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xddcd): Mirror 10: 0x5f39b6ee (stale) Mirror 14: 0x5f39b6ee (stale) Mirror 15: 0x5f39b6ee (stale) Mirror 17: 0x5f39b6ee (stale) Mirror 21: 0x5f39b6ee (stale) Mirror 22: 0x5f39b6ee (stale) Mirror 23: 0x5f39b6ee (stale) Mirror 24: 0x5f39b6ee (stale) Mirror 25: 0x5f39b6ee (stale) Mirror 26: 0x4fa93b92 (stale) Mirror 27: 0x71adddd9 (stale) CRC-32 checksum value for chunk [0, 0xddcd): Mirror 1: 0xd3cbf7c3 Mirror 28: 0xd3cbf7c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xddcd: skipped 000666 1783142577.931751 write 0x0313d4 thru 0x03de78 (0xcaa5 bytes) 000667 1783142578.024855 mapwrite 0x0386ff thru 0x03d79e (0x50a0 bytes) 000668 1783142578.086608 mapread 0x009c9b thru 0x010d69 (0x70cf bytes) 000669 1783142578.108535 read 0x02cc02 thru 0x03909a (0xc499 bytes) 000671 1783142578.123547 MIRROR_RESYNC 13 mirrors 000675 1783142579.623952 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) 000678 1783142580.051605 mapread 0x011587 thru 0x01e515 (0xcf8f bytes) 000681 1783142580.081131 write 0x03b522 thru 0x03ffff (0x4ade bytes) 000683 1783142580.131660 mapwrite 0x03b4fc thru 0x03ffff (0x4b04 bytes) 000687 1783142580.184756 write 0x01ec56 thru 0x026b85 (0x7f30 bytes) 000689 1783142580.195091 read 0x011414 thru 0x01f72b (0xe318 bytes) 000690 1783142580.201517 mapread 0x009775 thru 0x0189af (0xf23b bytes) 000691 1783142580.212969 trunc from 0x040000 to 0x01783a (0x287c5 bytes) 000692 1783142580.240843 read 0x016a52 thru 0x01783a (0xde9 bytes) 000693 1783142580.245776 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1783b): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1783b): Mirror 10: 0x411a33d4 (stale) Mirror 14: 0x411a33d4 (stale) Mirror 15: 0x411a33d4 (stale) Mirror 17: 0x411a33d4 (stale) Mirror 21: 0x411a33d4 (stale) Mirror 22: 0x411a33d4 (stale) Mirror 23: 0x411a33d4 (stale) Mirror 24: 0x411a33d4 (stale) Mirror 25: 0x411a33d4 (stale) Mirror 26: 0x411a33d4 (stale) Mirror 28: 0x411a33d4 (stale) CRC-32 checksum value for chunk [0, 0x1783b): Mirror 1: 0x411a33d4 Mirror 29: 0x411a33d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1783b: skipped 000694 1783142580.969212 mapread 0x007efa thru 0x012597 (0xa69e bytes) 000695 1783142581.009936 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1783b): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1783b): Mirror 10: 0x411a33d4 (stale) Mirror 14: 0x411a33d4 (stale) Mirror 15: 0x411a33d4 (stale) Mirror 17: 0x411a33d4 (stale) Mirror 21: 0x411a33d4 (stale) Mirror 22: 0x411a33d4 (stale) Mirror 23: 0x411a33d4 (stale) Mirror 24: 0x411a33d4 (stale) Mirror 25: 0x411a33d4 (stale) Mirror 26: 0x411a33d4 (stale) Mirror 28: 0x411a33d4 (stale) CRC-32 checksum value for chunk [0, 0x1783b): Mirror 1: 0x411a33d4 Mirror 29: 0x411a33d4 Mirror 30: 0x411a33d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1783b: skipped 000696 1783142581.812262 trunc from 0x01783b to 0x02273f (0xaf05 bytes) 000699 1783142581.942074 mapread 0x00aecc thru 0x00cac3 (0x1bf8 bytes) 000700 1783142581.967707 trunc from 0x022740 to 0x00c27e (0x164c1 bytes) 000702 1783142581.995705 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0xc27f): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc27f): Mirror 10: 0x6d895867 (stale) Mirror 14: 0x6d895867 (stale) Mirror 15: 0x6d895867 (stale) Mirror 17: 0x6d895867 (stale) Mirror 21: 0x6d895867 (stale) Mirror 22: 0x6d895867 (stale) Mirror 23: 0x6d895867 (stale) Mirror 24: 0x6d895867 (stale) Mirror 25: 0x6d895867 (stale) Mirror 26: 0x6d895867 (stale) Mirror 28: 0x6d895867 (stale) Mirror 29: 0x6d895867 (stale) Mirror 30: 0x6d895867 (stale) CRC-32 checksum value for chunk [0, 0xc27f): Mirror 1: 0x6d895867 Mirror 31: 0x6d895867 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc27f: skipped 000703 1783142582.844842 write 0x039a20 thru 0x03ffff (0x65e0 bytes) 000704 1783142582.889122 trunc from 0x040000 to 0x02f347 (0x10cb8 bytes) 000705 1783142582.903535 MIRROR_RESYNC 15 mirrors 000707 1783142584.420095 mapwrite 0x0022f9 thru 0x00ed4e (0xca56 bytes) 000709 1783142584.527361 trunc from 0x02f348 to 0x0341b1 (0x4e6a bytes) 000713 1783142584.553088 mapwrite 0x002cbf thru 0x00e4f3 (0xb835 bytes) 000714 1783142584.601748 MIRROR_SPLIT mirror 8 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x341b2): Mirror 10: 0x3536e2e6 (stale) Mirror 14: 0x3536e2e6 (stale) Mirror 15: 0x3536e2e6 (stale) Mirror 17: 0x3536e2e6 (stale) Mirror 21: 0x3536e2e6 (stale) Mirror 22: 0x3536e2e6 (stale) Mirror 23: 0x3536e2e6 (stale) Mirror 25: 0x3536e2e6 (stale) Mirror 26: 0x3536e2e6 (stale) Mirror 28: 0x3536e2e6 (stale) Mirror 29: 0x3536e2e6 (stale) Mirror 30: 0x3536e2e6 (stale) Mirror 31: 0x3536e2e6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x341b2): Mirror 10: 0x3536e2e6 (stale) Mirror 14: 0x3536e2e6 (stale) Mirror 15: 0x3536e2e6 (stale) Mirror 17: 0x3536e2e6 (stale) Mirror 21: 0x3536e2e6 (stale) Mirror 22: 0x3536e2e6 (stale) Mirror 23: 0x3536e2e6 (stale) Mirror 25: 0x3536e2e6 (stale) Mirror 26: 0x3536e2e6 (stale) Mirror 28: 0x3536e2e6 (stale) Mirror 29: 0x3536e2e6 (stale) Mirror 30: 0x3536e2e6 (stale) Mirror 31: 0x3536e2e6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x341b2: skipped 000717 1783142585.075964 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x341b2): Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x341b2): Mirror 10: 0x3536e2e6 (stale) Mirror 14: 0x3536e2e6 (stale) Mirror 15: 0x3536e2e6 (stale) Mirror 17: 0x3536e2e6 (stale) Mirror 21: 0x3536e2e6 (stale) Mirror 22: 0x3536e2e6 (stale) Mirror 23: 0x3536e2e6 (stale) Mirror 25: 0x3536e2e6 (stale) Mirror 26: 0x3536e2e6 (stale) Mirror 28: 0x3536e2e6 (stale) Mirror 29: 0x3536e2e6 (stale) Mirror 30: 0x3536e2e6 (stale) Mirror 31: 0x3536e2e6 (stale) CRC-32 checksum value for chunk [0, 0x341b2): Mirror 1: 0xa8b1ebb2 Mirror 32: 0xa8b1ebb2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x341b2: skipped 000722 1783142585.811886 mapwrite 0x030309 thru 0x037ddd (0x7ad5 bytes) 000725 1783142585.879542 read 0x037cf8 thru 0x037ddd (0xe6 bytes) 000726 1783142585.880580 write 0x0153e3 thru 0x0228f3 (0xd511 bytes) 000727 1783142585.887797 mapread 0x031b06 thru 0x037ddd (0x62d8 bytes) 000729 1783142585.889294 mapwrite 0x01385d thru 0x01b134 (0x78d8 bytes) 000731 1783142585.929169 read 0x0172b0 thru 0x019bf8 (0x2949 bytes) 000732 1783142585.929932 mapread 0x01cfd0 thru 0x021cb0 (0x4ce1 bytes) 000733 1783142585.938012 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37dde): Mirror 10: 0x8277486a (stale) Mirror 14: 0x8277486a (stale) Mirror 15: 0x8277486a (stale) Mirror 17: 0x8277486a (stale) Mirror 21: 0x8277486a (stale) Mirror 22: 0x8277486a (stale) Mirror 25: 0x8277486a (stale) Mirror 26: 0x8277486a (stale) Mirror 28: 0x8277486a (stale) Mirror 29: 0x8277486a (stale) Mirror 30: 0x8277486a (stale) Mirror 31: 0x8277486a (stale) Mirror 32: 0x349846a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37dde): Mirror 10: 0x8277486a (stale) Mirror 14: 0x8277486a (stale) Mirror 15: 0x8277486a (stale) Mirror 17: 0x8277486a (stale) Mirror 21: 0x8277486a (stale) Mirror 22: 0x8277486a (stale) Mirror 25: 0x8277486a (stale) Mirror 26: 0x8277486a (stale) Mirror 28: 0x8277486a (stale) Mirror 29: 0x8277486a (stale) Mirror 30: 0x8277486a (stale) Mirror 31: 0x8277486a (stale) Mirror 32: 0x349846a2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37dde: skipped 000735 1783142586.421730 trunc from 0x037dde to 0x029f9b (0xde42 bytes) 000736 1783142586.435220 mapread 0x01c8cb thru 0x02259f (0x5cd5 bytes) 000737 1783142586.468160 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29f9c): Mirror 10: 0x43ec5614 (stale) Mirror 14: 0x43ec5614 (stale) Mirror 15: 0x43ec5614 (stale) Mirror 17: 0x43ec5614 (stale) Mirror 21: 0x43ec5614 (stale) Mirror 22: 0x43ec5614 (stale) Mirror 25: 0x43ec5614 (stale) Mirror 28: 0x43ec5614 (stale) Mirror 29: 0x43ec5614 (stale) Mirror 30: 0x43ec5614 (stale) Mirror 31: 0x43ec5614 (stale) Mirror 32: 0xb454819c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f9c): Mirror 10: 0x43ec5614 (stale) Mirror 14: 0x43ec5614 (stale) Mirror 15: 0x43ec5614 (stale) Mirror 17: 0x43ec5614 (stale) Mirror 21: 0x43ec5614 (stale) Mirror 22: 0x43ec5614 (stale) Mirror 25: 0x43ec5614 (stale) Mirror 28: 0x43ec5614 (stale) Mirror 29: 0x43ec5614 (stale) Mirror 30: 0x43ec5614 (stale) Mirror 31: 0x43ec5614 (stale) Mirror 32: 0xb454819c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f9c: skipped 000738 1783142586.871570 mapread 0x007c25 thru 0x012caf (0xb08b bytes) 000740 1783142586.895639 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29f9c): Mirror 10: 0x43ec5614 (stale) Mirror 15: 0x43ec5614 (stale) Mirror 17: 0x43ec5614 (stale) Mirror 21: 0x43ec5614 (stale) Mirror 22: 0x43ec5614 (stale) Mirror 25: 0x43ec5614 (stale) Mirror 28: 0x43ec5614 (stale) Mirror 29: 0x43ec5614 (stale) Mirror 30: 0x43ec5614 (stale) Mirror 31: 0x43ec5614 (stale) Mirror 32: 0xb454819c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f9c): Mirror 10: 0x43ec5614 (stale) Mirror 15: 0x43ec5614 (stale) Mirror 17: 0x43ec5614 (stale) Mirror 21: 0x43ec5614 (stale) Mirror 22: 0x43ec5614 (stale) Mirror 25: 0x43ec5614 (stale) Mirror 28: 0x43ec5614 (stale) Mirror 29: 0x43ec5614 (stale) Mirror 30: 0x43ec5614 (stale) Mirror 31: 0x43ec5614 (stale) Mirror 32: 0xb454819c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f9c: skipped 000741 1783142587.247306 write 0x028fc6 thru 0x034980 (0xb9bb bytes) 000745 1783142587.258010 write 0x0118f8 thru 0x0176c8 (0x5dd1 bytes) 000746 1783142587.272518 read 0x01ea05 thru 0x0200ca (0x16c6 bytes) 000747 1783142587.282628 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x34981): Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34981): Mirror 10: 0xa01228d (stale) Mirror 15: 0xa01228d (stale) Mirror 17: 0xa01228d (stale) Mirror 21: 0xa01228d (stale) Mirror 22: 0xa01228d (stale) Mirror 25: 0xa01228d (stale) Mirror 28: 0xa01228d (stale) Mirror 29: 0xa01228d (stale) Mirror 30: 0xa01228d (stale) Mirror 31: 0xa01228d (stale) Mirror 32: 0x14aa6b46 (stale) CRC-32 checksum value for chunk [0, 0x34981): Mirror 1: 0xe3182429 Mirror 33: 0xe3182429 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34981: skipped 000748 1783142587.947026 read 0x00ff41 thru 0x01f028 (0xf0e8 bytes) 000749 1783142587.957773 trunc from 0x034981 to 0x03bec1 (0x7541 bytes) 000750 1783142588.016522 read 0x030330 thru 0x03bec1 (0xbb92 bytes) 000751 1783142588.023305 write 0x01ae53 thru 0x01f4d3 (0x4681 bytes) 000753 1783142588.025274 read 0x03239d thru 0x03baa8 (0x970c bytes) 000754 1783142588.026040 mapread 0x030eee thru 0x037104 (0x6217 bytes) 000756 1783142588.027860 write 0x00818f thru 0x012ce0 (0xab52 bytes) 000757 1783142588.029156 write 0x03d4e0 thru 0x03ffff (0x2b20 bytes) 000760 1783142588.031111 trunc from 0x040000 to 0x005f37 (0x3a0c8 bytes) 000761 1783142588.048200 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5f38): Mirror 10: 0x92bc731d (stale) Mirror 15: 0x92bc731d (stale) Mirror 21: 0x92bc731d (stale) Mirror 22: 0x92bc731d (stale) Mirror 25: 0x92bc731d (stale) Mirror 28: 0x92bc731d (stale) Mirror 29: 0x92bc731d (stale) Mirror 30: 0x92bc731d (stale) Mirror 31: 0x92bc731d (stale) Mirror 32: 0x65b3ab75 (stale) Mirror 33: 0x65b3ab75 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5f38): Mirror 10: 0x92bc731d (stale) Mirror 15: 0x92bc731d (stale) Mirror 21: 0x92bc731d (stale) Mirror 22: 0x92bc731d (stale) Mirror 25: 0x92bc731d (stale) Mirror 28: 0x92bc731d (stale) Mirror 29: 0x92bc731d (stale) Mirror 30: 0x92bc731d (stale) Mirror 31: 0x92bc731d (stale) Mirror 32: 0x65b3ab75 (stale) Mirror 33: 0x65b3ab75 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5f38: skipped 000762 1783142588.422686 read 0x00211b thru 0x005f37 (0x3e1d bytes) 000763 1783142588.433897 trunc from 0x005f38 to 0x02fa98 (0x29b61 bytes) 000764 1783142588.456701 mapread 0x0272e7 thru 0x02da0a (0x6724 bytes) 000766 1783142588.486057 read 0x026b17 thru 0x02fa98 (0x8f82 bytes) 000767 1783142588.486889 mapread 0x00e2e2 thru 0x01aa3b (0xc75a bytes) 000768 1783142588.501148 write 0x03e76f thru 0x03ffff (0x1891 bytes) 000770 1783142588.507113 trunc from 0x040000 to 0x015dc1 (0x2a23e bytes) 000772 1783142588.537198 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15dc2): Mirror 10: 0x447c7b6e (stale) Mirror 15: 0x447c7b6e (stale) Mirror 21: 0x447c7b6e (stale) Mirror 22: 0x447c7b6e (stale) Mirror 25: 0x447c7b6e (stale) Mirror 29: 0x447c7b6e (stale) Mirror 30: 0x447c7b6e (stale) Mirror 31: 0x447c7b6e (stale) Mirror 32: 0x425cf14 (stale) Mirror 33: 0x79991767 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15dc2): Mirror 10: 0x447c7b6e (stale) Mirror 15: 0x447c7b6e (stale) Mirror 21: 0x447c7b6e (stale) Mirror 22: 0x447c7b6e (stale) Mirror 25: 0x447c7b6e (stale) Mirror 29: 0x447c7b6e (stale) Mirror 30: 0x447c7b6e (stale) Mirror 31: 0x447c7b6e (stale) Mirror 32: 0x425cf14 (stale) Mirror 33: 0x79991767 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15dc2: skipped 000773 1783142588.918893 read 0x00daa9 thru 0x015141 (0x7699 bytes) 000775 1783142588.926235 read 0x0091ad thru 0x0132e6 (0xa13a bytes) 000776 1783142588.937282 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15dc2): Mirror 10: 0x447c7b6e (stale) Mirror 15: 0x447c7b6e (stale) Mirror 21: 0x447c7b6e (stale) Mirror 22: 0x447c7b6e (stale) Mirror 25: 0x447c7b6e (stale) Mirror 30: 0x447c7b6e (stale) Mirror 31: 0x447c7b6e (stale) Mirror 32: 0x425cf14 (stale) Mirror 33: 0x79991767 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15dc2): Mirror 10: 0x447c7b6e (stale) Mirror 15: 0x447c7b6e (stale) Mirror 21: 0x447c7b6e (stale) Mirror 22: 0x447c7b6e (stale) Mirror 25: 0x447c7b6e (stale) Mirror 30: 0x447c7b6e (stale) Mirror 31: 0x447c7b6e (stale) Mirror 32: 0x425cf14 (stale) Mirror 33: 0x79991767 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15dc2: skipped 000779 1783142589.362941 mapwrite 0x0028ac thru 0x00d78e (0xaee3 bytes) 000780 1783142589.422208 trunc from 0x015dc2 to 0x014e41 (0xf80 bytes) 000783 1783142589.444890 write 0x00e02a thru 0x00edba (0xd91 bytes) 000785 1783142589.448928 mapread 0x0063e9 thru 0x014e41 (0xea59 bytes) 000786 1783142589.458533 read 0x0056bb thru 0x0123a9 (0xccef bytes) 000787 1783142589.462435 MIRROR_RESYNC 10 mirrors 000788 1783142590.415687 MIRROR_EXTEND to 11 mirrors 000789 1783142590.906203 MIRROR_RESYNC 11 mirrors 000790 1783142591.345723 mapread 0x00ae63 thru 0x00d131 (0x22cf bytes) 000791 1783142591.359267 write 0x00ea75 thru 0x00ef29 (0x4b5 bytes) 000792 1783142591.424487 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x14e42): Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14e42): Mirror 10: 0xe5f3664e (stale) Mirror 15: 0xe5f3664e (stale) Mirror 21: 0xe5f3664e (stale) Mirror 22: 0xe5f3664e (stale) Mirror 25: 0xe5f3664e (stale) Mirror 30: 0xe5f3664e (stale) Mirror 31: 0xe5f3664e (stale) Mirror 32: 0xe5f3664e (stale) Mirror 33: 0xe5f3664e (stale) Mirror 34: 0xe5f3664e (stale) CRC-32 checksum value for chunk [0, 0x14e42): Mirror 1: 0x1e03f1fb Mirror 35: 0x1e03f1fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14e42: skipped 000793 1783142592.151067 mapwrite 0x018f9a thru 0x026330 (0xd397 bytes) 000794 1783142592.270014 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x26331): Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26331): Mirror 10: 0x663b5b0e (stale) Mirror 15: 0x663b5b0e (stale) Mirror 21: 0x663b5b0e (stale) Mirror 22: 0x663b5b0e (stale) Mirror 25: 0x663b5b0e (stale) Mirror 30: 0x663b5b0e (stale) Mirror 31: 0x663b5b0e (stale) Mirror 32: 0x663b5b0e (stale) Mirror 33: 0x663b5b0e (stale) Mirror 34: 0x663b5b0e (stale) Mirror 35: 0xa57eca9d (stale) CRC-32 checksum value for chunk [0, 0x26331): Mirror 1: 0x5e72f03e Mirror 36: 0x5e72f03e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26331: skipped 000795 1783142592.975489 read 0x00c2af thru 0x0113a6 (0x50f8 bytes) 000798 1783142592.998925 mapread 0x0034d6 thru 0x00f626 (0xc151 bytes) 000800 1783142593.027178 trunc from 0x026331 to 0x017ddc (0xe554 bytes) 000801 1783142593.125761 trunc from 0x017ddd to 0x003016 (0x14dc6 bytes) 000802 1783142593.145560 mapwrite 0x0058e5 thru 0x0150e6 (0xf802 bytes) 000804 1783142593.256815 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x150e7): Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x150e7): Mirror 10: 0xf41d62ae (stale) Mirror 15: 0xf41d62ae (stale) Mirror 21: 0xf41d62ae (stale) Mirror 22: 0xf41d62ae (stale) Mirror 25: 0xf41d62ae (stale) Mirror 30: 0xf41d62ae (stale) Mirror 31: 0xf41d62ae (stale) Mirror 32: 0xf41d62ae (stale) Mirror 33: 0xf41d62ae (stale) Mirror 34: 0xf41d62ae (stale) Mirror 35: 0x8ca96aa9 (stale) Mirror 36: 0x8ca96aa9 (stale) CRC-32 checksum value for chunk [0, 0x150e7): Mirror 1: 0xd3a698da Mirror 37: 0xd3a698da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x150e7: skipped 000806 1783142593.949915 trunc from 0x0150e7 to 0x036ef0 (0x21e0a bytes) 000807 1783142594.032957 MIRROR_RESYNC 14 mirrors 000808 1783142595.425918 mapwrite 0x0189b1 thru 0x01e2e1 (0x5931 bytes) 000810 1783142595.578787 read 0x01784b thru 0x01eaa6 (0x725c bytes) 000811 1783142595.582818 MIRROR_RESYNC 14 mirrors 000813 1783142597.031190 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) 000817 1783142597.460507 trunc from 0x036ef1 to 0x03a3df (0x34ef bytes) 000820 1783142597.566237 write 0x02ff80 thru 0x03f065 (0xf0e6 bytes) 000821 1783142597.572765 mapwrite 0x017659 thru 0x020123 (0x8acb bytes) 000822 1783142597.657661 trunc from 0x03f066 to 0x00e1a0 (0x30ec5 bytes) 000823 1783142597.677466 mapwrite 0x02c082 thru 0x03b0a3 (0xf022 bytes) 000828 1783142597.771320 trunc from 0x03b0a4 to 0x000873 (0x3a830 bytes) 000830 1783142597.789889 mapwrite 0x010a37 thru 0x01c20f (0xb7d9 bytes) 000831 1783142597.878288 mapwrite 0x031fac thru 0x035307 (0x335c bytes) 000832 1783142597.939776 read 0x01b325 thru 0x01eeb5 (0x3b91 bytes) 000833 1783142597.947733 mapwrite 0x03d181 thru 0x03ffff (0x2e7f bytes) 000834 1783142598.007758 write 0x030b9c thru 0x03ffff (0xf464 bytes) 000838 1783142598.018438 MIRROR_RESYNC 13 mirrors 000839 1783142599.468192 mapread 0x00c8e5 thru 0x0118fa (0x5016 bytes) 000841 1783142599.485629 trunc from 0x040000 to 0x021692 (0x1e96d bytes) 000842 1783142599.556944 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x21693): Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21693): Mirror 10: 0xb1f8e1f1 (stale) Mirror 15: 0xb1f8e1f1 (stale) Mirror 21: 0xb1f8e1f1 (stale) Mirror 22: 0xb1f8e1f1 (stale) Mirror 25: 0xb1f8e1f1 (stale) Mirror 30: 0xb1f8e1f1 (stale) Mirror 31: 0xb1f8e1f1 (stale) Mirror 32: 0xb1f8e1f1 (stale) Mirror 33: 0xb1f8e1f1 (stale) Mirror 34: 0xb1f8e1f1 (stale) Mirror 35: 0xb1f8e1f1 (stale) Mirror 36: 0xb1f8e1f1 (stale) CRC-32 checksum value for chunk [0, 0x21693): Mirror 1: 0xb1f8e1f1 Mirror 37: 0xb1f8e1f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21693: skipped 000848 1783142600.511890 trunc from 0x021693 to 0x016f62 (0xa730 bytes) 000849 1783142600.596674 read 0x007f1d thru 0x010e84 (0x8f68 bytes) 000850 1783142600.606997 write 0x03de75 thru 0x03ffff (0x218b bytes) 000851 1783142600.613573 write 0x012d11 thru 0x01b209 (0x84f9 bytes) 000852 1783142600.625798 read 0x017f15 thru 0x01fd47 (0x7e33 bytes) 000853 1783142600.634496 mapwrite 0x034e3c thru 0x03ffff (0xb1c4 bytes) 000856 1783142600.694680 trunc from 0x040000 to 0x0025b6 (0x3da49 bytes) 000858 1783142600.725369 trunc from 0x0025b7 to 0x01c869 (0x1a2b3 bytes) 000864 1783142600.752634 mapwrite 0x018a11 thru 0x01d18a (0x477a bytes) 000866 1783142600.844202 trunc from 0x01d18b to 0x0047e0 (0x189aa bytes) 000868 1783142600.867509 write 0x026eae thru 0x02d28b (0x63de bytes) 000869 1783142600.879030 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2d28c): Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d28c): Mirror 10: 0xcf511367 (stale) Mirror 15: 0xcf511367 (stale) Mirror 21: 0xcf511367 (stale) Mirror 22: 0xcf511367 (stale) Mirror 25: 0xcf511367 (stale) Mirror 30: 0xcf511367 (stale) Mirror 31: 0xcf511367 (stale) Mirror 32: 0xcf511367 (stale) Mirror 33: 0xcf511367 (stale) Mirror 34: 0xcf511367 (stale) Mirror 35: 0xcf511367 (stale) Mirror 36: 0xcf511367 (stale) Mirror 37: 0xcf511367 (stale) CRC-32 checksum value for chunk [0, 0x2d28c): Mirror 1: 0xe3e62140 Mirror 38: 0xe3e62140 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d28c: skipped 000870 1783142601.908154 read 0x01372b thru 0x020771 (0xd047 bytes) 000871 1783142601.926636 mapread 0x0100bd thru 0x014fc9 (0x4f0d bytes) 000872 1783142601.966224 read 0x00f79b thru 0x013ca1 (0x4507 bytes) 000875 1783142601.992675 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2d28c): Mirror 10: (stale - read error) Mirror 15: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d28c): Mirror 10: 0xcf511367 (stale) Mirror 15: 0xcf511367 (stale) Mirror 21: 0xcf511367 (stale) Mirror 22: 0xcf511367 (stale) Mirror 25: 0xcf511367 (stale) Mirror 30: 0xcf511367 (stale) Mirror 31: 0xcf511367 (stale) Mirror 32: 0xcf511367 (stale) Mirror 33: 0xcf511367 (stale) Mirror 34: 0xcf511367 (stale) Mirror 35: 0xcf511367 (stale) Mirror 36: 0xcf511367 (stale) Mirror 37: 0xcf511367 (stale) CRC-32 checksum value for chunk [0, 0x2d28c): Mirror 1: 0xe3e62140 Mirror 38: 0xe3e62140 Mirror 39: 0xe3e62140 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d28c: skipped 000878 1783142602.957961 mapread 0x009079 thru 0x00cc85 (0x3c0d bytes) truncating to largest ever: 0x3fb62 000880 1783142602.993823 trunc from 0x02d28c to 0x03fb61 (0x128d6 bytes) 000881 1783142603.137618 MIRROR_RESYNC 16 mirrors 000882 1783142604.986327 write 0x01b74e thru 0x01c650 (0xf03 bytes) 000887 1783142605.053255 read 0x00e11a thru 0x0124a3 (0x438a bytes) 000888 1783142605.060979 mapwrite 0x000f92 thru 0x00d784 (0xc7f3 bytes) 000890 1783142605.127547 mapwrite 0x01bbc3 thru 0x027322 (0xb760 bytes) 000891 1783142605.180871 mapread 0x033f7f thru 0x03ba76 (0x7af8 bytes) 000892 1783142605.192341 trunc from 0x03fb62 to 0x007591 (0x385d0 bytes) 000894 1783142605.215347 mapread 0x003c10 thru 0x007591 (0x3982 bytes) 000896 1783142605.218577 mapread 0x005616 thru 0x006261 (0xc4c bytes) 000897 1783142605.225570 MIRROR_RESYNC 16 mirrors 000899 1783142606.946097 read 0x004363 thru 0x00582e (0x14cc bytes) 000900 1783142606.950596 mapwrite 0x013bd0 thru 0x014d05 (0x1136 bytes) 000901 1783142607.071594 mapread 0x00a69b thru 0x0146c1 (0xa027 bytes) 000902 1783142607.080369 mapread 0x00c481 thru 0x012eb9 (0x6a39 bytes) 000904 1783142607.083233 mapwrite 0x02939a thru 0x037b2b (0xe792 bytes) 000905 1783142607.189850 write 0x010487 thru 0x0152d5 (0x4e4f bytes) 000906 1783142607.200106 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37b2c): Mirror 15: 0xb7c1d98c (stale) Mirror 21: 0xb7c1d98c (stale) Mirror 22: 0xb7c1d98c (stale) Mirror 25: 0xb7c1d98c (stale) Mirror 30: 0xb7c1d98c (stale) Mirror 31: 0xb7c1d98c (stale) Mirror 32: 0xb7c1d98c (stale) Mirror 33: 0xb7c1d98c (stale) Mirror 34: 0xb7c1d98c (stale) Mirror 35: 0xb7c1d98c (stale) Mirror 36: 0xb7c1d98c (stale) Mirror 37: 0xb7c1d98c (stale) Mirror 38: 0xb7c1d98c (stale) Mirror 39: 0xb7c1d98c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37b2c): Mirror 15: 0xb7c1d98c (stale) Mirror 21: 0xb7c1d98c (stale) Mirror 22: 0xb7c1d98c (stale) Mirror 25: 0xb7c1d98c (stale) Mirror 30: 0xb7c1d98c (stale) Mirror 31: 0xb7c1d98c (stale) Mirror 32: 0xb7c1d98c (stale) Mirror 33: 0xb7c1d98c (stale) Mirror 34: 0xb7c1d98c (stale) Mirror 35: 0xb7c1d98c (stale) Mirror 36: 0xb7c1d98c (stale) Mirror 37: 0xb7c1d98c (stale) Mirror 38: 0xb7c1d98c (stale) Mirror 39: 0xb7c1d98c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37b2c: skipped 000907 1783142607.828054 mapwrite 0x01840e thru 0x01f63c (0x722f bytes) 000911 1783142607.880539 mapwrite 0x006ef5 thru 0x00f7b9 (0x88c5 bytes) 000913 1783142607.947692 trunc from 0x037b2c to 0x00b2d5 (0x2c856 bytes) 000916 1783142607.960126 write 0x02d16a thru 0x03b084 (0xdf1b bytes) 000917 1783142607.962349 read 0x01dc65 thru 0x02b37e (0xd71a bytes) truncating to largest ever: 0x3fbb7 000918 1783142607.969597 trunc from 0x03b085 to 0x03fbb6 (0x4b32 bytes) 000920 1783142607.987540 read 0x039944 thru 0x03b3f6 (0x1ab3 bytes) 000923 1783142607.990106 mapread 0x031735 thru 0x03c048 (0xa914 bytes) 000924 1783142607.998116 mapwrite 0x01bab9 thru 0x0216e6 (0x5c2e bytes) 000925 1783142608.035644 read 0x022384 thru 0x03052d (0xe1aa bytes) 000926 1783142608.038340 mapwrite 0x03eea6 thru 0x03ffff (0x115a bytes) 000927 1783142608.090008 write 0x01d782 thru 0x01e75f (0xfde bytes) 000928 1783142608.092169 write 0x02d643 thru 0x03528a (0x7c48 bytes) 000929 1783142608.093741 mapread 0x011081 thru 0x01ccae (0xbc2e bytes) 000930 1783142608.096630 write 0x02ecfb thru 0x0363dc (0x76e2 bytes) 000931 1783142608.098617 write 0x014ba2 thru 0x01f357 (0xa7b6 bytes) 000932 1783142608.110699 MIRROR_SPLIT mirror 12 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x5ff59833 (stale) Mirror 21: 0x5ff59833 (stale) Mirror 22: 0x5ff59833 (stale) Mirror 25: 0x5ff59833 (stale) Mirror 30: 0x5ff59833 (stale) Mirror 31: 0x5ff59833 (stale) Mirror 32: 0x5ff59833 (stale) Mirror 33: 0x5ff59833 (stale) Mirror 34: 0x5ff59833 (stale) Mirror 35: 0x5ff59833 (stale) Mirror 36: 0x5ff59833 (stale) Mirror 38: 0x5ff59833 (stale) Mirror 39: 0x5ff59833 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x5ff59833 (stale) Mirror 21: 0x5ff59833 (stale) Mirror 22: 0x5ff59833 (stale) Mirror 25: 0x5ff59833 (stale) Mirror 30: 0x5ff59833 (stale) Mirror 31: 0x5ff59833 (stale) Mirror 32: 0x5ff59833 (stale) Mirror 33: 0x5ff59833 (stale) Mirror 34: 0x5ff59833 (stale) Mirror 35: 0x5ff59833 (stale) Mirror 36: 0x5ff59833 (stale) Mirror 38: 0x5ff59833 (stale) Mirror 39: 0x5ff59833 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000933 1783142608.611293 mapwrite 0x003fab thru 0x0129cb (0xea21 bytes) 000934 1783142608.687155 write 0x014ae7 thru 0x01913e (0x4658 bytes) 000935 1783142608.689200 trunc from 0x040000 to 0x017c3a (0x283c5 bytes) 000936 1783142608.707498 read 0x0128d4 thru 0x017c3a (0x5367 bytes) 000937 1783142608.708362 trunc from 0x017c3b to 0x02e147 (0x1650d bytes) 000938 1783142608.721782 write 0x036b59 thru 0x03ffff (0x94a7 bytes) 000940 1783142608.724040 read 0x00ea7f thru 0x01924c (0xa7ce bytes) 000941 1783142608.734866 trunc from 0x040000 to 0x030941 (0xf6be bytes) 000942 1783142608.750787 read 0x02dcc9 thru 0x030941 (0x2c79 bytes) 000945 1783142608.754413 read 0x0122d5 thru 0x0167bc (0x44e8 bytes) 000947 1783142608.761681 MIRROR_RESYNC 14 mirrors 000948 1783142610.368946 trunc from 0x030942 to 0x028756 (0x81eb bytes) 000950 1783142610.451601 trunc from 0x028757 to 0x0174ab (0x112ab bytes) 000951 1783142610.479447 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x174ac): Mirror 15: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 38: (stale - read error) Mirror 39: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x174ac): Mirror 15: 0xe25e514c (stale) Mirror 21: 0xe25e514c (stale) Mirror 22: 0xe25e514c (stale) Mirror 25: 0xe25e514c (stale) Mirror 30: 0xe25e514c (stale) Mirror 31: 0xe25e514c (stale) Mirror 32: 0xe25e514c (stale) Mirror 33: 0xe25e514c (stale) Mirror 34: 0xe25e514c (stale) Mirror 35: 0xe25e514c (stale) Mirror 36: 0xe25e514c (stale) Mirror 38: 0xe25e514c (stale) Mirror 39: 0xe25e514c (stale) CRC-32 checksum value for chunk [0, 0x174ac): Mirror 1: 0xe25e514c Mirror 40: 0xe25e514c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x174ac: skipped 000952 1783142611.379100 trunc from 0x0174ac to 0x03340f (0x1bf64 bytes) 000954 1783142611.499620 mapread 0x023747 thru 0x027c47 (0x4501 bytes) 000955 1783142611.527568 mapwrite 0x0353f6 thru 0x03cd8e (0x7999 bytes) 000956 1783142611.630628 mapread 0x02d94e thru 0x033e1a (0x64cd bytes) 000959 1783142611.636160 mapread 0x031cbe thru 0x03bd01 (0xa044 bytes) 000964 1783142611.639616 trunc from 0x03cd8f to 0x036827 (0x6567 bytes) 000966 1783142611.658307 read 0x036150 thru 0x036827 (0x6d8 bytes) 000968 1783142611.660050 read 0x02945b thru 0x02e9e3 (0x5589 bytes) 000969 1783142611.662092 write 0x0030eb thru 0x00cf4a (0x9e60 bytes) 000972 1783142611.676200 mapwrite 0x03d4b7 thru 0x03ffff (0x2b49 bytes) 000973 1783142611.743655 mapread 0x039974 thru 0x03ffff (0x668c bytes) 000974 1783142611.745186 mapread 0x02f4d8 thru 0x03ab5e (0xb687 bytes) 000976 1783142611.747674 read 0x00acd3 thru 0x00d559 (0x2887 bytes) 000978 1783142611.749290 mapwrite 0x025d5c thru 0x02adbd (0x5062 bytes) 000979 1783142611.788874 MIRROR_SPLIT mirror 13 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x22b24aa4 (stale) Mirror 21: 0x22b24aa4 (stale) Mirror 22: 0x22b24aa4 (stale) Mirror 25: 0x22b24aa4 (stale) Mirror 30: 0x22b24aa4 (stale) Mirror 31: 0x22b24aa4 (stale) Mirror 32: 0x22b24aa4 (stale) Mirror 33: 0x22b24aa4 (stale) Mirror 34: 0x22b24aa4 (stale) Mirror 35: 0x22b24aa4 (stale) Mirror 36: 0x22b24aa4 (stale) Mirror 38: 0x22b24aa4 (stale) Mirror 40: 0xd6030a28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x22b24aa4 (stale) Mirror 21: 0x22b24aa4 (stale) Mirror 22: 0x22b24aa4 (stale) Mirror 25: 0x22b24aa4 (stale) Mirror 30: 0x22b24aa4 (stale) Mirror 31: 0x22b24aa4 (stale) Mirror 32: 0x22b24aa4 (stale) Mirror 33: 0x22b24aa4 (stale) Mirror 34: 0x22b24aa4 (stale) Mirror 35: 0x22b24aa4 (stale) Mirror 36: 0x22b24aa4 (stale) Mirror 38: 0x22b24aa4 (stale) Mirror 40: 0xd6030a28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000981 1783142612.417811 mapwrite 0x018a6f thru 0x024d75 (0xc307 bytes) 000982 1783142612.497713 mapread 0x0255ae thru 0x026de5 (0x1838 bytes) 000983 1783142612.502428 mapwrite 0x039fc8 thru 0x03a74a (0x783 bytes) 000984 1783142612.580719 trunc from 0x040000 to 0x00873a (0x378c5 bytes) 000985 1783142612.604655 mapwrite 0x02668b thru 0x031bb6 (0xb52c bytes) 000987 1783142612.719858 MIRROR_RESYNC 14 mirrors 000989 1783142614.370246 trunc from 0x031bb7 to 0x00da49 (0x2416d bytes) 000991 1783142614.470905 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x226:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xda4a): Mirror 15: 0xa290170c (stale) Mirror 21: 0xa290170c (stale) Mirror 25: 0xa290170c (stale) Mirror 30: 0xa290170c (stale) Mirror 31: 0xa290170c (stale) Mirror 32: 0xa290170c (stale) Mirror 33: 0xa290170c (stale) Mirror 34: 0xa290170c (stale) Mirror 35: 0xa290170c (stale) Mirror 36: 0xa290170c (stale) Mirror 38: 0xa290170c (stale) Mirror 40: 0xa290170c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xda4a): Mirror 15: 0xa290170c (stale) Mirror 21: 0xa290170c (stale) Mirror 25: 0xa290170c (stale) Mirror 30: 0xa290170c (stale) Mirror 31: 0xa290170c (stale) Mirror 32: 0xa290170c (stale) Mirror 33: 0xa290170c (stale) Mirror 34: 0xa290170c (stale) Mirror 35: 0xa290170c (stale) Mirror 36: 0xa290170c (stale) Mirror 38: 0xa290170c (stale) Mirror 40: 0xa290170c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xda4a: skipped 000992 1783142615.012702 write 0x037b8e thru 0x03e95a (0x6dcd bytes) 000994 1783142615.017584 MIRROR_RESYNC 13 mirrors 000997 1783142616.520778 mapwrite 0x02a92c thru 0x0357d9 (0xaeae bytes) 000998 1783142616.671835 mapread 0x00eee9 thru 0x01649f (0x75b7 bytes) 000999 1783142616.679769 trunc from 0x03e95b to 0x0338a0 (0xb0ba bytes) 001000 1783142616.699877 mapread 0x003d83 thru 0x00efa3 (0xb221 bytes) All operations completed A-OK!