== sanity-flr test 70a: flr mode fsx test ================ 13:46:38 (1788803198) Seed set to 3200 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero length punch hole skipping zero size read 000003 1788803200.775888 MIRROR_EXTEND to 2 mirrors 000006 1788803201.380674 MIRROR_RESYNC 2 mirrors 000007 1788803201.546972 write 0x0079b9 thru 0x016fca (0xf612 bytes) 000008 1788803201.595623 mapwrite 0x022291 thru 0x026666 (0x43d6 bytes) 000011 1788803201.741952 read 0x009714 thru 0x01393b (0xa228 bytes) 000013 1788803201.743895 punch from 0x00dbf0 to 0x019ccd (0xc0de bytes) 000014 1788803201.751099 punch from 0x0144e9 to 0x01aeaa (0x69c2 bytes) 000015 1788803201.756959 read 0x00c298 thru 0x0182a2 (0xc00b bytes) 000016 1788803201.777794 read 0x012c38 thru 0x0169a0 (0x3d69 bytes) 000017 1788803201.778813 write 0x030227 thru 0x03be3b (0xbc15 bytes) 000018 1788803201.781639 punch from 0x00795b to 0x00f41c (0x7ac2 bytes) 000019 1788803201.809989 read 0x00ea70 thru 0x01bf60 (0xd4f1 bytes) 000021 1788803201.828708 write 0x035951 thru 0x0397cd (0x3e7d bytes) truncating to largest ever: 0x2ca01 000022 1788803201.830729 trunc from 0x03be3c to 0x02ca00 (0xf43b bytes) truncating to largest ever: 0x3be02 000023 1788803201.866011 trunc from 0x02ca01 to 0x03be01 (0xf401 bytes) 000026 1788803201.900636 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3be02): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3be02): Mirror 2: 0xce258665 (stale) CRC-32 checksum value for chunk [0, 0x3be02): Mirror 1: 0xd0fff98f Mirror 3: 0xd0fff98f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3be02: skipped 000027 1788803203.153054 write 0x019ff9 thru 0x020bb9 (0x6bc1 bytes) 000028 1788803203.230990 read 0x032d67 thru 0x03371a (0x9b4 bytes) 000029 1788803203.237014 mapread 0x0195e6 thru 0x01e94a (0x5365 bytes) 000030 1788803203.238028 read 0x0287fd thru 0x02d354 (0x4b58 bytes) 000033 1788803203.261132 mapread 0x00c01c thru 0x01bef4 (0xfed9 bytes) 000034 1788803203.263141 punch from 0x0307c7 to 0x03b525 (0xad5f bytes) 000035 1788803203.277971 read 0x035d47 thru 0x03be01 (0x60bb bytes) 000036 1788803203.289510 trunc from 0x03be02 to 0x000e9c (0x3af65 bytes) 000037 1788803203.307502 mapread 0x0005a7 thru 0x000e9c (0x8f6 bytes) 000039 1788803203.311041 mapread 0x000e3d thru 0x000e9c (0x60 bytes) 000040 1788803203.312311 mapread 0x0008be thru 0x000e9c (0x5df bytes) 000041 1788803203.314518 mapwrite 0x020eb7 thru 0x021c4c (0xd96 bytes) 000043 1788803203.382740 write 0x02119c thru 0x028de7 (0x7c4c bytes) 000044 1788803203.384983 mapread 0x001cc9 thru 0x00896c (0x6ca4 bytes) 000045 1788803203.433698 punch from 0x002610 to 0x008187 (0x5b78 bytes) 000047 1788803203.453675 mapread 0x019ac0 thru 0x01c2c1 (0x2802 bytes) 000048 1788803203.477103 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x28de8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28de8): Mirror 2: 0x5a56af40 (stale) Mirror 3: 0xab729905 (stale) CRC-32 checksum value for chunk [0, 0x28de8): Mirror 1: 0x3c45bf51 Mirror 4: 0x3c45bf51 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28de8: skipped 000050 1788803204.636175 read 0x014052 thru 0x014312 (0x2c1 bytes) 000051 1788803204.649111 mapwrite 0x02d7dc thru 0x037ce2 (0xa507 bytes) 000052 1788803204.928683 punch from 0x01e74f to 0x024d3e (0x65f0 bytes) 000053 1788803204.933731 read 0x02d471 thru 0x034bd4 (0x7764 bytes) 000054 1788803204.934839 mapwrite 0x0035ef thru 0x00fd64 (0xc776 bytes) 000055 1788803204.985812 mapread 0x01975a thru 0x02218f (0x8a36 bytes) 000056 1788803204.987299 mapwrite 0x008245 thru 0x00b4d5 (0x3291 bytes) 000057 1788803205.029561 mapwrite 0x03a8b2 thru 0x03ffff (0x574e bytes) 000058 1788803205.119801 punch from 0x01d256 to 0x02659a (0x9345 bytes) 000059 1788803205.136716 punch from 0x017968 to 0x01fce5 (0x837e bytes) 000060 1788803205.146262 mapread 0x0387d9 thru 0x03ffff (0x7827 bytes) 000061 1788803205.148062 punch from 0x014cd9 to 0x023ef5 (0xf21d bytes) 000063 1788803205.160355 mapwrite 0x003800 thru 0x007afb (0x42fc bytes) 000064 1788803205.299094 write 0x002dcd thru 0x0051e3 (0x2417 bytes) 000067 1788803205.301026 mapread 0x02c35a thru 0x038640 (0xc2e7 bytes) 000068 1788803205.304820 mapwrite 0x014961 thru 0x020676 (0xbd16 bytes) 000069 1788803205.638462 trunc from 0x040000 to 0x028148 (0x17eb7 bytes) 000070 1788803205.661029 punch from 0x007c7d to 0x011dea (0xa16e bytes) 000071 1788803205.667949 read 0x00fbee thru 0x01621d (0x6630 bytes) 000072 1788803205.676859 trunc from 0x028149 to 0x035cae (0xdb66 bytes) 000074 1788803205.694777 read 0x02ca79 thru 0x035cae (0x9236 bytes) 000075 1788803205.714276 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35caf): Mirror 3: 0x6ad30e7e (stale) Mirror 4: 0x9c699fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35caf): Mirror 3: 0x6ad30e7e (stale) Mirror 4: 0x9c699fb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35caf: skipped 000076 1788803206.021295 write 0x03dbef thru 0x03fe5f (0x2271 bytes) 000077 1788803206.028014 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3fe60): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe60): Mirror 3: 0x832e49c5 (stale) Mirror 4: 0x77383990 (stale) CRC-32 checksum value for chunk [0, 0x3fe60): Mirror 1: 0xb1e099bc Mirror 5: 0xb1e099bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe60: skipped 000078 1788803207.112554 mapread 0x02818c thru 0x02d070 (0x4ee5 bytes) 000080 1788803207.165946 trunc from 0x03fe60 to 0x0158c9 (0x2a596 bytes) 000081 1788803207.277411 read 0x00a96c thru 0x0158c9 (0xaf5e bytes) 000082 1788803207.292778 punch from 0x00f14a to 0x0158c9 (0x6780 bytes) 000083 1788803207.298866 mapread 0x00eb86 thru 0x0158c9 (0x6d44 bytes) 000084 1788803207.310181 read 0x0078fc thru 0x013c4d (0xc352 bytes) 000085 1788803207.320463 read 0x004947 thru 0x00f468 (0xab22 bytes) 000089 1788803207.324902 trunc from 0x0158ca to 0x000cb3 (0x14c16 bytes) 000090 1788803207.350075 write 0x010443 thru 0x0166b9 (0x6277 bytes) 000091 1788803207.358430 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x166ba): Mirror 4: 0xdcafc286 (stale) Mirror 5: 0x5ad9964c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x166ba): Mirror 4: 0xdcafc286 (stale) Mirror 5: 0x5ad9964c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x166ba: skipped 000094 1788803207.814012 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x166ba): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x166ba): Mirror 4: 0xdcafc286 (stale) Mirror 5: 0x5ad9964c (stale) CRC-32 checksum value for chunk [0, 0x166ba): Mirror 1: 0x7eaa3c2c Mirror 6: 0x7eaa3c2c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x166ba: skipped 000095 1788803209.091549 MIRROR_RESYNC 4 mirrors 000096 1788803209.983801 mapwrite 0x0228bf thru 0x027c21 (0x5363 bytes) 000097 1788803210.242565 trunc from 0x027c22 to 0x027967 (0x2ba bytes) 000098 1788803210.277436 write 0x011b80 thru 0x0135e4 (0x1a65 bytes) 000099 1788803210.293992 write 0x00b2db thru 0x018e1e (0xdb44 bytes) 000101 1788803210.315415 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27968): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27968): Mirror 4: 0x9fa7d6f2 (stale) Mirror 5: 0x9fa7d6f2 (stale) Mirror 6: 0x9fa7d6f2 (stale) CRC-32 checksum value for chunk [0, 0x27968): Mirror 1: 0x5cfa022c Mirror 7: 0x5cfa022c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27968: skipped 000103 1788803211.587923 read 0x01bd42 thru 0x02075d (0x4a1c bytes) 000104 1788803211.610750 write 0x0295a4 thru 0x038604 (0xf061 bytes) truncating to largest ever: 0x3ec2d 000107 1788803211.688499 trunc from 0x038605 to 0x03ec2c (0x6628 bytes) 000108 1788803211.719824 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ec2d): Mirror 4: 0x239bc4ed (stale) Mirror 6: 0x239bc4ed (stale) Mirror 7: 0xa97b0ae2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec2d): Mirror 4: 0x239bc4ed (stale) Mirror 6: 0x239bc4ed (stale) Mirror 7: 0xa97b0ae2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec2d: skipped 000109 1788803212.172501 punch from 0x004640 to 0x0102ed (0xbcae bytes) 000110 1788803212.179549 punch from 0x016ecf to 0x01ccf5 (0x5e27 bytes) 000111 1788803212.202546 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ec2d): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec2d): Mirror 4: 0x239bc4ed (stale) Mirror 6: 0x239bc4ed (stale) Mirror 7: 0xa97b0ae2 (stale) CRC-32 checksum value for chunk [0, 0x3ec2d): Mirror 1: 0x137ac6d9 Mirror 8: 0x137ac6d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec2d: skipped 000114 1788803213.180968 mapwrite 0x021e74 thru 0x02bf87 (0xa114 bytes) 000115 1788803213.446985 trunc from 0x03ec2d to 0x020235 (0x1e9f7 bytes) 000116 1788803213.500821 MIRROR_RESYNC 5 mirrors 000117 1788803214.709939 mapread 0x0160ef thru 0x020235 (0xa147 bytes) 000118 1788803214.758313 write 0x03db64 thru 0x03eb42 (0xfdf bytes) 000119 1788803214.822710 punch from 0x01c24f to 0x02b6f1 (0xf4a3 bytes) 000120 1788803214.838003 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3eb43): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb43): Mirror 4: 0xbbd8d715 (stale) Mirror 6: 0xbbd8d715 (stale) Mirror 7: 0xbbd8d715 (stale) Mirror 8: 0xbbd8d715 (stale) CRC-32 checksum value for chunk [0, 0x3eb43): Mirror 1: 0xcf8d6db5 Mirror 9: 0xcf8d6db5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb43: skipped 000121 1788803215.902924 trunc from 0x03eb43 to 0x003955 (0x3b1ed bytes) 000123 1788803216.013585 trunc from 0x003956 to 0x01b741 (0x17dec bytes) 000124 1788803216.042618 mapread 0x002f04 thru 0x0057b8 (0x28b5 bytes) 000125 1788803216.067730 trunc from 0x01b742 to 0x00ecb0 (0xca91 bytes) 000126 1788803216.090924 mapread 0x00d398 thru 0x00ecb0 (0x1919 bytes) 000127 1788803216.094797 trunc from 0x00ecb1 to 0x027f47 (0x19297 bytes) 000128 1788803216.117483 punch from 0x00cc3a to 0x00ea6f (0x1e36 bytes) 000129 1788803216.124042 mapread 0x026eed thru 0x027f47 (0x105b bytes) 000130 1788803216.149591 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27f48): Mirror 6: 0x94d4787d (stale) Mirror 7: 0x94d4787d (stale) Mirror 8: 0x94d4787d (stale) Mirror 9: 0x94d4787d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27f48): Mirror 6: 0x94d4787d (stale) Mirror 7: 0x94d4787d (stale) Mirror 8: 0x94d4787d (stale) Mirror 9: 0x94d4787d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27f48: skipped 000132 1788803216.549919 write 0x037ab4 thru 0x0394fb (0x1a48 bytes) 000133 1788803216.552555 punch from 0x013c82 to 0x0185e0 (0x495f bytes) 000135 1788803216.568234 read 0x0222ca thru 0x02ef9d (0xccd4 bytes) 000137 1788803216.586244 mapwrite 0x01d4fa thru 0x01efe6 (0x1aed bytes) 000138 1788803216.668639 mapread 0x0292b4 thru 0x038784 (0xf4d1 bytes) 000139 1788803216.687476 mapwrite 0x0117e1 thru 0x018036 (0x6856 bytes) 000140 1788803216.769971 trunc from 0x0394fc to 0x03a28c (0xd91 bytes) 000141 1788803216.794137 write 0x021343 thru 0x02d305 (0xbfc3 bytes) 000142 1788803216.801183 read 0x00bcab thru 0x011e17 (0x616d bytes) 000144 1788803216.802359 mapwrite 0x02d2a9 thru 0x03139b (0x40f3 bytes) 000145 1788803216.867791 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a28d): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a28d): Mirror 6: 0xd7a580d0 (stale) Mirror 7: 0xd7a580d0 (stale) Mirror 8: 0xd7a580d0 (stale) Mirror 9: 0xd7a580d0 (stale) CRC-32 checksum value for chunk [0, 0x3a28d): Mirror 1: 0x1f02d362 Mirror 10: 0x1f02d362 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a28d: skipped 000146 1788803217.836136 write 0x027f07 thru 0x02c4b3 (0x45ad bytes) 000147 1788803217.929851 read 0x0367d8 thru 0x03a28c (0x3ab5 bytes) 000149 1788803217.952051 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a28d): Mirror 6: 0xd7a580d0 (stale) Mirror 7: 0xd7a580d0 (stale) Mirror 8: 0xd7a580d0 (stale) Mirror 9: 0xd7a580d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a28d): Mirror 6: 0xd7a580d0 (stale) Mirror 7: 0xd7a580d0 (stale) Mirror 8: 0xd7a580d0 (stale) Mirror 9: 0xd7a580d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a28d: skipped 000152 1788803218.384481 read 0x01d82b thru 0x0234ab (0x5c81 bytes) 000153 1788803218.396860 write 0x02cf1c thru 0x031d44 (0x4e29 bytes) 000155 1788803218.408276 trunc from 0x03a28d to 0x012a08 (0x27884 bytes) 000157 1788803218.428104 read 0x00417b thru 0x006d12 (0x2b98 bytes) 000158 1788803218.440996 mapread 0x0126d1 thru 0x012a08 (0x338 bytes) 000159 1788803218.442964 write 0x0182e4 thru 0x0208dc (0x85f9 bytes) 000163 1788803218.446456 mapread 0x014466 thru 0x0208dc (0xc477 bytes) 000164 1788803218.459754 mapread 0x00ae6d thru 0x00cf6c (0x2100 bytes) 000168 1788803218.464913 mapread 0x002a56 thru 0x003317 (0x8c2 bytes) 000169 1788803218.467723 mapread 0x01243e thru 0x014c6d (0x2830 bytes) 000170 1788803218.469069 read 0x01037b thru 0x0134da (0x3160 bytes) 000171 1788803218.472105 read 0x004cde thru 0x008742 (0x3a65 bytes) 000172 1788803218.473106 punch from 0x004d22 to 0x00d5a9 (0x8888 bytes) 000173 1788803218.497848 MIRROR_RESYNC 5 mirrors 000175 1788803219.725896 mapwrite 0x00a46f thru 0x01808a (0xdc1c bytes) 000177 1788803219.908974 mapwrite 0x01284f thru 0x0166e7 (0x3e99 bytes) 000179 1788803219.997410 punch from 0x01e2d2 to 0x0208dc (0x260b bytes) 000180 1788803220.005853 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x208dd): Mirror 6: 0x4d07b932 (stale) Mirror 7: 0x4d07b932 (stale) Mirror 8: 0x4d07b932 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x208dd): Mirror 6: 0x4d07b932 (stale) Mirror 7: 0x4d07b932 (stale) Mirror 8: 0x4d07b932 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x208dd: skipped 000181 1788803220.424887 read 0x0196dc thru 0x01979b (0xc0 bytes) 000182 1788803220.436294 read 0x013522 thru 0x0208dc (0xd3bb bytes) 000183 1788803220.461009 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x208dd): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x208dd): Mirror 6: 0x4d07b932 (stale) Mirror 7: 0x4d07b932 (stale) Mirror 8: 0x4d07b932 (stale) CRC-32 checksum value for chunk [0, 0x208dd): Mirror 1: 0xa1dd66df Mirror 9: 0xa1dd66df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x208dd: skipped 000184 1788803221.776971 punch from 0x0019e6 to 0x00b6c8 (0x9ce3 bytes) 000185 1788803221.846250 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x208dd): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x208dd): Mirror 6: 0x4d07b932 (stale) Mirror 7: 0x4d07b932 (stale) Mirror 8: 0x4d07b932 (stale) Mirror 9: 0xa1dd66df (stale) CRC-32 checksum value for chunk [0, 0x208dd): Mirror 1: 0x494ecda1 Mirror 10: 0x494ecda1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x208dd: skipped 000186 1788803222.963855 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x208dd): Mirror 7: 0x4d07b932 (stale) Mirror 8: 0x4d07b932 (stale) Mirror 9: 0xa1dd66df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x208dd): Mirror 7: 0x4d07b932 (stale) Mirror 8: 0x4d07b932 (stale) Mirror 9: 0xa1dd66df (stale) CRC-32 checksum value for chunk [0, 0x208dd): Mirror 1: 0x494ecda1 Mirror 10: 0x494ecda1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x208dd: skipped 000188 1788803223.568598 mapwrite 0x03619d thru 0x03ffff (0x9e63 bytes) 000189 1788803223.741180 mapwrite 0x002b4b thru 0x00f274 (0xc72a bytes) 000190 1788803223.795662 mapwrite 0x01ef21 thru 0x02d061 (0xe141 bytes) 000191 1788803223.867968 trunc from 0x040000 to 0x026ff0 (0x1900f bytes) 000192 1788803223.897116 read 0x01ec9a thru 0x026ff0 (0x8357 bytes) 000193 1788803223.902743 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x26ff1): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26ff1): Mirror 7: 0xef6d1789 (stale) Mirror 8: 0xef6d1789 (stale) Mirror 9: 0xb01a404 (stale) Mirror 10: 0x487ff1b (stale) CRC-32 checksum value for chunk [0, 0x26ff1): Mirror 1: 0x5f9194b9 Mirror 11: 0x5f9194b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26ff1: skipped 000194 1788803224.833814 write 0x01f7f6 thru 0x022a69 (0x3274 bytes) 000195 1788803224.961960 trunc from 0x026ff1 to 0x01872e (0xe8c2 bytes) 000196 1788803224.992932 trunc from 0x01872f to 0x02d8f1 (0x151c3 bytes) 000198 1788803225.010523 trunc from 0x02d8f2 to 0x02b01a (0x28d7 bytes) 000201 1788803225.030762 write 0x026a10 thru 0x028459 (0x1a4a bytes) 000202 1788803225.044665 read 0x024930 thru 0x02b01a (0x66eb bytes) 000204 1788803225.057344 punch from 0x027d31 to 0x02b01a (0x32ea bytes) 000205 1788803225.067839 mapread 0x0278f3 thru 0x02b01a (0x3728 bytes) 000206 1788803225.085773 trunc from 0x02b01b to 0x019faa (0x11070 bytes) 000209 1788803225.116066 MIRROR_RESYNC 6 mirrors 000210 1788803226.266653 punch from 0x015436 to 0x019faa (0x4b75 bytes) 000211 1788803226.368773 write 0x00a6e3 thru 0x01a3b8 (0xfcd6 bytes) 000212 1788803226.376727 mapread 0x012dc3 thru 0x01933c (0x657a bytes) 000213 1788803226.377800 mapread 0x01a087 thru 0x01a3b8 (0x332 bytes) 000214 1788803226.384910 MIRROR_RESYNC 6 mirrors 000215 1788803227.987387 mapwrite 0x01846b thru 0x026727 (0xe2bd bytes) 000216 1788803228.253869 mapwrite 0x033767 thru 0x0351b9 (0x1a53 bytes) 000217 1788803228.360714 mapwrite 0x03758b thru 0x0387ff (0x1275 bytes) 000218 1788803228.430803 mapread 0x001a4b thru 0x00c9cf (0xaf85 bytes) 000220 1788803228.445795 read 0x004e9c thru 0x005c5c (0xdc1 bytes) 000221 1788803228.446485 trunc from 0x038800 to 0x02a4b0 (0xe34f bytes) 000222 1788803228.464954 mapread 0x0029a0 thru 0x00fee9 (0xd54a bytes) 000223 1788803228.466818 write 0x019f21 thru 0x01c9aa (0x2a8a bytes) 000224 1788803228.468761 mapwrite 0x03bf7f thru 0x03ffff (0x4081 bytes) 000225 1788803228.574459 write 0x023266 thru 0x032ce7 (0xfa82 bytes) 000226 1788803228.581914 trunc from 0x040000 to 0x032980 (0xd67f bytes) 000227 1788803228.606869 MIRROR_RESYNC 6 mirrors 000228 1788803229.710010 punch from 0x02f945 to 0x032980 (0x303c bytes) 000229 1788803229.764880 punch from 0x02f2fc to 0x032980 (0x3685 bytes) 000230 1788803229.776582 MIRROR_RESYNC 6 mirrors 000231 1788803231.511112 punch from 0x016f68 to 0x01aee4 (0x3f7d bytes) 000232 1788803231.605113 punch from 0x02e6f4 to 0x032980 (0x428d bytes) 000236 1788803231.614308 trunc from 0x032981 to 0x03045a (0x2526 bytes) 000237 1788803231.657664 trunc from 0x03045b to 0x01b919 (0x14b41 bytes) 000238 1788803231.680142 trunc from 0x01b91a to 0x03c252 (0x20939 bytes) 000239 1788803231.713405 write 0x00e3cc thru 0x00fbb5 (0x17ea bytes) 000241 1788803231.755542 read 0x028ef3 thru 0x02cfd2 (0x40e0 bytes) 000243 1788803231.779582 MIRROR_RESYNC 6 mirrors 000244 1788803233.379774 mapread 0x014ea1 thru 0x01573e (0x89e bytes) 000246 1788803233.394798 mapwrite 0x018f40 thru 0x01ed1d (0x5dde bytes) 000247 1788803233.559638 write 0x022d13 thru 0x0239b3 (0xca1 bytes) 000248 1788803233.570058 write 0x002852 thru 0x003641 (0xdf0 bytes) 000249 1788803233.580435 mapread 0x018149 thru 0x02784a (0xf702 bytes) 000250 1788803233.599735 mapread 0x02c678 thru 0x032677 (0x6000 bytes) 000252 1788803233.612792 read 0x03a280 thru 0x03c252 (0x1fd3 bytes) 000253 1788803233.618595 read 0x01c0d7 thru 0x01f239 (0x3163 bytes) 000254 1788803233.619359 mapwrite 0x0256ed thru 0x02fac9 (0xa3dd bytes) 000255 1788803233.696129 mapread 0x00b328 thru 0x00dd12 (0x29eb bytes) 000256 1788803233.720695 MIRROR_RESYNC 6 mirrors 000259 1788803235.234568 MIRROR_RESYNC 6 mirrors 000261 1788803235.848372 punch from 0x00c0da to 0x00c501 (0x428 bytes) 000263 1788803236.002866 write 0x0073dc thru 0x015d47 (0xe96c bytes) 000264 1788803236.014319 punch from 0x016b37 to 0x01893c (0x1e06 bytes) 000267 1788803236.027432 read 0x00bb73 thru 0x0196bf (0xdb4d bytes) 000268 1788803236.032996 punch from 0x014a04 to 0x016e60 (0x245d bytes) 000269 1788803236.038114 mapwrite 0x03e3a3 thru 0x03ffff (0x1c5d bytes) 000270 1788803236.186317 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc2ba8a0e (stale) Mirror 8: 0xc2ba8a0e (stale) Mirror 10: 0xc2ba8a0e (stale) Mirror 11: 0xc2ba8a0e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc2ba8a0e (stale) Mirror 8: 0xc2ba8a0e (stale) Mirror 10: 0xc2ba8a0e (stale) Mirror 11: 0xc2ba8a0e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000271 1788803236.632299 MIRROR_RESYNC 5 mirrors 000272 1788803237.888412 mapread 0x03a75a thru 0x03ffff (0x58a6 bytes) 000277 1788803237.928624 mapwrite 0x02b07c thru 0x035be9 (0xab6e bytes) 000279 1788803238.281438 trunc from 0x040000 to 0x0035e9 (0x3ca16 bytes) 000280 1788803238.301670 mapwrite 0x03754c thru 0x0381cc (0xc81 bytes) 000281 1788803238.377230 MIRROR_RESYNC 5 mirrors 000282 1788803239.757843 write 0x00e529 thru 0x00fe80 (0x1958 bytes) 000283 1788803239.931416 mapread 0x02d552 thru 0x0316e5 (0x4194 bytes) 000284 1788803239.963843 mapread 0x014dfb thru 0x020cf4 (0xbefa bytes) 000285 1788803239.984243 read 0x02d83e thru 0x0381cc (0xa98f bytes) 000287 1788803240.024033 trunc from 0x0381cd to 0x011e1e (0x263ae bytes) 000288 1788803240.065353 trunc from 0x011e1f to 0x008e71 (0x8fad bytes) 000289 1788803240.100877 MIRROR_RESYNC 5 mirrors 000290 1788803241.298872 read 0x00454b thru 0x008e71 (0x4927 bytes) 000292 1788803241.316552 mapread 0x00493c thru 0x008e71 (0x4536 bytes) 000293 1788803241.317324 trunc from 0x008e72 to 0x02849c (0x1f62b bytes) 000294 1788803241.446528 read 0x015926 thru 0x022a86 (0xd161 bytes) 000295 1788803241.472017 MIRROR_RESYNC 5 mirrors 000297 1788803242.822605 mapread 0x02136e thru 0x024f80 (0x3c13 bytes) 000298 1788803242.844010 punch from 0x0038ed to 0x00d729 (0x9e3d bytes) 000300 1788803242.902769 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2849d): Mirror 7: 0x47d48ffd (stale) Mirror 10: 0x47d48ffd (stale) Mirror 11: 0x47d48ffd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2849d): Mirror 7: 0x47d48ffd (stale) Mirror 10: 0x47d48ffd (stale) Mirror 11: 0x47d48ffd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2849d: skipped 000301 1788803243.422836 trunc from 0x02849d to 0x033119 (0xac7d bytes) 000303 1788803243.447583 write 0x01dbc7 thru 0x026747 (0x8b81 bytes) 000304 1788803243.459945 mapread 0x027918 thru 0x02fee3 (0x85cc bytes) 000305 1788803243.479338 mapwrite 0x03546d thru 0x03b364 (0x5ef8 bytes) 000306 1788803243.569662 write 0x038b7a thru 0x03f4f6 (0x697d bytes) 000307 1788803243.571837 trunc from 0x03f4f7 to 0x0198fb (0x25bfb bytes) 000309 1788803243.598389 mapread 0x008e65 thru 0x00c0c6 (0x3262 bytes) 000310 1788803243.614049 read 0x00e27e thru 0x0198fb (0xb67e bytes) 000311 1788803243.646449 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x198fc): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x198fc): Mirror 7: 0x6215394d (stale) Mirror 10: 0x6215394d (stale) Mirror 11: 0x6215394d (stale) CRC-32 checksum value for chunk [0, 0x198fc): Mirror 1: 0x6215394d Mirror 12: 0x6215394d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x198fc: skipped 000312 1788803244.744841 write 0x03cb6c thru 0x03ffff (0x3494 bytes) 000313 1788803244.828845 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x7232b9e7 (stale) Mirror 11: 0x7232b9e7 (stale) Mirror 12: 0x7232b9e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x7232b9e7 (stale) Mirror 11: 0x7232b9e7 (stale) Mirror 12: 0x7232b9e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000314 1788803245.150692 punch from 0x00aca2 to 0x012d76 (0x80d5 bytes) 000315 1788803245.155102 read 0x03b0b7 thru 0x03b5f3 (0x53d bytes) 000316 1788803245.160536 read 0x036adf thru 0x03fd4a (0x926c bytes) 000317 1788803245.172252 mapread 0x01377c thru 0x01c378 (0x8bfd bytes) 000318 1788803245.173642 punch from 0x0310bc to 0x0357c5 (0x470a bytes) 000319 1788803245.178410 trunc from 0x040000 to 0x00edb7 (0x31248 bytes) 000320 1788803245.200304 mapwrite 0x01a84a thru 0x028288 (0xda3f bytes) 000325 1788803245.377194 read 0x01e6f5 thru 0x022cd9 (0x45e5 bytes) 000331 1788803245.386477 punch from 0x0126ee to 0x01e148 (0xba5b bytes) 000332 1788803245.395560 mapwrite 0x016be1 thru 0x0213f3 (0xa813 bytes) 000333 1788803245.491627 MIRROR_RESYNC 4 mirrors 000334 1788803246.576994 mapwrite 0x00bef5 thru 0x00d1af (0x12bb bytes) 000337 1788803246.756587 read 0x000ed7 thru 0x00913b (0x8265 bytes) 000339 1788803246.765952 mapwrite 0x03dcab thru 0x03ffff (0x2355 bytes) 000340 1788803246.861625 write 0x022268 thru 0x0281a4 (0x5f3d bytes) 000341 1788803246.884700 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x8f19e4d8 (stale) Mirror 12: 0x8f19e4d8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x8f19e4d8 (stale) Mirror 12: 0x8f19e4d8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000342 1788803247.370619 write 0x03177f thru 0x03ffff (0xe881 bytes) 000343 1788803247.378533 mapwrite 0x01fa95 thru 0x028c6d (0x91d9 bytes) 000345 1788803247.495427 trunc from 0x040000 to 0x00fbe9 (0x30416 bytes) 000347 1788803247.516645 read 0x00ba1f thru 0x00fbe9 (0x41cb bytes) 000348 1788803247.537442 punch from 0x000ad3 to 0x00b22c (0xa75a bytes) 000349 1788803247.553890 write 0x01b8c6 thru 0x0219ce (0x6109 bytes) 000351 1788803247.561762 write 0x039693 thru 0x03ffff (0x696d bytes) 000355 1788803247.580698 mapread 0x015aa1 thru 0x02392f (0xde8f bytes) 000356 1788803247.604919 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x8f19e4d8 (stale) Mirror 12: 0x8f19e4d8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2a91d22a Mirror 13: 0x2a91d22a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000358 1788803248.453271 write 0x037470 thru 0x03775e (0x2ef bytes) 000360 1788803248.549316 punch from 0x018655 to 0x021682 (0x902e bytes) 000363 1788803248.563639 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x8f19e4d8 (stale) Mirror 12: 0x8f19e4d8 (stale) Mirror 13: 0x2a91d22a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x95c42ec3 Mirror 14: 0x95c42ec3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000364 1788803249.644698 mapwrite 0x02a3cb thru 0x03508b (0xacc1 bytes) 000365 1788803249.956554 read 0x03f608 thru 0x03ffff (0x9f8 bytes) 000366 1788803249.962546 mapread 0x024d84 thru 0x02ee6d (0xa0ea bytes) 000367 1788803249.963525 mapread 0x039baa thru 0x03ffff (0x6456 bytes) 000370 1788803249.972877 write 0x031511 thru 0x0384e3 (0x6fd3 bytes) 000371 1788803249.978226 punch from 0x0132e1 to 0x018c75 (0x5995 bytes) 000372 1788803250.000980 mapread 0x00a368 thru 0x0147e2 (0xa47b bytes) 000373 1788803250.027257 mapread 0x037c0b thru 0x03bd82 (0x4178 bytes) 000374 1788803250.028621 read 0x0217de thru 0x0226a2 (0xec5 bytes) 000375 1788803250.038235 punch from 0x026a78 to 0x02b089 (0x4612 bytes) 000377 1788803250.044409 mapwrite 0x00e565 thru 0x01a96c (0xc408 bytes) 000379 1788803250.094909 trunc from 0x040000 to 0x01c451 (0x23bae bytes) 000380 1788803250.110390 write 0x012cc7 thru 0x01c3ed (0x9727 bytes) 000381 1788803250.112696 trunc from 0x01c452 to 0x0398a3 (0x1d452 bytes) 000382 1788803250.131016 mapwrite 0x003d65 thru 0x00c1a1 (0x843d bytes) 000384 1788803250.181395 mapwrite 0x01e715 thru 0x025428 (0x6d14 bytes) 000385 1788803250.311412 punch from 0x022571 to 0x02ce86 (0xa916 bytes) 000387 1788803250.320937 trunc from 0x0398a4 to 0x01dd24 (0x1bb7f bytes) 000388 1788803250.355566 read 0x01c7b3 thru 0x01dd24 (0x1572 bytes) 000389 1788803250.361199 read 0x01be59 thru 0x01dd24 (0x1ecc bytes) 000390 1788803250.362017 write 0x0269d0 thru 0x030bed (0xa21e bytes) 000391 1788803250.364614 punch from 0x0234a7 to 0x02d5c6 (0xa120 bytes) 000392 1788803250.383329 trunc from 0x030bee to 0x01ea7b (0x12172 bytes) 000393 1788803250.402980 punch from 0x004716 to 0x006b8c (0x2477 bytes) 000394 1788803250.409975 mapwrite 0x02cc76 thru 0x03aff5 (0xe380 bytes) 000395 1788803250.496116 trunc from 0x03aff6 to 0x00b7f9 (0x2f7fc bytes) 000397 1788803250.513457 mapwrite 0x03e6a9 thru 0x03ffff (0x1957 bytes) 000398 1788803250.600296 trunc from 0x040000 to 0x00b6ce (0x34931 bytes) 000399 1788803250.620889 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xb6cf): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb6cf): Mirror 11: 0x1f98637c (stale) Mirror 12: 0x1f98637c (stale) Mirror 13: 0xbf47c477 (stale) Mirror 14: 0xbf47c477 (stale) CRC-32 checksum value for chunk [0, 0xb6cf): Mirror 1: 0xd351fcd6 Mirror 15: 0xd351fcd6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb6cf: skipped 000401 1788803251.607969 MIRROR_RESYNC 6 mirrors 000403 1788803253.046940 read 0x009fb9 thru 0x00b6ce (0x1716 bytes) 000406 1788803253.054507 mapread 0x0073c7 thru 0x00b6ce (0x4308 bytes) 000407 1788803253.065335 punch from 0x00a187 to 0x00b6ce (0x1548 bytes) 000409 1788803253.166307 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb6cf): Mirror 11: 0xd351fcd6 (stale) Mirror 12: 0xd351fcd6 (stale) Mirror 13: 0xd351fcd6 (stale) Mirror 14: 0xd351fcd6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb6cf): Mirror 11: 0xd351fcd6 (stale) Mirror 12: 0xd351fcd6 (stale) Mirror 13: 0xd351fcd6 (stale) Mirror 14: 0xd351fcd6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb6cf: skipped 000411 1788803253.576404 trunc from 0x00b6cf to 0x036504 (0x2ae36 bytes) 000412 1788803253.600840 mapread 0x023964 thru 0x029c56 (0x62f3 bytes) 000413 1788803253.637294 mapread 0x003f45 thru 0x0122de (0xe39a bytes) 000414 1788803253.661074 write 0x03c1f8 thru 0x03ffff (0x3e08 bytes) 000415 1788803253.662279 read 0x0246d4 thru 0x02bac8 (0x73f5 bytes) 000416 1788803253.671359 MIRROR_RESYNC 5 mirrors 000419 1788803255.387056 mapread 0x030741 thru 0x031788 (0x1048 bytes) 000420 1788803255.400859 read 0x012133 thru 0x020448 (0xe316 bytes) 000423 1788803255.412546 mapwrite 0x03fbaa thru 0x03ffff (0x456 bytes) 000424 1788803255.609973 write 0x028cab thru 0x030114 (0x746a bytes) 000425 1788803255.633923 trunc from 0x040000 to 0x035135 (0xaeca bytes) 000426 1788803255.659477 mapwrite 0x03c112 thru 0x03ed9e (0x2c8d bytes) 000428 1788803255.791370 mapwrite 0x034561 thru 0x038103 (0x3ba3 bytes) 000430 1788803255.870331 mapwrite 0x0399fc thru 0x03ffff (0x6604 bytes) 000431 1788803255.968532 punch from 0x01fe31 to 0x02a37b (0xa54b bytes) 000432 1788803255.973873 read 0x028ca0 thru 0x032cc5 (0xa026 bytes) 000433 1788803256.010469 write 0x021dc7 thru 0x026e80 (0x50ba bytes) 000434 1788803256.011944 mapwrite 0x013cda thru 0x01d04c (0x9373 bytes) 000436 1788803256.105592 mapread 0x017082 thru 0x0186db (0x165a bytes) 000438 1788803256.107790 write 0x011da8 thru 0x01cf27 (0xb180 bytes) 000439 1788803256.117027 MIRROR_RESYNC 5 mirrors 000440 1788803257.002677 mapread 0x027a52 thru 0x0306d0 (0x8c7f bytes) 000441 1788803257.036459 read 0x02974b thru 0x0313ad (0x7c63 bytes) 000443 1788803257.037396 write 0x01e09a thru 0x026421 (0x8388 bytes) 000446 1788803257.237841 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xf9ebbf48 (stale) Mirror 13: 0xf9ebbf48 (stale) Mirror 14: 0xf9ebbf48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xf9ebbf48 (stale) Mirror 13: 0xf9ebbf48 (stale) Mirror 14: 0xf9ebbf48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000447 1788803257.638247 trunc from 0x040000 to 0x01046a (0x2fb95 bytes) 000448 1788803257.693973 mapread 0x00044b thru 0x0018d3 (0x1489 bytes) 000449 1788803257.709979 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1046b): Mirror 12: 0xbddde5a8 (stale) Mirror 14: 0xbddde5a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1046b): Mirror 12: 0xbddde5a8 (stale) Mirror 14: 0xbddde5a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1046b: skipped 000450 1788803258.008787 trunc from 0x01046b to 0x0376a5 (0x2723b bytes) 000452 1788803258.027554 MIRROR_RESYNC 3 mirrors 000453 1788803258.968785 trunc from 0x0376a6 to 0x02bde9 (0xb8bc bytes) 000454 1788803259.055552 read 0x007386 thru 0x01344c (0xc0c7 bytes) 000455 1788803259.067141 read 0x00abbe thru 0x015d8a (0xb1cd bytes) 000456 1788803259.084485 trunc from 0x02bdea to 0x02c677 (0x88e bytes) 000458 1788803259.122501 MIRROR_RESYNC 3 mirrors 000459 1788803259.953185 mapread 0x01217a thru 0x01df75 (0xbdfc bytes) 000460 1788803259.987616 write 0x03b783 thru 0x03f750 (0x3fce bytes) 000461 1788803260.057526 MIRROR_RESYNC 3 mirrors 000462 1788803261.028672 write 0x02d6de thru 0x037ca6 (0xa5c9 bytes) 000463 1788803261.091712 write 0x01a292 thru 0x01b430 (0x119f bytes) 000464 1788803261.106200 trunc from 0x03f751 to 0x01475b (0x2aff5 bytes) 000465 1788803261.131131 mapwrite 0x03ccd3 thru 0x03ffff (0x332d bytes) 000467 1788803261.228118 mapwrite 0x023457 thru 0x02dd9e (0xa948 bytes) 000468 1788803261.319854 mapwrite 0x02ec47 thru 0x03e57c (0xf936 bytes) 000469 1788803261.372705 mapwrite 0x01338f thru 0x01b6ab (0x831d bytes) 000470 1788803261.429470 write 0x009f8a thru 0x0161bc (0xc233 bytes) 000471 1788803261.436236 mapwrite 0x0147d3 thru 0x01adad (0x65db bytes) 000472 1788803261.472016 read 0x037068 thru 0x039144 (0x20dd bytes) 000473 1788803261.472879 read 0x015090 thru 0x016a7f (0x19f0 bytes) 000476 1788803261.475105 read 0x01f329 thru 0x029769 (0xa441 bytes) 000477 1788803261.476378 read 0x001da4 thru 0x0076db (0x5938 bytes) 000478 1788803261.489034 read 0x004e4e thru 0x00e92b (0x9ade bytes) 000479 1788803261.496412 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x5ba61bc4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x5ba61bc4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000481 1788803261.861635 write 0x037b6e thru 0x03ef9d (0x7430 bytes) 000482 1788803261.870578 trunc from 0x040000 to 0x00d9e3 (0x3261c bytes) 000483 1788803261.887137 punch from 0x00c4ab to 0x00d9e3 (0x1539 bytes) 000484 1788803261.893244 punch from 0x0073ce to 0x00b32e (0x3f61 bytes) 000485 1788803261.899729 punch from 0x006b4b to 0x00b7f1 (0x4ca7 bytes) 000487 1788803261.910412 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xd9e4): Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd9e4): Mirror 14: 0xa2f25f2b (stale) CRC-32 checksum value for chunk [0, 0xd9e4): Mirror 1: 0xd1a4ed0a Mirror 15: 0xd1a4ed0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd9e4: skipped 000490 1788803262.958662 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xd9e4): Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd9e4): Mirror 14: 0xa2f25f2b (stale) CRC-32 checksum value for chunk [0, 0xd9e4): Mirror 1: 0xd1a4ed0a Mirror 15: 0xd1a4ed0a Mirror 16: 0xd1a4ed0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd9e4: skipped 000492 1788803263.838072 mapread 0x0003ce thru 0x005fbc (0x5bef bytes) 000493 1788803263.886846 punch from 0x00d613 to 0x00d9e3 (0x3d1 bytes) 000494 1788803263.960523 mapwrite 0x0074a5 thru 0x00df8a (0x6ae6 bytes) 000496 1788803264.115547 read 0x008681 thru 0x0091b8 (0xb38 bytes) 000498 1788803264.118982 write 0x03d40a thru 0x03d829 (0x420 bytes) 000499 1788803264.120503 read 0x0009df thru 0x00c81a (0xbe3c bytes) 000500 1788803264.144522 MIRROR_RESYNC 4 mirrors 000502 1788803265.458648 mapwrite 0x03fd2e thru 0x03ffff (0x2d2 bytes) 000503 1788803265.619897 punch from 0x03423f to 0x03ffff (0xbdc1 bytes) truncating to largest ever: 0x3ff87 000505 1788803265.627471 trunc from 0x040000 to 0x03ff86 (0x79 bytes) 000506 1788803265.656455 mapwrite 0x020f9f thru 0x02c147 (0xb1a9 bytes) 000507 1788803265.734906 trunc from 0x03ff87 to 0x03b20d (0x4d79 bytes) 000508 1788803265.762737 trunc from 0x03b20e to 0x00aee4 (0x30329 bytes) 000510 1788803265.781408 write 0x0351d3 thru 0x03f93b (0xa769 bytes) 000511 1788803265.795068 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f93c): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f93c): Mirror 14: 0xc46c001a (stale) Mirror 15: 0xc46c001a (stale) Mirror 16: 0xc46c001a (stale) CRC-32 checksum value for chunk [0, 0x3f93c): Mirror 1: 0x302b4145 Mirror 17: 0x302b4145 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f93c: skipped 000512 1788803267.128351 punch from 0x02a8a4 to 0x03a493 (0xfbf0 bytes) 000513 1788803267.279248 mapread 0x00606a thru 0x012688 (0xc61f bytes) 000514 1788803267.339829 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f93c): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f93c): Mirror 14: 0xc46c001a (stale) Mirror 15: 0xc46c001a (stale) Mirror 16: 0xc46c001a (stale) Mirror 17: 0x302b4145 (stale) CRC-32 checksum value for chunk [0, 0x3f93c): Mirror 1: 0x64dec553 Mirror 18: 0x64dec553 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f93c: skipped 000515 1788803268.697963 read 0x012a59 thru 0x017996 (0x4f3e bytes) 000516 1788803268.724121 MIRROR_RESYNC 6 mirrors 000517 1788803270.423550 mapread 0x01946b thru 0x01df72 (0x4b08 bytes) 000518 1788803270.446313 trunc from 0x03f93c to 0x016b9b (0x28da0 bytes) 000519 1788803270.557571 mapread 0x002e7f thru 0x003efb (0x107d bytes) 000520 1788803270.572420 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16b9c): Mirror 14: 0xfcf401ca (stale) Mirror 16: 0xfcf401ca (stale) Mirror 17: 0xfcf401ca (stale) Mirror 18: 0xfcf401ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16b9c): Mirror 14: 0xfcf401ca (stale) Mirror 16: 0xfcf401ca (stale) Mirror 17: 0xfcf401ca (stale) Mirror 18: 0xfcf401ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16b9c: skipped 000521 1788803271.006355 mapwrite 0x027f44 thru 0x029479 (0x1536 bytes) 000523 1788803271.114363 write 0x017a32 thru 0x024332 (0xc901 bytes) 000524 1788803271.139397 write 0x0374b1 thru 0x038257 (0xda7 bytes) 000525 1788803271.141668 mapwrite 0x02176d thru 0x026f5b (0x57ef bytes) 000526 1788803271.193413 write 0x00412d thru 0x00733b (0x320f bytes) 000527 1788803271.204709 punch from 0x000ac6 to 0x0106cb (0xfc06 bytes) 000529 1788803271.217500 read 0x007594 thru 0x00d3f4 (0x5e61 bytes) 000530 1788803271.228718 read 0x032831 thru 0x033532 (0xd02 bytes) 000531 1788803271.243297 mapwrite 0x00976a thru 0x0121da (0x8a71 bytes) 000532 1788803271.317594 punch from 0x003eef to 0x00dac1 (0x9bd3 bytes) 000533 1788803271.323710 trunc from 0x038258 to 0x022828 (0x15a2f bytes) 000536 1788803271.347839 punch from 0x01dcb3 to 0x022828 (0x4b76 bytes) 000537 1788803271.355858 write 0x0264ba thru 0x0292ec (0x2e33 bytes) 000538 1788803271.357823 mapwrite 0x002a56 thru 0x0092e2 (0x688d bytes) 000539 1788803271.445963 trunc from 0x0292ed to 0x0209b1 (0x893b bytes) 000542 1788803271.465191 read 0x019aa8 thru 0x01afae (0x1507 bytes) 000543 1788803271.466079 write 0x02375a thru 0x02b0d7 (0x797e bytes) 000544 1788803271.472722 MIRROR_RESYNC 5 mirrors 000545 1788803272.633289 write 0x00752d thru 0x012e24 (0xb8f8 bytes) 000551 1788803272.794564 punch from 0x01dbd0 to 0x02766a (0x9a9b bytes) 000553 1788803272.825290 write 0x02e8fc thru 0x03ab7b (0xc280 bytes) 000554 1788803272.829485 mapwrite 0x026763 thru 0x031846 (0xb0e4 bytes) 000555 1788803272.973233 write 0x00a266 thru 0x014b7b (0xa916 bytes) 000556 1788803273.000874 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ab7c): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab7c): Mirror 14: 0xa4f05f24 (stale) Mirror 16: 0xa4f05f24 (stale) Mirror 17: 0xa4f05f24 (stale) Mirror 18: 0xa4f05f24 (stale) CRC-32 checksum value for chunk [0, 0x3ab7c): Mirror 1: 0xb09aa9d Mirror 19: 0xb09aa9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab7c: skipped 000557 1788803274.058759 mapwrite 0x037285 thru 0x03ffff (0x8d7b bytes) 000558 1788803274.225581 mapwrite 0x004b67 thru 0x011dce (0xd268 bytes) 000559 1788803274.284828 mapwrite 0x011c88 thru 0x019f13 (0x828c bytes) 000560 1788803274.341930 trunc from 0x040000 to 0x007db9 (0x38246 bytes) 000562 1788803274.379056 MIRROR_RESYNC 6 mirrors 000564 1788803275.717882 mapwrite 0x02cbfb thru 0x031405 (0x480b bytes) 000566 1788803275.915586 trunc from 0x031406 to 0x03e08d (0xcc88 bytes) 000567 1788803275.957426 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e08e): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e08e): Mirror 14: 0x8c3151c3 (stale) Mirror 16: 0x8c3151c3 (stale) Mirror 17: 0x8c3151c3 (stale) Mirror 18: 0x8c3151c3 (stale) Mirror 19: 0x8c3151c3 (stale) CRC-32 checksum value for chunk [0, 0x3e08e): Mirror 1: 0x4e043089 Mirror 20: 0x4e043089 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e08e: skipped 000568 1788803277.720925 write 0x0263c2 thru 0x02bde7 (0x5a26 bytes) 000569 1788803277.918323 mapread 0x02d998 thru 0x032956 (0x4fbf bytes) 000570 1788803277.960074 write 0x038d73 thru 0x03ff4c (0x71da bytes) 000572 1788803277.980619 MIRROR_RESYNC 7 mirrors 000573 1788803280.154881 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) 000574 1788803280.642634 mapread 0x0028ee thru 0x007ac1 (0x51d4 bytes) 000576 1788803280.680530 mapread 0x02ef74 thru 0x03d3e2 (0xe46f bytes) 000577 1788803280.703996 mapwrite 0x027ccf thru 0x0296d7 (0x1a09 bytes) 000579 1788803280.862673 punch from 0x008d7e to 0x017048 (0xe2cb bytes) 000580 1788803280.867878 punch from 0x00a7d4 to 0x01a665 (0xfe92 bytes) 000581 1788803280.872903 trunc from 0x03ff4d to 0x016a68 (0x294e4 bytes) 000582 1788803280.897782 mapwrite 0x020b46 thru 0x02c1a7 (0xb662 bytes) 000585 1788803281.004079 write 0x008d7f thru 0x00bf2f (0x31b1 bytes) 000587 1788803281.039466 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c1a8): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c1a8): Mirror 14: 0xfd9c6885 (stale) Mirror 16: 0xfd9c6885 (stale) Mirror 17: 0xfd9c6885 (stale) Mirror 18: 0xfd9c6885 (stale) Mirror 19: 0xfd9c6885 (stale) CRC-32 checksum value for chunk [0, 0x2c1a8): Mirror 1: 0x822c0754 Mirror 20: 0x822c0754 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c1a8: skipped 000590 1788803282.450515 write 0x000639 thru 0x001673 (0x103b bytes) 000591 1788803282.553102 mapread 0x019401 thru 0x0231d8 (0x9dd8 bytes) 000592 1788803282.585017 mapread 0x018d82 thru 0x025762 (0xc9e1 bytes) 000593 1788803282.599410 write 0x01e045 thru 0x029b76 (0xbb32 bytes) 000594 1788803282.601082 read 0x01a3e2 thru 0x026929 (0xc548 bytes) 000595 1788803282.606709 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c1a8): Mirror 14: 0xfd9c6885 (stale) Mirror 16: 0xfd9c6885 (stale) Mirror 17: 0xfd9c6885 (stale) Mirror 18: 0xfd9c6885 (stale) Mirror 20: 0x822c0754 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c1a8): Mirror 14: 0xfd9c6885 (stale) Mirror 16: 0xfd9c6885 (stale) Mirror 17: 0xfd9c6885 (stale) Mirror 18: 0xfd9c6885 (stale) Mirror 20: 0x822c0754 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c1a8: skipped 000596 1788803283.157093 write 0x01eaa5 thru 0x026340 (0x789c bytes) 000599 1788803283.178518 trunc from 0x02c1a8 to 0x01d305 (0xeea2 bytes) 000600 1788803283.203600 read 0x0160d2 thru 0x01d305 (0x7234 bytes) 000601 1788803283.210594 trunc from 0x01d306 to 0x0378a6 (0x1a5a1 bytes) 000602 1788803283.227498 punch from 0x01b7c1 to 0x01c9e8 (0x1228 bytes) 000603 1788803283.232987 mapwrite 0x00c364 thru 0x01149d (0x513a bytes) 000606 1788803283.301033 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x378a7): Mirror 14: 0xcd486897 (stale) Mirror 16: 0xcd486897 (stale) Mirror 17: 0xcd486897 (stale) Mirror 18: 0xcd486897 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x378a7): Mirror 14: 0xcd486897 (stale) Mirror 16: 0xcd486897 (stale) Mirror 17: 0xcd486897 (stale) Mirror 18: 0xcd486897 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x378a7: skipped 000607 1788803283.880623 mapread 0x035a9a thru 0x0378a6 (0x1e0d bytes) 000608 1788803283.901737 mapwrite 0x024814 thru 0x025a6d (0x125a bytes) 000609 1788803283.953697 read 0x02c252 thru 0x0378a6 (0xb655 bytes) 000610 1788803283.960649 mapwrite 0x0190b4 thru 0x025976 (0xc8c3 bytes) 000612 1788803284.022996 read 0x026f44 thru 0x034e39 (0xdef6 bytes) 000613 1788803284.026721 mapwrite 0x0019fd thru 0x001cd0 (0x2d4 bytes) 000614 1788803284.076230 punch from 0x00cdc8 to 0x0140e7 (0x7320 bytes) 000615 1788803284.082216 mapwrite 0x03dbe6 thru 0x03ffff (0x241a bytes) 000616 1788803284.198797 trunc from 0x040000 to 0x03285f (0xd7a0 bytes) 000617 1788803284.228846 write 0x035ce5 thru 0x03e744 (0x8a60 bytes) 000619 1788803284.239032 punch from 0x012726 to 0x01a3b8 (0x7c93 bytes) 000620 1788803284.260597 mapwrite 0x039393 thru 0x03ffff (0x6c6d bytes) 000621 1788803284.335089 read 0x02ad29 thru 0x02b953 (0xc2b bytes) 000623 1788803284.336307 read 0x018773 thru 0x026722 (0xdfb0 bytes) 000625 1788803284.351114 trunc from 0x040000 to 0x02e63f (0x119c0 bytes) 000627 1788803284.369494 trunc from 0x02e640 to 0x0004bf (0x2e180 bytes) 000628 1788803284.395884 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4c0): Mirror 14: 0xb5edd5ed (stale) Mirror 17: 0xb5edd5ed (stale) Mirror 18: 0xb5edd5ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4c0): Mirror 14: 0xb5edd5ed (stale) Mirror 17: 0xb5edd5ed (stale) Mirror 18: 0xb5edd5ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4c0: skipped 000629 1788803284.676418 mapwrite 0x036c2e thru 0x03ffff (0x93d2 bytes) 000630 1788803284.788702 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x623d276b (stale) Mirror 17: 0x623d276b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x623d276b (stale) Mirror 17: 0x623d276b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000631 1788803285.106215 MIRROR_RESYNC 3 mirrors 000632 1788803286.333521 mapread 0x01b7a8 thru 0x01b949 (0x1a2 bytes) 000633 1788803286.342387 trunc from 0x040000 to 0x006440 (0x39bbf bytes) 000634 1788803286.453508 mapwrite 0x01ac9f thru 0x022733 (0x7a95 bytes) 000635 1788803286.569026 write 0x037d98 thru 0x03ffff (0x8268 bytes) 000636 1788803286.571755 trunc from 0x040000 to 0x01dbd1 (0x2242e bytes) 000637 1788803286.598932 read 0x002913 thru 0x00aaa0 (0x818e bytes) 000638 1788803286.613233 punch from 0x0042d1 to 0x00afdf (0x6d0f bytes) 000639 1788803286.626779 write 0x03c808 thru 0x03ffff (0x37f8 bytes) 000641 1788803286.644766 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xd51fba6f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xd51fba6f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000642 1788803287.128098 punch from 0x027f47 to 0x0334ca (0xb584 bytes) 000643 1788803287.133999 mapwrite 0x01d385 thru 0x02b44f (0xe0cb bytes) 000645 1788803287.235435 mapread 0x0075aa thru 0x00a8f7 (0x334e bytes) 000646 1788803287.251388 mapwrite 0x0097f4 thru 0x012336 (0x8b43 bytes) 000648 1788803287.319054 trunc from 0x040000 to 0x027aa0 (0x1855f bytes) 000649 1788803287.334641 write 0x037f7c thru 0x03f254 (0x72d9 bytes) 000651 1788803287.338178 read 0x027136 thru 0x034387 (0xd252 bytes) 000652 1788803287.346086 trunc from 0x03f255 to 0x03b33c (0x3f18 bytes) 000653 1788803287.363663 read 0x030a91 thru 0x035817 (0x4d87 bytes) 000654 1788803287.373538 mapread 0x019042 thru 0x028221 (0xf1e0 bytes) 000655 1788803287.378319 MIRROR_RESYNC 2 mirrors 000657 1788803288.217104 MIRROR_EXTEND to 3 mirrors 000659 1788803289.351259 read 0x01dc4d thru 0x026090 (0x8444 bytes) 000661 1788803289.390044 mapread 0x01bdcf thru 0x0202c6 (0x44f8 bytes) 000663 1788803289.445288 mapread 0x02338c thru 0x02b3c1 (0x8036 bytes) 000664 1788803289.486133 write 0x037b01 thru 0x0389dc (0xedc bytes) 000665 1788803289.614258 mapwrite 0x0264c5 thru 0x02b893 (0x53cf bytes) 000666 1788803289.694776 mapwrite 0x036444 thru 0x03c28b (0x5e48 bytes) 000667 1788803289.859655 mapread 0x03a696 thru 0x03a8ac (0x217 bytes) 000668 1788803289.861530 punch from 0x00654d to 0x011f26 (0xb9da bytes) 000669 1788803289.872539 punch from 0x01eb7b to 0x02401b (0x54a1 bytes) 000670 1788803289.882073 punch from 0x0250c7 to 0x02b9aa (0x68e4 bytes) 000671 1788803289.886848 write 0x017fde thru 0x01b313 (0x3336 bytes) 000672 1788803289.929277 MIRROR_RESYNC 3 mirrors 000673 1788803291.257086 trunc from 0x03c28c to 0x00412d (0x3815e bytes) 000675 1788803291.328517 read 0x002b30 thru 0x00412d (0x15fe bytes) 000676 1788803291.344592 read 0x000a2f thru 0x003089 (0x265b bytes) 000677 1788803291.352988 write 0x03e52b thru 0x03ffff (0x1ad5 bytes) 000678 1788803291.356329 mapread 0x0029f7 thru 0x00deac (0xb4b6 bytes) 000679 1788803291.370007 trunc from 0x040000 to 0x0336c1 (0xc93e bytes) 000680 1788803291.402037 punch from 0x004a58 to 0x00e6a0 (0x9c49 bytes) 000681 1788803291.406991 write 0x03ffad thru 0x03ffff (0x53 bytes) 000682 1788803291.408575 mapread 0x022122 thru 0x030127 (0xe006 bytes) 000684 1788803291.418720 mapwrite 0x03953c thru 0x03ffff (0x6ac4 bytes) 000685 1788803291.525646 mapwrite 0x01590e thru 0x02587e (0xff71 bytes) 000687 1788803291.577178 trunc from 0x040000 to 0x039e0d (0x61f2 bytes) 000688 1788803291.600930 punch from 0x02bb43 to 0x037bb0 (0xc06e bytes) 000689 1788803291.607652 punch from 0x0163d1 to 0x02512d (0xed5d bytes) 000690 1788803291.619754 mapread 0x016939 thru 0x01e157 (0x781f bytes) 000692 1788803291.691044 trunc from 0x039e0e to 0x007033 (0x32dda bytes) 000693 1788803291.759685 punch from 0x004d54 to 0x00692e (0x1bdb bytes) 000694 1788803291.791954 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7034): Mirror 14: 0x785f1e13 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7034): Mirror 14: 0x785f1e13 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7034: skipped 000695 1788803292.287782 trunc from 0x007034 to 0x0262f3 (0x1f2c0 bytes) 000696 1788803292.320643 mapwrite 0x012d52 thru 0x013ed1 (0x1180 bytes) 000697 1788803292.444769 mapwrite 0x007076 thru 0x0088cc (0x1857 bytes) 000698 1788803292.579382 write 0x038aff thru 0x03ffff (0x7501 bytes) 000700 1788803292.587966 mapread 0x01fd53 thru 0x02f17e (0xf42c bytes) 000702 1788803292.611977 read 0x025100 thru 0x029bc3 (0x4ac4 bytes) 000703 1788803292.612824 punch from 0x01d233 to 0x01fa5c (0x282a bytes) 000704 1788803292.632108 write 0x0165a6 thru 0x01cc63 (0x66be bytes) 000705 1788803292.640825 mapwrite 0x016685 thru 0x024984 (0xe300 bytes) 000706 1788803292.748266 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xcfc24ef3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2f675188 Mirror 15: 0x2f675188 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000709 1788803294.413366 write 0x026638 thru 0x030c1d (0xa5e6 bytes) 000711 1788803294.566250 MIRROR_RESYNC 3 mirrors 000712 1788803295.603348 MIRROR_EXTEND to 4 mirrors 000713 1788803296.438922 punch from 0x036ce9 to 0x03ffff (0x9317 bytes) 000715 1788803296.527429 trunc from 0x040000 to 0x007436 (0x38bc9 bytes) 000718 1788803296.549655 trunc from 0x007437 to 0x019d68 (0x12932 bytes) 000719 1788803296.567483 punch from 0x006f63 to 0x013a18 (0xcab6 bytes) 000720 1788803296.571634 mapwrite 0x0226c7 thru 0x027c59 (0x5593 bytes) 000721 1788803296.654721 write 0x0006ff thru 0x001a73 (0x1375 bytes) 000722 1788803296.668356 read 0x009eaf thru 0x01007f (0x61d1 bytes) 000723 1788803296.684624 mapread 0x003d65 thru 0x00b9d7 (0x7c73 bytes) 000724 1788803296.693995 write 0x0367f9 thru 0x03bd2e (0x5536 bytes) 000726 1788803296.703669 punch from 0x039662 to 0x03bd2e (0x26cd bytes) 000727 1788803296.765940 read 0x00e7a8 thru 0x0186f0 (0x9f49 bytes) 000728 1788803296.786048 mapwrite 0x007bd3 thru 0x0089c6 (0xdf4 bytes) 000729 1788803296.865769 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3bd2f): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd2f): Mirror 14: 0x48666afd (stale) Mirror 15: 0x48666afd (stale) Mirror 16: 0x48666afd (stale) CRC-32 checksum value for chunk [0, 0x3bd2f): Mirror 1: 0x3aa79ec Mirror 17: 0x3aa79ec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd2f: skipped 000730 1788803298.012939 mapread 0x0381e8 thru 0x03bd2e (0x3b47 bytes) 000731 1788803298.051499 read 0x0396a7 thru 0x03bd2e (0x2688 bytes) 000732 1788803298.064340 mapwrite 0x029fb0 thru 0x030b65 (0x6bb6 bytes) 000733 1788803298.289519 mapwrite 0x014c4f thru 0x01bf91 (0x7343 bytes) 000734 1788803298.380561 read 0x00e7ec thru 0x01c952 (0xe167 bytes) 000735 1788803298.381779 trunc from 0x03bd2f to 0x012e43 (0x28eeb bytes) 000736 1788803298.412690 trunc from 0x012e44 to 0x035d15 (0x22ed2 bytes) 000737 1788803298.434012 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35d16): Mirror 14: 0x7e502b5d (stale) Mirror 15: 0x7e502b5d (stale) Mirror 17: 0x70cc902c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d16): Mirror 14: 0x7e502b5d (stale) Mirror 15: 0x7e502b5d (stale) Mirror 17: 0x70cc902c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d16: skipped 000738 1788803298.900098 punch from 0x027f0e to 0x035d15 (0xde08 bytes) 000739 1788803298.918633 punch from 0x027dfb to 0x03202c (0xa232 bytes) 000740 1788803298.949020 MIRROR_RESYNC 4 mirrors 000741 1788803300.223600 read 0x01af59 thru 0x01b596 (0x63e bytes) 000742 1788803300.232870 trunc from 0x035d16 to 0x03196e (0x43a7 bytes) 000743 1788803300.363631 mapread 0x013822 thru 0x01401a (0x7f9 bytes) 000744 1788803300.385005 trunc from 0x03196f to 0x016fb1 (0x1a9bd bytes) 000747 1788803300.437581 write 0x02a9ec thru 0x035101 (0xa716 bytes) 000748 1788803300.440774 trunc from 0x035102 to 0x009ee4 (0x2b21d bytes) 000752 1788803300.479553 read 0x00472b thru 0x0085ed (0x3ec3 bytes) 000754 1788803300.494330 write 0x02984d thru 0x02fe72 (0x6626 bytes) 000755 1788803300.512578 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2fe73): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fe73): Mirror 14: 0x7108dea6 (stale) Mirror 15: 0x7108dea6 (stale) Mirror 17: 0x7108dea6 (stale) CRC-32 checksum value for chunk [0, 0x2fe73): Mirror 1: 0xbf5d0cc6 Mirror 18: 0xbf5d0cc6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fe73: skipped 000756 1788803302.040074 read 0x01b0cb thru 0x01c8fa (0x1830 bytes) 000757 1788803302.052684 read 0x024316 thru 0x02b546 (0x7231 bytes) 000758 1788803302.100018 read 0x00947c thru 0x015a40 (0xc5c5 bytes) 000761 1788803302.134139 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2fe73): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fe73): Mirror 14: 0x7108dea6 (stale) Mirror 15: 0x7108dea6 (stale) Mirror 17: 0x7108dea6 (stale) CRC-32 checksum value for chunk [0, 0x2fe73): Mirror 1: 0xbf5d0cc6 Mirror 18: 0xbf5d0cc6 Mirror 19: 0xbf5d0cc6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fe73: skipped 000762 1788803303.414776 read 0x00555f thru 0x0149fe (0xf4a0 bytes) 000763 1788803303.457278 mapwrite 0x02fc32 thru 0x032128 (0x24f7 bytes) 000765 1788803303.712352 read 0x027e6e thru 0x032128 (0xa2bb bytes) 000766 1788803303.741128 mapread 0x0153b9 thru 0x020dcf (0xba17 bytes) 000767 1788803303.750986 mapwrite 0x029be3 thru 0x02d9f0 (0x3e0e bytes) 000768 1788803303.810522 mapread 0x01dd30 thru 0x025b47 (0x7e18 bytes) 000770 1788803303.816009 write 0x026d90 thru 0x0362db (0xf54c bytes) 000771 1788803303.819273 read 0x025a61 thru 0x02e346 (0x88e6 bytes) 000772 1788803303.824026 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x362dc): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x362dc): Mirror 14: 0x495ea4ef (stale) Mirror 15: 0x495ea4ef (stale) Mirror 17: 0x495ea4ef (stale) Mirror 18: 0xd50035ed (stale) Mirror 19: 0xd50035ed (stale) CRC-32 checksum value for chunk [0, 0x362dc): Mirror 1: 0x54fd56e5 Mirror 20: 0x54fd56e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x362dc: skipped 000774 1788803304.892407 mapwrite 0x02bbef thru 0x0387c9 (0xcbdb bytes) 000775 1788803305.062137 mapread 0x004624 thru 0x012022 (0xd9ff bytes) 000776 1788803305.089514 mapread 0x00f552 thru 0x018803 (0x92b2 bytes) 000777 1788803305.091904 mapread 0x000019 thru 0x003cc3 (0x3cab bytes) 000778 1788803305.103293 punch from 0x017d6f to 0x01daa8 (0x5d3a bytes) 000779 1788803305.110315 write 0x007474 thru 0x00df21 (0x6aae bytes) 000780 1788803305.116835 write 0x01d35a thru 0x02b8cd (0xe574 bytes) 000784 1788803305.132584 read 0x029c93 thru 0x03420f (0xa57d bytes) 000786 1788803305.136681 write 0x038e50 thru 0x03bf91 (0x3142 bytes) 000789 1788803305.141617 mapwrite 0x030350 thru 0x032c49 (0x28fa bytes) 000790 1788803305.195288 read 0x00cbe8 thru 0x014007 (0x7420 bytes) 000791 1788803305.196706 read 0x03b0c5 thru 0x03bf91 (0xecd bytes) 000792 1788803305.197456 write 0x03e66d thru 0x03ffff (0x1993 bytes) 000793 1788803305.199930 trunc from 0x040000 to 0x00e57f (0x31a80 bytes) 000794 1788803305.225374 write 0x01a8b5 thru 0x020926 (0x6072 bytes) 000795 1788803305.226777 trunc from 0x020927 to 0x03f77a (0x1ee54 bytes) 000797 1788803305.247983 mapread 0x0173a6 thru 0x018e1c (0x1a77 bytes) 000799 1788803305.260326 trunc from 0x03f77b to 0x0093ac (0x363ce bytes) 000800 1788803305.281539 read 0x004f6b thru 0x0093ac (0x4442 bytes) 000801 1788803305.286976 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x93ad): Mirror 15: 0xb7821118 (stale) Mirror 17: 0xb7821118 (stale) Mirror 18: 0xb7821118 (stale) Mirror 19: 0xb7821118 (stale) Mirror 20: 0xb7821118 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x93ad): Mirror 15: 0xb7821118 (stale) Mirror 17: 0xb7821118 (stale) Mirror 18: 0xb7821118 (stale) Mirror 19: 0xb7821118 (stale) Mirror 20: 0xb7821118 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x93ad: skipped 000804 1788803305.781631 mapread 0x002477 thru 0x0093ac (0x6f36 bytes) 000805 1788803305.815588 trunc from 0x0093ad to 0x03e737 (0x3538b bytes) 000807 1788803305.856263 read 0x0163cd thru 0x023e8c (0xdac0 bytes) 000809 1788803305.870516 read 0x006e83 thru 0x00c635 (0x57b3 bytes) 000811 1788803305.890527 mapwrite 0x0062c0 thru 0x012a53 (0xc794 bytes) 000812 1788803305.982686 mapread 0x02d1f6 thru 0x036a9e (0x98a9 bytes) 000813 1788803305.985616 punch from 0x0327ff to 0x0367f8 (0x3ffa bytes) 000814 1788803305.998940 read 0x03132a thru 0x038bb9 (0x7890 bytes) 000816 1788803306.018695 MIRROR_RESYNC 6 mirrors 000817 1788803307.661600 trunc from 0x03e738 to 0x031484 (0xd2b3 bytes) 000819 1788803307.820266 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x31485): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31485): Mirror 15: 0xc96c3a3d (stale) Mirror 17: 0xc96c3a3d (stale) Mirror 18: 0xc96c3a3d (stale) Mirror 19: 0xc96c3a3d (stale) Mirror 20: 0xc96c3a3d (stale) CRC-32 checksum value for chunk [0, 0x31485): Mirror 1: 0xc96c3a3d Mirror 21: 0xc96c3a3d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31485: skipped 000822 1788803309.050871 mapread 0x005a48 thru 0x00c644 (0x6bfd bytes) 000823 1788803309.067879 mapwrite 0x02fab4 thru 0x03e12c (0xe679 bytes) 000824 1788803309.220605 mapread 0x00afdd thru 0x016f57 (0xbf7b bytes) 000828 1788803309.242001 write 0x03d004 thru 0x03ffff (0x2ffc bytes) 000830 1788803309.243744 mapread 0x035ac3 thru 0x03fe89 (0xa3c7 bytes) 000833 1788803309.246066 read 0x002589 thru 0x009d53 (0x77cb bytes) 000834 1788803309.251111 read 0x02cd64 thru 0x03c4ba (0xf757 bytes) 000836 1788803309.254053 write 0x004171 thru 0x00659a (0x242a bytes) 000837 1788803309.255443 punch from 0x01e488 to 0x020085 (0x1bfe bytes) 000838 1788803309.274609 write 0x015ee2 thru 0x021f07 (0xc026 bytes) 000839 1788803309.287079 trunc from 0x040000 to 0x0030d2 (0x3cf2d bytes) 000840 1788803309.332883 mapread 0x00074f thru 0x0030d2 (0x2984 bytes) 000843 1788803309.335658 mapread 0x001b91 thru 0x0030d2 (0x1542 bytes) 000844 1788803309.336797 read 0x0027c1 thru 0x0030d2 (0x912 bytes) 000847 1788803309.338322 punch from 0x00155d to 0x00180f (0x2b3 bytes) 000848 1788803309.349852 punch from 0x002a4d to 0x0030d2 (0x686 bytes) 000851 1788803309.364469 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30d3): Mirror 15: 0x2eed258 (stale) Mirror 18: 0x2eed258 (stale) Mirror 19: 0x2eed258 (stale) Mirror 20: 0x2eed258 (stale) Mirror 21: 0x2eed258 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30d3): Mirror 15: 0x2eed258 (stale) Mirror 18: 0x2eed258 (stale) Mirror 19: 0x2eed258 (stale) Mirror 20: 0x2eed258 (stale) Mirror 21: 0x2eed258 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30d3: skipped 000852 1788803309.737284 punch from 0x0013bd to 0x0030d2 (0x1d16 bytes) 000853 1788803309.744957 write 0x02b824 thru 0x03aba5 (0xf382 bytes) 000854 1788803309.749709 mapwrite 0x0223da thru 0x0225ab (0x1d2 bytes) 000855 1788803309.804518 mapwrite 0x003f83 thru 0x011415 (0xd493 bytes) 000856 1788803309.892269 MIRROR_RESYNC 6 mirrors 000857 1788803311.167953 mapread 0x02e7af thru 0x02fd38 (0x158a bytes) 000858 1788803311.197314 write 0x03c140 thru 0x03ffff (0x3ec0 bytes) 000859 1788803311.335533 mapread 0x03c0c6 thru 0x03ffff (0x3f3a bytes) 000860 1788803311.340664 read 0x017b3a thru 0x01ff55 (0x841c bytes) 000861 1788803311.367624 write 0x01151b thru 0x01b18e (0x9c74 bytes) 000862 1788803311.376477 write 0x00b154 thru 0x0140e8 (0x8f95 bytes) 000863 1788803311.388836 write 0x02ce5f thru 0x031cff (0x4ea1 bytes) 000864 1788803311.407143 mapwrite 0x00d984 thru 0x01b201 (0xd87e bytes) 000865 1788803311.498477 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x2fcd8354 (stale) Mirror 18: 0x2fcd8354 (stale) Mirror 19: 0x2fcd8354 (stale) Mirror 20: 0x2fcd8354 (stale) Mirror 21: 0x2fcd8354 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf9ad94d Mirror 22: 0xf9ad94d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000867 1788803312.541081 mapread 0x0278df thru 0x02acc3 (0x33e5 bytes) 000868 1788803312.556631 mapread 0x005d93 thru 0x00e508 (0x8776 bytes) 000869 1788803312.566053 write 0x012c76 thru 0x01df40 (0xb2cb bytes) 000870 1788803312.638085 mapwrite 0x00dd6b thru 0x0194c1 (0xb757 bytes) 000872 1788803312.686653 write 0x00b2b1 thru 0x00f7ee (0x453e bytes) 000873 1788803312.688416 punch from 0x007127 to 0x0140fb (0xcfd5 bytes) 000874 1788803312.702209 mapread 0x00dfbc thru 0x01b943 (0xd988 bytes) 000876 1788803312.721345 punch from 0x0171a9 to 0x019141 (0x1f99 bytes) 000877 1788803312.726386 punch from 0x036cd2 to 0x03ffff (0x932e bytes) 000878 1788803312.731548 mapwrite 0x02372b thru 0x02a023 (0x68f9 bytes) 000879 1788803312.800858 mapwrite 0x01b23d thru 0x01dc2c (0x29f0 bytes) 000880 1788803312.851520 mapread 0x020435 thru 0x025bd2 (0x579e bytes) 000882 1788803312.853016 read 0x02d650 thru 0x03b302 (0xdcb3 bytes) 000883 1788803312.865367 write 0x01ec74 thru 0x023f70 (0x52fd bytes) 000884 1788803312.866519 read 0x01ef28 thru 0x024ce7 (0x5dc0 bytes) 000885 1788803312.867058 mapwrite 0x02c59a thru 0x03c4d6 (0xff3d bytes) 000887 1788803312.932643 write 0x014be2 thru 0x01e81f (0x9c3e bytes) 000888 1788803312.933995 write 0x0289a3 thru 0x0299eb (0x1049 bytes) 000889 1788803312.937570 mapread 0x0241a4 thru 0x02d497 (0x92f4 bytes) 000891 1788803312.942320 mapread 0x03d583 thru 0x03ffff (0x2a7d bytes) 000892 1788803312.948955 mapread 0x01e3be thru 0x0291cf (0xae12 bytes) 000893 1788803312.953850 punch from 0x02b71d to 0x03ae59 (0xf73d bytes) 000894 1788803312.969919 read 0x029eb3 thru 0x034a1c (0xab6a bytes) 000895 1788803312.983367 mapwrite 0x003101 thru 0x004850 (0x1750 bytes) 000902 1788803313.041923 trunc from 0x040000 to 0x011296 (0x2ed69 bytes) 000903 1788803313.122457 MIRROR_RESYNC 7 mirrors 000904 1788803314.768846 read 0x00e3bd thru 0x011296 (0x2eda bytes) 000905 1788803314.778291 trunc from 0x011297 to 0x018eb3 (0x7c1d bytes) 000908 1788803314.937484 mapread 0x015d01 thru 0x018eb3 (0x31b3 bytes) 000909 1788803314.974001 mapread 0x00f708 thru 0x011c30 (0x2529 bytes) 000911 1788803314.987134 punch from 0x0088b9 to 0x017f96 (0xf6de bytes) 000913 1788803315.003489 trunc from 0x018eb4 to 0x01aaa4 (0x1bf1 bytes) 000916 1788803315.049516 write 0x01f772 thru 0x02eb35 (0xf3c4 bytes) 000918 1788803315.055735 trunc from 0x02eb36 to 0x03b1b5 (0xc680 bytes) 000919 1788803315.101188 MIRROR_RESYNC 7 mirrors 000920 1788803316.876756 write 0x012834 thru 0x0150cd (0x289a bytes) 000921 1788803316.978841 punch from 0x01e85c to 0x025868 (0x700d bytes) 000922 1788803316.990444 punch from 0x027331 to 0x033397 (0xc067 bytes) 000923 1788803317.001236 mapread 0x00f176 thru 0x01c177 (0xd002 bytes) 000925 1788803317.068553 write 0x02ccfd thru 0x02f10a (0x240e bytes) 000927 1788803317.095382 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b1b6): Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b1b6): Mirror 15: 0x4e750dcb (stale) Mirror 18: 0x4e750dcb (stale) Mirror 19: 0x4e750dcb (stale) Mirror 20: 0x4e750dcb (stale) Mirror 21: 0x4e750dcb (stale) Mirror 22: 0x4e750dcb (stale) CRC-32 checksum value for chunk [0, 0x3b1b6): Mirror 1: 0x9dc125bf Mirror 23: 0x9dc125bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b1b6: skipped 000928 1788803318.502216 trunc from 0x03b1b6 to 0x011973 (0x29842 bytes) 000930 1788803318.755384 write 0x01e4ab thru 0x020b0e (0x2664 bytes) 000931 1788803318.756423 mapread 0x0059ba thru 0x006f4e (0x1595 bytes) 000932 1788803318.781355 write 0x0208ad thru 0x022590 (0x1ce4 bytes) 000935 1788803318.783432 mapread 0x012f87 thru 0x01ad5b (0x7dd5 bytes) 000937 1788803318.818958 mapread 0x00cdd8 thru 0x019c49 (0xce72 bytes) 000938 1788803318.821581 read 0x00144f thru 0x007e44 (0x69f6 bytes) 000940 1788803318.849537 mapread 0x01a3bf thru 0x020a49 (0x668b bytes) 000941 1788803318.866841 trunc from 0x022591 to 0x02d106 (0xab76 bytes) 000943 1788803318.891519 write 0x03994d thru 0x03e720 (0x4dd4 bytes) 000945 1788803318.893802 punch from 0x03a98c to 0x03e720 (0x3d95 bytes) 000946 1788803318.905539 read 0x02458e thru 0x02df7e (0x99f1 bytes) 000948 1788803318.925845 write 0x03edcf thru 0x03ffff (0x1231 bytes) 000949 1788803318.926854 write 0x02efef thru 0x0314de (0x24f0 bytes) 000950 1788803318.928116 mapread 0x03efe7 thru 0x03f6df (0x6f9 bytes) 000951 1788803318.928992 write 0x01736c thru 0x026427 (0xf0bc bytes) 000953 1788803318.930945 read 0x00bd5d thru 0x00ead2 (0x2d76 bytes) 000955 1788803318.932230 mapwrite 0x00fc0b thru 0x013859 (0x3c4f bytes) 000956 1788803318.986595 mapwrite 0x021177 thru 0x0275c8 (0x6452 bytes) 000957 1788803319.041477 mapread 0x009be9 thru 0x00b8ea (0x1d02 bytes) 000958 1788803319.042598 mapwrite 0x003545 thru 0x00c1e7 (0x8ca3 bytes) 000959 1788803319.087443 punch from 0x001f7b to 0x004a4c (0x2ad2 bytes) 000960 1788803319.108097 MIRROR_RESYNC 8 mirrors 000962 1788803320.205598 read 0x03948b thru 0x03ffff (0x6b75 bytes) 000964 1788803320.215495 mapread 0x0126f6 thru 0x017b9d (0x54a8 bytes) 000966 1788803320.237689 trunc from 0x040000 to 0x02174e (0x1e8b1 bytes) 000967 1788803320.327733 punch from 0x003877 to 0x00494d (0x10d7 bytes) 000968 1788803320.331862 mapwrite 0x002458 thru 0x01110f (0xecb8 bytes) 000970 1788803320.406872 mapread 0x01c351 thru 0x01fbe6 (0x3896 bytes) 000971 1788803320.420098 mapwrite 0x00966e thru 0x01568e (0xc021 bytes) 000972 1788803320.473567 write 0x021cfc thru 0x02b749 (0x9a4e bytes) 000973 1788803320.475050 read 0x0148e0 thru 0x01a9a7 (0x60c8 bytes) 000975 1788803320.477346 punch from 0x00d1a1 to 0x01a93d (0xd79d bytes) 000977 1788803320.493609 read 0x019531 thru 0x01dc75 (0x4745 bytes) 000978 1788803320.501582 read 0x0290e6 thru 0x02a465 (0x1380 bytes) 000981 1788803320.503620 punch from 0x003c92 to 0x012093 (0xe402 bytes) 000983 1788803320.508071 mapwrite 0x038717 thru 0x039d63 (0x164d bytes) 000984 1788803320.569421 trunc from 0x039d64 to 0x021355 (0x18a0e bytes) 000985 1788803320.583740 trunc from 0x021356 to 0x009c0d (0x17748 bytes) 000986 1788803320.601679 read 0x0035d2 thru 0x009c0d (0x663c bytes) 000987 1788803320.602376 punch from 0x00794f to 0x008a61 (0x1113 bytes) 000988 1788803320.607083 read 0x008f9d thru 0x009c0d (0xc71 bytes) 000989 1788803320.612031 read 0x006533 thru 0x009c0d (0x36db bytes) 000990 1788803320.612702 punch from 0x0014fa to 0x001c47 (0x74e bytes) 000991 1788803320.616781 punch from 0x0016a9 to 0x0082c2 (0x6c1a bytes) 000992 1788803320.620720 punch from 0x004891 to 0x008070 (0x37e0 bytes) 000993 1788803320.624868 mapread 0x007d70 thru 0x009c0d (0x1e9e bytes) 000997 1788803320.633525 mapwrite 0x03fc27 thru 0x03ffff (0x3d9 bytes) 000998 1788803320.694064 mapwrite 0x0060ef thru 0x0092a4 (0x31b6 bytes) 000999 1788803320.733120 mapwrite 0x02b95c thru 0x038bb2 (0xd257 bytes) 001000 1788803320.788287 write 0x03ad7a thru 0x03d7d2 (0x2a59 bytes) All operations completed A-OK!