== sanity-flr test 70a: flr mode fsx test ================ 20:24:35 (1789518275) Seed set to 8276 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x27500 000002 1789518276.821705 trunc from 00000000 to 0x0274ff (0x27500 bytes) 000003 1789518276.834795 mapwrite 0x02033c thru 0x022b7f (0x2844 bytes) 000005 1789518276.889762 punch from 0x01e162 to 0x01f85d (0x16fc bytes) 000006 1789518276.893908 trunc from 0x027500 to 0x011be4 (0x1591b bytes) 000007 1789518276.913616 mapread 0x008577 thru 0x011be4 (0x966e bytes) 000009 1789518276.934540 read 0x011978 thru 0x011be4 (0x26d bytes) 000010 1789518276.935482 read 0x004883 thru 0x009e40 (0x55be bytes) truncating to largest ever: 0x2e028 000012 1789518276.936952 trunc from 0x011be5 to 0x02e027 (0x1c443 bytes) truncating to largest ever: 0x391b0 000013 1789518276.949659 trunc from 0x02e028 to 0x0391af (0xb188 bytes) 000014 1789518276.968037 mapwrite 0x020a2b thru 0x0259a5 (0x4f7b bytes) 000016 1789518277.024492 MIRROR_EXTEND to 2 mirrors 000017 1789518277.630077 write 0x002c9b thru 0x011cb9 (0xf01f bytes) 000018 1789518277.704485 mapread 0x01ca23 thru 0x02440b (0x79e9 bytes) 000019 1789518277.734141 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x391b0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x391b0): Mirror 2: 0xe52016ed (stale) CRC-32 checksum value for chunk [0, 0x391b0): Mirror 1: 0x1b7598dd Mirror 3: 0x1b7598dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x391b0: skipped 000020 1789518278.557391 read 0x02dba1 thru 0x0342a4 (0x6704 bytes) 000021 1789518278.570968 trunc from 0x0391b0 to 0x023fd0 (0x151df bytes) 000022 1789518278.660379 write 0x02c8f3 thru 0x0320c3 (0x57d1 bytes) 000023 1789518278.666167 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x320c4): Mirror 3: 0x4a47a7ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x320c4): Mirror 3: 0x4a47a7ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x320c4: skipped 000024 1789518278.974035 mapread 0x0069e2 thru 0x00e3a2 (0x79c1 bytes) 000027 1789518279.005327 mapread 0x02cf9f thru 0x0320c3 (0x5125 bytes) 000030 1789518279.020178 trunc from 0x0320c4 to 0x02ecd1 (0x33f2 bytes) 000031 1789518279.037255 trunc from 0x02ecd2 to 0x01221d (0x1cab4 bytes) 000032 1789518279.061348 mapread 0x00b9cd thru 0x00fa79 (0x40ad bytes) 000034 1789518279.064516 punch from 0x00c027 to 0x00f0e5 (0x30bf bytes) 000035 1789518279.074965 mapwrite 0x030d4b thru 0x037dc6 (0x707c bytes) 000036 1789518279.173198 read 0x001500 thru 0x0100b3 (0xebb4 bytes) truncating to largest ever: 0x39868 000039 1789518279.180471 trunc from 0x037dc7 to 0x039867 (0x1aa1 bytes) 000042 1789518279.199422 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39868): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39868): Mirror 3: 0x50303175 (stale) CRC-32 checksum value for chunk [0, 0x39868): Mirror 1: 0x6062b71b Mirror 4: 0x6062b71b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39868: skipped 000043 1789518279.891163 mapwrite 0x0292f0 thru 0x03042a (0x713b bytes) 000044 1789518280.038336 read 0x00354b thru 0x007f71 (0x4a27 bytes) 000046 1789518280.045541 punch from 0x02bfdf to 0x02c0d0 (0xf2 bytes) 000047 1789518280.053184 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39868): Mirror 4: 0x6062b71b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39868): Mirror 4: 0x6062b71b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39868: skipped 000048 1789518280.245307 trunc from 0x039868 to 0x023602 (0x16265 bytes) 000049 1789518280.268410 read 0x019087 thru 0x01d882 (0x47fc bytes) 000050 1789518280.273276 write 0x02f2dc thru 0x03f258 (0xff7d bytes) 000052 1789518280.278343 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) 000053 1789518280.382268 punch from 0x009c7e to 0x014476 (0xa7f9 bytes) 000054 1789518280.385838 trunc from 0x03f259 to 0x01404b (0x2b20d bytes) 000055 1789518280.400407 read 0x00838c thru 0x0109a4 (0x8619 bytes) 000056 1789518280.408807 read 0x0042d5 thru 0x009e9b (0x5bc7 bytes) 000057 1789518280.415458 punch from 0x013acf to 0x01404b (0x57d bytes) 000058 1789518280.420063 write 0x014d0d thru 0x01d519 (0x880d bytes) 000059 1789518280.425660 write 0x01c29f thru 0x029196 (0xcef8 bytes) 000062 1789518280.429086 read 0x016d63 thru 0x021885 (0xab23 bytes) 000066 1789518280.433707 mapread 0x01138c thru 0x0201d3 (0xee48 bytes) 000067 1789518280.441785 mapwrite 0x024d71 thru 0x02b637 (0x68c7 bytes) 000068 1789518280.499965 punch from 0x01bd13 to 0x02abd1 (0xeebf bytes) 000069 1789518280.505181 trunc from 0x02b638 to 0x0192f2 (0x12345 bytes) 000072 1789518280.518383 mapread 0x01907b thru 0x0192f2 (0x278 bytes) 000076 1789518280.520909 trunc from 0x0192f3 to 0x036a0d (0x1d71b bytes) 000078 1789518280.532803 mapwrite 0x03a808 thru 0x03f972 (0x516b bytes) 000079 1789518280.619650 write 0x017aec thru 0x022fcf (0xb4e4 bytes) 000081 1789518280.626077 mapwrite 0x00b519 thru 0x00bf38 (0xa20 bytes) 000084 1789518280.678843 read 0x0045f9 thru 0x009fad (0x59b5 bytes) 000085 1789518280.679431 write 0x01992d thru 0x020f6c (0x7640 bytes) 000087 1789518280.682673 read 0x015f99 thru 0x0175d1 (0x1639 bytes) 000088 1789518280.694033 MIRROR_EXTEND to 2 mirrors 000089 1789518281.375406 trunc from 0x03f973 to 0x02cfcd (0x129a5 bytes) 000090 1789518281.438249 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) 000091 1789518281.572194 write 0x01a100 thru 0x020e8f (0x6d90 bytes) 000092 1789518281.585509 punch from 0x01682b to 0x017d45 (0x151b bytes) 000094 1789518281.596892 mapwrite 0x027cb5 thru 0x02919e (0x14ea bytes) 000095 1789518281.674981 MIRROR_EXTEND to 2 mirrors 000097 1789518282.390857 trunc from 0x02cfce to 0x010343 (0x1cc8a bytes) 000099 1789518282.468746 read 0x000fa7 thru 0x00b0dc (0xa136 bytes) 000101 1789518282.477881 trunc from 0x010344 to 0x030ee8 (0x20ba5 bytes) 000102 1789518282.496766 punch from 0x01b53d to 0x01f820 (0x42e4 bytes) 000103 1789518282.500978 punch from 0x02e893 to 0x030ee8 (0x2656 bytes) 000104 1789518282.504917 read 0x01d344 thru 0x02c690 (0xf34d bytes) 000105 1789518282.512074 write 0x021604 thru 0x02b153 (0x9b50 bytes) 000107 1789518282.514547 trunc from 0x030ee9 to 0x01d8d8 (0x13610 bytes) 000109 1789518282.529697 write 0x032a01 thru 0x03481a (0x1e1a bytes) 000110 1789518282.530699 mapread 0x008119 thru 0x01577c (0xd664 bytes) 000111 1789518282.531664 mapread 0x01c0d8 thru 0x02aca1 (0xebca bytes) 000112 1789518282.589446 write 0x006163 thru 0x00c315 (0x61b3 bytes) 000113 1789518282.591505 read 0x01b260 thru 0x02273b (0x74dc bytes) 000114 1789518282.596169 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) 000117 1789518282.733533 mapwrite 0x01cec8 thru 0x024135 (0x726e bytes) 000118 1789518282.807869 write 0x00c017 thru 0x0163c9 (0xa3b3 bytes) 000119 1789518282.817047 read 0x0337da thru 0x03481a (0x1041 bytes) 000120 1789518282.822140 write 0x038ba4 thru 0x038ec9 (0x326 bytes) 000121 1789518282.823169 mapread 0x027ed3 thru 0x034cb4 (0xcde2 bytes) 000122 1789518282.839979 mapwrite 0x020ec2 thru 0x0252fe (0x443d bytes) 000123 1789518282.891011 read 0x028b03 thru 0x02f6af (0x6bad bytes) 000125 1789518282.892266 punch from 0x02bd2b to 0x038ec9 (0xd19f bytes) 000127 1789518282.900377 write 0x012f16 thru 0x013662 (0x74d bytes) 000129 1789518282.902054 trunc from 0x038eca to 0x0038d9 (0x355f0 bytes) 000133 1789518282.918385 trunc from 0x0038da to 0x00ad88 (0x74af bytes) 000134 1789518282.933239 write 0x00c9c3 thru 0x01b25c (0xe89a bytes) 000136 1789518282.936073 punch from 0x0078ec to 0x007ab1 (0x1c6 bytes) 000137 1789518282.949552 write 0x03c795 thru 0x03ffff (0x386b bytes) 000139 1789518282.951429 mapread 0x013276 thru 0x02233b (0xf0c6 bytes) 000140 1789518282.966626 mapread 0x01f85c thru 0x02af55 (0xb6fa bytes) 000141 1789518282.967266 punch from 0x00d72c to 0x0164a4 (0x8d79 bytes) 000144 1789518282.980251 mapread 0x01313f thru 0x017d71 (0x4c33 bytes) 000147 1789518282.998795 mapread 0x034a47 thru 0x036393 (0x194d bytes) 000148 1789518283.004692 MIRROR_EXTEND to 2 mirrors 000149 1789518283.773682 write 0x0283ad thru 0x035b1b (0xd76f bytes) 000152 1789518283.833929 write 0x002a3a thru 0x011b79 (0xf140 bytes) 000156 1789518283.843159 mapread 0x01651e thru 0x01a6c3 (0x41a6 bytes) 000157 1789518283.863594 write 0x00cc73 thru 0x017134 (0xa4c2 bytes) 000159 1789518283.865601 punch from 0x01b7e0 to 0x0228ff (0x7120 bytes) 000160 1789518283.877726 punch from 0x01ac7b to 0x01b1c1 (0x547 bytes) 000161 1789518283.882459 mapread 0x033bda thru 0x037d19 (0x4140 bytes) 000162 1789518283.889318 trunc from 0x040000 to 0x026e5e (0x191a1 bytes) 000163 1789518283.911305 write 0x00c51f thru 0x01ad7b (0xe85d bytes) 000165 1789518283.918871 mapwrite 0x000317 thru 0x00b1ae (0xae98 bytes) 000166 1789518283.985595 mapwrite 0x033110 thru 0x03dcd5 (0xabc6 bytes) 000167 1789518284.057120 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3dcd6): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dcd6): Mirror 2: 0xf683c52e (stale) CRC-32 checksum value for chunk [0, 0x3dcd6): Mirror 1: 0x57bc06ed Mirror 3: 0x57bc06ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dcd6: skipped 000170 1789518284.775924 mapread 0x028870 thru 0x029707 (0xe98 bytes) 000171 1789518284.806013 mapread 0x03b43b thru 0x03dcd5 (0x289b bytes) 000172 1789518284.833300 mapwrite 0x02ea9c thru 0x03b08b (0xc5f0 bytes) 000173 1789518285.032363 write 0x02156a thru 0x029867 (0x82fe bytes) 000175 1789518285.045387 read 0x035733 thru 0x036571 (0xe3f bytes) truncating to largest ever: 0x3a3f9 000176 1789518285.048409 trunc from 0x03dcd6 to 0x03a3f8 (0x38dd bytes) 000178 1789518285.077859 read 0x006776 thru 0x00c0b4 (0x593f bytes) 000180 1789518285.091363 punch from 0x036829 to 0x03a3f8 (0x3bd0 bytes) 000181 1789518285.108047 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a3f9): Mirror 3: 0x37fa98a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3f9): Mirror 3: 0x37fa98a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3f9: skipped 000182 1789518285.312619 mapread 0x010088 thru 0x011c8b (0x1c04 bytes) 000183 1789518285.327805 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) 000185 1789518285.444231 mapread 0x0229f9 thru 0x02fbfc (0xd204 bytes) 000186 1789518285.470951 mapread 0x00f9e2 thru 0x011acc (0x20eb bytes) 000187 1789518285.480090 read 0x00d83a thru 0x0189e2 (0xb1a9 bytes) 000190 1789518285.493279 write 0x02c10d thru 0x02d5da (0x14ce bytes) 000193 1789518285.495329 write 0x004d57 thru 0x00e0a6 (0x9350 bytes) 000194 1789518285.501243 read 0x018abc thru 0x01d62f (0x4b74 bytes) 000195 1789518285.515901 trunc from 0x03a3f9 to 0x0343fb (0x5ffd bytes) 000204 1789518285.535752 mapwrite 0x00dfdd thru 0x01b3f6 (0xd41a bytes) 000205 1789518285.578501 read 0x00620d thru 0x014c79 (0xea6d bytes) 000206 1789518285.581142 write 0x03d567 thru 0x03ffff (0x2a99 bytes) 000207 1789518285.583018 trunc from 0x040000 to 0x030594 (0xfa6b bytes) 000208 1789518285.599027 mapwrite 0x02d411 thru 0x03c316 (0xef06 bytes) 000210 1789518285.670487 mapread 0x006255 thru 0x0156bc (0xf468 bytes) 000213 1789518285.672555 mapread 0x030071 thru 0x038802 (0x8792 bytes) 000214 1789518285.677192 MIRROR_EXTEND to 2 mirrors 000215 1789518286.312665 mapwrite 0x0071e5 thru 0x0157bc (0xe5d8 bytes) 000216 1789518286.434552 mapwrite 0x02479c thru 0x027e73 (0x36d8 bytes) 000217 1789518286.472773 read 0x03540a thru 0x03c316 (0x6f0d bytes) 000219 1789518286.481230 punch from 0x03b63b to 0x03c316 (0xcdc bytes) 000220 1789518286.491228 write 0x01c54a thru 0x0243e7 (0x7e9e bytes) 000221 1789518286.498263 trunc from 0x03c317 to 0x009de5 (0x32531 bytes) 000222 1789518286.514399 trunc from 0x009de6 to 0x024bb7 (0x1add2 bytes) 000224 1789518286.537740 mapread 0x023d4a thru 0x024bb7 (0xe6e bytes) 000226 1789518286.550473 read 0x011683 thru 0x016c3c (0x55ba bytes) 000227 1789518286.560679 punch from 0x00bab9 to 0x013cba (0x8202 bytes) 000228 1789518286.566200 write 0x00cebb thru 0x016d92 (0x9ed8 bytes) 000229 1789518286.572677 punch from 0x01c7cb to 0x024263 (0x7a99 bytes) 000231 1789518286.591265 mapread 0x00899c thru 0x00a17c (0x17e1 bytes) 000233 1789518286.592846 read 0x00d379 thru 0x0198f0 (0xc578 bytes) 000235 1789518286.594137 mapread 0x01f9bf thru 0x024bb7 (0x51f9 bytes) 000237 1789518286.604426 mapwrite 0x002e25 thru 0x00cb2c (0x9d08 bytes) 000238 1789518286.650106 MIRROR_RESYNC 2 mirrors 000239 1789518287.232138 read 0x0126a8 thru 0x01855f (0x5eb8 bytes) 000240 1789518287.239306 read 0x0129bf thru 0x01812e (0x5770 bytes) 000241 1789518287.240064 mapwrite 0x020dc9 thru 0x02724b (0x6483 bytes) 000242 1789518287.353215 mapread 0x022606 thru 0x02724b (0x4c46 bytes) 000243 1789518287.354376 read 0x00d398 thru 0x00f5a2 (0x220b bytes) 000244 1789518287.355593 read 0x01bf55 thru 0x022493 (0x653f bytes) 000245 1789518287.356185 write 0x02a857 thru 0x03526e (0xaa18 bytes) 000246 1789518287.357512 mapread 0x01c2b1 thru 0x027b44 (0xb894 bytes) 000247 1789518287.360103 mapwrite 0x0364e7 thru 0x03ffff (0x9b19 bytes) 000248 1789518287.420797 mapread 0x01e896 thru 0x02748d (0x8bf8 bytes) 000252 1789518287.422795 read 0x03b6fa thru 0x03ffff (0x4906 bytes) 000253 1789518287.423618 read 0x00898c thru 0x00ea64 (0x60d9 bytes) 000254 1789518287.424209 punch from 0x00069d to 0x01034f (0xfcb3 bytes) 000255 1789518287.429763 write 0x0364f5 thru 0x037e7e (0x198a bytes) 000256 1789518287.430770 mapwrite 0x0197f2 thru 0x024fe2 (0xb7f1 bytes) 000258 1789518287.473238 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe903a3a5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa1c0e57 Mirror 3: 0xa1c0e57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000259 1789518288.191988 write 0x00fab2 thru 0x01c0ad (0xc5fc bytes) 000261 1789518288.260807 read 0x01e907 thru 0x0228d2 (0x3fcc bytes) 000264 1789518288.268673 mapread 0x00dd9a thru 0x016e57 (0x90be bytes) 000265 1789518288.277059 write 0x010fc3 thru 0x01a456 (0x9494 bytes) 000266 1789518288.279339 mapread 0x036b7b thru 0x03ffff (0x9485 bytes) 000268 1789518288.302521 punch from 0x01ce1d to 0x023f2b (0x710f bytes) 000269 1789518288.318311 mapwrite 0x00bbfb thru 0x00ed4a (0x3150 bytes) 000272 1789518288.376758 trunc from 0x040000 to 0x02620a (0x19df5 bytes) 000274 1789518288.420720 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2620b): Mirror 2: 0x8a2e8102 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2620b): Mirror 2: 0x8a2e8102 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2620b: skipped 000275 1789518288.640545 mapread 0x025fb4 thru 0x02620a (0x257 bytes) 000277 1789518288.650070 write 0x0044ce thru 0x00fd41 (0xb874 bytes) 000278 1789518288.659081 punch from 0x00aa0f to 0x00ce6d (0x245f bytes) 000279 1789518288.671961 write 0x012e89 thru 0x021539 (0xe6b1 bytes) 000280 1789518288.680651 mapwrite 0x03ac07 thru 0x03d18d (0x2587 bytes) 000281 1789518288.746020 read 0x033ae5 thru 0x03d18d (0x96a9 bytes) 000282 1789518288.747020 mapread 0x0047d7 thru 0x005a52 (0x127c bytes) 000283 1789518288.747959 read 0x01ac0a thru 0x01d09f (0x2496 bytes) 000286 1789518288.749506 mapread 0x0247d5 thru 0x033e5f (0xf68b bytes) 000287 1789518288.760741 mapread 0x008648 thru 0x0114bb (0x8e74 bytes) 000289 1789518288.767345 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d18e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d18e): Mirror 2: 0xa8179c54 (stale) CRC-32 checksum value for chunk [0, 0x3d18e): Mirror 1: 0x5bd2e882 Mirror 3: 0x5bd2e882 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d18e: skipped 000290 1789518289.509739 punch from 0x00f63b to 0x01c38f (0xcd55 bytes) 000291 1789518289.574519 mapread 0x016ae2 thru 0x024d15 (0xe234 bytes) 000292 1789518289.608878 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d18e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d18e): Mirror 2: 0xa8179c54 (stale) Mirror 3: 0x5bd2e882 (stale) CRC-32 checksum value for chunk [0, 0x3d18e): Mirror 1: 0x266d65ec Mirror 4: 0x266d65ec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d18e: skipped 000293 1789518290.441710 trunc from 0x03d18e to 0x000f97 (0x3c1f6 bytes) 000294 1789518290.532034 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xf98): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf98): Mirror 2: 0xddd81124 (stale) Mirror 3: 0xe7a4d480 (stale) Mirror 4: 0xe7a4d480 (stale) CRC-32 checksum value for chunk [0, 0xf98): Mirror 1: 0xe7a4d480 Mirror 5: 0xe7a4d480 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf98: skipped 000296 1789518291.251725 mapwrite 0x03bbca thru 0x03ffff (0x4436 bytes) 000298 1789518291.390467 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd72d10d7 (stale) Mirror 4: 0x757374d7 (stale) Mirror 5: 0xee5f840 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd72d10d7 (stale) Mirror 4: 0x757374d7 (stale) Mirror 5: 0xee5f840 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000299 1789518291.693512 mapwrite 0x02699e thru 0x02dfe5 (0x7648 bytes) 000300 1789518291.759964 mapwrite 0x017183 thru 0x01d02d (0x5eab bytes) 000302 1789518291.805401 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd72d10d7 (stale) Mirror 4: 0x757374d7 (stale) Mirror 5: 0xee5f840 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xee5b6436 Mirror 6: 0xee5b6436 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000306 1789518292.734721 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd72d10d7 (stale) Mirror 4: 0x757374d7 (stale) Mirror 5: 0xee5f840 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xee5b6436 Mirror 6: 0xee5b6436 Mirror 7: 0xee5b6436 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000308 1789518293.439781 mapwrite 0x0059b7 thru 0x01304f (0xd699 bytes) 000309 1789518293.581897 mapread 0x00f3d7 thru 0x01d1e9 (0xde13 bytes) 000310 1789518293.598905 write 0x0089a0 thru 0x014f0f (0xc570 bytes) 000311 1789518293.600477 trunc from 0x040000 to 0x01046b (0x2fb94 bytes) 000314 1789518293.625748 mapread 0x00e939 thru 0x01046b (0x1b33 bytes) 000315 1789518293.627020 punch from 0x0099a6 to 0x00e6e0 (0x4d3b bytes) 000316 1789518293.648967 MIRROR_RESYNC 6 mirrors 000317 1789518294.444524 write 0x02e5c8 thru 0x032e7b (0x48b4 bytes) 000318 1789518294.491153 mapwrite 0x02c727 thru 0x0307c3 (0x409d bytes) 000319 1789518294.543058 mapread 0x002ad3 thru 0x0069b2 (0x3ee0 bytes) 000320 1789518294.553825 read 0x000d28 thru 0x002621 (0x18fa bytes) 000321 1789518294.558262 punch from 0x0070d7 to 0x00b13b (0x4065 bytes) 000322 1789518294.566971 MIRROR_RESYNC 6 mirrors 000323 1789518295.611045 mapread 0x01ac91 thru 0x027dca (0xd13a bytes) 000325 1789518295.637819 MIRROR_EXTEND to 7 mirrors 000326 1789518296.206691 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) 000327 1789518296.474639 write 0x03e82b thru 0x03ffff (0x17d5 bytes) 000328 1789518296.523268 mapwrite 0x02d66a thru 0x031def (0x4786 bytes) 000329 1789518296.577528 mapread 0x00d4cb thru 0x0110cc (0x3c02 bytes) 000331 1789518296.588478 mapwrite 0x029ec8 thru 0x029f3b (0x74 bytes) 000332 1789518296.635709 trunc from 0x040000 to 0x01fa28 (0x205d7 bytes) 000333 1789518296.659836 trunc from 0x01fa29 to 0x0324d5 (0x12aad bytes) 000334 1789518296.682228 mapread 0x02e26c thru 0x0324d5 (0x426a bytes) 000336 1789518296.691756 mapwrite 0x0382fe thru 0x03ffff (0x7d02 bytes) 000337 1789518296.760482 trunc from 0x040000 to 0x002a34 (0x3d5cb bytes) 000338 1789518296.779207 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2a35): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a35): Mirror 3: 0xb149a8c7 (stale) Mirror 4: 0xb149a8c7 (stale) Mirror 5: 0xb149a8c7 (stale) Mirror 7: 0xb149a8c7 (stale) Mirror 8: 0xb149a8c7 (stale) CRC-32 checksum value for chunk [0, 0x2a35): Mirror 1: 0xb149a8c7 Mirror 9: 0xb149a8c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a35: skipped 000339 1789518297.473630 read 0x001857 thru 0x002a34 (0x11de bytes) 000340 1789518297.482945 MIRROR_RESYNC 7 mirrors 000341 1789518298.154108 MIRROR_EXTEND to 8 mirrors 000342 1789518298.607761 punch from 0x0002fb to 0x002a34 (0x273a bytes) 000346 1789518298.679842 mapwrite 0x01b608 thru 0x021f51 (0x694a bytes) 000350 1789518298.760628 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21f52): Mirror 3: 0x539552a7 (stale) Mirror 5: 0x539552a7 (stale) Mirror 7: 0x539552a7 (stale) Mirror 8: 0x539552a7 (stale) Mirror 9: 0x539552a7 (stale) Mirror 10: 0x539552a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f52): Mirror 3: 0x539552a7 (stale) Mirror 5: 0x539552a7 (stale) Mirror 7: 0x539552a7 (stale) Mirror 8: 0x539552a7 (stale) Mirror 9: 0x539552a7 (stale) Mirror 10: 0x539552a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f52: skipped 000352 1789518299.050276 read 0x015a7e thru 0x021f51 (0xc4d4 bytes) 000354 1789518299.064483 MIRROR_RESYNC 7 mirrors 000355 1789518300.258826 mapread 0x00eb33 thru 0x00fcfa (0x11c8 bytes) 000356 1789518300.267823 punch from 0x01b099 to 0x021f51 (0x6eb9 bytes) 000358 1789518300.322989 punch from 0x01f1a4 to 0x021f51 (0x2dae bytes) 000360 1789518300.328061 punch from 0x01c65d to 0x01dc9a (0x163e bytes) 000362 1789518300.341527 MIRROR_RESYNC 7 mirrors 000363 1789518301.575978 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) 000364 1789518301.768204 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) 000366 1789518301.958213 MIRROR_RESYNC 5 mirrors 000368 1789518302.197035 mapwrite 0x0257f7 thru 0x02e256 (0x8a60 bytes) 000369 1789518302.343592 read 0x0089bc thru 0x01289a (0x9edf bytes) 000370 1789518302.353157 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e257): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e257): Mirror 7: 0x2944714b (stale) Mirror 8: 0x2944714b (stale) Mirror 9: 0x2944714b (stale) Mirror 10: 0x2944714b (stale) CRC-32 checksum value for chunk [0, 0x2e257): Mirror 1: 0x8c8be896 Mirror 11: 0x8c8be896 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e257: skipped 000371 1789518303.003331 mapread 0x023d2e thru 0x027e2c (0x40ff bytes) 000372 1789518303.032531 mapread 0x004534 thru 0x0138b5 (0xf382 bytes) 000373 1789518303.060351 read 0x00c3f3 thru 0x00f73f (0x334d bytes) 000374 1789518303.068772 mapwrite 0x03a95c thru 0x03e4c8 (0x3b6d bytes) 000375 1789518303.185901 write 0x03c21b thru 0x03ffff (0x3de5 bytes) 000377 1789518303.187378 mapread 0x013b2c thru 0x01c8d1 (0x8da6 bytes) 000378 1789518303.197358 mapwrite 0x02b819 thru 0x02d494 (0x1c7c bytes) 000379 1789518303.234851 trunc from 0x040000 to 0x035a86 (0xa579 bytes) 000381 1789518303.256898 trunc from 0x035a87 to 0x036f29 (0x14a3 bytes) 000383 1789518303.270214 read 0x0224b2 thru 0x02420a (0x1d59 bytes) 000384 1789518303.275635 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36f2a): Mirror 7: 0x19f4be1b (stale) Mirror 8: 0x19f4be1b (stale) Mirror 10: 0x19f4be1b (stale) Mirror 11: 0x4f139e6e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f2a): Mirror 7: 0x19f4be1b (stale) Mirror 8: 0x19f4be1b (stale) Mirror 10: 0x19f4be1b (stale) Mirror 11: 0x4f139e6e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f2a: skipped 000385 1789518303.516850 punch from 0x0213e6 to 0x026415 (0x5030 bytes) 000388 1789518303.522332 mapread 0x02d6c2 thru 0x036f29 (0x9868 bytes) 000390 1789518303.539996 trunc from 0x036f2a to 0x001499 (0x35a90 bytes) 000391 1789518303.553557 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x149a): Mirror 8: 0x87b1c2c6 (stale) Mirror 10: 0x87b1c2c6 (stale) Mirror 11: 0x87b1c2c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x149a): Mirror 8: 0x87b1c2c6 (stale) Mirror 10: 0x87b1c2c6 (stale) Mirror 11: 0x87b1c2c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x149a: skipped 000392 1789518303.762946 mapwrite 0x01cba3 thru 0x02aebd (0xe31b bytes) 000395 1789518303.827904 mapread 0x01b2f6 thru 0x026120 (0xae2b bytes) 000396 1789518303.828784 punch from 0x022f89 to 0x02aebd (0x7f35 bytes) 000397 1789518303.834608 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2aebe): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aebe): Mirror 8: 0xf3f28b0e (stale) Mirror 10: 0xf3f28b0e (stale) Mirror 11: 0xc865cf1 (stale) CRC-32 checksum value for chunk [0, 0x2aebe): Mirror 1: 0x3edf27f9 Mirror 12: 0x3edf27f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aebe: skipped truncating to largest ever: 0x3cb0b 000399 1789518304.633199 trunc from 0x02aebe to 0x03cb0a (0x11c4d bytes) 000400 1789518304.707251 MIRROR_RESYNC 5 mirrors 000401 1789518305.765855 mapwrite 0x010b71 thru 0x0162c3 (0x5753 bytes) 000403 1789518305.886445 mapread 0x01247e thru 0x01fdab (0xd92e bytes) 000404 1789518305.895548 MIRROR_RESYNC 5 mirrors 000405 1789518307.074041 read 0x01434f thru 0x01d148 (0x8dfa bytes) 000407 1789518307.081725 mapwrite 0x03d274 thru 0x03ffff (0x2d8c bytes) 000408 1789518307.221273 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x1e1704ba (stale) Mirror 11: 0x1e1704ba (stale) Mirror 12: 0x1e1704ba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x1e1704ba (stale) Mirror 11: 0x1e1704ba (stale) Mirror 12: 0x1e1704ba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000410 1789518307.516440 write 0x012635 thru 0x01529e (0x2c6a bytes) 000411 1789518307.531322 punch from 0x00a711 to 0x014ed4 (0xa7c4 bytes) 000413 1789518307.546423 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x1e1704ba (stale) Mirror 11: 0x1e1704ba (stale) Mirror 12: 0x1e1704ba (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xafa1ef32 Mirror 13: 0xafa1ef32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000414 1789518308.375784 mapwrite 0x022f01 thru 0x02ea8e (0xbb8e bytes) 000416 1789518308.532121 trunc from 0x040000 to 0x00b39f (0x34c60 bytes) 000417 1789518308.554624 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb3a0): Mirror 10: 0x401df60a (stale) Mirror 11: 0x401df60a (stale) Mirror 12: 0x401df60a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb3a0): Mirror 10: 0x401df60a (stale) Mirror 11: 0x401df60a (stale) Mirror 12: 0x401df60a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb3a0: skipped 000419 1789518308.823483 punch from 0x006b8a to 0x00b39f (0x4816 bytes) 000421 1789518308.829455 mapwrite 0x038aa1 thru 0x03b814 (0x2d74 bytes) 000422 1789518308.901968 read 0x007559 thru 0x013932 (0xc3da bytes) 000424 1789518308.914062 write 0x01d220 thru 0x028e24 (0xbc05 bytes) 000425 1789518308.924047 read 0x0041bb thru 0x009d8f (0x5bd5 bytes) 000426 1789518308.935377 trunc from 0x03b815 to 0x019ce7 (0x21b2d bytes) 000427 1789518308.951488 mapwrite 0x009f02 thru 0x009f48 (0x47 bytes) 000428 1789518308.987885 mapread 0x011186 thru 0x017ab1 (0x692c bytes) 000429 1789518308.988860 trunc from 0x019ce8 to 0x00210e (0x17bd9 bytes) 000431 1789518309.008279 write 0x022b6a thru 0x02936e (0x6805 bytes) 000432 1789518309.009933 mapread 0x022dbb thru 0x02936e (0x65b4 bytes) 000434 1789518309.011469 read 0x008b92 thru 0x00973e (0xbad bytes) 000435 1789518309.020374 mapwrite 0x01868f thru 0x02135f (0x8cd1 bytes) 000437 1789518309.071382 MIRROR_RESYNC 4 mirrors 000438 1789518309.895808 read 0x018f53 thru 0x025515 (0xc5c3 bytes) 000440 1789518309.903507 write 0x01b255 thru 0x01e65f (0x340b bytes) 000443 1789518309.962931 mapread 0x021496 thru 0x02308c (0x1bf7 bytes) 000444 1789518309.980548 write 0x03eb57 thru 0x03ffff (0x14a9 bytes) 000445 1789518309.981902 read 0x02a3d5 thru 0x03014f (0x5d7b bytes) 000446 1789518309.991952 punch from 0x03bd94 to 0x03ffff (0x426c bytes) 000447 1789518310.006375 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8d190acb (stale) Mirror 11: 0x8d190acb (stale) Mirror 12: 0x8d190acb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1d1f1e20 Mirror 13: 0x1d1f1e20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000448 1789518310.743076 write 0x018a71 thru 0x018b78 (0x108 bytes) 000449 1789518310.812706 mapread 0x014f71 thru 0x01dfca (0x905a bytes) 000453 1789518310.827288 mapwrite 0x001d51 thru 0x00c34b (0xa5fb bytes) 000456 1789518310.871924 write 0x011e73 thru 0x015f52 (0x40e0 bytes) 000457 1789518310.873444 punch from 0x022ee1 to 0x030718 (0xd838 bytes) 000459 1789518310.892229 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8d190acb (stale) Mirror 11: 0x8d190acb (stale) Mirror 12: 0x8d190acb (stale) Mirror 13: 0x1d1f1e20 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x970b68cd Mirror 14: 0x970b68cd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000460 1789518311.684500 mapread 0x00fda6 thru 0x016f12 (0x716d bytes) 000462 1789518311.727191 mapwrite 0x03242e thru 0x03e621 (0xc1f4 bytes) 000463 1789518311.903793 read 0x019f7e thru 0x02504a (0xb0cd bytes) 000466 1789518311.920443 read 0x038a34 thru 0x03ffff (0x75cc bytes) 000467 1789518311.926651 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8d190acb (stale) Mirror 11: 0x8d190acb (stale) Mirror 12: 0x8d190acb (stale) Mirror 13: 0x1d1f1e20 (stale) Mirror 14: 0x970b68cd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb164a814 Mirror 15: 0xb164a814 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000468 1789518312.719471 write 0x0157b5 thru 0x023458 (0xdca4 bytes) 000469 1789518312.811729 read 0x001ab2 thru 0x0025e0 (0xb2f bytes) 000470 1789518312.817957 trunc from 0x040000 to 0x0360d8 (0x9f27 bytes) 000472 1789518312.847698 mapwrite 0x03f08f thru 0x03ffff (0xf71 bytes) 000473 1789518312.924462 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8d190acb (stale) Mirror 11: 0x8d190acb (stale) Mirror 12: 0x8d190acb (stale) Mirror 13: 0x1d1f1e20 (stale) Mirror 14: 0x970b68cd (stale) Mirror 15: 0xb164a814 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf9579601 Mirror 16: 0xf9579601 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000475 1789518313.817026 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8d190acb (stale) Mirror 11: 0x8d190acb (stale) Mirror 13: 0x1d1f1e20 (stale) Mirror 14: 0x970b68cd (stale) Mirror 15: 0xb164a814 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8d190acb (stale) Mirror 11: 0x8d190acb (stale) Mirror 13: 0x1d1f1e20 (stale) Mirror 14: 0x970b68cd (stale) Mirror 15: 0xb164a814 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf9579601 Mirror 16: 0xf9579601 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000476 1789518314.291040 mapwrite 0x018caf thru 0x01b34f (0x26a1 bytes) 000478 1789518314.441917 mapread 0x00ce2e thru 0x018a53 (0xbc26 bytes) 000479 1789518314.455679 mapwrite 0x005e6a thru 0x009974 (0x3b0b bytes) 000480 1789518314.496049 write 0x021d7c thru 0x0266fa (0x497f bytes) 000483 1789518314.505370 MIRROR_RESYNC 7 mirrors 000484 1789518316.077919 trunc from 0x040000 to 0x035b09 (0xa4f6 bytes) 000485 1789518316.137188 write 0x022d07 thru 0x032611 (0xf90b bytes) 000487 1789518316.147755 punch from 0x03165b to 0x035b09 (0x44af bytes) 000488 1789518316.161137 punch from 0x0346f0 to 0x035b09 (0x141a bytes) 000489 1789518316.164836 trunc from 0x035b0a to 0x029085 (0xca84 bytes) 000490 1789518316.179400 trunc from 0x029086 to 0x02212f (0x6f56 bytes) 000491 1789518316.189631 punch from 0x00f3ef to 0x018062 (0x8c74 bytes) 000493 1789518316.195489 write 0x003f72 thru 0x0114f0 (0xd57f bytes) 000494 1789518316.209532 punch from 0x01c188 to 0x01fb88 (0x3a01 bytes) 000497 1789518316.222838 punch from 0x021656 to 0x02212f (0xada bytes) 000498 1789518316.227916 punch from 0x01de33 to 0x02212f (0x42fd bytes) 000499 1789518316.232606 punch from 0x0132fc to 0x020aeb (0xd7f0 bytes) 000500 1789518316.242793 punch from 0x01fcd3 to 0x02212f (0x245d bytes) 000501 1789518316.250694 mapread 0x02012b thru 0x0205bc (0x492 bytes) 000504 1789518316.256967 write 0x03b03a thru 0x03ffff (0x4fc6 bytes) 000505 1789518316.258481 mapwrite 0x0266a8 thru 0x02ab02 (0x445b bytes) 000506 1789518316.317227 trunc from 0x040000 to 0x0350fb (0xaf04 bytes) 000508 1789518316.330761 mapwrite 0x02d8dd thru 0x03d865 (0xff89 bytes) 000509 1789518316.428939 mapread 0x02e620 thru 0x02ea78 (0x459 bytes) 000510 1789518316.429928 trunc from 0x03d866 to 0x0271f8 (0x1666d bytes) 000511 1789518316.444821 trunc from 0x0271f9 to 0x028edd (0x1ce5 bytes) truncating to largest ever: 0x3f384 000513 1789518316.463709 trunc from 0x028ede to 0x03f383 (0x164a6 bytes) 000515 1789518316.477689 read 0x007796 thru 0x00b3dd (0x3c48 bytes) 000517 1789518316.478852 read 0x012924 thru 0x01ff31 (0xd60e bytes) 000518 1789518316.489811 trunc from 0x03f384 to 0x018ac8 (0x268bb bytes) 000519 1789518316.505646 MIRROR_RESYNC 7 mirrors 000522 1789518317.383001 mapwrite 0x0380af thru 0x03ffff (0x7f51 bytes) 000523 1789518317.499063 write 0x00a0c8 thru 0x010ff1 (0x6f2a bytes) 000524 1789518317.508484 write 0x02af37 thru 0x03814b (0xd215 bytes) 000525 1789518317.515547 write 0x021267 thru 0x02be67 (0xac01 bytes) 000531 1789518317.526664 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x5ecfdff9 (stale) Mirror 11: 0x5ecfdff9 (stale) Mirror 13: 0x5ecfdff9 (stale) Mirror 14: 0x5ecfdff9 (stale) Mirror 16: 0x5ecfdff9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x5ecfdff9 (stale) Mirror 11: 0x5ecfdff9 (stale) Mirror 13: 0x5ecfdff9 (stale) Mirror 14: 0x5ecfdff9 (stale) Mirror 16: 0x5ecfdff9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000532 1789518317.856403 read 0x008912 thru 0x00a897 (0x1f86 bytes) 000533 1789518317.866008 write 0x035b44 thru 0x03ffff (0xa4bc bytes) 000535 1789518317.876420 punch from 0x02f8c6 to 0x037e8f (0x85ca bytes) 000536 1789518317.893344 mapwrite 0x013b9e thru 0x0173db (0x383e bytes) 000537 1789518317.961819 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x5ecfdff9 (stale) Mirror 13: 0x5ecfdff9 (stale) Mirror 14: 0x5ecfdff9 (stale) Mirror 16: 0x5ecfdff9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x5ecfdff9 (stale) Mirror 13: 0x5ecfdff9 (stale) Mirror 14: 0x5ecfdff9 (stale) Mirror 16: 0x5ecfdff9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000538 1789518318.252261 mapwrite 0x0156ac thru 0x022eb8 (0xd80d bytes) 000539 1789518318.333274 mapwrite 0x031baa thru 0x03df58 (0xc3af bytes) 000540 1789518318.378068 read 0x007dd5 thru 0x012ba5 (0xadd1 bytes) 000541 1789518318.386874 trunc from 0x040000 to 0x00d100 (0x32eff bytes) 000542 1789518318.401787 mapread 0x0012fc thru 0x007e98 (0x6b9d bytes) 000543 1789518318.410093 read 0x00ba0c thru 0x00d100 (0x16f5 bytes) 000544 1789518318.410773 read 0x006034 thru 0x00d100 (0x70cd bytes) 000547 1789518318.412248 write 0x00b075 thru 0x00c0f8 (0x1084 bytes) 000548 1789518318.416898 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd101): Mirror 11: 0x6633941b (stale) Mirror 13: 0x6633941b (stale) Mirror 14: 0x6633941b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd101): Mirror 11: 0x6633941b (stale) Mirror 13: 0x6633941b (stale) Mirror 14: 0x6633941b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd101: skipped 000550 1789518318.700193 mapread 0x005c71 thru 0x00af34 (0x52c4 bytes) 000551 1789518318.725729 trunc from 0x00d101 to 0x01069b (0x359b bytes) 000553 1789518318.744532 trunc from 0x01069c to 0x02591d (0x15282 bytes) 000554 1789518318.757847 mapread 0x011c69 thru 0x01ffa1 (0xe339 bytes) 000555 1789518318.771148 mapwrite 0x03a757 thru 0x03b166 (0xa10 bytes) 000556 1789518318.835421 mapread 0x02400f thru 0x02fb67 (0xbb59 bytes) 000557 1789518318.852799 trunc from 0x03b167 to 0x014ad9 (0x2668d bytes) 000559 1789518318.866914 write 0x000bde thru 0x0052f4 (0x4717 bytes) 000560 1789518318.872888 mapwrite 0x0005ab thru 0x00dd87 (0xd7dd bytes) 000561 1789518318.907640 write 0x03290d thru 0x03eb00 (0xc1f4 bytes) 000562 1789518318.909166 punch from 0x01ae45 to 0x021b9d (0x6d59 bytes) 000563 1789518318.924426 punch from 0x0329ce to 0x03eb00 (0xc133 bytes) 000565 1789518318.930031 write 0x01caca thru 0x022e4e (0x6385 bytes) 000567 1789518318.941974 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3eb01): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb01): Mirror 11: 0xb7e7850f (stale) Mirror 13: 0xb7e7850f (stale) Mirror 14: 0xb7e7850f (stale) CRC-32 checksum value for chunk [0, 0x3eb01): Mirror 1: 0x8bfd30fd Mirror 15: 0x8bfd30fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb01: skipped 000568 1789518319.746328 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3eb01): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb01): Mirror 11: 0xb7e7850f (stale) Mirror 13: 0xb7e7850f (stale) Mirror 14: 0xb7e7850f (stale) CRC-32 checksum value for chunk [0, 0x3eb01): Mirror 1: 0x8bfd30fd Mirror 15: 0x8bfd30fd Mirror 16: 0x8bfd30fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb01: skipped 000569 1789518320.260853 read 0x00e34a thru 0x00fd6b (0x1a22 bytes) 000570 1789518320.264625 punch from 0x034e0f to 0x03eb00 (0x9cf2 bytes) 000571 1789518320.321081 mapread 0x00062c thru 0x00e57e (0xdf53 bytes) 000572 1789518320.338058 mapwrite 0x0383f8 thru 0x03f852 (0x745b bytes) 000574 1789518320.399497 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 15: 0x8528efd4 (stale) Mirror 16: 0x8528efd4 (stale) CRC-32 checksum value for chunk [0, 0x3f853): Mirror 1: 0xbcc682c1 Mirror 17: 0xbcc682c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f853: skipped 000575 1789518321.117108 write 0x018acc thru 0x01929f (0x7d4 bytes) 000576 1789518321.189601 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 16: 0x8528efd4 (stale) Mirror 17: 0xbcc682c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 16: 0x8528efd4 (stale) Mirror 17: 0xbcc682c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f853: skipped 000579 1789518321.510831 mapread 0x03438e thru 0x03d1bf (0x8e32 bytes) 000580 1789518321.531485 punch from 0x037d81 to 0x03f852 (0x7ad2 bytes) 000582 1789518321.535707 mapread 0x035f8e thru 0x03bea6 (0x5f19 bytes) 000583 1789518321.545037 write 0x034f36 thru 0x038b67 (0x3c32 bytes) 000584 1789518321.546026 punch from 0x0162f9 to 0x01e784 (0x848c bytes) 000585 1789518321.558310 write 0x0320e9 thru 0x03ba31 (0x9949 bytes) 000587 1789518321.564042 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 16: 0x8528efd4 (stale) Mirror 17: 0xbcc682c1 (stale) CRC-32 checksum value for chunk [0, 0x3f853): Mirror 1: 0x758d8743 Mirror 18: 0x758d8743 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f853: skipped 000588 1789518322.482290 mapwrite 0x02a224 thru 0x036dee (0xcbcb bytes) 000589 1789518322.623900 read 0x00710c thru 0x00d2bb (0x61b0 bytes) 000590 1789518322.633618 write 0x02c519 thru 0x02e577 (0x205f bytes) 000591 1789518322.634580 mapread 0x019905 thru 0x01baa5 (0x21a1 bytes) 000592 1789518322.643708 mapread 0x01dedf thru 0x0271bb (0x92dd bytes) 000593 1789518322.648746 mapread 0x0267e4 thru 0x028832 (0x204f bytes) 000594 1789518322.655663 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 16: 0x8528efd4 (stale) Mirror 17: 0xbcc682c1 (stale) Mirror 18: 0x758d8743 (stale) CRC-32 checksum value for chunk [0, 0x3f853): Mirror 1: 0xec1d0fc5 Mirror 19: 0xec1d0fc5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f853: skipped 000596 1789518323.572878 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 16: 0x8528efd4 (stale) Mirror 18: 0x758d8743 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 16: 0x8528efd4 (stale) Mirror 18: 0x758d8743 (stale) CRC-32 checksum value for chunk [0, 0x3f853): Mirror 1: 0xec1d0fc5 Mirror 19: 0xec1d0fc5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f853: skipped 000598 1789518323.953038 mapread 0x0332b6 thru 0x03f7c4 (0xc50f bytes) 000599 1789518323.977703 read 0x03ca50 thru 0x03f852 (0x2e03 bytes) 000600 1789518323.978284 mapwrite 0x01179a thru 0x0191aa (0x7a11 bytes) 000601 1789518324.084169 mapread 0x02c2a4 thru 0x036816 (0xa573 bytes) 000602 1789518324.096616 read 0x028894 thru 0x029f98 (0x1705 bytes) 000603 1789518324.097147 read 0x012cab thru 0x019adf (0x6e35 bytes) 000608 1789518324.099612 mapwrite 0x016c56 thru 0x01de9c (0x7247 bytes) 000609 1789518324.145326 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 16: 0x8528efd4 (stale) Mirror 18: 0x758d8743 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f853): Mirror 11: 0x7c538e80 (stale) Mirror 13: 0x7c538e80 (stale) Mirror 14: 0x7c538e80 (stale) Mirror 16: 0x8528efd4 (stale) Mirror 18: 0x758d8743 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f853: skipped 000611 1789518324.402152 mapread 0x03331b thru 0x03ec4d (0xb933 bytes) 000613 1789518324.418086 punch from 0x03ca03 to 0x03f852 (0x2e50 bytes) 000614 1789518324.422160 write 0x003232 thru 0x00c56b (0x933a bytes) 000615 1789518324.427380 mapread 0x022985 thru 0x026669 (0x3ce5 bytes) 000617 1789518324.432205 write 0x03bea2 thru 0x03ffff (0x415e bytes) 000619 1789518324.433837 trunc from 0x040000 to 0x01bba7 (0x24458 bytes) 000620 1789518324.443065 mapwrite 0x0395f3 thru 0x03ffff (0x6a0d bytes) 000622 1789518324.497275 mapwrite 0x039e5b thru 0x03ffff (0x61a5 bytes) 000623 1789518324.549763 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x5ecfdff9 (stale) Mirror 14: 0x5ecfdff9 (stale) Mirror 16: 0xba4983f3 (stale) Mirror 18: 0xb6bbfcba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x5ecfdff9 (stale) Mirror 14: 0x5ecfdff9 (stale) Mirror 16: 0xba4983f3 (stale) Mirror 18: 0xb6bbfcba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000628 1789518324.824130 write 0x032250 thru 0x03ea9c (0xc84d bytes) 000629 1789518324.832753 mapwrite 0x03bc4c thru 0x03ffff (0x43b4 bytes) 000630 1789518324.870764 trunc from 0x040000 to 0x0293bd (0x16c42 bytes) 000631 1789518324.887417 trunc from 0x0293be to 0x007872 (0x21b4b bytes) 000632 1789518324.901639 MIRROR_RESYNC 5 mirrors 000633 1789518325.613377 trunc from 0x007873 to 0x030935 (0x290c3 bytes) 000634 1789518325.654437 write 0x0167dd thru 0x026012 (0xf836 bytes) 000635 1789518325.664302 read 0x016a92 thru 0x01b37a (0x48e9 bytes) 000637 1789518325.666808 mapwrite 0x00f932 thru 0x0154c2 (0x5b91 bytes) 000638 1789518325.730522 punch from 0x00ba0a to 0x01837b (0xc972 bytes) 000639 1789518325.735648 punch from 0x00fc6f to 0x01db78 (0xdf0a bytes) 000641 1789518325.742778 read 0x009a46 thru 0x018c14 (0xf1cf bytes) 000642 1789518325.757237 mapread 0x026549 thru 0x030935 (0xa3ed bytes) 000643 1789518325.759946 mapread 0x01a79e thru 0x022aa1 (0x8304 bytes) 000644 1789518325.761513 read 0x02ee33 thru 0x030935 (0x1b03 bytes) 000645 1789518325.766049 MIRROR_RESYNC 5 mirrors 000646 1789518326.984392 read 0x00022c thru 0x003922 (0x36f7 bytes) 000647 1789518326.989320 punch from 0x0043a7 to 0x01022b (0xbe85 bytes) 000649 1789518327.047908 mapread 0x01998e thru 0x02642e (0xcaa1 bytes) 000650 1789518327.069728 trunc from 0x030936 to 0x00bacf (0x24e66 bytes) 000651 1789518327.086689 read 0x009191 thru 0x00bacf (0x293f bytes) 000653 1789518327.096464 read 0x0012b1 thru 0x00bacf (0xa81f bytes) 000654 1789518327.097106 trunc from 0x00bad0 to 0x028a55 (0x1cf86 bytes) 000655 1789518327.108543 punch from 0x007cbc to 0x014829 (0xcb6e bytes) 000656 1789518327.112288 trunc from 0x028a56 to 0x020db1 (0x7ca4 bytes) 000659 1789518327.129728 write 0x008253 thru 0x00f776 (0x7524 bytes) 000660 1789518327.140699 write 0x012b92 thru 0x018b04 (0x5f73 bytes) 000662 1789518327.142296 write 0x0299a9 thru 0x02e3bb (0x4a13 bytes) 000664 1789518327.147347 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e3bc): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e3bc): Mirror 13: 0x22a4df08 (stale) Mirror 14: 0x22a4df08 (stale) Mirror 16: 0x22a4df08 (stale) Mirror 18: 0x22a4df08 (stale) CRC-32 checksum value for chunk [0, 0x2e3bc): Mirror 1: 0x86372bad Mirror 19: 0x86372bad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e3bc: skipped 000665 1789518327.916000 read 0x023f27 thru 0x0259cc (0x1aa6 bytes) 000666 1789518327.929899 trunc from 0x02e3bc to 0x03b49b (0xd0e0 bytes) 000668 1789518328.005461 mapread 0x01e2d2 thru 0x02a0c7 (0xbdf6 bytes) 000669 1789518328.029150 write 0x00173d thru 0x002774 (0x1038 bytes) 000670 1789518328.038554 mapread 0x00272f thru 0x00421c (0x1aee bytes) 000671 1789518328.047008 mapread 0x021cfb thru 0x022350 (0x656 bytes) 000673 1789518328.048294 read 0x00ac47 thru 0x00f417 (0x47d1 bytes) 000674 1789518328.048870 write 0x01e29c thru 0x022225 (0x3f8a bytes) 000675 1789518328.051821 read 0x008fa0 thru 0x01845b (0xf4bc bytes) 000677 1789518328.062790 trunc from 0x03b49c to 0x01f4e2 (0x1bfb9 bytes) 000678 1789518328.095469 read 0x007ccd thru 0x00df50 (0x6284 bytes) 000680 1789518328.096750 mapread 0x00a169 thru 0x00add4 (0xc6c bytes) 000681 1789518328.097739 read 0x004714 thru 0x010a43 (0xc330 bytes) 000682 1789518328.102237 MIRROR_RESYNC 6 mirrors 000683 1789518328.913118 read 0x010c68 thru 0x015503 (0x489c bytes) 000684 1789518328.921533 mapread 0x0175f8 thru 0x01a3cd (0x2dd6 bytes) 000686 1789518328.942284 mapread 0x002e60 thru 0x00edf2 (0xbf93 bytes) 000688 1789518328.954791 read 0x003ddb thru 0x00da58 (0x9c7e bytes) 000689 1789518328.955135 mapwrite 0x02684c thru 0x02a38a (0x3b3f bytes) 000690 1789518329.094134 mapwrite 0x02f9ca thru 0x03b8f1 (0xbf28 bytes) 000692 1789518329.169912 mapread 0x00f026 thru 0x01eb96 (0xfb71 bytes) 000693 1789518329.171000 mapwrite 0x00f51d thru 0x01499b (0x547f bytes) 000694 1789518329.210209 trunc from 0x03b8f2 to 0x0318ac (0xa045 bytes) 000695 1789518329.223026 mapwrite 0x0090d1 thru 0x0131b0 (0xa0e0 bytes) 000697 1789518329.256698 mapread 0x0032c9 thru 0x00c791 (0x94c9 bytes) 000698 1789518329.257747 mapread 0x024295 thru 0x02e0b8 (0x9e24 bytes) 000699 1789518329.260233 read 0x01f8a1 thru 0x025a1c (0x617c bytes) 000700 1789518329.261787 mapread 0x00feca thru 0x0130c3 (0x31fa bytes) 000701 1789518329.263053 trunc from 0x0318ad to 0x009c70 (0x27c3c bytes) 000704 1789518329.274850 punch from 0x006111 to 0x009184 (0x3074 bytes) 000705 1789518329.279514 trunc from 0x009c71 to 0x01999d (0xfd2d bytes) 000708 1789518329.300346 MIRROR_RESYNC 6 mirrors 000709 1789518330.210623 mapwrite 0x026bb8 thru 0x0367f5 (0xfc3e bytes) 000711 1789518330.376017 MIRROR_RESYNC 6 mirrors 000712 1789518331.457099 write 0x02ad51 thru 0x02d6cb (0x297b bytes) 000713 1789518331.557548 MIRROR_RESYNC 6 mirrors 000714 1789518332.517610 mapread 0x01e798 thru 0x0258c6 (0x712f bytes) 000715 1789518332.538115 mapread 0x012799 thru 0x01b149 (0x89b1 bytes) 000716 1789518332.548105 mapread 0x002170 thru 0x00290a (0x79b bytes) 000719 1789518332.559087 mapwrite 0x017161 thru 0x017578 (0x418 bytes) 000722 1789518332.661095 mapwrite 0x016eb6 thru 0x02176b (0xa8b6 bytes) 000723 1789518332.710285 trunc from 0x0367f6 to 0x00f3e0 (0x27415 bytes) 000724 1789518332.730973 write 0x009f3a thru 0x00a9ab (0xa72 bytes) 000726 1789518332.741383 write 0x0243c0 thru 0x024d5f (0x9a0 bytes) 000728 1789518332.743490 write 0x030549 thru 0x031234 (0xcec bytes) 000729 1789518332.748154 MIRROR_RESYNC 6 mirrors 000730 1789518334.019826 punch from 0x003b23 to 0x00612a (0x2608 bytes) 000731 1789518334.069640 punch from 0x01bec4 to 0x02b19c (0xf2d9 bytes) 000733 1789518334.074152 punch from 0x01b4e4 to 0x01ed4e (0x386b bytes) 000735 1789518334.079911 write 0x02b283 thru 0x030e53 (0x5bd1 bytes) 000736 1789518334.088966 write 0x022123 thru 0x025c53 (0x3b31 bytes) 000737 1789518334.096304 mapwrite 0x025275 thru 0x02c333 (0x70bf bytes) 000738 1789518334.148828 trunc from 0x031235 to 0x03a50f (0x92db bytes) 000739 1789518334.167940 read 0x001b7d thru 0x003bd2 (0x2056 bytes) 000742 1789518334.173243 write 0x01e898 thru 0x026443 (0x7bac bytes) 000743 1789518334.178186 read 0x017d4c thru 0x01c4fd (0x47b2 bytes) 000744 1789518334.187390 mapwrite 0x00121e thru 0x00baf9 (0xa8dc bytes) 000745 1789518334.225785 mapread 0x01ad59 thru 0x027b24 (0xcdcc bytes) 000746 1789518334.227183 mapread 0x0042a2 thru 0x0082e5 (0x4044 bytes) 000748 1789518334.228613 write 0x03fcfe thru 0x03ffff (0x302 bytes) 000751 1789518334.230550 read 0x0181ef thru 0x018a2d (0x83f bytes) 000752 1789518334.231264 mapread 0x016d64 thru 0x01c99b (0x5c38 bytes) 000754 1789518334.233065 trunc from 0x040000 to 0x028ae8 (0x17517 bytes) 000755 1789518334.246264 trunc from 0x028ae9 to 0x02628e (0x285a bytes) 000756 1789518334.261470 read 0x00e1ab thru 0x01d5bf (0xf415 bytes) 000757 1789518334.266308 MIRROR_RESYNC 6 mirrors 000760 1789518335.219657 read 0x00f339 thru 0x013bbf (0x4887 bytes) 000761 1789518335.224440 punch from 0x015fef to 0x01a19a (0x41ac bytes) 000762 1789518335.276475 mapwrite 0x00fbdb thru 0x01a0dc (0xa502 bytes) 000764 1789518335.343375 punch from 0x00030f to 0x00b369 (0xb05b bytes) 000767 1789518335.350074 mapread 0x017b36 thru 0x024b1d (0xcfe8 bytes) 000768 1789518335.354961 mapread 0x000759 thru 0x008898 (0x8140 bytes) 000769 1789518335.361155 punch from 0x021dbc to 0x02628e (0x44d3 bytes) 000771 1789518335.366014 mapread 0x01b9d0 thru 0x024f0f (0x9540 bytes) 000772 1789518335.372370 read 0x0071cb thru 0x0095ff (0x2435 bytes) 000774 1789518335.375389 write 0x01787f thru 0x01b2d2 (0x3a54 bytes) 000775 1789518335.376501 read 0x011b46 thru 0x0148ac (0x2d67 bytes) 000776 1789518335.377144 read 0x01de0b thru 0x01ea7f (0xc75 bytes) 000777 1789518335.377891 trunc from 0x02628f to 0x0340eb (0xde5d bytes) 000778 1789518335.406974 write 0x0079a0 thru 0x009f98 (0x25f9 bytes) 000779 1789518335.411110 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x340ec): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x340ec): Mirror 13: 0x82a17787 (stale) Mirror 14: 0x82a17787 (stale) Mirror 16: 0x82a17787 (stale) Mirror 18: 0x82a17787 (stale) Mirror 19: 0x82a17787 (stale) CRC-32 checksum value for chunk [0, 0x340ec): Mirror 1: 0x3aa904ab Mirror 20: 0x3aa904ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x340ec: skipped 000780 1789518336.181083 write 0x0278d3 thru 0x02b943 (0x4071 bytes) 000781 1789518336.230328 mapread 0x014132 thru 0x01dc68 (0x9b37 bytes) 000782 1789518336.241918 trunc from 0x0340ec to 0x025c8b (0xe460 bytes) 000783 1789518336.255658 mapread 0x00c050 thru 0x01712b (0xb0dc bytes) 000784 1789518336.262093 trunc from 0x025c8c to 0x030f25 (0xb29a bytes) 000785 1789518336.274388 write 0x016369 thru 0x01d2e7 (0x6f7f bytes) 000789 1789518336.279037 mapwrite 0x03b6f2 thru 0x03ffff (0x490e bytes) 000790 1789518336.332193 trunc from 0x040000 to 0x002d9d (0x3d262 bytes) 000791 1789518336.352535 read 0x001370 thru 0x002d9d (0x1a2e bytes) 000793 1789518336.357030 mapwrite 0x030c10 thru 0x0386ca (0x7abb bytes) 000794 1789518336.426545 mapread 0x036977 thru 0x0386ca (0x1d54 bytes) 000795 1789518336.434922 MIRROR_RESYNC 7 mirrors 000797 1789518337.569808 read 0x029d70 thru 0x037dd0 (0xe061 bytes) 000798 1789518337.576005 read 0x02e189 thru 0x0327b2 (0x462a bytes) 000799 1789518337.576388 trunc from 0x0386cb to 0x0117fb (0x26ecf bytes) 000803 1789518337.636031 mapread 0x0093d2 thru 0x00eb91 (0x57c0 bytes) 000804 1789518337.642453 write 0x0276fb thru 0x02a642 (0x2f48 bytes) 000805 1789518337.643501 punch from 0x0124be to 0x016ed8 (0x4a1b bytes) 000806 1789518337.650447 read 0x01728a thru 0x01e926 (0x769d bytes) 000808 1789518337.656692 mapwrite 0x02e7e4 thru 0x03a380 (0xbb9d bytes) 000809 1789518337.721081 trunc from 0x03a381 to 0x034beb (0x5795 bytes) 000810 1789518337.731049 read 0x012110 thru 0x01b028 (0x8f19 bytes) 000813 1789518337.732634 trunc from 0x034bec to 0x00130d (0x338de bytes) 000814 1789518337.745162 mapread 0x00082f thru 0x00130d (0xadf bytes) 000815 1789518337.746013 mapread 0x0009cd thru 0x00130d (0x941 bytes) 000816 1789518337.746787 mapread 0x0000b2 thru 0x00130d (0x125c bytes) 000817 1789518337.747654 write 0x03b4e9 thru 0x03ffff (0x4b17 bytes) 000819 1789518337.749245 write 0x035b47 thru 0x03ffff (0xa4b9 bytes) 000820 1789518337.756957 punch from 0x00a03e to 0x018616 (0xe5d9 bytes) 000821 1789518337.774505 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x11891816 (stale) Mirror 14: 0x11891816 (stale) Mirror 16: 0x11891816 (stale) Mirror 18: 0x11891816 (stale) Mirror 20: 0x11891816 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x11891816 (stale) Mirror 14: 0x11891816 (stale) Mirror 16: 0x11891816 (stale) Mirror 18: 0x11891816 (stale) Mirror 20: 0x11891816 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000822 1789518338.071629 write 0x0261bc thru 0x02c100 (0x5f45 bytes) 000823 1789518338.081534 mapread 0x02e69a thru 0x03d49c (0xee03 bytes) 000824 1789518338.108219 mapwrite 0x010640 thru 0x016503 (0x5ec4 bytes) 000825 1789518338.158616 write 0x01658b thru 0x0205d7 (0xa04d bytes) 000826 1789518338.162648 read 0x0340f7 thru 0x03ab20 (0x6a2a bytes) 000827 1789518338.163272 read 0x0078dd thru 0x00925f (0x1983 bytes) 000828 1789518338.171695 write 0x008661 thru 0x008b50 (0x4f0 bytes) 000830 1789518338.175519 trunc from 0x040000 to 0x03275c (0xd8a3 bytes) 000831 1789518338.190736 mapread 0x00f0cb thru 0x0111d9 (0x210f bytes) 000832 1789518338.192048 punch from 0x016fc0 to 0x022c4a (0xbc8b bytes) 000834 1789518338.207504 mapwrite 0x002909 thru 0x0060e1 (0x37d9 bytes) 000835 1789518338.241952 write 0x00da46 thru 0x0163c4 (0x897f bytes) 000836 1789518338.249960 punch from 0x02e3dd to 0x0314da (0x30fe bytes) 000837 1789518338.268712 mapwrite 0x021dfa thru 0x02ac5b (0x8e62 bytes) 000838 1789518338.325535 mapwrite 0x032b20 thru 0x03d737 (0xac18 bytes) 000839 1789518338.453742 write 0x01961c thru 0x01da10 (0x43f5 bytes) 000841 1789518338.465127 MIRROR_RESYNC 6 mirrors 000843 1789518339.159412 trunc from 0x03d738 to 0x028781 (0x14fb6 bytes) 000844 1789518339.223917 MIRROR_RESYNC 6 mirrors 000845 1789518339.849306 write 0x02e257 thru 0x030d7d (0x2b27 bytes) 000846 1789518339.884784 mapread 0x030d37 thru 0x030d7d (0x47 bytes) 000847 1789518339.886310 trunc from 0x030d7e to 0x027d03 (0x907a bytes) 000849 1789518339.903474 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x27d04): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27d04): Mirror 13: 0xd5483d1a (stale) Mirror 14: 0xd5483d1a (stale) Mirror 16: 0xd5483d1a (stale) Mirror 18: 0xd5483d1a (stale) Mirror 20: 0xd5483d1a (stale) CRC-32 checksum value for chunk [0, 0x27d04): Mirror 1: 0xd5483d1a Mirror 21: 0xd5483d1a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27d04: skipped 000850 1789518340.547786 write 0x02fdef thru 0x03e2b6 (0xe4c8 bytes) 000853 1789518340.595726 mapread 0x027ef1 thru 0x036150 (0xe260 bytes) 000854 1789518340.612033 trunc from 0x03e2b7 to 0x005f81 (0x38335 bytes) 000855 1789518340.624850 mapread 0x002727 thru 0x005f81 (0x385b bytes) 000856 1789518340.636056 read 0x005db5 thru 0x005f81 (0x1cd bytes) 000857 1789518340.643452 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5f82): Mirror 14: 0xb2f72ead (stale) Mirror 16: 0xb2f72ead (stale) Mirror 18: 0xb2f72ead (stale) Mirror 20: 0xb2f72ead (stale) Mirror 21: 0xb2f72ead (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5f82): Mirror 14: 0xb2f72ead (stale) Mirror 16: 0xb2f72ead (stale) Mirror 18: 0xb2f72ead (stale) Mirror 20: 0xb2f72ead (stale) Mirror 21: 0xb2f72ead (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5f82: skipped 000858 1789518340.900628 read 0x001ad1 thru 0x005f81 (0x44b1 bytes) 000861 1789518340.908502 write 0x00b3e2 thru 0x012b01 (0x7720 bytes) 000863 1789518340.910259 mapread 0x010c9a thru 0x010cc1 (0x28 bytes) 000865 1789518340.911403 write 0x000bff thru 0x00ef0f (0xe311 bytes) 000867 1789518340.916036 mapread 0x00f842 thru 0x012b01 (0x32c0 bytes) 000869 1789518340.920644 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12b02): Mirror 14: 0x9bc495a2 (stale) Mirror 16: 0x9bc495a2 (stale) Mirror 20: 0x9bc495a2 (stale) Mirror 21: 0x9bc495a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12b02): Mirror 14: 0x9bc495a2 (stale) Mirror 16: 0x9bc495a2 (stale) Mirror 20: 0x9bc495a2 (stale) Mirror 21: 0x9bc495a2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12b02: skipped 000870 1789518341.173498 mapread 0x00acef thru 0x00cf6b (0x227d bytes) 000871 1789518341.189080 mapwrite 0x002c24 thru 0x011ef4 (0xf2d1 bytes) 000872 1789518341.238342 write 0x031921 thru 0x0326dc (0xdbc bytes) 000873 1789518341.240251 write 0x017d75 thru 0x026af6 (0xed82 bytes) 000874 1789518341.251882 trunc from 0x0326dd to 0x02a741 (0x7f9b bytes) 000877 1789518341.270296 punch from 0x01bc6f to 0x024c17 (0x8fa9 bytes) 000879 1789518341.282389 write 0x00c2e9 thru 0x012bc9 (0x68e1 bytes) 000880 1789518341.284161 trunc from 0x02a742 to 0x0145d5 (0x1616c bytes) 000881 1789518341.304744 mapwrite 0x00de67 thru 0x01d3df (0xf579 bytes) 000883 1789518341.376198 write 0x00495e thru 0x00dafd (0x91a0 bytes) 000886 1789518341.384266 MIRROR_RESYNC 5 mirrors 000887 1789518342.028164 trunc from 0x01d3e0 to 0x007177 (0x16268 bytes) 000888 1789518342.105615 write 0x034a30 thru 0x0376aa (0x2c7b bytes) 000889 1789518342.107245 mapread 0x022afe thru 0x030b36 (0xe039 bytes) 000890 1789518342.131200 punch from 0x0371f8 to 0x0376aa (0x4b3 bytes) 000891 1789518342.140828 punch from 0x001513 to 0x0091b7 (0x7ca5 bytes) 000892 1789518342.145160 punch from 0x0081bb to 0x0149c4 (0xc80a bytes) 000893 1789518342.150061 read 0x0264d9 thru 0x03556c (0xf094 bytes) 000894 1789518342.150873 mapread 0x02866c thru 0x03128d (0x8c22 bytes) 000896 1789518342.152481 mapwrite 0x0148c1 thru 0x021203 (0xc943 bytes) 000897 1789518342.207460 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x376ab): Mirror 16: 0x10ecdbfb (stale) Mirror 20: 0x10ecdbfb (stale) Mirror 21: 0x10ecdbfb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x376ab): Mirror 16: 0x10ecdbfb (stale) Mirror 20: 0x10ecdbfb (stale) Mirror 21: 0x10ecdbfb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x376ab: skipped 000898 1789518342.453709 trunc from 0x0376ab to 0x00ece1 (0x289c9 bytes) 000900 1789518342.475902 MIRROR_RESYNC 4 mirrors 000901 1789518343.325199 trunc from 0x00ece2 to 0x0216c4 (0x129e3 bytes) 000903 1789518343.384974 write 0x02635d thru 0x02f5e8 (0x928c bytes) 000904 1789518343.386268 read 0x01d353 thru 0x02570e (0x83bc bytes) 000905 1789518343.395298 punch from 0x01b059 to 0x01d0b5 (0x205d bytes) 000906 1789518343.404779 punch from 0x002abf to 0x0035a2 (0xae4 bytes) 000908 1789518343.409532 mapread 0x02bd1e thru 0x02f5e8 (0x38cb bytes) 000909 1789518343.410716 read 0x004c07 thru 0x00c6bc (0x7ab6 bytes) 000910 1789518343.418085 write 0x01b643 thru 0x02794a (0xc308 bytes) 000911 1789518343.419381 punch from 0x022805 to 0x02f5e8 (0xcde4 bytes) 000913 1789518343.430139 mapwrite 0x00ca57 thru 0x01a7bf (0xdd69 bytes) 000916 1789518343.473587 punch from 0x0028da to 0x0032ba (0x9e1 bytes) 000917 1789518343.487921 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2f5e9): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5e9): Mirror 16: 0x2d949287 (stale) Mirror 20: 0x2d949287 (stale) Mirror 21: 0x2d949287 (stale) CRC-32 checksum value for chunk [0, 0x2f5e9): Mirror 1: 0xe8423820 Mirror 22: 0xe8423820 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5e9: skipped 000920 1789518344.244716 write 0x012efd thru 0x018dd8 (0x5edc bytes) 000921 1789518344.306283 mapwrite 0x03d1c5 thru 0x03ecff (0x1b3b bytes) 000923 1789518344.386085 MIRROR_RESYNC 5 mirrors 000925 1789518345.435185 MIRROR_RESYNC 5 mirrors 000926 1789518345.750977 mapread 0x0236cc thru 0x02f6ac (0xbfe1 bytes) 000927 1789518345.774389 MIRROR_RESYNC 5 mirrors 000931 1789518346.045093 read 0x0289fc thru 0x02ec28 (0x622d bytes) 000932 1789518346.045431 mapwrite 0x0095d0 thru 0x00dce3 (0x4714 bytes) 000933 1789518346.172133 punch from 0x009600 to 0x013ea3 (0xa8a4 bytes) 000934 1789518346.177261 read 0x00d983 thru 0x019485 (0xbb03 bytes) 000936 1789518346.187100 punch from 0x00d279 to 0x01986e (0xc5f6 bytes) 000937 1789518346.195169 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 16: 0xd4ec63bd (stale) Mirror 20: 0xd4ec63bd (stale) Mirror 21: 0xd4ec63bd (stale) Mirror 22: 0xd4ec63bd (stale) CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 1: 0xad4f8964 Mirror 23: 0xad4f8964 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed00: skipped 000939 1789518346.992044 read 0x02a99b thru 0x02ab65 (0x1cb bytes) 000940 1789518347.003731 mapread 0x0235fb thru 0x02c9d1 (0x93d7 bytes) 000941 1789518347.034352 mapwrite 0x01fa4c thru 0x02379a (0x3d4f bytes) 000943 1789518347.157443 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 16: 0xd4ec63bd (stale) Mirror 20: 0xd4ec63bd (stale) Mirror 21: 0xd4ec63bd (stale) Mirror 22: 0xd4ec63bd (stale) Mirror 23: 0xad4f8964 (stale) CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 1: 0x14b418e7 Mirror 24: 0x14b418e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed00: skipped 000944 1789518348.004040 read 0x0156b2 thru 0x01a1ac (0x4afb bytes) 000946 1789518348.011671 write 0x01bef9 thru 0x023329 (0x7431 bytes) 000947 1789518348.076129 write 0x03889d thru 0x03c92a (0x408e bytes) 000948 1789518348.097247 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x29b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 16: 0xd4ec63bd (stale) Mirror 20: 0xd4ec63bd (stale) Mirror 21: 0xd4ec63bd (stale) Mirror 22: 0xd4ec63bd (stale) Mirror 24: 0x14b418e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 16: 0xd4ec63bd (stale) Mirror 20: 0xd4ec63bd (stale) Mirror 21: 0xd4ec63bd (stale) Mirror 22: 0xd4ec63bd (stale) Mirror 24: 0x14b418e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed00: skipped 000949 1789518348.449976 mapread 0x014712 thru 0x0171e2 (0x2ad1 bytes) 000950 1789518348.474911 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 16: 0xd4ec63bd (stale) Mirror 20: 0xd4ec63bd (stale) Mirror 21: 0xd4ec63bd (stale) Mirror 22: 0xd4ec63bd (stale) Mirror 24: 0x14b418e7 (stale) CRC-32 checksum value for chunk [0, 0x3ed00): Mirror 1: 0xfdc189ae Mirror 25: 0xfdc189ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed00: skipped 000951 1789518349.412920 mapread 0x00c6a9 thru 0x01b50c (0xee64 bytes) 000953 1789518349.449447 mapwrite 0x000fee thru 0x00e9c0 (0xd9d3 bytes) 000954 1789518349.570400 mapread 0x0149f5 thru 0x01fbbb (0xb1c7 bytes) 000955 1789518349.590758 mapread 0x038976 thru 0x03c2e6 (0x3971 bytes) 000957 1789518349.598821 trunc from 0x03ed00 to 0x016e72 (0x27e8d bytes) 000958 1789518349.616192 write 0x028466 thru 0x0343c1 (0xbf5c bytes) 000959 1789518349.624344 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x343c2): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x343c2): Mirror 16: 0xa497d48f (stale) Mirror 20: 0xa497d48f (stale) Mirror 21: 0xa497d48f (stale) Mirror 22: 0xa497d48f (stale) Mirror 24: 0x9c8ea291 (stale) Mirror 25: 0xeed1a2c2 (stale) CRC-32 checksum value for chunk [0, 0x343c2): Mirror 1: 0xad6d197a Mirror 26: 0xad6d197a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x343c2: skipped 000960 1789518350.461418 punch from 0x00360a to 0x0091c2 (0x5bb9 bytes) 000964 1789518350.525663 mapread 0x000274 thru 0x001e53 (0x1be0 bytes) 000966 1789518350.542798 trunc from 0x0343c2 to 0x00a8ad (0x29b14 bytes) 000968 1789518350.563185 punch from 0x0001d9 to 0x00a8ad (0xa6d5 bytes) 000970 1789518350.572430 trunc from 0x00a8ae to 0x015b40 (0xb293 bytes) 000971 1789518350.591376 read 0x009a60 thru 0x00b3a1 (0x1942 bytes) 000974 1789518350.598696 read 0x0107fc thru 0x015b40 (0x5345 bytes) 000975 1789518350.606843 trunc from 0x015b41 to 0x000464 (0x156dc bytes) 000976 1789518350.626031 read 0x000376 thru 0x000464 (0xef bytes) 000977 1789518350.627435 read 0x000079 thru 0x000464 (0x3ec bytes) 000978 1789518350.627974 punch from 0x00029f to 0x000464 (0x1c6 bytes) 000979 1789518350.635991 trunc from 0x000465 to 0x01583c (0x153d8 bytes) 000980 1789518350.658238 mapread 0x00d635 thru 0x01583c (0x8208 bytes) 000982 1789518350.670821 mapread 0x002c53 thru 0x010ee7 (0xe295 bytes) 000984 1789518350.673186 mapread 0x00eb21 thru 0x0105ec (0x1acc bytes) 000985 1789518350.674415 mapwrite 0x00b867 thru 0x016ebb (0xb655 bytes) 000986 1789518350.744381 punch from 0x007087 to 0x008793 (0x170d bytes) 000987 1789518350.747977 write 0x02a095 thru 0x02cdc4 (0x2d30 bytes) 000988 1789518350.749016 mapwrite 0x024250 thru 0x029331 (0x50e2 bytes) 000989 1789518350.801774 mapwrite 0x003f38 thru 0x00a04b (0x6114 bytes) 000990 1789518350.866791 read 0x026f77 thru 0x02cdc4 (0x5e4e bytes) 000991 1789518350.874943 MIRROR_RESYNC 8 mirrors 000992 1789518352.391888 write 0x01f351 thru 0x02a6c1 (0xb371 bytes) 000999 1789518352.462183 trunc from 0x02cdc5 to 0x005196 (0x27c2e bytes) 001000 1789518352.487750 MIRROR_RESYNC 8 mirrors All operations completed A-OK!