== sanity-flr test 70a: flr mode fsx test ================ 12:44:22 (1785775462) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 5465 skipping zero size read skipping zero length zero range skipping zero length zero range truncating to largest ever: 0x1b6b4 000004 1785775465.569692 trunc from 00000000 to 0x01b6b3 (0x1b6b4 bytes) 000005 1785775465.631007 write 0x0123da thru 0x020f14 (0xeb3b bytes) 000006 1785775465.644350 write 0x01d17e thru 0x01f232 (0x20b5 bytes) 000007 1785775465.646456 fallocate 0x008809 thru 0x00c479 (0x3c71 bytes) 000008 1785775465.656251 punch from 0x01e559 to 0x020f14 (0x29bc bytes) 000009 1785775465.692791 trunc from 0x01e211 to 0x020f14 (0x2d04 bytes) 000010 1785775465.705456 trunc from 0x00d5be to 0x0104ad (0x2ef0 bytes) 000011 1785775465.717912 trunc from 0x01bfda to 0x020f14 (0x4f3b bytes) 000012 1785775465.738491 trunc from 0x020f15 to 0x014a75 (0xc49f bytes) 000013 1785775465.792830 read 0x00f8ae thru 0x014a75 (0x51c8 bytes) truncating to largest ever: 0x34dd8 000014 1785775465.803579 trunc from 0x014a76 to 0x034dd7 (0x20362 bytes) 000016 1785775465.845972 punch from 0x02ab40 to 0x034dd7 (0xa298 bytes) 000017 1785775465.874903 mapread 0x02e3a6 thru 0x0305a5 (0x2200 bytes) 000018 1785775465.939921 read 0x00f8a9 thru 0x01585b (0x5fb3 bytes) 000019 1785775465.963040 trunc from 0x01b3bb to 0x029194 (0xddda bytes) 000020 1785775465.969288 trunc from 0x021898 to 0x026f8e (0x56f7 bytes) 000021 1785775465.979571 trunc from 0x01f786 to 0x024c0c (0x5487 bytes) 000022 1785775465.996814 read 0x014abd thru 0x0243df (0xf923 bytes) 000023 1785775466.049105 MIRROR_EXTEND to 2 mirrors 000024 1785775466.756437 punch from 0x004f2f to 0x00d277 (0x8349 bytes) 000025 1785775466.873955 trunc from 0x034dd8 to 0x00c4bc (0x2891b bytes) 000026 1785775466.927992 trunc from 0x00c4bd to 0x01fd47 (0x1388b bytes) 000027 1785775466.963461 trunc from 0x01c9e1 to 0x01fd47 (0x3367 bytes) 000028 1785775466.971130 fallocate 0x01305e thru 0x01d048 (0x9feb bytes) 000029 1785775466.987448 trunc from 0x01fd48 to 0x00022b (0x1fb1c bytes) 000030 1785775467.031322 read 0x000216 thru 0x00022b (0x16 bytes) 000031 1785775467.051297 mapwrite 0x03a43b thru 0x03f0a6 (0x4c6c bytes) 000032 1785775467.196261 trunc from 0x03f0a7 to 0x0146d3 (0x2a9d3 bytes) 000033 1785775467.252507 mapread 0x001ebe thru 0x008c28 (0x6d6b bytes) 000035 1785775467.293974 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) 000036 1785775467.574390 MIRROR_EXTEND to 2 mirrors 000037 1785775468.780730 MIRROR_EXTEND to 3 mirrors 000038 1785775469.570699 mapread 0x00081f thru 0x00c621 (0xbe03 bytes) 000039 1785775469.623490 MIRROR_EXTEND to 4 mirrors 000040 1785775470.166405 trunc from 0x0146d4 to 0x01698e (0x22bb bytes) 000041 1785775470.214435 mapwrite 0x01fa5e thru 0x02873e (0x8ce1 bytes) 000042 1785775470.390857 fallocate 0x026155 thru 0x030dde (0xac8a bytes) 000043 1785775470.395475 trunc from 0x0206af to 0x023534 (0x2e86 bytes) 000044 1785775470.400535 punch from 0x001d60 to 0x00e0d5 (0xc376 bytes) 000045 1785775470.407598 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2873f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2873f): Mirror 2: 0x93260438 (stale) Mirror 3: 0x93260438 (stale) Mirror 4: 0x93260438 (stale) CRC-32 checksum value for chunk [0, 0x2873f): Mirror 1: 0x1b6ee298 Mirror 5: 0x1b6ee298 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2873f: skipped 000046 1785775471.476556 fallocate 0x01f8fd thru 0x021aba (0x21be bytes) 000047 1785775471.550564 read 0x00c1f0 thru 0x012da0 (0x6bb1 bytes) 000048 1785775471.581205 punch from 0x004da2 to 0x011d1f (0xcf7e bytes) 000049 1785775471.593883 punch from 0x019cda to 0x021e8b (0x81b2 bytes) 000051 1785775471.608836 write 0x01064f thru 0x012441 (0x1df3 bytes) 000052 1785775471.622894 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2873f): Mirror 2: 0x93260438 (stale) Mirror 3: 0x93260438 (stale) Mirror 5: 0x1b6ee298 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2873f): Mirror 2: 0x93260438 (stale) Mirror 3: 0x93260438 (stale) Mirror 5: 0x1b6ee298 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2873f: skipped 000053 1785775472.033700 punch from 0x009a5f to 0x0103c9 (0x696b bytes) 000054 1785775472.045225 fallocate 0x00c87e thru 0x017052 (0xa7d5 bytes) 000055 1785775472.058708 MIRROR_RESYNC 4 mirrors 000056 1785775473.450966 punch from 0x01d372 to 0x01facb (0x275a bytes) 000057 1785775473.508368 write 0x013d1f thru 0x01ada4 (0x7086 bytes) 000058 1785775473.524961 trunc from 0x024caa to 0x02873e (0x3a95 bytes) 000059 1785775473.534942 trunc from 0x02873f to 0x03083a (0x80fc bytes) 000060 1785775473.562802 read 0x028f7e thru 0x02b8d2 (0x2955 bytes) 000062 1785775473.569326 mapwrite 0x036ef7 thru 0x03ffff (0x9109 bytes) 000063 1785775473.625909 mapread 0x00616b thru 0x0149d7 (0xe86d bytes) 000064 1785775473.645575 write 0x038606 thru 0x03defc (0x58f7 bytes) 000065 1785775473.646801 write 0x03fd94 thru 0x03ffff (0x26c bytes) 000066 1785775473.652025 MIRROR_RESYNC 4 mirrors truncating to largest ever: 0x36309 000067 1785775475.642756 trunc from 0x040000 to 0x036308 (0x9cf7 bytes) 000068 1785775475.704198 trunc from 0x0227c2 to 0x02f572 (0xcdb1 bytes) 000069 1785775475.725257 mapwrite 0x0278a2 thru 0x02e2f8 (0x6a57 bytes) 000070 1785775475.775631 mapwrite 0x02e2be thru 0x0335de (0x5321 bytes) 000071 1785775475.839356 read 0x00413a thru 0x01249a (0xe361 bytes) 000072 1785775475.873246 write 0x030ab5 thru 0x03bf9d (0xb4e9 bytes) 000073 1785775475.874781 trunc from 0x0164ff to 0x0196e1 (0x31e3 bytes) 000074 1785775475.887859 write 0x01d3f8 thru 0x01f6a2 (0x22ab bytes) 000075 1785775475.921227 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3bf9e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bf9e): Mirror 2: 0x66280d02 (stale) Mirror 3: 0x66280d02 (stale) Mirror 5: 0x66280d02 (stale) CRC-32 checksum value for chunk [0, 0x3bf9e): Mirror 1: 0x7eb03cb3 Mirror 6: 0x7eb03cb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bf9e: skipped 000076 1785775477.794986 trunc from 0x03bf9e to 0x02e193 (0xde0a bytes) 000077 1785775477.909824 mapread 0x026be7 thru 0x02e193 (0x75ad bytes) 000078 1785775477.960035 punch from 0x01f800 to 0x0218c7 (0x20c8 bytes) 000079 1785775477.980222 read 0x017b16 thru 0x021082 (0x956d bytes) 000080 1785775477.992019 punch from 0x020eb3 to 0x02e193 (0xd2e1 bytes) 000081 1785775478.019381 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e194): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e194): Mirror 2: 0x6255a14f (stale) Mirror 3: 0x6255a14f (stale) Mirror 5: 0x6255a14f (stale) Mirror 6: 0x14b6cbd1 (stale) CRC-32 checksum value for chunk [0, 0x2e194): Mirror 1: 0x73a4664 Mirror 7: 0x73a4664 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e194: skipped 000082 1785775479.768783 punch from 0x029dc9 to 0x02e193 (0x43cb bytes) 000083 1785775479.871513 read 0x02a65c thru 0x02d9df (0x3384 bytes) 000084 1785775479.893109 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e194): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e194): Mirror 2: 0x6255a14f (stale) Mirror 3: 0x6255a14f (stale) Mirror 5: 0x6255a14f (stale) Mirror 6: 0x14b6cbd1 (stale) Mirror 7: 0x73a4664 (stale) CRC-32 checksum value for chunk [0, 0x2e194): Mirror 1: 0x73a4664 Mirror 8: 0x73a4664 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e194: skipped 000085 1785775481.761766 mapread 0x004d2f thru 0x00f7aa (0xaa7c bytes) 000086 1785775481.863329 mapwrite 0x0374c2 thru 0x03f592 (0x80d1 bytes) 000087 1785775482.110168 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3f593): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f593): Mirror 2: 0xe3a4e475 (stale) Mirror 3: 0xe3a4e475 (stale) Mirror 5: 0xe3a4e475 (stale) Mirror 6: 0xa620f871 (stale) Mirror 7: 0x1dc052b7 (stale) Mirror 8: 0x1dc052b7 (stale) CRC-32 checksum value for chunk [0, 0x3f593): Mirror 1: 0x3a9b65f3 Mirror 9: 0x3a9b65f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f593: skipped 000088 1785775484.347411 MIRROR_RESYNC 8 mirrors 000089 1785775488.397141 MIRROR_EXTEND to 9 mirrors 000090 1785775490.825966 write 0x02ef48 thru 0x0372d4 (0x838d bytes) 000091 1785775490.911681 read 0x0229dd thru 0x0326da (0xfcfe bytes) 000092 1785775490.927630 punch from 0x007974 to 0x009bc5 (0x2252 bytes) 000093 1785775490.952624 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f593): Mirror 2: 0x3a9b65f3 (stale) Mirror 3: 0x3a9b65f3 (stale) Mirror 5: 0x3a9b65f3 (stale) Mirror 6: 0x3a9b65f3 (stale) Mirror 8: 0x3a9b65f3 (stale) Mirror 9: 0x3a9b65f3 (stale) Mirror 10: 0x3a9b65f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f593): Mirror 2: 0x3a9b65f3 (stale) Mirror 3: 0x3a9b65f3 (stale) Mirror 5: 0x3a9b65f3 (stale) Mirror 6: 0x3a9b65f3 (stale) Mirror 8: 0x3a9b65f3 (stale) Mirror 9: 0x3a9b65f3 (stale) Mirror 10: 0x3a9b65f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f593: skipped 000094 1785775492.194439 mapread 0x026181 thru 0x035225 (0xf0a5 bytes) 000095 1785775492.270808 punch from 0x020b0e to 0x02a839 (0x9d2c bytes) 000096 1785775492.274700 trunc from 0x0149e8 to 0x020839 (0xbe52 bytes) 000098 1785775492.288138 punch from 0x034d2d to 0x03f592 (0xa866 bytes) 000099 1785775492.313592 punch from 0x01f635 to 0x0201bd (0xb89 bytes) 000100 1785775492.325024 punch from 0x017826 to 0x022f33 (0xb70e bytes) 000101 1785775492.346315 mapwrite 0x023970 thru 0x02c583 (0x8c14 bytes) 000102 1785775492.518109 punch from 0x035d71 to 0x03f592 (0x9822 bytes) 000104 1785775492.533920 trunc from 0x023a92 to 0x02d2b1 (0x9820 bytes) 000105 1785775492.553521 write 0x03e47d thru 0x03ffff (0x1b83 bytes) 000106 1785775492.600398 read 0x025860 thru 0x027600 (0x1da1 bytes) fallocating to largest ever: 0x388e7 000107 1785775492.633142 fallocate 0x02f4fd thru 0x0388e6 (0x93ea bytes) 000108 1785775492.650521 mapread 0x00d401 thru 0x011343 (0x3f43 bytes) 000109 1785775492.758358 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc9da4ce8 (stale) Mirror 3: 0xc9da4ce8 (stale) Mirror 5: 0xc9da4ce8 (stale) Mirror 6: 0xc9da4ce8 (stale) Mirror 8: 0xc9da4ce8 (stale) Mirror 9: 0xc9da4ce8 (stale) Mirror 10: 0xc9da4ce8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7e8875b0 Mirror 11: 0x7e8875b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000110 1785775495.839398 fallocate 0x018ddd thru 0x01db05 (0x4d29 bytes) 000111 1785775496.092531 punch from 0x025d9d to 0x02df98 (0x81fc bytes) 000112 1785775496.098546 mapwrite 0x01bb01 thru 0x01ff19 (0x4419 bytes) 000114 1785775497.149809 mapread 0x00ddfe thru 0x01a31d (0xc520 bytes) 000115 1785775497.252477 MIRROR_RESYNC 9 mirrors 000116 1785775503.737769 trunc from 0x027e81 to 0x03645c (0xe5dc bytes) 000117 1785775503.822659 trunc from 0x040000 to 0x003b84 (0x3c47b bytes) 000118 1785775503.895533 mapwrite 0x018ef7 thru 0x024c55 (0xbd5f bytes) 000119 1785775504.171913 MIRROR_RESYNC 9 mirrors 000120 1785775506.926401 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) 000121 1785775507.920976 punch from 0x014043 to 0x0173cc (0x338a bytes) 000122 1785775508.041436 mapread 0x016195 thru 0x01f7f8 (0x9664 bytes) 000123 1785775508.207011 trunc from 0x024c56 to 0x00235e (0x228f7 bytes) 000124 1785775508.257140 punch from 0x00227b to 0x00235e (0xe4 bytes) 000125 1785775508.297837 fallocate 0x007d24 thru 0x01491a (0xcbf7 bytes) 000126 1785775508.329925 punch from 0x00d4ce to 0x010a54 (0x3587 bytes) 000127 1785775508.369902 write 0x0143d4 thru 0x01c3d7 (0x8004 bytes) 000129 1785775508.421180 fallocate 0x01f17f thru 0x022a57 (0x38d9 bytes) 000130 1785775508.470952 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22a58): Mirror 5: 0x1c231fd5 (stale) Mirror 6: 0x1c231fd5 (stale) Mirror 8: 0x1c231fd5 (stale) Mirror 9: 0x1c231fd5 (stale) Mirror 10: 0x1c231fd5 (stale) Mirror 11: 0x1c231fd5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22a58): Mirror 5: 0x1c231fd5 (stale) Mirror 6: 0x1c231fd5 (stale) Mirror 8: 0x1c231fd5 (stale) Mirror 9: 0x1c231fd5 (stale) Mirror 10: 0x1c231fd5 (stale) Mirror 11: 0x1c231fd5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22a58: skipped 000131 1785775509.805114 punch from 0x01bd10 to 0x022a57 (0x6d48 bytes) 000132 1785775509.813389 punch from 0x00dd2d to 0x012560 (0x4834 bytes) 000134 1785775509.827813 trunc from 0x022a58 to 0x01e8e7 (0x4170 bytes) 000135 1785775509.857599 trunc from 0x0103d7 to 0x01e8e7 (0xe511 bytes) 000136 1785775509.866869 fallocate 0x02a300 thru 0x02eeab (0x4bac bytes) 000137 1785775509.873088 trunc from 0x022b57 to 0x02677c (0x3c26 bytes) 000138 1785775509.890856 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2eeac): Mirror 5: 0x65b324d1 (stale) Mirror 6: 0x65b324d1 (stale) Mirror 8: 0x65b324d1 (stale) Mirror 9: 0x65b324d1 (stale) Mirror 10: 0x65b324d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eeac): Mirror 5: 0x65b324d1 (stale) Mirror 6: 0x65b324d1 (stale) Mirror 8: 0x65b324d1 (stale) Mirror 9: 0x65b324d1 (stale) Mirror 10: 0x65b324d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eeac: skipped 000139 1785775511.123057 trunc from 0x01fa17 to 0x0258bd (0x5ea7 bytes) 000140 1785775511.136414 fallocate 0x01e3c6 thru 0x023908 (0x5543 bytes) truncating to largest ever: 0x3f110 000141 1785775511.145999 trunc from 0x02eeac to 0x03f10f (0x10264 bytes) 000142 1785775511.199014 mapread 0x004fa4 thru 0x00bcd8 (0x6d35 bytes) 000143 1785775511.252159 fallocate 0x017e46 thru 0x0244b2 (0xc66d bytes) 000144 1785775511.262033 mapread 0x029a63 thru 0x02fb0b (0x60a9 bytes) 000145 1785775511.315787 MIRROR_RESYNC 6 mirrors 000146 1785775512.076173 trunc from 0x03f110 to 0x0179f3 (0x2771c bytes) 000147 1785775512.312015 fallocate 0x023af2 thru 0x029084 (0x5593 bytes) 000148 1785775512.317458 fallocate 0x02655e thru 0x028e66 (0x2909 bytes) fallocating to largest ever: 0x40000 000149 1785775512.338046 fallocate 0x038009 thru 0x03ffff (0x7ff7 bytes) 000150 1785775512.360532 trunc from 0x00fe8e to 0x013e31 (0x3fa4 bytes) 000151 1785775512.367283 fallocate 0x01d20e thru 0x02823f (0xb032 bytes) 000152 1785775512.373090 mapwrite 0x029402 thru 0x036c4d (0xd84c bytes) 000153 1785775512.513389 read 0x0256ed thru 0x033c8e (0xe5a2 bytes) 000154 1785775512.514483 trunc from 0x02b857 to 0x02dc05 (0x23af bytes) 000155 1785775512.522091 read 0x02e036 thru 0x02f123 (0x10ee bytes) 000156 1785775512.523784 read 0x02be4a thru 0x02d762 (0x1919 bytes) 000157 1785775512.541159 MIRROR_RESYNC 6 mirrors 000158 1785775515.353228 punch from 0x01cea4 to 0x0290df (0xc23c bytes) 000159 1785775515.444367 trunc from 0x036c4e to 0x03da3a (0x6ded bytes) 000160 1785775515.473029 punch from 0x02ae20 to 0x035ab7 (0xac98 bytes) 000161 1785775515.484941 read 0x00cda2 thru 0x010013 (0x3272 bytes) 000162 1785775515.503876 write 0x000ca3 thru 0x00313a (0x2498 bytes) 000163 1785775515.528834 read 0x0142fd thru 0x020c6a (0xc96e bytes) 000164 1785775515.566822 punch from 0x014444 to 0x0213f6 (0xcfb3 bytes) 000165 1785775515.583862 mapwrite 0x02bab9 thru 0x033a73 (0x7fbb bytes) 000166 1785775515.689762 write 0x03dbbe thru 0x03de09 (0x24c bytes) 000167 1785775515.723604 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3de0a): Mirror 5: 0x901ad01 (stale) Mirror 6: 0x901ad01 (stale) Mirror 8: 0x901ad01 (stale) Mirror 10: 0x901ad01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de0a): Mirror 5: 0x901ad01 (stale) Mirror 6: 0x901ad01 (stale) Mirror 8: 0x901ad01 (stale) Mirror 10: 0x901ad01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de0a: skipped 000168 1785775516.610968 trunc from 0x016026 to 0x01d238 (0x7213 bytes) 000169 1785775516.626704 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3de0a): Mirror 5: 0x901ad01 (stale) Mirror 6: 0x901ad01 (stale) Mirror 10: 0x901ad01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de0a): Mirror 5: 0x901ad01 (stale) Mirror 6: 0x901ad01 (stale) Mirror 10: 0x901ad01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de0a: skipped 000170 1785775517.062409 trunc from 0x012d10 to 0x01e4d2 (0xb7c3 bytes) 000171 1785775517.068621 read 0x003501 thru 0x00df49 (0xaa49 bytes) 000173 1785775517.083670 trunc from 0x03de0a to 0x02534f (0x18aba bytes) 000174 1785775517.125020 fallocate 0x036351 thru 0x03ab0b (0x47bb bytes) 000175 1785775517.145877 mapwrite 0x020e96 thru 0x0267a6 (0x5911 bytes) 000176 1785775517.298986 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x267a7): Mirror 6: 0xdbc8e096 (stale) Mirror 10: 0xdbc8e096 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x267a7): Mirror 6: 0xdbc8e096 (stale) Mirror 10: 0xdbc8e096 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x267a7: skipped 000177 1785775517.855476 fallocate 0x01c14e thru 0x02a2ae (0xe161 bytes) 000178 1785775517.862880 read 0x022f7c thru 0x026756 (0x37db bytes) 000179 1785775517.881643 trunc from 0x0267a7 to 0x009cf9 (0x1caad bytes) 000180 1785775517.924343 trunc from 0x007da1 to 0x009cf9 (0x1f59 bytes) 000181 1785775517.956793 trunc from 0x00429a to 0x0052c6 (0x102d bytes) 000182 1785775518.005872 trunc from 0x009cfa to 0x019619 (0xf920 bytes) 000183 1785775518.044737 MIRROR_RESYNC 3 mirrors 000184 1785775518.794484 read 0x0191b9 thru 0x019619 (0x461 bytes) 000185 1785775518.798745 punch from 0x0192e7 to 0x019619 (0x333 bytes) 000186 1785775518.835003 trunc from 0x01961a to 0x0234b8 (0x9e9f bytes) 000187 1785775518.855126 trunc from 0x0234b9 to 0x01453c (0xef7c bytes) 000188 1785775518.870456 mapwrite 0x0102bc thru 0x0200d8 (0xfe1d bytes) 000189 1785775518.953625 punch from 0x016c9c to 0x0200d8 (0x943d bytes) 000190 1785775518.966009 MIRROR_RESYNC 3 mirrors 000191 1785775519.888630 punch from 0x01e2dd to 0x0200d8 (0x1dfc bytes) 000193 1785775519.941254 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x200d9): Mirror 6: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x200d9): Mirror 6: 0xf1b256ae (stale) Mirror 10: 0xf1b256ae (stale) CRC-32 checksum value for chunk [0, 0x200d9): Mirror 1: 0xf1b256ae Mirror 11: 0xf1b256ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x200d9: skipped 000194 1785775521.451009 mapread 0x0132a3 thru 0x015af5 (0x2853 bytes) 000195 1785775521.509428 trunc from 0x003a8b to 0x006667 (0x2bdd bytes) 000196 1785775521.600011 punch from 0x01776c to 0x0200d8 (0x896d bytes) 000197 1785775521.619288 fallocate 0x033845 thru 0x03e215 (0xa9d1 bytes) 000198 1785775521.627120 read 0x0093e5 thru 0x00d097 (0x3cb3 bytes) 000199 1785775521.657054 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x200d9): Mirror 10: 0xf1b256ae (stale) Mirror 11: 0xf1b256ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x200d9): Mirror 10: 0xf1b256ae (stale) Mirror 11: 0xf1b256ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x200d9: skipped 000202 1785775522.164599 fallocate 0x003ce5 thru 0x0078a0 (0x3bbc bytes) 000203 1785775522.173103 write 0x01159e thru 0x01e614 (0xd077 bytes) 000204 1785775522.192285 punch from 0x004ba4 to 0x008ba1 (0x3ffe bytes) 000205 1785775522.222852 trunc from 0x0200d9 to 0x02af12 (0xae3a bytes) 000206 1785775522.264418 punch from 0x0146b3 to 0x01dfb7 (0x9905 bytes) 000207 1785775522.304626 trunc from 0x02af13 to 0x00510f (0x25e03 bytes) 000209 1785775522.321603 trunc from 0x005110 to 0x000034 (0x50db bytes) 000210 1785775522.339337 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35): Mirror 11: 0x19af770e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35): Mirror 11: 0x19af770e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35: skipped 000211 1785775522.531563 mapread 0x000004 thru 0x000034 (0x31 bytes) 000212 1785775522.541484 trunc from 0x000021 to 0x000034 (0x14 bytes) 000213 1785775522.545254 trunc from 0x000035 to 0x028161 (0x2812d bytes) 000214 1785775522.601814 read 0x00360b thru 0x0095c1 (0x5fb7 bytes) 000215 1785775522.627368 trunc from 0x028162 to 0x00b895 (0x1c8cc bytes) 000217 1785775522.652240 punch from 0x000e57 to 0x009fde (0x9188 bytes) 000218 1785775522.672557 mapwrite 0x018345 thru 0x01f615 (0x72d1 bytes) 000219 1785775522.787903 fallocate 0x0100fa thru 0x015632 (0x5539 bytes) 000220 1785775522.802001 mapread 0x01b7c6 thru 0x01f615 (0x3e50 bytes) 000222 1785775522.807543 mapread 0x01c1e7 thru 0x01f615 (0x342f bytes) 000223 1785775522.811438 trunc from 0x01f616 to 0x00eda2 (0x10873 bytes) 000224 1785775522.843883 fallocate 0x01c011 thru 0x020a21 (0x4a11 bytes) 000225 1785775522.856410 trunc from 0x009eb6 to 0x016e80 (0xcfcb bytes) 000226 1785775522.867302 write 0x0340ee thru 0x035946 (0x1859 bytes) 000227 1785775522.868435 write 0x00e0ea thru 0x016ae4 (0x89fb bytes) 000228 1785775522.912895 MIRROR_RESYNC 2 mirrors 000230 1785775524.108947 fallocate 0x02fdae thru 0x032c36 (0x2e89 bytes) 000231 1785775524.151694 punch from 0x004a38 to 0x00f134 (0xa6fd bytes) 000232 1785775524.158212 mapread 0x02f27a thru 0x03183b (0x25c2 bytes) 000233 1785775524.176721 trunc from 0x035947 to 0x02cb5b (0x8deb bytes) 000234 1785775524.195048 mapread 0x025ad2 thru 0x02cb5b (0x708a bytes) 000235 1785775524.204672 mapwrite 0x03090d thru 0x03ba90 (0xb184 bytes) 000236 1785775524.267840 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ba91): Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba91): Mirror 11: 0x406a9b92 (stale) CRC-32 checksum value for chunk [0, 0x3ba91): Mirror 1: 0xb9113a7 Mirror 12: 0xb9113a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba91: skipped 000237 1785775526.449769 fallocate 0x032f33 thru 0x03ffff (0xd0cd bytes) 000238 1785775526.541799 trunc from 0x03ba91 to 0x01b04a (0x20a46 bytes) 000239 1785775526.587026 write 0x01b99e thru 0x029203 (0xd866 bytes) 000240 1785775526.602178 punch from 0x01872d to 0x023314 (0xabe8 bytes) 000241 1785775526.650292 fallocate 0x035568 thru 0x03d76e (0x8207 bytes) 000242 1785775526.677915 trunc from 0x029204 to 0x0054db (0x23d28 bytes) 000243 1785775526.714945 mapread 0x003466 thru 0x0054db (0x2076 bytes) 000244 1785775526.750055 punch from 0x003521 to 0x0054db (0x1fbb bytes) 000245 1785775526.756603 trunc from 0x0054dc to 0x027436 (0x21f5b bytes) 000246 1785775526.785257 read 0x0238f1 thru 0x027436 (0x3b46 bytes) 000248 1785775526.805057 read 0x0193f0 thru 0x027436 (0xe047 bytes) 000249 1785775526.828896 write 0x02d9f4 thru 0x03ba0d (0xe01a bytes) 000250 1785775526.835929 trunc from 0x0276c6 to 0x02be09 (0x4744 bytes) 000251 1785775526.849743 write 0x010469 thru 0x0143b5 (0x3f4d bytes) 000252 1785775526.859114 mapread 0x02d155 thru 0x031fe1 (0x4e8d bytes) 000254 1785775526.871357 trunc from 0x0079e7 to 0x008d9f (0x13b9 bytes) 000255 1785775526.893411 punch from 0x00ef10 to 0x01c708 (0xd7f9 bytes) 000256 1785775526.942059 trunc from 0x03ba0e to 0x01135d (0x2a6b0 bytes) 000258 1785775526.982077 mapread 0x00c812 thru 0x00e9e6 (0x21d5 bytes) 000260 1785775526.993522 punch from 0x000f50 to 0x003607 (0x26b8 bytes) 000261 1785775527.017360 fallocate 0x0016a8 thru 0x00edb7 (0xd710 bytes) 000262 1785775527.025963 trunc from 0x01135e to 0x00828b (0x90d2 bytes) 000263 1785775527.080762 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x828c): Mirror 12: 0x81a3a2b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x828c): Mirror 12: 0x81a3a2b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x828c: skipped 000264 1785775527.633081 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x828c): Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x828c): Mirror 12: 0x81a3a2b2 (stale) CRC-32 checksum value for chunk [0, 0x828c): Mirror 1: 0x81a3a2b2 Mirror 13: 0x81a3a2b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x828c: skipped 000265 1785775529.451937 punch from 0x0058c7 to 0x00828b (0x29c5 bytes) 000266 1785775529.574877 punch from 0x006d8e to 0x00828b (0x14fe bytes) 000267 1785775529.579464 trunc from 0x00828c to 0x0181ae (0xff23 bytes) 000268 1785775529.636594 mapread 0x01674c thru 0x017001 (0x8b6 bytes) 000269 1785775529.664303 trunc from 0x0181af to 0x029f96 (0x11de8 bytes) 000270 1785775529.722834 read 0x0001bf thru 0x004a28 (0x486a bytes) 000271 1785775529.746094 trunc from 0x029f97 to 0x02df25 (0x3f8f bytes) 000272 1785775529.769003 punch from 0x00edf3 to 0x012204 (0x3412 bytes) 000274 1785775529.779500 mapread 0x00ec4c thru 0x015454 (0x6809 bytes) 000275 1785775529.829331 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2df26): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df26): Mirror 12: 0x3a0a41fb (stale) Mirror 13: 0xb4ac1669 (stale) CRC-32 checksum value for chunk [0, 0x2df26): Mirror 1: 0xb4ac1669 Mirror 14: 0xb4ac1669 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df26: skipped 000276 1785775531.648304 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2df26): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df26): Mirror 12: 0x3a0a41fb (stale) Mirror 13: 0xb4ac1669 (stale) CRC-32 checksum value for chunk [0, 0x2df26): Mirror 1: 0xb4ac1669 Mirror 14: 0xb4ac1669 Mirror 15: 0xb4ac1669 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df26: skipped 000277 1785775533.239152 write 0x000eaa thru 0x00fd31 (0xee88 bytes) 000278 1785775533.320258 write 0x0025cd thru 0x00be53 (0x9887 bytes) 000279 1785775533.332878 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2df26): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df26): Mirror 12: 0x3a0a41fb (stale) Mirror 13: 0xb4ac1669 (stale) Mirror 14: 0xb4ac1669 (stale) Mirror 15: 0xb4ac1669 (stale) CRC-32 checksum value for chunk [0, 0x2df26): Mirror 1: 0x3f85cda2 Mirror 16: 0x3f85cda2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df26: skipped 000280 1785775535.633921 mapread 0x02b179 thru 0x02df25 (0x2dad bytes) 000282 1785775535.788539 fallocate 0x03dec8 thru 0x03ffff (0x2138 bytes) 000283 1785775535.940777 fallocate 0x02a065 thru 0x037f7e (0xdf1a bytes) 000284 1785775535.956149 trunc from 0x02df26 to 0x010034 (0x1def1 bytes) 000285 1785775536.033751 trunc from 0x004c3b to 0x010034 (0xb3fa bytes) 000286 1785775536.051193 mapwrite 0x021b76 thru 0x023a6f (0x1efa bytes) 000288 1785775536.228823 fallocate 0x0037a7 thru 0x007c26 (0x4480 bytes) 000289 1785775536.247386 mapwrite 0x02b70e thru 0x032825 (0x7118 bytes) 000290 1785775536.401685 fallocate 0x022433 thru 0x030c8f (0xe85d bytes) 000291 1785775536.421709 mapread 0x025f20 thru 0x032825 (0xc906 bytes) 000293 1785775536.428686 trunc from 0x030a19 to 0x032825 (0x1e0d bytes) 000294 1785775536.442720 trunc from 0x026d94 to 0x02e8c4 (0x7b31 bytes) 000295 1785775536.481750 trunc from 0x032826 to 0x0331cf (0x9aa bytes) 000296 1785775536.568776 fallocate 0x003084 thru 0x003839 (0x7b6 bytes) 000297 1785775536.594631 MIRROR_RESYNC 6 mirrors 000298 1785775540.187025 write 0x030328 thru 0x037d9b (0x7a74 bytes) 000299 1785775540.259020 punch from 0x02e881 to 0x037d9b (0x951b bytes) 000300 1785775540.286924 fallocate 0x02e1e4 thru 0x02f705 (0x1522 bytes) 000301 1785775540.301531 write 0x02dd92 thru 0x02ff6b (0x21da bytes) 000303 1785775540.319848 read 0x0145b1 thru 0x024365 (0xfdb5 bytes) 000304 1785775540.342331 write 0x00912d thru 0x00fb85 (0x6a59 bytes) 000306 1785775540.363372 mapwrite 0x025102 thru 0x026498 (0x1397 bytes) 000307 1785775540.422041 MIRROR_RESYNC 6 mirrors 000308 1785775543.942356 mapread 0x007a6b thru 0x0134ce (0xba64 bytes) 000309 1785775544.060763 mapwrite 0x00dd9a thru 0x016b65 (0x8dcc bytes) 000310 1785775544.283642 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37d9c): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d9c): Mirror 12: 0x5d69e045 (stale) Mirror 13: 0x5d69e045 (stale) Mirror 14: 0x5d69e045 (stale) Mirror 15: 0x5d69e045 (stale) Mirror 16: 0x5d69e045 (stale) CRC-32 checksum value for chunk [0, 0x37d9c): Mirror 1: 0x7b699a50 Mirror 17: 0x7b699a50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d9c: skipped 000312 1785775545.293382 mapread 0x028c6c thru 0x03772f (0xeac4 bytes) 000313 1785775545.340760 mapwrite 0x0311d7 thru 0x034474 (0x329e bytes) 000314 1785775545.454022 mapwrite 0x014d2e thru 0x01aac6 (0x5d99 bytes) 000315 1785775545.479752 MIRROR_RESYNC 7 mirrors 000316 1785775549.196763 mapwrite 0x012134 thru 0x01fc26 (0xdaf3 bytes) 000317 1785775549.515534 trunc from 0x037d9c to 0x039cab (0x1f10 bytes) 000318 1785775549.551329 mapwrite 0x00c035 thru 0x016782 (0xa74e bytes) 000319 1785775549.625033 mapwrite 0x033fa2 thru 0x03efdb (0xb03a bytes) 000320 1785775549.768390 trunc from 0x014fb4 to 0x0165bf (0x160c bytes) 000321 1785775549.802071 write 0x033943 thru 0x03ffb8 (0xc676 bytes) 000322 1785775549.803636 mapread 0x029c30 thru 0x03675f (0xcb30 bytes) 000323 1785775549.894704 mapread 0x03ded9 thru 0x03ffb8 (0x20e0 bytes) 000324 1785775549.907788 punch from 0x01f227 to 0x02af90 (0xbd6a bytes) 000325 1785775549.942455 read 0x00dc4e thru 0x01c90e (0xecc1 bytes) 000326 1785775549.965721 mapread 0x00bae4 thru 0x00f850 (0x3d6d bytes) 000327 1785775549.989956 punch from 0x02c1a8 to 0x02d015 (0xe6e bytes) 000328 1785775550.017843 trunc from 0x009a68 to 0x0129cd (0x8f66 bytes) 000329 1785775550.038181 mapread 0x033ba4 thru 0x0386bd (0x4b1a bytes) 000330 1785775550.044348 write 0x023364 thru 0x024fc7 (0x1c64 bytes) 000331 1785775550.068018 mapread 0x012fa0 thru 0x01b238 (0x8299 bytes) 000332 1785775550.117076 mapwrite 0x03ee2a thru 0x03ffff (0x11d6 bytes) 000333 1785775550.299597 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x653d4adb (stale) Mirror 13: 0x653d4adb (stale) Mirror 14: 0x653d4adb (stale) Mirror 15: 0x653d4adb (stale) Mirror 16: 0x653d4adb (stale) Mirror 17: 0x653d4adb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb2988019 Mirror 18: 0xb2988019 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000334 1785775552.916551 mapread 0x00ef8f thru 0x01da79 (0xeaeb bytes) 000335 1785775553.040124 trunc from 0x01ad01 to 0x01ccc5 (0x1fc5 bytes) 000336 1785775553.179571 punch from 0x01f8a7 to 0x02357c (0x3cd6 bytes) 000337 1785775553.188115 write 0x039cc9 thru 0x03ffff (0x6337 bytes) 000338 1785775553.208311 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x653d4adb (stale) Mirror 13: 0x653d4adb (stale) Mirror 14: 0x653d4adb (stale) Mirror 15: 0x653d4adb (stale) Mirror 16: 0x653d4adb (stale) Mirror 17: 0x653d4adb (stale) Mirror 18: 0xb2988019 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x473eb12 Mirror 19: 0x473eb12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000340 1785775555.477536 read 0x028c8c thru 0x037b5f (0xeed4 bytes) 000341 1785775555.517664 trunc from 0x009934 to 0x00b8d1 (0x1f9e bytes) 000342 1785775555.614934 punch from 0x026b6a to 0x032a38 (0xbecf bytes) 000343 1785775555.634933 mapread 0x027ce6 thru 0x036e68 (0xf183 bytes) 000344 1785775555.677145 mapwrite 0x00e815 thru 0x017161 (0x894d bytes) 000345 1785775555.805723 trunc from 0x040000 to 0x0001da (0x3fe25 bytes) 000346 1785775555.840981 write 0x0383ff thru 0x03ffff (0x7c01 bytes) 000347 1785775555.845895 mapwrite 0x03cebf thru 0x03ffff (0x3141 bytes) 000348 1785775555.877566 trunc from 0x040000 to 0x029e7a (0x16185 bytes) 000350 1785775555.916900 write 0x02f25b thru 0x03b793 (0xc539 bytes) 000351 1785775555.928042 MIRROR_RESYNC 9 mirrors 000352 1785775559.086400 punch from 0x016aa7 to 0x0206eb (0x9c45 bytes) 000353 1785775559.177831 trunc from 0x001411 to 0x00e047 (0xcc37 bytes) 000354 1785775559.193087 trunc from 0x01dca8 to 0x028db9 (0xb112 bytes) 000355 1785775559.204429 trunc from 0x03b794 to 0x00823a (0x33559 bytes) 000356 1785775559.274938 mapwrite 0x0305f9 thru 0x0337b9 (0x31c1 bytes) 000357 1785775559.406975 trunc from 0x026577 to 0x031ae9 (0xb573 bytes) 000358 1785775559.420453 trunc from 0x00d0f5 to 0x010157 (0x3063 bytes) 000359 1785775559.427516 write 0x03264f thru 0x035565 (0x2f17 bytes) 000360 1785775559.435669 trunc from 0x0089df to 0x013ff7 (0xb619 bytes) 000361 1785775559.460968 trunc from 0x035566 to 0x0387e3 (0x327e bytes) 000362 1785775559.496863 read 0x0105b7 thru 0x013c89 (0x36d3 bytes) 000363 1785775559.514843 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x387e4): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x387e4): Mirror 12: 0x4d6cce95 (stale) Mirror 13: 0x4d6cce95 (stale) Mirror 14: 0x4d6cce95 (stale) Mirror 15: 0x4d6cce95 (stale) Mirror 16: 0x4d6cce95 (stale) Mirror 17: 0x4d6cce95 (stale) Mirror 18: 0x4d6cce95 (stale) Mirror 19: 0x4d6cce95 (stale) CRC-32 checksum value for chunk [0, 0x387e4): Mirror 1: 0x1b41ce5d Mirror 20: 0x1b41ce5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x387e4: skipped 000364 1785775561.298708 punch from 0x010dbb to 0x020271 (0xf4b7 bytes) 000365 1785775561.431526 mapread 0x037705 thru 0x0387e3 (0x10df bytes) 000366 1785775561.447514 mapread 0x00f719 thru 0x016d24 (0x760c bytes) 000367 1785775561.544841 MIRROR_RESYNC 10 mirrors 000368 1785775565.668697 fallocate 0x03483c thru 0x03d554 (0x8d19 bytes) 000369 1785775565.741332 mapread 0x02dcae thru 0x036ae7 (0x8e3a bytes) 000370 1785775565.787033 fallocate 0x02140a thru 0x0254a7 (0x409e bytes) 000371 1785775565.803243 trunc from 0x0387e4 to 0x00afaa (0x2d839 bytes) 000373 1785775565.864446 punch from 0x002595 to 0x00afaa (0x8a16 bytes) 000375 1785775565.885930 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xafab): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xafab): Mirror 12: 0xf0bc3fd1 (stale) Mirror 13: 0xf0bc3fd1 (stale) Mirror 14: 0xf0bc3fd1 (stale) Mirror 15: 0xf0bc3fd1 (stale) Mirror 16: 0xf0bc3fd1 (stale) Mirror 17: 0xf0bc3fd1 (stale) Mirror 18: 0xf0bc3fd1 (stale) Mirror 19: 0xf0bc3fd1 (stale) Mirror 20: 0xf0bc3fd1 (stale) CRC-32 checksum value for chunk [0, 0xafab): Mirror 1: 0xf0bc3fd1 Mirror 21: 0xf0bc3fd1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xafab: skipped 000376 1785775567.660039 read 0x0027bc thru 0x00afaa (0x87ef bytes) 000378 1785775567.714782 read 0x00005f thru 0x00533c (0x52de bytes) 000379 1785775567.734398 mapwrite 0x033acb thru 0x03ffff (0xc535 bytes) 000381 1785775567.919357 read 0x00a534 thru 0x0148a2 (0xa36f bytes) 000382 1785775567.933039 fallocate 0x00fc98 thru 0x01d18f (0xd4f8 bytes) 000383 1785775567.940927 trunc from 0x040000 to 0x021334 (0x1eccb bytes) 000384 1785775567.969664 read 0x016d55 thru 0x021334 (0xa5e0 bytes) 000385 1785775567.980965 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21335): Mirror 12: 0xf553b008 (stale) Mirror 13: 0xf553b008 (stale) Mirror 14: 0xf553b008 (stale) Mirror 15: 0xf553b008 (stale) Mirror 16: 0xf553b008 (stale) Mirror 18: 0xf553b008 (stale) Mirror 19: 0xf553b008 (stale) Mirror 20: 0xf553b008 (stale) Mirror 21: 0xf553b008 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21335): Mirror 12: 0xf553b008 (stale) Mirror 13: 0xf553b008 (stale) Mirror 14: 0xf553b008 (stale) Mirror 15: 0xf553b008 (stale) Mirror 16: 0xf553b008 (stale) Mirror 18: 0xf553b008 (stale) Mirror 19: 0xf553b008 (stale) Mirror 20: 0xf553b008 (stale) Mirror 21: 0xf553b008 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21335: skipped 000386 1785775568.932388 mapwrite 0x01ef12 thru 0x02091e (0x1a0d bytes) 000387 1785775568.970057 punch from 0x00bee1 to 0x013ed9 (0x7ff9 bytes) 000388 1785775568.975989 fallocate 0x00e881 thru 0x0185a9 (0x9d29 bytes) 000389 1785775568.984686 write 0x01cb7e thru 0x02b726 (0xeba9 bytes) 000390 1785775568.992985 trunc from 0x02b727 to 0x00093a (0x2adec bytes) 000391 1785775569.015101 mapwrite 0x01e5a6 thru 0x0236c9 (0x5124 bytes) 000392 1785775569.068511 punch from 0x01ec25 to 0x0236c9 (0x4aa5 bytes) 000393 1785775569.093473 mapwrite 0x037645 thru 0x03e4c0 (0x6e7c bytes) 000394 1785775569.157705 mapwrite 0x01b59f thru 0x028008 (0xca6a bytes) 000395 1785775569.268555 trunc from 0x03e4c1 to 0x037995 (0x6b2b bytes) 000396 1785775569.305789 MIRROR_RESYNC 10 mirrors 000398 1785775572.823201 read 0x020b6a thru 0x02d03d (0xc4d4 bytes) 000399 1785775572.834153 mapwrite 0x035fd7 thru 0x03ffff (0xa029 bytes) 000400 1785775573.035750 write 0x021a6e thru 0x022cd0 (0x1263 bytes) 000401 1785775573.079674 mapread 0x026563 thru 0x0326b2 (0xc150 bytes) 000402 1785775573.113868 read 0x036a14 thru 0x0379c7 (0xfb4 bytes) 000403 1785775573.116983 trunc from 0x040000 to 0x0010c4 (0x3ef3b bytes) 000404 1785775573.176529 read 0x0003f8 thru 0x0010c4 (0xccd bytes) 000405 1785775573.194878 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10c5): Mirror 13: 0xfcc4b306 (stale) Mirror 14: 0xfcc4b306 (stale) Mirror 15: 0xfcc4b306 (stale) Mirror 16: 0xfcc4b306 (stale) Mirror 18: 0xfcc4b306 (stale) Mirror 19: 0xfcc4b306 (stale) Mirror 20: 0xfcc4b306 (stale) Mirror 21: 0xfcc4b306 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10c5): Mirror 13: 0xfcc4b306 (stale) Mirror 14: 0xfcc4b306 (stale) Mirror 15: 0xfcc4b306 (stale) Mirror 16: 0xfcc4b306 (stale) Mirror 18: 0xfcc4b306 (stale) Mirror 19: 0xfcc4b306 (stale) Mirror 20: 0xfcc4b306 (stale) Mirror 21: 0xfcc4b306 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10c5: skipped 000406 1785775573.886466 trunc from 0x0010c5 to 0x03d2c4 (0x3c200 bytes) 000407 1785775573.932071 mapwrite 0x01d5d4 thru 0x02d0b5 (0xfae2 bytes) 000408 1785775574.084985 fallocate 0x0263a3 thru 0x0311e2 (0xae40 bytes) 000409 1785775574.106294 read 0x020851 thru 0x030390 (0xfb40 bytes) 000410 1785775574.106998 trunc from 0x034562 to 0x03b6d9 (0x7178 bytes) 000411 1785775574.118888 mapwrite 0x0166c7 thru 0x0200f6 (0x9a30 bytes) 000412 1785775574.217803 write 0x02a78b thru 0x02ee34 (0x46aa bytes) 000413 1785775574.225680 fallocate 0x02b6a9 thru 0x02eb71 (0x34c9 bytes) 000414 1785775574.235495 write 0x01406a thru 0x01c178 (0x810f bytes) 000415 1785775574.241072 mapwrite 0x007641 thru 0x00a9a4 (0x3364 bytes) 000416 1785775574.361086 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d2c5): Mirror 13: 0xce394aed (stale) Mirror 14: 0xce394aed (stale) Mirror 15: 0xce394aed (stale) Mirror 18: 0xce394aed (stale) Mirror 19: 0xce394aed (stale) Mirror 20: 0xce394aed (stale) Mirror 21: 0xce394aed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2c5): Mirror 13: 0xce394aed (stale) Mirror 14: 0xce394aed (stale) Mirror 15: 0xce394aed (stale) Mirror 18: 0xce394aed (stale) Mirror 19: 0xce394aed (stale) Mirror 20: 0xce394aed (stale) Mirror 21: 0xce394aed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2c5: skipped 000417 1785775576.104252 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d2c5): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2c5): Mirror 13: 0xce394aed (stale) Mirror 14: 0xce394aed (stale) Mirror 15: 0xce394aed (stale) Mirror 18: 0xce394aed (stale) Mirror 19: 0xce394aed (stale) Mirror 20: 0xce394aed (stale) Mirror 21: 0xce394aed (stale) CRC-32 checksum value for chunk [0, 0x3d2c5): Mirror 1: 0x8346fdf0 Mirror 22: 0x8346fdf0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2c5: skipped 000418 1785775578.224605 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d2c5): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2c5): Mirror 13: 0xce394aed (stale) Mirror 14: 0xce394aed (stale) Mirror 15: 0xce394aed (stale) Mirror 18: 0xce394aed (stale) Mirror 19: 0xce394aed (stale) Mirror 20: 0xce394aed (stale) Mirror 21: 0xce394aed (stale) CRC-32 checksum value for chunk [0, 0x3d2c5): Mirror 1: 0x8346fdf0 Mirror 22: 0x8346fdf0 Mirror 23: 0x8346fdf0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2c5: skipped 000420 1785775579.558407 mapread 0x0021aa thru 0x00d375 (0xb1cc bytes) 000421 1785775579.576293 trunc from 0x03d2c5 to 0x024573 (0x18d51 bytes) 000422 1785775579.629488 read 0x01831f thru 0x0197ac (0x148e bytes) 000423 1785775579.637198 fallocate 0x02cd74 thru 0x03785a (0xaae7 bytes) 000424 1785775579.642082 punch from 0x014e24 to 0x020804 (0xb9e1 bytes) 000425 1785775579.647631 mapwrite 0x005b5d thru 0x00b3a3 (0x5847 bytes) 000426 1785775579.675721 mapread 0x014842 thru 0x01ab42 (0x6301 bytes) 000427 1785775579.689956 read 0x01fec6 thru 0x02394e (0x3a89 bytes) 000428 1785775579.702634 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x24574): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24574): Mirror 13: 0xe449bf60 (stale) Mirror 14: 0xe449bf60 (stale) Mirror 15: 0xe449bf60 (stale) Mirror 18: 0xe449bf60 (stale) Mirror 19: 0xe449bf60 (stale) Mirror 20: 0xe449bf60 (stale) Mirror 21: 0xe449bf60 (stale) Mirror 22: 0x7305ed30 (stale) Mirror 23: 0x7305ed30 (stale) CRC-32 checksum value for chunk [0, 0x24574): Mirror 1: 0x48b2f10f Mirror 24: 0x48b2f10f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24574: skipped 000429 1785775580.667046 mapwrite 0x02cde0 thru 0x03bba3 (0xedc4 bytes) 000430 1785775580.759560 trunc from 0x03bba4 to 0x0286b2 (0x134f1 bytes) 000431 1785775580.777717 read 0x01ac41 thru 0x025cec (0xb0ac bytes) 000432 1785775580.788691 mapwrite 0x0207e4 thru 0x021046 (0x863 bytes) 000433 1785775580.799929 mapread 0x005a48 thru 0x00b1e0 (0x5799 bytes) 000434 1785775580.807594 read 0x00cc66 thru 0x01c266 (0xf601 bytes) 000435 1785775580.814764 trunc from 0x0286b3 to 0x01f11b (0x9597 bytes) 000436 1785775580.831330 trunc from 0x01a981 to 0x01f11b (0x479b bytes) 000437 1785775580.836682 read 0x00eb43 thru 0x01defb (0xf3b9 bytes) 000438 1785775580.845717 mapwrite 0x010954 thru 0x016182 (0x582f bytes) 000439 1785775580.907410 MIRROR_RESYNC 11 mirrors 000440 1785775583.717257 MIRROR_RESYNC 11 mirrors 000442 1785775584.412772 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) 000443 1785775584.991704 read 0x00c23b thru 0x014325 (0x80eb bytes) 000444 1785775585.002835 mapread 0x012eca thru 0x01f11b (0xc252 bytes) 000446 1785775585.025761 trunc from 0x012f26 to 0x015acd (0x2ba8 bytes) 000447 1785775585.071566 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1f11c): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f11c): Mirror 13: 0xa5dfe710 (stale) Mirror 14: 0xa5dfe710 (stale) Mirror 15: 0xa5dfe710 (stale) Mirror 18: 0xa5dfe710 (stale) Mirror 19: 0xa5dfe710 (stale) Mirror 21: 0xa5dfe710 (stale) Mirror 22: 0xa5dfe710 (stale) Mirror 23: 0xa5dfe710 (stale) Mirror 24: 0xa5dfe710 (stale) CRC-32 checksum value for chunk [0, 0x1f11c): Mirror 1: 0xbfdc17ef Mirror 25: 0xbfdc17ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f11c: skipped 000449 1785775586.496385 mapwrite 0x00be63 thru 0x011e1f (0x5fbd bytes) 000450 1785775586.605747 mapwrite 0x002734 thru 0x010c53 (0xe520 bytes) 000451 1785775586.626129 fallocate 0x03a2af thru 0x03ffff (0x5d51 bytes) 000452 1785775586.629998 write 0x01c772 thru 0x029f87 (0xd816 bytes) 000453 1785775586.643497 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x29f88): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f88): Mirror 13: 0x3ffd20a5 (stale) Mirror 14: 0x3ffd20a5 (stale) Mirror 15: 0x3ffd20a5 (stale) Mirror 18: 0x3ffd20a5 (stale) Mirror 19: 0x3ffd20a5 (stale) Mirror 21: 0x3ffd20a5 (stale) Mirror 22: 0x3ffd20a5 (stale) Mirror 23: 0x3ffd20a5 (stale) Mirror 24: 0x3ffd20a5 (stale) Mirror 25: 0x7eea0482 (stale) CRC-32 checksum value for chunk [0, 0x29f88): Mirror 1: 0xedd0972 Mirror 26: 0xedd0972 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f88: skipped 000454 1785775588.193238 read 0x01ea28 thru 0x029f87 (0xb560 bytes) 000455 1785775588.253341 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29f88): Mirror 14: 0x3ffd20a5 (stale) Mirror 15: 0x3ffd20a5 (stale) Mirror 18: 0x3ffd20a5 (stale) Mirror 19: 0x3ffd20a5 (stale) Mirror 21: 0x3ffd20a5 (stale) Mirror 22: 0x3ffd20a5 (stale) Mirror 23: 0x3ffd20a5 (stale) Mirror 24: 0x3ffd20a5 (stale) Mirror 25: 0x7eea0482 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f88): Mirror 14: 0x3ffd20a5 (stale) Mirror 15: 0x3ffd20a5 (stale) Mirror 18: 0x3ffd20a5 (stale) Mirror 19: 0x3ffd20a5 (stale) Mirror 21: 0x3ffd20a5 (stale) Mirror 22: 0x3ffd20a5 (stale) Mirror 23: 0x3ffd20a5 (stale) Mirror 24: 0x3ffd20a5 (stale) Mirror 25: 0x7eea0482 (stale) CRC-32 checksum value for chunk [0, 0x29f88): Mirror 1: 0xedd0972 Mirror 26: 0xedd0972 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f88: skipped 000456 1785775589.491154 mapread 0x0005e9 thru 0x00990e (0x9326 bytes) 000457 1785775589.528703 MIRROR_RESYNC 11 mirrors 000458 1785775592.483770 trunc from 0x029f88 to 0x028645 (0x1942 bytes) 000459 1785775592.520233 write 0x02972e thru 0x030d6e (0x7641 bytes) 000460 1785775592.522044 mapwrite 0x002ddf thru 0x00b6b0 (0x88d2 bytes) 000461 1785775592.601487 fallocate 0x01faeb thru 0x023825 (0x3d3b bytes) 000463 1785775592.606092 write 0x0276cf thru 0x02de88 (0x67ba bytes) 000464 1785775592.611332 write 0x0359ab thru 0x03ffff (0xa655 bytes) 000465 1785775592.613165 trunc from 0x0220b0 to 0x02921f (0x7170 bytes) 000466 1785775592.629346 trunc from 0x040000 to 0x00533f (0x3acc0 bytes) 000467 1785775592.645821 mapwrite 0x03d6c0 thru 0x03f52c (0x1e6d bytes) 000468 1785775592.713390 mapwrite 0x03d116 thru 0x03ffff (0x2eea bytes) 000469 1785775592.770333 trunc from 0x040000 to 0x01b3c9 (0x24c36 bytes) 000470 1785775592.796125 mapread 0x002900 thru 0x004a14 (0x2115 bytes) 000471 1785775592.797125 mapread 0x006e19 thru 0x00cab9 (0x5ca1 bytes) 000472 1785775592.809564 trunc from 0x01b3ca to 0x03e449 (0x23080 bytes) 000473 1785775592.830758 fallocate 0x02d8d3 thru 0x031e5c (0x458a bytes) 000474 1785775592.840559 read 0x027bc2 thru 0x032003 (0xa442 bytes) 000475 1785775592.861586 fallocate 0x00bd18 thru 0x010e7f (0x5168 bytes) 000476 1785775592.904222 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e44a): Mirror 14: 0xffe503d1 (stale) Mirror 15: 0xffe503d1 (stale) Mirror 18: 0xffe503d1 (stale) Mirror 19: 0xffe503d1 (stale) Mirror 21: 0xffe503d1 (stale) Mirror 23: 0xffe503d1 (stale) Mirror 24: 0xffe503d1 (stale) Mirror 25: 0xffe503d1 (stale) Mirror 26: 0xffe503d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e44a): Mirror 14: 0xffe503d1 (stale) Mirror 15: 0xffe503d1 (stale) Mirror 18: 0xffe503d1 (stale) Mirror 19: 0xffe503d1 (stale) Mirror 21: 0xffe503d1 (stale) Mirror 23: 0xffe503d1 (stale) Mirror 24: 0xffe503d1 (stale) Mirror 25: 0xffe503d1 (stale) Mirror 26: 0xffe503d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e44a: skipped 000477 1785775594.560694 mapread 0x01ea9a thru 0x02a706 (0xbc6d bytes) 000478 1785775594.640979 read 0x01e10a thru 0x02d4ff (0xf3f6 bytes) 000479 1785775594.651121 trunc from 0x012f18 to 0x01ae4f (0x7f38 bytes) 000480 1785775594.656858 write 0x0328aa thru 0x03de68 (0xb5bf bytes) 000481 1785775594.714726 read 0x019f7b thru 0x01d115 (0x319b bytes) 000482 1785775594.839570 write 0x015307 thru 0x018103 (0x2dfd bytes) 000483 1785775594.856189 trunc from 0x025221 to 0x02d657 (0x8437 bytes) 000484 1785775594.884698 punch from 0x007cbb to 0x015c0a (0xdf50 bytes) 000485 1785775594.951602 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e44a): Mirror 15: 0xffe503d1 (stale) Mirror 18: 0xffe503d1 (stale) Mirror 19: 0xffe503d1 (stale) Mirror 21: 0xffe503d1 (stale) Mirror 23: 0xffe503d1 (stale) Mirror 24: 0xffe503d1 (stale) Mirror 25: 0xffe503d1 (stale) Mirror 26: 0xffe503d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e44a): Mirror 15: 0xffe503d1 (stale) Mirror 18: 0xffe503d1 (stale) Mirror 19: 0xffe503d1 (stale) Mirror 21: 0xffe503d1 (stale) Mirror 23: 0xffe503d1 (stale) Mirror 24: 0xffe503d1 (stale) Mirror 25: 0xffe503d1 (stale) Mirror 26: 0xffe503d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e44a: skipped 000486 1785775596.460644 trunc from 0x03e44a to 0x00c338 (0x32111 bytes) 000487 1785775596.526212 punch from 0x00ae44 to 0x00c338 (0x14f5 bytes) 000488 1785775596.547961 trunc from 0x004430 to 0x006b8b (0x275c bytes) 000490 1785775596.576254 trunc from 0x00c339 to 0x03c006 (0x2fcce bytes) 000491 1785775596.614827 mapwrite 0x0053f0 thru 0x006870 (0x1481 bytes) 000492 1785775596.681886 MIRROR_RESYNC 9 mirrors 000493 1785775600.982609 fallocate 0x02cc4d thru 0x036cb2 (0xa066 bytes) 000494 1785775601.031720 mapread 0x007238 thru 0x01362f (0xc3f8 bytes) 000495 1785775601.086626 fallocate 0x03ebd7 thru 0x03ffff (0x1429 bytes) 000496 1785775601.099041 punch from 0x013020 to 0x01667e (0x365f bytes) 000497 1785775601.105714 read 0x015a89 thru 0x018f79 (0x34f1 bytes) 000498 1785775601.112180 mapread 0x01fa3a thru 0x02cf80 (0xd547 bytes) 000499 1785775601.152903 write 0x004f4f thru 0x013748 (0xe7fa bytes) 000500 1785775601.169115 read 0x0344ef thru 0x036974 (0x2486 bytes) 000501 1785775601.179674 mapwrite 0x00b0f3 thru 0x01165f (0x656d bytes) 000502 1785775601.219710 punch from 0x0238e7 to 0x026ce4 (0x33fe bytes) 000503 1785775601.226818 fallocate 0x0303a6 thru 0x034fc5 (0x4c20 bytes) 000504 1785775601.234963 punch from 0x03257c to 0x0372ce (0x4d53 bytes) 000505 1785775601.241509 trunc from 0x0330fb to 0x03f577 (0xc47d bytes) 000506 1785775601.255530 mapread 0x035c4d thru 0x03aca6 (0x505a bytes) 000507 1785775601.300012 write 0x0196a5 thru 0x01cd69 (0x36c5 bytes) 000508 1785775601.304609 punch from 0x00ebae to 0x013ef8 (0x534b bytes) 000509 1785775601.323651 read 0x03b381 thru 0x03e791 (0x3411 bytes) 000511 1785775601.379978 read 0x01addf thru 0x028649 (0xd86b bytes) 000512 1785775601.391904 trunc from 0x040000 to 0x002d7e (0x3d281 bytes) 000513 1785775601.440128 read 0x00223d thru 0x002d7e (0xb42 bytes) 000514 1785775601.440793 read 0x000e34 thru 0x002d7e (0x1f4b bytes) 000515 1785775601.443253 write 0x00b65d thru 0x015500 (0x9ea4 bytes) 000517 1785775601.467438 trunc from 0x015501 to 0x01c600 (0x7100 bytes) 000518 1785775601.501838 fallocate 0x00b497 thru 0x00c1a2 (0xd0c bytes) 000519 1785775601.538567 punch from 0x0198ef to 0x01c600 (0x2d12 bytes) 000520 1785775601.550576 punch from 0x00e756 to 0x014e53 (0x66fe bytes) 000521 1785775601.601772 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1c601): Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c601): Mirror 15: 0x2d1c6124 (stale) Mirror 18: 0x2d1c6124 (stale) Mirror 19: 0x2d1c6124 (stale) Mirror 21: 0x2d1c6124 (stale) Mirror 23: 0x2d1c6124 (stale) Mirror 24: 0x2d1c6124 (stale) Mirror 25: 0x2d1c6124 (stale) Mirror 26: 0x2d1c6124 (stale) CRC-32 checksum value for chunk [0, 0x1c601): Mirror 1: 0xb0294a2d Mirror 27: 0xb0294a2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c601: skipped 000522 1785775604.098524 trunc from 0x01c601 to 0x01b74b (0xeb5 bytes) 000523 1785775604.273995 read 0x00ac89 thru 0x0175b9 (0xc931 bytes) 000524 1785775604.349061 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1b74c): Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b74c): Mirror 15: 0x6a3d6c91 (stale) Mirror 18: 0x6a3d6c91 (stale) Mirror 19: 0x6a3d6c91 (stale) Mirror 21: 0x6a3d6c91 (stale) Mirror 23: 0x6a3d6c91 (stale) Mirror 24: 0x6a3d6c91 (stale) Mirror 25: 0x6a3d6c91 (stale) Mirror 26: 0x6a3d6c91 (stale) Mirror 27: 0xdb3597a6 (stale) CRC-32 checksum value for chunk [0, 0x1b74c): Mirror 1: 0xdb3597a6 Mirror 28: 0xdb3597a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b74c: skipped 000525 1785775607.372205 mapwrite 0x01fd00 thru 0x02402c (0x432d bytes) 000526 1785775607.732521 mapread 0x0165f2 thru 0x0211cd (0xabdc bytes) 000527 1785775607.762088 mapwrite 0x005e20 thru 0x0102ce (0xa4af bytes) 000528 1785775607.890405 mapread 0x01b239 thru 0x021979 (0x6741 bytes) 000530 1785775607.913846 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2402d): Mirror 18: 0x408934a7 (stale) Mirror 19: 0x408934a7 (stale) Mirror 21: 0x408934a7 (stale) Mirror 23: 0x408934a7 (stale) Mirror 24: 0x408934a7 (stale) Mirror 25: 0x408934a7 (stale) Mirror 26: 0x408934a7 (stale) Mirror 27: 0xad66174a (stale) Mirror 28: 0xad66174a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2402d): Mirror 18: 0x408934a7 (stale) Mirror 19: 0x408934a7 (stale) Mirror 21: 0x408934a7 (stale) Mirror 23: 0x408934a7 (stale) Mirror 24: 0x408934a7 (stale) Mirror 25: 0x408934a7 (stale) Mirror 26: 0x408934a7 (stale) Mirror 27: 0xad66174a (stale) Mirror 28: 0xad66174a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2402d: skipped 000531 1785775609.703595 mapwrite 0x03bfb8 thru 0x03ffff (0x4048 bytes) 000532 1785775609.911802 write 0x039b89 thru 0x03ffff (0x6477 bytes) 000533 1785775609.913200 mapread 0x0225c8 thru 0x02d8b7 (0xb2f0 bytes) 000534 1785775610.032433 mapread 0x00cd17 thru 0x014713 (0x79fd bytes) 000536 1785775610.102511 trunc from 0x034e9e to 0x03ffff (0xb162 bytes) 000537 1785775610.156955 write 0x01a476 thru 0x024f7d (0xab08 bytes) 000538 1785775610.220981 mapread 0x00c673 thru 0x00cbfb (0x589 bytes) 000539 1785775610.222741 read 0x033f54 thru 0x0368fa (0x29a7 bytes) 000541 1785775610.244932 punch from 0x0137e4 to 0x0228d2 (0xf0ef bytes) 000542 1785775610.275365 punch from 0x03a162 to 0x03ffff (0x5e9e bytes) 000543 1785775610.293136 mapread 0x02b917 thru 0x02c089 (0x773 bytes) 000544 1785775610.310962 trunc from 0x040000 to 0x0141a5 (0x2be5a bytes) 000545 1785775610.342098 read 0x007a43 thru 0x01247a (0xaa38 bytes) 000546 1785775610.342874 fallocate 0x030e25 thru 0x0322b0 (0x148c bytes) 000547 1785775610.359400 punch from 0x00a49e to 0x0173e7 (0xcf4a bytes) 000548 1785775610.378226 fallocate 0x008687 thru 0x01263b (0x9fb5 bytes) 000549 1785775610.389144 fallocate 0x009d5f thru 0x010024 (0x62c6 bytes) 000550 1785775610.411120 trunc from 0x01c16d to 0x027db6 (0xbc4a bytes) 000551 1785775610.430700 trunc from 0x006525 to 0x00fef9 (0x99d5 bytes) 000552 1785775610.440401 write 0x030bd4 thru 0x03a57c (0x99a9 bytes) 000553 1785775610.489792 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3a57d): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a57d): Mirror 18: 0x7f45469a (stale) Mirror 19: 0x7f45469a (stale) Mirror 21: 0x7f45469a (stale) Mirror 23: 0x7f45469a (stale) Mirror 24: 0x7f45469a (stale) Mirror 25: 0x7f45469a (stale) Mirror 26: 0x7f45469a (stale) Mirror 27: 0x4dcb5bb3 (stale) Mirror 28: 0x4dcb5bb3 (stale) CRC-32 checksum value for chunk [0, 0x3a57d): Mirror 1: 0xc5f0b4e0 Mirror 29: 0xc5f0b4e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a57d: skipped 000554 1785775613.279702 write 0x004e16 thru 0x00b96a (0x6b55 bytes) 000555 1785775613.416850 fallocate 0x01862e thru 0x0274ce (0xeea1 bytes) 000556 1785775613.422536 write 0x013489 thru 0x01feef (0xca67 bytes) 000557 1785775613.461346 trunc from 0x010169 to 0x01d0e2 (0xcf7a bytes) 000558 1785775613.512539 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a57d): Mirror 19: 0x7f45469a (stale) Mirror 21: 0x7f45469a (stale) Mirror 23: 0x7f45469a (stale) Mirror 24: 0x7f45469a (stale) Mirror 25: 0x7f45469a (stale) Mirror 26: 0x7f45469a (stale) Mirror 27: 0x4dcb5bb3 (stale) Mirror 28: 0x4dcb5bb3 (stale) Mirror 29: 0xc5f0b4e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a57d): Mirror 19: 0x7f45469a (stale) Mirror 21: 0x7f45469a (stale) Mirror 23: 0x7f45469a (stale) Mirror 24: 0x7f45469a (stale) Mirror 25: 0x7f45469a (stale) Mirror 26: 0x7f45469a (stale) Mirror 27: 0x4dcb5bb3 (stale) Mirror 28: 0x4dcb5bb3 (stale) Mirror 29: 0xc5f0b4e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a57d: skipped 000559 1785775614.954239 mapread 0x038196 thru 0x03a57c (0x23e7 bytes) 000560 1785775614.988126 mapread 0x0393d8 thru 0x0399ea (0x613 bytes) 000561 1785775614.990225 trunc from 0x03a57d to 0x0299dd (0x10b9f bytes) 000562 1785775615.041166 punch from 0x00fe8d to 0x01d854 (0xd9c8 bytes) 000563 1785775615.060451 mapread 0x00b158 thru 0x019fcf (0xee78 bytes) 000564 1785775615.085229 MIRROR_RESYNC 10 mirrors 000566 1785775622.130662 trunc from 0x015aa1 to 0x01b5ac (0x5b0c bytes) 000568 1785775622.233685 fallocate 0x007cac thru 0x00a7f0 (0x2b45 bytes) 000569 1785775622.251391 read 0x01ef97 thru 0x0299dd (0xaa47 bytes) 000570 1785775622.263706 trunc from 0x022a4f to 0x0299dd (0x6f8f bytes) 000571 1785775622.272357 trunc from 0x0299de to 0x02d592 (0x3bb5 bytes) 000572 1785775622.326932 fallocate 0x02c05e thru 0x02d76b (0x170e bytes) 000573 1785775622.342428 fallocate 0x00bb94 thru 0x012cd3 (0x7140 bytes) 000574 1785775622.350797 trunc from 0x02d593 to 0x000f02 (0x2c690 bytes) 000575 1785775622.450599 fallocate 0x0124d0 thru 0x01d5aa (0xb0db bytes) 000576 1785775622.474196 read 0x000563 thru 0x000f02 (0x9a0 bytes) 000577 1785775622.491839 read 0x0009f4 thru 0x000f02 (0x50f bytes) 000578 1785775622.492787 read 0x000c4f thru 0x000f02 (0x2b4 bytes) 000579 1785775622.494051 read 0x00094f thru 0x000f02 (0x5b4 bytes) 000580 1785775622.495755 trunc from 0x000e4c to 0x000f02 (0xb7 bytes) 000581 1785775622.505480 fallocate 0x030e2c thru 0x03293f (0x1b14 bytes) 000583 1785775622.516227 punch from 0x0003a4 to 0x000a32 (0x68f bytes) 000585 1785775622.522896 mapread 0x000765 thru 0x000f02 (0x79e bytes) 000586 1785775622.559797 MIRROR_RESYNC 10 mirrors 000587 1785775624.167867 trunc from 0x000f03 to 0x01d796 (0x1c894 bytes) 000588 1785775624.257311 mapwrite 0x03b470 thru 0x03ffff (0x4b90 bytes) 000589 1785775624.367287 write 0x014008 thru 0x02396e (0xf967 bytes) 000590 1785775624.388412 trunc from 0x021aef to 0x02cc4f (0xb161 bytes) 000591 1785775624.414611 mapread 0x014c5d thru 0x0249a4 (0xfd48 bytes) 000592 1785775624.448842 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0xe20eea22 (stale) Mirror 25: 0xe20eea22 (stale) Mirror 26: 0xe20eea22 (stale) Mirror 27: 0xe20eea22 (stale) Mirror 28: 0xe20eea22 (stale) Mirror 29: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd4a6d63f Mirror 30: 0xd4a6d63f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000593 1785775625.946607 trunc from 0x01ebe4 to 0x028249 (0x9666 bytes) 000594 1785775626.045212 punch from 0x02334d to 0x03110f (0xddc3 bytes) 000595 1785775626.048837 trunc from 0x040000 to 0x03c8e8 (0x3717 bytes) 000596 1785775626.065324 mapwrite 0x0140cf thru 0x01b061 (0x6f93 bytes) 000597 1785775626.099757 mapwrite 0x006247 thru 0x00d653 (0x740d bytes) 000598 1785775626.126241 mapwrite 0x01c71a thru 0x01eb44 (0x242b bytes) 000599 1785775626.157932 mapwrite 0x003a86 thru 0x0110e6 (0xd661 bytes) 000600 1785775626.183734 trunc from 0x008f5a to 0x011ce5 (0x8d8c bytes) 000601 1785775626.204835 trunc from 0x026c7f to 0x035ac8 (0xee4a bytes) 000602 1785775626.311579 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3c8e9): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c8e9): Mirror 19: 0xd04959db (stale) Mirror 21: 0xd04959db (stale) Mirror 23: 0xd04959db (stale) Mirror 24: 0xd04959db (stale) Mirror 25: 0xd04959db (stale) Mirror 26: 0xd04959db (stale) Mirror 27: 0xd04959db (stale) Mirror 28: 0xd04959db (stale) Mirror 29: 0xd04959db (stale) Mirror 30: 0xa45efe28 (stale) CRC-32 checksum value for chunk [0, 0x3c8e9): Mirror 1: 0x8bff5c13 Mirror 31: 0x8bff5c13 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c8e9: skipped 000603 1785775629.643749 read 0x020338 thru 0x021391 (0x105a bytes) 000604 1785775629.677631 trunc from 0x03c8e9 to 0x03ac15 (0x1cd3 bytes) 000605 1785775629.904021 trunc from 0x03ac16 to 0x02ddbe (0xce57 bytes) 000606 1785775629.964795 punch from 0x010c5b to 0x01ac88 (0xa02e bytes) 000607 1785775629.994787 write 0x0249b4 thru 0x034468 (0xfab5 bytes) 000608 1785775630.021618 trunc from 0x034469 to 0x00a5e5 (0x29e83 bytes) 000609 1785775630.074150 trunc from 0x00a5e6 to 0x02c577 (0x21f92 bytes) 000610 1785775630.117347 trunc from 0x01ee03 to 0x02969a (0xa898 bytes) 000611 1785775630.153067 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c578): Mirror 19: 0xd79b7661 (stale) Mirror 21: 0xd79b7661 (stale) Mirror 23: 0xd79b7661 (stale) Mirror 25: 0xd79b7661 (stale) Mirror 26: 0xd79b7661 (stale) Mirror 27: 0xd79b7661 (stale) Mirror 28: 0xd79b7661 (stale) Mirror 29: 0xd79b7661 (stale) Mirror 30: 0x4a0539ac (stale) Mirror 31: 0x35d0ecc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c578): Mirror 19: 0xd79b7661 (stale) Mirror 21: 0xd79b7661 (stale) Mirror 23: 0xd79b7661 (stale) Mirror 25: 0xd79b7661 (stale) Mirror 26: 0xd79b7661 (stale) Mirror 27: 0xd79b7661 (stale) Mirror 28: 0xd79b7661 (stale) Mirror 29: 0xd79b7661 (stale) Mirror 30: 0x4a0539ac (stale) Mirror 31: 0x35d0ecc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c578: skipped 000612 1785775631.468709 punch from 0x0127de to 0x01a91b (0x813e bytes) 000613 1785775631.496358 fallocate 0x0296cc thru 0x031d9e (0x86d3 bytes) 000614 1785775631.515771 trunc from 0x02491e to 0x0276cc (0x2daf bytes) 000615 1785775631.551867 fallocate 0x03b68e thru 0x03c33a (0xcad bytes) 000616 1785775631.568152 fallocate 0x00bed8 thru 0x016394 (0xa4bd bytes) 000617 1785775631.578744 read 0x024f3a thru 0x029c8b (0x4d52 bytes) 000618 1785775631.602163 mapread 0x00bd1c thru 0x010ade (0x4dc3 bytes) 000619 1785775631.638328 mapwrite 0x02284c thru 0x02fb34 (0xd2e9 bytes) 000620 1785775631.766345 fallocate 0x016059 thru 0x01f6ca (0x9672 bytes) 000621 1785775631.774566 read 0x00c96e thru 0x011597 (0x4c2a bytes) 000623 1785775631.778793 trunc from 0x004eb5 to 0x005a06 (0xb52 bytes) 000625 1785775631.788188 read 0x01798f thru 0x0248f0 (0xcf62 bytes) 000626 1785775631.811330 write 0x02f47a thru 0x0391c7 (0x9d4e bytes) 000627 1785775631.818657 punch from 0x022253 to 0x02ce0e (0xabbc bytes) 000628 1785775631.826770 trunc from 0x0391c8 to 0x008a33 (0x30794 bytes) 000630 1785775631.851740 punch from 0x001e60 to 0x008a33 (0x6bd4 bytes) 000631 1785775631.883552 punch from 0x000630 to 0x008a33 (0x8404 bytes) 000632 1785775631.911857 trunc from 0x008a34 to 0x0028eb (0x6148 bytes) 000633 1785775631.974470 read 0x000b37 thru 0x0028eb (0x1db5 bytes) 000634 1785775631.992779 trunc from 0x0028ec to 0x00f6dd (0xcdf2 bytes) 000635 1785775632.075907 mapread 0x0009fa thru 0x002e2b (0x2432 bytes) 000636 1785775632.092293 mapread 0x007cc4 thru 0x00f6dd (0x7a1a bytes) 000637 1785775632.141366 mapwrite 0x006722 thru 0x0071be (0xa9d bytes) 000639 1785775632.182444 trunc from 0x00f6de to 0x006c16 (0x8ac7 bytes) 000640 1785775632.234340 mapwrite 0x00999d thru 0x00e7be (0x4e22 bytes) 000642 1785775632.434363 read 0x00a42f thru 0x00e7be (0x4390 bytes) 000643 1785775632.441885 mapwrite 0x03fa71 thru 0x03fbad (0x13d bytes) 000644 1785775632.515288 punch from 0x003a8e to 0x00a596 (0x6b09 bytes) 000645 1785775632.519672 write 0x03de78 thru 0x03e905 (0xa8e bytes) 000646 1785775632.520983 punch from 0x01ba44 to 0x02aa06 (0xefc3 bytes) 000647 1785775632.525024 mapwrite 0x038782 thru 0x03b1ec (0x2a6b bytes) 000648 1785775632.565055 fallocate 0x0077e4 thru 0x013c28 (0xc445 bytes) 000650 1785775632.582712 read 0x019b66 thru 0x01afa1 (0x143c bytes) 000651 1785775632.591755 trunc from 0x03f83d to 0x03fbad (0x371 bytes) 000653 1785775632.643908 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3fbae): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbae): Mirror 19: 0xd6988726 (stale) Mirror 21: 0xd6988726 (stale) Mirror 23: 0xd6988726 (stale) Mirror 25: 0xd6988726 (stale) Mirror 26: 0xd6988726 (stale) Mirror 27: 0xd6988726 (stale) Mirror 28: 0xd6988726 (stale) Mirror 29: 0xd6988726 (stale) Mirror 30: 0xee877352 (stale) Mirror 31: 0xaf911b19 (stale) CRC-32 checksum value for chunk [0, 0x3fbae): Mirror 1: 0x3153646a Mirror 32: 0x3153646a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbae: skipped 000654 1785775635.183956 read 0x0099b9 thru 0x00cdcf (0x3417 bytes) 000655 1785775635.200823 trunc from 0x01ba87 to 0x0264b7 (0xaa31 bytes) 000656 1785775635.267786 fallocate 0x01def7 thru 0x01df7d (0x87 bytes) 000657 1785775635.289254 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fbae): Mirror 21: 0xd6988726 (stale) Mirror 23: 0xd6988726 (stale) Mirror 25: 0xd6988726 (stale) Mirror 26: 0xd6988726 (stale) Mirror 27: 0xd6988726 (stale) Mirror 28: 0xd6988726 (stale) Mirror 29: 0xd6988726 (stale) Mirror 30: 0xee877352 (stale) Mirror 31: 0xaf911b19 (stale) Mirror 32: 0x3153646a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbae): Mirror 21: 0xd6988726 (stale) Mirror 23: 0xd6988726 (stale) Mirror 25: 0xd6988726 (stale) Mirror 26: 0xd6988726 (stale) Mirror 27: 0xd6988726 (stale) Mirror 28: 0xd6988726 (stale) Mirror 29: 0xd6988726 (stale) Mirror 30: 0xee877352 (stale) Mirror 31: 0xaf911b19 (stale) Mirror 32: 0x3153646a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbae: skipped 000658 1785775635.977344 trunc from 0x03fbae to 0x01a004 (0x25ba9 bytes) 000659 1785775636.023237 fallocate 0x015b6a thru 0x020b9d (0xb034 bytes) 000660 1785775636.031966 trunc from 0x00211f to 0x0052c6 (0x31a8 bytes) 000661 1785775636.045976 MIRROR_RESYNC 11 mirrors 000662 1785775638.913345 trunc from 0x01a005 to 0x03a9c6 (0x209c2 bytes) 000663 1785775638.995089 trunc from 0x01ce99 to 0x0299ca (0xcb32 bytes) 000664 1785775639.010311 read 0x03358b thru 0x03a9c6 (0x743c bytes) 000665 1785775639.047749 trunc from 0x02ec54 to 0x0345c8 (0x5975 bytes) 000666 1785775639.053050 mapwrite 0x02a577 thru 0x032462 (0x7eec bytes) 000667 1785775639.186868 write 0x00b434 thru 0x00f111 (0x3cde bytes) 000669 1785775639.229444 trunc from 0x013092 to 0x01b767 (0x86d6 bytes) 000670 1785775639.240083 trunc from 0x03a9c7 to 0x036d02 (0x3cc4 bytes) 000672 1785775639.299904 punch from 0x02d609 to 0x036d02 (0x96fa bytes) 000673 1785775639.317163 mapwrite 0x017806 thru 0x021605 (0x9e00 bytes) 000674 1785775639.398393 read 0x011985 thru 0x0155ef (0x3c6b bytes) 000675 1785775639.408188 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36d03): Mirror 21: 0x58eaad5a (stale) Mirror 23: 0x58eaad5a (stale) Mirror 25: 0x58eaad5a (stale) Mirror 26: 0x58eaad5a (stale) Mirror 27: 0x58eaad5a (stale) Mirror 28: 0x58eaad5a (stale) Mirror 29: 0x58eaad5a (stale) Mirror 30: 0x58eaad5a (stale) Mirror 32: 0x58eaad5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d03): Mirror 21: 0x58eaad5a (stale) Mirror 23: 0x58eaad5a (stale) Mirror 25: 0x58eaad5a (stale) Mirror 26: 0x58eaad5a (stale) Mirror 27: 0x58eaad5a (stale) Mirror 28: 0x58eaad5a (stale) Mirror 29: 0x58eaad5a (stale) Mirror 30: 0x58eaad5a (stale) Mirror 32: 0x58eaad5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d03: skipped 000676 1785775640.447819 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x36d03): Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d03): Mirror 21: 0x58eaad5a (stale) Mirror 23: 0x58eaad5a (stale) Mirror 25: 0x58eaad5a (stale) Mirror 26: 0x58eaad5a (stale) Mirror 27: 0x58eaad5a (stale) Mirror 28: 0x58eaad5a (stale) Mirror 29: 0x58eaad5a (stale) Mirror 30: 0x58eaad5a (stale) Mirror 32: 0x58eaad5a (stale) CRC-32 checksum value for chunk [0, 0x36d03): Mirror 1: 0x2e38cacc Mirror 33: 0x2e38cacc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d03: skipped 000677 1785775641.821491 read 0x0072eb thru 0x014c3c (0xd952 bytes) 000678 1785775641.869680 mapread 0x0295d6 thru 0x036d02 (0xd72d bytes) 000679 1785775641.973997 read 0x02be78 thru 0x036d02 (0xae8b bytes) 000680 1785775641.981635 mapwrite 0x012613 thru 0x0178c2 (0x52b0 bytes) 000681 1785775642.192002 fallocate 0x03ead9 thru 0x03ffff (0x1527 bytes) 000682 1785775642.202032 trunc from 0x00b53d to 0x013ead (0x8971 bytes) 000683 1785775642.223100 trunc from 0x01b0b6 to 0x029cb9 (0xec04 bytes) 000684 1785775642.240316 trunc from 0x018d32 to 0x01ae47 (0x2116 bytes) 000685 1785775642.293224 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x55e6a500 (stale) Mirror 23: 0x55e6a500 (stale) Mirror 25: 0x55e6a500 (stale) Mirror 26: 0x55e6a500 (stale) Mirror 27: 0x55e6a500 (stale) Mirror 28: 0x55e6a500 (stale) Mirror 29: 0x55e6a500 (stale) Mirror 30: 0x55e6a500 (stale) Mirror 32: 0x55e6a500 (stale) Mirror 33: 0x1e85b3b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6cf80f24 Mirror 34: 0x6cf80f24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000686 1785775644.439140 trunc from 0x02b0d0 to 0x02dcd3 (0x2c04 bytes) 000688 1785775644.572809 mapread 0x03ca25 thru 0x03ffff (0x35db bytes) 000689 1785775644.636211 mapwrite 0x020629 thru 0x02d8c0 (0xd298 bytes) 000690 1785775644.809393 trunc from 0x040000 to 0x01c356 (0x23ca9 bytes) 000691 1785775644.905418 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c357): Mirror 21: 0x38298a87 (stale) Mirror 23: 0x38298a87 (stale) Mirror 25: 0x38298a87 (stale) Mirror 26: 0x38298a87 (stale) Mirror 27: 0x38298a87 (stale) Mirror 28: 0x38298a87 (stale) Mirror 29: 0x38298a87 (stale) Mirror 32: 0x38298a87 (stale) Mirror 33: 0xfe28be85 (stale) Mirror 34: 0xe2bcc792 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c357): Mirror 21: 0x38298a87 (stale) Mirror 23: 0x38298a87 (stale) Mirror 25: 0x38298a87 (stale) Mirror 26: 0x38298a87 (stale) Mirror 27: 0x38298a87 (stale) Mirror 28: 0x38298a87 (stale) Mirror 29: 0x38298a87 (stale) Mirror 32: 0x38298a87 (stale) Mirror 33: 0xfe28be85 (stale) Mirror 34: 0xe2bcc792 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c357: skipped 000692 1785775645.975369 write 0x012ddb thru 0x01d2c1 (0xa4e7 bytes) 000693 1785775646.002292 trunc from 0x0161b4 to 0x01d2c1 (0x710e bytes) 000695 1785775646.024163 trunc from 0x0116b9 to 0x01d2c1 (0xbc09 bytes) 000696 1785775646.032918 mapwrite 0x0155ff thru 0x01dd47 (0x8749 bytes) 000697 1785775646.151885 write 0x033502 thru 0x03ffff (0xcafe bytes) 000698 1785775646.158141 mapwrite 0x03607c thru 0x0370d9 (0x105e bytes) 000699 1785775646.208399 read 0x0383b4 thru 0x03ffff (0x7c4c bytes) 000700 1785775646.211512 punch from 0x012aee to 0x022913 (0xfe26 bytes) 000701 1785775646.253199 punch from 0x00ffc5 to 0x0103f7 (0x433 bytes) 000702 1785775646.265611 fallocate 0x00c5fe thru 0x010f5f (0x4962 bytes) 000703 1785775646.275610 trunc from 0x040000 to 0x0361eb (0x9e14 bytes) 000705 1785775646.341170 mapread 0x018bbe thru 0x026083 (0xd4c6 bytes) 000706 1785775646.375854 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x361ec): Mirror 21: 0x6730cdd9 (stale) Mirror 23: 0x6730cdd9 (stale) Mirror 25: 0x6730cdd9 (stale) Mirror 26: 0x6730cdd9 (stale) Mirror 27: 0x6730cdd9 (stale) Mirror 28: 0x6730cdd9 (stale) Mirror 32: 0x6730cdd9 (stale) Mirror 33: 0x30b3a111 (stale) Mirror 34: 0xc461ccfe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x361ec): Mirror 21: 0x6730cdd9 (stale) Mirror 23: 0x6730cdd9 (stale) Mirror 25: 0x6730cdd9 (stale) Mirror 26: 0x6730cdd9 (stale) Mirror 27: 0x6730cdd9 (stale) Mirror 28: 0x6730cdd9 (stale) Mirror 32: 0x6730cdd9 (stale) Mirror 33: 0x30b3a111 (stale) Mirror 34: 0xc461ccfe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x361ec: skipped 000708 1785775647.562239 punch from 0x00f680 to 0x01df22 (0xe8a3 bytes) 000709 1785775647.577893 MIRROR_RESYNC 10 mirrors 000711 1785775651.759618 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) 000712 1785775652.459056 trunc from 0x031a3d to 0x0361eb (0x47af bytes) 000714 1785775652.543186 trunc from 0x0361ec to 0x03ab99 (0x49ae bytes) 000715 1785775652.606169 trunc from 0x00bceb to 0x016ca4 (0xafba bytes) 000716 1785775652.619136 punch from 0x030bcb to 0x03ab99 (0x9fcf bytes) 000717 1785775652.631339 punch from 0x034359 to 0x03ab99 (0x6841 bytes) 000719 1785775652.645069 read 0x0385ec thru 0x039373 (0xd88 bytes) 000720 1785775652.654422 mapwrite 0x0227c9 thru 0x02a46c (0x7ca4 bytes) 000721 1785775652.763507 read 0x01f9e5 thru 0x024133 (0x474f bytes) 000722 1785775652.764448 write 0x006309 thru 0x00e0b1 (0x7da9 bytes) 000723 1785775652.793078 trunc from 0x03ab9a to 0x03008c (0xab0d bytes) 000724 1785775652.815160 trunc from 0x03008d to 0x01261d (0x1da6f bytes) 000725 1785775652.837736 trunc from 0x002146 to 0x008af4 (0x69af bytes) 000726 1785775652.871047 mapwrite 0x03369f thru 0x03ffff (0xc961 bytes) 000727 1785775653.071879 write 0x03fb70 thru 0x03ffff (0x490 bytes) 000728 1785775653.096593 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xd8fc6264 (stale) Mirror 25: 0xd8fc6264 (stale) Mirror 26: 0xd8fc6264 (stale) Mirror 27: 0xd8fc6264 (stale) Mirror 32: 0xd8fc6264 (stale) Mirror 33: 0xd8fc6264 (stale) Mirror 34: 0xd8fc6264 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xd8fc6264 (stale) Mirror 25: 0xd8fc6264 (stale) Mirror 26: 0xd8fc6264 (stale) Mirror 27: 0xd8fc6264 (stale) Mirror 32: 0xd8fc6264 (stale) Mirror 33: 0xd8fc6264 (stale) Mirror 34: 0xd8fc6264 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000729 1785775653.957619 read 0x025e3f thru 0x028dda (0x2f9c bytes) 000733 1785775653.964920 trunc from 0x040000 to 0x0204f6 (0x1fb09 bytes) 000734 1785775654.020539 MIRROR_RESYNC 8 mirrors 000735 1785775656.284154 punch from 0x01b9b6 to 0x01dae4 (0x212f bytes) 000736 1785775656.370621 fallocate 0x0043e5 thru 0x013d10 (0xf92c bytes) 000737 1785775656.381566 trunc from 0x0204f7 to 0x00529e (0x1b258 bytes) 000740 1785775656.423441 mapwrite 0x027abc thru 0x035d32 (0xe277 bytes) 000741 1785775656.565656 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35d33): Mirror 23: 0x560ad6ea (stale) Mirror 25: 0x560ad6ea (stale) Mirror 27: 0x560ad6ea (stale) Mirror 32: 0x560ad6ea (stale) Mirror 33: 0x560ad6ea (stale) Mirror 34: 0x560ad6ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d33): Mirror 23: 0x560ad6ea (stale) Mirror 25: 0x560ad6ea (stale) Mirror 27: 0x560ad6ea (stale) Mirror 32: 0x560ad6ea (stale) Mirror 33: 0x560ad6ea (stale) Mirror 34: 0x560ad6ea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d33: skipped 000742 1785775657.263663 trunc from 0x034143 to 0x035d32 (0x1bf0 bytes) 000743 1785775657.277013 fallocate 0x028bbd thru 0x034536 (0xb97a bytes) 000745 1785775657.284324 punch from 0x00a6da to 0x012f23 (0x884a bytes) 000746 1785775657.293723 punch from 0x007fda to 0x00fb25 (0x7b4c bytes) 000747 1785775657.301445 punch from 0x026d0b to 0x02a04d (0x3343 bytes) 000749 1785775657.318665 write 0x003b4a thru 0x004aa5 (0xf5c bytes) 000751 1785775657.347899 mapread 0x018a02 thru 0x028768 (0xfd67 bytes) 000752 1785775657.443209 punch from 0x01ce8d to 0x021619 (0x478d bytes) 000753 1785775657.459961 mapread 0x01b094 thru 0x0257ea (0xa757 bytes) 000754 1785775657.503120 read 0x02078c thru 0x02ce3e (0xc6b3 bytes) 000755 1785775657.509702 punch from 0x00165e to 0x00e03d (0xc9e0 bytes) 000756 1785775657.531156 write 0x02ad97 thru 0x03613e (0xb3a8 bytes) 000758 1785775657.543739 trunc from 0x03613f to 0x0383ce (0x2290 bytes) 000759 1785775657.578717 trunc from 0x0056d8 to 0x010ec0 (0xb7e9 bytes) 000762 1785775657.595695 read 0x0180ce thru 0x018b9e (0xad1 bytes) 000763 1785775657.596355 fallocate 0x00adfc thru 0x00e9dc (0x3be1 bytes) 000764 1785775657.620971 trunc from 0x02a462 to 0x02f716 (0x52b5 bytes) 000766 1785775657.667688 read 0x01e804 thru 0x029e1f (0xb61c bytes) 000767 1785775657.668348 punch from 0x01e0c5 to 0x025e8b (0x7dc7 bytes) 000768 1785775657.678539 read 0x0075bd thru 0x00cd76 (0x57ba bytes) 000769 1785775657.895134 mapread 0x0308d3 thru 0x0383ce (0x7afc bytes) 000770 1785775657.896351 trunc from 0x02f3a2 to 0x030b82 (0x17e1 bytes) 000771 1785775657.919118 read 0x0040b9 thru 0x00fe09 (0xbd51 bytes) 000773 1785775657.922915 mapwrite 0x036600 thru 0x0372c3 (0xcc4 bytes) 000774 1785775657.944288 trunc from 0x032794 to 0x037503 (0x4d70 bytes) 000775 1785775657.968884 trunc from 0x01cd52 to 0x02aea9 (0xe158 bytes) 000776 1785775657.991350 write 0x0330fb thru 0x03ffff (0xcf05 bytes) 000777 1785775657.999967 trunc from 0x040000 to 0x01d749 (0x228b6 bytes) 000778 1785775658.100022 mapread 0x000b49 thru 0x0073ab (0x6863 bytes) 000780 1785775658.108032 trunc from 0x01637d to 0x01d749 (0x73cd bytes) 000781 1785775658.125354 fallocate 0x03a03b thru 0x03ffff (0x5fc5 bytes) 000782 1785775658.137553 mapread 0x01db3f thru 0x01e099 (0x55b bytes) 000784 1785775658.170654 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 25: 0x5196734d (stale) Mirror 27: 0x5196734d (stale) Mirror 32: 0x5196734d (stale) Mirror 33: 0x5196734d (stale) Mirror 34: 0x5196734d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 25: 0x5196734d (stale) Mirror 27: 0x5196734d (stale) Mirror 32: 0x5196734d (stale) Mirror 33: 0x5196734d (stale) Mirror 34: 0x5196734d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000785 1785775659.251192 read 0x0243f4 thru 0x027799 (0x33a6 bytes) 000786 1785775659.262006 read 0x025e1c thru 0x02de40 (0x8025 bytes) 000788 1785775659.323444 mapwrite 0x029794 thru 0x02cbf3 (0x3460 bytes) 000789 1785775659.343102 read 0x025b14 thru 0x033efe (0xe3eb bytes) 000790 1785775659.345414 trunc from 0x0220fd to 0x024919 (0x281d bytes) 000793 1785775659.356425 mapread 0x03ebc4 thru 0x03f9ff (0xe3c bytes) 000794 1785775659.361045 trunc from 0x0029c0 to 0x00d011 (0xa652 bytes) 000795 1785775659.369660 trunc from 0x01914f to 0x01a5ee (0x14a0 bytes) 000796 1785775659.385101 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 27: 0x5196734d (stale) Mirror 32: 0x5196734d (stale) Mirror 33: 0x5196734d (stale) Mirror 34: 0x5196734d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 27: 0x5196734d (stale) Mirror 32: 0x5196734d (stale) Mirror 33: 0x5196734d (stale) Mirror 34: 0x5196734d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000797 1785775660.088380 fallocate 0x0297fc thru 0x02a0df (0x8e4 bytes) 000798 1785775660.100804 mapread 0x0284bb thru 0x037853 (0xf399 bytes) 000799 1785775660.155346 read 0x003c81 thru 0x00e266 (0xa5e6 bytes) 000800 1785775660.169183 mapwrite 0x0072d5 thru 0x007766 (0x492 bytes) 000801 1785775660.189868 fallocate 0x02b1e1 thru 0x02d6c5 (0x24e5 bytes) 000802 1785775660.201391 MIRROR_RESYNC 5 mirrors 000804 1785775662.762905 trunc from 0x034ab5 to 0x03b06c (0x65b8 bytes) 000807 1785775662.819464 mapread 0x0334a3 thru 0x033f94 (0xaf2 bytes) 000808 1785775662.833032 write 0x02745f thru 0x03309c (0xbc3e bytes) 000809 1785775662.853491 fallocate 0x00811b thru 0x010aff (0x89e5 bytes) 000810 1785775662.886029 read 0x00b571 thru 0x011272 (0x5d02 bytes) 000811 1785775662.920075 mapread 0x030dea thru 0x0329d8 (0x1bef bytes) 000812 1785775662.921166 trunc from 0x040000 to 0x031a8a (0xe575 bytes) 000813 1785775662.975006 trunc from 0x0162c4 to 0x025f2a (0xfc67 bytes) 000814 1785775662.990616 mapwrite 0x015686 thru 0x023f22 (0xe89d bytes) 000815 1785775663.068906 trunc from 0x010c0c to 0x0121da (0x15cf bytes) 000816 1785775663.084673 MIRROR_RESYNC 5 mirrors 000817 1785775666.197420 mapwrite 0x006ef1 thru 0x009f27 (0x3037 bytes) 000818 1785775666.366431 punch from 0x022899 to 0x026e3e (0x45a6 bytes) 000819 1785775666.388766 punch from 0x008493 to 0x0086c6 (0x234 bytes) 000820 1785775666.400896 trunc from 0x031a8b to 0x000c3e (0x30e4c bytes) 000821 1785775666.478208 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xc3f): Mirror 27: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc3f): Mirror 27: 0x772fde70 (stale) Mirror 32: 0x772fde70 (stale) Mirror 33: 0x772fde70 (stale) Mirror 34: 0x772fde70 (stale) CRC-32 checksum value for chunk [0, 0xc3f): Mirror 1: 0x772fde70 Mirror 35: 0x772fde70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc3f: skipped 000822 1785775668.135542 mapwrite 0x022b15 thru 0x024ac5 (0x1fb1 bytes) 000823 1785775668.252970 mapread 0x0115c0 thru 0x01bec0 (0xa901 bytes) 000824 1785775668.277189 mapwrite 0x0000cf thru 0x009bfa (0x9b2c bytes) 000825 1785775668.357700 mapread 0x016cba thru 0x0223f7 (0xb73e bytes) 000826 1785775668.359962 read 0x003bd6 thru 0x0095ed (0x5a18 bytes) 000829 1785775668.367569 trunc from 0x024ac6 to 0x0292f6 (0x4831 bytes) 000830 1785775668.430128 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x292f7): Mirror 27: 0x5588d89f (stale) Mirror 32: 0x5588d89f (stale) Mirror 33: 0x5588d89f (stale) Mirror 34: 0x5588d89f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x292f7): Mirror 27: 0x5588d89f (stale) Mirror 32: 0x5588d89f (stale) Mirror 33: 0x5588d89f (stale) Mirror 34: 0x5588d89f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x292f7: skipped 000831 1785775668.876404 mapread 0x0085c1 thru 0x014256 (0xbc96 bytes) 000832 1785775668.913964 read 0x0065ad thru 0x014426 (0xde7a bytes) 000833 1785775668.935495 fallocate 0x016730 thru 0x01cd81 (0x6652 bytes) 000834 1785775669.016366 mapwrite 0x00e973 thru 0x01083e (0x1ecc bytes) 000835 1785775669.073453 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x292f7): Mirror 27: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x292f7): Mirror 27: 0x5588d89f (stale) Mirror 32: 0x5588d89f (stale) Mirror 33: 0x5588d89f (stale) Mirror 34: 0x5588d89f (stale) CRC-32 checksum value for chunk [0, 0x292f7): Mirror 1: 0x3c554bc4 Mirror 35: 0x3c554bc4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x292f7: skipped 000836 1785775670.417705 punch from 0x01279d to 0x0176a3 (0x4f07 bytes) 000838 1785775670.510324 punch from 0x000ed3 to 0x0109cb (0xfaf9 bytes) 000840 1785775670.524823 fallocate 0x0042d6 thru 0x012450 (0xe17b bytes) 000841 1785775670.534924 write 0x02768a thru 0x02e93b (0x72b2 bytes) 000842 1785775670.560250 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e93c): Mirror 27: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e93c): Mirror 27: 0xb2dc43f4 (stale) Mirror 32: 0xb2dc43f4 (stale) Mirror 33: 0xb2dc43f4 (stale) Mirror 34: 0xb2dc43f4 (stale) Mirror 35: 0xdf5ac52d (stale) CRC-32 checksum value for chunk [0, 0x2e93c): Mirror 1: 0x37ac22d3 Mirror 36: 0x37ac22d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e93c: skipped 000843 1785775672.106862 punch from 0x02d195 to 0x02e93b (0x17a7 bytes) 000844 1785775672.185787 trunc from 0x02e93c to 0x017662 (0x172d9 bytes) 000845 1785775672.207053 read 0x009da2 thru 0x00cb38 (0x2d97 bytes) 000846 1785775672.221757 MIRROR_RESYNC 7 mirrors 000847 1785775674.052196 read 0x0021d3 thru 0x005768 (0x3596 bytes) 000848 1785775674.074473 fallocate 0x018e9c thru 0x018f05 (0x6a bytes) 000849 1785775674.124598 write 0x02d858 thru 0x035863 (0x800c bytes) 000850 1785775674.133969 mapread 0x02ba70 thru 0x0304da (0x4a6b bytes) 000851 1785775674.175296 mapwrite 0x02aa86 thru 0x03840f (0xd98a bytes) 000852 1785775674.238774 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38410): Mirror 32: 0x449941a1 (stale) Mirror 33: 0x449941a1 (stale) Mirror 34: 0x449941a1 (stale) Mirror 35: 0x449941a1 (stale) Mirror 36: 0x449941a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38410): Mirror 32: 0x449941a1 (stale) Mirror 33: 0x449941a1 (stale) Mirror 34: 0x449941a1 (stale) Mirror 35: 0x449941a1 (stale) Mirror 36: 0x449941a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38410: skipped 000853 1785775674.707014 write 0x006ec6 thru 0x0107e4 (0x991f bytes) 000854 1785775674.720238 mapread 0x002f37 thru 0x011a11 (0xeadb bytes) 000855 1785775674.741826 fallocate 0x00a327 thru 0x00c398 (0x2072 bytes) 000856 1785775674.745920 mapread 0x02bad1 thru 0x0331a0 (0x76d0 bytes) 000857 1785775674.758005 trunc from 0x032634 to 0x03840f (0x5ddc bytes) 000858 1785775674.761541 trunc from 0x038410 to 0x03f34a (0x6f3b bytes) 000859 1785775674.774427 read 0x018998 thru 0x01b0b1 (0x271a bytes) 000860 1785775674.785938 mapwrite 0x0120c0 thru 0x012fb2 (0xef3 bytes) 000861 1785775674.794099 mapread 0x027549 thru 0x034a6b (0xd523 bytes) 000862 1785775674.801511 mapwrite 0x0236a3 thru 0x030db6 (0xd714 bytes) 000863 1785775674.832471 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f34b): Mirror 32: 0xa2493d4e (stale) Mirror 34: 0xa2493d4e (stale) Mirror 35: 0xa2493d4e (stale) Mirror 36: 0xa2493d4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f34b): Mirror 32: 0xa2493d4e (stale) Mirror 34: 0xa2493d4e (stale) Mirror 35: 0xa2493d4e (stale) Mirror 36: 0xa2493d4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f34b: skipped 000864 1785775675.130857 mapread 0x00a995 thru 0x015d30 (0xb39c bytes) 000865 1785775675.173068 mapwrite 0x0134fd thru 0x015154 (0x1c58 bytes) 000866 1785775675.186411 trunc from 0x03f34b to 0x035c54 (0x96f6 bytes) 000867 1785775675.205997 write 0x030350 thru 0x038dfb (0x8aac bytes) 000868 1785775675.216665 mapread 0x02a584 thru 0x038dfb (0xe878 bytes) 000869 1785775675.226815 mapread 0x0047c5 thru 0x00dd3c (0x9578 bytes) 000870 1785775675.234433 read 0x024366 thru 0x029790 (0x542b bytes) 000871 1785775675.239160 read 0x02968c thru 0x0313b4 (0x7d29 bytes) 000872 1785775675.239999 mapwrite 0x00fe6c thru 0x01b449 (0xb5de bytes) 000873 1785775675.279657 fallocate 0x00aeb6 thru 0x00f58d (0x46d8 bytes) 000874 1785775675.290663 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38dfc): Mirror 32: 0x7e4d57ab (stale) Mirror 35: 0x7e4d57ab (stale) Mirror 36: 0x7e4d57ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38dfc): Mirror 32: 0x7e4d57ab (stale) Mirror 35: 0x7e4d57ab (stale) Mirror 36: 0x7e4d57ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38dfc: skipped 000875 1785775675.685991 mapwrite 0x02d777 thru 0x030b5c (0x33e6 bytes) 000876 1785775675.750967 punch from 0x0197fd to 0x01b3e1 (0x1be5 bytes) 000877 1785775675.760750 write 0x0149a0 thru 0x0179c1 (0x3022 bytes) 000878 1785775675.798911 mapwrite 0x0030f6 thru 0x009e01 (0x6d0c bytes) 000879 1785775675.870006 trunc from 0x016f1f to 0x020ce4 (0x9dc6 bytes) 000880 1785775675.875024 mapread 0x030f06 thru 0x03300e (0x2109 bytes) 000881 1785775675.880493 mapwrite 0x03a3f5 thru 0x03ffff (0x5c0b bytes) 000882 1785775675.990038 write 0x00b5ba thru 0x0111b6 (0x5bfd bytes) 000883 1785775675.998884 write 0x005659 thru 0x00e230 (0x8bd8 bytes) 000885 1785775676.000822 write 0x013ac6 thru 0x01cf4b (0x9486 bytes) 000886 1785775676.028512 trunc from 0x02f492 to 0x03828a (0x8df9 bytes) 000887 1785775676.051521 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 32: 0x5c76d2a6 (stale) Mirror 36: 0x5c76d2a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 32: 0x5c76d2a6 (stale) Mirror 36: 0x5c76d2a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000888 1785775676.458103 trunc from 0x02fdd6 to 0x039772 (0x999d bytes) 000889 1785775676.463380 trunc from 0x040000 to 0x03cdf6 (0x3209 bytes) 000890 1785775676.495008 punch from 0x031bf4 to 0x03cdf6 (0xb203 bytes) 000891 1785775676.501913 mapread 0x02e9ea thru 0x032c8c (0x42a3 bytes) 000892 1785775676.526748 write 0x00d12e thru 0x0119ac (0x487f bytes) 000893 1785775676.534182 fallocate 0x01193e thru 0x011bff (0x2c2 bytes) 000895 1785775676.539115 trunc from 0x03cdf7 to 0x00bff9 (0x30dfd bytes) 000896 1785775676.557834 fallocate 0x037890 thru 0x03ffff (0x8770 bytes) 000897 1785775676.570357 trunc from 0x0090c8 to 0x00bff9 (0x2f32 bytes) 000898 1785775676.578720 trunc from 0x008ce5 to 0x00bff9 (0x3315 bytes) 000899 1785775676.591871 write 0x0370a8 thru 0x03803c (0xf95 bytes) 000902 1785775676.596975 write 0x030662 thru 0x036203 (0x5ba2 bytes) 000903 1785775676.603676 trunc from 0x036e95 to 0x03803c (0x11a8 bytes) 000904 1785775676.616871 read 0x012cf3 thru 0x01a070 (0x737e bytes) 000905 1785775676.631168 read 0x00abdd thru 0x017f61 (0xd385 bytes) 000906 1785775676.651768 write 0x034718 thru 0x03764c (0x2f35 bytes) 000907 1785775676.663290 read 0x0307e3 thru 0x0334ef (0x2d0d bytes) 000908 1785775676.664059 fallocate 0x00dd6d thru 0x015388 (0x761c bytes) 000909 1785775676.681411 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3803d): Mirror 32: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3803d): Mirror 32: 0x7518137d (stale) Mirror 36: 0x7518137d (stale) CRC-32 checksum value for chunk [0, 0x3803d): Mirror 1: 0xa593e7a7 Mirror 37: 0xa593e7a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3803d: skipped 000910 1785775677.707366 read 0x009001 thru 0x00c59e (0x359e bytes) 000911 1785775677.719440 write 0x0018f8 thru 0x00ee21 (0xd52a bytes) 000912 1785775677.793421 mapread 0x02e310 thru 0x02e81c (0x50d bytes) 000915 1785775677.808488 fallocate 0x026de9 thru 0x03423f (0xd457 bytes) 000916 1785775677.814715 trunc from 0x035adc to 0x03803c (0x2561 bytes) 000917 1785775677.830212 trunc from 0x01f3b2 to 0x027d41 (0x8990 bytes) 000918 1785775677.839691 trunc from 0x002062 to 0x00cb41 (0xaae0 bytes) 000919 1785775677.867207 MIRROR_RESYNC 4 mirrors 000920 1785775679.184712 read 0x02b450 thru 0x0345e9 (0x919a bytes) 000921 1785775679.193311 write 0x01d083 thru 0x01ebe0 (0x1b5e bytes) 000923 1785775679.224925 trunc from 0x03803d to 0x00c005 (0x2c037 bytes) 000924 1785775679.242317 MIRROR_RESYNC 4 mirrors 000925 1785775680.284125 write 0x01108c thru 0x012f0f (0x1e84 bytes) 000926 1785775680.376462 mapread 0x00afba thru 0x010000 (0x5047 bytes) 000927 1785775680.436903 MIRROR_RESYNC 4 mirrors 000928 1785775681.280658 write 0x03c69b thru 0x03dc76 (0x15dc bytes) 000929 1785775681.348968 mapwrite 0x0023de thru 0x0105a9 (0xe1cc bytes) 000930 1785775681.461170 fallocate 0x000b2f thru 0x00b158 (0xa62a bytes) 000931 1785775681.475896 mapwrite 0x012cc0 thru 0x01e400 (0xb741 bytes) 000932 1785775681.575343 write 0x01c513 thru 0x02144b (0x4f39 bytes) 000933 1785775681.578192 trunc from 0x03dc77 to 0x02cbc7 (0x110af bytes) 000934 1785775681.638837 fallocate 0x02849b thru 0x02bce7 (0x384d bytes) 000935 1785775681.646030 mapwrite 0x02f3f3 thru 0x03a0a6 (0xacb4 bytes) 000936 1785775681.735676 trunc from 0x0031be to 0x00be34 (0x8c77 bytes) 000938 1785775681.744491 fallocate 0x022c35 thru 0x02c19e (0x956a bytes) 000939 1785775681.765050 trunc from 0x03a0a7 to 0x00e365 (0x2bd41 bytes) 000940 1785775681.817428 MIRROR_RESYNC 4 mirrors 000941 1785775683.359904 mapwrite 0x010177 thru 0x01be93 (0xbd1d bytes) 000942 1785775683.553454 write 0x0335b1 thru 0x0373ee (0x3e3e bytes) 000943 1785775683.559645 fallocate 0x01090a thru 0x01b12b (0xa822 bytes) 000944 1785775683.571035 write 0x010a47 thru 0x01c3ff (0xb9b9 bytes) 000945 1785775683.595933 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x373ef): Mirror 32: 0x7ac497ba (stale) Mirror 37: 0x7ac497ba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x373ef): Mirror 32: 0x7ac497ba (stale) Mirror 37: 0x7ac497ba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x373ef: skipped 000946 1785775684.020171 write 0x023ff3 thru 0x0244e5 (0x4f3 bytes) 000947 1785775684.037850 MIRROR_RESYNC 3 mirrors 000949 1785775685.430954 write 0x00d10b thru 0x01bf61 (0xee57 bytes) 000950 1785775685.514614 punch from 0x014e14 to 0x0176f7 (0x28e4 bytes) 000951 1785775685.544829 mapread 0x011d83 thru 0x01c702 (0xa980 bytes) 000953 1785775685.594589 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x373ef): Mirror 32: 0x5c7b9b2f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x373ef): Mirror 32: 0x5c7b9b2f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x373ef: skipped 000954 1785775686.044354 MIRROR_RESYNC 2 mirrors 000955 1785775687.237972 mapread 0x02b366 thru 0x035ff9 (0xac94 bytes) 000956 1785775687.321823 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) 000957 1785775687.452705 mapwrite 0x0332a3 thru 0x038f4c (0x5caa bytes) 000958 1785775687.508694 MIRROR_EXTEND to 2 mirrors 000959 1785775688.681430 trunc from 0x002198 to 0x008a9b (0x6904 bytes) 000960 1785775688.756917 punch from 0x01511e to 0x01daba (0x899d bytes) 000961 1785775688.763986 mapwrite 0x0390ad thru 0x039855 (0x7a9 bytes) 000962 1785775688.866649 fallocate 0x035ae7 thru 0x03ffff (0xa519 bytes) 000963 1785775688.883067 write 0x032e27 thru 0x0330f0 (0x2ca bytes) 000964 1785775688.909586 MIRROR_RESYNC 2 mirrors 000965 1785775690.286363 trunc from 0x009565 to 0x00d685 (0x4121 bytes) 000966 1785775690.401034 read 0x035205 thru 0x0364d8 (0x12d4 bytes) 000967 1785775690.424179 read 0x028746 thru 0x02cd01 (0x45bc bytes) 000968 1785775690.491722 mapread 0x021d5e thru 0x028dbb (0x705e bytes) 000969 1785775690.497529 read 0x037559 thru 0x03e59f (0x7047 bytes) 000970 1785775690.512623 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd1366347 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x206c1da7 Mirror 3: 0x206c1da7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000971 1785775692.256685 trunc from 0x040000 to 0x022fbe (0x1d041 bytes) 000972 1785775692.453735 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x22fbf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22fbf): Mirror 2: 0x8b91a6e5 (stale) Mirror 3: 0xb4d727f7 (stale) CRC-32 checksum value for chunk [0, 0x22fbf): Mirror 1: 0xb4d727f7 Mirror 4: 0xb4d727f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22fbf: skipped 000973 1785775694.279516 read 0x0195b7 thru 0x01d112 (0x3b5c bytes) 000974 1785775694.305604 mapwrite 0x0076ec thru 0x00b6c3 (0x3fd8 bytes) 000975 1785775694.506919 punch from 0x004f96 to 0x013923 (0xe98e bytes) 000976 1785775694.526960 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x22fbf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22fbf): Mirror 2: 0x8b91a6e5 (stale) Mirror 3: 0xb4d727f7 (stale) Mirror 4: 0xb4d727f7 (stale) CRC-32 checksum value for chunk [0, 0x22fbf): Mirror 1: 0xe3f8d757 Mirror 5: 0xe3f8d757 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22fbf: skipped 000977 1785775696.304437 fallocate 0x00c10e thru 0x015400 (0x92f3 bytes) 000978 1785775696.391633 trunc from 0x022fbf to 0x019405 (0x9bb9 bytes) 000979 1785775696.482533 trunc from 0x00c363 to 0x01093f (0x45dd bytes) 000980 1785775696.489674 trunc from 0x019406 to 0x03f3d0 (0x25fcb bytes) 000981 1785775696.537171 mapread 0x03d815 thru 0x03f3d0 (0x1bbc bytes) 000982 1785775696.568453 write 0x03d7f5 thru 0x03ffff (0x280b bytes) 000983 1785775696.571399 fallocate 0x00c8c9 thru 0x012779 (0x5eb1 bytes) 000984 1785775696.591744 write 0x01308d thru 0x0162e4 (0x3258 bytes) 000986 1785775696.607435 fallocate 0x018ba7 thru 0x01e405 (0x585f bytes) 000987 1785775696.620139 mapwrite 0x011797 thru 0x020df8 (0xf662 bytes) 000988 1785775696.717807 mapwrite 0x039bb8 thru 0x03ffff (0x6448 bytes) 000989 1785775696.752957 trunc from 0x0199ad to 0x02591e (0xbf72 bytes) 000990 1785775696.778862 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd1366347 (stale) Mirror 3: 0x206c1da7 (stale) Mirror 4: 0xa34be102 (stale) Mirror 5: 0x78264288 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x171046a9 Mirror 6: 0x171046a9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000991 1785775698.482422 mapread 0x02646f thru 0x02e544 (0x80d6 bytes) 000992 1785775698.527186 trunc from 0x003886 to 0x010d8f (0xd50a bytes) 000993 1785775698.563121 trunc from 0x040000 to 0x029abf (0x16540 bytes) 000994 1785775698.586872 mapwrite 0x010a3d thru 0x01f41b (0xe9df bytes) 000995 1785775698.644380 mapwrite 0x010ee7 thru 0x01a342 (0x945c bytes) 000996 1785775698.685054 trunc from 0x0110d6 to 0x0161ce (0x50f9 bytes) 000997 1785775698.698160 mapread 0x0018e1 thru 0x00c7d2 (0xaef2 bytes) 000999 1785775698.712156 read 0x0224e9 thru 0x029abf (0x75d7 bytes) 001000 1785775698.726811 read 0x003fbd thru 0x005bbd (0x1c01 bytes) All operations completed A-OK!