== sanity-flr test 70a: flr mode fsx test ================ 10:19:50 (1787581190) Seed set to 1193 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1787581193.834574 mapwrite 0x00765b thru 0x013c75 (0xc61b bytes) 000003 1787581194.027224 write 0x02ce85 thru 0x03a7f1 (0xd96d bytes) 000004 1787581194.030129 read 0x00df86 thru 0x017688 (0x9703 bytes) 000005 1787581194.041214 read 0x028d66 thru 0x031668 (0x8903 bytes) truncating to largest ever: 0x14323 000008 1787581194.054238 trunc from 0x03a7f2 to 0x014322 (0x264cf bytes) 000010 1787581194.088707 write 0x038835 thru 0x03a9aa (0x2176 bytes) 000012 1787581194.092444 write 0x00924f thru 0x00f9f6 (0x67a8 bytes) 000015 1787581194.097561 read 0x005330 thru 0x0123ec (0xd0bd bytes) 000016 1787581194.098659 read 0x02ea29 thru 0x03826e (0x9846 bytes) 000017 1787581194.130234 mapwrite 0x019753 thru 0x026700 (0xcfae bytes) 000019 1787581194.291355 read 0x034153 thru 0x03a9aa (0x6858 bytes) truncating to largest ever: 0x2c8eb 000023 1787581194.299195 trunc from 0x03a9ab to 0x02c8ea (0xe0c0 bytes) 000024 1787581194.360034 write 0x0322e1 thru 0x0376a3 (0x53c3 bytes) 000026 1787581194.384187 MIRROR_EXTEND to 2 mirrors 000028 1787581196.103009 read 0x0274a1 thru 0x033c15 (0xc775 bytes) 000030 1787581196.122272 mapwrite 0x023122 thru 0x02bf00 (0x8ddf bytes) 000031 1787581196.437203 write 0x0331ae thru 0x03fff1 (0xce44 bytes) 000032 1787581196.443645 trunc from 0x03fff2 to 0x01f795 (0x2085c bytes) 000034 1787581196.520283 mapwrite 0x00eab3 thru 0x013031 (0x457f bytes) 000035 1787581196.768812 mapread 0x001a5b thru 0x003a06 (0x1fac bytes) 000036 1787581196.784989 mapread 0x0062e9 thru 0x011241 (0xaf59 bytes) 000039 1787581196.796843 trunc from 0x01f796 to 0x01ab33 (0x4c62 bytes) 000041 1787581196.841802 mapwrite 0x0272c5 thru 0x02d355 (0x6091 bytes) 000042 1787581197.070632 read 0x001b2b thru 0x010757 (0xec2d bytes) 000044 1787581197.071986 mapread 0x0203a6 thru 0x02d355 (0xcfb0 bytes) 000045 1787581197.077984 write 0x00d692 thru 0x010d58 (0x36c7 bytes) 000046 1787581197.079113 read 0x015918 thru 0x01c774 (0x6e5d bytes) 000047 1787581197.105759 mapread 0x001f46 thru 0x0096cb (0x7786 bytes) 000048 1787581197.107913 write 0x00cea0 thru 0x01214a (0x52ab bytes) 000049 1787581197.109949 read 0x00710d thru 0x00b1d8 (0x40cc bytes) 000050 1787581197.120698 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x314ef 000051 1787581198.304744 trunc from 0x02d356 to 0x0314ee (0x4199 bytes) 000052 1787581198.437885 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) 000053 1787581198.695211 mapwrite 0x034083 thru 0x03ffff (0xbf7d bytes) 000055 1787581198.979558 mapwrite 0x00e789 thru 0x016d77 (0x85ef bytes) 000056 1787581199.222392 read 0x003bd7 thru 0x006347 (0x2771 bytes) 000057 1787581199.243187 write 0x0117c0 thru 0x017323 (0x5b64 bytes) 000059 1787581199.259292 write 0x036bef thru 0x03ffff (0x9411 bytes) 000061 1787581199.260920 mapwrite 0x012be2 thru 0x02112c (0xe54b bytes) 000062 1787581199.555891 mapwrite 0x026607 thru 0x031f47 (0xb941 bytes) 000065 1787581199.736115 MIRROR_EXTEND to 2 mirrors 000066 1787581201.328391 mapread 0x00af3a thru 0x01418b (0x9252 bytes) 000067 1787581201.351963 mapread 0x01923f thru 0x01ea3f (0x5801 bytes) 000068 1787581201.359879 trunc from 0x040000 to 0x031102 (0xeefd bytes) 000069 1787581201.444421 read 0x016c6f thru 0x021feb (0xb37d bytes) 000070 1787581201.456118 write 0x01f90b thru 0x028061 (0x8757 bytes) truncating to largest ever: 0x3a89f 000073 1787581201.464964 trunc from 0x031103 to 0x03a89e (0x979c bytes) 000074 1787581201.487514 mapwrite 0x0379d7 thru 0x038bf9 (0x1223 bytes) 000075 1787581201.567190 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) 000076 1787581201.710702 read 0x02cf36 thru 0x02dccc (0xd97 bytes) 000078 1787581201.717180 trunc from 0x03a89f to 0x038741 (0x215d bytes) 000080 1787581201.740303 trunc from 0x038742 to 0x00cf7d (0x2b7c4 bytes) 000083 1787581201.762165 read 0x0083bc thru 0x009cb6 (0x18fb bytes) 000085 1787581201.771253 mapread 0x0079e4 thru 0x00cf7d (0x559a bytes) 000088 1787581201.778210 MIRROR_EXTEND to 2 mirrors 000090 1787581202.502514 write 0x02df45 thru 0x03a9f6 (0xcab2 bytes) 000091 1787581202.581934 write 0x01ed57 thru 0x02a209 (0xb4b3 bytes) 000092 1787581202.592084 mapwrite 0x02aa05 thru 0x035871 (0xae6d bytes) 000093 1787581202.710606 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a9f7): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a9f7): Mirror 2: 0xd1f8ce6e (stale) CRC-32 checksum value for chunk [0, 0x3a9f7): Mirror 1: 0x8127be53 Mirror 3: 0x8127be53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a9f7: skipped 000094 1787581204.305431 trunc from 0x03a9f7 to 0x0036d0 (0x37326 bytes) 000096 1787581204.433197 trunc from 0x0036d1 to 0x0249bd (0x212ed bytes) 000097 1787581204.472114 mapread 0x0075f7 thru 0x015ff5 (0xe9ff bytes) 000100 1787581204.517030 trunc from 0x0249be to 0x024b1e (0x161 bytes) 000101 1787581204.548206 mapread 0x00177e thru 0x00f327 (0xdbaa bytes) 000103 1787581204.558176 trunc from 0x024b1f to 0x00912a (0x1b9f4 bytes) 000104 1787581204.595633 mapwrite 0x006966 thru 0x01679a (0xfe35 bytes) truncating to largest ever: 0x3edaa 000110 1787581204.823298 trunc from 0x01679b to 0x03eda9 (0x2860f bytes) 000111 1787581204.846632 write 0x0104ce thru 0x01cbbf (0xc6f2 bytes) 000112 1787581204.858554 write 0x01fa01 thru 0x0266c6 (0x6cc6 bytes) 000113 1787581204.874494 mapwrite 0x02cd79 thru 0x038d70 (0xbff8 bytes) 000117 1787581205.041472 mapread 0x026109 thru 0x02cc06 (0x6afe bytes) 000118 1787581205.042809 read 0x01bb18 thru 0x0204f9 (0x49e2 bytes) 000119 1787581205.054376 write 0x000ba8 thru 0x00413d (0x3596 bytes) 000120 1787581205.063652 read 0x0044a5 thru 0x012db3 (0xe90f bytes) 000121 1787581205.072617 MIRROR_RESYNC 3 mirrors 000122 1787581207.226934 read 0x007e0f thru 0x00ebf9 (0x6deb bytes) 000123 1787581207.242673 trunc from 0x03edaa to 0x0269c3 (0x183e6 bytes) 000124 1787581207.346142 write 0x00f8d5 thru 0x012550 (0x2c7c bytes) 000125 1787581207.359156 trunc from 0x0269c4 to 0x02c0e9 (0x5726 bytes) 000126 1787581207.381756 write 0x00afd5 thru 0x0184cd (0xd4f9 bytes) 000129 1787581207.399736 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2c0ea): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c0ea): Mirror 2: 0xc15131bc (stale) Mirror 3: 0xc15131bc (stale) CRC-32 checksum value for chunk [0, 0x2c0ea): Mirror 1: 0xaa67eadb Mirror 4: 0xaa67eadb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c0ea: skipped 000130 1787581209.364145 read 0x0156dc thru 0x020fbc (0xb8e1 bytes) 000131 1787581209.377237 read 0x02178b thru 0x025bc9 (0x443f bytes) 000132 1787581209.395907 trunc from 0x02c0ea to 0x0081d2 (0x23f17 bytes) 000133 1787581209.538915 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x81d3): Mirror 3: 0x69f761bd (stale) Mirror 4: 0x69f761bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x81d3): Mirror 3: 0x69f761bd (stale) Mirror 4: 0x69f761bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x81d3: skipped 000135 1787581210.060820 write 0x0209cf thru 0x02142d (0xa5f bytes) 000136 1787581210.064529 write 0x01e98e thru 0x020ce8 (0x235b bytes) 000138 1787581210.084924 write 0x002ba7 thru 0x00ac45 (0x809f bytes) 000139 1787581210.121577 mapwrite 0x009735 thru 0x014ca8 (0xb574 bytes) 000140 1787581210.265612 mapwrite 0x00ced3 thru 0x019a75 (0xcba3 bytes) 000141 1787581210.429102 trunc from 0x02142e to 0x036507 (0x150da bytes) 000142 1787581210.485714 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36508): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36508): Mirror 3: 0xc8395b59 (stale) Mirror 4: 0x210b5bea (stale) CRC-32 checksum value for chunk [0, 0x36508): Mirror 1: 0xa66a816f Mirror 5: 0xa66a816f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36508: skipped 000144 1787581212.362016 read 0x01b130 thru 0x020905 (0x57d6 bytes) 000145 1787581212.376479 MIRROR_RESYNC 4 mirrors 000150 1787581213.809854 trunc from 0x036508 to 0x007de5 (0x2e722 bytes) 000151 1787581213.918508 mapread 0x006036 thru 0x007de5 (0x1db0 bytes) 000152 1787581213.932596 write 0x01b6c6 thru 0x0201e4 (0x4b1f bytes) 000155 1787581213.937889 read 0x00f39a thru 0x01958a (0xa1f1 bytes) 000159 1787581213.955134 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x201e5): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x201e5): Mirror 3: 0xe363e453 (stale) Mirror 4: 0xe363e453 (stale) Mirror 5: 0xe363e453 (stale) CRC-32 checksum value for chunk [0, 0x201e5): Mirror 1: 0xa5b35a82 Mirror 6: 0xa5b35a82 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x201e5: skipped 000161 1787581215.575624 mapwrite 0x00741d thru 0x00d436 (0x601a bytes) 000165 1787581215.920296 mapread 0x01c45c thru 0x0201e4 (0x3d89 bytes) 000166 1787581215.949400 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x201e5): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x201e5): Mirror 3: 0xe363e453 (stale) Mirror 4: 0xe363e453 (stale) Mirror 5: 0xe363e453 (stale) Mirror 6: 0xa5b35a82 (stale) CRC-32 checksum value for chunk [0, 0x201e5): Mirror 1: 0x2aeb08a7 Mirror 7: 0x2aeb08a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x201e5: skipped 000168 1787581217.499919 write 0x036bef thru 0x03ffff (0x9411 bytes) 000169 1787581217.592797 trunc from 0x040000 to 0x012a0b (0x2d5f4 bytes) 000170 1787581217.644987 read 0x012206 thru 0x012a0b (0x806 bytes) 000171 1787581217.657325 read 0x00922f thru 0x00ab20 (0x18f2 bytes) 000172 1787581217.690801 trunc from 0x012a0c to 0x018a1e (0x6013 bytes) 000173 1787581217.729273 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x18a1f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18a1f): Mirror 3: 0xd1e3bf3e (stale) Mirror 4: 0xd1e3bf3e (stale) Mirror 5: 0xd1e3bf3e (stale) Mirror 6: 0xecd8f45a (stale) Mirror 7: 0xe92790d0 (stale) CRC-32 checksum value for chunk [0, 0x18a1f): Mirror 1: 0xe92790d0 Mirror 8: 0xe92790d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18a1f: skipped 000174 1787581219.289064 trunc from 0x018a1f to 0x003090 (0x1598e bytes) 000175 1787581219.482243 write 0x0308e0 thru 0x035769 (0x4e8a bytes) 000177 1787581219.506085 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3576a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3576a): Mirror 3: 0x70eacb41 (stale) Mirror 4: 0x70eacb41 (stale) Mirror 5: 0x70eacb41 (stale) Mirror 6: 0xfa8ad8aa (stale) Mirror 7: 0xcbe5262b (stale) Mirror 8: 0x5627bd50 (stale) CRC-32 checksum value for chunk [0, 0x3576a): Mirror 1: 0xc411ccc Mirror 9: 0xc411ccc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3576a: skipped 000180 1787581221.214374 trunc from 0x03576a to 0x00ebc9 (0x26ba0 bytes) 000183 1787581221.447279 mapread 0x00b0ab thru 0x00ebc9 (0x3b1f bytes) 000184 1787581221.491473 mapread 0x00e203 thru 0x00ebc9 (0x9c7 bytes) 000185 1787581221.495857 write 0x03b986 thru 0x03ffff (0x467a bytes) 000189 1787581221.500186 read 0x003148 thru 0x008791 (0x564a bytes) 000191 1787581221.513497 trunc from 0x040000 to 0x01c3de (0x23c21 bytes) 000192 1787581221.575300 trunc from 0x01c3df to 0x01fbe5 (0x3807 bytes) 000193 1787581221.651962 mapwrite 0x03923b thru 0x03ffff (0x6dc5 bytes) 000194 1787581221.826842 mapwrite 0x02a727 thru 0x02d1c9 (0x2aa3 bytes) 000197 1787581221.947503 trunc from 0x040000 to 0x00d76c (0x32893 bytes) 000198 1787581221.992923 write 0x017dbf thru 0x01bd46 (0x3f88 bytes) 000200 1787581222.002194 mapread 0x00dd4b thru 0x0165b7 (0x886d bytes) 000201 1787581222.033485 write 0x0213cb thru 0x0264f8 (0x512e bytes) 000203 1787581222.049895 MIRROR_RESYNC 8 mirrors 000204 1787581227.246737 read 0x0208a7 thru 0x0264f8 (0x5c52 bytes) 000205 1787581227.278279 mapread 0x002623 thru 0x00ea2b (0xc409 bytes) 000207 1787581227.331717 read 0x018fd8 thru 0x0264f8 (0xd521 bytes) 000209 1787581227.350528 trunc from 0x0264f9 to 0x011753 (0x14da5 bytes) 000210 1787581227.529449 trunc from 0x011754 to 0x01d5bc (0xbe69 bytes) 000213 1787581227.577319 mapread 0x007cbb thru 0x00c083 (0x43c9 bytes) 000217 1787581227.652424 MIRROR_RESYNC 8 mirrors 000220 1787581230.430974 mapread 0x019cc2 thru 0x01b47a (0x17b9 bytes) 000222 1787581230.463066 mapwrite 0x03f60c thru 0x03ffff (0x9f4 bytes) 000225 1787581230.902264 mapread 0x015f1b thru 0x017db0 (0x1e96 bytes) 000228 1787581230.930111 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x42d780c5 (stale) Mirror 4: 0x42d780c5 (stale) Mirror 5: 0x42d780c5 (stale) Mirror 6: 0x42d780c5 (stale) Mirror 7: 0x42d780c5 (stale) Mirror 8: 0x42d780c5 (stale) Mirror 9: 0x42d780c5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x510c5656 Mirror 10: 0x510c5656 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000229 1787581233.496651 write 0x021b83 thru 0x02ff58 (0xe3d6 bytes) 000230 1787581233.753005 trunc from 0x040000 to 0x019e8c (0x26173 bytes) 000232 1787581233.800193 write 0x007dea thru 0x00bfab (0x41c2 bytes) 000234 1787581233.832624 read 0x015103 thru 0x016060 (0xf5e bytes) 000236 1787581233.857954 mapwrite 0x02394a thru 0x028e9f (0x5556 bytes) 000237 1787581233.989578 trunc from 0x028ea0 to 0x003700 (0x2579f bytes) 000239 1787581234.017482 read 0x001dc9 thru 0x003700 (0x1938 bytes) 000240 1787581234.028614 trunc from 0x003701 to 0x005883 (0x2183 bytes) 000241 1787581234.070673 trunc from 0x005884 to 0x021da6 (0x1c523 bytes) 000245 1787581234.102869 MIRROR_RESYNC 9 mirrors 000246 1787581237.021235 read 0x01fe87 thru 0x021da6 (0x1f20 bytes) 000247 1787581237.028200 read 0x01d55d thru 0x021da6 (0x484a bytes) 000248 1787581237.044177 MIRROR_RESYNC 9 mirrors 000249 1787581237.763287 mapread 0x005924 thru 0x009624 (0x3d01 bytes) 000250 1787581237.768119 mapwrite 0x02194a thru 0x023181 (0x1838 bytes) 000252 1787581237.979143 write 0x03d8dd thru 0x03ffff (0x2723 bytes) 000254 1787581237.982172 read 0x01929e thru 0x02760e (0xe371 bytes) 000255 1787581237.995417 trunc from 0x040000 to 0x00ea4f (0x315b0 bytes) 000258 1787581238.039778 write 0x02f77a thru 0x035338 (0x5bbf bytes) 000259 1787581238.046874 mapread 0x0321b5 thru 0x035338 (0x3184 bytes) 000260 1787581238.063202 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35339): Mirror 3: 0x7d661340 (stale) Mirror 4: 0x7d661340 (stale) Mirror 5: 0x7d661340 (stale) Mirror 6: 0x7d661340 (stale) Mirror 7: 0x7d661340 (stale) Mirror 8: 0x7d661340 (stale) Mirror 9: 0x7d661340 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35339): Mirror 3: 0x7d661340 (stale) Mirror 4: 0x7d661340 (stale) Mirror 5: 0x7d661340 (stale) Mirror 6: 0x7d661340 (stale) Mirror 7: 0x7d661340 (stale) Mirror 8: 0x7d661340 (stale) Mirror 9: 0x7d661340 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35339: skipped 000261 1787581238.832755 write 0x0093cb thru 0x013c55 (0xa88b bytes) 000265 1787581238.872319 write 0x024e37 thru 0x0320c7 (0xd291 bytes) 000267 1787581238.901811 read 0x0253f3 thru 0x02ba93 (0x66a1 bytes) 000270 1787581238.903566 mapwrite 0x01fdd9 thru 0x02d69d (0xd8c5 bytes) 000271 1787581239.100246 mapread 0x0204e7 thru 0x025488 (0x4fa2 bytes) 000272 1787581239.101993 write 0x00193a thru 0x0116f5 (0xfdbc bytes) 000273 1787581239.108185 trunc from 0x035339 to 0x010835 (0x24b03 bytes) 000275 1787581239.150240 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x10836): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10836): Mirror 3: 0x35590f53 (stale) Mirror 4: 0x35590f53 (stale) Mirror 5: 0x35590f53 (stale) Mirror 6: 0x35590f53 (stale) Mirror 7: 0x35590f53 (stale) Mirror 8: 0x35590f53 (stale) Mirror 9: 0x35590f53 (stale) CRC-32 checksum value for chunk [0, 0x10836): Mirror 1: 0x6e92e851 Mirror 10: 0x6e92e851 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10836: skipped 000277 1787581240.692768 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10836): Mirror 3: 0x35590f53 (stale) Mirror 5: 0x35590f53 (stale) Mirror 6: 0x35590f53 (stale) Mirror 7: 0x35590f53 (stale) Mirror 8: 0x35590f53 (stale) Mirror 9: 0x35590f53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10836): Mirror 3: 0x35590f53 (stale) Mirror 5: 0x35590f53 (stale) Mirror 6: 0x35590f53 (stale) Mirror 7: 0x35590f53 (stale) Mirror 8: 0x35590f53 (stale) Mirror 9: 0x35590f53 (stale) CRC-32 checksum value for chunk [0, 0x10836): Mirror 1: 0x6e92e851 Mirror 10: 0x6e92e851 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10836: skipped 000278 1787581241.853961 write 0x02e546 thru 0x0389aa (0xa465 bytes) 000282 1787581241.975671 read 0x010d0a thru 0x01b7fe (0xaaf5 bytes) 000287 1787581241.997652 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x389ab): Mirror 5: 0x616ac7cc (stale) Mirror 6: 0x616ac7cc (stale) Mirror 7: 0x616ac7cc (stale) Mirror 8: 0x616ac7cc (stale) Mirror 9: 0x616ac7cc (stale) Mirror 10: 0x5c8a1f8d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x389ab): Mirror 5: 0x616ac7cc (stale) Mirror 6: 0x616ac7cc (stale) Mirror 7: 0x616ac7cc (stale) Mirror 8: 0x616ac7cc (stale) Mirror 9: 0x616ac7cc (stale) Mirror 10: 0x5c8a1f8d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x389ab: skipped 000290 1787581242.897964 mapread 0x007e50 thru 0x009d92 (0x1f43 bytes) 000292 1787581242.930396 MIRROR_RESYNC 7 mirrors 000295 1787581244.833154 mapread 0x0121e6 thru 0x012591 (0x3ac bytes) 000298 1787581244.847156 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) 000300 1787581245.370496 write 0x015111 thru 0x01d664 (0x8554 bytes) 000302 1787581245.459900 write 0x02ea1a thru 0x0318ea (0x2ed1 bytes) 000304 1787581245.471984 mapwrite 0x0281bb thru 0x034701 (0xc547 bytes) 000305 1787581245.606611 trunc from 0x0389ab to 0x03da6b (0x50c1 bytes) 000307 1787581245.651964 write 0x01169c thru 0x01daf4 (0xc459 bytes) 000309 1787581245.661920 write 0x012192 thru 0x016f7f (0x4dee bytes) 000310 1787581245.663683 mapread 0x031a5c thru 0x039171 (0x7716 bytes) 000313 1787581245.679982 mapwrite 0x01f9f4 thru 0x02f01b (0xf628 bytes) 000314 1787581245.796036 trunc from 0x03da6c to 0x01de5b (0x1fc10 bytes) 000315 1787581245.842686 trunc from 0x01de5c to 0x01ad96 (0x30c5 bytes) 000316 1787581245.884148 trunc from 0x01ad97 to 0x016315 (0x4a81 bytes) 000320 1787581245.953620 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x16316): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16316): Mirror 5: 0x7522c260 (stale) Mirror 7: 0x7522c260 (stale) Mirror 8: 0x7522c260 (stale) Mirror 9: 0x7522c260 (stale) Mirror 10: 0x7522c260 (stale) CRC-32 checksum value for chunk [0, 0x16316): Mirror 1: 0xce08db0 Mirror 11: 0xce08db0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16316: skipped 000321 1787581247.599264 trunc from 0x016316 to 0x039792 (0x2347d bytes) 000322 1787581247.718835 MIRROR_RESYNC 7 mirrors 000324 1787581249.748831 mapwrite 0x013f9c thru 0x02230b (0xe370 bytes) 000325 1787581249.910128 mapwrite 0x0032f6 thru 0x00ef77 (0xbc82 bytes) 000326 1787581249.963511 read 0x02ebec thru 0x0379a3 (0x8db8 bytes) 000327 1787581249.971939 mapread 0x007eaf thru 0x00a192 (0x22e4 bytes) 000329 1787581249.973379 write 0x01a275 thru 0x01aef5 (0xc81 bytes) 000330 1787581249.974289 trunc from 0x039793 to 0x01b537 (0x1e25b bytes) 000331 1787581250.003181 read 0x013777 thru 0x013ca0 (0x52a bytes) 000332 1787581250.010524 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b538): Mirror 5: 0x68fbd3a4 (stale) Mirror 7: 0x68fbd3a4 (stale) Mirror 8: 0x68fbd3a4 (stale) Mirror 10: 0x68fbd3a4 (stale) Mirror 11: 0x68fbd3a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b538): Mirror 5: 0x68fbd3a4 (stale) Mirror 7: 0x68fbd3a4 (stale) Mirror 8: 0x68fbd3a4 (stale) Mirror 10: 0x68fbd3a4 (stale) Mirror 11: 0x68fbd3a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b538: skipped 000334 1787581250.500582 write 0x03361f thru 0x0373a3 (0x3d85 bytes) 000335 1787581250.506794 mapwrite 0x011a25 thru 0x011efa (0x4d6 bytes) 000336 1787581250.652145 mapread 0x023b89 thru 0x03015b (0xc5d3 bytes) 000337 1787581250.679958 mapread 0x0248ec thru 0x02b0af (0x67c4 bytes) 000340 1787581250.681558 mapread 0x020558 thru 0x024e3f (0x48e8 bytes) 000341 1787581250.682433 read 0x00715f thru 0x016849 (0xf6eb bytes) 000342 1787581250.701633 mapread 0x0132f1 thru 0x01f300 (0xc010 bytes) 000345 1787581250.717665 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x373a4): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x373a4): Mirror 5: 0xe9dabf81 (stale) Mirror 7: 0xe9dabf81 (stale) Mirror 8: 0xe9dabf81 (stale) Mirror 10: 0xe9dabf81 (stale) Mirror 11: 0xe9dabf81 (stale) CRC-32 checksum value for chunk [0, 0x373a4): Mirror 1: 0x66b8ab06 Mirror 12: 0x66b8ab06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x373a4: skipped 000347 1787581252.002919 write 0x0288c4 thru 0x02e1e1 (0x591e bytes) 000348 1787581252.116893 mapwrite 0x01e852 thru 0x02422f (0x59de bytes) 000349 1787581252.189166 trunc from 0x0373a4 to 0x03d12f (0x5d8c bytes) 000351 1787581252.212989 mapwrite 0x003c99 thru 0x00846e (0x47d6 bytes) 000352 1787581252.287088 write 0x023b7f thru 0x030021 (0xc4a3 bytes) 000354 1787581252.294965 trunc from 0x03d130 to 0x030307 (0xce28 bytes) 000355 1787581252.314166 mapwrite 0x02b1f1 thru 0x02d0f0 (0x1f00 bytes) 000358 1787581252.359898 mapread 0x02a26c thru 0x030307 (0x609c bytes) 000359 1787581252.362182 trunc from 0x030308 to 0x035fee (0x5ce7 bytes) 000360 1787581252.384204 MIRROR_RESYNC 7 mirrors 000362 1787581254.931136 read 0x030f89 thru 0x032b89 (0x1c01 bytes) 000363 1787581254.937650 read 0x004ebc thru 0x00e49c (0x95e1 bytes) 000364 1787581254.947150 trunc from 0x035fef to 0x02032c (0x15cc2 bytes) 000366 1787581255.032500 write 0x025e1b thru 0x030015 (0xa1fb bytes) 000367 1787581255.034213 mapread 0x01b022 thru 0x01f2b8 (0x4297 bytes) 000368 1787581255.060573 mapread 0x01b07c thru 0x01b804 (0x789 bytes) 000369 1787581255.061527 read 0x001930 thru 0x00381a (0x1eeb bytes) 000370 1787581255.073138 write 0x013d83 thru 0x0215cc (0xd84a bytes) 000373 1787581255.077912 write 0x009665 thru 0x019364 (0xfd00 bytes) 000374 1787581255.084089 mapwrite 0x01ea8e thru 0x02ca74 (0xdfe7 bytes) 000375 1787581255.147925 read 0x014617 thru 0x015898 (0x1282 bytes) 000376 1787581255.153884 MIRROR_RESYNC 7 mirrors 000377 1787581256.638963 mapwrite 0x03267f thru 0x03ddf2 (0xb774 bytes) 000378 1787581257.018381 mapread 0x03957d thru 0x03ddf2 (0x4876 bytes) 000379 1787581257.021250 write 0x004721 thru 0x00e8fd (0xa1dd bytes) 000380 1787581257.041273 trunc from 0x03ddf3 to 0x03b0a4 (0x2d4e bytes) 000383 1787581257.127808 mapwrite 0x037101 thru 0x03ffff (0x8eff bytes) 000385 1787581257.412314 mapread 0x0256c5 thru 0x0264cf (0xe0b bytes) 000389 1787581257.455089 read 0x0044d5 thru 0x0133df (0xef0b bytes) 000390 1787581257.481316 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x4478c16c (stale) Mirror 8: 0x4478c16c (stale) Mirror 10: 0x4478c16c (stale) Mirror 11: 0x4478c16c (stale) Mirror 12: 0x4478c16c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x4478c16c (stale) Mirror 8: 0x4478c16c (stale) Mirror 10: 0x4478c16c (stale) Mirror 11: 0x4478c16c (stale) Mirror 12: 0x4478c16c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000391 1787581258.224246 MIRROR_RESYNC 6 mirrors 000392 1787581260.504686 MIRROR_EXTEND to 7 mirrors 000393 1787581261.814520 trunc from 0x040000 to 0x024ae5 (0x1b51a bytes) 000394 1787581261.898839 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24ae6): Mirror 7: 0xdd1f9834 (stale) Mirror 8: 0xdd1f9834 (stale) Mirror 11: 0xdd1f9834 (stale) Mirror 12: 0xdd1f9834 (stale) Mirror 13: 0xdd1f9834 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24ae6): Mirror 7: 0xdd1f9834 (stale) Mirror 8: 0xdd1f9834 (stale) Mirror 11: 0xdd1f9834 (stale) Mirror 12: 0xdd1f9834 (stale) Mirror 13: 0xdd1f9834 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24ae6: skipped 000396 1787581262.297649 mapwrite 0x025e93 thru 0x02c8b9 (0x6a27 bytes) 000397 1787581262.418096 mapread 0x013735 thru 0x020758 (0xd024 bytes) 000398 1787581262.434726 write 0x00d2a1 thru 0x00eb59 (0x18b9 bytes) 000400 1787581262.436211 mapread 0x0243fa thru 0x02a846 (0x644d bytes) 000405 1787581262.443607 read 0x015244 thru 0x02302f (0xddec bytes) 000406 1787581262.444666 trunc from 0x02c8ba to 0x021dfa (0xaabf bytes) 000407 1787581262.474259 mapread 0x021caf thru 0x021dfa (0x14c bytes) 000408 1787581262.477598 write 0x03fc16 thru 0x03ffff (0x3ea bytes) 000409 1787581262.481538 write 0x03a2c5 thru 0x03ffff (0x5d3b bytes) 000410 1787581262.487612 trunc from 0x040000 to 0x01d955 (0x226aa bytes) 000411 1787581262.515273 MIRROR_RESYNC 6 mirrors 000412 1787581263.670059 write 0x032c35 thru 0x03ab47 (0x7f13 bytes) 000413 1787581263.750194 mapwrite 0x00bed8 thru 0x015273 (0x939c bytes) 000414 1787581263.825477 mapread 0x01b065 thru 0x01caa3 (0x1a3f bytes) 000415 1787581263.837135 mapwrite 0x031b2c thru 0x03b875 (0x9d4a bytes) 000416 1787581263.928634 mapread 0x02e50f thru 0x03b875 (0xd367 bytes) 000417 1787581263.932224 mapread 0x001fc0 thru 0x00c660 (0xa6a1 bytes) 000419 1787581263.943511 write 0x038eae thru 0x03b008 (0x215b bytes) 000420 1787581263.945856 trunc from 0x03b876 to 0x03abfb (0xc7a bytes) 000421 1787581263.974303 trunc from 0x03abfc to 0x03a17a (0xa81 bytes) 000422 1787581263.993496 write 0x012e20 thru 0x0208be (0xda9f bytes) 000424 1787581264.000721 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a17b): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a17b): Mirror 7: 0x9b1c6bf3 (stale) Mirror 8: 0x9b1c6bf3 (stale) Mirror 11: 0x9b1c6bf3 (stale) Mirror 12: 0x9b1c6bf3 (stale) Mirror 13: 0x9b1c6bf3 (stale) CRC-32 checksum value for chunk [0, 0x3a17b): Mirror 1: 0xd4ae6d27 Mirror 14: 0xd4ae6d27 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a17b: skipped 000425 1787581265.682035 mapread 0x009632 thru 0x00991e (0x2ed bytes) 000426 1787581265.687807 read 0x02be6c thru 0x02e429 (0x25be bytes) 000427 1787581265.693438 trunc from 0x03a17b to 0x00985a (0x30920 bytes) truncating to largest ever: 0x3f2f5 000428 1787581265.782846 trunc from 0x00985b to 0x03f2f4 (0x35a9a bytes) 000432 1787581265.832784 trunc from 0x03f2f5 to 0x020685 (0x1ec6f bytes) 000433 1787581265.862611 trunc from 0x020686 to 0x02154b (0xec6 bytes) 000434 1787581265.883054 trunc from 0x02154c to 0x010b0b (0x10a40 bytes) 000437 1787581265.917072 mapread 0x00c502 thru 0x00e6d9 (0x21d8 bytes) 000439 1787581265.932902 write 0x01cef9 thru 0x020faa (0x40b2 bytes) 000440 1787581265.934657 trunc from 0x020fab to 0x017f0b (0x909f bytes) 000443 1787581265.950602 trunc from 0x017f0c to 0x013636 (0x48d5 bytes) 000444 1787581265.972521 mapread 0x007478 thru 0x013636 (0xc1bf bytes) 000447 1787581265.984110 write 0x007e5d thru 0x016bc4 (0xed68 bytes) 000448 1787581265.990931 read 0x012270 thru 0x016bc4 (0x4955 bytes) 000449 1787581265.994195 mapwrite 0x019fab thru 0x0255c9 (0xb61f bytes) 000450 1787581266.089096 MIRROR_RESYNC 7 mirrors 000451 1787581268.128979 trunc from 0x0255ca to 0x02cf91 (0x79c8 bytes) 000452 1787581268.249177 read 0x000872 thru 0x008ec4 (0x8653 bytes) 000454 1787581268.262570 trunc from 0x02cf92 to 0x02be40 (0x1151 bytes) 000455 1787581268.297147 MIRROR_RESYNC 7 mirrors 000456 1787581271.625250 MIRROR_EXTEND to 8 mirrors 000458 1787581273.661517 trunc from 0x02be41 to 0x036fc9 (0xb189 bytes) 000459 1787581273.745178 write 0x025687 thru 0x03520e (0xfb88 bytes) 000460 1787581273.762466 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x36fca): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36fca): Mirror 7: 0x71029c4d (stale) Mirror 8: 0x71029c4d (stale) Mirror 11: 0x71029c4d (stale) Mirror 12: 0x71029c4d (stale) Mirror 13: 0x71029c4d (stale) Mirror 14: 0x71029c4d (stale) Mirror 15: 0x71029c4d (stale) CRC-32 checksum value for chunk [0, 0x36fca): Mirror 1: 0xbb47bcc4 Mirror 16: 0xbb47bcc4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36fca: skipped 000461 1787581276.767469 write 0x031681 thru 0x033dc4 (0x2744 bytes) 000463 1787581276.969728 write 0x01b4da thru 0x0215a2 (0x60c9 bytes) 000464 1787581276.988094 mapread 0x00d48a thru 0x00fe43 (0x29ba bytes) 000465 1787581277.052445 trunc from 0x036fca to 0x03afa7 (0x3fde bytes) 000466 1787581277.207869 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3afa8): Mirror 7: 0x7b38daa1 (stale) Mirror 8: 0x7b38daa1 (stale) Mirror 11: 0x7b38daa1 (stale) Mirror 12: 0x7b38daa1 (stale) Mirror 13: 0x7b38daa1 (stale) Mirror 14: 0x7b38daa1 (stale) Mirror 15: 0x7b38daa1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afa8): Mirror 7: 0x7b38daa1 (stale) Mirror 8: 0x7b38daa1 (stale) Mirror 11: 0x7b38daa1 (stale) Mirror 12: 0x7b38daa1 (stale) Mirror 13: 0x7b38daa1 (stale) Mirror 14: 0x7b38daa1 (stale) Mirror 15: 0x7b38daa1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afa8: skipped 000467 1787581278.291110 trunc from 0x03afa8 to 0x01f975 (0x1b632 bytes) 000469 1787581278.354816 mapwrite 0x0351d0 thru 0x03ffff (0xae30 bytes) 000470 1787581278.575426 MIRROR_RESYNC 8 mirrors 000474 1787581281.753494 MIRROR_EXTEND to 9 mirrors 000477 1787581282.908050 trunc from 0x040000 to 0x00cc77 (0x33388 bytes) 000478 1787581283.007717 mapwrite 0x018b98 thru 0x01ee4d (0x62b6 bytes) 000480 1787581283.117419 trunc from 0x01ee4e to 0x00a0bb (0x14d92 bytes) 000481 1787581283.142304 mapread 0x0046af thru 0x0086f5 (0x4047 bytes) 000483 1787581283.166943 write 0x0105e9 thru 0x01a0e8 (0x9b00 bytes) 000486 1787581283.184045 mapread 0x005418 thru 0x00e9c7 (0x95b0 bytes) 000487 1787581283.211618 MIRROR_RESYNC 9 mirrors 000490 1787581285.745574 write 0x0003e0 thru 0x003a7e (0x369f bytes) 000492 1787581285.828552 write 0x03b536 thru 0x03ffff (0x4aca bytes) 000496 1787581285.833605 read 0x000ed4 thru 0x00505f (0x418c bytes) 000497 1787581285.839795 mapread 0x00610e thru 0x00f256 (0x9149 bytes) 000498 1787581285.864527 mapwrite 0x0173a4 thru 0x020152 (0x8daf bytes) 000500 1787581286.008580 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2e72fdb3 (stale) Mirror 8: 0x2e72fdb3 (stale) Mirror 11: 0x2e72fdb3 (stale) Mirror 13: 0x2e72fdb3 (stale) Mirror 14: 0x2e72fdb3 (stale) Mirror 15: 0x2e72fdb3 (stale) Mirror 16: 0x2e72fdb3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2e72fdb3 (stale) Mirror 8: 0x2e72fdb3 (stale) Mirror 11: 0x2e72fdb3 (stale) Mirror 13: 0x2e72fdb3 (stale) Mirror 14: 0x2e72fdb3 (stale) Mirror 15: 0x2e72fdb3 (stale) Mirror 16: 0x2e72fdb3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000503 1787581286.585887 mapwrite 0x02a0f0 thru 0x02da40 (0x3951 bytes) 000505 1787581286.673811 read 0x0398d0 thru 0x03ffff (0x6730 bytes) 000506 1787581286.687716 mapread 0x014dca thru 0x0154c9 (0x700 bytes) 000508 1787581286.705752 mapread 0x00c366 thru 0x0190cf (0xcd6a bytes) 000509 1787581286.718377 mapwrite 0x00d781 thru 0x019ab8 (0xc338 bytes) 000510 1787581286.837634 mapread 0x01ef54 thru 0x027ce6 (0x8d93 bytes) 000511 1787581286.876298 mapread 0x035677 thru 0x03ffff (0xa989 bytes) 000513 1787581286.898509 mapread 0x0340ac thru 0x035aa4 (0x19f9 bytes) 000514 1787581286.899369 mapread 0x01c185 thru 0x02ab62 (0xe9de bytes) 000515 1787581286.904720 mapwrite 0x039924 thru 0x03ffff (0x66dc bytes) 000517 1787581287.039312 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2e72fdb3 (stale) Mirror 11: 0x2e72fdb3 (stale) Mirror 13: 0x2e72fdb3 (stale) Mirror 14: 0x2e72fdb3 (stale) Mirror 15: 0x2e72fdb3 (stale) Mirror 16: 0x2e72fdb3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2e72fdb3 (stale) Mirror 11: 0x2e72fdb3 (stale) Mirror 13: 0x2e72fdb3 (stale) Mirror 14: 0x2e72fdb3 (stale) Mirror 15: 0x2e72fdb3 (stale) Mirror 16: 0x2e72fdb3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000518 1787581287.865173 read 0x029753 thru 0x0380e8 (0xe996 bytes) 000520 1787581287.889524 write 0x0131a8 thru 0x015e5d (0x2cb6 bytes) 000521 1787581287.913325 mapread 0x0183a1 thru 0x01ec7a (0x68da bytes) 000522 1787581287.933665 read 0x036d21 thru 0x03ffff (0x92df bytes) 000523 1787581287.950807 trunc from 0x040000 to 0x00a4a2 (0x35b5d bytes) 000524 1787581287.976206 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0xa4a3): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa4a3): Mirror 7: 0x4619740b (stale) Mirror 11: 0x4619740b (stale) Mirror 13: 0x4619740b (stale) Mirror 14: 0x4619740b (stale) Mirror 15: 0x4619740b (stale) Mirror 16: 0x4619740b (stale) CRC-32 checksum value for chunk [0, 0xa4a3): Mirror 1: 0x5a2d983f Mirror 17: 0x5a2d983f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa4a3: skipped 000526 1787581289.099602 mapwrite 0x018578 thru 0x02067f (0x8108 bytes) 000528 1787581289.377904 trunc from 0x020680 to 0x034a14 (0x14395 bytes) 000529 1787581289.405845 mapwrite 0x01bd80 thru 0x0207b0 (0x4a31 bytes) 000530 1787581289.472853 trunc from 0x034a15 to 0x0261c6 (0xe84e bytes) 000532 1787581289.503603 trunc from 0x0261c7 to 0x006efd (0x1f2c9 bytes) 000533 1787581289.540686 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6efe): Mirror 7: 0x2a8e6081 (stale) Mirror 11: 0x2a8e6081 (stale) Mirror 13: 0x2a8e6081 (stale) Mirror 15: 0x2a8e6081 (stale) Mirror 16: 0x2a8e6081 (stale) Mirror 17: 0xeb5f8c2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6efe): Mirror 7: 0x2a8e6081 (stale) Mirror 11: 0x2a8e6081 (stale) Mirror 13: 0x2a8e6081 (stale) Mirror 15: 0x2a8e6081 (stale) Mirror 16: 0x2a8e6081 (stale) Mirror 17: 0xeb5f8c2c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6efe: skipped 000535 1787581290.071243 read 0x0035ef thru 0x006efd (0x390f bytes) 000537 1787581290.079229 mapwrite 0x00b69c thru 0x01164e (0x5fb3 bytes) 000538 1787581290.293496 mapread 0x0021f6 thru 0x009c6e (0x7a79 bytes) 000540 1787581290.302006 read 0x00a1e1 thru 0x00f32c (0x514c bytes) 000542 1787581290.317268 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1164f): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1164f): Mirror 7: 0xbf18df2b (stale) Mirror 11: 0xbf18df2b (stale) Mirror 13: 0xbf18df2b (stale) Mirror 15: 0xbf18df2b (stale) Mirror 16: 0xbf18df2b (stale) Mirror 17: 0x441a25ab (stale) CRC-32 checksum value for chunk [0, 0x1164f): Mirror 1: 0xebeefd70 Mirror 18: 0xebeefd70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1164f: skipped 000543 1787581291.581991 trunc from 0x01164f to 0x026099 (0x14a4b bytes) 000544 1787581291.763841 write 0x036df0 thru 0x03d8ef (0x6b00 bytes) 000546 1787581291.775486 MIRROR_RESYNC 8 mirrors 000548 1787581295.386203 mapread 0x028b18 thru 0x02ad84 (0x226d bytes) 000550 1787581295.407954 mapread 0x004b4f thru 0x010925 (0xbdd7 bytes) 000551 1787581295.425091 MIRROR_EXTEND to 9 mirrors 000553 1787581296.382909 mapread 0x030d90 thru 0x03664a (0x58bb bytes) 000554 1787581296.430816 mapread 0x035e1b thru 0x037cee (0x1ed4 bytes) 000556 1787581296.431635 mapread 0x01a14e thru 0x01f55c (0x540f bytes) 000558 1787581296.486305 trunc from 0x03d8f0 to 0x022f85 (0x1a96a bytes) 000560 1787581296.645098 mapwrite 0x036c08 thru 0x03ffff (0x93f8 bytes) 000562 1787581296.730781 mapwrite 0x01811a thru 0x022bc7 (0xaaae bytes) 000563 1787581296.818704 trunc from 0x040000 to 0x03755e (0x8aa1 bytes) 000564 1787581296.836898 mapread 0x026e9b thru 0x02f482 (0x85e8 bytes) 000566 1787581296.853244 mapwrite 0x0299f2 thru 0x033a30 (0xa03f bytes) 000568 1787581296.913774 trunc from 0x03755f to 0x02d940 (0x9c1e bytes) 000570 1787581296.950460 MIRROR_RESYNC 9 mirrors 000571 1787581301.162462 mapread 0x00df06 thru 0x01dad0 (0xfbcb bytes) 000573 1787581301.209758 write 0x00f4d9 thru 0x0131d2 (0x3cfa bytes) 000574 1787581301.313007 mapread 0x00c682 thru 0x015c7d (0x95fc bytes) 000577 1787581301.328509 trunc from 0x02d941 to 0x033d6e (0x642e bytes) 000578 1787581301.347353 mapread 0x01823f thru 0x023bc8 (0xb98a bytes) 000582 1787581301.358163 read 0x007a6d thru 0x01334b (0xb8df bytes) 000583 1787581301.358790 read 0x02d0af thru 0x033d6e (0x6cc0 bytes) 000587 1787581301.371301 write 0x03ae8e thru 0x03ffff (0x5172 bytes) 000589 1787581301.377554 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x48057247 (stale) Mirror 11: 0x48057247 (stale) Mirror 15: 0x48057247 (stale) Mirror 16: 0x48057247 (stale) Mirror 17: 0x48057247 (stale) Mirror 18: 0x48057247 (stale) Mirror 19: 0x48057247 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x48057247 (stale) Mirror 11: 0x48057247 (stale) Mirror 15: 0x48057247 (stale) Mirror 16: 0x48057247 (stale) Mirror 17: 0x48057247 (stale) Mirror 18: 0x48057247 (stale) Mirror 19: 0x48057247 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000590 1787581302.189322 mapread 0x027c89 thru 0x032aee (0xae66 bytes) 000592 1787581302.240716 mapwrite 0x012c16 thru 0x019fe2 (0x73cd bytes) 000593 1787581302.401317 mapwrite 0x012c32 thru 0x01d55d (0xa92c bytes) 000594 1787581302.546287 read 0x009d08 thru 0x0120d2 (0x83cb bytes) 000595 1787581302.560125 MIRROR_RESYNC 8 mirrors 000596 1787581306.346636 mapread 0x02bf72 thru 0x037176 (0xb205 bytes) 000597 1787581306.379258 write 0x039096 thru 0x03e7b5 (0x5720 bytes) 000598 1787581306.462756 trunc from 0x040000 to 0x007c3d (0x383c2 bytes) 000599 1787581306.500500 MIRROR_RESYNC 8 mirrors 000600 1787581308.345632 trunc from 0x007c3e to 0x0337fd (0x2bbc0 bytes) 000602 1787581308.497811 trunc from 0x0337fe to 0x009be6 (0x29c17 bytes) 000603 1787581308.522558 mapread 0x003dd2 thru 0x009be6 (0x5e15 bytes) 000605 1787581308.562111 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x9be7): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9be7): Mirror 7: 0xb95af1aa (stale) Mirror 11: 0xb95af1aa (stale) Mirror 15: 0xb95af1aa (stale) Mirror 16: 0xb95af1aa (stale) Mirror 17: 0xb95af1aa (stale) Mirror 18: 0xb95af1aa (stale) Mirror 19: 0xb95af1aa (stale) CRC-32 checksum value for chunk [0, 0x9be7): Mirror 1: 0xb95af1aa Mirror 20: 0xb95af1aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9be7: skipped 000607 1787581310.163535 write 0x03b46e thru 0x03ffff (0x4b92 bytes) 000608 1787581310.267921 read 0x032060 thru 0x033633 (0x15d4 bytes) 000611 1787581310.285440 mapwrite 0x00101d thru 0x008916 (0x78fa bytes) 000612 1787581310.377175 mapwrite 0x011a21 thru 0x016c18 (0x51f8 bytes) 000614 1787581310.456811 write 0x02faff thru 0x036193 (0x6695 bytes) truncating to largest ever: 0x3f72c 000618 1787581310.473356 trunc from 0x040000 to 0x03f72b (0x8d4 bytes) 000619 1787581310.506174 mapwrite 0x03fd53 thru 0x03ffff (0x2ad bytes) 000620 1787581310.571777 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8fec6ac7 (stale) Mirror 11: 0x8fec6ac7 (stale) Mirror 15: 0x8fec6ac7 (stale) Mirror 16: 0x8fec6ac7 (stale) Mirror 17: 0x8fec6ac7 (stale) Mirror 18: 0x8fec6ac7 (stale) Mirror 19: 0x8fec6ac7 (stale) Mirror 20: 0x8fec6ac7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5144db59 Mirror 21: 0x5144db59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000622 1787581312.284888 trunc from 0x040000 to 0x018815 (0x277ea bytes) 000623 1787581312.441247 write 0x022f63 thru 0x0279fa (0x4a98 bytes) 000624 1787581312.442713 trunc from 0x0279fb to 0x02f17f (0x7785 bytes) 000625 1787581312.489142 mapread 0x007572 thru 0x00e9d9 (0x7468 bytes) 000626 1787581312.558255 trunc from 0x02f180 to 0x03f105 (0xff86 bytes) 000627 1787581312.610221 mapread 0x0192c1 thru 0x021411 (0x8151 bytes) 000628 1787581312.639077 MIRROR_RESYNC 10 mirrors 000629 1787581316.625195 mapwrite 0x0113ff thru 0x0123aa (0xfac bytes) 000630 1787581316.852096 mapread 0x0388c1 thru 0x03f105 (0x6845 bytes) 000631 1787581316.866443 read 0x03b4b5 thru 0x03f105 (0x3c51 bytes) 000634 1787581316.868763 mapwrite 0x02a51a thru 0x0303bc (0x5ea3 bytes) 000636 1787581316.934846 write 0x0083f7 thru 0x017d76 (0xf980 bytes) 000638 1787581316.943529 trunc from 0x03f106 to 0x01bfc4 (0x23141 bytes) 000639 1787581316.972454 read 0x01967a thru 0x01bfc4 (0x294b bytes) 000640 1787581316.984559 mapwrite 0x00e9cd thru 0x011647 (0x2c7b bytes) 000641 1787581317.056811 mapwrite 0x03fda7 thru 0x03ffff (0x259 bytes) 000643 1787581317.254175 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x78c2f2d1 (stale) Mirror 11: 0x78c2f2d1 (stale) Mirror 15: 0x78c2f2d1 (stale) Mirror 16: 0x78c2f2d1 (stale) Mirror 18: 0x78c2f2d1 (stale) Mirror 19: 0x78c2f2d1 (stale) Mirror 20: 0x78c2f2d1 (stale) Mirror 21: 0x78c2f2d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x78c2f2d1 (stale) Mirror 11: 0x78c2f2d1 (stale) Mirror 15: 0x78c2f2d1 (stale) Mirror 16: 0x78c2f2d1 (stale) Mirror 18: 0x78c2f2d1 (stale) Mirror 19: 0x78c2f2d1 (stale) Mirror 20: 0x78c2f2d1 (stale) Mirror 21: 0x78c2f2d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000644 1787581318.068550 mapwrite 0x034f7f thru 0x03ffff (0xb081 bytes) 000645 1787581318.213652 mapwrite 0x0087a9 thru 0x01874b (0xffa3 bytes) 000646 1787581318.291386 mapread 0x026136 thru 0x02d280 (0x714b bytes) 000649 1787581318.302889 read 0x01ff77 thru 0x0202f7 (0x381 bytes) 000650 1787581318.303485 trunc from 0x040000 to 0x03de0e (0x21f1 bytes) 000651 1787581318.328990 trunc from 0x03de0f to 0x027976 (0x16498 bytes) 000653 1787581318.357017 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x27977): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27977): Mirror 7: 0x5b07d6f7 (stale) Mirror 11: 0x5b07d6f7 (stale) Mirror 15: 0x5b07d6f7 (stale) Mirror 16: 0x5b07d6f7 (stale) Mirror 18: 0x5b07d6f7 (stale) Mirror 19: 0x5b07d6f7 (stale) Mirror 20: 0x5b07d6f7 (stale) Mirror 21: 0x5b07d6f7 (stale) CRC-32 checksum value for chunk [0, 0x27977): Mirror 1: 0x47c57df1 Mirror 22: 0x47c57df1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27977: skipped 000654 1787581319.897425 mapread 0x01d33f thru 0x027976 (0xa638 bytes) 000655 1787581319.937589 mapread 0x00a975 thru 0x00e121 (0x37ad bytes) 000656 1787581319.966173 mapread 0x01bed8 thru 0x024ace (0x8bf7 bytes) 000657 1787581319.996068 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27977): Mirror 7: 0x5b07d6f7 (stale) Mirror 11: 0x5b07d6f7 (stale) Mirror 15: 0x5b07d6f7 (stale) Mirror 16: 0x5b07d6f7 (stale) Mirror 19: 0x5b07d6f7 (stale) Mirror 20: 0x5b07d6f7 (stale) Mirror 21: 0x5b07d6f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27977): Mirror 7: 0x5b07d6f7 (stale) Mirror 11: 0x5b07d6f7 (stale) Mirror 15: 0x5b07d6f7 (stale) Mirror 16: 0x5b07d6f7 (stale) Mirror 19: 0x5b07d6f7 (stale) Mirror 20: 0x5b07d6f7 (stale) Mirror 21: 0x5b07d6f7 (stale) CRC-32 checksum value for chunk [0, 0x27977): Mirror 1: 0x47c57df1 Mirror 22: 0x47c57df1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27977: skipped 000658 1787581321.085833 write 0x018360 thru 0x01c38f (0x4030 bytes) 000660 1787581321.194409 write 0x014db7 thru 0x01a332 (0x557c bytes) 000663 1787581321.227414 mapwrite 0x018ac0 thru 0x021fce (0x950f bytes) 000664 1787581321.460177 read 0x027101 thru 0x027976 (0x876 bytes) 000667 1787581321.475674 mapread 0x01569d thru 0x01b96c (0x62d0 bytes) 000668 1787581321.494739 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x27977): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27977): Mirror 7: 0x5b07d6f7 (stale) Mirror 11: 0x5b07d6f7 (stale) Mirror 15: 0x5b07d6f7 (stale) Mirror 16: 0x5b07d6f7 (stale) Mirror 19: 0x5b07d6f7 (stale) Mirror 20: 0x5b07d6f7 (stale) Mirror 21: 0x5b07d6f7 (stale) Mirror 22: 0x47c57df1 (stale) CRC-32 checksum value for chunk [0, 0x27977): Mirror 1: 0x1041738f Mirror 23: 0x1041738f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27977: skipped 000669 1787581323.117283 read 0x01f756 thru 0x024cc2 (0x556d bytes) 000670 1787581323.140178 mapread 0x0190a7 thru 0x027976 (0xe8d0 bytes) 000672 1787581323.193788 write 0x015d48 thru 0x024c3d (0xeef6 bytes) 000673 1787581323.310047 MIRROR_RESYNC 10 mirrors 000675 1787581325.479747 write 0x03ccf5 thru 0x03ffff (0x330b bytes) 000676 1787581325.592166 read 0x032eef thru 0x03ffff (0xd111 bytes) 000677 1787581325.618287 mapwrite 0x0070b6 thru 0x015612 (0xe55d bytes) 000679 1787581325.710942 mapread 0x01fee3 thru 0x024527 (0x4645 bytes) 000680 1787581325.722807 mapread 0x00cb13 thru 0x01c32f (0xf81d bytes) 000682 1787581325.725478 mapwrite 0x006445 thru 0x00e7ea (0x83a6 bytes) 000683 1787581325.777468 write 0x02efda thru 0x0329a0 (0x39c7 bytes) 000686 1787581325.785291 trunc from 0x040000 to 0x009c56 (0x363a9 bytes) 000687 1787581325.835992 trunc from 0x009c57 to 0x03564d (0x2b9f7 bytes) 000694 1787581325.864185 mapwrite 0x02b197 thru 0x034954 (0x97be bytes) 000695 1787581325.961901 write 0x0167d2 thru 0x016c6b (0x49a bytes) 000696 1787581325.971693 write 0x02274b thru 0x0263fc (0x3cb2 bytes) 000697 1787581325.985380 MIRROR_RESYNC 10 mirrors 000700 1787581331.786275 write 0x00f40e thru 0x019f9c (0xab8f bytes) 000703 1787581331.928600 trunc from 0x03564e to 0x00dee7 (0x27766 bytes) 000704 1787581331.973685 mapwrite 0x01f90e thru 0x025c37 (0x632a bytes) 000706 1787581332.077837 mapread 0x02598a thru 0x025c37 (0x2ae bytes) 000707 1787581332.079401 read 0x01ac7d thru 0x023907 (0x8c8b bytes) 000710 1787581332.083209 write 0x02c583 thru 0x03596b (0x93e9 bytes) 000712 1787581332.086283 write 0x010a79 thru 0x017fca (0x7552 bytes) 000713 1787581332.115432 write 0x0004cd thru 0x009c40 (0x9774 bytes) 000714 1787581332.143720 mapread 0x01c937 thru 0x028697 (0xbd61 bytes) 000716 1787581332.157270 trunc from 0x03596c to 0x03f02e (0x96c3 bytes) 000718 1787581332.229879 mapwrite 0x00a071 thru 0x013982 (0x9912 bytes) 000720 1787581332.332594 mapwrite 0x03ec08 thru 0x03ffff (0x13f8 bytes) 000722 1787581332.447889 mapread 0x03a93b thru 0x03ffff (0x56c5 bytes) 000723 1787581332.448958 trunc from 0x040000 to 0x02e176 (0x11e89 bytes) 000724 1787581332.469837 mapread 0x02db7e thru 0x02e176 (0x5f9 bytes) 000726 1787581332.471048 mapwrite 0x02402a thru 0x0242d7 (0x2ae bytes) 000727 1787581332.500228 read 0x017f64 thru 0x01d94b (0x59e8 bytes) 000729 1787581332.513041 mapread 0x0198ef thru 0x01cb86 (0x3298 bytes) 000730 1787581332.515917 mapwrite 0x0084ba thru 0x00a10b (0x1c52 bytes) 000731 1787581332.552807 read 0x02cf6f thru 0x02e176 (0x1208 bytes) 000733 1787581332.553817 trunc from 0x02e177 to 0x027996 (0x67e0 bytes) 000735 1787581332.565234 mapwrite 0x03afd1 thru 0x03ffb5 (0x4fe5 bytes) 000737 1787581332.671455 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3ffb6): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffb6): Mirror 7: 0x8c87d50e (stale) Mirror 11: 0x8c87d50e (stale) Mirror 15: 0x8c87d50e (stale) Mirror 16: 0x8c87d50e (stale) Mirror 19: 0x8c87d50e (stale) Mirror 20: 0x8c87d50e (stale) Mirror 21: 0x8c87d50e (stale) Mirror 22: 0x8c87d50e (stale) Mirror 23: 0x8c87d50e (stale) CRC-32 checksum value for chunk [0, 0x3ffb6): Mirror 1: 0xcb5b6e15 Mirror 24: 0xcb5b6e15 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffb6: skipped 000739 1787581334.247397 write 0x00e0bc thru 0x013d48 (0x5c8d bytes) 000743 1787581334.385429 mapread 0x01c23f thru 0x02b467 (0xf229 bytes) 000744 1787581334.413758 trunc from 0x03ffb6 to 0x0326cc (0xd8e9 bytes) 000748 1787581334.445449 trunc from 0x0326cd to 0x01e65e (0x1406e bytes) 000749 1787581334.463418 trunc from 0x01e65f to 0x0104fe (0xe160 bytes) 000752 1787581334.491218 read 0x009c30 thru 0x0104fe (0x68cf bytes) 000753 1787581334.500589 read 0x008afa thru 0x0104fe (0x7a05 bytes) 000755 1787581334.509064 mapwrite 0x01159f thru 0x01181a (0x27c bytes) 000757 1787581334.632998 read 0x00fa26 thru 0x01181a (0x1df5 bytes) 000759 1787581334.635052 mapwrite 0x02b60b thru 0x031167 (0x5b5d bytes) 000762 1787581334.808964 write 0x0219bd thru 0x02bd26 (0xa36a bytes) 000763 1787581334.810198 mapread 0x0271f7 thru 0x031167 (0x9f71 bytes) 000767 1787581334.835791 MIRROR_RESYNC 11 mirrors 000768 1787581339.229779 trunc from 0x031168 to 0x0383e7 (0x7280 bytes) 000769 1787581339.356218 trunc from 0x0383e8 to 0x009f48 (0x2e49f bytes) 000771 1787581339.420805 mapwrite 0x02d0b5 thru 0x02d6f0 (0x63c bytes) 000772 1787581339.617054 read 0x01e4c6 thru 0x024d40 (0x687b bytes) 000773 1787581339.633617 read 0x00a2f9 thru 0x017c02 (0xd90a bytes) 000774 1787581339.659410 write 0x02464f thru 0x032197 (0xdb49 bytes) 000777 1787581339.662855 read 0x010fda thru 0x015496 (0x44bd bytes) 000779 1787581339.665403 write 0x01a8db thru 0x0257d5 (0xaefb bytes) 000780 1787581339.675761 trunc from 0x032198 to 0x03a033 (0x7e9c bytes) 000781 1787581339.729806 write 0x01cf44 thru 0x02b2f7 (0xe3b4 bytes) 000783 1787581339.733930 write 0x021279 thru 0x025153 (0x3edb bytes) 000784 1787581339.735366 mapwrite 0x038ee4 thru 0x03ffff (0x711c bytes) 000785 1787581339.878930 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf63521f8 (stale) Mirror 11: 0xf63521f8 (stale) Mirror 16: 0xf63521f8 (stale) Mirror 19: 0xf63521f8 (stale) Mirror 20: 0xf63521f8 (stale) Mirror 21: 0xf63521f8 (stale) Mirror 22: 0xf63521f8 (stale) Mirror 23: 0xf63521f8 (stale) Mirror 24: 0xf63521f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf63521f8 (stale) Mirror 11: 0xf63521f8 (stale) Mirror 16: 0xf63521f8 (stale) Mirror 19: 0xf63521f8 (stale) Mirror 20: 0xf63521f8 (stale) Mirror 21: 0xf63521f8 (stale) Mirror 22: 0xf63521f8 (stale) Mirror 23: 0xf63521f8 (stale) Mirror 24: 0xf63521f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000786 1787581340.687026 write 0x021249 thru 0x027cf6 (0x6aae bytes) 000787 1787581340.696869 trunc from 0x040000 to 0x00a66a (0x35995 bytes) 000788 1787581340.728215 MIRROR_RESYNC 10 mirrors 000789 1787581342.704491 mapread 0x004077 thru 0x009505 (0x548f bytes) 000791 1787581342.743539 MIRROR_RESYNC 10 mirrors 000792 1787581343.440025 trunc from 0x00a66b to 0x013216 (0x8bac bytes) 000793 1787581343.528143 trunc from 0x013217 to 0x012437 (0xddf bytes) 000794 1787581343.549261 trunc from 0x012438 to 0x02cbab (0x1a774 bytes) 000796 1787581343.571954 write 0x0293fa thru 0x032550 (0x9157 bytes) 000798 1787581343.584806 MIRROR_RESYNC 10 mirrors 000799 1787581345.694968 MIRROR_RESYNC 10 mirrors 000800 1787581346.244680 MIRROR_RESYNC 10 mirrors 000802 1787581346.696412 trunc from 0x032551 to 0x02712e (0xb422 bytes) 000804 1787581346.775068 read 0x003547 thru 0x00db8e (0xa648 bytes) 000805 1787581346.783715 read 0x01e6f1 thru 0x0232d6 (0x4be6 bytes) 000806 1787581346.793597 trunc from 0x02712f to 0x030045 (0x8f17 bytes) 000809 1787581346.824068 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30046): Mirror 7: 0x6c822be0 (stale) Mirror 11: 0x6c822be0 (stale) Mirror 16: 0x6c822be0 (stale) Mirror 19: 0x6c822be0 (stale) Mirror 20: 0x6c822be0 (stale) Mirror 21: 0x6c822be0 (stale) Mirror 22: 0x6c822be0 (stale) Mirror 24: 0x6c822be0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30046): Mirror 7: 0x6c822be0 (stale) Mirror 11: 0x6c822be0 (stale) Mirror 16: 0x6c822be0 (stale) Mirror 19: 0x6c822be0 (stale) Mirror 20: 0x6c822be0 (stale) Mirror 21: 0x6c822be0 (stale) Mirror 22: 0x6c822be0 (stale) Mirror 24: 0x6c822be0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30046: skipped 000811 1787581347.345098 MIRROR_RESYNC 9 mirrors 000812 1787581348.985911 mapread 0x029532 thru 0x02ded5 (0x49a4 bytes) 000815 1787581349.050819 trunc from 0x030046 to 0x0270e2 (0x8f63 bytes) 000816 1787581349.168816 read 0x00607c thru 0x014a2f (0xe9b4 bytes) 000819 1787581349.200776 mapread 0x016117 thru 0x020a3a (0xa924 bytes) 000823 1787581349.271411 read 0x00f91d thru 0x013f2e (0x4612 bytes) 000824 1787581349.274171 write 0x030e38 thru 0x0395b0 (0x8779 bytes) 000828 1787581349.295778 read 0x01802c thru 0x018327 (0x2fc bytes) 000829 1787581349.296422 trunc from 0x0395b1 to 0x00d373 (0x2c23d bytes) 000836 1787581349.362890 write 0x03c202 thru 0x03ffff (0x3dfe bytes) 000837 1787581349.364902 write 0x0003d1 thru 0x001896 (0x14c6 bytes) 000838 1787581349.385645 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x1eb0174f (stale) Mirror 11: 0x1eb0174f (stale) Mirror 16: 0x1eb0174f (stale) Mirror 19: 0x1eb0174f (stale) Mirror 21: 0x1eb0174f (stale) Mirror 22: 0x1eb0174f (stale) Mirror 24: 0x1eb0174f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x1eb0174f (stale) Mirror 11: 0x1eb0174f (stale) Mirror 16: 0x1eb0174f (stale) Mirror 19: 0x1eb0174f (stale) Mirror 21: 0x1eb0174f (stale) Mirror 22: 0x1eb0174f (stale) Mirror 24: 0x1eb0174f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000839 1787581350.107070 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x1eb0174f (stale) Mirror 11: 0x1eb0174f (stale) Mirror 16: 0x1eb0174f (stale) Mirror 19: 0x1eb0174f (stale) Mirror 21: 0x1eb0174f (stale) Mirror 24: 0x1eb0174f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x1eb0174f (stale) Mirror 11: 0x1eb0174f (stale) Mirror 16: 0x1eb0174f (stale) Mirror 19: 0x1eb0174f (stale) Mirror 21: 0x1eb0174f (stale) Mirror 24: 0x1eb0174f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000840 1787581350.635712 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1eb0174f (stale) Mirror 16: 0x1eb0174f (stale) Mirror 19: 0x1eb0174f (stale) Mirror 21: 0x1eb0174f (stale) Mirror 24: 0x1eb0174f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1eb0174f (stale) Mirror 16: 0x1eb0174f (stale) Mirror 19: 0x1eb0174f (stale) Mirror 21: 0x1eb0174f (stale) Mirror 24: 0x1eb0174f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000841 1787581351.088545 write 0x01ce6b thru 0x0290a7 (0xc23d bytes) 000843 1787581351.104937 trunc from 0x040000 to 0x015293 (0x2ad6c bytes) 000845 1787581351.122090 mapread 0x00ffd1 thru 0x015293 (0x52c3 bytes) 000847 1787581351.140021 read 0x011b19 thru 0x015293 (0x377b bytes) 000849 1787581351.141007 read 0x0134a9 thru 0x015293 (0x1deb bytes) 000851 1787581351.143150 mapwrite 0x0325ce thru 0x034035 (0x1a68 bytes) 000852 1787581351.252995 write 0x029e32 thru 0x0362a5 (0xc474 bytes) 000854 1787581351.258095 write 0x013037 thru 0x018522 (0x54ec bytes) 000855 1787581351.259443 mapwrite 0x02d546 thru 0x033a47 (0x6502 bytes) 000856 1787581351.320610 trunc from 0x0362a6 to 0x0147d9 (0x21acc bytes) 000857 1787581351.336901 mapwrite 0x00a0d1 thru 0x01203b (0x7f6b bytes) 000858 1787581351.387777 mapread 0x0003b9 thru 0x0005be (0x206 bytes) 000859 1787581351.388916 mapwrite 0x03adcb thru 0x03ffff (0x5235 bytes) 000860 1787581351.469768 read 0x01fb9c thru 0x02c606 (0xca6b bytes) 000861 1787581351.485109 MIRROR_RESYNC 6 mirrors 000863 1787581353.371277 write 0x00a6b6 thru 0x0147f3 (0xa13e bytes) 000864 1787581353.519288 read 0x0021b4 thru 0x00ddf9 (0xbc46 bytes) 000865 1787581353.536483 mapwrite 0x036c3b thru 0x038850 (0x1c16 bytes) 000869 1787581353.728985 write 0x005df5 thru 0x00ebd5 (0x8de1 bytes) 000870 1787581353.730151 read 0x02c55c thru 0x038ff8 (0xca9d bytes) 000873 1787581353.754124 read 0x03c1a3 thru 0x03ffff (0x3e5d bytes) 000880 1787581353.787980 MIRROR_RESYNC 6 mirrors 000881 1787581355.938257 mapread 0x0263c5 thru 0x032542 (0xc17e bytes) 000882 1787581355.974646 write 0x01e4b8 thru 0x020160 (0x1ca9 bytes) 000884 1787581356.045491 write 0x01c006 thru 0x02381f (0x781a bytes) 000885 1787581356.055254 read 0x0333de thru 0x036419 (0x303c bytes) 000886 1787581356.063411 read 0x00f77a thru 0x01a239 (0xaac0 bytes) 000887 1787581356.080466 MIRROR_RESYNC 6 mirrors 000889 1787581359.210620 mapwrite 0x00418f thru 0x00630e (0x2180 bytes) 000890 1787581359.653791 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x81458241 (stale) Mirror 16: 0x81458241 (stale) Mirror 21: 0x81458241 (stale) Mirror 24: 0x81458241 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x81458241 (stale) Mirror 16: 0x81458241 (stale) Mirror 21: 0x81458241 (stale) Mirror 24: 0x81458241 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000892 1787581360.351090 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x81458241 (stale) Mirror 16: 0x81458241 (stale) Mirror 21: 0x81458241 (stale) Mirror 24: 0x81458241 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x99320712 Mirror 25: 0x99320712 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000893 1787581361.809422 MIRROR_RESYNC 6 mirrors 000894 1787581363.926089 mapwrite 0x002da6 thru 0x00dbca (0xae25 bytes) 000895 1787581364.178500 MIRROR_RESYNC 6 mirrors 000896 1787581367.452530 mapwrite 0x029d19 thru 0x032e6a (0x9152 bytes) 000897 1787581367.942646 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xb97ccba4 (stale) Mirror 16: 0xb97ccba4 (stale) Mirror 21: 0xb97ccba4 (stale) Mirror 24: 0xb97ccba4 (stale) Mirror 25: 0xb97ccba4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9c759c91 Mirror 26: 0x9c759c91 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000898 1787581369.961045 mapread 0x02ff73 thru 0x03d334 (0xd3c2 bytes) 000899 1787581370.031352 trunc from 0x040000 to 0x03465a (0xb9a5 bytes) 000900 1787581370.246987 mapread 0x0227f4 thru 0x0269a4 (0x41b1 bytes) 000901 1787581370.306607 mapread 0x0123ac thru 0x019041 (0x6c96 bytes) 000902 1787581370.341693 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3465b): Mirror 16: 0x7d52e9c9 (stale) Mirror 21: 0x7d52e9c9 (stale) Mirror 24: 0x7d52e9c9 (stale) Mirror 25: 0x7d52e9c9 (stale) Mirror 26: 0x43292771 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3465b): Mirror 16: 0x7d52e9c9 (stale) Mirror 21: 0x7d52e9c9 (stale) Mirror 24: 0x7d52e9c9 (stale) Mirror 25: 0x7d52e9c9 (stale) Mirror 26: 0x43292771 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3465b: skipped 000903 1787581371.215657 mapread 0x015528 thru 0x024423 (0xeefc bytes) 000905 1787581371.268467 mapread 0x007c0c thru 0x0135cd (0xb9c2 bytes) 000906 1787581371.281511 mapread 0x00b096 thru 0x00ec62 (0x3bcd bytes) 000908 1787581371.298463 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3465b): Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3465b): Mirror 16: 0x7d52e9c9 (stale) Mirror 21: 0x7d52e9c9 (stale) Mirror 24: 0x7d52e9c9 (stale) Mirror 25: 0x7d52e9c9 (stale) Mirror 26: 0x43292771 (stale) CRC-32 checksum value for chunk [0, 0x3465b): Mirror 1: 0x43292771 Mirror 27: 0x43292771 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3465b: skipped 000910 1787581373.445261 mapwrite 0x024c64 thru 0x02a576 (0x5913 bytes) 000911 1787581373.718985 mapread 0x01a913 thru 0x028c53 (0xe341 bytes) 000912 1787581373.730166 mapwrite 0x032462 thru 0x037483 (0x5022 bytes) 000914 1787581373.820029 read 0x033b95 thru 0x035629 (0x1a95 bytes) 000915 1787581373.829893 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x37484): Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37484): Mirror 16: 0x17b8281a (stale) Mirror 21: 0x17b8281a (stale) Mirror 24: 0x17b8281a (stale) Mirror 25: 0x17b8281a (stale) Mirror 26: 0x1a8fcbcd (stale) Mirror 27: 0x7ac8ef89 (stale) CRC-32 checksum value for chunk [0, 0x37484): Mirror 1: 0x183eeda8 Mirror 28: 0x183eeda8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37484: skipped 000916 1787581375.200264 read 0x021d89 thru 0x0305dc (0xe854 bytes) 000918 1787581375.247070 write 0x02784e thru 0x02a786 (0x2f39 bytes) 000919 1787581375.435766 mapread 0x008d41 thru 0x00fd7f (0x703f bytes) 000920 1787581375.491916 write 0x031055 thru 0x03f18c (0xe138 bytes) 000922 1787581375.504959 mapread 0x014d3e thru 0x0188b0 (0x3b73 bytes) 000924 1787581375.534930 read 0x01bdb9 thru 0x01ea53 (0x2c9b bytes) 000925 1787581375.570906 write 0x0335a9 thru 0x03dd20 (0xa778 bytes) 000926 1787581375.583869 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 16: 0x56a16bd3 (stale) Mirror 21: 0x56a16bd3 (stale) Mirror 24: 0x56a16bd3 (stale) Mirror 25: 0x56a16bd3 (stale) Mirror 26: 0x2f082534 (stale) Mirror 27: 0x74a23175 (stale) Mirror 28: 0xb6259bb3 (stale) CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 1: 0x3a47930f Mirror 29: 0x3a47930f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f18d: skipped 000928 1787581377.144732 write 0x0332cd thru 0x03a4ae (0x71e2 bytes) 000931 1787581377.275920 write 0x006212 thru 0x015046 (0xee35 bytes) 000935 1787581377.299503 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 16: 0x56a16bd3 (stale) Mirror 21: 0x56a16bd3 (stale) Mirror 24: 0x56a16bd3 (stale) Mirror 25: 0x56a16bd3 (stale) Mirror 26: 0x2f082534 (stale) Mirror 27: 0x74a23175 (stale) Mirror 28: 0xb6259bb3 (stale) Mirror 29: 0x3a47930f (stale) CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 1: 0xb1f0244e Mirror 30: 0xb1f0244e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f18d: skipped 000937 1787581379.299679 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 16: 0x56a16bd3 (stale) Mirror 21: 0x56a16bd3 (stale) Mirror 24: 0x56a16bd3 (stale) Mirror 25: 0x56a16bd3 (stale) Mirror 26: 0x2f082534 (stale) Mirror 27: 0x74a23175 (stale) Mirror 28: 0xb6259bb3 (stale) Mirror 29: 0x3a47930f (stale) CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 1: 0xb1f0244e Mirror 30: 0xb1f0244e Mirror 31: 0xb1f0244e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f18d: skipped 000938 1787581380.302248 mapread 0x01a0fe thru 0x01a27a (0x17d bytes) 000939 1787581380.308251 mapread 0x03efb5 thru 0x03f18c (0x1d8 bytes) 000940 1787581380.321920 write 0x01017a thru 0x01afaa (0xae31 bytes) 000942 1787581380.567559 trunc from 0x03f18d to 0x01b4bf (0x23ccd bytes) 000948 1787581380.633913 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1b4c0): Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b4c0): Mirror 16: 0xe16d0f08 (stale) Mirror 21: 0xe16d0f08 (stale) Mirror 24: 0xe16d0f08 (stale) Mirror 25: 0xe16d0f08 (stale) Mirror 26: 0xe16d0f08 (stale) Mirror 27: 0xe16d0f08 (stale) Mirror 28: 0xe16d0f08 (stale) Mirror 29: 0xe16d0f08 (stale) Mirror 30: 0x4d1bfa46 (stale) Mirror 31: 0x4d1bfa46 (stale) CRC-32 checksum value for chunk [0, 0x1b4c0): Mirror 1: 0xd4f52e8e Mirror 32: 0xd4f52e8e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b4c0: skipped 000949 1787581382.347204 trunc from 0x01b4c0 to 0x018254 (0x326b bytes) 000950 1787581382.569710 mapwrite 0x00f3a8 thru 0x01e61d (0xf276 bytes) 000951 1787581382.788879 MIRROR_RESYNC 12 mirrors 000953 1787581385.270870 write 0x01267b thru 0x014086 (0x1a0c bytes) 000955 1787581385.356238 write 0x0372eb thru 0x03a2a1 (0x2fb7 bytes) 000956 1787581385.357763 mapwrite 0x0276d2 thru 0x02d726 (0x6055 bytes) 000957 1787581385.494376 mapwrite 0x007644 thru 0x00a544 (0x2f01 bytes) 000960 1787581385.567717 mapwrite 0x03bb1e thru 0x03d5a8 (0x1a8b bytes) 000961 1787581385.703535 mapwrite 0x00ba87 thru 0x0113f9 (0x5973 bytes) 000963 1787581385.837145 mapread 0x021501 thru 0x02a6fa (0x91fa bytes) 000967 1787581385.851850 write 0x01ec74 thru 0x02e399 (0xf726 bytes) 000970 1787581385.855995 mapread 0x000412 thru 0x0061ff (0x5dee bytes) 000971 1787581385.906688 MIRROR_RESYNC 12 mirrors 000972 1787581390.390091 write 0x005607 thru 0x00cf44 (0x793e bytes) 000975 1787581390.513470 mapwrite 0x0299c9 thru 0x02d3b8 (0x39f0 bytes) 000976 1787581390.708477 mapwrite 0x007272 thru 0x00cbbd (0x594c bytes) 000977 1787581390.787517 trunc from 0x03d5a9 to 0x02bbed (0x119bb bytes) 000978 1787581390.830983 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bbee): Mirror 16: 0x379fdc05 (stale) Mirror 21: 0x379fdc05 (stale) Mirror 24: 0x379fdc05 (stale) Mirror 25: 0x379fdc05 (stale) Mirror 26: 0x379fdc05 (stale) Mirror 27: 0x379fdc05 (stale) Mirror 29: 0x379fdc05 (stale) Mirror 30: 0x379fdc05 (stale) Mirror 31: 0x379fdc05 (stale) Mirror 32: 0x379fdc05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bbee): Mirror 16: 0x379fdc05 (stale) Mirror 21: 0x379fdc05 (stale) Mirror 24: 0x379fdc05 (stale) Mirror 25: 0x379fdc05 (stale) Mirror 26: 0x379fdc05 (stale) Mirror 27: 0x379fdc05 (stale) Mirror 29: 0x379fdc05 (stale) Mirror 30: 0x379fdc05 (stale) Mirror 31: 0x379fdc05 (stale) Mirror 32: 0x379fdc05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bbee: skipped 000979 1787581391.789683 write 0x03fa2c thru 0x03ffff (0x5d4 bytes) 000980 1787581391.797060 MIRROR_RESYNC 11 mirrors 000981 1787581397.453694 mapwrite 0x006ebf thru 0x012712 (0xb854 bytes) 000982 1787581398.001103 MIRROR_RESYNC 11 mirrors 000983 1787581401.162807 trunc from 0x040000 to 0x03d57e (0x2a81 bytes) 000985 1787581401.372211 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x155:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d57f): Mirror 16: 0x12ac4dcf (stale) Mirror 21: 0x12ac4dcf (stale) Mirror 25: 0x12ac4dcf (stale) Mirror 26: 0x12ac4dcf (stale) Mirror 27: 0x12ac4dcf (stale) Mirror 29: 0x12ac4dcf (stale) Mirror 30: 0x12ac4dcf (stale) Mirror 31: 0x12ac4dcf (stale) Mirror 32: 0x12ac4dcf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d57f): Mirror 16: 0x12ac4dcf (stale) Mirror 21: 0x12ac4dcf (stale) Mirror 25: 0x12ac4dcf (stale) Mirror 26: 0x12ac4dcf (stale) Mirror 27: 0x12ac4dcf (stale) Mirror 29: 0x12ac4dcf (stale) Mirror 30: 0x12ac4dcf (stale) Mirror 31: 0x12ac4dcf (stale) Mirror 32: 0x12ac4dcf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d57f: skipped 000986 1787581402.072431 trunc from 0x03d57f to 0x02bfc2 (0x115bc bytes) 000987 1787581402.080883 mapwrite 0x03e733 thru 0x03ffff (0x18cd bytes) 000988 1787581402.148030 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xfc3c2a8a (stale) Mirror 21: 0xfc3c2a8a (stale) Mirror 25: 0xfc3c2a8a (stale) Mirror 26: 0xfc3c2a8a (stale) Mirror 27: 0xfc3c2a8a (stale) Mirror 29: 0xfc3c2a8a (stale) Mirror 30: 0xfc3c2a8a (stale) Mirror 31: 0xfc3c2a8a (stale) Mirror 32: 0xfc3c2a8a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9c555b44 Mirror 33: 0x9c555b44 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000990 1787581403.277933 trunc from 0x040000 to 0x022e54 (0x1d1ab bytes) 000991 1787581403.490952 trunc from 0x022e55 to 0x004cd7 (0x1e17d bytes) 000992 1787581403.510006 write 0x03ade2 thru 0x03e2f3 (0x3512 bytes) 000994 1787581403.516012 MIRROR_RESYNC 11 mirrors 000996 1787581408.561769 mapread 0x004e2b thru 0x0092d0 (0x44a6 bytes) 000998 1787581408.622208 MIRROR_EXTEND to 12 mirrors 000999 1787581410.218569 mapwrite 0x018466 thru 0x0209a5 (0x8540 bytes) 001000 1787581410.475845 trunc from 0x03e2f4 to 0x002493 (0x3be60 bytes) All operations completed A-OK!