== sanity-flr test 70a: flr mode fsx test ================ 06:51:51 (1781693511) Seed set to 3511 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x4b91 000003 1781693511.644269 trunc from 00000000 to 0x004b90 (0x4b91 bytes) 000005 1781693511.649592 read 0x000a71 thru 0x004b90 (0x4120 bytes) 000007 1781693511.653154 mapread 0x00143f thru 0x004b90 (0x3752 bytes) truncating to largest ever: 0x36a78 000008 1781693511.653888 trunc from 0x004b91 to 0x036a77 (0x31ee7 bytes) 000009 1781693511.658548 mapwrite 0x023a45 thru 0x024fa8 (0x1564 bytes) 000010 1781693511.679023 mapwrite 0x0209e3 thru 0x027028 (0x6646 bytes) 000011 1781693511.697190 read 0x02143c thru 0x02d24a (0xbe0f bytes) 000012 1781693511.702565 MIRROR_EXTEND to 2 mirrors 000013 1781693511.857651 mapwrite 0x016b7d thru 0x019e6d (0x32f1 bytes) 000015 1781693511.916044 mapwrite 0x03403c thru 0x03d412 (0x93d7 bytes) 000017 1781693511.959250 trunc from 0x03d413 to 0x00b16d (0x322a5 bytes) 000021 1781693511.968579 read 0x00a89e thru 0x00b16d (0x8d0 bytes) 000023 1781693511.974598 MIRROR_RESYNC 2 mirrors 000024 1781693512.199379 mapread 0x0051a0 thru 0x00891d (0x377e bytes) 000025 1781693512.206793 mapwrite 0x007c16 thru 0x00c01b (0x4406 bytes) 000026 1781693512.267942 read 0x005253 thru 0x00c01b (0x6dc9 bytes) 000028 1781693512.269844 mapwrite 0x03dbc9 thru 0x03ffff (0x2437 bytes) 000030 1781693512.308982 trunc from 0x040000 to 0x0197f0 (0x2680f bytes) 000032 1781693512.317873 read 0x0073b4 thru 0x00868e (0x12db bytes) 000033 1781693512.318791 read 0x0094d8 thru 0x00b735 (0x225e bytes) 000034 1781693512.319692 write 0x01084c thru 0x010d4d (0x502 bytes) 000036 1781693512.327162 mapwrite 0x024644 thru 0x02fb08 (0xb4c5 bytes) 000040 1781693512.374064 read 0x0015fa thru 0x00d449 (0xbe50 bytes) 000041 1781693512.374994 write 0x03573b thru 0x03ffff (0xa8c5 bytes) 000043 1781693512.377493 mapread 0x00c8f2 thru 0x016de0 (0xa4ef bytes) 000044 1781693512.378973 mapwrite 0x016ebd thru 0x019faa (0x30ee bytes) 000045 1781693512.405753 write 0x02843f thru 0x034b96 (0xc758 bytes) 000046 1781693512.410803 mapwrite 0x00f014 thru 0x01aa65 (0xba52 bytes) 000048 1781693512.437278 read 0x0398ab thru 0x03a783 (0xed9 bytes) 000049 1781693512.438072 read 0x016129 thru 0x01caba (0x6992 bytes) 000050 1781693512.438876 mapread 0x00ee53 thru 0x010273 (0x1421 bytes) 000052 1781693512.440496 trunc from 0x040000 to 0x001f76 (0x3e089 bytes) truncating to largest ever: 0x3ad4c 000053 1781693512.449439 trunc from 0x001f77 to 0x03ad4b (0x38dd5 bytes) 000054 1781693512.456688 mapwrite 0x00cc18 thru 0x01570e (0x8af7 bytes) 000056 1781693512.487071 mapread 0x00ee59 thru 0x01d281 (0xe429 bytes) 000058 1781693512.491664 MIRROR_RESYNC 2 mirrors 000060 1781693512.728479 mapwrite 0x032939 thru 0x035e1e (0x34e6 bytes) 000061 1781693512.798510 read 0x01cb48 thru 0x025df4 (0x92ad bytes) 000063 1781693512.804633 trunc from 0x03ad4c to 0x0039ff (0x3734c bytes) 000064 1781693512.821980 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a00): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a00): Mirror 2: 0x23b56767 (stale) CRC-32 checksum value for chunk [0, 0x3a00): Mirror 1: 0x23b56767 Mirror 3: 0x23b56767 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a00: skipped 000065 1781693513.051066 mapread 0x000cdf thru 0x0039ff (0x2d21 bytes) 000066 1781693513.057872 mapread 0x0025b4 thru 0x0039ff (0x144c bytes) 000067 1781693513.058661 trunc from 0x003a00 to 0x027f6a (0x2456b bytes) 000069 1781693513.087645 write 0x00b2b4 thru 0x0189cc (0xd719 bytes) 000070 1781693513.094249 read 0x005b03 thru 0x015081 (0xf57f bytes) 000075 1781693513.100009 mapread 0x023c9e thru 0x027f6a (0x42cd bytes) 000076 1781693513.103796 read 0x00d95b thru 0x01c464 (0xeb0a bytes) 000078 1781693513.104774 write 0x019c61 thru 0x01f8b5 (0x5c55 bytes) 000079 1781693513.105665 trunc from 0x027f6b to 0x020723 (0x7847 bytes) 000080 1781693513.111610 read 0x01dd87 thru 0x020723 (0x299d bytes) 000081 1781693513.112309 mapwrite 0x03fdd3 thru 0x03ffff (0x22d bytes) 000082 1781693513.144219 trunc from 0x040000 to 0x0189e9 (0x27616 bytes) 000086 1781693513.150915 mapwrite 0x001e96 thru 0x006258 (0x43c3 bytes) 000087 1781693513.166053 read 0x005a8b thru 0x007d20 (0x2296 bytes) 000091 1781693513.168608 mapread 0x003228 thru 0x00e0de (0xaeb7 bytes) 000093 1781693513.169825 read 0x00ccb3 thru 0x0189e9 (0xbd37 bytes) 000094 1781693513.170272 mapwrite 0x012476 thru 0x0179b5 (0x5540 bytes) 000095 1781693513.183327 mapread 0x00a4d8 thru 0x015e6a (0xb993 bytes) 000096 1781693513.185865 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x189ea): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x189ea): Mirror 2: 0x31d676a5 (stale) Mirror 3: 0xa9b3c9dd (stale) CRC-32 checksum value for chunk [0, 0x189ea): Mirror 1: 0xe3748923 Mirror 4: 0xe3748923 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x189ea: skipped 000097 1781693513.383062 mapwrite 0x0222f0 thru 0x025c94 (0x39a5 bytes) 000099 1781693513.427503 read 0x011afc thru 0x01e576 (0xca7b bytes) 000101 1781693513.431623 trunc from 0x025c95 to 0x01047c (0x15818 bytes) 000104 1781693513.438388 mapread 0x00bcb3 thru 0x00dbad (0x1efb bytes) 000105 1781693513.441477 trunc from 0x01047d to 0x02671e (0x162a2 bytes) 000106 1781693513.445883 mapwrite 0x029097 thru 0x03380a (0xa774 bytes) 000108 1781693513.470621 trunc from 0x03380b to 0x0114e5 (0x22325 bytes) 000109 1781693513.475734 write 0x014fb8 thru 0x01ec26 (0x9c6f bytes) 000110 1781693513.476744 read 0x0096a9 thru 0x017606 (0xdf5e bytes) 000111 1781693513.479453 trunc from 0x01ec27 to 0x000451 (0x1e7d5 bytes) 000114 1781693513.485028 trunc from 0x000452 to 0x035507 (0x350b6 bytes) 000115 1781693513.490494 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35508): Mirror 2: 0x2291f66 (stale) Mirror 4: 0xd0d95143 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35508): Mirror 2: 0x2291f66 (stale) Mirror 4: 0xd0d95143 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35508: skipped 000118 1781693513.574338 read 0x0346c3 thru 0x035507 (0xe45 bytes) 000119 1781693513.576112 read 0x018229 thru 0x01c2c2 (0x409a bytes) 000120 1781693513.579954 mapread 0x008d6f thru 0x00cf99 (0x422b bytes) 000122 1781693513.581054 read 0x0158ad thru 0x022845 (0xcf99 bytes) 000124 1781693513.581935 read 0x0310ae thru 0x035507 (0x445a bytes) 000125 1781693513.582386 read 0x006ca5 thru 0x00e152 (0x74ae bytes) 000126 1781693513.584151 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35508): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35508): Mirror 2: 0x2291f66 (stale) Mirror 4: 0xd0d95143 (stale) CRC-32 checksum value for chunk [0, 0x35508): Mirror 1: 0x53795e0e Mirror 5: 0x53795e0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35508: skipped 000128 1781693513.802655 write 0x005984 thru 0x00cb2b (0x71a8 bytes) 000129 1781693513.823284 write 0x009776 thru 0x014848 (0xb0d3 bytes) 000130 1781693513.827033 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35508): Mirror 2: 0x2291f66 (stale) Mirror 5: 0x53795e0e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35508): Mirror 2: 0x2291f66 (stale) Mirror 5: 0x53795e0e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35508: skipped 000131 1781693513.916309 trunc from 0x035508 to 0x02c4a3 (0x9064 bytes) 000133 1781693513.925327 mapread 0x01d460 thru 0x02182a (0x43cb bytes) 000134 1781693513.930682 mapwrite 0x01cb20 thru 0x02af7e (0xe45f bytes) 000135 1781693513.950033 trunc from 0x02c4a4 to 0x03179c (0x52f9 bytes) 000137 1781693513.956088 mapwrite 0x0040f4 thru 0x012878 (0xe785 bytes) 000138 1781693513.978679 read 0x016a8a thru 0x01dea6 (0x741d bytes) 000141 1781693513.980060 mapread 0x010e9e thru 0x017be6 (0x6d49 bytes) 000142 1781693513.981067 mapread 0x0033ed thru 0x009601 (0x6215 bytes) 000143 1781693513.981735 mapwrite 0x00e7c8 thru 0x01230a (0x3b43 bytes) 000144 1781693513.994549 read 0x01041e thru 0x01a0c1 (0x9ca4 bytes) 000145 1781693513.996571 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3179d): Mirror 5: 0xae43ea0e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3179d): Mirror 5: 0xae43ea0e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3179d: skipped 000147 1781693514.069825 read 0x005164 thru 0x013a2f (0xe8cc bytes) 000149 1781693514.073305 trunc from 0x03179d to 0x036676 (0x4eda bytes) 000152 1781693514.079771 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36677): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36677): Mirror 5: 0x6d995d59 (stale) CRC-32 checksum value for chunk [0, 0x36677): Mirror 1: 0x73c5cc7b Mirror 6: 0x73c5cc7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36677: skipped 000153 1781693514.287328 MIRROR_RESYNC 3 mirrors 000158 1781693514.462179 mapread 0x010738 thru 0x018d23 (0x85ec bytes) 000162 1781693514.468430 trunc from 0x036677 to 0x0306e4 (0x5f92 bytes) 000163 1781693514.491949 trunc from 0x0306e5 to 0x0034f0 (0x2d1f4 bytes) 000165 1781693514.497707 write 0x009c71 thru 0x013ace (0x9e5e bytes) truncating to largest ever: 0x3b431 000166 1781693514.498823 trunc from 0x013acf to 0x03b430 (0x27962 bytes) 000167 1781693514.503237 mapwrite 0x01633a thru 0x0191e3 (0x2eaa bytes) 000170 1781693514.521182 trunc from 0x03b431 to 0x0334ec (0x7f44 bytes) 000171 1781693514.525572 read 0x02b227 thru 0x0334ec (0x82c6 bytes) 000175 1781693514.529441 mapwrite 0x03c92a thru 0x03ffff (0x36d6 bytes) truncating to largest ever: 0x3d5f5 000176 1781693514.548992 trunc from 0x040000 to 0x03d5f4 (0x2a0b bytes) 000177 1781693514.554442 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d5f5): Mirror 6: 0x7da02a96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d5f5): Mirror 6: 0x7da02a96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d5f5: skipped 000178 1781693514.633671 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d5f5): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d5f5): Mirror 6: 0x7da02a96 (stale) CRC-32 checksum value for chunk [0, 0x3d5f5): Mirror 1: 0xb1042190 Mirror 7: 0xb1042190 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d5f5: skipped 000180 1781693514.874161 write 0x003bff thru 0x0092eb (0x56ed bytes) 000181 1781693514.895268 read 0x028e41 thru 0x032d96 (0x9f56 bytes) 000183 1781693514.898475 trunc from 0x03d5f5 to 0x01c62e (0x20fc6 bytes) 000185 1781693514.908975 mapread 0x018f13 thru 0x01c62e (0x371c bytes) 000186 1781693514.914979 trunc from 0x01c62f to 0x005707 (0x16f27 bytes) 000188 1781693514.921563 MIRROR_RESYNC 3 mirrors 000189 1781693515.119010 trunc from 0x005708 to 0x02b682 (0x25f7b bytes) 000190 1781693515.137844 trunc from 0x02b683 to 0x034067 (0x89e5 bytes) 000191 1781693515.143074 mapread 0x01ddb0 thru 0x02ba79 (0xdcca bytes) 000192 1781693515.151594 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34068): Mirror 7: 0x90689fab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34068): Mirror 7: 0x90689fab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34068: skipped 000193 1781693515.223160 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34068): Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34068): Mirror 7: 0x90689fab (stale) CRC-32 checksum value for chunk [0, 0x34068): Mirror 1: 0x90689fab Mirror 8: 0x90689fab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34068: skipped 000195 1781693515.441552 read 0x007adf thru 0x013432 (0xb954 bytes) 000196 1781693515.443970 trunc from 0x034068 to 0x01ddeb (0x1627c bytes) 000197 1781693515.464548 mapwrite 0x03275c thru 0x033bfe (0x14a3 bytes) 000199 1781693515.486831 mapwrite 0x002603 thru 0x010953 (0xe351 bytes) 000200 1781693515.506269 trunc from 0x033bff to 0x00592e (0x2e2d0 bytes) 000201 1781693515.511228 read 0x0034bf thru 0x003e52 (0x994 bytes) 000202 1781693515.513072 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x592f): Mirror 8: 0x807c1f92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x592f): Mirror 8: 0x807c1f92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x592f: skipped 000203 1781693515.580924 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x592f): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x592f): Mirror 8: 0x807c1f92 (stale) CRC-32 checksum value for chunk [0, 0x592f): Mirror 1: 0x55e3c854 Mirror 9: 0x55e3c854 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x592f: skipped 000206 1781693515.793886 write 0x029a18 thru 0x03514b (0xb734 bytes) 000209 1781693515.818159 mapwrite 0x00548b thru 0x01017b (0xacf1 bytes) 000210 1781693515.846177 trunc from 0x03514c to 0x01fa9e (0x156ad bytes) 000211 1781693515.853682 write 0x009b11 thru 0x00ec25 (0x5115 bytes) 000215 1781693515.855714 mapread 0x00a067 thru 0x00b154 (0x10ee bytes) 000216 1781693515.856428 trunc from 0x01fa9f to 0x01d566 (0x2538 bytes) 000217 1781693515.860836 trunc from 0x01d567 to 0x00e0f3 (0xf473 bytes) 000218 1781693515.865117 read 0x00dd13 thru 0x00e0f3 (0x3e1 bytes) 000219 1781693515.865775 read 0x008bbc thru 0x00e0f3 (0x5538 bytes) 000221 1781693515.866822 trunc from 0x00e0f4 to 0x01457d (0x648a bytes) 000224 1781693515.872127 read 0x001181 thru 0x00ccdd (0xbb5d bytes) 000225 1781693515.872788 mapread 0x0012f0 thru 0x00f4ed (0xe1fe bytes) 000227 1781693515.877312 read 0x00553c thru 0x010e52 (0xb917 bytes) 000228 1781693515.877936 read 0x0041b1 thru 0x0117ff (0xd64f bytes) 000229 1781693515.878583 mapread 0x0074bf thru 0x0087e2 (0x1324 bytes) 000232 1781693515.882257 MIRROR_RESYNC 3 mirrors 000234 1781693516.176156 trunc from 0x01457e to 0x0382ae (0x23d31 bytes) 000236 1781693516.196246 mapwrite 0x000d24 thru 0x00480a (0x3ae7 bytes) 000238 1781693516.216870 read 0x02a6c7 thru 0x02f4a7 (0x4de1 bytes) 000240 1781693516.220109 mapwrite 0x0055ad thru 0x013303 (0xdd57 bytes) 000243 1781693516.239111 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x382af): Mirror 9: 0xf8737af8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x382af): Mirror 9: 0xf8737af8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x382af: skipped 000244 1781693516.313683 MIRROR_RESYNC 2 mirrors 000248 1781693516.473486 mapread 0x025bf1 thru 0x02d957 (0x7d67 bytes) 000249 1781693516.480789 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) 000251 1781693516.514692 mapread 0x0296ec thru 0x02cba9 (0x34be bytes) 000252 1781693516.519878 trunc from 0x0382af to 0x03233b (0x5f73 bytes) 000253 1781693516.531437 MIRROR_EXTEND to 2 mirrors 000255 1781693516.689432 write 0x000202 thru 0x006951 (0x6750 bytes) 000256 1781693516.711271 mapread 0x018028 thru 0x024d28 (0xcd01 bytes) 000257 1781693516.721596 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3233c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3233c): Mirror 2: 0xfc4257e2 (stale) CRC-32 checksum value for chunk [0, 0x3233c): Mirror 1: 0x997a4b1b Mirror 3: 0x997a4b1b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3233c: skipped 000258 1781693516.941146 read 0x000699 thru 0x0026aa (0x2012 bytes) 000259 1781693516.942789 trunc from 0x03233c to 0x028cf7 (0x9644 bytes) 000260 1781693516.965837 write 0x01eca0 thru 0x02c8af (0xdc10 bytes) 000265 1781693516.969550 trunc from 0x02c8b0 to 0x01090c (0x1bfa3 bytes) 000269 1781693516.976124 mapwrite 0x02f549 thru 0x030a4a (0x1502 bytes) 000270 1781693516.995210 read 0x02f73f thru 0x030a4a (0x130c bytes) 000271 1781693516.995675 mapwrite 0x02273c thru 0x02ada2 (0x8667 bytes) 000272 1781693517.011738 mapwrite 0x01f2dd thru 0x02a213 (0xaf37 bytes) 000273 1781693517.026413 trunc from 0x030a4b to 0x012288 (0x1e7c2 bytes) 000275 1781693517.031281 read 0x00964b thru 0x012288 (0x8c3e bytes) 000276 1781693517.031750 read 0x0085c2 thru 0x010dec (0x882b bytes) 000279 1781693517.032961 mapread 0x00dd30 thru 0x012288 (0x4559 bytes) 000280 1781693517.033653 write 0x03047a thru 0x0390fb (0x8c82 bytes) 000281 1781693517.034576 write 0x02bf32 thru 0x0352df (0x93ae bytes) 000283 1781693517.037997 write 0x01c7a7 thru 0x024bcb (0x8425 bytes) 000285 1781693517.039147 write 0x01c7c9 thru 0x023a9c (0x72d4 bytes) 000286 1781693517.039859 read 0x028fb5 thru 0x037192 (0xe1de bytes) 000288 1781693517.040690 write 0x0045e3 thru 0x01431d (0xfd3b bytes) 000291 1781693517.043751 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x390fc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x390fc): Mirror 2: 0xaf62c922 (stale) Mirror 3: 0xe0ef8c7c (stale) CRC-32 checksum value for chunk [0, 0x390fc): Mirror 1: 0x8eb8d330 Mirror 4: 0x8eb8d330 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x390fc: skipped 000292 1781693517.267783 write 0x022c7a thru 0x031961 (0xece8 bytes) 000296 1781693517.292288 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x390fc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x390fc): Mirror 2: 0xaf62c922 (stale) Mirror 3: 0xe0ef8c7c (stale) Mirror 4: 0x8eb8d330 (stale) CRC-32 checksum value for chunk [0, 0x390fc): Mirror 1: 0xded68795 Mirror 5: 0xded68795 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x390fc: skipped 000300 1781693517.529141 trunc from 0x0390fc to 0x03c8c4 (0x37c9 bytes) 000301 1781693517.554971 mapread 0x01e3c5 thru 0x021317 (0x2f53 bytes) 000302 1781693517.561724 MIRROR_RESYNC 5 mirrors 000303 1781693517.800821 mapwrite 0x02440c thru 0x030d7d (0xc972 bytes) 000304 1781693517.853431 write 0x019ede thru 0x023715 (0x9838 bytes) 000305 1781693517.856021 mapwrite 0x014fb4 thru 0x01b69d (0x66ea bytes) 000306 1781693517.871742 mapwrite 0x0327dd thru 0x03f594 (0xcdb8 bytes) 000307 1781693517.898746 mapread 0x022830 thru 0x0272fe (0x4acf bytes) 000310 1781693517.900384 write 0x0302e1 thru 0x03dc0c (0xd92c bytes) 000311 1781693517.901385 mapwrite 0x015e4b thru 0x0208c4 (0xaa7a bytes) 000314 1781693517.918560 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f595): Mirror 2: 0x11235cc8 (stale) Mirror 3: 0x11235cc8 (stale) Mirror 4: 0x11235cc8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f595): Mirror 2: 0x11235cc8 (stale) Mirror 3: 0x11235cc8 (stale) Mirror 4: 0x11235cc8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f595: skipped 000315 1781693518.016758 mapwrite 0x00347c thru 0x006d07 (0x388c bytes) 000318 1781693518.041215 mapread 0x02aa05 thru 0x02c584 (0x1b80 bytes) 000319 1781693518.046825 mapwrite 0x017eb0 thru 0x0251e6 (0xd337 bytes) 000321 1781693518.076246 trunc from 0x03f595 to 0x0178d9 (0x27cbb bytes) 000324 1781693518.085254 read 0x00bcc6 thru 0x0151e2 (0x951d bytes) 000326 1781693518.086620 mapread 0x008a39 thru 0x0178bd (0xee85 bytes) 000327 1781693518.088045 trunc from 0x0178da to 0x01c785 (0x4eac bytes) 000328 1781693518.095157 trunc from 0x01c786 to 0x0353cc (0x18c47 bytes) 000329 1781693518.102011 mapread 0x0059fe thru 0x00b7c9 (0x5dcc bytes) 000330 1781693518.103244 write 0x00f8c4 thru 0x01316c (0x38a9 bytes) 000331 1781693518.104583 trunc from 0x0353cd to 0x03bbb0 (0x67e4 bytes) 000334 1781693518.112721 write 0x018cde thru 0x01babe (0x2de1 bytes) 000338 1781693518.119474 read 0x014c8d thru 0x016070 (0x13e4 bytes) 000339 1781693518.120165 read 0x02cda6 thru 0x034441 (0x769c bytes) 000341 1781693518.128295 MIRROR_RESYNC 4 mirrors 000345 1781693518.409832 mapread 0x016ca4 thru 0x0210e5 (0xa442 bytes) 000346 1781693518.420555 write 0x01b080 thru 0x02a495 (0xf416 bytes) 000347 1781693518.450368 write 0x02a01b thru 0x02ae4b (0xe31 bytes) 000348 1781693518.451227 write 0x024291 thru 0x02a82b (0x659b bytes) 000349 1781693518.452894 trunc from 0x03bbb1 to 0x027061 (0x14b4f bytes) 000353 1781693518.467811 read 0x0157ec thru 0x022b70 (0xd385 bytes) 000354 1781693518.472677 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27062): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27062): Mirror 2: 0x11876367 (stale) Mirror 3: 0x11876367 (stale) Mirror 4: 0x11876367 (stale) CRC-32 checksum value for chunk [0, 0x27062): Mirror 1: 0x4b1046e0 Mirror 5: 0x4b1046e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27062: skipped 000357 1781693518.776419 mapread 0x011911 thru 0x013dfe (0x24ee bytes) 000359 1781693518.789693 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27062): Mirror 2: 0x11876367 (stale) Mirror 3: 0x11876367 (stale) Mirror 4: 0x11876367 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27062): Mirror 2: 0x11876367 (stale) Mirror 3: 0x11876367 (stale) Mirror 4: 0x11876367 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27062: skipped 000361 1781693518.904425 mapread 0x006216 thru 0x01010c (0x9ef7 bytes) 000362 1781693518.913130 mapwrite 0x005e61 thru 0x012d7b (0xcf1b bytes) 000363 1781693518.966413 trunc from 0x027062 to 0x02a036 (0x2fd5 bytes) 000364 1781693518.985220 read 0x00ba1d thru 0x017713 (0xbcf7 bytes) 000367 1781693518.987907 trunc from 0x02a037 to 0x038b34 (0xeafe bytes) 000368 1781693518.999437 MIRROR_RESYNC 4 mirrors 000370 1781693519.309523 mapwrite 0x030b27 thru 0x030c4b (0x125 bytes) 000371 1781693519.354184 mapwrite 0x02aa53 thru 0x0313f7 (0x69a5 bytes) 000372 1781693519.371703 read 0x02c951 thru 0x038a71 (0xc121 bytes) 000374 1781693519.375782 read 0x002d4c thru 0x00f11d (0xc3d2 bytes) 000376 1781693519.379592 mapread 0x009db3 thru 0x00fb15 (0x5d63 bytes) 000377 1781693519.380304 write 0x017b68 thru 0x027777 (0xfc10 bytes) 000380 1781693519.382059 write 0x0082c1 thru 0x00e588 (0x62c8 bytes) 000382 1781693519.383391 write 0x00fd26 thru 0x01eb6a (0xee45 bytes) 000383 1781693519.384580 mapwrite 0x0320e4 thru 0x032f54 (0xe71 bytes) 000385 1781693519.401066 trunc from 0x038b35 to 0x001766 (0x373ce bytes) 000387 1781693519.408448 mapread 0x00054c thru 0x001766 (0x121b bytes) 000388 1781693519.409257 mapread 0x000250 thru 0x001766 (0x1517 bytes) 000389 1781693519.410102 mapwrite 0x03eaab thru 0x03ffff (0x1555 bytes) 000390 1781693519.432295 mapwrite 0x03dc50 thru 0x03ffff (0x23b0 bytes) 000392 1781693519.447403 write 0x02a342 thru 0x030f69 (0x6c28 bytes) 000394 1781693519.453782 MIRROR_RESYNC 4 mirrors 000395 1781693519.712992 write 0x01e645 thru 0x025a42 (0x73fe bytes) 000397 1781693519.738037 trunc from 0x040000 to 0x0382c7 (0x7d38 bytes) 000398 1781693519.750978 mapread 0x020cb6 thru 0x0306d2 (0xfa1d bytes) 000399 1781693519.759296 read 0x019ebf thru 0x0204a9 (0x65eb bytes) 000400 1781693519.762868 mapread 0x008ca9 thru 0x00db67 (0x4ebf bytes) 000402 1781693519.768134 write 0x0258c6 thru 0x026ec5 (0x1600 bytes) 000403 1781693519.769206 mapread 0x02195c thru 0x0288d1 (0x6f76 bytes) 000404 1781693519.770333 read 0x004eec thru 0x00a969 (0x5a7e bytes) 000407 1781693519.772171 mapread 0x0150f0 thru 0x021287 (0xc198 bytes) 000408 1781693519.776771 trunc from 0x0382c8 to 0x01571d (0x22baa bytes) 000411 1781693519.784635 write 0x031604 thru 0x036312 (0x4d0f bytes) 000412 1781693519.786014 trunc from 0x036313 to 0x011b61 (0x247b1 bytes) 000413 1781693519.793450 write 0x01078a thru 0x019e11 (0x9688 bytes) 000415 1781693519.795813 read 0x004cd8 thru 0x0146c5 (0xf9ee bytes) 000417 1781693519.797444 mapwrite 0x0151ae thru 0x017128 (0x1f7b bytes) 000423 1781693519.819339 read 0x00f622 thru 0x01550c (0x5eeb bytes) 000424 1781693519.820192 write 0x038ccb thru 0x03f2e0 (0x6616 bytes) 000425 1781693519.821658 write 0x03dbfc thru 0x03ffff (0x2404 bytes) 000427 1781693519.825592 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc1d6d401 (stale) Mirror 4: 0xc1d6d401 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc1d6d401 (stale) Mirror 4: 0xc1d6d401 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000430 1781693519.932554 MIRROR_RESYNC 3 mirrors 000432 1781693520.125825 mapread 0x03f346 thru 0x03ffff (0xcba bytes) 000436 1781693520.128585 mapread 0x0145ec thru 0x017b36 (0x354b bytes) 000439 1781693520.133577 mapread 0x02c5a8 thru 0x032093 (0x5aec bytes) 000440 1781693520.136562 trunc from 0x040000 to 0x0334d3 (0xcb2c bytes) 000442 1781693520.154921 mapread 0x02de5d thru 0x0334d3 (0x5677 bytes) 000443 1781693520.160218 MIRROR_RESYNC 3 mirrors 000444 1781693520.337025 mapwrite 0x0219d2 thru 0x02bb82 (0xa1b1 bytes) 000445 1781693520.388268 trunc from 0x0334d4 to 0x003665 (0x2fe6e bytes) 000446 1781693520.398430 trunc from 0x003666 to 0x0351fa (0x31b95 bytes) 000447 1781693520.403316 trunc from 0x0351fb to 0x00ca81 (0x28779 bytes) 000449 1781693520.408090 read 0x0050ef thru 0x00ca81 (0x7993 bytes) 000450 1781693520.411008 read 0x001c75 thru 0x003657 (0x19e3 bytes) 000451 1781693520.413774 mapwrite 0x0036d1 thru 0x00fee1 (0xc811 bytes) 000454 1781693520.436363 write 0x037e39 thru 0x03afc9 (0x3191 bytes) 000457 1781693520.438326 mapwrite 0x03fd41 thru 0x03ffff (0x2bf bytes) 000458 1781693520.458646 read 0x016d4c thru 0x018c20 (0x1ed5 bytes) 000459 1781693520.459165 trunc from 0x040000 to 0x0369e0 (0x961f bytes) 000461 1781693520.464316 mapread 0x0003fd thru 0x006b2c (0x6730 bytes) 000464 1781693520.467373 MIRROR_RESYNC 3 mirrors 000465 1781693520.654861 read 0x027cb6 thru 0x02b079 (0x33c4 bytes) 000468 1781693520.657668 mapwrite 0x02c5c0 thru 0x0365fa (0xa03b bytes) 000469 1781693520.711843 MIRROR_RESYNC 3 mirrors truncating to largest ever: 0x3fe15 000474 1781693520.909774 trunc from 0x0369e1 to 0x03fe14 (0x9434 bytes) 000475 1781693520.935285 mapread 0x00c622 thru 0x01967e (0xd05d bytes) 000479 1781693520.944817 trunc from 0x03fe15 to 0x03703d (0x8dd7 bytes) 000480 1781693520.950069 mapread 0x01f4dd thru 0x02e751 (0xf275 bytes) 000482 1781693520.955853 read 0x02bf5b thru 0x02c49b (0x541 bytes) 000483 1781693520.956540 mapwrite 0x007d24 thru 0x013d21 (0xbffe bytes) 000484 1781693520.972276 mapwrite 0x026cc1 thru 0x03405b (0xd39b bytes) 000486 1781693520.990573 mapwrite 0x0112a4 thru 0x01b895 (0xa5f2 bytes) 000487 1781693521.005968 write 0x01ab96 thru 0x0279d5 (0xce40 bytes) 000492 1781693521.009396 write 0x01501c thru 0x01ebb6 (0x9b9b bytes) 000494 1781693521.010790 trunc from 0x03703e to 0x01c5d7 (0x1aa66 bytes) 000495 1781693521.016827 write 0x008e6f thru 0x00978d (0x91f bytes) 000496 1781693521.017641 write 0x01290c thru 0x020c3b (0xe330 bytes) 000497 1781693521.018783 write 0x01eb41 thru 0x02782d (0x8ced bytes) 000500 1781693521.020938 write 0x03fd1b thru 0x03ffff (0x2e5 bytes) 000504 1781693521.023443 read 0x024782 thru 0x026b1d (0x239c bytes) 000505 1781693521.026146 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdc09fe2f (stale) Mirror 4: 0xdc09fe2f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x824ce8b0 Mirror 5: 0x824ce8b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000506 1781693521.266639 trunc from 0x040000 to 0x0231fd (0x1ce02 bytes) 000508 1781693521.293579 read 0x01a9dc thru 0x0231fd (0x8822 bytes) 000510 1781693521.297331 write 0x012aa3 thru 0x01d527 (0xaa85 bytes) 000512 1781693521.301543 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x231fe): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x231fe): Mirror 3: 0x9861aa9a (stale) Mirror 4: 0x9861aa9a (stale) Mirror 5: 0x7047538c (stale) CRC-32 checksum value for chunk [0, 0x231fe): Mirror 1: 0x724cb0eb Mirror 6: 0x724cb0eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x231fe: skipped 000514 1781693521.533758 trunc from 0x0231fe to 0x031b05 (0xe908 bytes) 000515 1781693521.562913 read 0x01190c thru 0x015cfc (0x43f1 bytes) 000516 1781693521.565542 trunc from 0x031b06 to 0x029cea (0x7e1b bytes) 000518 1781693521.571157 trunc from 0x029ceb to 0x03a526 (0x1083c bytes) 000520 1781693521.577721 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a527): Mirror 3: 0x9001f4ec (stale) Mirror 4: 0x9001f4ec (stale) Mirror 5: 0xa1601e2f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a527): Mirror 3: 0x9001f4ec (stale) Mirror 4: 0x9001f4ec (stale) Mirror 5: 0xa1601e2f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a527: skipped 000521 1781693521.673526 write 0x03b413 thru 0x03d5f3 (0x21e1 bytes) 000524 1781693521.676493 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d5f4): Mirror 3: 0xce3ff93c (stale) Mirror 5: 0x8f51791b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d5f4): Mirror 3: 0xce3ff93c (stale) Mirror 5: 0x8f51791b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d5f4: skipped 000525 1781693521.767137 mapread 0x01917c thru 0x01b1a4 (0x2029 bytes) 000526 1781693521.774605 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d5f4): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d5f4): Mirror 3: 0xce3ff93c (stale) Mirror 5: 0x8f51791b (stale) CRC-32 checksum value for chunk [0, 0x3d5f4): Mirror 1: 0x65c70e85 Mirror 6: 0x65c70e85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d5f4: skipped 000527 1781693522.014123 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d5f4): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d5f4): Mirror 3: 0xce3ff93c (stale) Mirror 5: 0x8f51791b (stale) CRC-32 checksum value for chunk [0, 0x3d5f4): Mirror 1: 0x65c70e85 Mirror 6: 0x65c70e85 Mirror 7: 0x65c70e85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d5f4: skipped 000528 1781693522.259036 trunc from 0x03d5f4 to 0x005317 (0x382dc bytes) 000529 1781693522.283392 write 0x030072 thru 0x03e7dd (0xe76c bytes) 000532 1781693522.285754 write 0x00249a thru 0x005b52 (0x36b9 bytes) 000533 1781693522.288928 mapread 0x03df3b thru 0x03e7dd (0x8a3 bytes) 000534 1781693522.290113 write 0x00b608 thru 0x00cbf7 (0x15f0 bytes) 000535 1781693522.292966 trunc from 0x03e7de to 0x01ddc5 (0x20a18 bytes) 000536 1781693522.298056 read 0x0192e8 thru 0x01ddc5 (0x4ade bytes) 000537 1781693522.300479 mapwrite 0x007aff thru 0x00c958 (0x4e5a bytes) 000540 1781693522.320369 read 0x0128c4 thru 0x017b5b (0x5298 bytes) 000541 1781693522.323288 trunc from 0x01ddc6 to 0x006859 (0x1756c bytes) 000542 1781693522.327647 mapread 0x000707 thru 0x006859 (0x6153 bytes) 000543 1781693522.329807 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x685a): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x685a): Mirror 3: 0x830674fa (stale) Mirror 5: 0x830674fa (stale) Mirror 6: 0x830674fa (stale) Mirror 7: 0x830674fa (stale) CRC-32 checksum value for chunk [0, 0x685a): Mirror 1: 0xb84ab101 Mirror 8: 0xb84ab101 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x685a: skipped 000545 1781693522.541350 read 0x005c56 thru 0x006859 (0xc04 bytes) 000549 1781693522.543702 mapread 0x0002e2 thru 0x002e06 (0x2b25 bytes) 000552 1781693522.549587 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x685a): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x685a): Mirror 3: 0x830674fa (stale) Mirror 5: 0x830674fa (stale) Mirror 6: 0x830674fa (stale) Mirror 7: 0x830674fa (stale) CRC-32 checksum value for chunk [0, 0x685a): Mirror 1: 0xb84ab101 Mirror 8: 0xb84ab101 Mirror 9: 0xb84ab101 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x685a: skipped 000553 1781693522.756561 write 0x00d722 thru 0x013a9c (0x637b bytes) 000555 1781693522.777245 trunc from 0x013a9d to 0x03f1ef (0x2b753 bytes) 000557 1781693522.789315 mapwrite 0x02bde0 thru 0x03428e (0x84af bytes) 000558 1781693522.811514 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f1f0): Mirror 3: 0x69063f11 (stale) Mirror 5: 0xe1401e57 (stale) Mirror 6: 0xe027dabe (stale) Mirror 7: 0xe027dabe (stale) Mirror 8: 0x7834e67 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f1f0): Mirror 3: 0x69063f11 (stale) Mirror 5: 0xe1401e57 (stale) Mirror 6: 0xe027dabe (stale) Mirror 7: 0xe027dabe (stale) Mirror 8: 0x7834e67 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f1f0: skipped 000560 1781693522.958101 write 0x02678f thru 0x028be4 (0x2456 bytes) 000561 1781693522.961307 trunc from 0x03f1f0 to 0x0296d5 (0x15b1a bytes) 000562 1781693522.965833 trunc from 0x0296d6 to 0x01b0da (0xe5fb bytes) 000563 1781693522.970464 mapread 0x00ab64 thru 0x01466f (0x9b0c bytes) 000565 1781693522.977128 mapwrite 0x0317cb thru 0x03377f (0x1fb5 bytes) 000567 1781693522.999562 write 0x017b7f thru 0x018fc8 (0x144a bytes) 000570 1781693523.003571 read 0x01b4ab thru 0x01fedf (0x4a35 bytes) 000571 1781693523.006539 mapwrite 0x0066a8 thru 0x00d1df (0x6b38 bytes) 000573 1781693523.025160 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33780): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33780): Mirror 3: 0x7bb8eec5 (stale) Mirror 5: 0x9a12e3e9 (stale) Mirror 6: 0xd66c926 (stale) Mirror 7: 0xd66c926 (stale) Mirror 8: 0x94a1b803 (stale) CRC-32 checksum value for chunk [0, 0x33780): Mirror 1: 0x8bbf352d Mirror 9: 0x8bbf352d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33780: skipped 000575 1781693523.262752 mapread 0x033392 thru 0x03377f (0x3ee bytes) 000576 1781693523.271500 mapread 0x02e4dc thru 0x03377f (0x52a4 bytes) 000577 1781693523.283307 MIRROR_RESYNC 7 mirrors 000579 1781693523.575754 trunc from 0x033780 to 0x017af4 (0x1bc8b bytes) 000580 1781693523.602121 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x17af5): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17af5): Mirror 3: 0xcf5748ae (stale) Mirror 5: 0xcf5748ae (stale) Mirror 6: 0xcf5748ae (stale) Mirror 7: 0xcf5748ae (stale) Mirror 8: 0xcf5748ae (stale) Mirror 9: 0xcf5748ae (stale) CRC-32 checksum value for chunk [0, 0x17af5): Mirror 1: 0xcf5748ae Mirror 10: 0xcf5748ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17af5: skipped 000581 1781693523.848968 trunc from 0x017af5 to 0x02a27d (0x12789 bytes) 000584 1781693523.891115 write 0x02e97e thru 0x03cdf5 (0xe478 bytes) 000586 1781693523.892644 mapwrite 0x02c27a thru 0x02eb97 (0x291e bytes) 000587 1781693523.916606 mapread 0x014e74 thru 0x024913 (0xfaa0 bytes) 000589 1781693523.923926 mapread 0x01c9a1 thru 0x024c0a (0x826a bytes) 000590 1781693523.924754 write 0x02fe06 thru 0x033b61 (0x3d5c bytes) 000593 1781693523.926235 mapread 0x014005 thru 0x018639 (0x4635 bytes) 000594 1781693523.926936 read 0x02b3b6 thru 0x03493f (0x958a bytes) 000595 1781693523.929328 read 0x013cf3 thru 0x02066b (0xc979 bytes) 000596 1781693523.930097 mapwrite 0x037d77 thru 0x03ffff (0x8289 bytes) 000598 1781693523.958259 write 0x0032a3 thru 0x006b20 (0x387e bytes) 000600 1781693523.960144 mapwrite 0x0086fa thru 0x015ec1 (0xd7c8 bytes) 000601 1781693523.979484 trunc from 0x040000 to 0x033804 (0xc7fb bytes) 000602 1781693523.985515 mapread 0x0129ef thru 0x017512 (0x4b24 bytes) 000603 1781693523.988589 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33805): Mirror 5: 0x3129db51 (stale) Mirror 6: 0x3129db51 (stale) Mirror 7: 0x3129db51 (stale) Mirror 8: 0x3129db51 (stale) Mirror 9: 0x3129db51 (stale) Mirror 10: 0x996fd863 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33805): Mirror 5: 0x3129db51 (stale) Mirror 6: 0x3129db51 (stale) Mirror 7: 0x3129db51 (stale) Mirror 8: 0x3129db51 (stale) Mirror 9: 0x3129db51 (stale) Mirror 10: 0x996fd863 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33805: skipped 000604 1781693524.121935 mapwrite 0x03f043 thru 0x03ffff (0xfbd bytes) 000605 1781693524.140340 mapwrite 0x02bf1b thru 0x03799f (0xba85 bytes) 000606 1781693524.163540 mapwrite 0x00623a thru 0x00ffbd (0x9d84 bytes) 000607 1781693524.182590 mapread 0x028ae0 thru 0x02da90 (0x4fb1 bytes) 000608 1781693524.183710 mapwrite 0x007ab6 thru 0x012c41 (0xb18c bytes) 000609 1781693524.202470 read 0x011051 thru 0x019a5a (0x8a0a bytes) 000611 1781693524.203406 write 0x03c94c thru 0x03d24a (0x8ff bytes) 000615 1781693524.205247 mapwrite 0x007a54 thru 0x007e90 (0x43d bytes) 000616 1781693524.218838 write 0x00b067 thru 0x00df45 (0x2edf bytes) 000618 1781693524.219984 read 0x01407f thru 0x01e37a (0xa2fc bytes) 000619 1781693524.223229 trunc from 0x040000 to 0x02b803 (0x147fc bytes) 000620 1781693524.228709 trunc from 0x02b804 to 0x01d493 (0xe370 bytes) 000622 1781693524.234959 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d494): Mirror 5: 0x5b71267d (stale) Mirror 7: 0x5b71267d (stale) Mirror 8: 0x5b71267d (stale) Mirror 9: 0x5b71267d (stale) Mirror 10: 0xafcfe044 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d494): Mirror 5: 0x5b71267d (stale) Mirror 7: 0x5b71267d (stale) Mirror 8: 0x5b71267d (stale) Mirror 9: 0x5b71267d (stale) Mirror 10: 0xafcfe044 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d494: skipped 000623 1781693524.343185 mapwrite 0x018a1f thru 0x0207cd (0x7daf bytes) 000624 1781693524.369108 read 0x00987f thru 0x014651 (0xadd3 bytes) 000625 1781693524.372295 mapwrite 0x023e69 thru 0x02cb0a (0x8ca2 bytes) 000626 1781693524.400151 mapwrite 0x00e097 thru 0x01da0c (0xf976 bytes) 000627 1781693524.419834 mapwrite 0x0064a7 thru 0x0078cb (0x1425 bytes) 000628 1781693524.435327 write 0x00e173 thru 0x0160f2 (0x7f80 bytes) 000631 1781693524.436970 read 0x0011e8 thru 0x00ea1a (0xd833 bytes) 000632 1781693524.437481 trunc from 0x02cb0b to 0x01b7e5 (0x11325 bytes) 000634 1781693524.444917 write 0x02a372 thru 0x038d16 (0xe9a5 bytes) 000635 1781693524.446155 mapwrite 0x03b0ea thru 0x03ffff (0x4f16 bytes) 000637 1781693524.469767 read 0x037c0e thru 0x03d733 (0x5b26 bytes) 000638 1781693524.470365 mapwrite 0x0114a1 thru 0x01b2d2 (0x9e32 bytes) 000640 1781693524.490314 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xee6ec416 (stale) Mirror 7: 0xee6ec416 (stale) Mirror 8: 0xee6ec416 (stale) Mirror 9: 0xee6ec416 (stale) Mirror 10: 0x985ba866 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x501dfa06 Mirror 11: 0x501dfa06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000644 1781693524.732877 read 0x026656 thru 0x02d73e (0x70e9 bytes) 000647 1781693524.738890 mapwrite 0x03232a thru 0x036dcb (0x4aa2 bytes) 000648 1781693524.790833 mapread 0x00ca56 thru 0x010725 (0x3cd0 bytes) 000649 1781693524.794115 read 0x01cd5c thru 0x0221f2 (0x5497 bytes) 000650 1781693524.797283 mapread 0x03833f thru 0x03ffff (0x7cc1 bytes) 000651 1781693524.799537 MIRROR_RESYNC 7 mirrors 000652 1781693525.085332 trunc from 0x040000 to 0x00eadc (0x31523 bytes) 000653 1781693525.109852 read 0x00b547 thru 0x00eadc (0x3596 bytes) 000655 1781693525.112710 write 0x021680 thru 0x0230d6 (0x1a57 bytes) 000656 1781693525.113477 mapread 0x01a54e thru 0x01f59b (0x504e bytes) 000657 1781693525.119068 mapread 0x01be7e thru 0x0230d6 (0x7259 bytes) 000663 1781693525.122250 mapread 0x003c01 thru 0x00b117 (0x7517 bytes) 000664 1781693525.125495 mapwrite 0x00c501 thru 0x00e539 (0x2039 bytes) 000665 1781693525.140845 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x230d7): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x230d7): Mirror 5: 0x38d32cf0 (stale) Mirror 7: 0x38d32cf0 (stale) Mirror 8: 0x38d32cf0 (stale) Mirror 9: 0x38d32cf0 (stale) Mirror 10: 0x38d32cf0 (stale) Mirror 11: 0x38d32cf0 (stale) CRC-32 checksum value for chunk [0, 0x230d7): Mirror 1: 0x7c3ba52a Mirror 12: 0x7c3ba52a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x230d7: skipped 000672 1781693525.368832 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x230d7): Mirror 5: 0x38d32cf0 (stale) Mirror 8: 0x38d32cf0 (stale) Mirror 9: 0x38d32cf0 (stale) Mirror 10: 0x38d32cf0 (stale) Mirror 11: 0x38d32cf0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x230d7): Mirror 5: 0x38d32cf0 (stale) Mirror 8: 0x38d32cf0 (stale) Mirror 9: 0x38d32cf0 (stale) Mirror 10: 0x38d32cf0 (stale) Mirror 11: 0x38d32cf0 (stale) CRC-32 checksum value for chunk [0, 0x230d7): Mirror 1: 0x7c3ba52a Mirror 12: 0x7c3ba52a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x230d7: skipped 000673 1781693525.558391 read 0x0043e8 thru 0x008709 (0x4322 bytes) 000675 1781693525.568131 MIRROR_RESYNC 7 mirrors 000677 1781693525.834432 read 0x00b25c thru 0x00c896 (0x163b bytes) 000678 1781693525.836889 read 0x01aa94 thru 0x022f45 (0x84b2 bytes) 000679 1781693525.842404 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) 000680 1781693525.968832 read 0x01a5fa thru 0x0230d6 (0x8add bytes) 000682 1781693525.973165 trunc from 0x0230d7 to 0x008f7e (0x1a158 bytes) 000683 1781693525.999837 read 0x0022e5 thru 0x005326 (0x3042 bytes) 000684 1781693526.003738 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x8f7f): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8f7f): Mirror 5: 0xc824ef57 (stale) Mirror 8: 0xc824ef57 (stale) Mirror 10: 0xc824ef57 (stale) Mirror 11: 0xc824ef57 (stale) Mirror 12: 0xc824ef57 (stale) CRC-32 checksum value for chunk [0, 0x8f7f): Mirror 1: 0xc824ef57 Mirror 13: 0xc824ef57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8f7f: skipped 000686 1781693526.243256 mapread 0x008f0d thru 0x008f7e (0x72 bytes) 000687 1781693526.251974 trunc from 0x008f7f to 0x01b10a (0x1218c bytes) 000688 1781693526.276236 write 0x001e51 thru 0x001f70 (0x120 bytes) 000689 1781693526.278408 read 0x00fad2 thru 0x017e3c (0x836b bytes) 000690 1781693526.283128 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1b10b): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b10b): Mirror 5: 0x742462ec (stale) Mirror 8: 0x742462ec (stale) Mirror 10: 0x742462ec (stale) Mirror 11: 0x742462ec (stale) Mirror 12: 0x742462ec (stale) Mirror 13: 0x5f7c31ed (stale) CRC-32 checksum value for chunk [0, 0x1b10b): Mirror 1: 0xc9e3f4de Mirror 14: 0xc9e3f4de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b10b: skipped 000691 1781693526.523419 trunc from 0x01b10b to 0x0286e8 (0xd5de bytes) 000692 1781693526.555602 trunc from 0x0286e9 to 0x013c1f (0x14ac9 bytes) 000693 1781693526.563528 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13c20): Mirror 8: 0xad5ad03d (stale) Mirror 10: 0xad5ad03d (stale) Mirror 11: 0xad5ad03d (stale) Mirror 12: 0xad5ad03d (stale) Mirror 13: 0x73439eb6 (stale) Mirror 14: 0xa84e78f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13c20): Mirror 8: 0xad5ad03d (stale) Mirror 10: 0xad5ad03d (stale) Mirror 11: 0xad5ad03d (stale) Mirror 12: 0xad5ad03d (stale) Mirror 13: 0x73439eb6 (stale) Mirror 14: 0xa84e78f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13c20: skipped 000694 1781693526.681191 write 0x01f666 thru 0x0232c8 (0x3c63 bytes) 000695 1781693526.682154 mapread 0x0168d6 thru 0x01dd48 (0x7473 bytes) 000696 1781693526.689972 MIRROR_RESYNC 7 mirrors 000699 1781693527.029774 write 0x0356d7 thru 0x03ffff (0xa929 bytes) 000700 1781693527.047032 write 0x01b85a thru 0x020ee1 (0x5688 bytes) 000702 1781693527.052144 MIRROR_RESYNC 7 mirrors 000703 1781693527.327237 mapread 0x0192ee thru 0x028cff (0xfa12 bytes) 000704 1781693527.335521 MIRROR_EXTEND to 8 mirrors 000707 1781693527.548703 mapwrite 0x017891 thru 0x01ca6f (0x51df bytes) 000708 1781693527.623501 mapread 0x00ee7b thru 0x018712 (0x9898 bytes) 000710 1781693527.629405 write 0x03d818 thru 0x03ffff (0x27e8 bytes) 000711 1781693527.633196 write 0x01a853 thru 0x029471 (0xec1f bytes) 000712 1781693527.637536 mapwrite 0x03c248 thru 0x03ffff (0x3db8 bytes) 000713 1781693527.668843 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x575a6672 (stale) Mirror 10: 0x575a6672 (stale) Mirror 11: 0x575a6672 (stale) Mirror 12: 0x575a6672 (stale) Mirror 13: 0x575a6672 (stale) Mirror 14: 0x575a6672 (stale) Mirror 15: 0x575a6672 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd3145948 Mirror 16: 0xd3145948 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000714 1781693527.976875 mapread 0x02fc9f thru 0x03df15 (0xe277 bytes) 000715 1781693527.989393 trunc from 0x040000 to 0x0312f8 (0xed07 bytes) 000717 1781693528.039044 trunc from 0x0312f9 to 0x00f697 (0x21c61 bytes) 000719 1781693528.054396 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xf698): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf698): Mirror 8: 0x343fbf26 (stale) Mirror 10: 0x343fbf26 (stale) Mirror 11: 0x343fbf26 (stale) Mirror 12: 0x343fbf26 (stale) Mirror 13: 0x343fbf26 (stale) Mirror 14: 0x343fbf26 (stale) Mirror 15: 0x343fbf26 (stale) Mirror 16: 0x343fbf26 (stale) CRC-32 checksum value for chunk [0, 0xf698): Mirror 1: 0x343fbf26 Mirror 17: 0x343fbf26 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf698: skipped 000720 1781693528.362314 read 0x00dedb thru 0x00f697 (0x17bd bytes) 000721 1781693528.366691 mapread 0x009e2b thru 0x00f697 (0x586d bytes) 000723 1781693528.380587 read 0x00a9ef thru 0x00f697 (0x4ca9 bytes) 000724 1781693528.383543 mapread 0x0022cf thru 0x006a53 (0x4785 bytes) 000725 1781693528.393615 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf698): Mirror 8: 0x343fbf26 (stale) Mirror 10: 0x343fbf26 (stale) Mirror 11: 0x343fbf26 (stale) Mirror 12: 0x343fbf26 (stale) Mirror 13: 0x343fbf26 (stale) Mirror 15: 0x343fbf26 (stale) Mirror 16: 0x343fbf26 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf698): Mirror 8: 0x343fbf26 (stale) Mirror 10: 0x343fbf26 (stale) Mirror 11: 0x343fbf26 (stale) Mirror 12: 0x343fbf26 (stale) Mirror 13: 0x343fbf26 (stale) Mirror 15: 0x343fbf26 (stale) Mirror 16: 0x343fbf26 (stale) CRC-32 checksum value for chunk [0, 0xf698): Mirror 1: 0x343fbf26 Mirror 17: 0x343fbf26 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf698: skipped 000726 1781693528.666386 MIRROR_RESYNC 9 mirrors 000728 1781693529.126173 read 0x00f1b4 thru 0x00f697 (0x4e4 bytes) 000730 1781693529.130943 MIRROR_RESYNC 9 mirrors 000731 1781693529.320049 mapwrite 0x0144a6 thru 0x016b35 (0x2690 bytes) 000732 1781693529.357051 mapwrite 0x02ca19 thru 0x02d858 (0xe40 bytes) 000735 1781693529.375938 write 0x031978 thru 0x035a0c (0x4095 bytes) 000738 1781693529.377484 mapread 0x01573c thru 0x01fbbe (0xa483 bytes) 000739 1781693529.381455 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x35a0d): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a0d): Mirror 8: 0x8f6ef44d (stale) Mirror 10: 0x8f6ef44d (stale) Mirror 11: 0x8f6ef44d (stale) Mirror 12: 0x8f6ef44d (stale) Mirror 13: 0x8f6ef44d (stale) Mirror 15: 0x8f6ef44d (stale) Mirror 16: 0x8f6ef44d (stale) Mirror 17: 0x8f6ef44d (stale) CRC-32 checksum value for chunk [0, 0x35a0d): Mirror 1: 0x96963cf4 Mirror 18: 0x96963cf4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a0d: skipped 000740 1781693529.649871 read 0x00a5b7 thru 0x017534 (0xcf7e bytes) 000741 1781693529.653386 write 0x00f852 thru 0x0185de (0x8d8d bytes) 000744 1781693529.675968 write 0x01875a thru 0x019e8e (0x1735 bytes) 000746 1781693529.678732 write 0x00c8bd thru 0x018cc7 (0xc40b bytes) 000747 1781693529.680930 mapread 0x02152e thru 0x025314 (0x3de7 bytes) 000748 1781693529.686760 mapread 0x00b770 thru 0x00e5d5 (0x2e66 bytes) 000751 1781693529.690469 read 0x0143c4 thru 0x01da0c (0x9649 bytes) 000752 1781693529.693274 mapwrite 0x00c5ca thru 0x015ef8 (0x992f bytes) 000758 1781693529.710828 mapread 0x002c75 thru 0x00527d (0x2609 bytes) 000759 1781693529.711524 write 0x0245cd thru 0x02a9ed (0x6421 bytes) 000760 1781693529.712404 write 0x00b8b5 thru 0x019b47 (0xe293 bytes) 000762 1781693529.713649 mapwrite 0x037d4f thru 0x03ffff (0x82b1 bytes) 000763 1781693529.740811 trunc from 0x040000 to 0x0307b8 (0xf847 bytes) 000764 1781693529.745129 read 0x003bb3 thru 0x00efca (0xb418 bytes) 000765 1781693529.745660 write 0x00b8ea thru 0x015b2b (0xa242 bytes) 000767 1781693529.746974 read 0x00bf25 thru 0x00dd27 (0x1e03 bytes) 000768 1781693529.747437 mapwrite 0x00c95f thru 0x01b5fa (0xec9c bytes) 000769 1781693529.762906 mapwrite 0x0083bd thru 0x00df5c (0x5ba0 bytes) 000773 1781693529.777322 mapwrite 0x037344 thru 0x0377c5 (0x482 bytes) 000774 1781693529.796085 trunc from 0x0377c6 to 0x012f0c (0x248b9 bytes) 000777 1781693529.801703 read 0x000a90 thru 0x010701 (0xfc72 bytes) 000779 1781693529.802594 trunc from 0x012f0d to 0x01f302 (0xc3f6 bytes) 000783 1781693529.807885 mapwrite 0x005008 thru 0x010252 (0xb24b bytes) 000785 1781693529.825615 MIRROR_RESYNC 10 mirrors 000786 1781693530.154283 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) 000789 1781693530.259321 trunc from 0x01f303 to 0x02eaa8 (0xf7a6 bytes) 000791 1781693530.280047 mapread 0x008a19 thru 0x00c73e (0x3d26 bytes) 000792 1781693530.285213 mapread 0x018376 thru 0x01e519 (0x61a4 bytes) 000795 1781693530.288838 read 0x02242a thru 0x02da54 (0xb62b bytes) 000796 1781693530.292929 MIRROR_RESYNC 9 mirrors 000797 1781693530.663057 read 0x01d36f thru 0x02990b (0xc59d bytes) 000798 1781693530.667513 mapwrite 0x02e0e1 thru 0x03d000 (0xef20 bytes) 000800 1781693530.747052 mapread 0x02495a thru 0x02804c (0x36f3 bytes) 000803 1781693530.753608 mapwrite 0x03a32e thru 0x03ffff (0x5cd2 bytes) 000804 1781693530.784649 MIRROR_RESYNC 9 mirrors 000805 1781693531.169528 MIRROR_RESYNC 9 mirrors 000807 1781693531.328721 write 0x00ad78 thru 0x00f913 (0x4b9c bytes) 000808 1781693531.355485 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x6560c6ef (stale) Mirror 11: 0x6560c6ef (stale) Mirror 12: 0x6560c6ef (stale) Mirror 13: 0x6560c6ef (stale) Mirror 15: 0x6560c6ef (stale) Mirror 16: 0x6560c6ef (stale) Mirror 17: 0x6560c6ef (stale) Mirror 18: 0x6560c6ef (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcf265ea0 Mirror 19: 0xcf265ea0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000813 1781693531.692270 mapread 0x03bd62 thru 0x03ffff (0x429e bytes) 000814 1781693531.701216 trunc from 0x040000 to 0x020cd0 (0x1f32f bytes) 000815 1781693531.733469 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x20cd1): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20cd1): Mirror 8: 0xcd0c7d13 (stale) Mirror 11: 0xcd0c7d13 (stale) Mirror 12: 0xcd0c7d13 (stale) Mirror 13: 0xcd0c7d13 (stale) Mirror 15: 0xcd0c7d13 (stale) Mirror 16: 0xcd0c7d13 (stale) Mirror 17: 0xcd0c7d13 (stale) Mirror 18: 0xcd0c7d13 (stale) Mirror 19: 0x9526823a (stale) CRC-32 checksum value for chunk [0, 0x20cd1): Mirror 1: 0x9526823a Mirror 20: 0x9526823a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20cd1: skipped 000816 1781693532.000776 read 0x01279d thru 0x018edb (0x673f bytes) 000818 1781693532.007042 mapwrite 0x00f635 thru 0x01a864 (0xb230 bytes) 000819 1781693532.065515 trunc from 0x020cd1 to 0x03fb7d (0x1eead bytes) 000820 1781693532.071182 trunc from 0x03fb7e to 0x001d53 (0x3de2a bytes) 000821 1781693532.075771 mapwrite 0x01e471 thru 0x027dd2 (0x9962 bytes) 000827 1781693532.102761 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27dd3): Mirror 11: 0xbf864bf6 (stale) Mirror 12: 0xbf864bf6 (stale) Mirror 13: 0xbf864bf6 (stale) Mirror 15: 0xbf864bf6 (stale) Mirror 16: 0xbf864bf6 (stale) Mirror 17: 0xbf864bf6 (stale) Mirror 18: 0xbf864bf6 (stale) Mirror 19: 0xf2b84349 (stale) Mirror 20: 0xf2b84349 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27dd3): Mirror 11: 0xbf864bf6 (stale) Mirror 12: 0xbf864bf6 (stale) Mirror 13: 0xbf864bf6 (stale) Mirror 15: 0xbf864bf6 (stale) Mirror 16: 0xbf864bf6 (stale) Mirror 17: 0xbf864bf6 (stale) Mirror 18: 0xbf864bf6 (stale) Mirror 19: 0xf2b84349 (stale) Mirror 20: 0xf2b84349 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27dd3: skipped 000830 1781693532.242588 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x27dd3): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27dd3): Mirror 11: 0xbf864bf6 (stale) Mirror 12: 0xbf864bf6 (stale) Mirror 13: 0xbf864bf6 (stale) Mirror 15: 0xbf864bf6 (stale) Mirror 16: 0xbf864bf6 (stale) Mirror 17: 0xbf864bf6 (stale) Mirror 18: 0xbf864bf6 (stale) Mirror 19: 0xf2b84349 (stale) Mirror 20: 0xf2b84349 (stale) CRC-32 checksum value for chunk [0, 0x27dd3): Mirror 1: 0xee141d36 Mirror 21: 0xee141d36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27dd3: skipped 000833 1781693532.509183 read 0x00fd41 thru 0x0118f4 (0x1bb4 bytes) 000836 1781693532.516263 write 0x015620 thru 0x01fb5d (0xa53e bytes) 000838 1781693532.539608 trunc from 0x027dd3 to 0x0114f0 (0x168e2 bytes) 000839 1781693532.545899 mapwrite 0x02c67d thru 0x039a99 (0xd41d bytes) 000845 1781693532.576627 trunc from 0x039a9a to 0x00c050 (0x2da49 bytes) 000846 1781693532.581767 mapwrite 0x00ad14 thru 0x00b29f (0x58c bytes) 000848 1781693532.596967 write 0x01adaa thru 0x02a061 (0xf2b8 bytes) 000849 1781693532.598250 write 0x0358dc thru 0x03ffff (0xa724 bytes) 000851 1781693532.599572 write 0x02f83a thru 0x0344cc (0x4c93 bytes) 000852 1781693532.602723 write 0x021ee6 thru 0x02a995 (0x8ab0 bytes) 000853 1781693532.605000 MIRROR_RESYNC 11 mirrors 000856 1781693532.972445 mapwrite 0x00ef47 thru 0x01b343 (0xc3fd bytes) 000857 1781693533.028724 read 0x003d1d thru 0x0046a8 (0x98c bytes) 000858 1781693533.031115 trunc from 0x040000 to 0x01d549 (0x22ab6 bytes) 000860 1781693533.042510 trunc from 0x01d54a to 0x02a039 (0xcaf0 bytes) 000861 1781693533.046812 write 0x02ab37 thru 0x02fc5f (0x5129 bytes) 000862 1781693533.049052 mapread 0x029563 thru 0x02fc5f (0x66fd bytes) 000863 1781693533.051878 write 0x021d8a thru 0x02e3e2 (0xc659 bytes) 000867 1781693533.055783 mapread 0x00caca thru 0x00dc3a (0x1171 bytes) 000868 1781693533.056463 read 0x014625 thru 0x019753 (0x512f bytes) 000869 1781693533.058445 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fc60): Mirror 11: 0x2c6440b9 (stale) Mirror 12: 0x2c6440b9 (stale) Mirror 13: 0x2c6440b9 (stale) Mirror 15: 0x2c6440b9 (stale) Mirror 16: 0x2c6440b9 (stale) Mirror 17: 0x2c6440b9 (stale) Mirror 18: 0x2c6440b9 (stale) Mirror 19: 0x2c6440b9 (stale) Mirror 21: 0x2c6440b9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fc60): Mirror 11: 0x2c6440b9 (stale) Mirror 12: 0x2c6440b9 (stale) Mirror 13: 0x2c6440b9 (stale) Mirror 15: 0x2c6440b9 (stale) Mirror 16: 0x2c6440b9 (stale) Mirror 17: 0x2c6440b9 (stale) Mirror 18: 0x2c6440b9 (stale) Mirror 19: 0x2c6440b9 (stale) Mirror 21: 0x2c6440b9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fc60: skipped 000871 1781693533.211630 trunc from 0x02fc60 to 0x034cb8 (0x5059 bytes) 000872 1781693533.215990 read 0x02a0e8 thru 0x034cb8 (0xabd1 bytes) 000873 1781693533.220423 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x34cb9): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34cb9): Mirror 11: 0xd1dfdb7b (stale) Mirror 12: 0xd1dfdb7b (stale) Mirror 13: 0xd1dfdb7b (stale) Mirror 15: 0xd1dfdb7b (stale) Mirror 16: 0xd1dfdb7b (stale) Mirror 17: 0xd1dfdb7b (stale) Mirror 18: 0xd1dfdb7b (stale) Mirror 19: 0xd1dfdb7b (stale) Mirror 21: 0xd1dfdb7b (stale) CRC-32 checksum value for chunk [0, 0x34cb9): Mirror 1: 0x15383db1 Mirror 22: 0x15383db1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34cb9: skipped 000874 1781693533.479271 write 0x03a31c thru 0x03ffff (0x5ce4 bytes) 000875 1781693533.500278 trunc from 0x040000 to 0x0041b5 (0x3be4a bytes) 000876 1781693533.510502 mapwrite 0x02c309 thru 0x0385c1 (0xc2b9 bytes) 000877 1781693533.541110 mapwrite 0x00c8b8 thru 0x014ee7 (0x8630 bytes) 000878 1781693533.558576 mapwrite 0x032ff2 thru 0x03b182 (0x8191 bytes) 000879 1781693533.578459 mapwrite 0x037383 thru 0x038378 (0xff6 bytes) 000880 1781693533.588609 mapwrite 0x030c26 thru 0x034505 (0x38e0 bytes) 000882 1781693533.601850 mapread 0x000726 thru 0x005ff9 (0x58d4 bytes) 000883 1781693533.605127 write 0x00d800 thru 0x014b28 (0x7329 bytes) 000885 1781693533.606447 mapwrite 0x027b3d thru 0x02fec1 (0x8385 bytes) 000886 1781693533.621253 read 0x037d48 thru 0x03b182 (0x343b bytes) 000888 1781693533.622117 write 0x03b365 thru 0x03ffff (0x4c9b bytes) 000889 1781693533.623144 write 0x02aab4 thru 0x034fb8 (0xa505 bytes) 000890 1781693533.624065 trunc from 0x040000 to 0x037407 (0x8bf8 bytes) 000891 1781693533.628984 write 0x03da81 thru 0x03efcb (0x154b bytes) 000892 1781693533.631200 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3efcc): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3efcc): Mirror 11: 0xf854ad8a (stale) Mirror 12: 0xf854ad8a (stale) Mirror 13: 0xf854ad8a (stale) Mirror 15: 0xf854ad8a (stale) Mirror 16: 0xf854ad8a (stale) Mirror 17: 0xf854ad8a (stale) Mirror 18: 0xf854ad8a (stale) Mirror 19: 0xf854ad8a (stale) Mirror 21: 0xf854ad8a (stale) Mirror 22: 0x7c3221eb (stale) CRC-32 checksum value for chunk [0, 0x3efcc): Mirror 1: 0x4d7ff9c0 Mirror 23: 0x4d7ff9c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3efcc: skipped 000893 1781693533.919134 read 0x02323a thru 0x029944 (0x670b bytes) 000894 1781693533.923501 mapwrite 0x00771b thru 0x0154e2 (0xddc8 bytes) 000895 1781693533.994238 write 0x02bfd1 thru 0x032afa (0x6b2a bytes) 000897 1781693533.998148 mapwrite 0x0048d9 thru 0x0115ed (0xcd15 bytes) 000898 1781693534.013802 mapwrite 0x01334e thru 0x017206 (0x3eb9 bytes) 000900 1781693534.029153 read 0x034447 thru 0x037b3c (0x36f6 bytes) 000901 1781693534.033400 read 0x01d6ef thru 0x01e373 (0xc85 bytes) 000902 1781693534.035432 MIRROR_RESYNC 12 mirrors 000905 1781693534.452419 trunc from 0x03efcc to 0x006de5 (0x381e6 bytes) 000909 1781693534.483018 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6de6): Mirror 12: 0xf1908670 (stale) Mirror 13: 0xf1908670 (stale) Mirror 15: 0xf1908670 (stale) Mirror 16: 0xf1908670 (stale) Mirror 17: 0xf1908670 (stale) Mirror 18: 0xf1908670 (stale) Mirror 19: 0xf1908670 (stale) Mirror 21: 0xf1908670 (stale) Mirror 22: 0xf1908670 (stale) Mirror 23: 0xf1908670 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6de6): Mirror 12: 0xf1908670 (stale) Mirror 13: 0xf1908670 (stale) Mirror 15: 0xf1908670 (stale) Mirror 16: 0xf1908670 (stale) Mirror 17: 0xf1908670 (stale) Mirror 18: 0xf1908670 (stale) Mirror 19: 0xf1908670 (stale) Mirror 21: 0xf1908670 (stale) Mirror 22: 0xf1908670 (stale) Mirror 23: 0xf1908670 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6de6: skipped 000915 1781693534.611262 trunc from 0x006de6 to 0x007a0b (0xc26 bytes) 000918 1781693534.616509 trunc from 0x007a0c to 0x0014e1 (0x652a bytes) 000919 1781693534.620611 trunc from 0x0014e2 to 0x033897 (0x323b6 bytes) 000920 1781693534.626819 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x33898): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33898): Mirror 12: 0xecc60ed8 (stale) Mirror 13: 0xecc60ed8 (stale) Mirror 15: 0xecc60ed8 (stale) Mirror 16: 0xecc60ed8 (stale) Mirror 17: 0xecc60ed8 (stale) Mirror 18: 0xecc60ed8 (stale) Mirror 19: 0xecc60ed8 (stale) Mirror 21: 0xecc60ed8 (stale) Mirror 22: 0xecc60ed8 (stale) Mirror 23: 0xecc60ed8 (stale) CRC-32 checksum value for chunk [0, 0x33898): Mirror 1: 0x3f4bf2a5 Mirror 24: 0x3f4bf2a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33898: skipped 000922 1781693534.881615 write 0x00a3db thru 0x016d1e (0xc944 bytes) 000924 1781693534.914994 read 0x026f20 thru 0x02b406 (0x44e7 bytes) 000927 1781693534.920817 write 0x004bf5 thru 0x00a096 (0x54a2 bytes) 000929 1781693534.924281 mapread 0x02533c thru 0x027d65 (0x2a2a bytes) 000930 1781693534.929495 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33898): Mirror 12: 0xecc60ed8 (stale) Mirror 13: 0xecc60ed8 (stale) Mirror 15: 0xecc60ed8 (stale) Mirror 16: 0xecc60ed8 (stale) Mirror 17: 0xecc60ed8 (stale) Mirror 18: 0xecc60ed8 (stale) Mirror 19: 0xecc60ed8 (stale) Mirror 22: 0xecc60ed8 (stale) Mirror 23: 0xecc60ed8 (stale) Mirror 24: 0x3f4bf2a5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33898): Mirror 12: 0xecc60ed8 (stale) Mirror 13: 0xecc60ed8 (stale) Mirror 15: 0xecc60ed8 (stale) Mirror 16: 0xecc60ed8 (stale) Mirror 17: 0xecc60ed8 (stale) Mirror 18: 0xecc60ed8 (stale) Mirror 19: 0xecc60ed8 (stale) Mirror 22: 0xecc60ed8 (stale) Mirror 23: 0xecc60ed8 (stale) Mirror 24: 0x3f4bf2a5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33898: skipped 000934 1781693535.116224 write 0x03813a thru 0x03901a (0xee1 bytes) 000936 1781693535.118489 read 0x004e8a thru 0x00fb70 (0xace7 bytes) 000938 1781693535.124565 mapwrite 0x02ed51 thru 0x033112 (0x43c2 bytes) 000939 1781693535.163791 mapread 0x011fee thru 0x013d2a (0x1d3d bytes) 000942 1781693535.170653 trunc from 0x03901b to 0x00bde3 (0x2d237 bytes) 000943 1781693535.188677 trunc from 0x00bde4 to 0x02f683 (0x238a0 bytes) 000944 1781693535.197682 mapread 0x013ede thru 0x01ad67 (0x6e8a bytes) 000945 1781693535.203969 write 0x01fe37 thru 0x02e96d (0xeb37 bytes) 000946 1781693535.212639 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2f684): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f684): Mirror 12: 0xe385056d (stale) Mirror 13: 0xe385056d (stale) Mirror 15: 0xe385056d (stale) Mirror 16: 0xe385056d (stale) Mirror 17: 0xe385056d (stale) Mirror 18: 0xe385056d (stale) Mirror 19: 0xe385056d (stale) Mirror 22: 0xe385056d (stale) Mirror 23: 0xe385056d (stale) Mirror 24: 0x6a69fdb8 (stale) CRC-32 checksum value for chunk [0, 0x2f684): Mirror 1: 0xc4f76ea4 Mirror 25: 0xc4f76ea4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f684: skipped 000947 1781693535.583084 mapwrite 0x012d58 thru 0x01f09d (0xc346 bytes) 000950 1781693535.653979 MIRROR_RESYNC 12 mirrors 000953 1781693536.067878 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x5b0:0x0]: Invalid argument (22) 000954 1781693536.221591 read 0x01c102 thru 0x022c3c (0x6b3b bytes) 000958 1781693536.224976 trunc from 0x02f684 to 0x02a7b0 (0x4ed3 bytes) 000962 1781693536.251794 mapwrite 0x02f5f8 thru 0x037bba (0x85c3 bytes) 000964 1781693536.277685 write 0x01b042 thru 0x01f6eb (0x46aa bytes) 000967 1781693536.282163 write 0x020f35 thru 0x029189 (0x8255 bytes) 000968 1781693536.285702 read 0x008739 thru 0x0096ba (0xf82 bytes) 000970 1781693536.289583 mapwrite 0x037e9f thru 0x03e380 (0x64e2 bytes) 000971 1781693536.310997 read 0x02cd5c thru 0x03be37 (0xf0dc bytes) 000972 1781693536.313332 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3e381): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e381): Mirror 12: 0x7798e7a (stale) Mirror 13: 0x7798e7a (stale) Mirror 16: 0x7798e7a (stale) Mirror 17: 0x7798e7a (stale) Mirror 18: 0x7798e7a (stale) Mirror 19: 0x7798e7a (stale) Mirror 22: 0x7798e7a (stale) Mirror 23: 0x7798e7a (stale) Mirror 24: 0x7798e7a (stale) Mirror 25: 0x7798e7a (stale) CRC-32 checksum value for chunk [0, 0x3e381): Mirror 1: 0xbd690242 Mirror 26: 0xbd690242 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e381: skipped 000974 1781693536.604193 read 0x02e8d8 thru 0x03ae0b (0xc534 bytes) 000975 1781693536.607766 trunc from 0x03e381 to 0x01a1a3 (0x241dd bytes) 000976 1781693536.635003 write 0x014f50 thru 0x01a386 (0x5437 bytes) 000978 1781693536.638486 write 0x00cb5b thru 0x00e474 (0x191a bytes) 000979 1781693536.641394 mapwrite 0x028a37 thru 0x03861e (0xfbe8 bytes) 000980 1781693536.669130 trunc from 0x03861f to 0x0108d9 (0x27d45 bytes) 000983 1781693536.674566 mapwrite 0x015b23 thru 0x01f547 (0x9a25 bytes) 000988 1781693536.696976 read 0x00eefa thru 0x012444 (0x354b bytes) 000991 1781693536.698233 read 0x01968b thru 0x01c992 (0x3308 bytes) 000993 1781693536.699015 mapwrite 0x0129da thru 0x01e5ff (0xbc26 bytes) 000994 1781693536.714211 read 0x0105de thru 0x012679 (0x209c bytes) 000995 1781693536.714665 write 0x01f443 thru 0x01ff6f (0xb2d bytes) 000996 1781693536.715331 mapread 0x0195a2 thru 0x01ff6f (0x69ce bytes) 000998 1781693536.716428 trunc from 0x01ff70 to 0x03bb2a (0x1bbbb bytes) All operations completed A-OK!