== sanity-flr test 70a: flr mode fsx test ================ 21:24:40 (1781227480) Seed set to 7482 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0xe51a 000004 1781227482.312428 trunc from 00000000 to 0x00e519 (0xe51a bytes) 000007 1781227482.331445 mapwrite 0x02c716 thru 0x02cb16 (0x401 bytes) 000008 1781227482.390104 read 0x00142e thru 0x00dab7 (0xc68a bytes) 000010 1781227482.404502 mapwrite 0x00f659 thru 0x01ca84 (0xd42c bytes) truncating to largest ever: 0x1297e 000012 1781227482.488007 trunc from 0x02cb17 to 0x01297d (0x1a199 bytes) 000013 1781227482.506072 write 0x03f1e3 thru 0x03ffff (0xe1d bytes) truncating to largest ever: 0x3578d 000014 1781227482.508261 trunc from 0x040000 to 0x03578c (0xa873 bytes) 000015 1781227482.522959 trunc from 0x03578d to 0x0355b4 (0x1d8 bytes) 000017 1781227482.540688 mapread 0x0086df thru 0x009976 (0x1298 bytes) 000019 1781227482.543428 trunc from 0x0355b5 to 0x0041dc (0x313d8 bytes) 000020 1781227482.584022 write 0x02188e thru 0x02308d (0x1800 bytes) 000021 1781227482.585889 mapwrite 0x01c350 thru 0x01dad6 (0x1787 bytes) 000026 1781227482.689690 mapwrite 0x03de32 thru 0x03ffff (0x21ce bytes) 000027 1781227482.803757 read 0x02f391 thru 0x0383b8 (0x9028 bytes) 000028 1781227482.817505 trunc from 0x040000 to 0x022304 (0x1dcfb bytes) 000032 1781227482.840007 write 0x00db43 thru 0x0128eb (0x4da9 bytes) 000034 1781227482.842428 mapwrite 0x002b39 thru 0x00347b (0x943 bytes) 000038 1781227482.884164 mapread 0x00f511 thru 0x01e56b (0xf05b bytes) 000039 1781227482.886142 mapread 0x017603 thru 0x01aa8b (0x3489 bytes) 000040 1781227482.888154 mapwrite 0x02d508 thru 0x0323d1 (0x4eca bytes) 000041 1781227482.982041 mapread 0x00f5d8 thru 0x018052 (0x8a7b bytes) 000042 1781227482.984708 trunc from 0x0323d2 to 0x022ea3 (0xf52e bytes) 000045 1781227483.009930 read 0x00273c thru 0x005b7b (0x3440 bytes) 000046 1781227483.011269 mapread 0x01724b thru 0x022ea3 (0xbc59 bytes) 000047 1781227483.013481 write 0x03f093 thru 0x03ffff (0xf6d bytes) 000048 1781227483.014767 trunc from 0x040000 to 0x0330dc (0xcf23 bytes) 000050 1781227483.035701 read 0x031865 thru 0x0330dc (0x1878 bytes) 000051 1781227483.046199 trunc from 0x0330dd to 0x00db5d (0x2557f bytes) 000052 1781227483.064708 trunc from 0x00db5e to 0x00ac42 (0x2f1b bytes) 000053 1781227483.085149 write 0x031a3d thru 0x0393a0 (0x7964 bytes) 000060 1781227483.092760 mapread 0x023371 thru 0x02cb6a (0x97fa bytes) 000063 1781227483.140883 read 0x0092d2 thru 0x00e88a (0x55b9 bytes) 000064 1781227483.148409 mapread 0x022756 thru 0x0252d8 (0x2b83 bytes) truncating to largest ever: 0x3764c 000065 1781227483.149327 trunc from 0x0393a1 to 0x03764b (0x1d55 bytes) 000068 1781227483.167857 mapread 0x004584 thru 0x010f29 (0xc9a6 bytes) 000069 1781227483.169917 mapread 0x01a324 thru 0x01e4a6 (0x4183 bytes) 000071 1781227483.173404 read 0x023bd8 thru 0x0297db (0x5c04 bytes) 000072 1781227483.174199 trunc from 0x03764c to 0x001409 (0x36242 bytes) 000074 1781227483.196811 mapread 0x000606 thru 0x001409 (0xe04 bytes) 000076 1781227483.199524 trunc from 0x00140a to 0x00e7d6 (0xd3cd bytes) 000077 1781227483.220673 mapread 0x005466 thru 0x00e7d6 (0x9371 bytes) 000078 1781227483.229457 mapwrite 0x027852 thru 0x02b6e6 (0x3e95 bytes) 000080 1781227483.299752 mapwrite 0x0302d8 thru 0x038528 (0x8251 bytes) 000082 1781227483.377773 MIRROR_EXTEND to 2 mirrors 000085 1781227483.877004 trunc from 0x038529 to 0x0293c6 (0xf162 bytes) 000086 1781227483.997466 read 0x00d369 thru 0x00d99d (0x635 bytes) 000088 1781227484.004783 read 0x017016 thru 0x0267c5 (0xf7b0 bytes) 000089 1781227484.017888 write 0x006ca2 thru 0x013c8c (0xcfeb bytes) 000090 1781227484.020120 write 0x030989 thru 0x03b374 (0xa9ec bytes) 000091 1781227484.022083 read 0x0139cc thru 0x01b546 (0x7b7b bytes) 000092 1781227484.023469 mapread 0x02058f thru 0x027c54 (0x76c6 bytes) 000094 1781227484.026196 mapwrite 0x03ca82 thru 0x03ffff (0x357e bytes) 000095 1781227484.110331 mapread 0x015c66 thru 0x01d616 (0x79b1 bytes) 000096 1781227484.111523 write 0x021152 thru 0x028815 (0x76c4 bytes) 000102 1781227484.119865 read 0x018895 thru 0x01bcba (0x3426 bytes) 000103 1781227484.120754 read 0x00f65d thru 0x017dd1 (0x8775 bytes) 000104 1781227484.122134 mapread 0x02fc80 thru 0x03002d (0x3ae bytes) 000105 1781227484.123943 write 0x001ca3 thru 0x010cec (0xf04a bytes) 000109 1781227484.135394 read 0x00b123 thru 0x018958 (0xd836 bytes) 000110 1781227484.136083 trunc from 0x040000 to 0x01670b (0x298f4 bytes) 000112 1781227484.174930 read 0x00e24b thru 0x01670b (0x84c1 bytes) 000113 1781227484.176147 mapwrite 0x0156b5 thru 0x01c4be (0x6e0a bytes) 000114 1781227484.262890 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000118 1781227484.462470 mapread 0x008a85 thru 0x01225a (0x97d6 bytes) 000120 1781227484.497049 write 0x02f372 thru 0x036597 (0x7226 bytes) 000122 1781227484.511184 MIRROR_EXTEND to 2 mirrors 000123 1781227485.085514 trunc from 0x036598 to 0x02d74f (0x8e48 bytes) 000125 1781227485.189748 mapread 0x0142e5 thru 0x019811 (0x552d bytes) 000127 1781227485.208369 mapwrite 0x03da73 thru 0x03ffff (0x258d bytes) 000128 1781227485.278917 write 0x033687 thru 0x03aa51 (0x73cb bytes) 000130 1781227485.289366 write 0x0160fb thru 0x01ed21 (0x8c27 bytes) 000131 1781227485.293050 trunc from 0x040000 to 0x02f428 (0x10bd7 bytes) 000132 1781227485.320145 mapread 0x011e13 thru 0x01b17e (0x936c bytes) 000133 1781227485.322024 mapwrite 0x00a192 thru 0x00d722 (0x3591 bytes) truncating to largest ever: 0x3a480 000135 1781227485.384929 trunc from 0x02f429 to 0x03a47f (0xb057 bytes) 000137 1781227485.411811 read 0x02cd99 thru 0x02f635 (0x289d bytes) 000138 1781227485.413400 mapwrite 0x031025 thru 0x03bed7 (0xaeb3 bytes) 000139 1781227485.533117 read 0x02b8b0 thru 0x03a943 (0xf094 bytes) 000140 1781227485.534839 mapread 0x0381e0 thru 0x03bed7 (0x3cf8 bytes) 000142 1781227485.547792 MIRROR_RESYNC 2 mirrors 000144 1781227486.135959 write 0x00e9b1 thru 0x015bac (0x71fc bytes) 000145 1781227486.202020 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 2: 0xc2d61cef (stale) CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 1: 0x96307340 Mirror 3: 0x96307340 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bed8: skipped 000146 1781227486.875037 mapread 0x0190b5 thru 0x01d52e (0x447a bytes) 000147 1781227486.912896 mapwrite 0x010ef1 thru 0x0147d4 (0x38e4 bytes) 000148 1781227487.110812 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 2: 0xc2d61cef (stale) Mirror 3: 0x96307340 (stale) CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 1: 0x911b626a Mirror 4: 0x911b626a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bed8: skipped 000151 1781227488.122899 write 0x02b749 thru 0x02f2eb (0x3ba3 bytes) 000152 1781227488.206002 write 0x034c7d thru 0x03ffff (0xb383 bytes) 000153 1781227488.214829 read 0x00fa12 thru 0x017d25 (0x8314 bytes) 000154 1781227488.222751 mapread 0x00402e thru 0x013d91 (0xfd64 bytes) 000155 1781227488.231021 read 0x019074 thru 0x01a4de (0x146b bytes) 000156 1781227488.239599 read 0x013d9a thru 0x015f4a (0x21b1 bytes) 000157 1781227488.240393 trunc from 0x040000 to 0x005313 (0x3acec bytes) 000158 1781227488.269419 MIRROR_RESYNC 4 mirrors 000159 1781227489.039955 trunc from 0x005314 to 0x023e65 (0x1eb52 bytes) 000161 1781227489.098950 mapread 0x00179a thru 0x001820 (0x87 bytes) 000162 1781227489.106438 trunc from 0x023e66 to 0x036aa3 (0x12c3e bytes) 000163 1781227489.120354 read 0x005659 thru 0x01469b (0xf043 bytes) 000164 1781227489.128835 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36aa4): Mirror 2: 0x1acb562b (stale) Mirror 3: 0x1acb562b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36aa4): Mirror 2: 0x1acb562b (stale) Mirror 3: 0x1acb562b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36aa4: skipped 000166 1781227489.519803 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36aa4): Mirror 3: 0x1acb562b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36aa4): Mirror 3: 0x1acb562b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36aa4: skipped 000170 1781227489.936413 read 0x00367a thru 0x0119fb (0xe382 bytes) 000171 1781227489.948408 mapwrite 0x010871 thru 0x01d6e6 (0xce76 bytes) 000172 1781227490.061102 mapread 0x030f2b thru 0x036aa3 (0x5b79 bytes) 000175 1781227490.076902 trunc from 0x036aa4 to 0x00b0f0 (0x2b9b3 bytes) 000176 1781227490.100666 write 0x00673e thru 0x00c0dc (0x599f bytes) 000177 1781227490.102664 write 0x016343 thru 0x017b12 (0x17d0 bytes) 000178 1781227490.105086 write 0x022fce thru 0x0320b3 (0xf0e6 bytes) 000179 1781227490.106790 mapread 0x0216c1 thru 0x0271d8 (0x5b18 bytes) 000180 1781227490.144726 mapwrite 0x020500 thru 0x02ac6d (0xa76e bytes) 000181 1781227490.248350 read 0x00fe83 thru 0x01d328 (0xd4a6 bytes) 000183 1781227490.261885 mapread 0x025439 thru 0x02737e (0x1f46 bytes) 000186 1781227490.270296 write 0x0029bc thru 0x0104ef (0xdb34 bytes) 000187 1781227490.272626 trunc from 0x0320b4 to 0x00311f (0x2ef94 bytes) 000189 1781227490.289797 read 0x0006eb thru 0x00311f (0x2a35 bytes) 000190 1781227490.290666 read 0x002b0a thru 0x00311f (0x616 bytes) 000191 1781227490.292349 mapwrite 0x00c3ca thru 0x012537 (0x616e bytes) 000192 1781227490.397017 read 0x000a15 thru 0x0035c2 (0x2bae bytes) 000193 1781227490.407697 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000195 1781227490.546809 write 0x022d2b thru 0x02c528 (0x97fe bytes) 000196 1781227490.549954 mapwrite 0x004960 thru 0x00da82 (0x9123 bytes) 000197 1781227490.621965 read 0x023e3c thru 0x02c528 (0x86ed bytes) 000199 1781227490.624016 read 0x02a87f thru 0x02c528 (0x1caa bytes) 000200 1781227490.625043 mapread 0x003e39 thru 0x00c96f (0x8b37 bytes) 000201 1781227490.627870 write 0x02bebe thru 0x03443b (0x857e bytes) 000202 1781227490.630366 trunc from 0x03443c to 0x00f5d5 (0x24e66 bytes) 000203 1781227490.653104 mapwrite 0x035d50 thru 0x03aca4 (0x4f55 bytes) truncating to largest ever: 0x3ddd4 000204 1781227490.789366 trunc from 0x03aca5 to 0x03ddd3 (0x312f bytes) 000212 1781227490.849841 read 0x0256fe thru 0x026d0a (0x160d bytes) 000213 1781227490.850546 write 0x00efdf thru 0x01074b (0x176d bytes) 000215 1781227490.858284 mapwrite 0x0051ee thru 0x005561 (0x374 bytes) 000216 1781227490.946115 trunc from 0x03ddd4 to 0x0258a6 (0x1852d bytes) 000217 1781227490.975780 trunc from 0x0258a7 to 0x0015d5 (0x242d1 bytes) 000220 1781227490.997884 mapread 0x000189 thru 0x000afb (0x973 bytes) 000221 1781227490.999838 mapwrite 0x00c5c0 thru 0x016247 (0x9c88 bytes) 000224 1781227491.114164 mapwrite 0x03b49d thru 0x03ffff (0x4b63 bytes) 000227 1781227491.252377 MIRROR_EXTEND to 2 mirrors 000228 1781227492.240363 trunc from 0x040000 to 0x011f74 (0x2e08b bytes) 000232 1781227492.491124 trunc from 0x011f75 to 0x02fc5b (0x1dce7 bytes) 000235 1781227492.530858 mapwrite 0x005591 thru 0x00e594 (0x9004 bytes) 000236 1781227492.612400 write 0x01ea09 thru 0x02da25 (0xf01d bytes) 000237 1781227492.626779 mapread 0x026e8a thru 0x02d230 (0x63a7 bytes) 000238 1781227492.636027 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 2: 0x759beb19 (stale) CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 1: 0xd86a83d0 Mirror 3: 0xd86a83d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fc5c: skipped 000240 1781227493.294554 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 2: 0x759beb19 (stale) CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 1: 0xd86a83d0 Mirror 3: 0xd86a83d0 Mirror 4: 0xd86a83d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fc5c: skipped 000242 1781227494.080439 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 2: 0x759beb19 (stale) CRC-32 checksum value for chunk [0, 0x2fc5c): Mirror 1: 0xd86a83d0 Mirror 3: 0xd86a83d0 Mirror 4: 0xd86a83d0 Mirror 5: 0xd86a83d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fc5c: skipped 000246 1781227494.937979 write 0x00deb1 thru 0x01711a (0x926a bytes) 000248 1781227494.998615 read 0x00ddf5 thru 0x015340 (0x754c bytes) 000249 1781227494.999635 read 0x018a70 thru 0x01da27 (0x4fb8 bytes) 000250 1781227495.009124 write 0x010858 thru 0x01ec4b (0xe3f4 bytes) 000251 1781227495.015607 MIRROR_RESYNC 5 mirrors 000252 1781227496.210514 read 0x009173 thru 0x0159ad (0xc83b bytes) 000253 1781227496.222652 MIRROR_RESYNC 5 mirrors 000254 1781227496.705781 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000259 1781227497.046801 mapwrite 0x039fb5 thru 0x03ffff (0x604b bytes) 000260 1781227497.233728 mapread 0x006ca5 thru 0x011382 (0xa6de bytes) 000261 1781227497.249451 read 0x03af9b thru 0x03ffff (0x5065 bytes) 000262 1781227497.250125 mapwrite 0x009193 thru 0x00e136 (0x4fa4 bytes) 000264 1781227497.369777 write 0x0063ed thru 0x00ad7c (0x4990 bytes) 000265 1781227497.374881 mapwrite 0x009009 thru 0x00993d (0x935 bytes) 000266 1781227497.466083 mapwrite 0x003d02 thru 0x0049ed (0xcec bytes) 000267 1781227497.616735 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x293887a6 (stale) Mirror 3: 0x293887a6 (stale) Mirror 5: 0x293887a6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbe6bb477 Mirror 6: 0xbe6bb477 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000268 1781227498.807257 mapwrite 0x00f181 thru 0x01e89b (0xf71b bytes) 000272 1781227499.104996 MIRROR_RESYNC 5 mirrors 000276 1781227500.232847 write 0x0203f6 thru 0x02f03d (0xec48 bytes) 000277 1781227500.321240 write 0x033d5d thru 0x03f55d (0xb801 bytes) 000278 1781227500.333071 trunc from 0x040000 to 0x009203 (0x36dfc bytes) 000279 1781227500.355576 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9204): Mirror 3: 0x2a5af4f3 (stale) Mirror 5: 0x2a5af4f3 (stale) Mirror 6: 0x2a5af4f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9204): Mirror 3: 0x2a5af4f3 (stale) Mirror 5: 0x2a5af4f3 (stale) Mirror 6: 0x2a5af4f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9204: skipped 000280 1781227500.650196 mapwrite 0x014b7d thru 0x022530 (0xd9b4 bytes) truncating to largest ever: 0x3e64a 000282 1781227500.758907 trunc from 0x022531 to 0x03e649 (0x1c119 bytes) 000283 1781227500.773083 write 0x00fc18 thru 0x00fd2a (0x113 bytes) 000284 1781227500.776685 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e64a): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e64a): Mirror 3: 0x7206a0f7 (stale) Mirror 5: 0x7206a0f7 (stale) Mirror 6: 0x7206a0f7 (stale) CRC-32 checksum value for chunk [0, 0x3e64a): Mirror 1: 0x904ac5e5 Mirror 7: 0x904ac5e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e64a: skipped 000285 1781227501.715317 mapwrite 0x03fb01 thru 0x03ffff (0x4ff bytes) 000287 1781227501.850149 mapwrite 0x034e85 thru 0x03a184 (0x5300 bytes) 000288 1781227501.908011 trunc from 0x040000 to 0x027c2c (0x183d3 bytes) 000289 1781227501.930825 mapread 0x021b89 thru 0x027c2c (0x60a4 bytes) 000292 1781227501.941425 trunc from 0x027c2d to 0x02d81e (0x5bf2 bytes) 000294 1781227501.963653 read 0x00e8f7 thru 0x018078 (0x9782 bytes) 000295 1781227501.974691 read 0x02b34b thru 0x02d81e (0x24d4 bytes) 000297 1781227501.990179 mapread 0x01a53f thru 0x02546f (0xaf31 bytes) 000298 1781227501.995863 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d81f): Mirror 3: 0x1e07d11d (stale) Mirror 5: 0x1e07d11d (stale) Mirror 6: 0x1e07d11d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d81f): Mirror 3: 0x1e07d11d (stale) Mirror 5: 0x1e07d11d (stale) Mirror 6: 0x1e07d11d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d81f: skipped 000299 1781227502.350685 trunc from 0x02d81f to 0x022a77 (0xada7 bytes) 000300 1781227502.368847 mapwrite 0x008122 thru 0x00c0d8 (0x3fb7 bytes) 000301 1781227502.497997 read 0x015afd thru 0x01f855 (0x9d59 bytes) 000302 1781227502.513616 read 0x016342 thru 0x01c7fe (0x64bd bytes) 000307 1781227502.534789 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x22a78): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22a78): Mirror 3: 0x6f40a9d5 (stale) Mirror 5: 0x6f40a9d5 (stale) Mirror 6: 0x6f40a9d5 (stale) CRC-32 checksum value for chunk [0, 0x22a78): Mirror 1: 0x79f007cf Mirror 7: 0x79f007cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22a78: skipped 000310 1781227503.414281 read 0x01a820 thru 0x01b877 (0x1058 bytes) 000311 1781227503.424399 mapread 0x010132 thru 0x01e3db (0xe2aa bytes) 000314 1781227503.467325 mapwrite 0x0311af thru 0x038d08 (0x7b5a bytes) 000316 1781227503.764949 read 0x0079b0 thru 0x00a8d5 (0x2f26 bytes) 000317 1781227503.774491 trunc from 0x038d09 to 0x00be0f (0x2cef9 bytes) 000320 1781227503.820445 read 0x00a23d thru 0x00be0f (0x1bd3 bytes) 000322 1781227503.824818 read 0x00214c thru 0x0039e7 (0x189c bytes) 000323 1781227503.825810 mapread 0x009f8e thru 0x00be0f (0x1e82 bytes) 000324 1781227503.832736 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xbe10): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbe10): Mirror 3: 0x5e5bfe18 (stale) Mirror 5: 0x5e5bfe18 (stale) Mirror 6: 0x5e5bfe18 (stale) Mirror 7: 0x884bbd31 (stale) CRC-32 checksum value for chunk [0, 0xbe10): Mirror 1: 0x884bbd31 Mirror 8: 0x884bbd31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbe10: skipped 000325 1781227504.690740 mapwrite 0x02128d thru 0x02d9ef (0xc763 bytes) 000326 1781227504.896953 mapread 0x017867 thru 0x01febb (0x8655 bytes) 000327 1781227504.906104 trunc from 0x02d9f0 to 0x02c493 (0x155c bytes) 000328 1781227504.926367 write 0x00f5f4 thru 0x01689a (0x72a7 bytes) 000331 1781227504.936294 mapwrite 0x0113dd thru 0x01a41f (0x9043 bytes) 000336 1781227504.979674 read 0x02bb7c thru 0x02c493 (0x918 bytes) 000337 1781227504.981644 mapread 0x020a52 thru 0x02ac8f (0xa23e bytes) 000339 1781227504.983520 write 0x001e87 thru 0x0106a3 (0xe81d bytes) 000340 1781227504.995156 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c494): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c494): Mirror 3: 0x8e926e1 (stale) Mirror 5: 0x8e926e1 (stale) Mirror 6: 0x8e926e1 (stale) Mirror 7: 0x26bb3e20 (stale) Mirror 8: 0x51d82442 (stale) CRC-32 checksum value for chunk [0, 0x2c494): Mirror 1: 0x48966ae4 Mirror 9: 0x48966ae4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c494: skipped 000343 1781227505.911599 MIRROR_RESYNC 7 mirrors 000345 1781227506.960274 mapwrite 0x01752e thru 0x017dac (0x87f bytes) 000346 1781227507.098691 trunc from 0x02c494 to 0x01bf04 (0x1058f bytes) 000347 1781227507.129843 mapwrite 0x03f674 thru 0x03ffff (0x98c bytes) 000348 1781227507.265245 read 0x0008b6 thru 0x007a8e (0x71d9 bytes) 000349 1781227507.284263 trunc from 0x040000 to 0x0012d3 (0x3ed2c bytes) 000350 1781227507.313640 mapread 0x00065f thru 0x0012d3 (0xc75 bytes) 000351 1781227507.323783 MIRROR_RESYNC 7 mirrors 000352 1781227508.427491 mapread 0x000745 thru 0x0012d3 (0xb8f bytes) 000357 1781227508.447901 mapread 0x000ea7 thru 0x0012d3 (0x42d bytes) 000358 1781227508.452677 write 0x0199b0 thru 0x0240ad (0xa6fe bytes) 000359 1781227508.567979 mapwrite 0x03b338 thru 0x03ffff (0x4cc8 bytes) 000360 1781227508.739461 write 0x03182e thru 0x0336de (0x1eb1 bytes) 000361 1781227508.756055 MIRROR_RESYNC 7 mirrors 000362 1781227509.842718 trunc from 0x040000 to 0x024827 (0x1b7d8 bytes) 000363 1781227509.964561 trunc from 0x024828 to 0x01611c (0xe70b bytes) 000364 1781227509.996832 trunc from 0x01611d to 0x025e79 (0xfd5d bytes) 000365 1781227510.023813 write 0x03a32a thru 0x03ac40 (0x917 bytes) 000367 1781227510.028427 write 0x0377fd thru 0x039afa (0x22fe bytes) 000369 1781227510.045002 trunc from 0x03ac41 to 0x03dce2 (0x30a2 bytes) truncating to largest ever: 0x3ef5c 000370 1781227510.075797 trunc from 0x03dce3 to 0x03ef5b (0x1279 bytes) 000371 1781227510.097794 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ef5c): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef5c): Mirror 3: 0xa9e7546 (stale) Mirror 5: 0xa9e7546 (stale) Mirror 6: 0xa9e7546 (stale) Mirror 7: 0xa9e7546 (stale) Mirror 8: 0xa9e7546 (stale) Mirror 9: 0xa9e7546 (stale) CRC-32 checksum value for chunk [0, 0x3ef5c): Mirror 1: 0x79f92422 Mirror 10: 0x79f92422 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef5c: skipped 000372 1781227511.045867 mapwrite 0x03d07c thru 0x03ffff (0x2f84 bytes) 000373 1781227511.283434 trunc from 0x040000 to 0x0233e0 (0x1cc1f bytes) 000375 1781227511.321830 write 0x038b19 thru 0x03ffff (0x74e7 bytes) 000378 1781227511.326056 read 0x024fdf thru 0x02700e (0x2030 bytes) 000379 1781227511.336067 mapwrite 0x02f554 thru 0x036300 (0x6dad bytes) 000380 1781227511.501416 mapread 0x00831c thru 0x009800 (0x14e5 bytes) 000381 1781227511.520742 trunc from 0x040000 to 0x01928a (0x26d75 bytes) 000382 1781227511.542128 trunc from 0x01928b to 0x033ef3 (0x1ac69 bytes) 000384 1781227511.570632 read 0x003671 thru 0x004341 (0xcd1 bytes) 000387 1781227511.572819 read 0x018222 thru 0x0190cf (0xeae bytes) 000389 1781227511.585435 read 0x00e46e thru 0x014787 (0x631a bytes) 000390 1781227511.586949 mapwrite 0x00de9d thru 0x01bf43 (0xe0a7 bytes) 000391 1781227511.647140 trunc from 0x033ef4 to 0x02bd82 (0x8171 bytes) 000392 1781227511.663644 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2bd83): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bd83): Mirror 3: 0xb0906612 (stale) Mirror 5: 0xb0906612 (stale) Mirror 6: 0xb0906612 (stale) Mirror 7: 0xb0906612 (stale) Mirror 8: 0xb0906612 (stale) Mirror 9: 0xb0906612 (stale) Mirror 10: 0xd3c65c2c (stale) CRC-32 checksum value for chunk [0, 0x2bd83): Mirror 1: 0xbb248de0 Mirror 11: 0xbb248de0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bd83: skipped 000393 1781227512.797316 mapread 0x00adea thru 0x00cbee (0x1e05 bytes) 000394 1781227512.820561 mapread 0x02431b thru 0x02bd82 (0x7a68 bytes) 000395 1781227512.831525 mapread 0x015eff thru 0x01a65f (0x4761 bytes) 000396 1781227512.847027 MIRROR_RESYNC 9 mirrors 000398 1781227514.470120 mapwrite 0x034f86 thru 0x03ffff (0xb07a bytes) 000399 1781227514.732077 trunc from 0x040000 to 0x01700e (0x28ff1 bytes) 000400 1781227514.753780 mapwrite 0x00f848 thru 0x01454c (0x4d05 bytes) 000402 1781227514.805733 mapwrite 0x00e488 thru 0x010942 (0x24bb bytes) 000404 1781227514.865666 trunc from 0x01700f to 0x0396a1 (0x22693 bytes) 000407 1781227514.888946 mapread 0x03232c thru 0x035406 (0x30db bytes) 000408 1781227514.899085 mapwrite 0x0353a5 thru 0x03a026 (0x4c82 bytes) 000409 1781227514.966867 trunc from 0x03a027 to 0x010a66 (0x295c0 bytes) 000411 1781227514.980685 mapwrite 0x00c558 thru 0x01b571 (0xf01a bytes) 000414 1781227515.048588 trunc from 0x01b572 to 0x01cf46 (0x19d5 bytes) 000415 1781227515.072838 trunc from 0x01cf47 to 0x024578 (0x7632 bytes) 000417 1781227515.102644 write 0x01dce9 thru 0x029d2b (0xc043 bytes) 000419 1781227515.112142 mapwrite 0x017b7e thru 0x0220c7 (0xa54a bytes) 000421 1781227515.158407 trunc from 0x029d2c to 0x00c730 (0x1d5fb bytes) 000423 1781227515.198088 trunc from 0x00c731 to 0x0355cf (0x28e9f bytes) 000424 1781227515.225473 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x355d0): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355d0): Mirror 3: 0x2efdae25 (stale) Mirror 5: 0x2efdae25 (stale) Mirror 6: 0x2efdae25 (stale) Mirror 7: 0x2efdae25 (stale) Mirror 8: 0x2efdae25 (stale) Mirror 9: 0x2efdae25 (stale) Mirror 10: 0x2efdae25 (stale) Mirror 11: 0x2efdae25 (stale) CRC-32 checksum value for chunk [0, 0x355d0): Mirror 1: 0xe8fbe896 Mirror 12: 0xe8fbe896 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355d0: skipped 000426 1781227516.163091 write 0x03f389 thru 0x03ffff (0xc77 bytes) 000428 1781227516.250964 mapwrite 0x030dab thru 0x0391b3 (0x8409 bytes) 000429 1781227516.327419 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb7c63e24 (stale) Mirror 5: 0xb7c63e24 (stale) Mirror 6: 0xb7c63e24 (stale) Mirror 7: 0xb7c63e24 (stale) Mirror 8: 0xb7c63e24 (stale) Mirror 9: 0xb7c63e24 (stale) Mirror 10: 0xb7c63e24 (stale) Mirror 11: 0xb7c63e24 (stale) Mirror 12: 0x2822334a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc018227 Mirror 13: 0xc018227 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000430 1781227517.089655 read 0x0179e2 thru 0x021bd8 (0xa1f7 bytes) 000431 1781227517.101442 mapwrite 0x01285c thru 0x016ddf (0x4584 bytes) 000434 1781227517.263996 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb7c63e24 (stale) Mirror 5: 0xb7c63e24 (stale) Mirror 7: 0xb7c63e24 (stale) Mirror 8: 0xb7c63e24 (stale) Mirror 9: 0xb7c63e24 (stale) Mirror 10: 0xb7c63e24 (stale) Mirror 11: 0xb7c63e24 (stale) Mirror 12: 0x2822334a (stale) Mirror 13: 0xc018227 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb7c63e24 (stale) Mirror 5: 0xb7c63e24 (stale) Mirror 7: 0xb7c63e24 (stale) Mirror 8: 0xb7c63e24 (stale) Mirror 9: 0xb7c63e24 (stale) Mirror 10: 0xb7c63e24 (stale) Mirror 11: 0xb7c63e24 (stale) Mirror 12: 0x2822334a (stale) Mirror 13: 0xc018227 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000438 1781227518.099625 trunc from 0x040000 to 0x02123a (0x1edc5 bytes) 000441 1781227518.192004 mapread 0x012022 thru 0x01747e (0x545d bytes) 000442 1781227518.224630 read 0x01be81 thru 0x01f92f (0x3aaf bytes) 000444 1781227518.245693 MIRROR_RESYNC 10 mirrors 000447 1781227521.093525 MIRROR_RESYNC 10 mirrors 000448 1781227521.954347 write 0x0047e6 thru 0x0139f1 (0xf20c bytes) 000450 1781227522.166792 trunc from 0x02123b to 0x03c08f (0x1ae55 bytes) 000452 1781227522.199983 read 0x034c9a thru 0x03c08f (0x73f6 bytes) 000454 1781227522.221072 write 0x012eed thru 0x01b4d3 (0x85e7 bytes) 000456 1781227522.247349 write 0x00369b thru 0x00e6a7 (0xb00d bytes) 000457 1781227522.274249 write 0x01756b thru 0x0265a3 (0xf039 bytes) 000459 1781227522.306268 mapread 0x015b07 thru 0x02398b (0xde85 bytes) 000460 1781227522.311989 mapread 0x03bbc6 thru 0x03c08f (0x4ca bytes) 000461 1781227522.313008 write 0x00fc0b thru 0x01555e (0x5954 bytes) 000467 1781227522.336199 mapwrite 0x01c0f0 thru 0x01f5dd (0x34ee bytes) 000468 1781227522.537708 mapread 0x009d4f thru 0x015387 (0xb639 bytes) 000469 1781227522.538974 mapwrite 0x0384fd thru 0x03ffff (0x7b03 bytes) 000470 1781227522.666353 trunc from 0x040000 to 0x03ae0a (0x51f5 bytes) 000472 1781227522.707943 mapwrite 0x0178a7 thru 0x019d8b (0x24e5 bytes) 000474 1781227522.763396 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ae0b): Mirror 3: 0x772dbcab (stale) Mirror 5: 0x772dbcab (stale) Mirror 7: 0x772dbcab (stale) Mirror 8: 0x772dbcab (stale) Mirror 9: 0x772dbcab (stale) Mirror 10: 0x772dbcab (stale) Mirror 12: 0x772dbcab (stale) Mirror 13: 0x772dbcab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae0b): Mirror 3: 0x772dbcab (stale) Mirror 5: 0x772dbcab (stale) Mirror 7: 0x772dbcab (stale) Mirror 8: 0x772dbcab (stale) Mirror 9: 0x772dbcab (stale) Mirror 10: 0x772dbcab (stale) Mirror 12: 0x772dbcab (stale) Mirror 13: 0x772dbcab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae0b: skipped 000475 1781227523.519376 mapread 0x030687 thru 0x03ae0a (0xa784 bytes) 000477 1781227523.571698 mapwrite 0x0045ea thru 0x008cc4 (0x46db bytes) 000480 1781227523.746579 mapwrite 0x02aa35 thru 0x02e1f7 (0x37c3 bytes) 000482 1781227523.912274 read 0x0238cb thru 0x03275e (0xee94 bytes) 000487 1781227523.965502 MIRROR_RESYNC 9 mirrors 000488 1781227525.639861 MIRROR_EXTEND to 10 mirrors 000489 1781227526.379891 trunc from 0x03ae0b to 0x0352a4 (0x5b66 bytes) 000490 1781227526.467843 mapread 0x024823 thru 0x03035c (0xbb3a bytes) 000491 1781227526.488745 mapread 0x01c413 thru 0x0230e9 (0x6cd7 bytes) 000492 1781227526.496987 write 0x019350 thru 0x023a09 (0xa6ba bytes) 000493 1781227526.499367 mapwrite 0x015d45 thru 0x0222e2 (0xc59e bytes) 000494 1781227526.553564 write 0x03aac3 thru 0x03ffff (0x553d bytes) 000495 1781227526.554733 mapread 0x01c2b2 thru 0x01fe74 (0x3bc3 bytes) 000496 1781227526.555695 read 0x02c864 thru 0x03945c (0xcbf9 bytes) 000498 1781227526.561771 mapread 0x02bcca thru 0x0391d3 (0xd50a bytes) 000499 1781227526.563489 write 0x0001a7 thru 0x006af1 (0x694b bytes) 000500 1781227526.573071 mapwrite 0x00f88c thru 0x01f44e (0xfbc3 bytes) 000501 1781227526.614752 trunc from 0x040000 to 0x000e8c (0x3f173 bytes) 000502 1781227526.636048 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xe8d): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe8d): Mirror 3: 0x3c64082b (stale) Mirror 5: 0x3c64082b (stale) Mirror 7: 0x3c64082b (stale) Mirror 8: 0x3c64082b (stale) Mirror 9: 0x3c64082b (stale) Mirror 10: 0x3c64082b (stale) Mirror 12: 0x3c64082b (stale) Mirror 13: 0x3c64082b (stale) Mirror 14: 0x3c64082b (stale) CRC-32 checksum value for chunk [0, 0xe8d): Mirror 1: 0xeeac8742 Mirror 15: 0xeeac8742 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe8d: skipped 000504 1781227527.319420 mapread 0x0009e3 thru 0x000e8c (0x4aa bytes) 000505 1781227527.328708 mapwrite 0x0072ea thru 0x0172e5 (0xfffc bytes) 000506 1781227527.585816 MIRROR_RESYNC 11 mirrors 000508 1781227529.080411 MIRROR_EXTEND to 12 mirrors 000510 1781227530.262629 read 0x00e8c3 thru 0x0172e5 (0x8a23 bytes) 000514 1781227530.286160 read 0x016f3a thru 0x0172e5 (0x3ac bytes) 000515 1781227530.286639 mapwrite 0x03157b thru 0x03c371 (0xadf7 bytes) 000516 1781227530.628910 write 0x0358af thru 0x03ffff (0xa751 bytes) 000518 1781227530.645436 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2ceb690e (stale) Mirror 5: 0x2ceb690e (stale) Mirror 7: 0x2ceb690e (stale) Mirror 8: 0x2ceb690e (stale) Mirror 9: 0x2ceb690e (stale) Mirror 10: 0x2ceb690e (stale) Mirror 12: 0x2ceb690e (stale) Mirror 13: 0x2ceb690e (stale) Mirror 14: 0x2ceb690e (stale) Mirror 15: 0x2ceb690e (stale) Mirror 16: 0x2ceb690e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x519b80e2 Mirror 17: 0x519b80e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000519 1781227531.881201 mapwrite 0x00764e thru 0x01682f (0xf1e2 bytes) 000520 1781227532.045682 trunc from 0x040000 to 0x036390 (0x9c6f bytes) 000522 1781227532.068124 mapwrite 0x0007b4 thru 0x005966 (0x51b3 bytes) 000525 1781227532.138543 MIRROR_RESYNC 13 mirrors 000526 1781227534.048982 read 0x0153fb thru 0x01bdc9 (0x69cf bytes) 000528 1781227534.075786 MIRROR_SPLIT mirror 8 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000529 1781227534.661132 mapread 0x006275 thru 0x011e3a (0xbbc6 bytes) 000530 1781227534.716909 mapwrite 0x02ff3b thru 0x030ed7 (0xf9d bytes) 000531 1781227535.041387 mapread 0x0279cc thru 0x033cde (0xc313 bytes) 000533 1781227535.064031 write 0x026642 thru 0x035529 (0xeee8 bytes) 000534 1781227535.084133 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x36391): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36391): Mirror 3: 0xbcb86e76 (stale) Mirror 5: 0xbcb86e76 (stale) Mirror 7: 0xbcb86e76 (stale) Mirror 8: 0xbcb86e76 (stale) Mirror 9: 0xbcb86e76 (stale) Mirror 10: 0xbcb86e76 (stale) Mirror 12: 0xbcb86e76 (stale) Mirror 14: 0xbcb86e76 (stale) Mirror 15: 0xbcb86e76 (stale) Mirror 16: 0xbcb86e76 (stale) Mirror 17: 0xbcb86e76 (stale) CRC-32 checksum value for chunk [0, 0x36391): Mirror 1: 0x43167ac8 Mirror 18: 0x43167ac8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36391: skipped 000535 1781227535.994602 trunc from 0x036391 to 0x01ddc7 (0x185c9 bytes) 000537 1781227536.115728 mapread 0x014a94 thru 0x017cde (0x324b bytes) 000538 1781227536.139859 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ddc8): Mirror 3: 0x6fb82932 (stale) Mirror 5: 0x6fb82932 (stale) Mirror 7: 0x6fb82932 (stale) Mirror 8: 0x6fb82932 (stale) Mirror 9: 0x6fb82932 (stale) Mirror 10: 0x6fb82932 (stale) Mirror 12: 0x6fb82932 (stale) Mirror 14: 0x6fb82932 (stale) Mirror 15: 0x6fb82932 (stale) Mirror 16: 0x6fb82932 (stale) Mirror 18: 0x6fb82932 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ddc8): Mirror 3: 0x6fb82932 (stale) Mirror 5: 0x6fb82932 (stale) Mirror 7: 0x6fb82932 (stale) Mirror 8: 0x6fb82932 (stale) Mirror 9: 0x6fb82932 (stale) Mirror 10: 0x6fb82932 (stale) Mirror 12: 0x6fb82932 (stale) Mirror 14: 0x6fb82932 (stale) Mirror 15: 0x6fb82932 (stale) Mirror 16: 0x6fb82932 (stale) Mirror 18: 0x6fb82932 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ddc8: skipped truncating to largest ever: 0x3f33e 000539 1781227536.870946 trunc from 0x01ddc8 to 0x03f33d (0x21576 bytes) 000540 1781227536.893438 write 0x01ec56 thru 0x027276 (0x8621 bytes) 000542 1781227536.912532 trunc from 0x03f33e to 0x0126e1 (0x2cc5c bytes) 000543 1781227536.937534 mapwrite 0x03c50b thru 0x03ffff (0x3af5 bytes) 000544 1781227537.021876 write 0x01451d thru 0x0171d2 (0x2cb6 bytes) 000547 1781227537.040456 write 0x00f355 thru 0x01a892 (0xb53e bytes) 000548 1781227537.042922 read 0x009179 thru 0x00ad7a (0x1c02 bytes) 000549 1781227537.052363 write 0x01bd8e thru 0x01caae (0xd21 bytes) 000550 1781227537.053598 mapread 0x0186fd thru 0x01eca7 (0x65ab bytes) 000552 1781227537.065683 mapread 0x03cb18 thru 0x03d097 (0x580 bytes) 000553 1781227537.066735 trunc from 0x040000 to 0x02ced9 (0x13126 bytes) 000554 1781227537.085560 mapread 0x003eb9 thru 0x011798 (0xd8e0 bytes) 000555 1781227537.099393 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ceda): Mirror 3: 0xac15995e (stale) Mirror 7: 0xac15995e (stale) Mirror 8: 0xac15995e (stale) Mirror 9: 0xac15995e (stale) Mirror 10: 0xac15995e (stale) Mirror 12: 0xac15995e (stale) Mirror 14: 0xac15995e (stale) Mirror 15: 0xac15995e (stale) Mirror 16: 0xac15995e (stale) Mirror 18: 0xdbe7670d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ceda): Mirror 3: 0xac15995e (stale) Mirror 7: 0xac15995e (stale) Mirror 8: 0xac15995e (stale) Mirror 9: 0xac15995e (stale) Mirror 10: 0xac15995e (stale) Mirror 12: 0xac15995e (stale) Mirror 14: 0xac15995e (stale) Mirror 15: 0xac15995e (stale) Mirror 16: 0xac15995e (stale) Mirror 18: 0xdbe7670d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ceda: skipped 000556 1781227537.725913 mapread 0x02b799 thru 0x02ced9 (0x1741 bytes) 000559 1781227537.741925 mapread 0x01649a thru 0x023e3d (0xd9a4 bytes) 000562 1781227537.763401 trunc from 0x02ceda to 0x0394fb (0xc622 bytes) 000563 1781227537.792576 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x394fc): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394fc): Mirror 3: 0xe70ed6d4 (stale) Mirror 7: 0xe70ed6d4 (stale) Mirror 8: 0xe70ed6d4 (stale) Mirror 9: 0xe70ed6d4 (stale) Mirror 10: 0xe70ed6d4 (stale) Mirror 12: 0xe70ed6d4 (stale) Mirror 14: 0xe70ed6d4 (stale) Mirror 15: 0xe70ed6d4 (stale) Mirror 16: 0xe70ed6d4 (stale) Mirror 18: 0x1eb2de8f (stale) CRC-32 checksum value for chunk [0, 0x394fc): Mirror 1: 0x2ab51bee Mirror 19: 0x2ab51bee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394fc: skipped 000564 1781227538.840876 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x394fc): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394fc): Mirror 3: 0xe70ed6d4 (stale) Mirror 7: 0xe70ed6d4 (stale) Mirror 8: 0xe70ed6d4 (stale) Mirror 9: 0xe70ed6d4 (stale) Mirror 10: 0xe70ed6d4 (stale) Mirror 12: 0xe70ed6d4 (stale) Mirror 14: 0xe70ed6d4 (stale) Mirror 15: 0xe70ed6d4 (stale) Mirror 16: 0xe70ed6d4 (stale) Mirror 18: 0x1eb2de8f (stale) CRC-32 checksum value for chunk [0, 0x394fc): Mirror 1: 0x2ab51bee Mirror 19: 0x2ab51bee Mirror 20: 0x2ab51bee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394fc: skipped 000566 1781227540.025482 mapwrite 0x016d08 thru 0x0180a3 (0x139c bytes) 000567 1781227540.205765 read 0x02f800 thru 0x032ee8 (0x36e9 bytes) 000570 1781227540.216448 read 0x01b79d thru 0x01ee7c (0x36e0 bytes) 000571 1781227540.217128 mapread 0x018e8d thru 0x01bbfe (0x2d72 bytes) 000573 1781227540.220601 mapread 0x01f424 thru 0x01fbbf (0x79c bytes) 000576 1781227540.223677 mapread 0x021c22 thru 0x02da4b (0xbe2a bytes) 000577 1781227540.236894 trunc from 0x0394fc to 0x02f549 (0x9fb2 bytes) 000582 1781227540.267566 mapwrite 0x03992c thru 0x03ffff (0x66d4 bytes) 000583 1781227540.346945 MIRROR_RESYNC 13 mirrors 000584 1781227542.193402 write 0x03c9be thru 0x03ffff (0x3642 bytes) 000585 1781227542.281987 mapwrite 0x03cac0 thru 0x03ffff (0x3540 bytes) 000586 1781227542.331804 read 0x009291 thru 0x013ae0 (0xa850 bytes) 000587 1781227542.339694 mapwrite 0x02bd70 thru 0x034eec (0x917d bytes) 000590 1781227542.398137 mapwrite 0x013fed thru 0x019c32 (0x5c46 bytes) 000591 1781227542.451712 trunc from 0x040000 to 0x00b428 (0x34bd7 bytes) 000592 1781227542.473063 read 0x001db3 thru 0x00b428 (0x9676 bytes) 000595 1781227542.482414 mapwrite 0x000f3d thru 0x00aaf1 (0x9bb5 bytes) 000596 1781227542.532309 mapread 0x00a988 thru 0x00b428 (0xaa1 bytes) 000597 1781227542.538343 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb429): Mirror 3: 0x211f0f0d (stale) Mirror 7: 0x211f0f0d (stale) Mirror 8: 0x211f0f0d (stale) Mirror 9: 0x211f0f0d (stale) Mirror 10: 0x211f0f0d (stale) Mirror 12: 0x211f0f0d (stale) Mirror 14: 0x211f0f0d (stale) Mirror 15: 0x211f0f0d (stale) Mirror 16: 0x211f0f0d (stale) Mirror 19: 0x211f0f0d (stale) Mirror 20: 0x211f0f0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb429): Mirror 3: 0x211f0f0d (stale) Mirror 7: 0x211f0f0d (stale) Mirror 8: 0x211f0f0d (stale) Mirror 9: 0x211f0f0d (stale) Mirror 10: 0x211f0f0d (stale) Mirror 12: 0x211f0f0d (stale) Mirror 14: 0x211f0f0d (stale) Mirror 15: 0x211f0f0d (stale) Mirror 16: 0x211f0f0d (stale) Mirror 19: 0x211f0f0d (stale) Mirror 20: 0x211f0f0d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb429: skipped 000601 1781227543.042137 MIRROR_RESYNC 12 mirrors 000602 1781227544.831500 trunc from 0x00b429 to 0x02c073 (0x20c4b bytes) 000603 1781227544.907194 mapread 0x024bad thru 0x026531 (0x1985 bytes) 000604 1781227544.929527 MIRROR_RESYNC 12 mirrors 000606 1781227546.712983 MIRROR_RESYNC 12 mirrors 000607 1781227547.664353 trunc from 0x02c074 to 0x0122cf (0x19da4 bytes) 000609 1781227547.781744 trunc from 0x0122d0 to 0x03e299 (0x2bfca bytes) 000610 1781227547.819360 read 0x03d4e2 thru 0x03e299 (0xdb8 bytes) 000614 1781227547.840820 mapread 0x015666 thru 0x01cba3 (0x753e bytes) 000616 1781227547.888912 mapread 0x00a097 thru 0x00ab7b (0xae5 bytes) 000617 1781227547.910650 write 0x01d6b6 thru 0x0283f8 (0xad43 bytes) 000618 1781227547.921365 write 0x014f77 thru 0x0153c6 (0x450 bytes) 000619 1781227547.930390 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e29a): Mirror 3: 0x6c05945c (stale) Mirror 7: 0x6c05945c (stale) Mirror 8: 0x6c05945c (stale) Mirror 9: 0x6c05945c (stale) Mirror 12: 0x6c05945c (stale) Mirror 14: 0x6c05945c (stale) Mirror 15: 0x6c05945c (stale) Mirror 16: 0x6c05945c (stale) Mirror 19: 0x6c05945c (stale) Mirror 20: 0x6c05945c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e29a): Mirror 3: 0x6c05945c (stale) Mirror 7: 0x6c05945c (stale) Mirror 8: 0x6c05945c (stale) Mirror 9: 0x6c05945c (stale) Mirror 12: 0x6c05945c (stale) Mirror 14: 0x6c05945c (stale) Mirror 15: 0x6c05945c (stale) Mirror 16: 0x6c05945c (stale) Mirror 19: 0x6c05945c (stale) Mirror 20: 0x6c05945c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e29a: skipped 000620 1781227548.557439 write 0x024ecd thru 0x02e3f9 (0x952d bytes) 000623 1781227548.569033 write 0x02d428 thru 0x030505 (0x30de bytes) 000624 1781227548.576543 mapwrite 0x00a24a thru 0x012001 (0x7db8 bytes) 000625 1781227548.642844 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e29a): Mirror 7: 0x6c05945c (stale) Mirror 8: 0x6c05945c (stale) Mirror 9: 0x6c05945c (stale) Mirror 12: 0x6c05945c (stale) Mirror 14: 0x6c05945c (stale) Mirror 15: 0x6c05945c (stale) Mirror 16: 0x6c05945c (stale) Mirror 19: 0x6c05945c (stale) Mirror 20: 0x6c05945c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e29a): Mirror 7: 0x6c05945c (stale) Mirror 8: 0x6c05945c (stale) Mirror 9: 0x6c05945c (stale) Mirror 12: 0x6c05945c (stale) Mirror 14: 0x6c05945c (stale) Mirror 15: 0x6c05945c (stale) Mirror 16: 0x6c05945c (stale) Mirror 19: 0x6c05945c (stale) Mirror 20: 0x6c05945c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e29a: skipped 000627 1781227549.138178 read 0x020831 thru 0x02efc9 (0xe799 bytes) 000629 1781227549.158796 write 0x0047bf thru 0x00ce19 (0x865b bytes) 000630 1781227549.181527 mapwrite 0x03f907 thru 0x03ffff (0x6f9 bytes) 000632 1781227549.248675 mapread 0x036211 thru 0x037260 (0x1050 bytes) 000636 1781227549.258711 read 0x01af33 thru 0x024427 (0x94f5 bytes) 000638 1781227549.268272 trunc from 0x040000 to 0x001a6f (0x3e590 bytes) 000639 1781227549.298812 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1a70): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a70): Mirror 7: 0xb4994c7a (stale) Mirror 8: 0xb4994c7a (stale) Mirror 9: 0xb4994c7a (stale) Mirror 12: 0xb4994c7a (stale) Mirror 14: 0xb4994c7a (stale) Mirror 15: 0xb4994c7a (stale) Mirror 16: 0xb4994c7a (stale) Mirror 19: 0xb4994c7a (stale) Mirror 20: 0xb4994c7a (stale) CRC-32 checksum value for chunk [0, 0x1a70): Mirror 1: 0xb4994c7a Mirror 21: 0xb4994c7a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a70: skipped 000640 1781227550.226596 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1a70): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a70): Mirror 7: 0xb4994c7a (stale) Mirror 8: 0xb4994c7a (stale) Mirror 9: 0xb4994c7a (stale) Mirror 12: 0xb4994c7a (stale) Mirror 14: 0xb4994c7a (stale) Mirror 15: 0xb4994c7a (stale) Mirror 16: 0xb4994c7a (stale) Mirror 19: 0xb4994c7a (stale) Mirror 20: 0xb4994c7a (stale) CRC-32 checksum value for chunk [0, 0x1a70): Mirror 1: 0xb4994c7a Mirror 21: 0xb4994c7a Mirror 22: 0xb4994c7a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a70: skipped 000641 1781227551.275154 mapwrite 0x0028bd thru 0x009d54 (0x7498 bytes) 000644 1781227551.420500 mapread 0x007bb7 thru 0x009d54 (0x219e bytes) 000645 1781227551.421861 mapread 0x0059d4 thru 0x009d54 (0x4381 bytes) 000646 1781227551.426532 MIRROR_RESYNC 12 mirrors 000647 1781227553.850151 mapwrite 0x03bab0 thru 0x03c83b (0xd8c bytes) 000649 1781227554.070789 mapwrite 0x031c26 thru 0x03e275 (0xc650 bytes) 000651 1781227554.192488 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3e276): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e276): Mirror 7: 0x149e02b3 (stale) Mirror 8: 0x149e02b3 (stale) Mirror 9: 0x149e02b3 (stale) Mirror 12: 0x149e02b3 (stale) Mirror 14: 0x149e02b3 (stale) Mirror 15: 0x149e02b3 (stale) Mirror 16: 0x149e02b3 (stale) Mirror 19: 0x149e02b3 (stale) Mirror 20: 0x149e02b3 (stale) Mirror 21: 0x149e02b3 (stale) Mirror 22: 0x149e02b3 (stale) CRC-32 checksum value for chunk [0, 0x3e276): Mirror 1: 0xee43cf44 Mirror 23: 0xee43cf44 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e276: skipped 000652 1781227555.511620 mapwrite 0x00737c thru 0x016127 (0xedac bytes) 000653 1781227555.861408 mapread 0x02257f thru 0x02b51b (0x8f9d bytes) 000655 1781227555.890512 MIRROR_RESYNC 13 mirrors 000656 1781227557.863641 mapread 0x0101fa thru 0x0191a8 (0x8faf bytes) 000658 1781227557.902710 trunc from 0x03e276 to 0x006d8b (0x374ea bytes) 000659 1781227558.003656 read 0x0007e9 thru 0x006d8b (0x65a3 bytes) 000660 1781227558.011665 read 0x00131a thru 0x003ad0 (0x27b7 bytes) 000662 1781227558.013358 mapread 0x001662 thru 0x006d8b (0x572a bytes) 000665 1781227558.017101 write 0x036d67 thru 0x03ffff (0x9299 bytes) 000666 1781227558.018785 write 0x034aa5 thru 0x03ffff (0xb55b bytes) 000667 1781227558.028459 mapwrite 0x0349e1 thru 0x03abd2 (0x61f2 bytes) 000672 1781227558.093770 read 0x0195bb thru 0x027b18 (0xe55e bytes) 000675 1781227558.096985 trunc from 0x040000 to 0x025ece (0x1a131 bytes) 000676 1781227558.122571 mapread 0x0087db thru 0x014596 (0xbdbc bytes) 000677 1781227558.125437 mapwrite 0x020d7d thru 0x022716 (0x199a bytes) 000678 1781227558.172320 mapwrite 0x03822d thru 0x03ffff (0x7dd3 bytes) 000679 1781227558.242697 mapread 0x01a202 thru 0x024102 (0x9f01 bytes) 000680 1781227558.245128 trunc from 0x040000 to 0x0383cb (0x7c34 bytes) 000682 1781227558.267632 mapwrite 0x023908 thru 0x0331a1 (0xf89a bytes) 000683 1781227558.333930 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x383cc): Mirror 7: 0x7c157d17 (stale) Mirror 8: 0x7c157d17 (stale) Mirror 9: 0x7c157d17 (stale) Mirror 12: 0x7c157d17 (stale) Mirror 14: 0x7c157d17 (stale) Mirror 15: 0x7c157d17 (stale) Mirror 16: 0x7c157d17 (stale) Mirror 19: 0x7c157d17 (stale) Mirror 20: 0x7c157d17 (stale) Mirror 22: 0x7c157d17 (stale) Mirror 23: 0x7c157d17 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x383cc): Mirror 7: 0x7c157d17 (stale) Mirror 8: 0x7c157d17 (stale) Mirror 9: 0x7c157d17 (stale) Mirror 12: 0x7c157d17 (stale) Mirror 14: 0x7c157d17 (stale) Mirror 15: 0x7c157d17 (stale) Mirror 16: 0x7c157d17 (stale) Mirror 19: 0x7c157d17 (stale) Mirror 20: 0x7c157d17 (stale) Mirror 22: 0x7c157d17 (stale) Mirror 23: 0x7c157d17 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x383cc: skipped 000684 1781227559.071597 trunc from 0x0383cc to 0x01f899 (0x18b32 bytes) 000685 1781227559.089160 read 0x00d95b thru 0x019e41 (0xc4e7 bytes) 000691 1781227559.100626 trunc from 0x01f89a to 0x02d46d (0xdbd4 bytes) 000693 1781227559.121686 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d46e): Mirror 7: 0x8e729175 (stale) Mirror 8: 0x8e729175 (stale) Mirror 9: 0x8e729175 (stale) Mirror 12: 0x8e729175 (stale) Mirror 14: 0x8e729175 (stale) Mirror 15: 0x8e729175 (stale) Mirror 16: 0x8e729175 (stale) Mirror 20: 0x8e729175 (stale) Mirror 22: 0x8e729175 (stale) Mirror 23: 0x8e729175 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d46e): Mirror 7: 0x8e729175 (stale) Mirror 8: 0x8e729175 (stale) Mirror 9: 0x8e729175 (stale) Mirror 12: 0x8e729175 (stale) Mirror 14: 0x8e729175 (stale) Mirror 15: 0x8e729175 (stale) Mirror 16: 0x8e729175 (stale) Mirror 20: 0x8e729175 (stale) Mirror 22: 0x8e729175 (stale) Mirror 23: 0x8e729175 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d46e: skipped 000694 1781227559.805804 read 0x0270bf thru 0x02d46d (0x63af bytes) 000696 1781227559.816405 read 0x01238f thru 0x015190 (0x2e02 bytes) 000699 1781227559.829441 mapwrite 0x019a0d thru 0x028f41 (0xf535 bytes) 000700 1781227559.874199 write 0x0217a1 thru 0x0239f2 (0x2252 bytes) 000701 1781227559.879532 trunc from 0x02d46e to 0x033088 (0x5c1b bytes) 000702 1781227559.898435 read 0x021fd1 thru 0x028e39 (0x6e69 bytes) 000705 1781227559.904924 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33089): Mirror 7: 0x51d69c8a (stale) Mirror 8: 0x51d69c8a (stale) Mirror 9: 0x51d69c8a (stale) Mirror 12: 0x51d69c8a (stale) Mirror 14: 0x51d69c8a (stale) Mirror 15: 0x51d69c8a (stale) Mirror 16: 0x51d69c8a (stale) Mirror 20: 0x51d69c8a (stale) Mirror 22: 0x51d69c8a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33089): Mirror 7: 0x51d69c8a (stale) Mirror 8: 0x51d69c8a (stale) Mirror 9: 0x51d69c8a (stale) Mirror 12: 0x51d69c8a (stale) Mirror 14: 0x51d69c8a (stale) Mirror 15: 0x51d69c8a (stale) Mirror 16: 0x51d69c8a (stale) Mirror 20: 0x51d69c8a (stale) Mirror 22: 0x51d69c8a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33089: skipped 000706 1781227560.597114 mapread 0x00616d thru 0x011d14 (0xbba8 bytes) 000707 1781227560.629402 write 0x0207a5 thru 0x02a40a (0x9c66 bytes) 000708 1781227560.649472 mapread 0x011e6a thru 0x02181d (0xf9b4 bytes) 000710 1781227560.652697 mapread 0x029182 thru 0x02d6c3 (0x4542 bytes) 000711 1781227560.674895 read 0x030dbf thru 0x033088 (0x22ca bytes) 000712 1781227560.675587 mapwrite 0x02edb1 thru 0x038272 (0x94c2 bytes) 000713 1781227560.829994 mapread 0x01ab7a thru 0x02874b (0xdbd2 bytes) 000715 1781227560.831898 trunc from 0x038273 to 0x00e335 (0x29f3d bytes) 000717 1781227560.925453 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe336): Mirror 7: 0x83ea779e (stale) Mirror 8: 0x83ea779e (stale) Mirror 12: 0x83ea779e (stale) Mirror 14: 0x83ea779e (stale) Mirror 15: 0x83ea779e (stale) Mirror 16: 0x83ea779e (stale) Mirror 20: 0x83ea779e (stale) Mirror 22: 0x83ea779e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe336): Mirror 7: 0x83ea779e (stale) Mirror 8: 0x83ea779e (stale) Mirror 12: 0x83ea779e (stale) Mirror 14: 0x83ea779e (stale) Mirror 15: 0x83ea779e (stale) Mirror 16: 0x83ea779e (stale) Mirror 20: 0x83ea779e (stale) Mirror 22: 0x83ea779e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe336: skipped 000718 1781227561.671943 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe336): Mirror 7: 0x83ea779e (stale) Mirror 12: 0x83ea779e (stale) Mirror 14: 0x83ea779e (stale) Mirror 15: 0x83ea779e (stale) Mirror 16: 0x83ea779e (stale) Mirror 20: 0x83ea779e (stale) Mirror 22: 0x83ea779e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe336): Mirror 7: 0x83ea779e (stale) Mirror 12: 0x83ea779e (stale) Mirror 14: 0x83ea779e (stale) Mirror 15: 0x83ea779e (stale) Mirror 16: 0x83ea779e (stale) Mirror 20: 0x83ea779e (stale) Mirror 22: 0x83ea779e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe336: skipped 000719 1781227562.161618 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xe336): Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe336): Mirror 7: 0x83ea779e (stale) Mirror 12: 0x83ea779e (stale) Mirror 14: 0x83ea779e (stale) Mirror 15: 0x83ea779e (stale) Mirror 16: 0x83ea779e (stale) Mirror 20: 0x83ea779e (stale) Mirror 22: 0x83ea779e (stale) CRC-32 checksum value for chunk [0, 0xe336): Mirror 1: 0xcc84f402 Mirror 23: 0xcc84f402 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe336: skipped 000721 1781227563.090195 read 0x008077 thru 0x00e335 (0x62bf bytes) 000724 1781227563.111004 write 0x01e0af thru 0x02caa0 (0xe9f2 bytes) 000727 1781227563.271766 mapread 0x0229fa thru 0x02caa0 (0xa0a7 bytes) 000728 1781227563.274628 trunc from 0x02caa1 to 0x03a4e1 (0xda41 bytes) 000730 1781227563.328367 read 0x00150c thru 0x00568a (0x417f bytes) 000732 1781227563.348183 mapread 0x004d3c thru 0x00c984 (0x7c49 bytes) 000733 1781227563.350935 mapwrite 0x017cef thru 0x0212ce (0x95e0 bytes) 000735 1781227563.514394 mapwrite 0x030dbc thru 0x038008 (0x724d bytes) 000736 1781227563.587645 read 0x01ba0b thru 0x02434a (0x8940 bytes) 000738 1781227563.589084 write 0x00d971 thru 0x0144c4 (0x6b54 bytes) 000739 1781227563.597243 mapread 0x0153b3 thru 0x01cc62 (0x78b0 bytes) 000741 1781227563.601833 write 0x011f89 thru 0x01d053 (0xb0cb bytes) 000745 1781227563.610283 write 0x020a40 thru 0x02ed91 (0xe352 bytes) 000746 1781227563.618467 mapwrite 0x014638 thru 0x01c02d (0x79f6 bytes) 000748 1781227563.765494 read 0x0082e1 thru 0x0178e8 (0xf608 bytes) 000749 1781227563.795853 MIRROR_RESYNC 9 mirrors 000751 1781227565.853965 read 0x01e1ef thru 0x02b784 (0xd596 bytes) 000752 1781227565.868302 mapwrite 0x036546 thru 0x03b9e7 (0x54a2 bytes) 000753 1781227566.031417 write 0x03f4f9 thru 0x03ffff (0xb07 bytes) 000754 1781227566.036580 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8344c48c (stale) Mirror 12: 0x8344c48c (stale) Mirror 15: 0x8344c48c (stale) Mirror 16: 0x8344c48c (stale) Mirror 20: 0x8344c48c (stale) Mirror 22: 0x8344c48c (stale) Mirror 23: 0x8344c48c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8344c48c (stale) Mirror 12: 0x8344c48c (stale) Mirror 15: 0x8344c48c (stale) Mirror 16: 0x8344c48c (stale) Mirror 20: 0x8344c48c (stale) Mirror 22: 0x8344c48c (stale) Mirror 23: 0x8344c48c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000755 1781227566.509724 mapwrite 0x014114 thru 0x01b34f (0x723c bytes) 000756 1781227566.579082 read 0x017f31 thru 0x018c27 (0xcf7 bytes) 000757 1781227566.579962 mapwrite 0x020805 thru 0x028301 (0x7afd bytes) 000758 1781227566.632281 read 0x03f72d thru 0x03ffff (0x8d3 bytes) 000759 1781227566.650662 MIRROR_RESYNC 8 mirrors 000761 1781227568.151835 mapread 0x037e8b thru 0x03ffff (0x8175 bytes) 000762 1781227568.171277 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000763 1781227568.496743 trunc from 0x040000 to 0x029462 (0x16b9d bytes) 000766 1781227568.595409 mapwrite 0x034a2b thru 0x03ffff (0xb5d5 bytes) 000767 1781227568.718180 mapwrite 0x036a03 thru 0x03ffff (0x95fd bytes) 000768 1781227568.770101 mapread 0x037c4e thru 0x039126 (0x14d9 bytes) 000769 1781227568.771259 write 0x00ef42 thru 0x01e8bc (0xf97b bytes) 000770 1781227568.787044 read 0x033d2e thru 0x03bb65 (0x7e38 bytes) 000771 1781227568.788147 mapwrite 0x0180bf thru 0x022a76 (0xa9b8 bytes) 000773 1781227568.847678 mapread 0x01de81 thru 0x02137d (0x34fd bytes) 000774 1781227568.849322 write 0x00308b thru 0x008623 (0x5599 bytes) 000775 1781227568.860309 write 0x0262bd thru 0x02d751 (0x7495 bytes) 000776 1781227568.867319 write 0x01cf39 thru 0x025210 (0x82d8 bytes) 000780 1781227568.873086 write 0x02c869 thru 0x03c458 (0xfbf0 bytes) 000781 1781227568.880646 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x2bfdba3 (stale) Mirror 15: 0x2bfdba3 (stale) Mirror 16: 0x2bfdba3 (stale) Mirror 20: 0x2bfdba3 (stale) Mirror 22: 0x2bfdba3 (stale) Mirror 23: 0x2bfdba3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa98ee0fc Mirror 24: 0xa98ee0fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000782 1781227570.016497 mapwrite 0x034fdf thru 0x03ffff (0xb021 bytes) 000787 1781227570.388616 read 0x006234 thru 0x007a3d (0x180a bytes) 000788 1781227570.419536 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x2bfdba3 (stale) Mirror 16: 0x2bfdba3 (stale) Mirror 20: 0x2bfdba3 (stale) Mirror 22: 0x2bfdba3 (stale) Mirror 23: 0x2bfdba3 (stale) Mirror 24: 0xa98ee0fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x2bfdba3 (stale) Mirror 16: 0x2bfdba3 (stale) Mirror 20: 0x2bfdba3 (stale) Mirror 22: 0x2bfdba3 (stale) Mirror 23: 0x2bfdba3 (stale) Mirror 24: 0xa98ee0fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000789 1781227571.162945 trunc from 0x040000 to 0x021e6e (0x1e191 bytes) 000790 1781227571.187623 write 0x03dfd3 thru 0x03ffff (0x202d bytes) 000792 1781227571.196332 mapread 0x0140d9 thru 0x015346 (0x126e bytes) 000794 1781227571.214174 trunc from 0x040000 to 0x00cf92 (0x3306d bytes) 000797 1781227571.281536 read 0x004b66 thru 0x0091f7 (0x4692 bytes) 000798 1781227571.289656 trunc from 0x00cf93 to 0x01e6da (0x11748 bytes) 000802 1781227571.327277 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e6db): Mirror 15: 0x954852a2 (stale) Mirror 16: 0x954852a2 (stale) Mirror 20: 0x954852a2 (stale) Mirror 22: 0x954852a2 (stale) Mirror 24: 0x3beeaf9b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e6db): Mirror 15: 0x954852a2 (stale) Mirror 16: 0x954852a2 (stale) Mirror 20: 0x954852a2 (stale) Mirror 22: 0x954852a2 (stale) Mirror 24: 0x3beeaf9b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e6db: skipped 000805 1781227571.727536 read 0x01ca59 thru 0x01e6da (0x1c82 bytes) 000807 1781227571.732796 read 0x016860 thru 0x01e6da (0x7e7b bytes) 000809 1781227571.745152 mapread 0x01500e thru 0x01b4ba (0x64ad bytes) truncating to largest ever: 0x3f929 000813 1781227571.749233 trunc from 0x01e6db to 0x03f928 (0x2124e bytes) 000814 1781227571.766576 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f929): Mirror 15: 0x268513a7 (stale) Mirror 16: 0x268513a7 (stale) Mirror 20: 0x268513a7 (stale) Mirror 22: 0x268513a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f929): Mirror 15: 0x268513a7 (stale) Mirror 16: 0x268513a7 (stale) Mirror 20: 0x268513a7 (stale) Mirror 22: 0x268513a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f929: skipped 000815 1781227572.121173 read 0x01a227 thru 0x022fd0 (0x8daa bytes) 000817 1781227572.133397 write 0x03dcff thru 0x03ffff (0x2301 bytes) 000819 1781227572.143140 mapwrite 0x006b04 thru 0x007bcf (0x10cc bytes) 000820 1781227572.238139 mapread 0x000a98 thru 0x0022cb (0x1834 bytes) 000821 1781227572.245528 mapwrite 0x0148de thru 0x01fda6 (0xb4c9 bytes) 000822 1781227572.358797 trunc from 0x040000 to 0x029ed1 (0x1612e bytes) 000825 1781227572.397977 read 0x0253f2 thru 0x029ed1 (0x4ae0 bytes) 000826 1781227572.412881 MIRROR_RESYNC 5 mirrors 000828 1781227573.362188 mapwrite 0x01b3af thru 0x025a21 (0xa673 bytes) 000829 1781227573.505974 write 0x01932a thru 0x0258a5 (0xc57c bytes) 000832 1781227573.511958 trunc from 0x029ed2 to 0x01ea7e (0xb453 bytes) 000833 1781227573.546914 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 15: 0x1a1d16d9 (stale) Mirror 16: 0x1a1d16d9 (stale) Mirror 20: 0x1a1d16d9 (stale) Mirror 22: 0x1a1d16d9 (stale) CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 1: 0x9350219b Mirror 23: 0x9350219b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea7f: skipped 000834 1781227574.865155 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 16: 0x1a1d16d9 (stale) Mirror 20: 0x1a1d16d9 (stale) Mirror 22: 0x1a1d16d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 16: 0x1a1d16d9 (stale) Mirror 20: 0x1a1d16d9 (stale) Mirror 22: 0x1a1d16d9 (stale) CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 1: 0x9350219b Mirror 23: 0x9350219b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea7f: skipped 000836 1781227575.373230 mapread 0x019f0c thru 0x01ea7e (0x4b73 bytes) 000837 1781227575.398518 read 0x0182e0 thru 0x01ea7e (0x679f bytes) 000839 1781227575.400544 mapread 0x01cc3f thru 0x01ea7e (0x1e40 bytes) 000841 1781227575.406543 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 20: 0x1a1d16d9 (stale) Mirror 22: 0x1a1d16d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 20: 0x1a1d16d9 (stale) Mirror 22: 0x1a1d16d9 (stale) CRC-32 checksum value for chunk [0, 0x1ea7f): Mirror 1: 0x9350219b Mirror 23: 0x9350219b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea7f: skipped 000843 1781227575.825001 MIRROR_RESYNC 4 mirrors 000845 1781227576.504340 mapwrite 0x025b44 thru 0x02cf56 (0x7413 bytes) 000846 1781227576.653196 mapread 0x015265 thru 0x01e776 (0x9512 bytes) 000847 1781227576.667578 mapread 0x0071e2 thru 0x00dfcf (0x6dee bytes) 000848 1781227576.675433 write 0x02ea88 thru 0x032788 (0x3d01 bytes) 000849 1781227576.677053 mapread 0x00a277 thru 0x00c835 (0x25bf bytes) 000851 1781227576.678878 mapwrite 0x02513c thru 0x03241b (0xd2e0 bytes) 000853 1781227576.729392 trunc from 0x032789 to 0x034bad (0x2425 bytes) 000854 1781227576.762939 MIRROR_RESYNC 4 mirrors 000859 1781227577.621914 mapread 0x021a8b thru 0x02e356 (0xc8cc bytes) 000861 1781227577.662454 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000862 1781227578.016853 write 0x0143b0 thru 0x017263 (0x2eb4 bytes) 000864 1781227578.136559 mapread 0x000a8d thru 0x0014ed (0xa61 bytes) 000865 1781227578.149062 write 0x033681 thru 0x038b3c (0x54bc bytes) 000868 1781227578.171569 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38b3d): Mirror 20: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38b3d): Mirror 20: 0x990a5032 (stale) Mirror 23: 0x990a5032 (stale) CRC-32 checksum value for chunk [0, 0x38b3d): Mirror 1: 0xe67eb020 Mirror 24: 0xe67eb020 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38b3d: skipped 000870 1781227579.073319 write 0x039602 thru 0x03ffff (0x69fe bytes) 000871 1781227579.222051 write 0x00425e thru 0x00a2c2 (0x6065 bytes) 000872 1781227579.235572 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xd6233a61 (stale) Mirror 23: 0xd6233a61 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xd6233a61 (stale) Mirror 23: 0xd6233a61 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000873 1781227579.620538 read 0x02f62d thru 0x031bc7 (0x259b bytes) 000875 1781227579.628154 write 0x02b417 thru 0x03914e (0xdd38 bytes) 000876 1781227579.641798 MIRROR_RESYNC 3 mirrors 000878 1781227580.255431 mapread 0x03d476 thru 0x03ffff (0x2b8a bytes) 000879 1781227580.274527 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000881 1781227580.528561 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b8:0x0]: Invalid argument (22) 000882 1781227580.634225 mapread 0x00ae50 thru 0x013577 (0x8728 bytes) 000886 1781227580.657342 write 0x02dbf0 thru 0x034f08 (0x7319 bytes) 000887 1781227580.677981 write 0x034954 thru 0x0382ac (0x3959 bytes) 000888 1781227580.684049 mapread 0x018fbd thru 0x01da39 (0x4a7d bytes) 000889 1781227580.695420 mapread 0x010af8 thru 0x01e7fe (0xdd07 bytes) 000890 1781227580.702915 mapwrite 0x021bba thru 0x02c8d5 (0xad1c bytes) 000892 1781227580.766708 mapread 0x012ba6 thru 0x014010 (0x146b bytes) 000893 1781227580.767740 mapread 0x035e07 thru 0x03f0c3 (0x92bd bytes) 000895 1781227580.777348 trunc from 0x040000 to 0x0267ea (0x19815 bytes) 000896 1781227580.811110 read 0x008344 thru 0x0145e5 (0xc2a2 bytes) 000898 1781227580.816778 mapread 0x00cf68 thru 0x013d65 (0x6dfe bytes) 000899 1781227580.818052 trunc from 0x0267eb to 0x0360d9 (0xf8ef bytes) 000900 1781227580.832545 mapwrite 0x019359 thru 0x01f40e (0x60b6 bytes) 000901 1781227580.871146 mapwrite 0x0021ca thru 0x005c2f (0x3a66 bytes) 000905 1781227580.912618 trunc from 0x0360da to 0x02b724 (0xa9b5 bytes) 000909 1781227580.932159 mapwrite 0x0297cb thru 0x035c45 (0xc47b bytes) 000910 1781227581.029737 read 0x024a08 thru 0x032a62 (0xe05b bytes) 000912 1781227581.031999 mapwrite 0x009479 thru 0x010f14 (0x7a9c bytes) 000913 1781227581.075504 write 0x02da94 thru 0x032af5 (0x5062 bytes) 000915 1781227581.078123 trunc from 0x035c46 to 0x01e582 (0x176c3 bytes) 000919 1781227581.097762 mapwrite 0x02d3bd thru 0x039b0b (0xc74f bytes) 000923 1781227581.258246 read 0x013f70 thru 0x019668 (0x56f9 bytes) 000925 1781227581.261434 mapread 0x01401d thru 0x0190ad (0x5091 bytes) 000926 1781227581.262665 mapread 0x00ed6b thru 0x01caa1 (0xdd37 bytes) 000930 1781227581.272569 trunc from 0x039b0c to 0x003b08 (0x36003 bytes) 000934 1781227581.305573 mapread 0x003385 thru 0x003b08 (0x784 bytes) 000935 1781227581.307461 mapwrite 0x02e78d thru 0x02e823 (0x97 bytes) 000936 1781227581.448880 mapwrite 0x033631 thru 0x038f33 (0x5903 bytes) 000939 1781227581.544743 mapread 0x00143f thru 0x00ebf9 (0xd7bb bytes) 000944 1781227581.567500 trunc from 0x038f34 to 0x015630 (0x23903 bytes) 000945 1781227581.597650 trunc from 0x015631 to 0x02a439 (0x14e09 bytes) 000947 1781227581.652947 read 0x0221c4 thru 0x0255b8 (0x33f5 bytes) 000948 1781227581.678510 read 0x000f7f thru 0x008d8d (0x7e0f bytes) 000953 1781227581.684689 mapwrite 0x009935 thru 0x00f9cb (0x6097 bytes) 000954 1781227581.743335 mapread 0x02762c thru 0x02a439 (0x2e0e bytes) 000956 1781227581.744938 mapwrite 0x033072 thru 0x03ac28 (0x7bb7 bytes) 000960 1781227581.831953 write 0x008f64 thru 0x0188bd (0xf95a bytes) 000965 1781227581.853078 mapwrite 0x012aa2 thru 0x014d5d (0x22bc bytes) 000966 1781227581.946191 read 0x02e154 thru 0x031dda (0x3c87 bytes) 000968 1781227581.947507 mapread 0x01f8fc thru 0x027dd1 (0x84d6 bytes) 000971 1781227581.951997 mapread 0x016a8b thru 0x022eb7 (0xc42d bytes) 000972 1781227581.953805 write 0x01c78f thru 0x01e719 (0x1f8b bytes) 000974 1781227581.955735 mapread 0x0225e2 thru 0x023cb3 (0x16d2 bytes) 000975 1781227581.957470 read 0x01f2d6 thru 0x028b2e (0x9859 bytes) 000976 1781227581.958533 write 0x026df8 thru 0x033f07 (0xd110 bytes) 000977 1781227581.961072 read 0x01fa03 thru 0x02ada9 (0xb3a7 bytes) 000978 1781227581.962104 write 0x03b834 thru 0x03ffff (0x47cc bytes) 000979 1781227581.963811 mapwrite 0x03d4ec thru 0x03eb48 (0x165d bytes) 000981 1781227582.056699 read 0x006e58 thru 0x010688 (0x9831 bytes) 000985 1781227582.068298 trunc from 0x040000 to 0x018c0e (0x273f1 bytes) 000986 1781227582.100235 mapwrite 0x025786 thru 0x02b548 (0x5dc3 bytes) 000987 1781227582.191902 write 0x0091f9 thru 0x010574 (0x737c bytes) 000988 1781227582.194314 trunc from 0x02b549 to 0x03796f (0xc427 bytes) 000989 1781227582.209227 mapread 0x014463 thru 0x01f0d3 (0xac71 bytes) 000990 1781227582.211072 mapread 0x0187a9 thru 0x024dc0 (0xc618 bytes) 000992 1781227582.214528 read 0x00180c thru 0x00b976 (0xa16b bytes) 000995 1781227582.217721 trunc from 0x037970 to 0x035194 (0x27db bytes) 000997 1781227582.235411 mapread 0x028a44 thru 0x035194 (0xc751 bytes) 000998 1781227582.253326 read 0x01f92b thru 0x0218ad (0x1f83 bytes) 000999 1781227582.254114 read 0x00f6d3 thru 0x0134c1 (0x3def bytes) 001000 1781227582.266307 read 0x0309e6 thru 0x035194 (0x47af bytes) All operations completed A-OK!