== sanity-flr test 70a: flr mode fsx test ================ 18:12:08 (1784585528) Seed set to 5530 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read 000007 1784585530.569662 write 0x00b330 thru 0x016a63 (0xb734 bytes) 000008 1784585530.573411 write 0x00fc96 thru 0x01520d (0x5578 bytes) 000009 1784585530.577824 mapread 0x005296 thru 0x00b211 (0x5f7c bytes) 000011 1784585530.597547 mapread 0x0167a9 thru 0x016a63 (0x2bb bytes) 000012 1784585530.600412 write 0x00a2ff thru 0x012fad (0x8caf bytes) 000013 1784585530.615128 mapread 0x0124f2 thru 0x016a63 (0x4572 bytes) 000015 1784585530.617506 write 0x01f1d6 thru 0x02cff4 (0xde1f bytes) 000016 1784585530.619790 read 0x003541 thru 0x011f11 (0xe9d1 bytes) 000017 1784585530.620761 mapwrite 0x007987 thru 0x017408 (0xfa82 bytes) truncating to largest ever: 0x7297 000019 1784585530.685690 trunc from 0x02cff5 to 0x007296 (0x25d5e bytes) truncating to largest ever: 0x35524 000020 1784585530.703153 trunc from 0x007297 to 0x035523 (0x2e28d bytes) 000022 1784585530.727041 write 0x0383f3 thru 0x03f77b (0x7389 bytes) 000023 1784585530.729021 mapread 0x014cb0 thru 0x018a93 (0x3de4 bytes) 000024 1784585530.746241 mapread 0x031f26 thru 0x0341ac (0x2287 bytes) 000025 1784585530.760911 write 0x00e107 thru 0x0152f6 (0x71f0 bytes) 000026 1784585530.763512 trunc from 0x03f77c to 0x00f583 (0x301f8 bytes) 000029 1784585530.793879 MIRROR_EXTEND to 2 mirrors 000031 1784585531.591800 write 0x0075cb thru 0x01533f (0xdd75 bytes) 000034 1784585531.685656 mapwrite 0x026ae7 thru 0x030645 (0x9b5f bytes) 000036 1784585531.853333 mapread 0x00855d thru 0x01850c (0xffb0 bytes) 000037 1784585531.871675 read 0x015bc4 thru 0x022c9d (0xd0da bytes) 000041 1784585531.881064 write 0x03cd09 thru 0x03ffff (0x32f7 bytes) 000042 1784585531.882829 mapread 0x022ae5 thru 0x0271f4 (0x4710 bytes) 000043 1784585531.884260 read 0x00ff83 thru 0x019397 (0x9415 bytes) 000044 1784585531.885129 write 0x033525 thru 0x036c81 (0x375d bytes) 000046 1784585531.896649 write 0x03ae63 thru 0x03ffff (0x519d bytes) 000047 1784585531.898192 trunc from 0x040000 to 0x0173f9 (0x28c06 bytes) 000049 1784585531.915556 write 0x01748a thru 0x01793b (0x4b2 bytes) 000052 1784585531.918568 read 0x00a03f thru 0x011997 (0x7959 bytes) 000053 1784585531.919596 trunc from 0x01793c to 0x030992 (0x19057 bytes) 000054 1784585531.940602 read 0x0025fb thru 0x00f2e0 (0xcce6 bytes) 000056 1784585531.942203 mapread 0x002a87 thru 0x00cda4 (0xa31e bytes) 000057 1784585531.943822 read 0x00e883 thru 0x012a64 (0x41e2 bytes) 000060 1784585531.946757 mapwrite 0x025145 thru 0x02d2fc (0x81b8 bytes) 000061 1784585532.020155 trunc from 0x030993 to 0x017b68 (0x18e2a bytes) 000063 1784585532.057217 read 0x0011ed thru 0x006009 (0x4e1d bytes) 000066 1784585532.063836 mapwrite 0x02f1e1 thru 0x03d62b (0xe44b bytes) 000067 1784585532.164413 read 0x016fe6 thru 0x0245e4 (0xd5ff bytes) 000068 1784585532.166896 write 0x016080 thru 0x01e158 (0x80d9 bytes) 000069 1784585532.168370 write 0x036114 thru 0x03c451 (0x633e bytes) 000070 1784585532.174268 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000072 1784585532.352813 read 0x03b661 thru 0x03d62b (0x1fcb bytes) 000073 1784585532.365738 read 0x011ad9 thru 0x01595f (0x3e87 bytes) 000077 1784585532.389076 mapread 0x0035cd thru 0x004e4a (0x187e bytes) 000079 1784585532.390857 write 0x03586e thru 0x03ffff (0xa792 bytes) truncating to largest ever: 0x3c35c 000080 1784585532.395136 trunc from 0x040000 to 0x03c35b (0x3ca4 bytes) 000085 1784585532.423461 mapwrite 0x03b5eb thru 0x03ffff (0x4a15 bytes) 000086 1784585532.527993 trunc from 0x040000 to 0x0333d2 (0xcc2d bytes) 000087 1784585532.559572 trunc from 0x0333d3 to 0x00cacd (0x26905 bytes) 000088 1784585532.592425 mapread 0x008076 thru 0x00cacd (0x4a58 bytes) 000092 1784585532.600787 read 0x00bf7f thru 0x00cacd (0xb4f bytes) 000093 1784585532.603606 write 0x023362 thru 0x032db1 (0xfa50 bytes) 000096 1784585532.608852 trunc from 0x032db2 to 0x03c224 (0x9473 bytes) 000097 1784585532.639303 write 0x00e335 thru 0x0129e4 (0x46b0 bytes) 000099 1784585532.668669 mapread 0x018683 thru 0x01efe3 (0x6961 bytes) 000101 1784585532.678649 MIRROR_EXTEND to 2 mirrors 000103 1784585533.476631 MIRROR_RESYNC 2 mirrors 000104 1784585533.850107 read 0x01026d thru 0x017f90 (0x7d24 bytes) 000106 1784585533.882975 mapwrite 0x005bcf thru 0x006d2b (0x115d bytes) 000107 1784585534.131758 write 0x0300bf thru 0x03172c (0x166e bytes) 000108 1784585534.148535 mapwrite 0x03387e thru 0x03ffff (0xc782 bytes) 000110 1784585534.221081 mapwrite 0x02913b thru 0x02b5c6 (0x248c bytes) 000111 1784585534.262830 trunc from 0x040000 to 0x016583 (0x29a7c bytes) 000112 1784585534.285447 read 0x00e543 thru 0x016583 (0x8041 bytes) 000113 1784585534.298075 write 0x01d517 thru 0x02bd11 (0xe7fb bytes) 000114 1784585534.300709 write 0x03dbb1 thru 0x03eab7 (0xf07 bytes) 000115 1784585534.304453 trunc from 0x03eab8 to 0x00aa2d (0x3408a bytes) 000116 1784585534.344184 read 0x008d4a thru 0x00aa2d (0x1ce4 bytes) 000119 1784585534.350226 mapwrite 0x012b23 thru 0x018b7e (0x605c bytes) 000121 1784585534.432633 mapread 0x0120d7 thru 0x018b7e (0x6aa8 bytes) 000122 1784585534.439451 mapread 0x002836 thru 0x006a03 (0x41ce bytes) 000123 1784585534.442899 trunc from 0x018b7f to 0x027389 (0xe80b bytes) 000124 1784585534.470583 read 0x024549 thru 0x027389 (0x2e41 bytes) 000125 1784585534.483225 trunc from 0x02738a to 0x023f40 (0x3449 bytes) 000126 1784585534.515690 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x23f41): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f41): Mirror 2: 0x9fc5b65 (stale) CRC-32 checksum value for chunk [0, 0x23f41): Mirror 1: 0xc94b3e23 Mirror 3: 0xc94b3e23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f41: skipped 000127 1784585535.777787 read 0x00ade8 thru 0x01906f (0xe288 bytes) 000130 1784585535.827515 write 0x014d41 thru 0x01659b (0x185b bytes) 000131 1784585535.995132 write 0x00c397 thru 0x015c25 (0x988f bytes) 000133 1784585536.003458 trunc from 0x023f41 to 0x016109 (0xde37 bytes) 000135 1784585536.035952 write 0x024bc9 thru 0x02af54 (0x638c bytes) 000137 1784585536.039748 mapwrite 0x01a3c2 thru 0x029437 (0xf076 bytes) 000138 1784585536.142647 read 0x004c1d thru 0x012d3c (0xe120 bytes) 000139 1784585536.159421 read 0x00b8b7 thru 0x018555 (0xcc9f bytes) 000140 1784585536.165565 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2af55): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2af55): Mirror 2: 0xfc045be2 (stale) Mirror 3: 0x4330748 (stale) CRC-32 checksum value for chunk [0, 0x2af55): Mirror 1: 0x1ffb65d2 Mirror 4: 0x1ffb65d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2af55: skipped 000141 1784585537.189548 mapwrite 0x0153d2 thru 0x0173ca (0x1ff9 bytes) 000142 1784585537.399984 trunc from 0x02af55 to 0x032856 (0x7902 bytes) 000143 1784585537.457572 read 0x02e577 thru 0x031f72 (0x39fc bytes) 000144 1784585537.469029 read 0x000574 thru 0x00c769 (0xc1f6 bytes) 000145 1784585537.489369 mapwrite 0x03f613 thru 0x03ffff (0x9ed bytes) 000146 1784585537.620067 mapwrite 0x0100ff thru 0x01341e (0x3320 bytes) 000148 1784585537.695843 mapwrite 0x01722b thru 0x01d1f6 (0x5fcc bytes) 000152 1784585537.758010 mapwrite 0x010b89 thru 0x0113ea (0x862 bytes) 000153 1784585537.815136 mapwrite 0x024ceb thru 0x0306d3 (0xb9e9 bytes) 000155 1784585537.879271 mapread 0x02b379 thru 0x03b20a (0xfe92 bytes) 000156 1784585537.883311 write 0x02f783 thru 0x03a95e (0xb1dc bytes) 000158 1784585537.897895 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x52eb8a (stale) Mirror 3: 0xfdc59aa9 (stale) Mirror 4: 0x54e55110 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc81698f Mirror 5: 0xc81698f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000159 1784585538.979506 write 0x028c83 thru 0x02d47d (0x47fb bytes) 000162 1784585539.109483 mapwrite 0x020c15 thru 0x030198 (0xf584 bytes) 000164 1784585539.240714 write 0x0212cf thru 0x02b63f (0xa371 bytes) 000165 1784585539.243811 trunc from 0x040000 to 0x026194 (0x19e6b bytes) 000167 1784585539.280494 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26195): Mirror 2: 0x493576ea (stale) Mirror 3: 0x2115a168 (stale) Mirror 4: 0x6aeb1f78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26195): Mirror 2: 0x493576ea (stale) Mirror 3: 0x2115a168 (stale) Mirror 4: 0x6aeb1f78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26195: skipped 000168 1784585539.814878 mapwrite 0x0045b4 thru 0x00b6ee (0x713b bytes) 000171 1784585539.959674 mapwrite 0x019e96 thru 0x027bf3 (0xdd5e bytes) 000172 1784585540.089817 mapwrite 0x009994 thru 0x0166ef (0xcd5c bytes) 000174 1784585540.160226 MIRROR_RESYNC 4 mirrors 000177 1784585541.438263 read 0x007111 thru 0x009056 (0x1f46 bytes) 000178 1784585541.446426 read 0x018a6b thru 0x01c19b (0x3731 bytes) 000179 1784585541.474333 mapwrite 0x00ac31 thru 0x00f02a (0x43fa bytes) 000181 1784585541.670356 write 0x000fbd thru 0x003366 (0x23aa bytes) 000183 1784585541.697653 mapread 0x0030d8 thru 0x012452 (0xf37b bytes) 000184 1784585541.796662 read 0x018a08 thru 0x01ee9f (0x6498 bytes) 000185 1784585541.823722 write 0x01dd21 thru 0x01fffb (0x22db bytes) 000186 1784585541.828644 trunc from 0x027bf4 to 0x006a89 (0x2116a bytes) 000188 1784585541.872760 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6a8a): Mirror 2: 0x47dcabf8 (stale) Mirror 4: 0x47dcabf8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6a8a): Mirror 2: 0x47dcabf8 (stale) Mirror 4: 0x47dcabf8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6a8a: skipped 000189 1784585542.295564 write 0x02bbd0 thru 0x03631d (0xa74e bytes) 000190 1784585542.298756 read 0x007bce thru 0x014c70 (0xd0a3 bytes) 000193 1784585542.310833 read 0x026d39 thru 0x036198 (0xf460 bytes) 000194 1784585542.324825 mapwrite 0x0308a0 thru 0x032b40 (0x22a1 bytes) 000196 1784585542.380865 read 0x003e4b thru 0x0128aa (0xea60 bytes) 000198 1784585542.384676 read 0x011788 thru 0x020094 (0xe90d bytes) 000199 1784585542.386610 read 0x0045af thru 0x011fca (0xda1c bytes) 000201 1784585542.388884 mapwrite 0x021f90 thru 0x02350f (0x1580 bytes) 000202 1784585542.452867 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3631e): Mirror 2: 0x14f00381 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3631e): Mirror 2: 0x14f00381 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3631e: skipped 000203 1784585542.910433 mapwrite 0x03d550 thru 0x03ffff (0x2ab0 bytes) 000204 1784585543.037564 mapread 0x0219e5 thru 0x02bf53 (0xa56f bytes) 000207 1784585543.065878 MIRROR_RESYNC 2 mirrors 000210 1784585544.131644 read 0x016bba thru 0x01b410 (0x4857 bytes) 000211 1784585544.144491 read 0x02b814 thru 0x035b0a (0xa2f7 bytes) 000214 1784585544.170827 trunc from 0x040000 to 0x03aa69 (0x5596 bytes) 000215 1784585544.252803 trunc from 0x03aa6a to 0x009afe (0x30f6b bytes) 000216 1784585544.311676 trunc from 0x009aff to 0x0060b2 (0x3a4c bytes) 000217 1784585544.334197 read 0x0050ca thru 0x0060b2 (0xfe9 bytes) 000218 1784585544.349274 read 0x00520d thru 0x0060b2 (0xea6 bytes) 000219 1784585544.357751 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x60b3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x60b3): Mirror 2: 0x2d0ddada (stale) CRC-32 checksum value for chunk [0, 0x60b3): Mirror 1: 0x2d0ddada Mirror 3: 0x2d0ddada lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x60b3: skipped 000220 1784585545.324407 write 0x032c7d thru 0x03ffff (0xd383 bytes) 000221 1784585545.408022 write 0x027514 thru 0x02f90b (0x83f8 bytes) 000222 1784585545.422519 trunc from 0x040000 to 0x027bc0 (0x1843f bytes) 000224 1784585545.480825 trunc from 0x027bc1 to 0x02b8d4 (0x3d14 bytes) 000229 1784585545.547197 mapwrite 0x029d7c thru 0x0335c0 (0x9845 bytes) 000231 1784585545.685867 mapread 0x01a92b thru 0x022c9c (0x8372 bytes) 000234 1784585545.728117 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x335c1): Mirror 2: 0x87b6dd37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x335c1): Mirror 2: 0x87b6dd37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x335c1: skipped 000236 1784585546.054743 read 0x00ee1a thru 0x011aae (0x2c95 bytes) 000237 1784585546.064254 mapread 0x02db6f thru 0x02fe27 (0x22b9 bytes) 000238 1784585546.090546 mapread 0x00c81e thru 0x01416a (0x794d bytes) 000239 1784585546.106304 write 0x010c0b thru 0x01b86b (0xac61 bytes) 000240 1784585546.111841 mapread 0x023902 thru 0x02f650 (0xbd4f bytes) 000241 1784585546.122210 read 0x018f2e thru 0x01d3be (0x4491 bytes) 000242 1784585546.123777 read 0x000823 thru 0x00c9d5 (0xc1b3 bytes) 000244 1784585546.133583 trunc from 0x0335c1 to 0x00aaec (0x28ad4 bytes) 000245 1784585546.152014 read 0x009105 thru 0x00aaec (0x19e8 bytes) 000246 1784585546.154792 trunc from 0x00aaed to 0x020df6 (0x1630a bytes) 000248 1784585546.211527 trunc from 0x020df7 to 0x011a94 (0xf362 bytes) 000249 1784585546.228394 read 0x008f8f thru 0x00fce5 (0x6d57 bytes) 000252 1784585546.254892 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000253 1784585546.480120 mapwrite 0x014dda thru 0x0239d9 (0xec00 bytes) 000256 1784585546.674725 read 0x010ce2 thru 0x01b737 (0xaa56 bytes) 000257 1784585546.675576 trunc from 0x0239da to 0x00c1c5 (0x17814 bytes) 000259 1784585546.712225 write 0x03e888 thru 0x03e8ad (0x26 bytes) 000260 1784585546.715481 read 0x038307 thru 0x03e8ad (0x65a7 bytes) 000261 1784585546.742184 mapwrite 0x01acf3 thru 0x023a92 (0x8da0 bytes) 000264 1784585546.870124 mapwrite 0x002bad thru 0x00b006 (0x845a bytes) 000266 1784585546.927529 mapread 0x01e322 thru 0x02c8c0 (0xe59f bytes) 000267 1784585546.929199 write 0x02b6f6 thru 0x036b98 (0xb4a3 bytes) 000270 1784585546.932175 mapread 0x00cf12 thru 0x018b12 (0xbc01 bytes) 000271 1784585546.933642 mapread 0x02b309 thru 0x02d93c (0x2634 bytes) 000274 1784585546.936902 write 0x000eec thru 0x00840e (0x7523 bytes) 000280 1784585546.942511 read 0x011d7f thru 0x0135e6 (0x1868 bytes) 000284 1784585546.945388 write 0x035ede thru 0x03ffff (0xa122 bytes) 000285 1784585546.947028 mapwrite 0x0157d8 thru 0x015dfb (0x624 bytes) 000286 1784585547.013290 read 0x00765e thru 0x00fd61 (0x8704 bytes) 000288 1784585547.017905 mapread 0x0183a2 thru 0x01bde7 (0x3a46 bytes) 000290 1784585547.020044 mapread 0x01d6c2 thru 0x025df3 (0x8732 bytes) 000291 1784585547.025093 trunc from 0x040000 to 0x02a4a3 (0x15b5c bytes) 000293 1784585547.046905 mapwrite 0x002ca0 thru 0x00c4f1 (0x9852 bytes) 000297 1784585547.159439 trunc from 0x02a4a4 to 0x004f6c (0x25537 bytes) 000298 1784585547.203831 write 0x03f871 thru 0x03ffff (0x78f bytes) 000300 1784585547.211340 mapwrite 0x008385 thru 0x013fde (0xbc5a bytes) 000301 1784585547.302055 read 0x03a1a0 thru 0x03ee34 (0x4c95 bytes) 000302 1784585547.302828 trunc from 0x040000 to 0x01af07 (0x250f8 bytes) 000303 1784585547.329203 mapread 0x0140af thru 0x019643 (0x5595 bytes) 000306 1784585547.333694 mapread 0x00257c thru 0x00a2eb (0x7d70 bytes) 000307 1784585547.335738 mapwrite 0x03fab6 thru 0x03ffff (0x54a bytes) 000309 1784585547.446478 trunc from 0x040000 to 0x012f62 (0x2d09d bytes) 000312 1784585547.495579 mapwrite 0x01c7f1 thru 0x021d6a (0x557a bytes) 000315 1784585547.703794 trunc from 0x021d6b to 0x022b16 (0xdac bytes) 000317 1784585547.739784 mapwrite 0x0363da thru 0x0383dc (0x2003 bytes) 000318 1784585547.828202 write 0x0152a8 thru 0x016b3a (0x1893 bytes) 000319 1784585547.841243 mapwrite 0x039486 thru 0x03ee12 (0x598d bytes) 000321 1784585547.979871 read 0x0043ad thru 0x0106ea (0xc33e bytes) 000322 1784585547.981909 mapwrite 0x036abf thru 0x03dcca (0x720c bytes) 000325 1784585548.078252 write 0x03970d thru 0x03ae00 (0x16f4 bytes) 000326 1784585548.080134 write 0x02843d thru 0x02be6b (0x3a2f bytes) 000327 1784585548.127133 MIRROR_EXTEND to 2 mirrors 000328 1784585549.299636 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000330 1784585549.497798 mapread 0x01c42e thru 0x01d4e4 (0x10b7 bytes) 000334 1784585549.526374 mapwrite 0x03bc14 thru 0x03e71b (0x2b08 bytes) 000336 1784585549.591839 trunc from 0x03ee13 to 0x03643d (0x89d5 bytes) 000339 1784585549.645162 mapread 0x0097cf thru 0x018d0f (0xf541 bytes) 000340 1784585549.678674 trunc from 0x03643e to 0x01c32d (0x1a110 bytes) 000344 1784585549.720347 read 0x016f45 thru 0x01c32d (0x53e9 bytes) 000348 1784585549.738970 trunc from 0x01c32e to 0x0362a2 (0x19f75 bytes) 000354 1784585549.816549 write 0x034205 thru 0x03ffff (0xbdfb bytes) 000355 1784585549.841402 trunc from 0x040000 to 0x0380e0 (0x7f1f bytes) 000356 1784585549.886599 MIRROR_EXTEND to 2 mirrors 000357 1784585551.170447 mapread 0x025a0f thru 0x026f5d (0x154f bytes) 000361 1784585551.251347 write 0x03de6c thru 0x03ffff (0x2194 bytes) truncating to largest ever: 0x3e1c0 000363 1784585551.412235 trunc from 0x040000 to 0x03e1bf (0x1e40 bytes) 000366 1784585551.439541 mapread 0x01c8ac thru 0x02190d (0x5062 bytes) 000367 1784585551.460744 mapwrite 0x00fae2 thru 0x01e91c (0xee3b bytes) 000369 1784585551.612054 MIRROR_RESYNC 2 mirrors 000371 1784585552.860168 mapwrite 0x023e26 thru 0x0306cc (0xc8a7 bytes) 000375 1784585553.133191 write 0x00b816 thru 0x00bcb0 (0x49b bytes) 000377 1784585553.158818 mapwrite 0x0306cb thru 0x039ad9 (0x940f bytes) 000378 1784585553.261417 mapread 0x029ea2 thru 0x031b5e (0x7cbd bytes) 000381 1784585553.268057 mapwrite 0x03d65e thru 0x03ffff (0x29a2 bytes) 000382 1784585553.438355 mapread 0x02c267 thru 0x02ccc8 (0xa62 bytes) 000383 1784585553.439809 read 0x02c540 thru 0x02f63d (0x30fe bytes) 000384 1784585553.449439 mapread 0x038bc4 thru 0x03ffff (0x743c bytes) 000386 1784585553.451225 trunc from 0x040000 to 0x02913c (0x16ec3 bytes) 000387 1784585553.488728 write 0x034845 thru 0x03644b (0x1c07 bytes) 000388 1784585553.491765 read 0x0179d4 thru 0x01a007 (0x2634 bytes) 000394 1784585553.537448 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000395 1784585553.887713 mapread 0x00ad90 thru 0x017366 (0xc5d7 bytes) 000397 1784585553.942560 MIRROR_EXTEND to 2 mirrors 000399 1784585555.011383 mapwrite 0x035a16 thru 0x03c293 (0x687e bytes) 000400 1784585555.507871 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000402 1784585555.705217 read 0x003df5 thru 0x00ac04 (0x6e10 bytes) 000403 1784585555.734826 write 0x029af4 thru 0x037b6b (0xe078 bytes) 000407 1784585555.763709 mapwrite 0x01cc30 thru 0x022dfb (0x61cc bytes) 000408 1784585555.943310 mapwrite 0x01ccf4 thru 0x02a2f3 (0xd600 bytes) 000410 1784585556.181630 trunc from 0x03c294 to 0x000e2e (0x3b465 bytes) 000412 1784585556.214620 trunc from 0x000e2f to 0x001bb3 (0xd85 bytes) 000413 1784585556.247658 MIRROR_EXTEND to 2 mirrors 000415 1784585557.302251 mapread 0x000529 thru 0x001bb3 (0x168b bytes) 000416 1784585557.337327 mapwrite 0x02b992 thru 0x02c478 (0xae7 bytes) 000417 1784585557.470562 write 0x03d305 thru 0x03ffff (0x2cfb bytes) 000420 1784585557.477724 read 0x024469 thru 0x032189 (0xdd21 bytes) 000423 1784585557.493199 mapread 0x004419 thru 0x010d78 (0xc960 bytes) 000424 1784585557.517166 mapread 0x007496 thru 0x0138f7 (0xc462 bytes) 000425 1784585557.538509 mapwrite 0x0325d5 thru 0x03c1af (0x9bdb bytes) 000428 1784585557.695161 MIRROR_RESYNC 2 mirrors 000429 1784585559.066560 mapwrite 0x025d87 thru 0x0296e4 (0x395e bytes) 000430 1784585559.218080 write 0x039ee5 thru 0x03eb42 (0x4c5e bytes) 000432 1784585559.242645 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000434 1784585559.495991 trunc from 0x040000 to 0x037d92 (0x826d bytes) 000435 1784585559.518382 write 0x03cd8f thru 0x03ffff (0x3271 bytes) 000437 1784585559.524370 read 0x022197 thru 0x026d39 (0x4ba3 bytes) 000438 1784585559.535410 mapwrite 0x03e7c2 thru 0x03efd5 (0x814 bytes) 000440 1784585559.597501 mapread 0x015ef8 thru 0x01c8bf (0x69c8 bytes) 000441 1784585559.626422 trunc from 0x040000 to 0x015770 (0x2a88f bytes) 000442 1784585559.647439 trunc from 0x015771 to 0x01d893 (0x8123 bytes) 000445 1784585559.672593 write 0x00e7e5 thru 0x0101c8 (0x19e4 bytes) 000446 1784585559.689501 write 0x01054f thru 0x014d2a (0x47dc bytes) 000449 1784585559.701178 read 0x01d577 thru 0x01d893 (0x31d bytes) 000450 1784585559.717614 trunc from 0x01d894 to 0x02b187 (0xd8f4 bytes) 000451 1784585559.748082 mapwrite 0x002146 thru 0x00f89b (0xd756 bytes) 000452 1784585559.816416 read 0x01ee46 thru 0x026ede (0x8099 bytes) 000453 1784585559.831808 write 0x03488e thru 0x03ffff (0xb772 bytes) 000454 1784585559.836588 mapread 0x030f57 thru 0x038b1b (0x7bc5 bytes) 000457 1784585559.853015 mapread 0x012f24 thru 0x01b0a9 (0x8186 bytes) 000459 1784585559.857080 read 0x02923f thru 0x02a4d6 (0x1298 bytes) 000461 1784585559.862401 trunc from 0x040000 to 0x028be0 (0x1741f bytes) 000463 1784585559.898213 read 0x009f5c thru 0x019dfb (0xfea0 bytes) 000465 1784585559.901705 mapwrite 0x00a02f thru 0x00b534 (0x1506 bytes) 000466 1784585559.973411 MIRROR_EXTEND to 2 mirrors 000468 1784585561.536714 trunc from 0x028be1 to 0x01b1ba (0xda26 bytes) 000470 1784585561.689957 mapwrite 0x0036c8 thru 0x005d05 (0x263e bytes) 000471 1784585561.897343 mapwrite 0x01a8ed thru 0x026a24 (0xc138 bytes) 000472 1784585562.026077 write 0x00064e thru 0x00549a (0x4e4d bytes) 000473 1784585562.036899 mapread 0x022c76 thru 0x025e63 (0x31ee bytes) 000475 1784585562.038692 write 0x01fa7a thru 0x023fb4 (0x453b bytes) 000476 1784585562.044762 write 0x0219ce thru 0x031319 (0xf94c bytes) 000477 1784585562.064221 trunc from 0x03131a to 0x027db5 (0x9564 bytes) 000478 1784585562.094284 trunc from 0x027db6 to 0x000405 (0x279b0 bytes) 000479 1784585562.120216 mapwrite 0x024642 thru 0x02945c (0x4e1b bytes) 000482 1784585562.245784 mapread 0x000505 thru 0x0060ca (0x5bc6 bytes) 000484 1784585562.275562 write 0x02b0d0 thru 0x0342fc (0x922d bytes) 000485 1784585562.279407 read 0x02b64e thru 0x02de0e (0x27c1 bytes) 000487 1784585562.283073 trunc from 0x0342fd to 0x010b45 (0x237b7 bytes) 000488 1784585562.319595 mapwrite 0x0240f7 thru 0x02d64d (0x9557 bytes) 000489 1784585562.402637 write 0x03bf9e thru 0x03ffff (0x4062 bytes) 000490 1784585562.404487 read 0x03e874 thru 0x03ffff (0x178c bytes) 000493 1784585562.407471 write 0x02bacc thru 0x02d4f2 (0x1a27 bytes) 000494 1784585562.408616 write 0x002278 thru 0x00f7a0 (0xd529 bytes) 000495 1784585562.411732 write 0x02dfb3 thru 0x03d0b3 (0xf101 bytes) 000496 1784585562.416016 mapread 0x004dea thru 0x00dc1e (0x8e35 bytes) 000499 1784585562.418436 mapwrite 0x0185c2 thru 0x01ae55 (0x2894 bytes) 000500 1784585562.508476 mapread 0x030dea thru 0x034445 (0x365c bytes) 000501 1784585562.509629 trunc from 0x040000 to 0x02a4c9 (0x15b36 bytes) 000502 1784585562.527556 write 0x02d5df thru 0x03570b (0x812d bytes) 000503 1784585562.530335 mapwrite 0x01af23 thru 0x026634 (0xb712 bytes) 000505 1784585562.597572 write 0x017c20 thru 0x01d3f7 (0x57d8 bytes) 000506 1784585562.600175 mapwrite 0x029064 thru 0x033dce (0xad6b bytes) 000507 1784585562.668180 trunc from 0x03570c to 0x00615d (0x2f5ae bytes) 000508 1784585562.687967 mapread 0x004a49 thru 0x00615d (0x1715 bytes) 000510 1784585562.691005 mapwrite 0x01daaa thru 0x022c0a (0x5161 bytes) 000512 1784585562.842208 read 0x012da1 thru 0x020cec (0xdf4c bytes) 000513 1784585562.857594 write 0x003c45 thru 0x00ec7f (0xb03b bytes) truncating to largest ever: 0x3fef5 000515 1784585562.860731 trunc from 0x022c0b to 0x03fef4 (0x1d2ea bytes) 000516 1784585562.880905 trunc from 0x03fef5 to 0x017a9d (0x28457 bytes) 000517 1784585562.916632 write 0x0319f2 thru 0x03c140 (0xa74f bytes) 000519 1784585562.920357 write 0x001ef5 thru 0x00d87a (0xb986 bytes) 000520 1784585562.921843 write 0x01334d thru 0x017898 (0x454c bytes) 000521 1784585562.923718 mapread 0x035540 thru 0x03c140 (0x6c01 bytes) 000525 1784585562.927585 read 0x01657d thru 0x020495 (0x9f19 bytes) 000526 1784585562.937837 read 0x0369ab thru 0x03c140 (0x5796 bytes) 000528 1784585562.940099 read 0x029197 thru 0x0359f9 (0xc863 bytes) 000530 1784585562.947547 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c141): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c141): Mirror 2: 0xa37ef904 (stale) CRC-32 checksum value for chunk [0, 0x3c141): Mirror 1: 0x3828a052 Mirror 3: 0x3828a052 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c141: skipped 000531 1784585564.355884 mapread 0x02e0c5 thru 0x037ce2 (0x9c1e bytes) 000533 1784585564.461156 MIRROR_RESYNC 3 mirrors 000534 1784585565.796510 mapread 0x00d25b thru 0x010773 (0x3519 bytes) 000535 1784585565.843994 write 0x0045ab thru 0x013c50 (0xf6a6 bytes) 000536 1784585565.971042 MIRROR_RESYNC 3 mirrors 000539 1784585567.353525 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000540 1784585567.761307 trunc from 0x03c141 to 0x0180b7 (0x24089 bytes) 000542 1784585567.927313 read 0x013908 thru 0x0180b7 (0x47b0 bytes) 000543 1784585567.974873 mapread 0x00cf94 thru 0x011902 (0x496f bytes) 000544 1784585568.038268 write 0x020bc3 thru 0x02ae20 (0xa25e bytes) 000545 1784585568.040080 mapread 0x01e12c thru 0x02ae20 (0xccf5 bytes) 000546 1784585568.059185 read 0x02527b thru 0x02ae20 (0x5ba6 bytes) 000548 1784585568.060651 trunc from 0x02ae21 to 0x030f97 (0x6177 bytes) 000550 1784585568.106637 mapread 0x0072d2 thru 0x0165b8 (0xf2e7 bytes) 000555 1784585568.115771 mapread 0x02d125 thru 0x030f97 (0x3e73 bytes) 000556 1784585568.144522 MIRROR_RESYNC 2 mirrors 000559 1784585569.132857 read 0x01340e thru 0x023009 (0xfbfc bytes) 000562 1784585569.152350 mapread 0x00459e thru 0x00fb18 (0xb57b bytes) 000563 1784585569.215069 MIRROR_EXTEND to 3 mirrors 000565 1784585570.446609 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000567 1784585571.128287 MIRROR_EXTEND to 3 mirrors 000568 1784585572.180566 mapread 0x0024f5 thru 0x00f114 (0xcc20 bytes) 000569 1784585572.217408 mapread 0x01b5b8 thru 0x02093f (0x5388 bytes) 000570 1784585572.246268 read 0x000e2b thru 0x0090c4 (0x829a bytes) 000571 1784585572.263429 MIRROR_EXTEND to 4 mirrors 000572 1784585573.153406 write 0x018802 thru 0x024c86 (0xc485 bytes) 000574 1784585573.265120 read 0x02c28a thru 0x030f97 (0x4d0e bytes) 000575 1784585573.277212 trunc from 0x030f98 to 0x0389c2 (0x7a2b bytes) 000576 1784585573.335809 trunc from 0x0389c3 to 0x03ee72 (0x64b0 bytes) 000579 1784585573.357014 trunc from 0x03ee73 to 0x0132de (0x2bb94 bytes) 000580 1784585573.376107 mapread 0x009821 thru 0x00c09b (0x287b bytes) 000584 1784585573.407320 write 0x0315f3 thru 0x03b143 (0x9b51 bytes) 000585 1784585573.409523 trunc from 0x03b144 to 0x00f001 (0x2c142 bytes) 000586 1784585573.434192 write 0x004a5b thru 0x00ae7e (0x6424 bytes) 000587 1784585573.437236 write 0x01fabf thru 0x025e07 (0x6349 bytes) 000590 1784585573.442301 read 0x0055cf thru 0x00d7e8 (0x821a bytes) 000591 1784585573.443858 mapread 0x01b4c9 thru 0x025e07 (0xa93f bytes) 000592 1784585573.456743 mapwrite 0x01b474 thru 0x0285f7 (0xd184 bytes) 000593 1784585573.551272 MIRROR_RESYNC 4 mirrors 000595 1784585574.585371 read 0x0143f9 thru 0x0199fa (0x5602 bytes) 000599 1784585574.608830 read 0x004bc0 thru 0x013a5f (0xeea0 bytes) 000601 1784585574.634354 mapwrite 0x017f9c thru 0x021cc9 (0x9d2e bytes) 000603 1784585574.894048 read 0x0179c2 thru 0x0219e3 (0xa022 bytes) 000604 1784585574.897524 trunc from 0x0285f8 to 0x01465e (0x13f99 bytes) 000606 1784585574.939804 mapwrite 0x03f5c6 thru 0x03ffff (0xa3a bytes) 000608 1784585575.078675 MIRROR_RESYNC 4 mirrors 000609 1784585576.573280 MIRROR_EXTEND to 5 mirrors 000610 1784585577.727899 read 0x00fd7b thru 0x01f406 (0xf68c bytes) 000613 1784585577.740306 write 0x03d299 thru 0x03ffff (0x2d67 bytes) 000615 1784585577.871617 mapwrite 0x038e9e thru 0x03ffff (0x7162 bytes) 000616 1784585577.973854 trunc from 0x040000 to 0x03cd90 (0x326f bytes) 000617 1784585578.014282 write 0x03c9e3 thru 0x03ffff (0x361d bytes) 000618 1784585578.024387 MIRROR_RESYNC 5 mirrors 000619 1784585579.968884 mapwrite 0x004747 thru 0x0073a5 (0x2c5f bytes) 000621 1784585580.212732 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe3ef39ea (stale) Mirror 5: 0xe3ef39ea (stale) Mirror 6: 0xe3ef39ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe3ef39ea (stale) Mirror 5: 0xe3ef39ea (stale) Mirror 6: 0xe3ef39ea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000622 1784585580.701567 mapread 0x006556 thru 0x014581 (0xe02c bytes) 000625 1784585580.738089 mapread 0x002eb4 thru 0x0068c5 (0x3a12 bytes) 000630 1784585580.750701 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe3ef39ea (stale) Mirror 6: 0xe3ef39ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe3ef39ea (stale) Mirror 6: 0xe3ef39ea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000633 1784585581.238100 read 0x02bccd thru 0x0393b5 (0xd6e9 bytes) 000634 1784585581.250174 read 0x01bbe9 thru 0x027ee1 (0xc2f9 bytes) 000638 1784585581.264737 write 0x03777e thru 0x03ac22 (0x34a5 bytes) 000645 1784585581.274100 write 0x02de23 thru 0x039168 (0xb346 bytes) 000647 1784585581.277118 mapread 0x024c47 thru 0x02c72f (0x7ae9 bytes) 000650 1784585581.280617 write 0x02b93b thru 0x02c420 (0xae6 bytes) 000651 1784585581.283995 mapwrite 0x03b661 thru 0x03ffff (0x499f bytes) 000652 1784585581.374173 mapwrite 0x02e9a4 thru 0x03388f (0x4eec bytes) 000653 1784585581.479174 write 0x0208fa thru 0x02e9c6 (0xe0cd bytes) 000654 1784585581.480861 mapread 0x02245c thru 0x0305da (0xe17f bytes) 000656 1784585581.487204 mapread 0x037428 thru 0x038da2 (0x197b bytes) 000657 1784585581.513815 MIRROR_RESYNC 3 mirrors 000660 1784585582.871901 mapwrite 0x029f9a thru 0x02f71f (0x5786 bytes) 000662 1784585583.166117 mapread 0x00bc9d thru 0x0194ca (0xd82e bytes) 000664 1784585583.198117 mapread 0x02123b thru 0x03107c (0xfe42 bytes) 000665 1784585583.208999 trunc from 0x040000 to 0x00c5b3 (0x33a4c bytes) 000666 1784585583.242308 read 0x00bd2e thru 0x00c5b3 (0x886 bytes) 000667 1784585583.257845 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xc5b4): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc5b4): Mirror 4: 0x565d1f17 (stale) Mirror 6: 0x565d1f17 (stale) CRC-32 checksum value for chunk [0, 0xc5b4): Mirror 1: 0x565d1f17 Mirror 7: 0x565d1f17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc5b4: skipped 000668 1784585584.314585 trunc from 0x00c5b4 to 0x015f47 (0x9994 bytes) 000669 1784585584.444748 mapread 0x012ffd thru 0x015f47 (0x2f4b bytes) 000670 1784585584.468528 trunc from 0x015f48 to 0x0028a1 (0x136a6 bytes) 000672 1784585584.498205 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28a2): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28a2): Mirror 4: 0xa348b640 (stale) Mirror 6: 0xa348b640 (stale) Mirror 7: 0xa348b640 (stale) CRC-32 checksum value for chunk [0, 0x28a2): Mirror 1: 0xa348b640 Mirror 8: 0xa348b640 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28a2: skipped 000674 1784585585.432829 trunc from 0x0028a2 to 0x03cae0 (0x3a23f bytes) 000677 1784585585.611282 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3cae1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cae1): Mirror 4: 0xd7a450f5 (stale) Mirror 6: 0xd7a450f5 (stale) Mirror 7: 0x1396d9e7 (stale) Mirror 8: 0x8934fad (stale) CRC-32 checksum value for chunk [0, 0x3cae1): Mirror 1: 0x8934fad Mirror 9: 0x8934fad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cae1: skipped 000680 1784585587.273596 trunc from 0x03cae1 to 0x003d1c (0x38dc4 bytes) 000681 1784585587.462705 trunc from 0x003d1d to 0x024602 (0x208e6 bytes) 000682 1784585587.516567 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x24603): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24603): Mirror 4: 0x1f5a4f95 (stale) Mirror 6: 0x1f5a4f95 (stale) Mirror 7: 0x8cee8f3d (stale) Mirror 8: 0x4ad0e6fa (stale) Mirror 9: 0x4ad0e6fa (stale) CRC-32 checksum value for chunk [0, 0x24603): Mirror 1: 0x4ad0e6fa Mirror 10: 0x4ad0e6fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24603: skipped 000684 1784585588.876081 write 0x019471 thru 0x01ee60 (0x59f0 bytes) 000686 1784585588.971122 mapread 0x01be89 thru 0x02174f (0x58c7 bytes) 000688 1784585588.986237 write 0x01e3a4 thru 0x01eb55 (0x7b2 bytes) 000689 1784585588.986911 read 0x00c8ff thru 0x0158f1 (0x8ff3 bytes) 000690 1784585588.996632 mapread 0x018a7c thru 0x021ab5 (0x903a bytes) 000691 1784585589.004018 mapread 0x002167 thru 0x00a21e (0x80b8 bytes) 000693 1784585589.012973 read 0x013273 thru 0x021b3b (0xe8c9 bytes) 000694 1784585589.013790 read 0x01b5d9 thru 0x024602 (0x902a bytes) 000695 1784585589.014815 trunc from 0x024603 to 0x0025b1 (0x22051 bytes) 000696 1784585589.056278 MIRROR_RESYNC 7 mirrors 000697 1784585590.894482 write 0x02ee79 thru 0x0391b3 (0xa33b bytes) 000698 1784585590.976750 mapwrite 0x01704d thru 0x017fd4 (0xf88 bytes) 000700 1784585591.095396 read 0x009a57 thru 0x00ac88 (0x1232 bytes) 000701 1784585591.102972 write 0x01793d thru 0x0231f5 (0xb8b9 bytes) 000704 1784585591.112609 mapread 0x0371fe thru 0x0385ba (0x13bd bytes) 000706 1784585591.114628 mapread 0x01b020 thru 0x01c4b3 (0x1494 bytes) 000708 1784585591.116712 read 0x0081df thru 0x0139ed (0xb80f bytes) 000712 1784585591.137509 write 0x015a06 thru 0x017414 (0x1a0f bytes) 000714 1784585591.140505 trunc from 0x0391b4 to 0x01ceba (0x1c2f9 bytes) 000718 1784585591.176325 write 0x03ebcc thru 0x03ffff (0x1434 bytes) 000719 1784585591.178379 mapread 0x02a2a4 thru 0x02b15d (0xeba bytes) 000723 1784585591.202290 trunc from 0x040000 to 0x0216d0 (0x1e92f bytes) 000726 1784585591.236621 mapread 0x001591 thru 0x0098df (0x834f bytes) 000727 1784585591.240011 read 0x01e572 thru 0x01eace (0x55d bytes) 000729 1784585591.273389 write 0x026792 thru 0x02abb1 (0x4420 bytes) 000730 1784585591.274817 write 0x006b25 thru 0x0083a3 (0x187f bytes) 000731 1784585591.276586 trunc from 0x02abb2 to 0x02baf0 (0xf3f bytes) 000733 1784585591.331136 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2baf1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2baf1): Mirror 4: 0x39de5dae (stale) Mirror 6: 0x39de5dae (stale) Mirror 7: 0x39de5dae (stale) Mirror 8: 0x39de5dae (stale) Mirror 9: 0x39de5dae (stale) Mirror 10: 0x39de5dae (stale) CRC-32 checksum value for chunk [0, 0x2baf1): Mirror 1: 0xe8477165 Mirror 11: 0xe8477165 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2baf1: skipped 000735 1784585592.641847 trunc from 0x02baf1 to 0x00415a (0x27996 bytes) 000736 1784585592.853508 trunc from 0x00415b to 0x02f2c8 (0x2b16e bytes) 000737 1784585592.921886 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f2c9): Mirror 4: 0x20585b70 (stale) Mirror 6: 0x20585b70 (stale) Mirror 7: 0x20585b70 (stale) Mirror 8: 0x20585b70 (stale) Mirror 9: 0x20585b70 (stale) Mirror 10: 0x20585b70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f2c9): Mirror 4: 0x20585b70 (stale) Mirror 6: 0x20585b70 (stale) Mirror 7: 0x20585b70 (stale) Mirror 8: 0x20585b70 (stale) Mirror 9: 0x20585b70 (stale) Mirror 10: 0x20585b70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f2c9: skipped 000738 1784585593.537567 mapwrite 0x02c4b6 thru 0x02e0b0 (0x1bfb bytes) 000739 1784585593.634206 trunc from 0x02f2c9 to 0x0166a5 (0x18c23 bytes) 000740 1784585593.656706 mapread 0x00fdab thru 0x0166a5 (0x68fb bytes) 000742 1784585593.682319 mapwrite 0x016094 thru 0x023d39 (0xdca6 bytes) 000743 1784585593.803040 trunc from 0x023d3a to 0x02f095 (0xb35c bytes) 000745 1784585593.843816 mapread 0x023c9f thru 0x029ec0 (0x6222 bytes) 000747 1784585593.869039 write 0x013aa1 thru 0x0174d0 (0x3a30 bytes) 000749 1784585593.871371 mapread 0x013acc thru 0x0229a7 (0xeedc bytes) 000750 1784585593.877675 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f096): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f096): Mirror 4: 0x59846db8 (stale) Mirror 6: 0x59846db8 (stale) Mirror 7: 0x59846db8 (stale) Mirror 8: 0x59846db8 (stale) Mirror 9: 0x59846db8 (stale) Mirror 10: 0x59846db8 (stale) CRC-32 checksum value for chunk [0, 0x2f096): Mirror 1: 0xffc6b261 Mirror 11: 0xffc6b261 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f096: skipped 000751 1784585595.034401 write 0x025163 thru 0x028fd3 (0x3e71 bytes) 000753 1784585595.150863 mapwrite 0x035c38 thru 0x03ffff (0xa3c8 bytes) 000754 1784585595.262607 mapread 0x0382f4 thru 0x03ffff (0x7d0c bytes) 000757 1784585595.266692 trunc from 0x040000 to 0x00e539 (0x31ac6 bytes) 000758 1784585595.284659 trunc from 0x00e53a to 0x03f98b (0x31452 bytes) 000759 1784585595.303991 read 0x033ed1 thru 0x03e2c3 (0xa3f3 bytes) 000761 1784585595.319363 MIRROR_RESYNC 8 mirrors 000762 1784585597.216106 mapwrite 0x034b8a thru 0x03ffff (0xb476 bytes) 000764 1784585597.464344 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x62ea5786 (stale) Mirror 6: 0x62ea5786 (stale) Mirror 7: 0x62ea5786 (stale) Mirror 9: 0x62ea5786 (stale) Mirror 10: 0x62ea5786 (stale) Mirror 11: 0x62ea5786 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x62ea5786 (stale) Mirror 6: 0x62ea5786 (stale) Mirror 7: 0x62ea5786 (stale) Mirror 9: 0x62ea5786 (stale) Mirror 10: 0x62ea5786 (stale) Mirror 11: 0x62ea5786 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000765 1784585597.891535 trunc from 0x040000 to 0x033d4b (0xc2b4 bytes) 000766 1784585597.924750 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33d4c): Mirror 6: 0x90ccfc49 (stale) Mirror 7: 0x90ccfc49 (stale) Mirror 9: 0x90ccfc49 (stale) Mirror 10: 0x90ccfc49 (stale) Mirror 11: 0x90ccfc49 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d4c): Mirror 6: 0x90ccfc49 (stale) Mirror 7: 0x90ccfc49 (stale) Mirror 9: 0x90ccfc49 (stale) Mirror 10: 0x90ccfc49 (stale) Mirror 11: 0x90ccfc49 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d4c: skipped 000767 1784585598.642973 mapread 0x0103e2 thru 0x013fd7 (0x3bf6 bytes) 000768 1784585598.666364 mapwrite 0x01c02e thru 0x029b12 (0xdae5 bytes) 000769 1784585598.733728 trunc from 0x033d4c to 0x002570 (0x317db bytes) 000770 1784585598.755420 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2571): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2571): Mirror 6: 0xba838dff (stale) Mirror 7: 0xba838dff (stale) Mirror 9: 0xba838dff (stale) Mirror 10: 0xba838dff (stale) Mirror 11: 0xba838dff (stale) CRC-32 checksum value for chunk [0, 0x2571): Mirror 1: 0xba838dff Mirror 12: 0xba838dff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2571: skipped 000771 1784585599.785780 trunc from 0x002571 to 0x006541 (0x3fd1 bytes) 000774 1784585599.959393 read 0x001b34 thru 0x006541 (0x4a0e bytes) 000775 1784585599.989100 mapread 0x00455d thru 0x00459d (0x41 bytes) 000776 1784585599.990317 read 0x0021ed thru 0x006541 (0x4355 bytes) 000777 1784585599.995815 read 0x00644f thru 0x006541 (0xf3 bytes) 000778 1784585599.997306 trunc from 0x006542 to 0x01f9bb (0x1947a bytes) 000779 1784585600.038290 read 0x015e1c thru 0x01f9bb (0x9ba0 bytes) 000781 1784585600.049681 mapread 0x01b20c thru 0x01f9bb (0x47b0 bytes) 000783 1784585600.051856 mapread 0x00e3ba thru 0x015a7d (0x76c4 bytes) 000784 1784585600.060563 write 0x033178 thru 0x03ffff (0xce88 bytes) 000785 1784585600.068685 MIRROR_RESYNC 7 mirrors 000786 1784585602.648422 mapread 0x0015ae thru 0x005849 (0x429c bytes) 000787 1784585602.669665 mapread 0x007798 thru 0x00968f (0x1ef8 bytes) 000788 1784585602.671668 mapread 0x02a25a thru 0x036c41 (0xc9e8 bytes) 000793 1784585602.699379 mapread 0x01c708 thru 0x01e622 (0x1f1b bytes) 000798 1784585602.724459 MIRROR_RESYNC 7 mirrors 000800 1784585603.526678 mapwrite 0x025698 thru 0x02f409 (0x9d72 bytes) 000801 1784585603.805801 mapwrite 0x029af5 thru 0x02efdc (0x54e8 bytes) 000802 1784585603.957814 mapwrite 0x03bb17 thru 0x03ffff (0x44e9 bytes) 000803 1784585604.057265 mapwrite 0x01750d thru 0x01cfcf (0x5ac3 bytes) 000805 1784585604.166455 mapread 0x03dcb9 thru 0x03ffff (0x2347 bytes) 000806 1784585604.170509 mapread 0x037c55 thru 0x03eb26 (0x6ed2 bytes) 000807 1784585604.173472 mapwrite 0x001fb3 thru 0x00c534 (0xa582 bytes) 000808 1784585604.304616 trunc from 0x040000 to 0x008aa4 (0x3755b bytes) 000810 1784585604.351571 read 0x00115a thru 0x008696 (0x753d bytes) 000811 1784585604.353570 mapread 0x000ab0 thru 0x001bfc (0x114d bytes) 000812 1784585604.372664 write 0x00e3b1 thru 0x012cb5 (0x4905 bytes) 000816 1784585604.382850 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12cb6): Mirror 7: 0x82200ab5 (stale) Mirror 9: 0x82200ab5 (stale) Mirror 10: 0x82200ab5 (stale) Mirror 11: 0x82200ab5 (stale) Mirror 12: 0x82200ab5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12cb6): Mirror 7: 0x82200ab5 (stale) Mirror 9: 0x82200ab5 (stale) Mirror 10: 0x82200ab5 (stale) Mirror 11: 0x82200ab5 (stale) Mirror 12: 0x82200ab5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12cb6: skipped 000817 1784585605.039168 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12cb6): Mirror 9: 0x82200ab5 (stale) Mirror 10: 0x82200ab5 (stale) Mirror 11: 0x82200ab5 (stale) Mirror 12: 0x82200ab5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12cb6): Mirror 9: 0x82200ab5 (stale) Mirror 10: 0x82200ab5 (stale) Mirror 11: 0x82200ab5 (stale) Mirror 12: 0x82200ab5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12cb6: skipped 000818 1784585605.504137 read 0x007c4d thru 0x00fcb3 (0x8067 bytes) 000820 1784585605.517559 mapread 0x003dc9 thru 0x00ffc7 (0xc1ff bytes) 000821 1784585605.545810 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x12cb6): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12cb6): Mirror 9: 0x82200ab5 (stale) Mirror 10: 0x82200ab5 (stale) Mirror 11: 0x82200ab5 (stale) Mirror 12: 0x82200ab5 (stale) CRC-32 checksum value for chunk [0, 0x12cb6): Mirror 1: 0xdf68d14c Mirror 13: 0xdf68d14c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12cb6: skipped 000824 1784585606.910503 mapwrite 0x01ddcf thru 0x0296f0 (0xb922 bytes) 000825 1784585607.238281 mapread 0x01f8b3 thru 0x020494 (0xbe2 bytes) 000826 1784585607.239396 write 0x004b05 thru 0x0107ab (0xbca7 bytes) 000833 1784585607.271485 mapwrite 0x026bed thru 0x02cea4 (0x62b8 bytes) 000834 1784585607.507286 MIRROR_RESYNC 6 mirrors 000835 1784585609.241896 read 0x00deab thru 0x0120bd (0x4213 bytes) 000836 1784585609.254708 trunc from 0x02cea5 to 0x00c0e7 (0x20dbd bytes) 000838 1784585609.358120 write 0x02f8dd thru 0x03a639 (0xad5d bytes) 000841 1784585609.365883 write 0x00c3aa thru 0x018120 (0xbd77 bytes) 000842 1784585609.380862 trunc from 0x03a63a to 0x0292f7 (0x11342 bytes) 000843 1784585609.413137 trunc from 0x0292f8 to 0x0350de (0xbde7 bytes) 000845 1784585609.440640 read 0x01cf7b thru 0x01d8b0 (0x936 bytes) 000849 1784585609.455300 write 0x027ee8 thru 0x02da54 (0x5b6d bytes) 000852 1784585609.458379 write 0x03bebe thru 0x03ffff (0x4142 bytes) 000854 1784585609.465879 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x2425bbd5 (stale) Mirror 10: 0x2425bbd5 (stale) Mirror 11: 0x2425bbd5 (stale) Mirror 12: 0x2425bbd5 (stale) Mirror 13: 0x2425bbd5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2f990aa Mirror 14: 0xc2f990aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000856 1784585610.663806 mapread 0x00b18e thru 0x00d42a (0x229d bytes) 000858 1784585610.710680 mapread 0x01164d thru 0x01a74d (0x9101 bytes) 000859 1784585610.729154 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x2425bbd5 (stale) Mirror 10: 0x2425bbd5 (stale) Mirror 11: 0x2425bbd5 (stale) Mirror 12: 0x2425bbd5 (stale) Mirror 13: 0x2425bbd5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2f990aa Mirror 14: 0xc2f990aa Mirror 15: 0xc2f990aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000862 1784585611.955193 write 0x007afa thru 0x014812 (0xcd19 bytes) 000865 1784585612.105486 trunc from 0x040000 to 0x037513 (0x8aec bytes) 000866 1784585612.138480 write 0x0167c2 thru 0x01c461 (0x5ca0 bytes) 000867 1784585612.171634 trunc from 0x037514 to 0x02502b (0x124e8 bytes) 000869 1784585612.209687 mapwrite 0x038bff thru 0x03e727 (0x5b29 bytes) 000870 1784585612.375564 write 0x0116a2 thru 0x017f6e (0x68cd bytes) 000871 1784585612.378251 trunc from 0x03e728 to 0x01bd4f (0x229d8 bytes) 000873 1784585612.410705 read 0x0069f1 thru 0x007a7d (0x108d bytes) 000878 1784585612.442205 mapwrite 0x00b248 thru 0x010848 (0x5601 bytes) 000879 1784585612.533991 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bd50): Mirror 9: 0x38af836f (stale) Mirror 10: 0x38af836f (stale) Mirror 11: 0x38af836f (stale) Mirror 12: 0x38af836f (stale) Mirror 13: 0x38af836f (stale) Mirror 15: 0xc034c4fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bd50): Mirror 9: 0x38af836f (stale) Mirror 10: 0x38af836f (stale) Mirror 11: 0x38af836f (stale) Mirror 12: 0x38af836f (stale) Mirror 13: 0x38af836f (stale) Mirror 15: 0xc034c4fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bd50: skipped 000880 1784585613.063797 trunc from 0x01bd50 to 0x01199e (0xa3b1 bytes) 000881 1784585613.080677 trunc from 0x01199f to 0x012faa (0x160c bytes) 000882 1784585613.101564 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12fab): Mirror 9: 0x2c2e3951 (stale) Mirror 10: 0x2c2e3951 (stale) Mirror 11: 0x2c2e3951 (stale) Mirror 12: 0x2c2e3951 (stale) Mirror 15: 0x4247d2e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12fab): Mirror 9: 0x2c2e3951 (stale) Mirror 10: 0x2c2e3951 (stale) Mirror 11: 0x2c2e3951 (stale) Mirror 12: 0x2c2e3951 (stale) Mirror 15: 0x4247d2e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12fab: skipped 000884 1784585613.617647 write 0x03f099 thru 0x03ffff (0xf67 bytes) 000885 1784585613.619506 mapread 0x0241b3 thru 0x02e9fe (0xa84c bytes) 000887 1784585613.649814 read 0x02239e thru 0x02f5c9 (0xd22c bytes) 000888 1784585613.658224 mapwrite 0x013169 thru 0x01624f (0x30e7 bytes) 000889 1784585613.745599 trunc from 0x040000 to 0x03bac0 (0x453f bytes) 000890 1784585613.769833 write 0x0376a3 thru 0x03b463 (0x3dc1 bytes) 000891 1784585613.790367 MIRROR_RESYNC 6 mirrors 000892 1784585615.528129 read 0x02c21f thru 0x0353bb (0x919d bytes) 000894 1784585615.569567 MIRROR_RESYNC 6 mirrors 000895 1784585616.307085 read 0x00af1d thru 0x0195aa (0xe68e bytes) 000896 1784585616.321900 mapwrite 0x01e621 thru 0x02de8e (0xf86e bytes) 000897 1784585616.612666 read 0x01d53d thru 0x022fa0 (0x5a64 bytes) 000899 1784585616.635175 MIRROR_RESYNC 6 mirrors 000902 1784585617.981467 trunc from 0x03bac1 to 0x032d5a (0x8d66 bytes) 000903 1784585618.063582 mapwrite 0x03e36a thru 0x03ffff (0x1c96 bytes) 000904 1784585618.169151 trunc from 0x040000 to 0x01eb20 (0x214df bytes) 000905 1784585618.193160 mapwrite 0x0373fa thru 0x03908e (0x1c95 bytes) 000912 1784585618.297376 write 0x00c403 thru 0x011446 (0x5044 bytes) 000914 1784585618.320259 trunc from 0x03908f to 0x009e99 (0x2f1f5 bytes) 000915 1784585618.346254 mapwrite 0x02a997 thru 0x037b18 (0xd182 bytes) 000916 1784585618.472461 read 0x02aaaf thru 0x037b18 (0xd06a bytes) 000919 1784585618.482581 write 0x015b15 thru 0x023b5d (0xe049 bytes) 000920 1784585618.495341 read 0x00eda2 thru 0x018f4a (0xa1a9 bytes) 000921 1784585618.508303 read 0x02c308 thru 0x030fc3 (0x4cbc bytes) 000923 1784585618.512889 mapread 0x003b52 thru 0x00790f (0x3dbe bytes) 000924 1784585618.515673 write 0x0266b1 thru 0x02a2c6 (0x3c16 bytes) 000925 1784585618.517125 read 0x00ed6c thru 0x0188d7 (0x9b6c bytes) 000926 1784585618.523875 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37b19): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37b19): Mirror 9: 0x5272c7b3 (stale) Mirror 10: 0x5272c7b3 (stale) Mirror 11: 0x5272c7b3 (stale) Mirror 12: 0x5272c7b3 (stale) Mirror 15: 0x5272c7b3 (stale) CRC-32 checksum value for chunk [0, 0x37b19): Mirror 1: 0x8755e494 Mirror 16: 0x8755e494 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37b19: skipped 000927 1784585619.678083 read 0x01c5e4 thru 0x01d69e (0x10bb bytes) 000929 1784585619.686236 trunc from 0x037b19 to 0x014fd1 (0x22b47 bytes) 000931 1784585619.806243 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14fd2): Mirror 9: 0xfb70e95a (stale) Mirror 10: 0xfb70e95a (stale) Mirror 11: 0xfb70e95a (stale) Mirror 12: 0xfb70e95a (stale) Mirror 16: 0xc66660be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14fd2): Mirror 9: 0xfb70e95a (stale) Mirror 10: 0xfb70e95a (stale) Mirror 11: 0xfb70e95a (stale) Mirror 12: 0xfb70e95a (stale) Mirror 16: 0xc66660be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14fd2: skipped 000933 1784585620.257169 mapwrite 0x01be09 thru 0x0224f5 (0x66ed bytes) 000936 1784585620.371900 read 0x009137 thru 0x016afe (0xd9c8 bytes) 000940 1784585620.384143 read 0x019091 thru 0x0224f5 (0x9465 bytes) 000943 1784585620.386455 mapread 0x000365 thru 0x01000f (0xfcab bytes) 000944 1784585620.422376 mapread 0x01ed68 thru 0x01f6cd (0x966 bytes) 000946 1784585620.434734 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x224f6): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x224f6): Mirror 9: 0xe6dd3eb1 (stale) Mirror 10: 0xe6dd3eb1 (stale) Mirror 11: 0xe6dd3eb1 (stale) Mirror 12: 0xe6dd3eb1 (stale) Mirror 16: 0xcc16dc95 (stale) CRC-32 checksum value for chunk [0, 0x224f6): Mirror 1: 0x46f70f1f Mirror 17: 0x46f70f1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x224f6: skipped 000947 1784585621.425448 trunc from 0x0224f6 to 0x03a47c (0x17f87 bytes) 000948 1784585621.637244 MIRROR_RESYNC 7 mirrors 000950 1784585623.674406 read 0x006174 thru 0x006176 (0x3 bytes) 000951 1784585623.688433 read 0x0317fa thru 0x031e2d (0x634 bytes) 000953 1784585623.753779 write 0x01b7c0 thru 0x01d53a (0x1d7b bytes) 000955 1784585623.921866 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 9: 0x20acfa91 (stale) Mirror 10: 0x20acfa91 (stale) Mirror 11: 0x20acfa91 (stale) Mirror 12: 0x20acfa91 (stale) Mirror 16: 0x20acfa91 (stale) Mirror 17: 0x20acfa91 (stale) CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 1: 0xe8fd1878 Mirror 18: 0xe8fd1878 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a47d: skipped 000956 1784585625.404085 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 9: 0x20acfa91 (stale) Mirror 10: 0x20acfa91 (stale) Mirror 11: 0x20acfa91 (stale) Mirror 12: 0x20acfa91 (stale) Mirror 16: 0x20acfa91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 9: 0x20acfa91 (stale) Mirror 10: 0x20acfa91 (stale) Mirror 11: 0x20acfa91 (stale) Mirror 12: 0x20acfa91 (stale) Mirror 16: 0x20acfa91 (stale) CRC-32 checksum value for chunk [0, 0x3a47d): Mirror 1: 0xe8fd1878 Mirror 18: 0xe8fd1878 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a47d: skipped 000958 1784585626.283528 write 0x030d33 thru 0x03752f (0x67fd bytes) 000960 1784585626.456024 MIRROR_RESYNC 7 mirrors 000961 1784585628.235759 read 0x00dbb2 thru 0x014df1 (0x7240 bytes) 000963 1784585628.245715 trunc from 0x03a47d to 0x02c8a4 (0xdbd8 bytes) 000964 1784585628.391492 mapread 0x005a56 thru 0x009c7c (0x4227 bytes) 000966 1784585628.422217 write 0x01bb71 thru 0x01ef09 (0x3399 bytes) 000967 1784585628.442620 mapread 0x027030 thru 0x02a88a (0x385b bytes) 000968 1784585628.461329 mapread 0x0260a4 thru 0x026245 (0x1a2 bytes) 000969 1784585628.462995 mapread 0x020746 thru 0x025ca8 (0x5563 bytes) 000970 1784585628.465986 trunc from 0x02c8a5 to 0x03f8ea (0x13046 bytes) 000971 1784585628.501218 mapread 0x01514d thru 0x01e0b2 (0x8f66 bytes) 000973 1784585628.516859 trunc from 0x03f8eb to 0x01bc7e (0x23c6c bytes) 000975 1784585628.539848 read 0x0179a9 thru 0x017d18 (0x370 bytes) 000976 1784585628.540793 mapwrite 0x021089 thru 0x02ab0d (0x9a85 bytes) 000977 1784585628.630487 write 0x02c7e1 thru 0x038ec1 (0xc6e1 bytes) 000978 1784585628.636527 read 0x02d5d8 thru 0x0331fc (0x5c25 bytes) 000979 1784585628.637883 read 0x033425 thru 0x038ec1 (0x5a9d bytes) 000980 1784585628.639045 mapread 0x022feb thru 0x02461f (0x1635 bytes) 000982 1784585628.641975 write 0x031282 thru 0x03b5c2 (0xa341 bytes) 000983 1784585628.643788 trunc from 0x03b5c3 to 0x02d2c2 (0xe300 bytes) 000984 1784585628.694116 mapwrite 0x00dc40 thru 0x01054d (0x290e bytes) 000986 1784585628.772276 write 0x03fa04 thru 0x03ffff (0x5fc bytes) 000988 1784585628.779142 mapwrite 0x03554a thru 0x03d4ee (0x7fa5 bytes) 000989 1784585628.854605 read 0x0051e7 thru 0x0095dc (0x43f6 bytes) 000990 1784585628.855841 read 0x002944 thru 0x00b46b (0x8b28 bytes) 000991 1784585628.859904 write 0x0359ab thru 0x03ffff (0xa655 bytes) 000993 1784585628.878218 read 0x000d48 thru 0x00cbff (0xbeb8 bytes) 000996 1784585628.881826 write 0x0150f0 thru 0x01b0e6 (0x5ff7 bytes) All operations completed A-OK!