== sanity-flr test 70a: flr mode fsx test ================ 17:07:47 (1786828067) Seed set to 8069 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1786828069.368213 write 0x00d081 thru 0x0161af (0x912f bytes) 000002 1786828069.385002 write 0x01e8a1 thru 0x023049 (0x47a9 bytes) 000003 1786828069.387652 read 0x01d6a6 thru 0x023049 (0x59a4 bytes) 000004 1786828069.394715 mapread 0x0123ae thru 0x01ac31 (0x8884 bytes) 000005 1786828069.416121 mapread 0x00fb77 thru 0x01748f (0x7919 bytes) 000008 1786828069.420544 write 0x02228c thru 0x02335e (0x10d3 bytes) 000009 1786828069.422412 read 0x00deb6 thru 0x016aae (0x8bf9 bytes) 000010 1786828069.423480 write 0x01b34b thru 0x025740 (0xa3f6 bytes) truncating to largest ever: 0xadbe 000011 1786828069.425481 trunc from 0x025741 to 0x00adbd (0x1a983 bytes) 000012 1786828069.445706 mapwrite 0x03042b thru 0x038c1e (0x87f4 bytes) 000013 1786828069.588415 mapwrite 0x000d2f thru 0x00b2b7 (0xa589 bytes) 000014 1786828069.670367 write 0x03d52c thru 0x03e609 (0x10de bytes) 000016 1786828069.676721 mapwrite 0x03e8cc thru 0x03ffff (0x1734 bytes) 000018 1786828069.760203 mapwrite 0x018715 thru 0x01c940 (0x422c bytes) 000020 1786828069.844364 write 0x0085a9 thru 0x00ea67 (0x64bf bytes) truncating to largest ever: 0x37d08 000022 1786828069.846407 trunc from 0x040000 to 0x037d07 (0x82f8 bytes) 000024 1786828069.866919 read 0x0192b8 thru 0x02423a (0xaf83 bytes) 000026 1786828069.869526 mapwrite 0x002f4d thru 0x00a422 (0x74d6 bytes) 000027 1786828069.962858 mapwrite 0x007c85 thru 0x00f2aa (0x7626 bytes) 000028 1786828070.020342 write 0x00eb40 thru 0x01b452 (0xc913 bytes) 000029 1786828070.025156 read 0x025dda thru 0x031a2a (0xbc51 bytes) 000030 1786828070.026091 read 0x029fe8 thru 0x034b24 (0xab3d bytes) 000032 1786828070.032507 mapwrite 0x012088 thru 0x0202c5 (0xe23e bytes) 000033 1786828070.140689 trunc from 0x037d08 to 0x034418 (0x38ef bytes) 000034 1786828070.161865 trunc from 0x034419 to 0x0186fa (0x1bd1e bytes) 000035 1786828070.181300 read 0x01560c thru 0x0186fa (0x30ef bytes) 000037 1786828070.192404 mapread 0x00afb2 thru 0x0186fa (0xd749 bytes) 000040 1786828070.205794 read 0x0162da thru 0x0174b4 (0x11db bytes) 000042 1786828070.213671 mapwrite 0x027ea1 thru 0x0321e0 (0xa340 bytes) 000043 1786828070.293908 MIRROR_EXTEND to 2 mirrors 000044 1786828071.422927 write 0x00a22f thru 0x018350 (0xe122 bytes) 000049 1786828071.516224 write 0x01876d thru 0x021fbd (0x9851 bytes) 000050 1786828071.526839 mapread 0x019e16 thru 0x01dcbb (0x3ea6 bytes) 000051 1786828071.528777 mapread 0x016bed thru 0x01c1d9 (0x55ed bytes) 000052 1786828071.530884 write 0x01d8da thru 0x029320 (0xba47 bytes) 000053 1786828071.539728 trunc from 0x0321e1 to 0x01e907 (0x138d9 bytes) 000054 1786828071.566981 trunc from 0x01e908 to 0x00a9f9 (0x13f0e bytes) 000055 1786828071.586403 mapread 0x006274 thru 0x008f08 (0x2c95 bytes) 000056 1786828071.610037 trunc from 0x00a9fa to 0x004003 (0x69f6 bytes) 000057 1786828071.628890 read 0x00322d thru 0x004003 (0xdd7 bytes) 000058 1786828071.635546 mapwrite 0x037371 thru 0x03ffff (0x8c8f bytes) 000059 1786828071.727477 trunc from 0x040000 to 0x02fa8e (0x10571 bytes) 000060 1786828071.756370 read 0x01da80 thru 0x0274ce (0x9a4f bytes) 000061 1786828071.769685 mapread 0x02351e thru 0x02b2c5 (0x7da8 bytes) 000062 1786828071.771647 mapread 0x02ac40 thru 0x02fa8e (0x4e4f bytes) 000064 1786828071.773524 mapread 0x0123f6 thru 0x019c48 (0x7853 bytes) 000066 1786828071.775712 mapread 0x020501 thru 0x0251fb (0x4cfb bytes) 000070 1786828071.789033 write 0x01ec64 thru 0x01fb9a (0xf37 bytes) 000072 1786828071.797900 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2fa8f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa8f): Mirror 2: 0x6a352ae3 (stale) CRC-32 checksum value for chunk [0, 0x2fa8f): Mirror 1: 0x6f07bbaa Mirror 3: 0x6f07bbaa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa8f: skipped 000074 1786828073.168637 trunc from 0x02fa8f to 0x005ee8 (0x29ba6 bytes) 000077 1786828073.299425 mapread 0x003f5c thru 0x005ee8 (0x1f8d bytes) 000079 1786828073.326442 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x5ee9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5ee9): Mirror 2: 0xc6c97262 (stale) Mirror 3: 0xadb91b3f (stale) CRC-32 checksum value for chunk [0, 0x5ee9): Mirror 1: 0xadb91b3f Mirror 4: 0xadb91b3f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5ee9: skipped 000080 1786828074.558714 write 0x03f0cc thru 0x03ffff (0xf34 bytes) 000081 1786828074.612976 mapread 0x01dfd6 thru 0x024fc9 (0x6ff4 bytes) 000082 1786828074.629132 read 0x009637 thru 0x009c9f (0x669 bytes) 000084 1786828074.634870 read 0x01ee99 thru 0x02876a (0x98d2 bytes) 000085 1786828074.644856 write 0x0206cc thru 0x02d34f (0xcc84 bytes) 000087 1786828074.648782 mapwrite 0x026241 thru 0x02bf24 (0x5ce4 bytes) 000088 1786828074.711400 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x16b3da5d (stale) Mirror 4: 0x9ffe9203 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x16b3da5d (stale) Mirror 4: 0x9ffe9203 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000089 1786828075.059300 write 0x035462 thru 0x038c9a (0x3839 bytes) 000090 1786828075.071298 read 0x03ca6a thru 0x03ffff (0x3596 bytes) 000093 1786828075.097898 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x16b3da5d (stale) Mirror 4: 0x9ffe9203 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x41a64611 Mirror 5: 0x41a64611 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000095 1786828076.717862 write 0x00b3df thru 0x019ffb (0xec1d bytes) 000099 1786828076.847043 mapread 0x03ccdd thru 0x03ffff (0x3323 bytes) 000100 1786828076.884474 write 0x0205e3 thru 0x02f26a (0xec88 bytes) 000101 1786828076.897307 trunc from 0x040000 to 0x01c6d6 (0x23929 bytes) 000103 1786828076.933131 trunc from 0x01c6d7 to 0x021830 (0x515a bytes) 000104 1786828076.953491 read 0x019d0b thru 0x01a0a0 (0x396 bytes) 000105 1786828076.960794 trunc from 0x021831 to 0x003adc (0x1dd54 bytes) 000106 1786828076.981805 read 0x00188a thru 0x003adc (0x2253 bytes) 000108 1786828076.992263 mapwrite 0x01bf2e thru 0x027535 (0xb608 bytes) 000109 1786828077.097824 mapwrite 0x005894 thru 0x00e91b (0x9088 bytes) 000110 1786828077.165856 write 0x002955 thru 0x00aa14 (0x80c0 bytes) 000113 1786828077.169939 mapwrite 0x00bad4 thru 0x011f76 (0x64a3 bytes) 000114 1786828077.213364 write 0x01acc1 thru 0x01ddc8 (0x3108 bytes) 000115 1786828077.218805 write 0x03e7eb thru 0x03ffff (0x1815 bytes) 000116 1786828077.229291 write 0x036c4a thru 0x03ffff (0x93b6 bytes) 000120 1786828077.256776 write 0x01e7e4 thru 0x0290bd (0xa8da bytes) 000121 1786828077.264874 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9ffe9203 (stale) Mirror 5: 0x41a64611 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9ffe9203 (stale) Mirror 5: 0x41a64611 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000122 1786828077.594159 write 0x02f157 thru 0x034981 (0x582b bytes) 000123 1786828077.620825 write 0x01bc0b thru 0x028957 (0xcd4d bytes) 000124 1786828077.633902 mapwrite 0x03df39 thru 0x03ffff (0x20c7 bytes) 000130 1786828077.722020 mapwrite 0x0083b2 thru 0x011904 (0x9553 bytes) 000135 1786828077.811338 mapread 0x02a241 thru 0x02f752 (0x5512 bytes) 000136 1786828077.833443 mapwrite 0x01ff52 thru 0x023035 (0x30e4 bytes) 000137 1786828077.941938 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x41a64611 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x41a64611 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000138 1786828078.181748 read 0x03c794 thru 0x03dbe5 (0x1452 bytes) 000140 1786828078.187873 read 0x005ca5 thru 0x011d86 (0xc0e2 bytes) 000141 1786828078.200559 read 0x03c760 thru 0x03ffff (0x38a0 bytes) 000142 1786828078.204863 MIRROR_RESYNC 2 mirrors 000143 1786828079.353689 mapread 0x0270ad thru 0x035da9 (0xecfd bytes) 000145 1786828079.421414 mapread 0x027917 thru 0x032e69 (0xb553 bytes) 000146 1786828079.422764 mapwrite 0x006bce thru 0x006f7e (0x3b1 bytes) 000148 1786828079.606526 MIRROR_RESYNC 2 mirrors 000149 1786828080.597284 MIRROR_RESYNC 2 mirrors 000150 1786828080.922322 mapwrite 0x013022 thru 0x015c1e (0x2bfd bytes) 000153 1786828081.129790 write 0x01f361 thru 0x020f06 (0x1ba6 bytes) 000154 1786828081.152874 mapwrite 0x01b805 thru 0x01f6e6 (0x3ee2 bytes) 000155 1786828081.238286 MIRROR_RESYNC 2 mirrors 000157 1786828082.224383 write 0x02d957 thru 0x02f9f5 (0x209f bytes) 000158 1786828082.294635 read 0x006399 thru 0x01413e (0xdda6 bytes) 000159 1786828082.313770 MIRROR_RESYNC 2 mirrors 000162 1786828083.480836 read 0x034d85 thru 0x03ffff (0xb27b bytes) 000166 1786828083.496475 write 0x00860b thru 0x012e04 (0xa7fa bytes) truncating to largest ever: 0x3892f 000167 1786828083.578363 trunc from 0x040000 to 0x03892e (0x76d1 bytes) 000168 1786828083.613998 write 0x01cdff thru 0x021b91 (0x4d93 bytes) 000169 1786828083.627693 mapread 0x0258c4 thru 0x03170e (0xbe4b bytes) 000170 1786828083.695882 mapread 0x0338bc thru 0x03892e (0x5073 bytes) 000172 1786828083.701746 read 0x00d63b thru 0x01028d (0x2c53 bytes) 000174 1786828083.708488 mapread 0x031b2a thru 0x034fb3 (0x348a bytes) 000175 1786828083.709988 read 0x028ad5 thru 0x02cb56 (0x4082 bytes) 000176 1786828083.710974 mapread 0x02a6ce thru 0x03892e (0xe261 bytes) 000178 1786828083.717705 trunc from 0x03892f to 0x002a62 (0x35ecc bytes) 000182 1786828083.756596 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000183 1786828083.933639 write 0x03292e thru 0x03a9d6 (0x80a9 bytes) 000186 1786828083.946593 mapread 0x02e886 thru 0x02ec05 (0x380 bytes) 000187 1786828083.971036 MIRROR_EXTEND to 2 mirrors 000188 1786828084.908760 write 0x003f99 thru 0x005991 (0x19f9 bytes) 000189 1786828085.031399 mapread 0x009a81 thru 0x0184aa (0xea2a bytes) 000191 1786828085.077265 mapread 0x0131f9 thru 0x020326 (0xd12e bytes) 000197 1786828085.106493 mapwrite 0x024f63 thru 0x030259 (0xb2f7 bytes) 000199 1786828085.205841 write 0x01eb69 thru 0x027426 (0x88be bytes) 000200 1786828085.211874 mapwrite 0x027269 thru 0x02b53f (0x42d7 bytes) 000202 1786828085.269413 trunc from 0x03a9d7 to 0x02f594 (0xb442 bytes) 000205 1786828085.299996 mapwrite 0x00237c thru 0x00ae10 (0x8a95 bytes) 000206 1786828085.348470 write 0x029719 thru 0x037335 (0xdc1d bytes) 000207 1786828085.351144 mapread 0x01fafb thru 0x02764e (0x7b54 bytes) 000208 1786828085.352972 read 0x007b46 thru 0x0162dc (0xe797 bytes) 000210 1786828085.361734 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000211 1786828085.509960 trunc from 0x037336 to 0x00b2f8 (0x2c03d bytes) 000212 1786828085.538841 write 0x02021e thru 0x02defd (0xdce0 bytes) 000213 1786828085.541048 mapwrite 0x036141 thru 0x039cfe (0x3bbe bytes) 000215 1786828085.654279 mapread 0x01a41f thru 0x025128 (0xad0a bytes) 000216 1786828085.665235 write 0x01bc89 thru 0x02624f (0xa5c7 bytes) 000217 1786828085.667717 mapwrite 0x03dfdd thru 0x03ffff (0x2023 bytes) 000219 1786828085.741929 read 0x03cf5f thru 0x03ffff (0x30a1 bytes) 000220 1786828085.742707 write 0x00d84a thru 0x0100ef (0x28a6 bytes) 000221 1786828085.753372 write 0x0117cc thru 0x01746f (0x5ca4 bytes) 000222 1786828085.766539 write 0x014e33 thru 0x024377 (0xf545 bytes) 000223 1786828085.772912 read 0x023e59 thru 0x02dd09 (0x9eb1 bytes) 000224 1786828085.774767 mapread 0x00c072 thru 0x00fb39 (0x3ac8 bytes) 000227 1786828085.803663 mapread 0x022269 thru 0x02f56f (0xd307 bytes) 000232 1786828085.815393 mapwrite 0x039a82 thru 0x03ccc1 (0x3240 bytes) 000233 1786828085.898410 MIRROR_EXTEND to 2 mirrors 000234 1786828086.812815 trunc from 0x040000 to 0x017042 (0x28fbd bytes) 000236 1786828086.930989 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x17043): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17043): Mirror 2: 0x1bf334b8 (stale) CRC-32 checksum value for chunk [0, 0x17043): Mirror 1: 0x1bf334b8 Mirror 3: 0x1bf334b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17043: skipped 000237 1786828088.294036 mapread 0x013798 thru 0x017042 (0x38ab bytes) 000238 1786828088.352374 read 0x00bcbc thru 0x00ecd7 (0x301c bytes) 000239 1786828088.368704 mapwrite 0x00fcf2 thru 0x01b5aa (0xb8b9 bytes) 000240 1786828088.580251 MIRROR_RESYNC 3 mirrors 000241 1786828089.774680 mapread 0x00d0b6 thru 0x013512 (0x645d bytes) 000242 1786828089.811916 mapwrite 0x03536e thru 0x03ffff (0xac92 bytes) 000243 1786828090.094385 mapread 0x0137a9 thru 0x02015a (0xc9b2 bytes) 000244 1786828090.126814 mapread 0x0316b2 thru 0x03dc78 (0xc5c7 bytes) 000245 1786828090.128211 mapread 0x00a009 thru 0x00dfde (0x3fd6 bytes) 000246 1786828090.136911 trunc from 0x040000 to 0x016041 (0x29fbe bytes) 000247 1786828090.170618 trunc from 0x016042 to 0x0188a0 (0x285f bytes) 000248 1786828090.185247 read 0x00eb6f thru 0x0188a0 (0x9d32 bytes) 000253 1786828090.194532 mapwrite 0x0316a1 thru 0x03d2cc (0xbc2c bytes) 000254 1786828090.306128 write 0x0379c6 thru 0x03ffff (0x863a bytes) 000258 1786828090.317308 write 0x018650 thru 0x020e82 (0x8833 bytes) 000259 1786828090.338583 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8e3d02f8 (stale) Mirror 3: 0x8e3d02f8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe7e6c515 Mirror 4: 0xe7e6c515 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000260 1786828091.893282 trunc from 0x040000 to 0x035f91 (0xa06e bytes) 000261 1786828091.977941 mapwrite 0x0334cb thru 0x03ffff (0xcb35 bytes) 000262 1786828092.075902 mapwrite 0x03ec8d thru 0x03ffff (0x1373 bytes) 000263 1786828092.121448 trunc from 0x040000 to 0x015b0d (0x2a4f2 bytes) 000264 1786828092.151153 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15b0e): Mirror 2: 0x7f0e2cfb (stale) Mirror 3: 0x7f0e2cfb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15b0e): Mirror 2: 0x7f0e2cfb (stale) Mirror 3: 0x7f0e2cfb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15b0e: skipped 000265 1786828092.511486 mapwrite 0x0059f6 thru 0x00e571 (0x8b7c bytes) 000266 1786828092.603706 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x15b0e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15b0e): Mirror 2: 0x7f0e2cfb (stale) Mirror 3: 0x7f0e2cfb (stale) CRC-32 checksum value for chunk [0, 0x15b0e): Mirror 1: 0xf585b126 Mirror 4: 0xf585b126 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15b0e: skipped 000268 1786828093.328160 mapread 0x000c2f thru 0x0103af (0xf781 bytes) 000270 1786828093.385892 MIRROR_RESYNC 4 mirrors 000274 1786828094.203254 trunc from 0x015b0e to 0x036ec3 (0x213b6 bytes) 000276 1786828094.323727 trunc from 0x036ec4 to 0x01a604 (0x1c8bf bytes) 000277 1786828094.363062 mapwrite 0x00d50a thru 0x018ff1 (0xbae8 bytes) 000279 1786828094.459814 trunc from 0x01a605 to 0x008e2b (0x117d9 bytes) 000281 1786828094.489772 write 0x028dde thru 0x035e98 (0xd0bb bytes) 000285 1786828094.501839 mapwrite 0x00f622 thru 0x00fac7 (0x4a6 bytes) 000286 1786828094.598678 read 0x00d3d4 thru 0x0156fb (0x8328 bytes) 000287 1786828094.600939 write 0x03d2e1 thru 0x03ffff (0x2d1f bytes) 000288 1786828094.607655 mapread 0x02e7f0 thru 0x03c07e (0xd88f bytes) 000289 1786828094.619709 mapwrite 0x02af73 thru 0x038106 (0xd194 bytes) 000290 1786828094.680820 trunc from 0x040000 to 0x010094 (0x2ff6b bytes) 000293 1786828094.698646 mapread 0x005dc2 thru 0x010094 (0xa2d3 bytes) 000296 1786828094.711392 mapwrite 0x00330a thru 0x00fd19 (0xca10 bytes) 000297 1786828094.761852 read 0x00ad11 thru 0x00c6b9 (0x19a9 bytes) 000299 1786828094.763754 mapread 0x00cfd6 thru 0x010094 (0x30bf bytes) 000301 1786828094.766366 mapread 0x0081ed thru 0x010094 (0x7ea8 bytes) 000302 1786828094.771526 MIRROR_RESYNC 4 mirrors 000303 1786828096.038689 trunc from 0x010095 to 0x02efd0 (0x1ef3c bytes) 000304 1786828096.104512 write 0x03777f thru 0x03ceb9 (0x573b bytes) 000305 1786828096.106904 mapread 0x00b030 thru 0x01390f (0x88e0 bytes) 000306 1786828096.127219 mapwrite 0x0270fd thru 0x03307b (0xbf7f bytes) 000307 1786828096.221233 trunc from 0x03ceba to 0x036d75 (0x6144 bytes) 000308 1786828096.252432 trunc from 0x036d76 to 0x027427 (0xf94e bytes) 000309 1786828096.276596 write 0x023715 thru 0x02babb (0x83a7 bytes) 000310 1786828096.285055 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2babc): Mirror 3: 0xef6dd9ae (stale) Mirror 4: 0xef6dd9ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2babc): Mirror 3: 0xef6dd9ae (stale) Mirror 4: 0xef6dd9ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2babc: skipped 000314 1786828096.808900 mapwrite 0x01f91a thru 0x02801f (0x8706 bytes) 000315 1786828096.989441 read 0x000f70 thru 0x00ae41 (0x9ed2 bytes) 000316 1786828097.019508 read 0x005dd1 thru 0x013e55 (0xe085 bytes) 000320 1786828097.084560 MIRROR_RESYNC 3 mirrors 000321 1786828098.596410 trunc from 0x02babc to 0x024530 (0x758b bytes) 000322 1786828098.716562 mapread 0x017be1 thru 0x019bf2 (0x2012 bytes) 000323 1786828098.748826 write 0x00aa84 thru 0x019146 (0xe6c3 bytes) 000324 1786828098.786024 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24531): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24531): Mirror 3: 0x718a0a20 (stale) Mirror 4: 0x718a0a20 (stale) CRC-32 checksum value for chunk [0, 0x24531): Mirror 1: 0xc6f55678 Mirror 5: 0xc6f55678 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24531: skipped 000326 1786828100.331261 read 0x00e3b2 thru 0x00e51e (0x16d bytes) 000327 1786828100.370566 MIRROR_RESYNC 4 mirrors 000333 1786828101.436418 trunc from 0x024531 to 0x00a8e7 (0x19c49 bytes) 000335 1786828101.502618 read 0x007274 thru 0x00845a (0x11e7 bytes) 000338 1786828101.510378 read 0x003e4e thru 0x00a8e7 (0x6a9a bytes) 000339 1786828101.519305 trunc from 0x00a8e8 to 0x0033e9 (0x74fe bytes) 000343 1786828101.569410 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33ea): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33ea): Mirror 3: 0xd46ccac9 (stale) Mirror 4: 0xd46ccac9 (stale) Mirror 5: 0xd46ccac9 (stale) CRC-32 checksum value for chunk [0, 0x33ea): Mirror 1: 0xd46ccac9 Mirror 6: 0xd46ccac9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33ea: skipped 000346 1786828102.619722 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33ea): Mirror 3: 0xd46ccac9 (stale) Mirror 4: 0xd46ccac9 (stale) Mirror 5: 0xd46ccac9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33ea): Mirror 3: 0xd46ccac9 (stale) Mirror 4: 0xd46ccac9 (stale) Mirror 5: 0xd46ccac9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33ea: skipped 000347 1786828102.991526 trunc from 0x0033ea to 0x012d61 (0xf978 bytes) 000348 1786828103.043461 mapread 0x003c49 thru 0x00fc53 (0xc00b bytes) 000349 1786828103.081214 mapwrite 0x01570e thru 0x01e52e (0x8e21 bytes) 000350 1786828103.242245 read 0x0141f8 thru 0x01e52e (0xa337 bytes) 000355 1786828103.257649 MIRROR_RESYNC 4 mirrors 000357 1786828104.650461 trunc from 0x01e52f to 0x036f9e (0x18a70 bytes) 000358 1786828104.738712 mapwrite 0x03468e thru 0x038e0a (0x477d bytes) 000361 1786828104.865437 read 0x00503f thru 0x011b46 (0xcb08 bytes) 000362 1786828104.875668 mapread 0x021497 thru 0x02e748 (0xd2b2 bytes) 000365 1786828104.904725 write 0x01ff12 thru 0x0259a1 (0x5a90 bytes) 000366 1786828104.920691 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38e0b): Mirror 4: 0xb6b527e5 (stale) Mirror 5: 0xb6b527e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e0b): Mirror 4: 0xb6b527e5 (stale) Mirror 5: 0xb6b527e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e0b: skipped 000368 1786828105.279457 mapwrite 0x037cb9 thru 0x03ffff (0x8347 bytes) 000370 1786828105.419409 mapwrite 0x00890f thru 0x01612e (0xd820 bytes) 000371 1786828105.570921 trunc from 0x040000 to 0x034ea0 (0xb15f bytes) 000373 1786828105.598753 write 0x032afe thru 0x03f8ea (0xcded bytes) 000374 1786828105.601701 trunc from 0x03f8eb to 0x02a36a (0x15580 bytes) 000377 1786828105.633336 mapwrite 0x007ddb thru 0x00f2ce (0x74f4 bytes) 000378 1786828105.692007 trunc from 0x02a36b to 0x02655a (0x3e10 bytes) 000380 1786828105.711609 trunc from 0x02655b to 0x03340b (0xceb1 bytes) 000383 1786828105.739463 mapread 0x02bc86 thru 0x02d154 (0x14cf bytes) 000389 1786828105.754885 read 0x0033be thru 0x00e351 (0xaf94 bytes) 000390 1786828105.755931 mapwrite 0x002269 thru 0x00d150 (0xaee8 bytes) 000392 1786828105.805070 write 0x017986 thru 0x01d77c (0x5df7 bytes) 000393 1786828105.813242 mapread 0x021544 thru 0x02df52 (0xca0f bytes) 000394 1786828105.827561 write 0x013a53 thru 0x0148d6 (0xe84 bytes) 000395 1786828105.829744 mapwrite 0x003d7e thru 0x0126ad (0xe930 bytes) 000397 1786828105.885273 trunc from 0x03340c to 0x0244d4 (0xef37 bytes) 000399 1786828105.904594 write 0x00dad7 thru 0x01be84 (0xe3ae bytes) 000400 1786828105.907728 mapwrite 0x026c1d thru 0x02ed9e (0x8182 bytes) 000401 1786828105.991439 trunc from 0x02ed9f to 0x02c91c (0x2482 bytes) 000402 1786828106.009248 mapread 0x01b59c thru 0x024aab (0x9510 bytes) 000403 1786828106.011241 read 0x002551 thru 0x008bb8 (0x6668 bytes) 000406 1786828106.013486 write 0x01df81 thru 0x021cf0 (0x3d70 bytes) 000408 1786828106.016072 write 0x020b7b thru 0x02bc72 (0xb0f8 bytes) 000409 1786828106.017687 trunc from 0x02c91d to 0x002dd2 (0x29b4a bytes) 000411 1786828106.041031 trunc from 0x002dd3 to 0x003a02 (0xc30 bytes) 000412 1786828106.061634 read 0x003838 thru 0x003a02 (0x1cb bytes) 000415 1786828106.070460 mapread 0x003454 thru 0x003a02 (0x5af bytes) 000418 1786828106.074604 write 0x00c600 thru 0x0164eb (0x9eec bytes) 000419 1786828106.082848 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x164ec): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x164ec): Mirror 4: 0xcef5ce1d (stale) Mirror 5: 0xcef5ce1d (stale) CRC-32 checksum value for chunk [0, 0x164ec): Mirror 1: 0x3533c3c4 Mirror 6: 0x3533c3c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x164ec: skipped 000420 1786828107.279759 read 0x007f65 thru 0x00ea35 (0x6ad1 bytes) 000422 1786828107.321558 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x164ec): Mirror 5: 0xcef5ce1d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x164ec): Mirror 5: 0xcef5ce1d (stale) CRC-32 checksum value for chunk [0, 0x164ec): Mirror 1: 0x3533c3c4 Mirror 6: 0x3533c3c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x164ec: skipped 000423 1786828107.935607 mapwrite 0x024edc thru 0x02dcc4 (0x8de9 bytes) 000427 1786828108.144262 trunc from 0x02dcc5 to 0x01faf1 (0xe1d3 bytes) truncating to largest ever: 0x3b9fe 000428 1786828108.170642 trunc from 0x01faf2 to 0x03b9fd (0x1bf0c bytes) 000429 1786828108.195632 mapwrite 0x02baa5 thru 0x02cdc4 (0x1320 bytes) 000430 1786828108.301011 write 0x028c3b thru 0x032ac8 (0x9e8e bytes) 000433 1786828108.307056 write 0x015987 thru 0x017e10 (0x248a bytes) 000434 1786828108.327005 write 0x00eef9 thru 0x0146da (0x57e2 bytes) 000435 1786828108.343006 trunc from 0x03b9fe to 0x0347bd (0x7240 bytes) 000436 1786828108.397067 MIRROR_RESYNC 3 mirrors 000437 1786828109.843438 write 0x024c25 thru 0x02fb74 (0xaf50 bytes) 000439 1786828109.968213 write 0x01a926 thru 0x02172f (0x6e0a bytes) 000440 1786828109.993166 mapread 0x02b2d5 thru 0x02e39b (0x30c7 bytes) 000441 1786828109.994330 mapread 0x02e32b thru 0x0347bd (0x6493 bytes) 000443 1786828110.023545 write 0x002a19 thru 0x007eb9 (0x54a1 bytes) 000448 1786828110.038396 mapread 0x01ca9e thru 0x027fb0 (0xb513 bytes) 000451 1786828110.046169 write 0x02de48 thru 0x03742a (0x95e3 bytes) 000453 1786828110.049536 write 0x000692 thru 0x000f69 (0x8d8 bytes) 000455 1786828110.068977 MIRROR_RESYNC 3 mirrors 000458 1786828111.647633 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000460 1786828112.065171 mapread 0x02a286 thru 0x03742a (0xd1a5 bytes) 000462 1786828112.107659 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000463 1786828112.269802 write 0x0226a0 thru 0x02dde5 (0xb746 bytes) 000466 1786828112.297621 mapread 0x002041 thru 0x0037ce (0x178e bytes) 000467 1786828112.312271 write 0x02b2c1 thru 0x038335 (0xd075 bytes) 000475 1786828112.325668 write 0x036f6a thru 0x03aeef (0x3f86 bytes) 000480 1786828112.333505 read 0x02bc98 thru 0x02c950 (0xcb9 bytes) 000481 1786828112.334379 read 0x017317 thru 0x024602 (0xd2ec bytes) 000482 1786828112.350057 trunc from 0x03aef0 to 0x033580 (0x796f bytes) 000483 1786828112.369608 write 0x011d43 thru 0x01f4db (0xd799 bytes) 000486 1786828112.376358 trunc from 0x033581 to 0x0309a6 (0x2bda bytes) 000487 1786828112.395853 mapwrite 0x010a54 thru 0x01fa20 (0xefcd bytes) 000488 1786828112.482054 mapwrite 0x006b6b thru 0x006ddd (0x273 bytes) 000489 1786828112.517692 write 0x01c58a thru 0x01cb51 (0x5c8 bytes) 000492 1786828112.520833 write 0x016e03 thru 0x023732 (0xc930 bytes) 000494 1786828112.524012 write 0x01301e thru 0x016d39 (0x3d1c bytes) 000497 1786828112.530346 read 0x00dbed thru 0x017889 (0x9c9d bytes) 000499 1786828112.533828 trunc from 0x0309a7 to 0x0085cd (0x283d9 bytes) 000500 1786828112.563529 read 0x005296 thru 0x0085cd (0x3338 bytes) 000501 1786828112.564355 trunc from 0x0085ce to 0x0024e9 (0x60e4 bytes) 000502 1786828112.580775 mapwrite 0x026da4 thru 0x02dc50 (0x6ead bytes) 000503 1786828112.683879 mapwrite 0x02fc48 thru 0x035515 (0x58ce bytes) 000505 1786828112.817335 write 0x00dd4d thru 0x0181e5 (0xa499 bytes) 000506 1786828112.819931 trunc from 0x035516 to 0x0095d5 (0x2bf40 bytes) 000509 1786828112.857590 mapwrite 0x028c86 thru 0x02e345 (0x56c0 bytes) 000511 1786828113.010983 trunc from 0x02e346 to 0x00f37c (0x1efc9 bytes) 000512 1786828113.040736 write 0x0398c1 thru 0x03ffff (0x673f bytes) 000514 1786828113.043677 read 0x021ea0 thru 0x02ceda (0xb03b bytes) 000516 1786828113.056749 trunc from 0x040000 to 0x00b77f (0x34880 bytes) 000521 1786828113.096154 trunc from 0x00b780 to 0x001985 (0x9dfa bytes) 000522 1786828113.119387 read 0x000b91 thru 0x001985 (0xdf5 bytes) 000523 1786828113.120625 read 0x001661 thru 0x001985 (0x325 bytes) 000524 1786828113.122400 mapread 0x0012fd thru 0x001985 (0x689 bytes) 000529 1786828113.138557 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3f250 000530 1786828113.811332 trunc from 0x001986 to 0x03f24f (0x3d8ca bytes) 000532 1786828114.000965 mapwrite 0x0355e9 thru 0x0360ea (0xb02 bytes) 000533 1786828114.102306 trunc from 0x03f250 to 0x020f56 (0x1e2f9 bytes) 000534 1786828114.140985 read 0x01c942 thru 0x020f56 (0x4615 bytes) 000536 1786828114.163684 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000537 1786828114.361366 read 0x0148a5 thru 0x01e92c (0xa088 bytes) 000538 1786828114.381711 write 0x01655d thru 0x019ac6 (0x356a bytes) 000539 1786828114.382821 mapread 0x01c30c thru 0x020f56 (0x4c4b bytes) 000540 1786828114.400223 mapread 0x019c29 thru 0x020f56 (0x732e bytes) 000542 1786828114.402187 read 0x01a5d7 thru 0x020f56 (0x6980 bytes) 000543 1786828114.402899 mapread 0x0008da thru 0x007fed (0x7714 bytes) 000544 1786828114.414065 mapwrite 0x00c018 thru 0x01491d (0x8906 bytes) 000547 1786828114.505561 mapwrite 0x03d724 thru 0x03ffff (0x28dc bytes) 000550 1786828114.642401 mapread 0x01ffdf thru 0x02daf8 (0xdb1a bytes) 000551 1786828114.645389 write 0x005037 thru 0x008635 (0x35ff bytes) 000554 1786828114.665274 write 0x00828e thru 0x01622a (0xdf9d bytes) 000556 1786828114.677665 MIRROR_EXTEND to 2 mirrors 000558 1786828115.863337 trunc from 0x040000 to 0x01392f (0x2c6d0 bytes) 000561 1786828115.986652 mapread 0x0063f0 thru 0x00790e (0x151f bytes) 000563 1786828116.000860 trunc from 0x013930 to 0x0284cf (0x14ba0 bytes) 000564 1786828116.043253 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000565 1786828116.312174 read 0x01acb0 thru 0x0284cf (0xd820 bytes) 000568 1786828116.340774 MIRROR_EXTEND to 2 mirrors 000569 1786828117.475767 read 0x003648 thru 0x003e25 (0x7de bytes) 000570 1786828117.489038 MIRROR_RESYNC 2 mirrors 000571 1786828117.925723 trunc from 0x0284d0 to 0x02bf31 (0x3a62 bytes) 000573 1786828118.067570 mapwrite 0x036697 thru 0x03ebae (0x8518 bytes) 000574 1786828118.196176 read 0x03475a thru 0x03ebae (0xa455 bytes) truncating to largest ever: 0x3f353 000575 1786828118.196998 trunc from 0x03ebaf to 0x03f352 (0x7a4 bytes) 000576 1786828118.217493 trunc from 0x03f353 to 0x039446 (0x5f0c bytes) 000577 1786828118.232867 mapwrite 0x03a7b3 thru 0x03ffff (0x584d bytes) 000579 1786828118.299606 mapwrite 0x03d053 thru 0x03ffff (0x2fad bytes) 000580 1786828118.348898 mapwrite 0x02a69a thru 0x036f0e (0xc875 bytes) 000583 1786828118.412877 read 0x00e407 thru 0x016c82 (0x887c bytes) 000586 1786828118.440646 mapread 0x01fc74 thru 0x02a3b3 (0xa740 bytes) 000590 1786828118.446428 write 0x032d55 thru 0x036a01 (0x3cad bytes) 000591 1786828118.447757 trunc from 0x040000 to 0x028ceb (0x17314 bytes) 000592 1786828118.469424 mapread 0x016f6a thru 0x020ccf (0x9d66 bytes) 000596 1786828118.474411 mapread 0x0137a7 thru 0x01587c (0x20d6 bytes) 000597 1786828118.475856 trunc from 0x028cec to 0x005a31 (0x232ba bytes) 000599 1786828118.491896 write 0x03cab0 thru 0x03ffff (0x3550 bytes) 000600 1786828118.494755 trunc from 0x040000 to 0x03b8cf (0x4730 bytes) 000601 1786828118.512815 trunc from 0x03b8d0 to 0x01d3ba (0x1e515 bytes) 000602 1786828118.528590 write 0x01ee2e thru 0x01f0a5 (0x278 bytes) 000605 1786828118.531805 write 0x038647 thru 0x03ffff (0x79b9 bytes) 000606 1786828118.538714 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xade56e62 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd4a6d6d2 Mirror 3: 0xd4a6d6d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000608 1786828119.859596 write 0x0348b9 thru 0x03e69c (0x9de4 bytes) 000609 1786828120.008811 trunc from 0x040000 to 0x022a7e (0x1d581 bytes) 000611 1786828120.039023 mapread 0x0208db thru 0x022a7e (0x21a4 bytes) 000612 1786828120.072576 write 0x037ece thru 0x03e0b5 (0x61e8 bytes) 000613 1786828120.075355 trunc from 0x03e0b6 to 0x035314 (0x8da1 bytes) 000615 1786828120.098927 mapwrite 0x017190 thru 0x0206c0 (0x9531 bytes) 000617 1786828120.213247 write 0x030cb1 thru 0x033f3c (0x328c bytes) 000620 1786828120.230386 mapread 0x030329 thru 0x035314 (0x4fec bytes) 000621 1786828120.237504 read 0x02f800 thru 0x035314 (0x5b15 bytes) 000623 1786828120.247814 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35315): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35315): Mirror 2: 0x355be617 (stale) Mirror 3: 0x38aa515 (stale) CRC-32 checksum value for chunk [0, 0x35315): Mirror 1: 0x47df019a Mirror 4: 0x47df019a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35315: skipped 000624 1786828121.354362 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35315): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35315): Mirror 2: 0x355be617 (stale) Mirror 3: 0x38aa515 (stale) CRC-32 checksum value for chunk [0, 0x35315): Mirror 1: 0x47df019a Mirror 4: 0x47df019a Mirror 5: 0x47df019a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35315: skipped 000626 1786828122.873505 trunc from 0x035315 to 0x02557a (0xfd9a bytes) 000627 1786828123.049567 mapwrite 0x006e6e thru 0x0103e5 (0x9578 bytes) 000629 1786828123.192151 write 0x01c624 thru 0x02771f (0xb0fc bytes) 000630 1786828123.199616 read 0x01956a thru 0x01af36 (0x19cd bytes) 000631 1786828123.218290 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27720): Mirror 2: 0xa8c34662 (stale) Mirror 4: 0x456d5a1 (stale) Mirror 5: 0x456d5a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27720): Mirror 2: 0xa8c34662 (stale) Mirror 4: 0x456d5a1 (stale) Mirror 5: 0x456d5a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27720: skipped 000632 1786828123.667633 write 0x03681d thru 0x03e876 (0x805a bytes) 000633 1786828123.668986 mapread 0x00b52f thru 0x011dff (0x68d1 bytes) 000635 1786828123.691276 mapwrite 0x017158 thru 0x0183ab (0x1254 bytes) 000636 1786828123.756928 trunc from 0x03e877 to 0x01ddcd (0x20aa9 bytes) 000639 1786828123.779045 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ddce): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ddce): Mirror 2: 0x6ac95f2d (stale) Mirror 4: 0x3ab0daeb (stale) Mirror 5: 0x3ab0daeb (stale) CRC-32 checksum value for chunk [0, 0x1ddce): Mirror 1: 0x67ea81c8 Mirror 6: 0x67ea81c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ddce: skipped 000642 1786828124.949812 read 0x003744 thru 0x00e32e (0xabeb bytes) 000644 1786828124.970202 mapread 0x0108c2 thru 0x0143a0 (0x3adf bytes) 000645 1786828125.003430 mapwrite 0x0385e8 thru 0x03ffff (0x7a18 bytes) 000651 1786828125.211752 mapread 0x0104ee thru 0x01fa25 (0xf538 bytes) 000652 1786828125.237932 write 0x02511e thru 0x02c830 (0x7713 bytes) 000656 1786828125.253881 trunc from 0x040000 to 0x01276f (0x2d890 bytes) 000659 1786828125.281922 mapwrite 0x005af4 thru 0x00d68b (0x7b98 bytes) 000661 1786828125.358075 write 0x00b9ff thru 0x00e314 (0x2916 bytes) 000663 1786828125.369792 MIRROR_RESYNC 5 mirrors 000665 1786828126.885017 MIRROR_EXTEND to 6 mirrors 000667 1786828127.914559 mapwrite 0x0235c8 thru 0x0325b6 (0xefef bytes) 000668 1786828128.072223 read 0x0193ff thru 0x0257d8 (0xc3da bytes) 000669 1786828128.081280 trunc from 0x0325b7 to 0x00719d (0x2b419 bytes) 000670 1786828128.104715 read 0x0056f6 thru 0x0070f5 (0x1a00 bytes) 000671 1786828128.112905 mapwrite 0x019029 thru 0x01ebb4 (0x5b8c bytes) 000674 1786828128.193449 trunc from 0x01ebb5 to 0x0291f0 (0xa63c bytes) 000676 1786828128.210140 mapwrite 0x023eab thru 0x03159c (0xd6f2 bytes) 000677 1786828128.354917 mapread 0x02548e thru 0x02af44 (0x5ab7 bytes) 000678 1786828128.359664 mapwrite 0x034cfe thru 0x03e894 (0x9b97 bytes) 000679 1786828128.475084 read 0x019a37 thru 0x01c498 (0x2a62 bytes) 000683 1786828128.485392 mapread 0x008201 thru 0x016370 (0xe170 bytes) 000684 1786828128.490569 mapwrite 0x008a45 thru 0x0094ac (0xa68 bytes) 000687 1786828128.555239 read 0x0169cf thru 0x01c777 (0x5da9 bytes) 000689 1786828128.571626 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e895): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e895): Mirror 2: 0xe422fb3e (stale) Mirror 4: 0xe422fb3e (stale) Mirror 5: 0xe422fb3e (stale) Mirror 6: 0xe422fb3e (stale) Mirror 7: 0xe422fb3e (stale) CRC-32 checksum value for chunk [0, 0x3e895): Mirror 1: 0x29544a96 Mirror 8: 0x29544a96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e895: skipped 000690 1786828129.765326 mapwrite 0x032c45 thru 0x03593c (0x2cf8 bytes) 000692 1786828130.021707 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e895): Mirror 4: 0xe422fb3e (stale) Mirror 5: 0xe422fb3e (stale) Mirror 6: 0xe422fb3e (stale) Mirror 7: 0xe422fb3e (stale) Mirror 8: 0x29544a96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e895): Mirror 4: 0xe422fb3e (stale) Mirror 5: 0xe422fb3e (stale) Mirror 6: 0xe422fb3e (stale) Mirror 7: 0xe422fb3e (stale) Mirror 8: 0x29544a96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e895: skipped 000693 1786828130.619287 read 0x00e007 thru 0x00e508 (0x502 bytes) 000694 1786828130.625640 mapwrite 0x034bd2 thru 0x03e49b (0x98ca bytes) 000695 1786828130.682683 read 0x00bc29 thru 0x0115fc (0x59d4 bytes) 000696 1786828130.695705 mapwrite 0x00c108 thru 0x01831c (0xc215 bytes) 000698 1786828130.763606 mapread 0x001fb7 thru 0x0093ef (0x7439 bytes) 000699 1786828130.766362 mapwrite 0x003e9a thru 0x00cb09 (0x8c70 bytes) 000702 1786828130.841971 trunc from 0x03e895 to 0x015d88 (0x28b0c bytes) 000704 1786828130.871831 read 0x01094b thru 0x011cc9 (0x137f bytes) 000706 1786828130.873738 mapwrite 0x03b7a8 thru 0x03ffff (0x4858 bytes) 000709 1786828130.968724 mapwrite 0x00d776 thru 0x011bc8 (0x4453 bytes) 000711 1786828131.028659 mapwrite 0x017009 thru 0x01dcf0 (0x6ce8 bytes) 000712 1786828131.149257 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xaa4856de (stale) Mirror 5: 0xaa4856de (stale) Mirror 6: 0xaa4856de (stale) Mirror 7: 0xaa4856de (stale) Mirror 8: 0x638de08d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd893bb5b Mirror 9: 0xd893bb5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000714 1786828132.422605 read 0x005405 thru 0x00eb54 (0x9750 bytes) 000715 1786828132.437794 write 0x016e19 thru 0x017feb (0x11d3 bytes) 000717 1786828132.527773 mapwrite 0x00c0e9 thru 0x00fda1 (0x3cb9 bytes) 000718 1786828132.622036 trunc from 0x040000 to 0x039795 (0x686a bytes) 000719 1786828132.665660 write 0x03f5c3 thru 0x03ffff (0xa3d bytes) 000720 1786828132.667296 mapread 0x021a1f thru 0x02749d (0x5a7f bytes) 000721 1786828132.677393 trunc from 0x040000 to 0x0301ef (0xfe10 bytes) 000722 1786828132.694718 read 0x00580d thru 0x00e0c8 (0x88bc bytes) 000723 1786828132.703592 read 0x0148f1 thru 0x01664f (0x1d5f bytes) 000724 1786828132.708144 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x301f0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x301f0): Mirror 4: 0x763014d7 (stale) Mirror 5: 0x763014d7 (stale) Mirror 6: 0x763014d7 (stale) Mirror 7: 0x763014d7 (stale) Mirror 8: 0xbd23ea0a (stale) Mirror 9: 0x69068d3d (stale) CRC-32 checksum value for chunk [0, 0x301f0): Mirror 1: 0x754d2bd Mirror 10: 0x754d2bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x301f0: skipped 000725 1786828133.859468 mapread 0x00444d thru 0x00822e (0x3de2 bytes) 000729 1786828133.949712 write 0x03d08d thru 0x03ffff (0x2f73 bytes) 000730 1786828134.027837 mapwrite 0x03b561 thru 0x03ffff (0x4a9f bytes) 000731 1786828134.103210 MIRROR_RESYNC 8 mirrors 000732 1786828136.882056 MIRROR_EXTEND to 9 mirrors 000733 1786828137.958865 mapwrite 0x035579 thru 0x03df1c (0x89a4 bytes) 000735 1786828138.245239 trunc from 0x040000 to 0x0212be (0x1ed41 bytes) 000737 1786828138.283608 trunc from 0x0212bf to 0x001b14 (0x1f7aa bytes) 000740 1786828138.309061 trunc from 0x001b15 to 0x0082db (0x67c7 bytes) 000742 1786828138.350621 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x82dc): Mirror 4: 0xdd1f8b14 (stale) Mirror 5: 0xdd1f8b14 (stale) Mirror 6: 0xdd1f8b14 (stale) Mirror 7: 0xdd1f8b14 (stale) Mirror 9: 0xdd1f8b14 (stale) Mirror 10: 0xdd1f8b14 (stale) Mirror 11: 0xdd1f8b14 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x82dc): Mirror 4: 0xdd1f8b14 (stale) Mirror 5: 0xdd1f8b14 (stale) Mirror 6: 0xdd1f8b14 (stale) Mirror 7: 0xdd1f8b14 (stale) Mirror 9: 0xdd1f8b14 (stale) Mirror 10: 0xdd1f8b14 (stale) Mirror 11: 0xdd1f8b14 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x82dc: skipped 000745 1786828138.840312 read 0x0031e7 thru 0x004c50 (0x1a6a bytes) 000746 1786828138.847385 mapwrite 0x00a949 thru 0x012e71 (0x8529 bytes) 000748 1786828138.933376 write 0x01a68c thru 0x021e89 (0x77fe bytes) 000749 1786828138.941448 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21e8a): Mirror 4: 0x233bad74 (stale) Mirror 5: 0x233bad74 (stale) Mirror 6: 0x233bad74 (stale) Mirror 7: 0x233bad74 (stale) Mirror 10: 0x233bad74 (stale) Mirror 11: 0x233bad74 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21e8a): Mirror 4: 0x233bad74 (stale) Mirror 5: 0x233bad74 (stale) Mirror 6: 0x233bad74 (stale) Mirror 7: 0x233bad74 (stale) Mirror 10: 0x233bad74 (stale) Mirror 11: 0x233bad74 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21e8a: skipped 000750 1786828139.419654 mapread 0x00a2c0 thru 0x019ce6 (0xfa27 bytes) 000754 1786828139.450445 read 0x015885 thru 0x01b4be (0x5c3a bytes) 000755 1786828139.451338 write 0x02b01f thru 0x033529 (0x850b bytes) 000756 1786828139.453993 write 0x035847 thru 0x03e149 (0x8903 bytes) 000757 1786828139.456423 mapwrite 0x03c91a thru 0x03db5e (0x1245 bytes) 000758 1786828139.522836 write 0x03621f thru 0x03f546 (0x9328 bytes) 000759 1786828139.524429 read 0x030b53 thru 0x0359ef (0x4e9d bytes) 000760 1786828139.540968 mapread 0x03415c thru 0x03f546 (0xb3eb bytes) 000761 1786828139.544272 write 0x0198de thru 0x0266f7 (0xce1a bytes) 000762 1786828139.547496 trunc from 0x03f547 to 0x023f15 (0x1b631 bytes) 000763 1786828139.589574 read 0x012140 thru 0x01c98e (0xa84f bytes) 000764 1786828139.591448 mapread 0x0105c0 thru 0x01c900 (0xc341 bytes) 000765 1786828139.601150 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x23f16): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23f16): Mirror 4: 0x5375422a (stale) Mirror 5: 0x5375422a (stale) Mirror 6: 0x5375422a (stale) Mirror 7: 0x5375422a (stale) Mirror 10: 0x5375422a (stale) Mirror 11: 0x5375422a (stale) CRC-32 checksum value for chunk [0, 0x23f16): Mirror 1: 0xfcd0e612 Mirror 12: 0xfcd0e612 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23f16: skipped 000769 1786828140.876662 write 0x02c5e4 thru 0x030561 (0x3f7e bytes) 000770 1786828141.010265 write 0x02d739 thru 0x02d86d (0x135 bytes) 000771 1786828141.013751 read 0x00c508 thru 0x010983 (0x447c bytes) 000772 1786828141.028659 trunc from 0x030562 to 0x014b9a (0x1b9c7 bytes) 000774 1786828141.105457 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x14b9b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14b9b): Mirror 4: 0xd5e87cdd (stale) Mirror 5: 0xd5e87cdd (stale) Mirror 6: 0xd5e87cdd (stale) Mirror 7: 0xd5e87cdd (stale) Mirror 10: 0xd5e87cdd (stale) Mirror 11: 0xd5e87cdd (stale) Mirror 12: 0xd30c1f19 (stale) CRC-32 checksum value for chunk [0, 0x14b9b): Mirror 1: 0xd30c1f19 Mirror 13: 0xd30c1f19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14b9b: skipped 000775 1786828142.324860 write 0x012256 thru 0x01de12 (0xbbbd bytes) 000777 1786828142.410989 read 0x00d7b1 thru 0x00e133 (0x983 bytes) 000778 1786828142.423941 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1de13): Mirror 5: 0x76c16f48 (stale) Mirror 6: 0x76c16f48 (stale) Mirror 7: 0x76c16f48 (stale) Mirror 10: 0x76c16f48 (stale) Mirror 11: 0x76c16f48 (stale) Mirror 12: 0x58648c4d (stale) Mirror 13: 0x85a32ef4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1de13): Mirror 5: 0x76c16f48 (stale) Mirror 6: 0x76c16f48 (stale) Mirror 7: 0x76c16f48 (stale) Mirror 10: 0x76c16f48 (stale) Mirror 11: 0x76c16f48 (stale) Mirror 12: 0x58648c4d (stale) Mirror 13: 0x85a32ef4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1de13: skipped 000779 1786828142.931471 read 0x00bb6e thru 0x0117e9 (0x5c7c bytes) 000780 1786828142.945210 read 0x01c76f thru 0x01de12 (0x16a4 bytes) 000786 1786828142.960180 trunc from 0x01de13 to 0x027b49 (0x9d37 bytes) 000787 1786828143.002169 write 0x00d598 thru 0x013972 (0x63db bytes) 000788 1786828143.008787 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27b4a): Mirror 5: 0x55bf4118 (stale) Mirror 6: 0x55bf4118 (stale) Mirror 10: 0x55bf4118 (stale) Mirror 11: 0x55bf4118 (stale) Mirror 12: 0xfccb094a (stale) Mirror 13: 0xea919c44 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b4a): Mirror 5: 0x55bf4118 (stale) Mirror 6: 0x55bf4118 (stale) Mirror 10: 0x55bf4118 (stale) Mirror 11: 0x55bf4118 (stale) Mirror 12: 0xfccb094a (stale) Mirror 13: 0xea919c44 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b4a: skipped 000789 1786828143.681972 read 0x014774 thru 0x0169df (0x226c bytes) 000790 1786828143.690195 write 0x03af8d thru 0x03f8b5 (0x4929 bytes) 000792 1786828143.693876 mapread 0x003210 thru 0x006816 (0x3607 bytes) 000793 1786828143.725590 mapread 0x01a145 thru 0x020027 (0x5ee3 bytes) 000794 1786828143.742920 write 0x021f76 thru 0x02f1d7 (0xd262 bytes) 000795 1786828143.755991 mapwrite 0x0023ad thru 0x011a65 (0xf6b9 bytes) 000796 1786828143.897522 write 0x03c50f thru 0x03ffff (0x3af1 bytes) 000798 1786828143.909655 mapwrite 0x02e067 thru 0x02f49a (0x1434 bytes) 000799 1786828144.097567 mapwrite 0x00af5c thru 0x00f382 (0x4427 bytes) 000800 1786828144.235252 trunc from 0x040000 to 0x018759 (0x278a6 bytes) 000801 1786828144.278569 mapwrite 0x034355 thru 0x03ad9e (0x6a4a bytes) 000804 1786828144.407370 mapwrite 0x012ce3 thru 0x01b041 (0x835f bytes) 000805 1786828144.487451 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ad9f): Mirror 5: 0x5a7166c6 (stale) Mirror 6: 0x5a7166c6 (stale) Mirror 10: 0x5a7166c6 (stale) Mirror 11: 0x5a7166c6 (stale) Mirror 12: 0x29b24180 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad9f): Mirror 5: 0x5a7166c6 (stale) Mirror 6: 0x5a7166c6 (stale) Mirror 10: 0x5a7166c6 (stale) Mirror 11: 0x5a7166c6 (stale) Mirror 12: 0x29b24180 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad9f: skipped 000806 1786828144.922842 mapread 0x036ecf thru 0x03ad9e (0x3ed0 bytes) 000807 1786828144.946438 mapread 0x017d6e thru 0x026e6e (0xf101 bytes) 000808 1786828144.965505 mapwrite 0x001593 thru 0x003ee3 (0x2951 bytes) 000810 1786828145.019308 read 0x01f529 thru 0x02853c (0x9014 bytes) 000811 1786828145.024551 MIRROR_RESYNC 6 mirrors 000812 1786828147.064807 MIRROR_EXTEND to 7 mirrors 000813 1786828148.230934 trunc from 0x03ad9f to 0x002978 (0x38426 bytes) 000817 1786828148.350330 MIRROR_RESYNC 7 mirrors 000819 1786828149.759049 write 0x0150e2 thru 0x0215af (0xc4ce bytes) 000820 1786828149.846820 trunc from 0x0215b0 to 0x032bf2 (0x11643 bytes) 000821 1786828149.887849 MIRROR_RESYNC 7 mirrors 000822 1786828152.742782 mapread 0x0267aa thru 0x032111 (0xb968 bytes) 000823 1786828152.783253 trunc from 0x032bf3 to 0x001f29 (0x30cc9 bytes) 000825 1786828153.005796 write 0x02df6d thru 0x031d15 (0x3da9 bytes) 000826 1786828153.011845 mapread 0x017d49 thru 0x02710e (0xf3c6 bytes) 000827 1786828153.055468 mapread 0x011e2a thru 0x0187e0 (0x69b7 bytes) 000828 1786828153.058778 mapread 0x0284b0 thru 0x031d15 (0x9866 bytes) 000829 1786828153.070453 read 0x003b4d thru 0x00a97d (0x6e31 bytes) 000833 1786828153.087391 read 0x0179fd thru 0x01baae (0x40b2 bytes) 000835 1786828153.091196 trunc from 0x031d16 to 0x02841e (0x98f7 bytes) 000836 1786828153.165369 write 0x026ada thru 0x03345a (0xc981 bytes) 000837 1786828153.172415 mapread 0x00374c thru 0x003fe1 (0x896 bytes) 000838 1786828153.177357 read 0x02d1d7 thru 0x03345a (0x6284 bytes) 000839 1786828153.178924 write 0x02e7e1 thru 0x03b123 (0xc943 bytes) 000840 1786828153.191182 write 0x00f766 thru 0x01a57f (0xae1a bytes) 000842 1786828153.220604 read 0x017e4e thru 0x025934 (0xdae7 bytes) 000843 1786828153.221404 write 0x00e483 thru 0x01bd3a (0xd8b8 bytes) 000844 1786828153.230543 mapread 0x01e0fa thru 0x023ca8 (0x5baf bytes) 000845 1786828153.237251 write 0x003b9f thru 0x00a1cf (0x6631 bytes) 000846 1786828153.245152 MIRROR_RESYNC 7 mirrors 000849 1786828157.311083 mapread 0x023f48 thru 0x0242c9 (0x382 bytes) 000850 1786828157.325167 MIRROR_RESYNC 7 mirrors 000851 1786828157.860136 write 0x004582 thru 0x007f3b (0x39ba bytes) 000852 1786828157.936137 read 0x0235a5 thru 0x02fb88 (0xc5e4 bytes) 000853 1786828157.951301 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b124): Mirror 5: 0x1b2491f6 (stale) Mirror 6: 0x1b2491f6 (stale) Mirror 10: 0x1b2491f6 (stale) Mirror 12: 0x1b2491f6 (stale) Mirror 13: 0x1b2491f6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b124): Mirror 5: 0x1b2491f6 (stale) Mirror 6: 0x1b2491f6 (stale) Mirror 10: 0x1b2491f6 (stale) Mirror 12: 0x1b2491f6 (stale) Mirror 13: 0x1b2491f6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b124: skipped 000854 1786828158.483173 read 0x00b496 thru 0x010dbd (0x5928 bytes) 000855 1786828158.495003 mapwrite 0x005fb0 thru 0x00fea3 (0x9ef4 bytes) 000856 1786828158.602165 mapwrite 0x0280a6 thru 0x03104e (0x8fa9 bytes) 000858 1786828158.717895 read 0x0152cb thru 0x01982d (0x4563 bytes) 000860 1786828158.732222 mapread 0x029e1b thru 0x02b114 (0x12fa bytes) 000861 1786828158.734380 mapread 0x001de9 thru 0x009d3d (0x7f55 bytes) 000862 1786828158.736296 trunc from 0x03b124 to 0x015f07 (0x2521c bytes) 000863 1786828158.766521 mapread 0x009374 thru 0x00f9d2 (0x665f bytes) 000864 1786828158.776218 mapwrite 0x013af0 thru 0x018215 (0x4726 bytes) 000865 1786828158.913906 mapwrite 0x03307c thru 0x03b380 (0x8305 bytes) 000867 1786828159.112343 trunc from 0x03b381 to 0x01e485 (0x1cefb bytes) 000868 1786828159.131470 read 0x010e84 thru 0x014b73 (0x3cf0 bytes) 000873 1786828159.137998 read 0x00f76c thru 0x01e13d (0xe9d2 bytes) 000874 1786828159.145510 mapwrite 0x023693 thru 0x02d593 (0x9f01 bytes) 000876 1786828159.218314 read 0x010eba thru 0x01555b (0x46a2 bytes) 000877 1786828159.219343 read 0x005a91 thru 0x00b2aa (0x581a bytes) 000879 1786828159.221424 mapread 0x0071e6 thru 0x015c67 (0xea82 bytes) 000880 1786828159.223475 write 0x02340d thru 0x02df76 (0xab6a bytes) 000881 1786828159.225844 write 0x032837 thru 0x033f04 (0x16ce bytes) 000882 1786828159.227432 trunc from 0x033f05 to 0x020b96 (0x1336e bytes) 000883 1786828159.249555 write 0x01dc6f thru 0x029364 (0xb6f6 bytes) 000885 1786828159.258926 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29365): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29365): Mirror 5: 0x92c7429a (stale) Mirror 6: 0x92c7429a (stale) Mirror 10: 0x92c7429a (stale) Mirror 12: 0x92c7429a (stale) Mirror 13: 0x92c7429a (stale) CRC-32 checksum value for chunk [0, 0x29365): Mirror 1: 0x933df5fb Mirror 14: 0x933df5fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29365: skipped 000887 1786828160.571734 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x29365): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29365): Mirror 5: 0x92c7429a (stale) Mirror 6: 0x92c7429a (stale) Mirror 10: 0x92c7429a (stale) Mirror 12: 0x92c7429a (stale) Mirror 13: 0x92c7429a (stale) CRC-32 checksum value for chunk [0, 0x29365): Mirror 1: 0x933df5fb Mirror 14: 0x933df5fb Mirror 15: 0x933df5fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29365: skipped 000889 1786828161.805820 mapread 0x008786 thru 0x015ec0 (0xd73b bytes) 000890 1786828161.842034 mapwrite 0x02aabf thru 0x038d04 (0xe246 bytes) 000891 1786828162.131610 write 0x01597c thru 0x021bc4 (0xc249 bytes) 000895 1786828162.151139 mapread 0x01f161 thru 0x02e326 (0xf1c6 bytes) 000896 1786828162.160339 read 0x03806b thru 0x038d04 (0xc9a bytes) 000897 1786828162.162767 mapwrite 0x039634 thru 0x03ffff (0x69cc bytes) 000898 1786828162.256644 read 0x02ed92 thru 0x0380af (0x931e bytes) 000899 1786828162.257680 mapwrite 0x0149b9 thru 0x0222ae (0xd8f6 bytes) 000900 1786828162.316015 write 0x031f90 thru 0x03f90e (0xd97f bytes) 000901 1786828162.317633 mapwrite 0x01a937 thru 0x01db19 (0x31e3 bytes) 000902 1786828162.384794 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xaa741139 (stale) Mirror 6: 0xaa741139 (stale) Mirror 10: 0xaa741139 (stale) Mirror 12: 0xaa741139 (stale) Mirror 13: 0xaa741139 (stale) Mirror 14: 0x22876d5f (stale) Mirror 15: 0x22876d5f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfba88944 Mirror 16: 0xfba88944 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000904 1786828163.567303 mapwrite 0x011fb1 thru 0x0183ed (0x643d bytes) 000905 1786828163.820910 read 0x00d739 thru 0x017b74 (0xa43c bytes) 000908 1786828163.825958 mapread 0x009990 thru 0x017c14 (0xe285 bytes) 000910 1786828163.838494 mapread 0x036f50 thru 0x038750 (0x1801 bytes) 000913 1786828163.854725 MIRROR_RESYNC 9 mirrors 000914 1786828166.464404 write 0x003a0f thru 0x012f7c (0xf56e bytes) 000915 1786828166.575131 MIRROR_RESYNC 9 mirrors 000916 1786828169.089692 MIRROR_EXTEND to 10 mirrors 000917 1786828170.149506 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000918 1786828170.763792 mapread 0x015b03 thru 0x01e4d1 (0x89cf bytes) 000921 1786828170.796303 write 0x02f0d1 thru 0x03e38e (0xf2be bytes) 000922 1786828170.904508 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xaa9d63a9 (stale) Mirror 6: 0xaa9d63a9 (stale) Mirror 10: 0xaa9d63a9 (stale) Mirror 12: 0xaa9d63a9 (stale) Mirror 13: 0xaa9d63a9 (stale) Mirror 15: 0xaa9d63a9 (stale) Mirror 16: 0xaa9d63a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xaa9d63a9 (stale) Mirror 6: 0xaa9d63a9 (stale) Mirror 10: 0xaa9d63a9 (stale) Mirror 12: 0xaa9d63a9 (stale) Mirror 13: 0xaa9d63a9 (stale) Mirror 15: 0xaa9d63a9 (stale) Mirror 16: 0xaa9d63a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000924 1786828171.550460 trunc from 0x040000 to 0x011b10 (0x2e4ef bytes) 000927 1786828171.579364 mapwrite 0x01b84e thru 0x021f5c (0x670f bytes) 000928 1786828171.679559 trunc from 0x021f5d to 0x02484a (0x28ee bytes) 000930 1786828171.734775 mapread 0x0212a1 thru 0x02484a (0x35aa bytes) 000933 1786828171.746256 write 0x02188a thru 0x02dbb0 (0xc327 bytes) 000934 1786828171.748067 mapread 0x0045d2 thru 0x00acfe (0x672d bytes) 000936 1786828171.760365 mapwrite 0x00b6bb thru 0x017c79 (0xc5bf bytes) 000939 1786828171.846435 mapwrite 0x00acfb thru 0x0173ae (0xc6b4 bytes) 000941 1786828171.900425 read 0x01b26f thru 0x01f99c (0x472e bytes) 000942 1786828171.901085 trunc from 0x02dbb1 to 0x023abf (0xa0f1 bytes) 000947 1786828171.923430 read 0x0226a2 thru 0x023abf (0x141e bytes) 000949 1786828171.932206 read 0x00a3fd thru 0x017078 (0xcc7c bytes) 000950 1786828171.934967 read 0x0090a3 thru 0x009f0d (0xe6b bytes) 000951 1786828171.942224 MIRROR_RESYNC 8 mirrors 000952 1786828176.732026 write 0x019722 thru 0x028670 (0xef4f bytes) 000954 1786828176.816418 read 0x00e516 thru 0x0124c1 (0x3fac bytes) 000955 1786828176.829130 mapwrite 0x0264ad thru 0x02f182 (0x8cd6 bytes) 000956 1786828176.987286 mapwrite 0x02e3ec thru 0x032ec4 (0x4ad9 bytes) 000960 1786828177.071072 mapwrite 0x0284e8 thru 0x02c777 (0x4290 bytes) 000961 1786828177.126318 MIRROR_RESYNC 8 mirrors 000962 1786828180.389651 write 0x026b16 thru 0x028532 (0x1a1d bytes) 000963 1786828180.471041 trunc from 0x032ec5 to 0x003cb7 (0x2f20d bytes) 000964 1786828180.501667 write 0x015da2 thru 0x017b2d (0x1d8c bytes) 000965 1786828180.505038 read 0x012ca7 thru 0x01479d (0x1af7 bytes) 000966 1786828180.512836 read 0x00d005 thru 0x00ed82 (0x1d7e bytes) 000968 1786828180.525839 mapwrite 0x0070eb thru 0x0134b0 (0xc3c6 bytes) 000969 1786828180.583528 write 0x0103e8 thru 0x0103fd (0x16 bytes) 000970 1786828180.584537 mapread 0x0089f7 thru 0x0145a7 (0xbbb1 bytes) 000971 1786828180.585614 read 0x00b0c0 thru 0x010b6e (0x5aaf bytes) 000972 1786828180.586273 mapread 0x00c349 thru 0x01060e (0x42c6 bytes) 000973 1786828180.587184 read 0x007b00 thru 0x015b2a (0xe02b bytes) 000974 1786828180.587734 write 0x030013 thru 0x03ec97 (0xec85 bytes) 000975 1786828180.592194 MIRROR_RESYNC 8 mirrors 000976 1786828185.215449 write 0x01ae4c thru 0x02ac37 (0xfdec bytes) 000981 1786828185.362182 mapwrite 0x03979a thru 0x03ffff (0x6866 bytes) 000982 1786828185.525290 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x51bd0db2 (stale) Mirror 6: 0x51bd0db2 (stale) Mirror 10: 0x51bd0db2 (stale) Mirror 12: 0x51bd0db2 (stale) Mirror 13: 0x51bd0db2 (stale) Mirror 15: 0x51bd0db2 (stale) Mirror 16: 0x51bd0db2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf88d0f88 Mirror 17: 0xf88d0f88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000985 1786828187.478664 write 0x0135bc thru 0x016d13 (0x3758 bytes) 000989 1786828187.583778 mapwrite 0x029516 thru 0x02e8d5 (0x53c0 bytes) 000990 1786828187.677696 write 0x0108fe thru 0x01884b (0x7f4e bytes) 000992 1786828187.700287 trunc from 0x040000 to 0x01fb96 (0x20469 bytes) 000997 1786828187.730329 read 0x013930 thru 0x019b62 (0x6233 bytes) All operations completed A-OK!