== sanity-flr test 70a: flr mode fsx test ================ 16:01:29 (1787860889) Seed set to 890 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1787860891.268342 write 0x0045aa thru 0x00b02a (0x6a81 bytes) truncating to largest ever: 0x3c3c7 000004 1787860891.269865 trunc from 0x00b02b to 0x03c3c6 (0x3139c bytes) 000005 1787860891.307723 trunc from 0x03c3c7 to 0x03099f (0xba27 bytes) 000007 1787860891.332631 trunc from 0x0309a0 to 0x038de5 (0x8446 bytes) 000008 1787860891.359376 MIRROR_EXTEND to 2 mirrors 000009 1787860892.326898 read 0x0375d8 thru 0x038de5 (0x180e bytes) 000010 1787860892.334865 read 0x025bc7 thru 0x0355b6 (0xf9f0 bytes) 000012 1787860892.344569 write 0x00b430 thru 0x011704 (0x62d5 bytes) 000013 1787860892.427227 trunc from 0x038de6 to 0x02efc6 (0x9e1f bytes) 000014 1787860892.452984 write 0x00a85d thru 0x013583 (0x8d27 bytes) 000017 1787860892.466356 MIRROR_RESYNC 2 mirrors 000018 1787860893.296496 read 0x022357 thru 0x02e384 (0xc02e bytes) 000019 1787860893.322347 MIRROR_EXTEND to 3 mirrors 000020 1787860894.568120 read 0x00b34d thru 0x012bf5 (0x78a9 bytes) 000021 1787860894.597922 mapwrite 0x0019d2 thru 0x00b3f6 (0x9a25 bytes) 000023 1787860894.860145 read 0x01a1f1 thru 0x0239f5 (0x9805 bytes) 000024 1787860894.874888 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2efc7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2efc7): Mirror 2: 0x84c5abcd (stale) Mirror 3: 0x84c5abcd (stale) CRC-32 checksum value for chunk [0, 0x2efc7): Mirror 1: 0x9ccaef64 Mirror 4: 0x9ccaef64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2efc7: skipped 000025 1787860896.078176 read 0x00675e thru 0x00d690 (0x6f33 bytes) 000027 1787860896.097291 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2efc7): Mirror 3: 0x84c5abcd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2efc7): Mirror 3: 0x84c5abcd (stale) CRC-32 checksum value for chunk [0, 0x2efc7): Mirror 1: 0x9ccaef64 Mirror 4: 0x9ccaef64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2efc7: skipped 000031 1787860896.673604 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) 000033 1787860897.029604 write 0x03bc9b thru 0x03ffff (0x4365 bytes) 000034 1787860897.114872 MIRROR_RESYNC 2 mirrors 000035 1787860897.937051 MIRROR_RESYNC 2 mirrors 000036 1787860898.283644 mapread 0x022708 thru 0x02c5e1 (0x9eda bytes) 000039 1787860898.315519 mapwrite 0x03ae03 thru 0x03ffff (0x51fd bytes) 000041 1787860898.467960 write 0x020c88 thru 0x02630b (0x5684 bytes) 000042 1787860898.485118 MIRROR_RESYNC 2 mirrors 000043 1787860899.589476 trunc from 0x040000 to 0x02f6e5 (0x1091a bytes) 000047 1787860899.672003 read 0x011502 thru 0x01ed53 (0xd852 bytes) 000048 1787860899.703126 write 0x0219cc thru 0x0260c9 (0x46fe bytes) 000050 1787860899.729604 mapread 0x00eaf5 thru 0x01608e (0x759a bytes) 000053 1787860899.783384 read 0x02044a thru 0x02a19e (0x9d55 bytes) 000054 1787860899.804891 trunc from 0x02f6e6 to 0x026240 (0x94a5 bytes) 000055 1787860899.844471 write 0x02c359 thru 0x036e50 (0xaaf8 bytes) 000057 1787860899.846228 read 0x02d61d thru 0x035032 (0x7a16 bytes) 000059 1787860899.848231 mapread 0x00a9e3 thru 0x00e8f7 (0x3f15 bytes) 000060 1787860899.849350 write 0x011526 thru 0x012581 (0x105c bytes) 000061 1787860899.853040 read 0x012038 thru 0x015db9 (0x3d82 bytes) 000062 1787860899.854457 read 0x035037 thru 0x036e50 (0x1e1a bytes) 000063 1787860899.855183 mapwrite 0x02519e thru 0x02a406 (0x5269 bytes) 000064 1787860899.964362 mapwrite 0x039a7b thru 0x03ffff (0x6585 bytes) 000065 1787860900.062071 read 0x01cff9 thru 0x02995b (0xc963 bytes) 000066 1787860900.062676 write 0x03cbae thru 0x03ffff (0x3452 bytes) 000067 1787860900.063600 write 0x01dddc thru 0x02679d (0x89c2 bytes) 000068 1787860900.064609 mapwrite 0x0155dd thru 0x021067 (0xba8b bytes) 000070 1787860900.106670 read 0x006c47 thru 0x01036f (0x9729 bytes) 000071 1787860900.107238 read 0x024f7d thru 0x02c1ad (0x7231 bytes) 000074 1787860900.113073 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) 000076 1787860900.219868 mapread 0x022ac0 thru 0x0251d4 (0x2715 bytes) 000078 1787860900.236780 mapwrite 0x03755b thru 0x03e450 (0x6ef6 bytes) 000082 1787860900.280567 write 0x016799 thru 0x024f91 (0xe7f9 bytes) 000084 1787860900.290300 read 0x02c445 thru 0x030b66 (0x4722 bytes) 000086 1787860900.296548 read 0x037051 thru 0x03ffff (0x8faf bytes) 000087 1787860900.297195 mapwrite 0x036250 thru 0x03ffff (0x9db0 bytes) 000093 1787860900.365518 trunc from 0x040000 to 0x01ad5d (0x252a2 bytes) 000094 1787860900.379143 write 0x00a02f thru 0x014e32 (0xae04 bytes) 000095 1787860900.388780 mapread 0x0008f7 thru 0x005860 (0x4f6a bytes) 000097 1787860900.394050 write 0x0012ec thru 0x00c882 (0xb597 bytes) 000099 1787860900.397568 mapwrite 0x0009d0 thru 0x007f1d (0x754e bytes) 000100 1787860900.455752 mapwrite 0x000f7d thru 0x00a4a4 (0x9528 bytes) 000101 1787860900.529841 mapread 0x007c3e thru 0x011414 (0x97d7 bytes) 000102 1787860900.530929 trunc from 0x01ad5e to 0x011678 (0x96e5 bytes) 000105 1787860900.548336 mapwrite 0x023df3 thru 0x02537e (0x158c bytes) 000106 1787860900.643842 write 0x01b4d8 thru 0x02549e (0x9fc7 bytes) 000107 1787860900.646040 read 0x007fec thru 0x00dd4d (0x5d62 bytes) 000112 1787860900.651069 trunc from 0x02549f to 0x008e65 (0x1c639 bytes) 000113 1787860900.669682 mapwrite 0x014280 thru 0x01ce60 (0x8be1 bytes) 000115 1787860900.747214 write 0x0256ba thru 0x02b693 (0x5fda bytes) 000116 1787860900.748302 trunc from 0x02b694 to 0x0239b6 (0x7cdd bytes) 000117 1787860900.786712 write 0x0137e4 thru 0x01718e (0x39ab bytes) truncating to largest ever: 0x3e236 000125 1787860900.802606 trunc from 0x0239b7 to 0x03e235 (0x1a87f bytes) 000126 1787860900.843457 MIRROR_EXTEND to 2 mirrors 000127 1787860901.947582 read 0x01c2e7 thru 0x01cd0e (0xa28 bytes) 000128 1787860901.953034 read 0x0338d2 thru 0x03e235 (0xa964 bytes) 000131 1787860901.965890 mapread 0x039a0f thru 0x03e076 (0x4668 bytes) 000132 1787860901.967092 mapwrite 0x0277d7 thru 0x02784a (0x74 bytes) 000134 1787860902.137315 mapread 0x023367 thru 0x02981d (0x64b7 bytes) 000135 1787860902.202047 write 0x03f960 thru 0x03ffff (0x6a0 bytes) 000136 1787860902.212116 MIRROR_RESYNC 2 mirrors 000138 1787860903.089845 trunc from 0x040000 to 0x036bfd (0x9402 bytes) 000140 1787860903.199483 mapread 0x0346b5 thru 0x036bfd (0x2549 bytes) 000141 1787860903.224916 trunc from 0x036bfe to 0x02a25e (0xc99f bytes) 000147 1787860903.260516 read 0x028879 thru 0x02a25e (0x19e6 bytes) 000148 1787860903.270607 mapwrite 0x00b081 thru 0x0177d0 (0xc750 bytes) 000152 1787860903.334528 write 0x03efb6 thru 0x03ffff (0x104a bytes) 000153 1787860903.335500 read 0x03737a thru 0x03ffff (0x8c86 bytes) 000154 1787860903.344363 trunc from 0x040000 to 0x019fdc (0x26023 bytes) 000155 1787860903.366734 MIRROR_RESYNC 2 mirrors 000156 1787860904.135752 mapwrite 0x01e917 thru 0x022d76 (0x4460 bytes) 000157 1787860904.414135 mapread 0x01250f thru 0x01fe95 (0xd987 bytes) 000158 1787860904.438863 write 0x0270eb thru 0x02d356 (0x626c bytes) 000159 1787860904.441283 mapwrite 0x01dd66 thru 0x020597 (0x2832 bytes) 000160 1787860904.551272 mapread 0x026eaf thru 0x02d05b (0x61ad bytes) 000162 1787860904.578812 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2d357): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d357): Mirror 2: 0x5d0d905b (stale) CRC-32 checksum value for chunk [0, 0x2d357): Mirror 1: 0x8b45de20 Mirror 3: 0x8b45de20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d357: skipped 000163 1787860905.310100 read 0x014831 thru 0x01d22a (0x89fa bytes) 000168 1787860905.329859 read 0x00bd3f thru 0x00bec6 (0x188 bytes) 000169 1787860905.358159 MIRROR_RESYNC 3 mirrors 000172 1787860906.144052 mapread 0x0273cd thru 0x02cd7c (0x59b0 bytes) 000173 1787860906.163468 mapwrite 0x0278b1 thru 0x02e871 (0x6fc1 bytes) 000174 1787860906.303704 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e872): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e872): Mirror 2: 0x16c10478 (stale) Mirror 3: 0x16c10478 (stale) CRC-32 checksum value for chunk [0, 0x2e872): Mirror 1: 0xba3095ab Mirror 4: 0xba3095ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e872: skipped 000176 1787860907.015762 trunc from 0x02e872 to 0x01a5c1 (0x142b0 bytes) 000178 1787860907.147322 mapread 0x00d155 thru 0x01a5c1 (0xd46d bytes) 000179 1787860907.176876 mapwrite 0x037844 thru 0x0392bf (0x1a7c bytes) 000183 1787860907.253733 mapwrite 0x03ccc4 thru 0x03e305 (0x1642 bytes) 000184 1787860907.320693 read 0x0331c8 thru 0x039a41 (0x687a bytes) 000185 1787860907.321676 mapwrite 0x03b153 thru 0x03ffff (0x4ead bytes) 000187 1787860907.411855 read 0x003f79 thru 0x009181 (0x5209 bytes) 000188 1787860907.420554 mapwrite 0x004db1 thru 0x00855d (0x37ad bytes) 000189 1787860907.458621 read 0x03f2fd thru 0x03ffff (0xd03 bytes) 000192 1787860907.459765 mapwrite 0x00c7a1 thru 0x0100f9 (0x3959 bytes) 000194 1787860907.553455 read 0x01d1b9 thru 0x0246ff (0x7547 bytes) 000196 1787860907.555440 mapwrite 0x0188ff thru 0x025bcc (0xd2ce bytes) 000197 1787860907.649374 mapread 0x020540 thru 0x026e1a (0x68db bytes) 000200 1787860907.656802 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000202 1787860908.018738 mapwrite 0x01a7fa thru 0x01a977 (0x17e bytes) 000205 1787860908.109033 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcd22367d Mirror 5: 0xcd22367d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000206 1787860909.001321 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcd22367d Mirror 5: 0xcd22367d Mirror 6: 0xcd22367d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000207 1787860909.948747 mapwrite 0x01287a thru 0x018d53 (0x64da bytes) 000209 1787860910.165553 mapwrite 0x0212e3 thru 0x0273cb (0x60e9 bytes) 000210 1787860910.206480 write 0x037c51 thru 0x039dbf (0x216f bytes) 000213 1787860910.219783 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) Mirror 5: 0xcd22367d (stale) Mirror 6: 0xcd22367d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2e41593 Mirror 7: 0x2e41593 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000214 1787860911.174910 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) Mirror 5: 0xcd22367d (stale) Mirror 6: 0xcd22367d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2e41593 Mirror 7: 0x2e41593 Mirror 8: 0x2e41593 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000216 1787860912.412308 mapread 0x00b24b thru 0x00b7e3 (0x599 bytes) 000218 1787860912.422836 write 0x0047fa thru 0x007cd8 (0x34df bytes) 000220 1787860912.554074 mapwrite 0x02cdb5 thru 0x0300eb (0x3337 bytes) 000223 1787860912.645062 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) Mirror 5: 0xcd22367d (stale) Mirror 6: 0xcd22367d (stale) Mirror 7: 0x2e41593 (stale) Mirror 8: 0x2e41593 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc64c7f5 Mirror 9: 0xc64c7f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000224 1787860913.556746 mapread 0x025fb5 thru 0x02890b (0x2957 bytes) 000227 1787860913.588842 write 0x035a01 thru 0x03ffff (0xa5ff bytes) 000229 1787860913.691432 mapwrite 0x034f22 thru 0x03ffff (0xb0de bytes) 000230 1787860913.736837 write 0x018fd2 thru 0x023669 (0xa698 bytes) 000232 1787860913.752344 trunc from 0x040000 to 0x0243b1 (0x1bc4e bytes) 000234 1787860913.787974 mapread 0x01d787 thru 0x01ea5e (0x12d8 bytes) 000235 1787860913.789812 trunc from 0x0243b2 to 0x030dde (0xca2d bytes) 000236 1787860913.803646 trunc from 0x030ddf to 0x01bf7d (0x14e61 bytes) 000237 1787860913.828639 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1bf7e): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bf7e): Mirror 3: 0x46b4b390 (stale) Mirror 4: 0x46b4b390 (stale) Mirror 5: 0x72601f89 (stale) Mirror 6: 0x72601f89 (stale) Mirror 7: 0xee62f387 (stale) Mirror 8: 0xee62f387 (stale) Mirror 9: 0xa92f8eb6 (stale) CRC-32 checksum value for chunk [0, 0x1bf7e): Mirror 1: 0xc5dced Mirror 10: 0xc5dced lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bf7e: skipped 000238 1787860914.725598 mapwrite 0x03025f thru 0x03c0ba (0xbe5c bytes) 000239 1787860914.897190 mapwrite 0x03912c thru 0x0393e6 (0x2bb bytes) 000240 1787860914.924281 mapread 0x00a387 thru 0x00dd7b (0x39f5 bytes) 000243 1787860914.937473 mapread 0x038298 thru 0x03c0ba (0x3e23 bytes) 000246 1787860914.940638 trunc from 0x03c0bb to 0x02a506 (0x11bb4 bytes) 000248 1787860914.958775 mapread 0x00746b thru 0x00ecc7 (0x785d bytes) 000249 1787860914.960080 read 0x006f87 thru 0x00b14e (0x41c8 bytes) 000252 1787860914.961840 read 0x008a31 thru 0x01296f (0x9f3f bytes) 000254 1787860914.963659 read 0x0248dd thru 0x02a506 (0x5c2a bytes) 000255 1787860914.982002 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a507): Mirror 3: 0xeb7f26ff (stale) Mirror 4: 0x67b0252c (stale) Mirror 5: 0xaa6ba912 (stale) Mirror 6: 0xaa6ba912 (stale) Mirror 7: 0x6e204e54 (stale) Mirror 9: 0x4d92a6d5 (stale) Mirror 10: 0xeb1f98d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a507): Mirror 3: 0xeb7f26ff (stale) Mirror 4: 0x67b0252c (stale) Mirror 5: 0xaa6ba912 (stale) Mirror 6: 0xaa6ba912 (stale) Mirror 7: 0x6e204e54 (stale) Mirror 9: 0x4d92a6d5 (stale) Mirror 10: 0xeb1f98d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a507: skipped 000256 1787860915.411191 mapwrite 0x027c96 thru 0x02ebd6 (0x6f41 bytes) 000258 1787860915.502727 write 0x00ffa6 thru 0x01991a (0x9975 bytes) 000263 1787860915.516692 read 0x021aac thru 0x02ebd6 (0xd12b bytes) 000264 1787860915.522968 mapwrite 0x026b1b thru 0x02cfa5 (0x648b bytes) 000265 1787860915.568369 write 0x01cbf8 thru 0x01cf93 (0x39c bytes) 000267 1787860915.573744 write 0x0378f5 thru 0x03f043 (0x774f bytes) 000269 1787860915.576756 mapwrite 0x03a939 thru 0x03b1c2 (0x88a bytes) 000270 1787860915.630274 read 0x0216a1 thru 0x02b0e4 (0x9a44 bytes) 000271 1787860915.630882 trunc from 0x03f044 to 0x018766 (0x268dd bytes) 000272 1787860915.652206 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x18767): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18767): Mirror 3: 0x75434781 (stale) Mirror 4: 0x75434781 (stale) Mirror 5: 0x7be1a1f0 (stale) Mirror 6: 0x7be1a1f0 (stale) Mirror 7: 0x2e60c410 (stale) Mirror 9: 0x8df256dd (stale) Mirror 10: 0x8df256dd (stale) CRC-32 checksum value for chunk [0, 0x18767): Mirror 1: 0xa1ed96ff Mirror 11: 0xa1ed96ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18767: skipped 000275 1787860916.782022 read 0x0140ba thru 0x014abc (0xa03 bytes) 000276 1787860916.785443 write 0x022d36 thru 0x025f29 (0x31f4 bytes) 000277 1787860916.854047 mapwrite 0x0340f7 thru 0x03ffff (0xbf09 bytes) 000280 1787860916.939784 read 0x03b258 thru 0x03c69a (0x1443 bytes) 000281 1787860916.940300 write 0x03eef9 thru 0x03ffff (0x1107 bytes) 000282 1787860916.945067 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) Mirror 5: 0xcd22367d (stale) Mirror 7: 0x2e41593 (stale) Mirror 9: 0xc64c7f5 (stale) Mirror 10: 0xc54afc64 (stale) Mirror 11: 0x29d075b6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x67e0f78 (stale) Mirror 4: 0xd9900d7f (stale) Mirror 5: 0xcd22367d (stale) Mirror 7: 0x2e41593 (stale) Mirror 9: 0xc64c7f5 (stale) Mirror 10: 0xc54afc64 (stale) Mirror 11: 0x29d075b6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000283 1787860917.546119 mapwrite 0x00c222 thru 0x01ac30 (0xea0f bytes) 000284 1787860917.645497 trunc from 0x040000 to 0x0079cb (0x38634 bytes) 000287 1787860917.668587 mapread 0x000438 thru 0x0079cb (0x7594 bytes) 000289 1787860917.680609 mapwrite 0x0393fd thru 0x03c1f8 (0x2dfc bytes) 000290 1787860917.770680 read 0x031610 thru 0x031f87 (0x978 bytes) 000292 1787860917.782025 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c1f9): Mirror 4: 0x9027584e (stale) Mirror 5: 0xb6c0b6dc (stale) Mirror 7: 0x8915c3b5 (stale) Mirror 9: 0xbb3f6210 (stale) Mirror 10: 0x9ab22365 (stale) Mirror 11: 0x27c39e9a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c1f9): Mirror 4: 0x9027584e (stale) Mirror 5: 0xb6c0b6dc (stale) Mirror 7: 0x8915c3b5 (stale) Mirror 9: 0xbb3f6210 (stale) Mirror 10: 0x9ab22365 (stale) Mirror 11: 0x27c39e9a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c1f9: skipped 000293 1787860918.369576 mapwrite 0x029fa2 thru 0x03560a (0xb669 bytes) 000294 1787860918.488381 mapread 0x009251 thru 0x00c2ef (0x309f bytes) 000295 1787860918.498562 trunc from 0x03c1f9 to 0x013d17 (0x284e1 bytes) 000297 1787860918.519266 mapread 0x003795 thru 0x00e5f1 (0xae5d bytes) 000298 1787860918.520593 trunc from 0x013d18 to 0x00906d (0xacaa bytes) 000300 1787860918.539545 read 0x007dd7 thru 0x00906d (0x1297 bytes) 000302 1787860918.540825 mapwrite 0x037ae4 thru 0x03ffff (0x851c bytes) 000303 1787860918.690680 write 0x01569f thru 0x01e4e9 (0x8e4b bytes) 000304 1787860918.707447 mapread 0x00e745 thru 0x016e79 (0x8735 bytes) 000306 1787860918.719611 trunc from 0x040000 to 0x009ab1 (0x3654e bytes) 000308 1787860918.745557 write 0x01bc32 thru 0x01db9c (0x1f6b bytes) 000309 1787860918.750844 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1db9d): Mirror 4: 0xa4754218 (stale) Mirror 5: 0xc1499c87 (stale) Mirror 7: 0xc0c173a7 (stale) Mirror 9: 0xa36262b4 (stale) Mirror 10: 0x26bd11db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1db9d): Mirror 4: 0xa4754218 (stale) Mirror 5: 0xc1499c87 (stale) Mirror 7: 0xc0c173a7 (stale) Mirror 9: 0xa36262b4 (stale) Mirror 10: 0x26bd11db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1db9d: skipped 000310 1787860919.246385 trunc from 0x01db9d to 0x00b536 (0x12666 bytes) 000312 1787860919.289909 mapwrite 0x004895 thru 0x01432a (0xfa96 bytes) 000313 1787860919.448018 mapwrite 0x00fcd5 thru 0x014313 (0x463f bytes) 000316 1787860919.525546 mapwrite 0x017b40 thru 0x01b6dc (0x3b9d bytes) 000319 1787860919.611681 write 0x03b70f thru 0x03d614 (0x1f06 bytes) 000321 1787860919.614369 mapwrite 0x00372b thru 0x004763 (0x1039 bytes) 000323 1787860919.690531 mapread 0x034f5c thru 0x03d614 (0x86b9 bytes) 000324 1787860919.706710 trunc from 0x03d615 to 0x01c36c (0x212a8 bytes) 000326 1787860919.725923 trunc from 0x01c36d to 0x01928c (0x30e0 bytes) 000328 1787860919.745624 trunc from 0x01928d to 0x012396 (0x6ef6 bytes) 000329 1787860919.766604 mapwrite 0x0191d2 thru 0x02035f (0x718e bytes) 000330 1787860919.839386 trunc from 0x020360 to 0x02a23e (0x9edf bytes) 000332 1787860919.857700 write 0x00eb3e thru 0x011e17 (0x32da bytes) 000336 1787860919.861544 read 0x01f837 thru 0x02a23e (0xaa08 bytes) 000338 1787860919.871785 write 0x03a37c thru 0x03e976 (0x45fb bytes) 000339 1787860919.873580 write 0x02b7a2 thru 0x033ed1 (0x8730 bytes) 000341 1787860919.883834 read 0x01533c thru 0x01d3d3 (0x8098 bytes) 000342 1787860919.884664 read 0x03a06b thru 0x03a7dd (0x773 bytes) 000343 1787860919.885174 mapread 0x024c1d thru 0x02d074 (0x8458 bytes) 000344 1787860919.886782 write 0x00260f thru 0x00926e (0x6c60 bytes) 000346 1787860919.893597 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e977): Mirror 4: 0x381308a (stale) Mirror 5: 0x13e3852a (stale) Mirror 7: 0x729c0a6c (stale) Mirror 9: 0xc136be37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e977): Mirror 4: 0x381308a (stale) Mirror 5: 0x13e3852a (stale) Mirror 7: 0x729c0a6c (stale) Mirror 9: 0xc136be37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e977: skipped 000347 1787860920.209132 write 0x021e72 thru 0x024122 (0x22b1 bytes) 000349 1787860920.229193 MIRROR_RESYNC 5 mirrors 000350 1787860921.512071 MIRROR_RESYNC 5 mirrors 000351 1787860921.863093 write 0x005e53 thru 0x012196 (0xc344 bytes) 000352 1787860921.936730 write 0x02729d thru 0x032a25 (0xb789 bytes) 000353 1787860921.947699 mapwrite 0x02f64e thru 0x03efbd (0xf970 bytes) 000354 1787860922.061237 mapread 0x00f219 thru 0x01b11c (0xbf04 bytes) 000355 1787860922.074515 trunc from 0x03efbe to 0x03790a (0x76b3 bytes) 000357 1787860922.099743 mapread 0x008a8c thru 0x0110bd (0x8632 bytes) 000358 1787860922.102243 trunc from 0x03790b to 0x007144 (0x307c6 bytes) 000359 1787860922.129237 trunc from 0x007145 to 0x007e0e (0xcca bytes) truncating to largest ever: 0x3ee09 000360 1787860922.168285 trunc from 0x007e0f to 0x03ee08 (0x36ffa bytes) 000361 1787860922.243194 MIRROR_RESYNC 5 mirrors 000364 1787860923.639156 mapread 0x01803b thru 0x027868 (0xf82e bytes) 000365 1787860923.693181 MIRROR_RESYNC 5 mirrors 000367 1787860924.417536 read 0x0378df thru 0x03ee08 (0x752a bytes) 000368 1787860924.440579 trunc from 0x03ee09 to 0x0217fc (0x1d60c bytes) 000370 1787860924.598997 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x217fd): Mirror 4: 0xdbea84a3 (stale) Mirror 5: 0xdbea84a3 (stale) Mirror 9: 0xdbea84a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x217fd): Mirror 4: 0xdbea84a3 (stale) Mirror 5: 0xdbea84a3 (stale) Mirror 9: 0xdbea84a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x217fd: skipped 000371 1787860925.082160 mapread 0x0065e2 thru 0x01296d (0xc38c bytes) 000374 1787860925.159498 write 0x01ca1c thru 0x0256b7 (0x8c9c bytes) 000375 1787860925.165723 read 0x00f0c0 thru 0x016c6c (0x7bad bytes) 000377 1787860925.167079 read 0x024c25 thru 0x0256b7 (0xa93 bytes) 000380 1787860925.168939 mapread 0x0189db thru 0x022ba9 (0xa1cf bytes) 000381 1787860925.177904 MIRROR_RESYNC 4 mirrors 000382 1787860927.012540 MIRROR_EXTEND to 5 mirrors 000383 1787860928.411930 mapread 0x01f9bd thru 0x0256b7 (0x5cfb bytes) 000384 1787860928.454558 MIRROR_EXTEND to 6 mirrors 000385 1787860929.851774 trunc from 0x0256b8 to 0x006b2a (0x1eb8d bytes) 000388 1787860929.954241 mapread 0x0030f0 thru 0x006b2a (0x3a3b bytes) 000390 1787860929.982724 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x6b2b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6b2b): Mirror 4: 0x8753b435 (stale) Mirror 5: 0x8753b435 (stale) Mirror 9: 0x8753b435 (stale) Mirror 10: 0x8753b435 (stale) Mirror 11: 0x8753b435 (stale) CRC-32 checksum value for chunk [0, 0x6b2b): Mirror 1: 0x8753b435 Mirror 12: 0x8753b435 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6b2b: skipped 000391 1787860931.255546 MIRROR_RESYNC 7 mirrors 000392 1787860933.128466 mapwrite 0x002248 thru 0x008957 (0x6710 bytes) 000393 1787860933.277478 read 0x0052ed thru 0x008957 (0x366b bytes) 000395 1787860933.284609 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x8958): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8958): Mirror 4: 0x208188c3 (stale) Mirror 5: 0x208188c3 (stale) Mirror 9: 0x208188c3 (stale) Mirror 10: 0x208188c3 (stale) Mirror 11: 0x208188c3 (stale) Mirror 12: 0x208188c3 (stale) CRC-32 checksum value for chunk [0, 0x8958): Mirror 1: 0xa0f9c24 Mirror 13: 0xa0f9c24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8958: skipped 000397 1787860934.009083 mapread 0x003486 thru 0x008957 (0x54d2 bytes) 000398 1787860934.038035 write 0x02d989 thru 0x02e23f (0x8b7 bytes) 000399 1787860934.158776 MIRROR_RESYNC 8 mirrors 000402 1787860936.203237 write 0x00fe68 thru 0x018611 (0x87aa bytes) 000403 1787860936.277144 trunc from 0x02e240 to 0x000ae7 (0x2d758 bytes) 000405 1787860936.299095 write 0x02a7a7 thru 0x030bc3 (0x641d bytes) 000406 1787860936.300313 trunc from 0x030bc4 to 0x038eb5 (0x82f2 bytes) 000407 1787860936.325874 mapwrite 0x02290e thru 0x0273db (0x4ace bytes) 000409 1787860936.424615 mapwrite 0x0048d5 thru 0x00bfdd (0x7709 bytes) 000410 1787860936.494601 mapwrite 0x01e274 thru 0x023fe0 (0x5d6d bytes) 000415 1787860936.589457 mapread 0x018ec2 thru 0x01c6ed (0x382c bytes) 000416 1787860936.634162 trunc from 0x038eb6 to 0x0388e2 (0x5d3 bytes) 000419 1787860936.676005 write 0x0358d1 thru 0x03ffff (0xa72f bytes) 000421 1787860936.693927 mapread 0x0137ff thru 0x022b2b (0xf32d bytes) 000424 1787860936.703772 read 0x0091ea thru 0x011d46 (0x8b5d bytes) 000425 1787860936.704459 write 0x00210c thru 0x00c598 (0xa48d bytes) 000427 1787860936.722847 MIRROR_RESYNC 8 mirrors 000428 1787860939.321587 trunc from 0x040000 to 0x016154 (0x29eab bytes) 000430 1787860939.505179 write 0x027967 thru 0x02a83b (0x2ed5 bytes) 000433 1787860939.508881 trunc from 0x02a83c to 0x001450 (0x293eb bytes) 000434 1787860939.549496 read 0x000944 thru 0x001450 (0xb0d bytes) 000436 1787860939.556805 read 0x000346 thru 0x001450 (0x110b bytes) 000438 1787860939.559765 read 0x0006a4 thru 0x0011f0 (0xb4d bytes) 000440 1787860939.561564 write 0x00d964 thru 0x0114bd (0x3b5a bytes) 000441 1787860939.563731 mapwrite 0x0187ec thru 0x021517 (0x8d2c bytes) 000442 1787860939.682840 read 0x009c9d thru 0x01313a (0x949e bytes) 000443 1787860939.683543 mapwrite 0x03de88 thru 0x03ffff (0x2178 bytes) 000445 1787860939.795026 trunc from 0x040000 to 0x03b640 (0x49bf bytes) 000446 1787860939.821698 trunc from 0x03b641 to 0x02c886 (0xedba bytes) 000448 1787860939.839944 read 0x01aa52 thru 0x01c73c (0x1ceb bytes) 000449 1787860939.845526 MIRROR_RESYNC 8 mirrors 000450 1787860941.533172 read 0x028a6a thru 0x02b698 (0x2c2f bytes) 000451 1787860941.541150 read 0x009405 thru 0x015f4e (0xcb4a bytes) 000453 1787860941.556281 write 0x009ff2 thru 0x0151a0 (0xb1af bytes) 000456 1787860941.636616 mapwrite 0x009d9f thru 0x013299 (0x94fb bytes) 000457 1787860941.705446 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c887): Mirror 4: 0x8ff8be1f (stale) Mirror 5: 0x8ff8be1f (stale) Mirror 9: 0x8ff8be1f (stale) Mirror 10: 0x8ff8be1f (stale) Mirror 11: 0x8ff8be1f (stale) Mirror 12: 0x8ff8be1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c887): Mirror 4: 0x8ff8be1f (stale) Mirror 5: 0x8ff8be1f (stale) Mirror 9: 0x8ff8be1f (stale) Mirror 10: 0x8ff8be1f (stale) Mirror 11: 0x8ff8be1f (stale) Mirror 12: 0x8ff8be1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c887: skipped 000458 1787860942.088571 write 0x002172 thru 0x005108 (0x2f97 bytes) 000459 1787860942.103091 read 0x027682 thru 0x027cc4 (0x643 bytes) 000460 1787860942.107588 read 0x012b49 thru 0x01a4d9 (0x7991 bytes) 000461 1787860942.116963 mapread 0x018643 thru 0x01fc87 (0x7645 bytes) 000462 1787860942.121397 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c887): Mirror 5: 0x8ff8be1f (stale) Mirror 9: 0x8ff8be1f (stale) Mirror 10: 0x8ff8be1f (stale) Mirror 11: 0x8ff8be1f (stale) Mirror 12: 0x8ff8be1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c887): Mirror 5: 0x8ff8be1f (stale) Mirror 9: 0x8ff8be1f (stale) Mirror 10: 0x8ff8be1f (stale) Mirror 11: 0x8ff8be1f (stale) Mirror 12: 0x8ff8be1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c887: skipped 000465 1787860942.545004 trunc from 0x02c887 to 0x027f6e (0x4918 bytes) 000466 1787860942.577056 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27f6f): Mirror 5: 0x1dbe7f72 (stale) Mirror 9: 0x1dbe7f72 (stale) Mirror 10: 0x1dbe7f72 (stale) Mirror 12: 0x1dbe7f72 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27f6f): Mirror 5: 0x1dbe7f72 (stale) Mirror 9: 0x1dbe7f72 (stale) Mirror 10: 0x1dbe7f72 (stale) Mirror 12: 0x1dbe7f72 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27f6f: skipped 000469 1787860942.994165 mapread 0x010fa8 thru 0x01fc40 (0xec99 bytes) 000470 1787860943.043478 trunc from 0x027f6f to 0x00c48c (0x1bae2 bytes) truncating to largest ever: 0x3f873 000471 1787860943.057752 trunc from 0x00c48d to 0x03f872 (0x333e6 bytes) 000472 1787860943.072799 MIRROR_RESYNC 5 mirrors 000473 1787860944.248370 write 0x01dd5f thru 0x029c06 (0xbea8 bytes) 000474 1787860944.312505 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f873): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f873): Mirror 5: 0x65a4be9a (stale) Mirror 9: 0x65a4be9a (stale) Mirror 10: 0x65a4be9a (stale) Mirror 12: 0x65a4be9a (stale) CRC-32 checksum value for chunk [0, 0x3f873): Mirror 1: 0xa3a8ad85 Mirror 13: 0xa3a8ad85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f873: skipped 000475 1787860945.599863 trunc from 0x03f873 to 0x029d89 (0x15ae9 bytes) 000476 1787860945.724898 read 0x026a88 thru 0x02928f (0x2808 bytes) 000477 1787860945.731122 read 0x0011ff thru 0x0018ce (0x6d0 bytes) 000478 1787860945.739742 read 0x00f8a2 thru 0x01df51 (0xe6b0 bytes) 000480 1787860945.740954 mapwrite 0x01fe60 thru 0x020a10 (0xbb1 bytes) 000481 1787860945.770093 read 0x025612 thru 0x029d89 (0x4778 bytes) 000482 1787860945.770720 write 0x02b758 thru 0x02ebfb (0x34a4 bytes) 000484 1787860945.775856 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2ebfc): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ebfc): Mirror 5: 0xb852a867 (stale) Mirror 9: 0xb852a867 (stale) Mirror 10: 0xb852a867 (stale) Mirror 12: 0xb852a867 (stale) Mirror 13: 0xf9b65791 (stale) CRC-32 checksum value for chunk [0, 0x2ebfc): Mirror 1: 0xbf1c1301 Mirror 14: 0xbf1c1301 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ebfc: skipped 000485 1787860946.954261 read 0x01951e thru 0x026c5c (0xd73f bytes) 000486 1787860946.975080 mapwrite 0x007b8d thru 0x00f210 (0x7684 bytes) 000489 1787860947.240145 read 0x01b633 thru 0x02adc1 (0xf78f bytes) 000493 1787860947.283853 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ebfc): Mirror 9: 0xb852a867 (stale) Mirror 10: 0xb852a867 (stale) Mirror 12: 0xb852a867 (stale) Mirror 13: 0xf9b65791 (stale) Mirror 14: 0xbf1c1301 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ebfc): Mirror 9: 0xb852a867 (stale) Mirror 10: 0xb852a867 (stale) Mirror 12: 0xb852a867 (stale) Mirror 13: 0xf9b65791 (stale) Mirror 14: 0xbf1c1301 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ebfc: skipped 000495 1787860947.787385 trunc from 0x02ebfc to 0x01b534 (0x136c7 bytes) 000497 1787860947.809785 MIRROR_RESYNC 6 mirrors 000498 1787860949.280438 write 0x01e081 thru 0x029ca1 (0xbc21 bytes) 000499 1787860949.373679 mapread 0x01e949 thru 0x022db6 (0x446e bytes) 000500 1787860949.374661 trunc from 0x029ca2 to 0x01e01c (0xbc85 bytes) 000501 1787860949.405071 trunc from 0x01e01d to 0x0004ad (0x1db6f bytes) 000502 1787860949.430384 write 0x01e3a3 thru 0x0226a8 (0x4306 bytes) 000503 1787860949.431521 mapwrite 0x026265 thru 0x02a988 (0x4724 bytes) 000504 1787860949.560794 write 0x02043b thru 0x02be72 (0xba38 bytes) 000505 1787860949.565300 read 0x026bfd thru 0x02be72 (0x5276 bytes) 000506 1787860949.576584 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2be73): Mirror 10: 0x5fdd7d2 (stale) Mirror 12: 0x5fdd7d2 (stale) Mirror 13: 0x5fdd7d2 (stale) Mirror 14: 0x5fdd7d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2be73): Mirror 10: 0x5fdd7d2 (stale) Mirror 12: 0x5fdd7d2 (stale) Mirror 13: 0x5fdd7d2 (stale) Mirror 14: 0x5fdd7d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2be73: skipped 000507 1787860950.041587 mapread 0x0202bc thru 0x02be72 (0xbbb7 bytes) 000508 1787860950.065625 write 0x03c17f thru 0x03ffff (0x3e81 bytes) 000511 1787860950.068373 trunc from 0x040000 to 0x036aa9 (0x9556 bytes) 000512 1787860950.120575 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36aaa): Mirror 10: 0x6a34bcd2 (stale) Mirror 12: 0x6a34bcd2 (stale) Mirror 14: 0x6a34bcd2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36aaa): Mirror 10: 0x6a34bcd2 (stale) Mirror 12: 0x6a34bcd2 (stale) Mirror 14: 0x6a34bcd2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36aaa: skipped 000515 1787860950.479598 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36aaa): Mirror 12: 0x6a34bcd2 (stale) Mirror 14: 0x6a34bcd2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36aaa): Mirror 12: 0x6a34bcd2 (stale) Mirror 14: 0x6a34bcd2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36aaa: skipped 000516 1787860950.729190 read 0x002feb thru 0x006895 (0x38ab bytes) 000520 1787860950.738815 trunc from 0x036aaa to 0x020020 (0x16a89 bytes) 000522 1787860950.769896 MIRROR_RESYNC 3 mirrors 000524 1787860951.947944 mapwrite 0x02c3db thru 0x037f5a (0xbb80 bytes) 000526 1787860952.228698 write 0x03dba9 thru 0x03ffff (0x2457 bytes) 000527 1787860952.231039 write 0x01f3e2 thru 0x02e00d (0xec2c bytes) 000529 1787860952.244816 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x1f49d8d3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x1f49d8d3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000530 1787860952.585841 mapwrite 0x019008 thru 0x01cfc9 (0x3fc2 bytes) 000531 1787860952.639055 mapread 0x006a5d thru 0x0151b4 (0xe758 bytes) 000532 1787860952.660835 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x1f49d8d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe923875e Mirror 15: 0xe923875e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000534 1787860953.515960 mapread 0x0375b4 thru 0x03ffff (0x8a4c bytes) 000537 1787860953.550052 trunc from 0x040000 to 0x00df76 (0x32089 bytes) 000538 1787860953.640243 mapread 0x009fcd thru 0x00df76 (0x3faa bytes) 000540 1787860953.648959 write 0x00b154 thru 0x0108ef (0x579c bytes) 000541 1787860953.649977 trunc from 0x0108f0 to 0x01096d (0x7e bytes) 000544 1787860953.667326 mapwrite 0x00b74a thru 0x0151f6 (0x9aad bytes) 000545 1787860953.728139 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x151f7): Mirror 15: 0x553e89aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x151f7): Mirror 15: 0x553e89aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x151f7: skipped 000546 1787860953.975034 mapwrite 0x035972 thru 0x03ffff (0xa68e bytes) 000547 1787860954.102264 trunc from 0x040000 to 0x01665e (0x299a1 bytes) 000549 1787860954.119583 write 0x039256 thru 0x03ffff (0x6daa bytes) 000550 1787860954.126059 MIRROR_RESYNC 2 mirrors 000551 1787860955.094221 write 0x028a36 thru 0x033737 (0xad02 bytes) 000554 1787860955.193575 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xb5962bef (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2a7547eb Mirror 16: 0x2a7547eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000556 1787860956.718530 mapread 0x039879 thru 0x03ffff (0x6787 bytes) 000557 1787860956.751884 mapread 0x00ebf4 thru 0x018746 (0x9b53 bytes) 000558 1787860956.776582 read 0x00466c thru 0x0046ab (0x40 bytes) 000559 1787860956.789952 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xb5962bef (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2a7547eb Mirror 16: 0x2a7547eb Mirror 17: 0x2a7547eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000560 1787860958.013964 write 0x017d93 thru 0x01f281 (0x74ef bytes) 000561 1787860958.189152 mapread 0x02464c thru 0x028901 (0x42b6 bytes) 000563 1787860958.276534 write 0x01cf65 thru 0x02741c (0xa4b8 bytes) 000564 1787860958.282935 mapwrite 0x023d08 thru 0x02accc (0x6fc5 bytes) 000565 1787860958.408626 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xb5962bef (stale) Mirror 16: 0x2a7547eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xb5962bef (stale) Mirror 16: 0x2a7547eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000567 1787860958.852547 read 0x01e6a6 thru 0x02dcac (0xf607 bytes) 000568 1787860958.865659 mapwrite 0x01d674 thru 0x023ecc (0x6859 bytes) 000569 1787860958.939722 write 0x003b44 thru 0x00931c (0x57d9 bytes) 000572 1787860958.956287 trunc from 0x040000 to 0x01cf86 (0x23079 bytes) 000574 1787860958.983812 write 0x01fafd thru 0x01fc3c (0x140 bytes) 000575 1787860958.984950 trunc from 0x01fc3d to 0x025156 (0x551a bytes) 000576 1787860959.018981 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25157): Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25157): Mirror 15: 0xa88b74ba (stale) Mirror 16: 0xa88b74ba (stale) CRC-32 checksum value for chunk [0, 0x25157): Mirror 1: 0xf0f63ba8 Mirror 17: 0xf0f63ba8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25157: skipped 000579 1787860960.163278 mapwrite 0x0126b6 thru 0x0185c0 (0x5f0b bytes) 000580 1787860960.434254 read 0x00485b thru 0x00c350 (0x7af6 bytes) 000581 1787860960.449679 mapread 0x003fe5 thru 0x00e9df (0xa9fb bytes) 000582 1787860960.456258 read 0x016d53 thru 0x020e8a (0xa138 bytes) 000583 1787860960.469690 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25157): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25157): Mirror 15: 0xa88b74ba (stale) Mirror 16: 0xa88b74ba (stale) Mirror 17: 0xf0f63ba8 (stale) CRC-32 checksum value for chunk [0, 0x25157): Mirror 1: 0xafbc6d18 Mirror 18: 0xafbc6d18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25157: skipped 000585 1787860962.242551 write 0x01fc7e thru 0x02fb7b (0xfefe bytes) 000586 1787860962.444625 mapwrite 0x03a1c4 thru 0x03fe1f (0x5c5c bytes) 000587 1787860962.711926 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fe20): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe20): Mirror 15: 0xcd387477 (stale) Mirror 16: 0x214b5137 (stale) Mirror 17: 0x3b68c5e1 (stale) Mirror 18: 0xa0c5a3b0 (stale) CRC-32 checksum value for chunk [0, 0x3fe20): Mirror 1: 0xb9e81370 Mirror 19: 0xb9e81370 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe20: skipped 000589 1787860964.979528 mapread 0x020ed8 thru 0x02c23c (0xb365 bytes) 000592 1787860965.037475 write 0x032f7e thru 0x0344d1 (0x1554 bytes) 000593 1787860965.233719 trunc from 0x03fe20 to 0x00934a (0x36ad5 bytes) 000595 1787860965.272315 read 0x000159 thru 0x00174e (0x15f6 bytes) 000597 1787860965.285917 read 0x007e98 thru 0x00934a (0x14b3 bytes) 000598 1787860965.301058 read 0x008117 thru 0x00934a (0x1234 bytes) 000599 1787860965.303067 mapread 0x004654 thru 0x00934a (0x4cf7 bytes) 000600 1787860965.304119 mapwrite 0x007336 thru 0x007668 (0x333 bytes) 000601 1787860965.407110 mapwrite 0x016679 thru 0x023937 (0xd2bf bytes) 000602 1787860965.550767 read 0x00a1f7 thru 0x017dac (0xdbb6 bytes) 000603 1787860965.561359 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x23938): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23938): Mirror 15: 0xdd72d2fa (stale) Mirror 16: 0xdd72d2fa (stale) Mirror 17: 0x5e002db3 (stale) Mirror 18: 0xa542c06a (stale) Mirror 19: 0x4c2e9d1f (stale) CRC-32 checksum value for chunk [0, 0x23938): Mirror 1: 0xc53a7ec5 Mirror 20: 0xc53a7ec5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23938: skipped 000605 1787860967.279447 write 0x037ca7 thru 0x03eeec (0x7246 bytes) 000606 1787860967.465936 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3eeed): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eeed): Mirror 15: 0x67a388ba (stale) Mirror 16: 0x40e7d87a (stale) Mirror 17: 0x64078d43 (stale) Mirror 18: 0x2d791153 (stale) Mirror 19: 0x87922598 (stale) Mirror 20: 0x80f29aac (stale) CRC-32 checksum value for chunk [0, 0x3eeed): Mirror 1: 0x18a2ba1e Mirror 21: 0x18a2ba1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eeed: skipped 000607 1787860968.566514 mapwrite 0x01be2b thru 0x021040 (0x5216 bytes) 000608 1787860968.772935 read 0x0074ac thru 0x010a90 (0x95e5 bytes) 000611 1787860968.795985 write 0x000ff6 thru 0x00385c (0x2867 bytes) 000612 1787860968.825140 trunc from 0x03eeed to 0x01336e (0x2bb7e bytes) 000614 1787860968.878665 mapwrite 0x022057 thru 0x0286df (0x6689 bytes) 000615 1787860969.107336 read 0x002956 thru 0x01144e (0xeaf9 bytes) 000617 1787860969.120730 trunc from 0x0286e0 to 0x034b29 (0xc44a bytes) 000620 1787860969.151744 mapwrite 0x01c742 thru 0x025eb0 (0x976f bytes) 000621 1787860969.287581 trunc from 0x034b2a to 0x030be8 (0x3f41 bytes) 000622 1787860969.327019 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30be9): Mirror 16: 0x5fb6a3b1 (stale) Mirror 17: 0x38c53769 (stale) Mirror 18: 0x5fdb4f6f (stale) Mirror 19: 0x265ce1b4 (stale) Mirror 20: 0x8692b3d (stale) Mirror 21: 0x8692b3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30be9): Mirror 16: 0x5fb6a3b1 (stale) Mirror 17: 0x38c53769 (stale) Mirror 18: 0x5fdb4f6f (stale) Mirror 19: 0x265ce1b4 (stale) Mirror 20: 0x8692b3d (stale) Mirror 21: 0x8692b3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30be9: skipped 000624 1787860969.946037 trunc from 0x030be9 to 0x02f634 (0x15b4 bytes) 000626 1787860970.007277 mapread 0x0281ef thru 0x0291bd (0xfcf bytes) 000627 1787860970.032481 trunc from 0x02f635 to 0x00391f (0x2bd15 bytes) 000628 1787860970.074047 mapwrite 0x03c181 thru 0x03e806 (0x2686 bytes) 000629 1787860970.164730 write 0x0237ab thru 0x032815 (0xf06b bytes) 000630 1787860970.177493 mapread 0x02598a thru 0x032392 (0xca09 bytes) 000633 1787860970.179512 read 0x021522 thru 0x03068f (0xf16e bytes) 000635 1787860970.186675 mapwrite 0x01f0e5 thru 0x0241f4 (0x5110 bytes) 000636 1787860970.235484 read 0x03e44d thru 0x03e806 (0x3ba bytes) 000639 1787860970.238354 mapread 0x039bf2 thru 0x03e806 (0x4c15 bytes) 000640 1787860970.239731 mapwrite 0x00cfa6 thru 0x010633 (0x368e bytes) 000641 1787860970.313946 read 0x018494 thru 0x01ae94 (0x2a01 bytes) 000642 1787860970.330496 MIRROR_RESYNC 7 mirrors 000643 1787860972.116988 trunc from 0x03e807 to 0x01620f (0x285f7 bytes) 000645 1787860972.310887 MIRROR_RESYNC 7 mirrors 000646 1787860973.767766 MIRROR_EXTEND to 8 mirrors 000648 1787860974.249027 mapwrite 0x00b0ca thru 0x0154fc (0xa433 bytes) 000649 1787860974.393357 mapread 0x014a16 thru 0x01620f (0x17fa bytes) 000650 1787860974.395119 write 0x021a35 thru 0x02afe4 (0x95b0 bytes) 000651 1787860974.397128 mapwrite 0x004ee8 thru 0x00b8e7 (0x6a00 bytes) 000653 1787860974.459657 read 0x010703 thru 0x01880a (0x8108 bytes) 000654 1787860974.482926 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2afe5): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2afe5): Mirror 16: 0x3ec01fa7 (stale) Mirror 17: 0x3ec01fa7 (stale) Mirror 18: 0x3ec01fa7 (stale) Mirror 19: 0x3ec01fa7 (stale) Mirror 20: 0x3ec01fa7 (stale) Mirror 21: 0x3ec01fa7 (stale) Mirror 22: 0x3ec01fa7 (stale) CRC-32 checksum value for chunk [0, 0x2afe5): Mirror 1: 0x8358d82d Mirror 23: 0x8358d82d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2afe5: skipped 000655 1787860975.687357 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2afe5): Mirror 16: 0x3ec01fa7 (stale) Mirror 17: 0x3ec01fa7 (stale) Mirror 18: 0x3ec01fa7 (stale) Mirror 19: 0x3ec01fa7 (stale) Mirror 20: 0x3ec01fa7 (stale) Mirror 21: 0x3ec01fa7 (stale) Mirror 22: 0x3ec01fa7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2afe5): Mirror 16: 0x3ec01fa7 (stale) Mirror 17: 0x3ec01fa7 (stale) Mirror 18: 0x3ec01fa7 (stale) Mirror 19: 0x3ec01fa7 (stale) Mirror 20: 0x3ec01fa7 (stale) Mirror 21: 0x3ec01fa7 (stale) Mirror 22: 0x3ec01fa7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2afe5: skipped 000658 1787860976.162551 mapwrite 0x032379 thru 0x03bbb1 (0x9839 bytes) 000659 1787860976.329504 mapread 0x023ac4 thru 0x0299f6 (0x5f33 bytes) 000660 1787860976.345079 mapread 0x030991 thru 0x038869 (0x7ed9 bytes) 000661 1787860976.345989 mapread 0x03374f thru 0x039d08 (0x65ba bytes) 000662 1787860976.346774 write 0x03e4eb thru 0x03f0f8 (0xc0e bytes) 000664 1787860976.348232 read 0x020c29 thru 0x027fb9 (0x7391 bytes) 000665 1787860976.348887 trunc from 0x03f0f9 to 0x00a924 (0x347d4 bytes) 000670 1787860976.381118 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa925): Mirror 17: 0x7d2f9cdf (stale) Mirror 18: 0x7d2f9cdf (stale) Mirror 19: 0x7d2f9cdf (stale) Mirror 20: 0x7d2f9cdf (stale) Mirror 21: 0x7d2f9cdf (stale) Mirror 22: 0x7d2f9cdf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa925): Mirror 17: 0x7d2f9cdf (stale) Mirror 18: 0x7d2f9cdf (stale) Mirror 19: 0x7d2f9cdf (stale) Mirror 20: 0x7d2f9cdf (stale) Mirror 21: 0x7d2f9cdf (stale) Mirror 22: 0x7d2f9cdf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa925: skipped 000671 1787860976.758461 trunc from 0x00a925 to 0x006ea7 (0x3a7d bytes) 000672 1787860976.782556 read 0x0039b3 thru 0x006ea7 (0x34f5 bytes) 000673 1787860976.791980 mapread 0x001276 thru 0x006ea7 (0x5c32 bytes) 000676 1787860976.812310 read 0x006099 thru 0x006ea7 (0xe0f bytes) 000679 1787860976.814944 mapread 0x000ceb thru 0x006ea7 (0x61bd bytes) 000680 1787860976.824076 trunc from 0x006ea8 to 0x039669 (0x327c2 bytes) 000681 1787860976.846328 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3966a): Mirror 17: 0xc79496ee (stale) Mirror 18: 0xc79496ee (stale) Mirror 19: 0xc79496ee (stale) Mirror 21: 0xc79496ee (stale) Mirror 22: 0xc79496ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3966a): Mirror 17: 0xc79496ee (stale) Mirror 18: 0xc79496ee (stale) Mirror 19: 0xc79496ee (stale) Mirror 21: 0xc79496ee (stale) Mirror 22: 0xc79496ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3966a: skipped 000683 1787860977.339618 trunc from 0x03966a to 0x00edac (0x2a8bd bytes) 000684 1787860977.357059 write 0x02b165 thru 0x0322ca (0x7166 bytes) 000685 1787860977.359283 mapwrite 0x03bb65 thru 0x03ffff (0x449b bytes) 000686 1787860977.461068 write 0x00a442 thru 0x014130 (0x9cef bytes) 000687 1787860977.473928 read 0x0190c7 thru 0x019e61 (0xd9b bytes) 000689 1787860977.486519 MIRROR_RESYNC 6 mirrors 000694 1787860980.090897 mapread 0x02e4e1 thru 0x032153 (0x3c73 bytes) 000695 1787860980.115387 write 0x035fd1 thru 0x03e5a8 (0x85d8 bytes) 000700 1787860980.239644 MIRROR_RESYNC 6 mirrors 000702 1787860982.783980 MIRROR_EXTEND to 7 mirrors 000705 1787860983.799280 write 0x0331ea thru 0x03d900 (0xa717 bytes) 000707 1787860983.926920 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xdf4849db (stale) Mirror 18: 0xdf4849db (stale) Mirror 19: 0xdf4849db (stale) Mirror 21: 0xdf4849db (stale) Mirror 22: 0xdf4849db (stale) Mirror 23: 0xdf4849db (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3138bac6 Mirror 24: 0x3138bac6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000708 1787860985.297161 mapwrite 0x004e55 thru 0x00e36d (0x9519 bytes) 000710 1787860985.457692 mapwrite 0x03be0f thru 0x03ec97 (0x2e89 bytes) 000711 1787860985.492857 read 0x01bec0 thru 0x02596e (0x9aaf bytes) 000715 1787860985.501608 write 0x009788 thru 0x00e3eb (0x4c64 bytes) 000716 1787860985.503031 mapwrite 0x03a505 thru 0x03ffff (0x5afb bytes) 000717 1787860985.534463 write 0x00ca4b thru 0x0178ed (0xaea3 bytes) 000719 1787860985.539236 write 0x015db1 thru 0x01fe93 (0xa0e3 bytes) 000720 1787860985.543876 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xdf4849db (stale) Mirror 18: 0xdf4849db (stale) Mirror 19: 0xdf4849db (stale) Mirror 21: 0xdf4849db (stale) Mirror 22: 0xdf4849db (stale) Mirror 24: 0x3138bac6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0xdf4849db (stale) Mirror 18: 0xdf4849db (stale) Mirror 19: 0xdf4849db (stale) Mirror 21: 0xdf4849db (stale) Mirror 22: 0xdf4849db (stale) Mirror 24: 0x3138bac6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000722 1787860986.166771 trunc from 0x040000 to 0x0045db (0x3ba24 bytes) 000724 1787860986.187653 write 0x01ba14 thru 0x0282c0 (0xc8ad bytes) 000725 1787860986.192025 write 0x0356c4 thru 0x038f81 (0x38be bytes) 000726 1787860986.193900 write 0x03bef1 thru 0x03ffff (0x410f bytes) 000727 1787860986.196087 trunc from 0x040000 to 0x010854 (0x2f7ab bytes) 000728 1787860986.213925 mapread 0x009c4f thru 0x010854 (0x6c06 bytes) 000729 1787860986.235855 mapwrite 0x0098ae thru 0x00b61c (0x1d6f bytes) 000730 1787860986.277746 mapread 0x00fda9 thru 0x010854 (0xaac bytes) 000731 1787860986.278934 read 0x00738f thru 0x00ee45 (0x7ab7 bytes) 000732 1787860986.280228 mapwrite 0x03403b thru 0x03b987 (0x794d bytes) 000733 1787860986.347800 mapread 0x00ecfb thru 0x01a6fc (0xba02 bytes) 000734 1787860986.364993 read 0x01043f thru 0x01be98 (0xba5a bytes) 000735 1787860986.369025 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b988): Mirror 18: 0x2a13720b (stale) Mirror 19: 0x2a13720b (stale) Mirror 21: 0x2a13720b (stale) Mirror 22: 0x2a13720b (stale) Mirror 24: 0x7df36e97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b988): Mirror 18: 0x2a13720b (stale) Mirror 19: 0x2a13720b (stale) Mirror 21: 0x2a13720b (stale) Mirror 22: 0x2a13720b (stale) Mirror 24: 0x7df36e97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b988: skipped 000736 1787860986.922668 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b988): Mirror 18: 0x2a13720b (stale) Mirror 19: 0x2a13720b (stale) Mirror 21: 0x2a13720b (stale) Mirror 24: 0x7df36e97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b988): Mirror 18: 0x2a13720b (stale) Mirror 19: 0x2a13720b (stale) Mirror 21: 0x2a13720b (stale) Mirror 24: 0x7df36e97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b988: skipped 000737 1787860987.367856 trunc from 0x03b988 to 0x01544a (0x2653d bytes) 000738 1787860987.399598 trunc from 0x01544b to 0x0207ed (0xb3a3 bytes) 000739 1787860987.429220 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x207ee): Mirror 19: 0xba9bdc27 (stale) Mirror 21: 0xba9bdc27 (stale) Mirror 24: 0xba9bdc27 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x207ee): Mirror 19: 0xba9bdc27 (stale) Mirror 21: 0xba9bdc27 (stale) Mirror 24: 0xba9bdc27 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x207ee: skipped 000740 1787860987.792034 mapread 0x004b2c thru 0x009690 (0x4b65 bytes) 000741 1787860987.831794 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x207ee): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x207ee): Mirror 19: 0xba9bdc27 (stale) Mirror 21: 0xba9bdc27 (stale) Mirror 24: 0xba9bdc27 (stale) CRC-32 checksum value for chunk [0, 0x207ee): Mirror 1: 0x3667a6b Mirror 25: 0x3667a6b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x207ee: skipped 000746 1787860988.998570 write 0x02e977 thru 0x037771 (0x8dfb bytes) 000747 1787860989.146235 read 0x007dba thru 0x00fe0f (0x8056 bytes) 000750 1787860989.173420 read 0x026f39 thru 0x02f38a (0x8452 bytes) 000752 1787860989.184854 write 0x0277c2 thru 0x029e53 (0x2692 bytes) 000753 1787860989.185882 trunc from 0x037772 to 0x030cf9 (0x6a78 bytes) 000754 1787860989.207896 read 0x016a25 thru 0x022221 (0xb7fd bytes) 000755 1787860989.208645 write 0x02bee5 thru 0x03025d (0x4379 bytes) 000760 1787860989.213168 read 0x0160fc thru 0x021513 (0xb418 bytes) 000763 1787860989.214878 trunc from 0x030cfa to 0x00d347 (0x239b2 bytes) 000764 1787860989.230861 read 0x009ba1 thru 0x00d193 (0x35f3 bytes) 000765 1787860989.231498 trunc from 0x00d348 to 0x001090 (0xc2b7 bytes) 000766 1787860989.247130 mapread 0x0009de thru 0x001090 (0x6b3 bytes) 000767 1787860989.248040 trunc from 0x001091 to 0x02a945 (0x298b5 bytes) 000769 1787860989.277295 mapwrite 0x039247 thru 0x03a4a7 (0x1261 bytes) 000770 1787860989.332735 mapread 0x0013d5 thru 0x00d524 (0xc150 bytes) 000771 1787860989.334153 write 0x035990 thru 0x03ffff (0xa670 bytes) 000773 1787860989.336371 write 0x01bb6c thru 0x0278d2 (0xbd67 bytes) 000774 1787860989.342950 MIRROR_RESYNC 5 mirrors 000775 1787860991.614875 write 0x003223 thru 0x00863c (0x541a bytes) 000776 1787860991.685145 mapwrite 0x019bab thru 0x0263f4 (0xc84a bytes) 000777 1787860991.871512 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x9bfd94af (stale) Mirror 24: 0x9bfd94af (stale) Mirror 25: 0x9bfd94af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0x9bfd94af (stale) Mirror 24: 0x9bfd94af (stale) Mirror 25: 0x9bfd94af (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000783 1787860992.284134 trunc from 0x040000 to 0x01c3fc (0x23c03 bytes) 000784 1787860992.306779 write 0x0315a1 thru 0x03f2ce (0xdd2e bytes) 000785 1787860992.314241 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f2cf): Mirror 21: 0x228e17c5 (stale) Mirror 25: 0x228e17c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f2cf): Mirror 21: 0x228e17c5 (stale) Mirror 25: 0x228e17c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f2cf: skipped 000786 1787860992.772943 MIRROR_RESYNC 3 mirrors 000788 1787860994.430106 mapread 0x031761 thru 0x03c388 (0xac28 bytes) 000791 1787860994.475057 mapwrite 0x021752 thru 0x02d72c (0xbfdb bytes) 000792 1787860994.760318 MIRROR_RESYNC 3 mirrors 000795 1787860995.807615 mapwrite 0x02af30 thru 0x03a27a (0xf34b bytes) 000796 1787860995.983178 mapread 0x035028 thru 0x03b3d0 (0x63a9 bytes) 000797 1787860995.984668 mapread 0x00f489 thru 0x014008 (0x4b80 bytes) 000798 1787860995.997015 write 0x036e9c thru 0x03ffff (0x9164 bytes) 000801 1787860996.005939 write 0x039404 thru 0x03ffff (0x6bfc bytes) 000802 1787860996.013275 mapwrite 0x0020dd thru 0x011eba (0xfdde bytes) 000804 1787860996.130752 mapread 0x0392ce thru 0x03e10e (0x4e41 bytes) 000806 1787860996.139685 write 0x0263ba thru 0x027276 (0xebd bytes) 000810 1787860996.145564 read 0x028b40 thru 0x03360a (0xaacb bytes) 000812 1787860996.149309 trunc from 0x040000 to 0x01a4b2 (0x25b4d bytes) 000814 1787860996.186161 read 0x013f47 thru 0x01a4b2 (0x656c bytes) 000815 1787860996.194111 read 0x000268 thru 0x0080bf (0x7e58 bytes) 000816 1787860996.198989 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a4b3): Mirror 25: 0xa2976c8c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a4b3): Mirror 25: 0xa2976c8c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a4b3: skipped 000818 1787860996.505212 read 0x01690b thru 0x01a4b2 (0x3ba8 bytes) 000819 1787860996.516225 trunc from 0x01a4b3 to 0x01523a (0x5278 bytes) 000821 1787860996.535870 write 0x014862 thru 0x017584 (0x2d23 bytes) 000822 1787860996.544823 read 0x00cf28 thru 0x017584 (0xa65d bytes) 000823 1787860996.557045 write 0x02e590 thru 0x034486 (0x5ef7 bytes) 000826 1787860996.566002 write 0x03ed68 thru 0x03ffff (0x1298 bytes) 000827 1787860996.568064 trunc from 0x040000 to 0x03410b (0xbef4 bytes) 000830 1787860996.600454 MIRROR_RESYNC 2 mirrors 000831 1787860998.008972 mapwrite 0x011356 thru 0x020dbe (0xfa69 bytes) 000832 1787860998.167142 read 0x02a52c thru 0x030520 (0x5ff5 bytes) 000836 1787860998.178265 mapread 0x003602 thru 0x0054b2 (0x1eb1 bytes) 000839 1787860998.188869 read 0x031843 thru 0x032f2b (0x16e9 bytes) 000840 1787860998.202522 read 0x02fd8b thru 0x03410b (0x4381 bytes) 000842 1787860998.204229 trunc from 0x03410c to 0x0374bd (0x33b2 bytes) 000843 1787860998.241744 mapwrite 0x03c049 thru 0x03ffff (0x3fb7 bytes) 000845 1787860998.342355 read 0x002587 thru 0x0105e1 (0xe05b bytes) 000847 1787860998.343460 trunc from 0x040000 to 0x032295 (0xdd6a bytes) 000849 1787860998.360721 write 0x010d95 thru 0x01be1a (0xb086 bytes) 000851 1787860998.364569 mapwrite 0x007c30 thru 0x00cf45 (0x5316 bytes) 000852 1787860998.415675 trunc from 0x032296 to 0x03c904 (0xa66f bytes) 000854 1787860998.436549 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) 000857 1787860998.646071 mapread 0x02a091 thru 0x030ca1 (0x6c11 bytes) 000858 1787860998.691391 mapwrite 0x02f0b4 thru 0x03ac69 (0xbbb6 bytes) 000859 1787860998.813238 read 0x039b7f thru 0x03c904 (0x2d86 bytes) 000860 1787860998.813798 write 0x02d803 thru 0x03a243 (0xca41 bytes) 000862 1787860998.817053 mapread 0x0302ec thru 0x034051 (0x3d66 bytes) 000863 1787860998.819266 mapwrite 0x016e75 thru 0x01e459 (0x75e5 bytes) 000864 1787860999.008542 mapwrite 0x0092f9 thru 0x011ad1 (0x87d9 bytes) 000865 1787860999.155956 trunc from 0x03c905 to 0x01025e (0x2c6a6 bytes) 000869 1787860999.195686 mapread 0x00cf0d thru 0x01025e (0x3352 bytes) 000871 1787860999.197075 write 0x01293e thru 0x01c8c0 (0x9f83 bytes) 000872 1787860999.211001 trunc from 0x01c8c1 to 0x02c869 (0xffa9 bytes) 000875 1787860999.257867 write 0x0337c0 thru 0x03d9d6 (0xa217 bytes) 000876 1787860999.260194 write 0x00294a thru 0x005dd4 (0x348b bytes) 000877 1787860999.262284 trunc from 0x03d9d7 to 0x015f7d (0x27a59 bytes) 000878 1787860999.291562 write 0x020dcf thru 0x027545 (0x6777 bytes) 000881 1787860999.303239 trunc from 0x027546 to 0x0294aa (0x1f65 bytes) 000883 1787860999.343387 read 0x013724 thru 0x01baca (0x83a7 bytes) 000884 1787860999.359958 mapwrite 0x00f5d1 thru 0x0199b0 (0xa3e0 bytes) 000886 1787860999.470736 trunc from 0x0294ab to 0x01e387 (0xb123 bytes) 000892 1787860999.523278 trunc from 0x01e388 to 0x01a086 (0x4301 bytes) 000894 1787860999.569476 mapwrite 0x016d49 thru 0x01a63e (0x38f6 bytes) 000899 1787860999.715460 write 0x00c745 thru 0x014088 (0x7944 bytes) 000900 1787860999.723193 mapwrite 0x03ea52 thru 0x03ffff (0x15ae bytes) 000902 1787860999.917023 mapwrite 0x025ae3 thru 0x0339d2 (0xdef0 bytes) 000906 1787861000.029207 mapread 0x0059da thru 0x008492 (0x2ab9 bytes) 000908 1787861000.033759 read 0x000c5c thru 0x0102cc (0xf671 bytes) 000912 1787861000.038794 mapwrite 0x038983 thru 0x03ffff (0x767d bytes) 000913 1787861000.104153 trunc from 0x040000 to 0x011b89 (0x2e476 bytes) 000914 1787861000.136052 mapwrite 0x011bc4 thru 0x019db5 (0x81f2 bytes) 000916 1787861000.268087 mapread 0x0099b6 thru 0x010bbc (0x7207 bytes) 000917 1787861000.273744 write 0x024e96 thru 0x03238f (0xd4fa bytes) 000919 1787861000.282286 read 0x01aa21 thru 0x02a9eb (0xffcb bytes) 000920 1787861000.314283 trunc from 0x032390 to 0x002480 (0x2ff0f bytes) 000922 1787861000.397255 mapwrite 0x011d46 thru 0x0133cc (0x1687 bytes) 000925 1787861000.611992 read 0x00f8e6 thru 0x0133cc (0x3ae7 bytes) 000929 1787861000.639172 read 0x001699 thru 0x006ca8 (0x5610 bytes) 000930 1787861000.647101 MIRROR_EXTEND to 2 mirrors 000931 1787861001.647521 trunc from 0x0133cd to 0x02f788 (0x1c3bc bytes) 000936 1787861001.753745 write 0x0079a3 thru 0x013b9e (0xc1fc bytes) 000937 1787861001.764187 write 0x017336 thru 0x019b92 (0x285d bytes) 000945 1787861001.781000 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f789): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f789): Mirror 2: 0x92682f01 (stale) CRC-32 checksum value for chunk [0, 0x2f789): Mirror 1: 0x5431d4a3 Mirror 3: 0x5431d4a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f789: skipped 000947 1787861003.553509 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2f789): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f789): Mirror 2: 0x92682f01 (stale) CRC-32 checksum value for chunk [0, 0x2f789): Mirror 1: 0x5431d4a3 Mirror 3: 0x5431d4a3 Mirror 4: 0x5431d4a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f789: skipped 000948 1787861004.673679 mapwrite 0x02bd2f thru 0x02fe66 (0x4138 bytes) 000949 1787861004.804982 trunc from 0x02fe67 to 0x03a279 (0xa413 bytes) 000950 1787861004.821092 trunc from 0x03a27a to 0x02251a (0x17d5f bytes) 000951 1787861004.838605 mapwrite 0x008aaa thru 0x0156f8 (0xcc4f bytes) 000952 1787861005.041865 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2251b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2251b): Mirror 2: 0xfca4680e (stale) Mirror 3: 0x6ccbad96 (stale) Mirror 4: 0x6ccbad96 (stale) CRC-32 checksum value for chunk [0, 0x2251b): Mirror 1: 0x87b25071 Mirror 5: 0x87b25071 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2251b: skipped 000953 1787861006.838806 read 0x00751f thru 0x00feda (0x89bc bytes) 000954 1787861006.858778 read 0x018ac9 thru 0x02251a (0x9a52 bytes) 000957 1787861006.870206 write 0x012047 thru 0x018c64 (0x6c1e bytes) 000958 1787861006.983267 write 0x0388e4 thru 0x03ab19 (0x2236 bytes) 000959 1787861006.984347 write 0x01bd90 thru 0x01f708 (0x3979 bytes) 000961 1787861007.024341 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ab1a): Mirror 2: 0xb285b189 (stale) Mirror 4: 0x3c43a2e1 (stale) Mirror 5: 0x8adbd408 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab1a): Mirror 2: 0xb285b189 (stale) Mirror 4: 0x3c43a2e1 (stale) Mirror 5: 0x8adbd408 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab1a: skipped 000962 1787861007.425207 read 0x02818f thru 0x037a5f (0xf8d1 bytes) 000963 1787861007.439893 write 0x00bcc2 thru 0x011615 (0x5954 bytes) 000964 1787861007.456212 read 0x01d7b9 thru 0x02334e (0x5b96 bytes) 000965 1787861007.478523 read 0x0145e8 thru 0x02146e (0xce87 bytes) 000966 1787861007.483495 trunc from 0x03ab1a to 0x01dcfb (0x1ce1e bytes) 000967 1787861007.510437 write 0x017a7d thru 0x020e48 (0x93cc bytes) 000968 1787861007.513209 mapwrite 0x03e94c thru 0x03ffff (0x16b4 bytes) 000972 1787861007.654311 write 0x02c089 thru 0x02d59d (0x1515 bytes) 000976 1787861007.658421 read 0x02331d thru 0x023bb3 (0x897 bytes) 000977 1787861007.662155 mapwrite 0x0058be thru 0x00fccd (0xa410 bytes) 000978 1787861007.760292 mapread 0x013ef2 thru 0x01819c (0x42ab bytes) 000979 1787861007.765197 read 0x02acb2 thru 0x02b421 (0x770 bytes) 000980 1787861007.780898 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x345cf3f7 (stale) Mirror 4: 0xe5f9067e (stale) Mirror 5: 0xacede038 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1912198a Mirror 6: 0x1912198a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000981 1787861009.000141 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ac:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe5f9067e (stale) Mirror 5: 0xacede038 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe5f9067e (stale) Mirror 5: 0xacede038 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1912198a Mirror 6: 0x1912198a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000982 1787861009.690925 write 0x029da1 thru 0x032220 (0x8480 bytes) 000983 1787861009.838086 trunc from 0x040000 to 0x0124d9 (0x2db26 bytes) 000986 1787861009.900227 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x124da): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x124da): Mirror 4: 0x5d6d1038 (stale) Mirror 5: 0x13e6e4d1 (stale) Mirror 6: 0x3cd9767a (stale) CRC-32 checksum value for chunk [0, 0x124da): Mirror 1: 0x3cd9767a Mirror 7: 0x3cd9767a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x124da: skipped 000988 1787861011.140301 MIRROR_RESYNC 5 mirrors 000991 1787861012.419481 read 0x00ca73 thru 0x0124d9 (0x5a67 bytes) 000992 1787861012.428199 read 0x004f47 thru 0x0124d9 (0xd593 bytes) 000996 1787861012.436019 mapread 0x00e8d8 thru 0x0124d9 (0x3c02 bytes) 000997 1787861012.436897 write 0x02099f thru 0x02815e (0x77c0 bytes) 000999 1787861012.511979 write 0x017531 thru 0x01efae (0x7a7e bytes) All operations completed A-OK!