== sanity-flr test 70a: flr mode fsx test ================ 21:00:37 (1788310837) Seed set to 839 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003 1788310839.703240 write 0x02fbea thru 0x03e04e (0xe465 bytes) 000004 1788310839.719188 read 0x00a23f thru 0x018e55 (0xec17 bytes) 000005 1788310839.736117 write 0x033582 thru 0x03f15d (0xbbdc bytes) 000006 1788310839.737655 write 0x002666 thru 0x004870 (0x220b bytes) 000007 1788310839.761603 mapread 0x00a33d thru 0x01630e (0xbfd2 bytes) 000008 1788310839.764422 write 0x03208f thru 0x03ec8e (0xcc00 bytes) 000011 1788310839.775737 write 0x01afba thru 0x01f7af (0x47f6 bytes) 000012 1788310839.808201 mapwrite 0x014ea6 thru 0x022a43 (0xdb9e bytes) 000013 1788310840.033992 read 0x016909 thru 0x025585 (0xec7d bytes) 000014 1788310840.035390 mapwrite 0x0208f7 thru 0x02270d (0x1e17 bytes) truncating to largest ever: 0x209d0 000015 1788310840.117116 trunc from 0x03f15e to 0x0209cf (0x1e78e bytes) 000018 1788310840.149856 mapread 0x020876 thru 0x0209cf (0x15a bytes) 000019 1788310840.151606 mapread 0x004eaf thru 0x0147bf (0xf911 bytes) 000020 1788310840.189055 mapread 0x002f2c thru 0x00cec7 (0x9f9c bytes) 000022 1788310840.192558 write 0x012bca thru 0x01fd0b (0xd142 bytes) 000023 1788310840.194718 write 0x00c54d thru 0x016759 (0xa20d bytes) 000024 1788310840.205354 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3d7dd 000025 1788310840.922462 trunc from 0x0209d0 to 0x03d7dc (0x1ce0d bytes) 000026 1788310841.061289 read 0x0036aa thru 0x010f21 (0xd878 bytes) 000028 1788310841.082679 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d7dd): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7dd): Mirror 2: 0x1bdc89be (stale) CRC-32 checksum value for chunk [0, 0x3d7dd): Mirror 1: 0x1bdc89be Mirror 3: 0x1bdc89be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7dd: skipped 000031 1788310842.545120 read 0x021733 thru 0x02e3aa (0xcc78 bytes) 000033 1788310842.633012 write 0x02bb22 thru 0x031c6e (0x614d bytes) 000034 1788310842.815550 mapread 0x02b08b thru 0x02d0d9 (0x204f bytes) 000036 1788310842.818366 write 0x033853 thru 0x039077 (0x5825 bytes) 000039 1788310842.845706 mapread 0x02b0e6 thru 0x03997b (0xe896 bytes) 000041 1788310842.875571 trunc from 0x03d7dd to 0x0011bc (0x3c620 bytes) 000042 1788310842.918350 mapwrite 0x036fab thru 0x039eef (0x2f45 bytes) 000043 1788310843.070454 write 0x00f10f thru 0x01e4d8 (0xf3ca bytes) 000044 1788310843.099156 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39ef0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ef0): Mirror 2: 0x8e1a8b37 (stale) Mirror 3: 0x8e1a8b37 (stale) CRC-32 checksum value for chunk [0, 0x39ef0): Mirror 1: 0x8bdbe8ff Mirror 4: 0x8bdbe8ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ef0: skipped 000047 1788310844.507736 read 0x02b17b thru 0x038ba4 (0xda2a bytes) 000049 1788310844.551277 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x39ef0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ef0): Mirror 2: 0x8e1a8b37 (stale) Mirror 3: 0x8e1a8b37 (stale) CRC-32 checksum value for chunk [0, 0x39ef0): Mirror 1: 0x8bdbe8ff Mirror 4: 0x8bdbe8ff Mirror 5: 0x8bdbe8ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ef0: skipped 000050 1788310846.020159 trunc from 0x039ef0 to 0x004081 (0x35e6e bytes) 000051 1788310846.178841 mapwrite 0x02bb46 thru 0x033d51 (0x820c bytes) 000052 1788310846.323091 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33d52): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d52): Mirror 2: 0xba0a4d0d (stale) Mirror 3: 0xba0a4d0d (stale) Mirror 4: 0x9a6f85fb (stale) Mirror 5: 0x9a6f85fb (stale) CRC-32 checksum value for chunk [0, 0x33d52): Mirror 1: 0xb8952edd Mirror 6: 0xb8952edd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d52: skipped 000053 1788310847.820426 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33d52): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d52): Mirror 2: 0xba0a4d0d (stale) Mirror 3: 0xba0a4d0d (stale) Mirror 4: 0x9a6f85fb (stale) Mirror 5: 0x9a6f85fb (stale) CRC-32 checksum value for chunk [0, 0x33d52): Mirror 1: 0xb8952edd Mirror 6: 0xb8952edd Mirror 7: 0xb8952edd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d52: skipped 000055 1788310849.424993 trunc from 0x033d52 to 0x034612 (0x8c1 bytes) 000056 1788310849.625275 read 0x027a65 thru 0x02803f (0x5db bytes) 000057 1788310849.633031 mapread 0x010cf0 thru 0x017ce0 (0x6ff1 bytes) 000058 1788310849.685050 write 0x024b1c thru 0x027e83 (0x3368 bytes) 000059 1788310849.690254 read 0x0322c7 thru 0x034612 (0x234c bytes) 000060 1788310849.716064 mapread 0x02d914 thru 0x034612 (0x6cff bytes) 000061 1788310849.717354 mapwrite 0x00bc94 thru 0x013670 (0x79dd bytes) 000064 1788310849.780172 mapread 0x021bed thru 0x025e30 (0x4244 bytes) 000067 1788310849.785282 write 0x032e63 thru 0x03f6e3 (0xc881 bytes) 000068 1788310849.788446 mapwrite 0x02c0cc thru 0x038298 (0xc1cd bytes) 000070 1788310849.857753 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f6e4): Mirror 3: 0xdfe3caf4 (stale) Mirror 4: 0x8eaac571 (stale) Mirror 5: 0x8eaac571 (stale) Mirror 6: 0xfd5be39e (stale) Mirror 7: 0xfd5be39e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f6e4): Mirror 3: 0xdfe3caf4 (stale) Mirror 4: 0x8eaac571 (stale) Mirror 5: 0x8eaac571 (stale) Mirror 6: 0xfd5be39e (stale) Mirror 7: 0xfd5be39e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f6e4: skipped 000071 1788310850.452716 read 0x009241 thru 0x015a7d (0xc83d bytes) 000074 1788310850.469564 trunc from 0x03f6e4 to 0x0359e3 (0x9d00 bytes) 000075 1788310850.484145 mapread 0x0051dd thru 0x00e6aa (0x94ce bytes) 000076 1788310850.502220 read 0x03047c thru 0x0359e3 (0x5568 bytes) 000077 1788310850.511688 mapread 0x02a73f thru 0x03514f (0xaa11 bytes) 000079 1788310850.513363 read 0x035533 thru 0x0359e3 (0x4b1 bytes) 000083 1788310850.524031 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x359e4): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x359e4): Mirror 3: 0x3c4a554d (stale) Mirror 4: 0x904bb6b1 (stale) Mirror 5: 0x904bb6b1 (stale) Mirror 6: 0x8d13e24c (stale) Mirror 7: 0x8d13e24c (stale) CRC-32 checksum value for chunk [0, 0x359e4): Mirror 1: 0x1f50773 Mirror 8: 0x1f50773 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x359e4: skipped 000084 1788310851.601406 mapwrite 0x01fa5f thru 0x025e8a (0x642c bytes) 000086 1788310851.911011 MIRROR_RESYNC 7 mirrors 000087 1788310853.392814 read 0x03293b thru 0x0359e3 (0x30a9 bytes) 000090 1788310853.410232 mapread 0x013df8 thru 0x01ad7f (0x6f88 bytes) 000091 1788310853.437969 write 0x001f2e thru 0x006c9c (0x4d6f bytes) 000092 1788310853.526093 MIRROR_RESYNC 7 mirrors 000093 1788310854.919232 MIRROR_RESYNC 7 mirrors 000095 1788310855.477229 mapwrite 0x03dd81 thru 0x03ffff (0x227f bytes) 000096 1788310855.725407 write 0x01b883 thru 0x01d6b1 (0x1e2f bytes) 000097 1788310855.752582 mapread 0x03d4b6 thru 0x03ffff (0x2b4a bytes) 000099 1788310855.754137 read 0x00b157 thru 0x00e272 (0x311c bytes) 000100 1788310855.767605 read 0x00fe8b thru 0x01bbd2 (0xbd48 bytes) 000101 1788310855.781749 write 0x00bdb0 thru 0x0118b6 (0x5b07 bytes) 000111 1788310855.791147 mapwrite 0x02243a thru 0x025e78 (0x3a3f bytes) 000113 1788310855.841633 mapwrite 0x0376b1 thru 0x03ffff (0x894f bytes) 000114 1788310855.937531 trunc from 0x040000 to 0x037fa9 (0x8056 bytes) 000116 1788310855.964148 read 0x02b525 thru 0x037fa9 (0xca85 bytes) 000117 1788310855.964762 write 0x0238d9 thru 0x02c6da (0x8e02 bytes) 000118 1788310855.967036 mapread 0x015945 thru 0x01d2fb (0x79b7 bytes) 000121 1788310855.970268 read 0x0018de thru 0x0046e7 (0x2e0a bytes) 000122 1788310855.971143 mapread 0x01ce4a thru 0x02832b (0xb4e2 bytes) 000123 1788310855.972625 write 0x01d06a thru 0x0266b0 (0x9647 bytes) 000127 1788310855.976259 mapread 0x01f7d7 thru 0x02e04e (0xe878 bytes) 000129 1788310855.978383 mapwrite 0x00489c thru 0x011fff (0xd764 bytes) 000130 1788310856.036503 mapread 0x03656b thru 0x037fa9 (0x1a3f bytes) 000131 1788310856.038060 mapwrite 0x01c62a thru 0x01e634 (0x200b bytes) 000132 1788310856.079115 mapread 0x00d25f thru 0x00e961 (0x1703 bytes) 000133 1788310856.084467 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37faa): Mirror 4: 0x118066c9 (stale) Mirror 5: 0x118066c9 (stale) Mirror 6: 0x118066c9 (stale) Mirror 7: 0x118066c9 (stale) Mirror 8: 0x118066c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37faa): Mirror 4: 0x118066c9 (stale) Mirror 5: 0x118066c9 (stale) Mirror 6: 0x118066c9 (stale) Mirror 7: 0x118066c9 (stale) Mirror 8: 0x118066c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37faa: skipped 000134 1788310856.597099 mapwrite 0x00c7cf thru 0x0162df (0x9b11 bytes) 000136 1788310856.721045 mapread 0x003929 thru 0x00784d (0x3f25 bytes) 000137 1788310856.741949 write 0x037e76 thru 0x03d8ff (0x5a8a bytes) 000141 1788310856.758586 mapwrite 0x020d99 thru 0x029f63 (0x91cb bytes) 000142 1788310856.887458 write 0x03d711 thru 0x03ffff (0x28ef bytes) 000148 1788310856.893669 mapwrite 0x02f8c3 thru 0x0319f3 (0x2131 bytes) 000149 1788310856.957709 mapwrite 0x024aa8 thru 0x02aaf1 (0x604a bytes) 000150 1788310857.014772 write 0x0389c7 thru 0x03ffff (0x7639 bytes) 000151 1788310857.023361 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x90e55690 (stale) Mirror 6: 0x90e55690 (stale) Mirror 7: 0x90e55690 (stale) Mirror 8: 0x90e55690 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x90e55690 (stale) Mirror 6: 0x90e55690 (stale) Mirror 7: 0x90e55690 (stale) Mirror 8: 0x90e55690 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000156 1788310857.560183 write 0x0116ba thru 0x01e37a (0xccc1 bytes) 000157 1788310857.587501 MIRROR_RESYNC 5 mirrors 000159 1788310858.944402 MIRROR_RESYNC 5 mirrors 000160 1788310859.366104 write 0x03976d thru 0x03ffff (0x6893 bytes) 000161 1788310859.432159 mapwrite 0x02d98d thru 0x032147 (0x47bb bytes) 000162 1788310859.521329 trunc from 0x040000 to 0x019314 (0x26ceb bytes) 000163 1788310859.546896 trunc from 0x019315 to 0x0283e0 (0xf0cc bytes) 000165 1788310859.569550 mapread 0x00eaff thru 0x012676 (0x3b78 bytes) 000166 1788310859.583271 read 0x003a91 thru 0x00fded (0xc35d bytes) 000167 1788310859.592264 mapwrite 0x03981a thru 0x03ffff (0x67e6 bytes) 000170 1788310859.675441 write 0x0004b4 thru 0x00ce5b (0xc9a8 bytes) 000171 1788310859.684680 write 0x026321 thru 0x0303b6 (0xa096 bytes) 000172 1788310859.700062 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xdbc86a80 (stale) Mirror 6: 0xdbc86a80 (stale) Mirror 7: 0xdbc86a80 (stale) Mirror 8: 0xdbc86a80 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb6bb7c69 Mirror 9: 0xb6bb7c69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000173 1788310860.835363 read 0x01a07a thru 0x0251b7 (0xb13e bytes) 000175 1788310860.886384 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xdbc86a80 (stale) Mirror 6: 0xdbc86a80 (stale) Mirror 7: 0xdbc86a80 (stale) Mirror 8: 0xdbc86a80 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb6bb7c69 Mirror 9: 0xb6bb7c69 Mirror 10: 0xb6bb7c69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000178 1788310862.365793 read 0x0324b3 thru 0x03ffff (0xdb4d bytes) 000179 1788310862.387597 write 0x019c96 thru 0x01cd6d (0x30d8 bytes) 000180 1788310862.520809 mapread 0x0003ca thru 0x00e30d (0xdf44 bytes) 000181 1788310862.558328 write 0x0039f0 thru 0x0057b8 (0x1dc9 bytes) 000182 1788310862.563613 mapwrite 0x00dcd5 thru 0x010784 (0x2ab0 bytes) 000184 1788310862.624665 write 0x038f73 thru 0x03b42f (0x24bd bytes) 000186 1788310862.639487 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xdbc86a80 (stale) Mirror 6: 0xdbc86a80 (stale) Mirror 7: 0xdbc86a80 (stale) Mirror 8: 0xdbc86a80 (stale) Mirror 9: 0xb6bb7c69 (stale) Mirror 10: 0xb6bb7c69 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4718134c Mirror 11: 0x4718134c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000187 1788310863.809801 MIRROR_RESYNC 8 mirrors 000188 1788310865.111561 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000189 1788310865.560622 mapwrite 0x02e7b9 thru 0x039876 (0xb0be bytes) 000191 1788310865.872765 mapread 0x024e16 thru 0x029eb4 (0x509f bytes) 000193 1788310865.893825 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4718134c (stale) Mirror 6: 0x4718134c (stale) Mirror 7: 0x4718134c (stale) Mirror 8: 0x4718134c (stale) Mirror 9: 0x4718134c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4718134c (stale) Mirror 6: 0x4718134c (stale) Mirror 7: 0x4718134c (stale) Mirror 8: 0x4718134c (stale) Mirror 9: 0x4718134c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000194 1788310866.407491 mapread 0x00106c thru 0x0013ca (0x35f bytes) 000196 1788310866.415885 read 0x00cc86 thru 0x00e853 (0x1bce bytes) 000197 1788310866.421896 mapwrite 0x028b0d thru 0x02c944 (0x3e38 bytes) truncating to largest ever: 0x3dcee 000198 1788310866.475557 trunc from 0x040000 to 0x03dced (0x2312 bytes) 000200 1788310866.500080 mapwrite 0x037c8e thru 0x03f12f (0x74a2 bytes) 000201 1788310866.659951 mapread 0x020e70 thru 0x02616e (0x52ff bytes) 000203 1788310866.697279 read 0x02c236 thru 0x02d8de (0x16a9 bytes) 000204 1788310866.698037 read 0x00f14b thru 0x0164ed (0x73a3 bytes) 000206 1788310866.735451 MIRROR_RESYNC 6 mirrors 000210 1788310867.855076 mapread 0x0288e3 thru 0x0366e1 (0xddff bytes) 000211 1788310867.889343 mapread 0x03e7f0 thru 0x03f12f (0x940 bytes) 000213 1788310867.897054 mapread 0x03ad56 thru 0x03f12f (0x43da bytes) 000214 1788310867.898126 trunc from 0x03f130 to 0x002324 (0x3ce0b bytes) 000215 1788310868.058059 read 0x0011d9 thru 0x002324 (0x114c bytes) 000216 1788310868.067994 write 0x03d360 thru 0x03ffff (0x2ca0 bytes) 000217 1788310868.069234 write 0x02f782 thru 0x032dfc (0x367b bytes) 000221 1788310868.082298 trunc from 0x040000 to 0x021b26 (0x1e4d9 bytes) 000222 1788310868.138777 trunc from 0x021b27 to 0x027b0f (0x5fe9 bytes) 000225 1788310868.197819 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x27b10): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b10): Mirror 5: 0x4ec929fa (stale) Mirror 6: 0x4ec929fa (stale) Mirror 7: 0x4ec929fa (stale) Mirror 8: 0x4ec929fa (stale) Mirror 9: 0x4ec929fa (stale) CRC-32 checksum value for chunk [0, 0x27b10): Mirror 1: 0xd0f96bdd Mirror 10: 0xd0f96bdd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b10: skipped 000229 1788310869.442231 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27b10): Mirror 5: 0x4ec929fa (stale) Mirror 6: 0x4ec929fa (stale) Mirror 7: 0x4ec929fa (stale) Mirror 8: 0x4ec929fa (stale) Mirror 9: 0x4ec929fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b10): Mirror 5: 0x4ec929fa (stale) Mirror 6: 0x4ec929fa (stale) Mirror 7: 0x4ec929fa (stale) Mirror 8: 0x4ec929fa (stale) Mirror 9: 0x4ec929fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b10: skipped 000231 1788310869.931323 mapread 0x010324 thru 0x01335f (0x303c bytes) 000235 1788310869.988485 trunc from 0x027b10 to 0x028a78 (0xf69 bytes) 000236 1788310870.093169 trunc from 0x028a79 to 0x0310b5 (0x863d bytes) 000239 1788310870.127082 trunc from 0x0310b6 to 0x01e342 (0x12d73 bytes) 000241 1788310870.174035 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1e343): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e343): Mirror 5: 0xefaf2c16 (stale) Mirror 6: 0xefaf2c16 (stale) Mirror 7: 0xefaf2c16 (stale) Mirror 8: 0xefaf2c16 (stale) Mirror 9: 0xefaf2c16 (stale) CRC-32 checksum value for chunk [0, 0x1e343): Mirror 1: 0x39427a28 Mirror 10: 0x39427a28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e343: skipped 000242 1788310871.263236 read 0x008fd5 thru 0x01393a (0xa966 bytes) 000244 1788310871.297340 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1e343): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e343): Mirror 5: 0xefaf2c16 (stale) Mirror 6: 0xefaf2c16 (stale) Mirror 7: 0xefaf2c16 (stale) Mirror 8: 0xefaf2c16 (stale) Mirror 9: 0xefaf2c16 (stale) CRC-32 checksum value for chunk [0, 0x1e343): Mirror 1: 0x39427a28 Mirror 10: 0x39427a28 Mirror 11: 0x39427a28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e343: skipped 000245 1788310872.329281 mapread 0x0047ed thru 0x013fc3 (0xf7d7 bytes) 000247 1788310872.368066 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e343): Mirror 5: 0xefaf2c16 (stale) Mirror 6: 0xefaf2c16 (stale) Mirror 7: 0xefaf2c16 (stale) Mirror 8: 0xefaf2c16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e343): Mirror 5: 0xefaf2c16 (stale) Mirror 6: 0xefaf2c16 (stale) Mirror 7: 0xefaf2c16 (stale) Mirror 8: 0xefaf2c16 (stale) CRC-32 checksum value for chunk [0, 0x1e343): Mirror 1: 0x39427a28 Mirror 10: 0x39427a28 Mirror 11: 0x39427a28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e343: skipped 000249 1788310873.163758 mapwrite 0x03e6cf thru 0x03ffff (0x1931 bytes) 000250 1788310873.388356 trunc from 0x040000 to 0x00e2af (0x31d50 bytes) 000251 1788310873.441485 mapwrite 0x039c37 thru 0x03ffff (0x63c9 bytes) 000252 1788310873.567800 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf95a2eba (stale) Mirror 6: 0xf95a2eba (stale) Mirror 7: 0xf95a2eba (stale) Mirror 8: 0xf95a2eba (stale) Mirror 10: 0xf9b0d29a (stale) Mirror 11: 0xf9b0d29a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1b9b93c7 Mirror 12: 0x1b9b93c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000253 1788310874.801563 read 0x033778 thru 0x03ca69 (0x92f2 bytes) 000255 1788310874.848386 mapread 0x03ce52 thru 0x03ffff (0x31ae bytes) 000256 1788310874.879047 read 0x03417f thru 0x035c6a (0x1aec bytes) 000258 1788310874.892764 mapread 0x013698 thru 0x021e3c (0xe7a5 bytes) 000260 1788310874.928188 read 0x03205b thru 0x03ffff (0xdfa5 bytes) 000262 1788310874.949532 read 0x00474e thru 0x01189d (0xd150 bytes) 000266 1788310875.035616 trunc from 0x040000 to 0x034181 (0xbe7e bytes) 000269 1788310875.162800 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x34182): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34182): Mirror 5: 0x7c298161 (stale) Mirror 6: 0x7c298161 (stale) Mirror 7: 0x7c298161 (stale) Mirror 8: 0x7c298161 (stale) Mirror 10: 0x237dc054 (stale) Mirror 11: 0x237dc054 (stale) Mirror 12: 0x237dc054 (stale) CRC-32 checksum value for chunk [0, 0x34182): Mirror 1: 0x237dc054 Mirror 13: 0x237dc054 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34182: skipped 000270 1788310876.416495 write 0x006f9c thru 0x00c0de (0x5143 bytes) 000271 1788310876.496619 mapread 0x017119 thru 0x0263a5 (0xf28d bytes) 000272 1788310876.532195 write 0x024137 thru 0x026569 (0x2433 bytes) 000273 1788310876.533418 mapwrite 0x00e357 thru 0x01cd66 (0xea10 bytes) 000275 1788310876.627346 MIRROR_RESYNC 9 mirrors 000276 1788310878.322509 read 0x025b9f thru 0x03216a (0xc5cc bytes) 000277 1788310878.332312 mapread 0x004d67 thru 0x008c41 (0x3edb bytes) 000278 1788310878.351088 mapwrite 0x0244e8 thru 0x03343e (0xef57 bytes) 000280 1788310878.523067 trunc from 0x034182 to 0x02af28 (0x9259 bytes) 000283 1788310878.556591 write 0x03c45b thru 0x03ffff (0x3ba5 bytes) 000284 1788310878.558893 mapread 0x019764 thru 0x0214d5 (0x7d72 bytes) 000286 1788310878.568532 read 0x03adb4 thru 0x03ffff (0x524c bytes) 000287 1788310878.576678 read 0x034008 thru 0x03fc07 (0xbc00 bytes) 000288 1788310878.577317 mapread 0x02a63f thru 0x02aa7a (0x43c bytes) 000289 1788310878.578127 mapread 0x005b0e thru 0x01407c (0xe56f bytes) 000291 1788310878.579998 write 0x01c72f thru 0x0232aa (0x6b7c bytes) 000292 1788310878.581324 read 0x022de5 thru 0x032cf9 (0xff15 bytes) 000296 1788310878.584180 read 0x035b24 thru 0x03ffff (0xa4dc bytes) 000297 1788310878.585092 write 0x000f9b thru 0x010485 (0xf4eb bytes) 000298 1788310878.588074 read 0x0141f6 thru 0x0165c0 (0x23cb bytes) 000300 1788310878.591618 write 0x031d40 thru 0x03b117 (0x93d8 bytes) 000304 1788310878.595440 trunc from 0x040000 to 0x00a1d4 (0x35e2b bytes) 000305 1788310878.622381 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xa1d5): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa1d5): Mirror 5: 0x26a62497 (stale) Mirror 6: 0x26a62497 (stale) Mirror 7: 0x26a62497 (stale) Mirror 8: 0x26a62497 (stale) Mirror 10: 0x26a62497 (stale) Mirror 11: 0x26a62497 (stale) Mirror 12: 0x26a62497 (stale) Mirror 13: 0x26a62497 (stale) CRC-32 checksum value for chunk [0, 0xa1d5): Mirror 1: 0x831950fe Mirror 14: 0x831950fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa1d5: skipped 000306 1788310879.720143 trunc from 0x00a1d5 to 0x01d026 (0x12e52 bytes) 000307 1788310879.839121 trunc from 0x01d027 to 0x00e326 (0xed00 bytes) 000308 1788310879.876947 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xe327): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe327): Mirror 5: 0x5909cf53 (stale) Mirror 6: 0x5909cf53 (stale) Mirror 7: 0x5909cf53 (stale) Mirror 8: 0x5909cf53 (stale) Mirror 10: 0x5909cf53 (stale) Mirror 11: 0x5909cf53 (stale) Mirror 12: 0x5909cf53 (stale) Mirror 13: 0x5909cf53 (stale) Mirror 14: 0x54f26732 (stale) CRC-32 checksum value for chunk [0, 0xe327): Mirror 1: 0x54f26732 Mirror 15: 0x54f26732 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe327: skipped 000309 1788310880.960068 write 0x01ccde thru 0x024669 (0x798c bytes) 000310 1788310881.036409 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2466a): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2466a): Mirror 5: 0x84b5b112 (stale) Mirror 6: 0x84b5b112 (stale) Mirror 7: 0x84b5b112 (stale) Mirror 8: 0x84b5b112 (stale) Mirror 10: 0x84b5b112 (stale) Mirror 11: 0x84b5b112 (stale) Mirror 12: 0x84b5b112 (stale) Mirror 13: 0x84b5b112 (stale) Mirror 14: 0x2d400a25 (stale) Mirror 15: 0x2d400a25 (stale) CRC-32 checksum value for chunk [0, 0x2466a): Mirror 1: 0x8893a5f7 Mirror 16: 0x8893a5f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2466a: skipped 000312 1788310882.156481 read 0x001de6 thru 0x006558 (0x4773 bytes) 000315 1788310882.198536 read 0x017966 thru 0x023af8 (0xc193 bytes) 000316 1788310882.218542 mapread 0x00886b thru 0x017b22 (0xf2b8 bytes) 000319 1788310882.263030 mapwrite 0x03165b thru 0x03ffff (0xe9a5 bytes) 000320 1788310882.431992 read 0x037c7e thru 0x03ffff (0x8382 bytes) 000322 1788310882.433563 mapread 0x015e1a thru 0x01da31 (0x7c18 bytes) 000324 1788310882.451230 mapread 0x02f04d thru 0x036d40 (0x7cf4 bytes) 000326 1788310882.454513 trunc from 0x040000 to 0x03be33 (0x41cc bytes) 000330 1788310882.492956 trunc from 0x03be34 to 0x027591 (0x148a2 bytes) 000331 1788310882.529217 MIRROR_RESYNC 12 mirrors 000332 1788310884.310125 mapread 0x015762 thru 0x01d318 (0x7bb7 bytes) 000333 1788310884.337686 mapwrite 0x038b53 thru 0x03ffff (0x74ad bytes) 000334 1788310884.531891 write 0x0172f5 thru 0x01c8a8 (0x55b4 bytes) 000335 1788310884.541656 mapread 0x039787 thru 0x03e0ac (0x4926 bytes) 000336 1788310884.542872 write 0x017616 thru 0x01ec89 (0x7674 bytes) 000338 1788310884.551051 mapwrite 0x00ba7f thru 0x0108b6 (0x4e38 bytes) 000340 1788310884.615009 mapwrite 0x03f2d5 thru 0x03ffff (0xd2b bytes) 000341 1788310884.664774 trunc from 0x040000 to 0x017d7e (0x28281 bytes) 000343 1788310884.696450 write 0x02b065 thru 0x02b206 (0x1a2 bytes) 000344 1788310884.705664 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2b207): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b207): Mirror 5: 0xed138e1e (stale) Mirror 6: 0xed138e1e (stale) Mirror 7: 0xed138e1e (stale) Mirror 8: 0xed138e1e (stale) Mirror 10: 0xed138e1e (stale) Mirror 11: 0xed138e1e (stale) Mirror 12: 0xed138e1e (stale) Mirror 13: 0xed138e1e (stale) Mirror 14: 0xed138e1e (stale) Mirror 15: 0xed138e1e (stale) Mirror 16: 0xed138e1e (stale) CRC-32 checksum value for chunk [0, 0x2b207): Mirror 1: 0x30d8c2bd Mirror 17: 0x30d8c2bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b207: skipped 000345 1788310885.951419 MIRROR_RESYNC 13 mirrors 000346 1788310887.794617 write 0x00828d thru 0x00f1a1 (0x6f15 bytes) 000347 1788310887.953298 MIRROR_RESYNC 13 mirrors 000348 1788310889.935386 mapwrite 0x010d8a thru 0x01afa8 (0xa21f bytes) 000349 1788310890.120972 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2b207): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b207): Mirror 5: 0x66444639 (stale) Mirror 6: 0x66444639 (stale) Mirror 7: 0x66444639 (stale) Mirror 8: 0x66444639 (stale) Mirror 10: 0x66444639 (stale) Mirror 11: 0x66444639 (stale) Mirror 12: 0x66444639 (stale) Mirror 13: 0x66444639 (stale) Mirror 14: 0x66444639 (stale) Mirror 15: 0x66444639 (stale) Mirror 16: 0x66444639 (stale) Mirror 17: 0x66444639 (stale) CRC-32 checksum value for chunk [0, 0x2b207): Mirror 1: 0xe92b7202 Mirror 18: 0xe92b7202 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b207: skipped 000350 1788310891.259855 write 0x02ce42 thru 0x02dac7 (0xc86 bytes) 000352 1788310891.365961 mapread 0x0071c5 thru 0x00bc4b (0x4a87 bytes) 000353 1788310891.388157 write 0x02a783 thru 0x034697 (0x9f15 bytes) 000355 1788310891.400612 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34698): Mirror 5: 0x3ea94622 (stale) Mirror 6: 0x3ea94622 (stale) Mirror 7: 0x3ea94622 (stale) Mirror 8: 0x3ea94622 (stale) Mirror 10: 0x3ea94622 (stale) Mirror 11: 0x3ea94622 (stale) Mirror 13: 0x3ea94622 (stale) Mirror 14: 0x3ea94622 (stale) Mirror 15: 0x3ea94622 (stale) Mirror 16: 0x3ea94622 (stale) Mirror 17: 0x3ea94622 (stale) Mirror 18: 0x18b21c87 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34698): Mirror 5: 0x3ea94622 (stale) Mirror 6: 0x3ea94622 (stale) Mirror 7: 0x3ea94622 (stale) Mirror 8: 0x3ea94622 (stale) Mirror 10: 0x3ea94622 (stale) Mirror 11: 0x3ea94622 (stale) Mirror 13: 0x3ea94622 (stale) Mirror 14: 0x3ea94622 (stale) Mirror 15: 0x3ea94622 (stale) Mirror 16: 0x3ea94622 (stale) Mirror 17: 0x3ea94622 (stale) Mirror 18: 0x18b21c87 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34698: skipped 000358 1788310892.227431 mapwrite 0x02ae54 thru 0x03a22c (0xf3d9 bytes) truncating to largest ever: 0x3ddfb 000360 1788310892.366294 trunc from 0x03a22d to 0x03ddfa (0x3bce bytes) 000361 1788310892.385549 read 0x03dde0 thru 0x03ddfa (0x1b bytes) 000362 1788310892.391990 mapread 0x02afa3 thru 0x036604 (0xb662 bytes) 000363 1788310892.394167 write 0x021fea thru 0x02a8b6 (0x88cd bytes) 000364 1788310892.402104 read 0x02bf20 thru 0x03b6ed (0xf7ce bytes) 000365 1788310892.411128 mapread 0x02e7a2 thru 0x03b11d (0xc97c bytes) 000367 1788310892.413220 mapwrite 0x00484a thru 0x0141a0 (0xf957 bytes) 000369 1788310892.463227 write 0x00e076 thru 0x01da84 (0xfa0f bytes) 000372 1788310892.470460 read 0x0385ba thru 0x03ddfa (0x5841 bytes) 000375 1788310892.472284 mapread 0x011bbe thru 0x01ee03 (0xd246 bytes) 000378 1788310892.480013 MIRROR_RESYNC 13 mirrors 000379 1788310894.332072 write 0x00eaef thru 0x019fd6 (0xb4e8 bytes) 000380 1788310894.421444 mapread 0x036cca thru 0x03ddfa (0x7131 bytes) 000382 1788310894.459710 read 0x026c7c thru 0x02f08d (0x8412 bytes) 000385 1788310894.472155 mapwrite 0x0154d0 thru 0x022ef6 (0xda27 bytes) 000386 1788310894.540142 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3ddfb): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ddfb): Mirror 5: 0x311ec509 (stale) Mirror 6: 0x311ec509 (stale) Mirror 7: 0x311ec509 (stale) Mirror 8: 0x311ec509 (stale) Mirror 10: 0x311ec509 (stale) Mirror 11: 0x311ec509 (stale) Mirror 13: 0x311ec509 (stale) Mirror 14: 0x311ec509 (stale) Mirror 15: 0x311ec509 (stale) Mirror 16: 0x311ec509 (stale) Mirror 17: 0x311ec509 (stale) Mirror 18: 0x311ec509 (stale) CRC-32 checksum value for chunk [0, 0x3ddfb): Mirror 1: 0xcdafce43 Mirror 19: 0xcdafce43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ddfb: skipped 000388 1788310895.722710 mapread 0x019cf5 thru 0x027332 (0xd63e bytes) 000389 1788310895.779487 mapwrite 0x017210 thru 0x01bd10 (0x4b01 bytes) 000390 1788310895.948948 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ddfb): Mirror 5: 0x311ec509 (stale) Mirror 6: 0x311ec509 (stale) Mirror 7: 0x311ec509 (stale) Mirror 8: 0x311ec509 (stale) Mirror 10: 0x311ec509 (stale) Mirror 11: 0x311ec509 (stale) Mirror 14: 0x311ec509 (stale) Mirror 15: 0x311ec509 (stale) Mirror 16: 0x311ec509 (stale) Mirror 17: 0x311ec509 (stale) Mirror 18: 0x311ec509 (stale) Mirror 19: 0xcdafce43 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ddfb): Mirror 5: 0x311ec509 (stale) Mirror 6: 0x311ec509 (stale) Mirror 7: 0x311ec509 (stale) Mirror 8: 0x311ec509 (stale) Mirror 10: 0x311ec509 (stale) Mirror 11: 0x311ec509 (stale) Mirror 14: 0x311ec509 (stale) Mirror 15: 0x311ec509 (stale) Mirror 16: 0x311ec509 (stale) Mirror 17: 0x311ec509 (stale) Mirror 18: 0x311ec509 (stale) Mirror 19: 0xcdafce43 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ddfb: skipped 000391 1788310896.904197 mapwrite 0x03b8cc thru 0x03ef7d (0x36b2 bytes) 000394 1788310897.052514 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef7e): Mirror 6: 0xf2f543e1 (stale) Mirror 7: 0xf2f543e1 (stale) Mirror 8: 0xf2f543e1 (stale) Mirror 10: 0xf2f543e1 (stale) Mirror 11: 0xf2f543e1 (stale) Mirror 14: 0xf2f543e1 (stale) Mirror 15: 0xf2f543e1 (stale) Mirror 16: 0xf2f543e1 (stale) Mirror 17: 0xf2f543e1 (stale) Mirror 18: 0xf2f543e1 (stale) Mirror 19: 0x8a02139f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef7e): Mirror 6: 0xf2f543e1 (stale) Mirror 7: 0xf2f543e1 (stale) Mirror 8: 0xf2f543e1 (stale) Mirror 10: 0xf2f543e1 (stale) Mirror 11: 0xf2f543e1 (stale) Mirror 14: 0xf2f543e1 (stale) Mirror 15: 0xf2f543e1 (stale) Mirror 16: 0xf2f543e1 (stale) Mirror 17: 0xf2f543e1 (stale) Mirror 18: 0xf2f543e1 (stale) Mirror 19: 0x8a02139f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef7e: skipped 000395 1788310897.774697 mapwrite 0x03b4dd thru 0x03ffff (0x4b23 bytes) 000396 1788310897.935602 MIRROR_RESYNC 12 mirrors 000400 1788310899.746351 MIRROR_RESYNC 12 mirrors 000401 1788310900.570205 mapread 0x00fdd9 thru 0x015663 (0x588b bytes) 000402 1788310900.593783 MIRROR_RESYNC 12 mirrors 000405 1788310901.484173 mapwrite 0x00d34f thru 0x011422 (0x40d4 bytes) 000406 1788310901.665247 write 0x007ba0 thru 0x00875f (0xbc0 bytes) 000407 1788310901.672117 MIRROR_RESYNC 12 mirrors 000408 1788310903.252210 MIRROR_RESYNC 12 mirrors 000409 1788310903.871428 trunc from 0x040000 to 0x00dc60 (0x3239f bytes) 000410 1788310903.999760 mapread 0x004fa1 thru 0x00dc60 (0x8cc0 bytes) 000411 1788310904.030205 MIRROR_RESYNC 12 mirrors 000412 1788310905.998217 trunc from 0x00dc61 to 0x02b66c (0x1da0c bytes) 000414 1788310906.098784 mapread 0x00e79e thru 0x010fba (0x281d bytes) 000416 1788310906.140887 mapread 0x0202fe thru 0x0233e0 (0x30e3 bytes) 000420 1788310906.161587 mapread 0x004924 thru 0x00cafa (0x81d7 bytes) 000421 1788310906.181743 trunc from 0x02b66d to 0x002b4a (0x28b22 bytes) 000425 1788310906.222182 trunc from 0x002b4b to 0x00044b (0x26ff bytes) 000429 1788310906.245200 mapwrite 0x03b759 thru 0x03ffff (0x48a7 bytes) 000430 1788310906.376451 write 0x027f97 thru 0x02c95a (0x49c4 bytes) 000433 1788310906.412705 MIRROR_RESYNC 12 mirrors 000434 1788310908.250970 write 0x00794a thru 0x00e2e4 (0x699b bytes) 000436 1788310908.344740 trunc from 0x040000 to 0x02e7c8 (0x11837 bytes) 000437 1788310908.385390 MIRROR_RESYNC 12 mirrors 000440 1788310910.494969 mapwrite 0x02c4ea thru 0x03acb3 (0xe7ca bytes) 000441 1788310910.780766 write 0x020fb6 thru 0x021087 (0xd2 bytes) 000442 1788310910.800099 trunc from 0x03acb4 to 0x00f61d (0x2b696 bytes) 000443 1788310910.867475 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf61e): Mirror 7: 0xe4d64165 (stale) Mirror 8: 0xe4d64165 (stale) Mirror 10: 0xe4d64165 (stale) Mirror 11: 0xe4d64165 (stale) Mirror 14: 0xe4d64165 (stale) Mirror 15: 0xe4d64165 (stale) Mirror 16: 0xe4d64165 (stale) Mirror 17: 0xe4d64165 (stale) Mirror 18: 0xe4d64165 (stale) Mirror 19: 0xe4d64165 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf61e): Mirror 7: 0xe4d64165 (stale) Mirror 8: 0xe4d64165 (stale) Mirror 10: 0xe4d64165 (stale) Mirror 11: 0xe4d64165 (stale) Mirror 14: 0xe4d64165 (stale) Mirror 15: 0xe4d64165 (stale) Mirror 16: 0xe4d64165 (stale) Mirror 17: 0xe4d64165 (stale) Mirror 18: 0xe4d64165 (stale) Mirror 19: 0xe4d64165 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf61e: skipped 000444 1788310911.626337 mapread 0x00ad95 thru 0x00f61d (0x4889 bytes) 000446 1788310911.653277 mapwrite 0x013b2a thru 0x014df2 (0x12c9 bytes) 000449 1788310911.727121 mapwrite 0x006156 thru 0x00efab (0x8e56 bytes) 000452 1788310911.802649 read 0x012b8c thru 0x014df2 (0x2267 bytes) 000454 1788310911.810593 MIRROR_RESYNC 11 mirrors 000455 1788310913.766823 read 0x011556 thru 0x014df2 (0x389d bytes) 000456 1788310913.785413 MIRROR_EXTEND to 12 mirrors 000460 1788310915.099364 write 0x00d7d4 thru 0x0151d4 (0x7a01 bytes) 000461 1788310915.166254 mapread 0x00426e thru 0x00b487 (0x721a bytes) 000463 1788310915.197131 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x151d5): Mirror 7: 0x24599645 (stale) Mirror 8: 0x24599645 (stale) Mirror 11: 0x24599645 (stale) Mirror 14: 0x24599645 (stale) Mirror 15: 0x24599645 (stale) Mirror 16: 0x24599645 (stale) Mirror 17: 0x24599645 (stale) Mirror 18: 0x24599645 (stale) Mirror 19: 0x24599645 (stale) Mirror 20: 0x24599645 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x151d5): Mirror 7: 0x24599645 (stale) Mirror 8: 0x24599645 (stale) Mirror 11: 0x24599645 (stale) Mirror 14: 0x24599645 (stale) Mirror 15: 0x24599645 (stale) Mirror 16: 0x24599645 (stale) Mirror 17: 0x24599645 (stale) Mirror 18: 0x24599645 (stale) Mirror 19: 0x24599645 (stale) Mirror 20: 0x24599645 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x151d5: skipped 000468 1788310915.879365 write 0x031d03 thru 0x03b10c (0x940a bytes) 000469 1788310915.881073 mapread 0x01ff96 thru 0x02c0be (0xc129 bytes) 000470 1788310915.903859 read 0x01783d thru 0x0277a3 (0xff67 bytes) 000472 1788310915.910473 write 0x0353fa thru 0x03ffff (0xac06 bytes) 000474 1788310915.912816 write 0x013f29 thru 0x016a74 (0x2b4c bytes) 000475 1788310915.922851 mapwrite 0x0224f0 thru 0x02f54b (0xd05c bytes) 000477 1788310915.995085 mapwrite 0x01a6e3 thru 0x0242e0 (0x9bfe bytes) 000479 1788310916.055795 write 0x02c98b thru 0x032c15 (0x628b bytes) 000481 1788310916.057979 write 0x02a7b1 thru 0x038657 (0xdea7 bytes) 000482 1788310916.064788 MIRROR_RESYNC 11 mirrors 000484 1788310917.721117 write 0x004bde thru 0x0051e7 (0x60a bytes) 000485 1788310917.893998 read 0x011216 thru 0x01d5ac (0xc397 bytes) 000487 1788310917.924051 mapwrite 0x00f7de thru 0x01f6d9 (0xfefc bytes) 000488 1788310918.044570 read 0x00cb1c thru 0x013550 (0x6a35 bytes) 000489 1788310918.058862 trunc from 0x040000 to 0x00693f (0x396c0 bytes) 000491 1788310918.099845 mapread 0x004638 thru 0x00693f (0x2308 bytes) 000493 1788310918.101617 mapread 0x0064d6 thru 0x00693f (0x46a bytes) 000494 1788310918.112758 MIRROR_RESYNC 11 mirrors 000496 1788310920.054102 read 0x002bff thru 0x00693f (0x3d41 bytes) 000497 1788310920.065374 write 0x03c940 thru 0x03ffff (0x36c0 bytes) 000499 1788310920.229550 write 0x021fe3 thru 0x02ba2e (0x9a4c bytes) 000501 1788310920.264280 mapwrite 0x017284 thru 0x01ed48 (0x7ac5 bytes) 000502 1788310920.515319 mapread 0x0335bb thru 0x03a5ef (0x7035 bytes) 000504 1788310920.547271 trunc from 0x040000 to 0x016dd4 (0x2922b bytes) 000505 1788310920.601742 read 0x00afe6 thru 0x00e815 (0x3830 bytes) 000507 1788310920.615481 write 0x028c89 thru 0x030ae6 (0x7e5e bytes) 000508 1788310920.617536 write 0x0243cf thru 0x030e54 (0xca86 bytes) 000509 1788310920.632879 trunc from 0x030e55 to 0x017db0 (0x190a4 bytes) 000510 1788310920.658965 read 0x012867 thru 0x017db0 (0x554a bytes) 000512 1788310920.660067 read 0x0044f5 thru 0x00a0ea (0x5bf6 bytes) 000515 1788310920.664240 trunc from 0x017db1 to 0x02b97d (0x13bcd bytes) 000516 1788310920.700986 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b97e): Mirror 7: 0x2ab984f (stale) Mirror 11: 0x2ab984f (stale) Mirror 14: 0x2ab984f (stale) Mirror 15: 0x2ab984f (stale) Mirror 16: 0x2ab984f (stale) Mirror 17: 0x2ab984f (stale) Mirror 18: 0x2ab984f (stale) Mirror 19: 0x2ab984f (stale) Mirror 20: 0x2ab984f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b97e): Mirror 7: 0x2ab984f (stale) Mirror 11: 0x2ab984f (stale) Mirror 14: 0x2ab984f (stale) Mirror 15: 0x2ab984f (stale) Mirror 16: 0x2ab984f (stale) Mirror 17: 0x2ab984f (stale) Mirror 18: 0x2ab984f (stale) Mirror 19: 0x2ab984f (stale) Mirror 20: 0x2ab984f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b97e: skipped 000517 1788310921.318764 mapread 0x00e333 thru 0x01823a (0x9f08 bytes) 000518 1788310921.364320 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b97e): Mirror 7: 0x2ab984f (stale) Mirror 11: 0x2ab984f (stale) Mirror 14: 0x2ab984f (stale) Mirror 15: 0x2ab984f (stale) Mirror 16: 0x2ab984f (stale) Mirror 17: 0x2ab984f (stale) Mirror 18: 0x2ab984f (stale) Mirror 20: 0x2ab984f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b97e): Mirror 7: 0x2ab984f (stale) Mirror 11: 0x2ab984f (stale) Mirror 14: 0x2ab984f (stale) Mirror 15: 0x2ab984f (stale) Mirror 16: 0x2ab984f (stale) Mirror 17: 0x2ab984f (stale) Mirror 18: 0x2ab984f (stale) Mirror 20: 0x2ab984f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b97e: skipped 000519 1788310921.950023 trunc from 0x02b97e to 0x010e68 (0x1ab15 bytes) 000520 1788310921.974082 mapread 0x00e27c thru 0x010e68 (0x2bed bytes) 000522 1788310921.999684 mapread 0x00ff18 thru 0x010e68 (0xf51 bytes) 000524 1788310922.002742 mapread 0x00e396 thru 0x010e68 (0x2ad3 bytes) 000526 1788310922.004822 mapread 0x008b24 thru 0x00e466 (0x5943 bytes) 000528 1788310922.015535 trunc from 0x010e69 to 0x004111 (0xcd57 bytes) 000529 1788310922.061597 trunc from 0x004112 to 0x034682 (0x30571 bytes) 000531 1788310922.085819 trunc from 0x034683 to 0x01a46c (0x1a216 bytes) 000532 1788310922.138949 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a46d): Mirror 7: 0xd3e87465 (stale) Mirror 14: 0xd3e87465 (stale) Mirror 15: 0xd3e87465 (stale) Mirror 16: 0xd3e87465 (stale) Mirror 17: 0xd3e87465 (stale) Mirror 18: 0xd3e87465 (stale) Mirror 20: 0xd3e87465 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a46d): Mirror 7: 0xd3e87465 (stale) Mirror 14: 0xd3e87465 (stale) Mirror 15: 0xd3e87465 (stale) Mirror 16: 0xd3e87465 (stale) Mirror 17: 0xd3e87465 (stale) Mirror 18: 0xd3e87465 (stale) Mirror 20: 0xd3e87465 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a46d: skipped 000536 1788310922.772720 mapread 0x013b5a thru 0x01780c (0x3cb3 bytes) 000537 1788310922.804618 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a46d): Mirror 7: 0xd3e87465 (stale) Mirror 14: 0xd3e87465 (stale) Mirror 15: 0xd3e87465 (stale) Mirror 16: 0xd3e87465 (stale) Mirror 17: 0xd3e87465 (stale) Mirror 20: 0xd3e87465 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a46d): Mirror 7: 0xd3e87465 (stale) Mirror 14: 0xd3e87465 (stale) Mirror 15: 0xd3e87465 (stale) Mirror 16: 0xd3e87465 (stale) Mirror 17: 0xd3e87465 (stale) Mirror 20: 0xd3e87465 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a46d: skipped 000538 1788310923.441230 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a46d): Mirror 14: 0xd3e87465 (stale) Mirror 15: 0xd3e87465 (stale) Mirror 16: 0xd3e87465 (stale) Mirror 17: 0xd3e87465 (stale) Mirror 20: 0xd3e87465 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a46d): Mirror 14: 0xd3e87465 (stale) Mirror 15: 0xd3e87465 (stale) Mirror 16: 0xd3e87465 (stale) Mirror 17: 0xd3e87465 (stale) Mirror 20: 0xd3e87465 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a46d: skipped 000539 1788310923.934856 trunc from 0x01a46d to 0x016d1b (0x3751 bytes) 000543 1788310923.985299 mapwrite 0x003152 thru 0x003766 (0x615 bytes) 000544 1788310924.069582 write 0x027d4a thru 0x035ac2 (0xdd79 bytes) 000545 1788310924.074580 mapread 0x03441d thru 0x0356fc (0x12e0 bytes) 000546 1788310924.075673 read 0x0106b8 thru 0x011271 (0xbba bytes) 000547 1788310924.093990 mapwrite 0x010075 thru 0x010b5d (0xae9 bytes) 000548 1788310924.200559 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35ac3): Mirror 15: 0x712e2914 (stale) Mirror 16: 0x712e2914 (stale) Mirror 17: 0x712e2914 (stale) Mirror 20: 0x712e2914 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ac3): Mirror 15: 0x712e2914 (stale) Mirror 16: 0x712e2914 (stale) Mirror 17: 0x712e2914 (stale) Mirror 20: 0x712e2914 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ac3: skipped 000551 1788310924.665805 trunc from 0x035ac3 to 0x0355a0 (0x522 bytes) 000553 1788310924.707523 write 0x03ad23 thru 0x03ffff (0x52dd bytes) 000559 1788310924.720276 MIRROR_RESYNC 5 mirrors 000563 1788310925.949856 write 0x017219 thru 0x01c2b9 (0x50a1 bytes) 000564 1788310926.091793 mapwrite 0x032dc8 thru 0x03e156 (0xb38f bytes) 000566 1788310926.236594 trunc from 0x040000 to 0x03ba9c (0x4563 bytes) 000567 1788310926.275205 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ba9d): Mirror 15: 0x9182a803 (stale) Mirror 16: 0x9182a803 (stale) Mirror 20: 0x9182a803 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba9d): Mirror 15: 0x9182a803 (stale) Mirror 16: 0x9182a803 (stale) Mirror 20: 0x9182a803 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba9d: skipped 000568 1788310926.689851 read 0x02df8c thru 0x0320b0 (0x4125 bytes) 000569 1788310926.702659 read 0x034ad2 thru 0x03ba9c (0x6fcb bytes) 000570 1788310926.717875 mapwrite 0x028d4b thru 0x037239 (0xe4ef bytes) 000571 1788310926.827821 MIRROR_RESYNC 4 mirrors 000573 1788310928.133890 write 0x02b3e3 thru 0x0398ef (0xe50d bytes) 000576 1788310928.305773 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ba9d): Mirror 16: 0xe1222cb1 (stale) Mirror 20: 0xe1222cb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba9d): Mirror 16: 0xe1222cb1 (stale) Mirror 20: 0xe1222cb1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba9d: skipped 000580 1788310928.651658 mapread 0x011bc6 thru 0x01d114 (0xb54f bytes) 000582 1788310928.692444 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ba9d): Mirror 16: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ba9d): Mirror 16: 0xe1222cb1 (stale) Mirror 20: 0xe1222cb1 (stale) CRC-32 checksum value for chunk [0, 0x3ba9d): Mirror 1: 0x542e00aa Mirror 21: 0x542e00aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ba9d: skipped 000584 1788310929.993836 read 0x0210d7 thru 0x02b2a4 (0xa1ce bytes) 000585 1788310930.018717 write 0x014ef1 thru 0x01521d (0x32d bytes) 000586 1788310930.206592 mapwrite 0x02e68d thru 0x030335 (0x1ca9 bytes) 000587 1788310930.296846 trunc from 0x03ba9d to 0x028c07 (0x12e95 bytes) 000588 1788310930.328408 read 0x011eea thru 0x018304 (0x641b bytes) 000589 1788310930.341855 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28c08): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28c08): Mirror 16: 0x233eedc0 (stale) Mirror 20: 0x233eedc0 (stale) Mirror 21: 0x233eedc0 (stale) CRC-32 checksum value for chunk [0, 0x28c08): Mirror 1: 0x266a3f0a Mirror 22: 0x266a3f0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28c08: skipped 000592 1788310931.247971 write 0x00c90c thru 0x00f60b (0x2d00 bytes) 000593 1788310931.350710 mapread 0x00a3a0 thru 0x019632 (0xf293 bytes) 000594 1788310931.376589 write 0x035c07 thru 0x03a8dc (0x4cd6 bytes) 000595 1788310931.383016 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a8dd): Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8dd): Mirror 16: 0x6a0854f5 (stale) Mirror 20: 0x6a0854f5 (stale) Mirror 21: 0x539887f6 (stale) Mirror 22: 0x7096544f (stale) CRC-32 checksum value for chunk [0, 0x3a8dd): Mirror 1: 0x558ad05 Mirror 23: 0x558ad05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8dd: skipped 000596 1788310932.358882 write 0x013a66 thru 0x014a27 (0xfc2 bytes) 000598 1788310932.462226 read 0x008281 thru 0x017c15 (0xf995 bytes) 000600 1788310932.475412 MIRROR_RESYNC 6 mirrors 000601 1788310934.102069 write 0x01fd6e thru 0x02a716 (0xa9a9 bytes) 000602 1788310934.222119 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a8dd): Mirror 16: 0xcd2b32c1 (stale) Mirror 20: 0xcd2b32c1 (stale) Mirror 21: 0xcd2b32c1 (stale) Mirror 23: 0xcd2b32c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8dd): Mirror 16: 0xcd2b32c1 (stale) Mirror 20: 0xcd2b32c1 (stale) Mirror 21: 0xcd2b32c1 (stale) Mirror 23: 0xcd2b32c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8dd: skipped 000603 1788310934.713597 read 0x01a7af thru 0x01af88 (0x7da bytes) 000604 1788310934.719105 read 0x005189 thru 0x00949d (0x4315 bytes) 000605 1788310934.733847 read 0x02e91f thru 0x02e99d (0x7f bytes) 000608 1788310934.737147 read 0x023623 thru 0x029193 (0x5b71 bytes) 000611 1788310934.740604 read 0x00cdc1 thru 0x01c5ae (0xf7ee bytes) 000612 1788310934.742020 read 0x020cf3 thru 0x02421b (0x3529 bytes) 000618 1788310934.761107 write 0x0310c7 thru 0x0319e6 (0x920 bytes) 000619 1788310934.773649 MIRROR_RESYNC 5 mirrors 000620 1788310935.858140 write 0x035752 thru 0x03ffff (0xa8ae bytes) 000622 1788310935.903469 MIRROR_RESYNC 5 mirrors 000623 1788310936.804478 mapwrite 0x016f2c thru 0x01e46a (0x753f bytes) 000625 1788310937.024825 mapread 0x03f2a2 thru 0x03ffff (0xd5e bytes) 000626 1788310937.054596 mapwrite 0x038171 thru 0x03c02e (0x3ebe bytes) 000628 1788310937.144778 read 0x02a40c thru 0x02cae0 (0x26d5 bytes) 000630 1788310937.153745 mapwrite 0x0387ee thru 0x03bf39 (0x374c bytes) 000632 1788310937.208791 mapread 0x033e20 thru 0x03b64d (0x782e bytes) 000635 1788310937.222110 read 0x023726 thru 0x02fc2e (0xc509 bytes) 000636 1788310937.243692 read 0x009c43 thru 0x016afe (0xcebc bytes) 000637 1788310937.244530 read 0x012b57 thru 0x018c40 (0x60ea bytes) 000638 1788310937.245430 read 0x01ec10 thru 0x02de12 (0xf203 bytes) 000639 1788310937.246296 mapread 0x02a5f7 thru 0x031a28 (0x7432 bytes) 000640 1788310937.248440 read 0x00b983 thru 0x00dae6 (0x2164 bytes) 000641 1788310937.249430 mapread 0x02bfe6 thru 0x032e69 (0x6e84 bytes) truncating to largest ever: 0x3f739 000642 1788310937.250839 trunc from 0x040000 to 0x03f738 (0x8c7 bytes) 000643 1788310937.306681 trunc from 0x03f739 to 0x037c92 (0x7aa6 bytes) 000644 1788310937.349646 trunc from 0x037c93 to 0x004477 (0x3381b bytes) 000645 1788310937.405465 trunc from 0x004478 to 0x027117 (0x22ca0 bytes) 000646 1788310937.434822 mapread 0x017e30 thru 0x024e65 (0xd036 bytes) 000649 1788310937.456018 read 0x008baa thru 0x014e6a (0xc2c1 bytes) 000650 1788310937.457255 trunc from 0x027118 to 0x02c230 (0x5119 bytes) 000651 1788310937.493789 mapwrite 0x033c03 thru 0x03b313 (0x7711 bytes) 000652 1788310937.615376 mapwrite 0x0118ee thru 0x012d02 (0x1415 bytes) 000653 1788310937.696750 read 0x00ad7c thru 0x017b94 (0xce19 bytes) 000654 1788310937.697603 mapread 0x01f0a0 thru 0x01fc38 (0xb99 bytes) 000655 1788310937.733403 MIRROR_RESYNC 5 mirrors 000659 1788310938.758546 read 0x0097cf thru 0x00e447 (0x4c79 bytes) 000660 1788310938.770078 mapread 0x00cb4c thru 0x0105b2 (0x3a67 bytes) 000661 1788310938.780811 write 0x03c410 thru 0x03d6d4 (0x12c5 bytes) 000662 1788310938.840435 trunc from 0x03d6d5 to 0x01feb8 (0x1d81c bytes) 000665 1788310938.871459 trunc from 0x01feb9 to 0x00ed32 (0x11186 bytes) 000666 1788310938.897208 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xed33): Mirror 20: 0x4ef5f12d (stale) Mirror 21: 0x4ef5f12d (stale) Mirror 23: 0x4ef5f12d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xed33): Mirror 20: 0x4ef5f12d (stale) Mirror 21: 0x4ef5f12d (stale) Mirror 23: 0x4ef5f12d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xed33: skipped 000667 1788310939.290276 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xed33): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xed33): Mirror 20: 0x4ef5f12d (stale) Mirror 21: 0x4ef5f12d (stale) Mirror 23: 0x4ef5f12d (stale) CRC-32 checksum value for chunk [0, 0xed33): Mirror 1: 0x4ef5f12d Mirror 24: 0x4ef5f12d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xed33: skipped 000671 1788310940.203691 mapread 0x00bd6f thru 0x00dade (0x1d70 bytes) 000673 1788310940.257389 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xed33): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xed33): Mirror 20: 0x4ef5f12d (stale) Mirror 21: 0x4ef5f12d (stale) Mirror 23: 0x4ef5f12d (stale) CRC-32 checksum value for chunk [0, 0xed33): Mirror 1: 0x4ef5f12d Mirror 24: 0x4ef5f12d Mirror 25: 0x4ef5f12d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xed33: skipped 000674 1788310941.397561 mapwrite 0x02213c thru 0x0283da (0x629f bytes) 000676 1788310941.555375 read 0x0037d0 thru 0x00ed0f (0xb540 bytes) 000677 1788310941.562809 write 0x01ab40 thru 0x020a5d (0x5f1e bytes) 000679 1788310941.568364 trunc from 0x0283db to 0x03dfe9 (0x15c0f bytes) 000681 1788310941.596284 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3dfea): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dfea): Mirror 20: 0xd90ae96 (stale) Mirror 21: 0xd90ae96 (stale) Mirror 23: 0xd90ae96 (stale) Mirror 24: 0xfa08401b (stale) Mirror 25: 0xfa08401b (stale) CRC-32 checksum value for chunk [0, 0x3dfea): Mirror 1: 0x51a1b4a4 Mirror 26: 0x51a1b4a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dfea: skipped 000683 1788310942.502827 write 0x03d23a thru 0x03d976 (0x73d bytes) 000684 1788310942.603120 mapwrite 0x00dd19 thru 0x015383 (0x766b bytes) 000689 1788310942.850762 mapwrite 0x00aae1 thru 0x00e34e (0x386e bytes) 000690 1788310942.897729 read 0x031c52 thru 0x033d31 (0x20e0 bytes) 000691 1788310942.906623 mapread 0x013eb3 thru 0x01f324 (0xb472 bytes) 000692 1788310942.924854 read 0x02cb1c thru 0x0359e0 (0x8ec5 bytes) 000694 1788310942.946075 trunc from 0x03dfea to 0x0252e3 (0x18d06 bytes) 000696 1788310942.989375 mapwrite 0x034fd5 thru 0x036ae1 (0x1b0d bytes) 000698 1788310943.063788 read 0x021b62 thru 0x02e17b (0xc61a bytes) 000699 1788310943.074239 read 0x03134c thru 0x032fb4 (0x1c69 bytes) 000700 1788310943.075220 trunc from 0x036ae2 to 0x019526 (0x1d5bb bytes) 000701 1788310943.092943 trunc from 0x019527 to 0x0396eb (0x201c5 bytes) 000703 1788310943.113838 read 0x014b4d thru 0x01755a (0x2a0e bytes) 000708 1788310943.119875 trunc from 0x0396ec to 0x0036f4 (0x35ff7 bytes) 000709 1788310943.136799 mapread 0x0011db thru 0x0036f4 (0x251a bytes) 000711 1788310943.142590 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x36f5): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f5): Mirror 20: 0x879e29ef (stale) Mirror 21: 0x879e29ef (stale) Mirror 23: 0x879e29ef (stale) Mirror 24: 0x879e29ef (stale) Mirror 25: 0x879e29ef (stale) Mirror 26: 0x879e29ef (stale) CRC-32 checksum value for chunk [0, 0x36f5): Mirror 1: 0x879e29ef Mirror 27: 0x879e29ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f5: skipped 000712 1788310943.896779 mapread 0x0003a6 thru 0x0036f4 (0x334f bytes) 000713 1788310943.927471 write 0x012e99 thru 0x01c26a (0x93d2 bytes) 000714 1788310943.996184 read 0x0088fb thru 0x00b5db (0x2ce1 bytes) 000717 1788310944.018892 trunc from 0x01c26b to 0x02cb3e (0x108d4 bytes) 000718 1788310944.078721 mapread 0x01c622 thru 0x01f7f4 (0x31d3 bytes) 000720 1788310944.092474 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2cb3f): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cb3f): Mirror 20: 0xf1fcb929 (stale) Mirror 21: 0xf1fcb929 (stale) Mirror 23: 0xf1fcb929 (stale) Mirror 24: 0xbdf452b0 (stale) Mirror 25: 0xbdf452b0 (stale) Mirror 26: 0xa0d8ba9a (stale) Mirror 27: 0x1fa3e00a (stale) CRC-32 checksum value for chunk [0, 0x2cb3f): Mirror 1: 0xddb96c1a Mirror 28: 0xddb96c1a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cb3f: skipped 000722 1788310945.268156 trunc from 0x02cb3f to 0x031ef8 (0x53ba bytes) 000724 1788310945.379099 read 0x01552c thru 0x0182a5 (0x2d7a bytes) 000725 1788310945.387507 read 0x013d9b thru 0x022ce8 (0xef4e bytes) 000726 1788310945.410161 trunc from 0x031ef9 to 0x0375dc (0x56e4 bytes) 000727 1788310945.428077 trunc from 0x0375dd to 0x000bfe (0x369de bytes) 000729 1788310945.439201 trunc from 0x000bff to 0x03a0d8 (0x394da bytes) 000731 1788310945.455500 trunc from 0x03a0d9 to 0x03ecf2 (0x4c1a bytes) 000732 1788310945.475732 mapread 0x013f62 thru 0x018a96 (0x4b35 bytes) 000733 1788310945.516599 trunc from 0x03ecf3 to 0x02f0d3 (0xfc1f bytes) 000734 1788310945.541811 trunc from 0x02f0d4 to 0x003710 (0x2b9c3 bytes) 000738 1788310945.571628 mapread 0x001b4a thru 0x003710 (0x1bc7 bytes) 000739 1788310945.608773 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3711): Mirror 20: 0x75db888d (stale) Mirror 21: 0x75db888d (stale) Mirror 24: 0x75db888d (stale) Mirror 25: 0x75db888d (stale) Mirror 26: 0x75db888d (stale) Mirror 27: 0xe915333a (stale) Mirror 28: 0xe915333a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3711): Mirror 20: 0x75db888d (stale) Mirror 21: 0x75db888d (stale) Mirror 24: 0x75db888d (stale) Mirror 25: 0x75db888d (stale) Mirror 26: 0x75db888d (stale) Mirror 27: 0xe915333a (stale) Mirror 28: 0xe915333a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3711: skipped 000740 1788310946.023376 write 0x024284 thru 0x027b5e (0x38db bytes) 000742 1788310946.027473 write 0x00a759 thru 0x012081 (0x7929 bytes) 000743 1788310946.037451 mapwrite 0x036b4b thru 0x03ffff (0x94b5 bytes) 000745 1788310946.145739 read 0x005b0a thru 0x00b57c (0x5a73 bytes) 000747 1788310946.159723 write 0x01cdbb thru 0x02272d (0x5973 bytes) 000748 1788310946.173850 read 0x01af9e thru 0x027e98 (0xcefb bytes) 000749 1788310946.183347 mapread 0x00c46c thru 0x016cc4 (0xa859 bytes) 000750 1788310946.191178 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xed956e1e (stale) Mirror 21: 0xed956e1e (stale) Mirror 24: 0xc9f279e3 (stale) Mirror 25: 0xc9f279e3 (stale) Mirror 26: 0xb2171b6f (stale) Mirror 27: 0x17909734 (stale) Mirror 28: 0x17383525 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa6544344 Mirror 29: 0xa6544344 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000751 1788310947.256378 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xed956e1e (stale) Mirror 24: 0xc9f279e3 (stale) Mirror 25: 0xc9f279e3 (stale) Mirror 26: 0xb2171b6f (stale) Mirror 27: 0x17909734 (stale) Mirror 28: 0x17383525 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xed956e1e (stale) Mirror 24: 0xc9f279e3 (stale) Mirror 25: 0xc9f279e3 (stale) Mirror 26: 0xb2171b6f (stale) Mirror 27: 0x17909734 (stale) Mirror 28: 0x17383525 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa6544344 Mirror 29: 0xa6544344 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000752 1788310947.991684 mapread 0x0049b2 thru 0x01444d (0xfa9c bytes) 000756 1788310948.050507 trunc from 0x040000 to 0x01128e (0x2ed71 bytes) 000758 1788310948.118580 trunc from 0x01128f to 0x02b6e2 (0x1a454 bytes) 000764 1788310948.132523 write 0x03ec88 thru 0x03ffff (0x1378 bytes) 000765 1788310948.133753 mapread 0x02453f thru 0x028c85 (0x4747 bytes) 000766 1788310948.151821 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0xc9f279e3 (stale) Mirror 25: 0xc9f279e3 (stale) Mirror 26: 0xb2171b6f (stale) Mirror 27: 0x17909734 (stale) Mirror 28: 0x17383525 (stale) Mirror 29: 0xa6544344 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0xc9f279e3 (stale) Mirror 25: 0xc9f279e3 (stale) Mirror 26: 0xb2171b6f (stale) Mirror 27: 0x17909734 (stale) Mirror 28: 0x17383525 (stale) Mirror 29: 0xa6544344 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000767 1788310948.662359 trunc from 0x040000 to 0x034f21 (0xb0de bytes) 000772 1788310948.721054 read 0x026c44 thru 0x034f21 (0xe2de bytes) 000773 1788310948.742399 mapwrite 0x01c98d thru 0x026f56 (0xa5ca bytes) 000774 1788310948.851605 mapwrite 0x0216cc thru 0x027bf3 (0x6528 bytes) 000776 1788310948.899127 mapwrite 0x0138f2 thru 0x01c5fd (0x8d0c bytes) 000777 1788310948.979687 read 0x0341cf thru 0x034f21 (0xd53 bytes) 000779 1788310948.981051 write 0x02250c thru 0x0276e7 (0x51dc bytes) 000780 1788310948.983059 write 0x01fb45 thru 0x023a0a (0x3ec6 bytes) 000782 1788310948.985723 mapwrite 0x02d6f8 thru 0x039c6b (0xc574 bytes) 000783 1788310949.122361 write 0x016419 thru 0x020855 (0xa43d bytes) 000785 1788310949.125613 write 0x01e81a thru 0x02203c (0x3823 bytes) 000787 1788310949.128737 mapread 0x028522 thru 0x02a60b (0x20ea bytes) 000788 1788310949.130136 trunc from 0x039c6c to 0x0198a0 (0x203cb bytes) 000789 1788310949.179105 write 0x000f25 thru 0x00a074 (0x9150 bytes) 000790 1788310949.180307 trunc from 0x0198a1 to 0x003794 (0x1610c bytes) 000793 1788310949.227482 write 0x03e293 thru 0x03ffff (0x1d6d bytes) 000795 1788310949.229174 mapread 0x03b3a0 thru 0x03fb66 (0x47c7 bytes) 000798 1788310949.255864 write 0x039ccd thru 0x03ffff (0x6333 bytes) 000800 1788310949.272077 trunc from 0x040000 to 0x025f70 (0x1a08f bytes) 000802 1788310949.290550 trunc from 0x025f71 to 0x0158d6 (0x1069a bytes) 000803 1788310949.332230 read 0x007f67 thru 0x0158d6 (0xd970 bytes) 000806 1788310949.345475 mapread 0x00532c thru 0x00e21e (0x8ef3 bytes) 000807 1788310949.347339 trunc from 0x0158d7 to 0x022ca9 (0xd3d3 bytes) 000808 1788310949.362444 mapwrite 0x00ec28 thru 0x01c90b (0xdce4 bytes) 000809 1788310949.490505 mapwrite 0x0336c6 thru 0x03bf9c (0x88d7 bytes) 000810 1788310949.626224 read 0x011134 thru 0x020b01 (0xf9ce bytes) 000811 1788310949.627394 trunc from 0x03bf9d to 0x03d566 (0x15ca bytes) 000812 1788310949.670557 trunc from 0x03d567 to 0x016b96 (0x269d0 bytes) 000815 1788310949.706040 mapwrite 0x0264fa thru 0x027bfd (0x1704 bytes) 000817 1788310949.789686 write 0x028917 thru 0x0345a9 (0xbc93 bytes) 000821 1788310949.801543 trunc from 0x0345aa to 0x028e62 (0xb747 bytes) 000823 1788310949.829113 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28e63): Mirror 24: 0xc182eeb7 (stale) Mirror 26: 0xdef22465 (stale) Mirror 27: 0x215b0ef7 (stale) Mirror 28: 0x81d3642e (stale) Mirror 29: 0x50417ca3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28e63): Mirror 24: 0xc182eeb7 (stale) Mirror 26: 0xdef22465 (stale) Mirror 27: 0x215b0ef7 (stale) Mirror 28: 0x81d3642e (stale) Mirror 29: 0x50417ca3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28e63: skipped 000824 1788310950.206717 write 0x01f9c4 thru 0x02d8c4 (0xdf01 bytes) 000825 1788310950.214111 mapwrite 0x024a3b thru 0x032ac2 (0xe088 bytes) 000829 1788310950.295784 read 0x0083ef thru 0x009dba (0x19cc bytes) 000831 1788310950.302380 mapread 0x006c24 thru 0x00eff7 (0x83d4 bytes) 000832 1788310950.315109 trunc from 0x032ac3 to 0x00cb67 (0x25f5b bytes) 000833 1788310950.351129 write 0x025d45 thru 0x02bbbc (0x5e78 bytes) 000834 1788310950.352389 write 0x00fd98 thru 0x0139d9 (0x3c42 bytes) 000835 1788310950.362741 write 0x0052e9 thru 0x00c402 (0x711a bytes) 000836 1788310950.364171 write 0x0329ce thru 0x03d9e5 (0xb018 bytes) 000837 1788310950.368829 trunc from 0x03d9e6 to 0x039381 (0x4664 bytes) 000838 1788310950.385692 trunc from 0x039382 to 0x02708f (0x122f2 bytes) 000840 1788310950.407286 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x27090): Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27090): Mirror 24: 0x14132322 (stale) Mirror 26: 0xb0f5163d (stale) Mirror 27: 0x85d7b5af (stale) Mirror 28: 0x91c1d0e2 (stale) Mirror 29: 0x4a5fc7ba (stale) CRC-32 checksum value for chunk [0, 0x27090): Mirror 1: 0x4582ca78 Mirror 30: 0x4582ca78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27090: skipped 000842 1788310951.191314 trunc from 0x027090 to 0x03e758 (0x176c9 bytes) 000843 1788310951.279004 read 0x020fa1 thru 0x028748 (0x77a8 bytes) 000845 1788310951.289627 trunc from 0x03e759 to 0x03bd9d (0x29bb bytes) 000846 1788310951.303518 MIRROR_RESYNC 7 mirrors 000847 1788310952.654892 mapread 0x029631 thru 0x03588c (0xc25c bytes) 000848 1788310952.679384 mapwrite 0x02ed9a thru 0x035a86 (0x6ced bytes) 000849 1788310952.870137 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3bd9e): Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bd9e): Mirror 24: 0x5eeb6b46 (stale) Mirror 26: 0x5eeb6b46 (stale) Mirror 27: 0x5eeb6b46 (stale) Mirror 28: 0x5eeb6b46 (stale) Mirror 29: 0x5eeb6b46 (stale) Mirror 30: 0x5eeb6b46 (stale) CRC-32 checksum value for chunk [0, 0x3bd9e): Mirror 1: 0x58414836 Mirror 31: 0x58414836 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bd9e: skipped 000850 1788310954.283344 mapwrite 0x0104b1 thru 0x014e0a (0x495a bytes) 000851 1788310954.663376 read 0x020ae0 thru 0x02f71f (0xec40 bytes) 000854 1788310954.679839 write 0x000ea8 thru 0x00f920 (0xea79 bytes) 000856 1788310954.692481 read 0x01155f thru 0x020f8a (0xfa2c bytes) 000857 1788310954.723356 write 0x031c11 thru 0x035332 (0x3722 bytes) 000859 1788310954.733306 mapwrite 0x0002d2 thru 0x0082ee (0x801d bytes) 000860 1788310954.789368 write 0x003aa7 thru 0x012556 (0xeab0 bytes) 000861 1788310954.792569 mapread 0x009201 thru 0x00c938 (0x3738 bytes) 000862 1788310954.793875 trunc from 0x03bd9e to 0x00d7ba (0x2e5e3 bytes) 000864 1788310954.830474 read 0x003bb4 thru 0x004e0f (0x125c bytes) 000865 1788310954.831730 mapwrite 0x02f777 thru 0x038a81 (0x930b bytes) 000866 1788310954.944432 write 0x0060f9 thru 0x00ce2d (0x6d35 bytes) 000867 1788310954.945619 mapwrite 0x036d41 thru 0x03d47e (0x673e bytes) 000868 1788310955.107762 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 24: 0xb305e470 (stale) Mirror 26: 0xb305e470 (stale) Mirror 27: 0xb305e470 (stale) Mirror 28: 0xb305e470 (stale) Mirror 30: 0xb305e470 (stale) Mirror 31: 0xbd72bd2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 24: 0xb305e470 (stale) Mirror 26: 0xb305e470 (stale) Mirror 27: 0xb305e470 (stale) Mirror 28: 0xb305e470 (stale) Mirror 30: 0xb305e470 (stale) Mirror 31: 0xbd72bd2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d47f: skipped 000869 1788310955.620547 mapwrite 0x02ca68 thru 0x030252 (0x37eb bytes) 000871 1788310955.686443 mapwrite 0x02b15f thru 0x0339af (0x8851 bytes) 000874 1788310955.778036 mapwrite 0x00a9fb thru 0x0108f2 (0x5ef8 bytes) 000876 1788310955.839244 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 26: 0xb305e470 (stale) Mirror 27: 0xb305e470 (stale) Mirror 28: 0xb305e470 (stale) Mirror 30: 0xb305e470 (stale) Mirror 31: 0xbd72bd2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 26: 0xb305e470 (stale) Mirror 27: 0xb305e470 (stale) Mirror 28: 0xb305e470 (stale) Mirror 30: 0xb305e470 (stale) Mirror 31: 0xbd72bd2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d47f: skipped 000878 1788310956.325221 read 0x02e953 thru 0x03a4e9 (0xbb97 bytes) 000879 1788310956.340559 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 26: 0xb305e470 (stale) Mirror 27: 0xb305e470 (stale) Mirror 28: 0xb305e470 (stale) Mirror 30: 0xb305e470 (stale) Mirror 31: 0xbd72bd2e (stale) CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 1: 0x198a2acf Mirror 32: 0x198a2acf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d47f: skipped 000880 1788310957.288544 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 26: 0xb305e470 (stale) Mirror 27: 0xb305e470 (stale) Mirror 28: 0xb305e470 (stale) Mirror 30: 0xb305e470 (stale) Mirror 31: 0xbd72bd2e (stale) CRC-32 checksum value for chunk [0, 0x3d47f): Mirror 1: 0x198a2acf Mirror 32: 0x198a2acf Mirror 33: 0x198a2acf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d47f: skipped 000883 1788310958.345184 trunc from 0x03d47f to 0x0358ee (0x7b90 bytes) 000884 1788310958.444845 mapread 0x002cbb thru 0x007ee2 (0x5228 bytes) 000885 1788310958.476679 trunc from 0x0358ef to 0x009b1d (0x2bdd1 bytes) 000886 1788310958.520792 read 0x0054bb thru 0x009b1d (0x4663 bytes) 000890 1788310958.530514 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9b1e): Mirror 27: 0x9a58d2dd (stale) Mirror 28: 0x9a58d2dd (stale) Mirror 30: 0x9a58d2dd (stale) Mirror 31: 0x9a58d2dd (stale) Mirror 32: 0x20abf558 (stale) Mirror 33: 0x20abf558 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9b1e): Mirror 27: 0x9a58d2dd (stale) Mirror 28: 0x9a58d2dd (stale) Mirror 30: 0x9a58d2dd (stale) Mirror 31: 0x9a58d2dd (stale) Mirror 32: 0x20abf558 (stale) Mirror 33: 0x20abf558 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9b1e: skipped 000893 1788310959.155327 trunc from 0x009b1e to 0x03f5f6 (0x35ad9 bytes) 000894 1788310959.179408 write 0x034f5f thru 0x03bcf6 (0x6d98 bytes) 000895 1788310959.195546 trunc from 0x03f5f7 to 0x001939 (0x3dcbd bytes) 000896 1788310959.216889 trunc from 0x00193a to 0x00e933 (0xcffa bytes) 000897 1788310959.254866 MIRROR_RESYNC 7 mirrors 000898 1788310960.752300 trunc from 0x00e934 to 0x01e1c9 (0xf896 bytes) 000899 1788310960.859634 mapread 0x013d53 thru 0x01e1c9 (0xa477 bytes) 000901 1788310960.888419 read 0x012863 thru 0x012b4f (0x2ed bytes) 000902 1788310960.889465 trunc from 0x01e1ca to 0x00f373 (0xee56 bytes) 000904 1788310960.921361 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf374): Mirror 27: 0x8350fdf6 (stale) Mirror 28: 0x8350fdf6 (stale) Mirror 30: 0x8350fdf6 (stale) Mirror 31: 0x8350fdf6 (stale) Mirror 33: 0x8350fdf6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf374): Mirror 27: 0x8350fdf6 (stale) Mirror 28: 0x8350fdf6 (stale) Mirror 30: 0x8350fdf6 (stale) Mirror 31: 0x8350fdf6 (stale) Mirror 33: 0x8350fdf6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf374: skipped 000905 1788310961.390536 mapread 0x00c4c8 thru 0x00f373 (0x2eac bytes) 000909 1788310961.416405 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xf374): Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf374): Mirror 27: 0x8350fdf6 (stale) Mirror 28: 0x8350fdf6 (stale) Mirror 30: 0x8350fdf6 (stale) Mirror 31: 0x8350fdf6 (stale) Mirror 33: 0x8350fdf6 (stale) CRC-32 checksum value for chunk [0, 0xf374): Mirror 1: 0x8350fdf6 Mirror 34: 0x8350fdf6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf374: skipped 000910 1788310962.647275 mapread 0x0085c2 thru 0x00f373 (0x6db2 bytes) 000911 1788310962.690810 read 0x00d569 thru 0x00f373 (0x1e0b bytes) 000914 1788310962.716782 read 0x001bae thru 0x00f373 (0xd7c6 bytes) 000915 1788310962.730092 mapread 0x009ac3 thru 0x00c2c0 (0x27fe bytes) 000916 1788310962.748868 mapread 0x003169 thru 0x0097a8 (0x6640 bytes) 000918 1788310962.778434 mapread 0x0099e8 thru 0x00f373 (0x598c bytes) 000919 1788310962.792204 mapread 0x0037be thru 0x00c121 (0x8964 bytes) 000920 1788310962.807388 read 0x003562 thru 0x00a732 (0x71d1 bytes) 000921 1788310962.818433 read 0x00643c thru 0x007f7c (0x1b41 bytes) 000923 1788310962.848938 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0xf374): Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf374): Mirror 27: 0x8350fdf6 (stale) Mirror 28: 0x8350fdf6 (stale) Mirror 30: 0x8350fdf6 (stale) Mirror 31: 0x8350fdf6 (stale) Mirror 33: 0x8350fdf6 (stale) CRC-32 checksum value for chunk [0, 0xf374): Mirror 1: 0x8350fdf6 Mirror 34: 0x8350fdf6 Mirror 35: 0x8350fdf6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf374: skipped 000924 1788310963.923498 read 0x00c07e thru 0x00f373 (0x32f6 bytes) 000925 1788310963.936641 mapwrite 0x024971 thru 0x030026 (0xb6b6 bytes) 000927 1788310964.114275 MIRROR_RESYNC 8 mirrors 000931 1788310965.740432 mapread 0x005529 thru 0x0065d4 (0x10ac bytes) 000934 1788310965.766458 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1ab:0x0]: Invalid argument (22) 000937 1788310966.171631 read 0x00068b thru 0x00e202 (0xdb78 bytes) 000940 1788310966.190304 read 0x02a39e thru 0x02a722 (0x385 bytes) 000945 1788310966.201563 mapread 0x01401c thru 0x017a8a (0x3a6f bytes) 000946 1788310966.204502 write 0x016554 thru 0x01e62f (0x80dc bytes) 000948 1788310966.290838 mapread 0x012da4 thru 0x018498 (0x56f5 bytes) 000949 1788310966.322665 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x30027): Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30027): Mirror 27: 0x7c5eb4bd (stale) Mirror 28: 0x7c5eb4bd (stale) Mirror 30: 0x7c5eb4bd (stale) Mirror 31: 0x7c5eb4bd (stale) Mirror 34: 0x7c5eb4bd (stale) Mirror 35: 0x7c5eb4bd (stale) CRC-32 checksum value for chunk [0, 0x30027): Mirror 1: 0x75255d1c Mirror 36: 0x75255d1c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30027: skipped 000951 1788310967.343495 write 0x03258c thru 0x036fb8 (0x4a2d bytes) 000953 1788310967.498008 write 0x026a5e thru 0x02cfce (0x6571 bytes) 000954 1788310967.513282 trunc from 0x036fb9 to 0x018ffb (0x1dfbd bytes) 000956 1788310967.587539 mapwrite 0x03029a thru 0x03dd1b (0xda82 bytes) 000957 1788310967.763761 write 0x01362f thru 0x0190db (0x5aad bytes) 000958 1788310967.792574 mapwrite 0x01bd51 thru 0x024b3e (0x8dee bytes) 000959 1788310967.894541 read 0x039a9d thru 0x03dd1b (0x427f bytes) 000961 1788310967.895586 mapwrite 0x01e90f thru 0x02667d (0x7d6f bytes) 000962 1788310967.990861 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3dd1c): Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd1c): Mirror 27: 0x79cadb4a (stale) Mirror 28: 0x79cadb4a (stale) Mirror 30: 0x79cadb4a (stale) Mirror 31: 0x79cadb4a (stale) Mirror 34: 0x79cadb4a (stale) Mirror 35: 0x79cadb4a (stale) Mirror 36: 0x54868ee6 (stale) CRC-32 checksum value for chunk [0, 0x3dd1c): Mirror 1: 0x6d8db3e9 Mirror 37: 0x6d8db3e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd1c: skipped 000963 1788310969.239879 mapread 0x002cb5 thru 0x00bf48 (0x9294 bytes) 000964 1788310969.279404 mapwrite 0x003834 thru 0x009eea (0x66b7 bytes) 000968 1788310969.554035 trunc from 0x03dd1c to 0x01708c (0x26c8f bytes) 000969 1788310969.584420 trunc from 0x01708d to 0x025289 (0xe1fd bytes) 000972 1788310969.610220 trunc from 0x02528a to 0x0382cf (0x13046 bytes) 000973 1788310969.633827 read 0x0019c4 thru 0x00af15 (0x9552 bytes) 000974 1788310969.636106 write 0x03d39d thru 0x03f31f (0x1f83 bytes) 000975 1788310969.638112 mapread 0x00dcf4 thru 0x011da6 (0x40b3 bytes) 000976 1788310969.650680 write 0x02edd5 thru 0x030be8 (0x1e14 bytes) 000977 1788310969.667542 read 0x024232 thru 0x025038 (0xe07 bytes) 000978 1788310969.692716 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f320): Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f320): Mirror 27: 0xb451bbd6 (stale) Mirror 28: 0xb451bbd6 (stale) Mirror 30: 0xb451bbd6 (stale) Mirror 31: 0xb451bbd6 (stale) Mirror 34: 0xb451bbd6 (stale) Mirror 35: 0xb451bbd6 (stale) Mirror 36: 0x5bbef82c (stale) Mirror 37: 0x211690df (stale) CRC-32 checksum value for chunk [0, 0x3f320): Mirror 1: 0x1dd74148 Mirror 38: 0x1dd74148 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f320: skipped 000980 1788310970.859114 trunc from 0x03f320 to 0x03afb2 (0x436d bytes) 000985 1788310970.934619 write 0x0254ba thru 0x026e6c (0x19b3 bytes) 000986 1788310970.957015 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3afb3): Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afb3): Mirror 27: 0xabfcd1bd (stale) Mirror 28: 0xabfcd1bd (stale) Mirror 30: 0xabfcd1bd (stale) Mirror 31: 0xabfcd1bd (stale) Mirror 34: 0xabfcd1bd (stale) Mirror 35: 0xabfcd1bd (stale) Mirror 36: 0xe70e4b8f (stale) Mirror 37: 0x498a9c9b (stale) Mirror 38: 0x266fdd1b (stale) CRC-32 checksum value for chunk [0, 0x3afb3): Mirror 1: 0xa95e5f23 Mirror 39: 0xa95e5f23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afb3: skipped 000987 1788310972.132553 trunc from 0x03afb3 to 0x017d57 (0x2325b bytes) 000988 1788310972.251823 mapread 0x0077bd thru 0x00b82e (0x4072 bytes) 000992 1788310972.309087 trunc from 0x017d58 to 0x0094d2 (0xe885 bytes) 000993 1788310972.345420 mapwrite 0x03cbe2 thru 0x03ffff (0x341e bytes) 000994 1788310972.462738 mapwrite 0x00d6b9 thru 0x01af0b (0xd853 bytes) 000995 1788310972.546263 read 0x039f7e thru 0x03ffff (0x6082 bytes) 000997 1788310972.552509 trunc from 0x040000 to 0x03add9 (0x5226 bytes) 000998 1788310972.573237 mapread 0x00114a thru 0x007371 (0x6228 bytes) 000999 1788310972.581117 mapwrite 0x03ed8f thru 0x03ffff (0x1271 bytes) All operations completed A-OK!