== sanity-flr test 70a: flr mode fsx test ================ 17:48:21 (1788212901) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 2903 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1788212904.138588 write 0x017ddc thru 0x01acac (0x2ed1 bytes) 000003 1788212904.152918 mapread 0x0065e2 thru 0x00c7cc (0x61eb bytes) 000005 1788212904.192707 MIRROR_EXTEND to 2 mirrors 000006 1788212905.125214 mapwrite 0x03c026 thru 0x03ffff (0x3fda bytes) 000007 1788212905.344276 mapwrite 0x03e2d9 thru 0x03ffff (0x1d27 bytes) truncating to largest ever: 0x3ce59 000008 1788212905.443081 trunc from 0x040000 to 0x03ce58 (0x31a7 bytes) 000009 1788212905.465632 mapread 0x0023cb thru 0x0090d8 (0x6d0e bytes) 000010 1788212905.481473 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ce59): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce59): Mirror 2: 0x820055f2 (stale) CRC-32 checksum value for chunk [0, 0x3ce59): Mirror 1: 0x198ea3a4 Mirror 3: 0x198ea3a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce59: skipped 000011 1788212906.755505 mapwrite 0x01362e thru 0x015102 (0x1ad5 bytes) 000015 1788212907.025686 MIRROR_RESYNC 3 mirrors 000016 1788212908.249307 mapread 0x00c1db thru 0x013d0b (0x7b31 bytes) 000018 1788212908.265516 read 0x001b54 thru 0x006be1 (0x508e bytes) 000019 1788212908.273013 read 0x015c85 thru 0x01fb41 (0x9ebd bytes) 000021 1788212908.313042 trunc from 0x03ce59 to 0x035acb (0x738d bytes) 000022 1788212908.426046 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35acc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35acc): Mirror 2: 0xafda69ad (stale) Mirror 3: 0xafda69ad (stale) CRC-32 checksum value for chunk [0, 0x35acc): Mirror 1: 0xafda69ad Mirror 4: 0xafda69ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35acc: skipped 000023 1788212909.413668 mapread 0x001634 thru 0x003116 (0x1ae3 bytes) 000025 1788212909.431407 trunc from 0x035acc to 0x01cf4d (0x18b7e bytes) 000026 1788212909.516746 write 0x0288d4 thru 0x029201 (0x92e bytes) 000030 1788212909.520480 write 0x03671e thru 0x03ffff (0x98e2 bytes) 000031 1788212909.526253 MIRROR_RESYNC 4 mirrors 000032 1788212911.204157 read 0x03a867 thru 0x03c930 (0x20ca bytes) 000041 1788212911.222784 MIRROR_RESYNC 4 mirrors 000044 1788212911.629804 trunc from 0x040000 to 0x03b082 (0x4f7d bytes) 000045 1788212911.714438 write 0x03ec74 thru 0x03ffff (0x138c bytes) 000046 1788212911.715907 write 0x02ea92 thru 0x03a95b (0xbeca bytes) 000047 1788212911.727578 mapwrite 0x01d8fc thru 0x0258b4 (0x7fb9 bytes) 000048 1788212911.801453 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa003a91f (stale) Mirror 3: 0xa003a91f (stale) Mirror 4: 0xa003a91f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfc0a4474 Mirror 5: 0xfc0a4474 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000050 1788212913.121789 mapread 0x03b5e6 thru 0x03e54a (0x2f65 bytes) 000052 1788212913.217794 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa003a91f (stale) Mirror 3: 0xa003a91f (stale) Mirror 4: 0xa003a91f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfc0a4474 Mirror 5: 0xfc0a4474 Mirror 6: 0xfc0a4474 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000053 1788212914.727253 write 0x036c2a thru 0x03ffff (0x93d6 bytes) 000056 1788212914.862947 read 0x0300de thru 0x03925a (0x917d bytes) 000057 1788212914.871766 read 0x03cc76 thru 0x03ffff (0x338a bytes) 000060 1788212914.884214 MIRROR_RESYNC 6 mirrors 000061 1788212916.359220 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) 000063 1788212916.941418 read 0x025d10 thru 0x02c540 (0x6831 bytes) 000065 1788212916.969569 mapread 0x005142 thru 0x0074ee (0x23ad bytes) 000066 1788212916.998902 mapread 0x0236e2 thru 0x0332f4 (0xfc13 bytes) 000067 1788212917.040143 write 0x00d77e thru 0x00f06e (0x18f1 bytes) 000068 1788212917.140433 write 0x00ba36 thru 0x01a736 (0xed01 bytes) 000070 1788212917.150593 mapread 0x004569 thru 0x00af96 (0x6a2e bytes) 000071 1788212917.158971 mapread 0x015438 thru 0x022dbe (0xd987 bytes) 000072 1788212917.169820 trunc from 0x040000 to 0x02246b (0x1db94 bytes) 000073 1788212917.189309 trunc from 0x02246c to 0x002a99 (0x1f9d2 bytes) 000076 1788212917.208453 mapwrite 0x03fedf thru 0x03ffff (0x121 bytes) 000077 1788212917.284518 mapwrite 0x0051be thru 0x00a18d (0x4fd0 bytes) 000078 1788212917.344121 trunc from 0x040000 to 0x01c937 (0x236c8 bytes) 000079 1788212917.363459 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1c938): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c938): Mirror 3: 0xa398e0e8 (stale) Mirror 4: 0xa398e0e8 (stale) Mirror 5: 0xa398e0e8 (stale) Mirror 6: 0xa398e0e8 (stale) CRC-32 checksum value for chunk [0, 0x1c938): Mirror 1: 0xa1786752 Mirror 7: 0xa1786752 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c938: skipped 000080 1788212918.486774 trunc from 0x01c938 to 0x011fcc (0xa96b bytes) 000082 1788212918.592509 read 0x0030c3 thru 0x00eb45 (0xba83 bytes) 000083 1788212918.604384 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11fcd): Mirror 3: 0x46b80775 (stale) Mirror 5: 0x46b80775 (stale) Mirror 6: 0x46b80775 (stale) Mirror 7: 0x1387e9d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11fcd): Mirror 3: 0x46b80775 (stale) Mirror 5: 0x46b80775 (stale) Mirror 6: 0x46b80775 (stale) Mirror 7: 0x1387e9d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11fcd: skipped 000084 1788212918.959475 trunc from 0x011fcd to 0x014413 (0x2447 bytes) 000085 1788212919.003529 read 0x01342d thru 0x014413 (0xfe7 bytes) 000086 1788212919.012038 read 0x010ed4 thru 0x014413 (0x3540 bytes) 000087 1788212919.019807 mapwrite 0x035a2c thru 0x03ffff (0xa5d4 bytes) 000089 1788212919.097250 trunc from 0x040000 to 0x001cad (0x3e352 bytes) 000090 1788212919.119763 mapread 0x000831 thru 0x001cad (0x147d bytes) 000092 1788212919.126433 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1cae): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cae): Mirror 3: 0xa2051dca (stale) Mirror 5: 0xa2051dca (stale) Mirror 6: 0xa2051dca (stale) Mirror 7: 0xa2051dca (stale) CRC-32 checksum value for chunk [0, 0x1cae): Mirror 1: 0xa2051dca Mirror 8: 0xa2051dca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cae: skipped 000097 1788212920.008563 trunc from 0x001cae to 0x03bc54 (0x39fa7 bytes) 000098 1788212920.114415 trunc from 0x03bc55 to 0x022208 (0x19a4c bytes) 000102 1788212920.160691 read 0x01b0e7 thru 0x01df5d (0x2e77 bytes) 000104 1788212920.180473 write 0x003caa thru 0x009ab8 (0x5e0f bytes) 000105 1788212920.203658 read 0x013d3e thru 0x01d65e (0x9921 bytes) 000106 1788212920.218402 read 0x004f2e thru 0x0056de (0x7b1 bytes) 000109 1788212920.223406 read 0x010858 thru 0x0185fc (0x7da5 bytes) 000110 1788212920.224177 trunc from 0x022209 to 0x01e607 (0x3c01 bytes) 000113 1788212920.260261 write 0x02d7fa thru 0x03bafe (0xe305 bytes) 000115 1788212920.280857 mapwrite 0x03339a thru 0x03ffff (0xcc66 bytes) 000116 1788212920.406503 read 0x02e43a thru 0x03df13 (0xfada bytes) 000117 1788212920.407830 mapwrite 0x038728 thru 0x03c44e (0x3d27 bytes) 000119 1788212920.487301 trunc from 0x040000 to 0x02f0b3 (0x10f4c bytes) 000121 1788212920.525322 mapread 0x0069e6 thru 0x014f9b (0xe5b6 bytes) 000123 1788212920.528202 write 0x00c848 thru 0x016499 (0x9c52 bytes) 000124 1788212920.530885 mapread 0x00e28b thru 0x016f4b (0x8cc1 bytes) 000126 1788212920.533561 read 0x01eea7 thru 0x022594 (0x36ee bytes) 000131 1788212920.547738 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2f0b4): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f0b4): Mirror 3: 0x9d2fff30 (stale) Mirror 5: 0x9d2fff30 (stale) Mirror 6: 0x9d2fff30 (stale) Mirror 7: 0xef5bdf79 (stale) Mirror 8: 0x7859fba9 (stale) CRC-32 checksum value for chunk [0, 0x2f0b4): Mirror 1: 0x2ab5bc3 Mirror 9: 0x2ab5bc3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f0b4: skipped 000135 1788212921.370391 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f0b4): Mirror 3: 0x9d2fff30 (stale) Mirror 6: 0x9d2fff30 (stale) Mirror 7: 0xef5bdf79 (stale) Mirror 8: 0x7859fba9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f0b4): Mirror 3: 0x9d2fff30 (stale) Mirror 6: 0x9d2fff30 (stale) Mirror 7: 0xef5bdf79 (stale) Mirror 8: 0x7859fba9 (stale) CRC-32 checksum value for chunk [0, 0x2f0b4): Mirror 1: 0x2ab5bc3 Mirror 9: 0x2ab5bc3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f0b4: skipped 000136 1788212922.312604 mapread 0x007e5d thru 0x00b20d (0x33b1 bytes) 000137 1788212922.360923 trunc from 0x02f0b4 to 0x01b2fc (0x13db7 bytes) 000142 1788212922.503438 write 0x024c15 thru 0x028c9d (0x4089 bytes) 000149 1788212922.512573 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x28c9e): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28c9e): Mirror 3: 0x1c8d251f (stale) Mirror 6: 0x1c8d251f (stale) Mirror 7: 0x2d1f417e (stale) Mirror 8: 0xed855543 (stale) Mirror 9: 0xcea2c555 (stale) CRC-32 checksum value for chunk [0, 0x28c9e): Mirror 1: 0x4fca5721 Mirror 10: 0x4fca5721 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28c9e: skipped 000150 1788212923.645832 mapwrite 0x02b2af thru 0x0302f8 (0x504a bytes) 000151 1788212923.833331 read 0x01d5d0 thru 0x026e23 (0x9854 bytes) 000152 1788212923.841929 mapwrite 0x00965a thru 0x0150ab (0xba52 bytes) 000158 1788212923.910186 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x302f9): Mirror 3: 0x5970be68 (stale) Mirror 7: 0x50bd7bf (stale) Mirror 8: 0x37197829 (stale) Mirror 9: 0xe54946ab (stale) Mirror 10: 0xaa1d1995 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x302f9): Mirror 3: 0x5970be68 (stale) Mirror 7: 0x50bd7bf (stale) Mirror 8: 0x37197829 (stale) Mirror 9: 0xe54946ab (stale) Mirror 10: 0xaa1d1995 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x302f9: skipped 000161 1788212924.382785 mapread 0x0291e9 thru 0x0302f8 (0x7110 bytes) 000164 1788212924.405511 read 0x026ef9 thru 0x0302f8 (0x9400 bytes) 000166 1788212924.408167 mapwrite 0x00500c thru 0x012656 (0xd64b bytes) 000167 1788212924.612144 trunc from 0x0302f9 to 0x03c480 (0xc188 bytes) 000168 1788212924.652799 trunc from 0x03c481 to 0x007c60 (0x34820 bytes) 000169 1788212924.699522 mapread 0x004160 thru 0x007146 (0x2fe7 bytes) 000170 1788212924.701479 read 0x004fb2 thru 0x005e6b (0xeba bytes) 000172 1788212924.717466 mapread 0x004651 thru 0x007c60 (0x3610 bytes) 000173 1788212924.725972 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x7c61): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7c61): Mirror 3: 0xe4c39eeb (stale) Mirror 7: 0x9590d639 (stale) Mirror 8: 0xe4c39eeb (stale) Mirror 9: 0x7312f006 (stale) Mirror 10: 0x7312f006 (stale) CRC-32 checksum value for chunk [0, 0x7c61): Mirror 1: 0x90998ea2 Mirror 11: 0x90998ea2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7c61: skipped 000174 1788212925.924791 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7c61): Mirror 7: 0x9590d639 (stale) Mirror 8: 0xe4c39eeb (stale) Mirror 9: 0x7312f006 (stale) Mirror 10: 0x7312f006 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7c61): Mirror 7: 0x9590d639 (stale) Mirror 8: 0xe4c39eeb (stale) Mirror 9: 0x7312f006 (stale) Mirror 10: 0x7312f006 (stale) CRC-32 checksum value for chunk [0, 0x7c61): Mirror 1: 0x90998ea2 Mirror 11: 0x90998ea2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7c61: skipped 000176 1788212926.665719 trunc from 0x007c61 to 0x035d1a (0x2e0ba bytes) 000177 1788212926.818408 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35d1b): Mirror 8: 0xb9c626b2 (stale) Mirror 9: 0x54cc61eb (stale) Mirror 10: 0x3672778e (stale) Mirror 11: 0x4367a4a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d1b): Mirror 8: 0xb9c626b2 (stale) Mirror 9: 0x54cc61eb (stale) Mirror 10: 0x3672778e (stale) Mirror 11: 0x4367a4a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d1b: skipped 000181 1788212927.384922 mapread 0x019cdd thru 0x0262c4 (0xc5e8 bytes) 000182 1788212927.424547 mapread 0x02c30b thru 0x035d1a (0x9a10 bytes) 000183 1788212927.439838 trunc from 0x035d1b to 0x018a25 (0x1d2f5 bytes) 000184 1788212927.471235 mapwrite 0x013be8 thru 0x015890 (0x1ca9 bytes) 000186 1788212927.559655 read 0x015a52 thru 0x018a25 (0x2fd4 bytes) 000190 1788212927.586495 write 0x01bbba thru 0x020f9f (0x53e6 bytes) 000191 1788212927.592011 mapwrite 0x03bd4e thru 0x03ffff (0x42b2 bytes) 000192 1788212927.676202 write 0x00c8b3 thru 0x01826e (0xb9bc bytes) 000193 1788212927.677945 mapread 0x03e9cc thru 0x03ffff (0x1634 bytes) 000195 1788212927.679978 mapread 0x03ddd4 thru 0x03ffff (0x222c bytes) 000196 1788212927.681157 trunc from 0x040000 to 0x01f098 (0x20f67 bytes) 000197 1788212927.697131 mapwrite 0x03b271 thru 0x03ffff (0x4d8f bytes) 000200 1788212927.779209 trunc from 0x040000 to 0x009c0d (0x363f2 bytes) 000203 1788212927.795279 trunc from 0x009c0e to 0x0321f8 (0x285eb bytes) 000206 1788212927.816576 mapwrite 0x011ffb thru 0x01c67e (0xa684 bytes) 000208 1788212927.943851 mapread 0x003db6 thru 0x00691c (0x2b67 bytes) 000210 1788212927.954675 write 0x00003f thru 0x00742f (0x73f1 bytes) 000212 1788212927.961467 read 0x0226f3 thru 0x02e8fd (0xc20b bytes) 000213 1788212927.992910 MIRROR_RESYNC 5 mirrors 000214 1788212930.182333 mapwrite 0x026831 thru 0x0335c3 (0xcd93 bytes) 000215 1788212930.413432 write 0x03957e thru 0x03ffff (0x6a82 bytes) 000216 1788212930.415514 read 0x018374 thru 0x02830b (0xff98 bytes) 000218 1788212930.431417 MIRROR_RESYNC 5 mirrors 000221 1788212932.543956 mapread 0x0098ab thru 0x00b58b (0x1ce1 bytes) 000224 1788212932.567617 read 0x01ad1d thru 0x02442c (0x9710 bytes) 000227 1788212932.601035 MIRROR_EXTEND to 6 mirrors 000228 1788212933.575680 trunc from 0x040000 to 0x004b91 (0x3b46e bytes) 000229 1788212933.666139 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x4b92): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4b92): Mirror 8: 0x749da16a (stale) Mirror 9: 0x749da16a (stale) Mirror 10: 0x749da16a (stale) Mirror 11: 0x749da16a (stale) Mirror 12: 0x749da16a (stale) CRC-32 checksum value for chunk [0, 0x4b92): Mirror 1: 0x749da16a Mirror 13: 0x749da16a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4b92: skipped 000230 1788212934.928010 read 0x002f80 thru 0x004b91 (0x1c12 bytes) 000235 1788212934.944473 write 0x034f2a thru 0x03ce23 (0x7efa bytes) 000236 1788212935.077994 mapread 0x0013e6 thru 0x00b018 (0x9c33 bytes) 000239 1788212935.113657 mapwrite 0x00471e thru 0x011572 (0xce55 bytes) 000240 1788212935.239481 read 0x01ad04 thru 0x024ffe (0xa2fb bytes) 000243 1788212935.252860 write 0x030c23 thru 0x036c77 (0x6055 bytes) 000244 1788212935.264118 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ce24): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce24): Mirror 8: 0xda0738d2 (stale) Mirror 9: 0xda0738d2 (stale) Mirror 10: 0xda0738d2 (stale) Mirror 11: 0xda0738d2 (stale) Mirror 12: 0xda0738d2 (stale) Mirror 13: 0x102baf0a (stale) CRC-32 checksum value for chunk [0, 0x3ce24): Mirror 1: 0x70972606 Mirror 14: 0x70972606 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce24: skipped 000245 1788212936.548407 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ce24): Mirror 8: 0xda0738d2 (stale) Mirror 9: 0xda0738d2 (stale) Mirror 10: 0xda0738d2 (stale) Mirror 11: 0xda0738d2 (stale) Mirror 12: 0xda0738d2 (stale) Mirror 13: 0x102baf0a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce24): Mirror 8: 0xda0738d2 (stale) Mirror 9: 0xda0738d2 (stale) Mirror 10: 0xda0738d2 (stale) Mirror 11: 0xda0738d2 (stale) Mirror 12: 0xda0738d2 (stale) Mirror 13: 0x102baf0a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce24: skipped 000246 1788212937.156399 read 0x0269f6 thru 0x02cdbf (0x63ca bytes) 000248 1788212937.174779 MIRROR_RESYNC 7 mirrors 000249 1788212938.963458 mapread 0x01d245 thru 0x02af3c (0xdcf8 bytes) 000251 1788212939.031051 trunc from 0x03ce24 to 0x01ecaf (0x1e174 bytes) 000252 1788212939.147410 mapread 0x00c403 thru 0x01311e (0x6d1c bytes) 000254 1788212939.159260 mapwrite 0x02faa4 thru 0x03f240 (0xf79d bytes) 000257 1788212939.268879 mapwrite 0x0392af thru 0x03ffff (0x6d51 bytes) 000258 1788212939.354643 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x53a58a9d (stale) Mirror 10: 0x53a58a9d (stale) Mirror 11: 0x53a58a9d (stale) Mirror 12: 0x53a58a9d (stale) Mirror 13: 0x53a58a9d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x53a58a9d (stale) Mirror 10: 0x53a58a9d (stale) Mirror 11: 0x53a58a9d (stale) Mirror 12: 0x53a58a9d (stale) Mirror 13: 0x53a58a9d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000259 1788212939.778499 read 0x03a46e thru 0x03c4f2 (0x2085 bytes) 000260 1788212939.783853 mapread 0x02f9c1 thru 0x03d17c (0xd7bc bytes) 000262 1788212939.810143 MIRROR_RESYNC 6 mirrors 000263 1788212941.049328 read 0x00e892 thru 0x015fa9 (0x7718 bytes) 000264 1788212941.061920 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) 000265 1788212941.439693 trunc from 0x040000 to 0x03b7aa (0x4855 bytes) 000267 1788212941.516242 write 0x03a682 thru 0x03c4f9 (0x1e78 bytes) 000268 1788212941.525670 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c4fa): Mirror 9: 0x305d2aa2 (stale) Mirror 10: 0x305d2aa2 (stale) Mirror 13: 0x305d2aa2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c4fa): Mirror 9: 0x305d2aa2 (stale) Mirror 10: 0x305d2aa2 (stale) Mirror 13: 0x305d2aa2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c4fa: skipped 000269 1788212941.858570 mapread 0x00a066 thru 0x015062 (0xaffd bytes) 000270 1788212941.884355 write 0x03a25b thru 0x03cf30 (0x2cd6 bytes) 000276 1788212941.895115 trunc from 0x03cf31 to 0x03144a (0xbae6 bytes) 000278 1788212941.916550 write 0x020a5c thru 0x024b8e (0x4133 bytes) 000279 1788212941.927404 write 0x02ae32 thru 0x031dd2 (0x6fa1 bytes) 000280 1788212941.936016 mapread 0x0184d7 thru 0x02082f (0x8359 bytes) 000281 1788212941.941689 mapread 0x021af1 thru 0x027869 (0x5d79 bytes) 000283 1788212941.944177 mapwrite 0x01a599 thru 0x01b9cf (0x1437 bytes) 000284 1788212942.017146 mapread 0x002df3 thru 0x010ee8 (0xe0f6 bytes) 000286 1788212942.029786 read 0x00c5ce thru 0x01bed9 (0xf90c bytes) 000287 1788212942.037409 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31dd3): Mirror 10: 0xe3f44c37 (stale) Mirror 13: 0xe3f44c37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31dd3): Mirror 10: 0xe3f44c37 (stale) Mirror 13: 0xe3f44c37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31dd3: skipped 000288 1788212942.405002 write 0x03ca9c thru 0x03ffff (0x3564 bytes) 000289 1788212942.412550 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xfedd4df (stale) Mirror 13: 0xfedd4df (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe6ea73e0 Mirror 14: 0xe6ea73e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000290 1788212943.611665 write 0x00be70 thru 0x016c59 (0xadea bytes) 000291 1788212943.711007 mapread 0x0137a1 thru 0x01cb9d (0x93fd bytes) 000292 1788212943.733779 MIRROR_RESYNC 4 mirrors 000293 1788212945.531786 mapwrite 0x02b04c thru 0x02edcd (0x3d82 bytes) 000294 1788212945.716817 trunc from 0x040000 to 0x0135d3 (0x2ca2c bytes) 000295 1788212945.741713 read 0x000dec thru 0x00255c (0x1771 bytes) 000296 1788212945.747575 read 0x0011ad thru 0x003f67 (0x2dbb bytes) 000297 1788212945.755115 mapread 0x00a60b thru 0x00dbf7 (0x35ed bytes) 000299 1788212945.759607 MIRROR_RESYNC 4 mirrors 000301 1788212946.517478 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) 000302 1788212946.808564 trunc from 0x0135d4 to 0x01e863 (0xb290 bytes) 000305 1788212946.899195 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e864): Mirror 13: 0xa7776353 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e864): Mirror 13: 0xa7776353 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e864: skipped 000307 1788212947.242003 read 0x013e84 thru 0x01bf91 (0x810e bytes) 000312 1788212947.256084 mapread 0x001da7 thru 0x010853 (0xeaad bytes) 000313 1788212947.282254 read 0x01e6ed thru 0x01e863 (0x177 bytes) 000315 1788212947.296240 mapread 0x00d4c8 thru 0x018743 (0xb27c bytes) 000317 1788212947.301147 mapwrite 0x006300 thru 0x00bbbf (0x58c0 bytes) 000318 1788212947.442860 MIRROR_RESYNC 2 mirrors 000320 1788212948.124966 MIRROR_EXTEND to 3 mirrors 000321 1788212949.066322 trunc from 0x01e864 to 0x00c045 (0x1281e bytes) 000327 1788212949.134714 mapwrite 0x01afad thru 0x02195a (0x69ae bytes) 000329 1788212949.297816 write 0x03adc8 thru 0x03ffff (0x5238 bytes) 000331 1788212949.301358 read 0x03de3f thru 0x03f5da (0x179c bytes) 000334 1788212949.315712 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x40e4390f (stale) Mirror 14: 0x40e4390f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xab5ad72b Mirror 15: 0xab5ad72b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000336 1788212950.340955 read 0x01b6d3 thru 0x02b3dc (0xfd0a bytes) 000337 1788212950.356871 trunc from 0x040000 to 0x03ab31 (0x54ce bytes) 000338 1788212950.463765 write 0x0115b5 thru 0x020c56 (0xf6a2 bytes) 000339 1788212950.476149 mapread 0x0355ee thru 0x03ab31 (0x5544 bytes) 000340 1788212950.495906 trunc from 0x03ab32 to 0x00f74e (0x2b3e3 bytes) 000342 1788212950.524885 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf74f): Mirror 14: 0x2b591273 (stale) Mirror 15: 0xa788f0c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf74f): Mirror 14: 0x2b591273 (stale) Mirror 15: 0xa788f0c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf74f: skipped 000343 1788212950.841434 mapwrite 0x00496e thru 0x00b73d (0x6dd0 bytes) 000345 1788212950.908373 read 0x0017cf thru 0x00f74e (0xdf80 bytes) 000346 1788212950.912437 MIRROR_RESYNC 3 mirrors 000347 1788212951.755239 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) 000350 1788212952.118593 mapwrite 0x01a7d5 thru 0x027d69 (0xd595 bytes) 000351 1788212952.319637 write 0x0271d2 thru 0x02f058 (0x7e87 bytes) 000352 1788212952.321926 read 0x01830b thru 0x01aa67 (0x275d bytes) 000354 1788212952.323950 mapread 0x00bb29 thru 0x01455f (0x8a37 bytes) 000356 1788212952.345897 trunc from 0x02f059 to 0x03732b (0x82d3 bytes) 000357 1788212952.370305 mapread 0x0311b2 thru 0x034997 (0x37e6 bytes) 000358 1788212952.378001 trunc from 0x03732c to 0x022277 (0x150b4 bytes) 000359 1788212952.393939 mapwrite 0x025abb thru 0x026123 (0x669 bytes) 000360 1788212952.464600 mapread 0x0001a9 thru 0x00731f (0x7177 bytes) 000361 1788212952.472319 mapread 0x00a6eb thru 0x00fd3c (0x5652 bytes) 000362 1788212952.473249 mapwrite 0x019f2d thru 0x026eaa (0xcf7e bytes) 000363 1788212952.544499 read 0x00f66d thru 0x016209 (0x6b9d bytes) 000364 1788212952.545872 read 0x024537 thru 0x026eaa (0x2974 bytes) 000365 1788212952.551023 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) 000366 1788212952.676902 write 0x00b584 thru 0x018050 (0xcacd bytes) 000367 1788212952.692661 mapread 0x004d99 thru 0x010b0a (0xbd72 bytes) 000368 1788212952.716982 mapwrite 0x0125f5 thru 0x01cc17 (0xa623 bytes) 000369 1788212952.813961 mapread 0x00060b thru 0x010383 (0xfd79 bytes) 000372 1788212952.834194 write 0x001ac2 thru 0x0099be (0x7efd bytes) 000375 1788212952.843373 MIRROR_EXTEND to 2 mirrors 000376 1788212953.539812 write 0x02cb0f thru 0x02f59d (0x2a8f bytes) 000380 1788212953.634911 trunc from 0x02f59e to 0x01613f (0x1945e bytes) 000382 1788212953.658897 mapwrite 0x00e069 thru 0x00ef19 (0xeb1 bytes) 000383 1788212953.720810 trunc from 0x016140 to 0x0047e0 (0x1195f bytes) 000384 1788212953.752023 read 0x001cf9 thru 0x0047e0 (0x2ae8 bytes) 000386 1788212953.761954 write 0x00d7ab thru 0x01c53e (0xed94 bytes) 000388 1788212953.784185 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) 000390 1788212953.989869 write 0x017767 thru 0x01dba0 (0x643a bytes) 000395 1788212954.003768 read 0x00a8f4 thru 0x00e266 (0x3973 bytes) 000397 1788212954.015962 trunc from 0x01dba1 to 0x03c1de (0x1e63e bytes) 000399 1788212954.038500 write 0x01dd60 thru 0x021bd9 (0x3e7a bytes) 000400 1788212954.048884 mapread 0x03a5ce thru 0x03c1de (0x1c11 bytes) 000401 1788212954.062650 write 0x021174 thru 0x02296e (0x17fb bytes) 000406 1788212954.074641 mapread 0x005668 thru 0x01324a (0xdbe3 bytes) 000407 1788212954.099939 read 0x012b7c thru 0x0189f5 (0x5e7a bytes) 000409 1788212954.102031 write 0x036f3f thru 0x03f6f0 (0x87b2 bytes) 000410 1788212954.104048 write 0x03909a thru 0x03ba3a (0x29a1 bytes) 000411 1788212954.105865 read 0x00ea60 thru 0x019023 (0xa5c4 bytes) 000412 1788212954.107247 mapread 0x0254b9 thru 0x0272d3 (0x1e1b bytes) 000416 1788212954.111735 read 0x017f4b thru 0x023945 (0xb9fb bytes) 000417 1788212954.112870 mapwrite 0x017553 thru 0x01ac89 (0x3737 bytes) 000418 1788212954.187883 write 0x0315ab thru 0x0338ff (0x2355 bytes) 000419 1788212954.197765 trunc from 0x03f6f1 to 0x02e4c6 (0x1122a bytes) truncating to largest ever: 0x3e71c 000420 1788212954.243631 trunc from 0x02e4c7 to 0x03e71b (0x10255 bytes) 000424 1788212954.260852 read 0x03bf4f thru 0x03e71b (0x27cd bytes) 000425 1788212954.270729 read 0x02f3af thru 0x031eeb (0x2b3d bytes) 000426 1788212954.275148 MIRROR_EXTEND to 2 mirrors 000429 1788212955.098146 mapread 0x02891d thru 0x02b9f9 (0x30dd bytes) 000430 1788212955.116830 write 0x035c6c thru 0x03c96f (0x6d04 bytes) 000432 1788212955.191277 mapwrite 0x03a24b thru 0x03ffff (0x5db5 bytes) 000433 1788212955.313846 read 0x028b77 thru 0x02e2ef (0x5779 bytes) 000435 1788212955.330704 mapwrite 0x0279c1 thru 0x02bfb5 (0x45f5 bytes) 000436 1788212955.432441 mapwrite 0x013e38 thru 0x01be80 (0x8049 bytes) 000438 1788212955.504325 read 0x012885 thru 0x01f964 (0xd0e0 bytes) 000439 1788212955.515231 mapwrite 0x013307 thru 0x018342 (0x503c bytes) 000441 1788212955.585725 mapread 0x029767 thru 0x029f2a (0x7c4 bytes) 000444 1788212955.595109 mapread 0x02649f thru 0x03427d (0xdddf bytes) 000447 1788212955.604278 read 0x018f85 thru 0x026adc (0xdb58 bytes) 000451 1788212955.606452 mapwrite 0x03a925 thru 0x03ffff (0x56db bytes) 000452 1788212955.670813 trunc from 0x040000 to 0x03d427 (0x2bd8 bytes) 000454 1788212955.715385 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) 000456 1788212955.876325 mapread 0x025489 thru 0x033d5b (0xe8d3 bytes) 000458 1788212955.901782 write 0x00c55e thru 0x017cf2 (0xb795 bytes) 000460 1788212955.911670 write 0x02d986 thru 0x02de23 (0x49e bytes) 000462 1788212955.912931 trunc from 0x03d428 to 0x019c72 (0x237b5 bytes) 000463 1788212955.933554 trunc from 0x019c73 to 0x019df6 (0x184 bytes) 000465 1788212955.954401 mapwrite 0x037c80 thru 0x03ffff (0x8380 bytes) 000466 1788212956.022399 trunc from 0x040000 to 0x00b2a9 (0x34d56 bytes) 000468 1788212956.039514 trunc from 0x00b2aa to 0x00d249 (0x1fa0 bytes) 000469 1788212956.053698 mapwrite 0x03f4bb thru 0x03ffff (0xb45 bytes) 000470 1788212956.116018 read 0x0351a2 thru 0x039234 (0x4093 bytes) 000472 1788212956.124240 mapwrite 0x03754d thru 0x0388e5 (0x1399 bytes) 000480 1788212956.175673 mapwrite 0x035768 thru 0x036627 (0xec0 bytes) 000481 1788212956.215672 trunc from 0x040000 to 0x00248c (0x3db73 bytes) 000482 1788212956.228408 read 0x0015cf thru 0x00248c (0xebe bytes) 000484 1788212956.234845 mapread 0x00125d thru 0x0020be (0xe62 bytes) 000485 1788212956.236659 write 0x02ae61 thru 0x02f3b0 (0x4550 bytes) 000489 1788212956.239375 mapwrite 0x0298e4 thru 0x0305d0 (0x6ced bytes) 000493 1788212956.303293 trunc from 0x0305d1 to 0x0109b7 (0x1fc19 bytes) 000494 1788212956.324775 write 0x006949 thru 0x00fad4 (0x918c bytes) 000495 1788212956.326046 mapwrite 0x03708d thru 0x03d633 (0x65a7 bytes) 000496 1788212956.405542 read 0x011d8a thru 0x01abb4 (0x8e2b bytes) 000499 1788212956.415201 mapread 0x02ca8c thru 0x02ff95 (0x350a bytes) 000501 1788212956.416865 write 0x02b2da thru 0x0363e6 (0xb10d bytes) 000502 1788212956.418430 mapwrite 0x036a42 thru 0x03ffff (0x95be bytes) 000503 1788212956.482620 mapwrite 0x030c5d thru 0x0353d4 (0x4778 bytes) 000504 1788212956.518760 mapread 0x022526 thru 0x0228d3 (0x3ae bytes) 000505 1788212956.519561 mapwrite 0x010bd0 thru 0x013d03 (0x3134 bytes) 000506 1788212956.554618 trunc from 0x040000 to 0x025dc0 (0x1a23f bytes) 000509 1788212956.572105 mapwrite 0x03368a thru 0x03c6fa (0x9071 bytes) 000511 1788212956.712909 read 0x01e361 thru 0x02c469 (0xe109 bytes) 000512 1788212956.721810 trunc from 0x03c6fb to 0x0086d7 (0x34023 bytes) 000514 1788212956.747505 read 0x005bb3 thru 0x0086d7 (0x2b25 bytes) 000515 1788212956.748601 mapwrite 0x02a52a thru 0x02b927 (0x13fe bytes) 000517 1788212956.862038 mapwrite 0x02fec5 thru 0x03632d (0x6469 bytes) 000519 1788212956.962704 MIRROR_EXTEND to 2 mirrors 000520 1788212957.779359 mapwrite 0x02f20d thru 0x03cb91 (0xd985 bytes) 000521 1788212957.960987 trunc from 0x03cb92 to 0x00d083 (0x2fb0e bytes) 000523 1788212957.992623 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xd084): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd084): Mirror 2: 0x994fb92c (stale) CRC-32 checksum value for chunk [0, 0xd084): Mirror 1: 0x994fb92c Mirror 3: 0x994fb92c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd084: skipped 000524 1788212958.979147 trunc from 0x00d084 to 0x012389 (0x5306 bytes) 000525 1788212959.056527 trunc from 0x01238a to 0x031b4f (0x1f7c6 bytes) 000527 1788212959.083054 write 0x0332d6 thru 0x03fdd5 (0xcb00 bytes) 000528 1788212959.085717 write 0x012252 thru 0x02134b (0xf0fa bytes) 000531 1788212959.096272 mapwrite 0x01ec56 thru 0x0282c1 (0x966c bytes) 000534 1788212959.175329 trunc from 0x03fdd6 to 0x000702 (0x3f6d3 bytes) 000535 1788212959.192145 mapwrite 0x036549 thru 0x03b7c2 (0x527a bytes) 000536 1788212959.284640 mapwrite 0x0013d9 thru 0x008456 (0x707e bytes) 000538 1788212959.356402 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b7c3): Mirror 3: 0xfc058ac1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7c3): Mirror 3: 0xfc058ac1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7c3: skipped 000539 1788212959.666153 write 0x03d7d8 thru 0x03fb4d (0x2376 bytes) 000540 1788212959.672468 read 0x023a7d thru 0x02e8c8 (0xae4c bytes) 000541 1788212959.686849 read 0x00671d thru 0x0084fd (0x1de1 bytes) 000542 1788212959.704743 mapread 0x01c861 thru 0x023044 (0x67e4 bytes) 000545 1788212959.707480 trunc from 0x03fb4e to 0x00363c (0x3c511 bytes) 000546 1788212959.735596 mapread 0x002308 thru 0x00363c (0x1335 bytes) 000548 1788212959.739253 mapread 0x0035f4 thru 0x00363c (0x49 bytes) 000549 1788212959.740732 mapwrite 0x03b810 thru 0x03ffff (0x47f0 bytes) 000551 1788212959.883472 trunc from 0x040000 to 0x02abb3 (0x1544c bytes) 000554 1788212959.904454 mapread 0x00312f thru 0x00b094 (0x7f66 bytes) 000556 1788212959.952865 read 0x009dd6 thru 0x016b7f (0xcdaa bytes) 000558 1788212959.971733 write 0x033ea1 thru 0x036019 (0x2179 bytes) 000560 1788212959.975695 mapwrite 0x03cd76 thru 0x03ffff (0x328a bytes) 000561 1788212960.054471 mapwrite 0x0204dc thru 0x029406 (0x8f2b bytes) 000562 1788212960.141588 mapwrite 0x009d7f thru 0x00c8de (0x2b60 bytes) 000563 1788212960.205268 trunc from 0x040000 to 0x00a1b4 (0x35e4b bytes) 000565 1788212960.228732 MIRROR_RESYNC 2 mirrors 000566 1788212961.017421 mapwrite 0x021588 thru 0x02b901 (0xa37a bytes) 000567 1788212961.136164 mapread 0x01a2f8 thru 0x0220d7 (0x7de0 bytes) 000568 1788212961.143260 mapread 0x0114e7 thru 0x01a866 (0x9380 bytes) 000569 1788212961.151253 trunc from 0x02b902 to 0x006125 (0x257dc bytes) 000570 1788212961.167754 write 0x032355 thru 0x03e136 (0xbde2 bytes) 000571 1788212961.172469 mapread 0x00cb56 thru 0x00f976 (0x2e21 bytes) 000573 1788212961.182100 mapread 0x033010 thru 0x036cef (0x3ce0 bytes) 000577 1788212961.184792 read 0x034c1a thru 0x03e136 (0x951d bytes) 000578 1788212961.185711 read 0x00e1b0 thru 0x01bc1f (0xda70 bytes) 000579 1788212961.194254 mapwrite 0x0399ab thru 0x03ffff (0x6655 bytes) 000581 1788212961.275555 write 0x037b67 thru 0x03a220 (0x26ba bytes) 000582 1788212961.281388 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb99940c5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6d4d2437 Mirror 4: 0x6d4d2437 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000584 1788212962.290110 mapwrite 0x02c7ea thru 0x03b071 (0xe888 bytes) 000585 1788212962.528135 mapwrite 0x001ed0 thru 0x002139 (0x26a bytes) 000586 1788212962.588297 mapwrite 0x005218 thru 0x0149d2 (0xf7bb bytes) 000588 1788212962.643834 mapwrite 0x00301b thru 0x00f28f (0xc275 bytes) 000590 1788212962.692220 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb99940c5 (stale) Mirror 4: 0x6d4d2437 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcf3c2e33 Mirror 5: 0xcf3c2e33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000591 1788212963.536607 read 0x00667c thru 0x00fca3 (0x9628 bytes) 000592 1788212963.544778 read 0x02b32f thru 0x0328d2 (0x75a4 bytes) 000593 1788212963.553798 read 0x02fc24 thru 0x038cb7 (0x9094 bytes) 000594 1788212963.555125 mapwrite 0x030938 thru 0x03b401 (0xaaca bytes) 000596 1788212963.787423 trunc from 0x040000 to 0x027e99 (0x18166 bytes) 000601 1788212963.873113 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27e9a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27e9a): Mirror 3: 0x7e6ac959 (stale) Mirror 4: 0x344301f5 (stale) Mirror 5: 0xdcbd584f (stale) CRC-32 checksum value for chunk [0, 0x27e9a): Mirror 1: 0xdcbd584f Mirror 6: 0xdcbd584f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27e9a: skipped 000602 1788212964.865161 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x27e9a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27e9a): Mirror 3: 0x7e6ac959 (stale) Mirror 4: 0x344301f5 (stale) Mirror 5: 0xdcbd584f (stale) CRC-32 checksum value for chunk [0, 0x27e9a): Mirror 1: 0xdcbd584f Mirror 6: 0xdcbd584f Mirror 7: 0xdcbd584f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27e9a: skipped 000603 1788212965.934177 MIRROR_RESYNC 6 mirrors 000604 1788212966.996972 trunc from 0x027e9a to 0x029c8c (0x1df3 bytes) 000606 1788212967.065595 read 0x0087c1 thru 0x00d362 (0x4ba2 bytes) 000607 1788212967.073408 read 0x0292ba thru 0x029622 (0x369 bytes) 000608 1788212967.087335 MIRROR_RESYNC 6 mirrors 000611 1788212968.290487 mapwrite 0x035a86 thru 0x03ffff (0xa57a bytes) 000612 1788212968.481301 MIRROR_RESYNC 6 mirrors 000613 1788212969.984549 MIRROR_RESYNC 6 mirrors 000615 1788212970.473832 read 0x03a8b6 thru 0x03f850 (0x4f9b bytes) 000617 1788212970.488806 MIRROR_RESYNC 6 mirrors 000620 1788212970.890446 MIRROR_EXTEND to 7 mirrors 000622 1788212971.592807 mapread 0x001079 thru 0x00a8c1 (0x9849 bytes) 000623 1788212971.609049 write 0x015195 thru 0x01e135 (0x8fa1 bytes) 000624 1788212971.702370 trunc from 0x040000 to 0x024ee0 (0x1b11f bytes) 000626 1788212971.728034 write 0x02e347 thru 0x03c2b4 (0xdf6e bytes) 000629 1788212971.732714 read 0x02de43 thru 0x033769 (0x5927 bytes) 000631 1788212971.739056 trunc from 0x03c2b5 to 0x03bdaa (0x50a bytes) 000633 1788212971.757268 mapread 0x028e5e thru 0x03242b (0x95ce bytes) 000637 1788212971.768040 trunc from 0x03bdab to 0x0210eb (0x1acbf bytes) 000639 1788212971.786273 mapwrite 0x00f57e thru 0x0190ef (0x9b72 bytes) 000640 1788212971.847298 write 0x02569b thru 0x02c58b (0x6ef1 bytes) 000641 1788212971.848601 trunc from 0x02c58c to 0x014008 (0x18583 bytes) 000642 1788212971.866646 mapread 0x010cdc thru 0x014008 (0x332d bytes) 000643 1788212971.867888 read 0x0014e6 thru 0x008f42 (0x7a5d bytes) 000644 1788212971.883887 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x14009): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14009): Mirror 3: 0x38728d41 (stale) Mirror 4: 0x38728d41 (stale) Mirror 5: 0x38728d41 (stale) Mirror 6: 0x38728d41 (stale) Mirror 7: 0x38728d41 (stale) Mirror 8: 0x38728d41 (stale) CRC-32 checksum value for chunk [0, 0x14009): Mirror 1: 0x41c2a096 Mirror 9: 0x41c2a096 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14009: skipped 000646 1788212972.736651 mapread 0x011ff1 thru 0x014008 (0x2018 bytes) 000647 1788212972.767571 write 0x01c7b2 thru 0x0228da (0x6129 bytes) 000648 1788212972.845156 mapwrite 0x028fad thru 0x033eb1 (0xaf05 bytes) 000650 1788212972.959820 write 0x007604 thru 0x013a20 (0xc41d bytes) 000651 1788212972.975906 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33eb2): Mirror 3: 0xb1e99f07 (stale) Mirror 4: 0xb1e99f07 (stale) Mirror 6: 0xb1e99f07 (stale) Mirror 7: 0xb1e99f07 (stale) Mirror 8: 0xb1e99f07 (stale) Mirror 9: 0xff09b177 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33eb2): Mirror 3: 0xb1e99f07 (stale) Mirror 4: 0xb1e99f07 (stale) Mirror 6: 0xb1e99f07 (stale) Mirror 7: 0xb1e99f07 (stale) Mirror 8: 0xb1e99f07 (stale) Mirror 9: 0xff09b177 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33eb2: skipped 000652 1788212973.532025 trunc from 0x033eb2 to 0x00e4be (0x259f3 bytes) 000654 1788212973.556497 trunc from 0x00e4bf to 0x03ad61 (0x2c8a3 bytes) 000655 1788212973.571184 write 0x024a76 thru 0x034453 (0xf9de bytes) 000656 1788212973.581980 read 0x0006f8 thru 0x00bb55 (0xb45e bytes) 000657 1788212973.587805 mapwrite 0x02cb7a thru 0x034030 (0x74b7 bytes) 000658 1788212973.630360 write 0x03b033 thru 0x03c293 (0x1261 bytes) 000659 1788212973.631677 trunc from 0x03c294 to 0x028ab6 (0x137dd bytes) 000660 1788212973.645887 mapread 0x019f21 thru 0x01a7b7 (0x897 bytes) 000662 1788212973.658789 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28ab7): Mirror 3: 0x630d5ba (stale) Mirror 4: 0x630d5ba (stale) Mirror 7: 0x630d5ba (stale) Mirror 8: 0x630d5ba (stale) Mirror 9: 0xeb420941 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28ab7): Mirror 3: 0x630d5ba (stale) Mirror 4: 0x630d5ba (stale) Mirror 7: 0x630d5ba (stale) Mirror 8: 0x630d5ba (stale) Mirror 9: 0xeb420941 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28ab7: skipped 000663 1788212974.019001 mapwrite 0x02d351 thru 0x03adac (0xda5c bytes) 000665 1788212974.117488 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3adad): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3adad): Mirror 3: 0xedba337f (stale) Mirror 4: 0xedba337f (stale) Mirror 7: 0xedba337f (stale) Mirror 8: 0xedba337f (stale) Mirror 9: 0x1b4e2ba7 (stale) CRC-32 checksum value for chunk [0, 0x3adad): Mirror 1: 0x41c3be18 Mirror 10: 0x41c3be18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3adad: skipped 000666 1788212975.242023 mapread 0x02049f thru 0x0215dc (0x113e bytes) 000667 1788212975.251517 write 0x0086fa thru 0x01597a (0xd281 bytes) 000668 1788212975.355928 mapwrite 0x028930 thru 0x036421 (0xdaf2 bytes) 000669 1788212975.430894 MIRROR_RESYNC 7 mirrors 000670 1788212977.193452 read 0x0017ae thru 0x00583d (0x4090 bytes) 000674 1788212977.207845 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) 000675 1788212977.569023 mapread 0x01d839 thru 0x0269da (0x91a2 bytes) 000676 1788212977.602300 mapwrite 0x019168 thru 0x028091 (0xef2a bytes) 000677 1788212977.826048 trunc from 0x03adad to 0x01c18d (0x1ec1f bytes) 000678 1788212977.863438 write 0x032f1e thru 0x03ffff (0xd0e2 bytes) 000680 1788212977.869981 write 0x03a237 thru 0x03ffff (0x5dc9 bytes) 000681 1788212977.872315 mapread 0x01e7c7 thru 0x029070 (0xa8aa bytes) 000682 1788212977.910385 write 0x03d9c4 thru 0x03ffff (0x263c bytes) 000683 1788212977.911705 trunc from 0x040000 to 0x026feb (0x19014 bytes) 000685 1788212977.956443 trunc from 0x026fec to 0x03ae0d (0x13e22 bytes) 000687 1788212977.995837 mapwrite 0x02fd97 thru 0x03ec38 (0xeea2 bytes) 000690 1788212978.170329 trunc from 0x03ec39 to 0x0244db (0x1a75d bytes) 000691 1788212978.200842 read 0x01c81f thru 0x0244db (0x7cbd bytes) 000693 1788212978.201981 mapwrite 0x0280c2 thru 0x02b6a6 (0x35e5 bytes) 000696 1788212978.330875 write 0x02e255 thru 0x0375cf (0x937b bytes) 000699 1788212978.339944 read 0x02aff3 thru 0x02ff26 (0x4f34 bytes) 000700 1788212978.356945 mapread 0x01a75a thru 0x028339 (0xdbe0 bytes) 000705 1788212978.365159 read 0x00e446 thru 0x01deb9 (0xfa74 bytes) 000706 1788212978.365797 read 0x02996d thru 0x0375cf (0xdc63 bytes) 000707 1788212978.376263 MIRROR_RESYNC 6 mirrors 000708 1788212979.811446 mapwrite 0x0316d8 thru 0x03ffff (0xe928 bytes) 000710 1788212980.009551 read 0x00f928 thru 0x01e908 (0xefe1 bytes) 000713 1788212980.027770 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4a852119 (stale) Mirror 7: 0x4a852119 (stale) Mirror 8: 0x4a852119 (stale) Mirror 9: 0x4a852119 (stale) Mirror 10: 0x4a852119 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe3ccdafb Mirror 11: 0xe3ccdafb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000714 1788212980.950081 mapread 0x038ff5 thru 0x03ffff (0x700b bytes) 000715 1788212980.986970 write 0x01b07a thru 0x02a6c8 (0xf64f bytes) 000718 1788212981.086293 trunc from 0x040000 to 0x00e10f (0x31ef0 bytes) 000719 1788212981.119679 read 0x0062ce thru 0x0079ee (0x1721 bytes) 000720 1788212981.131580 read 0x003fde thru 0x00c98c (0x89af bytes) truncating to largest ever: 0x3f3e5 000722 1788212981.144673 trunc from 0x00e110 to 0x03f3e4 (0x312d5 bytes) 000724 1788212981.159527 trunc from 0x03f3e5 to 0x01952c (0x25eb8 bytes) 000725 1788212981.174858 mapread 0x01861e thru 0x01865e (0x41 bytes) 000727 1788212981.185082 mapread 0x0180b5 thru 0x01952c (0x1478 bytes) 000728 1788212981.186218 mapwrite 0x0095f8 thru 0x010fa4 (0x79ad bytes) 000729 1788212981.241001 mapread 0x0048d5 thru 0x00533a (0xa66 bytes) 000731 1788212981.242368 trunc from 0x01952d to 0x025c06 (0xc6da bytes) 000732 1788212981.258393 mapwrite 0x008c18 thru 0x014ea8 (0xc291 bytes) 000733 1788212981.303173 trunc from 0x025c07 to 0x006b93 (0x1f073 bytes) 000738 1788212981.323791 mapwrite 0x0087b5 thru 0x0092ee (0xb3a bytes) 000739 1788212981.409777 mapread 0x003c97 thru 0x00673c (0x2aa6 bytes) 000740 1788212981.419881 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x92ef): Mirror 3: 0xef54adf2 (stale) Mirror 7: 0xef54adf2 (stale) Mirror 8: 0xef54adf2 (stale) Mirror 10: 0xef54adf2 (stale) Mirror 11: 0xef54adf2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x92ef): Mirror 3: 0xef54adf2 (stale) Mirror 7: 0xef54adf2 (stale) Mirror 8: 0xef54adf2 (stale) Mirror 10: 0xef54adf2 (stale) Mirror 11: 0xef54adf2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x92ef: skipped 000741 1788212981.771236 mapread 0x006dd6 thru 0x0092ee (0x2519 bytes) 000742 1788212981.801919 read 0x007a22 thru 0x0092ee (0x18cd bytes) 000744 1788212981.803577 mapread 0x008698 thru 0x0092ee (0xc57 bytes) 000745 1788212981.804651 mapwrite 0x022f77 thru 0x02b250 (0x82da bytes) 000746 1788212981.900678 trunc from 0x02b251 to 0x024de0 (0x6470 bytes) 000747 1788212981.924690 trunc from 0x024de1 to 0x013d31 (0x110af bytes) 000749 1788212981.948842 mapwrite 0x01abb5 thru 0x023fd7 (0x9423 bytes) 000751 1788212982.031474 write 0x009110 thru 0x0167a3 (0xd694 bytes) 000754 1788212982.035519 trunc from 0x023fd8 to 0x0049ea (0x1f5ed bytes) 000757 1788212982.059360 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x49eb): Mirror 3: 0x7202ffd2 (stale) Mirror 7: 0x7202ffd2 (stale) Mirror 8: 0x7202ffd2 (stale) Mirror 11: 0x7202ffd2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x49eb): Mirror 3: 0x7202ffd2 (stale) Mirror 7: 0x7202ffd2 (stale) Mirror 8: 0x7202ffd2 (stale) Mirror 11: 0x7202ffd2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x49eb: skipped 000758 1788212982.344637 read 0x003bd9 thru 0x0049ea (0xe12 bytes) 000761 1788212982.362954 MIRROR_RESYNC 5 mirrors 000763 1788212983.231899 mapwrite 0x00cf0b thru 0x01aa63 (0xdb59 bytes) 000764 1788212983.406457 trunc from 0x01aa64 to 0x00fc1a (0xae49 bytes) 000765 1788212983.424153 read 0x008439 thru 0x00e650 (0x6218 bytes) 000766 1788212983.424863 mapread 0x002953 thru 0x00b853 (0x8f01 bytes) 000767 1788212983.435429 mapwrite 0x013c8a thru 0x014d7a (0x10f1 bytes) 000768 1788212983.518800 mapwrite 0x004596 thru 0x0105db (0xc046 bytes) 000774 1788212983.578232 write 0x00efe2 thru 0x0130bb (0x40da bytes) 000775 1788212983.580442 read 0x00640f thru 0x010c5d (0xa84f bytes) 000776 1788212983.581211 mapwrite 0x00978d thru 0x0162a9 (0xcb1d bytes) 000777 1788212983.739577 mapread 0x00b19a thru 0x01444c (0x92b3 bytes) 000779 1788212983.744616 mapread 0x0070f3 thru 0x012177 (0xb085 bytes) 000788 1788212983.755726 mapread 0x004686 thru 0x0053f0 (0xd6b bytes) 000790 1788212983.770591 MIRROR_RESYNC 5 mirrors 000791 1788212984.602988 write 0x038335 thru 0x03ffff (0x7ccb bytes) 000792 1788212984.670606 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa43985dc (stale) Mirror 8: 0xa43985dc (stale) Mirror 11: 0xa43985dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa43985dc (stale) Mirror 8: 0xa43985dc (stale) Mirror 11: 0xa43985dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000794 1788212985.057681 trunc from 0x040000 to 0x0005d4 (0x3fa2b bytes) 000797 1788212985.071689 read 0x0004f6 thru 0x0005d4 (0xdf bytes) 000801 1788212985.081774 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x5d5): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5d5): Mirror 3: 0x76016636 (stale) Mirror 8: 0x76016636 (stale) Mirror 11: 0x76016636 (stale) CRC-32 checksum value for chunk [0, 0x5d5): Mirror 1: 0x76016636 Mirror 12: 0x76016636 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5d5: skipped 000803 1788212985.805802 write 0x03c69f thru 0x03e468 (0x1dca bytes) 000807 1788212985.912234 MIRROR_RESYNC 5 mirrors 000809 1788212987.230401 mapwrite 0x00b2ee thru 0x017cb4 (0xc9c7 bytes) 000810 1788212987.443582 trunc from 0x03e469 to 0x01a89e (0x23bca bytes) 000811 1788212987.475753 trunc from 0x01a89f to 0x008441 (0x1245d bytes) 000812 1788212987.491796 trunc from 0x008442 to 0x0177d9 (0xf398 bytes) 000813 1788212987.506602 trunc from 0x0177da to 0x036f3d (0x1f764 bytes) 000814 1788212987.519596 mapread 0x00435a thru 0x005529 (0x11d0 bytes) 000815 1788212987.526228 read 0x017bb4 thru 0x01d4b3 (0x5900 bytes) 000816 1788212987.533581 mapwrite 0x00aac0 thru 0x012603 (0x7b44 bytes) 000817 1788212987.585217 read 0x026c69 thru 0x03026a (0x9602 bytes) 000818 1788212987.598293 mapwrite 0x01233f thru 0x013a6d (0x172f bytes) 000820 1788212987.648941 MIRROR_RESYNC 5 mirrors 000822 1788212989.055977 mapwrite 0x0320a2 thru 0x03ffff (0xdf5e bytes) 000823 1788212989.241364 write 0x00f1dc thru 0x019212 (0xa037 bytes) truncating to largest ever: 0x3f948 000824 1788212989.253015 trunc from 0x040000 to 0x03f947 (0x6b8 bytes) 000825 1788212989.282907 write 0x01efc7 thru 0x02390d (0x4947 bytes) 000826 1788212989.295771 mapwrite 0x02496c thru 0x02ba76 (0x710b bytes) 000827 1788212989.368377 mapwrite 0x0331e1 thru 0x03a0ee (0x6f0e bytes) 000828 1788212989.441120 trunc from 0x03f948 to 0x0197bd (0x2618a bytes) 000829 1788212989.466862 mapwrite 0x0320a2 thru 0x03ad2a (0x8c89 bytes) 000830 1788212989.551384 read 0x02f358 thru 0x03367b (0x4324 bytes) 000831 1788212989.553345 mapread 0x018264 thru 0x0276da (0xf477 bytes) 000835 1788212989.573200 mapread 0x025657 thru 0x033d4d (0xe6f7 bytes) 000838 1788212989.577944 mapread 0x011c13 thru 0x017502 (0x58f0 bytes) 000839 1788212989.579241 write 0x01c9b9 thru 0x0221a1 (0x57e9 bytes) 000841 1788212989.584085 read 0x02e368 thru 0x02e729 (0x3c2 bytes) 000843 1788212989.587000 mapread 0x03a570 thru 0x03ad2a (0x7bb bytes) 000845 1788212989.588710 write 0x038329 thru 0x039c2a (0x1902 bytes) 000846 1788212989.592880 mapread 0x00242d thru 0x00d910 (0xb4e4 bytes) 000847 1788212989.607254 mapwrite 0x0333ab thru 0x03b8f3 (0x8549 bytes) 000848 1788212989.677476 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b8f4): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8f4): Mirror 3: 0x6dbe8df0 (stale) Mirror 8: 0x6dbe8df0 (stale) Mirror 11: 0x6dbe8df0 (stale) Mirror 12: 0x6dbe8df0 (stale) CRC-32 checksum value for chunk [0, 0x3b8f4): Mirror 1: 0x4304b8e2 Mirror 13: 0x4304b8e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8f4: skipped 000849 1788212990.631208 mapwrite 0x003361 thru 0x00e8da (0xb57a bytes) 000856 1788212990.865324 write 0x002121 thru 0x006a50 (0x4930 bytes) 000857 1788212990.867274 trunc from 0x03b8f4 to 0x03ebd4 (0x32e1 bytes) 000859 1788212990.898690 mapread 0x02b4af thru 0x03394f (0x84a1 bytes) 000860 1788212990.914572 read 0x018dc1 thru 0x01ddf3 (0x5033 bytes) 000861 1788212990.925676 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 3: 0x44ef30b5 (stale) Mirror 8: 0x44ef30b5 (stale) Mirror 11: 0x44ef30b5 (stale) Mirror 12: 0x44ef30b5 (stale) Mirror 13: 0xd4ce98a7 (stale) CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 1: 0x18fa7a03 Mirror 14: 0x18fa7a03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebd5: skipped 000862 1788212992.336798 mapwrite 0x003aee thru 0x00b917 (0x7e2a bytes) 000863 1788212992.593630 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 3: 0x44ef30b5 (stale) Mirror 8: 0x44ef30b5 (stale) Mirror 11: 0x44ef30b5 (stale) Mirror 12: 0x44ef30b5 (stale) Mirror 14: 0x18fa7a03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 3: 0x44ef30b5 (stale) Mirror 8: 0x44ef30b5 (stale) Mirror 11: 0x44ef30b5 (stale) Mirror 12: 0x44ef30b5 (stale) Mirror 14: 0x18fa7a03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebd5: skipped 000864 1788212993.028617 write 0x004190 thru 0x0091b6 (0x5027 bytes) 000865 1788212993.038485 write 0x00779b thru 0x00adc7 (0x362d bytes) 000866 1788212993.048915 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 3: 0x44ef30b5 (stale) Mirror 8: 0x44ef30b5 (stale) Mirror 11: 0x44ef30b5 (stale) Mirror 12: 0x44ef30b5 (stale) Mirror 14: 0x18fa7a03 (stale) CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 1: 0x2c170ad9 Mirror 15: 0x2c170ad9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebd5: skipped 000870 1788212994.378923 write 0x02d463 thru 0x036388 (0x8f26 bytes) 000871 1788212994.460504 write 0x03a161 thru 0x03ab7a (0xa1a bytes) 000872 1788212994.471536 read 0x02ac9d thru 0x02c82e (0x1b92 bytes) 000873 1788212994.486468 mapwrite 0x01de96 thru 0x02a35e (0xc4c9 bytes) 000876 1788212994.579542 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 8: 0x44ef30b5 (stale) Mirror 11: 0x44ef30b5 (stale) Mirror 12: 0x44ef30b5 (stale) Mirror 14: 0x18fa7a03 (stale) Mirror 15: 0x2c170ad9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebd5): Mirror 8: 0x44ef30b5 (stale) Mirror 11: 0x44ef30b5 (stale) Mirror 12: 0x44ef30b5 (stale) Mirror 14: 0x18fa7a03 (stale) Mirror 15: 0x2c170ad9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebd5: skipped 000877 1788212995.011779 read 0x03d882 thru 0x03e9ef (0x116e bytes) 000879 1788212995.018296 mapwrite 0x019358 thru 0x026b7e (0xd827 bytes) 000881 1788212995.080586 write 0x0381f7 thru 0x03ffff (0x7e09 bytes) 000886 1788212995.088128 write 0x031ef1 thru 0x03703c (0x514c bytes) 000888 1788212995.097490 trunc from 0x040000 to 0x03356e (0xca91 bytes) 000890 1788212995.111857 read 0x00e798 thru 0x0186a9 (0x9f12 bytes) 000891 1788212995.120583 mapwrite 0x02e35a thru 0x03bc3f (0xd8e6 bytes) 000894 1788212995.186017 write 0x023a47 thru 0x031168 (0xd722 bytes) 000895 1788212995.193153 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 8: 0xa8dfca61 (stale) Mirror 11: 0xa8dfca61 (stale) Mirror 12: 0xa8dfca61 (stale) Mirror 14: 0xdeecb667 (stale) Mirror 15: 0x53b46792 (stale) CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 1: 0x2b26b650 Mirror 16: 0x2b26b650 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc40: skipped 000896 1788212996.148721 mapwrite 0x01c786 thru 0x01cec2 (0x73d bytes) 000897 1788212996.350674 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 8: 0xa8dfca61 (stale) Mirror 11: 0xa8dfca61 (stale) Mirror 12: 0xa8dfca61 (stale) Mirror 14: 0xdeecb667 (stale) Mirror 15: 0x53b46792 (stale) Mirror 16: 0x2b26b650 (stale) CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 1: 0xdb42e0b7 Mirror 17: 0xdb42e0b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc40: skipped 000899 1788212997.569463 trunc from 0x03bc40 to 0x029cad (0x11f92 bytes) 000901 1788212997.695758 write 0x020f96 thru 0x027698 (0x6703 bytes) 000902 1788212997.726889 trunc from 0x029cae to 0x02c389 (0x26dc bytes) 000904 1788212997.808772 trunc from 0x02c38a to 0x0372a6 (0xaf1d bytes) 000908 1788212997.869818 trunc from 0x0372a7 to 0x014b3c (0x2276a bytes) 000909 1788212997.905938 write 0x02cce5 thru 0x032a15 (0x5d31 bytes) 000910 1788212997.911198 read 0x00421a thru 0x00d3fd (0x91e4 bytes) 000911 1788212997.938142 read 0x013ad6 thru 0x014e0b (0x1336 bytes) 000912 1788212997.971874 trunc from 0x032a16 to 0x023ad2 (0xef43 bytes) 000914 1788212998.018911 write 0x022ffe thru 0x02ec95 (0xbc98 bytes) 000917 1788212998.023080 write 0x000cce thru 0x00ecf6 (0xe029 bytes) 000919 1788212998.027204 read 0x00e078 thru 0x0126c2 (0x464b bytes) 000921 1788212998.029030 read 0x00d61a thru 0x010935 (0x331c bytes) 000922 1788212998.035107 MIRROR_RESYNC 8 mirrors 000923 1788213000.088541 write 0x01c7a4 thru 0x028967 (0xc1c4 bytes) 000925 1788213000.188626 mapwrite 0x0154a0 thru 0x019401 (0x3f62 bytes) 000926 1788213000.275515 MIRROR_RESYNC 8 mirrors 000927 1788213001.806197 read 0x01941a thru 0x01cb48 (0x372f bytes) 000928 1788213001.814509 mapwrite 0x0225e5 thru 0x031c10 (0xf62c bytes) 000929 1788213002.081004 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x31c11): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c11): Mirror 8: 0x95f2b8cd (stale) Mirror 11: 0x95f2b8cd (stale) Mirror 12: 0x95f2b8cd (stale) Mirror 14: 0x95f2b8cd (stale) Mirror 15: 0x95f2b8cd (stale) Mirror 16: 0x95f2b8cd (stale) Mirror 17: 0x95f2b8cd (stale) CRC-32 checksum value for chunk [0, 0x31c11): Mirror 1: 0xebd2639f Mirror 18: 0xebd2639f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c11: skipped 000930 1788213003.013179 mapread 0x02a61f thru 0x02f139 (0x4b1b bytes) 000931 1788213003.050698 trunc from 0x031c11 to 0x021b2f (0x100e1 bytes) 000932 1788213003.152454 mapread 0x00dca7 thru 0x01274a (0x4aa4 bytes) 000933 1788213003.160228 read 0x017f9d thru 0x021b2f (0x9b93 bytes) 000934 1788213003.167561 trunc from 0x021b30 to 0x0145fa (0xd535 bytes) 000936 1788213003.187458 mapwrite 0x005525 thru 0x00b3a7 (0x5e83 bytes) 000937 1788213003.250869 read 0x003162 thru 0x00b550 (0x83ef bytes) 000939 1788213003.253434 write 0x01fda6 thru 0x02e38d (0xe5e8 bytes) 000941 1788213003.257664 mapwrite 0x0166d4 thru 0x01f6cd (0x8ffa bytes) 000946 1788213003.340978 write 0x039e98 thru 0x03b455 (0x15be bytes) 000947 1788213003.342234 trunc from 0x03b456 to 0x00e841 (0x2cc14 bytes) 000948 1788213003.367446 mapwrite 0x027f49 thru 0x02e7c4 (0x687c bytes) 000949 1788213003.546783 MIRROR_RESYNC 9 mirrors 000950 1788213005.903823 write 0x00a997 thru 0x0172ec (0xc956 bytes) 000951 1788213005.991141 MIRROR_RESYNC 9 mirrors 000954 1788213008.240882 write 0x03e82d thru 0x03ffff (0x17d3 bytes) 000955 1788213008.296306 read 0x016c94 thru 0x01e1b2 (0x751f bytes) 000956 1788213008.304911 read 0x01d54d thru 0x02a07b (0xcb2f bytes) 000957 1788213008.314966 mapread 0x03fa27 thru 0x03ffff (0x5d9 bytes) 000958 1788213008.316590 write 0x01eb49 thru 0x02a603 (0xbabb bytes) 000959 1788213008.318670 trunc from 0x040000 to 0x00a83e (0x357c1 bytes) 000961 1788213008.339829 read 0x003268 thru 0x00a83e (0x75d7 bytes) 000963 1788213008.340922 read 0x0010ba thru 0x00a83e (0x9785 bytes) 000966 1788213008.343996 mapread 0x00166d thru 0x00a83e (0x91d2 bytes) 000967 1788213008.345958 mapwrite 0x03ffa0 thru 0x03ffff (0x60 bytes) 000968 1788213008.444500 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa2dcad4a (stale) Mirror 11: 0xa2dcad4a (stale) Mirror 12: 0xa2dcad4a (stale) Mirror 14: 0xa2dcad4a (stale) Mirror 15: 0xa2dcad4a (stale) Mirror 16: 0xa2dcad4a (stale) Mirror 17: 0xa2dcad4a (stale) Mirror 18: 0xa2dcad4a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xef5d280 Mirror 19: 0xef5d280 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000969 1788213009.628904 read 0x03a4a3 thru 0x03ffff (0x5b5d bytes) 000971 1788213009.650646 trunc from 0x040000 to 0x03114d (0xeeb2 bytes) 000972 1788213009.761850 mapwrite 0x021182 thru 0x027838 (0x66b7 bytes) 000973 1788213009.886217 trunc from 0x03114e to 0x012aac (0x1e6a1 bytes) 000974 1788213009.922802 mapwrite 0x024104 thru 0x0261d8 (0x20d5 bytes) 000976 1788213010.002460 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x261d9): Mirror 8: 0x2a0186ac (stale) Mirror 11: 0x2a0186ac (stale) Mirror 14: 0x2a0186ac (stale) Mirror 15: 0x2a0186ac (stale) Mirror 16: 0x2a0186ac (stale) Mirror 17: 0x2a0186ac (stale) Mirror 18: 0x2a0186ac (stale) Mirror 19: 0x6a08b736 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x261d9): Mirror 8: 0x2a0186ac (stale) Mirror 11: 0x2a0186ac (stale) Mirror 14: 0x2a0186ac (stale) Mirror 15: 0x2a0186ac (stale) Mirror 16: 0x2a0186ac (stale) Mirror 17: 0x2a0186ac (stale) Mirror 18: 0x2a0186ac (stale) Mirror 19: 0x6a08b736 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x261d9: skipped 000977 1788213010.479023 trunc from 0x0261d9 to 0x00673f (0x1fa99 bytes) 000978 1788213010.503272 write 0x006c20 thru 0x016192 (0xf573 bytes) 000979 1788213010.513839 trunc from 0x016193 to 0x02a285 (0x140f3 bytes) 000980 1788213010.536927 read 0x0031c0 thru 0x00d231 (0xa072 bytes) 000981 1788213010.558509 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2a286): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a286): Mirror 8: 0x2f8d13e7 (stale) Mirror 11: 0x2f8d13e7 (stale) Mirror 14: 0x2f8d13e7 (stale) Mirror 15: 0x2f8d13e7 (stale) Mirror 16: 0x2f8d13e7 (stale) Mirror 17: 0x2f8d13e7 (stale) Mirror 18: 0x2f8d13e7 (stale) Mirror 19: 0x9a21e7da (stale) CRC-32 checksum value for chunk [0, 0x2a286): Mirror 1: 0x5eb06407 Mirror 20: 0x5eb06407 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a286: skipped 000982 1788213011.964832 mapwrite 0x03b548 thru 0x03ffff (0x4ab8 bytes) 000984 1788213012.164347 mapread 0x039b92 thru 0x03ffff (0x646e bytes) 000985 1788213012.166905 trunc from 0x040000 to 0x0258bb (0x1a744 bytes) 000986 1788213012.197745 trunc from 0x0258bc to 0x004583 (0x21338 bytes) 000988 1788213012.225645 trunc from 0x004584 to 0x017a76 (0x134f3 bytes) 000989 1788213012.265838 mapread 0x0083c6 thru 0x015ecc (0xdb07 bytes) 000990 1788213012.290189 trunc from 0x017a77 to 0x035900 (0x1de8a bytes) 000992 1788213012.317799 mapwrite 0x0282f5 thru 0x030938 (0x8644 bytes) 000993 1788213012.381896 write 0x02b85f thru 0x0322e4 (0x6a86 bytes) 000997 1788213012.391586 trunc from 0x035901 to 0x0160cb (0x1f835 bytes) All operations completed A-OK!