== sanity-flr test 70a: flr mode fsx test ================ 02:24:34 (1786170274) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 276 skipping zero size read skipping zero size read fallocating to largest ever: 0x1ef8a 000006 1786170277.216097 fallocate 0x01338f thru 0x01ef89 (0xbbfb bytes) 000007 1786170277.223950 punch from 0x0058c2 to 0x00b0fe (0x583d bytes) fallocating to largest ever: 0x40000 000008 1786170277.231193 fallocate 0x03ce32 thru 0x03ffff (0x31ce bytes) 000009 1786170277.238366 mapread 0x01d64f thru 0x024e11 (0x77c3 bytes) 000010 1786170277.266580 read 0x00ab66 thru 0x00fa24 (0x4ebf bytes) 000011 1786170277.287673 fallocate 0x032ee1 thru 0x038d4b (0x5e6b bytes) 000012 1786170277.295845 fallocate 0x037b4b thru 0x03b7db (0x3c91 bytes) 000013 1786170277.310785 MIRROR_EXTEND to 2 mirrors 000015 1786170278.144636 MIRROR_RESYNC 2 mirrors 000016 1786170278.534893 fallocate 0x01412a thru 0x0156f1 (0x15c8 bytes) 000017 1786170278.575117 trunc from 0x040000 to 0x038596 (0x7a69 bytes) 000018 1786170278.634984 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38597): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38597): Mirror 2: 0xc88072ae (stale) CRC-32 checksum value for chunk [0, 0x38597): Mirror 1: 0xc88072ae Mirror 3: 0xc88072ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38597: skipped 000020 1786170279.598455 fallocate 0x028033 thru 0x02eaee (0x6abc bytes) 000021 1786170279.662173 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38597): Mirror 2: 0xc88072ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38597): Mirror 2: 0xc88072ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38597: skipped 000022 1786170280.252793 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38597): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38597): Mirror 2: 0xc88072ae (stale) CRC-32 checksum value for chunk [0, 0x38597): Mirror 1: 0xc88072ae Mirror 3: 0xc88072ae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38597: skipped 000024 1786170281.375007 fallocate 0x03809b thru 0x03ffff (0x7f65 bytes) 000025 1786170281.429202 trunc from 0x00fda5 to 0x0164d9 (0x6735 bytes) 000027 1786170281.437816 write 0x02cc01 thru 0x02de4e (0x124e bytes) 000028 1786170281.457113 trunc from 0x038597 to 0x01434e (0x24248 bytes) 000029 1786170281.487895 read 0x00fcc9 thru 0x010ddf (0x1117 bytes) 000030 1786170281.497229 mapread 0x00f4e4 thru 0x01434e (0x4e6b bytes) 000031 1786170281.528128 trunc from 0x01434f to 0x023232 (0xeee4 bytes) 000033 1786170281.559784 fallocate 0x026cfe thru 0x029d0e (0x3011 bytes) 000034 1786170281.567973 fallocate 0x01e9e5 thru 0x025994 (0x6fb0 bytes) 000035 1786170281.575251 trunc from 0x029d0f to 0x002398 (0x27976 bytes) 000037 1786170281.601926 mapwrite 0x002d8a thru 0x0078f8 (0x4b6f bytes) 000038 1786170281.665336 trunc from 0x004660 to 0x006911 (0x22b2 bytes) 000039 1786170281.674204 write 0x031062 thru 0x03d8c7 (0xc866 bytes) 000040 1786170281.676665 write 0x008fb5 thru 0x015cde (0xcd2a bytes) 000041 1786170281.693462 write 0x014c3d thru 0x01e1ad (0x9571 bytes) 000042 1786170281.712099 punch from 0x001b3d to 0x00430c (0x27d0 bytes) 000043 1786170281.725438 write 0x00c0ea thru 0x01aceb (0xec02 bytes) 000044 1786170281.734032 write 0x0032ce thru 0x00488d (0x15c0 bytes) 000046 1786170281.756964 fallocate 0x03ae5e thru 0x03ffff (0x51a2 bytes) 000047 1786170281.763688 mapread 0x030c31 thru 0x03d8c7 (0xcc97 bytes) 000048 1786170281.775149 read 0x035742 thru 0x03afcf (0x588e bytes) 000049 1786170281.785336 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 2: 0x7b0c380c (stale) Mirror 3: 0x7b0c380c (stale) CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 1: 0x7a3d4b5a Mirror 4: 0x7a3d4b5a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8c8: skipped 000050 1786170282.877009 write 0x00ac0a thru 0x017a48 (0xce3f bytes) 000051 1786170282.944622 fallocate 0x019e5b thru 0x01a93c (0xae2 bytes) 000052 1786170282.951213 trunc from 0x03853c to 0x03d8c7 (0x538c bytes) 000053 1786170282.962044 MIRROR_RESYNC 4 mirrors 000055 1786170284.596151 MIRROR_RESYNC 4 mirrors 000056 1786170285.155535 mapread 0x01bdab thru 0x01d3e6 (0x163c bytes) 000057 1786170285.180758 fallocate 0x036a6a thru 0x03ffff (0x9596 bytes) 000058 1786170285.228067 fallocate 0x007534 thru 0x00a17c (0x2c49 bytes) 000059 1786170285.235178 fallocate 0x018622 thru 0x0221f7 (0x9bd6 bytes) 000060 1786170285.242069 read 0x02c932 thru 0x031b17 (0x51e6 bytes) 000062 1786170285.258194 trunc from 0x0208c3 to 0x02bd83 (0xb4c1 bytes) 000063 1786170285.267757 read 0x02e47c thru 0x032722 (0x42a7 bytes) 000064 1786170285.320169 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 2: 0xc051aa00 (stale) Mirror 4: 0xc051aa00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 2: 0xc051aa00 (stale) Mirror 4: 0xc051aa00 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8c8: skipped 000065 1786170285.934907 mapread 0x036e5d thru 0x03d6b0 (0x6854 bytes) 000066 1786170285.973763 punch from 0x00233b to 0x00f77c (0xd442 bytes) 000067 1786170285.983977 punch from 0x033114 to 0x035b10 (0x29fd bytes) 000068 1786170285.993071 fallocate 0x01f2ea thru 0x020b42 (0x1859 bytes) 000069 1786170286.006160 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 2: 0xc051aa00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 2: 0xc051aa00 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8c8: skipped 000070 1786170286.486367 mapread 0x00f143 thru 0x015c31 (0x6aef bytes) 000071 1786170286.537040 read 0x000f25 thru 0x009816 (0x88f2 bytes) 000072 1786170286.554234 fallocate 0x0250f0 thru 0x02eed2 (0x9de3 bytes) 000073 1786170286.565221 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 2: 0xc051aa00 (stale) CRC-32 checksum value for chunk [0, 0x3d8c8): Mirror 1: 0x2b98c909 Mirror 3: 0x2b98c909 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8c8: skipped 000074 1786170287.895601 trunc from 0x03d8c8 to 0x008c6f (0x34c58 bytes) 000075 1786170287.969738 trunc from 0x008c70 to 0x02b258 (0x225e9 bytes) 000076 1786170288.020128 write 0x037626 thru 0x03ffff (0x89da bytes) 000077 1786170288.030973 fallocate 0x02a205 thru 0x036fa6 (0xcda2 bytes) 000078 1786170288.046407 write 0x0330b9 thru 0x03a19a (0x70e2 bytes) 000080 1786170288.068478 mapread 0x03eef9 thru 0x03ffff (0x1107 bytes) 000081 1786170288.071231 trunc from 0x01e362 to 0x0292ab (0xaf4a bytes) 000082 1786170288.083479 trunc from 0x016d21 to 0x0173dd (0x6bd bytes) 000083 1786170288.094586 fallocate 0x0049d2 thru 0x00cf18 (0x8547 bytes) 000084 1786170288.105727 read 0x0212d2 thru 0x026034 (0x4d63 bytes) 000085 1786170288.133021 punch from 0x01f228 to 0x025dca (0x6ba3 bytes) 000086 1786170288.147480 trunc from 0x040000 to 0x038bf9 (0x7406 bytes) 000087 1786170288.199211 mapread 0x01fa08 thru 0x02cf00 (0xd4f9 bytes) 000088 1786170288.246469 read 0x03787b thru 0x038bf9 (0x137f bytes) 000089 1786170288.248440 punch from 0x03658d to 0x038bf9 (0x266d bytes) 000090 1786170288.277634 trunc from 0x038bfa to 0x000d10 (0x37ee9 bytes) 000092 1786170288.306618 punch from 0x00098a to 0x000d10 (0x387 bytes) 000093 1786170288.319045 write 0x025736 thru 0x033c65 (0xe530 bytes) 000094 1786170288.325670 fallocate 0x0173af thru 0x02260f (0xb261 bytes) 000095 1786170288.337291 punch from 0x015a87 to 0x0249c3 (0xef3d bytes) 000096 1786170288.350904 trunc from 0x00e41f to 0x010af8 (0x26da bytes) 000097 1786170288.373466 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33c66): Mirror 3: 0xa63fa5de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c66): Mirror 3: 0xa63fa5de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c66: skipped 000098 1786170288.903980 write 0x036c1a thru 0x03a633 (0x3a1a bytes) 000099 1786170288.915057 punch from 0x01e19e to 0x020fcb (0x2e2e bytes) 000100 1786170288.930431 trunc from 0x03a634 to 0x001275 (0x393be bytes) 000101 1786170288.975101 mapread 0x00000f thru 0x001275 (0x1267 bytes) 000102 1786170289.014303 trunc from 0x000b44 to 0x001275 (0x732 bytes) 000103 1786170289.060161 punch from 0x000c4d to 0x001275 (0x629 bytes) 000104 1786170289.080198 mapwrite 0x0118fc thru 0x0149f0 (0x30f5 bytes) 000105 1786170289.251134 write 0x02383f thru 0x02fdf7 (0xc5b9 bytes) 000106 1786170289.263205 write 0x00049a thru 0x00692e (0x6495 bytes) 000107 1786170289.289258 trunc from 0x02fdf8 to 0x00498b (0x2b46c bytes) 000108 1786170289.340402 trunc from 0x0046d1 to 0x00498b (0x2bb bytes) 000109 1786170289.388062 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000111 1786170289.644084 write 0x015f1f thru 0x016025 (0x107 bytes) 000112 1786170289.678075 read 0x00499e thru 0x00b451 (0x6ab4 bytes) 000114 1786170289.705971 MIRROR_EXTEND to 2 mirrors 000115 1786170290.758098 punch from 0x00d8cb to 0x01546c (0x7ba2 bytes) 000116 1786170290.825715 MIRROR_RESYNC 2 mirrors 000117 1786170291.618092 write 0x01e2bf thru 0x021469 (0x31ab bytes) 000118 1786170291.665970 mapread 0x0027ff thru 0x00ecf5 (0xc4f7 bytes) 000119 1786170291.722416 MIRROR_RESYNC 2 mirrors 000120 1786170292.626719 punch from 0x004f6e to 0x00a53a (0x55cd bytes) 000121 1786170292.690190 fallocate 0x00ae41 thru 0x015fa0 (0xb160 bytes) 000122 1786170292.700372 write 0x03baaf thru 0x03ffff (0x4551 bytes) 000123 1786170292.703962 read 0x01d8f2 thru 0x028dca (0xb4d9 bytes) 000124 1786170292.730979 write 0x010d45 thru 0x019ead (0x9169 bytes) 000125 1786170292.745382 trunc from 0x03324e to 0x03ffff (0xcdb2 bytes) 000126 1786170292.765057 mapwrite 0x01e060 thru 0x0232b1 (0x5252 bytes) 000127 1786170292.789028 mapread 0x037234 thru 0x03ffff (0x8dcc bytes) 000128 1786170292.816247 trunc from 0x040000 to 0x00b736 (0x348c9 bytes) 000129 1786170292.844374 trunc from 0x00b34d to 0x00b736 (0x3ea bytes) 000130 1786170292.857409 MIRROR_RESYNC 2 mirrors 000131 1786170293.646080 mapread 0x009a1d thru 0x00b736 (0x1d1a bytes) 000132 1786170293.670883 trunc from 0x002958 to 0x005bae (0x3257 bytes) 000133 1786170293.709946 trunc from 0x00b737 to 0x021251 (0x15b1b bytes) 000134 1786170293.750078 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000135 1786170293.996186 punch from 0x009a75 to 0x015568 (0xbaf4 bytes) 000136 1786170294.006342 write 0x02cd11 thru 0x035da4 (0x9094 bytes) 000137 1786170294.014112 mapread 0x001879 thru 0x0104d5 (0xec5d bytes) 000138 1786170294.048769 write 0x033f6c thru 0x03ffff (0xc094 bytes) 000139 1786170294.051721 mapread 0x002d68 thru 0x00ec93 (0xbf2c bytes) 000140 1786170294.054700 mapread 0x0047d5 thru 0x00cfb9 (0x87e5 bytes) 000141 1786170294.056372 fallocate 0x0097a3 thru 0x018d7e (0xf5dc bytes) 000142 1786170294.063625 mapread 0x0171cf thru 0x022119 (0xaf4b bytes) 000144 1786170294.091185 punch from 0x03aee3 to 0x03fc4d (0x4d6b bytes) 000145 1786170294.109817 read 0x03cddc thru 0x03e6bc (0x18e1 bytes) 000147 1786170294.118782 mapwrite 0x028757 thru 0x02f08d (0x6937 bytes) 000148 1786170294.160754 write 0x016f3c thru 0x0251e6 (0xe2ab bytes) 000149 1786170294.165236 mapwrite 0x03b066 thru 0x03f8de (0x4879 bytes) 000150 1786170294.212068 write 0x023f11 thru 0x029b1e (0x5c0e bytes) 000153 1786170294.218663 punch from 0x031d58 to 0x03ffff (0xe2a8 bytes) 000154 1786170294.227050 write 0x02a260 thru 0x0331a5 (0x8f46 bytes) 000155 1786170294.236166 mapwrite 0x027fa0 thru 0x02a23d (0x229e bytes) 000156 1786170294.286054 fallocate 0x01f8a6 thru 0x02c16e (0xc8c9 bytes) 000157 1786170294.300198 punch from 0x02f18d to 0x038c20 (0x9a94 bytes) 000158 1786170294.310070 trunc from 0x0158b2 to 0x02188e (0xbfdd bytes) 000159 1786170294.319125 trunc from 0x019511 to 0x026921 (0xd411 bytes) 000160 1786170294.332977 MIRROR_EXTEND to 2 mirrors 000161 1786170295.069149 fallocate 0x0310cc thru 0x03ce98 (0xbdcd bytes) 000162 1786170295.110075 trunc from 0x0251d6 to 0x034d34 (0xfb5f bytes) 000163 1786170295.116753 punch from 0x038c04 to 0x039ba4 (0xfa1 bytes) 000164 1786170295.124715 trunc from 0x02b011 to 0x02eba5 (0x3b95 bytes) 000165 1786170295.130785 write 0x02a37e thru 0x035dac (0xba2f bytes) 000166 1786170295.148871 read 0x01c3a4 thru 0x022918 (0x6575 bytes) 000167 1786170295.167298 MIRROR_RESYNC 2 mirrors 000168 1786170295.804577 fallocate 0x027e29 thru 0x036bc9 (0xeda1 bytes) 000169 1786170295.850155 trunc from 0x040000 to 0x0060cb (0x39f34 bytes) 000170 1786170295.907785 fallocate 0x0377e3 thru 0x03ffff (0x881d bytes) 000171 1786170295.914779 mapread 0x03519f thru 0x03d77c (0x85de bytes) 000173 1786170295.945452 mapread 0x00e0df thru 0x01660d (0x852f bytes) 000174 1786170295.960752 trunc from 0x040000 to 0x03a5e6 (0x5a19 bytes) 000175 1786170295.984229 punch from 0x012de2 to 0x0130d8 (0x2f7 bytes) 000176 1786170295.989986 punch from 0x027269 to 0x028fb7 (0x1d4f bytes) 000177 1786170295.995844 read 0x036417 thru 0x03a5e6 (0x41d0 bytes) 000178 1786170295.999118 mapwrite 0x01cf7a thru 0x0238a0 (0x6927 bytes) 000179 1786170296.044825 trunc from 0x03a5e7 to 0x02cbbc (0xda2a bytes) 000181 1786170296.075080 write 0x00e1bf thru 0x00e4f1 (0x333 bytes) 000182 1786170296.077829 write 0x01670a thru 0x024e81 (0xe778 bytes) 000183 1786170296.079842 read 0x0277c7 thru 0x029e05 (0x263f bytes) 000184 1786170296.091124 write 0x0240db thru 0x026cde (0x2c04 bytes) 000185 1786170296.093407 punch from 0x01e7b8 to 0x02cbbc (0xe405 bytes) 000186 1786170296.112105 write 0x03177c thru 0x03e600 (0xce85 bytes) 000187 1786170296.115853 write 0x03a396 thru 0x03ffff (0x5c6a bytes) 000188 1786170296.118367 mapwrite 0x029dc5 thru 0x036e78 (0xd0b4 bytes) 000189 1786170296.180484 mapread 0x0042e0 thru 0x00b6db (0x73fc bytes) 000190 1786170296.184303 punch from 0x02ea99 to 0x03c891 (0xddf9 bytes) 000191 1786170296.193058 fallocate 0x010af7 thru 0x0161cc (0x56d6 bytes) 000192 1786170296.207440 punch from 0x00c2a8 to 0x018bb2 (0xc90b bytes) 000193 1786170296.218008 read 0x028417 thru 0x02a155 (0x1d3f bytes) 000194 1786170296.240142 write 0x002c50 thru 0x00f5f1 (0xc9a2 bytes) 000195 1786170296.243170 mapwrite 0x00444f thru 0x004957 (0x509 bytes) 000196 1786170296.268453 mapwrite 0x010c90 thru 0x01e7de (0xdb4f bytes) 000197 1786170296.299187 read 0x015fe9 thru 0x020684 (0xa69c bytes) 000198 1786170296.300540 write 0x00f838 thru 0x01455b (0x4d24 bytes) 000199 1786170296.302951 write 0x035e43 thru 0x03d69f (0x785d bytes) 000200 1786170296.305434 trunc from 0x040000 to 0x00fab5 (0x3054a bytes) 000201 1786170296.331118 mapwrite 0x023cb3 thru 0x023f09 (0x257 bytes) 000202 1786170296.389992 read 0x01360b thru 0x0229dd (0xf3d3 bytes) 000203 1786170296.392386 read 0x0114e2 thru 0x01a68a (0x91a9 bytes) 000205 1786170296.395607 write 0x034d91 thru 0x03d538 (0x87a8 bytes) 000206 1786170296.398994 trunc from 0x01b99c to 0x0220e4 (0x6749 bytes) 000207 1786170296.415014 MIRROR_RESYNC 2 mirrors 000209 1786170297.434022 trunc from 0x01f574 to 0x02798c (0x8419 bytes) 000212 1786170297.476977 mapread 0x021c99 thru 0x026dd9 (0x5141 bytes) 000213 1786170297.501327 mapwrite 0x017d9e thru 0x01ef64 (0x71c7 bytes) 000214 1786170297.536198 write 0x01c569 thru 0x029685 (0xd11d bytes) 000215 1786170297.538524 fallocate 0x01e999 thru 0x022558 (0x3bc0 bytes) 000217 1786170297.545041 read 0x00f361 thru 0x01567f (0x631f bytes) 000218 1786170297.556118 punch from 0x014d77 to 0x015306 (0x590 bytes) 000219 1786170297.564009 trunc from 0x00d951 to 0x01bd52 (0xe402 bytes) 000220 1786170297.570831 mapwrite 0x012b6e thru 0x0164cb (0x395e bytes) 000222 1786170297.607132 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000223 1786170297.821132 mapwrite 0x01ac92 thru 0x01ee08 (0x4177 bytes) 000224 1786170297.870001 read 0x02b39c thru 0x03717d (0xbde2 bytes) 000225 1786170297.887755 punch from 0x01f427 to 0x02b9a0 (0xc57a bytes) 000226 1786170297.895643 mapwrite 0x033777 thru 0x03ffff (0xc889 bytes) 000227 1786170297.975393 trunc from 0x040000 to 0x02ef77 (0x11088 bytes) 000228 1786170298.002363 trunc from 0x016312 to 0x01ccc3 (0x69b2 bytes) 000229 1786170298.009905 write 0x02df59 thru 0x02f67c (0x1724 bytes) 000230 1786170298.012056 write 0x0374e5 thru 0x03c637 (0x5153 bytes) 000231 1786170298.014920 punch from 0x0201e8 to 0x02e7c7 (0xe5e0 bytes) 000232 1786170298.033523 punch from 0x00fe1a to 0x0145a0 (0x4787 bytes) 000233 1786170298.041523 fallocate 0x015c9a thru 0x01c12b (0x6492 bytes) 000234 1786170298.047885 mapread 0x0307c5 thru 0x03911e (0x895a bytes) 000235 1786170298.062027 punch from 0x028471 to 0x02ca38 (0x45c8 bytes) 000237 1786170298.076457 MIRROR_EXTEND to 2 mirrors 000238 1786170299.109387 write 0x039ad5 thru 0x03ffff (0x652b bytes) 000239 1786170299.179786 write 0x03eebe thru 0x03ffff (0x1142 bytes) 000240 1786170299.181238 trunc from 0x040000 to 0x0150a3 (0x2af5c bytes) 000241 1786170299.243128 punch from 0x0060fe to 0x0150a3 (0xefa6 bytes) 000242 1786170299.251931 trunc from 0x0150a4 to 0x01ffd6 (0xaf33 bytes) 000244 1786170299.272871 trunc from 0x01ffd7 to 0x028024 (0x804e bytes) 000245 1786170299.308686 mapread 0x005d99 thru 0x00c12a (0x6392 bytes) 000246 1786170299.343949 mapread 0x02312b thru 0x026d3b (0x3c11 bytes) 000247 1786170299.358082 write 0x0084ab thru 0x00fb7e (0x76d4 bytes) 000248 1786170299.360469 punch from 0x010bfd to 0x014e2a (0x422e bytes) 000249 1786170299.366445 fallocate 0x0041de thru 0x00ef4b (0xad6e bytes) 000250 1786170299.373059 trunc from 0x028025 to 0x0359e7 (0xd9c3 bytes) 000251 1786170299.403935 punch from 0x028523 to 0x034419 (0xbef7 bytes) 000252 1786170299.411943 trunc from 0x0359e8 to 0x02d725 (0x82c2 bytes) 000253 1786170299.433480 punch from 0x01d97e to 0x021467 (0x3aea bytes) 000254 1786170299.441115 write 0x0307d1 thru 0x030bad (0x3dd bytes) 000255 1786170299.442979 write 0x02cb28 thru 0x038395 (0xb86e bytes) 000256 1786170299.450442 write 0x003057 thru 0x01055f (0xd509 bytes) 000257 1786170299.464088 punch from 0x01f11c to 0x02a8df (0xb7c4 bytes) 000258 1786170299.470349 mapwrite 0x015ca8 thru 0x02263e (0xc997 bytes) 000259 1786170299.528204 write 0x00dbe5 thru 0x010202 (0x261e bytes) 000260 1786170299.531116 read 0x00f7f1 thru 0x013fa1 (0x47b1 bytes) 000261 1786170299.532753 read 0x025ab9 thru 0x02c2c2 (0x680a bytes) 000262 1786170299.545378 fallocate 0x022302 thru 0x024afb (0x27fa bytes) 000263 1786170299.551807 punch from 0x02e67a to 0x02f519 (0xea0 bytes) 000264 1786170299.558885 fallocate 0x00ee4e thru 0x016b61 (0x7d14 bytes) 000265 1786170299.565977 trunc from 0x038396 to 0x00d3a2 (0x2aff3 bytes) 000266 1786170299.594091 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xd3a3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd3a3): Mirror 2: 0x5c4de55c (stale) CRC-32 checksum value for chunk [0, 0xd3a3): Mirror 1: 0xc3ad900f Mirror 3: 0xc3ad900f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd3a3: skipped 000267 1786170300.612025 trunc from 0x00d3a3 to 0x03535c (0x27fba bytes) 000268 1786170300.702086 mapwrite 0x0018e3 thru 0x00ac4b (0x9369 bytes) 000269 1786170300.749731 mapwrite 0x02e369 thru 0x030e07 (0x2a9f bytes) 000270 1786170300.782852 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3535d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3535d): Mirror 2: 0xaa2d03e2 (stale) Mirror 3: 0x79da3ae0 (stale) CRC-32 checksum value for chunk [0, 0x3535d): Mirror 1: 0x93b93ce9 Mirror 4: 0x93b93ce9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3535d: skipped 000271 1786170301.966470 mapwrite 0x017bc0 thru 0x018c79 (0x10ba bytes) 000272 1786170302.076840 read 0x00cb47 thru 0x019616 (0xcad0 bytes) 000274 1786170302.088633 mapread 0x011532 thru 0x012f9e (0x1a6d bytes) 000275 1786170302.090254 write 0x00302f thru 0x005109 (0x20db bytes) 000276 1786170302.109898 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3535d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3535d): Mirror 2: 0xaa2d03e2 (stale) Mirror 3: 0x79da3ae0 (stale) Mirror 4: 0x93b93ce9 (stale) CRC-32 checksum value for chunk [0, 0x3535d): Mirror 1: 0xeea50383 Mirror 5: 0xeea50383 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3535d: skipped 000277 1786170303.338807 mapwrite 0x004d83 thru 0x008cd0 (0x3f4e bytes) 000278 1786170303.498391 write 0x03c7eb thru 0x03ffff (0x3815 bytes) 000279 1786170303.515382 mapwrite 0x003f2e thru 0x00b498 (0x756b bytes) 000280 1786170303.579981 write 0x0130f1 thru 0x021ff0 (0xef00 bytes) 000281 1786170303.600906 read 0x00f2e1 thru 0x0197ad (0xa4cd bytes) 000282 1786170303.626040 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x67b2b652 (stale) Mirror 3: 0x9eee9390 (stale) Mirror 4: 0x9b795c5f (stale) Mirror 5: 0x4caf5e9e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1ae63080 Mirror 6: 0x1ae63080 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000283 1786170305.056338 read 0x03b1a1 thru 0x03c6f1 (0x1551 bytes) 000284 1786170305.075370 fallocate 0x026669 thru 0x02e1c2 (0x7b5a bytes) 000285 1786170305.132395 read 0x01bbad thru 0x0259f7 (0x9e4b bytes) 000286 1786170305.158249 write 0x025b53 thru 0x02a7da (0x4c88 bytes) 000287 1786170305.172671 trunc from 0x0304b4 to 0x032f67 (0x2ab4 bytes) 000288 1786170305.186280 mapwrite 0x039358 thru 0x03ad76 (0x1a1f bytes) 000289 1786170305.236243 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x67b2b652 (stale) Mirror 3: 0x9eee9390 (stale) Mirror 4: 0x9b795c5f (stale) Mirror 5: 0x4caf5e9e (stale) Mirror 6: 0x1ae63080 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4ef41b57 Mirror 7: 0x4ef41b57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000290 1786170306.637235 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x67b2b652 (stale) Mirror 3: 0x9eee9390 (stale) Mirror 5: 0x4caf5e9e (stale) Mirror 6: 0x1ae63080 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x67b2b652 (stale) Mirror 3: 0x9eee9390 (stale) Mirror 5: 0x4caf5e9e (stale) Mirror 6: 0x1ae63080 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4ef41b57 Mirror 7: 0x4ef41b57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000291 1786170307.499043 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x67b2b652 (stale) Mirror 3: 0x9eee9390 (stale) Mirror 5: 0x4caf5e9e (stale) Mirror 6: 0x1ae63080 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4ef41b57 Mirror 7: 0x4ef41b57 Mirror 8: 0x4ef41b57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000292 1786170309.104399 trunc from 0x040000 to 0x00d2ad (0x32d52 bytes) 000293 1786170309.197643 trunc from 0x00a940 to 0x00bd4e (0x140f bytes) 000294 1786170309.203920 trunc from 0x003b9c to 0x00d2ad (0x9712 bytes) 000295 1786170309.210583 trunc from 0x00d2ae to 0x0208de (0x13631 bytes) 000296 1786170309.239595 trunc from 0x00d483 to 0x010a87 (0x3605 bytes) 000297 1786170309.246922 trunc from 0x0208df to 0x027cb1 (0x73d3 bytes) 000298 1786170309.273739 trunc from 0x004ab6 to 0x00fa33 (0xaf7e bytes) 000299 1786170309.285192 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x27cb2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27cb2): Mirror 2: 0x4c3c37ea (stale) Mirror 3: 0x7c14878b (stale) Mirror 5: 0x85f1d91d (stale) Mirror 6: 0x4feb66cb (stale) Mirror 7: 0xecb1fd87 (stale) Mirror 8: 0xecb1fd87 (stale) CRC-32 checksum value for chunk [0, 0x27cb2): Mirror 1: 0x1bd20da Mirror 9: 0x1bd20da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27cb2: skipped 000300 1786170310.359213 punch from 0x027741 to 0x027cb1 (0x571 bytes) 000301 1786170310.433362 MIRROR_RESYNC 8 mirrors 000302 1786170311.873669 mapread 0x01c911 thru 0x025fd0 (0x96c0 bytes) 000303 1786170311.904017 mapwrite 0x011cfc thru 0x01edf8 (0xd0fd bytes) 000304 1786170312.050003 write 0x02e875 thru 0x03d2ca (0xea56 bytes) 000305 1786170312.053922 write 0x030264 thru 0x039663 (0x9400 bytes) 000306 1786170312.057956 mapread 0x021678 thru 0x028ae0 (0x7469 bytes) 000307 1786170312.079480 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d2cb): Mirror 2: 0x1684277d (stale) Mirror 3: 0x1684277d (stale) Mirror 5: 0x1684277d (stale) Mirror 7: 0x1684277d (stale) Mirror 8: 0x1684277d (stale) Mirror 9: 0x1684277d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2cb): Mirror 2: 0x1684277d (stale) Mirror 3: 0x1684277d (stale) Mirror 5: 0x1684277d (stale) Mirror 7: 0x1684277d (stale) Mirror 8: 0x1684277d (stale) Mirror 9: 0x1684277d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2cb: skipped 000308 1786170312.760439 trunc from 0x03d2cb to 0x02d291 (0x10039 bytes) 000309 1786170312.791000 read 0x026af2 thru 0x02bbcf (0x50de bytes) 000310 1786170312.803449 read 0x01f385 thru 0x021d47 (0x29c3 bytes) 000311 1786170312.839577 fallocate 0x03210d thru 0x032ff1 (0xee5 bytes) 000312 1786170312.846625 trunc from 0x032ff2 to 0x02df2a (0x50c7 bytes) 000313 1786170312.881228 MIRROR_RESYNC 7 mirrors 000314 1786170314.702219 write 0x0230f0 thru 0x02d3ab (0xa2bc bytes) 000315 1786170314.775068 mapread 0x01551c thru 0x01e71d (0x9202 bytes) 000316 1786170314.808788 trunc from 0x0056b0 to 0x005f63 (0x8b4 bytes) 000317 1786170314.822026 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2df2b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df2b): Mirror 2: 0xe1dceb32 (stale) Mirror 3: 0xe1dceb32 (stale) Mirror 5: 0xe1dceb32 (stale) Mirror 7: 0xe1dceb32 (stale) Mirror 8: 0xe1dceb32 (stale) Mirror 9: 0xe1dceb32 (stale) CRC-32 checksum value for chunk [0, 0x2df2b): Mirror 1: 0xcd1644d Mirror 10: 0xcd1644d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df2b: skipped 000318 1786170316.325679 trunc from 0x02df2b to 0x0370d4 (0x91aa bytes) 000319 1786170316.446673 mapread 0x017f1f thru 0x02205f (0xa141 bytes) 000320 1786170316.549762 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x370d5): Mirror 3: 0x95f90cbe (stale) Mirror 5: 0x95f90cbe (stale) Mirror 7: 0x95f90cbe (stale) Mirror 8: 0x95f90cbe (stale) Mirror 9: 0x95f90cbe (stale) Mirror 10: 0x882b719f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x370d5): Mirror 3: 0x95f90cbe (stale) Mirror 5: 0x95f90cbe (stale) Mirror 7: 0x95f90cbe (stale) Mirror 8: 0x95f90cbe (stale) Mirror 9: 0x95f90cbe (stale) Mirror 10: 0x882b719f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x370d5: skipped 000321 1786170317.276028 trunc from 0x01d2d2 to 0x01d3f9 (0x128 bytes) 000322 1786170317.285452 trunc from 0x0010f8 to 0x0014d9 (0x3e2 bytes) 000324 1786170317.295234 punch from 0x00da28 to 0x015b63 (0x813c bytes) 000325 1786170317.303829 punch from 0x00dec8 to 0x0166f2 (0x882b bytes) 000327 1786170317.318193 fallocate 0x026b79 thru 0x02e762 (0x7bea bytes) 000329 1786170317.330095 punch from 0x015d1f to 0x020eee (0xb1d0 bytes) 000330 1786170317.339144 write 0x022ef8 thru 0x02fe36 (0xcf3f bytes) 000331 1786170317.361988 trunc from 0x0370d5 to 0x037de8 (0xd14 bytes) 000334 1786170317.400665 trunc from 0x037de9 to 0x006e54 (0x30f94 bytes) 000335 1786170317.433161 mapread 0x005256 thru 0x006e54 (0x1bff bytes) 000336 1786170317.454562 read 0x003713 thru 0x006e54 (0x3742 bytes) 000340 1786170317.466998 read 0x0018bc thru 0x006298 (0x49dd bytes) 000341 1786170317.474887 write 0x026f19 thru 0x03463c (0xd724 bytes) 000342 1786170317.479438 trunc from 0x03463d to 0x01a7a1 (0x19e9b bytes) 000343 1786170317.506443 mapread 0x00e6d3 thru 0x01103c (0x296a bytes) 000344 1786170317.523603 write 0x0377e9 thru 0x03ffff (0x8817 bytes) 000345 1786170317.526829 punch from 0x02f615 to 0x033a82 (0x446e bytes) 000346 1786170317.532327 read 0x03b6db thru 0x03ffff (0x4925 bytes) 000347 1786170317.533829 mapwrite 0x03cbf4 thru 0x03ffff (0x340c bytes) 000348 1786170317.559169 trunc from 0x02478a to 0x026400 (0x1c77 bytes) 000349 1786170317.570851 mapread 0x02b5a3 thru 0x035db9 (0xa817 bytes) 000350 1786170317.604013 trunc from 0x03ec9e to 0x03ffff (0x1362 bytes) 000351 1786170317.620724 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc5f951aa (stale) Mirror 5: 0xc5f951aa (stale) Mirror 7: 0xc5f951aa (stale) Mirror 8: 0xc5f951aa (stale) Mirror 9: 0xc5f951aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc5f951aa (stale) Mirror 5: 0xc5f951aa (stale) Mirror 7: 0xc5f951aa (stale) Mirror 8: 0xc5f951aa (stale) Mirror 9: 0xc5f951aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000352 1786170318.337135 mapwrite 0x02c143 thru 0x0356dd (0x959b bytes) 000353 1786170318.405638 trunc from 0x02a84b to 0x02f350 (0x4b06 bytes) 000354 1786170318.416195 write 0x00b034 thru 0x00de56 (0x2e23 bytes) 000355 1786170318.453112 MIRROR_RESYNC 6 mirrors 000356 1786170320.791862 mapread 0x032535 thru 0x037ae0 (0x55ac bytes) 000357 1786170320.826446 mapwrite 0x01be92 thru 0x0268d6 (0xaa45 bytes) 000358 1786170320.979323 trunc from 0x003e76 to 0x007607 (0x3792 bytes) 000359 1786170320.988013 fallocate 0x016b07 thru 0x021fff (0xb4f9 bytes) 000360 1786170321.000416 MIRROR_RESYNC 6 mirrors 000361 1786170324.180850 mapread 0x02bb93 thru 0x02eb91 (0x2fff bytes) 000362 1786170324.210360 punch from 0x0264c6 to 0x035850 (0xf38b bytes) 000363 1786170324.254823 trunc from 0x040000 to 0x00b0e9 (0x34f16 bytes) 000364 1786170324.290188 write 0x01ec73 thru 0x02765b (0x89e9 bytes) 000365 1786170324.295967 trunc from 0x02765c to 0x012981 (0x14cda bytes) 000366 1786170324.316877 trunc from 0x003051 to 0x00851f (0x54cf bytes) 000367 1786170324.324696 read 0x0127d9 thru 0x012981 (0x1a9 bytes) 000368 1786170324.338283 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12982): Mirror 3: 0x12e17101 (stale) Mirror 5: 0x12e17101 (stale) Mirror 7: 0x12e17101 (stale) Mirror 9: 0x12e17101 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12982): Mirror 3: 0x12e17101 (stale) Mirror 5: 0x12e17101 (stale) Mirror 7: 0x12e17101 (stale) Mirror 9: 0x12e17101 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12982: skipped 000370 1786170324.833587 mapwrite 0x038959 thru 0x03ffff (0x76a7 bytes) 000371 1786170324.905763 trunc from 0x02f9ed to 0x03a031 (0xa645 bytes) 000372 1786170324.912116 read 0x009df3 thru 0x019d67 (0xff75 bytes) 000373 1786170324.922475 fallocate 0x014d36 thru 0x019bf8 (0x4ec3 bytes) 000374 1786170324.928390 trunc from 0x040000 to 0x029b64 (0x1649b bytes) 000376 1786170324.958904 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x29b65): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b65): Mirror 3: 0x126e3474 (stale) Mirror 5: 0x126e3474 (stale) Mirror 7: 0x126e3474 (stale) Mirror 9: 0x126e3474 (stale) CRC-32 checksum value for chunk [0, 0x29b65): Mirror 1: 0x479d1853 Mirror 10: 0x479d1853 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b65: skipped 000377 1786170326.238149 read 0x0046e7 thru 0x0090de (0x49f8 bytes) 000379 1786170326.271643 read 0x02656f thru 0x029b64 (0x35f6 bytes) 000380 1786170326.318281 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29b65): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b65): Mirror 3: 0x126e3474 (stale) Mirror 5: 0x126e3474 (stale) Mirror 7: 0x126e3474 (stale) Mirror 9: 0x126e3474 (stale) CRC-32 checksum value for chunk [0, 0x29b65): Mirror 1: 0x479d1853 Mirror 10: 0x479d1853 Mirror 11: 0x479d1853 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b65: skipped 000381 1786170327.373267 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x29b65): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b65): Mirror 3: 0x126e3474 (stale) Mirror 5: 0x126e3474 (stale) Mirror 7: 0x126e3474 (stale) Mirror 9: 0x126e3474 (stale) CRC-32 checksum value for chunk [0, 0x29b65): Mirror 1: 0x479d1853 Mirror 10: 0x479d1853 Mirror 11: 0x479d1853 Mirror 12: 0x479d1853 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b65: skipped 000382 1786170328.354202 write 0x03abc3 thru 0x03ffff (0x543d bytes) 000383 1786170328.412537 write 0x03c973 thru 0x03ffff (0x368d bytes) 000384 1786170328.417312 mapwrite 0x03fafa thru 0x03ffff (0x506 bytes) 000385 1786170328.439089 trunc from 0x040000 to 0x03046f (0xfb90 bytes) 000386 1786170328.468181 trunc from 0x019ffb to 0x020f4e (0x6f54 bytes) 000387 1786170328.477874 read 0x024ef1 thru 0x02d356 (0x8466 bytes) 000388 1786170328.494218 punch from 0x007da5 to 0x00d976 (0x5bd2 bytes) 000389 1786170328.501301 trunc from 0x01e6b6 to 0x02dc08 (0xf553 bytes) 000391 1786170328.515750 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x30470): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30470): Mirror 3: 0x27a9710a (stale) Mirror 5: 0x27a9710a (stale) Mirror 7: 0x27a9710a (stale) Mirror 9: 0x27a9710a (stale) Mirror 10: 0xccfc5904 (stale) Mirror 11: 0xccfc5904 (stale) Mirror 12: 0xccfc5904 (stale) CRC-32 checksum value for chunk [0, 0x30470): Mirror 1: 0x9204e218 Mirror 13: 0x9204e218 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30470: skipped 000392 1786170329.929299 fallocate 0x02469d thru 0x02552d (0xe91 bytes) 000393 1786170329.994396 trunc from 0x030470 to 0x010598 (0x1fed7 bytes) 000394 1786170330.076050 fallocate 0x00ba88 thru 0x00f366 (0x38df bytes) 000395 1786170330.086321 read 0x00417b thru 0x005ba2 (0x1a28 bytes) 000396 1786170330.103100 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10599): Mirror 3: 0x530eeb1f (stale) Mirror 5: 0x530eeb1f (stale) Mirror 9: 0x530eeb1f (stale) Mirror 10: 0xd541b1d (stale) Mirror 11: 0xd541b1d (stale) Mirror 12: 0xd541b1d (stale) Mirror 13: 0x6b72dd34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10599): Mirror 3: 0x530eeb1f (stale) Mirror 5: 0x530eeb1f (stale) Mirror 9: 0x530eeb1f (stale) Mirror 10: 0xd541b1d (stale) Mirror 11: 0xd541b1d (stale) Mirror 12: 0xd541b1d (stale) Mirror 13: 0x6b72dd34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10599: skipped 000397 1786170330.794125 mapwrite 0x038c22 thru 0x03df2c (0x530b bytes) 000398 1786170330.875001 mapread 0x025649 thru 0x033bae (0xe566 bytes) 000400 1786170330.903815 MIRROR_RESYNC 8 mirrors 000401 1786170332.415046 mapread 0x0247e1 thru 0x0247e4 (0x4 bytes) 000402 1786170332.432238 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000403 1786170333.000021 write 0x01fc4f thru 0x02ee4f (0xf201 bytes) 000404 1786170333.137755 mapwrite 0x01626d thru 0x01c950 (0x66e4 bytes) 000405 1786170333.234031 fallocate 0x0291d9 thru 0x03226c (0x9094 bytes) 000406 1786170333.242248 mapread 0x02409f thru 0x024861 (0x7c3 bytes) 000408 1786170333.250451 mapread 0x012748 thru 0x0185fd (0x5eb6 bytes) 000409 1786170333.258980 read 0x02cd1f thru 0x03aca9 (0xdf8b bytes) 000410 1786170333.294779 write 0x03d272 thru 0x03d985 (0x714 bytes) 000411 1786170333.306674 fallocate 0x038b5d thru 0x03ffff (0x74a3 bytes) 000412 1786170333.325040 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xf3c33158 (stale) Mirror 10: 0xf3c33158 (stale) Mirror 11: 0xf3c33158 (stale) Mirror 12: 0xf3c33158 (stale) Mirror 13: 0xf3c33158 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xf3c33158 (stale) Mirror 10: 0xf3c33158 (stale) Mirror 11: 0xf3c33158 (stale) Mirror 12: 0xf3c33158 (stale) Mirror 13: 0xf3c33158 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000413 1786170334.069325 trunc from 0x002b54 to 0x002ccb (0x178 bytes) 000414 1786170334.077101 write 0x00528a thru 0x006c82 (0x19f9 bytes) 000415 1786170334.094747 trunc from 0x026c50 to 0x034730 (0xdae1 bytes) 000416 1786170334.113816 MIRROR_RESYNC 6 mirrors 000417 1786170336.874162 trunc from 0x008a17 to 0x00cec6 (0x44b0 bytes) 000418 1786170336.913220 mapwrite 0x030e8c thru 0x03c44c (0xb5c1 bytes) 000419 1786170336.971220 trunc from 0x027a16 to 0x02921f (0x180a bytes) 000420 1786170336.977235 read 0x033b9e thru 0x03ffff (0xc462 bytes) 000422 1786170336.979261 mapwrite 0x018b5a thru 0x028676 (0xfb1d bytes) 000423 1786170337.045968 MIRROR_RESYNC 6 mirrors 000424 1786170339.155011 trunc from 0x040000 to 0x0067a0 (0x3985f bytes) 000426 1786170339.204126 mapwrite 0x0257db thru 0x02749a (0x1cc0 bytes) 000427 1786170339.262753 mapwrite 0x03635f thru 0x03ffff (0x9ca1 bytes) 000428 1786170339.334800 mapread 0x030ab8 thru 0x034844 (0x3d8d bytes) 000429 1786170339.336966 mapwrite 0x0257cd thru 0x026ec5 (0x16f9 bytes) 000430 1786170339.351587 trunc from 0x040000 to 0x018eb9 (0x27146 bytes) 000431 1786170339.376961 write 0x00d692 thru 0x01bad7 (0xe446 bytes) 000432 1786170339.385786 write 0x02ba13 thru 0x032439 (0x6a27 bytes) 000433 1786170339.388743 mapread 0x0316cf thru 0x032439 (0xd6b bytes) 000434 1786170339.390336 write 0x003064 thru 0x00d8de (0xa87b bytes) 000435 1786170339.397740 fallocate 0x00142a thru 0x0054c4 (0x409b bytes) 000436 1786170339.407396 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3243a): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3243a): Mirror 9: 0x68014412 (stale) Mirror 10: 0x68014412 (stale) Mirror 11: 0x68014412 (stale) Mirror 12: 0x68014412 (stale) Mirror 13: 0x68014412 (stale) CRC-32 checksum value for chunk [0, 0x3243a): Mirror 1: 0x3aadcf8c Mirror 14: 0x3aadcf8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3243a: skipped 000437 1786170340.499854 read 0x0151fa thru 0x022bff (0xda06 bytes) 000439 1786170340.547711 mapwrite 0x02f191 thru 0x030fc9 (0x1e39 bytes) 000440 1786170340.680184 trunc from 0x03243a to 0x024a0f (0xda2a bytes) 000441 1786170340.751649 trunc from 0x01bc77 to 0x020e26 (0x51b0 bytes) 000442 1786170340.758606 mapread 0x0217ad thru 0x024a0f (0x3263 bytes) 000443 1786170340.777933 MIRROR_RESYNC 7 mirrors 000444 1786170342.190390 fallocate 0x017936 thru 0x020fa6 (0x9671 bytes) 000445 1786170342.245563 trunc from 0x024a10 to 0x0094e8 (0x1b527 bytes) 000446 1786170342.302623 mapwrite 0x0245c4 thru 0x032f83 (0xe9c0 bytes) 000447 1786170342.402173 mapread 0x0311dd thru 0x032f83 (0x1da7 bytes) 000448 1786170342.414073 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x32f84): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32f84): Mirror 9: 0xe44bdc84 (stale) Mirror 10: 0xe44bdc84 (stale) Mirror 11: 0xe44bdc84 (stale) Mirror 12: 0xe44bdc84 (stale) Mirror 13: 0xe44bdc84 (stale) Mirror 14: 0xe44bdc84 (stale) CRC-32 checksum value for chunk [0, 0x32f84): Mirror 1: 0xb3a259da Mirror 15: 0xb3a259da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32f84: skipped 000449 1786170343.680680 mapread 0x00f302 thru 0x0199b6 (0xa6b5 bytes) 000450 1786170343.729978 fallocate 0x012094 thru 0x01faa8 (0xda15 bytes) 000451 1786170343.787170 write 0x00024c thru 0x008e35 (0x8bea bytes) 000452 1786170343.805321 mapwrite 0x023643 thru 0x0304e6 (0xcea4 bytes) 000453 1786170343.867939 mapwrite 0x01d661 thru 0x02b173 (0xdb13 bytes) 000454 1786170343.894371 mapread 0x0261f5 thru 0x0292c0 (0x30cc bytes) 000455 1786170343.896141 mapread 0x001269 thru 0x006367 (0x50ff bytes) 000457 1786170343.898948 mapread 0x017bf8 thru 0x026000 (0xe409 bytes) 000459 1786170343.912641 fallocate 0x019662 thru 0x026460 (0xcdff bytes) 000461 1786170343.919149 trunc from 0x032f84 to 0x023efc (0xf087 bytes) 000462 1786170343.971169 read 0x00c388 thru 0x01712b (0xada4 bytes) 000463 1786170343.978593 trunc from 0x004b40 to 0x0115ac (0xca6d bytes) 000464 1786170343.990559 trunc from 0x023efd to 0x00d646 (0x168b6 bytes) 000465 1786170344.012000 trunc from 0x00d647 to 0x03e85e (0x31218 bytes) 000466 1786170344.029356 trunc from 0x03e85f to 0x02fcd1 (0xeb8d bytes) 000467 1786170344.046244 fallocate 0x03ae23 thru 0x03ffff (0x51dd bytes) 000468 1786170344.054053 mapread 0x029333 thru 0x02fcd1 (0x699f bytes) 000469 1786170344.074994 fallocate 0x01848a thru 0x0267ce (0xe345 bytes) 000470 1786170344.081166 write 0x030d3e thru 0x033969 (0x2c2c bytes) 000471 1786170344.083933 trunc from 0x020a17 to 0x028227 (0x7811 bytes) 000472 1786170344.094230 mapread 0x02f06b thru 0x032b5f (0x3af5 bytes) 000473 1786170344.097961 mapread 0x00c2a5 thru 0x00e2f4 (0x2050 bytes) 000474 1786170344.118105 fallocate 0x015dda thru 0x0198c1 (0x3ae8 bytes) 000475 1786170344.126120 trunc from 0x01c682 to 0x01df18 (0x1897 bytes) 000476 1786170344.133223 write 0x002292 thru 0x0064d4 (0x4243 bytes) 000477 1786170344.135801 punch from 0x029eed to 0x02a672 (0x786 bytes) 000478 1786170344.143911 read 0x02ca6a thru 0x033969 (0x6f00 bytes) 000479 1786170344.148223 punch from 0x0055e0 to 0x0093e6 (0x3e07 bytes) 000480 1786170344.180487 punch from 0x008c34 to 0x00a68e (0x1a5b bytes) 000482 1786170344.201840 trunc from 0x02710f to 0x02d402 (0x62f4 bytes) 000483 1786170344.212039 punch from 0x015eef to 0x01c78b (0x689d bytes) 000484 1786170344.234574 mapread 0x013f77 thru 0x018947 (0x49d1 bytes) 000485 1786170344.266805 fallocate 0x007e72 thru 0x00d78f (0x591e bytes) 000486 1786170344.280232 mapwrite 0x001468 thru 0x002bdb (0x1774 bytes) 000488 1786170344.313024 mapread 0x000250 thru 0x00ac0d (0xa9be bytes) 000489 1786170344.320276 mapread 0x01a941 thru 0x0201ea (0x58aa bytes) 000490 1786170344.326668 read 0x02f92e thru 0x033969 (0x403c bytes) 000491 1786170344.343379 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3396a): Mirror 9: 0x3cfc425b (stale) Mirror 11: 0x3cfc425b (stale) Mirror 12: 0x3cfc425b (stale) Mirror 13: 0x3cfc425b (stale) Mirror 14: 0x3cfc425b (stale) Mirror 15: 0xd341ecd0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3396a): Mirror 9: 0x3cfc425b (stale) Mirror 11: 0x3cfc425b (stale) Mirror 12: 0x3cfc425b (stale) Mirror 13: 0x3cfc425b (stale) Mirror 14: 0x3cfc425b (stale) Mirror 15: 0xd341ecd0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3396a: skipped 000494 1786170345.082392 read 0x011d25 thru 0x016755 (0x4a31 bytes) 000495 1786170345.097433 write 0x018e10 thru 0x025965 (0xcb56 bytes) 000496 1786170345.155086 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3396a): Mirror 11: 0x3cfc425b (stale) Mirror 12: 0x3cfc425b (stale) Mirror 13: 0x3cfc425b (stale) Mirror 14: 0x3cfc425b (stale) Mirror 15: 0xd341ecd0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3396a): Mirror 11: 0x3cfc425b (stale) Mirror 12: 0x3cfc425b (stale) Mirror 13: 0x3cfc425b (stale) Mirror 14: 0x3cfc425b (stale) Mirror 15: 0xd341ecd0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3396a: skipped 000497 1786170345.836052 read 0x030f83 thru 0x033969 (0x29e7 bytes) 000498 1786170345.850027 fallocate 0x000d98 thru 0x010adf (0xfd48 bytes) 000499 1786170345.858464 mapread 0x011d69 thru 0x019662 (0x78fa bytes) 000500 1786170345.885141 punch from 0x00c8a3 to 0x00ef28 (0x2686 bytes) 000501 1786170345.891958 trunc from 0x008d35 to 0x00d341 (0x460d bytes) 000502 1786170345.898292 punch from 0x000c87 to 0x007f40 (0x72ba bytes) 000503 1786170345.905838 fallocate 0x000145 thru 0x000cc9 (0xb85 bytes) 000504 1786170345.913081 trunc from 0x03396a to 0x011fda (0x2198f bytes) 000505 1786170345.941877 mapwrite 0x03f949 thru 0x03ffff (0x6b7 bytes) 000506 1786170345.999173 MIRROR_RESYNC 6 mirrors 000508 1786170347.598163 punch from 0x01a400 to 0x01d900 (0x3501 bytes) 000510 1786170347.655110 punch from 0x0028d9 to 0x00f570 (0xcc98 bytes) 000511 1786170347.671070 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x274231c3 (stale) Mirror 12: 0x274231c3 (stale) Mirror 13: 0x274231c3 (stale) Mirror 14: 0x274231c3 (stale) Mirror 15: 0x274231c3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x274231c3 Mirror 16: 0x274231c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000512 1786170348.841562 mapread 0x0248b6 thru 0x02d889 (0x8fd4 bytes) 000513 1786170348.913919 mapread 0x00635f thru 0x0154c8 (0xf16a bytes) 000514 1786170348.973848 read 0x01b070 thru 0x029761 (0xe6f2 bytes) 000515 1786170348.990926 read 0x03cd4c thru 0x03d066 (0x31b bytes) 000516 1786170349.019852 write 0x023c78 thru 0x03008b (0xc414 bytes) 000517 1786170349.112750 write 0x013c4d thru 0x019de3 (0x6197 bytes) 000518 1786170349.131662 mapwrite 0x007851 thru 0x011d3d (0xa4ed bytes) 000519 1786170349.270368 trunc from 0x040000 to 0x01e9b4 (0x2164b bytes) 000520 1786170349.311332 mapread 0x017b8e thru 0x01e9b4 (0x6e27 bytes) 000521 1786170349.363855 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1e9b5): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e9b5): Mirror 11: 0x4d7db6dc (stale) Mirror 12: 0x4d7db6dc (stale) Mirror 13: 0x4d7db6dc (stale) Mirror 14: 0x4d7db6dc (stale) Mirror 15: 0x4d7db6dc (stale) Mirror 16: 0x4d7db6dc (stale) CRC-32 checksum value for chunk [0, 0x1e9b5): Mirror 1: 0xb0bcf9b3 Mirror 17: 0xb0bcf9b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e9b5: skipped 000522 1786170350.420973 read 0x0010ea thru 0x010b01 (0xfa18 bytes) 000523 1786170350.443121 trunc from 0x01e9b5 to 0x029324 (0xa970 bytes) 000524 1786170350.571469 fallocate 0x03324e thru 0x03430e (0x10c1 bytes) 000525 1786170350.579618 trunc from 0x0159bc to 0x01796c (0x1fb1 bytes) 000526 1786170350.590206 punch from 0x00b22a to 0x01776e (0xc545 bytes) 000527 1786170350.598810 fallocate 0x0379f7 thru 0x03ffff (0x8609 bytes) 000528 1786170350.606348 write 0x00f30a thru 0x014acf (0x57c6 bytes) 000529 1786170350.627843 punch from 0x02ec99 to 0x03430e (0x5676 bytes) 000530 1786170350.642341 trunc from 0x01e552 to 0x022043 (0x3af2 bytes) 000531 1786170350.660230 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3430f): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3430f): Mirror 11: 0x9f4db995 (stale) Mirror 12: 0x9f4db995 (stale) Mirror 13: 0x9f4db995 (stale) Mirror 14: 0x9f4db995 (stale) Mirror 15: 0x9f4db995 (stale) Mirror 16: 0x9f4db995 (stale) Mirror 17: 0xb09cc85b (stale) CRC-32 checksum value for chunk [0, 0x3430f): Mirror 1: 0x62c3c756 Mirror 18: 0x62c3c756 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3430f: skipped 000532 1786170351.996240 MIRROR_RESYNC 9 mirrors 000534 1786170354.938578 trunc from 0x03430f to 0x02ce1d (0x74f1 bytes) 000535 1786170355.027970 mapwrite 0x02ad88 thru 0x036ce5 (0xbf5e bytes) 000536 1786170355.143460 punch from 0x01dde9 to 0x020e19 (0x3031 bytes) 000537 1786170355.152950 punch from 0x004c77 to 0x0068d1 (0x1c5b bytes) 000538 1786170355.160307 mapwrite 0x030c73 thru 0x032594 (0x1922 bytes) 000539 1786170355.188158 mapread 0x023919 thru 0x0272b9 (0x39a1 bytes) 000540 1786170355.204949 trunc from 0x036ce6 to 0x0079df (0x2f306 bytes) 000541 1786170355.245441 fallocate 0x03c1fd thru 0x03ffff (0x3e03 bytes) 000542 1786170355.253953 punch from 0x006945 to 0x0079df (0x109b bytes) 000543 1786170355.259376 mapwrite 0x01d503 thru 0x020264 (0x2d62 bytes) 000544 1786170355.316182 mapwrite 0x039dec thru 0x03ffff (0x6214 bytes) 000546 1786170355.379004 trunc from 0x02da1b to 0x031657 (0x3c3d bytes) 000547 1786170355.389430 read 0x0391a9 thru 0x03ac80 (0x1ad8 bytes) 000548 1786170355.392404 mapread 0x02a8f1 thru 0x0323ab (0x7abb bytes) 000549 1786170355.410342 trunc from 0x014cda to 0x01e70d (0x9a34 bytes) 000550 1786170355.420548 read 0x03e834 thru 0x03ffff (0x17cc bytes) 000551 1786170355.423203 mapread 0x031b72 thru 0x03ac17 (0x90a6 bytes) 000552 1786170355.428014 fallocate 0x02226b thru 0x029283 (0x7019 bytes) 000553 1786170355.436777 mapread 0x02971a thru 0x037a5e (0xe345 bytes) 000554 1786170355.440655 trunc from 0x040000 to 0x01d97f (0x22680 bytes) 000555 1786170355.468716 punch from 0x0114b7 to 0x01897e (0x74c8 bytes) 000556 1786170355.476655 fallocate 0x015198 thru 0x01d949 (0x87b2 bytes) 000557 1786170355.484792 mapread 0x011af1 thru 0x01313e (0x164e bytes) 000559 1786170355.508888 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1d980): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d980): Mirror 11: 0xd869a42f (stale) Mirror 12: 0xd869a42f (stale) Mirror 13: 0xd869a42f (stale) Mirror 14: 0xd869a42f (stale) Mirror 15: 0xd869a42f (stale) Mirror 16: 0xd869a42f (stale) Mirror 17: 0xd869a42f (stale) Mirror 18: 0xd869a42f (stale) CRC-32 checksum value for chunk [0, 0x1d980): Mirror 1: 0xae505aa2 Mirror 19: 0xae505aa2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d980: skipped 000560 1786170356.850937 write 0x021eb7 thru 0x02dfc6 (0xc110 bytes) 000561 1786170356.912799 write 0x004d88 thru 0x014747 (0xf9c0 bytes) 000562 1786170356.928232 mapwrite 0x0088d4 thru 0x00fd1d (0x744a bytes) 000563 1786170356.952115 read 0x0176af thru 0x026865 (0xf1b7 bytes) 000564 1786170356.972719 punch from 0x028814 to 0x02dfc6 (0x57b3 bytes) 000565 1786170356.979872 trunc from 0x02dfc7 to 0x018d7b (0x1524b bytes) 000567 1786170357.042803 mapread 0x00141e thru 0x0053a0 (0x3f83 bytes) 000568 1786170357.083211 trunc from 0x018d7c to 0x024dfc (0xc081 bytes) 000569 1786170357.114062 mapwrite 0x015187 thru 0x01afc0 (0x5e3a bytes) 000570 1786170357.191115 trunc from 0x02189d to 0x021e35 (0x599 bytes) 000572 1786170357.210692 fallocate 0x0176dd thru 0x01c02c (0x4950 bytes) 000573 1786170357.222788 punch from 0x009514 to 0x00cbd0 (0x36bd bytes) 000574 1786170357.232399 mapwrite 0x02919a thru 0x033401 (0xa268 bytes) 000575 1786170357.310394 trunc from 0x033402 to 0x00518c (0x2e275 bytes) 000576 1786170357.330374 trunc from 0x0018a5 to 0x00518c (0x38e8 bytes) 000577 1786170357.339961 mapwrite 0x01c24e thru 0x021704 (0x54b7 bytes) 000579 1786170357.406110 trunc from 0x0216b7 to 0x021704 (0x4e bytes) 000580 1786170357.427146 fallocate 0x0069d9 thru 0x014514 (0xdb3c bytes) 000581 1786170357.437156 trunc from 0x00deda to 0x01947c (0xb5a3 bytes) 000582 1786170357.446335 punch from 0x00fd02 to 0x0109c7 (0xcc6 bytes) 000583 1786170357.455598 trunc from 0x021705 to 0x00b176 (0x1658e bytes) 000584 1786170357.488941 write 0x037b48 thru 0x03ffff (0x84b8 bytes) 000585 1786170357.502797 punch from 0x01002a to 0x0182b5 (0x828c bytes) 000586 1786170357.514541 trunc from 0x01ded1 to 0x0214f9 (0x3629 bytes) 000587 1786170357.523581 trunc from 0x040000 to 0x019d4a (0x262b5 bytes) 000588 1786170357.545627 mapread 0x018e43 thru 0x019d4a (0xf08 bytes) 000590 1786170357.557013 trunc from 0x019d4b to 0x00fbd4 (0xa176 bytes) 000591 1786170357.585135 fallocate 0x023a8f thru 0x02ca8d (0x8fff bytes) 000592 1786170357.594917 mapwrite 0x01f3c5 thru 0x02511b (0x5d57 bytes) 000593 1786170357.652155 trunc from 0x02511c to 0x00a315 (0x1ae06 bytes) 000594 1786170357.681404 trunc from 0x00a316 to 0x0198c7 (0xf5b2 bytes) 000595 1786170357.706377 mapwrite 0x010917 thru 0x0181e1 (0x78cb bytes) 000596 1786170357.738183 write 0x02867c thru 0x02d364 (0x4ce9 bytes) 000598 1786170357.741894 punch from 0x0022ff to 0x00bebd (0x9bbf bytes) 000599 1786170357.756874 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d365): Mirror 12: 0xfd916890 (stale) Mirror 13: 0xfd916890 (stale) Mirror 14: 0xfd916890 (stale) Mirror 15: 0xfd916890 (stale) Mirror 16: 0xfd916890 (stale) Mirror 17: 0xfd916890 (stale) Mirror 18: 0xfd916890 (stale) Mirror 19: 0x42cf19bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d365): Mirror 12: 0xfd916890 (stale) Mirror 13: 0xfd916890 (stale) Mirror 14: 0xfd916890 (stale) Mirror 15: 0xfd916890 (stale) Mirror 16: 0xfd916890 (stale) Mirror 17: 0xfd916890 (stale) Mirror 18: 0xfd916890 (stale) Mirror 19: 0x42cf19bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d365: skipped 000601 1786170358.445631 fallocate 0x023190 thru 0x0276bd (0x452e bytes) 000602 1786170358.452310 fallocate 0x03cfd5 thru 0x03ffff (0x302b bytes) 000603 1786170358.459804 punch from 0x0280a4 to 0x02d364 (0x52c1 bytes) 000604 1786170358.468277 mapread 0x0288c5 thru 0x02af9a (0x26d6 bytes) 000605 1786170358.493845 write 0x026fa0 thru 0x02a13e (0x319f bytes) 000606 1786170358.505095 fallocate 0x0262f3 thru 0x031e32 (0xbb40 bytes) 000607 1786170358.512157 read 0x02c97a thru 0x031e32 (0x54b9 bytes) 000609 1786170358.521805 fallocate 0x009738 thru 0x00f4f1 (0x5dba bytes) 000610 1786170358.533281 MIRROR_RESYNC 9 mirrors 000611 1786170361.027798 write 0x03672c thru 0x03ffff (0x98d4 bytes) 000612 1786170361.070589 write 0x03ecdf thru 0x03ffff (0x1321 bytes) 000613 1786170361.072017 write 0x02c729 thru 0x03708b (0xa963 bytes) 000614 1786170361.080913 mapwrite 0x03f827 thru 0x03ffff (0x7d9 bytes) 000615 1786170361.119438 mapread 0x0060a4 thru 0x008900 (0x285d bytes) 000616 1786170361.142202 fallocate 0x0240ec thru 0x02f0f4 (0xb009 bytes) 000617 1786170361.148161 punch from 0x036549 to 0x03ffff (0x9ab7 bytes) 000618 1786170361.162893 punch from 0x01a7b3 to 0x025d04 (0xb552 bytes) 000620 1786170361.177054 trunc from 0x02dfb9 to 0x03a025 (0xc06d bytes) 000621 1786170361.196755 write 0x0260a8 thru 0x03293f (0xc898 bytes) 000622 1786170361.235696 mapwrite 0x00c1eb thru 0x00d34c (0x1162 bytes) 000623 1786170361.255639 write 0x00cf82 thru 0x011cf5 (0x4d74 bytes) 000624 1786170361.261479 fallocate 0x0220e6 thru 0x02a4b8 (0x83d3 bytes) 000625 1786170361.267185 mapwrite 0x03626e thru 0x03c56f (0x6302 bytes) 000627 1786170361.286256 mapread 0x00d67a thru 0x012613 (0x4f9a bytes) 000628 1786170361.299108 mapread 0x0223f3 thru 0x02b6dc (0x92ea bytes) 000630 1786170361.313688 trunc from 0x02e7f5 to 0x03c4b8 (0xdcc4 bytes) 000631 1786170361.321084 punch from 0x01a931 to 0x020e52 (0x6522 bytes) 000632 1786170361.330172 fallocate 0x00fe91 thru 0x011354 (0x14c4 bytes) 000633 1786170361.344350 punch from 0x0241b3 to 0x033d63 (0xfbb1 bytes) 000634 1786170361.358803 read 0x02f0e7 thru 0x03121e (0x2138 bytes) 000635 1786170361.379306 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xba353690 (stale) Mirror 13: 0xba353690 (stale) Mirror 14: 0xba353690 (stale) Mirror 15: 0xba353690 (stale) Mirror 16: 0xba353690 (stale) Mirror 17: 0xba353690 (stale) Mirror 18: 0xba353690 (stale) Mirror 19: 0xba353690 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x73a05d4e Mirror 20: 0x73a05d4e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000636 1786170362.594285 trunc from 0x0222cd to 0x02a831 (0x8565 bytes) 000637 1786170362.665068 punch from 0x000c03 to 0x00dbfc (0xcffa bytes) 000638 1786170362.678321 trunc from 0x020b16 to 0x021c60 (0x114b bytes) 000639 1786170362.685588 mapwrite 0x00fce3 thru 0x01dbe6 (0xdf04 bytes) 000640 1786170362.749213 write 0x002aa6 thru 0x01267f (0xfbda bytes) 000641 1786170362.765634 mapread 0x03f011 thru 0x03ffff (0xfef bytes) 000642 1786170362.789898 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xba353690 (stale) Mirror 14: 0xba353690 (stale) Mirror 15: 0xba353690 (stale) Mirror 16: 0xba353690 (stale) Mirror 17: 0xba353690 (stale) Mirror 18: 0xba353690 (stale) Mirror 19: 0xba353690 (stale) Mirror 20: 0x73a05d4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xba353690 (stale) Mirror 14: 0xba353690 (stale) Mirror 15: 0xba353690 (stale) Mirror 16: 0xba353690 (stale) Mirror 17: 0xba353690 (stale) Mirror 18: 0xba353690 (stale) Mirror 19: 0xba353690 (stale) Mirror 20: 0x73a05d4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000643 1786170363.655057 write 0x02eec5 thru 0x038d95 (0x9ed1 bytes) 000644 1786170363.683307 punch from 0x01dfa3 to 0x023bac (0x5c0a bytes) 000645 1786170363.693878 trunc from 0x040000 to 0x00a999 (0x35666 bytes) 000646 1786170363.774738 mapread 0x00405c thru 0x0060f4 (0x2099 bytes) 000647 1786170363.818857 MIRROR_RESYNC 9 mirrors 000648 1786170365.728259 punch from 0x00a403 to 0x00a999 (0x597 bytes) 000649 1786170365.795059 punch from 0x0067c8 to 0x00a999 (0x41d2 bytes) 000650 1786170365.812227 trunc from 0x005001 to 0x00a999 (0x5999 bytes) 000651 1786170365.841004 MIRROR_RESYNC 9 mirrors 000652 1786170367.821674 trunc from 0x00a99a to 0x03ee84 (0x344eb bytes) 000653 1786170367.872106 fallocate 0x01a842 thru 0x01f840 (0x4fff bytes) 000654 1786170367.881107 mapwrite 0x027f6c thru 0x02e2d8 (0x636d bytes) 000655 1786170367.933931 trunc from 0x03ee85 to 0x029752 (0x15732 bytes) 000656 1786170367.959558 fallocate 0x01dc25 thru 0x0225a8 (0x4984 bytes) 000657 1786170367.966115 trunc from 0x01e64a to 0x026700 (0x80b7 bytes) 000658 1786170367.971717 read 0x013428 thru 0x01f8b6 (0xc48f bytes) 000659 1786170367.989906 punch from 0x01bfff to 0x028646 (0xc648 bytes) 000661 1786170367.996775 punch from 0x0090d2 to 0x00c5e4 (0x3513 bytes) 000662 1786170368.002639 fallocate 0x01cfc8 thru 0x01d10c (0x145 bytes) 000663 1786170368.008146 mapwrite 0x00ebaf thru 0x0137b7 (0x4c09 bytes) 000664 1786170368.038719 read 0x01924e thru 0x01b1d2 (0x1f85 bytes) 000665 1786170368.049804 mapwrite 0x0092b8 thru 0x018c63 (0xf9ac bytes) 000666 1786170368.074474 read 0x001209 thru 0x00b072 (0x9e6a bytes) 000667 1786170368.075984 mapread 0x020f71 thru 0x024ae7 (0x3b77 bytes) 000668 1786170368.077620 mapwrite 0x00d692 thru 0x0118d6 (0x4245 bytes) 000669 1786170368.096995 fallocate 0x008f63 thru 0x011873 (0x8911 bytes) 000670 1786170368.103034 write 0x00772f thru 0x009a26 (0x22f8 bytes) 000671 1786170368.104694 mapread 0x005fcd thru 0x007387 (0x13bb bytes) 000672 1786170368.106325 read 0x019370 thru 0x020bfc (0x788d bytes) 000673 1786170368.107480 write 0x00b99a thru 0x01aad5 (0xf13c bytes) 000674 1786170368.109773 read 0x013251 thru 0x01c544 (0x92f4 bytes) 000675 1786170368.110850 punch from 0x01583b to 0x018f25 (0x36eb bytes) 000676 1786170368.129110 trunc from 0x022e4d to 0x029752 (0x6906 bytes) 000677 1786170368.137333 trunc from 0x00e5d1 to 0x00f2ad (0xcdd bytes) 000678 1786170368.143642 trunc from 0x029753 to 0x0142c6 (0x1548c bytes) 000679 1786170368.165994 mapwrite 0x0387a1 thru 0x03ffff (0x785f bytes) 000680 1786170368.235622 trunc from 0x027f41 to 0x029e39 (0x1ef9 bytes) 000681 1786170368.246390 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x11ae05e (stale) Mirror 14: 0x11ae05e (stale) Mirror 15: 0x11ae05e (stale) Mirror 16: 0x11ae05e (stale) Mirror 17: 0x11ae05e (stale) Mirror 18: 0x11ae05e (stale) Mirror 19: 0x11ae05e (stale) Mirror 20: 0x11ae05e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x887ff5fe Mirror 21: 0x887ff5fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000682 1786170369.745181 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x11ae05e (stale) Mirror 14: 0x11ae05e (stale) Mirror 15: 0x11ae05e (stale) Mirror 17: 0x11ae05e (stale) Mirror 18: 0x11ae05e (stale) Mirror 19: 0x11ae05e (stale) Mirror 20: 0x11ae05e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x11ae05e (stale) Mirror 14: 0x11ae05e (stale) Mirror 15: 0x11ae05e (stale) Mirror 17: 0x11ae05e (stale) Mirror 18: 0x11ae05e (stale) Mirror 19: 0x11ae05e (stale) Mirror 20: 0x11ae05e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x887ff5fe Mirror 21: 0x887ff5fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000683 1786170370.722951 read 0x028ceb thru 0x03556f (0xc885 bytes) 000684 1786170370.782611 mapwrite 0x022160 thru 0x02802c (0x5ecd bytes) 000686 1786170371.036112 mapwrite 0x010ac2 thru 0x01b5d4 (0xab13 bytes) 000687 1786170371.150527 punch from 0x001bc7 to 0x00a0b5 (0x84ef bytes) 000688 1786170371.159218 mapread 0x00cde6 thru 0x014642 (0x785d bytes) 000689 1786170371.161390 fallocate 0x038596 thru 0x03ffff (0x7a6a bytes) 000690 1786170371.177681 mapwrite 0x00fe49 thru 0x017b5e (0x7d16 bytes) 000691 1786170371.236891 MIRROR_RESYNC 9 mirrors 000692 1786170374.122426 mapwrite 0x00f5aa thru 0x0193c2 (0x9e19 bytes) 000693 1786170374.283853 trunc from 0x040000 to 0x01d3fe (0x22c01 bytes) 000694 1786170374.320227 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1d3ff): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d3ff): Mirror 13: 0x64412417 (stale) Mirror 14: 0x64412417 (stale) Mirror 15: 0x64412417 (stale) Mirror 17: 0x64412417 (stale) Mirror 18: 0x64412417 (stale) Mirror 19: 0x64412417 (stale) Mirror 20: 0x64412417 (stale) Mirror 21: 0x64412417 (stale) CRC-32 checksum value for chunk [0, 0x1d3ff): Mirror 1: 0xaa25b02f Mirror 22: 0xaa25b02f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d3ff: skipped 000695 1786170375.489707 fallocate 0x0148fe thru 0x018951 (0x4054 bytes) 000696 1786170375.540185 trunc from 0x01c638 to 0x01d3fe (0xdc7 bytes) 000697 1786170375.545168 punch from 0x00fa12 to 0x0175fd (0x7bec bytes) 000698 1786170375.551623 mapread 0x014bee thru 0x01d3fe (0x8811 bytes) 000699 1786170375.576434 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d3ff): Mirror 13: 0x64412417 (stale) Mirror 14: 0x64412417 (stale) Mirror 15: 0x64412417 (stale) Mirror 17: 0x64412417 (stale) Mirror 18: 0x64412417 (stale) Mirror 19: 0x64412417 (stale) Mirror 21: 0x64412417 (stale) Mirror 22: 0xaa25b02f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d3ff): Mirror 13: 0x64412417 (stale) Mirror 14: 0x64412417 (stale) Mirror 15: 0x64412417 (stale) Mirror 17: 0x64412417 (stale) Mirror 18: 0x64412417 (stale) Mirror 19: 0x64412417 (stale) Mirror 21: 0x64412417 (stale) Mirror 22: 0xaa25b02f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d3ff: skipped 000700 1786170376.173767 punch from 0x01b269 to 0x01d3fe (0x2196 bytes) 000701 1786170376.181070 trunc from 0x01135c to 0x01488a (0x352f bytes) 000702 1786170376.189861 trunc from 0x01c2b6 to 0x01d3fe (0x1149 bytes) 000704 1786170376.196376 write 0x02d55f thru 0x03bed7 (0xe979 bytes) 000705 1786170376.203981 write 0x022e78 thru 0x022f3c (0xc5 bytes) 000706 1786170376.211790 punch from 0x02f380 to 0x038f89 (0x9c0a bytes) 000707 1786170376.232324 mapwrite 0x0049ab thru 0x010fff (0xc655 bytes) 000708 1786170376.282419 read 0x00b05c thru 0x0185e2 (0xd587 bytes) 000709 1786170376.292786 trunc from 0x02a6af to 0x02fdbd (0x570f bytes) 000710 1786170376.302068 punch from 0x003cf8 to 0x00b1f3 (0x74fc bytes) 000713 1786170376.309786 mapread 0x01413a thru 0x021a91 (0xd958 bytes) 000714 1786170376.321141 mapread 0x0115fc thru 0x01649e (0x4ea3 bytes) 000715 1786170376.322944 read 0x00759b thru 0x014129 (0xcb8f bytes) 000716 1786170376.339906 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 13: 0x249c6502 (stale) Mirror 14: 0x249c6502 (stale) Mirror 15: 0x249c6502 (stale) Mirror 17: 0x249c6502 (stale) Mirror 19: 0x249c6502 (stale) Mirror 21: 0x249c6502 (stale) Mirror 22: 0x99597949 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 13: 0x249c6502 (stale) Mirror 14: 0x249c6502 (stale) Mirror 15: 0x249c6502 (stale) Mirror 17: 0x249c6502 (stale) Mirror 19: 0x249c6502 (stale) Mirror 21: 0x249c6502 (stale) Mirror 22: 0x99597949 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bed8: skipped 000717 1786170377.021958 trunc from 0x022e4c to 0x024886 (0x1a3b bytes) 000718 1786170377.030197 mapwrite 0x000369 thru 0x00f984 (0xf61c bytes) 000719 1786170377.089436 fallocate 0x009cd9 thru 0x017443 (0xd76b bytes) 000720 1786170377.097919 trunc from 0x009b0c to 0x00eeb5 (0x53aa bytes) 000721 1786170377.108252 MIRROR_RESYNC 8 mirrors 000722 1786170380.323456 mapwrite 0x00bdb8 thru 0x0107f9 (0x4a42 bytes) 000723 1786170380.477423 write 0x01eea8 thru 0x020c59 (0x1db2 bytes) 000724 1786170380.506338 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 13: 0x1bf6e1c2 (stale) Mirror 14: 0x1bf6e1c2 (stale) Mirror 15: 0x1bf6e1c2 (stale) Mirror 17: 0x1bf6e1c2 (stale) Mirror 19: 0x1bf6e1c2 (stale) Mirror 21: 0x1bf6e1c2 (stale) Mirror 22: 0x1bf6e1c2 (stale) CRC-32 checksum value for chunk [0, 0x3bed8): Mirror 1: 0x700e9e5b Mirror 23: 0x700e9e5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bed8: skipped 000727 1786170382.288392 mapwrite 0x012f82 thru 0x01b8a1 (0x8920 bytes) 000728 1786170382.523109 read 0x013c47 thru 0x014f46 (0x1300 bytes) 000729 1786170382.524424 trunc from 0x0177af to 0x023906 (0xc158 bytes) 000730 1786170382.533269 write 0x018bfb thru 0x02043f (0x7845 bytes) 000732 1786170382.561807 mapread 0x00be28 thru 0x013040 (0x7219 bytes) 000733 1786170382.581258 write 0x03f527 thru 0x03ffff (0xad9 bytes) 000734 1786170382.590673 MIRROR_RESYNC 9 mirrors 000735 1786170386.631126 fallocate 0x01a811 thru 0x01b19f (0x98f bytes) 000736 1786170386.673937 punch from 0x03b31b to 0x03ffff (0x4ce5 bytes) 000737 1786170386.684395 trunc from 0x01c3ce to 0x022352 (0x5f85 bytes) 000738 1786170386.695304 trunc from 0x00172f to 0x00fc85 (0xe557 bytes) 000739 1786170386.711081 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x7c22913b (stale) Mirror 14: 0x7c22913b (stale) Mirror 15: 0x7c22913b (stale) Mirror 17: 0x7c22913b (stale) Mirror 19: 0x7c22913b (stale) Mirror 21: 0x7c22913b (stale) Mirror 22: 0x7c22913b (stale) Mirror 23: 0x7c22913b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x53663fba Mirror 24: 0x53663fba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000740 1786170388.092204 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x7c22913b (stale) Mirror 14: 0x7c22913b (stale) Mirror 15: 0x7c22913b (stale) Mirror 17: 0x7c22913b (stale) Mirror 19: 0x7c22913b (stale) Mirror 21: 0x7c22913b (stale) Mirror 22: 0x7c22913b (stale) Mirror 23: 0x7c22913b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x53663fba Mirror 24: 0x53663fba Mirror 25: 0x53663fba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000741 1786170389.270458 read 0x02553d thru 0x0261be (0xc82 bytes) 000742 1786170389.277153 mapwrite 0x015649 thru 0x01a230 (0x4be8 bytes) 000743 1786170389.412206 mapread 0x02abeb thru 0x0343c6 (0x97dc bytes) 000744 1786170389.472271 read 0x03e04b thru 0x03ffff (0x1fb5 bytes) 000745 1786170389.508310 write 0x00f4d4 thru 0x016c98 (0x77c5 bytes) 000746 1786170389.519036 fallocate 0x03b7a0 thru 0x03ffff (0x4860 bytes) 000747 1786170389.529300 trunc from 0x040000 to 0x03741f (0x8be0 bytes) 000748 1786170389.563968 punch from 0x03329c to 0x03741f (0x4184 bytes) 000750 1786170389.572027 trunc from 0x037420 to 0x01d11b (0x1a304 bytes) 000751 1786170389.611250 fallocate 0x011516 thru 0x014fb1 (0x3a9c bytes) 000752 1786170389.630119 punch from 0x016cea to 0x01a1d6 (0x34ed bytes) 000754 1786170389.689263 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1d11c): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d11c): Mirror 13: 0x1dc522b3 (stale) Mirror 14: 0x1dc522b3 (stale) Mirror 15: 0x1dc522b3 (stale) Mirror 17: 0x1dc522b3 (stale) Mirror 19: 0x1dc522b3 (stale) Mirror 21: 0x1dc522b3 (stale) Mirror 22: 0x1dc522b3 (stale) Mirror 23: 0x1dc522b3 (stale) Mirror 24: 0xeee99c91 (stale) Mirror 25: 0xeee99c91 (stale) CRC-32 checksum value for chunk [0, 0x1d11c): Mirror 1: 0xe6a25847 Mirror 26: 0xe6a25847 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d11c: skipped 000755 1786170391.208474 punch from 0x014cd9 to 0x017b87 (0x2eaf bytes) 000756 1786170391.265259 trunc from 0x0138c7 to 0x01d11b (0x9855 bytes) 000757 1786170391.272369 trunc from 0x01d11c to 0x010b10 (0xc60b bytes) 000758 1786170391.297973 trunc from 0x010b11 to 0x02046a (0xf95a bytes) 000759 1786170391.314668 read 0x01c898 thru 0x01cbe3 (0x34c bytes) 000760 1786170391.323313 punch from 0x01d1e3 to 0x02046a (0x3288 bytes) 000761 1786170391.335973 MIRROR_RESYNC 12 mirrors 000762 1786170393.917306 mapread 0x00da33 thru 0x01a2b5 (0xc883 bytes) 000763 1786170393.972202 punch from 0x00772d to 0x00eb6e (0x7442 bytes) 000764 1786170394.044155 punch from 0x011443 to 0x01d4c9 (0xc087 bytes) 000766 1786170394.051248 trunc from 0x00379f to 0x00bf68 (0x87ca bytes) 000767 1786170394.060835 fallocate 0x01f857 thru 0x02dfbf (0xe769 bytes) 000768 1786170394.094988 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2046b): Mirror 13: 0x76ece559 (stale) Mirror 14: 0x76ece559 (stale) Mirror 15: 0x76ece559 (stale) Mirror 17: 0x76ece559 (stale) Mirror 19: 0x76ece559 (stale) Mirror 21: 0x76ece559 (stale) Mirror 22: 0x76ece559 (stale) Mirror 23: 0x76ece559 (stale) Mirror 24: 0x76ece559 (stale) Mirror 25: 0x76ece559 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2046b): Mirror 13: 0x76ece559 (stale) Mirror 14: 0x76ece559 (stale) Mirror 15: 0x76ece559 (stale) Mirror 17: 0x76ece559 (stale) Mirror 19: 0x76ece559 (stale) Mirror 21: 0x76ece559 (stale) Mirror 22: 0x76ece559 (stale) Mirror 23: 0x76ece559 (stale) Mirror 24: 0x76ece559 (stale) Mirror 25: 0x76ece559 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2046b: skipped 000769 1786170394.924079 write 0x000dc5 thru 0x00dc0e (0xce4a bytes) 000771 1786170394.948871 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2046b): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2046b): Mirror 13: 0x76ece559 (stale) Mirror 14: 0x76ece559 (stale) Mirror 15: 0x76ece559 (stale) Mirror 17: 0x76ece559 (stale) Mirror 19: 0x76ece559 (stale) Mirror 21: 0x76ece559 (stale) Mirror 22: 0x76ece559 (stale) Mirror 23: 0x76ece559 (stale) Mirror 24: 0x76ece559 (stale) Mirror 25: 0x76ece559 (stale) CRC-32 checksum value for chunk [0, 0x2046b): Mirror 1: 0xb59f2bf3 Mirror 26: 0xb59f2bf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2046b: skipped 000772 1786170396.351738 MIRROR_RESYNC 12 mirrors 000773 1786170399.269082 mapread 0x0196c8 thru 0x01a35f (0xc98 bytes) 000774 1786170399.301149 trunc from 0x019955 to 0x02046a (0x6b16 bytes) 000775 1786170399.382629 fallocate 0x036787 thru 0x03b037 (0x48b1 bytes) 000776 1786170399.394406 mapread 0x0087e2 thru 0x01631b (0xdb3a bytes) 000777 1786170399.419116 mapread 0x009c18 thru 0x0131a0 (0x9589 bytes) 000778 1786170399.421127 punch from 0x00b391 to 0x018795 (0xd405 bytes) 000779 1786170399.430792 mapwrite 0x035d75 thru 0x039fba (0x4246 bytes) 000780 1786170399.514727 write 0x005aab thru 0x01025a (0xa7b0 bytes) 000781 1786170399.525972 mapread 0x02f068 thru 0x036782 (0x771b bytes) 000782 1786170399.529450 read 0x00c9fe thru 0x0180d4 (0xb6d7 bytes) 000784 1786170399.544332 read 0x021f70 thru 0x028a3e (0x6acf bytes) 000785 1786170399.560406 mapread 0x029b05 thru 0x030d39 (0x7235 bytes) 000786 1786170399.564083 fallocate 0x02da09 thru 0x03be5c (0xe454 bytes) 000787 1786170399.577576 mapread 0x026eb7 thru 0x027239 (0x383 bytes) 000788 1786170399.579910 write 0x03cd8c thru 0x03ffff (0x3274 bytes) 000789 1786170399.584954 mapwrite 0x036050 thru 0x03ffff (0x9fb0 bytes) 000790 1786170399.626032 mapread 0x035ec3 thru 0x038f57 (0x3095 bytes) 000791 1786170399.627451 mapread 0x023699 thru 0x02e3e9 (0xad51 bytes) 000793 1786170399.637660 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4169ba1f (stale) Mirror 14: 0x4169ba1f (stale) Mirror 15: 0x4169ba1f (stale) Mirror 17: 0x4169ba1f (stale) Mirror 19: 0x4169ba1f (stale) Mirror 21: 0x4169ba1f (stale) Mirror 22: 0x4169ba1f (stale) Mirror 23: 0x4169ba1f (stale) Mirror 24: 0x4169ba1f (stale) Mirror 25: 0x4169ba1f (stale) Mirror 26: 0x4169ba1f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x94ccb155 Mirror 27: 0x94ccb155 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000794 1786170401.327897 read 0x002293 thru 0x004610 (0x237e bytes) 000795 1786170401.354395 trunc from 0x02f5d6 to 0x030921 (0x134c bytes) 000796 1786170401.432214 write 0x01c790 thru 0x02a3df (0xdc50 bytes) 000797 1786170401.451806 mapread 0x03cb88 thru 0x03ffff (0x3478 bytes) 000798 1786170401.478675 fallocate 0x01e825 thru 0x02b085 (0xc861 bytes) 000799 1786170401.485835 trunc from 0x040000 to 0x008c45 (0x373ba bytes) 000800 1786170401.517811 punch from 0x005cd0 to 0x00744f (0x1780 bytes) 000801 1786170401.524858 mapread 0x005de0 thru 0x008011 (0x2232 bytes) 000802 1786170401.539318 trunc from 0x00435f to 0x0044d0 (0x172 bytes) 000803 1786170401.546903 write 0x006ca2 thru 0x014657 (0xd9b6 bytes) 000804 1786170401.551834 write 0x000d0e thru 0x005799 (0x4a8c bytes) 000806 1786170401.565806 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14658): Mirror 13: 0x95e08e88 (stale) Mirror 14: 0x95e08e88 (stale) Mirror 17: 0x95e08e88 (stale) Mirror 19: 0x95e08e88 (stale) Mirror 21: 0x95e08e88 (stale) Mirror 22: 0x95e08e88 (stale) Mirror 23: 0x95e08e88 (stale) Mirror 24: 0x95e08e88 (stale) Mirror 25: 0x95e08e88 (stale) Mirror 26: 0x95e08e88 (stale) Mirror 27: 0xa420ecc7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14658): Mirror 13: 0x95e08e88 (stale) Mirror 14: 0x95e08e88 (stale) Mirror 17: 0x95e08e88 (stale) Mirror 19: 0x95e08e88 (stale) Mirror 21: 0x95e08e88 (stale) Mirror 22: 0x95e08e88 (stale) Mirror 23: 0x95e08e88 (stale) Mirror 24: 0x95e08e88 (stale) Mirror 25: 0x95e08e88 (stale) Mirror 26: 0x95e08e88 (stale) Mirror 27: 0xa420ecc7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14658: skipped 000807 1786170402.438846 trunc from 0x014658 to 0x01396d (0xcea bytes) 000808 1786170402.466996 fallocate 0x00d5b5 thru 0x010784 (0x31d0 bytes) 000809 1786170402.475095 trunc from 0x005e4a to 0x01396d (0xdb24 bytes) 000810 1786170402.482228 trunc from 0x00d641 to 0x01396d (0x632d bytes) 000811 1786170402.489621 mapwrite 0x011181 thru 0x016e4e (0x5cce bytes) 000812 1786170402.591185 mapread 0x0050ea thru 0x0072dc (0x21f3 bytes) 000813 1786170402.606172 write 0x02b83d thru 0x02fd03 (0x44c7 bytes) 000814 1786170402.609969 punch from 0x012302 to 0x01af68 (0x8c67 bytes) 000815 1786170402.618209 trunc from 0x02fd04 to 0x032b36 (0x2e33 bytes) 000816 1786170402.656458 fallocate 0x02efc3 thru 0x033c9c (0x4cda bytes) 000817 1786170402.664160 fallocate 0x009c4e thru 0x015c15 (0xbfc8 bytes) 000818 1786170402.672376 mapwrite 0x0367c6 thru 0x03ffff (0x983a bytes) 000819 1786170402.778481 mapread 0x027f3c thru 0x02a3e1 (0x24a6 bytes) 000820 1786170402.792311 mapread 0x02448b thru 0x033365 (0xeedb bytes) 000821 1786170402.795688 read 0x013863 thru 0x021b0e (0xe2ac bytes) 000822 1786170402.813657 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4169ba1f (stale) Mirror 14: 0x4169ba1f (stale) Mirror 17: 0x4169ba1f (stale) Mirror 19: 0x4169ba1f (stale) Mirror 21: 0x4169ba1f (stale) Mirror 22: 0x4169ba1f (stale) Mirror 23: 0x4169ba1f (stale) Mirror 24: 0x4169ba1f (stale) Mirror 25: 0x4169ba1f (stale) Mirror 26: 0x4169ba1f (stale) Mirror 27: 0x94ccb155 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xecee7682 Mirror 28: 0xecee7682 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000823 1786170404.176458 mapread 0x02c930 thru 0x02ec34 (0x2305 bytes) 000825 1786170404.233162 read 0x027f24 thru 0x030d5f (0x8e3c bytes) 000826 1786170404.245326 mapwrite 0x00b256 thru 0x00be32 (0xbdd bytes) 000827 1786170404.392834 mapread 0x011b86 thru 0x019b60 (0x7fdb bytes) 000829 1786170404.415419 mapread 0x02fa53 thru 0x03627c (0x682a bytes) 000830 1786170404.441094 mapwrite 0x039260 thru 0x03ffff (0x6da0 bytes) 000831 1786170404.498710 punch from 0x0289af to 0x02990f (0xf61 bytes) 000832 1786170404.509897 trunc from 0x03561e to 0x039d7b (0x475e bytes) 000834 1786170404.528610 trunc from 0x040000 to 0x0063a6 (0x39c59 bytes) 000835 1786170404.568087 mapwrite 0x00a23c thru 0x01051f (0x62e4 bytes) 000836 1786170404.632043 fallocate 0x000a2a thru 0x007dde (0x73b5 bytes) 000837 1786170404.646727 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x10520): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10520): Mirror 13: 0x62dc714e (stale) Mirror 14: 0x62dc714e (stale) Mirror 17: 0x62dc714e (stale) Mirror 19: 0x62dc714e (stale) Mirror 21: 0x62dc714e (stale) Mirror 22: 0x62dc714e (stale) Mirror 23: 0x62dc714e (stale) Mirror 24: 0x62dc714e (stale) Mirror 25: 0x62dc714e (stale) Mirror 26: 0x62dc714e (stale) Mirror 27: 0xf5ad3c8a (stale) Mirror 28: 0xa2bbfe99 (stale) CRC-32 checksum value for chunk [0, 0x10520): Mirror 1: 0xb017831c Mirror 29: 0xb017831c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10520: skipped 000838 1786170406.072756 write 0x0096c3 thru 0x01402f (0xa96d bytes) 000839 1786170406.191913 punch from 0x012d19 to 0x01402f (0x1317 bytes) 000840 1786170406.232786 write 0x028b7e thru 0x02d6f7 (0x4b7a bytes) 000841 1786170406.245370 mapwrite 0x01c65a thru 0x022ac4 (0x646b bytes) 000843 1786170406.317167 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2d6f8): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d6f8): Mirror 13: 0x77d43685 (stale) Mirror 14: 0x77d43685 (stale) Mirror 17: 0x77d43685 (stale) Mirror 19: 0x77d43685 (stale) Mirror 21: 0x77d43685 (stale) Mirror 22: 0x77d43685 (stale) Mirror 23: 0x77d43685 (stale) Mirror 24: 0x77d43685 (stale) Mirror 25: 0x77d43685 (stale) Mirror 26: 0x77d43685 (stale) Mirror 27: 0xffdf7b6a (stale) Mirror 28: 0xa963382 (stale) Mirror 29: 0x6a2e8dc6 (stale) CRC-32 checksum value for chunk [0, 0x2d6f8): Mirror 1: 0x78e94f7f Mirror 30: 0x78e94f7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d6f8: skipped 000844 1786170408.102816 fallocate 0x014bdd thru 0x01d822 (0x8c46 bytes) 000845 1786170408.171858 read 0x00ab10 thru 0x01269b (0x7b8c bytes) 000846 1786170408.189172 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2d6f8): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d6f8): Mirror 13: 0x77d43685 (stale) Mirror 14: 0x77d43685 (stale) Mirror 17: 0x77d43685 (stale) Mirror 19: 0x77d43685 (stale) Mirror 21: 0x77d43685 (stale) Mirror 22: 0x77d43685 (stale) Mirror 23: 0x77d43685 (stale) Mirror 24: 0x77d43685 (stale) Mirror 25: 0x77d43685 (stale) Mirror 26: 0x77d43685 (stale) Mirror 27: 0xffdf7b6a (stale) Mirror 28: 0xa963382 (stale) Mirror 29: 0x6a2e8dc6 (stale) Mirror 30: 0x78e94f7f (stale) CRC-32 checksum value for chunk [0, 0x2d6f8): Mirror 1: 0x78e94f7f Mirror 31: 0x78e94f7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d6f8: skipped 000848 1786170409.783891 trunc from 0x02d6f8 to 0x000832 (0x2cec5 bytes) 000849 1786170409.910344 read 0x000487 thru 0x000832 (0x3ac bytes) 000850 1786170409.925481 read 0x0006cd thru 0x000832 (0x166 bytes) 000851 1786170409.932084 trunc from 0x000833 to 0x013802 (0x12fd0 bytes) 000853 1786170409.986125 trunc from 0x013803 to 0x013648 (0x1ba bytes) 000854 1786170410.015890 trunc from 0x013649 to 0x038776 (0x2512e bytes) 000855 1786170410.056437 trunc from 0x02eb2f to 0x03861f (0x9af1 bytes) 000857 1786170410.070405 mapread 0x029819 thru 0x02e8d9 (0x50c1 bytes) 000858 1786170410.099390 trunc from 0x038777 to 0x025dfb (0x1297b bytes) 000860 1786170410.149780 read 0x003c8b thru 0x0137f2 (0xfb68 bytes) 000861 1786170410.152264 mapwrite 0x01b972 thru 0x02a175 (0xe804 bytes) 000862 1786170410.241977 fallocate 0x036762 thru 0x03ffff (0x989e bytes) 000863 1786170410.251126 punch from 0x0316e8 to 0x0364e4 (0x4dfd bytes) 000864 1786170410.263120 mapread 0x02f6ae thru 0x033501 (0x3e54 bytes) 000865 1786170410.285818 read 0x019e84 thru 0x023be1 (0x9d5e bytes) 000867 1786170410.288320 fallocate 0x003050 thru 0x01068e (0xd63f bytes) 000868 1786170410.296245 trunc from 0x007513 to 0x015b31 (0xe61f bytes) 000869 1786170410.304287 punch from 0x000120 to 0x00a59e (0xa47f bytes) 000871 1786170410.315062 write 0x037d45 thru 0x03ffff (0x82bb bytes) 000872 1786170410.318101 write 0x020fe3 thru 0x02b509 (0xa527 bytes) 000873 1786170410.322177 fallocate 0x03b264 thru 0x03fcc2 (0x4a5f bytes) 000874 1786170410.330460 trunc from 0x040000 to 0x0270ff (0x18f00 bytes) 000875 1786170410.354931 fallocate 0x010009 thru 0x01c439 (0xc431 bytes) 000876 1786170410.363788 punch from 0x00b4d6 to 0x00fc3e (0x4769 bytes) 000878 1786170410.372175 trunc from 0x027100 to 0x028c89 (0x1b8a bytes) 000879 1786170410.396697 trunc from 0x00a623 to 0x00f785 (0x5163 bytes) 000880 1786170410.404869 fallocate 0x01ee42 thru 0x02d78b (0xe94a bytes) 000881 1786170410.418054 MIRROR_RESYNC 16 mirrors 000882 1786170414.431399 write 0x02cdca thru 0x036beb (0x9e22 bytes) 000884 1786170414.495753 write 0x039992 thru 0x03ffff (0x666e bytes) 000885 1786170414.499282 read 0x012460 thru 0x01d6bb (0xb25c bytes) 000886 1786170414.507399 punch from 0x017fc2 to 0x01bf47 (0x3f86 bytes) 000887 1786170414.514757 punch from 0x02aaec to 0x0319cb (0x6ee0 bytes) 000888 1786170414.545691 fallocate 0x02a00b thru 0x032b63 (0x8b59 bytes) 000889 1786170414.562933 MIRROR_RESYNC 16 mirrors 000890 1786170419.254412 mapread 0x02e2a1 thru 0x03c1ec (0xdf4c bytes) 000891 1786170419.305887 fallocate 0x030afa thru 0x03b7a4 (0xacab bytes) 000892 1786170419.373055 mapwrite 0x02268b thru 0x02a69d (0x8013 bytes) 000894 1786170419.416977 write 0x018177 thru 0x01f994 (0x781e bytes) 000895 1786170419.425717 trunc from 0x032b2d to 0x036a07 (0x3edb bytes) 000896 1786170419.436831 trunc from 0x00d77a to 0x00d89c (0x123 bytes) 000897 1786170419.444746 write 0x0220fe thru 0x02722c (0x512f bytes) 000899 1786170419.450173 write 0x0241d8 thru 0x02accb (0x6af4 bytes) 000901 1786170419.456098 mapread 0x016fc9 thru 0x0239c6 (0xc9fe bytes) 000902 1786170419.474607 write 0x0192a4 thru 0x024257 (0xafb4 bytes) 000903 1786170419.480113 fallocate 0x02565e thru 0x02ee6c (0x980f bytes) 000905 1786170419.491474 trunc from 0x040000 to 0x03e953 (0x16ac bytes) 000906 1786170419.527141 write 0x0351f5 thru 0x03ffff (0xae0b bytes) 000907 1786170419.536892 read 0x00900f thru 0x018015 (0xf007 bytes) 000908 1786170419.548728 mapread 0x0241e3 thru 0x029be1 (0x59ff bytes) 000909 1786170419.552557 punch from 0x02396c to 0x02fe45 (0xc4da bytes) 000910 1786170419.579707 mapread 0x02e98f thru 0x03877b (0x9ded bytes) 000911 1786170419.597459 punch from 0x03286f to 0x03bbf5 (0x9387 bytes) 000912 1786170419.606108 read 0x00c1d3 thru 0x00ebb7 (0x29e5 bytes) 000913 1786170419.607268 mapread 0x0329e4 thru 0x0379e8 (0x5005 bytes) 000914 1786170419.630918 write 0x03bce8 thru 0x03ffff (0x4318 bytes) 000915 1786170419.637330 mapread 0x00b491 thru 0x016adb (0xb64b bytes) 000916 1786170419.642080 mapread 0x03a43e thru 0x03ffff (0x5bc2 bytes) 000917 1786170419.644999 mapread 0x01c5a1 thru 0x029b8d (0xd5ed bytes) 000918 1786170419.648014 trunc from 0x0157bd to 0x01e55f (0x8da3 bytes) 000919 1786170419.655379 read 0x00f612 thru 0x01f083 (0xfa72 bytes) 000920 1786170419.669813 trunc from 0x0136db to 0x0153d4 (0x1cfa bytes) 000921 1786170419.676467 trunc from 0x03b91d to 0x03e93b (0x301f bytes) 000922 1786170419.696122 mapwrite 0x01d0b9 thru 0x02cf60 (0xfea8 bytes) 000924 1786170419.730092 fallocate 0x0107c3 thru 0x01bcee (0xb52c bytes) 000925 1786170419.742164 trunc from 0x01ba55 to 0x01d622 (0x1bce bytes) 000926 1786170419.751450 write 0x00f581 thru 0x0176a7 (0x8127 bytes) 000927 1786170419.757388 trunc from 0x026225 to 0x02e6fd (0x84d9 bytes) 000928 1786170419.768759 trunc from 0x040000 to 0x0146f0 (0x2b90f bytes) 000931 1786170419.810456 read 0x00225a thru 0x00f591 (0xd338 bytes) 000932 1786170419.816170 write 0x01092a thru 0x01ebba (0xe291 bytes) 000933 1786170419.818226 mapread 0x001164 thru 0x010536 (0xf3d3 bytes) 000934 1786170419.823426 write 0x02b213 thru 0x02bc64 (0xa52 bytes) 000935 1786170419.830629 trunc from 0x02bc65 to 0x02e82e (0x2bca bytes) 000936 1786170419.886549 write 0x013851 thru 0x015d30 (0x24e0 bytes) 000937 1786170419.893630 write 0x038d1e thru 0x039d93 (0x1076 bytes) 000939 1786170419.898416 mapwrite 0x03b339 thru 0x03ffff (0x4cc7 bytes) 000941 1786170420.008146 read 0x01d93b thru 0x02aa7c (0xd142 bytes) 000942 1786170420.009397 write 0x03e835 thru 0x03ffff (0x17cb bytes) 000943 1786170420.011246 read 0x00c687 thru 0x0187d0 (0xc14a bytes) 000945 1786170420.013223 read 0x01da37 thru 0x023dbc (0x6386 bytes) 000946 1786170420.014327 read 0x02d707 thru 0x02f479 (0x1d73 bytes) 000947 1786170420.019186 fallocate 0x0335f1 thru 0x03eb2b (0xb53b bytes) 000948 1786170420.029394 read 0x036357 thru 0x03e587 (0x8231 bytes) 000949 1786170420.031100 mapread 0x03fadb thru 0x03ffff (0x525 bytes) 000950 1786170420.032631 mapwrite 0x006bd6 thru 0x00d103 (0x652e bytes) 000951 1786170420.071753 fallocate 0x03d45d thru 0x03ffff (0x2ba3 bytes) 000954 1786170420.085140 mapread 0x003fbe thru 0x013ccf (0xfd12 bytes) 000955 1786170420.089641 punch from 0x031ff5 to 0x03ff4c (0xdf58 bytes) 000957 1786170420.101566 read 0x00e282 thru 0x00f019 (0xd98 bytes) 000958 1786170420.111896 MIRROR_RESYNC 16 mirrors 000960 1786170424.490318 write 0x007f14 thru 0x010139 (0x8226 bytes) 000961 1786170424.547358 punch from 0x006125 to 0x006f1c (0xdf8 bytes) 000962 1786170424.561655 MIRROR_RESYNC 16 mirrors 000963 1786170428.611466 trunc from 0x02873a to 0x0338ee (0xb1b5 bytes) 000964 1786170428.656715 write 0x00caeb thru 0x0158a6 (0x8dbc bytes) 000965 1786170428.670365 read 0x01ca22 thru 0x01f5e6 (0x2bc5 bytes) 000966 1786170428.678155 read 0x03b78b thru 0x03ffff (0x4875 bytes) 000968 1786170428.696683 punch from 0x01fdf0 to 0x023f53 (0x4164 bytes) 000969 1786170428.704367 trunc from 0x040000 to 0x025630 (0x1a9cf bytes) 000970 1786170428.756276 read 0x01f35f thru 0x025630 (0x62d2 bytes) 000972 1786170428.775472 fallocate 0x036305 thru 0x03ffff (0x9cfb bytes) 000973 1786170428.784326 mapread 0x0348f8 thru 0x039149 (0x4852 bytes) 000974 1786170428.826860 punch from 0x01b5ec to 0x020df1 (0x5806 bytes) 000975 1786170428.841180 mapwrite 0x0082eb thru 0x00cec6 (0x4bdc bytes) 000976 1786170428.886970 write 0x031aa3 thru 0x033eea (0x2448 bytes) 000977 1786170428.889870 punch from 0x02bf4c to 0x033bbb (0x7c70 bytes) 000979 1786170428.908920 punch from 0x00afa0 to 0x01a2e9 (0xf34a bytes) 000980 1786170428.917456 trunc from 0x040000 to 0x00d262 (0x32d9d bytes) 000982 1786170428.956450 MIRROR_RESYNC 16 mirrors 000983 1786170432.648458 trunc from 0x000af0 to 0x0030ec (0x25fd bytes) 000984 1786170432.698479 punch from 0x006810 to 0x00d262 (0x6a53 bytes) 000985 1786170432.706675 mapwrite 0x022e87 thru 0x02df26 (0xb0a0 bytes) 000986 1786170432.790762 write 0x0089bb thru 0x00f0cc (0x6712 bytes) 000987 1786170432.805347 write 0x01f02d thru 0x02826a (0x923e bytes) 000988 1786170432.808758 mapwrite 0x0347ad thru 0x03ffff (0xb853 bytes) 000989 1786170432.890305 mapread 0x01bf58 thru 0x023281 (0x732a bytes) 000990 1786170432.916248 MIRROR_RESYNC 16 mirrors 000991 1786170438.701164 write 0x038a8f thru 0x038c54 (0x1c6 bytes) 000992 1786170438.764410 read 0x01c954 thru 0x02b039 (0xe6e6 bytes) 000993 1786170438.797143 trunc from 0x007367 to 0x01106b (0x9d05 bytes) 000994 1786170438.812857 write 0x02fdc2 thru 0x03dc2d (0xde6c bytes) 000995 1786170438.848784 MIRROR_RESYNC 16 mirrors 000996 1786170443.588262 mapread 0x015018 thru 0x020255 (0xb23e bytes) 000998 1786170443.627922 fallocate 0x02d1f3 thru 0x02dac0 (0x8ce bytes) 000999 1786170443.681057 mapwrite 0x03a73a thru 0x03ffff (0x58c6 bytes) All operations completed A-OK!