== sanity-flr test 70a: flr mode fsx test ================ 17:03:52 (1788901432) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 1433 000001 1788901433.241709 mapwrite 0x01250f thru 0x012f75 (0xa67 bytes) fallocating to largest ever: 0x31c96 000002 1788901433.290927 fallocate 0x030b8a thru 0x031c95 (0x110c bytes) 000003 1788901433.299800 MIRROR_EXTEND to 2 mirrors 000004 1788901433.751372 mapread 0x00108e thru 0x00517c (0x40ef bytes) 000005 1788901433.782591 punch from 0x00be72 to 0x012f75 (0x7104 bytes) 000006 1788901433.814139 punch from 0x00d28a to 0x012f75 (0x5cec bytes) 000007 1788901433.817092 fallocate 0x017af1 thru 0x01a5c0 (0x2ad0 bytes) 000008 1788901433.820247 read 0x00c315 thru 0x0180f9 (0xbde5 bytes) fallocating to largest ever: 0x40000 000009 1788901433.828398 fallocate 0x03eea4 thru 0x03ffff (0x115c bytes) 000010 1788901433.833656 mapwrite 0x00e64e thru 0x01e3d2 (0xfd85 bytes) 000011 1788901433.873252 fallocate 0x01f1ae thru 0x02d5b6 (0xe409 bytes) 000012 1788901433.879305 write 0x007db0 thru 0x0084ff (0x750 bytes) 000013 1788901433.894033 punch from 0x00460f to 0x008e41 (0x4833 bytes) 000014 1788901433.908823 trunc from 0x01c39f to 0x01dbe6 (0x1848 bytes) 000015 1788901433.917163 mapread 0x01c895 thru 0x028dc9 (0xc535 bytes) 000016 1788901433.938450 punch from 0x03c675 to 0x03ffff (0x398b bytes) 000017 1788901433.946372 mapwrite 0x022e46 thru 0x02a5e0 (0x779b bytes) 000018 1788901433.974777 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x34292637 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x98e157a4 Mirror 3: 0x98e157a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000019 1788901434.693026 trunc from 0x0308c1 to 0x03fb56 (0xf296 bytes) 000020 1788901434.724157 trunc from 0x00aaee to 0x0125da (0x7aed bytes) 000021 1788901434.727940 trunc from 0x040000 to 0x01be2a (0x241d5 bytes) 000022 1788901434.758556 mapwrite 0x034357 thru 0x03ffff (0xbca9 bytes) 000023 1788901434.829502 mapread 0x0046e0 thru 0x0104b6 (0xbdd7 bytes) 000024 1788901434.838200 mapread 0x02256c thru 0x02e57c (0xc011 bytes) 000025 1788901434.851397 punch from 0x03d1d9 to 0x03ffff (0x2e27 bytes) 000026 1788901434.857231 punch from 0x03436e to 0x03ffff (0xbc92 bytes) 000027 1788901434.861254 punch from 0x029347 to 0x0358ac (0xc566 bytes) 000028 1788901434.869623 fallocate 0x0354b4 thru 0x03977e (0x42cb bytes) 000029 1788901434.875431 trunc from 0x040000 to 0x002dab (0x3d254 bytes) 000030 1788901434.900398 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2dac): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dac): Mirror 2: 0x56997298 (stale) Mirror 3: 0x56997298 (stale) CRC-32 checksum value for chunk [0, 0x2dac): Mirror 1: 0x56997298 Mirror 4: 0x56997298 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dac: skipped 000031 1788901435.484102 fallocate 0x020ab5 thru 0x021df2 (0x133e bytes) 000032 1788901435.518693 fallocate 0x02b21e thru 0x03a111 (0xeef4 bytes) 000033 1788901435.522672 fallocate 0x01b0c7 thru 0x02217c (0x70b6 bytes) 000034 1788901435.527563 punch from 0x0008ca to 0x002dab (0x24e2 bytes) 000035 1788901435.532334 mapread 0x001ba3 thru 0x002dab (0x1209 bytes) 000036 1788901435.542793 fallocate 0x026be0 thru 0x03388a (0xccab bytes) 000037 1788901435.547292 trunc from 0x002dac to 0x00c5e4 (0x9839 bytes) 000038 1788901435.567919 read 0x00c408 thru 0x00c5e4 (0x1dd bytes) 000039 1788901435.573132 read 0x007851 thru 0x00c5e4 (0x4d94 bytes) 000040 1788901435.583631 write 0x009f44 thru 0x013977 (0x9a34 bytes) 000041 1788901435.585579 read 0x01336a thru 0x013977 (0x60e bytes) 000042 1788901435.586144 trunc from 0x009e23 to 0x013977 (0x9b55 bytes) 000043 1788901435.597175 fallocate 0x004810 thru 0x00910c (0x48fd bytes) 000044 1788901435.600491 trunc from 0x0114cd to 0x013977 (0x24ab bytes) 000045 1788901435.607060 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x13978): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13978): Mirror 2: 0xf1a09aa8 (stale) Mirror 3: 0xf1504b67 (stale) Mirror 4: 0x63882442 (stale) CRC-32 checksum value for chunk [0, 0x13978): Mirror 1: 0x63882442 Mirror 5: 0x63882442 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13978: skipped 000046 1788901436.230214 fallocate 0x016ccb thru 0x0198bf (0x2bf5 bytes) 000047 1788901436.285066 trunc from 0x00f9fc to 0x0198bf (0x9ec4 bytes) 000048 1788901436.293918 mapread 0x013f8f thru 0x0198bf (0x5931 bytes) 000049 1788901436.313996 trunc from 0x009341 to 0x0169a9 (0xd669 bytes) 000050 1788901436.319063 read 0x011731 thru 0x0162b5 (0x4b85 bytes) 000051 1788901436.334224 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x198c0): Mirror 2: 0xc1fe6379 (stale) Mirror 4: 0x6a89f57 (stale) Mirror 5: 0x6a89f57 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x198c0): Mirror 2: 0xc1fe6379 (stale) Mirror 4: 0x6a89f57 (stale) Mirror 5: 0x6a89f57 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x198c0: skipped 000052 1788901436.625465 trunc from 0x0198c0 to 0x005366 (0x14559 bytes) 000053 1788901436.672647 mapread 0x001b85 thru 0x005366 (0x37e2 bytes) 000054 1788901436.690537 punch from 0x003eb6 to 0x005366 (0x14b1 bytes) 000055 1788901436.694452 mapread 0x0027e3 thru 0x005366 (0x2b84 bytes) 000056 1788901436.698415 read 0x0018a3 thru 0x001a3d (0x19b bytes) 000057 1788901436.699218 fallocate 0x033d1a thru 0x03ef74 (0xb25b bytes) 000058 1788901436.704559 read 0x004823 thru 0x005366 (0xb44 bytes) 000059 1788901436.705363 trunc from 0x0048e9 to 0x005366 (0xa7e bytes) 000060 1788901436.708553 trunc from 0x0020d5 to 0x002aca (0x9f6 bytes) 000061 1788901436.712462 trunc from 0x004d4a to 0x005366 (0x61d bytes) 000062 1788901436.722363 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x5367): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5367): Mirror 2: 0xc6a2dd62 (stale) Mirror 4: 0xc6a2dd62 (stale) Mirror 5: 0xc6a2dd62 (stale) CRC-32 checksum value for chunk [0, 0x5367): Mirror 1: 0xc6a2dd62 Mirror 6: 0xc6a2dd62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5367: skipped 000063 1788901437.318423 mapread 0x002e36 thru 0x005366 (0x2531 bytes) 000065 1788901437.356260 fallocate 0x031805 thru 0x0328c2 (0x10be bytes) 000066 1788901437.392882 trunc from 0x00045d to 0x000abc (0x660 bytes) 000067 1788901437.400494 read 0x001fbd thru 0x005366 (0x33aa bytes) 000068 1788901437.409958 read 0x004430 thru 0x005366 (0xf37 bytes) 000069 1788901437.410808 punch from 0x00229c to 0x005366 (0x30cb bytes) 000070 1788901437.414358 punch from 0x004e1d to 0x005366 (0x54a bytes) 000071 1788901437.422231 read 0x000ae6 thru 0x005366 (0x4881 bytes) 000072 1788901437.431335 fallocate 0x02f624 thru 0x030ec1 (0x189e bytes) 000074 1788901437.438676 MIRROR_RESYNC 5 mirrors 000075 1788901438.056509 write 0x02031a thru 0x02a148 (0x9e2f bytes) 000076 1788901438.087810 mapwrite 0x006185 thru 0x0145c6 (0xe442 bytes) 000077 1788901438.131764 read 0x01f075 thru 0x02278a (0x3716 bytes) 000078 1788901438.135446 read 0x01946c thru 0x01ff5c (0x6af1 bytes) 000079 1788901438.141669 mapwrite 0x037067 thru 0x03ca9d (0x5a37 bytes) 000080 1788901438.193935 write 0x00078d thru 0x003414 (0x2c88 bytes) 000081 1788901438.195195 fallocate 0x02fe1f thru 0x036f0d (0x70ef bytes) 000083 1788901438.202967 read 0x029c50 thru 0x0388d7 (0xec88 bytes) 000084 1788901438.203922 trunc from 0x03ca9e to 0x02a877 (0x12226 bytes) 000085 1788901438.227047 trunc from 0x01169e to 0x0148a3 (0x3206 bytes) 000086 1788901438.232908 trunc from 0x02a878 to 0x035652 (0xaddb bytes) 000087 1788901438.253316 trunc from 0x023d2b to 0x023dc9 (0x9f bytes) 000088 1788901438.258980 punch from 0x01fd99 to 0x021c3e (0x1ea6 bytes) 000089 1788901438.264523 read 0x02720b thru 0x02bc85 (0x4a7b bytes) 000090 1788901438.273444 write 0x038394 thru 0x03fdb8 (0x7a25 bytes) 000091 1788901438.276016 trunc from 0x03fdb9 to 0x031865 (0xe553 bytes) 000092 1788901438.292287 punch from 0x00a92e to 0x00d33b (0x2a0e bytes) 000093 1788901438.296255 write 0x02bec8 thru 0x02e880 (0x29b9 bytes) 000095 1788901438.297801 write 0x036e34 thru 0x039e35 (0x3002 bytes) 000096 1788901438.300146 fallocate 0x0130bc thru 0x01c809 (0x974e bytes) 000097 1788901438.304108 mapwrite 0x007842 thru 0x00f612 (0x7dd1 bytes) 000098 1788901438.333039 mapwrite 0x005e53 thru 0x012ff9 (0xd1a7 bytes) 000099 1788901438.355100 MIRROR_RESYNC 5 mirrors 000100 1788901439.653405 mapread 0x0150d0 thru 0x0180e5 (0x3016 bytes) 000101 1788901439.666431 fallocate 0x033380 thru 0x03edba (0xba3b bytes) 000102 1788901439.692299 punch from 0x024de3 to 0x02db0c (0x8d2a bytes) 000103 1788901439.696828 trunc from 0x039e36 to 0x00e53b (0x2b8fa bytes) 000106 1788901439.725629 trunc from 0x00e53c to 0x006c2d (0x790e bytes) 000107 1788901439.743482 mapwrite 0x01aa08 thru 0x0274c4 (0xcabd bytes) 000108 1788901439.821986 mapwrite 0x00363e thru 0x00d6a3 (0xa066 bytes) 000109 1788901439.857518 mapwrite 0x008ea5 thru 0x00bbaa (0x2d06 bytes) 000110 1788901439.878085 trunc from 0x00db6d to 0x01230a (0x479e bytes) 000111 1788901439.883312 fallocate 0x03015c thru 0x0343ba (0x425f bytes) 000112 1788901439.897075 read 0x01c009 thru 0x025d95 (0x9d8d bytes) 000113 1788901439.899990 read 0x01abe0 thru 0x01ce11 (0x2232 bytes) 000114 1788901439.913312 fallocate 0x0343dc thru 0x039118 (0x4d3d bytes) 000115 1788901439.920153 write 0x030ef0 thru 0x0381ba (0x72cb bytes) 000116 1788901439.924059 fallocate 0x029713 thru 0x030d44 (0x7632 bytes) 000117 1788901439.932028 MIRROR_RESYNC 5 mirrors 000118 1788901440.981203 read 0x001807 thru 0x00eb3f (0xd339 bytes) 000119 1788901440.991931 mapwrite 0x03dcdc thru 0x03ffff (0x2324 bytes) 000120 1788901441.068683 read 0x00762d thru 0x016702 (0xf0d6 bytes) 000121 1788901441.091544 MIRROR_RESYNC 5 mirrors 000122 1788901442.205157 fallocate 0x0191c1 thru 0x0251be (0xbffe bytes) 000123 1788901442.247477 trunc from 0x003f25 to 0x006c3a (0x2d16 bytes) 000125 1788901442.253302 trunc from 0x00f9d2 to 0x018b4d (0x917c bytes) 000126 1788901442.258075 fallocate 0x02d22a thru 0x02eeda (0x1cb1 bytes) 000127 1788901442.262108 mapwrite 0x02646e thru 0x0347e6 (0xe379 bytes) 000128 1788901442.315331 read 0x018f77 thru 0x023edd (0xaf67 bytes) 000129 1788901442.323534 punch from 0x0348a4 to 0x03dce7 (0x9444 bytes) 000130 1788901442.327507 fallocate 0x005dc3 thru 0x00ebd1 (0x8e0f bytes) 000131 1788901442.332195 trunc from 0x040000 to 0x02d469 (0x12b96 bytes) 000133 1788901442.377198 read 0x0168f6 thru 0x017a21 (0x112c bytes) 000134 1788901442.390811 fallocate 0x02cda0 thru 0x03b967 (0xebc8 bytes) 000135 1788901442.395998 trunc from 0x02292f to 0x02b429 (0x8afb bytes) 000137 1788901442.400882 punch from 0x0216bf to 0x026410 (0x4d52 bytes) 000139 1788901442.406040 read 0x018d04 thru 0x019cf5 (0xff2 bytes) 000140 1788901442.406458 mapread 0x01eeec thru 0x02c73f (0xd854 bytes) 000141 1788901442.413989 mapwrite 0x037d34 thru 0x03d3b7 (0x5684 bytes) 000142 1788901442.461589 fallocate 0x02cc86 thru 0x030920 (0x3c9b bytes) 000143 1788901442.472072 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d3b8): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3b8): Mirror 2: 0xd02a655e (stale) Mirror 4: 0xd02a655e (stale) Mirror 5: 0xd02a655e (stale) Mirror 6: 0xd02a655e (stale) CRC-32 checksum value for chunk [0, 0x3d3b8): Mirror 1: 0x2101834a Mirror 7: 0x2101834a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3b8: skipped 000144 1788901443.220147 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d3b8): Mirror 2: 0xd02a655e (stale) Mirror 4: 0xd02a655e (stale) Mirror 5: 0xd02a655e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3b8): Mirror 2: 0xd02a655e (stale) Mirror 4: 0xd02a655e (stale) Mirror 5: 0xd02a655e (stale) CRC-32 checksum value for chunk [0, 0x3d3b8): Mirror 1: 0x2101834a Mirror 7: 0x2101834a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3b8: skipped 000145 1788901443.828835 punch from 0x013015 to 0x01b64e (0x863a bytes) 000146 1788901443.867887 trunc from 0x03d3b8 to 0x00c201 (0x311b6 bytes) 000147 1788901443.919668 mapread 0x002fb6 thru 0x00bd27 (0x8d72 bytes) 000148 1788901443.949445 read 0x006059 thru 0x007448 (0x13f0 bytes) 000150 1788901443.951881 trunc from 0x0025bf to 0x00a247 (0x7c89 bytes) 000152 1788901443.956322 trunc from 0x00a284 to 0x00c201 (0x1f7e bytes) 000153 1788901443.966439 read 0x003121 thru 0x00c201 (0x90e1 bytes) 000154 1788901443.978622 trunc from 0x00c202 to 0x0033e5 (0x8e1c bytes) 000155 1788901443.999444 MIRROR_RESYNC 5 mirrors 000156 1788901444.617789 fallocate 0x03116c thru 0x031c1c (0xab1 bytes) 000157 1788901444.659202 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x31c1d): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c1d): Mirror 2: 0x73dd7007 (stale) Mirror 4: 0x73dd7007 (stale) Mirror 5: 0x73dd7007 (stale) Mirror 7: 0x73dd7007 (stale) CRC-32 checksum value for chunk [0, 0x31c1d): Mirror 1: 0x73dd7007 Mirror 8: 0x73dd7007 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c1d: skipped 000158 1788901445.339546 trunc from 0x00a277 to 0x0134b8 (0x9242 bytes) 000159 1788901445.367961 mapwrite 0x017dd4 thru 0x01cbb5 (0x4de2 bytes) 000160 1788901445.400340 read 0x0039da thru 0x00ec45 (0xb26c bytes) 000162 1788901445.409239 write 0x014dff thru 0x0197af (0x49b1 bytes) 000164 1788901445.414576 mapread 0x020211 thru 0x02c9fe (0xc7ee bytes) 000165 1788901445.437302 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x31c1d): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c1d): Mirror 2: 0x73dd7007 (stale) Mirror 4: 0x73dd7007 (stale) Mirror 5: 0x73dd7007 (stale) Mirror 7: 0x73dd7007 (stale) Mirror 8: 0x73dd7007 (stale) CRC-32 checksum value for chunk [0, 0x31c1d): Mirror 1: 0x4a85afd0 Mirror 9: 0x4a85afd0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c1d: skipped 000166 1788901446.075616 write 0x01f68f thru 0x02da95 (0xe407 bytes) 000167 1788901446.109631 punch from 0x025577 to 0x02da93 (0x851d bytes) 000169 1788901446.124708 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31c1d): Mirror 4: 0x73dd7007 (stale) Mirror 5: 0x73dd7007 (stale) Mirror 7: 0x73dd7007 (stale) Mirror 8: 0x73dd7007 (stale) Mirror 9: 0x4a85afd0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c1d): Mirror 4: 0x73dd7007 (stale) Mirror 5: 0x73dd7007 (stale) Mirror 7: 0x73dd7007 (stale) Mirror 8: 0x73dd7007 (stale) Mirror 9: 0x4a85afd0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c1d: skipped 000170 1788901446.402437 trunc from 0x031c1d to 0x020384 (0x11898 bytes) 000171 1788901446.441178 fallocate 0x00873a thru 0x0128b4 (0xa17b bytes) 000172 1788901446.446767 fallocate 0x00cdf4 thru 0x017329 (0xa536 bytes) 000173 1788901446.451497 trunc from 0x020385 to 0x0141ca (0xc1ba bytes) 000174 1788901446.473106 trunc from 0x00954a to 0x00c149 (0x2c00 bytes) 000175 1788901446.478462 punch from 0x00c76e to 0x0141ca (0x7a5d bytes) 000176 1788901446.483432 mapread 0x006596 thru 0x0141ca (0xdc35 bytes) 000177 1788901446.510775 punch from 0x011265 to 0x0141ca (0x2f66 bytes) 000178 1788901446.517243 mapwrite 0x03aaa1 thru 0x03ffff (0x555f bytes) 000179 1788901446.558686 punch from 0x02a3e0 to 0x02be6b (0x1a8c bytes) 000180 1788901446.563527 mapwrite 0x02ec9a thru 0x03c434 (0xd79b bytes) 000181 1788901446.594864 mapread 0x005fe6 thru 0x00b01f (0x503a bytes) 000182 1788901446.595950 mapread 0x01ff77 thru 0x02fd47 (0xfdd1 bytes) 000183 1788901446.605212 punch from 0x023a87 to 0x02fa72 (0xbfec bytes) 000184 1788901446.609591 trunc from 0x017675 to 0x0187df (0x116b bytes) 000185 1788901446.614480 mapread 0x02848a thru 0x028796 (0x30d bytes) 000186 1788901446.631307 MIRROR_RESYNC 6 mirrors 000187 1788901447.570010 MIRROR_RESYNC 6 mirrors 000188 1788901447.855591 trunc from 0x040000 to 0x034b77 (0xb488 bytes) 000189 1788901447.893864 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x34b78): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b78): Mirror 4: 0xbe3d29e5 (stale) Mirror 5: 0xbe3d29e5 (stale) Mirror 7: 0xbe3d29e5 (stale) Mirror 8: 0xbe3d29e5 (stale) Mirror 9: 0xbe3d29e5 (stale) CRC-32 checksum value for chunk [0, 0x34b78): Mirror 1: 0xbe3d29e5 Mirror 10: 0xbe3d29e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b78: skipped 000190 1788901448.582004 mapread 0x0092bf thru 0x012164 (0x8ea6 bytes) 000192 1788901448.614788 mapwrite 0x0178f7 thru 0x021c9e (0xa3a8 bytes) 000193 1788901448.724889 trunc from 0x034b78 to 0x003f45 (0x30c32 bytes) 000194 1788901448.759852 trunc from 0x00026d to 0x003f45 (0x3cd9 bytes) 000195 1788901448.764079 fallocate 0x022c11 thru 0x030330 (0xd720 bytes) 000196 1788901448.768686 mapwrite 0x0393a6 thru 0x039eb2 (0xb0d bytes) 000197 1788901448.809376 write 0x0367fb thru 0x03ffff (0x9805 bytes) 000198 1788901448.814771 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd923f85c (stale) Mirror 5: 0xd923f85c (stale) Mirror 7: 0xd923f85c (stale) Mirror 8: 0xd923f85c (stale) Mirror 9: 0xd923f85c (stale) Mirror 10: 0xa8bf6ab8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcd19cff0 Mirror 11: 0xcd19cff0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000199 1788901449.441602 mapwrite 0x0113da thru 0x01618c (0x4db3 bytes) 000200 1788901449.549344 fallocate 0x005226 thru 0x007bc8 (0x29a3 bytes) 000201 1788901449.558143 read 0x02e9f3 thru 0x03405d (0x566b bytes) 000202 1788901449.572949 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd923f85c (stale) Mirror 5: 0xd923f85c (stale) Mirror 7: 0xd923f85c (stale) Mirror 8: 0xd923f85c (stale) Mirror 9: 0xd923f85c (stale) Mirror 10: 0xa8bf6ab8 (stale) Mirror 11: 0xcd19cff0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf567f80a Mirror 12: 0xf567f80a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000203 1788901450.359694 mapread 0x004eed thru 0x00c03a (0x714e bytes) 000204 1788901450.395302 mapread 0x0069fc thru 0x0099c7 (0x2fcc bytes) 000206 1788901450.411494 punch from 0x0135f0 to 0x01b239 (0x7c4a bytes) 000207 1788901450.441622 trunc from 0x0207e1 to 0x0224f0 (0x1d10 bytes) 000208 1788901450.445357 punch from 0x005295 to 0x00f6f9 (0xa465 bytes) 000209 1788901450.450663 read 0x01f2d0 thru 0x02b07d (0xbdae bytes) 000210 1788901450.465698 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd923f85c (stale) Mirror 5: 0xd923f85c (stale) Mirror 7: 0xd923f85c (stale) Mirror 8: 0xd923f85c (stale) Mirror 9: 0xd923f85c (stale) Mirror 10: 0xa8bf6ab8 (stale) Mirror 11: 0xcd19cff0 (stale) Mirror 12: 0xf567f80a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc10dc89d Mirror 13: 0xc10dc89d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000211 1788901451.260654 fallocate 0x03b9b5 thru 0x03ffff (0x464b bytes) 000212 1788901451.287359 trunc from 0x001dfe to 0x00285f (0xa62 bytes) 000213 1788901451.298326 MIRROR_RESYNC 10 mirrors 000214 1788901452.821218 trunc from 0x040000 to 0x02e2e7 (0x11d18 bytes) 000215 1788901452.859469 trunc from 0x02e2e8 to 0x0086c8 (0x25c1f bytes) 000216 1788901452.872518 punch from 0x001489 to 0x0086c8 (0x7240 bytes) 000217 1788901452.876583 mapread 0x006df9 thru 0x0086c8 (0x18d0 bytes) 000218 1788901452.895481 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x86c9): Mirror 4: 0x244fe28a (stale) Mirror 5: 0x244fe28a (stale) Mirror 7: 0x244fe28a (stale) Mirror 8: 0x244fe28a (stale) Mirror 9: 0x244fe28a (stale) Mirror 11: 0x244fe28a (stale) Mirror 12: 0x244fe28a (stale) Mirror 13: 0x244fe28a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x86c9): Mirror 4: 0x244fe28a (stale) Mirror 5: 0x244fe28a (stale) Mirror 7: 0x244fe28a (stale) Mirror 8: 0x244fe28a (stale) Mirror 9: 0x244fe28a (stale) Mirror 11: 0x244fe28a (stale) Mirror 12: 0x244fe28a (stale) Mirror 13: 0x244fe28a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x86c9: skipped 000219 1788901453.234158 mapwrite 0x0151cf thru 0x024ce3 (0xfb15 bytes) 000220 1788901453.304568 trunc from 0x024ce4 to 0x01192c (0x133b7 bytes) 000221 1788901453.321113 read 0x0061b6 thru 0x00f60b (0x9456 bytes) 000222 1788901453.329897 trunc from 0x001a25 to 0x00729a (0x5876 bytes) 000223 1788901453.337850 fallocate 0x029349 thru 0x03258e (0x9246 bytes) 000224 1788901453.343482 read 0x004ec7 thru 0x00b35b (0x6495 bytes) 000226 1788901453.353508 trunc from 0x01192d to 0x00d9bf (0x3f6d bytes) 000227 1788901453.363621 fallocate 0x019411 thru 0x019f35 (0xb25 bytes) 000228 1788901453.368814 fallocate 0x00627d thru 0x00c9da (0x675e bytes) 000229 1788901453.373577 mapwrite 0x02630d thru 0x02d136 (0x6e2a bytes) 000230 1788901453.413242 read 0x022655 thru 0x02d136 (0xaae2 bytes) 000231 1788901453.414699 read 0x01a5d2 thru 0x020ad7 (0x6506 bytes) 000232 1788901453.417001 trunc from 0x019c4b to 0x0253a5 (0xb75b bytes) 000233 1788901453.423234 punch from 0x02a065 to 0x02d136 (0x30d2 bytes) 000234 1788901453.431790 read 0x01dbc7 thru 0x029c34 (0xc06e bytes) 000235 1788901453.441101 mapwrite 0x03b17c thru 0x03f18c (0x4011 bytes) 000237 1788901453.488761 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 4: 0xd9af9b69 (stale) Mirror 5: 0xd9af9b69 (stale) Mirror 7: 0xd9af9b69 (stale) Mirror 8: 0xd9af9b69 (stale) Mirror 9: 0xd9af9b69 (stale) Mirror 11: 0xd9af9b69 (stale) Mirror 12: 0xd9af9b69 (stale) Mirror 13: 0xd9af9b69 (stale) CRC-32 checksum value for chunk [0, 0x3f18d): Mirror 1: 0xdfce2233 Mirror 14: 0xdfce2233 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f18d: skipped 000238 1788901454.234888 mapread 0x012ba9 thru 0x021cfe (0xf156 bytes) 000240 1788901454.277985 fallocate 0x03255e thru 0x03ffff (0xdaa2 bytes) 000241 1788901454.312424 punch from 0x009b12 to 0x00a5fc (0xaeb bytes) 000242 1788901454.315943 read 0x02bdd1 thru 0x039bb7 (0xdde7 bytes) 000245 1788901454.325594 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc10dc89d (stale) Mirror 5: 0xc10dc89d (stale) Mirror 7: 0xc10dc89d (stale) Mirror 8: 0xc10dc89d (stale) Mirror 9: 0xc10dc89d (stale) Mirror 11: 0xc10dc89d (stale) Mirror 12: 0xc10dc89d (stale) Mirror 13: 0xc10dc89d (stale) Mirror 14: 0xe06283e0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe06283e0 Mirror 15: 0xe06283e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000247 1788901455.132225 trunc from 0x029556 to 0x035dca (0xc875 bytes) 000248 1788901455.168140 mapread 0x008b53 thru 0x010f71 (0x841f bytes) 000249 1788901455.188807 punch from 0x03f2bc to 0x03f982 (0x6c7 bytes) 000250 1788901455.194998 mapwrite 0x0328eb thru 0x03ef47 (0xc65d bytes) 000251 1788901455.230243 fallocate 0x016383 thru 0x019a39 (0x36b7 bytes) 000252 1788901455.235218 read 0x0022fa thru 0x0051f4 (0x2efb bytes) 000253 1788901455.242901 punch from 0x0154ba to 0x015c1d (0x764 bytes) 000254 1788901455.256694 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc10dc89d (stale) Mirror 5: 0xc10dc89d (stale) Mirror 7: 0xc10dc89d (stale) Mirror 8: 0xc10dc89d (stale) Mirror 9: 0xc10dc89d (stale) Mirror 11: 0xc10dc89d (stale) Mirror 12: 0xc10dc89d (stale) Mirror 13: 0xc10dc89d (stale) Mirror 14: 0xe06283e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc10dc89d (stale) Mirror 5: 0xc10dc89d (stale) Mirror 7: 0xc10dc89d (stale) Mirror 8: 0xc10dc89d (stale) Mirror 9: 0xc10dc89d (stale) Mirror 11: 0xc10dc89d (stale) Mirror 12: 0xc10dc89d (stale) Mirror 13: 0xc10dc89d (stale) Mirror 14: 0xe06283e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000255 1788901455.749165 mapwrite 0x0009de thru 0x009af3 (0x9116 bytes) 000256 1788901455.804279 mapwrite 0x03b588 thru 0x03ffff (0x4a78 bytes) 000257 1788901455.827334 mapwrite 0x00f818 thru 0x012df3 (0x35dc bytes) 000258 1788901455.849524 mapread 0x02f39e thru 0x03d0d0 (0xdd33 bytes) 000259 1788901455.862780 fallocate 0x00a5d7 thru 0x01712e (0xcb58 bytes) 000260 1788901455.870547 trunc from 0x038581 to 0x03f8dd (0x735d bytes) 000262 1788901455.888662 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc10dc89d (stale) Mirror 5: 0xc10dc89d (stale) Mirror 7: 0xc10dc89d (stale) Mirror 8: 0xc10dc89d (stale) Mirror 9: 0xc10dc89d (stale) Mirror 11: 0xc10dc89d (stale) Mirror 12: 0xc10dc89d (stale) Mirror 13: 0xc10dc89d (stale) Mirror 14: 0xe06283e0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1f4cc81 Mirror 15: 0x1f4cc81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1788901456.725122 read 0x00a909 thru 0x017c22 (0xd31a bytes) 000264 1788901456.740406 trunc from 0x040000 to 0x037de1 (0x821e bytes) 000265 1788901456.785522 mapwrite 0x0359f4 thru 0x03ffff (0xa60c bytes) 000266 1788901456.836573 trunc from 0x040000 to 0x018d90 (0x2726f bytes) 000267 1788901456.848418 mapread 0x009121 thru 0x0165de (0xd4be bytes) 000268 1788901456.860081 mapwrite 0x01d4d2 thru 0x0253aa (0x7ed9 bytes) 000269 1788901456.890536 MIRROR_RESYNC 11 mirrors 000270 1788901458.526877 trunc from 0x0253ab to 0x0181ba (0xd1f0 bytes) 000271 1788901458.570345 MIRROR_RESYNC 11 mirrors 000272 1788901460.158450 trunc from 0x011de0 to 0x0181ba (0x63db bytes) 000273 1788901460.185698 trunc from 0x0181bb to 0x03de53 (0x25c99 bytes) 000275 1788901460.205963 fallocate 0x01031a thru 0x01051b (0x202 bytes) 000276 1788901460.210079 punch from 0x03a5f7 to 0x03de53 (0x385d bytes) 000277 1788901460.213652 punch from 0x038df8 to 0x03de53 (0x505c bytes) 000278 1788901460.220072 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3de54): Mirror 4: 0x631ad8b0 (stale) Mirror 5: 0x631ad8b0 (stale) Mirror 7: 0x631ad8b0 (stale) Mirror 8: 0x631ad8b0 (stale) Mirror 9: 0x631ad8b0 (stale) Mirror 11: 0x631ad8b0 (stale) Mirror 12: 0x631ad8b0 (stale) Mirror 14: 0x631ad8b0 (stale) Mirror 15: 0x631ad8b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de54): Mirror 4: 0x631ad8b0 (stale) Mirror 5: 0x631ad8b0 (stale) Mirror 7: 0x631ad8b0 (stale) Mirror 8: 0x631ad8b0 (stale) Mirror 9: 0x631ad8b0 (stale) Mirror 11: 0x631ad8b0 (stale) Mirror 12: 0x631ad8b0 (stale) Mirror 14: 0x631ad8b0 (stale) Mirror 15: 0x631ad8b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de54: skipped 000279 1788901460.640580 fallocate 0x00c1aa thru 0x018d47 (0xcb9e bytes) 000280 1788901460.645380 read 0x007a88 thru 0x0156ed (0xdc66 bytes) 000281 1788901460.658006 MIRROR_RESYNC 10 mirrors 000282 1788901462.292901 trunc from 0x01170a to 0x01191f (0x216 bytes) 000283 1788901462.325678 mapwrite 0x01e60c thru 0x029897 (0xb28c bytes) 000284 1788901462.376343 trunc from 0x00c17d to 0x015ffe (0x9e82 bytes) 000285 1788901462.384324 punch from 0x00898e to 0x011d99 (0x940c bytes) 000287 1788901462.388626 write 0x02c3d7 thru 0x02ed20 (0x294a bytes) 000288 1788901462.391619 fallocate 0x01d1b8 thru 0x02638d (0x91d6 bytes) 000289 1788901462.396131 punch from 0x02fd50 to 0x0385a4 (0x8855 bytes) 000290 1788901462.402198 mapwrite 0x027104 thru 0x0271a0 (0x9d bytes) 000291 1788901462.423319 read 0x00a79f thru 0x01645f (0xbcc1 bytes) 000292 1788901462.438040 read 0x037bd7 thru 0x03de53 (0x627d bytes) 000293 1788901462.445003 mapread 0x0051c8 thru 0x0066e9 (0x1522 bytes) 000294 1788901462.445947 punch from 0x020881 to 0x02b601 (0xad81 bytes) 000295 1788901462.450829 fallocate 0x014216 thru 0x01a4ef (0x62da bytes) 000296 1788901462.454941 trunc from 0x03de54 to 0x01b265 (0x22bee bytes) 000297 1788901462.478985 punch from 0x00ed71 to 0x010a58 (0x1ce8 bytes) 000298 1788901462.487033 MIRROR_RESYNC 10 mirrors 000299 1788901463.599897 punch from 0x00dca8 to 0x016256 (0x85af bytes) 000300 1788901463.637320 trunc from 0x0193fb to 0x01b265 (0x1e6b bytes) 000301 1788901463.641648 punch from 0x010d25 to 0x01396b (0x2c47 bytes) 000302 1788901463.646844 mapwrite 0x00b055 thru 0x00dbd0 (0x2b7c bytes) 000303 1788901463.690913 trunc from 0x01b266 to 0x03a0a9 (0x1ee44 bytes) 000305 1788901463.711269 write 0x01b964 thru 0x01f59e (0x3c3b bytes) 000306 1788901463.721172 write 0x0371ac thru 0x03ffff (0x8e54 bytes) 000307 1788901463.727580 read 0x010bcf thru 0x01edca (0xe1fc bytes) 000308 1788901463.738114 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8c096dd6 (stale) Mirror 5: 0x8c096dd6 (stale) Mirror 7: 0x8c096dd6 (stale) Mirror 8: 0x8c096dd6 (stale) Mirror 9: 0x8c096dd6 (stale) Mirror 11: 0x8c096dd6 (stale) Mirror 12: 0x8c096dd6 (stale) Mirror 14: 0x8c096dd6 (stale) Mirror 15: 0x8c096dd6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x46b8bcb Mirror 16: 0x46b8bcb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000309 1788901464.607413 trunc from 0x01f4a9 to 0x02af79 (0xbad1 bytes) 000310 1788901464.659202 mapwrite 0x00e367 thru 0x0141c6 (0x5e60 bytes) 000311 1788901464.691989 mapwrite 0x02fad2 thru 0x03b878 (0xbda7 bytes) 000313 1788901464.729997 read 0x018b43 thru 0x028054 (0xf512 bytes) 000315 1788901464.739581 trunc from 0x037a62 to 0x03d2c2 (0x5861 bytes) 000316 1788901464.744991 punch from 0x007175 to 0x010f91 (0x9e1d bytes) 000317 1788901464.749974 mapread 0x02bce3 thru 0x02cc71 (0xf8f bytes) 000318 1788901464.750889 read 0x00ec66 thru 0x01bceb (0xd086 bytes) 000319 1788901464.762133 MIRROR_RESYNC 11 mirrors 000320 1788901467.464846 read 0x03bdab thru 0x03ffff (0x4255 bytes) 000322 1788901467.469971 mapread 0x03dcda thru 0x03ffff (0x2326 bytes) 000323 1788901467.471031 trunc from 0x040000 to 0x01410b (0x2bef4 bytes) 000324 1788901467.524683 mapread 0x0059db thru 0x01410b (0xe731 bytes) 000325 1788901467.550925 mapread 0x005cd7 thru 0x00eb13 (0x8e3d bytes) 000326 1788901467.552019 write 0x0206cc thru 0x02f6cc (0xf001 bytes) 000328 1788901467.553947 punch from 0x021d92 to 0x02c7e1 (0xaa50 bytes) 000329 1788901467.568497 mapread 0x02a2d8 thru 0x02f6cc (0x53f5 bytes) 000330 1788901467.577896 punch from 0x00566b to 0x0083a5 (0x2d3b bytes) 000331 1788901467.582114 mapwrite 0x03ff23 thru 0x03ffff (0xdd bytes) 000333 1788901467.620841 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x23900679 (stale) Mirror 7: 0x23900679 (stale) Mirror 8: 0x23900679 (stale) Mirror 9: 0x23900679 (stale) Mirror 11: 0x23900679 (stale) Mirror 12: 0x23900679 (stale) Mirror 14: 0x23900679 (stale) Mirror 15: 0x23900679 (stale) Mirror 16: 0x23900679 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x23900679 (stale) Mirror 7: 0x23900679 (stale) Mirror 8: 0x23900679 (stale) Mirror 9: 0x23900679 (stale) Mirror 11: 0x23900679 (stale) Mirror 12: 0x23900679 (stale) Mirror 14: 0x23900679 (stale) Mirror 15: 0x23900679 (stale) Mirror 16: 0x23900679 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000335 1788901468.022106 mapwrite 0x0398c3 thru 0x03ffff (0x673d bytes) 000336 1788901468.068206 mapread 0x01258f thru 0x020a24 (0xe496 bytes) 000337 1788901468.090559 write 0x016fee thru 0x01c978 (0x598b bytes) 000338 1788901468.095585 read 0x012bee thru 0x01a686 (0x7a99 bytes) 000340 1788901468.101176 MIRROR_RESYNC 10 mirrors 000341 1788901470.498003 MIRROR_RESYNC 10 mirrors 000342 1788901470.961405 punch from 0x038f45 to 0x03ffff (0x70bb bytes) 000344 1788901470.987897 read 0x02c890 thru 0x031073 (0x47e4 bytes) 000345 1788901471.000308 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbfc7c4df (stale) Mirror 7: 0xbfc7c4df (stale) Mirror 8: 0xbfc7c4df (stale) Mirror 11: 0xbfc7c4df (stale) Mirror 12: 0xbfc7c4df (stale) Mirror 14: 0xbfc7c4df (stale) Mirror 15: 0xbfc7c4df (stale) Mirror 16: 0xbfc7c4df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbfc7c4df (stale) Mirror 7: 0xbfc7c4df (stale) Mirror 8: 0xbfc7c4df (stale) Mirror 11: 0xbfc7c4df (stale) Mirror 12: 0xbfc7c4df (stale) Mirror 14: 0xbfc7c4df (stale) Mirror 15: 0xbfc7c4df (stale) Mirror 16: 0xbfc7c4df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000346 1788901471.362789 mapread 0x00caf9 thru 0x0164f2 (0x99fa bytes) 000348 1788901471.378595 write 0x00ce91 thru 0x01449f (0x760f bytes) 000349 1788901471.385425 fallocate 0x0060c3 thru 0x00fbdc (0x9b1a bytes) 000350 1788901471.398065 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbfc7c4df (stale) Mirror 7: 0xbfc7c4df (stale) Mirror 8: 0xbfc7c4df (stale) Mirror 11: 0xbfc7c4df (stale) Mirror 12: 0xbfc7c4df (stale) Mirror 14: 0xbfc7c4df (stale) Mirror 15: 0xbfc7c4df (stale) Mirror 16: 0xbfc7c4df (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdad79237 Mirror 17: 0xdad79237 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000351 1788901472.278424 trunc from 0x040000 to 0x018b37 (0x274c8 bytes) 000352 1788901472.319783 punch from 0x00afbf to 0x018b09 (0xdb4b bytes) 000353 1788901472.324576 mapread 0x00ff46 thru 0x0177d9 (0x7894 bytes) 000354 1788901472.345304 mapwrite 0x020bbe thru 0x0248ef (0x3d32 bytes) 000355 1788901472.395977 fallocate 0x00bd29 thru 0x013147 (0x741f bytes) 000356 1788901472.406462 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x248f0): Mirror 5: 0xae32c9ff (stale) Mirror 7: 0xae32c9ff (stale) Mirror 8: 0xae32c9ff (stale) Mirror 11: 0xae32c9ff (stale) Mirror 12: 0xae32c9ff (stale) Mirror 14: 0xae32c9ff (stale) Mirror 15: 0xae32c9ff (stale) Mirror 16: 0xae32c9ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x248f0): Mirror 5: 0xae32c9ff (stale) Mirror 7: 0xae32c9ff (stale) Mirror 8: 0xae32c9ff (stale) Mirror 11: 0xae32c9ff (stale) Mirror 12: 0xae32c9ff (stale) Mirror 14: 0xae32c9ff (stale) Mirror 15: 0xae32c9ff (stale) Mirror 16: 0xae32c9ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x248f0: skipped 000357 1788901472.847451 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x248f0): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x248f0): Mirror 5: 0xae32c9ff (stale) Mirror 7: 0xae32c9ff (stale) Mirror 8: 0xae32c9ff (stale) Mirror 11: 0xae32c9ff (stale) Mirror 12: 0xae32c9ff (stale) Mirror 14: 0xae32c9ff (stale) Mirror 15: 0xae32c9ff (stale) Mirror 16: 0xae32c9ff (stale) CRC-32 checksum value for chunk [0, 0x248f0): Mirror 1: 0xe2fa98e7 Mirror 17: 0xe2fa98e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x248f0: skipped 000358 1788901473.634076 mapwrite 0x028a5b thru 0x02fc50 (0x71f6 bytes) 000359 1788901473.703984 write 0x020005 thru 0x02a7cb (0xa7c7 bytes) 000361 1788901473.711101 mapwrite 0x0039e3 thru 0x007392 (0x39b0 bytes) 000362 1788901473.733923 write 0x0234d5 thru 0x02e81f (0xb34b bytes) 000364 1788901473.736458 trunc from 0x02fc51 to 0x037a90 (0x7e40 bytes) 000365 1788901473.756425 read 0x0181b7 thru 0x01ced4 (0x4d1e bytes) 000366 1788901473.771630 MIRROR_RESYNC 10 mirrors 000367 1788901475.570523 mapwrite 0x011bde thru 0x0186a0 (0x6ac3 bytes) 000368 1788901475.654347 mapwrite 0x00436c thru 0x00aa22 (0x66b7 bytes) 000369 1788901475.682877 MIRROR_RESYNC 10 mirrors 000370 1788901477.582749 mapread 0x003c8c thru 0x00f7c4 (0xbb39 bytes) 000371 1788901477.603284 mapread 0x029a05 thru 0x037a90 (0xe08c bytes) 000372 1788901477.624774 fallocate 0x00172d thru 0x002538 (0xe0c bytes) 000373 1788901477.646771 trunc from 0x037a91 to 0x03a03b (0x25ab bytes) 000374 1788901477.659081 trunc from 0x00d368 to 0x014441 (0x70da bytes) 000375 1788901477.666750 trunc from 0x03a03c to 0x0104e2 (0x29b59 bytes) 000376 1788901477.689824 MIRROR_RESYNC 10 mirrors 000377 1788901478.870475 fallocate 0x01a9d4 thru 0x01fbed (0x521a bytes) 000378 1788901478.910271 mapwrite 0x03bbfc thru 0x03ffff (0x4404 bytes) 000379 1788901478.975632 mapwrite 0x015765 thru 0x021c74 (0xc510 bytes) 000380 1788901479.032984 read 0x03a43f thru 0x03def0 (0x3ab2 bytes) 000381 1788901479.034322 mapwrite 0x02be25 thru 0x035db8 (0x9f94 bytes) 000382 1788901479.064226 punch from 0x01c190 to 0x01cb4f (0x9c0 bytes) 000383 1788901479.084291 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x31cc356e (stale) Mirror 8: 0x31cc356e (stale) Mirror 11: 0x31cc356e (stale) Mirror 12: 0x31cc356e (stale) Mirror 14: 0x31cc356e (stale) Mirror 15: 0x31cc356e (stale) Mirror 16: 0x31cc356e (stale) Mirror 17: 0x31cc356e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x31cc356e (stale) Mirror 8: 0x31cc356e (stale) Mirror 11: 0x31cc356e (stale) Mirror 12: 0x31cc356e (stale) Mirror 14: 0x31cc356e (stale) Mirror 15: 0x31cc356e (stale) Mirror 16: 0x31cc356e (stale) Mirror 17: 0x31cc356e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000384 1788901479.510819 trunc from 0x040000 to 0x007293 (0x38d6c bytes) 000385 1788901479.544892 fallocate 0x005f94 thru 0x00fca0 (0x9d0d bytes) 000386 1788901479.555658 mapwrite 0x03f51b thru 0x03ffff (0xae5 bytes) 000387 1788901479.599301 read 0x0183b7 thru 0x019f6a (0x1bb4 bytes) 000388 1788901479.604634 read 0x016677 thru 0x016e4a (0x7d4 bytes) 000389 1788901479.619234 mapread 0x01fbc6 thru 0x0231f7 (0x3632 bytes) 000390 1788901479.621269 trunc from 0x040000 to 0x02f101 (0x10efe bytes) 000391 1788901479.637976 punch from 0x00bb65 to 0x0117a4 (0x5c40 bytes) 000392 1788901479.644047 read 0x023df8 thru 0x025108 (0x1311 bytes) 000393 1788901479.644890 trunc from 0x010a23 to 0x0169fe (0x5fdc bytes) 000394 1788901479.649439 mapwrite 0x0084d1 thru 0x014624 (0xc154 bytes) 000395 1788901479.685929 mapread 0x0259fa thru 0x02db5f (0x8166 bytes) 000396 1788901479.687593 mapread 0x004652 thru 0x00bbd0 (0x757f bytes) 000397 1788901479.688707 read 0x02cd9a thru 0x02f101 (0x2368 bytes) 000398 1788901479.695849 trunc from 0x02f102 to 0x009be4 (0x2551d bytes) 000399 1788901479.726070 mapread 0x000d2f thru 0x009be4 (0x8eb6 bytes) 000400 1788901479.727047 fallocate 0x028b3d thru 0x02c516 (0x39da bytes) 000401 1788901479.732295 mapwrite 0x03aafc thru 0x03ffff (0x5504 bytes) 000402 1788901479.791573 mapwrite 0x03a102 thru 0x03ffff (0x5efe bytes) 000403 1788901479.813556 mapread 0x034a93 thru 0x03fed0 (0xb43e bytes) 000404 1788901479.814622 punch from 0x010313 to 0x0201ae (0xfe9c bytes) 000405 1788901479.819382 mapread 0x017aa8 thru 0x01a5b5 (0x2b0e bytes) 000406 1788901479.842888 mapwrite 0x02b5ce thru 0x0314fe (0x5f31 bytes) 000407 1788901479.857937 mapread 0x0352f2 thru 0x03ffff (0xad0e bytes) 000408 1788901479.858929 fallocate 0x00a436 thru 0x00d257 (0x2e22 bytes) 000409 1788901479.863381 mapread 0x013781 thru 0x01ea43 (0xb2c3 bytes) 000410 1788901479.907739 punch from 0x0247ba to 0x027742 (0x2f89 bytes) 000411 1788901479.911783 fallocate 0x009048 thru 0x0121ae (0x9167 bytes) 000412 1788901479.915416 trunc from 0x00866a to 0x00bc15 (0x35ac bytes) 000413 1788901479.932044 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x31cc356e (stale) Mirror 8: 0x31cc356e (stale) Mirror 11: 0x31cc356e (stale) Mirror 12: 0x31cc356e (stale) Mirror 14: 0x31cc356e (stale) Mirror 15: 0x31cc356e (stale) Mirror 17: 0x31cc356e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x31cc356e (stale) Mirror 8: 0x31cc356e (stale) Mirror 11: 0x31cc356e (stale) Mirror 12: 0x31cc356e (stale) Mirror 14: 0x31cc356e (stale) Mirror 15: 0x31cc356e (stale) Mirror 17: 0x31cc356e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000414 1788901480.320503 mapwrite 0x031937 thru 0x03ffff (0xe6c9 bytes) 000415 1788901480.379235 mapwrite 0x01ebc2 thru 0x0288f0 (0x9d2f bytes) 000416 1788901480.409619 read 0x004e4d thru 0x0131d6 (0xe38a bytes) 000418 1788901480.421921 mapread 0x01f6f9 thru 0x026039 (0x6941 bytes) 000419 1788901480.422916 punch from 0x00cdcf to 0x00f7e2 (0x2a14 bytes) 000420 1788901480.433500 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x31cc356e (stale) Mirror 8: 0x31cc356e (stale) Mirror 11: 0x31cc356e (stale) Mirror 12: 0x31cc356e (stale) Mirror 14: 0x31cc356e (stale) Mirror 15: 0x31cc356e (stale) Mirror 17: 0x31cc356e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbc1e78c8 Mirror 18: 0xbc1e78c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000421 1788901481.301382 mapwrite 0x02e143 thru 0x034baf (0x6a6d bytes) 000422 1788901481.423976 MIRROR_RESYNC 9 mirrors 000423 1788901482.573906 punch from 0x03991c to 0x03ffff (0x66e4 bytes) 000424 1788901482.603142 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x90fa55d5 (stale) Mirror 8: 0x90fa55d5 (stale) Mirror 11: 0x90fa55d5 (stale) Mirror 12: 0x90fa55d5 (stale) Mirror 14: 0x90fa55d5 (stale) Mirror 15: 0x90fa55d5 (stale) Mirror 17: 0x90fa55d5 (stale) Mirror 18: 0x90fa55d5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x46724946 Mirror 19: 0x46724946 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000425 1788901483.443803 mapwrite 0x02d2c6 thru 0x03b7cc (0xe507 bytes) 000426 1788901483.553878 mapread 0x032bab thru 0x03eacc (0xbf22 bytes) 000427 1788901483.554759 mapread 0x028695 thru 0x029967 (0x12d3 bytes) 000428 1788901483.555426 read 0x028c70 thru 0x0317fe (0x8b8f bytes) 000429 1788901483.556201 punch from 0x0175d1 to 0x019e64 (0x2894 bytes) 000430 1788901483.564289 mapwrite 0x0307b5 thru 0x035acd (0x5319 bytes) 000431 1788901483.578832 trunc from 0x039698 to 0x03ffff (0x6968 bytes) 000432 1788901483.584139 mapread 0x01b134 thru 0x01cd3c (0x1c09 bytes) 000434 1788901483.592485 trunc from 0x00d9be to 0x01aa72 (0xd0b5 bytes) 000435 1788901483.597020 write 0x039ca3 thru 0x03ffff (0x635d bytes) 000436 1788901483.608106 fallocate 0x0154bf thru 0x01a249 (0x4d8b bytes) 000437 1788901483.628594 MIRROR_RESYNC 10 mirrors 000438 1788901484.866529 mapread 0x024e3a thru 0x02e255 (0x941c bytes) 000439 1788901484.884960 fallocate 0x02711b thru 0x02f2ab (0x8191 bytes) 000440 1788901484.931666 MIRROR_RESYNC 10 mirrors 000441 1788901486.023329 mapread 0x027ccf thru 0x02cc8a (0x4fbc bytes) 000442 1788901486.047053 trunc from 0x040000 to 0x0080fe (0x37f01 bytes) 000443 1788901486.094566 mapwrite 0x0216f9 thru 0x0284c1 (0x6dc9 bytes) 000444 1788901486.150544 MIRROR_RESYNC 10 mirrors 000445 1788901487.288249 write 0x02e84b thru 0x031735 (0x2eeb bytes) 000446 1788901487.320899 trunc from 0x031736 to 0x039cb3 (0x857e bytes) 000447 1788901487.359486 mapwrite 0x013d68 thru 0x01ad66 (0x6fff bytes) 000448 1788901487.397988 trunc from 0x02714b to 0x02e1f0 (0x70a6 bytes) 000449 1788901487.405700 punch from 0x01e7d6 to 0x027d04 (0x952f bytes) 000450 1788901487.411427 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39cb4): Mirror 7: 0xca544add (stale) Mirror 8: 0xca544add (stale) Mirror 11: 0xca544add (stale) Mirror 12: 0xca544add (stale) Mirror 14: 0xca544add (stale) Mirror 15: 0xca544add (stale) Mirror 17: 0xca544add (stale) Mirror 18: 0xca544add (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cb4): Mirror 7: 0xca544add (stale) Mirror 8: 0xca544add (stale) Mirror 11: 0xca544add (stale) Mirror 12: 0xca544add (stale) Mirror 14: 0xca544add (stale) Mirror 15: 0xca544add (stale) Mirror 17: 0xca544add (stale) Mirror 18: 0xca544add (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cb4: skipped 000451 1788901487.842950 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39cb4): Mirror 7: 0xca544add (stale) Mirror 8: 0xca544add (stale) Mirror 11: 0xca544add (stale) Mirror 12: 0xca544add (stale) Mirror 14: 0xca544add (stale) Mirror 15: 0xca544add (stale) Mirror 17: 0xca544add (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cb4): Mirror 7: 0xca544add (stale) Mirror 8: 0xca544add (stale) Mirror 11: 0xca544add (stale) Mirror 12: 0xca544add (stale) Mirror 14: 0xca544add (stale) Mirror 15: 0xca544add (stale) Mirror 17: 0xca544add (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cb4: skipped 000452 1788901488.177010 trunc from 0x039cb4 to 0x005599 (0x3471a bytes) 000453 1788901488.197966 write 0x037525 thru 0x03ffff (0x8adb bytes) 000454 1788901488.199699 punch from 0x00a683 to 0x0110bf (0x6a3d bytes) 000456 1788901488.207592 punch from 0x004746 to 0x00a49c (0x5d57 bytes) 000457 1788901488.213122 mapread 0x030d90 thru 0x03857b (0x77ec bytes) 000458 1788901488.235631 write 0x01e35d thru 0x0242be (0x5f62 bytes) 000459 1788901488.243247 write 0x013449 thru 0x0210a8 (0xdc60 bytes) 000460 1788901488.253620 trunc from 0x01665c to 0x025915 (0xf2ba bytes) 000461 1788901488.267077 mapread 0x018290 thru 0x01c862 (0x45d3 bytes) 000462 1788901488.286820 read 0x01c22d thru 0x01f767 (0x353b bytes) 000463 1788901488.290083 trunc from 0x040000 to 0x037ec4 (0x813b bytes) 000464 1788901488.307801 write 0x025e20 thru 0x0352e0 (0xf4c1 bytes) 000465 1788901488.315698 trunc from 0x02a631 to 0x0342c0 (0x9c90 bytes) 000466 1788901488.330892 punch from 0x016c49 to 0x01851b (0x18d3 bytes) 000467 1788901488.335886 mapread 0x01b9b3 thru 0x02b159 (0xf7a7 bytes) 000468 1788901488.355373 mapwrite 0x01ad62 thru 0x022d91 (0x8030 bytes) 000469 1788901488.376406 mapread 0x01f483 thru 0x029e16 (0xa994 bytes) 000471 1788901488.379151 trunc from 0x037ec5 to 0x01b7c1 (0x1c703 bytes) 000472 1788901488.405380 mapwrite 0x0257c9 thru 0x030b37 (0xb36f bytes) 000473 1788901488.462449 punch from 0x0052f3 to 0x008cf7 (0x3a05 bytes) 000474 1788901488.466585 read 0x001ce7 thru 0x00f297 (0xd5b1 bytes) 000475 1788901488.480453 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30b38): Mirror 7: 0xfbd059c7 (stale) Mirror 8: 0xfbd059c7 (stale) Mirror 11: 0xfbd059c7 (stale) Mirror 14: 0xfbd059c7 (stale) Mirror 15: 0xfbd059c7 (stale) Mirror 17: 0xfbd059c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30b38): Mirror 7: 0xfbd059c7 (stale) Mirror 8: 0xfbd059c7 (stale) Mirror 11: 0xfbd059c7 (stale) Mirror 14: 0xfbd059c7 (stale) Mirror 15: 0xfbd059c7 (stale) Mirror 17: 0xfbd059c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30b38: skipped 000476 1788901488.862984 trunc from 0x026b4d to 0x030aad (0x9f61 bytes) 000477 1788901488.868422 write 0x0119e4 thru 0x01b4ae (0x9acb bytes) 000478 1788901488.882690 mapwrite 0x02ed34 thru 0x03c324 (0xd5f1 bytes) 000479 1788901488.955986 punch from 0x037164 to 0x03c324 (0x51c1 bytes) 000480 1788901488.961845 read 0x001e95 thru 0x00e552 (0xc6be bytes) 000481 1788901488.977362 mapwrite 0x01f814 thru 0x0269b0 (0x719d bytes) 000482 1788901489.020649 mapread 0x025b16 thru 0x03487e (0xed69 bytes) 000484 1788901489.026662 read 0x008306 thru 0x00c1eb (0x3ee6 bytes) 000485 1788901489.030876 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c325): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c325): Mirror 7: 0x7223cd43 (stale) Mirror 8: 0x7223cd43 (stale) Mirror 11: 0x7223cd43 (stale) Mirror 14: 0x7223cd43 (stale) Mirror 15: 0x7223cd43 (stale) Mirror 17: 0x7223cd43 (stale) CRC-32 checksum value for chunk [0, 0x3c325): Mirror 1: 0x478c73e Mirror 18: 0x478c73e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c325: skipped 000486 1788901489.916688 MIRROR_RESYNC 8 mirrors 000487 1788901491.790560 trunc from 0x01fd23 to 0x0287ff (0x8add bytes) 000488 1788901491.832917 write 0x035b16 thru 0x03be6d (0x6358 bytes) 000489 1788901491.849076 punch from 0x02788b to 0x02b6fa (0x3e70 bytes) 000492 1788901491.853999 trunc from 0x03c325 to 0x02d052 (0xf2d2 bytes) 000493 1788901491.881514 punch from 0x01712f to 0x01acd2 (0x3ba4 bytes) 000494 1788901491.886236 trunc from 0x021d53 to 0x027e53 (0x6101 bytes) 000496 1788901491.901149 MIRROR_RESYNC 8 mirrors 000497 1788901493.645764 mapread 0x0207da thru 0x023ecb (0x36f2 bytes) 000498 1788901493.668638 trunc from 0x02d053 to 0x01bef8 (0x1115a bytes) 000499 1788901493.696433 trunc from 0x017014 to 0x01bef8 (0x4ee5 bytes) 000500 1788901493.701454 write 0x037440 thru 0x037795 (0x356 bytes) 000501 1788901493.702705 write 0x003c87 thru 0x010304 (0xc67e bytes) 000502 1788901493.711207 write 0x007936 thru 0x00ae1c (0x34e7 bytes) 000503 1788901493.712876 trunc from 0x009484 to 0x014bc9 (0xb746 bytes) 000504 1788901493.727793 write 0x03a3da thru 0x03f31b (0x4f42 bytes) 000505 1788901493.732043 trunc from 0x03f31c to 0x0123d6 (0x2cf45 bytes) 000506 1788901493.759895 fallocate 0x01c507 thru 0x02b454 (0xef4e bytes) 000507 1788901493.773575 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x123d7): Mirror 7: 0x2693a1e2 (stale) Mirror 8: 0x2693a1e2 (stale) Mirror 11: 0x2693a1e2 (stale) Mirror 14: 0x2693a1e2 (stale) Mirror 15: 0x2693a1e2 (stale) Mirror 18: 0x2693a1e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x123d7): Mirror 7: 0x2693a1e2 (stale) Mirror 8: 0x2693a1e2 (stale) Mirror 11: 0x2693a1e2 (stale) Mirror 14: 0x2693a1e2 (stale) Mirror 15: 0x2693a1e2 (stale) Mirror 18: 0x2693a1e2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x123d7: skipped 000508 1788901494.171292 fallocate 0x013983 thru 0x01f985 (0xc003 bytes) 000509 1788901494.180643 mapwrite 0x03ab25 thru 0x03ffff (0x54db bytes) 000510 1788901494.232536 trunc from 0x040000 to 0x03b161 (0x4e9e bytes) 000511 1788901494.262211 trunc from 0x0085a2 to 0x00f41c (0x6e7b bytes) 000512 1788901494.267614 mapread 0x016395 thru 0x024a0f (0xe67b bytes) 000513 1788901494.302951 trunc from 0x03b162 to 0x023a43 (0x1771e bytes) 000514 1788901494.320915 write 0x01bfb2 thru 0x0266f7 (0xa746 bytes) 000515 1788901494.322367 trunc from 0x0266f8 to 0x03d5ec (0x16ef5 bytes) 000516 1788901494.338034 trunc from 0x03d5ed to 0x014008 (0x295e4 bytes) 000517 1788901494.354905 punch from 0x007a68 to 0x014008 (0xc5a1 bytes) 000518 1788901494.362963 trunc from 0x014009 to 0x02bf45 (0x17f3d bytes) 000519 1788901494.379982 write 0x016e4f thru 0x01fd98 (0x8f4a bytes) 000520 1788901494.388638 trunc from 0x02bf46 to 0x019d68 (0x121dd bytes) 000521 1788901494.407833 write 0x03efd9 thru 0x03ffff (0x1027 bytes) 000522 1788901494.409273 punch from 0x024de4 to 0x029e67 (0x5084 bytes) 000523 1788901494.416235 trunc from 0x008e64 to 0x016659 (0xd7f6 bytes) 000524 1788901494.434841 fallocate 0x03cbec thru 0x03ffff (0x3414 bytes) 000525 1788901494.447959 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdef81ffd (stale) Mirror 8: 0xdef81ffd (stale) Mirror 11: 0xdef81ffd (stale) Mirror 14: 0xdef81ffd (stale) Mirror 15: 0xdef81ffd (stale) Mirror 18: 0xdef81ffd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa92af409 Mirror 19: 0xa92af409 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000526 1788901495.248021 punch from 0x031945 to 0x03f83a (0xdef6 bytes) 000527 1788901495.288047 trunc from 0x03e3df to 0x03ffff (0x1c21 bytes) 000528 1788901495.292057 punch from 0x03e403 to 0x03ffff (0x1bfd bytes) 000529 1788901495.295833 trunc from 0x040000 to 0x024c1e (0x1b3e1 bytes) 000530 1788901495.311941 read 0x011c69 thru 0x01d3b4 (0xb74c bytes) 000531 1788901495.321236 fallocate 0x030c35 thru 0x0342dc (0x36a8 bytes) 000532 1788901495.324979 mapwrite 0x0172c3 thru 0x01de3c (0x6b7a bytes) 000533 1788901495.342852 punch from 0x013169 to 0x013ffa (0xe92 bytes) 000534 1788901495.352125 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x24c1f): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24c1f): Mirror 7: 0x1e1b4867 (stale) Mirror 8: 0x1e1b4867 (stale) Mirror 11: 0x1e1b4867 (stale) Mirror 14: 0x1e1b4867 (stale) Mirror 15: 0x1e1b4867 (stale) Mirror 18: 0x1e1b4867 (stale) Mirror 19: 0x9a3698c2 (stale) CRC-32 checksum value for chunk [0, 0x24c1f): Mirror 1: 0x5d6e0ff4 Mirror 20: 0x5d6e0ff4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24c1f: skipped 000535 1788901496.065841 read 0x0003ed thru 0x009ad0 (0x96e4 bytes) 000536 1788901496.078870 trunc from 0x024c1f to 0x03b7df (0x16bc1 bytes) 000537 1788901496.145139 mapwrite 0x021b49 thru 0x02dcf5 (0xc1ad bytes) 000538 1788901496.194933 read 0x014a5e thru 0x016b16 (0x20b9 bytes) 000539 1788901496.208710 trunc from 0x0155b8 to 0x0212dd (0xbd26 bytes) 000540 1788901496.221328 trunc from 0x00a8c3 to 0x00fae1 (0x521f bytes) 000541 1788901496.227752 trunc from 0x03b7e0 to 0x03a583 (0x125c bytes) 000542 1788901496.245958 trunc from 0x03a584 to 0x0231e0 (0x173a3 bytes) 000543 1788901496.277090 MIRROR_RESYNC 9 mirrors 000544 1788901497.330974 trunc from 0x0231e1 to 0x03b90b (0x1872b bytes) 000545 1788901497.377071 read 0x03910b thru 0x03b90b (0x2801 bytes) 000547 1788901497.387653 punch from 0x009115 to 0x0166b6 (0xd5a2 bytes) 000548 1788901497.402375 mapwrite 0x0302e5 thru 0x03cb52 (0xc86e bytes) 000549 1788901497.467229 trunc from 0x033b36 to 0x03cb52 (0x901d bytes) 000551 1788901497.472891 trunc from 0x03cb53 to 0x02f221 (0xd931 bytes) 000552 1788901497.487200 punch from 0x02401c to 0x025293 (0x1278 bytes) 000553 1788901497.491683 write 0x00d255 thru 0x0179d1 (0xa77d bytes) 000555 1788901497.504265 trunc from 0x02f222 to 0x014609 (0x1ac18 bytes) 000557 1788901497.516182 mapwrite 0x00b959 thru 0x013fb7 (0x865f bytes) 000558 1788901497.536471 read 0x012119 thru 0x013a1f (0x1907 bytes) 000560 1788901497.537472 fallocate 0x02d9df thru 0x0334ef (0x5b11 bytes) 000561 1788901497.540863 trunc from 0x0334f0 to 0x020434 (0x130bb bytes) 000562 1788901497.554626 punch from 0x00fa56 to 0x01856f (0x8b1a bytes) 000563 1788901497.558594 read 0x01e433 thru 0x020434 (0x2002 bytes) 000564 1788901497.565967 read 0x01aced thru 0x01b616 (0x92a bytes) 000565 1788901497.566588 trunc from 0x009c25 to 0x00e4ae (0x488a bytes) 000566 1788901497.573869 fallocate 0x01c682 thru 0x02412f (0x7aae bytes) 000567 1788901497.581376 trunc from 0x020435 to 0x03be10 (0x1b9dc bytes) 000568 1788901497.597062 fallocate 0x033d7b thru 0x03ea34 (0xacba bytes) 000569 1788901497.607081 MIRROR_RESYNC 9 mirrors 000570 1788901498.924835 MIRROR_EXTEND to 10 mirrors 000571 1788901499.571753 fallocate 0x011675 thru 0x01a1dd (0x8b69 bytes) 000572 1788901499.625290 trunc from 0x01666a to 0x01791d (0x12b4 bytes) 000573 1788901499.629297 mapwrite 0x034d34 thru 0x039e63 (0x5130 bytes) 000574 1788901499.679156 fallocate 0x01b6f0 thru 0x02b503 (0xfe14 bytes) 000575 1788901499.684235 mapread 0x010d26 thru 0x0175a2 (0x687d bytes) 000576 1788901499.693937 fallocate 0x01d64f thru 0x02be5b (0xe80d bytes) 000577 1788901499.703398 punch from 0x037458 to 0x03a198 (0x2d41 bytes) 000578 1788901499.710915 mapwrite 0x02c4bb thru 0x02dcae (0x17f4 bytes) 000579 1788901499.740057 punch from 0x01e623 to 0x0263d5 (0x7db3 bytes) 000580 1788901499.752592 mapread 0x02cf7b thru 0x02ea37 (0x1abd bytes) 000581 1788901499.756472 trunc from 0x03be11 to 0x01a966 (0x214aa bytes) 000582 1788901499.777604 trunc from 0x01a967 to 0x0204e4 (0x5b7e bytes) 000583 1788901499.790240 fallocate 0x014478 thru 0x0236b4 (0xf23d bytes) 000584 1788901499.794280 fallocate 0x0161e5 thru 0x0229f7 (0xc813 bytes) 000585 1788901499.797967 mapwrite 0x007b02 thru 0x00ef73 (0x7472 bytes) 000586 1788901499.820977 fallocate 0x038740 thru 0x03ffff (0x78c0 bytes) 000588 1788901499.825554 punch from 0x032ae4 to 0x036186 (0x36a3 bytes) 000589 1788901499.829262 mapread 0x0092e3 thru 0x018c2e (0xf94c bytes) 000590 1788901499.830251 trunc from 0x001501 to 0x0029db (0x14db bytes) 000591 1788901499.834153 fallocate 0x036ba8 thru 0x03f2fd (0x8756 bytes) 000593 1788901499.838463 fallocate 0x00dff5 thru 0x00f6dd (0x16e9 bytes) 000594 1788901499.842259 write 0x00626f thru 0x00b80d (0x559f bytes) 000595 1788901499.844014 trunc from 0x040000 to 0x0215d7 (0x1ea28 bytes) 000596 1788901499.855530 write 0x032f05 thru 0x03c12e (0x922a bytes) 000597 1788901499.858008 trunc from 0x004d97 to 0x005c5c (0xec6 bytes) 000598 1788901499.861990 mapread 0x019a0f thru 0x01dc8a (0x427c bytes) 000599 1788901499.873648 trunc from 0x03bf37 to 0x03c12e (0x1f8 bytes) 000600 1788901499.890100 write 0x0117ac thru 0x011c71 (0x4c6 bytes) 000601 1788901499.891554 trunc from 0x03c12f to 0x016529 (0x25c05 bytes) 000602 1788901499.912482 punch from 0x000d31 to 0x00fb10 (0xede0 bytes) 000603 1788901499.917261 write 0x015422 thru 0x01db95 (0x8774 bytes) 000604 1788901499.918571 mapread 0x007877 thru 0x00e3e8 (0x6b72 bytes) 000606 1788901499.930230 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1db96): Mirror 8: 0xfd4295e6 (stale) Mirror 11: 0xfd4295e6 (stale) Mirror 14: 0xfd4295e6 (stale) Mirror 15: 0xfd4295e6 (stale) Mirror 18: 0xfd4295e6 (stale) Mirror 19: 0xfd4295e6 (stale) Mirror 20: 0xfd4295e6 (stale) Mirror 21: 0xfd4295e6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1db96): Mirror 8: 0xfd4295e6 (stale) Mirror 11: 0xfd4295e6 (stale) Mirror 14: 0xfd4295e6 (stale) Mirror 15: 0xfd4295e6 (stale) Mirror 18: 0xfd4295e6 (stale) Mirror 19: 0xfd4295e6 (stale) Mirror 20: 0xfd4295e6 (stale) Mirror 21: 0xfd4295e6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1db96: skipped 000607 1788901500.308919 trunc from 0x01db96 to 0x00b325 (0x12870 bytes) 000608 1788901500.327042 fallocate 0x01e574 thru 0x0260f9 (0x7b86 bytes) 000609 1788901500.331946 write 0x001746 thru 0x010b7e (0xf439 bytes) 000610 1788901500.341792 trunc from 0x002b78 to 0x00b4d1 (0x895a bytes) 000611 1788901500.356323 punch from 0x000137 to 0x005ee4 (0x5dae bytes) 000612 1788901500.362194 trunc from 0x010b7f to 0x020ccf (0x10151 bytes) 000613 1788901500.384093 mapread 0x00082e thru 0x009c9a (0x946d bytes) 000614 1788901500.405238 trunc from 0x020cd0 to 0x01148c (0xf843 bytes) 000615 1788901500.425996 fallocate 0x020250 thru 0x027ac7 (0x7878 bytes) 000616 1788901500.433303 read 0x000083 thru 0x004961 (0x48df bytes) 000617 1788901500.434037 trunc from 0x00dd26 to 0x00e6cf (0x9aa bytes) 000619 1788901500.438490 write 0x017b25 thru 0x024fa9 (0xd485 bytes) 000620 1788901500.446949 trunc from 0x006fd1 to 0x008a1e (0x1a4e bytes) 000621 1788901500.451995 mapread 0x00deef thru 0x0106e7 (0x27f9 bytes) 000622 1788901500.460403 mapwrite 0x02f3b1 thru 0x037728 (0x8378 bytes) 000623 1788901500.502148 mapwrite 0x010d97 thru 0x012b3c (0x1da6 bytes) 000624 1788901500.514041 trunc from 0x037729 to 0x0028d6 (0x34e52 bytes) 000625 1788901500.530312 trunc from 0x002059 to 0x0028d6 (0x87e bytes) 000626 1788901500.537373 fallocate 0x02ac63 thru 0x02bf90 (0x132e bytes) 000627 1788901500.543466 mapwrite 0x02a315 thru 0x03481f (0xa50b bytes) 000628 1788901500.593069 read 0x021d30 thru 0x0249b3 (0x2c84 bytes) 000629 1788901500.610665 fallocate 0x02e5f1 thru 0x0339a3 (0x53b3 bytes) 000630 1788901500.621397 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34820): Mirror 11: 0xfe2f64c4 (stale) Mirror 14: 0xfe2f64c4 (stale) Mirror 15: 0xfe2f64c4 (stale) Mirror 18: 0xfe2f64c4 (stale) Mirror 19: 0xfe2f64c4 (stale) Mirror 20: 0xfe2f64c4 (stale) Mirror 21: 0xfe2f64c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34820): Mirror 11: 0xfe2f64c4 (stale) Mirror 14: 0xfe2f64c4 (stale) Mirror 15: 0xfe2f64c4 (stale) Mirror 18: 0xfe2f64c4 (stale) Mirror 19: 0xfe2f64c4 (stale) Mirror 20: 0xfe2f64c4 (stale) Mirror 21: 0xfe2f64c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34820: skipped 000631 1788901501.064916 trunc from 0x034820 to 0x01b103 (0x1971c bytes) 000632 1788901501.084346 read 0x018a61 thru 0x0194ab (0xa4b bytes) 000633 1788901501.090667 mapread 0x00137d thru 0x00255b (0x11df bytes) 000634 1788901501.101252 mapwrite 0x018789 thru 0x024b47 (0xc3bf bytes) 000635 1788901501.155419 trunc from 0x0117ef to 0x013eab (0x26bd bytes) 000636 1788901501.162818 write 0x016801 thru 0x01eb15 (0x8315 bytes) 000637 1788901501.163868 punch from 0x01680f to 0x01f677 (0x8e69 bytes) 000639 1788901501.175238 fallocate 0x02fbfa thru 0x038094 (0x849b bytes) 000640 1788901501.183339 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x24b48): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24b48): Mirror 11: 0x40eb8728 (stale) Mirror 14: 0x40eb8728 (stale) Mirror 15: 0x40eb8728 (stale) Mirror 18: 0x40eb8728 (stale) Mirror 19: 0x40eb8728 (stale) Mirror 20: 0x40eb8728 (stale) Mirror 21: 0x40eb8728 (stale) CRC-32 checksum value for chunk [0, 0x24b48): Mirror 1: 0xacf8b024 Mirror 22: 0xacf8b024 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24b48: skipped 000641 1788901501.886516 fallocate 0x01bc3f thru 0x01bca6 (0x68 bytes) 000642 1788901501.919311 punch from 0x01d093 to 0x01d0ba (0x28 bytes) 000643 1788901501.923441 mapread 0x021457 thru 0x024b47 (0x36f1 bytes) 000644 1788901501.938932 trunc from 0x01bea0 to 0x01e9bc (0x2b1d bytes) 000645 1788901501.943336 mapwrite 0x02c808 thru 0x02dee8 (0x16e1 bytes) 000646 1788901502.004171 trunc from 0x01a703 to 0x01d844 (0x3142 bytes) 000647 1788901502.015238 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2dee9): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dee9): Mirror 11: 0x2ea9d304 (stale) Mirror 14: 0x2ea9d304 (stale) Mirror 15: 0x2ea9d304 (stale) Mirror 18: 0x2ea9d304 (stale) Mirror 19: 0x2ea9d304 (stale) Mirror 20: 0x2ea9d304 (stale) Mirror 21: 0x2ea9d304 (stale) Mirror 22: 0x51ed438d (stale) CRC-32 checksum value for chunk [0, 0x2dee9): Mirror 1: 0xd1f515d Mirror 23: 0xd1f515d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dee9: skipped 000648 1788901502.836389 read 0x021e2b thru 0x028177 (0x634d bytes) 000649 1788901502.849900 read 0x005246 thru 0x014288 (0xf043 bytes) 000650 1788901502.873947 write 0x0068f7 thru 0x014ecd (0xe5d7 bytes) 000651 1788901502.907106 read 0x01024d thru 0x0115ca (0x137e bytes) 000652 1788901502.907810 mapread 0x007e53 thru 0x012232 (0xa3e0 bytes) 000653 1788901502.912088 trunc from 0x02dee9 to 0x00d753 (0x20795 bytes) 000654 1788901502.935632 mapread 0x005773 thru 0x00d753 (0x7fe1 bytes) 000655 1788901502.945178 read 0x000193 thru 0x00b6af (0xb51d bytes) 000656 1788901502.945955 mapread 0x006126 thru 0x00d753 (0x762e bytes) 000657 1788901502.946985 trunc from 0x008107 to 0x00d753 (0x564d bytes) 000659 1788901502.963710 fallocate 0x0359cd thru 0x03c937 (0x6f6b bytes) 000660 1788901502.971520 fallocate 0x0252aa thru 0x029da6 (0x4afd bytes) 000661 1788901502.982841 mapread 0x00614e thru 0x00954f (0x3402 bytes) 000662 1788901503.001459 mapwrite 0x0227ea thru 0x02d0c4 (0xa8db bytes) 000663 1788901503.054909 read 0x0197d3 thru 0x022f9c (0x97ca bytes) 000664 1788901503.056065 read 0x02a60f thru 0x02d0c4 (0x2ab6 bytes) 000665 1788901503.056583 read 0x01042b thru 0x01fd40 (0xf916 bytes) 000666 1788901503.057971 punch from 0x026582 to 0x02bb02 (0x5581 bytes) 000667 1788901503.068878 trunc from 0x02d0c5 to 0x02415d (0x8f67 bytes) 000668 1788901503.085702 punch from 0x005c4b to 0x011772 (0xbb28 bytes) 000669 1788901503.094064 trunc from 0x02415e to 0x017f5e (0xc1ff bytes) 000670 1788901503.110380 mapwrite 0x025f21 thru 0x034739 (0xe819 bytes) 000671 1788901503.166946 punch from 0x021bf2 to 0x029385 (0x7794 bytes) 000672 1788901503.175888 mapwrite 0x02aef9 thru 0x0386bc (0xd7c4 bytes) 000673 1788901503.229973 mapread 0x0067cb thru 0x0080bd (0x18f3 bytes) 000674 1788901503.230867 write 0x02fe41 thru 0x03df7b (0xe13b bytes) 000675 1788901503.232995 write 0x036f3d thru 0x0371fa (0x2be bytes) 000677 1788901503.234310 write 0x004eab thru 0x00c7ec (0x7942 bytes) 000678 1788901503.242488 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3df7c): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df7c): Mirror 11: 0x2513ab54 (stale) Mirror 14: 0x2513ab54 (stale) Mirror 15: 0x2513ab54 (stale) Mirror 18: 0x2513ab54 (stale) Mirror 19: 0x2513ab54 (stale) Mirror 20: 0x2513ab54 (stale) Mirror 21: 0x2513ab54 (stale) Mirror 22: 0xa3689e35 (stale) Mirror 23: 0x1f3aa149 (stale) CRC-32 checksum value for chunk [0, 0x3df7c): Mirror 1: 0xd3553887 Mirror 24: 0xd3553887 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df7c: skipped 000680 1788901504.102553 write 0x026308 thru 0x029120 (0x2e19 bytes) 000681 1788901504.158277 trunc from 0x03df7c to 0x031a58 (0xc523 bytes) 000682 1788901504.180074 write 0x01eee2 thru 0x0295f8 (0xa717 bytes) 000683 1788901504.183978 trunc from 0x031a59 to 0x00cfc8 (0x24a90 bytes) 000684 1788901504.202873 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcfc9): Mirror 11: 0x5a8bbdc9 (stale) Mirror 14: 0x5a8bbdc9 (stale) Mirror 15: 0x5a8bbdc9 (stale) Mirror 18: 0x5a8bbdc9 (stale) Mirror 19: 0x5a8bbdc9 (stale) Mirror 21: 0x5a8bbdc9 (stale) Mirror 22: 0x90199528 (stale) Mirror 23: 0x90199528 (stale) Mirror 24: 0x50be1b45 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcfc9): Mirror 11: 0x5a8bbdc9 (stale) Mirror 14: 0x5a8bbdc9 (stale) Mirror 15: 0x5a8bbdc9 (stale) Mirror 18: 0x5a8bbdc9 (stale) Mirror 19: 0x5a8bbdc9 (stale) Mirror 21: 0x5a8bbdc9 (stale) Mirror 22: 0x90199528 (stale) Mirror 23: 0x90199528 (stale) Mirror 24: 0x50be1b45 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcfc9: skipped 000685 1788901504.619911 write 0x01ff7e thru 0x023d76 (0x3df9 bytes) 000688 1788901504.628848 MIRROR_RESYNC 10 mirrors 000689 1788901506.163331 mapread 0x001125 thru 0x0031d0 (0x20ac bytes) 000690 1788901506.178958 read 0x015c1e thru 0x019d07 (0x40ea bytes) 000692 1788901506.185556 fallocate 0x006ef2 thru 0x00fa0a (0x8b19 bytes) 000693 1788901506.217060 punch from 0x005c08 to 0x009424 (0x381d bytes) 000694 1788901506.223087 read 0x019e56 thru 0x023d76 (0x9f21 bytes) 000695 1788901506.235905 fallocate 0x0241bd thru 0x03156f (0xd3b3 bytes) 000696 1788901506.240952 fallocate 0x009eb4 thru 0x01503b (0xb188 bytes) 000697 1788901506.251447 trunc from 0x031570 to 0x011c45 (0x1f92a bytes) 000698 1788901506.277612 fallocate 0x0383c7 thru 0x039d0e (0x1948 bytes) 000699 1788901506.281618 write 0x019eb4 thru 0x023bfc (0x9d49 bytes) 000700 1788901506.292908 mapread 0x02eb57 thru 0x035374 (0x681e bytes) 000701 1788901506.299864 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39d0f): Mirror 14: 0xf2666c7d (stale) Mirror 15: 0xf2666c7d (stale) Mirror 18: 0xf2666c7d (stale) Mirror 19: 0xf2666c7d (stale) Mirror 21: 0xf2666c7d (stale) Mirror 22: 0xf2666c7d (stale) Mirror 23: 0xf2666c7d (stale) Mirror 24: 0xf2666c7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d0f): Mirror 14: 0xf2666c7d (stale) Mirror 15: 0xf2666c7d (stale) Mirror 18: 0xf2666c7d (stale) Mirror 19: 0xf2666c7d (stale) Mirror 21: 0xf2666c7d (stale) Mirror 22: 0xf2666c7d (stale) Mirror 23: 0xf2666c7d (stale) Mirror 24: 0xf2666c7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d0f: skipped 000702 1788901506.746854 write 0x0076ca thru 0x007f4d (0x884 bytes) 000703 1788901506.756963 trunc from 0x039d0f to 0x02ffbd (0x9d51 bytes) 000705 1788901506.780503 fallocate 0x01dd32 thru 0x029eb9 (0xc188 bytes) 000706 1788901506.791868 trunc from 0x02ffbe to 0x0376da (0x771d bytes) 000707 1788901506.805039 read 0x0046d1 thru 0x00f42e (0xad5e bytes) 000708 1788901506.813514 fallocate 0x02d065 thru 0x02df3e (0xeda bytes) 000709 1788901506.817602 mapread 0x03289d thru 0x0376da (0x4e3e bytes) 000710 1788901506.830792 punch from 0x002635 to 0x00caf8 (0xa4c4 bytes) 000711 1788901506.839176 mapwrite 0x03fb02 thru 0x03ffff (0x4fe bytes) 000712 1788901506.873846 MIRROR_RESYNC 9 mirrors 000713 1788901508.689895 punch from 0x034200 to 0x03ffff (0xbe00 bytes) 000714 1788901508.725867 read 0x006b70 thru 0x00cde0 (0x6271 bytes) 000715 1788901508.734442 read 0x03550c thru 0x03b35d (0x5e52 bytes) 000716 1788901508.747531 trunc from 0x040000 to 0x039c73 (0x638c bytes) 000717 1788901508.780290 mapread 0x003019 thru 0x003dee (0xdd6 bytes) 000718 1788901508.781192 fallocate 0x01c773 thru 0x020e53 (0x46e1 bytes) 000719 1788901508.784595 fallocate 0x02fad8 thru 0x03744a (0x7973 bytes) 000720 1788901508.789451 punch from 0x022e66 to 0x0235df (0x77a bytes) 000721 1788901508.793106 read 0x02152e thru 0x028790 (0x7263 bytes) 000722 1788901508.797161 trunc from 0x021e61 to 0x02f924 (0xdac4 bytes) 000723 1788901508.802221 mapread 0x0076dd thru 0x0149ab (0xd2cf bytes) 000724 1788901508.803627 read 0x02e9f0 thru 0x032ab5 (0x40c6 bytes) 000725 1788901508.812461 trunc from 0x039c74 to 0x012802 (0x27471 bytes) 000726 1788901508.829695 mapwrite 0x010c9e thru 0x0151cf (0x4532 bytes) 000727 1788901508.880051 trunc from 0x00364a to 0x00a0d7 (0x6a8e bytes) 000728 1788901508.891206 trunc from 0x0151d0 to 0x039b5e (0x2498f bytes) 000729 1788901508.905183 trunc from 0x039b5f to 0x01092a (0x29234 bytes) 000731 1788901508.916981 fallocate 0x007477 thru 0x00ae3a (0x39c4 bytes) 000732 1788901508.920805 punch from 0x00ef4a to 0x00fba6 (0xc5d bytes) 000733 1788901508.929276 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1092b): Mirror 14: 0xbe93cb8e (stale) Mirror 15: 0xbe93cb8e (stale) Mirror 18: 0xbe93cb8e (stale) Mirror 21: 0xbe93cb8e (stale) Mirror 22: 0xbe93cb8e (stale) Mirror 23: 0xbe93cb8e (stale) Mirror 24: 0xbe93cb8e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1092b): Mirror 14: 0xbe93cb8e (stale) Mirror 15: 0xbe93cb8e (stale) Mirror 18: 0xbe93cb8e (stale) Mirror 21: 0xbe93cb8e (stale) Mirror 22: 0xbe93cb8e (stale) Mirror 23: 0xbe93cb8e (stale) Mirror 24: 0xbe93cb8e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1092b: skipped 000734 1788901509.313556 mapwrite 0x0045cb thru 0x009e9d (0x58d3 bytes) 000736 1788901509.349133 punch from 0x00652b to 0x00f818 (0x92ee bytes) 000737 1788901509.357388 trunc from 0x01092b to 0x0247a9 (0x13e7f bytes) 000738 1788901509.378426 trunc from 0x009713 to 0x00e14b (0x4a39 bytes) 000739 1788901509.382976 punch from 0x00b6ca to 0x0176d8 (0xc00f bytes) 000740 1788901509.391934 MIRROR_RESYNC 8 mirrors 000741 1788901510.551635 mapwrite 0x03bfbe thru 0x03ffff (0x4042 bytes) 000742 1788901510.639236 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x2fe7d09a (stale) Mirror 15: 0x2fe7d09a (stale) Mirror 18: 0x2fe7d09a (stale) Mirror 21: 0x2fe7d09a (stale) Mirror 22: 0x2fe7d09a (stale) Mirror 23: 0x2fe7d09a (stale) Mirror 24: 0x2fe7d09a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7e041888 Mirror 25: 0x7e041888 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000743 1788901511.360517 mapread 0x032195 thru 0x034c9f (0x2b0b bytes) 000744 1788901511.403673 fallocate 0x03dfa9 thru 0x03ffff (0x2057 bytes) 000745 1788901511.442423 read 0x0209fe thru 0x02a086 (0x9689 bytes) 000747 1788901511.450430 mapwrite 0x03cbce thru 0x03ffff (0x3432 bytes) 000749 1788901511.479539 punch from 0x0350c9 to 0x03f885 (0xa7bd bytes) 000750 1788901511.486187 trunc from 0x0046cf to 0x00ee6a (0xa79c bytes) 000751 1788901511.493692 MIRROR_RESYNC 9 mirrors 000752 1788901512.723242 write 0x00ae64 thru 0x00e529 (0x36c6 bytes) 000753 1788901512.747423 mapwrite 0x006934 thru 0x0109fe (0xa0cb bytes) 000754 1788901512.780130 write 0x031bae thru 0x03dcce (0xc121 bytes) 000755 1788901512.791164 mapwrite 0x029b9e thru 0x0310a1 (0x7504 bytes) 000756 1788901512.820922 fallocate 0x02f455 thru 0x02f467 (0x13 bytes) 000757 1788901512.826869 mapread 0x02377b thru 0x032ecf (0xf755 bytes) 000758 1788901512.829387 mapread 0x038458 thru 0x03ffff (0x7ba8 bytes) 000759 1788901512.835078 mapread 0x00052f thru 0x006049 (0x5b1b bytes) 000761 1788901512.840577 punch from 0x00c044 to 0x0198b5 (0xd872 bytes) 000762 1788901512.845244 mapread 0x0246aa thru 0x02681e (0x2175 bytes) 000763 1788901512.846227 punch from 0x01a987 to 0x027979 (0xcff3 bytes) 000764 1788901512.850883 mapread 0x0018e9 thru 0x002a50 (0x1168 bytes) 000766 1788901512.852189 trunc from 0x040000 to 0x03e4dc (0x1b23 bytes) 000767 1788901512.870710 trunc from 0x03e4dd to 0x02c342 (0x1219a bytes) 000768 1788901512.899854 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2c343): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c343): Mirror 14: 0x68aa8f04 (stale) Mirror 15: 0x68aa8f04 (stale) Mirror 18: 0x68aa8f04 (stale) Mirror 21: 0x68aa8f04 (stale) Mirror 22: 0x68aa8f04 (stale) Mirror 23: 0x68aa8f04 (stale) Mirror 24: 0x68aa8f04 (stale) Mirror 25: 0x68aa8f04 (stale) CRC-32 checksum value for chunk [0, 0x2c343): Mirror 1: 0x47478244 Mirror 26: 0x47478244 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c343: skipped 000769 1788901513.614016 fallocate 0x0146d3 thru 0x014d7f (0x6ad bytes) 000770 1788901513.646089 write 0x036d00 thru 0x03ffff (0x9300 bytes) 000771 1788901513.653592 read 0x035367 thru 0x03ffff (0xac99 bytes) 000772 1788901513.658544 read 0x02f70d thru 0x0342e3 (0x4bd7 bytes) 000773 1788901513.668066 mapwrite 0x0005ec thru 0x00237e (0x1d93 bytes) 000774 1788901513.680854 punch from 0x01becc to 0x01fa89 (0x3bbe bytes) 000775 1788901513.690339 MIRROR_RESYNC 10 mirrors 000776 1788901515.937249 fallocate 0x01c2ed thru 0x027e6e (0xbb82 bytes) 000777 1788901515.982701 read 0x037a6d thru 0x03ffff (0x8593 bytes) 000778 1788901516.000361 MIRROR_RESYNC 10 mirrors 000779 1788901518.320966 mapread 0x017338 thru 0x01b9b5 (0x467e bytes) 000780 1788901518.348953 trunc from 0x040000 to 0x003a30 (0x3c5cf bytes) 000781 1788901518.420044 read 0x0029d4 thru 0x003a30 (0x105d bytes) 000782 1788901518.432587 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a31): Mirror 14: 0x7ce9df3b (stale) Mirror 15: 0x7ce9df3b (stale) Mirror 18: 0x7ce9df3b (stale) Mirror 21: 0x7ce9df3b (stale) Mirror 22: 0x7ce9df3b (stale) Mirror 23: 0x7ce9df3b (stale) Mirror 25: 0x7ce9df3b (stale) Mirror 26: 0x7ce9df3b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a31): Mirror 14: 0x7ce9df3b (stale) Mirror 15: 0x7ce9df3b (stale) Mirror 18: 0x7ce9df3b (stale) Mirror 21: 0x7ce9df3b (stale) Mirror 22: 0x7ce9df3b (stale) Mirror 23: 0x7ce9df3b (stale) Mirror 25: 0x7ce9df3b (stale) Mirror 26: 0x7ce9df3b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a31: skipped 000783 1788901518.827399 trunc from 0x003a31 to 0x00b335 (0x7905 bytes) 000784 1788901518.843003 trunc from 0x00b336 to 0x01db24 (0x127ef bytes) 000785 1788901518.873128 MIRROR_RESYNC 9 mirrors 000786 1788901519.834212 trunc from 0x01db25 to 0x016016 (0x7b0e bytes) 000787 1788901519.874169 punch from 0x0021a9 to 0x00c92a (0xa782 bytes) 000788 1788901519.877530 mapread 0x00aece thru 0x016016 (0xb149 bytes) 000790 1788901519.903082 mapwrite 0x03d397 thru 0x03ffff (0x2c69 bytes) 000792 1788901519.941610 trunc from 0x0041db to 0x00625f (0x2085 bytes) 000794 1788901519.947445 punch from 0x03d7e3 to 0x03fa0a (0x2228 bytes) 000795 1788901519.952319 read 0x00a3b7 thru 0x0136d5 (0x931f bytes) 000796 1788901519.952965 trunc from 0x040000 to 0x00a12b (0x35ed4 bytes) 000797 1788901519.970829 read 0x0099ae thru 0x00a12b (0x77e bytes) 000798 1788901519.971457 trunc from 0x001dc2 to 0x0025cd (0x80c bytes) 000799 1788901519.979585 trunc from 0x0044f6 to 0x0086ec (0x41f7 bytes) 000800 1788901519.985587 read 0x006d07 thru 0x0075f6 (0x8f0 bytes) 000801 1788901519.995710 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xa12c): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa12c): Mirror 14: 0xfc198745 (stale) Mirror 15: 0xfc198745 (stale) Mirror 18: 0xfc198745 (stale) Mirror 21: 0xfc198745 (stale) Mirror 22: 0xfc198745 (stale) Mirror 23: 0xfc198745 (stale) Mirror 25: 0xfc198745 (stale) Mirror 26: 0xfc198745 (stale) CRC-32 checksum value for chunk [0, 0xa12c): Mirror 1: 0xfd1ab2ad Mirror 27: 0xfd1ab2ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa12c: skipped 000802 1788901520.761368 read 0x0061df thru 0x00956e (0x3390 bytes) 000803 1788901520.779210 mapwrite 0x02d380 thru 0x035e99 (0x8b1a bytes) 000804 1788901520.852827 punch from 0x0238ae to 0x024498 (0xbeb bytes) 000805 1788901520.857858 read 0x0177ba thru 0x021aa8 (0xa2ef bytes) 000806 1788901520.863981 mapwrite 0x02b0f5 thru 0x03710e (0xc01a bytes) 000807 1788901520.904006 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3710f): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3710f): Mirror 14: 0x314f326 (stale) Mirror 15: 0x314f326 (stale) Mirror 18: 0x314f326 (stale) Mirror 21: 0x314f326 (stale) Mirror 22: 0x314f326 (stale) Mirror 23: 0x314f326 (stale) Mirror 25: 0x314f326 (stale) Mirror 26: 0x314f326 (stale) Mirror 27: 0xaa5cacc1 (stale) CRC-32 checksum value for chunk [0, 0x3710f): Mirror 1: 0x57db1a2e Mirror 28: 0x57db1a2e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3710f: skipped 000808 1788901521.643979 trunc from 0x01ca83 to 0x01d04b (0x5c9 bytes) 000809 1788901521.671087 read 0x014d72 thru 0x021195 (0xc424 bytes) 000810 1788901521.678829 write 0x01416e thru 0x023b68 (0xf9fb bytes) 000811 1788901521.690453 write 0x03d8c6 thru 0x03ffff (0x273a bytes) 000812 1788901521.691938 mapread 0x025599 thru 0x02a11a (0x4b82 bytes) 000813 1788901521.707831 punch from 0x002583 to 0x003651 (0x10cf bytes) 000815 1788901521.713789 mapread 0x032869 thru 0x03389a (0x1032 bytes) 000816 1788901521.725895 trunc from 0x038d24 to 0x03ffff (0x72dc bytes) 000817 1788901521.743081 mapwrite 0x00dc39 thru 0x00ec40 (0x1008 bytes) 000818 1788901521.767049 read 0x0171d5 thru 0x026655 (0xf481 bytes) 000819 1788901521.768696 read 0x005a78 thru 0x00db64 (0x80ed bytes) 000820 1788901521.782385 write 0x027e8d thru 0x035d71 (0xdee5 bytes) 000821 1788901521.784067 punch from 0x01003a to 0x0110b9 (0x1080 bytes) 000822 1788901521.788914 trunc from 0x025d4c to 0x02e7f1 (0x8aa6 bytes) 000823 1788901521.804658 read 0x00b6be thru 0x012258 (0x6b9b bytes) 000824 1788901521.813666 write 0x00fb05 thru 0x01781a (0x7d16 bytes) 000825 1788901521.815483 punch from 0x015d60 to 0x01a253 (0x44f4 bytes) 000826 1788901521.825476 fallocate 0x032b6e thru 0x03e6c4 (0xbb57 bytes) 000827 1788901521.837714 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x47e5e22e (stale) Mirror 15: 0x47e5e22e (stale) Mirror 18: 0x47e5e22e (stale) Mirror 21: 0x47e5e22e (stale) Mirror 22: 0x47e5e22e (stale) Mirror 25: 0x47e5e22e (stale) Mirror 26: 0x47e5e22e (stale) Mirror 27: 0x5a4e3e5e (stale) Mirror 28: 0x321f3490 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x47e5e22e (stale) Mirror 15: 0x47e5e22e (stale) Mirror 18: 0x47e5e22e (stale) Mirror 21: 0x47e5e22e (stale) Mirror 22: 0x47e5e22e (stale) Mirror 25: 0x47e5e22e (stale) Mirror 26: 0x47e5e22e (stale) Mirror 27: 0x5a4e3e5e (stale) Mirror 28: 0x321f3490 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000828 1788901522.323679 trunc from 0x040000 to 0x03934d (0x6cb2 bytes) 000829 1788901522.352481 trunc from 0x017f5e to 0x024042 (0xc0e5 bytes) 000831 1788901522.360905 read 0x005730 thru 0x0156b0 (0xff81 bytes) 000832 1788901522.381000 fallocate 0x019750 thru 0x027236 (0xdae7 bytes) 000833 1788901522.385017 punch from 0x02cb54 to 0x036d0b (0xa1b8 bytes) 000835 1788901522.390094 read 0x014dfc thru 0x020efc (0xc101 bytes) 000836 1788901522.397060 mapread 0x01d7aa thru 0x0212da (0x3b31 bytes) 000837 1788901522.399178 punch from 0x01e0d9 to 0x0266e1 (0x8609 bytes) 000838 1788901522.408405 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3934e): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3934e): Mirror 14: 0xb016a62e (stale) Mirror 15: 0xb016a62e (stale) Mirror 18: 0xb016a62e (stale) Mirror 21: 0xb016a62e (stale) Mirror 22: 0xb016a62e (stale) Mirror 25: 0xb016a62e (stale) Mirror 26: 0xb016a62e (stale) Mirror 27: 0x1213e647 (stale) Mirror 28: 0x1cda9ebe (stale) CRC-32 checksum value for chunk [0, 0x3934e): Mirror 1: 0x9cba1947 Mirror 29: 0x9cba1947 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3934e: skipped 000840 1788901523.268086 trunc from 0x00deae to 0x019dc2 (0xbf15 bytes) 000841 1788901523.310513 trunc from 0x00c31c to 0x00f3ca (0x30af bytes) 000842 1788901523.325130 mapwrite 0x02baf2 thru 0x02dca7 (0x21b6 bytes) 000844 1788901523.358080 mapread 0x018f24 thru 0x019487 (0x564 bytes) 000845 1788901523.370685 mapread 0x00ac8c thru 0x010641 (0x59b6 bytes) 000846 1788901523.378384 trunc from 0x03934e to 0x026b47 (0x12806 bytes) 000847 1788901523.432680 trunc from 0x026b48 to 0x0377dc (0x10c95 bytes) 000848 1788901523.454199 trunc from 0x0239aa to 0x02c554 (0x8bab bytes) 000853 1788901523.460970 punch from 0x00c4e5 to 0x0148ab (0x83c7 bytes) 000854 1788901523.467524 mapread 0x015eb8 thru 0x0172ad (0x13f6 bytes) 000855 1788901523.469089 write 0x014c53 thru 0x01bd7a (0x7128 bytes) 000856 1788901523.473075 trunc from 0x0377dd to 0x00175d (0x3607f bytes) 000857 1788901523.492375 read 0x00015a thru 0x00175d (0x1604 bytes) 000858 1788901523.499478 read 0x0001ac thru 0x00175d (0x15b2 bytes) 000859 1788901523.500174 trunc from 0x000159 to 0x00175d (0x1605 bytes) 000860 1788901523.508503 mapwrite 0x010a25 thru 0x01181f (0xdfb bytes) 000861 1788901523.549928 MIRROR_RESYNC 11 mirrors 000863 1788901524.883120 trunc from 0x01104e to 0x01181f (0x7d2 bytes) 000864 1788901524.914059 write 0x023f2d thru 0x02d774 (0x9848 bytes) 000865 1788901524.915561 write 0x013333 thru 0x019c16 (0x68e4 bytes) 000866 1788901524.929703 write 0x029043 thru 0x038450 (0xf40e bytes) 000867 1788901524.935115 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x38451): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38451): Mirror 14: 0xa89b0750 (stale) Mirror 15: 0xa89b0750 (stale) Mirror 18: 0xa89b0750 (stale) Mirror 21: 0xa89b0750 (stale) Mirror 22: 0xa89b0750 (stale) Mirror 25: 0xa89b0750 (stale) Mirror 26: 0xa89b0750 (stale) Mirror 27: 0xa89b0750 (stale) Mirror 28: 0xa89b0750 (stale) Mirror 29: 0xa89b0750 (stale) CRC-32 checksum value for chunk [0, 0x38451): Mirror 1: 0x33e1f285 Mirror 30: 0x33e1f285 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38451: skipped 000868 1788901525.850272 fallocate 0x032f43 thru 0x036e88 (0x3f46 bytes) 000870 1788901525.893154 read 0x005598 thru 0x00bce0 (0x6749 bytes) 000871 1788901525.903463 trunc from 0x038451 to 0x03f62f (0x71df bytes) 000872 1788901525.923496 trunc from 0x03f630 to 0x03ec6e (0x9c1 bytes) 000874 1788901525.940241 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ec6f): Mirror 14: 0x1a0c91cb (stale) Mirror 18: 0x1a0c91cb (stale) Mirror 21: 0x1a0c91cb (stale) Mirror 22: 0x1a0c91cb (stale) Mirror 25: 0x1a0c91cb (stale) Mirror 26: 0x1a0c91cb (stale) Mirror 27: 0x1a0c91cb (stale) Mirror 28: 0x1a0c91cb (stale) Mirror 29: 0x1a0c91cb (stale) Mirror 30: 0x927898ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec6f): Mirror 14: 0x1a0c91cb (stale) Mirror 18: 0x1a0c91cb (stale) Mirror 21: 0x1a0c91cb (stale) Mirror 22: 0x1a0c91cb (stale) Mirror 25: 0x1a0c91cb (stale) Mirror 26: 0x1a0c91cb (stale) Mirror 27: 0x1a0c91cb (stale) Mirror 28: 0x1a0c91cb (stale) Mirror 29: 0x1a0c91cb (stale) Mirror 30: 0x927898ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec6f: skipped 000876 1788901526.400885 fallocate 0x001bdd thru 0x00c031 (0xa455 bytes) 000877 1788901526.404796 trunc from 0x00483f to 0x012386 (0xdb48 bytes) 000878 1788901526.409043 trunc from 0x00b0e4 to 0x00e83c (0x3759 bytes) 000879 1788901526.412322 trunc from 0x03ec6f to 0x0155cb (0x296a3 bytes) 000880 1788901526.432279 MIRROR_RESYNC 11 mirrors 000881 1788901527.621096 punch from 0x00cb95 to 0x0155cb (0x8a37 bytes) 000882 1788901527.650085 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x155cc): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x155cc): Mirror 14: 0x1c7dc8a3 (stale) Mirror 18: 0x1c7dc8a3 (stale) Mirror 21: 0x1c7dc8a3 (stale) Mirror 22: 0x1c7dc8a3 (stale) Mirror 25: 0x1c7dc8a3 (stale) Mirror 26: 0x1c7dc8a3 (stale) Mirror 27: 0x1c7dc8a3 (stale) Mirror 28: 0x1c7dc8a3 (stale) Mirror 29: 0x1c7dc8a3 (stale) Mirror 30: 0x1c7dc8a3 (stale) CRC-32 checksum value for chunk [0, 0x155cc): Mirror 1: 0xba469ba Mirror 31: 0xba469ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x155cc: skipped 000884 1788901528.487365 fallocate 0x006457 thru 0x0145a0 (0xe14a bytes) 000885 1788901528.524783 trunc from 0x0155cc to 0x0041d1 (0x113fa bytes) 000886 1788901528.543700 trunc from 0x0041d2 to 0x01f496 (0x1b2c5 bytes) 000887 1788901528.561504 read 0x012d66 thru 0x01a59c (0x7837 bytes) 000888 1788901528.570504 punch from 0x014903 to 0x01f496 (0xab94 bytes) 000889 1788901528.574294 trunc from 0x01f497 to 0x01e3ef (0x10a7 bytes) 000890 1788901528.589781 read 0x019cf0 thru 0x01ce34 (0x3145 bytes) 000891 1788901528.601765 trunc from 0x0076f9 to 0x012c9a (0xb5a2 bytes) 000892 1788901528.607953 mapread 0x00ba1b thru 0x0132fa (0x78e0 bytes) 000893 1788901528.652570 write 0x0024e6 thru 0x00fabd (0xd5d8 bytes) 000894 1788901528.659367 punch from 0x00c442 to 0x015862 (0x9421 bytes) 000895 1788901528.682624 fallocate 0x028f4a thru 0x02bd32 (0x2de9 bytes) 000896 1788901528.688124 trunc from 0x01e3f0 to 0x02f070 (0x10c81 bytes) 000897 1788901528.705116 mapwrite 0x002c0a thru 0x007ab6 (0x4ead bytes) 000898 1788901528.736019 read 0x01c5f1 thru 0x01df88 (0x1998 bytes) 000899 1788901528.736514 trunc from 0x026ff1 to 0x02f070 (0x8080 bytes) 000900 1788901528.739858 write 0x0185bc thru 0x021db5 (0x97fa bytes) 000901 1788901528.749665 mapread 0x00bb80 thru 0x01196d (0x5dee bytes) 000902 1788901528.751357 punch from 0x0129db to 0x021833 (0xee59 bytes) 000903 1788901528.762064 write 0x013ec0 thru 0x021fd7 (0xe118 bytes) 000904 1788901528.770657 trunc from 0x0225b8 to 0x02961b (0x7064 bytes) 000906 1788901528.775327 fallocate 0x01e3b5 thru 0x021a06 (0x3652 bytes) 000907 1788901528.779120 trunc from 0x02f071 to 0x0053d4 (0x29c9c bytes) 000908 1788901528.795368 mapread 0x00163a thru 0x003deb (0x27b2 bytes) 000909 1788901528.796814 write 0x01f08b thru 0x029d32 (0xaca8 bytes) 000910 1788901528.800258 mapread 0x003127 thru 0x00a083 (0x6f5d bytes) 000911 1788901528.818363 trunc from 0x029d33 to 0x03e2e9 (0x145b7 bytes) 000912 1788901528.828563 mapread 0x036196 thru 0x03ad40 (0x4bab bytes) 000913 1788901528.838939 fallocate 0x03d4f3 thru 0x03ffff (0x2b0d bytes) 000914 1788901528.843077 trunc from 0x007f7b to 0x009d7d (0x1e03 bytes) 000915 1788901528.846123 fallocate 0x02cad4 thru 0x035e8a (0x93b7 bytes) 000916 1788901528.856369 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e2ea): Mirror 14: 0x4846c3ed (stale) Mirror 18: 0x4846c3ed (stale) Mirror 22: 0x4846c3ed (stale) Mirror 25: 0x4846c3ed (stale) Mirror 26: 0x4846c3ed (stale) Mirror 27: 0x4846c3ed (stale) Mirror 28: 0x4846c3ed (stale) Mirror 29: 0x4846c3ed (stale) Mirror 30: 0x4846c3ed (stale) Mirror 31: 0xdf35e97c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e2ea): Mirror 14: 0x4846c3ed (stale) Mirror 18: 0x4846c3ed (stale) Mirror 22: 0x4846c3ed (stale) Mirror 25: 0x4846c3ed (stale) Mirror 26: 0x4846c3ed (stale) Mirror 27: 0x4846c3ed (stale) Mirror 28: 0x4846c3ed (stale) Mirror 29: 0x4846c3ed (stale) Mirror 30: 0x4846c3ed (stale) Mirror 31: 0xdf35e97c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e2ea: skipped 000917 1788901529.302901 mapwrite 0x00a3f5 thru 0x019ead (0xfab9 bytes) 000918 1788901529.365902 mapwrite 0x0132ed thru 0x021d96 (0xeaaa bytes) 000919 1788901529.395200 read 0x01068a thru 0x01fa79 (0xf3f0 bytes) 000920 1788901529.395902 read 0x01925d thru 0x028638 (0xf3dc bytes) 000922 1788901529.407327 fallocate 0x039113 thru 0x03ffff (0x6eed bytes) 000923 1788901529.412305 punch from 0x026dc9 to 0x036032 (0xf26a bytes) 000924 1788901529.416416 read 0x0075ff thru 0x0146ff (0xd101 bytes) 000925 1788901529.416976 punch from 0x03fa96 to 0x03ffff (0x56a bytes) 000926 1788901529.427847 MIRROR_RESYNC 11 mirrors 000927 1788901530.884504 MIRROR_EXTEND to 12 mirrors 000928 1788901531.465218 mapwrite 0x00cb2f thru 0x0105b1 (0x3a83 bytes) 000929 1788901531.548365 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xd87fbdbb (stale) Mirror 18: 0xd87fbdbb (stale) Mirror 22: 0xd87fbdbb (stale) Mirror 25: 0xd87fbdbb (stale) Mirror 26: 0xd87fbdbb (stale) Mirror 27: 0xd87fbdbb (stale) Mirror 28: 0xd87fbdbb (stale) Mirror 29: 0xd87fbdbb (stale) Mirror 30: 0xd87fbdbb (stale) Mirror 31: 0xd87fbdbb (stale) Mirror 32: 0xd87fbdbb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9ee5c5d9 Mirror 33: 0x9ee5c5d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000930 1788901532.272624 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xd87fbdbb (stale) Mirror 18: 0xd87fbdbb (stale) Mirror 22: 0xd87fbdbb (stale) Mirror 25: 0xd87fbdbb (stale) Mirror 26: 0xd87fbdbb (stale) Mirror 27: 0xd87fbdbb (stale) Mirror 28: 0xd87fbdbb (stale) Mirror 29: 0xd87fbdbb (stale) Mirror 30: 0xd87fbdbb (stale) Mirror 31: 0xd87fbdbb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0xd87fbdbb (stale) Mirror 18: 0xd87fbdbb (stale) Mirror 22: 0xd87fbdbb (stale) Mirror 25: 0xd87fbdbb (stale) Mirror 26: 0xd87fbdbb (stale) Mirror 27: 0xd87fbdbb (stale) Mirror 28: 0xd87fbdbb (stale) Mirror 29: 0xd87fbdbb (stale) Mirror 30: 0xd87fbdbb (stale) Mirror 31: 0xd87fbdbb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9ee5c5d9 Mirror 33: 0x9ee5c5d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000931 1788901533.012083 read 0x031837 thru 0x03c865 (0xb02f bytes) 000932 1788901533.031505 trunc from 0x040000 to 0x004416 (0x3bbe9 bytes) 000933 1788901533.075125 trunc from 0x0030fe to 0x004416 (0x1319 bytes) 000934 1788901533.080964 read 0x00419b thru 0x004416 (0x27c bytes) 000935 1788901533.090680 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x4417): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4417): Mirror 14: 0x7ab2169c (stale) Mirror 18: 0x7ab2169c (stale) Mirror 22: 0x7ab2169c (stale) Mirror 25: 0x7ab2169c (stale) Mirror 26: 0x7ab2169c (stale) Mirror 27: 0x7ab2169c (stale) Mirror 28: 0x7ab2169c (stale) Mirror 29: 0x7ab2169c (stale) Mirror 30: 0x7ab2169c (stale) Mirror 31: 0x7ab2169c (stale) Mirror 33: 0x7ab2169c (stale) CRC-32 checksum value for chunk [0, 0x4417): Mirror 1: 0x12bb6990 Mirror 34: 0x12bb6990 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4417: skipped 000937 1788901533.651135 punch from 0x001ca0 to 0x00233e (0x69f bytes) 000938 1788901533.675702 trunc from 0x004417 to 0x02eff7 (0x2abe1 bytes) 000939 1788901533.714262 punch from 0x01cac8 to 0x028ad0 (0xc009 bytes) 000940 1788901533.717304 write 0x00dd0b thru 0x00f792 (0x1a88 bytes) 000941 1788901533.724534 MIRROR_RESYNC 13 mirrors 000942 1788901535.340414 trunc from 0x02eff8 to 0x01f79f (0xf858 bytes) 000943 1788901535.378413 mapwrite 0x0066f4 thru 0x01061f (0x9f2c bytes) 000944 1788901535.421709 mapwrite 0x0009a9 thru 0x003d81 (0x33d9 bytes) 000945 1788901535.444660 trunc from 0x01f7a0 to 0x03155d (0x11dbe bytes) 000946 1788901535.465318 trunc from 0x02cd82 to 0x03155d (0x47dc bytes) 000947 1788901535.471643 mapwrite 0x020322 thru 0x021205 (0xee4 bytes) 000948 1788901535.496546 fallocate 0x033dc7 thru 0x038713 (0x494d bytes) 000949 1788901535.509625 MIRROR_RESYNC 13 mirrors 000950 1788901537.555010 trunc from 0x038714 to 0x031499 (0x727a bytes) 000951 1788901537.594039 read 0x014a22 thru 0x018f17 (0x44f6 bytes) 000952 1788901537.607521 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3149a): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3149a): Mirror 14: 0x2c82282b (stale) Mirror 18: 0x2c82282b (stale) Mirror 22: 0x2c82282b (stale) Mirror 25: 0x2c82282b (stale) Mirror 26: 0x2c82282b (stale) Mirror 27: 0x2c82282b (stale) Mirror 28: 0x2c82282b (stale) Mirror 29: 0x2c82282b (stale) Mirror 30: 0x2c82282b (stale) Mirror 31: 0x2c82282b (stale) Mirror 33: 0x2c82282b (stale) Mirror 34: 0x2c82282b (stale) CRC-32 checksum value for chunk [0, 0x3149a): Mirror 1: 0x2c82282b Mirror 35: 0x2c82282b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3149a: skipped 000953 1788901538.302354 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3149a): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3149a): Mirror 14: 0x2c82282b (stale) Mirror 18: 0x2c82282b (stale) Mirror 22: 0x2c82282b (stale) Mirror 25: 0x2c82282b (stale) Mirror 26: 0x2c82282b (stale) Mirror 27: 0x2c82282b (stale) Mirror 28: 0x2c82282b (stale) Mirror 29: 0x2c82282b (stale) Mirror 30: 0x2c82282b (stale) Mirror 31: 0x2c82282b (stale) Mirror 33: 0x2c82282b (stale) Mirror 34: 0x2c82282b (stale) CRC-32 checksum value for chunk [0, 0x3149a): Mirror 1: 0x2c82282b Mirror 35: 0x2c82282b Mirror 36: 0x2c82282b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3149a: skipped 000954 1788901539.016507 trunc from 0x01922f to 0x025ea9 (0xcc7b bytes) 000955 1788901539.055542 trunc from 0x0162cd to 0x022f5f (0xcc93 bytes) 000956 1788901539.060342 trunc from 0x03149a to 0x02faf2 (0x19a7 bytes) 000957 1788901539.093799 read 0x01086e thru 0x0153e8 (0x4b7b bytes) 000958 1788901539.103085 trunc from 0x021e3e to 0x02ac7f (0x8e42 bytes) 000959 1788901539.108689 trunc from 0x02faf3 to 0x004de2 (0x2ad10 bytes) 000960 1788901539.120438 trunc from 0x004de3 to 0x03c6b6 (0x378d4 bytes) 000961 1788901539.132212 trunc from 0x03c6b7 to 0x023492 (0x19224 bytes) 000962 1788901539.145569 fallocate 0x02928f thru 0x02d989 (0x46fb bytes) 000963 1788901539.150415 mapwrite 0x006c8c thru 0x006fa5 (0x31a bytes) 000964 1788901539.162558 mapread 0x01be83 thru 0x01bfc7 (0x145 bytes) 000965 1788901539.166410 trunc from 0x0171ad to 0x019ae6 (0x293a bytes) 000966 1788901539.171000 punch from 0x01b02e to 0x01ed6c (0x3d3f bytes) 000967 1788901539.177951 fallocate 0x01781d thru 0x018cd3 (0x14b7 bytes) 000968 1788901539.182584 fallocate 0x0380f9 thru 0x03ffff (0x7f07 bytes) 000970 1788901539.189286 write 0x031822 thru 0x039aa1 (0x8280 bytes) 000971 1788901539.190362 mapwrite 0x02f57a thru 0x033085 (0x3b0c bytes) 000972 1788901539.210981 trunc from 0x039aa2 to 0x0203b4 (0x196ed bytes) 000973 1788901539.227284 MIRROR_RESYNC 15 mirrors 000974 1788901541.111931 trunc from 0x0203b5 to 0x036b4f (0x1679b bytes) 000975 1788901541.161614 fallocate 0x03003a thru 0x03f8a6 (0xf86d bytes) 000976 1788901541.172919 MIRROR_RESYNC 15 mirrors 000978 1788901542.968865 read 0x01339e thru 0x015618 (0x227b bytes) 000979 1788901542.972117 fallocate 0x03772a thru 0x03ef31 (0x7808 bytes) 000980 1788901543.001018 mapread 0x0263c3 thru 0x02d66a (0x72a8 bytes) 000981 1788901543.018298 punch from 0x0053a2 to 0x00a4cd (0x512c bytes) 000982 1788901543.021976 write 0x01326d thru 0x01934d (0x60e1 bytes) 000983 1788901543.032414 fallocate 0x03d523 thru 0x03ef0b (0x19e9 bytes) 000984 1788901543.037263 trunc from 0x01d63a to 0x02d2ad (0xfc74 bytes) 000985 1788901543.042664 punch from 0x009945 to 0x00fc51 (0x630d bytes) 000986 1788901543.050342 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3ef32): Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef32): Mirror 14: 0xd12b1b9e (stale) Mirror 18: 0xd12b1b9e (stale) Mirror 22: 0xd12b1b9e (stale) Mirror 25: 0xd12b1b9e (stale) Mirror 26: 0xd12b1b9e (stale) Mirror 27: 0xd12b1b9e (stale) Mirror 28: 0xd12b1b9e (stale) Mirror 29: 0xd12b1b9e (stale) Mirror 30: 0xd12b1b9e (stale) Mirror 31: 0xd12b1b9e (stale) Mirror 33: 0xd12b1b9e (stale) Mirror 34: 0xd12b1b9e (stale) Mirror 35: 0xd12b1b9e (stale) Mirror 36: 0xd12b1b9e (stale) CRC-32 checksum value for chunk [0, 0x3ef32): Mirror 1: 0x6a533c7d Mirror 37: 0x6a533c7d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef32: skipped 000987 1788901543.780181 trunc from 0x008236 to 0x00af2d (0x2cf8 bytes) 000988 1788901543.814228 write 0x01854a thru 0x026a9a (0xe551 bytes) 000989 1788901543.833941 MIRROR_SPLIT mirror 12 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef32): Mirror 14: 0xd12b1b9e (stale) Mirror 18: 0xd12b1b9e (stale) Mirror 22: 0xd12b1b9e (stale) Mirror 25: 0xd12b1b9e (stale) Mirror 26: 0xd12b1b9e (stale) Mirror 27: 0xd12b1b9e (stale) Mirror 28: 0xd12b1b9e (stale) Mirror 29: 0xd12b1b9e (stale) Mirror 30: 0xd12b1b9e (stale) Mirror 31: 0xd12b1b9e (stale) Mirror 33: 0xd12b1b9e (stale) Mirror 35: 0xd12b1b9e (stale) Mirror 36: 0xd12b1b9e (stale) Mirror 37: 0x6a533c7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef32): Mirror 14: 0xd12b1b9e (stale) Mirror 18: 0xd12b1b9e (stale) Mirror 22: 0xd12b1b9e (stale) Mirror 25: 0xd12b1b9e (stale) Mirror 26: 0xd12b1b9e (stale) Mirror 27: 0xd12b1b9e (stale) Mirror 28: 0xd12b1b9e (stale) Mirror 29: 0xd12b1b9e (stale) Mirror 30: 0xd12b1b9e (stale) Mirror 31: 0xd12b1b9e (stale) Mirror 33: 0xd12b1b9e (stale) Mirror 35: 0xd12b1b9e (stale) Mirror 36: 0xd12b1b9e (stale) Mirror 37: 0x6a533c7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef32: skipped 000990 1788901544.367286 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ef32): Mirror 18: 0xd12b1b9e (stale) Mirror 22: 0xd12b1b9e (stale) Mirror 25: 0xd12b1b9e (stale) Mirror 26: 0xd12b1b9e (stale) Mirror 27: 0xd12b1b9e (stale) Mirror 28: 0xd12b1b9e (stale) Mirror 29: 0xd12b1b9e (stale) Mirror 30: 0xd12b1b9e (stale) Mirror 31: 0xd12b1b9e (stale) Mirror 33: 0xd12b1b9e (stale) Mirror 35: 0xd12b1b9e (stale) Mirror 36: 0xd12b1b9e (stale) Mirror 37: 0x6a533c7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ef32): Mirror 18: 0xd12b1b9e (stale) Mirror 22: 0xd12b1b9e (stale) Mirror 25: 0xd12b1b9e (stale) Mirror 26: 0xd12b1b9e (stale) Mirror 27: 0xd12b1b9e (stale) Mirror 28: 0xd12b1b9e (stale) Mirror 29: 0xd12b1b9e (stale) Mirror 30: 0xd12b1b9e (stale) Mirror 31: 0xd12b1b9e (stale) Mirror 33: 0xd12b1b9e (stale) Mirror 35: 0xd12b1b9e (stale) Mirror 36: 0xd12b1b9e (stale) Mirror 37: 0x6a533c7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ef32: skipped 000991 1788901544.842357 trunc from 0x012017 to 0x019425 (0x740f bytes) 000994 1788901544.846751 write 0x001ba6 thru 0x00d508 (0xb963 bytes) 000995 1788901544.863992 punch from 0x03dd74 to 0x03e696 (0x923 bytes) 000996 1788901544.868377 mapread 0x02ef55 thru 0x0313c1 (0x246d bytes) 000998 1788901544.886904 trunc from 0x03ef32 to 0x00ac6c (0x342c5 bytes) 000999 1788901544.911369 read 0x00a9b6 thru 0x00ac6c (0x2b7 bytes) 001000 1788901544.912069 fallocate 0x003d0e thru 0x007e39 (0x412c bytes) All operations completed A-OK!