== sanity-flr test 70a: flr mode fsx test ================ 01:33:25 (1789709605) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 9606 000001 1789709606.680628 mapwrite 0x0314eb thru 0x037009 (0x5b1f bytes) 000002 1789709606.712918 read 0x01e098 thru 0x02dd7d (0xfce6 bytes) 000003 1789709606.719128 mapread 0x0219a6 thru 0x02fd35 (0xe390 bytes) 000004 1789709606.720131 punch from 0x01b485 to 0x022185 (0x6d01 bytes) 000005 1789709606.725745 punch from 0x00b524 to 0x010a75 (0x5552 bytes) 000007 1789709606.732228 mapread 0x01207b thru 0x020a11 (0xe997 bytes) truncating to largest ever: 0x2a6f9 000008 1789709606.742670 trunc from 0x03700a to 0x02a6f8 (0xc911 bytes) 000009 1789709606.754198 mapwrite 0x00d2b6 thru 0x01180d (0x4558 bytes) 000010 1789709606.776267 MIRROR_EXTEND to 2 mirrors 000011 1789709607.091126 write 0x02029e thru 0x029b49 (0x98ac bytes) 000013 1789709607.114411 trunc from 0x02a6f9 to 0x00d142 (0x1d5b6 bytes) fallocating to largest ever: 0x313fb 000014 1789709607.133788 fallocate 0x029ee7 thru 0x0313fa (0x7514 bytes) 000015 1789709607.136472 punch from 0x00c21d to 0x010643 (0x4427 bytes) 000016 1789709607.138667 punch from 0x02c4fe to 0x0313fa (0x4efd bytes) 000017 1789709607.141046 punch from 0x02673f to 0x02bb10 (0x53d2 bytes) 000019 1789709607.150488 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) 000020 1789709607.221784 mapread 0x01c6ba thru 0x0295a1 (0xcee8 bytes) 000021 1789709607.241691 fallocate 0x01a5bb thru 0x027df5 (0xd83b bytes) 000022 1789709607.245313 mapread 0x005441 thru 0x00dc19 (0x87d9 bytes) 000023 1789709607.256213 MIRROR_EXTEND to 2 mirrors 000024 1789709607.581454 trunc from 0x0313fb to 0x01d7db (0x13c1f bytes) 000025 1789709607.606656 mapread 0x00f1f0 thru 0x018961 (0x9772 bytes) 000026 1789709607.615071 punch from 0x00338b to 0x004265 (0xedb bytes) 000027 1789709607.617611 write 0x005532 thru 0x0102a1 (0xad70 bytes) 000028 1789709607.620436 mapwrite 0x03ab46 thru 0x03ffff (0x54ba bytes) 000029 1789709607.646175 punch from 0x026d53 to 0x02d1e8 (0x6496 bytes) 000030 1789709607.653336 punch from 0x02795c to 0x02ddfe (0x64a3 bytes) 000031 1789709607.656600 trunc from 0x01f830 to 0x02f3bd (0xfb8e bytes) 000032 1789709607.659349 trunc from 0x018b02 to 0x023c26 (0xb125 bytes) 000033 1789709607.662351 read 0x03d1b2 thru 0x03e389 (0x11d8 bytes) 000034 1789709607.662962 trunc from 0x02345a to 0x02b79a (0x8341 bytes) 000035 1789709607.666023 write 0x0319eb thru 0x03ffff (0xe615 bytes) 000036 1789709607.668784 trunc from 0x040000 to 0x0093b1 (0x36c4e bytes) 000037 1789709607.677467 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x93b2): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x93b2): Mirror 2: 0x94d5134d (stale) CRC-32 checksum value for chunk [0, 0x93b2): Mirror 1: 0x1034a49 Mirror 3: 0x1034a49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x93b2: skipped 000038 1789709608.044913 write 0x00af9e thru 0x017457 (0xc4ba bytes) 000039 1789709608.065115 trunc from 0x017458 to 0x009e53 (0xd604 bytes) 000040 1789709608.079233 trunc from 0x009e54 to 0x0260d1 (0x1c27e bytes) 000041 1789709608.090389 mapwrite 0x013598 thru 0x021f2e (0xe997 bytes) 000042 1789709608.120953 trunc from 0x019c82 to 0x0260d1 (0xc450 bytes) 000043 1789709608.125132 punch from 0x0010fa to 0x00fd19 (0xec20 bytes) 000045 1789709608.134182 write 0x03003d thru 0x03e711 (0xe6d5 bytes) 000047 1789709608.137218 punch from 0x0248fc to 0x02522c (0x931 bytes) fallocating to largest ever: 0x3db72 000048 1789709608.140151 fallocate 0x03bdfc thru 0x03db71 (0x1d76 bytes) 000049 1789709608.144644 write 0x00eeef thru 0x01d50e (0xe620 bytes) 000050 1789709608.154038 read 0x02070a thru 0x023b6c (0x3463 bytes) 000051 1789709608.157801 punch from 0x016347 to 0x01a404 (0x40be bytes) 000052 1789709608.166330 write 0x015279 thru 0x0161c1 (0xf49 bytes) 000053 1789709608.170816 trunc from 0x03e712 to 0x03af70 (0x37a1 bytes) 000054 1789709608.181278 trunc from 0x03af71 to 0x00e22d (0x2cd43 bytes) 000055 1789709608.198173 write 0x03ac41 thru 0x03ffff (0x53bf bytes) 000056 1789709608.199465 punch from 0x02d629 to 0x0385fe (0xafd6 bytes) 000057 1789709608.204074 trunc from 0x040000 to 0x015159 (0x2aea6 bytes) 000059 1789709608.217004 trunc from 0x01515a to 0x011b3f (0x361a bytes) 000060 1789709608.228451 MIRROR_RESYNC 3 mirrors 000061 1789709608.630112 read 0x00e841 thru 0x011b3f (0x32ff bytes) 000062 1789709608.637610 MIRROR_EXTEND to 4 mirrors 000063 1789709609.011458 mapwrite 0x02a0bf thru 0x02ce7f (0x2dc1 bytes) fallocating to largest ever: 0x40000 000064 1789709609.102768 fallocate 0x03c5b3 thru 0x03ffff (0x3a4d bytes) 000065 1789709609.108917 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000066 1789709609.292966 trunc from 0x02bd8f to 0x0329f3 (0x6c65 bytes) 000067 1789709609.299844 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000068 1789709609.471388 fallocate 0x02d494 thru 0x038f67 (0xbad4 bytes) 000069 1789709609.475378 trunc from 0x01b9f1 to 0x028851 (0xce61 bytes) 000070 1789709609.480646 mapread 0x026275 thru 0x033d19 (0xdaa5 bytes) 000071 1789709609.493697 read 0x023705 thru 0x024de4 (0x16e0 bytes) 000072 1789709609.494108 mapread 0x01de03 thru 0x02462e (0x682c bytes) 000073 1789709609.499258 write 0x01eb76 thru 0x0294db (0xa966 bytes) 000074 1789709609.503210 read 0x028e12 thru 0x029a3e (0xc2d bytes) 000075 1789709609.503746 write 0x020b39 thru 0x027eae (0x7376 bytes) 000076 1789709609.505284 write 0x002569 thru 0x00e77b (0xc213 bytes) 000077 1789709609.512536 punch from 0x001649 to 0x0109e6 (0xf39e bytes) 000078 1789709609.521895 read 0x00f2bb thru 0x01260f (0x3355 bytes) 000079 1789709609.526127 mapread 0x033f6d thru 0x034afb (0xb8f bytes) 000080 1789709609.526749 punch from 0x03ce2c to 0x03ffff (0x31d4 bytes) 000081 1789709609.529188 punch from 0x00ea05 to 0x015f81 (0x757d bytes) 000082 1789709609.531916 fallocate 0x016b0e thru 0x019205 (0x26f8 bytes) 000083 1789709609.534515 mapread 0x021da9 thru 0x02804b (0x62a3 bytes) 000084 1789709609.535214 trunc from 0x007b2f to 0x00b3c0 (0x3892 bytes) 000085 1789709609.541893 mapread 0x030f15 thru 0x0326bc (0x17a8 bytes) 000086 1789709609.542891 fallocate 0x01bcce thru 0x02726f (0xb5a2 bytes) 000087 1789709609.546363 mapwrite 0x02d4f1 thru 0x0329ac (0x54bc bytes) 000088 1789709609.560356 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6c1f8222 Mirror 4: 0x6c1f8222 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000090 1789709610.007905 trunc from 0x00bc98 to 0x0150b7 (0x9420 bytes) 000094 1789709610.029773 fallocate 0x012e04 thru 0x01454d (0x174a bytes) 000095 1789709610.033116 mapread 0x00ab6c thru 0x017325 (0xc7ba bytes) 000096 1789709610.051584 read 0x03fd57 thru 0x03ffff (0x2a9 bytes) 000097 1789709610.054764 mapread 0x036f4b thru 0x03ffff (0x90b5 bytes) 000099 1789709610.061082 write 0x01e2e0 thru 0x028c63 (0xa984 bytes) 000100 1789709610.069775 fallocate 0x00375a thru 0x00e6c9 (0xaf70 bytes) 000101 1789709610.072634 read 0x0358ba thru 0x03b493 (0x5bda bytes) 000102 1789709610.073168 trunc from 0x00c932 to 0x01b707 (0xedd6 bytes) 000103 1789709610.076088 mapread 0x02bfff thru 0x03100b (0x500d bytes) 000104 1789709610.083494 fallocate 0x001fe9 thru 0x00536d (0x3385 bytes) 000105 1789709610.087007 mapread 0x014df1 thru 0x01bc14 (0x6e24 bytes) 000106 1789709610.087690 trunc from 0x008f30 to 0x00a5de (0x16af bytes) 000107 1789709610.090962 read 0x030d41 thru 0x0335db (0x289b bytes) 000108 1789709610.091392 write 0x03a377 thru 0x03ffff (0x5c89 bytes) 000109 1789709610.092156 mapread 0x011f29 thru 0x012487 (0x55f bytes) 000110 1789709610.092787 trunc from 0x016d19 to 0x01fc83 (0x8f6b bytes) 000111 1789709610.107211 mapread 0x0318c0 thru 0x03c4ce (0xac0f bytes) 000112 1789709610.108028 mapread 0x0107ae thru 0x01cd9f (0xc5f2 bytes) 000113 1789709610.118682 read 0x038ed8 thru 0x03ffff (0x7128 bytes) 000114 1789709610.119360 read 0x036fe2 thru 0x03ffff (0x901e bytes) 000115 1789709610.120349 read 0x00ee63 thru 0x01a0cc (0xb26a bytes) 000116 1789709610.120872 read 0x02859a thru 0x034645 (0xc0ac bytes) 000117 1789709610.121584 trunc from 0x040000 to 0x03f504 (0xafb bytes) 000118 1789709610.152392 write 0x03ec99 thru 0x03ffff (0x1367 bytes) 000119 1789709610.165035 trunc from 0x03300b to 0x03ffff (0xcff5 bytes) 000120 1789709610.174727 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6c1f8222 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6c1f8222 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000121 1789709610.368960 mapread 0x00afb0 thru 0x018546 (0xd597 bytes) 000122 1789709610.389816 trunc from 0x0175e5 to 0x01a5ee (0x300a bytes) 000123 1789709610.396448 trunc from 0x040000 to 0x01b0d6 (0x24f29 bytes) 000125 1789709610.408623 mapwrite 0x03c6af thru 0x03ffff (0x3951 bytes) 000126 1789709610.435990 mapread 0x02a864 thru 0x037409 (0xcba6 bytes) 000127 1789709610.449629 trunc from 0x0045ce to 0x00ab48 (0x657b bytes) 000128 1789709610.454623 write 0x030392 thru 0x033e3d (0x3aac bytes) 000130 1789709610.456095 fallocate 0x03ab3a thru 0x03ae99 (0x360 bytes) 000131 1789709610.460407 punch from 0x03b12c to 0x03b7dc (0x6b1 bytes) 000132 1789709610.463787 trunc from 0x00f1f9 to 0x01e250 (0xf058 bytes) 000133 1789709610.467080 read 0x0272e1 thru 0x0289d9 (0x16f9 bytes) 000134 1789709610.467617 trunc from 0x040000 to 0x0379c9 (0x8636 bytes) 000135 1789709610.477146 fallocate 0x03a3ff thru 0x03ffff (0x5c01 bytes) 000136 1789709610.479654 trunc from 0x013ab3 to 0x013fbe (0x50c bytes) 000137 1789709610.483621 trunc from 0x040000 to 0x010b81 (0x2f47e bytes) 000138 1789709610.491442 punch from 0x00db44 to 0x010b81 (0x303e bytes) 000139 1789709610.497216 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x10b82): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10b82): Mirror 4: 0x2875b92c (stale) CRC-32 checksum value for chunk [0, 0x10b82): Mirror 1: 0x2875b92c Mirror 5: 0x2875b92c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10b82: skipped 000140 1789709610.895693 fallocate 0x0093d1 thru 0x00c350 (0x2f80 bytes) 000142 1789709610.927191 MIRROR_RESYNC 3 mirrors 000143 1789709611.267322 write 0x03c4ee thru 0x03ffff (0x3b12 bytes) 000144 1789709611.288311 trunc from 0x004ba4 to 0x010435 (0xb892 bytes) 000145 1789709611.292080 trunc from 0x02755f to 0x029a2c (0x24ce bytes) 000146 1789709611.295381 fallocate 0x0009db thru 0x00599c (0x4fc2 bytes) 000147 1789709611.298296 fallocate 0x005aaf thru 0x008886 (0x2dd8 bytes) 000148 1789709611.305847 trunc from 0x030217 to 0x033313 (0x30fd bytes) 000149 1789709611.308548 write 0x019e08 thru 0x0268fc (0xcaf5 bytes) 000150 1789709611.317730 trunc from 0x021292 to 0x0267d2 (0x5541 bytes) 000151 1789709611.328637 mapread 0x02a83c thru 0x03538d (0xab52 bytes) 000153 1789709611.347688 punch from 0x018bb9 to 0x02450e (0xb956 bytes) 000154 1789709611.350762 punch from 0x025d40 to 0x02ed99 (0x905a bytes) 000155 1789709611.356365 read 0x029344 thru 0x02e7ee (0x54ab bytes) 000159 1789709611.362773 mapread 0x0270cb thru 0x030435 (0x936b bytes) 000160 1789709611.368159 punch from 0x018b15 to 0x01c674 (0x3b60 bytes) 000161 1789709611.371144 trunc from 0x016c4e to 0x018dbc (0x216f bytes) 000162 1789709611.374211 write 0x00c616 thru 0x01a98e (0xe379 bytes) 000163 1789709611.381057 trunc from 0x014c7b to 0x016624 (0x19aa bytes) 000164 1789709611.391726 mapwrite 0x00be1f thru 0x01a733 (0xe915 bytes) 000165 1789709611.420994 MIRROR_RESYNC 3 mirrors 000166 1789709611.817119 trunc from 0x040000 to 0x0310a2 (0xef5d bytes) 000167 1789709611.871363 read 0x024dde thru 0x02f276 (0xa499 bytes) 000168 1789709611.878689 trunc from 0x0310a3 to 0x00e55b (0x22b47 bytes) 000169 1789709611.900004 fallocate 0x02979f thru 0x0356e5 (0xbf47 bytes) 000170 1789709611.905762 trunc from 0x003081 to 0x008b98 (0x5b18 bytes) 000171 1789709611.910354 read 0x00a628 thru 0x00e55b (0x3f34 bytes) 000172 1789709611.920137 trunc from 0x00e55c to 0x024e78 (0x1691d bytes) 000173 1789709611.941237 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24e79): Mirror 5: 0x33dd7124 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24e79): Mirror 5: 0x33dd7124 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24e79: skipped 000174 1789709612.222669 trunc from 0x024e79 to 0x026921 (0x1aa9 bytes) 000175 1789709612.256556 MIRROR_RESYNC 2 mirrors 000176 1789709612.728378 punch from 0x007e21 to 0x0144ff (0xc6df bytes) 000177 1789709612.767317 write 0x0060ee thru 0x0109e8 (0xa8fb bytes) 000178 1789709612.775061 punch from 0x017622 to 0x021df7 (0xa7d6 bytes) 000179 1789709612.778352 punch from 0x012881 to 0x0158f8 (0x3078 bytes) 000180 1789709612.781410 read 0x01665e thru 0x01dc0f (0x75b2 bytes) 000182 1789709612.788406 read 0x00c1e5 thru 0x01a725 (0xe541 bytes) 000183 1789709612.802571 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) 000184 1789709612.923368 write 0x022a48 thru 0x02a931 (0x7eea bytes) 000185 1789709612.938255 write 0x01953b thru 0x01c538 (0x2ffe bytes) 000186 1789709612.954726 punch from 0x022800 to 0x0248db (0x20dc bytes) 000187 1789709612.975470 fallocate 0x017d82 thru 0x01f364 (0x75e3 bytes) 000188 1789709612.980032 trunc from 0x02a932 to 0x00603a (0x248f7 bytes) 000189 1789709612.995484 fallocate 0x035857 thru 0x03e409 (0x8bb3 bytes) 000190 1789709613.000980 trunc from 0x00603b to 0x006705 (0x6cb bytes) 000192 1789709613.023313 read 0x006312 thru 0x006705 (0x3f4 bytes) 000193 1789709613.028700 write 0x013c77 thru 0x01e4a0 (0xa82a bytes) 000194 1789709613.032717 trunc from 0x01e4a1 to 0x01ff6c (0x1acc bytes) 000195 1789709613.045807 trunc from 0x01ff6d to 0x030e4d (0x10ee1 bytes) 000196 1789709613.063221 mapwrite 0x02b881 thru 0x02bbed (0x36d bytes) 000197 1789709613.083957 mapread 0x003262 thru 0x007029 (0x3dc8 bytes) 000199 1789709613.100777 fallocate 0x0384f9 thru 0x03ffff (0x7b07 bytes) 000200 1789709613.105144 fallocate 0x03bd12 thru 0x03ffff (0x42ee bytes) 000201 1789709613.110024 mapread 0x011e33 thru 0x01ceb5 (0xb083 bytes) 000203 1789709613.116338 fallocate 0x007c44 thru 0x015022 (0xd3df bytes) 000204 1789709613.120443 read 0x008f14 thru 0x00e707 (0x57f4 bytes) 000205 1789709613.121122 read 0x0278ca thru 0x032147 (0xa87e bytes) 000206 1789709613.130120 read 0x03500c thru 0x035992 (0x987 bytes) 000207 1789709613.131192 trunc from 0x040000 to 0x02874e (0x178b1 bytes) 000209 1789709613.146987 read 0x0018b4 thru 0x00d528 (0xbc75 bytes) 000210 1789709613.148212 mapread 0x0281bf thru 0x02874e (0x590 bytes) 000211 1789709613.152771 trunc from 0x00338b to 0x004dc7 (0x1a3d bytes) 000212 1789709613.156867 read 0x00e4d5 thru 0x013706 (0x5232 bytes) 000213 1789709613.157637 trunc from 0x02874f to 0x01d1a3 (0xb5ab bytes) 000214 1789709613.180929 fallocate 0x038d51 thru 0x0394af (0x75f bytes) 000215 1789709613.186368 trunc from 0x0394b0 to 0x0142d1 (0x251de bytes) 000216 1789709613.204242 punch from 0x0096a2 to 0x00adef (0x174e bytes) 000218 1789709613.208820 trunc from 0x001e4b to 0x003ac8 (0x1c7e bytes) 000219 1789709613.215249 MIRROR_EXTEND to 2 mirrors 000221 1789709613.643016 mapwrite 0x03b550 thru 0x03ffff (0x4ab0 bytes) 000223 1789709613.724927 trunc from 0x018e4d to 0x027ed0 (0xf084 bytes) 000224 1789709613.730656 read 0x03284c thru 0x0371f7 (0x49ac bytes) 000225 1789709613.740557 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x21d9d395 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa4491ff6 Mirror 3: 0xa4491ff6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000226 1789709614.495283 trunc from 0x040000 to 0x03ebfb (0x1404 bytes) 000227 1789709614.547117 fallocate 0x038b90 thru 0x03ffff (0x7470 bytes) 000229 1789709614.553093 mapwrite 0x03e12b thru 0x03ffff (0x1ed5 bytes) 000231 1789709614.590174 punch from 0x01d31a to 0x020d98 (0x3a7f bytes) 000232 1789709614.597483 fallocate 0x03b113 thru 0x03ffff (0x4eed bytes) 000233 1789709614.601831 trunc from 0x0136a9 to 0x01d63b (0x9f93 bytes) 000234 1789709614.607499 punch from 0x035266 to 0x039c6e (0x4a09 bytes) 000235 1789709614.615400 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x21d9d395 (stale) Mirror 3: 0xa4491ff6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x74081dba Mirror 4: 0x74081dba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000236 1789709615.349556 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x21d9d395 (stale) Mirror 3: 0xa4491ff6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x74081dba Mirror 4: 0x74081dba Mirror 5: 0x74081dba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000237 1789709615.856211 mapread 0x0110bd thru 0x013ef9 (0x2e3d bytes) 000238 1789709615.870117 trunc from 0x023251 to 0x02440d (0x11bd bytes) 000239 1789709615.892385 trunc from 0x040000 to 0x00ed6f (0x31290 bytes) 000240 1789709615.921026 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xed70): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xed70): Mirror 2: 0xf8cd288a (stale) Mirror 3: 0xf8cd288a (stale) Mirror 4: 0xf8cd288a (stale) Mirror 5: 0xf8cd288a (stale) CRC-32 checksum value for chunk [0, 0xed70): Mirror 1: 0xf8cd288a Mirror 6: 0xf8cd288a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xed70: skipped 000241 1789709616.419287 punch from 0x006bb0 to 0x00d8d6 (0x6d27 bytes) 000242 1789709616.473806 trunc from 0x00ed70 to 0x02d8bb (0x1eb4c bytes) 000243 1789709616.496893 trunc from 0x000e45 to 0x00e95d (0xdb19 bytes) 000244 1789709616.505198 trunc from 0x02d8bc to 0x0188a1 (0x1501a bytes) 000245 1789709616.515056 trunc from 0x0188a2 to 0x033f17 (0x1b676 bytes) 000246 1789709616.539484 mapwrite 0x0270a6 thru 0x027b5d (0xab8 bytes) 000247 1789709616.561097 mapread 0x03174a thru 0x033f17 (0x27ce bytes) 000248 1789709616.577818 fallocate 0x0278b1 thru 0x02a11b (0x286b bytes) 000249 1789709616.581753 trunc from 0x033f18 to 0x01f801 (0x14716 bytes) 000250 1789709616.619158 trunc from 0x01f802 to 0x02779f (0x7f9e bytes) 000251 1789709616.640019 read 0x01718b thru 0x020a58 (0x98ce bytes) 000252 1789709616.654105 fallocate 0x00b202 thru 0x015133 (0x9f32 bytes) 000253 1789709616.663082 trunc from 0x01703b to 0x023dd4 (0xcd9a bytes) 000254 1789709616.670881 mapwrite 0x008974 thru 0x013395 (0xaa22 bytes) 000255 1789709616.712933 trunc from 0x00cadc to 0x01c5a8 (0xfacd bytes) 000256 1789709616.717488 read 0x01f942 thru 0x022247 (0x2906 bytes) 000257 1789709616.725256 write 0x02dcb2 thru 0x0363d5 (0x8724 bytes) 000258 1789709616.726325 fallocate 0x01a6de thru 0x01f280 (0x4ba3 bytes) 000259 1789709616.732142 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: 0xbb9b42b3 (stale) Mirror 3: 0xbb9b42b3 (stale) Mirror 4: 0x70f68e59 (stale) Mirror 5: 0x70f68e59 (stale) Mirror 6: 0x70f68e59 (stale) CRC-32 checksum value for chunk [0, 0x363d6): Mirror 1: 0x5eb390c7 Mirror 7: 0x5eb390c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363d6: skipped 000260 1789709617.243868 fallocate 0x01cfe2 thru 0x020956 (0x3975 bytes) 000261 1789709617.284162 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: 0xbb9b42b3 (stale) Mirror 3: 0xbb9b42b3 (stale) Mirror 4: 0x70f68e59 (stale) Mirror 5: 0x70f68e59 (stale) Mirror 7: 0x5eb390c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: 0xbb9b42b3 (stale) Mirror 3: 0xbb9b42b3 (stale) Mirror 4: 0x70f68e59 (stale) Mirror 5: 0x70f68e59 (stale) Mirror 7: 0x5eb390c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363d6: skipped 000262 1789709617.480272 punch from 0x00367c to 0x005be1 (0x2566 bytes) 000263 1789709617.483085 read 0x01bfad thru 0x01fcab (0x3cff bytes) 000264 1789709617.488154 mapread 0x00cba0 thru 0x013dde (0x723f bytes) 000265 1789709617.499473 mapwrite 0x022c32 thru 0x028998 (0x5d67 bytes) 000266 1789709617.511691 read 0x02cddb thru 0x0363d5 (0x95fb bytes) 000267 1789709617.516810 trunc from 0x035966 to 0x0363d5 (0xa70 bytes) 000268 1789709617.519717 read 0x027d77 thru 0x032651 (0xa8db bytes) 000270 1789709617.523170 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: 0xbb9b42b3 (stale) Mirror 3: 0xbb9b42b3 (stale) Mirror 4: 0x70f68e59 (stale) Mirror 5: 0x70f68e59 (stale) Mirror 7: 0x5eb390c7 (stale) CRC-32 checksum value for chunk [0, 0x363d6): Mirror 1: 0x4fda78d4 Mirror 8: 0x4fda78d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363d6: skipped 000271 1789709617.912348 write 0x01233c thru 0x0216b9 (0xf37e bytes) 000272 1789709617.936783 punch from 0x0168e0 to 0x0230ff (0xc820 bytes) 000273 1789709617.944405 read 0x0001f7 thru 0x0009e2 (0x7ec bytes) 000274 1789709617.950793 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: 0xbb9b42b3 (stale) Mirror 3: 0xbb9b42b3 (stale) Mirror 4: 0x70f68e59 (stale) Mirror 5: 0x70f68e59 (stale) Mirror 7: 0x5eb390c7 (stale) Mirror 8: 0x4fda78d4 (stale) CRC-32 checksum value for chunk [0, 0x363d6): Mirror 1: 0x4f438d96 Mirror 9: 0x4f438d96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363d6: skipped 000275 1789709618.590725 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363d6): Mirror 2: 0xbb9b42b3 (stale) Mirror 3: 0xbb9b42b3 (stale) Mirror 4: 0x70f68e59 (stale) Mirror 5: 0x70f68e59 (stale) Mirror 7: 0x5eb390c7 (stale) Mirror 8: 0x4fda78d4 (stale) CRC-32 checksum value for chunk [0, 0x363d6): Mirror 1: 0x4f438d96 Mirror 9: 0x4f438d96 Mirror 10: 0x4f438d96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363d6: skipped 000276 1789709619.149364 punch from 0x0208f6 to 0x023b13 (0x321e bytes) 000279 1789709619.177318 trunc from 0x0363d6 to 0x03c46b (0x6096 bytes) 000281 1789709619.195130 MIRROR_RESYNC 9 mirrors 000282 1789709620.840847 mapread 0x0169b5 thru 0x023917 (0xcf63 bytes) 000283 1789709620.866069 fallocate 0x02aeb9 thru 0x02e136 (0x327e bytes) 000284 1789709620.895096 mapwrite 0x02c514 thru 0x03103a (0x4b27 bytes) 000285 1789709620.920057 trunc from 0x00487e to 0x006230 (0x19b3 bytes) 000286 1789709620.925988 punch from 0x00d9c6 to 0x0108bf (0x2efa bytes) 000287 1789709620.930806 trunc from 0x03c46c to 0x02b6af (0x10dbc bytes) 000288 1789709620.963229 mapwrite 0x034e68 thru 0x03cff8 (0x8191 bytes) 000289 1789709621.004215 fallocate 0x000611 thru 0x005104 (0x4af4 bytes) 000290 1789709621.006681 fallocate 0x03285a thru 0x03b3c0 (0x8b67 bytes) 000291 1789709621.011835 trunc from 0x012c25 to 0x0198b4 (0x6c90 bytes) 000292 1789709621.014288 trunc from 0x005bf4 to 0x00d20f (0x761c bytes) 000293 1789709621.028390 MIRROR_RESYNC 9 mirrors 000294 1789709622.355128 fallocate 0x011b28 thru 0x01a71a (0x8bf3 bytes) 000295 1789709622.379761 fallocate 0x019d02 thru 0x02544a (0xb749 bytes) 000296 1789709622.383326 trunc from 0x03cff9 to 0x006525 (0x36ad3 bytes) 000297 1789709622.401347 trunc from 0x006526 to 0x0165f3 (0x100ce bytes) 000298 1789709622.412377 trunc from 0x00e31c to 0x016131 (0x7e16 bytes) 000299 1789709622.415246 trunc from 0x00db0d to 0x011081 (0x3575 bytes) 000300 1789709622.422006 trunc from 0x0165f4 to 0x03864b (0x22058 bytes) 000301 1789709622.432806 trunc from 0x03864c to 0x03a6da (0x208f bytes) 000302 1789709622.443502 mapread 0x020589 thru 0x02e1fe (0xdc76 bytes) 000303 1789709622.460471 fallocate 0x034b3d thru 0x038364 (0x3828 bytes) 000304 1789709622.466136 trunc from 0x00e8e0 to 0x017aa3 (0x91c4 bytes) 000305 1789709622.469351 mapread 0x0121cc thru 0x01a805 (0x863a bytes) 000307 1789709622.478090 mapwrite 0x03642a thru 0x03ffff (0x9bd6 bytes) 000308 1789709622.530211 write 0x02130d thru 0x0292c8 (0x7fbc bytes) 000309 1789709622.531514 read 0x023402 thru 0x02fe55 (0xca54 bytes) 000310 1789709622.532074 read 0x007429 thru 0x00ba4c (0x4624 bytes) 000311 1789709622.542617 trunc from 0x0216ae to 0x02d173 (0xbac6 bytes) 000312 1789709622.555807 trunc from 0x040000 to 0x004c9b (0x3b364 bytes) 000313 1789709622.567488 trunc from 0x004c9c to 0x02deed (0x29252 bytes) 000314 1789709622.582776 trunc from 0x02deee to 0x03ea59 (0x10b6c bytes) 000315 1789709622.598595 trunc from 0x02d784 to 0x03cc45 (0xf4c2 bytes) 000316 1789709622.600965 trunc from 0x03ea5a to 0x01477f (0x2a2da bytes) 000317 1789709622.616892 trunc from 0x00cdd3 to 0x01477f (0x79ad bytes) 000318 1789709622.621264 trunc from 0x014780 to 0x03c87a (0x280fb bytes) 000319 1789709622.641343 mapread 0x02f367 thru 0x02f696 (0x330 bytes) 000320 1789709622.646468 punch from 0x012d60 to 0x019eb9 (0x715a bytes) 000321 1789709622.650084 mapread 0x02fee4 thru 0x035d98 (0x5eb5 bytes) 000322 1789709622.676223 fallocate 0x0301a1 thru 0x03b83a (0xb69a bytes) 000323 1789709622.679253 trunc from 0x021db4 to 0x0267fb (0x4a48 bytes) 000324 1789709622.682116 fallocate 0x01288f thru 0x0205cd (0xdd3f bytes) 000325 1789709622.689494 fallocate 0x031171 thru 0x03dbc2 (0xca52 bytes) 000326 1789709622.698089 read 0x03c19a thru 0x03c87a (0x6e1 bytes) 000327 1789709622.712878 mapread 0x00d406 thru 0x0194be (0xc0b9 bytes) 000328 1789709622.713610 fallocate 0x036a79 thru 0x038a57 (0x1fdf bytes) 000329 1789709622.717258 read 0x02cb3f thru 0x02dbdc (0x109e bytes) 000330 1789709622.717644 read 0x02eb73 thru 0x0392fb (0xa789 bytes) 000331 1789709622.718231 mapwrite 0x01afe7 thru 0x028ab1 (0xdacb bytes) 000332 1789709622.740047 mapwrite 0x03c9ed thru 0x03ffff (0x3613 bytes) 000333 1789709622.778691 fallocate 0x000b8f thru 0x00ba8f (0xaf01 bytes) 000335 1789709622.782651 punch from 0x03f679 to 0x03ffff (0x987 bytes) 000336 1789709622.785817 mapwrite 0x015d09 thru 0x017669 (0x1961 bytes) 000337 1789709622.796110 fallocate 0x033efd thru 0x03ffff (0xc103 bytes) 000339 1789709622.802927 punch from 0x010cc9 to 0x018021 (0x7359 bytes) 000340 1789709622.807047 trunc from 0x015185 to 0x022450 (0xd2cc bytes) 000341 1789709622.810023 fallocate 0x0222b7 thru 0x02a3a7 (0x80f1 bytes) 000342 1789709622.812600 trunc from 0x02d019 to 0x033d72 (0x6d5a bytes) 000343 1789709622.814855 mapread 0x0133a0 thru 0x01a235 (0x6e96 bytes) 000344 1789709622.842927 write 0x00e55d thru 0x01a22e (0xbcd2 bytes) 000345 1789709622.844080 mapwrite 0x01a8af thru 0x01ffc6 (0x5718 bytes) 000346 1789709622.876869 fallocate 0x03e26c thru 0x03ffff (0x1d94 bytes) 000347 1789709622.882160 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1c3f910e (stale) Mirror 3: 0x1c3f910e (stale) Mirror 4: 0x1c3f910e (stale) Mirror 5: 0x1c3f910e (stale) Mirror 7: 0x1c3f910e (stale) Mirror 8: 0x1c3f910e (stale) Mirror 9: 0x1c3f910e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1c3f910e (stale) Mirror 3: 0x1c3f910e (stale) Mirror 4: 0x1c3f910e (stale) Mirror 5: 0x1c3f910e (stale) Mirror 7: 0x1c3f910e (stale) Mirror 8: 0x1c3f910e (stale) Mirror 9: 0x1c3f910e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000348 1789709623.109249 trunc from 0x040000 to 0x039354 (0x6cab bytes) 000349 1789709623.127088 punch from 0x0154ea to 0x01668d (0x11a4 bytes) 000350 1789709623.131307 write 0x022210 thru 0x02bee6 (0x9cd7 bytes) 000351 1789709623.139592 mapwrite 0x030ed8 thru 0x03ffc1 (0xf0ea bytes) 000352 1789709623.182014 MIRROR_RESYNC 8 mirrors 000353 1789709624.338075 read 0x018a5c thru 0x01b45e (0x2a03 bytes) 000354 1789709624.344050 read 0x0177e1 thru 0x018163 (0x983 bytes) 000356 1789709624.357093 write 0x00dd86 thru 0x01a066 (0xc2e1 bytes) 000357 1789709624.386317 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3ffc2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffc2): Mirror 2: 0xb279d0be (stale) Mirror 3: 0xb279d0be (stale) Mirror 4: 0xb279d0be (stale) Mirror 5: 0xb279d0be (stale) Mirror 7: 0xb279d0be (stale) Mirror 8: 0xb279d0be (stale) Mirror 9: 0xb279d0be (stale) CRC-32 checksum value for chunk [0, 0x3ffc2): Mirror 1: 0x27d77829 Mirror 10: 0x27d77829 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffc2: skipped 000358 1789709625.229883 trunc from 0x03b7b6 to 0x03c921 (0x116c bytes) 000359 1789709625.262534 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3ffc2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffc2): Mirror 2: 0xb279d0be (stale) Mirror 3: 0xb279d0be (stale) Mirror 4: 0xb279d0be (stale) Mirror 5: 0xb279d0be (stale) Mirror 7: 0xb279d0be (stale) Mirror 8: 0xb279d0be (stale) Mirror 9: 0xb279d0be (stale) Mirror 10: 0x27d77829 (stale) CRC-32 checksum value for chunk [0, 0x3ffc2): Mirror 1: 0x21fa1fa3 Mirror 11: 0x21fa1fa3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffc2: skipped 000360 1789709625.876708 fallocate 0x021174 thru 0x02d414 (0xc2a1 bytes) 000362 1789709625.902080 trunc from 0x03ffc2 to 0x0306a8 (0xf919 bytes) 000363 1789709625.915697 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x306a9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306a9): Mirror 2: 0x174ccd3a (stale) Mirror 3: 0x174ccd3a (stale) Mirror 4: 0x174ccd3a (stale) Mirror 5: 0x174ccd3a (stale) Mirror 7: 0x174ccd3a (stale) Mirror 8: 0x174ccd3a (stale) Mirror 9: 0x174ccd3a (stale) Mirror 10: 0x88a5a167 (stale) Mirror 11: 0x88a5a167 (stale) CRC-32 checksum value for chunk [0, 0x306a9): Mirror 1: 0x88a5a167 Mirror 12: 0x88a5a167 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306a9: skipped 000364 1789709626.721024 fallocate 0x00c365 thru 0x010f45 (0x4be1 bytes) 000366 1789709626.770066 mapwrite 0x0072c1 thru 0x010c77 (0x99b7 bytes) 000367 1789709626.829081 trunc from 0x0306a9 to 0x01456f (0x1c139 bytes) 000368 1789709626.872315 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x14570): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14570): Mirror 2: 0xf21e5a36 (stale) Mirror 3: 0xf21e5a36 (stale) Mirror 4: 0xf21e5a36 (stale) Mirror 5: 0xf21e5a36 (stale) Mirror 7: 0xf21e5a36 (stale) Mirror 8: 0xf21e5a36 (stale) Mirror 9: 0xf21e5a36 (stale) Mirror 10: 0xdc491720 (stale) Mirror 11: 0xdc491720 (stale) Mirror 12: 0xdc491720 (stale) CRC-32 checksum value for chunk [0, 0x14570): Mirror 1: 0xccc08523 Mirror 13: 0xccc08523 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14570: skipped 000369 1789709627.482398 punch from 0x004a9b to 0x012d36 (0xe29c bytes) 000370 1789709627.514308 write 0x02e1cb thru 0x03c3e6 (0xe21c bytes) 000371 1789709627.518550 mapread 0x00999c thru 0x00e368 (0x49cd bytes) 000373 1789709627.530892 fallocate 0x019f21 thru 0x01c9dd (0x2abd bytes) 000374 1789709627.534299 mapwrite 0x003328 thru 0x00ce3c (0x9b15 bytes) 000375 1789709627.564947 write 0x0024f5 thru 0x00472d (0x2239 bytes) 000376 1789709627.565638 trunc from 0x0018ee to 0x0080e7 (0x67fa bytes) 000377 1789709627.572299 mapwrite 0x01bcd8 thru 0x01c4fc (0x825 bytes) 000378 1789709627.590076 read 0x017511 thru 0x024c87 (0xd777 bytes) 000379 1789709627.599455 mapwrite 0x0017bd thru 0x01023c (0xea80 bytes) 000380 1789709627.631026 write 0x0017e2 thru 0x004d41 (0x3560 bytes) 000381 1789709627.636994 MIRROR_RESYNC 12 mirrors 000382 1789709629.784658 fallocate 0x031b2b thru 0x038c1f (0x70f5 bytes) 000383 1789709629.820034 write 0x0055cc thru 0x00c8cc (0x7301 bytes) 000384 1789709629.839278 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c3e7): Mirror 3: 0xb9055546 (stale) Mirror 4: 0xb9055546 (stale) Mirror 5: 0xb9055546 (stale) Mirror 7: 0xb9055546 (stale) Mirror 8: 0xb9055546 (stale) Mirror 9: 0xb9055546 (stale) Mirror 10: 0xb9055546 (stale) Mirror 11: 0xb9055546 (stale) Mirror 12: 0xb9055546 (stale) Mirror 13: 0xb9055546 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c3e7): Mirror 3: 0xb9055546 (stale) Mirror 4: 0xb9055546 (stale) Mirror 5: 0xb9055546 (stale) Mirror 7: 0xb9055546 (stale) Mirror 8: 0xb9055546 (stale) Mirror 9: 0xb9055546 (stale) Mirror 10: 0xb9055546 (stale) Mirror 11: 0xb9055546 (stale) Mirror 12: 0xb9055546 (stale) Mirror 13: 0xb9055546 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c3e7: skipped 000385 1789709630.375780 mapread 0x008429 thru 0x0099f0 (0x15c8 bytes) 000386 1789709630.385005 write 0x01d6e3 thru 0x020c2f (0x354d bytes) 000387 1789709630.413690 MIRROR_RESYNC 11 mirrors 000388 1789709632.435533 fallocate 0x03232d thru 0x039b0e (0x77e2 bytes) 000389 1789709632.496862 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c3e7): Mirror 3: 0x5cf5871f (stale) Mirror 5: 0x5cf5871f (stale) Mirror 7: 0x5cf5871f (stale) Mirror 8: 0x5cf5871f (stale) Mirror 9: 0x5cf5871f (stale) Mirror 10: 0x5cf5871f (stale) Mirror 11: 0x5cf5871f (stale) Mirror 12: 0x5cf5871f (stale) Mirror 13: 0x5cf5871f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c3e7): Mirror 3: 0x5cf5871f (stale) Mirror 5: 0x5cf5871f (stale) Mirror 7: 0x5cf5871f (stale) Mirror 8: 0x5cf5871f (stale) Mirror 9: 0x5cf5871f (stale) Mirror 10: 0x5cf5871f (stale) Mirror 11: 0x5cf5871f (stale) Mirror 12: 0x5cf5871f (stale) Mirror 13: 0x5cf5871f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c3e7: skipped 000390 1789709632.897682 trunc from 0x03c3e7 to 0x014f2f (0x274b7 bytes) 000391 1789709632.913477 mapread 0x0139a6 thru 0x014f2f (0x158a bytes) 000392 1789709632.920544 mapwrite 0x00d4d7 thru 0x019925 (0xc44f bytes) 000393 1789709632.948946 mapwrite 0x011806 thru 0x012d37 (0x1532 bytes) 000394 1789709632.961157 trunc from 0x012810 to 0x016cd0 (0x44c1 bytes) 000395 1789709632.964788 write 0x002584 thru 0x00f003 (0xca80 bytes) 000396 1789709632.971512 mapread 0x019524 thru 0x019925 (0x402 bytes) 000398 1789709632.972452 mapwrite 0x03430b thru 0x03ac40 (0x6936 bytes) 000399 1789709632.999851 MIRROR_RESYNC 10 mirrors 000400 1789709634.560718 mapwrite 0x002660 thru 0x0030ee (0xa8f bytes) 000401 1789709634.628889 punch from 0x026b6f to 0x02792c (0xdbe bytes) 000402 1789709634.632032 trunc from 0x03ac41 to 0x02cb8c (0xe0b4 bytes) 000403 1789709634.641465 punch from 0x02b31c to 0x02cb8c (0x1871 bytes) 000404 1789709634.643960 write 0x00cba8 thru 0x0120e4 (0x553d bytes) 000405 1789709634.649946 write 0x034b1a thru 0x03ffff (0xb4e6 bytes) 000406 1789709634.653183 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa85541aa (stale) Mirror 5: 0xa85541aa (stale) Mirror 7: 0xa85541aa (stale) Mirror 8: 0xa85541aa (stale) Mirror 9: 0xa85541aa (stale) Mirror 10: 0xa85541aa (stale) Mirror 11: 0xa85541aa (stale) Mirror 12: 0xa85541aa (stale) Mirror 13: 0xa85541aa (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x42778c7b Mirror 14: 0x42778c7b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000407 1789709635.402955 mapwrite 0x03bf85 thru 0x03fed0 (0x3f4c bytes) 000408 1789709635.512028 trunc from 0x040000 to 0x00faf7 (0x30508 bytes) 000409 1789709635.534838 mapwrite 0x02dfe4 thru 0x036600 (0x861d bytes) 000410 1789709635.570892 mapread 0x00a329 thru 0x00d402 (0x30da bytes) 000411 1789709635.575701 punch from 0x02d297 to 0x036600 (0x936a bytes) 000412 1789709635.580780 mapwrite 0x02b1c8 thru 0x031f62 (0x6d9b bytes) 000413 1789709635.597815 trunc from 0x036601 to 0x02a4e5 (0xc11b bytes) 000414 1789709635.612789 mapwrite 0x00ebbc thru 0x00f19e (0x5e3 bytes) 000415 1789709635.620529 fallocate 0x00e78f thru 0x01a8c6 (0xc138 bytes) 000416 1789709635.624817 mapread 0x024b9d thru 0x02a4e5 (0x5949 bytes) 000417 1789709635.633456 punch from 0x002197 to 0x00e56a (0xc3d4 bytes) 000418 1789709635.637273 fallocate 0x03d9e2 thru 0x03ffff (0x261e bytes) 000419 1789709635.640381 trunc from 0x02a4e6 to 0x0245ef (0x5ef6 bytes) 000420 1789709635.654563 punch from 0x017e3b to 0x01986e (0x1a34 bytes) 000421 1789709635.662758 fallocate 0x000ac4 thru 0x008052 (0x758f bytes) 000422 1789709635.666276 trunc from 0x0245f0 to 0x027d9d (0x37ae bytes) 000423 1789709635.682303 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x27d9e): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27d9e): Mirror 3: 0xf62a64b4 (stale) Mirror 5: 0xf62a64b4 (stale) Mirror 7: 0xf62a64b4 (stale) Mirror 8: 0xf62a64b4 (stale) Mirror 9: 0xf62a64b4 (stale) Mirror 10: 0xf62a64b4 (stale) Mirror 11: 0xf62a64b4 (stale) Mirror 12: 0xf62a64b4 (stale) Mirror 13: 0xf62a64b4 (stale) Mirror 14: 0xdabd808f (stale) CRC-32 checksum value for chunk [0, 0x27d9e): Mirror 1: 0x36030b5d Mirror 15: 0x36030b5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27d9e: skipped 000424 1789709636.327222 fallocate 0x0093fc thru 0x014f7b (0xbb80 bytes) 000425 1789709636.363677 mapread 0x01b3f6 thru 0x01e7af (0x33ba bytes) 000426 1789709636.375826 fallocate 0x0014ab thru 0x010e33 (0xf989 bytes) 000427 1789709636.379932 fallocate 0x03533b thru 0x03c70c (0x73d2 bytes) 000428 1789709636.383309 fallocate 0x0288fe thru 0x02d189 (0x488c bytes) 000429 1789709636.386070 read 0x0068ef thru 0x00935a (0x2a6c bytes) 000430 1789709636.389829 trunc from 0x027d9e to 0x01e5ac (0x97f1 bytes) 000431 1789709636.404251 mapwrite 0x017478 thru 0x02742a (0xffb3 bytes) 000432 1789709636.440168 fallocate 0x036b88 thru 0x03ffff (0x9478 bytes) 000435 1789709636.447385 punch from 0x030947 to 0x039acd (0x9187 bytes) 000436 1789709636.452173 mapread 0x02e5e5 thru 0x035140 (0x6b5c bytes) 000437 1789709636.459509 mapread 0x01a7df thru 0x026a12 (0xc234 bytes) 000438 1789709636.460543 punch from 0x029695 to 0x0332c0 (0x9c2c bytes) 000440 1789709636.467894 read 0x0134b1 thru 0x01d7b4 (0xa304 bytes) 000441 1789709636.479541 trunc from 0x040000 to 0x013358 (0x2cca7 bytes) 000442 1789709636.497343 MIRROR_RESYNC 12 mirrors 000447 1789709638.127527 punch from 0x010e2b to 0x013358 (0x252e bytes) 000448 1789709638.155054 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x13359): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13359): Mirror 3: 0x264319a8 (stale) Mirror 5: 0x264319a8 (stale) Mirror 7: 0x264319a8 (stale) Mirror 8: 0x264319a8 (stale) Mirror 9: 0x264319a8 (stale) Mirror 10: 0x264319a8 (stale) Mirror 11: 0x264319a8 (stale) Mirror 12: 0x264319a8 (stale) Mirror 13: 0x264319a8 (stale) Mirror 14: 0x264319a8 (stale) Mirror 15: 0x264319a8 (stale) CRC-32 checksum value for chunk [0, 0x13359): Mirror 1: 0x264319a8 Mirror 16: 0x264319a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13359: skipped 000449 1789709638.851745 trunc from 0x00c103 to 0x011326 (0x5224 bytes) 000451 1789709638.889589 trunc from 0x001b44 to 0x00b727 (0x9be4 bytes) 000452 1789709638.893149 write 0x03e69b thru 0x03ffff (0x1965 bytes) 000453 1789709638.896487 trunc from 0x01b10f to 0x021f56 (0x6e48 bytes) 000454 1789709638.900338 punch from 0x014d58 to 0x0243bd (0xf666 bytes) 000456 1789709638.904704 mapwrite 0x0092dc thru 0x00ea1b (0x5740 bytes) 000457 1789709638.929825 read 0x02c26b thru 0x035302 (0x9098 bytes) 000458 1789709638.937128 write 0x02207c thru 0x029189 (0x710e bytes) 000459 1789709638.946760 write 0x035eaa thru 0x03eaf8 (0x8c4f bytes) 000460 1789709638.948037 mapread 0x01458a thru 0x016d51 (0x27c8 bytes) 000461 1789709638.959808 punch from 0x002aaf to 0x009ab7 (0x7009 bytes) 000462 1789709638.966331 mapwrite 0x01c5da thru 0x021004 (0x4a2b bytes) 000463 1789709638.986909 trunc from 0x040000 to 0x01779a (0x28865 bytes) 000464 1789709639.001996 MIRROR_RESYNC 13 mirrors 000465 1789709640.803630 mapwrite 0x02b70b thru 0x03a4c4 (0xedba bytes) 000466 1789709640.888224 trunc from 0x03a4c5 to 0x0069b9 (0x33b0b bytes) 000467 1789709640.900960 write 0x013860 thru 0x0213e0 (0xdb81 bytes) 000468 1789709640.902395 punch from 0x015f85 to 0x0163c2 (0x43e bytes) 000469 1789709640.909535 punch from 0x016ed0 to 0x016f9a (0xcb bytes) 000470 1789709640.911806 mapwrite 0x038d02 thru 0x03ffff (0x72fe bytes) 000471 1789709640.933572 trunc from 0x040000 to 0x0351b2 (0xae4d bytes) 000472 1789709640.942284 read 0x028ebd thru 0x02cb0b (0x3c4f bytes) 000473 1789709640.948876 fallocate 0x008412 thru 0x0107a5 (0x8394 bytes) 000474 1789709640.958770 read 0x00768a thru 0x00fcc0 (0x8637 bytes) 000475 1789709640.973033 mapread 0x00a5a7 thru 0x0130c8 (0x8b22 bytes) 000477 1789709640.975401 read 0x007bea thru 0x017468 (0xf87f bytes) 000478 1789709640.975896 fallocate 0x023578 thru 0x02951c (0x5fa5 bytes) 000479 1789709640.979379 punch from 0x0091e2 to 0x00b536 (0x2355 bytes) 000480 1789709640.982840 write 0x032fc7 thru 0x03a487 (0x74c1 bytes) 000481 1789709640.985315 trunc from 0x006939 to 0x00c761 (0x5e29 bytes) 000482 1789709640.994921 read 0x01bfb0 thru 0x01c6e0 (0x731 bytes) 000484 1789709640.995693 write 0x01f810 thru 0x029f36 (0xa727 bytes) 000485 1789709641.000069 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a488): Mirror 3: 0xf0f7bee8 (stale) Mirror 5: 0xf0f7bee8 (stale) Mirror 7: 0xf0f7bee8 (stale) Mirror 8: 0xf0f7bee8 (stale) Mirror 10: 0xf0f7bee8 (stale) Mirror 11: 0xf0f7bee8 (stale) Mirror 12: 0xf0f7bee8 (stale) Mirror 13: 0xf0f7bee8 (stale) Mirror 14: 0xf0f7bee8 (stale) Mirror 15: 0xf0f7bee8 (stale) Mirror 16: 0xf0f7bee8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a488): Mirror 3: 0xf0f7bee8 (stale) Mirror 5: 0xf0f7bee8 (stale) Mirror 7: 0xf0f7bee8 (stale) Mirror 8: 0xf0f7bee8 (stale) Mirror 10: 0xf0f7bee8 (stale) Mirror 11: 0xf0f7bee8 (stale) Mirror 12: 0xf0f7bee8 (stale) Mirror 13: 0xf0f7bee8 (stale) Mirror 14: 0xf0f7bee8 (stale) Mirror 15: 0xf0f7bee8 (stale) Mirror 16: 0xf0f7bee8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a488: skipped 000486 1789709641.494130 punch from 0x023fea to 0x024ee0 (0xef7 bytes) 000487 1789709641.497053 trunc from 0x00f538 to 0x01b54f (0xc018 bytes) 000488 1789709641.503598 mapread 0x004806 thru 0x00b108 (0x6903 bytes) 000489 1789709641.527944 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a488): Mirror 3: 0xf0f7bee8 (stale) Mirror 5: 0xf0f7bee8 (stale) Mirror 7: 0xf0f7bee8 (stale) Mirror 10: 0xf0f7bee8 (stale) Mirror 11: 0xf0f7bee8 (stale) Mirror 12: 0xf0f7bee8 (stale) Mirror 13: 0xf0f7bee8 (stale) Mirror 14: 0xf0f7bee8 (stale) Mirror 15: 0xf0f7bee8 (stale) Mirror 16: 0xf0f7bee8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a488): Mirror 3: 0xf0f7bee8 (stale) Mirror 5: 0xf0f7bee8 (stale) Mirror 7: 0xf0f7bee8 (stale) Mirror 10: 0xf0f7bee8 (stale) Mirror 11: 0xf0f7bee8 (stale) Mirror 12: 0xf0f7bee8 (stale) Mirror 13: 0xf0f7bee8 (stale) Mirror 14: 0xf0f7bee8 (stale) Mirror 15: 0xf0f7bee8 (stale) Mirror 16: 0xf0f7bee8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a488: skipped 000490 1789709641.937317 write 0x0215ce thru 0x027253 (0x5c86 bytes) 000491 1789709641.945068 punch from 0x0073e7 to 0x00b863 (0x447d bytes) 000492 1789709641.948410 punch from 0x0147a6 to 0x01d700 (0x8f5b bytes) 000493 1789709641.955065 trunc from 0x03a488 to 0x028475 (0x12012 bytes) 000494 1789709641.972331 punch from 0x000c06 to 0x00d1ce (0xc5c9 bytes) 000495 1789709641.975300 fallocate 0x0138f3 thru 0x0191a0 (0x58ae bytes) 000496 1789709641.977917 mapwrite 0x03eb35 thru 0x03fbeb (0x10b7 bytes) 000497 1789709642.011136 read 0x0186c5 thru 0x01fc5b (0x7597 bytes) 000498 1789709642.020757 fallocate 0x020ac2 thru 0x02e482 (0xd9c1 bytes) 000499 1789709642.033821 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fbec): Mirror 3: 0xfe117f15 (stale) Mirror 5: 0xfe117f15 (stale) Mirror 7: 0xfe117f15 (stale) Mirror 10: 0xfe117f15 (stale) Mirror 11: 0xfe117f15 (stale) Mirror 12: 0xfe117f15 (stale) Mirror 13: 0xfe117f15 (stale) Mirror 14: 0xfe117f15 (stale) Mirror 15: 0xfe117f15 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbec): Mirror 3: 0xfe117f15 (stale) Mirror 5: 0xfe117f15 (stale) Mirror 7: 0xfe117f15 (stale) Mirror 10: 0xfe117f15 (stale) Mirror 11: 0xfe117f15 (stale) Mirror 12: 0xfe117f15 (stale) Mirror 13: 0xfe117f15 (stale) Mirror 14: 0xfe117f15 (stale) Mirror 15: 0xfe117f15 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbec: skipped 000500 1789709642.516294 trunc from 0x03fbec to 0x000ceb (0x3ef00 bytes) 000501 1789709642.568556 mapwrite 0x02b6b8 thru 0x033990 (0x82d9 bytes) 000502 1789709642.621529 punch from 0x00182f to 0x00344f (0x1c21 bytes) 000503 1789709642.627773 trunc from 0x033991 to 0x024d3c (0xec54 bytes) 000504 1789709642.638310 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24d3d): Mirror 3: 0xefb95841 (stale) Mirror 5: 0xefb95841 (stale) Mirror 7: 0xefb95841 (stale) Mirror 10: 0xefb95841 (stale) Mirror 12: 0xefb95841 (stale) Mirror 13: 0xefb95841 (stale) Mirror 14: 0xefb95841 (stale) Mirror 15: 0xefb95841 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d3d): Mirror 3: 0xefb95841 (stale) Mirror 5: 0xefb95841 (stale) Mirror 7: 0xefb95841 (stale) Mirror 10: 0xefb95841 (stale) Mirror 12: 0xefb95841 (stale) Mirror 13: 0xefb95841 (stale) Mirror 14: 0xefb95841 (stale) Mirror 15: 0xefb95841 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d3d: skipped 000505 1789709642.956610 mapwrite 0x038b19 thru 0x038dca (0x2b2 bytes) 000506 1789709643.000201 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x38dcb): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38dcb): Mirror 3: 0xbe295eee (stale) Mirror 5: 0xbe295eee (stale) Mirror 7: 0xbe295eee (stale) Mirror 10: 0xbe295eee (stale) Mirror 12: 0xbe295eee (stale) Mirror 13: 0xbe295eee (stale) Mirror 14: 0xbe295eee (stale) Mirror 15: 0xbe295eee (stale) CRC-32 checksum value for chunk [0, 0x38dcb): Mirror 1: 0xd6f4ab48 Mirror 16: 0xd6f4ab48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38dcb: skipped 000507 1789709643.781388 punch from 0x01bb21 to 0x020b73 (0x5053 bytes) 000508 1789709643.842408 trunc from 0x038dcb to 0x029f2a (0xeea0 bytes) 000509 1789709643.865354 punch from 0x00b8a1 to 0x00ffb1 (0x4711 bytes) 000510 1789709643.870607 mapwrite 0x006500 thru 0x0085fa (0x20fb bytes) 000511 1789709643.903612 read 0x006622 thru 0x00a676 (0x4055 bytes) 000512 1789709643.904520 punch from 0x0206a5 to 0x028cbe (0x861a bytes) 000513 1789709643.915915 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29f2b): Mirror 5: 0x585bb7b6 (stale) Mirror 7: 0x585bb7b6 (stale) Mirror 10: 0x585bb7b6 (stale) Mirror 12: 0x585bb7b6 (stale) Mirror 13: 0x585bb7b6 (stale) Mirror 14: 0x585bb7b6 (stale) Mirror 15: 0x585bb7b6 (stale) Mirror 16: 0xf034c287 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f2b): Mirror 5: 0x585bb7b6 (stale) Mirror 7: 0x585bb7b6 (stale) Mirror 10: 0x585bb7b6 (stale) Mirror 12: 0x585bb7b6 (stale) Mirror 13: 0x585bb7b6 (stale) Mirror 14: 0x585bb7b6 (stale) Mirror 15: 0x585bb7b6 (stale) Mirror 16: 0xf034c287 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f2b: skipped 000514 1789709644.340706 punch from 0x01f85b to 0x020466 (0xc0c bytes) 000515 1789709644.343971 trunc from 0x0124b3 to 0x01944a (0x6f98 bytes) 000516 1789709644.347523 mapwrite 0x0255c4 thru 0x02d2a5 (0x7ce2 bytes) 000517 1789709644.403603 write 0x007b9a thru 0x017885 (0xfcec bytes) 000518 1789709644.414717 fallocate 0x01ad52 thru 0x029aaf (0xed5e bytes) 000519 1789709644.419510 fallocate 0x02b622 thru 0x02d055 (0x1a34 bytes) 000520 1789709644.424141 write 0x0058df thru 0x00cb8e (0x72b0 bytes) 000521 1789709644.429394 punch from 0x004d01 to 0x006a24 (0x1d24 bytes) 000522 1789709644.437520 trunc from 0x0055fe to 0x011a41 (0xc444 bytes) 000523 1789709644.440857 write 0x00222a thru 0x005eb9 (0x3c90 bytes) 000524 1789709644.445654 trunc from 0x02d2a6 to 0x013cc5 (0x195e0 bytes) 000525 1789709644.453069 trunc from 0x007a2b to 0x013079 (0xb64f bytes) 000526 1789709644.455498 mapread 0x001a23 thru 0x006653 (0x4c31 bytes) 000527 1789709644.460068 trunc from 0x013cc6 to 0x03f64b (0x2b986 bytes) 000528 1789709644.466110 fallocate 0x02b955 thru 0x03ab9e (0xf24a bytes) 000529 1789709644.468746 read 0x01fea3 thru 0x0242a0 (0x43fe bytes) 000530 1789709644.474163 punch from 0x03f25a to 0x03f64b (0x3f2 bytes) 000531 1789709644.476766 fallocate 0x026d63 thru 0x0351a0 (0xe43e bytes) 000532 1789709644.480002 mapwrite 0x00dd0c thru 0x00f952 (0x1c47 bytes) 000533 1789709644.503170 punch from 0x00b4ca to 0x00dcdb (0x2812 bytes) 000534 1789709644.514208 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f64c): Mirror 5: 0xb8828f5f (stale) Mirror 7: 0xb8828f5f (stale) Mirror 12: 0xb8828f5f (stale) Mirror 13: 0xb8828f5f (stale) Mirror 14: 0xb8828f5f (stale) Mirror 15: 0xb8828f5f (stale) Mirror 16: 0x3e6d4070 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f64c): Mirror 5: 0xb8828f5f (stale) Mirror 7: 0xb8828f5f (stale) Mirror 12: 0xb8828f5f (stale) Mirror 13: 0xb8828f5f (stale) Mirror 14: 0xb8828f5f (stale) Mirror 15: 0xb8828f5f (stale) Mirror 16: 0x3e6d4070 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f64c: skipped 000535 1789709644.873940 write 0x025300 thru 0x02a545 (0x5246 bytes) 000536 1789709644.884322 trunc from 0x035a42 to 0x035fea (0x5a9 bytes) 000538 1789709644.889318 punch from 0x01861f to 0x01c112 (0x3af4 bytes) 000539 1789709644.892258 read 0x03d4a9 thru 0x03f64b (0x21a3 bytes) 000540 1789709644.896985 trunc from 0x008a95 to 0x0091aa (0x716 bytes) 000541 1789709644.907353 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f64c): Mirror 5: 0xb8828f5f (stale) Mirror 12: 0xb8828f5f (stale) Mirror 13: 0xb8828f5f (stale) Mirror 14: 0xb8828f5f (stale) Mirror 15: 0xb8828f5f (stale) Mirror 16: 0x3e6d4070 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f64c): Mirror 5: 0xb8828f5f (stale) Mirror 12: 0xb8828f5f (stale) Mirror 13: 0xb8828f5f (stale) Mirror 14: 0xb8828f5f (stale) Mirror 15: 0xb8828f5f (stale) Mirror 16: 0x3e6d4070 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f64c: skipped 000543 1789709645.226552 MIRROR_RESYNC 7 mirrors 000544 1789709646.665774 mapread 0x01a4f3 thru 0x023c9a (0x97a8 bytes) 000545 1789709646.678624 mapread 0x003851 thru 0x00b22e (0x79de bytes) 000547 1789709646.689356 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) 000548 1789709646.988894 punch from 0x027798 to 0x02fba5 (0x840e bytes) 000549 1789709647.010871 mapread 0x017e42 thru 0x026019 (0xe1d8 bytes) 000550 1789709647.031170 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f64c): Mirror 5: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f64c): Mirror 5: 0x388457ed (stale) Mirror 12: 0x388457ed (stale) Mirror 13: 0x388457ed (stale) Mirror 14: 0x388457ed (stale) Mirror 16: 0x388457ed (stale) CRC-32 checksum value for chunk [0, 0x3f64c): Mirror 1: 0xeb5930f Mirror 17: 0xeb5930f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f64c: skipped 000551 1789709647.686369 mapwrite 0x022c3a thru 0x02a8ab (0x7c72 bytes) 000552 1789709647.783193 punch from 0x0352a5 to 0x03e879 (0x95d5 bytes) 000553 1789709647.794701 punch from 0x004f5e to 0x005abf (0xb62 bytes) 000554 1789709647.799043 write 0x0146aa thru 0x016b02 (0x2459 bytes) 000555 1789709647.809899 mapwrite 0x028013 thru 0x0321ed (0xa1db bytes) 000556 1789709647.834517 punch from 0x03f636 to 0x03f64b (0x16 bytes) 000557 1789709647.838159 trunc from 0x000118 to 0x00633f (0x6228 bytes) 000558 1789709647.841957 write 0x03f32e thru 0x03ffff (0xcd2 bytes) 000559 1789709647.845746 mapread 0x010550 thru 0x010c2c (0x6dd bytes) 000561 1789709647.853745 punch from 0x029c46 to 0x02f2de (0x5699 bytes) 000562 1789709647.857729 read 0x012467 thru 0x01713c (0x4cd6 bytes) 000563 1789709647.858335 write 0x030028 thru 0x03c9bf (0xc998 bytes) 000564 1789709647.864800 punch from 0x034195 to 0x03a0a0 (0x5f0c bytes) 000566 1789709647.881060 punch from 0x01291f to 0x01bd08 (0x93ea bytes) 000567 1789709647.889717 fallocate 0x01e67a thru 0x027f59 (0x98e0 bytes) 000568 1789709647.898050 fallocate 0x00588b thru 0x0078b7 (0x202d bytes) 000569 1789709647.903859 mapwrite 0x00e083 thru 0x015049 (0x6fc7 bytes) 000570 1789709647.932747 mapwrite 0x00d80d thru 0x00ef2e (0x1722 bytes) 000571 1789709647.947933 mapread 0x03431c thru 0x0344ae (0x193 bytes) 000572 1789709647.964289 read 0x036c21 thru 0x03ffff (0x93df bytes) 000574 1789709647.965527 mapwrite 0x00b49e thru 0x00edcb (0x392e bytes) 000575 1789709647.984170 fallocate 0x03e5cc thru 0x03ffff (0x1a34 bytes) 000576 1789709647.989766 read 0x03fac0 thru 0x03ffff (0x540 bytes) 000577 1789709647.990533 punch from 0x01d52a to 0x0246bc (0x7193 bytes) 000578 1789709647.995558 trunc from 0x040000 to 0x021bd7 (0x1e428 bytes) 000579 1789709648.015095 read 0x004937 thru 0x00e7f1 (0x9ebb bytes) 000580 1789709648.026319 write 0x03c7d5 thru 0x03ffff (0x382b bytes) 000581 1789709648.031585 punch from 0x00d96f to 0x012e95 (0x5527 bytes) 000582 1789709648.036350 punch from 0x024bf8 to 0x028e3f (0x4248 bytes) 000583 1789709648.040117 fallocate 0x018209 thru 0x026d47 (0xeb3f bytes) 000584 1789709648.045070 trunc from 0x040000 to 0x03f855 (0x7aa bytes) 000585 1789709648.059805 trunc from 0x03f856 to 0x035335 (0xa520 bytes) 000586 1789709648.073580 trunc from 0x035336 to 0x030b74 (0x47c1 bytes) 000587 1789709648.087814 read 0x009645 thru 0x00a93d (0x12f9 bytes) 000588 1789709648.088487 read 0x02823f thru 0x02c292 (0x4054 bytes) 000589 1789709648.096722 trunc from 0x030b75 to 0x030b93 (0x1f bytes) 000590 1789709648.113780 trunc from 0x00c979 to 0x00f5b8 (0x2c40 bytes) 000591 1789709648.117531 mapread 0x0188b6 thru 0x0239c8 (0xb113 bytes) 000592 1789709648.118929 mapwrite 0x01ede5 thru 0x026b2d (0x7d49 bytes) 000593 1789709648.140865 mapwrite 0x005d5f thru 0x013476 (0xd718 bytes) 000594 1789709648.180260 MIRROR_RESYNC 7 mirrors 000595 1789709649.295210 mapwrite 0x031f77 thru 0x03a1bf (0x8249 bytes) 000596 1789709649.363499 read 0x0289e0 thru 0x02a3ce (0x19ef bytes) 000597 1789709649.367204 trunc from 0x03a1c0 to 0x017c4a (0x22575 bytes) 000598 1789709649.379899 mapread 0x017a37 thru 0x017c4a (0x214 bytes) 000599 1789709649.385731 trunc from 0x00e112 to 0x011ef5 (0x3de4 bytes) 000600 1789709649.391548 trunc from 0x00c182 to 0x010541 (0x43c0 bytes) 000601 1789709649.397734 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x17c4b): Mirror 5: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17c4b): Mirror 5: 0x4a7f2bd4 (stale) Mirror 12: 0x4a7f2bd4 (stale) Mirror 13: 0x4a7f2bd4 (stale) Mirror 14: 0x4a7f2bd4 (stale) Mirror 16: 0x4a7f2bd4 (stale) Mirror 17: 0x4a7f2bd4 (stale) CRC-32 checksum value for chunk [0, 0x17c4b): Mirror 1: 0x730405bb Mirror 18: 0x730405bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17c4b: skipped 000602 1789709650.006216 mapwrite 0x03d475 thru 0x03ffff (0x2b8b bytes) 000603 1789709650.083349 mapread 0x0161a4 thru 0x01d9aa (0x7807 bytes) 000604 1789709650.095373 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x843624a (stale) Mirror 13: 0x843624a (stale) Mirror 14: 0x843624a (stale) Mirror 16: 0x843624a (stale) Mirror 17: 0x843624a (stale) Mirror 18: 0x8871a462 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x843624a (stale) Mirror 13: 0x843624a (stale) Mirror 14: 0x843624a (stale) Mirror 16: 0x843624a (stale) Mirror 17: 0x843624a (stale) Mirror 18: 0x8871a462 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000605 1789709650.367173 trunc from 0x036ed8 to 0x03f8f1 (0x8a1a bytes) 000606 1789709650.377553 MIRROR_RESYNC 7 mirrors 000607 1789709651.574960 trunc from 0x040000 to 0x009865 (0x3679a bytes) 000608 1789709651.594244 write 0x028719 thru 0x02b98e (0x3276 bytes) 000610 1789709651.595358 mapwrite 0x0340c8 thru 0x03ffff (0xbf38 bytes) 000611 1789709651.658277 mapwrite 0x02d8f8 thru 0x036d57 (0x9460 bytes) 000614 1789709651.700541 write 0x01b207 thru 0x02892b (0xd725 bytes) 000615 1789709651.707786 mapread 0x02ebc4 thru 0x02f00d (0x44a bytes) 000617 1789709651.708937 mapwrite 0x029c14 thru 0x036d68 (0xd155 bytes) 000618 1789709651.741842 mapread 0x019ec0 thru 0x01e4d8 (0x4619 bytes) 000619 1789709651.755674 trunc from 0x02674b to 0x02ccf4 (0x65aa bytes) 000620 1789709651.762064 punch from 0x0264c6 to 0x027f35 (0x1a70 bytes) 000621 1789709651.765325 mapwrite 0x016474 thru 0x018b46 (0x26d3 bytes) 000622 1789709651.776782 fallocate 0x02958d thru 0x036aff (0xd573 bytes) 000623 1789709651.786889 read 0x035446 thru 0x03d84c (0x8407 bytes) 000624 1789709651.787273 trunc from 0x040000 to 0x01f7e0 (0x2081f bytes) 000625 1789709651.800693 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f7e1): Mirror 12: 0x52ccafba (stale) Mirror 13: 0x52ccafba (stale) Mirror 14: 0x52ccafba (stale) Mirror 16: 0x52ccafba (stale) Mirror 18: 0x52ccafba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f7e1): Mirror 12: 0x52ccafba (stale) Mirror 13: 0x52ccafba (stale) Mirror 14: 0x52ccafba (stale) Mirror 16: 0x52ccafba (stale) Mirror 18: 0x52ccafba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f7e1: skipped 000627 1789709652.053393 mapwrite 0x01377a thru 0x017892 (0x4119 bytes) 000628 1789709652.085375 mapwrite 0x022c15 thru 0x0254ce (0x28ba bytes) 000629 1789709652.139032 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x254cf): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x254cf): Mirror 12: 0xdb91756c (stale) Mirror 13: 0xdb91756c (stale) Mirror 14: 0xdb91756c (stale) Mirror 16: 0xdb91756c (stale) Mirror 18: 0xdb91756c (stale) CRC-32 checksum value for chunk [0, 0x254cf): Mirror 1: 0x784d0c43 Mirror 19: 0x784d0c43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x254cf: skipped 000631 1789709652.699381 mapread 0x001add thru 0x00c5b5 (0xaad9 bytes) 000633 1789709652.744729 read 0x020ce3 thru 0x0254ce (0x47ec bytes) 000635 1789709652.758626 punch from 0x02068b to 0x0254ce (0x4e44 bytes) 000636 1789709652.779365 mapwrite 0x0310ee thru 0x03fb65 (0xea78 bytes) 000638 1789709652.845466 trunc from 0x0121b6 to 0x01bc4b (0x9a96 bytes) 000639 1789709652.851138 punch from 0x00aa4e to 0x00bf30 (0x14e3 bytes) 000640 1789709652.856969 trunc from 0x02fdc5 to 0x032f7f (0x31bb bytes) 000641 1789709652.862139 punch from 0x01b837 to 0x01cb01 (0x12cb bytes) 000643 1789709652.866772 trunc from 0x0030ca to 0x00fc30 (0xcb67 bytes) 000644 1789709652.876114 trunc from 0x03fb66 to 0x016a08 (0x2915d bytes) 000645 1789709652.888762 trunc from 0x012795 to 0x016a08 (0x4274 bytes) 000646 1789709652.892356 trunc from 0x016a09 to 0x031923 (0x1af1b bytes) 000647 1789709652.911773 trunc from 0x031924 to 0x0259cd (0xbf56 bytes) 000648 1789709652.933382 fallocate 0x026a22 thru 0x0335fe (0xcbdd bytes) 000649 1789709652.938274 trunc from 0x0335ff to 0x03d80c (0xa20e bytes) 000650 1789709652.950720 MIRROR_RESYNC 7 mirrors 000651 1789709653.534978 write 0x018648 thru 0x019824 (0x11dd bytes) 000652 1789709653.570361 mapwrite 0x00323f thru 0x0079f4 (0x47b6 bytes) 000653 1789709653.599599 write 0x0222e5 thru 0x028de9 (0x6b05 bytes) 000654 1789709653.608011 fallocate 0x02e20d thru 0x034a59 (0x684d bytes) 000655 1789709653.611791 punch from 0x027ca5 to 0x02c174 (0x44d0 bytes) 000656 1789709653.622513 mapwrite 0x015a5e thru 0x01f54a (0x9aed bytes) 000657 1789709653.659887 trunc from 0x03d80d to 0x031be4 (0xbc28 bytes) 000658 1789709653.684077 fallocate 0x031c92 thru 0x03ffff (0xe36e bytes) 000659 1789709653.692664 mapread 0x031118 thru 0x0377ee (0x66d7 bytes) 000660 1789709653.703342 trunc from 0x0362df to 0x03ffff (0x9d21 bytes) 000661 1789709653.718079 trunc from 0x040000 to 0x02426c (0x1bd93 bytes) 000663 1789709653.729667 trunc from 0x02426d to 0x03b2d8 (0x1706c bytes) 000664 1789709653.754876 trunc from 0x03b2d9 to 0x03c858 (0x1580 bytes) 000665 1789709653.775083 write 0x02d0cb thru 0x039d71 (0xcca7 bytes) 000666 1789709653.784246 mapread 0x02576f thru 0x0265a5 (0xe37 bytes) 000667 1789709653.792115 trunc from 0x013495 to 0x019b46 (0x66b2 bytes) 000668 1789709653.799828 MIRROR_RESYNC 7 mirrors 000669 1789709655.214701 MIRROR_EXTEND to 8 mirrors 000670 1789709655.764021 mapread 0x00d212 thru 0x014846 (0x7635 bytes) 000671 1789709655.778742 MIRROR_RESYNC 8 mirrors 000672 1789709656.187439 trunc from 0x03c859 to 0x0159bc (0x26e9c bytes) 000673 1789709656.224939 trunc from 0x0159bd to 0x013903 (0x20b9 bytes) 000674 1789709656.234634 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x13904): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13904): Mirror 12: 0xc3d283f5 (stale) Mirror 13: 0xc3d283f5 (stale) Mirror 14: 0xc3d283f5 (stale) Mirror 16: 0xc3d283f5 (stale) Mirror 18: 0xc3d283f5 (stale) Mirror 19: 0xc3d283f5 (stale) Mirror 20: 0xc3d283f5 (stale) CRC-32 checksum value for chunk [0, 0x13904): Mirror 1: 0xc3d283f5 Mirror 21: 0xc3d283f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13904: skipped 000675 1789709656.817586 write 0x03c605 thru 0x03d5f9 (0xff5 bytes) 000676 1789709656.847596 trunc from 0x01ca2d to 0x020e5c (0x4430 bytes) 000677 1789709656.855128 fallocate 0x01830a thru 0x0193de (0x10d5 bytes) 000678 1789709656.859880 write 0x0043a6 thru 0x00795e (0x35b9 bytes) 000679 1789709656.868594 punch from 0x028a42 to 0x0290f4 (0x6b3 bytes) 000680 1789709656.871747 mapwrite 0x00734b thru 0x0109e7 (0x969d bytes) 000681 1789709656.922032 mapread 0x02276b thru 0x024721 (0x1fb7 bytes) 000682 1789709656.931337 fallocate 0x028f1e thru 0x038d5b (0xfe3e bytes) 000683 1789709656.934405 write 0x03b5cb thru 0x03ffff (0x4a35 bytes) 000684 1789709656.940316 write 0x0237ec thru 0x0278bc (0x40d1 bytes) 000685 1789709656.942045 read 0x01a395 thru 0x024353 (0x9fbf bytes) 000686 1789709656.949313 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xa86f0b4d (stale) Mirror 14: 0xa86f0b4d (stale) Mirror 16: 0xa86f0b4d (stale) Mirror 18: 0xa86f0b4d (stale) Mirror 19: 0xa86f0b4d (stale) Mirror 20: 0xa86f0b4d (stale) Mirror 21: 0xe1652c01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xa86f0b4d (stale) Mirror 14: 0xa86f0b4d (stale) Mirror 16: 0xa86f0b4d (stale) Mirror 18: 0xa86f0b4d (stale) Mirror 19: 0xa86f0b4d (stale) Mirror 20: 0xa86f0b4d (stale) Mirror 21: 0xe1652c01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000687 1789709657.217709 read 0x03335a thru 0x033904 (0x5ab bytes) 000688 1789709657.222836 trunc from 0x034cf6 to 0x03ffff (0xb30a bytes) 000690 1789709657.226737 mapread 0x02f250 thru 0x037241 (0x7ff2 bytes) 000691 1789709657.241796 mapwrite 0x00f581 thru 0x018faf (0x9a2f bytes) 000692 1789709657.267281 mapwrite 0x037b2f thru 0x03ccf5 (0x51c7 bytes) 000693 1789709657.284494 punch from 0x02b967 to 0x034bed (0x9287 bytes) 000694 1789709657.288604 trunc from 0x040000 to 0x020b41 (0x1f4be bytes) 000695 1789709657.304243 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x20b42): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20b42): Mirror 13: 0xe4a32fc2 (stale) Mirror 14: 0xe4a32fc2 (stale) Mirror 16: 0xe4a32fc2 (stale) Mirror 18: 0xe4a32fc2 (stale) Mirror 19: 0xe4a32fc2 (stale) Mirror 20: 0xe4a32fc2 (stale) Mirror 21: 0xf00d6afc (stale) CRC-32 checksum value for chunk [0, 0x20b42): Mirror 1: 0x60da7059 Mirror 22: 0x60da7059 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20b42: skipped 000696 1789709657.854790 mapwrite 0x013989 thru 0x01412c (0x7a4 bytes) 000697 1789709657.938234 MIRROR_RESYNC 9 mirrors 000698 1789709658.866114 trunc from 0x020b42 to 0x002503 (0x1e63e bytes) 000699 1789709658.886680 mapread 0x0015d6 thru 0x002503 (0xf2e bytes) 000700 1789709658.895138 MIRROR_RESYNC 9 mirrors 000701 1789709659.451968 punch from 0x0015e2 to 0x002503 (0xf22 bytes) 000702 1789709659.479323 write 0x00aba2 thru 0x013841 (0x8ca0 bytes) 000703 1789709659.481275 mapwrite 0x029e88 thru 0x02cfec (0x3165 bytes) 000704 1789709659.543824 mapwrite 0x031935 thru 0x03610d (0x47d9 bytes) 000705 1789709659.584860 trunc from 0x03610e to 0x00d7c7 (0x28946 bytes) 000707 1789709659.592022 trunc from 0x007647 to 0x00b089 (0x3a43 bytes) 000708 1789709659.594968 trunc from 0x00d7c8 to 0x02905d (0x1b896 bytes) 000710 1789709659.603996 write 0x01a19e thru 0x025f53 (0xbdb6 bytes) 000711 1789709659.609907 mapread 0x01ee54 thru 0x02905d (0xa20a bytes) 000712 1789709659.615863 trunc from 0x02905e to 0x002b0f (0x2654e bytes) 000713 1789709659.635399 read 0x001423 thru 0x002b0f (0x16ed bytes) 000714 1789709659.639885 mapwrite 0x037394 thru 0x03ffff (0x8c6c bytes) 000715 1789709659.694012 fallocate 0x03c8d3 thru 0x03ffff (0x372d bytes) 000716 1789709659.697968 mapread 0x00a275 thru 0x012630 (0x83bc bytes) 000717 1789709659.709633 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd4f73f9c Mirror 23: 0xd4f73f9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000718 1789709660.248398 fallocate 0x01c95e thru 0x026548 (0x9beb bytes) 000719 1789709660.294391 write 0x011501 thru 0x020c0d (0xf70d bytes) 000720 1789709660.311297 write 0x02d73f thru 0x036cae (0x9570 bytes) 000721 1789709660.332287 trunc from 0x040000 to 0x023f4f (0x1c0b0 bytes) 000722 1789709660.360899 trunc from 0x0088a7 to 0x00fbcb (0x7325 bytes) 000723 1789709660.363346 write 0x014231 thru 0x0172ec (0x30bc bytes) 000725 1789709660.364499 trunc from 0x010a8c to 0x01718d (0x6702 bytes) 000728 1789709660.374356 MIRROR_RESYNC 10 mirrors 000729 1789709661.217295 trunc from 0x009240 to 0x012165 (0x8f26 bytes) 000730 1789709661.250334 read 0x02391b thru 0x023f4f (0x635 bytes) 000731 1789709661.255083 mapread 0x012db2 thru 0x013654 (0x8a3 bytes) 000733 1789709661.262604 trunc from 0x023f50 to 0x028507 (0x45b8 bytes) 000734 1789709661.277649 punch from 0x00cef5 to 0x01ce77 (0xff83 bytes) 000735 1789709661.281343 write 0x03ba5b thru 0x03ffff (0x45a5 bytes) 000736 1789709661.282904 punch from 0x02c449 to 0x038cb1 (0xc869 bytes) 000737 1789709661.285683 trunc from 0x03a787 to 0x03ffff (0x5879 bytes) 000738 1789709661.304129 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x3eac0568 (stale) Mirror 14: 0x3eac0568 (stale) Mirror 16: 0x3eac0568 (stale) Mirror 18: 0x3eac0568 (stale) Mirror 19: 0x3eac0568 (stale) Mirror 20: 0x3eac0568 (stale) Mirror 21: 0x3eac0568 (stale) Mirror 22: 0x3eac0568 (stale) Mirror 23: 0x3eac0568 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xecec3f9a Mirror 24: 0xecec3f9a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000739 1789709661.849991 write 0x024456 thru 0x0290c2 (0x4c6d bytes) 000740 1789709661.889925 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x3eac0568 (stale) Mirror 14: 0x3eac0568 (stale) Mirror 16: 0x3eac0568 (stale) Mirror 18: 0x3eac0568 (stale) Mirror 19: 0x3eac0568 (stale) Mirror 20: 0x3eac0568 (stale) Mirror 21: 0x3eac0568 (stale) Mirror 22: 0x3eac0568 (stale) Mirror 23: 0x3eac0568 (stale) Mirror 24: 0xecec3f9a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x70277b6a Mirror 25: 0x70277b6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000741 1789709662.556806 trunc from 0x040000 to 0x02fe5f (0x101a0 bytes) 000742 1789709662.593205 write 0x031867 thru 0x035ed9 (0x4673 bytes) 000743 1789709662.594298 trunc from 0x035eda to 0x000685 (0x35854 bytes) 000744 1789709662.606301 mapwrite 0x015d29 thru 0x0212b5 (0xb58d bytes) 000745 1789709662.644867 trunc from 0x009939 to 0x01429f (0xa967 bytes) 000746 1789709662.647299 mapread 0x00bb76 thru 0x00bdfe (0x289 bytes) 000747 1789709662.656130 mapread 0x018df2 thru 0x0212b5 (0x84c4 bytes) 000748 1789709662.656779 trunc from 0x0212b6 to 0x025437 (0x4182 bytes) 000749 1789709662.665524 read 0x01ec11 thru 0x025437 (0x6827 bytes) 000750 1789709662.668243 fallocate 0x0184b4 thru 0x01d0f1 (0x4c3e bytes) 000751 1789709662.671267 write 0x01c858 thru 0x0236e5 (0x6e8e bytes) 000752 1789709662.672442 mapwrite 0x0145ff thru 0x020e9a (0xc89c bytes) 000753 1789709662.693820 trunc from 0x025438 to 0x03f9f7 (0x1a5c0 bytes) 000754 1789709662.708067 fallocate 0x013a36 thru 0x023650 (0xfc1b bytes) 000755 1789709662.712950 write 0x02ae18 thru 0x02bcda (0xec3 bytes) 000756 1789709662.719010 punch from 0x02a601 to 0x036670 (0xc070 bytes) 000757 1789709662.724953 fallocate 0x0232cb thru 0x02349f (0x1d5 bytes) 000758 1789709662.729507 trunc from 0x036c05 to 0x038231 (0x162d bytes) 000760 1789709662.733928 punch from 0x003abf to 0x006bf6 (0x3138 bytes) 000761 1789709662.736325 mapwrite 0x033da7 thru 0x035a06 (0x1c60 bytes) 000762 1789709662.749090 mapwrite 0x007e77 thru 0x00e397 (0x6521 bytes) 000763 1789709662.765778 punch from 0x03d39d to 0x03f9f7 (0x265b bytes) 000764 1789709662.771086 punch from 0x02eb46 to 0x036c99 (0x8154 bytes) 000766 1789709662.776862 trunc from 0x036c49 to 0x03ae8f (0x4247 bytes) 000768 1789709662.781865 trunc from 0x03f9f8 to 0x0057df (0x3a218 bytes) 000769 1789709662.796519 read 0x003395 thru 0x0057df (0x244b bytes) 000770 1789709662.804855 read 0x0007ef thru 0x0057df (0x4ff1 bytes) 000771 1789709662.805487 trunc from 0x0057e0 to 0x01d26e (0x17a8f bytes) 000772 1789709662.819203 mapwrite 0x03faba thru 0x03ffff (0x546 bytes) 000773 1789709662.845169 trunc from 0x03a4d6 to 0x03ffff (0x5b2a bytes) 000774 1789709662.850290 mapread 0x00e048 thru 0x0101e1 (0x219a bytes) 000775 1789709662.851164 punch from 0x0229bb to 0x02d6cb (0xad11 bytes) 000776 1789709662.856138 trunc from 0x0295aa to 0x032946 (0x939d bytes) 000777 1789709662.859250 read 0x00757e thru 0x00c414 (0x4e97 bytes) 000778 1789709662.860054 mapread 0x01ad9c thru 0x01e2a7 (0x350c bytes) 000779 1789709662.860813 mapread 0x02843e thru 0x032964 (0xa527 bytes) 000780 1789709662.865324 trunc from 0x040000 to 0x021a29 (0x1e5d6 bytes) 000781 1789709662.874983 trunc from 0x00544a to 0x009a86 (0x463d bytes) 000782 1789709662.878517 mapread 0x0198a5 thru 0x01b30e (0x1a6a bytes) 000783 1789709662.880067 punch from 0x01536b to 0x01d439 (0x80cf bytes) 000784 1789709662.883946 fallocate 0x036664 thru 0x03ffff (0x999c bytes) 000785 1789709662.889240 fallocate 0x029dc1 thru 0x02e189 (0x43c9 bytes) 000786 1789709662.893234 punch from 0x01a7f4 to 0x021a29 (0x7236 bytes) 000787 1789709662.899833 trunc from 0x021a2a to 0x02fbac (0xe183 bytes) 000788 1789709662.911500 mapread 0x02651d thru 0x02fbac (0x9690 bytes) 000789 1789709662.956199 trunc from 0x01b95b to 0x023d07 (0x83ad bytes) 000790 1789709662.967190 MIRROR_RESYNC 12 mirrors 000791 1789709663.964101 read 0x02b2ae thru 0x02fbac (0x48ff bytes) 000792 1789709663.972185 punch from 0x025ec5 to 0x02fbac (0x9ce8 bytes) 000793 1789709664.000359 read 0x00d0ab thru 0x01b13e (0xe094 bytes) 000794 1789709664.013636 mapwrite 0x026d28 thru 0x031435 (0xa70e bytes) 000795 1789709664.055509 fallocate 0x000e7a thru 0x00c9b8 (0xbb3f bytes) 000797 1789709664.064309 trunc from 0x02e305 to 0x031435 (0x3131 bytes) 000798 1789709664.071664 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31436): Mirror 13: 0xc33d17b (stale) Mirror 14: 0xc33d17b (stale) Mirror 16: 0xc33d17b (stale) Mirror 18: 0xc33d17b (stale) Mirror 19: 0xc33d17b (stale) Mirror 20: 0xc33d17b (stale) Mirror 22: 0xc33d17b (stale) Mirror 23: 0xc33d17b (stale) Mirror 24: 0xc33d17b (stale) Mirror 25: 0xc33d17b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31436): Mirror 13: 0xc33d17b (stale) Mirror 14: 0xc33d17b (stale) Mirror 16: 0xc33d17b (stale) Mirror 18: 0xc33d17b (stale) Mirror 19: 0xc33d17b (stale) Mirror 20: 0xc33d17b (stale) Mirror 22: 0xc33d17b (stale) Mirror 23: 0xc33d17b (stale) Mirror 24: 0xc33d17b (stale) Mirror 25: 0xc33d17b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31436: skipped 000799 1789709664.475698 trunc from 0x01f566 to 0x023f5f (0x49fa bytes) 000800 1789709664.479287 write 0x01f19b thru 0x02ed0b (0xfb71 bytes) 000801 1789709664.489615 mapwrite 0x008cbe thru 0x00c0cf (0x3412 bytes) 000802 1789709664.514353 mapread 0x01dc78 thru 0x023dd8 (0x6161 bytes) 000803 1789709664.523694 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x31436): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31436): Mirror 13: 0xc33d17b (stale) Mirror 14: 0xc33d17b (stale) Mirror 16: 0xc33d17b (stale) Mirror 18: 0xc33d17b (stale) Mirror 19: 0xc33d17b (stale) Mirror 20: 0xc33d17b (stale) Mirror 22: 0xc33d17b (stale) Mirror 23: 0xc33d17b (stale) Mirror 24: 0xc33d17b (stale) Mirror 25: 0xc33d17b (stale) CRC-32 checksum value for chunk [0, 0x31436): Mirror 1: 0xa40bd1f7 Mirror 26: 0xa40bd1f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31436: skipped 000804 1789709665.183871 write 0x02588f thru 0x0266e6 (0xe58 bytes) 000805 1789709665.229051 fallocate 0x007c5d thru 0x012d84 (0xb128 bytes) 000806 1789709665.239912 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x31436): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31436): Mirror 13: 0xc33d17b (stale) Mirror 14: 0xc33d17b (stale) Mirror 16: 0xc33d17b (stale) Mirror 18: 0xc33d17b (stale) Mirror 19: 0xc33d17b (stale) Mirror 20: 0xc33d17b (stale) Mirror 22: 0xc33d17b (stale) Mirror 23: 0xc33d17b (stale) Mirror 24: 0xc33d17b (stale) Mirror 25: 0xc33d17b (stale) Mirror 26: 0xa40bd1f7 (stale) CRC-32 checksum value for chunk [0, 0x31436): Mirror 1: 0x25382325 Mirror 27: 0x25382325 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31436: skipped 000807 1789709665.949806 fallocate 0x028843 thru 0x034564 (0xbd22 bytes) 000808 1789709665.966776 punch from 0x02f1b0 to 0x031435 (0x2286 bytes) 000809 1789709665.972565 punch from 0x016d16 to 0x01b248 (0x4533 bytes) 000810 1789709665.979213 punch from 0x030455 to 0x031435 (0xfe1 bytes) 000811 1789709665.984128 mapread 0x0122f1 thru 0x01569a (0x33aa bytes) 000813 1789709665.998823 mapwrite 0x0149ed thru 0x0159fa (0x100e bytes) 000814 1789709666.011878 write 0x02411d thru 0x031b52 (0xda36 bytes) 000815 1789709666.026400 fallocate 0x0297bc thru 0x02bf9e (0x27e3 bytes) 000816 1789709666.033275 punch from 0x009d78 to 0x0155b7 (0xb840 bytes) 000817 1789709666.039215 fallocate 0x00c82e thru 0x00e35b (0x1b2e bytes) 000818 1789709666.045103 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31b53): Mirror 13: 0x1c2f400a (stale) Mirror 14: 0x1c2f400a (stale) Mirror 16: 0x1c2f400a (stale) Mirror 18: 0x1c2f400a (stale) Mirror 19: 0x1c2f400a (stale) Mirror 20: 0x1c2f400a (stale) Mirror 22: 0x1c2f400a (stale) Mirror 23: 0x1c2f400a (stale) Mirror 24: 0x1c2f400a (stale) Mirror 26: 0xe7818e8 (stale) Mirror 27: 0x8cfe6a07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31b53): Mirror 13: 0x1c2f400a (stale) Mirror 14: 0x1c2f400a (stale) Mirror 16: 0x1c2f400a (stale) Mirror 18: 0x1c2f400a (stale) Mirror 19: 0x1c2f400a (stale) Mirror 20: 0x1c2f400a (stale) Mirror 22: 0x1c2f400a (stale) Mirror 23: 0x1c2f400a (stale) Mirror 24: 0x1c2f400a (stale) Mirror 26: 0xe7818e8 (stale) Mirror 27: 0x8cfe6a07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31b53: skipped 000819 1789709666.448845 fallocate 0x00be4a thru 0x00fcb1 (0x3e68 bytes) 000820 1789709666.452092 write 0x0314ca thru 0x038f69 (0x7aa0 bytes) 000821 1789709666.472542 MIRROR_RESYNC 12 mirrors 000822 1789709668.093365 mapread 0x02257f thru 0x028aac (0x652e bytes) 000823 1789709668.111496 trunc from 0x023588 to 0x02f929 (0xc3a2 bytes) 000824 1789709668.164342 trunc from 0x011819 to 0x01fc97 (0xe47f bytes) 000825 1789709668.170335 mapread 0x019725 thru 0x01bca9 (0x2585 bytes) 000826 1789709668.180676 trunc from 0x014d49 to 0x0187de (0x3a96 bytes) 000827 1789709668.183933 write 0x002bb3 thru 0x00d520 (0xa96e bytes) 000828 1789709668.191013 read 0x036aa5 thru 0x038093 (0x15ef bytes) 000829 1789709668.194985 mapwrite 0x02eacc thru 0x03669e (0x7bd3 bytes) 000830 1789709668.229267 read 0x004813 thru 0x00d965 (0x9153 bytes) 000831 1789709668.229807 mapwrite 0x003271 thru 0x0060eb (0x2e7b bytes) 000832 1789709668.241577 fallocate 0x00ce50 thru 0x01a0a8 (0xd259 bytes) 000833 1789709668.246075 write 0x00ac12 thru 0x015f76 (0xb365 bytes) 000834 1789709668.253187 write 0x03432a thru 0x03ffff (0xbcd6 bytes) 000835 1789709668.254853 mapwrite 0x0005aa thru 0x0005e1 (0x38 bytes) 000836 1789709668.269082 punch from 0x0302b0 to 0x0345d1 (0x4322 bytes) 000837 1789709668.274904 read 0x036c4e thru 0x037ab6 (0xe69 bytes) 000839 1789709668.277367 trunc from 0x040000 to 0x024877 (0x1b788 bytes) 000840 1789709668.291915 fallocate 0x02e0f6 thru 0x03d296 (0xf1a1 bytes) 000841 1789709668.297752 write 0x00ab1f thru 0x00dbda (0x30bc bytes) 000842 1789709668.299003 mapwrite 0x00c28d thru 0x015c97 (0x9a0b bytes) 000843 1789709668.325519 MIRROR_RESYNC 12 mirrors 000845 1789709670.089042 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) 000846 1789709670.348036 trunc from 0x0145c8 to 0x014e6b (0x8a4 bytes) 000847 1789709670.373848 fallocate 0x01663c thru 0x01d719 (0x70de bytes) 000848 1789709670.376966 fallocate 0x0367c5 thru 0x03ed71 (0x85ad bytes) 000849 1789709670.380044 punch from 0x0005ad to 0x003330 (0x2d84 bytes) 000850 1789709670.385110 mapread 0x024782 thru 0x024877 (0xf6 bytes) 000852 1789709670.402608 MIRROR_RESYNC 11 mirrors 000853 1789709672.026883 trunc from 0x024878 to 0x00bc15 (0x18c62 bytes) 000854 1789709672.053850 trunc from 0x00bc16 to 0x00a3f1 (0x1824 bytes) 000855 1789709672.067105 read 0x00931a thru 0x00a3f1 (0x10d8 bytes) 000856 1789709672.074063 trunc from 0x00a3f2 to 0x03c78a (0x32399 bytes) 000857 1789709672.093937 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c78b): Mirror 13: 0x88840bfb (stale) Mirror 14: 0x88840bfb (stale) Mirror 16: 0x88840bfb (stale) Mirror 19: 0x88840bfb (stale) Mirror 20: 0x88840bfb (stale) Mirror 22: 0x88840bfb (stale) Mirror 23: 0x88840bfb (stale) Mirror 26: 0x88840bfb (stale) Mirror 27: 0x88840bfb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c78b): Mirror 13: 0x88840bfb (stale) Mirror 14: 0x88840bfb (stale) Mirror 16: 0x88840bfb (stale) Mirror 19: 0x88840bfb (stale) Mirror 20: 0x88840bfb (stale) Mirror 22: 0x88840bfb (stale) Mirror 23: 0x88840bfb (stale) Mirror 26: 0x88840bfb (stale) Mirror 27: 0x88840bfb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c78b: skipped 000858 1789709672.456578 mapwrite 0x010e7e thru 0x0154e7 (0x466a bytes) 000859 1789709672.476777 mapwrite 0x021ae2 thru 0x0295ac (0x7acb bytes) 000860 1789709672.496922 punch from 0x006d1d to 0x00bb3c (0x4e20 bytes) 000861 1789709672.500291 mapwrite 0x020404 thru 0x022b7e (0x277b bytes) 000862 1789709672.514274 read 0x02e613 thru 0x02ef18 (0x906 bytes) 000863 1789709672.518901 mapread 0x020a3c thru 0x02a800 (0x9dc5 bytes) 000865 1789709672.530963 mapread 0x007da7 thru 0x00b2de (0x3538 bytes) 000866 1789709672.544854 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c78b): Mirror 13: 0x88840bfb (stale) Mirror 16: 0x88840bfb (stale) Mirror 19: 0x88840bfb (stale) Mirror 20: 0x88840bfb (stale) Mirror 22: 0x88840bfb (stale) Mirror 23: 0x88840bfb (stale) Mirror 26: 0x88840bfb (stale) Mirror 27: 0x88840bfb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c78b): Mirror 13: 0x88840bfb (stale) Mirror 16: 0x88840bfb (stale) Mirror 19: 0x88840bfb (stale) Mirror 20: 0x88840bfb (stale) Mirror 22: 0x88840bfb (stale) Mirror 23: 0x88840bfb (stale) Mirror 26: 0x88840bfb (stale) Mirror 27: 0x88840bfb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c78b: skipped 000867 1789709672.925513 fallocate 0x03f1fa thru 0x03ffff (0xe06 bytes) 000869 1789709672.930285 mapread 0x031e86 thru 0x03ffff (0xe17a bytes) 000870 1789709672.948392 mapread 0x03064e thru 0x036107 (0x5aba bytes) 000871 1789709672.950077 write 0x025c6e thru 0x02f3b4 (0x9747 bytes) 000872 1789709672.959218 punch from 0x013111 to 0x01a5e7 (0x74d7 bytes) 000873 1789709672.966487 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xd227ffa7 (stale) Mirror 16: 0xd227ffa7 (stale) Mirror 19: 0xd227ffa7 (stale) Mirror 20: 0xd227ffa7 (stale) Mirror 22: 0xd227ffa7 (stale) Mirror 23: 0xd227ffa7 (stale) Mirror 26: 0xd227ffa7 (stale) Mirror 27: 0xd227ffa7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa1904288 Mirror 28: 0xa1904288 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000874 1789709673.662567 write 0x018b0e thru 0x01a231 (0x1724 bytes) 000875 1789709673.713183 read 0x00c49b thru 0x01160c (0x5172 bytes) 000876 1789709673.728703 trunc from 0x011e9b to 0x017e37 (0x5f9d bytes) 000877 1789709673.733948 mapwrite 0x01b88b thru 0x027a55 (0xc1cb bytes) 000878 1789709673.785019 fallocate 0x029d06 thru 0x031052 (0x734d bytes) 000879 1789709673.791490 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xd227ffa7 (stale) Mirror 16: 0xd227ffa7 (stale) Mirror 19: 0xd227ffa7 (stale) Mirror 22: 0xd227ffa7 (stale) Mirror 23: 0xd227ffa7 (stale) Mirror 26: 0xd227ffa7 (stale) Mirror 27: 0xd227ffa7 (stale) Mirror 28: 0xa1904288 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xd227ffa7 (stale) Mirror 16: 0xd227ffa7 (stale) Mirror 19: 0xd227ffa7 (stale) Mirror 22: 0xd227ffa7 (stale) Mirror 23: 0xd227ffa7 (stale) Mirror 26: 0xd227ffa7 (stale) Mirror 27: 0xd227ffa7 (stale) Mirror 28: 0xa1904288 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000880 1789709674.123675 write 0x02e827 thru 0x034614 (0x5dee bytes) 000881 1789709674.138519 trunc from 0x040000 to 0x003c59 (0x3c3a6 bytes) 000883 1789709674.152711 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c5a): Mirror 13: 0xab435294 (stale) Mirror 16: 0xab435294 (stale) Mirror 19: 0xab435294 (stale) Mirror 22: 0xab435294 (stale) Mirror 23: 0xab435294 (stale) Mirror 27: 0xab435294 (stale) Mirror 28: 0xab435294 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c5a): Mirror 13: 0xab435294 (stale) Mirror 16: 0xab435294 (stale) Mirror 19: 0xab435294 (stale) Mirror 22: 0xab435294 (stale) Mirror 23: 0xab435294 (stale) Mirror 27: 0xab435294 (stale) Mirror 28: 0xab435294 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c5a: skipped 000884 1789709674.399793 write 0x03fdef thru 0x03ffff (0x211 bytes) 000885 1789709674.404034 fallocate 0x0140a3 thru 0x0204a3 (0xc401 bytes) 000886 1789709674.407454 write 0x03f5b4 thru 0x03ffff (0xa4c bytes) 000887 1789709674.412891 MIRROR_RESYNC 8 mirrors 000889 1789709675.260290 read 0x005d89 thru 0x00c50b (0x6783 bytes) 000891 1789709675.267218 trunc from 0x034c76 to 0x035ba5 (0xf30 bytes) 000892 1789709675.310672 fallocate 0x03c0ac thru 0x03d679 (0x15ce bytes) 000893 1789709675.317877 mapwrite 0x026ff6 thru 0x02b083 (0x408e bytes) 000894 1789709675.362793 mapread 0x0013e9 thru 0x0022a8 (0xec0 bytes) 000895 1789709675.371727 read 0x01e8a9 thru 0x01ed84 (0x4dc bytes) 000896 1789709675.381037 mapwrite 0x02824a thru 0x037b15 (0xf8cc bytes) 000897 1789709675.399097 trunc from 0x040000 to 0x037564 (0x8a9b bytes) 000898 1789709675.414521 write 0x03f36c thru 0x03ffff (0xc94 bytes) 000899 1789709675.415401 write 0x008bff thru 0x012007 (0x9409 bytes) 000900 1789709675.416511 mapread 0x022da6 thru 0x02959a (0x67f5 bytes) 000901 1789709675.417248 write 0x02f774 thru 0x033f38 (0x47c5 bytes) 000902 1789709675.418218 read 0x02bc17 thru 0x034836 (0x8c20 bytes) 000903 1789709675.418910 write 0x0042ca thru 0x005fe2 (0x1d19 bytes) 000904 1789709675.420037 punch from 0x036aa5 to 0x03a3e4 (0x3940 bytes) 000905 1789709675.430850 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x3c8416e8 (stale) Mirror 16: 0x3c8416e8 (stale) Mirror 19: 0x3c8416e8 (stale) Mirror 22: 0x3c8416e8 (stale) Mirror 23: 0x3c8416e8 (stale) Mirror 27: 0x3c8416e8 (stale) Mirror 28: 0x3c8416e8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x83d4caf7 Mirror 29: 0x83d4caf7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000906 1789709676.066341 read 0x00a837 thru 0x014d56 (0xa520 bytes) 000907 1789709676.078027 trunc from 0x01fca4 to 0x0246b7 (0x4a14 bytes) 000908 1789709676.101283 punch from 0x008258 to 0x011bc8 (0x9971 bytes) 000909 1789709676.104149 write 0x03b5f9 thru 0x03ffff (0x4a07 bytes) 000910 1789709676.111703 punch from 0x030db2 to 0x035bf3 (0x4e42 bytes) 000911 1789709676.116024 trunc from 0x02670b to 0x02e22c (0x7b22 bytes) 000913 1789709676.120447 mapread 0x0214bf thru 0x02ef72 (0xdab4 bytes) 000914 1789709676.142390 trunc from 0x01a252 to 0x01f363 (0x5112 bytes) 000915 1789709676.147015 mapread 0x03a458 thru 0x03ffff (0x5ba8 bytes) 000916 1789709676.158795 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x3c8416e8 (stale) Mirror 16: 0x3c8416e8 (stale) Mirror 19: 0x3c8416e8 (stale) Mirror 22: 0x3c8416e8 (stale) Mirror 23: 0x3c8416e8 (stale) Mirror 27: 0x3c8416e8 (stale) Mirror 28: 0x3c8416e8 (stale) Mirror 29: 0x83d4caf7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcd4787e4 Mirror 30: 0xcd4787e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000917 1789709676.825195 punch from 0x01ceca to 0x0218ce (0x4a05 bytes) 000918 1789709676.858841 read 0x032320 thru 0x03612f (0x3e10 bytes) 000919 1789709676.863255 mapwrite 0x003973 thru 0x005106 (0x1794 bytes) 000920 1789709676.879563 trunc from 0x040000 to 0x03a480 (0x5b7f bytes) 000921 1789709676.913986 trunc from 0x006cef to 0x011483 (0xa795 bytes) 000922 1789709676.917716 read 0x01049d thru 0x019196 (0x8cfa bytes) 000923 1789709676.922994 write 0x03d133 thru 0x03ffff (0x2ecd bytes) 000924 1789709676.924050 trunc from 0x040000 to 0x0159ed (0x2a612 bytes) 000927 1789709676.938014 mapread 0x006139 thru 0x00cfc7 (0x6e8f bytes) 000928 1789709676.938640 trunc from 0x00e859 to 0x0159ed (0x7195 bytes) 000929 1789709676.944957 write 0x032425 thru 0x03c57c (0xa158 bytes) 000930 1789709676.946133 trunc from 0x011f47 to 0x014926 (0x29e0 bytes) 000931 1789709676.952866 read 0x01adcf thru 0x0279ca (0xcbfc bytes) 000932 1789709676.963973 write 0x006fb8 thru 0x00d864 (0x68ad bytes) 000933 1789709676.970227 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 13: 0xc623c420 (stale) Mirror 16: 0xc623c420 (stale) Mirror 19: 0xc623c420 (stale) Mirror 22: 0xc623c420 (stale) Mirror 23: 0xc623c420 (stale) Mirror 27: 0xc623c420 (stale) Mirror 28: 0xc623c420 (stale) Mirror 29: 0x8e0152da (stale) Mirror 30: 0xff6121a9 (stale) CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 1: 0x81b16147 Mirror 31: 0x81b16147 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c57d: skipped 000934 1789709677.627977 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 16: 0xc623c420 (stale) Mirror 19: 0xc623c420 (stale) Mirror 22: 0xc623c420 (stale) Mirror 23: 0xc623c420 (stale) Mirror 27: 0xc623c420 (stale) Mirror 28: 0xc623c420 (stale) Mirror 29: 0x8e0152da (stale) Mirror 30: 0xff6121a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 16: 0xc623c420 (stale) Mirror 19: 0xc623c420 (stale) Mirror 22: 0xc623c420 (stale) Mirror 23: 0xc623c420 (stale) Mirror 27: 0xc623c420 (stale) Mirror 28: 0xc623c420 (stale) Mirror 29: 0x8e0152da (stale) Mirror 30: 0xff6121a9 (stale) CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 1: 0x81b16147 Mirror 31: 0x81b16147 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c57d: skipped 000935 1789709678.098871 trunc from 0x036636 to 0x03833b (0x1d06 bytes) 000936 1789709678.127265 write 0x01fe57 thru 0x0266a3 (0x684d bytes) 000937 1789709678.140754 write 0x002f11 thru 0x00670d (0x37fd bytes) 000938 1789709678.157283 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 16: 0xc623c420 (stale) Mirror 19: 0xc623c420 (stale) Mirror 22: 0xc623c420 (stale) Mirror 23: 0xc623c420 (stale) Mirror 27: 0xc623c420 (stale) Mirror 28: 0xc623c420 (stale) Mirror 29: 0x8e0152da (stale) Mirror 30: 0xff6121a9 (stale) Mirror 31: 0x81b16147 (stale) CRC-32 checksum value for chunk [0, 0x3c57d): Mirror 1: 0xa6210da6 Mirror 32: 0xa6210da6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c57d: skipped 000939 1789709678.774466 write 0x036b69 thru 0x03a056 (0x34ee bytes) 000940 1789709678.804876 mapread 0x036076 thru 0x03c57c (0x6507 bytes) 000941 1789709678.812495 write 0x0148d0 thru 0x0201de (0xb90f bytes) 000942 1789709678.819631 read 0x02a921 thru 0x03697c (0xc05c bytes) 000943 1789709678.825887 punch from 0x013b6c to 0x01b89c (0x7d31 bytes) 000946 1789709678.841552 punch from 0x039543 to 0x03c57c (0x303a bytes) 000947 1789709678.850727 mapwrite 0x0294fd thru 0x0380c1 (0xebc5 bytes) 000948 1789709678.883351 MIRROR_RESYNC 11 mirrors 000949 1789709680.717101 mapread 0x01a5c8 thru 0x024187 (0x9bc0 bytes) 000950 1789709680.728267 read 0x024c32 thru 0x027a3a (0x2e09 bytes) 000951 1789709680.738620 MIRROR_RESYNC 11 mirrors 000952 1789709681.016392 punch from 0x012f1d to 0x020a4f (0xdb33 bytes) 000953 1789709681.044330 mapread 0x02bad9 thru 0x02fb9b (0x40c3 bytes) 000954 1789709681.054660 fallocate 0x00e985 thru 0x013261 (0x48dd bytes) 000955 1789709681.058499 trunc from 0x03c57d to 0x03eed2 (0x2956 bytes) 000956 1789709681.074685 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eed3): Mirror 19: 0x96f00aa (stale) Mirror 22: 0x96f00aa (stale) Mirror 23: 0x96f00aa (stale) Mirror 27: 0x96f00aa (stale) Mirror 28: 0x96f00aa (stale) Mirror 29: 0x96f00aa (stale) Mirror 30: 0x96f00aa (stale) Mirror 31: 0x96f00aa (stale) Mirror 32: 0x96f00aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eed3): Mirror 19: 0x96f00aa (stale) Mirror 22: 0x96f00aa (stale) Mirror 23: 0x96f00aa (stale) Mirror 27: 0x96f00aa (stale) Mirror 28: 0x96f00aa (stale) Mirror 29: 0x96f00aa (stale) Mirror 30: 0x96f00aa (stale) Mirror 31: 0x96f00aa (stale) Mirror 32: 0x96f00aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eed3: skipped 000957 1789709681.335773 trunc from 0x01f975 to 0x02c522 (0xcbae bytes) 000958 1789709681.338245 trunc from 0x03eed3 to 0x010198 (0x2ed3a bytes) 000959 1789709681.349399 write 0x018c1e thru 0x025ce1 (0xd0c4 bytes) 000960 1789709681.350838 write 0x036913 thru 0x03ffff (0x96ed bytes) 000961 1789709681.351922 read 0x01fc53 thru 0x02b3c8 (0xb776 bytes) 000962 1789709681.357999 mapwrite 0x00182d thru 0x008c2f (0x7403 bytes) 000963 1789709681.405220 punch from 0x034836 to 0x03650f (0x1cda bytes) 000964 1789709681.416723 punch from 0x023308 to 0x02c8af (0x95a8 bytes) 000965 1789709681.424945 mapread 0x0372f3 thru 0x03ffff (0x8d0d bytes) 000966 1789709681.425899 fallocate 0x03747f thru 0x03e2a0 (0x6e22 bytes) 000967 1789709681.432473 punch from 0x0303cc to 0x037504 (0x7139 bytes) 000968 1789709681.435815 punch from 0x00a4b4 to 0x0123c9 (0x7f16 bytes) 000969 1789709681.443141 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x8a3e19c4 (stale) Mirror 22: 0x8a3e19c4 (stale) Mirror 27: 0x8a3e19c4 (stale) Mirror 28: 0x8a3e19c4 (stale) Mirror 29: 0x8a3e19c4 (stale) Mirror 30: 0x8a3e19c4 (stale) Mirror 31: 0x8a3e19c4 (stale) Mirror 32: 0x8a3e19c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x8a3e19c4 (stale) Mirror 22: 0x8a3e19c4 (stale) Mirror 27: 0x8a3e19c4 (stale) Mirror 28: 0x8a3e19c4 (stale) Mirror 29: 0x8a3e19c4 (stale) Mirror 30: 0x8a3e19c4 (stale) Mirror 31: 0x8a3e19c4 (stale) Mirror 32: 0x8a3e19c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000970 1789709681.769291 read 0x02001f thru 0x0206c1 (0x6a3 bytes) 000971 1789709681.773852 trunc from 0x03dc57 to 0x03ffff (0x23a9 bytes) 000972 1789709681.781290 write 0x02b0a0 thru 0x038de3 (0xdd44 bytes) 000973 1789709681.795856 write 0x02fa60 thru 0x03b6bf (0xbc60 bytes) 000974 1789709681.801599 trunc from 0x0275f8 to 0x034523 (0xcf2c bytes) 000975 1789709681.814221 trunc from 0x040000 to 0x02b4b9 (0x14b46 bytes) 000976 1789709681.830980 read 0x00d9cc thru 0x01ce06 (0xf43b bytes) 000977 1789709681.839217 trunc from 0x028360 to 0x02b4b9 (0x315a bytes) 000978 1789709681.844924 trunc from 0x02b4ba to 0x014a08 (0x16ab1 bytes) 000979 1789709681.859380 mapwrite 0x0171de thru 0x01e003 (0x6e26 bytes) 000980 1789709681.919360 trunc from 0x010b34 to 0x019ff1 (0x94be bytes) 000981 1789709681.923037 mapwrite 0x01bddd thru 0x023e82 (0x80a6 bytes) 000982 1789709681.973244 mapread 0x00c707 thru 0x00cc28 (0x522 bytes) 000983 1789709681.976360 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x23e83): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23e83): Mirror 19: 0xa5bf824d (stale) Mirror 22: 0xa5bf824d (stale) Mirror 27: 0xa5bf824d (stale) Mirror 28: 0xa5bf824d (stale) Mirror 29: 0xa5bf824d (stale) Mirror 30: 0xa5bf824d (stale) Mirror 31: 0xa5bf824d (stale) Mirror 32: 0xa5bf824d (stale) CRC-32 checksum value for chunk [0, 0x23e83): Mirror 1: 0xe3b869b8 Mirror 33: 0xe3b869b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23e83: skipped 000984 1789709682.556319 read 0x008ab9 thru 0x00e1d9 (0x5721 bytes) 000985 1789709682.563196 punch from 0x011f36 to 0x01a6e1 (0x87ac bytes) 000987 1789709682.586839 write 0x000344 thru 0x003a42 (0x36ff bytes) 000988 1789709682.594144 trunc from 0x017f30 to 0x023e82 (0xbf53 bytes) 000989 1789709682.599704 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23e83): Mirror 19: 0xa5bf824d (stale) Mirror 22: 0xa5bf824d (stale) Mirror 27: 0xa5bf824d (stale) Mirror 28: 0xa5bf824d (stale) Mirror 30: 0xa5bf824d (stale) Mirror 31: 0xa5bf824d (stale) Mirror 32: 0xa5bf824d (stale) Mirror 33: 0xe3b869b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23e83): Mirror 19: 0xa5bf824d (stale) Mirror 22: 0xa5bf824d (stale) Mirror 27: 0xa5bf824d (stale) Mirror 28: 0xa5bf824d (stale) Mirror 30: 0xa5bf824d (stale) Mirror 31: 0xa5bf824d (stale) Mirror 32: 0xa5bf824d (stale) Mirror 33: 0xe3b869b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23e83: skipped 000990 1789709682.995202 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x1e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23e83): Mirror 19: 0xa5bf824d (stale) Mirror 22: 0xa5bf824d (stale) Mirror 27: 0xa5bf824d (stale) Mirror 28: 0xa5bf824d (stale) Mirror 30: 0xa5bf824d (stale) Mirror 32: 0xa5bf824d (stale) Mirror 33: 0xe3b869b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23e83): Mirror 19: 0xa5bf824d (stale) Mirror 22: 0xa5bf824d (stale) Mirror 27: 0xa5bf824d (stale) Mirror 28: 0xa5bf824d (stale) Mirror 30: 0xa5bf824d (stale) Mirror 32: 0xa5bf824d (stale) Mirror 33: 0xe3b869b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23e83: skipped 000992 1789709683.325453 trunc from 0x00d23c to 0x01892e (0xb6f3 bytes) 000993 1789709683.330494 write 0x0342c1 thru 0x03ecf0 (0xaa30 bytes) 000994 1789709683.336133 punch from 0x020947 to 0x024513 (0x3bcd bytes) 000995 1789709683.339033 fallocate 0x03bcb3 thru 0x03ffff (0x434d bytes) 000996 1789709683.341646 trunc from 0x040000 to 0x007336 (0x38cc9 bytes) 000997 1789709683.352205 trunc from 0x006e66 to 0x007336 (0x4d1 bytes) 000999 1789709683.355955 trunc from 0x00680c to 0x007336 (0xb2b bytes) 001000 1789709683.359004 punch from 0x005d04 to 0x007336 (0x1633 bytes) All operations completed A-OK!