== sanity-flr test 70a: flr mode fsx test ================ 15:14:55 (1777576495) Seed set to 6498 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1777576498.420831 MIRROR_EXTEND to 2 mirrors skipping zero size read skipping zero size read truncating to largest ever: 0x68bc 000005 1777576498.950001 trunc from 00000000 to 0x0068bb (0x68bc bytes) 000006 1777576499.085649 mapwrite 0x01b209 thru 0x024552 (0x934a bytes) truncating to largest ever: 0xccdd 000007 1777576499.206171 trunc from 0x024553 to 0x00ccdc (0x17876 bytes) 000011 1777576499.227369 read 0x00975e thru 0x00ccdc (0x357f bytes) 000012 1777576499.237386 read 0x0078b7 thru 0x00ccdc (0x5426 bytes) 000016 1777576499.256106 mapwrite 0x03f0e4 thru 0x03ffff (0xf1c bytes) 000018 1777576499.357263 write 0x036389 thru 0x037af5 (0x176d bytes) 000019 1777576499.367073 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) truncating to largest ever: 0x3bcee 000020 1777576499.583063 trunc from 0x040000 to 0x03bced (0x4312 bytes) 000021 1777576499.610546 mapwrite 0x03a763 thru 0x03ffff (0x589d bytes) 000024 1777576499.775578 trunc from 0x040000 to 0x009ce5 (0x3631a bytes) 000026 1777576499.806676 read 0x005382 thru 0x009ce5 (0x4964 bytes) 000027 1777576499.828908 read 0x0063b1 thru 0x009ce5 (0x3935 bytes) 000033 1777576499.840414 read 0x003f7c thru 0x009ce5 (0x5d6a bytes) 000035 1777576499.852722 read 0x00388b thru 0x009ce5 (0x645b bytes) 000036 1777576499.853375 mapwrite 0x02bada thru 0x0316ae (0x5bd5 bytes) 000037 1777576499.983019 mapread 0x01c37c thru 0x01d9ad (0x1632 bytes) 000038 1777576499.985975 write 0x013eb8 thru 0x01d16c (0x92b5 bytes) 000039 1777576499.991396 read 0x02080b thru 0x028f5f (0x8755 bytes) 000041 1777576499.998766 write 0x02609f thru 0x02761b (0x157d bytes) 000043 1777576500.002986 write 0x03c550 thru 0x03ffff (0x3ab0 bytes) 000045 1777576500.009017 mapread 0x015dc7 thru 0x022294 (0xc4ce bytes) 000047 1777576500.012240 trunc from 0x040000 to 0x03575c (0xa8a3 bytes) 000054 1777576500.055253 mapwrite 0x025fd7 thru 0x02c1b1 (0x61db bytes) 000055 1777576500.106467 mapwrite 0x001f23 thru 0x00c5d1 (0xa6af bytes) 000056 1777576500.158163 mapread 0x024fe2 thru 0x02e7d5 (0x97f4 bytes) 000060 1777576500.162520 read 0x022c37 thru 0x0277ca (0x4b94 bytes) 000061 1777576500.164642 read 0x0114ab thru 0x011669 (0x1bf bytes) truncating to largest ever: 0x3bf29 000062 1777576500.166339 trunc from 0x03575d to 0x03bf28 (0x67cc bytes) 000063 1777576500.180609 write 0x027345 thru 0x029307 (0x1fc3 bytes) 000064 1777576500.181893 trunc from 0x03bf29 to 0x029e76 (0x120b2 bytes) 000065 1777576500.203342 mapwrite 0x005462 thru 0x0095dc (0x417b bytes) 000069 1777576500.245104 read 0x0031b5 thru 0x011c9c (0xeae8 bytes) 000071 1777576500.248103 trunc from 0x029e77 to 0x0153ff (0x14a77 bytes) 000075 1777576500.279261 mapwrite 0x02b51b thru 0x02fff1 (0x4ad7 bytes) 000076 1777576500.362479 trunc from 0x02fff2 to 0x021516 (0xeadb bytes) 000077 1777576500.384037 MIRROR_EXTEND to 2 mirrors 000079 1777576501.145369 mapread 0x000309 thru 0x0047d2 (0x44ca bytes) 000082 1777576501.276812 mapwrite 0x011392 thru 0x01fc7a (0xe8e9 bytes) 000083 1777576501.545265 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x21517): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21517): Mirror 2: 0x85aa6f07 (stale) CRC-32 checksum value for chunk [0, 0x21517): Mirror 1: 0xa85ed5e8 Mirror 3: 0xa85ed5e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21517: skipped 000084 1777576502.578189 mapread 0x00fc19 thru 0x01822c (0x8614 bytes) 000085 1777576502.621954 trunc from 0x021517 to 0x02da56 (0xc540 bytes) 000092 1777576502.732398 trunc from 0x02da57 to 0x0192fe (0x14758 bytes) truncating to largest ever: 0x3dfe1 000094 1777576502.759142 trunc from 0x0192ff to 0x03dfe0 (0x24ce2 bytes) 000095 1777576502.780172 write 0x02afb2 thru 0x02daca (0x2b19 bytes) 000096 1777576502.794076 mapread 0x026445 thru 0x02811e (0x1cda bytes) 000097 1777576502.796176 trunc from 0x03dfe1 to 0x01455a (0x29a86 bytes) 000098 1777576502.818696 mapread 0x010b48 thru 0x01455a (0x3a13 bytes) 000099 1777576502.827577 write 0x0038b2 thru 0x011e0d (0xe55c bytes) 000101 1777576502.836763 read 0x00a48d thru 0x01455a (0xa0ce bytes) 000102 1777576502.839295 read 0x012e9e thru 0x01455a (0x16bd bytes) 000105 1777576502.852390 trunc from 0x01455b to 0x0353e7 (0x20e8d bytes) 000108 1777576502.882825 write 0x03b7d4 thru 0x03ffff (0x482c bytes) 000109 1777576502.884988 mapread 0x024c40 thru 0x0266e5 (0x1aa6 bytes) 000110 1777576502.902603 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xf9e34cd1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xf9e34cd1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000111 1777576503.311238 mapread 0x03c62e thru 0x03ffff (0x39d2 bytes) 000112 1777576503.330235 mapread 0x002785 thru 0x00abc8 (0x8444 bytes) 000113 1777576503.340489 trunc from 0x040000 to 0x0166af (0x29950 bytes) 000114 1777576503.359135 write 0x006a54 thru 0x010bcf (0xa17c bytes) 000115 1777576503.361171 mapwrite 0x03ac2b thru 0x03ffff (0x53d5 bytes) 000117 1777576503.531068 mapwrite 0x03212a thru 0x03430f (0x21e6 bytes) 000118 1777576503.643074 write 0x022dbe thru 0x025b16 (0x2d59 bytes) 000119 1777576503.658965 mapread 0x0303bc thru 0x03d134 (0xcd79 bytes) 000121 1777576503.662047 mapread 0x03088f thru 0x034a3b (0x41ad bytes) 000123 1777576503.663754 write 0x007aaf thru 0x00fda6 (0x82f8 bytes) 000124 1777576503.668363 mapread 0x02e9ad thru 0x032b8c (0x41e0 bytes) 000126 1777576503.670001 trunc from 0x040000 to 0x0035e4 (0x3ca1b bytes) 000127 1777576503.705685 mapread 0x0005be thru 0x0035e4 (0x3027 bytes) 000130 1777576503.717935 trunc from 0x0035e5 to 0x0356a8 (0x320c4 bytes) 000131 1777576503.739556 write 0x03c807 thru 0x03ef30 (0x272a bytes) 000132 1777576503.741287 write 0x0327d6 thru 0x03d2ac (0xaad7 bytes) 000135 1777576503.756337 read 0x01865c thru 0x01fdb8 (0x775d bytes) 000138 1777576503.774556 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000139 1777576503.939047 mapread 0x0355b2 thru 0x03ef30 (0x997f bytes) 000140 1777576503.978837 trunc from 0x03ef31 to 0x012c01 (0x2c32f bytes) 000141 1777576503.997586 write 0x028414 thru 0x0309de (0x85cb bytes) 000142 1777576503.999673 mapwrite 0x038c4e thru 0x03ffff (0x73b2 bytes) 000150 1777576504.156286 write 0x0182d7 thru 0x01fffe (0x7d28 bytes) 000151 1777576504.175292 mapwrite 0x00a360 thru 0x00d150 (0x2df1 bytes) 000152 1777576504.261674 mapwrite 0x016633 thru 0x017ada (0x14a8 bytes) 000155 1777576504.303357 trunc from 0x040000 to 0x03a214 (0x5deb bytes) 000156 1777576504.342494 read 0x027f15 thru 0x02bfa1 (0x408d bytes) 000159 1777576504.353538 mapread 0x00f46e thru 0x00fdb0 (0x943 bytes) 000160 1777576504.355192 mapwrite 0x01f37d thru 0x02cd7b (0xd9ff bytes) 000161 1777576504.437072 mapwrite 0x017ae9 thru 0x026466 (0xe97e bytes) 000162 1777576504.514508 mapwrite 0x0060b2 thru 0x00f4f9 (0x9448 bytes) 000163 1777576504.569262 write 0x0380da thru 0x03e7d9 (0x6700 bytes) 000167 1777576504.583120 mapwrite 0x0278eb thru 0x02ef6c (0x7682 bytes) 000168 1777576504.647539 write 0x000e1b thru 0x004a46 (0x3c2c bytes) 000169 1777576504.656236 mapwrite 0x009f8e thru 0x00c941 (0x29b4 bytes) 000171 1777576504.733986 trunc from 0x03e7da to 0x022254 (0x1c585 bytes) 000172 1777576504.758631 write 0x01c6e6 thru 0x026977 (0xa292 bytes) 000174 1777576504.760521 mapread 0x0076fe thru 0x014213 (0xcb16 bytes) 000177 1777576504.764824 mapread 0x016dfd thru 0x01f65a (0x885e bytes) 000178 1777576504.766601 mapread 0x00dd96 thru 0x00f080 (0x12eb bytes) 000180 1777576504.769330 write 0x0008fe thru 0x00faf4 (0xf1f7 bytes) 000181 1777576504.771061 mapread 0x01e1ef thru 0x026977 (0x8789 bytes) 000183 1777576504.774520 write 0x029549 thru 0x03711e (0xdbd6 bytes) 000189 1777576504.785711 read 0x0069fe thru 0x011f18 (0xb51b bytes) 000191 1777576504.787579 read 0x01af18 thru 0x01d08b (0x2174 bytes) 000193 1777576504.788848 write 0x01b087 thru 0x022f9f (0x7f19 bytes) 000194 1777576504.790269 read 0x002021 thru 0x00c8de (0xa8be bytes) 000197 1777576504.792297 trunc from 0x03711f to 0x0201fd (0x16f21 bytes) 000200 1777576504.815205 trunc from 0x0201fe to 0x02cff8 (0xcdfb bytes) 000201 1777576504.836231 MIRROR_EXTEND to 2 mirrors 000204 1777576505.443663 MIRROR_EXTEND to 3 mirrors 000205 1777576506.255070 trunc from 0x02cff9 to 0x02f35d (0x2365 bytes) 000207 1777576506.368010 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2f35e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f35e): Mirror 2: 0x349278e (stale) Mirror 3: 0x349278e (stale) CRC-32 checksum value for chunk [0, 0x2f35e): Mirror 1: 0x349278e Mirror 4: 0x349278e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f35e: skipped 000208 1777576507.258347 write 0x01e659 thru 0x029cf2 (0xb69a bytes) 000210 1777576507.387379 mapread 0x0269b0 thru 0x029715 (0x2d66 bytes) 000212 1777576507.389060 mapread 0x024c43 thru 0x02cc85 (0x8043 bytes) 000213 1777576507.403241 mapread 0x018350 thru 0x01f36d (0x701e bytes) 000214 1777576507.420229 read 0x01bcc2 thru 0x01c719 (0xa58 bytes) 000215 1777576507.421048 mapread 0x005fbc thru 0x014c5e (0xeca3 bytes) 000216 1777576507.435918 read 0x017633 thru 0x02087e (0x924c bytes) 000217 1777576507.437509 trunc from 0x02f35e to 0x002574 (0x2cde9 bytes) 000219 1777576507.465651 trunc from 0x002575 to 0x004763 (0x21ef bytes) 000220 1777576507.483150 mapwrite 0x02ae0e thru 0x038848 (0xda3b bytes) 000221 1777576507.600984 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38849): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38849): Mirror 2: 0xb0db0933 (stale) Mirror 3: 0xb0db0933 (stale) Mirror 4: 0xb0db0933 (stale) CRC-32 checksum value for chunk [0, 0x38849): Mirror 1: 0x9a21c073 Mirror 5: 0x9a21c073 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38849: skipped 000222 1777576508.494132 mapwrite 0x024e48 thru 0x0349a9 (0xfb62 bytes) 000223 1777576508.662478 write 0x033695 thru 0x03a3ba (0x6d26 bytes) 000224 1777576508.667141 mapread 0x010242 thru 0x01e57c (0xe33b bytes) 000225 1777576508.697423 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a3bb): Mirror 2: 0xbb5a0d6a (stale) Mirror 3: 0xbb5a0d6a (stale) Mirror 5: 0xee3628d5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3bb): Mirror 2: 0xbb5a0d6a (stale) Mirror 3: 0xbb5a0d6a (stale) Mirror 5: 0xee3628d5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3bb: skipped 000227 1777576509.097277 mapwrite 0x02b6cc thru 0x0302d0 (0x4c05 bytes) 000229 1777576509.179893 read 0x03343a thru 0x036531 (0x30f8 bytes) 000230 1777576509.193746 MIRROR_RESYNC 4 mirrors 000231 1777576510.203166 MIRROR_RESYNC 4 mirrors 000234 1777576510.604198 mapread 0x0248ab thru 0x02cfcc (0x8722 bytes) 000236 1777576510.629690 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000237 1777576510.975990 mapwrite 0x01f947 thru 0x0240dc (0x4796 bytes) 000240 1777576511.156016 mapread 0x0219ad thru 0x029a05 (0x8059 bytes) 000241 1777576511.176840 trunc from 0x03a3bb to 0x0083ab (0x3200f bytes) 000242 1777576511.233578 mapwrite 0x0175e5 thru 0x0202e7 (0x8d03 bytes) 000243 1777576511.381264 read 0x0087ee thru 0x0154a7 (0xccba bytes) 000244 1777576511.400937 trunc from 0x0202e8 to 0x02a2c0 (0x9fd9 bytes) 000245 1777576511.440526 mapread 0x021513 thru 0x028f00 (0x79ee bytes) 000246 1777576511.457147 mapwrite 0x02c1bd thru 0x03a6a0 (0xe4e4 bytes) 000248 1777576511.544285 write 0x01a765 thru 0x020a80 (0x631c bytes) 000249 1777576511.545620 read 0x008da5 thru 0x00c647 (0x38a3 bytes) 000250 1777576511.547227 trunc from 0x03a6a1 to 0x0184ce (0x221d2 bytes) 000254 1777576511.567145 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x184cf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x184cf): Mirror 2: 0xc0df10b2 (stale) Mirror 3: 0xc0df10b2 (stale) CRC-32 checksum value for chunk [0, 0x184cf): Mirror 1: 0x9298a3ca Mirror 4: 0x9298a3ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x184cf: skipped 000258 1777576512.457305 mapread 0x008dfc thru 0x012508 (0x970d bytes) 000259 1777576512.504578 read 0x00745d thru 0x011abf (0xa663 bytes) 000260 1777576512.515303 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x184cf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x184cf): Mirror 2: 0xc0df10b2 (stale) Mirror 3: 0xc0df10b2 (stale) CRC-32 checksum value for chunk [0, 0x184cf): Mirror 1: 0x9298a3ca Mirror 4: 0x9298a3ca Mirror 5: 0x9298a3ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x184cf: skipped 000261 1777576513.381074 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x184cf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x184cf): Mirror 2: 0xc0df10b2 (stale) Mirror 3: 0xc0df10b2 (stale) CRC-32 checksum value for chunk [0, 0x184cf): Mirror 1: 0x9298a3ca Mirror 4: 0x9298a3ca Mirror 5: 0x9298a3ca Mirror 6: 0x9298a3ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x184cf: skipped 000263 1777576514.302062 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x184cf): Mirror 2: 0xc0df10b2 (stale) Mirror 3: 0xc0df10b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x184cf): Mirror 2: 0xc0df10b2 (stale) Mirror 3: 0xc0df10b2 (stale) CRC-32 checksum value for chunk [0, 0x184cf): Mirror 1: 0x9298a3ca Mirror 4: 0x9298a3ca Mirror 6: 0x9298a3ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x184cf: skipped 000266 1777576514.860684 mapwrite 0x016eea thru 0x01da48 (0x6b5f bytes) 000267 1777576515.092139 write 0x02bc2f thru 0x0349ea (0x8dbc bytes) 000268 1777576515.096481 write 0x031239 thru 0x033ba5 (0x296d bytes) 000269 1777576515.104806 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x349eb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x349eb): Mirror 2: 0x6e8a7196 (stale) Mirror 3: 0x6e8a7196 (stale) Mirror 4: 0x349f473a (stale) Mirror 6: 0x349f473a (stale) CRC-32 checksum value for chunk [0, 0x349eb): Mirror 1: 0x1c6496da Mirror 7: 0x1c6496da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x349eb: skipped 000270 1777576516.011133 mapread 0x00fc5a thru 0x01062c (0x9d3 bytes) 000271 1777576516.058639 mapwrite 0x0249c2 thru 0x025541 (0xb80 bytes) 000272 1777576516.255970 mapread 0x0130b0 thru 0x0189ff (0x5950 bytes) 000274 1777576516.268850 write 0x0052f1 thru 0x0088c0 (0x35d0 bytes) 000275 1777576516.279264 write 0x02efb9 thru 0x035cfd (0x6d45 bytes) 000279 1777576516.292893 write 0x02dee4 thru 0x02f671 (0x178e bytes) 000280 1777576516.294128 read 0x002dff thru 0x007f30 (0x5132 bytes) 000281 1777576516.295553 trunc from 0x035cfe to 0x007a4a (0x2e2b3 bytes) 000282 1777576516.321689 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x7a4b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7a4b): Mirror 2: 0xfed24cfa (stale) Mirror 3: 0xfed24cfa (stale) Mirror 4: 0xfed24cfa (stale) Mirror 6: 0xfed24cfa (stale) Mirror 7: 0xfed24cfa (stale) CRC-32 checksum value for chunk [0, 0x7a4b): Mirror 1: 0x1de77b40 Mirror 8: 0x1de77b40 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7a4b: skipped 000283 1777576517.390400 trunc from 0x007a4b to 0x03009e (0x28654 bytes) 000284 1777576517.507343 read 0x019325 thru 0x022ff9 (0x9cd5 bytes) 000285 1777576517.518055 read 0x01b427 thru 0x02555e (0xa138 bytes) 000288 1777576517.545047 write 0x022d15 thru 0x02c9ec (0x9cd8 bytes) 000290 1777576517.548134 trunc from 0x03009f to 0x02790e (0x8790 bytes) 000291 1777576517.591968 MIRROR_RESYNC 7 mirrors 000292 1777576519.052139 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000293 1777576519.439534 trunc from 0x02790f to 0x032fdc (0xb6ce bytes) 000295 1777576519.561075 mapread 0x02a3ca thru 0x02be4f (0x1a86 bytes) 000296 1777576519.574165 read 0x01dbae thru 0x02671c (0x8b6f bytes) 000297 1777576519.583821 mapread 0x022460 thru 0x02c54a (0xa0eb bytes) 000298 1777576519.603813 MIRROR_RESYNC 6 mirrors 000301 1777576520.653971 MIRROR_EXTEND to 7 mirrors 000302 1777576521.384635 write 0x02cb31 thru 0x02f7bb (0x2c8b bytes) 000303 1777576521.471750 mapwrite 0x00988a thru 0x00b471 (0x1be8 bytes) 000304 1777576521.557333 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32fdd): Mirror 4: 0xdf0d57ad (stale) Mirror 6: 0xdf0d57ad (stale) Mirror 7: 0xdf0d57ad (stale) Mirror 8: 0xdf0d57ad (stale) Mirror 9: 0xdf0d57ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32fdd): Mirror 4: 0xdf0d57ad (stale) Mirror 6: 0xdf0d57ad (stale) Mirror 7: 0xdf0d57ad (stale) Mirror 8: 0xdf0d57ad (stale) Mirror 9: 0xdf0d57ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32fdd: skipped 000306 1777576522.068789 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32fdd): Mirror 4: 0xdf0d57ad (stale) Mirror 6: 0xdf0d57ad (stale) Mirror 7: 0xdf0d57ad (stale) Mirror 8: 0xdf0d57ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32fdd): Mirror 4: 0xdf0d57ad (stale) Mirror 6: 0xdf0d57ad (stale) Mirror 7: 0xdf0d57ad (stale) Mirror 8: 0xdf0d57ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32fdd: skipped 000308 1777576522.463126 mapread 0x030fbd thru 0x032fdc (0x2020 bytes) 000309 1777576522.485518 mapread 0x02d8c1 thru 0x032fdc (0x571c bytes) 000310 1777576522.486872 read 0x00bf1d thru 0x016569 (0xa64d bytes) 000311 1777576522.503162 trunc from 0x032fdd to 0x0336c6 (0x6ea bytes) 000313 1777576522.522933 trunc from 0x0336c7 to 0x003088 (0x3063e bytes) 000314 1777576522.545843 mapread 0x0004a9 thru 0x003088 (0x2be0 bytes) 000315 1777576522.553900 write 0x033099 thru 0x035c08 (0x2b70 bytes) 000317 1777576522.561151 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35c09): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c09): Mirror 4: 0xc72a3a1a (stale) Mirror 6: 0xc72a3a1a (stale) Mirror 7: 0xc72a3a1a (stale) Mirror 8: 0xc72a3a1a (stale) CRC-32 checksum value for chunk [0, 0x35c09): Mirror 1: 0xdeb89347 Mirror 9: 0xdeb89347 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c09: skipped 000318 1777576523.392980 write 0x03f852 thru 0x03ffff (0x7ae bytes) 000322 1777576523.468005 read 0x02c61f thru 0x03887c (0xc25e bytes) 000323 1777576523.482632 read 0x0245e4 thru 0x027ff8 (0x3a15 bytes) 000326 1777576523.499985 read 0x02fb98 thru 0x03ca5b (0xcec4 bytes) 000329 1777576523.502851 trunc from 0x040000 to 0x03d60b (0x29f4 bytes) 000331 1777576523.556840 mapwrite 0x00511b thru 0x006125 (0x100b bytes) 000332 1777576523.604401 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d60c): Mirror 4: 0x1f8a1f7d (stale) Mirror 6: 0x1f8a1f7d (stale) Mirror 7: 0x1f8a1f7d (stale) Mirror 9: 0x6e9ce314 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d60c): Mirror 4: 0x1f8a1f7d (stale) Mirror 6: 0x1f8a1f7d (stale) Mirror 7: 0x1f8a1f7d (stale) Mirror 9: 0x6e9ce314 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d60c: skipped 000334 1777576524.085727 mapwrite 0x0211da thru 0x02d1ac (0xbfd3 bytes) 000335 1777576524.181055 mapread 0x0030d3 thru 0x003b68 (0xa96 bytes) 000336 1777576524.196423 read 0x02f364 thru 0x0327ab (0x3448 bytes) 000337 1777576524.198260 mapwrite 0x0383e8 thru 0x03ffff (0x7c18 bytes) 000339 1777576524.275986 trunc from 0x040000 to 0x025390 (0x1ac6f bytes) 000341 1777576524.297895 write 0x02c4db thru 0x036339 (0x9e5f bytes) 000343 1777576524.301073 mapread 0x00bf43 thru 0x00e5e8 (0x26a6 bytes) 000345 1777576524.304552 write 0x02bcc2 thru 0x035300 (0x963f bytes) 000347 1777576524.312173 write 0x00fff6 thru 0x01c160 (0xc16b bytes) 000349 1777576524.314762 read 0x00e48c thru 0x013e32 (0x59a7 bytes) 000353 1777576524.317012 mapwrite 0x0395ef thru 0x03ffff (0x6a11 bytes) 000354 1777576524.411036 mapread 0x03b566 thru 0x03ffff (0x4a9a bytes) 000356 1777576524.415918 read 0x0207cc thru 0x026655 (0x5e8a bytes) 000357 1777576524.418027 trunc from 0x040000 to 0x00879f (0x37860 bytes) 000358 1777576524.445160 trunc from 0x0087a0 to 0x009897 (0x10f8 bytes) 000359 1777576524.471172 read 0x00681e thru 0x007aea (0x12cd bytes) 000360 1777576524.477405 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9898): Mirror 6: 0xdece27ef (stale) Mirror 7: 0xdece27ef (stale) Mirror 9: 0xa6006e3e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9898): Mirror 6: 0xdece27ef (stale) Mirror 7: 0xdece27ef (stale) Mirror 9: 0xa6006e3e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9898: skipped 000363 1777576524.859135 trunc from 0x009898 to 0x01e724 (0x14e8d bytes) 000364 1777576524.882948 trunc from 0x01e725 to 0x012efc (0xb828 bytes) 000366 1777576524.904887 mapwrite 0x012d43 thru 0x016c4a (0x3f08 bytes) 000367 1777576525.012004 read 0x01030b thru 0x0147c5 (0x44bb bytes) 000368 1777576525.013406 write 0x00cb4f thru 0x015dd0 (0x9282 bytes) 000371 1777576525.033387 trunc from 0x016c4b to 0x006b2c (0x1011e bytes) 000372 1777576525.056193 trunc from 0x006b2d to 0x030e87 (0x2a35b bytes) 000373 1777576525.076755 read 0x011e41 thru 0x01b9f1 (0x9bb1 bytes) 000374 1777576525.084884 write 0x039575 thru 0x03cb25 (0x35b1 bytes) 000375 1777576525.086341 read 0x035875 thru 0x03cb25 (0x72b1 bytes) 000377 1777576525.099111 mapread 0x02e247 thru 0x037502 (0x92bc bytes) 000379 1777576525.107170 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3cb26): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb26): Mirror 6: 0x1c29de51 (stale) Mirror 7: 0x1c29de51 (stale) Mirror 9: 0x3eddeed6 (stale) CRC-32 checksum value for chunk [0, 0x3cb26): Mirror 1: 0x7f0051ed Mirror 10: 0x7f0051ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb26: skipped 000383 1777576525.877133 mapwrite 0x00d7c1 thru 0x018762 (0xafa2 bytes) 000387 1777576526.071263 mapwrite 0x025fc7 thru 0x0313f6 (0xb430 bytes) 000390 1777576526.178856 mapread 0x030024 thru 0x037d94 (0x7d71 bytes) 000391 1777576526.206237 write 0x0208d4 thru 0x02d475 (0xcba2 bytes) 000392 1777576526.212247 trunc from 0x03cb26 to 0x038841 (0x42e4 bytes) 000395 1777576526.280007 mapwrite 0x01754f thru 0x027343 (0xfdf5 bytes) 000397 1777576526.325338 mapwrite 0x020e15 thru 0x023dfb (0x2fe7 bytes) 000398 1777576526.372899 mapread 0x022157 thru 0x0246bb (0x2565 bytes) 000401 1777576526.377071 mapwrite 0x023419 thru 0x02ec75 (0xb85d bytes) 000402 1777576526.450667 mapwrite 0x026d14 thru 0x027fda (0x12c7 bytes) 000405 1777576526.524826 mapwrite 0x0399f5 thru 0x03ffff (0x660b bytes) 000406 1777576526.607043 trunc from 0x040000 to 0x02e5a3 (0x11a5c bytes) 000407 1777576526.629830 mapwrite 0x0027d3 thru 0x0076d2 (0x4f00 bytes) 000408 1777576526.689660 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e5a4): Mirror 7: 0x4bcc3dff (stale) Mirror 9: 0x664b694c (stale) Mirror 10: 0xf4189a11 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e5a4): Mirror 7: 0x4bcc3dff (stale) Mirror 9: 0x664b694c (stale) Mirror 10: 0xf4189a11 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e5a4: skipped 000409 1777576527.065587 mapwrite 0x004c67 thru 0x007440 (0x27da bytes) 000410 1777576527.147722 mapread 0x01b61e thru 0x01d2ff (0x1ce2 bytes) 000412 1777576527.160926 mapread 0x00a127 thru 0x018150 (0xe02a bytes) 000413 1777576527.171283 read 0x00d64b thru 0x00fcd5 (0x268b bytes) 000414 1777576527.172577 trunc from 0x02e5a4 to 0x028441 (0x6162 bytes) 000415 1777576527.198568 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28442): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28442): Mirror 7: 0x585d13c5 (stale) Mirror 9: 0xc60f1e1b (stale) Mirror 10: 0xd84f22f (stale) CRC-32 checksum value for chunk [0, 0x28442): Mirror 1: 0xa24cc341 Mirror 11: 0xa24cc341 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28442: skipped 000416 1777576528.060749 trunc from 0x028442 to 0x01f4e7 (0x8f5a bytes) 000420 1777576528.202257 mapread 0x01d83f thru 0x01f4e7 (0x1ca9 bytes) 000422 1777576528.255987 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1f4e8): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f4e8): Mirror 7: 0x72a31904 (stale) Mirror 9: 0xb5bd1827 (stale) Mirror 10: 0xcc97751a (stale) Mirror 11: 0x3fb0cd88 (stale) CRC-32 checksum value for chunk [0, 0x1f4e8): Mirror 1: 0x3fb0cd88 Mirror 12: 0x3fb0cd88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f4e8: skipped 000423 1777576529.110067 mapwrite 0x03fbc1 thru 0x03ffff (0x43f bytes) 000425 1777576529.298128 trunc from 0x040000 to 0x03bf0a (0x40f5 bytes) 000426 1777576529.333114 read 0x034554 thru 0x03bf0a (0x79b7 bytes) 000428 1777576529.353577 trunc from 0x03bf0b to 0x01a590 (0x2197a bytes) 000429 1777576529.401754 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a591): Mirror 7: 0xa312b98a (stale) Mirror 9: 0x84510605 (stale) Mirror 10: 0xafcce112 (stale) Mirror 12: 0x1fa882ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a591): Mirror 7: 0xa312b98a (stale) Mirror 9: 0x84510605 (stale) Mirror 10: 0xafcce112 (stale) Mirror 12: 0x1fa882ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a591: skipped 000434 1777576529.851467 mapwrite 0x02bca3 thru 0x03553b (0x9899 bytes) 000438 1777576530.004158 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3553c): Mirror 9: 0xe0178b33 (stale) Mirror 10: 0x99f84d1d (stale) Mirror 12: 0x420212c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3553c): Mirror 9: 0xe0178b33 (stale) Mirror 10: 0x99f84d1d (stale) Mirror 12: 0x420212c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3553c: skipped 000439 1777576530.333572 mapwrite 0x0204e8 thru 0x029c6f (0x9788 bytes) 000440 1777576530.398233 write 0x01c39d thru 0x02858a (0xc1ee bytes) 000443 1777576530.404811 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3553c): Mirror 9: 0xe0178b33 (stale) Mirror 12: 0x420212c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3553c): Mirror 9: 0xe0178b33 (stale) Mirror 12: 0x420212c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3553c: skipped 000444 1777576530.791862 read 0x00cdbd thru 0x01cb19 (0xfd5d bytes) 000445 1777576530.804900 read 0x02f1da thru 0x034ee4 (0x5d0b bytes) 000447 1777576530.814689 trunc from 0x03553c to 0x01266c (0x22ecf bytes) 000450 1777576530.836409 write 0x00cb6f thru 0x00ccdd (0x16f bytes) 000451 1777576530.838840 write 0x01751d thru 0x020e99 (0x997d bytes) 000453 1777576530.847220 MIRROR_RESYNC 3 mirrors 000454 1777576531.814966 mapread 0x00c0f8 thru 0x01b9f1 (0xf8fa bytes) 000456 1777576531.854564 trunc from 0x020e9a to 0x028799 (0x7900 bytes) 000457 1777576531.950579 write 0x03e9c8 thru 0x03ffff (0x1638 bytes) 000459 1777576531.954225 write 0x033b31 thru 0x03ffff (0xc4cf bytes) 000461 1777576531.995806 MIRROR_RESYNC 3 mirrors 000465 1777576532.841939 mapwrite 0x0358b7 thru 0x03ffff (0xa749 bytes) 000466 1777576533.007278 mapread 0x007ccd thru 0x014404 (0xc738 bytes) 000468 1777576533.032722 mapwrite 0x0118af thru 0x0127e6 (0xf38 bytes) 000469 1777576533.076965 trunc from 0x040000 to 0x011348 (0x2ecb7 bytes) 000471 1777576533.097659 write 0x0100c6 thru 0x01e51c (0xe457 bytes) 000472 1777576533.105238 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e51d): Mirror 12: 0x7a2a42dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e51d): Mirror 12: 0x7a2a42dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e51d: skipped 000473 1777576533.440732 mapwrite 0x020796 thru 0x03051e (0xfd89 bytes) 000475 1777576533.560851 mapwrite 0x000b0e thru 0x00efae (0xe4a1 bytes) 000476 1777576533.628455 read 0x0064cd thru 0x009cc9 (0x37fd bytes) 000478 1777576533.629833 read 0x023ebc thru 0x024913 (0xa58 bytes) 000480 1777576533.632363 read 0x02a158 thru 0x03051e (0x63c7 bytes) 000482 1777576533.633701 mapread 0x01779b thru 0x01f4f2 (0x7d58 bytes) 000485 1777576533.652953 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000487 1777576533.773703 read 0x02a9a8 thru 0x03051e (0x5b77 bytes) 000490 1777576533.790694 read 0x019f59 thru 0x023f62 (0xa00a bytes) 000491 1777576533.802780 mapread 0x023829 thru 0x026301 (0x2ad9 bytes) 000495 1777576533.810207 mapwrite 0x01f88a thru 0x02b9dc (0xc153 bytes) 000501 1777576533.877702 trunc from 0x03051f to 0x0015fd (0x2ef21 bytes) 000502 1777576533.900269 trunc from 0x0015fe to 0x001cff (0x702 bytes) 000503 1777576533.918788 mapwrite 0x023529 thru 0x032b18 (0xf5f0 bytes) truncating to largest ever: 0x3f7e8 000504 1777576534.124965 trunc from 0x032b19 to 0x03f7e7 (0xcccf bytes) 000507 1777576534.165757 read 0x024de4 thru 0x02faa6 (0xacc3 bytes) 000508 1777576534.167707 mapread 0x000344 thru 0x0085fa (0x82b7 bytes) 000509 1777576534.183725 mapwrite 0x020557 thru 0x02b1d4 (0xac7e bytes) 000510 1777576534.261159 mapread 0x02f0da thru 0x0396ef (0xa616 bytes) 000513 1777576534.270554 mapwrite 0x031797 thru 0x03baab (0xa315 bytes) 000516 1777576534.397596 read 0x00e4cd thru 0x00fb13 (0x1647 bytes) 000517 1777576534.398478 mapread 0x029cdc thru 0x033363 (0x9688 bytes) 000518 1777576534.405858 write 0x02333e thru 0x027947 (0x460a bytes) 000520 1777576534.416172 trunc from 0x03f7e8 to 0x02f328 (0x104bf bytes) 000521 1777576534.448135 write 0x00f56a thru 0x017b66 (0x85fd bytes) 000523 1777576534.452633 read 0x008254 thru 0x00860c (0x3b9 bytes) 000524 1777576534.454504 read 0x0029a9 thru 0x0112ba (0xe912 bytes) 000528 1777576534.459708 mapread 0x01a371 thru 0x020a2a (0x66ba bytes) 000529 1777576534.462485 write 0x005cb6 thru 0x00cce4 (0x702f bytes) 000531 1777576534.465406 mapwrite 0x021d18 thru 0x029293 (0x757c bytes) 000533 1777576534.532544 trunc from 0x02f329 to 0x00f1a5 (0x20183 bytes) 000536 1777576534.552598 mapread 0x00cc7a thru 0x00f1a5 (0x252c bytes) 000537 1777576534.553770 write 0x020e16 thru 0x02fa36 (0xec21 bytes) 000539 1777576534.556992 read 0x01e6dc thru 0x02b745 (0xd06a bytes) 000542 1777576534.566610 read 0x0180b0 thru 0x0238f8 (0xb849 bytes) 000543 1777576534.568517 read 0x024a8d thru 0x02f67e (0xabf2 bytes) 000544 1777576534.569850 mapread 0x00db7c thru 0x01b226 (0xd6ab bytes) 000545 1777576534.573206 write 0x03df67 thru 0x03ffff (0x2099 bytes) 000548 1777576534.577147 write 0x01a33f thru 0x01c15a (0x1e1c bytes) 000550 1777576534.579418 mapread 0x03c245 thru 0x03ffff (0x3dbb bytes) 000551 1777576534.588806 read 0x03ea3a thru 0x03ffff (0x15c6 bytes) 000553 1777576534.599807 MIRROR_EXTEND to 2 mirrors 000554 1777576535.318374 read 0x03d8f6 thru 0x03ffff (0x270a bytes) 000555 1777576535.338900 mapread 0x028dc0 thru 0x02c00e (0x324f bytes) 000556 1777576535.392566 mapread 0x012743 thru 0x012744 (0x2 bytes) 000557 1777576535.440423 mapread 0x02e2a9 thru 0x039917 (0xb66f bytes) 000558 1777576535.460621 trunc from 0x040000 to 0x025303 (0x1acfc bytes) 000559 1777576535.586152 read 0x01f60b thru 0x025303 (0x5cf9 bytes) 000560 1777576535.601398 mapwrite 0x0386fd thru 0x03ffff (0x7903 bytes) 000562 1777576535.739180 read 0x001c2e thru 0x002f0f (0x12e2 bytes) 000564 1777576535.755499 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000566 1777576535.963133 write 0x0201a1 thru 0x020594 (0x3f4 bytes) 000568 1777576535.973154 read 0x020c1d thru 0x027a1f (0x6e03 bytes) 000571 1777576535.986906 write 0x02d97d thru 0x03caa2 (0xf126 bytes) 000579 1777576536.003315 mapread 0x0327dd thru 0x036631 (0x3e55 bytes) 000581 1777576536.005598 trunc from 0x040000 to 0x0204b7 (0x1fb48 bytes) 000584 1777576536.041338 read 0x010fca thru 0x011bff (0xc36 bytes) 000586 1777576536.061136 write 0x002ef6 thru 0x00a653 (0x775e bytes) 000589 1777576536.071007 write 0x002401 thru 0x00f599 (0xd199 bytes) 000592 1777576536.085963 mapread 0x007878 thru 0x010dc3 (0x954c bytes) 000596 1777576536.094004 mapwrite 0x030ae5 thru 0x03cac4 (0xbfe0 bytes) 000597 1777576536.244486 write 0x02c36a thru 0x03439e (0x8035 bytes) 000598 1777576536.248149 read 0x036446 thru 0x03cac4 (0x667f bytes) 000599 1777576536.249375 write 0x02e933 thru 0x03ad06 (0xc3d4 bytes) 000600 1777576536.251810 trunc from 0x03cac5 to 0x0263e8 (0x166dc bytes) 000601 1777576536.304885 write 0x02a52b thru 0x02ce83 (0x2959 bytes) 000602 1777576536.308487 trunc from 0x02ce84 to 0x0170e4 (0x15d9f bytes) 000603 1777576536.353685 write 0x03074c thru 0x030c39 (0x4ee bytes) 000605 1777576536.355249 read 0x01e32d thru 0x027055 (0x8d29 bytes) 000608 1777576536.396688 MIRROR_EXTEND to 2 mirrors 000609 1777576537.113496 MIRROR_EXTEND to 3 mirrors 000610 1777576537.885704 mapread 0x01d304 thru 0x027d16 (0xaa13 bytes) 000613 1777576537.914757 trunc from 0x030c3a to 0x0392a9 (0x8670 bytes) 000614 1777576538.030754 mapwrite 0x02208a thru 0x031bd9 (0xfb50 bytes) 000615 1777576538.100739 mapread 0x037373 thru 0x0392a9 (0x1f37 bytes) 000618 1777576538.126298 write 0x00ef6a thru 0x0168d4 (0x796b bytes) 000621 1777576538.143732 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x392aa): Mirror 3: 0x9604bf41 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392aa): Mirror 3: 0x9604bf41 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392aa: skipped 000623 1777576538.529727 mapwrite 0x013ab6 thru 0x017ddf (0x432a bytes) 000624 1777576538.657337 write 0x02229b thru 0x02857b (0x62e1 bytes) 000625 1777576538.705409 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x392aa): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392aa): Mirror 3: 0x9604bf41 (stale) CRC-32 checksum value for chunk [0, 0x392aa): Mirror 1: 0x93fba80c Mirror 4: 0x93fba80c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392aa: skipped 000626 1777576539.785640 write 0x028490 thru 0x029d05 (0x1876 bytes) 000627 1777576539.919598 trunc from 0x0392aa to 0x034999 (0x4910 bytes) 000628 1777576539.956378 write 0x035418 thru 0x03ffff (0xabe8 bytes) 000631 1777576539.960642 trunc from 0x040000 to 0x015405 (0x2abfa bytes) 000632 1777576539.999531 trunc from 0x015406 to 0x01146f (0x3f96 bytes) 000633 1777576540.023383 mapwrite 0x039a29 thru 0x03ffff (0x65d7 bytes) 000634 1777576540.134788 mapwrite 0x038e85 thru 0x03ffff (0x717b bytes) 000635 1777576540.192134 mapwrite 0x026826 thru 0x035b62 (0xf33d bytes) 000636 1777576540.300762 read 0x01e6a9 thru 0x01eec7 (0x81f bytes) 000637 1777576540.314228 mapwrite 0x01316d thru 0x01e053 (0xaee7 bytes) 000639 1777576540.419651 write 0x03698f thru 0x03ffff (0x9671 bytes) 000642 1777576540.423767 write 0x03c25b thru 0x03ffff (0x3da5 bytes) 000643 1777576540.425183 trunc from 0x040000 to 0x00aa6d (0x35592 bytes) 000646 1777576540.453796 trunc from 0x00aa6e to 0x03093a (0x25ecd bytes) 000647 1777576540.473292 write 0x03552d thru 0x03ffff (0xaad3 bytes) 000650 1777576540.476618 trunc from 0x040000 to 0x002c9b (0x3d364 bytes) 000651 1777576540.499922 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2c9c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c9c): Mirror 3: 0xc364a04 (stale) Mirror 4: 0xc364a04 (stale) CRC-32 checksum value for chunk [0, 0x2c9c): Mirror 1: 0xc364a04 Mirror 5: 0xc364a04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c9c: skipped 000655 1777576541.370168 trunc from 0x002c9c to 0x000ad9 (0x21c2 bytes) 000657 1777576541.544241 trunc from 0x000ada to 0x01e670 (0x1db97 bytes) 000658 1777576541.581742 write 0x03b19e thru 0x03ffff (0x4e62 bytes) 000659 1777576541.585303 write 0x00ccf6 thru 0x00f8d3 (0x2bde bytes) 000661 1777576541.608627 mapwrite 0x03201c thru 0x03243e (0x423 bytes) 000662 1777576541.702635 trunc from 0x040000 to 0x02c1ac (0x13e53 bytes) 000664 1777576541.729742 write 0x00ed8e thru 0x01d70b (0xe97e bytes) 000665 1777576541.739192 mapwrite 0x02d0e0 thru 0x030995 (0x38b6 bytes) 000666 1777576541.824484 mapwrite 0x015d82 thru 0x01e708 (0x8987 bytes) 000668 1777576541.909316 read 0x01a7fd thru 0x021058 (0x685c bytes) 000670 1777576541.914267 read 0x00acb4 thru 0x00e5f4 (0x3941 bytes) 000673 1777576541.936825 mapwrite 0x010e40 thru 0x01895d (0x7b1e bytes) 000675 1777576541.990944 MIRROR_RESYNC 4 mirrors 000676 1777576542.914995 trunc from 0x030996 to 0x023872 (0xd123 bytes) 000678 1777576543.005859 write 0x02ccf5 thru 0x036793 (0x9a9f bytes) 000680 1777576543.013932 read 0x02075d thru 0x0274fa (0x6d9e bytes) 000681 1777576543.024946 mapread 0x01c42e thru 0x022c04 (0x67d7 bytes) 000683 1777576543.048313 read 0x034974 thru 0x036793 (0x1e20 bytes) 000684 1777576543.049575 write 0x031fa3 thru 0x03f0e8 (0xd146 bytes) 000687 1777576543.055835 write 0x00144b thru 0x00c939 (0xb4ef bytes) 000689 1777576543.073945 read 0x010a89 thru 0x01fb88 (0xf100 bytes) 000691 1777576543.077255 mapread 0x03bce6 thru 0x03f0e8 (0x3403 bytes) 000692 1777576543.079512 trunc from 0x03f0e9 to 0x019f51 (0x25197 bytes) 000695 1777576543.112736 mapread 0x00b1a8 thru 0x013f68 (0x8dc1 bytes) 000699 1777576543.116461 write 0x036944 thru 0x03ffff (0x96bc bytes) 000700 1777576543.122071 write 0x036479 thru 0x039464 (0x2fec bytes) 000702 1777576543.131589 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x48435079 (stale) Mirror 4: 0x48435079 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x48435079 (stale) Mirror 4: 0x48435079 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000703 1777576543.517853 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x48435079 (stale) Mirror 4: 0x48435079 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7f47917 Mirror 5: 0x7f47917 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000704 1777576544.299983 mapread 0x026342 thru 0x02d674 (0x7333 bytes) 000705 1777576544.336409 MIRROR_RESYNC 4 mirrors 000707 1777576545.049114 write 0x019c66 thru 0x0233eb (0x9786 bytes) 000708 1777576545.183935 mapwrite 0x0062cb thru 0x00dd1c (0x7a52 bytes) 000710 1777576545.318580 mapwrite 0x00aa5b thru 0x0184d7 (0xda7d bytes) 000711 1777576545.439169 mapread 0x023092 thru 0x024a8a (0x19f9 bytes) 000713 1777576545.473563 trunc from 0x040000 to 0x004259 (0x3bda6 bytes) 000714 1777576545.531369 mapwrite 0x03dc46 thru 0x03ffff (0x23ba bytes) 000715 1777576545.625689 mapread 0x00b53f thru 0x014947 (0x9409 bytes) 000716 1777576545.663236 mapread 0x014249 thru 0x014776 (0x52e bytes) 000717 1777576545.664333 write 0x0041aa thru 0x00fcf3 (0xbb4a bytes) 000719 1777576545.671120 mapwrite 0x006987 thru 0x00e193 (0x780d bytes) 000720 1777576545.775777 mapwrite 0x020454 thru 0x027736 (0x72e3 bytes) 000722 1777576545.899596 read 0x020864 thru 0x02a22d (0x99ca bytes) 000723 1777576545.910190 read 0x001b5a thru 0x0079ca (0x5e71 bytes) 000724 1777576545.912221 read 0x0306b4 thru 0x030c04 (0x551 bytes) 000726 1777576545.933170 mapread 0x004b82 thru 0x00807e (0x34fd bytes) 000727 1777576545.934205 read 0x02d6cb thru 0x037aba (0xa3f0 bytes) 000728 1777576545.936314 mapread 0x00063d thru 0x0011af (0xb73 bytes) 000732 1777576545.945215 write 0x0144e9 thru 0x022bb1 (0xe6c9 bytes) 000734 1777576545.950937 mapread 0x03dc25 thru 0x03ec33 (0x100f bytes) 000736 1777576545.967552 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7f47917 (stale) Mirror 4: 0x7f47917 (stale) Mirror 5: 0x7f47917 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1397f0f Mirror 6: 0x1397f0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000737 1777576546.892918 mapread 0x03f626 thru 0x03ffff (0x9da bytes) 000738 1777576546.924692 MIRROR_RESYNC 5 mirrors 000739 1777576547.847591 trunc from 0x040000 to 0x01840d (0x27bf2 bytes) 000741 1777576547.948497 write 0x02341b thru 0x024fc6 (0x1bac bytes) 000742 1777576547.949639 read 0x01860e thru 0x0194e2 (0xed5 bytes) 000744 1777576547.956690 write 0x01a6b1 thru 0x02a14a (0xfa9a bytes) 000745 1777576547.965143 mapread 0x00ab01 thru 0x00cf04 (0x2404 bytes) 000746 1777576547.981358 trunc from 0x02a14b to 0x005094 (0x250b6 bytes) 000747 1777576548.006424 trunc from 0x005095 to 0x0232de (0x1e24a bytes) 000748 1777576548.025137 mapread 0x017034 thru 0x01fd0a (0x8cd7 bytes) 000749 1777576548.036504 mapread 0x0185c7 thru 0x02114d (0x8b87 bytes) 000750 1777576548.043804 mapwrite 0x035723 thru 0x0380cb (0x29a9 bytes) 000751 1777576548.112552 mapwrite 0x02a8e8 thru 0x032f3d (0x8656 bytes) 000753 1777576548.177566 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x380cc): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x380cc): Mirror 3: 0xc82cfd49 (stale) Mirror 4: 0xc82cfd49 (stale) Mirror 5: 0xc82cfd49 (stale) Mirror 6: 0xc82cfd49 (stale) CRC-32 checksum value for chunk [0, 0x380cc): Mirror 1: 0x53375fd3 Mirror 7: 0x53375fd3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x380cc: skipped 000755 1777576549.063537 trunc from 0x0380cc to 0x01756f (0x20b5c bytes) 000757 1777576549.216697 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x17570): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17570): Mirror 3: 0x769b22df (stale) Mirror 4: 0x769b22df (stale) Mirror 5: 0x769b22df (stale) Mirror 6: 0x769b22df (stale) Mirror 7: 0xa47414dc (stale) CRC-32 checksum value for chunk [0, 0x17570): Mirror 1: 0xa47414dc Mirror 8: 0xa47414dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17570: skipped 000761 1777576550.198193 read 0x01520e thru 0x01752c (0x231f bytes) 000762 1777576550.207577 trunc from 0x017570 to 0x01c0a9 (0x4b3a bytes) 000763 1777576550.325542 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c0aa): Mirror 3: 0x6a2dc17b (stale) Mirror 4: 0x6a2dc17b (stale) Mirror 5: 0x6a2dc17b (stale) Mirror 6: 0x6a2dc17b (stale) Mirror 8: 0x96691846 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c0aa): Mirror 3: 0x6a2dc17b (stale) Mirror 4: 0x6a2dc17b (stale) Mirror 5: 0x6a2dc17b (stale) Mirror 6: 0x6a2dc17b (stale) Mirror 8: 0x96691846 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c0aa: skipped 000764 1777576550.797142 write 0x00a3e5 thru 0x017c57 (0xd873 bytes) 000767 1777576550.820534 read 0x005778 thru 0x007ec7 (0x2750 bytes) 000768 1777576550.842233 mapwrite 0x0231d1 thru 0x02395d (0x78d bytes) 000770 1777576550.996762 MIRROR_RESYNC 6 mirrors 000771 1777576552.103652 write 0x011908 thru 0x0203cd (0xeac6 bytes) 000774 1777576552.193221 trunc from 0x02395e to 0x01944a (0xa513 bytes) 000775 1777576552.232354 read 0x01307b thru 0x01944a (0x63d0 bytes) 000776 1777576552.233801 trunc from 0x01944b to 0x025440 (0xbff6 bytes) 000782 1777576552.270508 read 0x01d451 thru 0x0206b8 (0x3268 bytes) 000783 1777576552.284602 mapread 0x014dd8 thru 0x015780 (0x9a9 bytes) 000784 1777576552.285680 write 0x017951 thru 0x01e79a (0x6e4a bytes) 000786 1777576552.294610 MIRROR_RESYNC 6 mirrors 000787 1777576553.552097 read 0x014f99 thru 0x02482b (0xf893 bytes) 000788 1777576553.565480 write 0x008f57 thru 0x00a645 (0x16ef bytes) 000793 1777576553.646317 mapread 0x01154e thru 0x0153fb (0x3eae bytes) 000794 1777576553.657051 trunc from 0x025441 to 0x01b2fe (0xa142 bytes) 000795 1777576553.682575 write 0x00c30c thru 0x00ea85 (0x277a bytes) 000797 1777576553.685790 mapread 0x002a10 thru 0x004dc8 (0x23b9 bytes) 000799 1777576553.699380 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1b2ff): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b2ff): Mirror 3: 0xc46df52 (stale) Mirror 4: 0xc46df52 (stale) Mirror 5: 0xc46df52 (stale) Mirror 6: 0xc46df52 (stale) Mirror 8: 0xc46df52 (stale) CRC-32 checksum value for chunk [0, 0x1b2ff): Mirror 1: 0x96159dbc Mirror 9: 0x96159dbc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b2ff: skipped 000801 1777576554.701833 mapread 0x011698 thru 0x014e6c (0x37d5 bytes) 000803 1777576554.771036 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b2ff): Mirror 3: 0xc46df52 (stale) Mirror 4: 0xc46df52 (stale) Mirror 5: 0xc46df52 (stale) Mirror 6: 0xc46df52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b2ff): Mirror 3: 0xc46df52 (stale) Mirror 4: 0xc46df52 (stale) Mirror 5: 0xc46df52 (stale) Mirror 6: 0xc46df52 (stale) CRC-32 checksum value for chunk [0, 0x1b2ff): Mirror 1: 0x96159dbc Mirror 9: 0x96159dbc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b2ff: skipped 000804 1777576555.472557 write 0x02c6fc thru 0x031fd5 (0x58da bytes) 000805 1777576555.632354 mapread 0x0173b2 thru 0x022f71 (0xbbc0 bytes) 000807 1777576555.683706 read 0x014ec4 thru 0x0219a7 (0xcae4 bytes) 000811 1777576555.688543 trunc from 0x031fd6 to 0x011bb8 (0x2041d bytes) 000814 1777576555.724940 trunc from 0x011bb9 to 0x006f54 (0xac64 bytes) 000816 1777576555.754041 mapwrite 0x037602 thru 0x03ffff (0x89fe bytes) 000819 1777576555.840784 mapread 0x02b488 thru 0x02fb52 (0x46cb bytes) 000820 1777576555.852508 write 0x03fafe thru 0x03ffff (0x502 bytes) 000821 1777576555.857739 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf2c4b2 (stale) Mirror 5: 0xf2c4b2 (stale) Mirror 6: 0xf2c4b2 (stale) Mirror 9: 0xe691650a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf2c4b2 (stale) Mirror 5: 0xf2c4b2 (stale) Mirror 6: 0xf2c4b2 (stale) Mirror 9: 0xe691650a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000822 1777576556.411125 mapread 0x009927 thru 0x018615 (0xecef bytes) 000824 1777576556.475464 write 0x00b2d5 thru 0x01945a (0xe186 bytes) 000825 1777576556.480178 mapwrite 0x02cb7c thru 0x030648 (0x3acd bytes) 000830 1777576556.632717 read 0x03d786 thru 0x03ffff (0x287a bytes) 000831 1777576556.641013 trunc from 0x040000 to 0x01652e (0x29ad1 bytes) 000832 1777576556.672880 write 0x02c11f thru 0x02c270 (0x152 bytes) 000836 1777576556.678036 mapwrite 0x01d735 thru 0x02b668 (0xdf34 bytes) 000837 1777576556.763034 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c271): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c271): Mirror 4: 0xa576e409 (stale) Mirror 5: 0xa576e409 (stale) Mirror 6: 0xa576e409 (stale) Mirror 9: 0x92dd7a85 (stale) CRC-32 checksum value for chunk [0, 0x2c271): Mirror 1: 0x4272782f Mirror 10: 0x4272782f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c271: skipped 000838 1777576557.888627 MIRROR_RESYNC 6 mirrors 000841 1777576559.297869 read 0x0151b2 thru 0x018b3f (0x398e bytes) 000842 1777576559.303475 write 0x016552 thru 0x01ae38 (0x48e7 bytes) 000846 1777576559.481407 mapwrite 0x02e054 thru 0x0369bf (0x896c bytes) 000847 1777576559.661099 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x369c0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x369c0): Mirror 4: 0xff0e1de0 (stale) Mirror 5: 0xff0e1de0 (stale) Mirror 6: 0xff0e1de0 (stale) Mirror 9: 0xff0e1de0 (stale) Mirror 10: 0xff0e1de0 (stale) CRC-32 checksum value for chunk [0, 0x369c0): Mirror 1: 0x49d07502 Mirror 11: 0x49d07502 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x369c0: skipped 000849 1777576560.941687 write 0x004e8e thru 0x006655 (0x17c8 bytes) 000850 1777576561.103220 trunc from 0x0369c0 to 0x023a1d (0x12fa2 bytes) 000851 1777576561.151338 trunc from 0x023a1e to 0x039270 (0x15853 bytes) 000853 1777576561.168976 read 0x03842f thru 0x039270 (0xe42 bytes) 000854 1777576561.176090 mapwrite 0x019bf8 thru 0x01b752 (0x1b5b bytes) 000857 1777576561.282172 trunc from 0x039271 to 0x017e75 (0x213fb bytes) 000859 1777576561.308049 write 0x02d6d7 thru 0x03852c (0xae56 bytes) 000860 1777576561.312192 read 0x018cc8 thru 0x0272c1 (0xe5fa bytes) 000861 1777576561.326231 read 0x00af56 thru 0x00cc01 (0x1cac bytes) 000863 1777576561.335215 MIRROR_RESYNC 7 mirrors 000864 1777576563.179516 write 0x01735a thru 0x0209ee (0x9695 bytes) 000865 1777576563.273856 mapwrite 0x03b36c thru 0x03dc16 (0x28ab bytes) 000866 1777576563.360910 write 0x01e8c2 thru 0x022a00 (0x413f bytes) 000869 1777576563.370155 mapwrite 0x01326f thru 0x01a46b (0x71fd bytes) 000871 1777576563.488970 MIRROR_RESYNC 7 mirrors 000874 1777576564.973386 write 0x02317f thru 0x02d55e (0xa3e0 bytes) 000876 1777576565.116908 mapread 0x023372 thru 0x02d0b5 (0x9d44 bytes) 000878 1777576565.119492 mapread 0x02bf68 thru 0x03b748 (0xf7e1 bytes) 000879 1777576565.142291 mapwrite 0x021f52 thru 0x03128a (0xf339 bytes) 000880 1777576565.238817 write 0x0130b7 thru 0x021d2c (0xec76 bytes) 000881 1777576565.253263 mapread 0x023bfd thru 0x0304b8 (0xc8bc bytes) 000884 1777576565.258131 write 0x03e588 thru 0x03ffff (0x1a78 bytes) 000885 1777576565.259627 write 0x030b12 thru 0x03b55e (0xaa4d bytes) 000886 1777576565.262946 mapread 0x004fef thru 0x0083bf (0x33d1 bytes) 000888 1777576565.278280 write 0x000b50 thru 0x00897d (0x7e2e bytes) 000889 1777576565.284708 write 0x0269d6 thru 0x027593 (0xbbe bytes) 000891 1777576565.286259 trunc from 0x040000 to 0x025ee6 (0x1a119 bytes) 000894 1777576565.321993 trunc from 0x025ee7 to 0x02406d (0x1e79 bytes) 000896 1777576565.350322 mapwrite 0x0125cf thru 0x01871c (0x614e bytes) 000898 1777576565.452643 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2406e): Mirror 5: 0xecfc5a74 (stale) Mirror 6: 0xecfc5a74 (stale) Mirror 9: 0xecfc5a74 (stale) Mirror 10: 0xecfc5a74 (stale) Mirror 11: 0xecfc5a74 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2406e): Mirror 5: 0xecfc5a74 (stale) Mirror 6: 0xecfc5a74 (stale) Mirror 9: 0xecfc5a74 (stale) Mirror 10: 0xecfc5a74 (stale) Mirror 11: 0xecfc5a74 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2406e: skipped 000899 1777576566.189951 mapread 0x017a83 thru 0x0216ec (0x9c6a bytes) 000901 1777576566.220254 read 0x00f399 thru 0x0194f1 (0xa159 bytes) 000902 1777576566.229604 trunc from 0x02406e to 0x03c7f2 (0x18785 bytes) 000903 1777576566.262026 trunc from 0x03c7f3 to 0x028722 (0x140d0 bytes) 000907 1777576566.283209 mapwrite 0x035ea2 thru 0x03ffff (0xa15e bytes) 000912 1777576566.372749 write 0x020220 thru 0x027ec0 (0x7ca1 bytes) 000913 1777576566.378239 write 0x020f03 thru 0x021f1c (0x101a bytes) 000917 1777576566.382227 mapread 0x015a7d thru 0x01980d (0x3d91 bytes) 000919 1777576566.385130 mapread 0x012db8 thru 0x01fb1b (0xcd64 bytes) 000920 1777576566.393273 MIRROR_RESYNC 6 mirrors 000922 1777576567.816198 trunc from 0x040000 to 0x00ee7c (0x31183 bytes) 000923 1777576567.907601 write 0x00ca49 thru 0x0154c7 (0x8a7f bytes) 000924 1777576567.915051 trunc from 0x0154c8 to 0x02ecfd (0x19836 bytes) 000926 1777576567.951286 MIRROR_RESYNC 6 mirrors 000927 1777576569.220734 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000928 1777576569.801145 mapread 0x004a73 thru 0x00f17b (0xa709 bytes) 000930 1777576569.862106 read 0x00a5f8 thru 0x011512 (0x6f1b bytes) 000932 1777576569.876020 read 0x02877f thru 0x02ecfd (0x657f bytes) 000935 1777576569.896887 trunc from 0x02ecfe to 0x012361 (0x1c99c bytes) 000938 1777576569.977471 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x12362): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12362): Mirror 5: 0x7016e302 (stale) Mirror 6: 0x7016e302 (stale) Mirror 10: 0x7016e302 (stale) Mirror 11: 0x7016e302 (stale) CRC-32 checksum value for chunk [0, 0x12362): Mirror 1: 0x7016e302 Mirror 12: 0x7016e302 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12362: skipped 000940 1777576571.083870 write 0x02dcb0 thru 0x033914 (0x5c65 bytes) 000941 1777576571.197553 trunc from 0x033915 to 0x03939c (0x5a88 bytes) 000942 1777576571.275093 trunc from 0x03939d to 0x0254e0 (0x13ebc bytes) 000944 1777576571.339701 mapwrite 0x03d003 thru 0x03ffff (0x2ffd bytes) 000946 1777576571.467171 write 0x01f61e thru 0x027492 (0x7e75 bytes) 000948 1777576571.481170 read 0x03e096 thru 0x03ffff (0x1f6a bytes) 000949 1777576571.487391 MIRROR_RESYNC 6 mirrors 000951 1777576572.778253 read 0x023056 thru 0x027d96 (0x4d41 bytes) 000952 1777576572.790946 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000953 1777576573.164010 MIRROR_RESYNC 5 mirrors 000954 1777576573.660800 read 0x002dc1 thru 0x00b88f (0x8acf bytes) 000955 1777576573.669173 mapwrite 0x03559b thru 0x03ffff (0xaa65 bytes) 000959 1777576573.853116 mapwrite 0x0063db thru 0x00e66b (0x8291 bytes) 000965 1777576573.924075 read 0x011ab0 thru 0x01914e (0x769f bytes) 000966 1777576573.934897 mapwrite 0x013d21 thru 0x015c0c (0x1eec bytes) 000968 1777576574.000274 mapread 0x006797 thru 0x01092c (0xa196 bytes) 000970 1777576574.009118 trunc from 0x040000 to 0x0126ac (0x2d953 bytes) 000976 1777576574.064703 read 0x008bf9 thru 0x0126ac (0x9ab4 bytes) 000978 1777576574.066161 mapread 0x0037c3 thru 0x00c5ed (0x8e2b bytes) 000979 1777576574.071266 write 0x015971 thru 0x01ec72 (0x9302 bytes) 000980 1777576574.077046 trunc from 0x01ec73 to 0x02a0b8 (0xb446 bytes) 000985 1777576574.107869 trunc from 0x02a0b9 to 0x0152d5 (0x14de3 bytes) 000986 1777576574.133471 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x152d6): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x152d6): Mirror 5: 0xa933e82e (stale) Mirror 6: 0xa933e82e (stale) Mirror 10: 0xa933e82e (stale) Mirror 11: 0xa933e82e (stale) CRC-32 checksum value for chunk [0, 0x152d6): Mirror 1: 0x1cdc5b52 Mirror 12: 0x1cdc5b52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x152d6: skipped 000987 1777576574.936827 read 0x002296 thru 0x010743 (0xe4ae bytes) 000988 1777576574.963964 MIRROR_RESYNC 6 mirrors 000989 1777576575.891019 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000990 1777576576.331361 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000993 1777576576.671756 mapread 0x005047 thru 0x014c85 (0xfc3f bytes) 000995 1777576576.721173 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19e:0x0]: Invalid argument (22) 000996 1777576577.105251 MIRROR_RESYNC 3 mirrors 000997 1777576577.569067 write 0x011703 thru 0x01edd2 (0xd6d0 bytes) 000998 1777576577.704567 write 0x02d0a3 thru 0x03a3c1 (0xd31f bytes) 000999 1777576577.706314 read 0x0120dd thru 0x0205d7 (0xe4fb bytes) 001000 1777576577.712470 read 0x01ecaf thru 0x024210 (0x5562 bytes) All operations completed A-OK!