== sanity-flr test 70a: flr mode fsx test ================ 01:43:07 (1790919787) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 9789 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x2e6c7 000002 1790919790.104842 trunc from 00000000 to 0x02e6c6 (0x2e6c7 bytes) 000003 1790919790.126317 write 0x032856 thru 0x03c431 (0x9bdc bytes) 000004 1790919790.131576 mapread 0x00aeeb thru 0x015673 (0xa789 bytes) 000005 1790919790.175758 trunc from 0x03c432 to 0x0166c4 (0x25d6d bytes) 000007 1790919790.198890 mapread 0x00f34c thru 0x0166c4 (0x7379 bytes) 000009 1790919790.202252 mapwrite 0x025b44 thru 0x029682 (0x3b3f bytes) 000013 1790919790.327850 read 0x021f4f thru 0x029682 (0x7734 bytes) 000014 1790919790.329643 trunc from 0x029683 to 0x02267a (0x7008 bytes) 000016 1790919790.371444 read 0x003920 thru 0x010d3e (0xd41f bytes) 000018 1790919790.390259 punch from 0x00cd78 to 0x01642b (0x96b4 bytes) 000019 1790919790.395650 mapread 0x00f8db thru 0x01d191 (0xd8b7 bytes) truncating to largest ever: 0x3cfca 000021 1790919790.447938 trunc from 0x02267b to 0x03cfc9 (0x1a94f bytes) 000022 1790919790.470830 trunc from 0x03cfca to 0x037b6a (0x545f bytes) 000024 1790919790.488659 mapread 0x00d70f thru 0x018a8a (0xb37c bytes) 000031 1790919790.509638 write 0x01aca9 thru 0x022fa2 (0x82fa bytes) 000034 1790919790.514173 trunc from 0x037b6b to 0x020d8b (0x16ddf bytes) 000039 1790919790.533253 write 0x0018b6 thru 0x00f4cc (0xdc17 bytes) 000040 1790919790.536412 write 0x0356e1 thru 0x03fd83 (0xa6a3 bytes) 000041 1790919790.538638 trunc from 0x03fd84 to 0x001165 (0x3ec1e bytes) 000044 1790919790.565613 punch from 0x001030 to 0x001165 (0x136 bytes) 000045 1790919790.579163 MIRROR_EXTEND to 2 mirrors 000046 1790919791.367670 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000047 1790919791.556647 punch from 0x000fe8 to 0x001165 (0x17e bytes) 000048 1790919791.587073 punch from 0x00005a to 0x001165 (0x110c bytes) 000049 1790919791.596007 mapwrite 0x011192 thru 0x016957 (0x57c6 bytes) 000050 1790919791.770316 punch from 0x01233a to 0x016957 (0x461e bytes) 000052 1790919791.781381 read 0x015c61 thru 0x016957 (0xcf7 bytes) 000053 1790919791.805893 MIRROR_EXTEND to 2 mirrors 000056 1790919792.902280 punch from 0x003eb6 to 0x00dced (0x9e38 bytes) 000058 1790919792.982249 write 0x01d614 thru 0x02ba71 (0xe45e bytes) 000059 1790919792.989149 MIRROR_RESYNC 2 mirrors 000060 1790919793.936847 trunc from 0x02ba72 to 0x00bc56 (0x1fe1b bytes) 000062 1790919794.012208 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xbc57): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbc57): Mirror 2: 0xb2764194 (stale) CRC-32 checksum value for chunk [0, 0xbc57): Mirror 1: 0xb2764194 Mirror 3: 0xb2764194 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbc57: skipped 000063 1790919795.121115 read 0x00ba49 thru 0x00bc56 (0x20e bytes) 000064 1790919795.141197 read 0x002fb2 thru 0x00bc56 (0x8ca5 bytes) 000065 1790919795.165365 punch from 0x0040e7 to 0x00823a (0x4154 bytes) 000066 1790919795.298955 MIRROR_RESYNC 3 mirrors 000067 1790919796.251230 mapwrite 0x0383f7 thru 0x038bbe (0x7c8 bytes) 000068 1790919796.457982 mapread 0x00635c thru 0x00f2a4 (0x8f49 bytes) 000069 1790919796.485238 mapwrite 0x03c55e thru 0x03f7a7 (0x324a bytes) 000070 1790919796.577876 trunc from 0x03f7a8 to 0x005e6c (0x3993b bytes) 000071 1790919796.597132 mapwrite 0x01a7c5 thru 0x024221 (0x9a5d bytes) 000072 1790919796.723541 mapwrite 0x0341f9 thru 0x03ffff (0xbe07 bytes) 000073 1790919796.862598 mapread 0x02e3c1 thru 0x033c27 (0x5867 bytes) 000074 1790919796.866152 mapread 0x02b927 thru 0x02b92b (0x5 bytes) 000075 1790919796.892340 mapread 0x0279ec thru 0x03319a (0xb7af bytes) 000076 1790919796.893403 mapread 0x01f602 thru 0x02bdbf (0xc7be bytes) 000077 1790919796.899932 mapwrite 0x00ce05 thru 0x012f1f (0x611b bytes) 000078 1790919796.978950 trunc from 0x040000 to 0x013d75 (0x2c28a bytes) 000079 1790919797.003285 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13d76): Mirror 3: 0x24ae73aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13d76): Mirror 3: 0x24ae73aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13d76: skipped 000080 1790919797.342755 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000081 1790919797.492509 read 0x00ac66 thru 0x012648 (0x79e3 bytes) 000082 1790919797.522461 punch from 0x00220c to 0x00bc58 (0x9a4d bytes) 000086 1790919797.529408 punch from 0x00dddb to 0x013d75 (0x5f9b bytes) 000087 1790919797.534963 mapwrite 0x0237da thru 0x02d2c2 (0x9ae9 bytes) 000088 1790919797.629545 mapread 0x02102e thru 0x02b009 (0x9fdc bytes) 000089 1790919797.631140 punch from 0x02003c to 0x027ee6 (0x7eab bytes) 000091 1790919797.645587 read 0x001096 thru 0x006eec (0x5e57 bytes) 000092 1790919797.658405 trunc from 0x02d2c3 to 0x02fecd (0x2c0b bytes) 000094 1790919797.673973 trunc from 0x02fece to 0x0040bb (0x2be12 bytes) 000095 1790919797.695819 write 0x027a0c thru 0x0284c3 (0xab8 bytes) 000096 1790919797.697547 trunc from 0x0284c4 to 0x019c23 (0xe8a0 bytes) 000098 1790919797.725006 read 0x01668e thru 0x019c23 (0x3596 bytes) 000099 1790919797.740339 read 0x018457 thru 0x018f29 (0xad3 bytes) 000100 1790919797.742168 mapwrite 0x01fbf7 thru 0x02579b (0x5ba5 bytes) 000101 1790919797.908758 punch from 0x00fe4d to 0x01f954 (0xfb08 bytes) 000102 1790919797.918561 punch from 0x01aba0 to 0x02579b (0xabfc bytes) 000103 1790919797.929597 MIRROR_EXTEND to 2 mirrors 000104 1790919798.958591 write 0x03a0c7 thru 0x03ffff (0x5f39 bytes) 000105 1790919799.068897 read 0x009f5c thru 0x01672a (0xc7cf bytes) 000106 1790919799.082304 read 0x03257f thru 0x03c0ac (0x9b2e bytes) 000107 1790919799.096157 trunc from 0x040000 to 0x0060ee (0x39f11 bytes) 000108 1790919799.124192 mapwrite 0x03679b thru 0x03bf70 (0x57d6 bytes) 000109 1790919799.230198 punch from 0x01c080 to 0x027b60 (0xbae1 bytes) 000111 1790919799.242544 mapwrite 0x03f9d4 thru 0x03ffff (0x62c bytes) 000113 1790919799.315944 MIRROR_RESYNC 2 mirrors 000114 1790919800.423198 punch from 0x00a536 to 0x0124f4 (0x7fbf bytes) 000115 1790919800.499799 write 0x027ac3 thru 0x02b037 (0x3575 bytes) 000116 1790919800.511436 mapwrite 0x022e2e thru 0x029a10 (0x6be3 bytes) 000117 1790919800.598678 write 0x029907 thru 0x02ccd8 (0x33d2 bytes) 000118 1790919800.601426 mapwrite 0x029723 thru 0x02e0f3 (0x49d1 bytes) 000120 1790919800.702210 punch from 0x021021 to 0x02528c (0x426c bytes) 000121 1790919800.708381 punch from 0x00833d to 0x011830 (0x94f4 bytes) 000122 1790919800.713759 mapwrite 0x02874b thru 0x0331f7 (0xaaad bytes) 000123 1790919800.781099 trunc from 0x040000 to 0x0253d5 (0x1ac2a bytes) 000124 1790919800.807228 mapwrite 0x006ca9 thru 0x00e78e (0x7ae6 bytes) 000125 1790919800.883057 mapread 0x0068d8 thru 0x009a5a (0x3183 bytes) 000126 1790919800.886261 write 0x0047f0 thru 0x00db25 (0x9336 bytes) 000127 1790919800.888214 mapread 0x005277 thru 0x0091dc (0x3f66 bytes) 000128 1790919800.891218 write 0x024b30 thru 0x02f9d6 (0xaea7 bytes) 000129 1790919800.903672 read 0x0212fe thru 0x025958 (0x465b bytes) 000130 1790919800.913108 write 0x00d490 thru 0x00f094 (0x1c05 bytes) 000131 1790919800.914286 mapread 0x012d7c thru 0x022c09 (0xfe8e bytes) 000132 1790919800.938959 read 0x023dbf thru 0x02b79d (0x79df bytes) 000134 1790919800.940654 mapwrite 0x03d237 thru 0x03ffff (0x2dc9 bytes) 000138 1790919801.043776 mapwrite 0x01b9c9 thru 0x020ba6 (0x51de bytes) 000139 1790919801.105895 punch from 0x00ca18 to 0x014a4a (0x8033 bytes) 000141 1790919801.117409 mapread 0x00696a thru 0x0096c7 (0x2d5e bytes) 000143 1790919801.122490 punch from 0x01ec99 to 0x028e12 (0xa17a bytes) 000145 1790919801.129829 read 0x014223 thru 0x023b16 (0xf8f4 bytes) 000146 1790919801.156350 MIRROR_RESYNC 2 mirrors 000147 1790919802.191216 trunc from 0x040000 to 0x001d51 (0x3e2ae bytes) 000148 1790919802.291917 trunc from 0x001d52 to 0x01dc55 (0x1bf04 bytes) 000149 1790919802.314890 mapread 0x000889 thru 0x003c4f (0x33c7 bytes) 000152 1790919802.343321 punch from 0x016f70 to 0x01756b (0x5fc bytes) 000153 1790919802.347651 mapwrite 0x007886 thru 0x00eb53 (0x72ce bytes) 000155 1790919802.400195 write 0x016a12 thru 0x01885f (0x1e4e bytes) 000157 1790919802.410509 punch from 0x006ced to 0x00c259 (0x556d bytes) 000159 1790919802.422396 mapread 0x015418 thru 0x01991f (0x4508 bytes) 000160 1790919802.431384 mapwrite 0x005d77 thru 0x0147a4 (0xea2e bytes) 000161 1790919802.494196 mapwrite 0x009d69 thru 0x011bb3 (0x7e4b bytes) 000162 1790919802.550479 punch from 0x0009a6 to 0x00853e (0x7b99 bytes) 000163 1790919802.559231 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000165 1790919802.787680 write 0x0178a4 thru 0x01b55a (0x3cb7 bytes) 000168 1790919802.811636 punch from 0x01162d to 0x011916 (0x2ea bytes) 000169 1790919802.825999 punch from 0x009b7b to 0x00d008 (0x348e bytes) 000172 1790919802.839976 mapread 0x002d32 thru 0x00f2df (0xc5ae bytes) 000173 1790919802.861071 mapread 0x003708 thru 0x008d73 (0x566c bytes) 000174 1790919802.862201 trunc from 0x01dc56 to 0x02c072 (0xe41d bytes) 000175 1790919802.881171 write 0x02a275 thru 0x02c947 (0x26d3 bytes) 000180 1790919802.894851 punch from 0x029d7f to 0x02c947 (0x2bc9 bytes) 000182 1790919802.903646 mapread 0x01a50f thru 0x0294c6 (0xefb8 bytes) 000183 1790919802.921443 mapread 0x00a4c2 thru 0x016f9e (0xcadd bytes) 000184 1790919802.932515 trunc from 0x02c948 to 0x01b599 (0x113ae bytes) 000185 1790919802.951485 read 0x00c135 thru 0x00ee87 (0x2d53 bytes) 000186 1790919802.952623 trunc from 0x01b59a to 0x00de0e (0xd78b bytes) 000187 1790919802.969597 write 0x008e49 thru 0x012d89 (0x9f41 bytes) 000188 1790919802.970992 mapwrite 0x001528 thru 0x0043a2 (0x2e7b bytes) 000189 1790919803.031124 write 0x03bb6c thru 0x03ffff (0x4494 bytes) 000190 1790919803.033754 punch from 0x02bc7a to 0x03420f (0x8596 bytes) 000191 1790919803.062429 write 0x01d9b6 thru 0x022740 (0x4d8b bytes) 000194 1790919803.081587 mapread 0x03178d thru 0x03276b (0xfdf bytes) 000195 1790919803.091224 mapwrite 0x02878f thru 0x02a55c (0x1dce bytes) 000196 1790919803.186948 mapwrite 0x025193 thru 0x032c16 (0xda84 bytes) 000198 1790919803.271924 trunc from 0x040000 to 0x001be0 (0x3e41f bytes) 000199 1790919803.303277 mapread 0x0015ce thru 0x001be0 (0x613 bytes) 000201 1790919803.304554 mapwrite 0x02a945 thru 0x02e03f (0x36fb bytes) 000202 1790919803.481527 write 0x0321ad thru 0x03c945 (0xa799 bytes) 000203 1790919803.482963 read 0x0289b5 thru 0x030b62 (0x81ae bytes) 000204 1790919803.505811 read 0x031741 thru 0x03c945 (0xb205 bytes) 000206 1790919803.510155 mapread 0x030a7f thru 0x03911b (0x869d bytes) 000209 1790919803.513286 trunc from 0x03c946 to 0x032595 (0xa3b0 bytes) 000210 1790919803.543683 mapwrite 0x03d754 thru 0x03ffff (0x28ac bytes) 000211 1790919803.653124 punch from 0x00c75e to 0x019fa3 (0xd846 bytes) 000213 1790919803.658604 mapread 0x01a17e thru 0x028667 (0xe4ea bytes) 000215 1790919803.660103 mapread 0x000729 thru 0x002574 (0x1e4c bytes) 000216 1790919803.661887 trunc from 0x040000 to 0x0373c8 (0x8c37 bytes) 000217 1790919803.676349 trunc from 0x0373c9 to 0x01a3ff (0x1cfc9 bytes) 000219 1790919803.695504 MIRROR_EXTEND to 2 mirrors 000220 1790919804.796177 read 0x0076e3 thru 0x008b67 (0x1485 bytes) 000223 1790919804.809896 mapwrite 0x03febf thru 0x03ffff (0x141 bytes) 000224 1790919805.053588 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000225 1790919805.178964 read 0x037ba5 thru 0x03ffff (0x845b bytes) 000227 1790919805.188866 mapwrite 0x00c34a thru 0x0187dd (0xc494 bytes) 000230 1790919805.275394 mapread 0x037579 thru 0x03ffff (0x8a87 bytes) 000232 1790919805.277296 trunc from 0x040000 to 0x014600 (0x2b9ff bytes) 000234 1790919805.298570 mapwrite 0x03653c thru 0x03be94 (0x5959 bytes) 000236 1790919805.369756 read 0x00ba79 thru 0x0197e5 (0xdd6d bytes) 000237 1790919805.381846 mapread 0x035cfe thru 0x03be94 (0x6197 bytes) 000238 1790919805.382850 mapwrite 0x035379 thru 0x03b0e2 (0x5d6a bytes) 000239 1790919805.431089 punch from 0x014857 to 0x01bdd1 (0x757b bytes) 000240 1790919805.435868 mapread 0x039a9d thru 0x03be94 (0x23f8 bytes) 000242 1790919805.438381 mapwrite 0x014c82 thru 0x0225bf (0xd93e bytes) 000243 1790919805.530219 mapread 0x03b4bf thru 0x03be94 (0x9d6 bytes) 000244 1790919805.531280 punch from 0x028a23 to 0x032d28 (0xa306 bytes) 000245 1790919805.536308 read 0x01ccfc thru 0x01eafd (0x1e02 bytes) 000248 1790919805.537848 mapwrite 0x005dd5 thru 0x0097bc (0x39e8 bytes) 000249 1790919805.583658 trunc from 0x03be95 to 0x005cee (0x361a6 bytes) 000250 1790919805.599274 mapread 0x00090a thru 0x005cee (0x53e5 bytes) 000254 1790919805.603159 write 0x002509 thru 0x007b94 (0x568c bytes) 000255 1790919805.604624 write 0x00a651 thru 0x00e368 (0x3d18 bytes) 000258 1790919805.607725 read 0x0042fe thru 0x00db79 (0x987c bytes) 000260 1790919805.613529 trunc from 0x00e369 to 0x02f33c (0x20fd4 bytes) 000261 1790919805.631836 mapread 0x024adc thru 0x02af06 (0x642b bytes) 000263 1790919805.642857 read 0x020012 thru 0x02230e (0x22fd bytes) 000267 1790919805.646743 punch from 0x000cac to 0x007472 (0x67c7 bytes) 000269 1790919805.660932 punch from 0x00109a to 0x004bf5 (0x3b5c bytes) 000270 1790919805.665653 write 0x00c1d8 thru 0x00e7ef (0x2618 bytes) 000271 1790919805.666599 mapwrite 0x034d37 thru 0x03e9fa (0x9cc4 bytes) 000275 1790919805.742278 read 0x038c6a thru 0x03c58d (0x3924 bytes) 000276 1790919805.743385 read 0x029db8 thru 0x033c20 (0x9e69 bytes) 000277 1790919805.744505 read 0x01bbf3 thru 0x01c038 (0x446 bytes) 000278 1790919805.745130 write 0x03cc3b thru 0x03e155 (0x151b bytes) 000281 1790919805.747147 mapwrite 0x03edd2 thru 0x03ffff (0x122e bytes) 000282 1790919805.809231 mapread 0x03fe2a thru 0x03ffff (0x1d6 bytes) 000283 1790919805.810015 write 0x0202b0 thru 0x0262a8 (0x5ff9 bytes) 000285 1790919805.813511 mapwrite 0x00016c thru 0x00087d (0x712 bytes) 000286 1790919805.872550 MIRROR_EXTEND to 2 mirrors 000287 1790919806.954324 MIRROR_RESYNC 2 mirrors 000288 1790919807.317370 read 0x012f35 thru 0x019cc8 (0x6d94 bytes) 000290 1790919807.332384 mapwrite 0x01376a thru 0x0228d2 (0xf169 bytes) 000291 1790919807.673651 read 0x018455 thru 0x01ed28 (0x68d4 bytes) 000292 1790919807.674364 write 0x02bf97 thru 0x039cc3 (0xdd2d bytes) 000295 1790919807.690067 punch from 0x01a4ca to 0x026cc6 (0xc7fd bytes) 000297 1790919807.720230 read 0x013ed0 thru 0x0204fa (0xc62b bytes) 000298 1790919807.731254 punch from 0x018565 to 0x01ced3 (0x496f bytes) 000300 1790919807.737169 read 0x009117 thru 0x00eb63 (0x5a4d bytes) 000301 1790919807.738150 punch from 0x016adf to 0x01a1c7 (0x36e9 bytes) 000302 1790919807.743342 mapwrite 0x0209e7 thru 0x02c52f (0xbb49 bytes) 000303 1790919807.795192 write 0x017128 thru 0x017eed (0xdc6 bytes) 000306 1790919807.804750 punch from 0x013aaa to 0x019245 (0x579c bytes) 000307 1790919807.813984 mapwrite 0x01e6f8 thru 0x024a2b (0x6334 bytes) 000308 1790919807.862583 mapread 0x02fc6e thru 0x03d470 (0xd803 bytes) 000309 1790919807.865218 read 0x025701 thru 0x031208 (0xbb08 bytes) 000310 1790919807.866129 write 0x02384f thru 0x032ed9 (0xf68b bytes) 000311 1790919807.870161 trunc from 0x040000 to 0x0374d7 (0x8b28 bytes) 000312 1790919807.905933 write 0x01caba thru 0x024660 (0x7ba7 bytes) 000313 1790919807.907589 read 0x00930e thru 0x01088c (0x757f bytes) 000315 1790919807.914593 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000316 1790919808.067638 mapwrite 0x01a88c thru 0x01cfac (0x2721 bytes) 000317 1790919808.138758 write 0x03d482 thru 0x03ffff (0x2b7e bytes) 000319 1790919808.142042 mapread 0x01ea41 thru 0x02688c (0x7e4c bytes) 000320 1790919808.153908 punch from 0x004af3 to 0x00f7c6 (0xacd4 bytes) 000322 1790919808.166351 write 0x03100d thru 0x03d86f (0xc863 bytes) 000323 1790919808.174360 trunc from 0x040000 to 0x029416 (0x16be9 bytes) 000326 1790919808.197840 punch from 0x009c0b to 0x00d323 (0x3719 bytes) 000327 1790919808.204203 punch from 0x01b086 to 0x0235ac (0x8527 bytes) 000328 1790919808.211525 mapread 0x027985 thru 0x029416 (0x1a92 bytes) 000329 1790919808.213921 punch from 0x01d357 to 0x02770c (0xa3b6 bytes) 000330 1790919808.220879 write 0x016046 thru 0x0222f6 (0xc2b1 bytes) 000331 1790919808.229078 mapread 0x01f7ce thru 0x029416 (0x9c49 bytes) 000333 1790919808.241612 mapwrite 0x010476 thru 0x017fa7 (0x7b32 bytes) 000335 1790919808.343876 trunc from 0x029417 to 0x02a1a1 (0xd8b bytes) truncating to largest ever: 0x3f4e2 000339 1790919808.361932 trunc from 0x02a1a2 to 0x03f4e1 (0x15340 bytes) 000341 1790919808.384803 punch from 0x0185f1 to 0x01fe5a (0x786a bytes) 000342 1790919808.389890 trunc from 0x03f4e2 to 0x033eba (0xb627 bytes) 000343 1790919808.413265 read 0x014b1f thru 0x020bb2 (0xc094 bytes) 000346 1790919808.428284 trunc from 0x033ebb to 0x03a75e (0x68a4 bytes) 000347 1790919808.448915 mapwrite 0x02a290 thru 0x03768b (0xd3fc bytes) 000348 1790919808.546005 read 0x0195f3 thru 0x01c26e (0x2c7c bytes) 000349 1790919808.546627 mapwrite 0x012fd2 thru 0x0193c6 (0x63f5 bytes) 000350 1790919808.603623 mapwrite 0x01cecb thru 0x020f95 (0x40cb bytes) 000352 1790919808.683876 mapwrite 0x009224 thru 0x00c19c (0x2f79 bytes) 000353 1790919808.740414 write 0x03fc67 thru 0x03ffff (0x399 bytes) 000354 1790919808.741624 read 0x037993 thru 0x039b99 (0x2207 bytes) 000355 1790919808.744674 trunc from 0x040000 to 0x005196 (0x3ae69 bytes) 000356 1790919808.762571 trunc from 0x005197 to 0x02741d (0x22287 bytes) 000357 1790919808.778246 write 0x0224bd thru 0x02f34a (0xce8e bytes) 000358 1790919808.792778 punch from 0x0227d6 to 0x02a5e5 (0x7e10 bytes) 000359 1790919808.811374 read 0x006d3e thru 0x00f9ee (0x8cb1 bytes) 000360 1790919808.812094 mapread 0x01eb4f thru 0x021b83 (0x3035 bytes) 000362 1790919808.814168 read 0x01dfa2 thru 0x022b90 (0x4bef bytes) 000364 1790919808.823562 trunc from 0x02f34b to 0x0117b4 (0x1db96 bytes) 000365 1790919808.843359 punch from 0x00fe7c to 0x010253 (0x3d8 bytes) 000367 1790919808.850572 punch from 0x006b76 to 0x0117b4 (0xac3f bytes) 000370 1790919808.857471 write 0x02065a thru 0x029ccc (0x9673 bytes) 000372 1790919808.860848 trunc from 0x029ccd to 0x018896 (0x11436 bytes) 000373 1790919808.882337 trunc from 0x018897 to 0x02dc25 (0x1538f bytes) 000374 1790919808.911138 trunc from 0x02dc26 to 0x000bbd (0x2d068 bytes) 000375 1790919808.931954 mapread 0x0006a2 thru 0x000bbd (0x51c bytes) 000377 1790919808.934616 read 0x0000d5 thru 0x000bbd (0xae9 bytes) 000378 1790919808.935342 punch from 0x0000ad to 0x000bbd (0xb11 bytes) 000379 1790919808.940626 mapread 0x00084d thru 0x000bbd (0x371 bytes) 000380 1790919808.946218 read 0x0001f9 thru 0x000bbd (0x9c5 bytes) 000382 1790919808.947772 mapwrite 0x017eba thru 0x01866e (0x7b5 bytes) 000383 1790919809.012796 mapwrite 0x0194ed thru 0x024b3b (0xb64f bytes) 000385 1790919809.088373 trunc from 0x024b3c to 0x03137f (0xc844 bytes) 000386 1790919809.107355 punch from 0x002e67 to 0x00ac50 (0x7dea bytes) 000388 1790919809.112327 mapwrite 0x0099e0 thru 0x0188fc (0xef1d bytes) 000392 1790919809.196445 write 0x00a581 thru 0x00ba16 (0x1496 bytes) 000393 1790919809.198038 trunc from 0x031380 to 0x03aa92 (0x9713 bytes) 000397 1790919809.220655 read 0x022167 thru 0x02392f (0x17c9 bytes) 000398 1790919809.222137 punch from 0x0332ba to 0x03aa92 (0x77d9 bytes) 000399 1790919809.230995 trunc from 0x03aa93 to 0x022406 (0x1868c bytes) 000400 1790919809.252080 trunc from 0x022407 to 0x03dfd5 (0x1bbcf bytes) 000401 1790919809.268771 read 0x0361a2 thru 0x03dfd5 (0x7e34 bytes) 000402 1790919809.279607 read 0x01c367 thru 0x01e0ce (0x1d68 bytes) 000403 1790919809.280316 mapwrite 0x03305c thru 0x038a58 (0x59fd bytes) 000404 1790919809.340756 write 0x0209b7 thru 0x022761 (0x1dab bytes) 000405 1790919809.344162 trunc from 0x03dfd6 to 0x01d02b (0x20faa bytes) 000409 1790919809.374548 write 0x007521 thru 0x0145d4 (0xd0b4 bytes) 000410 1790919809.377850 trunc from 0x01d02c to 0x00df60 (0xf0cb bytes) 000411 1790919809.411829 punch from 0x009046 to 0x00df60 (0x4f1b bytes) 000412 1790919809.454494 trunc from 0x00df61 to 0x02ac33 (0x1ccd3 bytes) 000417 1790919809.523890 punch from 0x0292e0 to 0x02ac33 (0x1954 bytes) 000418 1790919809.533319 mapwrite 0x0207d2 thru 0x025797 (0x4fc6 bytes) 000421 1790919809.626121 mapread 0x02426e thru 0x02a6a8 (0x643b bytes) 000422 1790919809.630781 write 0x000f02 thru 0x0010ee (0x1ed bytes) 000427 1790919809.646505 mapread 0x0120f1 thru 0x0165d5 (0x44e5 bytes) 000428 1790919809.665274 MIRROR_EXTEND to 2 mirrors 000429 1790919811.102209 mapwrite 0x039fa3 thru 0x03dc4f (0x3cad bytes) 000430 1790919811.332941 write 0x021775 thru 0x026bc2 (0x544e bytes) 000431 1790919811.342627 read 0x01452c thru 0x01d619 (0x90ee bytes) 000432 1790919811.353503 read 0x004254 thru 0x00a40e (0x61bb bytes) 000434 1790919811.381772 write 0x004d2e thru 0x009370 (0x4643 bytes) 000435 1790919811.384680 read 0x023ce9 thru 0x029fcd (0x62e5 bytes) 000437 1790919811.386655 read 0x01f047 thru 0x028d85 (0x9d3f bytes) 000438 1790919811.387880 write 0x018a23 thru 0x0211a6 (0x8784 bytes) 000439 1790919811.390298 write 0x036fbb thru 0x038d3f (0x1d85 bytes) 000440 1790919811.391257 trunc from 0x03dc50 to 0x03c2a3 (0x19ac bytes) 000441 1790919811.428610 write 0x001193 thru 0x00e025 (0xce93 bytes) 000443 1790919811.435451 write 0x03b8dd thru 0x03ffff (0x4723 bytes) 000445 1790919811.455674 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd5fab2f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x17896c07 Mirror 3: 0x17896c07 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000448 1790919812.892585 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd5fab2f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x17896c07 Mirror 3: 0x17896c07 Mirror 4: 0x17896c07 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000449 1790919813.952050 trunc from 0x040000 to 0x03c452 (0x3bad bytes) 000450 1790919814.120180 mapread 0x02e416 thru 0x035596 (0x7181 bytes) 000451 1790919814.139288 write 0x03b615 thru 0x03ffff (0x49eb bytes) 000453 1790919814.148002 mapwrite 0x006d29 thru 0x008d33 (0x200b bytes) 000455 1790919814.223448 write 0x0221f0 thru 0x02990f (0x7720 bytes) 000456 1790919814.229792 write 0x030cb3 thru 0x03e16d (0xd4bb bytes) 000457 1790919814.231937 read 0x01ddca thru 0x02096b (0x2ba2 bytes) 000458 1790919814.240899 trunc from 0x040000 to 0x03886f (0x7790 bytes) 000459 1790919814.285474 read 0x00b958 thru 0x01b2c2 (0xf96b bytes) 000460 1790919814.296927 read 0x01505a thru 0x01eece (0x9e75 bytes) 000462 1790919814.298107 trunc from 0x038870 to 0x03d6ba (0x4e4b bytes) 000463 1790919814.332522 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 3: 0x27122b74 (stale) Mirror 4: 0x27122b74 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6bb): Mirror 3: 0x27122b74 (stale) Mirror 4: 0x27122b74 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6bb: skipped 000464 1790919814.789944 trunc from 0x03d6bb to 0x0159a6 (0x27d14 bytes) 000465 1790919814.816363 punch from 0x009782 to 0x00dfaa (0x4829 bytes) 000466 1790919814.822076 write 0x01cde7 thru 0x0295ff (0xc819 bytes) 000467 1790919814.829796 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29600): Mirror 4: 0x27c3f807 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29600): Mirror 4: 0x27c3f807 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29600: skipped 000468 1790919815.202447 punch from 0x027a6f to 0x0295ff (0x1b91 bytes) 000469 1790919815.207750 trunc from 0x029600 to 0x026e7e (0x2781 bytes) 000470 1790919815.229741 mapread 0x006eda thru 0x013737 (0xc85e bytes) 000472 1790919815.258612 trunc from 0x026e7f to 0x022522 (0x495c bytes) 000474 1790919815.282466 write 0x0174e4 thru 0x01c5b4 (0x50d1 bytes) 000475 1790919815.289614 mapread 0x00a257 thru 0x00ca1a (0x27c4 bytes) 000476 1790919815.294577 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000480 1790919815.434279 mapread 0x00701b thru 0x011066 (0xa04c bytes) 000481 1790919815.462252 mapwrite 0x03da25 thru 0x03f4ce (0x1aaa bytes) 000482 1790919815.543595 read 0x03a7a2 thru 0x03f4ce (0x4d2d bytes) 000483 1790919815.549449 MIRROR_EXTEND to 2 mirrors 000484 1790919816.639885 trunc from 0x03f4cf to 0x01cb4f (0x2297f bytes) 000486 1790919816.806614 trunc from 0x01cb50 to 0x004ff8 (0x17b57 bytes) 000487 1790919816.850299 mapread 0x004bad thru 0x004ff8 (0x44c bytes) 000489 1790919816.863201 write 0x01a7b9 thru 0x025643 (0xae8b bytes) 000490 1790919816.867504 punch from 0x00a7ee to 0x01242f (0x7c42 bytes) 000491 1790919816.894447 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x25644): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25644): Mirror 2: 0xaee12ba1 (stale) CRC-32 checksum value for chunk [0, 0x25644): Mirror 1: 0xcc0c03a3 Mirror 3: 0xcc0c03a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25644: skipped 000494 1790919818.397833 mapread 0x01f4a7 thru 0x0206f7 (0x1251 bytes) 000495 1790919818.427031 mapwrite 0x035e2f thru 0x03ffff (0xa1d1 bytes) 000497 1790919818.675187 read 0x02c312 thru 0x0377a0 (0xb48f bytes) 000499 1790919818.708359 MIRROR_RESYNC 3 mirrors 000500 1790919820.118919 trunc from 0x040000 to 0x0049b0 (0x3b64f bytes) 000501 1790919820.291246 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x49b1): Mirror 3: 0xaf9bd218 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x49b1): Mirror 3: 0xaf9bd218 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x49b1: skipped 000502 1790919820.778842 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000503 1790919820.903972 mapread 0x000872 thru 0x0049b0 (0x413f bytes) 000504 1790919820.927790 mapread 0x0011c9 thru 0x00295c (0x1794 bytes) 000505 1790919820.930442 mapread 0x000181 thru 0x0049b0 (0x4830 bytes) 000507 1790919820.932866 punch from 0x001549 to 0x0049b0 (0x3468 bytes) 000512 1790919820.940758 write 0x01291c thru 0x0211d9 (0xe8be bytes) 000513 1790919820.944399 trunc from 0x0211da to 0x0306e2 (0xf509 bytes) 000514 1790919820.959948 read 0x005990 thru 0x013421 (0xda92 bytes) 000515 1790919820.970775 read 0x03012d thru 0x0306e2 (0x5b6 bytes) 000516 1790919820.981781 trunc from 0x0306e3 to 0x03c6b6 (0xbfd4 bytes) 000517 1790919821.005994 punch from 0x0294ae to 0x0302fd (0x6e50 bytes) 000520 1790919821.039680 punch from 0x02ff7a to 0x037014 (0x709b bytes) 000522 1790919821.044999 write 0x0391a7 thru 0x03b98e (0x27e8 bytes) 000523 1790919821.057644 mapwrite 0x02799f thru 0x02ee27 (0x7489 bytes) 000524 1790919821.167628 mapread 0x00530d thru 0x007e6b (0x2b5f bytes) 000525 1790919821.170611 write 0x013f0c thru 0x018e4f (0x4f44 bytes) 000526 1790919821.180216 read 0x011d9c thru 0x021931 (0xfb96 bytes) 000529 1790919821.192095 mapwrite 0x02bece thru 0x0396c1 (0xd7f4 bytes) 000531 1790919821.326608 read 0x037ee0 thru 0x03c6b6 (0x47d7 bytes) 000533 1790919821.345009 MIRROR_EXTEND to 2 mirrors 000534 1790919822.362766 mapwrite 0x03c5a7 thru 0x03d1ab (0xc05 bytes) 000535 1790919822.562518 mapwrite 0x01c4a6 thru 0x0249f8 (0x8553 bytes) 000537 1790919822.675988 trunc from 0x03d1ac to 0x01aeb1 (0x222fa bytes) 000538 1790919822.706719 punch from 0x007fec to 0x00d27b (0x5290 bytes) 000539 1790919822.713654 trunc from 0x01aeb2 to 0x02f6f3 (0x14842 bytes) 000541 1790919822.738082 trunc from 0x02f6f4 to 0x003be2 (0x2bb11 bytes) 000542 1790919822.763081 read 0x0038ca thru 0x003be2 (0x319 bytes) 000544 1790919822.776239 trunc from 0x003be3 to 0x012c4a (0xf068 bytes) 000546 1790919822.824296 mapwrite 0x025fc3 thru 0x02eacf (0x8b0d bytes) 000547 1790919822.995021 trunc from 0x02ead0 to 0x01ebd1 (0xfefe bytes) 000548 1790919823.024238 write 0x01c079 thru 0x029bd0 (0xdb58 bytes) 000550 1790919823.039367 mapread 0x01b552 thru 0x028a3f (0xd4ee bytes) 000551 1790919823.076257 trunc from 0x029bd1 to 0x037126 (0xd556 bytes) 000552 1790919823.091072 punch from 0x028333 to 0x02d4c6 (0x5194 bytes) 000553 1790919823.127640 mapread 0x00ea07 thru 0x01a5c9 (0xbbc3 bytes) 000556 1790919823.145591 trunc from 0x037127 to 0x036336 (0xdf0 bytes) 000557 1790919823.174520 trunc from 0x036337 to 0x02a156 (0xc1e0 bytes) 000558 1790919823.222134 mapread 0x002fa3 thru 0x00dff6 (0xb054 bytes) 000559 1790919823.267076 MIRROR_RESYNC 2 mirrors 000560 1790919824.653194 MIRROR_EXTEND to 3 mirrors 000563 1790919826.016405 trunc from 0x02a157 to 0x03daeb (0x13995 bytes) 000564 1790919826.114234 write 0x0119f9 thru 0x01c9ed (0xaff5 bytes) 000566 1790919826.129176 trunc from 0x03daec to 0x016015 (0x27ad6 bytes) 000567 1790919826.150684 write 0x0201d5 thru 0x02e27b (0xe0a7 bytes) 000569 1790919826.160644 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e27c): Mirror 2: 0x106e2493 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e27c): Mirror 2: 0x106e2493 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e27c: skipped 000570 1790919826.655495 mapread 0x025e2a thru 0x02e27b (0x8452 bytes) 000571 1790919826.673105 trunc from 0x02e27c to 0x0251d9 (0x90a2 bytes) 000572 1790919826.689975 trunc from 0x0251da to 0x02eb49 (0x9970 bytes) 000575 1790919826.716519 read 0x000602 thru 0x0023aa (0x1da9 bytes) 000576 1790919826.724177 punch from 0x01aa8e to 0x01dcb7 (0x322a bytes) 000577 1790919826.728376 punch from 0x02a659 to 0x02eb49 (0x44f1 bytes) 000578 1790919826.732642 mapread 0x00fe47 thru 0x01c8f0 (0xcaaa bytes) 000579 1790919826.754015 write 0x001dc1 thru 0x002963 (0xba3 bytes) 000580 1790919826.755615 trunc from 0x02eb4a to 0x010a53 (0x1e0f6 bytes) 000581 1790919826.775772 read 0x00f652 thru 0x010a53 (0x1402 bytes) 000582 1790919826.777289 read 0x006495 thru 0x010a53 (0xa5bf bytes) 000585 1790919826.791476 MIRROR_RESYNC 2 mirrors 000587 1790919827.690183 write 0x01512c thru 0x01982c (0x4701 bytes) 000588 1790919827.787220 mapread 0x01855d thru 0x01982c (0x12d0 bytes) 000589 1790919827.789814 read 0x0069d6 thru 0x00a776 (0x3da1 bytes) 000590 1790919827.798905 punch from 0x010239 to 0x0159e0 (0x57a8 bytes) 000592 1790919827.813610 punch from 0x0074d7 to 0x015cfa (0xe824 bytes) 000594 1790919827.818970 punch from 0x00f26d to 0x010547 (0x12db bytes) 000596 1790919827.824984 write 0x015369 thru 0x01e4e8 (0x9180 bytes) 000597 1790919827.832462 punch from 0x019109 to 0x01e107 (0x4fff bytes) 000598 1790919827.847057 write 0x01d63b thru 0x01fcc3 (0x2689 bytes) 000599 1790919827.853841 trunc from 0x01fcc4 to 0x0269ea (0x6d27 bytes) 000602 1790919827.889001 mapread 0x00b013 thru 0x00eb25 (0x3b13 bytes) 000603 1790919827.915113 mapread 0x015201 thru 0x0218e6 (0xc6e6 bytes) 000605 1790919827.933421 read 0x016882 thru 0x0218a5 (0xb024 bytes) 000606 1790919827.934126 trunc from 0x0269eb to 0x01258a (0x14460 bytes) 000607 1790919827.955577 mapread 0x00d7d0 thru 0x01258a (0x4dbb bytes) 000608 1790919827.957194 write 0x0302c5 thru 0x03b632 (0xb36e bytes) 000612 1790919827.966027 trunc from 0x03b633 to 0x01b801 (0x1fe31 bytes) 000613 1790919827.988561 punch from 0x0073e1 to 0x00eedf (0x7aff bytes) 000615 1790919828.004277 punch from 0x007c8f to 0x0117f1 (0x9b63 bytes) 000616 1790919828.013382 punch from 0x0033eb to 0x00fa23 (0xc639 bytes) 000617 1790919828.018442 trunc from 0x01b802 to 0x00fd33 (0xbace bytes) 000618 1790919828.055610 write 0x02278b thru 0x027aa9 (0x531f bytes) 000620 1790919828.062607 mapwrite 0x027c12 thru 0x028786 (0xb75 bytes) 000621 1790919828.257248 write 0x01725f thru 0x0213e5 (0xa187 bytes) 000622 1790919828.265646 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x28787): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28787): Mirror 2: 0x36a5f8bc (stale) CRC-32 checksum value for chunk [0, 0x28787): Mirror 1: 0x340eed6c Mirror 3: 0x340eed6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28787: skipped 000624 1790919829.576781 mapwrite 0x0027c6 thru 0x007bad (0x53e8 bytes) 000625 1790919829.838861 mapwrite 0x025fb0 thru 0x0278c5 (0x1916 bytes) 000626 1790919829.909527 mapwrite 0x027587 thru 0x02b251 (0x3ccb bytes) 000627 1790919830.015178 mapread 0x028c44 thru 0x02911d (0x4da bytes) 000631 1790919830.020506 punch from 0x0081f2 to 0x00be27 (0x3c36 bytes) 000632 1790919830.026634 read 0x01659d thru 0x02357b (0xcfdf bytes) 000633 1790919830.045599 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2b252): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b252): Mirror 2: 0x1475b806 (stale) Mirror 3: 0x6e9cc48a (stale) CRC-32 checksum value for chunk [0, 0x2b252): Mirror 1: 0x276d98a Mirror 4: 0x276d98a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b252: skipped 000634 1790919831.283000 punch from 0x0177dd to 0x01e766 (0x6f8a bytes) 000635 1790919831.385408 punch from 0x029f0d to 0x02b251 (0x1345 bytes) 000637 1790919831.399982 read 0x02919d thru 0x02b251 (0x20b5 bytes) 000638 1790919831.411684 mapread 0x027c75 thru 0x02b251 (0x35dd bytes) 000639 1790919831.422176 write 0x026c27 thru 0x033540 (0xc91a bytes) 000641 1790919831.429273 mapread 0x01b329 thru 0x01b96e (0x646 bytes) 000642 1790919831.438594 write 0x0081e9 thru 0x00bd08 (0x3b20 bytes) 000644 1790919831.451908 punch from 0x01c379 to 0x01f745 (0x33cd bytes) 000645 1790919831.480938 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33541): Mirror 3: 0x32b68ae3 (stale) Mirror 4: 0x65b7ec9a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33541): Mirror 3: 0x32b68ae3 (stale) Mirror 4: 0x65b7ec9a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33541: skipped 000647 1790919831.855909 read 0x02c3e5 thru 0x0334a0 (0x70bc bytes) 000648 1790919831.867553 read 0x01afb1 thru 0x020204 (0x5254 bytes) 000650 1790919831.884987 write 0x002d67 thru 0x00f124 (0xc3be bytes) 000651 1790919831.887692 read 0x02b84f thru 0x033540 (0x7cf2 bytes) 000653 1790919831.889918 read 0x0159b0 thru 0x0223aa (0xc9fb bytes) 000654 1790919831.890549 mapwrite 0x015177 thru 0x02488d (0xf717 bytes) 000655 1790919831.970975 punch from 0x009e3d to 0x010be3 (0x6da7 bytes) 000656 1790919831.981399 write 0x039f74 thru 0x03ffff (0x608c bytes) 000659 1790919831.998204 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x12afac87 (stale) Mirror 4: 0xd5346c19 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc9473ef0 Mirror 5: 0xc9473ef0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000660 1790919833.409138 mapwrite 0x023a81 thru 0x0318ef (0xde6f bytes) 000662 1790919833.739966 punch from 0x01ed07 to 0x0206dc (0x19d6 bytes) 000664 1790919833.747145 read 0x0224b6 thru 0x024236 (0x1d81 bytes) 000665 1790919833.753531 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x12afac87 (stale) Mirror 5: 0xc9473ef0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x12afac87 (stale) Mirror 5: 0xc9473ef0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000666 1790919834.171660 mapwrite 0x004f6a thru 0x012571 (0xd608 bytes) 000668 1790919834.262763 trunc from 0x040000 to 0x0198e3 (0x2671c bytes) 000669 1790919834.279654 mapread 0x000731 thru 0x008aa4 (0x8374 bytes) 000672 1790919834.292183 mapwrite 0x00a034 thru 0x011e54 (0x7e21 bytes) 000674 1790919834.356759 write 0x028a89 thru 0x02c3db (0x3953 bytes) 000675 1790919834.358966 read 0x00069c thru 0x002443 (0x1da8 bytes) 000676 1790919834.360454 punch from 0x013df1 to 0x01cc34 (0x8e44 bytes) 000677 1790919834.431799 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c3dc): Mirror 3: 0x8551ea5b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c3dc): Mirror 3: 0x8551ea5b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c3dc: skipped 000678 1790919834.736353 write 0x014bd4 thru 0x018033 (0x3460 bytes) 000679 1790919834.748350 write 0x009b1e thru 0x01036a (0x684d bytes) 000680 1790919834.757786 read 0x01c859 thru 0x02714c (0xa8f4 bytes) 000682 1790919834.766560 read 0x024a95 thru 0x029ddd (0x5349 bytes) 000683 1790919834.779587 mapread 0x013677 thru 0x0171d0 (0x3b5a bytes) 000684 1790919834.781168 write 0x03f6c3 thru 0x03ffff (0x93d bytes) 000687 1790919834.783772 write 0x03e08d thru 0x03ffff (0x1f73 bytes) 000689 1790919834.792929 mapread 0x02c59e thru 0x036e91 (0xa8f4 bytes) 000691 1790919834.795360 trunc from 0x040000 to 0x0235e8 (0x1ca17 bytes) 000692 1790919834.809379 punch from 0x013935 to 0x016895 (0x2f61 bytes) 000695 1790919834.823934 punch from 0x000cac to 0x002fcf (0x2324 bytes) 000697 1790919834.829369 mapwrite 0x01aba5 thru 0x023af0 (0x8f4c bytes) 000698 1790919834.904558 punch from 0x0036c7 to 0x00828a (0x4bc4 bytes) 000700 1790919834.912652 mapwrite 0x039c7a thru 0x03ea87 (0x4e0e bytes) 000702 1790919835.067236 MIRROR_RESYNC 2 mirrors 000703 1790919837.022538 read 0x01d022 thru 0x023209 (0x61e8 bytes) 000704 1790919837.034607 read 0x031100 thru 0x0368aa (0x57ab bytes) 000705 1790919837.050042 mapwrite 0x009fd7 thru 0x0157d3 (0xb7fd bytes) 000707 1790919837.356644 read 0x037141 thru 0x03ba92 (0x4952 bytes) 000709 1790919837.394674 mapread 0x038a0e thru 0x03ea87 (0x607a bytes) 000710 1790919837.396763 mapread 0x01e66a thru 0x027c14 (0x95ab bytes) 000711 1790919837.401547 write 0x01a1d1 thru 0x01fa3d (0x586d bytes) 000712 1790919837.404835 mapread 0x016ef5 thru 0x021414 (0xa520 bytes) 000713 1790919837.412011 mapwrite 0x0341c3 thru 0x0387ca (0x4608 bytes) 000714 1790919837.518666 trunc from 0x03ea88 to 0x039def (0x4c98 bytes) 000715 1790919837.573215 punch from 0x00569c to 0x013093 (0xd9f8 bytes) 000716 1790919837.586472 punch from 0x035128 to 0x039def (0x4cc8 bytes) 000717 1790919837.596243 read 0x02b31b thru 0x0334ab (0x8191 bytes) 000718 1790919837.601556 write 0x03a5df thru 0x03ffff (0x5a21 bytes) 000719 1790919837.604854 write 0x03ab25 thru 0x03ffff (0x54db bytes) 000720 1790919837.608622 write 0x00122e thru 0x00681b (0x55ee bytes) 000721 1790919837.620591 trunc from 0x040000 to 0x014a83 (0x2b57c bytes) 000724 1790919837.647162 mapwrite 0x01be1b thru 0x02a250 (0xe436 bytes) 000725 1790919837.754978 trunc from 0x02a251 to 0x0097f7 (0x20a59 bytes) 000726 1790919837.776443 trunc from 0x0097f8 to 0x023674 (0x19e7d bytes) 000727 1790919837.801177 trunc from 0x023675 to 0x0192c3 (0xa3b1 bytes) 000728 1790919837.818592 mapwrite 0x02473d thru 0x030040 (0xb904 bytes) 000729 1790919838.007458 trunc from 0x030041 to 0x009b03 (0x2653d bytes) 000731 1790919838.024959 trunc from 0x009b04 to 0x03bf40 (0x3243d bytes) 000732 1790919838.041868 mapread 0x01c643 thru 0x01cb7a (0x538 bytes) 000733 1790919838.050338 mapread 0x0116d0 thru 0x01527b (0x3bac bytes) truncating to largest ever: 0x3f9df 000735 1790919838.076418 trunc from 0x03bf41 to 0x03f9de (0x3a9e bytes) 000736 1790919838.094244 read 0x00a968 thru 0x0139da (0x9073 bytes) 000737 1790919838.106674 mapwrite 0x004812 thru 0x00bebc (0x76ab bytes) 000740 1790919838.153095 read 0x020d17 thru 0x02ac2f (0x9f19 bytes) 000741 1790919838.162289 MIRROR_RESYNC 2 mirrors 000742 1790919838.984824 trunc from 0x03f9df to 0x0121fd (0x2d7e1 bytes) 000743 1790919839.152943 mapwrite 0x021300 thru 0x02153a (0x23b bytes) 000744 1790919839.259740 punch from 0x011e6b to 0x0138c1 (0x1a57 bytes) 000746 1790919839.268867 trunc from 0x02153b to 0x02f3a0 (0xde66 bytes) 000747 1790919839.289233 punch from 0x015b36 to 0x021764 (0xbc2f bytes) 000748 1790919839.298436 mapread 0x01406d thru 0x014e4c (0xde0 bytes) 000750 1790919839.307204 mapread 0x007fb7 thru 0x017cac (0xfcf6 bytes) 000751 1790919839.335652 trunc from 0x02f3a1 to 0x0048ea (0x2aab6 bytes) 000752 1790919839.360492 read 0x002fde thru 0x0048ea (0x190d bytes) 000755 1790919839.362130 mapread 0x0003b5 thru 0x000a29 (0x675 bytes) 000756 1790919839.369566 punch from 0x001b2b to 0x0048ea (0x2dc0 bytes) 000758 1790919839.380424 mapread 0x001f17 thru 0x0048ea (0x29d4 bytes) 000759 1790919839.389176 mapread 0x000b9a thru 0x0048ea (0x3d51 bytes) 000760 1790919839.390657 trunc from 0x0048eb to 0x000caa (0x3c40 bytes) 000762 1790919839.409169 read 0x00022c thru 0x000caa (0xa7f bytes) 000763 1790919839.409823 mapread 0x00057a thru 0x000caa (0x731 bytes) 000764 1790919839.411948 write 0x0364a2 thru 0x03c86b (0x63ca bytes) 000765 1790919839.413957 mapwrite 0x006708 thru 0x00bdd5 (0x56ce bytes) 000766 1790919839.491017 write 0x03c36c thru 0x03ffff (0x3c94 bytes) 000767 1790919839.493122 mapwrite 0x00a593 thru 0x00dbe4 (0x3652 bytes) 000769 1790919839.545596 trunc from 0x040000 to 0x025958 (0x1a6a7 bytes) 000770 1790919839.572773 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000772 1790919839.823131 read 0x0160fa thru 0x021786 (0xb68d bytes) 000773 1790919839.832060 punch from 0x00aea3 to 0x010deb (0x5f49 bytes) 000774 1790919839.838411 write 0x026944 thru 0x02f297 (0x8954 bytes) 000775 1790919839.840263 write 0x0147be thru 0x016601 (0x1e44 bytes) 000778 1790919839.855416 read 0x0248b7 thru 0x02c55e (0x7ca8 bytes) 000779 1790919839.869058 read 0x001660 thru 0x003735 (0x20d6 bytes) 000780 1790919839.870128 trunc from 0x02f298 to 0x01bdbd (0x134da bytes) 000781 1790919839.891162 mapwrite 0x00fd75 thru 0x01daca (0xdd56 bytes) 000782 1790919840.017220 mapread 0x012ce8 thru 0x0161ed (0x3506 bytes) 000787 1790919840.028165 trunc from 0x01dacb to 0x03eae4 (0x2101a bytes) 000789 1790919840.047212 write 0x03d596 thru 0x03f23f (0x1caa bytes) 000790 1790919840.063086 punch from 0x00ed04 to 0x016ba0 (0x7e9d bytes) 000791 1790919840.091017 mapwrite 0x03d1bb thru 0x03f53e (0x2384 bytes) 000792 1790919840.156750 trunc from 0x03f53f to 0x006583 (0x38fbb bytes) 000799 1790919840.186499 mapwrite 0x00bd13 thru 0x018a21 (0xcd0f bytes) 000802 1790919840.334887 write 0x0170a1 thru 0x01d29c (0x61fc bytes) 000803 1790919840.336896 trunc from 0x01d29d to 0x013210 (0xa08c bytes) 000804 1790919840.370244 punch from 0x00612e to 0x013210 (0xd0e3 bytes) 000805 1790919840.389945 read 0x004aba thru 0x009ed3 (0x541a bytes) 000807 1790919840.424465 MIRROR_EXTEND to 2 mirrors 000808 1790919841.393470 mapwrite 0x038b67 thru 0x03ffff (0x7499 bytes) 000809 1790919841.571151 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000810 1790919841.739232 mapread 0x01f22c thru 0x025279 (0x604e bytes) 000812 1790919841.767098 mapread 0x03e128 thru 0x03eaac (0x985 bytes) 000813 1790919841.781158 trunc from 0x040000 to 0x031180 (0xee7f bytes) 000814 1790919841.799568 trunc from 0x031181 to 0x0249d9 (0xc7a7 bytes) 000815 1790919841.821293 read 0x0016aa thru 0x006af1 (0x5448 bytes) 000816 1790919841.829358 write 0x028aa5 thru 0x034d74 (0xc2d0 bytes) 000817 1790919841.830978 mapread 0x0162e6 thru 0x024d5d (0xea78 bytes) 000818 1790919841.839344 trunc from 0x034d75 to 0x03402d (0xd47 bytes) 000819 1790919841.854592 mapwrite 0x02deb6 thru 0x03d515 (0xf660 bytes) 000820 1790919841.940555 read 0x024fc6 thru 0x031013 (0xc04e bytes) 000821 1790919841.958635 MIRROR_EXTEND to 2 mirrors 000823 1790919843.167143 trunc from 0x03d516 to 0x034eb5 (0x8660 bytes) 000825 1790919843.261408 punch from 0x004554 to 0x005be4 (0x1691 bytes) 000826 1790919843.266553 punch from 0x024d05 to 0x033d77 (0xf073 bytes) 000827 1790919843.271531 write 0x011665 thru 0x01c23c (0xabd8 bytes) 000828 1790919843.282295 trunc from 0x034eb6 to 0x00d961 (0x27554 bytes) 000831 1790919843.311889 punch from 0x00b956 to 0x00d961 (0x200c bytes) 000832 1790919843.321197 write 0x008e7a thru 0x00c923 (0x3aaa bytes) 000833 1790919843.334428 MIRROR_RESYNC 2 mirrors 000834 1790919844.266116 trunc from 0x00d962 to 0x01812b (0xa7ca bytes) 000835 1790919844.421431 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000836 1790919844.570579 trunc from 0x01812c to 0x02d271 (0x15146 bytes) 000837 1790919844.582777 mapread 0x020c83 thru 0x024f71 (0x42ef bytes) 000838 1790919844.611101 mapwrite 0x012c4b thru 0x013898 (0xc4e bytes) 000840 1790919844.686112 trunc from 0x02d272 to 0x02c9f2 (0x87f bytes) 000843 1790919844.704549 mapwrite 0x02ba80 thru 0x034261 (0x87e2 bytes) 000844 1790919844.807116 mapread 0x01d263 thru 0x0220cb (0x4e69 bytes) 000845 1790919844.808401 write 0x03d96d thru 0x03eb2c (0x11c0 bytes) 000847 1790919844.811549 mapwrite 0x038730 thru 0x03ffff (0x78d0 bytes) 000848 1790919844.888545 mapread 0x00ff9f thru 0x0197c7 (0x9829 bytes) 000849 1790919844.892651 mapread 0x0363d0 thru 0x03961d (0x324e bytes) 000850 1790919844.894401 trunc from 0x040000 to 0x0030be (0x3cf41 bytes) 000851 1790919844.916851 mapwrite 0x022a85 thru 0x028a94 (0x6010 bytes) 000852 1790919845.016657 mapwrite 0x03ee95 thru 0x03ffff (0x116b bytes) 000853 1790919845.134132 trunc from 0x040000 to 0x026d4f (0x192b0 bytes) 000854 1790919845.158528 write 0x010bb4 thru 0x018353 (0x77a0 bytes) 000859 1790919845.176147 mapread 0x00ce06 thru 0x0171f7 (0xa3f2 bytes) 000861 1790919845.186504 read 0x011048 thru 0x011b0b (0xac4 bytes) 000864 1790919845.187927 mapread 0x013064 thru 0x01f9c9 (0xc966 bytes) 000867 1790919845.196538 mapread 0x008f34 thru 0x018ded (0xfeba bytes) 000869 1790919845.199125 trunc from 0x026d50 to 0x00276f (0x245e0 bytes) 000870 1790919845.213612 mapwrite 0x012305 thru 0x01651b (0x4217 bytes) 000872 1790919845.339746 trunc from 0x01651c to 0x037ebe (0x219a3 bytes) 000875 1790919845.361325 mapread 0x00cedf thru 0x00dbdd (0xcff bytes) 000876 1790919845.364768 trunc from 0x037ebf to 0x02972a (0xe794 bytes) 000877 1790919845.393556 write 0x03493c thru 0x03f176 (0xa83b bytes) 000878 1790919845.397455 trunc from 0x03f177 to 0x02b574 (0x13c02 bytes) 000881 1790919845.414941 punch from 0x025ad4 to 0x02b574 (0x5aa1 bytes) 000882 1790919845.422558 trunc from 0x02b575 to 0x01a68c (0x10ee8 bytes) 000883 1790919845.441479 write 0x03eb0d thru 0x03ffff (0x14f3 bytes) 000885 1790919845.444471 punch from 0x014b24 to 0x0201bc (0xb699 bytes) 000886 1790919845.454618 mapwrite 0x00e690 thru 0x0196a4 (0xb015 bytes) 000888 1790919845.529463 mapwrite 0x025c89 thru 0x02a06a (0x43e2 bytes) 000890 1790919845.595637 mapwrite 0x020f94 thru 0x02b924 (0xa991 bytes) 000892 1790919845.705012 read 0x0136f2 thru 0x015245 (0x1b54 bytes) 000894 1790919845.706106 write 0x012c79 thru 0x016b88 (0x3f10 bytes) 000895 1790919845.711847 punch from 0x035289 to 0x03bf56 (0x6cce bytes) 000896 1790919845.725149 mapread 0x02f5b4 thru 0x03dbeb (0xe638 bytes) 000897 1790919845.741172 write 0x007da3 thru 0x00808b (0x2e9 bytes) 000898 1790919845.742276 write 0x0373e0 thru 0x038096 (0xcb7 bytes) 000899 1790919845.749468 mapread 0x033667 thru 0x034da7 (0x1741 bytes) 000900 1790919845.766648 MIRROR_EXTEND to 2 mirrors 000901 1790919847.045015 read 0x0239c7 thru 0x0271c0 (0x37fa bytes) 000903 1790919847.054818 mapwrite 0x02b03a thru 0x037340 (0xc307 bytes) 000906 1790919847.248300 punch from 0x0348bc to 0x03675b (0x1ea0 bytes) 000907 1790919847.254004 trunc from 0x040000 to 0x00701d (0x38fe2 bytes) 000909 1790919847.282909 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x701e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x701e): Mirror 2: 0x7ef85900 (stale) CRC-32 checksum value for chunk [0, 0x701e): Mirror 1: 0x7ef85900 Mirror 3: 0x7ef85900 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x701e: skipped 000910 1790919848.234752 mapread 0x0017fc thru 0x00701d (0x5822 bytes) 000913 1790919848.300945 read 0x0047e6 thru 0x00701d (0x2838 bytes) 000914 1790919848.319343 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x701e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x701e): Mirror 2: 0x7ef85900 (stale) CRC-32 checksum value for chunk [0, 0x701e): Mirror 1: 0x7ef85900 Mirror 3: 0x7ef85900 Mirror 4: 0x7ef85900 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x701e: skipped 000915 1790919849.396349 punch from 0x0069d5 to 0x00701d (0x649 bytes) 000917 1790919849.518066 write 0x0095dc thru 0x016dab (0xd7d0 bytes) 000919 1790919849.523439 mapread 0x014034 thru 0x016dab (0x2d78 bytes) 000921 1790919849.528385 read 0x01362e thru 0x015cf9 (0x26cc bytes) 000922 1790919849.543132 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x16dac): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16dac): Mirror 2: 0xc989ea84 (stale) Mirror 3: 0xe737d8b9 (stale) Mirror 4: 0xe737d8b9 (stale) CRC-32 checksum value for chunk [0, 0x16dac): Mirror 1: 0xbb41d6dc Mirror 5: 0xbb41d6dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16dac: skipped 000923 1790919850.909520 MIRROR_RESYNC 5 mirrors 000925 1790919852.404359 punch from 0x010dc1 to 0x016dab (0x5feb bytes) 000926 1790919852.544885 mapwrite 0x024e23 thru 0x031eb3 (0xd091 bytes) 000929 1790919852.778524 punch from 0x02a3ce to 0x02d286 (0x2eb9 bytes) 000930 1790919852.785968 trunc from 0x031eb4 to 0x026e32 (0xb081 bytes) 000931 1790919852.810848 mapread 0x00afa0 thru 0x01299a (0x79fb bytes) 000932 1790919852.825026 read 0x00606a thru 0x012221 (0xc1b8 bytes) 000933 1790919852.825827 write 0x03796d thru 0x038805 (0xe99 bytes) 000934 1790919852.835767 mapread 0x0287b3 thru 0x03100c (0x885a bytes) 000935 1790919852.858641 mapread 0x00ccb7 thru 0x016827 (0x9b71 bytes) 000936 1790919852.883179 trunc from 0x038806 to 0x01aeb6 (0x1d94f bytes) 000939 1790919852.911644 read 0x00b6e1 thru 0x015c8e (0xa5ae bytes) 000940 1790919852.921228 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1aeb7): Mirror 3: 0xda6ea21a (stale) Mirror 4: 0xda6ea21a (stale) Mirror 5: 0xda6ea21a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1aeb7): Mirror 3: 0xda6ea21a (stale) Mirror 4: 0xda6ea21a (stale) Mirror 5: 0xda6ea21a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1aeb7: skipped 000941 1790919853.384530 read 0x00ef6b thru 0x014b9e (0x5c34 bytes) 000942 1790919853.406916 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1aeb7): Mirror 3: 0xda6ea21a (stale) Mirror 5: 0xda6ea21a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1aeb7): Mirror 3: 0xda6ea21a (stale) Mirror 5: 0xda6ea21a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1aeb7: skipped 000943 1790919853.790962 mapread 0x003104 thru 0x00beea (0x8de7 bytes) 000944 1790919853.836673 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1aeb7): Mirror 3: 0xda6ea21a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1aeb7): Mirror 3: 0xda6ea21a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1aeb7: skipped 000949 1790919854.243572 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) 000950 1790919854.390126 read 0x012289 thru 0x01aeb6 (0x8c2e bytes) 000951 1790919854.399474 punch from 0x0155c1 to 0x017fd6 (0x2a16 bytes) 000955 1790919854.406469 punch from 0x0032ad to 0x011a4d (0xe7a1 bytes) 000956 1790919854.411442 write 0x020772 thru 0x02d0d6 (0xc965 bytes) 000958 1790919854.418835 read 0x010431 thru 0x01e000 (0xdbd0 bytes) 000959 1790919854.435337 read 0x004025 thru 0x007e31 (0x3e0d bytes) 000961 1790919854.437143 trunc from 0x02d0d7 to 0x0183c6 (0x14d10 bytes) 000963 1790919854.466546 trunc from 0x0183c7 to 0x01f086 (0x6cc0 bytes) 000964 1790919854.501097 punch from 0x00aa93 to 0x00f821 (0x4d8f bytes) 000965 1790919854.514810 mapread 0x0043a6 thru 0x006890 (0x24eb bytes) 000967 1790919854.516241 read 0x0171aa thru 0x01f086 (0x7edd bytes) 000968 1790919854.527646 punch from 0x00bfa4 to 0x0126c3 (0x6720 bytes) 000969 1790919854.546263 MIRROR_EXTEND to 2 mirrors 000971 1790919855.812166 trunc from 0x01f087 to 0x00a430 (0x14c56 bytes) 000973 1790919855.958235 mapwrite 0x03bc35 thru 0x03ffff (0x43cb bytes) 000974 1790919856.102236 mapwrite 0x02467d thru 0x0292b3 (0x4c37 bytes) 000975 1790919856.218680 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2357ac9 Mirror 3: 0x2357ac9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000976 1790919857.306440 write 0x01cb2c thru 0x026a57 (0x9f2c bytes) 000977 1790919857.404512 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0x2357ac9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4f269562 Mirror 4: 0x4f269562 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000979 1790919858.911648 mapwrite 0x0280c7 thru 0x02a4a0 (0x23da bytes) 000980 1790919859.137128 punch from 0x009473 to 0x0151f4 (0xbd82 bytes) 000981 1790919859.146513 read 0x00fa59 thru 0x0103da (0x982 bytes) 000983 1790919859.164834 mapwrite 0x027cb2 thru 0x030664 (0x89b3 bytes) 000984 1790919859.277819 punch from 0x004083 to 0x00f9b5 (0xb933 bytes) 000987 1790919859.291013 punch from 0x01ed8b to 0x02017d (0x13f3 bytes) 000988 1790919859.313481 mapwrite 0x039427 thru 0x03ffff (0x6bd9 bytes) 000989 1790919859.416492 mapwrite 0x00c0a4 thru 0x015413 (0x9370 bytes) 000990 1790919859.598684 punch from 0x016b41 to 0x017734 (0xbf4 bytes) 000991 1790919859.619676 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2357ac9 (stale) Mirror 4: 0x4f269562 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2357ac9 (stale) Mirror 4: 0x4f269562 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000992 1790919860.038407 mapwrite 0x002148 thru 0x0052d0 (0x3189 bytes) 000993 1790919860.131766 mapread 0x00db2d thru 0x00f404 (0x18d8 bytes) 000994 1790919860.137890 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x147:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x4f269562 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x4f269562 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000995 1790919860.454310 read 0x02271d thru 0x03120a (0xeaee bytes) 000996 1790919860.475656 mapwrite 0x02db04 thru 0x037cbe (0xa1bb bytes) 000997 1790919860.565322 read 0x022455 thru 0x024b3c (0x26e8 bytes) 000998 1790919860.568564 punch from 0x03dd7e to 0x03ffff (0x2282 bytes) 000999 1790919860.577520 read 0x031493 thru 0x03dad4 (0xc642 bytes) All operations completed A-OK!