== sanity-flr test 70a: flr mode fsx test ================ 20:41:56 (1780533716) Seed set to 3717 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000008 1780533717.504520 MIRROR_EXTEND to 2 mirrors 000009 1780533717.588871 mapwrite 0x01f40a thru 0x0254e7 (0x60de bytes) 000010 1780533717.629305 read 0x023387 thru 0x0254e7 (0x2161 bytes) truncating to largest ever: 0x2711c 000011 1780533717.629785 trunc from 0x0254e8 to 0x02711b (0x1c34 bytes) 000012 1780533717.634167 mapread 0x02090c thru 0x02711b (0x6810 bytes) 000013 1780533717.636093 mapwrite 0x022846 thru 0x02dda2 (0xb55d bytes) 000014 1780533717.656919 write 0x03201e thru 0x034f5b (0x2f3e bytes) 000015 1780533717.657601 mapwrite 0x01a773 thru 0x0298d0 (0xf15e bytes) 000016 1780533717.671251 read 0x00f01d thru 0x0169ba (0x799e bytes) 000017 1780533717.674572 mapread 0x0066eb thru 0x012463 (0xbd79 bytes) 000018 1780533717.675344 write 0x0147b1 thru 0x0230b1 (0xe901 bytes) 000020 1780533717.676510 trunc from 0x034f5c to 0x00f626 (0x25935 bytes) 000021 1780533717.680994 read 0x007e6c thru 0x00f626 (0x77bb bytes) 000022 1780533717.681416 read 0x00857e thru 0x00f626 (0x70a9 bytes) 000023 1780533717.682852 MIRROR_RESYNC 2 mirrors 000026 1780533717.821077 MIRROR_RESYNC 2 mirrors 000032 1780533717.911045 MIRROR_EXTEND to 3 mirrors 000033 1780533718.057725 read 0x009631 thru 0x009d3a (0x70a bytes) 000037 1780533718.060390 MIRROR_EXTEND to 4 mirrors 000038 1780533718.202662 read 0x00aed0 thru 0x00f626 (0x4757 bytes) 000040 1780533718.206446 write 0x02a27a thru 0x02a68f (0x416 bytes) truncating to largest ever: 0x2c2d8 000041 1780533718.223493 trunc from 0x02a690 to 0x02c2d7 (0x1c48 bytes) 000042 1780533718.231663 mapread 0x01acb5 thru 0x01f78e (0x4ada bytes) 000045 1780533718.237597 mapwrite 0x019451 thru 0x01ecf6 (0x58a6 bytes) truncating to largest ever: 0x35dab 000046 1780533718.251974 trunc from 0x02c2d8 to 0x035daa (0x9ad3 bytes) 000047 1780533718.256321 mapwrite 0x03eb56 thru 0x03ffff (0x14aa bytes) 000048 1780533718.274189 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 4: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000049 1780533718.356515 mapwrite 0x005684 thru 0x01519a (0xfb17 bytes) 000050 1780533718.378674 trunc from 0x040000 to 0x004ff6 (0x3b009 bytes) 000052 1780533718.383414 read 0x002f28 thru 0x004ff6 (0x20cf bytes) 000055 1780533718.384410 trunc from 0x004ff7 to 0x01ffff (0x1b009 bytes) 000056 1780533718.388552 mapwrite 0x02b1a2 thru 0x032efb (0x7d5a bytes) 000058 1780533718.408261 read 0x02f2a2 thru 0x02ff7d (0xcdc bytes) 000059 1780533718.408927 write 0x0274f3 thru 0x0309a6 (0x94b4 bytes) 000063 1780533718.411683 mapread 0x01b00c thru 0x02129e (0x6293 bytes) 000064 1780533718.415573 mapwrite 0x036d23 thru 0x03ffff (0x92dd bytes) 000065 1780533718.435996 write 0x028b76 thru 0x02978f (0xc1a bytes) 000066 1780533718.436949 write 0x005ba9 thru 0x008835 (0x2c8d bytes) 000067 1780533718.438903 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000068 1780533718.504103 write 0x02898a thru 0x034182 (0xb7f9 bytes) 000069 1780533718.506649 read 0x036b66 thru 0x03bc76 (0x5111 bytes) 000070 1780533718.508625 write 0x00f32f thru 0x01c034 (0xcd06 bytes) 000073 1780533718.513824 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000076 1780533718.546637 trunc from 0x040000 to 0x02965c (0x169a3 bytes) 000077 1780533718.550450 mapwrite 0x01d9f9 thru 0x02243e (0x4a46 bytes) 000080 1780533718.567953 mapread 0x014621 thru 0x023197 (0xeb77 bytes) 000082 1780533718.571670 mapwrite 0x0278a9 thru 0x033a82 (0xc1da bytes) 000085 1780533718.592759 write 0x021ff6 thru 0x029396 (0x73a1 bytes) 000090 1780533718.594774 read 0x01d006 thru 0x02bb0d (0xeb08 bytes) 000092 1780533718.595559 read 0x01a896 thru 0x01e786 (0x3ef1 bytes) 000093 1780533718.596024 read 0x00f192 thru 0x017adc (0x894b bytes) 000094 1780533718.597725 MIRROR_EXTEND to 2 mirrors 000095 1780533718.734505 MIRROR_RESYNC 2 mirrors 000096 1780533718.831416 mapwrite 0x00940a thru 0x015c8e (0xc885 bytes) 000097 1780533718.878773 read 0x00bb99 thru 0x00ffeb (0x4453 bytes) 000099 1780533718.879488 mapread 0x0128ee thru 0x014222 (0x1935 bytes) 000101 1780533718.880378 write 0x0313d3 thru 0x037d17 (0x6945 bytes) 000102 1780533718.883971 MIRROR_RESYNC 2 mirrors 000103 1780533719.019190 read 0x029cb8 thru 0x03718b (0xd4d4 bytes) 000104 1780533719.021525 write 0x00b658 thru 0x00cd08 (0x16b1 bytes) 000105 1780533719.037525 MIRROR_RESYNC 2 mirrors 000106 1780533719.185133 trunc from 0x037d18 to 0x032c37 (0x50e0 bytes) 000107 1780533719.199703 mapwrite 0x01a029 thru 0x028ed6 (0xeeae bytes) 000109 1780533719.218928 write 0x0201a9 thru 0x025c6e (0x5ac6 bytes) 000111 1780533719.221047 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000112 1780533719.252389 mapwrite 0x028025 thru 0x02960a (0x15e6 bytes) 000113 1780533719.263923 mapwrite 0x0249b2 thru 0x02adbf (0x640e bytes) 000117 1780533719.278192 mapwrite 0x03fa80 thru 0x03ffff (0x580 bytes) 000118 1780533719.293239 read 0x020af9 thru 0x025965 (0x4e6d bytes) 000119 1780533719.293785 trunc from 0x040000 to 0x01adc3 (0x2523c bytes) 000120 1780533719.297664 mapwrite 0x004c5a thru 0x00f35c (0xa703 bytes) 000125 1780533719.315301 trunc from 0x01adc4 to 0x00d10e (0xdcb5 bytes) 000126 1780533719.319651 write 0x02389c thru 0x02c57f (0x8ce4 bytes) 000127 1780533719.320463 read 0x011421 thru 0x012502 (0x10e2 bytes) 000130 1780533719.323605 mapread 0x01fa82 thru 0x02a93b (0xaeba bytes) 000132 1780533719.324950 trunc from 0x02c580 to 0x02c22c (0x353 bytes) 000133 1780533719.328365 mapwrite 0x007a00 thru 0x00e299 (0x689a bytes) 000135 1780533719.340457 trunc from 0x02c22d to 0x0341a7 (0x7f7b bytes) 000137 1780533719.344894 write 0x000fc0 thru 0x007d7c (0x6dbd bytes) 000139 1780533719.346321 mapread 0x027f58 thru 0x0341a7 (0xc250 bytes) 000140 1780533719.349013 mapread 0x0247c5 thru 0x02f0cf (0xa90b bytes) 000142 1780533719.350044 read 0x01dfc3 thru 0x01ee4c (0xe8a bytes) 000145 1780533719.351463 mapwrite 0x0202ad thru 0x026ac7 (0x681b bytes) 000147 1780533719.363667 trunc from 0x0341a8 to 0x023694 (0x10b13 bytes) 000148 1780533719.367956 mapwrite 0x0132c9 thru 0x022f97 (0xfccf bytes) 000152 1780533719.382753 trunc from 0x023695 to 0x007664 (0x1c030 bytes) 000154 1780533719.387471 mapread 0x003d47 thru 0x007664 (0x391e bytes) 000156 1780533719.388712 trunc from 0x007665 to 0x0141c7 (0xcb63 bytes) truncating to largest ever: 0x3623f 000161 1780533719.394793 trunc from 0x0141c8 to 0x03623e (0x22077 bytes) 000162 1780533719.398225 trunc from 0x03623f to 0x021ad7 (0x14767 bytes) 000167 1780533719.402997 mapread 0x001ca3 thru 0x01049f (0xe7fd bytes) 000168 1780533719.405980 write 0x027d49 thru 0x03243d (0xa6f5 bytes) 000170 1780533719.407174 read 0x010747 thru 0x012a6d (0x2327 bytes) 000171 1780533719.408766 MIRROR_EXTEND to 2 mirrors 000172 1780533719.546833 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000173 1780533719.575144 read 0x013e77 thru 0x01b4ae (0x7638 bytes) 000176 1780533719.578350 trunc from 0x03243e to 0x019b45 (0x188f8 bytes) 000177 1780533719.587411 write 0x03af15 thru 0x03cd37 (0x1e23 bytes) 000179 1780533719.588455 mapwrite 0x03bcc6 thru 0x03ffc7 (0x4302 bytes) 000180 1780533719.607070 write 0x028e31 thru 0x0354b0 (0xc680 bytes) 000181 1780533719.611859 MIRROR_EXTEND to 2 mirrors 000183 1780533719.750546 mapwrite 0x014532 thru 0x0185b0 (0x407f bytes) 000184 1780533719.794277 mapwrite 0x031ec1 thru 0x032880 (0x9c0 bytes) 000186 1780533719.805538 read 0x03548c thru 0x0359ef (0x564 bytes) 000187 1780533719.806127 mapwrite 0x01d378 thru 0x02b3e1 (0xe06a bytes) 000188 1780533719.822772 mapwrite 0x031642 thru 0x03610f (0x4ace bytes) 000189 1780533719.833560 mapread 0x034fee thru 0x0370ee (0x2101 bytes) 000191 1780533719.834623 mapread 0x003011 thru 0x012497 (0xf487 bytes) 000193 1780533719.838547 mapwrite 0x00a26b thru 0x017887 (0xd61d bytes) 000194 1780533719.853450 write 0x0196c9 thru 0x01aa79 (0x13b1 bytes) 000195 1780533719.854463 read 0x006dea thru 0x0110a5 (0xa2bc bytes) 000198 1780533719.858221 trunc from 0x03ffc8 to 0x02034d (0x1fc7a bytes) 000200 1780533719.868704 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000201 1780533719.901341 read 0x00759a thru 0x016704 (0xf16b bytes) 000202 1780533719.903901 trunc from 0x02034e to 0x001043 (0x1f30a bytes) 000204 1780533719.908096 mapread 0x000924 thru 0x001043 (0x720 bytes) 000206 1780533719.911856 mapwrite 0x029515 thru 0x029686 (0x172 bytes) 000207 1780533719.928489 read 0x008d3d thru 0x009d42 (0x1006 bytes) 000208 1780533719.931673 read 0x0269bc thru 0x029686 (0x2ccb bytes) 000209 1780533719.932237 read 0x0058c2 thru 0x00cb77 (0x72b6 bytes) 000210 1780533719.932592 write 0x01f9bf thru 0x0274ca (0x7b0c bytes) 000213 1780533719.934107 write 0x018af5 thru 0x01fff8 (0x7504 bytes) 000215 1780533719.936659 MIRROR_EXTEND to 2 mirrors 000218 1780533720.093919 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000219 1780533720.125115 write 0x020f87 thru 0x0301a2 (0xf21c bytes) 000224 1780533720.132074 write 0x02bc67 thru 0x039aec (0xde86 bytes) 000226 1780533720.134052 mapwrite 0x038dde thru 0x03ffff (0x7222 bytes) 000227 1780533720.155072 mapread 0x019ef7 thru 0x026906 (0xca10 bytes) 000228 1780533720.158187 read 0x0177d9 thru 0x024e3e (0xd666 bytes) 000229 1780533720.158583 trunc from 0x040000 to 0x00c34e (0x33cb1 bytes) 000232 1780533720.163490 mapwrite 0x02fd8d thru 0x03dfab (0xe21f bytes) 000233 1780533720.183115 write 0x024558 thru 0x033e8e (0xf937 bytes) 000234 1780533720.185667 read 0x0014e5 thru 0x00d2fa (0xbe16 bytes) 000241 1780533720.190395 read 0x0332fa thru 0x03cde5 (0x9aec bytes) 000242 1780533720.190778 write 0x02f5b8 thru 0x036451 (0x6e9a bytes) 000243 1780533720.191452 mapread 0x0077f5 thru 0x009f54 (0x2760 bytes) 000245 1780533720.192380 mapwrite 0x02a351 thru 0x02fdbe (0x5a6e bytes) 000247 1780533720.204992 read 0x01fa70 thru 0x021a13 (0x1fa4 bytes) 000248 1780533720.205443 write 0x02d747 thru 0x02f39e (0x1c58 bytes) 000252 1780533720.207562 read 0x03dd40 thru 0x03dfab (0x26c bytes) 000258 1780533720.210879 mapread 0x019067 thru 0x026bfc (0xdb96 bytes) 000262 1780533720.212886 write 0x02244f thru 0x0309c1 (0xe573 bytes) 000263 1780533720.214035 write 0x00cc92 thru 0x01905d (0xc3cc bytes) 000264 1780533720.214975 write 0x0239be thru 0x02a15a (0x679d bytes) 000265 1780533720.215773 trunc from 0x03dfac to 0x01d843 (0x20768 bytes) 000268 1780533720.221828 MIRROR_EXTEND to 2 mirrors 000270 1780533720.358234 MIRROR_EXTEND to 3 mirrors 000271 1780533720.499200 mapwrite 0x008371 thru 0x008ec9 (0xb59 bytes) 000272 1780533720.547801 mapwrite 0x01cdff thru 0x025d51 (0x8f53 bytes) 000274 1780533720.574730 write 0x02fac6 thru 0x037dbc (0x82f7 bytes) 000275 1780533720.575596 mapread 0x004e93 thru 0x01076f (0xb8dd bytes) 000276 1780533720.578499 mapwrite 0x017d51 thru 0x0193db (0x168b bytes) 000277 1780533720.591028 mapread 0x0110ec thru 0x012e67 (0x1d7c bytes) 000279 1780533720.595533 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37dbd): Mirror 3: 0xde190cf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37dbd): Mirror 3: 0xde190cf9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37dbd: skipped 000284 1780533720.670040 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x3fd16 000287 1780533720.816619 trunc from 0x037dbd to 0x03fd15 (0x7f59 bytes) 000289 1780533720.840413 MIRROR_RESYNC 2 mirrors 000292 1780533720.985897 write 0x03509b thru 0x03ffff (0xaf65 bytes) 000295 1780533721.003010 mapwrite 0x02b3bc thru 0x03893e (0xd583 bytes) 000296 1780533721.019414 read 0x02bc15 thru 0x03a5dd (0xe9c9 bytes) 000298 1780533721.020234 mapread 0x02840f thru 0x02cc2e (0x4820 bytes) 000301 1780533721.022933 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000302 1780533721.054431 write 0x0350d2 thru 0x03bb86 (0x6ab5 bytes) 000307 1780533721.058530 trunc from 0x040000 to 0x0042eb (0x3bd14 bytes) 000308 1780533721.066987 write 0x01c22a thru 0x01dcde (0x1ab5 bytes) 000310 1780533721.068035 write 0x0118e8 thru 0x01bd19 (0xa432 bytes) 000312 1780533721.072313 write 0x02b266 thru 0x037c17 (0xc9b2 bytes) 000313 1780533721.073271 mapwrite 0x0383e1 thru 0x03dc34 (0x5854 bytes) 000314 1780533721.093954 MIRROR_EXTEND to 2 mirrors 000316 1780533721.234035 write 0x03c271 thru 0x03e389 (0x2119 bytes) 000317 1780533721.250634 read 0x0174cb thru 0x0262ba (0xedf0 bytes) 000318 1780533721.254540 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000321 1780533721.291757 MIRROR_EXTEND to 2 mirrors 000322 1780533721.443900 trunc from 0x03e38a to 0x03fc69 (0x18e0 bytes) 000324 1780533721.469380 read 0x0192ce thru 0x022c2e (0x9961 bytes) 000327 1780533721.473702 trunc from 0x03fc6a to 0x01e9ff (0x2126a bytes) 000328 1780533721.480057 mapwrite 0x035f6d thru 0x039527 (0x35bb bytes) 000329 1780533721.501939 read 0x02e1b5 thru 0x034002 (0x5e4e bytes) 000330 1780533721.505449 mapread 0x020a0f thru 0x023e82 (0x3474 bytes) 000331 1780533721.506122 read 0x037e4f thru 0x039527 (0x16d9 bytes) 000332 1780533721.506484 write 0x029069 thru 0x02992e (0x8c6 bytes) 000333 1780533721.507111 mapread 0x01b9fc thru 0x021305 (0x590a bytes) 000336 1780533721.508371 trunc from 0x039528 to 0x01b1e5 (0x1e342 bytes) 000337 1780533721.512867 write 0x027f6b thru 0x02fb0b (0x7ba1 bytes) 000340 1780533721.514402 mapread 0x0206c3 thru 0x02e04b (0xd989 bytes) 000341 1780533721.517091 mapread 0x007f77 thru 0x00d5f4 (0x567e bytes) 000342 1780533721.517798 read 0x017baa thru 0x01f1be (0x7615 bytes) 000343 1780533721.518386 trunc from 0x02fb0c to 0x003746 (0x2c3c5 bytes) 000345 1780533721.522816 read 0x00245f thru 0x003746 (0x12e8 bytes) 000350 1780533721.524590 read 0x003146 thru 0x003746 (0x601 bytes) 000351 1780533721.525029 mapread 0x002e30 thru 0x003746 (0x917 bytes) 000352 1780533721.525632 trunc from 0x003747 to 0x03b525 (0x37ddf bytes) 000354 1780533721.529733 read 0x01c950 thru 0x021632 (0x4ce3 bytes) 000355 1780533721.534817 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b526): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b526): Mirror 2: 0x15fc7bb3 (stale) CRC-32 checksum value for chunk [0, 0x3b526): Mirror 1: 0x609e9885 Mirror 3: 0x609e9885 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b526: skipped 000359 1780533721.731909 mapwrite 0x01cce7 thru 0x029ff1 (0xd30b bytes) 000360 1780533721.785843 mapwrite 0x0117e4 thru 0x01c28b (0xaaa8 bytes) 000361 1780533721.802943 trunc from 0x03b526 to 0x037511 (0x4014 bytes) 000362 1780533721.812981 read 0x010ea1 thru 0x01ff30 (0xf090 bytes) 000363 1780533721.814806 MIRROR_RESYNC 3 mirrors 000371 1780533721.992050 mapwrite 0x0388e7 thru 0x03d31f (0x4a39 bytes) 000372 1780533722.030263 mapwrite 0x02d03e thru 0x0331bf (0x6182 bytes) 000373 1780533722.044633 mapread 0x023c88 thru 0x02dd00 (0xa079 bytes) 000374 1780533722.048484 trunc from 0x03d320 to 0x035303 (0x801c bytes) 000376 1780533722.058091 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35304): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35304): Mirror 2: 0x14317cd9 (stale) Mirror 3: 0x14317cd9 (stale) CRC-32 checksum value for chunk [0, 0x35304): Mirror 1: 0x3edb3553 Mirror 4: 0x3edb3553 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35304: skipped 000377 1780533722.266166 MIRROR_RESYNC 4 mirrors 000378 1780533722.437478 read 0x00d467 thru 0x01a76c (0xd306 bytes) 000379 1780533722.440027 trunc from 0x035304 to 0x0186e6 (0x1cc1d bytes) 000384 1780533722.460090 mapwrite 0x02e7a6 thru 0x03c7db (0xe036 bytes) 000385 1780533722.485897 read 0x02d72d thru 0x02fea4 (0x2778 bytes) 000386 1780533722.486358 write 0x026bcc thru 0x02e1f4 (0x7629 bytes) 000387 1780533722.489523 mapread 0x01c150 thru 0x025af4 (0x99a5 bytes) 000389 1780533722.490589 mapread 0x005c02 thru 0x0155f1 (0xf9f0 bytes) 000391 1780533722.492802 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c7dc): Mirror 3: 0x359f8bd4 (stale) Mirror 4: 0x359f8bd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c7dc): Mirror 3: 0x359f8bd4 (stale) Mirror 4: 0x359f8bd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c7dc: skipped 000393 1780533722.576200 mapread 0x01938a thru 0x01e75c (0x53d3 bytes) 000394 1780533722.581504 read 0x00535e thru 0x00b89a (0x653d bytes) 000396 1780533722.584324 mapwrite 0x0190fa thru 0x027992 (0xe899 bytes) 000397 1780533722.599847 mapwrite 0x03cd70 thru 0x03ffff (0x3290 bytes) 000399 1780533722.616640 read 0x02c25d thru 0x02cc7d (0xa21 bytes) 000401 1780533722.617472 trunc from 0x040000 to 0x02dc85 (0x1237a bytes) 000402 1780533722.621527 trunc from 0x02dc86 to 0x01d755 (0x10530 bytes) 000403 1780533722.625837 mapread 0x0178b0 thru 0x01b4d1 (0x3c22 bytes) 000405 1780533722.627082 write 0x012563 thru 0x01752f (0x4fcd bytes) 000406 1780533722.629734 trunc from 0x01d756 to 0x0183ca (0x538b bytes) 000407 1780533722.633756 trunc from 0x0183cb to 0x037efa (0x1fb30 bytes) 000410 1780533722.638514 mapread 0x00ed19 thru 0x0127c4 (0x3aac bytes) 000412 1780533722.639657 write 0x01ed99 thru 0x0268c1 (0x7b29 bytes) 000413 1780533722.643288 read 0x031e53 thru 0x03262e (0x7dc bytes) 000414 1780533722.645050 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37efb): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37efb): Mirror 3: 0x898be879 (stale) Mirror 4: 0x898be879 (stale) CRC-32 checksum value for chunk [0, 0x37efb): Mirror 1: 0x3376a784 Mirror 5: 0x3376a784 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37efb: skipped 000415 1780533722.844086 trunc from 0x037efb to 0x0069fe (0x314fc bytes) 000419 1780533722.868097 write 0x01716f thru 0x02680e (0xf6a0 bytes) 000421 1780533722.869407 write 0x0128f0 thru 0x017852 (0x4f63 bytes) 000422 1780533722.871156 write 0x010c1f thru 0x01cf3b (0xc31d bytes) 000423 1780533722.872904 read 0x00d8c8 thru 0x00fe61 (0x259a bytes) 000424 1780533722.874440 write 0x02c258 thru 0x033927 (0x76d0 bytes) 000425 1780533722.875176 mapread 0x012c5b thru 0x01ddbf (0xb165 bytes) 000427 1780533722.877264 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33928): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33928): Mirror 3: 0x1e911beb (stale) Mirror 4: 0x1e911beb (stale) Mirror 5: 0x366270e5 (stale) CRC-32 checksum value for chunk [0, 0x33928): Mirror 1: 0x4d4e27d7 Mirror 6: 0x4d4e27d7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33928: skipped 000430 1780533723.073214 trunc from 0x033928 to 0x02900c (0xa91b bytes) 000431 1780533723.099483 write 0x029ab0 thru 0x033f19 (0xa46a bytes) 000432 1780533723.101526 mapread 0x020114 thru 0x020996 (0x883 bytes) 000434 1780533723.103798 write 0x032c69 thru 0x03ffff (0xd397 bytes) 000435 1780533723.104901 mapwrite 0x037ed6 thru 0x03c2a7 (0x43d2 bytes) 000436 1780533723.118207 trunc from 0x040000 to 0x015a38 (0x2a5c7 bytes) 000438 1780533723.124413 trunc from 0x015a39 to 0x02dc46 (0x1820e bytes) 000441 1780533723.129056 mapread 0x027f7e thru 0x02dc46 (0x5cc9 bytes) 000442 1780533723.132150 mapwrite 0x020593 thru 0x025269 (0x4cd7 bytes) 000443 1780533723.146878 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dc47): Mirror 4: 0xd23f405b (stale) Mirror 5: 0x1f989fb1 (stale) Mirror 6: 0xb988aa23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dc47): Mirror 4: 0xd23f405b (stale) Mirror 5: 0x1f989fb1 (stale) Mirror 6: 0xb988aa23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dc47: skipped 000444 1780533723.236872 write 0x0244ac thru 0x033cde (0xf833 bytes) 000446 1780533723.239671 trunc from 0x033cdf to 0x0066ec (0x2d5f2 bytes) 000447 1780533723.244374 trunc from 0x0066ed to 0x028ec3 (0x227d7 bytes) 000448 1780533723.248483 mapwrite 0x038d91 thru 0x039285 (0x4f5 bytes) 000450 1780533723.267486 trunc from 0x039286 to 0x00ba54 (0x2d831 bytes) 000453 1780533723.273547 mapwrite 0x00335c thru 0x0110b1 (0xdd56 bytes) 000454 1780533723.297226 write 0x0040da thru 0x00523c (0x1163 bytes) 000456 1780533723.298362 mapwrite 0x0141ab thru 0x0209df (0xc835 bytes) 000459 1780533723.323478 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x209e0): Mirror 5: 0xd66e3881 (stale) Mirror 6: 0x469334f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x209e0): Mirror 5: 0xd66e3881 (stale) Mirror 6: 0x469334f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x209e0: skipped 000461 1780533723.397073 write 0x0139be thru 0x01f6f6 (0xbd39 bytes) 000462 1780533723.401513 MIRROR_RESYNC 3 mirrors 000464 1780533723.598292 mapread 0x01f5f7 thru 0x0209df (0x13e9 bytes) 000465 1780533723.600896 mapread 0x0059bc thru 0x006e60 (0x14a5 bytes) 000466 1780533723.603091 trunc from 0x0209e0 to 0x0288a3 (0x7ec4 bytes) 000467 1780533723.618820 read 0x008ad1 thru 0x012f17 (0xa447 bytes) 000469 1780533723.622898 MIRROR_RESYNC 3 mirrors 000471 1780533723.792713 write 0x01270a thru 0x013472 (0xd69 bytes) 000472 1780533723.810179 mapwrite 0x03801c thru 0x03ffff (0x7fe4 bytes) 000475 1780533723.837407 read 0x02b947 thru 0x03365e (0x7d18 bytes) 000476 1780533723.842033 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89deb51d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x89deb51d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000479 1780533723.918169 write 0x020c3d thru 0x026a74 (0x5e38 bytes) 000482 1780533723.922327 mapread 0x03f503 thru 0x03ffff (0xafd bytes) 000483 1780533723.925082 read 0x01a618 thru 0x0278f8 (0xd2e1 bytes) 000484 1780533723.927769 mapread 0x011eca thru 0x01b08f (0x91c6 bytes) 000486 1780533723.931464 mapread 0x00f7df thru 0x010b62 (0x1384 bytes) 000487 1780533723.933822 MIRROR_RESYNC 2 mirrors 000490 1780533724.091913 write 0x0203fd thru 0x025dd0 (0x59d4 bytes) 000491 1780533724.112328 read 0x003d9c thru 0x006e38 (0x309d bytes) 000492 1780533724.114335 mapread 0x017daf thru 0x018768 (0x9ba bytes) 000493 1780533724.117197 write 0x0292d0 thru 0x0384fd (0xf22e bytes) 000494 1780533724.120932 read 0x00eba6 thru 0x01bc61 (0xd0bc bytes) 000496 1780533724.124043 mapwrite 0x0132b5 thru 0x016106 (0x2e52 bytes) 000497 1780533724.137900 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000500 1780533724.174426 read 0x015a65 thru 0x017350 (0x18ec bytes) 000502 1780533724.176813 read 0x013337 thru 0x019377 (0x6041 bytes) 000503 1780533724.179869 read 0x0121b0 thru 0x01b3f4 (0x9245 bytes) 000506 1780533724.181049 write 0x03801e thru 0x03ffff (0x7fe2 bytes) 000507 1780533724.181826 mapread 0x008180 thru 0x016099 (0xdf1a bytes) 000512 1780533724.183880 write 0x00737b thru 0x015213 (0xde99 bytes) 000515 1780533724.185573 mapwrite 0x024bc7 thru 0x028995 (0x3dcf bytes) 000516 1780533724.199751 read 0x026429 thru 0x02d530 (0x7108 bytes) 000517 1780533724.200244 mapwrite 0x008bca thru 0x012506 (0x993d bytes) 000518 1780533724.213272 mapwrite 0x03ac33 thru 0x03b06c (0x43a bytes) 000521 1780533724.224873 read 0x024d4f thru 0x029ab4 (0x4d66 bytes) 000522 1780533724.225298 trunc from 0x040000 to 0x01e892 (0x2176d bytes) 000523 1780533724.229700 trunc from 0x01e893 to 0x023f31 (0x569f bytes) 000525 1780533724.233615 mapread 0x01029a thru 0x01e5dd (0xe344 bytes) 000528 1780533724.235264 write 0x03fa4b thru 0x03ffff (0x5b5 bytes) 000530 1780533724.236508 trunc from 0x040000 to 0x020cc4 (0x1f33b bytes) 000532 1780533724.240472 read 0x00312c thru 0x00346b (0x340 bytes) 000536 1780533724.242038 read 0x02044d thru 0x020cc4 (0x878 bytes) 000537 1780533724.243624 write 0x00b13c thru 0x01a7ec (0xf6b1 bytes) 000539 1780533724.244754 mapwrite 0x018f94 thru 0x02145f (0x84cc bytes) 000540 1780533724.262723 MIRROR_EXTEND to 2 mirrors 000541 1780533724.405517 mapwrite 0x025444 thru 0x034d44 (0xf901 bytes) 000542 1780533724.450948 mapread 0x0238a1 thru 0x02b74d (0x7ead bytes) 000544 1780533724.452654 write 0x02d652 thru 0x03a24d (0xcbfc bytes) 000545 1780533724.454082 mapwrite 0x01e796 thru 0x024a8e (0x62f9 bytes) 000546 1780533724.471622 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000547 1780533724.505168 mapread 0x01270d thru 0x01f557 (0xce4b bytes) 000548 1780533724.512303 read 0x0144e4 thru 0x022c1c (0xe739 bytes) 000551 1780533724.513345 trunc from 0x03a24e to 0x01790d (0x22940 bytes) 000555 1780533724.518390 trunc from 0x01790e to 0x021ead (0xa5a0 bytes) 000557 1780533724.522337 mapread 0x015d70 thru 0x018eae (0x313f bytes) 000558 1780533724.524715 read 0x006754 thru 0x011ac6 (0xb373 bytes) 000559 1780533724.527211 write 0x0366e1 thru 0x03f09a (0x89ba bytes) 000560 1780533724.528367 mapwrite 0x01fdfa thru 0x0216d3 (0x18da bytes) 000564 1780533724.541658 trunc from 0x03f09b to 0x01ba5c (0x2363e bytes) 000565 1780533724.545819 write 0x025b32 thru 0x03442b (0xe8fa bytes) 000566 1780533724.546765 mapread 0x02d998 thru 0x03442b (0x6a94 bytes) 000567 1780533724.547407 trunc from 0x03442c to 0x0054ca (0x2ef61 bytes) 000568 1780533724.551286 mapwrite 0x00d41c thru 0x00dcda (0x8bf bytes) 000569 1780533724.567244 read 0x00c65a thru 0x00dcda (0x1681 bytes) 000573 1780533724.571368 trunc from 0x00dcdb to 0x0212c0 (0x135e6 bytes) 000574 1780533724.575957 mapread 0x001bda thru 0x0086c5 (0x6aec bytes) 000578 1780533724.578623 write 0x01c5c7 thru 0x0220cf (0x5b09 bytes) 000579 1780533724.582137 write 0x03110c thru 0x03a45e (0x9353 bytes) 000582 1780533724.584027 mapwrite 0x000343 thru 0x0085c2 (0x8280 bytes) 000583 1780533724.598665 write 0x034a18 thru 0x03cff3 (0x85dc bytes) 000591 1780533724.603066 trunc from 0x03cff4 to 0x03b8cc (0x1727 bytes) 000593 1780533724.608198 read 0x001153 thru 0x00fcaa (0xeb58 bytes) 000594 1780533724.609821 MIRROR_EXTEND to 2 mirrors 000596 1780533724.759374 trunc from 0x03b8cd to 0x015e3c (0x25a90 bytes) 000599 1780533724.780914 trunc from 0x015e3d to 0x03cfb2 (0x27176 bytes) 000601 1780533724.786273 read 0x023003 thru 0x02fc21 (0xcc1f bytes) 000602 1780533724.788874 write 0x03d698 thru 0x03e80d (0x1176 bytes) 000603 1780533724.789620 write 0x008b33 thru 0x00fa37 (0x6f05 bytes) 000607 1780533724.793459 mapread 0x037ec5 thru 0x03e80d (0x6949 bytes) 000608 1780533724.796253 mapread 0x002975 thru 0x008b92 (0x621e bytes) 000609 1780533724.798816 read 0x017df0 thru 0x01b128 (0x3339 bytes) 000610 1780533724.802248 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000612 1780533724.840102 trunc from 0x03e80e to 0x017c62 (0x26bab bytes) 000613 1780533724.844371 mapread 0x00fa44 thru 0x00fde7 (0x3a4 bytes) 000617 1780533724.848038 read 0x00a4bd thru 0x00c3e2 (0x1f26 bytes) 000621 1780533724.851387 write 0x03ed22 thru 0x03ffff (0x12de bytes) 000622 1780533724.853662 MIRROR_EXTEND to 2 mirrors 000623 1780533725.007395 mapread 0x019ceb thru 0x01c2d8 (0x25ee bytes) 000624 1780533725.012922 mapwrite 0x00ff31 thru 0x01c4bb (0xc58b bytes) 000625 1780533725.064732 mapread 0x01a7a7 thru 0x024a91 (0xa2eb bytes) 000626 1780533725.067725 mapwrite 0x011a6e thru 0x0161e1 (0x4774 bytes) 000628 1780533725.080443 write 0x02706b thru 0x02fe6b (0x8e01 bytes) 000631 1780533725.084365 write 0x029d93 thru 0x02e3fa (0x4668 bytes) 000633 1780533725.086030 mapread 0x027815 thru 0x0303fb (0x8be7 bytes) 000636 1780533725.089917 mapwrite 0x02905f thru 0x0331ec (0xa18e bytes) 000638 1780533725.104187 mapread 0x03451a thru 0x03a751 (0x6238 bytes) 000642 1780533725.109187 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) 000644 1780533725.145530 mapread 0x006abb thru 0x00a215 (0x375b bytes) 000645 1780533725.152066 mapread 0x03641e thru 0x036cbd (0x8a0 bytes) 000647 1780533725.156215 mapwrite 0x0254ed thru 0x02c7ac (0x72c0 bytes) 000648 1780533725.171570 read 0x002bf7 thru 0x00deda (0xb2e4 bytes) 000649 1780533725.172160 mapwrite 0x018464 thru 0x022aa3 (0xa640 bytes) 000651 1780533725.188266 write 0x0043b2 thru 0x00d0b8 (0x8d07 bytes) 000653 1780533725.189307 trunc from 0x040000 to 0x0040d4 (0x3bf2b bytes) 000655 1780533725.198894 write 0x031b22 thru 0x036f9d (0x547c bytes) 000656 1780533725.199750 trunc from 0x036f9e to 0x02ed9f (0x81fe bytes) 000659 1780533725.205039 mapread 0x029cb0 thru 0x02d6ea (0x3a3b bytes) 000663 1780533725.209497 read 0x018428 thru 0x01ed7a (0x6953 bytes) 000667 1780533725.213877 mapread 0x00ccd8 thru 0x01732d (0xa656 bytes) 000670 1780533725.215768 mapread 0x0234f8 thru 0x0296d9 (0x61e2 bytes) 000672 1780533725.216903 trunc from 0x02eda0 to 0x0267ce (0x85d1 bytes) 000673 1780533725.222491 mapread 0x01e148 thru 0x01f903 (0x17bc bytes) 000674 1780533725.223236 mapwrite 0x03bfbc thru 0x03ffff (0x4044 bytes) 000675 1780533725.247183 write 0x034aa3 thru 0x03ffff (0xb55d bytes) 000676 1780533725.248473 mapwrite 0x035f50 thru 0x03b49f (0x5550 bytes) 000677 1780533725.262093 read 0x00a090 thru 0x011213 (0x7184 bytes) 000678 1780533725.262522 write 0x002efe thru 0x00353a (0x63d bytes) 000679 1780533725.263151 mapwrite 0x02e105 thru 0x039c8c (0xbb88 bytes) 000680 1780533725.279816 trunc from 0x040000 to 0x017d2d (0x282d2 bytes) 000682 1780533725.285222 write 0x008b70 thru 0x01338d (0xa81e bytes) 000683 1780533725.286060 read 0x00bdd7 thru 0x0147da (0x8a04 bytes) 000684 1780533725.286423 mapwrite 0x036b96 thru 0x03a328 (0x3793 bytes) 000686 1780533725.306542 read 0x025ca6 thru 0x02a4c6 (0x4821 bytes) 000687 1780533725.306986 mapread 0x011cbd thru 0x01b6c7 (0x9a0b bytes) 000688 1780533725.307751 trunc from 0x03a329 to 0x039636 (0xcf2 bytes) 000690 1780533725.312524 read 0x02eb6f thru 0x037569 (0x89fb bytes) 000692 1780533725.313289 read 0x010ce3 thru 0x011c3e (0xf5c bytes) 000693 1780533725.313619 read 0x0066d6 thru 0x007bb6 (0x14e1 bytes) 000694 1780533725.314005 trunc from 0x039637 to 0x03c9e9 (0x33b3 bytes) 000696 1780533725.318804 write 0x02745d thru 0x02fcdd (0x8881 bytes) 000699 1780533725.321132 read 0x003f2e thru 0x00a03d (0x6110 bytes) 000704 1780533725.324013 write 0x02d78a thru 0x03d43c (0xfcb3 bytes) 000705 1780533725.325449 write 0x02a782 thru 0x038b73 (0xe3f2 bytes) 000706 1780533725.326269 mapwrite 0x006402 thru 0x007b4d (0x174c bytes) 000707 1780533725.338588 mapwrite 0x03fd1f thru 0x03ffff (0x2e1 bytes) 000708 1780533725.353467 mapwrite 0x03b745 thru 0x03ffff (0x48bb bytes) 000709 1780533725.365323 write 0x00542e thru 0x00a104 (0x4cd7 bytes) 000710 1780533725.367506 MIRROR_EXTEND to 2 mirrors 000714 1780533725.520175 MIRROR_RESYNC 2 mirrors 000716 1780533725.625637 read 0x00a1ac thru 0x00aced (0xb42 bytes) 000721 1780533725.628088 trunc from 0x040000 to 0x01501f (0x2afe0 bytes) 000723 1780533725.652087 mapwrite 0x021e9c thru 0x02ed19 (0xce7e bytes) 000724 1780533725.677514 read 0x01cefe thru 0x0298e4 (0xc9e7 bytes) 000725 1780533725.678120 trunc from 0x02ed1a to 0x002ed7 (0x2be42 bytes) 000728 1780533725.683666 mapwrite 0x0003df thru 0x00a36c (0x9f8e bytes) 000730 1780533725.705135 read 0x0002e7 thru 0x00a36c (0xa086 bytes) 000734 1780533725.707215 trunc from 0x00a36d to 0x016aeb (0xc77f bytes) 000735 1780533725.712294 mapread 0x010ff6 thru 0x016aeb (0x5af6 bytes) 000736 1780533725.715592 trunc from 0x016aec to 0x029c64 (0x13179 bytes) 000737 1780533725.720049 trunc from 0x029c65 to 0x00c389 (0x1d8db bytes) 000738 1780533725.726034 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xc38a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc38a): Mirror 2: 0x2132fb88 (stale) CRC-32 checksum value for chunk [0, 0xc38a): Mirror 1: 0x986ba085 Mirror 3: 0x986ba085 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc38a: skipped 000741 1780533725.908759 trunc from 0x00c38a to 0x0333fd (0x27074 bytes) 000743 1780533725.932529 read 0x031cfc thru 0x0333fd (0x1702 bytes) 000745 1780533725.936433 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x333fe): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x333fe): Mirror 2: 0x6c555d4e (stale) Mirror 3: 0xc6a0a796 (stale) CRC-32 checksum value for chunk [0, 0x333fe): Mirror 1: 0xc6a0a796 Mirror 4: 0xc6a0a796 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x333fe: skipped 000747 1780533726.172114 mapread 0x002ab4 thru 0x010123 (0xd670 bytes) 000750 1780533726.184089 trunc from 0x0333fe to 0x0136b5 (0x1fd48 bytes) 000751 1780533726.202450 mapwrite 0x006b00 thru 0x0111dd (0xa6de bytes) 000755 1780533726.219593 mapread 0x005a46 thru 0x0073b6 (0x1971 bytes) 000756 1780533726.220340 trunc from 0x0136b6 to 0x00a222 (0x9493 bytes) 000757 1780533726.225442 mapwrite 0x0010f2 thru 0x002318 (0x1227 bytes) 000760 1780533726.239202 MIRROR_RESYNC 4 mirrors 000761 1780533726.431318 mapread 0x004820 thru 0x00a222 (0x5a03 bytes) 000765 1780533726.436604 mapread 0x00483e thru 0x007ff4 (0x37b7 bytes) 000767 1780533726.437195 mapwrite 0x0108c1 thru 0x01bacc (0xb20c bytes) 000768 1780533726.476891 MIRROR_RESYNC 4 mirrors 000769 1780533726.653170 read 0x003123 thru 0x00c1d8 (0x90b6 bytes) 000770 1780533726.655575 read 0x01464a thru 0x0146b8 (0x6f bytes) 000771 1780533726.659959 MIRROR_EXTEND to 5 mirrors 000773 1780533726.797509 trunc from 0x01bacd to 0x0375ca (0x1bafe bytes) 000777 1780533726.821890 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x375cb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x375cb): Mirror 2: 0xcb394569 (stale) Mirror 3: 0xcb394569 (stale) Mirror 4: 0xcb394569 (stale) Mirror 5: 0xcb394569 (stale) CRC-32 checksum value for chunk [0, 0x375cb): Mirror 1: 0xcb394569 Mirror 6: 0xcb394569 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x375cb: skipped 000778 1780533727.036797 mapread 0x02aaf7 thru 0x035f1e (0xb428 bytes) 000779 1780533727.044110 write 0x00c7ed thru 0x017697 (0xaeab bytes) 000781 1780533727.064194 trunc from 0x0375cb to 0x036778 (0xe52 bytes) 000784 1780533727.074185 write 0x02a000 thru 0x030006 (0x6007 bytes) 000788 1780533727.079100 MIRROR_RESYNC 6 mirrors 000789 1780533727.343016 mapread 0x01a6a5 thru 0x027e08 (0xd764 bytes) 000790 1780533727.349405 read 0x01db86 thru 0x02bf59 (0xe3d4 bytes) 000794 1780533727.350429 mapread 0x00c8fa thru 0x016efe (0xa605 bytes) 000796 1780533727.353386 trunc from 0x036779 to 0x03d61e (0x6ea6 bytes) 000797 1780533727.371164 mapread 0x034511 thru 0x03c174 (0x7c64 bytes) 000803 1780533727.376341 write 0x03a330 thru 0x03f960 (0x5631 bytes) 000804 1780533727.378733 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f961): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f961): Mirror 2: 0x44d97ff3 (stale) Mirror 3: 0x44d97ff3 (stale) Mirror 4: 0x44d97ff3 (stale) Mirror 5: 0x44d97ff3 (stale) Mirror 6: 0x44d97ff3 (stale) CRC-32 checksum value for chunk [0, 0x3f961): Mirror 1: 0xf6ff7328 Mirror 7: 0xf6ff7328 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f961: skipped 000805 1780533727.607949 write 0x001dc3 thru 0x00629d (0x44db bytes) 000806 1780533727.627537 trunc from 0x03f961 to 0x000ae2 (0x3ee7e bytes) 000807 1780533727.637873 MIRROR_RESYNC 7 mirrors 000809 1780533727.860654 mapread 0x000309 thru 0x000ae2 (0x7da bytes) 000810 1780533727.863064 write 0x02421b thru 0x031fe9 (0xddcf bytes) 000811 1780533727.880149 read 0x0313d7 thru 0x031fe9 (0xc13 bytes) 000813 1780533727.881016 mapwrite 0x03a9ba thru 0x03d04c (0x2693 bytes) 000815 1780533727.907146 trunc from 0x03d04d to 0x037fde (0x506e bytes) 000816 1780533727.912101 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x37fdf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37fdf): Mirror 2: 0xabf10581 (stale) Mirror 3: 0xabf10581 (stale) Mirror 4: 0xabf10581 (stale) Mirror 5: 0xabf10581 (stale) Mirror 6: 0xabf10581 (stale) Mirror 7: 0xabf10581 (stale) CRC-32 checksum value for chunk [0, 0x37fdf): Mirror 1: 0x4a786813 Mirror 8: 0x4a786813 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37fdf: skipped 000817 1780533728.120778 mapwrite 0x006ac4 thru 0x01162b (0xab68 bytes) 000819 1780533728.176299 read 0x002bcc thru 0x00eb65 (0xbf9a bytes) 000820 1780533728.176844 mapread 0x02e38b thru 0x037fde (0x9c54 bytes) 000821 1780533728.181434 read 0x00ea8a thru 0x01516e (0x66e5 bytes) 000822 1780533728.181937 trunc from 0x037fdf to 0x02acd2 (0xd30c bytes) 000825 1780533728.192856 MIRROR_RESYNC 8 mirrors 000826 1780533728.466948 mapwrite 0x03fb8c thru 0x03ffff (0x474 bytes) 000828 1780533728.496121 trunc from 0x040000 to 0x005f93 (0x3a06c bytes) 000830 1780533728.502281 mapread 0x0003f5 thru 0x005f93 (0x5b9f bytes) 000833 1780533728.509362 MIRROR_RESYNC 8 mirrors 000835 1780533728.760010 mapwrite 0x002402 thru 0x005904 (0x3503 bytes) 000836 1780533728.807948 mapwrite 0x03239f thru 0x03ffff (0xdc61 bytes) 000840 1780533728.838313 read 0x02bf1d thru 0x03a449 (0xe52d bytes) 000843 1780533728.839796 read 0x007c77 thru 0x0080ad (0x437 bytes) 000844 1780533728.845213 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa4a147c8 (stale) Mirror 4: 0xa4a147c8 (stale) Mirror 5: 0xa4a147c8 (stale) Mirror 6: 0xa4a147c8 (stale) Mirror 7: 0xa4a147c8 (stale) Mirror 8: 0xa4a147c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa4a147c8 (stale) Mirror 4: 0xa4a147c8 (stale) Mirror 5: 0xa4a147c8 (stale) Mirror 6: 0xa4a147c8 (stale) Mirror 7: 0xa4a147c8 (stale) Mirror 8: 0xa4a147c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000845 1780533728.960705 trunc from 0x040000 to 0x026d42 (0x192bd bytes) 000846 1780533728.965481 write 0x00ab03 thru 0x0175c5 (0xcac3 bytes) 000850 1780533728.970652 write 0x0385c8 thru 0x03ffff (0x7a38 bytes) 000854 1780533728.973593 mapwrite 0x03b184 thru 0x03ffff (0x4e7c bytes) 000855 1780533728.988526 write 0x03ea4d thru 0x03ffff (0x15b3 bytes) 000856 1780533728.989237 trunc from 0x040000 to 0x00fbda (0x30425 bytes) 000858 1780533728.993869 mapread 0x00c95f thru 0x00fbda (0x327c bytes) 000863 1780533728.995951 mapwrite 0x03bbaa thru 0x03e3a9 (0x2800 bytes) 000865 1780533729.013289 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e3aa): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e3aa): Mirror 3: 0x3c4f8945 (stale) Mirror 4: 0x3c4f8945 (stale) Mirror 5: 0x3c4f8945 (stale) Mirror 6: 0x3c4f8945 (stale) Mirror 7: 0x3c4f8945 (stale) Mirror 8: 0x3c4f8945 (stale) CRC-32 checksum value for chunk [0, 0x3e3aa): Mirror 1: 0xef02d064 Mirror 9: 0xef02d064 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e3aa: skipped 000868 1780533729.255298 read 0x0091b1 thru 0x00a80b (0x165b bytes) 000869 1780533729.258567 read 0x02fc40 thru 0x03d05f (0xd420 bytes) 000871 1780533729.265373 read 0x03d372 thru 0x03e3a9 (0x1038 bytes) 000875 1780533729.272259 read 0x019797 thru 0x01f524 (0x5d8e bytes) 000876 1780533729.274950 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e3aa): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e3aa): Mirror 3: 0x3c4f8945 (stale) Mirror 4: 0x3c4f8945 (stale) Mirror 5: 0x3c4f8945 (stale) Mirror 6: 0x3c4f8945 (stale) Mirror 7: 0x3c4f8945 (stale) Mirror 8: 0x3c4f8945 (stale) CRC-32 checksum value for chunk [0, 0x3e3aa): Mirror 1: 0xef02d064 Mirror 9: 0xef02d064 Mirror 10: 0xef02d064 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e3aa: skipped 000877 1780533729.503568 mapread 0x03b7cd thru 0x03c5b6 (0xdea bytes) 000879 1780533729.506752 mapwrite 0x00503e thru 0x00801d (0x2fe0 bytes) 000882 1780533729.553614 mapwrite 0x0144a9 thru 0x02396e (0xf4c6 bytes) 000883 1780533729.571046 mapread 0x021c08 thru 0x029a34 (0x7e2d bytes) 000884 1780533729.573993 trunc from 0x03e3aa to 0x01af7b (0x2342e bytes) 000885 1780533729.579249 write 0x00b6d6 thru 0x00ddf4 (0x271f bytes) 000886 1780533729.580060 read 0x01343d thru 0x017206 (0x3dca bytes) 000887 1780533729.582047 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1af7c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1af7c): Mirror 3: 0x5bca18c1 (stale) Mirror 4: 0x5bca18c1 (stale) Mirror 5: 0x5bca18c1 (stale) Mirror 6: 0x5bca18c1 (stale) Mirror 7: 0x5bca18c1 (stale) Mirror 8: 0x5bca18c1 (stale) Mirror 9: 0xf6c1a9e0 (stale) Mirror 10: 0xf6c1a9e0 (stale) CRC-32 checksum value for chunk [0, 0x1af7c): Mirror 1: 0x979c1c53 Mirror 11: 0x979c1c53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1af7c: skipped 000888 1780533729.795655 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1af7c): Mirror 3: 0x5bca18c1 (stale) Mirror 4: 0x5bca18c1 (stale) Mirror 5: 0x5bca18c1 (stale) Mirror 7: 0x5bca18c1 (stale) Mirror 8: 0x5bca18c1 (stale) Mirror 9: 0xf6c1a9e0 (stale) Mirror 10: 0xf6c1a9e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1af7c): Mirror 3: 0x5bca18c1 (stale) Mirror 4: 0x5bca18c1 (stale) Mirror 5: 0x5bca18c1 (stale) Mirror 7: 0x5bca18c1 (stale) Mirror 8: 0x5bca18c1 (stale) Mirror 9: 0xf6c1a9e0 (stale) Mirror 10: 0xf6c1a9e0 (stale) CRC-32 checksum value for chunk [0, 0x1af7c): Mirror 1: 0x979c1c53 Mirror 11: 0x979c1c53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1af7c: skipped 000890 1780533729.987560 write 0x02d177 thru 0x02da78 (0x902 bytes) 000892 1780533730.007380 write 0x00c138 thru 0x019290 (0xd159 bytes) 000893 1780533730.010907 mapwrite 0x00c4b0 thru 0x00e6fc (0x224d bytes) 000894 1780533730.033507 trunc from 0x02da79 to 0x00fe18 (0x1dc60 bytes) 000895 1780533730.043432 mapwrite 0x03cc7a thru 0x03ffff (0x3386 bytes) 000896 1780533730.061151 read 0x035d26 thru 0x03ffff (0xa2da bytes) 000897 1780533730.062941 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa4a147c8 (stale) Mirror 4: 0xa4a147c8 (stale) Mirror 5: 0xa4a147c8 (stale) Mirror 7: 0xa4a147c8 (stale) Mirror 8: 0xa4a147c8 (stale) Mirror 9: 0x2bb035c (stale) Mirror 11: 0x44fa5fed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa4a147c8 (stale) Mirror 4: 0xa4a147c8 (stale) Mirror 5: 0xa4a147c8 (stale) Mirror 7: 0xa4a147c8 (stale) Mirror 8: 0xa4a147c8 (stale) Mirror 9: 0x2bb035c (stale) Mirror 11: 0x44fa5fed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000899 1780533730.177310 read 0x010aea thru 0x01ae56 (0xa36d bytes) 000901 1780533730.180090 mapread 0x03802c thru 0x03ffff (0x7fd4 bytes) 000903 1780533730.185937 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa4a147c8 (stale) Mirror 4: 0xa4a147c8 (stale) Mirror 5: 0xa4a147c8 (stale) Mirror 7: 0xa4a147c8 (stale) Mirror 8: 0xa4a147c8 (stale) Mirror 9: 0x2bb035c (stale) Mirror 11: 0x44fa5fed (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6e88e7da Mirror 12: 0x6e88e7da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000904 1780533730.405261 read 0x010a5b thru 0x019b3a (0x90e0 bytes) 000905 1780533730.409427 read 0x036a45 thru 0x038c0c (0x21c8 bytes) 000906 1780533730.413223 write 0x03286e thru 0x0368a3 (0x4036 bytes) 000907 1780533730.434053 read 0x012902 thru 0x01c9b4 (0xa0b3 bytes) 000908 1780533730.437465 read 0x036b3f thru 0x03dc6b (0x712d bytes) 000909 1780533730.437954 read 0x00cb5b thru 0x01aa19 (0xdebf bytes) 000912 1780533730.439186 read 0x022f0f thru 0x025c03 (0x2cf5 bytes) 000913 1780533730.439603 trunc from 0x040000 to 0x02180c (0x1e7f3 bytes) 000914 1780533730.448660 read 0x00ed89 thru 0x010eed (0x2165 bytes) 000916 1780533730.449509 write 0x0268bd thru 0x02df41 (0x7685 bytes) 000919 1780533730.451092 trunc from 0x02df42 to 0x00c35f (0x21be2 bytes) 000920 1780533730.455000 write 0x03f70f thru 0x03ffff (0x8f1 bytes) 000921 1780533730.455626 read 0x026752 thru 0x02a77c (0x402b bytes) 000923 1780533730.458519 mapwrite 0x029142 thru 0x037f46 (0xee05 bytes) 000926 1780533730.472761 write 0x02e9c6 thru 0x03e3f8 (0xfa33 bytes) 000928 1780533730.474094 write 0x03d66e thru 0x03ffff (0x2992 bytes) 000929 1780533730.474790 trunc from 0x040000 to 0x02dfac (0x12053 bytes) 000930 1780533730.479369 mapread 0x013ee5 thru 0x01db13 (0x9c2f bytes) 000931 1780533730.480229 mapread 0x02dd11 thru 0x02dfac (0x29c bytes) 000933 1780533730.482673 MIRROR_RESYNC 9 mirrors 000937 1780533730.783222 trunc from 0x02dfad to 0x00a767 (0x23845 bytes) 000939 1780533730.807649 MIRROR_RESYNC 9 mirrors 000940 1780533731.069153 read 0x003558 thru 0x006b29 (0x35d2 bytes) 000942 1780533731.071233 mapwrite 0x00780a thru 0x012db9 (0xb5b0 bytes) 000943 1780533731.114597 mapwrite 0x01db4c thru 0x028e47 (0xb2fc bytes) 000945 1780533731.137171 read 0x018231 thru 0x01ad56 (0x2b26 bytes) 000946 1780533731.138893 MIRROR_RESYNC 9 mirrors 000947 1780533731.408742 read 0x00bcb8 thru 0x01a377 (0xe6c0 bytes) 000950 1780533731.411980 write 0x02fdf1 thru 0x0363b5 (0x65c5 bytes) 000951 1780533731.429067 write 0x0122e1 thru 0x014dd6 (0x2af6 bytes) 000953 1780533731.433521 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x363b6): Mirror 4: 0x46664202 (stale) Mirror 5: 0x46664202 (stale) Mirror 7: 0x46664202 (stale) Mirror 8: 0x46664202 (stale) Mirror 9: 0x46664202 (stale) Mirror 11: 0x46664202 (stale) Mirror 12: 0x46664202 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x363b6): Mirror 4: 0x46664202 (stale) Mirror 5: 0x46664202 (stale) Mirror 7: 0x46664202 (stale) Mirror 8: 0x46664202 (stale) Mirror 9: 0x46664202 (stale) Mirror 11: 0x46664202 (stale) Mirror 12: 0x46664202 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x363b6: skipped 000956 1780533731.559735 mapread 0x02131a thru 0x02bdaa (0xaa91 bytes) 000958 1780533731.565634 mapwrite 0x012a53 thru 0x0142ad (0x185b bytes) 000960 1780533731.582372 mapread 0x02ab3e thru 0x02ee9c (0x435f bytes) 000962 1780533731.586595 mapread 0x001b8b thru 0x006d14 (0x518a bytes) 000963 1780533731.590160 trunc from 0x0363b6 to 0x028144 (0xe271 bytes) 000964 1780533731.599082 read 0x0111d2 thru 0x02033c (0xf16b bytes) 000965 1780533731.602358 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x28145): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28145): Mirror 4: 0xc9ac55cb (stale) Mirror 5: 0xc9ac55cb (stale) Mirror 7: 0xc9ac55cb (stale) Mirror 8: 0xc9ac55cb (stale) Mirror 9: 0xc9ac55cb (stale) Mirror 11: 0xc9ac55cb (stale) Mirror 12: 0xc9ac55cb (stale) CRC-32 checksum value for chunk [0, 0x28145): Mirror 1: 0x4751502f Mirror 13: 0x4751502f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28145: skipped 000966 1780533731.833506 MIRROR_RESYNC 9 mirrors 000969 1780533732.106133 write 0x026561 thru 0x028259 (0x1cf9 bytes) 000970 1780533732.127734 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2825a): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2825a): Mirror 4: 0xae3b3d1 (stale) Mirror 5: 0xae3b3d1 (stale) Mirror 7: 0xae3b3d1 (stale) Mirror 8: 0xae3b3d1 (stale) Mirror 9: 0xae3b3d1 (stale) Mirror 11: 0xae3b3d1 (stale) Mirror 12: 0xae3b3d1 (stale) Mirror 13: 0xae3b3d1 (stale) CRC-32 checksum value for chunk [0, 0x2825a): Mirror 1: 0x1e6c5d19 Mirror 14: 0x1e6c5d19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2825a: skipped 000971 1780533732.362932 read 0x0266d7 thru 0x028259 (0x1b83 bytes) 000973 1780533732.365070 mapwrite 0x02d9bf thru 0x031f9c (0x45de bytes) 000974 1780533732.405646 mapread 0x01a6bf thru 0x029dab (0xf6ed bytes) 000976 1780533732.411417 trunc from 0x031f9d to 0x02abff (0x739d bytes) 000977 1780533732.418624 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x736:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ac00): Mirror 4: 0x11a01bee (stale) Mirror 5: 0x11a01bee (stale) Mirror 7: 0x11a01bee (stale) Mirror 8: 0x11a01bee (stale) Mirror 9: 0x11a01bee (stale) Mirror 11: 0x11a01bee (stale) Mirror 12: 0x11a01bee (stale) Mirror 14: 0x80c424f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ac00): Mirror 4: 0x11a01bee (stale) Mirror 5: 0x11a01bee (stale) Mirror 7: 0x11a01bee (stale) Mirror 8: 0x11a01bee (stale) Mirror 9: 0x11a01bee (stale) Mirror 11: 0x11a01bee (stale) Mirror 12: 0x11a01bee (stale) Mirror 14: 0x80c424f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ac00: skipped 000979 1780533732.536662 mapread 0x00b0f3 thru 0x017cc4 (0xcbd2 bytes) 000980 1780533732.544123 mapwrite 0x00347b thru 0x0072a1 (0x3e27 bytes) 000985 1780533732.560318 mapread 0x00ff86 thru 0x012080 (0x20fb bytes) 000986 1780533732.561428 mapwrite 0x0177a4 thru 0x01b735 (0x3f92 bytes) 000987 1780533732.573610 write 0x010b45 thru 0x014dd7 (0x4293 bytes) 000989 1780533732.574637 write 0x03d76b thru 0x03ffff (0x2895 bytes) 000991 1780533732.575705 trunc from 0x040000 to 0x01f99c (0x20663 bytes) 000995 1780533732.581111 trunc from 0x01f99d to 0x0353cf (0x15a33 bytes) 000998 1780533732.585504 trunc from 0x0353d0 to 0x029c1c (0xb7b3 bytes) 001000 1780533732.590862 MIRROR_RESYNC 9 mirrors All operations completed A-OK!