== sanity-flr test 70a: flr mode fsx test ================ 16:44:30 (1789073070) Seed set to 3072 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x340bb 000001 1789073073.233916 trunc from 00000000 to 0x0340ba (0x340bb bytes) 000004 1789073073.256908 write 0x03fb8c thru 0x03ffff (0x474 bytes) 000005 1789073073.259082 mapread 0x0334a6 thru 0x03bdb2 (0x890d bytes) 000006 1789073073.278515 mapwrite 0x00df95 thru 0x00f255 (0x12c1 bytes) 000009 1789073073.339263 mapread 0x00c9e8 thru 0x0147af (0x7dc8 bytes) 000011 1789073073.340641 write 0x029814 thru 0x030a1f (0x720c bytes) 000015 1789073073.349190 mapread 0x0293c1 thru 0x038ed5 (0xfb15 bytes) 000021 1789073073.354399 trunc from 0x040000 to 0x02c5ac (0x13a53 bytes) 000024 1789073073.375334 mapread 0x019889 thru 0x01ba90 (0x2208 bytes) 000027 1789073073.390233 mapwrite 0x032c77 thru 0x03ffff (0xd389 bytes) truncating to largest ever: 0x36904 000028 1789073073.461564 trunc from 0x040000 to 0x036903 (0x96fc bytes) 000029 1789073073.479515 write 0x022b3f thru 0x02ea67 (0xbf29 bytes) 000030 1789073073.485521 trunc from 0x036904 to 0x0038ad (0x33056 bytes) 000031 1789073073.506205 trunc from 0x0038ae to 0x0130b0 (0xf803 bytes) 000036 1789073073.529155 write 0x0074f3 thru 0x016d09 (0xf817 bytes) 000037 1789073073.534403 read 0x00607b thru 0x007355 (0x12db bytes) 000038 1789073073.539311 mapread 0x011b5b thru 0x016d09 (0x51af bytes) 000041 1789073073.542895 read 0x00f078 thru 0x016d09 (0x7c92 bytes) 000042 1789073073.543524 trunc from 0x016d0a to 0x01d73e (0x6a35 bytes) 000045 1789073073.575108 write 0x0099d3 thru 0x01972a (0xfd58 bytes) 000046 1789073073.589865 mapwrite 0x01fa08 thru 0x022c6c (0x3265 bytes) 000047 1789073073.686521 read 0x00f5bc thru 0x01944c (0x9e91 bytes) 000049 1789073073.696709 mapwrite 0x035f26 thru 0x039888 (0x3963 bytes) 000050 1789073073.782567 read 0x013b3f thru 0x01e4d4 (0xa996 bytes) 000051 1789073073.783118 mapread 0x01026d thru 0x012eae (0x2c42 bytes) 000053 1789073073.784595 mapwrite 0x017361 thru 0x01cf54 (0x5bf4 bytes) 000055 1789073073.839313 read 0x022f57 thru 0x02c8cd (0x9977 bytes) 000057 1789073073.840473 read 0x01d92c thru 0x01eab9 (0x118e bytes) 000059 1789073073.842215 write 0x00050a thru 0x007d24 (0x781b bytes) 000061 1789073073.843616 trunc from 0x039889 to 0x026581 (0x13307 bytes) 000062 1789073073.861724 read 0x017f4a thru 0x026581 (0xe638 bytes) 000064 1789073073.862888 write 0x0116d3 thru 0x0132c1 (0x1bef bytes) 000065 1789073073.863763 trunc from 0x026582 to 0x01c1f7 (0xa38a bytes) 000066 1789073073.877938 mapwrite 0x00ce6e thru 0x015a31 (0x8bc4 bytes) 000068 1789073073.945947 mapwrite 0x00a0d4 thru 0x00c1e7 (0x2114 bytes) 000071 1789073074.063560 mapwrite 0x00892c thru 0x015bf1 (0xd2c6 bytes) 000072 1789073074.129007 mapwrite 0x03ba4b thru 0x03ffff (0x45b5 bytes) 000073 1789073074.215264 trunc from 0x040000 to 0x032d6a (0xd295 bytes) 000074 1789073074.236310 read 0x003be4 thru 0x00d7e7 (0x9c04 bytes) 000075 1789073074.237310 write 0x023c47 thru 0x025a5f (0x1e19 bytes) 000077 1789073074.243070 MIRROR_EXTEND to 2 mirrors 000078 1789073075.351877 mapread 0x02a42c thru 0x031a22 (0x75f7 bytes) 000080 1789073075.401158 mapread 0x009ee6 thru 0x00b93c (0x1a57 bytes) 000081 1789073075.413087 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000084 1789073075.622059 mapwrite 0x026ae3 thru 0x0280bb (0x15d9 bytes) 000085 1789073075.686946 trunc from 0x032d6b to 0x0302af (0x2abb bytes) 000086 1789073075.698399 trunc from 0x0302b0 to 0x010ae4 (0x1f7cb bytes) 000089 1789073075.712172 read 0x00dadc thru 0x010ae4 (0x3009 bytes) truncating to largest ever: 0x3c114 000092 1789073075.718196 trunc from 0x010ae5 to 0x03c113 (0x2b62f bytes) 000094 1789073075.727118 write 0x039bbe thru 0x03ffff (0x6442 bytes) 000096 1789073075.730333 mapwrite 0x028099 thru 0x0330d8 (0xb040 bytes) 000097 1789073075.804488 mapread 0x0204f2 thru 0x026602 (0x6111 bytes) 000098 1789073075.818642 mapwrite 0x02dd4d thru 0x039e68 (0xc11c bytes) 000100 1789073075.896840 mapread 0x031dc3 thru 0x03c4bf (0xa6fd bytes) 000104 1789073075.901821 trunc from 0x040000 to 0x00bbc4 (0x3443b bytes) 000105 1789073075.927722 MIRROR_EXTEND to 2 mirrors 000106 1789073076.713955 read 0x007d52 thru 0x00bbc4 (0x3e73 bytes) 000107 1789073076.735006 mapwrite 0x03d801 thru 0x03ffff (0x27ff bytes) 000108 1789073076.893927 mapwrite 0x03d0df thru 0x03ffff (0x2f21 bytes) 000111 1789073076.939384 trunc from 0x040000 to 0x02f50b (0x10af4 bytes) 000112 1789073076.971622 read 0x01fefc thru 0x022883 (0x2988 bytes) 000113 1789073076.988247 mapread 0x00f7d6 thru 0x011892 (0x20bd bytes) 000115 1789073077.002116 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000116 1789073077.225577 write 0x01a189 thru 0x0211ee (0x7066 bytes) 000118 1789073077.239425 mapread 0x02bf03 thru 0x02f50b (0x3609 bytes) 000121 1789073077.272320 read 0x01273f thru 0x0184ce (0x5d90 bytes) 000122 1789073077.279412 read 0x020175 thru 0x022317 (0x21a3 bytes) 000123 1789073077.291234 read 0x024923 thru 0x025ecb (0x15a9 bytes) 000124 1789073077.291924 mapwrite 0x0164e8 thru 0x022168 (0xbc81 bytes) 000126 1789073077.343341 mapread 0x022a9d thru 0x0247cd (0x1d31 bytes) 000127 1789073077.344201 read 0x021a77 thru 0x02b582 (0x9b0c bytes) 000129 1789073077.345641 trunc from 0x02f50c to 0x02c00f (0x34fc bytes) 000131 1789073077.365014 trunc from 0x02c010 to 0x006742 (0x258cd bytes) 000135 1789073077.385248 write 0x02780f thru 0x032176 (0xa968 bytes) 000136 1789073077.386848 read 0x00be68 thru 0x0175e4 (0xb77d bytes) 000137 1789073077.400998 trunc from 0x032177 to 0x026f62 (0xb214 bytes) 000140 1789073077.466532 read 0x019e21 thru 0x026f62 (0xd142 bytes) 000142 1789073077.467589 write 0x0025fb thru 0x00a23c (0x7c42 bytes) 000143 1789073077.468784 mapread 0x002e7c thru 0x0105c6 (0xd74b bytes) 000146 1789073077.471261 mapwrite 0x008901 thru 0x016f13 (0xe613 bytes) 000147 1789073077.560936 mapwrite 0x01baeb thru 0x027128 (0xb63e bytes) 000148 1789073077.661471 read 0x00920b thru 0x018e78 (0xfc6e bytes) 000150 1789073077.664355 read 0x021e1e thru 0x027128 (0x530b bytes) 000151 1789073077.665177 trunc from 0x027129 to 0x01ec06 (0x8522 bytes) 000152 1789073077.690889 read 0x009a25 thru 0x012fbb (0x9597 bytes) 000154 1789073077.691956 write 0x013ecc thru 0x016c9c (0x2dd1 bytes) 000159 1789073077.696071 mapread 0x01e9cc thru 0x01ec06 (0x23b bytes) 000160 1789073077.696883 read 0x017236 thru 0x01ec06 (0x79d1 bytes) 000162 1789073077.709260 MIRROR_EXTEND to 2 mirrors 000163 1789073079.244225 MIRROR_EXTEND to 3 mirrors 000164 1789073080.506054 mapwrite 0x030be9 thru 0x032b7f (0x1f97 bytes) 000165 1789073080.887309 trunc from 0x032b80 to 0x003017 (0x2fb68 bytes) 000168 1789073080.943188 trunc from 0x003018 to 0x012cfb (0xfce4 bytes) 000172 1789073081.000557 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12cfc): Mirror 3: 0x1722b248 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12cfc): Mirror 3: 0x1722b248 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12cfc: skipped 000173 1789073081.251549 mapwrite 0x024f91 thru 0x02d71d (0x878d bytes) 000174 1789073081.336854 mapwrite 0x030208 thru 0x037083 (0x6e7c bytes) 000175 1789073081.419043 mapwrite 0x0081f2 thru 0x013b60 (0xb96f bytes) 000179 1789073081.487128 write 0x01f81e thru 0x02ecbe (0xf4a1 bytes) 000180 1789073081.488560 mapwrite 0x0295be thru 0x02c789 (0x31cc bytes) truncating to largest ever: 0x3de01 000181 1789073081.519098 trunc from 0x037084 to 0x03de00 (0x6d7d bytes) 000182 1789073081.549687 mapread 0x0159ad thru 0x0251df (0xf833 bytes) 000183 1789073081.567939 MIRROR_RESYNC 2 mirrors 000185 1789073082.361189 mapwrite 0x01c96d thru 0x026ea7 (0xa53b bytes) 000186 1789073082.501497 trunc from 0x03de01 to 0x0312ff (0xcb01 bytes) 000188 1789073082.524424 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31300): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31300): Mirror 3: 0x14c41910 (stale) CRC-32 checksum value for chunk [0, 0x31300): Mirror 1: 0x49202d0f Mirror 4: 0x49202d0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31300: skipped 000190 1789073084.036761 mapwrite 0x008df9 thru 0x00d1fd (0x4405 bytes) 000191 1789073084.272432 mapread 0x004317 thru 0x00666f (0x2359 bytes) 000192 1789073084.274337 mapread 0x000a92 thru 0x001fd6 (0x1545 bytes) 000193 1789073084.285524 read 0x01e85d thru 0x02d2b4 (0xea58 bytes) 000194 1789073084.319848 write 0x00b2e5 thru 0x0151ac (0x9ec8 bytes) 000195 1789073084.333035 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31300): Mirror 3: 0x14c41910 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31300): Mirror 3: 0x14c41910 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31300: skipped 000197 1789073084.763568 trunc from 0x031300 to 0x024dec (0xc513 bytes) 000198 1789073084.799205 read 0x01db17 thru 0x024dec (0x72d6 bytes) 000199 1789073084.814147 mapwrite 0x00383d thru 0x012c78 (0xf43c bytes) 000200 1789073084.888952 mapwrite 0x01d5b7 thru 0x021df2 (0x483c bytes) 000203 1789073085.016320 mapwrite 0x035589 thru 0x03fc38 (0xa6b0 bytes) 000204 1789073085.121119 mapwrite 0x02867c thru 0x02b448 (0x2dcd bytes) 000205 1789073085.205244 read 0x02f502 thru 0x031e55 (0x2954 bytes) 000207 1789073085.212511 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000212 1789073085.434476 mapread 0x0380fd thru 0x03fc38 (0x7b3c bytes) 000213 1789073085.451062 trunc from 0x03fc39 to 0x003efa (0x3bd3e bytes) 000214 1789073085.467964 mapread 0x000963 thru 0x003efa (0x3598 bytes) 000215 1789073085.482216 read 0x000f53 thru 0x003efa (0x2fa8 bytes) 000216 1789073085.483146 trunc from 0x003efb to 0x020c32 (0x1cd38 bytes) 000217 1789073085.543883 MIRROR_EXTEND to 2 mirrors 000218 1789073086.781503 trunc from 0x020c33 to 0x006635 (0x1a5fd bytes) 000221 1789073086.992305 mapwrite 0x03dd6c thru 0x03ffff (0x2294 bytes) 000222 1789073087.120406 mapread 0x01c111 thru 0x020c8f (0x4b7f bytes) 000223 1789073087.161136 mapread 0x01e962 thru 0x02c667 (0xdd06 bytes) 000224 1789073087.176235 mapread 0x0072dc thru 0x00f323 (0x8048 bytes) 000229 1789073087.227137 write 0x019fed thru 0x01e116 (0x412a bytes) 000230 1789073087.233261 mapread 0x02f95d thru 0x034c81 (0x5325 bytes) 000231 1789073087.256474 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000233 1789073087.440493 read 0x020df6 thru 0x02868a (0x7895 bytes) 000236 1789073087.457006 read 0x01a555 thru 0x023b02 (0x95ae bytes) 000239 1789073087.470241 read 0x004d38 thru 0x007316 (0x25df bytes) 000240 1789073087.470987 read 0x0358ba thru 0x03ffff (0xa746 bytes) 000243 1789073087.472738 trunc from 0x040000 to 0x039607 (0x69f8 bytes) 000244 1789073087.481024 mapread 0x01bae7 thru 0x024ee4 (0x93fe bytes) 000247 1789073087.482760 trunc from 0x039608 to 0x032cf7 (0x6910 bytes) 000248 1789073087.491076 trunc from 0x032cf8 to 0x01a45d (0x1889a bytes) 000249 1789073087.499770 write 0x002637 thru 0x010151 (0xdb1b bytes) 000252 1789073087.502507 mapread 0x00acf2 thru 0x0176a8 (0xc9b7 bytes) 000254 1789073087.504883 mapread 0x00dcff thru 0x0138b9 (0x5bbb bytes) 000256 1789073087.507026 trunc from 0x01a45e to 0x022998 (0x853b bytes) 000259 1789073087.521136 write 0x029063 thru 0x02fa10 (0x69ae bytes) 000262 1789073087.523827 read 0x013a4c thru 0x01c7a9 (0x8d5e bytes) 000264 1789073087.532786 trunc from 0x02fa11 to 0x025d4b (0x9cc5 bytes) 000265 1789073087.570080 read 0x010c0e thru 0x020b5a (0xff4d bytes) 000268 1789073087.571841 mapread 0x01be0c thru 0x025d4b (0x9f40 bytes) 000269 1789073087.580537 mapwrite 0x011fcc thru 0x018abd (0x6af2 bytes) 000270 1789073087.683300 mapwrite 0x01b7f5 thru 0x02363e (0x7e4a bytes) 000272 1789073087.796432 write 0x0126a8 thru 0x015411 (0x2d6a bytes) 000273 1789073087.797770 write 0x005072 thru 0x007094 (0x2023 bytes) 000276 1789073087.800980 mapwrite 0x02d88f thru 0x038ec2 (0xb634 bytes) 000279 1789073087.902893 mapwrite 0x02e336 thru 0x03adab (0xca76 bytes) 000283 1789073088.067903 trunc from 0x03adac to 0x0184aa (0x22901 bytes) 000287 1789073088.099453 read 0x01210b thru 0x014329 (0x221f bytes) 000288 1789073088.100312 mapwrite 0x00cbe0 thru 0x019a8e (0xceaf bytes) 000291 1789073088.195459 mapread 0x00f0a0 thru 0x00fb62 (0xac3 bytes) 000293 1789073088.202467 write 0x0079bb thru 0x00a768 (0x2dae bytes) 000294 1789073088.205100 mapwrite 0x022071 thru 0x031d8e (0xfd1e bytes) 000297 1789073088.326445 MIRROR_EXTEND to 2 mirrors 000298 1789073089.029428 write 0x018576 thru 0x022f36 (0xa9c1 bytes) 000301 1789073089.121242 read 0x00e4c0 thru 0x019574 (0xb0b5 bytes) 000302 1789073089.128807 trunc from 0x031d8f to 0x0046ce (0x2d6c0 bytes) 000303 1789073089.178406 mapwrite 0x03ae72 thru 0x03ffff (0x518e bytes) 000305 1789073089.283123 read 0x025adf thru 0x02e60e (0x8b30 bytes) 000306 1789073089.297838 trunc from 0x040000 to 0x015d9a (0x2a265 bytes) 000308 1789073089.322837 mapwrite 0x03313f thru 0x03fa95 (0xc957 bytes) 000309 1789073089.518120 trunc from 0x03fa96 to 0x0065c1 (0x394d4 bytes) 000311 1789073089.533088 mapread 0x005211 thru 0x0065c1 (0x13b1 bytes) 000312 1789073089.534375 write 0x014116 thru 0x01eae5 (0xa9d0 bytes) 000315 1789073089.537929 write 0x003436 thru 0x009a81 (0x664c bytes) 000316 1789073089.542130 write 0x0355ed thru 0x03ec60 (0x9674 bytes) 000317 1789073089.543614 write 0x03c334 thru 0x03ffff (0x3ccc bytes) 000318 1789073089.545236 trunc from 0x040000 to 0x01d369 (0x22c96 bytes) 000321 1789073089.570235 write 0x0392a9 thru 0x03ffff (0x6d57 bytes) 000322 1789073089.577299 read 0x00e445 thru 0x019f71 (0xbb2d bytes) 000325 1789073089.595811 mapread 0x02a8f7 thru 0x033a3b (0x9145 bytes) 000330 1789073089.614031 write 0x006219 thru 0x00d968 (0x7750 bytes) 000331 1789073089.617142 mapwrite 0x02bc41 thru 0x03246a (0x682a bytes) 000333 1789073089.733893 mapread 0x009103 thru 0x010537 (0x7435 bytes) 000334 1789073089.739283 trunc from 0x040000 to 0x02d045 (0x12fba bytes) 000335 1789073089.776117 mapread 0x00dc7c thru 0x013091 (0x5416 bytes) 000336 1789073089.777519 mapwrite 0x035fe8 thru 0x03ccef (0x6d08 bytes) 000337 1789073090.045789 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ccf0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ccf0): Mirror 2: 0xb2ba0452 (stale) CRC-32 checksum value for chunk [0, 0x3ccf0): Mirror 1: 0xed3adc1b Mirror 3: 0xed3adc1b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ccf0: skipped 000338 1789073091.458186 read 0x026d70 thru 0x02f361 (0x85f2 bytes) 000339 1789073091.482415 mapwrite 0x03cb05 thru 0x03ffff (0x34fb bytes) 000343 1789073091.744529 read 0x02e131 thru 0x033e4c (0x5d1c bytes) 000344 1789073091.761962 write 0x008dd0 thru 0x012556 (0x9787 bytes) 000346 1789073091.773700 MIRROR_RESYNC 3 mirrors 000347 1789073093.180179 write 0x00d3c1 thru 0x0110bd (0x3cfd bytes) 000349 1789073093.327469 mapread 0x00d258 thru 0x018995 (0xb73e bytes) 000351 1789073093.344455 mapread 0x02e177 thru 0x03511d (0x6fa7 bytes) 000353 1789073093.352242 write 0x03949f thru 0x039842 (0x3a4 bytes) 000354 1789073093.360444 MIRROR_RESYNC 3 mirrors 000356 1789073095.962834 MIRROR_RESYNC 3 mirrors 000357 1789073096.316585 MIRROR_EXTEND to 4 mirrors 000358 1789073097.647983 mapwrite 0x03dca8 thru 0x03ffff (0x2358 bytes) 000359 1789073097.789153 read 0x039225 thru 0x03ffff (0x6ddb bytes) 000360 1789073097.790922 mapread 0x019dea thru 0x01bda3 (0x1fba bytes) 000361 1789073097.801064 mapread 0x03927b thru 0x03f68f (0x6415 bytes) 000362 1789073097.806138 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa0d93600 (stale) Mirror 3: 0xa0d93600 (stale) Mirror 4: 0xa0d93600 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x14c59ccc Mirror 5: 0x14c59ccc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000363 1789073098.874022 MIRROR_RESYNC 5 mirrors 000364 1789073100.556726 mapread 0x006238 thru 0x00c528 (0x62f1 bytes) 000367 1789073100.573241 MIRROR_RESYNC 5 mirrors 000368 1789073100.952325 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000369 1789073101.278551 trunc from 0x040000 to 0x005fc8 (0x3a037 bytes) 000370 1789073101.391795 mapwrite 0x014d7b thru 0x014e4a (0xd0 bytes) 000371 1789073101.454095 mapread 0x00814a thru 0x0087e5 (0x69c bytes) 000372 1789073101.459074 mapwrite 0x01635a thru 0x019b23 (0x37ca bytes) 000374 1789073101.502491 write 0x03afa5 thru 0x03ffff (0x505b bytes) 000376 1789073101.504100 trunc from 0x040000 to 0x01db0d (0x224f2 bytes) 000378 1789073101.527339 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1db0e): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1db0e): Mirror 2: 0x56fbb3bb (stale) Mirror 4: 0x56fbb3bb (stale) Mirror 5: 0x56fbb3bb (stale) CRC-32 checksum value for chunk [0, 0x1db0e): Mirror 1: 0x190f4d84 Mirror 6: 0x190f4d84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1db0e: skipped 000379 1789073102.958065 mapread 0x0009ea thru 0x00f529 (0xeb40 bytes) 000380 1789073103.002321 trunc from 0x01db0e to 0x038ade (0x1afd1 bytes) 000382 1789073103.123130 mapwrite 0x02d3a5 thru 0x0305fe (0x325a bytes) 000384 1789073103.187439 read 0x0280ea thru 0x02bedd (0x3df4 bytes) 000386 1789073103.195195 mapwrite 0x022405 thru 0x02eea1 (0xca9d bytes) 000390 1789073103.260570 mapwrite 0x02f5e8 thru 0x03061c (0x1035 bytes) 000392 1789073103.303385 read 0x0367c2 thru 0x038ade (0x231d bytes) 000393 1789073103.314121 write 0x02cb71 thru 0x032052 (0x54e2 bytes) 000394 1789073103.316541 trunc from 0x038adf to 0x02481e (0x142c0 bytes) 000395 1789073103.347056 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2481f): Mirror 2: 0xf3f0c7ca (stale) Mirror 4: 0xf3f0c7ca (stale) Mirror 5: 0xf3f0c7ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2481f): Mirror 2: 0xf3f0c7ca (stale) Mirror 4: 0xf3f0c7ca (stale) Mirror 5: 0xf3f0c7ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2481f: skipped 000398 1789073103.815658 read 0x020e9d thru 0x021e85 (0xfe9 bytes) 000399 1789073103.832444 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2481f): Mirror 2: 0xf3f0c7ca (stale) Mirror 5: 0xf3f0c7ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2481f): Mirror 2: 0xf3f0c7ca (stale) Mirror 5: 0xf3f0c7ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2481f: skipped 000401 1789073104.174368 read 0x009182 thru 0x00a63d (0x14bc bytes) 000402 1789073104.182209 mapwrite 0x01dfcc thru 0x02503c (0x7071 bytes) 000404 1789073104.273352 mapread 0x0036a8 thru 0x00e831 (0xb18a bytes) 000406 1789073104.285108 mapwrite 0x022496 thru 0x029a0e (0x7579 bytes) 000409 1789073104.369006 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29a0f): Mirror 2: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29a0f): Mirror 2: 0xbf7fde45 (stale) Mirror 5: 0xbf7fde45 (stale) CRC-32 checksum value for chunk [0, 0x29a0f): Mirror 1: 0x384ef631 Mirror 6: 0x384ef631 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29a0f: skipped 000412 1789073105.577690 mapread 0x016f4e thru 0x01873e (0x17f1 bytes) 000415 1789073105.598902 read 0x01b933 thru 0x027117 (0xb7e5 bytes) 000417 1789073105.612069 trunc from 0x029a0f to 0x03753e (0xdb30 bytes) 000418 1789073105.750111 write 0x0248f2 thru 0x0304c7 (0xbbd6 bytes) 000419 1789073105.771394 MIRROR_RESYNC 4 mirrors 000420 1789073107.928195 mapwrite 0x01b80d thru 0x0217c3 (0x5fb7 bytes) 000421 1789073108.199608 write 0x035eea thru 0x03ffff (0xa116 bytes) truncating to largest ever: 0x3f828 000422 1789073108.216208 trunc from 0x040000 to 0x03f827 (0x7d8 bytes) 000425 1789073108.252656 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f828): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f828): Mirror 2: 0x3387268d (stale) Mirror 5: 0x3387268d (stale) Mirror 6: 0x3387268d (stale) CRC-32 checksum value for chunk [0, 0x3f828): Mirror 1: 0xa6fb6c80 Mirror 7: 0xa6fb6c80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f828: skipped 000426 1789073109.892653 mapwrite 0x03e102 thru 0x03ffff (0x1efe bytes) 000427 1789073110.010150 mapwrite 0x015257 thru 0x01c1ab (0x6f55 bytes) 000428 1789073110.056639 mapread 0x005c27 thru 0x00ff2c (0xa306 bytes) 000429 1789073110.063933 mapwrite 0x0335d1 thru 0x03ffff (0xca2f bytes) 000431 1789073110.131845 mapread 0x033f55 thru 0x03a51b (0x65c7 bytes) 000434 1789073110.139590 trunc from 0x040000 to 0x011f1a (0x2e0e5 bytes) 000435 1789073110.176338 read 0x00fe8e thru 0x011f1a (0x208d bytes) 000436 1789073110.177032 trunc from 0x011f1b to 0x03509a (0x23180 bytes) 000437 1789073110.217974 read 0x00b2ef thru 0x015e4c (0xab5e bytes) 000445 1789073110.232020 write 0x019f58 thru 0x01f78e (0x5837 bytes) 000450 1789073110.236611 mapread 0x01caec thru 0x01dba9 (0x10be bytes) 000452 1789073110.238194 read 0x01dd79 thru 0x02b8ac (0xdb34 bytes) 000453 1789073110.239299 read 0x01d9ca thru 0x0272f1 (0x9928 bytes) 000457 1789073110.241458 trunc from 0x03509b to 0x021f2a (0x13170 bytes) 000458 1789073110.257055 trunc from 0x021f2b to 0x03b361 (0x19437 bytes) 000459 1789073110.280127 write 0x01d0d8 thru 0x024b98 (0x7ac1 bytes) 000460 1789073110.285517 mapwrite 0x002811 thru 0x009f52 (0x7742 bytes) 000462 1789073110.328239 write 0x00de53 thru 0x016401 (0x85af bytes) 000465 1789073110.331630 read 0x038285 thru 0x03b361 (0x30dd bytes) 000470 1789073110.348493 MIRROR_RESYNC 5 mirrors 000472 1789073112.572885 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000475 1789073112.944941 mapwrite 0x0303b2 thru 0x03da89 (0xd6d8 bytes) 000479 1789073113.186224 mapwrite 0x018776 thru 0x01a01e (0x18a9 bytes) 000481 1789073113.272118 mapwrite 0x03e2fa thru 0x03e780 (0x487 bytes) 000483 1789073113.368881 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e781): Mirror 5: 0x4f6b460f (stale) Mirror 6: 0x4f6b460f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e781): Mirror 5: 0x4f6b460f (stale) Mirror 6: 0x4f6b460f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e781: skipped 000484 1789073113.959904 trunc from 0x03e781 to 0x00e674 (0x3010c bytes) 000485 1789073114.004473 mapwrite 0x00c73f thru 0x016588 (0x9e4a bytes) 000486 1789073114.093842 mapwrite 0x01ba02 thru 0x01f825 (0x3e24 bytes) 000487 1789073114.274139 mapread 0x01a4a5 thru 0x01f825 (0x5381 bytes) 000490 1789073114.285105 trunc from 0x01f826 to 0x02b072 (0xb84d bytes) 000491 1789073114.338401 read 0x01b963 thru 0x01f381 (0x3a1f bytes) 000492 1789073114.339440 read 0x02364f thru 0x02397e (0x330 bytes) 000493 1789073114.351925 write 0x02a70b thru 0x02f150 (0x4a46 bytes) 000495 1789073114.354078 mapwrite 0x0091b3 thru 0x01052a (0x7378 bytes) 000496 1789073114.499786 write 0x03cc60 thru 0x03ffff (0x33a0 bytes) 000499 1789073114.508190 mapread 0x03ac45 thru 0x03bdb6 (0x1172 bytes) 000501 1789073114.538592 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc9d05635 (stale) Mirror 6: 0xc9d05635 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xda081b6d Mirror 7: 0xda081b6d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000502 1789073115.970268 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc9d05635 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc9d05635 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xda081b6d Mirror 7: 0xda081b6d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000504 1789073116.610299 mapwrite 0x0163aa thru 0x018b08 (0x275f bytes) 000505 1789073116.962374 read 0x02e5d5 thru 0x039cb8 (0xb6e4 bytes) 000506 1789073116.995876 write 0x0134e1 thru 0x01d9f9 (0xa519 bytes) 000507 1789073117.000052 write 0x03f366 thru 0x03ffff (0xc9a bytes) 000508 1789073117.011950 mapwrite 0x01c19f thru 0x02b5e3 (0xf445 bytes) 000509 1789073117.159760 mapwrite 0x0082a0 thru 0x00d9d7 (0x5738 bytes) 000510 1789073117.252635 read 0x00f270 thru 0x013c67 (0x49f8 bytes) 000511 1789073117.266522 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc9d05635 (stale) Mirror 7: 0xda081b6d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6b50651e Mirror 8: 0x6b50651e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000512 1789073118.266365 trunc from 0x040000 to 0x034197 (0xbe68 bytes) 000514 1789073118.406326 write 0x033850 thru 0x038c77 (0x5428 bytes) 000515 1789073118.420817 mapwrite 0x030370 thru 0x0390a9 (0x8d3a bytes) 000516 1789073118.519655 trunc from 0x0390aa to 0x007f43 (0x31166 bytes) 000517 1789073118.552906 read 0x002458 thru 0x005983 (0x352c bytes) 000518 1789073118.563832 trunc from 0x007f44 to 0x035a6e (0x2db2b bytes) 000520 1789073118.589221 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35a6f): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a6f): Mirror 6: 0xdd53d33f (stale) Mirror 7: 0x7e957d1c (stale) Mirror 8: 0xa6bf02ee (stale) CRC-32 checksum value for chunk [0, 0x35a6f): Mirror 1: 0xf60b586d Mirror 9: 0xf60b586d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a6f: skipped 000521 1789073120.524539 mapwrite 0x0369d5 thru 0x03e257 (0x7883 bytes) 000523 1789073120.833554 mapwrite 0x03a930 thru 0x03ffff (0x56d0 bytes) 000524 1789073121.068523 read 0x022729 thru 0x02ce22 (0xa6fa bytes) 000525 1789073121.135868 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc9d05635 (stale) Mirror 7: 0xda081b6d (stale) Mirror 8: 0x6b50651e (stale) Mirror 9: 0x29148cb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4b694c50 Mirror 10: 0x4b694c50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000526 1789073123.140958 trunc from 0x040000 to 0x01a2c4 (0x25d3b bytes) 000528 1789073123.289248 mapread 0x00a62c thru 0x015711 (0xb0e6 bytes) 000529 1789073123.346222 write 0x00a400 thru 0x00a676 (0x277 bytes) 000530 1789073123.347923 write 0x030a39 thru 0x039d2c (0x92f4 bytes) 000536 1789073123.370892 read 0x022bfc thru 0x02ff16 (0xd31b bytes) 000539 1789073123.392792 mapwrite 0x0107fc thru 0x014b7b (0x4380 bytes) 000540 1789073123.513369 read 0x0103d6 thru 0x01c49f (0xc0ca bytes) 000543 1789073123.533765 write 0x03ef92 thru 0x03ffff (0x106e bytes) 000544 1789073123.534826 mapread 0x01dc00 thru 0x02b869 (0xdc6a bytes) 000545 1789073123.536064 read 0x03334b thru 0x035097 (0x1d4d bytes) 000546 1789073123.536854 mapread 0x032e9b thru 0x033ad8 (0xc3e bytes) 000548 1789073123.538245 mapread 0x021dc9 thru 0x0264cc (0x4704 bytes) 000550 1789073123.546319 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc9d05635 (stale) Mirror 7: 0xda081b6d (stale) Mirror 8: 0x6b50651e (stale) Mirror 9: 0x29148cb (stale) Mirror 10: 0x4b694c50 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3f1df4e4 Mirror 11: 0x3f1df4e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000551 1789073125.973920 write 0x038508 thru 0x03ffff (0x7af8 bytes) 000552 1789073126.189109 mapread 0x0102f8 thru 0x0173e3 (0x70ec bytes) 000556 1789073126.235615 mapwrite 0x0077d5 thru 0x01030e (0x8b3a bytes) 000558 1789073126.432684 trunc from 0x040000 to 0x0379f2 (0x860d bytes) 000561 1789073126.491554 mapread 0x00ac51 thru 0x010dd5 (0x6185 bytes) 000562 1789073126.495827 mapwrite 0x038bb0 thru 0x03e83f (0x5c90 bytes) 000563 1789073126.689798 write 0x008dec thru 0x00f4d1 (0x66e6 bytes) 000567 1789073126.711538 MIRROR_RESYNC 7 mirrors 000568 1789073129.759901 mapread 0x00bd71 thru 0x0153b2 (0x9642 bytes) 000571 1789073129.781234 trunc from 0x03e840 to 0x01b02d (0x23812 bytes) 000573 1789073129.880271 trunc from 0x01b02e to 0x03e681 (0x23654 bytes) 000574 1789073129.908696 read 0x036aea thru 0x03c160 (0x5677 bytes) 000575 1789073129.915963 mapread 0x0065ee thru 0x006b94 (0x5a7 bytes) 000577 1789073129.924587 mapwrite 0x02e3e5 thru 0x02f928 (0x1544 bytes) 000579 1789073129.975000 mapwrite 0x01b05f thru 0x02a34d (0xf2ef bytes) 000580 1789073130.066166 read 0x030b1f thru 0x03dd2c (0xd20e bytes) 000586 1789073130.084010 read 0x00ac2e thru 0x017437 (0xc80a bytes) 000587 1789073130.085351 trunc from 0x03e682 to 0x026f79 (0x17708 bytes) 000590 1789073130.122974 mapread 0x0126c4 thru 0x0207f2 (0xe12f bytes) 000592 1789073130.133596 mapwrite 0x025aa5 thru 0x0315a3 (0xbaff bytes) 000597 1789073130.313003 mapwrite 0x02acc5 thru 0x0319c1 (0x6cfd bytes) 000598 1789073130.568129 trunc from 0x0319c2 to 0x034235 (0x2874 bytes) 000601 1789073130.614327 mapwrite 0x027d0c thru 0x035b92 (0xde87 bytes) 000602 1789073130.893184 MIRROR_RESYNC 7 mirrors 000604 1789073134.206135 read 0x0195ee thru 0x02677f (0xd192 bytes) 000605 1789073134.213073 mapread 0x017812 thru 0x01d92a (0x6119 bytes) 000606 1789073134.222269 write 0x0237b3 thru 0x02f001 (0xb84f bytes) 000607 1789073134.307809 mapwrite 0x038728 thru 0x03ffff (0x78d8 bytes) 000609 1789073134.381082 read 0x028f1c thru 0x0329cd (0x9ab2 bytes) 000610 1789073134.392943 write 0x02d303 thru 0x037962 (0xa660 bytes) 000611 1789073134.395011 write 0x028f44 thru 0x029b72 (0xc2f bytes) 000612 1789073134.395987 mapread 0x005f85 thru 0x00a728 (0x47a4 bytes) 000613 1789073134.397427 read 0x023ccd thru 0x02aded (0x7121 bytes) 000614 1789073134.398175 trunc from 0x040000 to 0x015565 (0x2aa9a bytes) 000616 1789073134.415641 mapwrite 0x030586 thru 0x03ffff (0xfa7a bytes) 000617 1789073134.488063 mapwrite 0x026330 thru 0x03053e (0xa20f bytes) 000618 1789073134.547818 write 0x03a4af thru 0x03ffff (0x5b51 bytes) 000619 1789073134.548815 mapread 0x00e544 thru 0x01ac22 (0xc6df bytes) 000621 1789073134.555816 MIRROR_RESYNC 7 mirrors 000622 1789073136.027088 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000623 1789073136.437298 trunc from 0x040000 to 0x024e31 (0x1b1ce bytes) 000624 1789073136.526692 mapread 0x008506 thru 0x01381c (0xb317 bytes) 000625 1789073136.550987 trunc from 0x024e32 to 0x031a27 (0xcbf6 bytes) 000627 1789073136.576697 mapread 0x02fdb7 thru 0x031a27 (0x1c71 bytes) 000628 1789073136.585478 mapwrite 0x03578b thru 0x03af58 (0x57ce bytes) 000629 1789073136.660935 mapread 0x008b7c thru 0x0092e2 (0x767 bytes) 000632 1789073136.663452 trunc from 0x03af59 to 0x000e02 (0x3a156 bytes) 000633 1789073136.676497 read 0x000524 thru 0x000e02 (0x8df bytes) 000635 1789073136.684819 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe03): Mirror 7: 0x3500285d (stale) Mirror 8: 0x3500285d (stale) Mirror 10: 0x3500285d (stale) Mirror 11: 0x3500285d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe03): Mirror 7: 0x3500285d (stale) Mirror 8: 0x3500285d (stale) Mirror 10: 0x3500285d (stale) Mirror 11: 0x3500285d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe03: skipped 000636 1789073136.890017 read 0x0005e1 thru 0x000e02 (0x822 bytes) 000637 1789073136.898497 MIRROR_RESYNC 5 mirrors 000638 1789073138.471419 trunc from 0x000e03 to 0x0058d5 (0x4ad3 bytes) 000639 1789073138.714086 read 0x000d92 thru 0x0058d5 (0x4b44 bytes) 000641 1789073138.752625 MIRROR_RESYNC 5 mirrors 000642 1789073141.002541 read 0x0003a2 thru 0x0058d5 (0x5534 bytes) 000643 1789073141.028001 trunc from 0x0058d6 to 0x010b3f (0xb26a bytes) 000645 1789073141.257096 mapread 0x001138 thru 0x00b303 (0xa1cc bytes) 000646 1789073141.291541 write 0x032f30 thru 0x03ffff (0xd0d0 bytes) 000647 1789073141.293414 write 0x00aa36 thru 0x014203 (0x97ce bytes) 000648 1789073141.314987 trunc from 0x040000 to 0x022020 (0x1dfdf bytes) 000649 1789073141.411205 write 0x02e2de thru 0x034274 (0x5f97 bytes) 000651 1789073141.412879 mapread 0x00455c thru 0x0138aa (0xf34f bytes) 000652 1789073141.437178 read 0x022497 thru 0x030a2f (0xe599 bytes) 000654 1789073141.492442 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34275): Mirror 8: 0xaa7a65cb (stale) Mirror 10: 0xaa7a65cb (stale) Mirror 11: 0xaa7a65cb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34275): Mirror 8: 0xaa7a65cb (stale) Mirror 10: 0xaa7a65cb (stale) Mirror 11: 0xaa7a65cb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34275: skipped 000655 1789073142.443025 mapread 0x0096d8 thru 0x00f992 (0x62bb bytes) 000657 1789073142.470526 mapread 0x00045b thru 0x00f692 (0xf238 bytes) 000658 1789073142.483365 write 0x013bcd thru 0x0204ba (0xc8ee bytes) 000660 1789073142.526470 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x34275): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34275): Mirror 8: 0xaa7a65cb (stale) Mirror 10: 0xaa7a65cb (stale) Mirror 11: 0xaa7a65cb (stale) CRC-32 checksum value for chunk [0, 0x34275): Mirror 1: 0x668408d3 Mirror 12: 0x668408d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34275: skipped 000661 1789073144.105975 mapwrite 0x00762b thru 0x00ef5b (0x7931 bytes) 000662 1789073144.457973 mapwrite 0x00023b thru 0x00f942 (0xf708 bytes) 000668 1789073144.593928 write 0x031b4b thru 0x03ffff (0xe4b5 bytes) 000669 1789073144.604859 trunc from 0x040000 to 0x03cd96 (0x3269 bytes) 000670 1789073144.678442 write 0x02aaec thru 0x02bbd1 (0x10e6 bytes) 000672 1789073144.700712 mapwrite 0x03fc8c thru 0x03ffff (0x374 bytes) 000674 1789073144.900995 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9f3d4786 (stale) Mirror 10: 0x9f3d4786 (stale) Mirror 11: 0x9f3d4786 (stale) Mirror 12: 0x875e5d45 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2b5d4ee1 Mirror 13: 0x2b5d4ee1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000675 1789073146.329094 write 0x0101b4 thru 0x0197c6 (0x9613 bytes) 000676 1789073146.488754 read 0x0162ed thru 0x016f95 (0xca9 bytes) 000677 1789073146.489545 trunc from 0x040000 to 0x028a1a (0x175e5 bytes) 000678 1789073146.531979 mapread 0x01b49b thru 0x01ce25 (0x198b bytes) 000679 1789073146.547526 write 0x025413 thru 0x02ed64 (0x9952 bytes) 000680 1789073146.556330 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ed65): Mirror 8: 0xedc73d8a (stale) Mirror 10: 0xedc73d8a (stale) Mirror 12: 0xf4f0ff72 (stale) Mirror 13: 0x9cac4ebe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed65): Mirror 8: 0xedc73d8a (stale) Mirror 10: 0xedc73d8a (stale) Mirror 12: 0xf4f0ff72 (stale) Mirror 13: 0x9cac4ebe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed65: skipped 000682 1789073147.006261 write 0x020d8a thru 0x029db9 (0x9030 bytes) 000684 1789073147.025044 MIRROR_RESYNC 5 mirrors 000685 1789073147.934048 trunc from 0x02ed65 to 0x0031cf (0x2bb95 bytes) 000691 1789073148.056808 read 0x002f2e thru 0x0031cf (0x2a2 bytes) 000693 1789073148.062500 write 0x037d3d thru 0x03ffff (0x82c3 bytes) 000696 1789073148.064141 trunc from 0x040000 to 0x035a07 (0xa5f8 bytes) 000697 1789073148.095979 MIRROR_RESYNC 5 mirrors 000698 1789073149.573741 trunc from 0x035a08 to 0x02c764 (0x92a3 bytes) 000699 1789073149.734000 trunc from 0x02c765 to 0x0392b9 (0xcb55 bytes) 000700 1789073149.763122 mapread 0x02181b thru 0x021c80 (0x466 bytes) 000701 1789073149.792926 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x392ba): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392ba): Mirror 8: 0xabd767d6 (stale) Mirror 10: 0xabd767d6 (stale) Mirror 12: 0xabd767d6 (stale) Mirror 13: 0xabd767d6 (stale) CRC-32 checksum value for chunk [0, 0x392ba): Mirror 1: 0xabd767d6 Mirror 14: 0xabd767d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392ba: skipped 000705 1789073151.401052 mapwrite 0x03ce93 thru 0x03dab9 (0xc27 bytes) 000706 1789073151.688124 trunc from 0x03daba to 0x030a13 (0xd0a6 bytes) 000707 1789073151.731751 trunc from 0x030a14 to 0x016ced (0x19d26 bytes) 000708 1789073151.775507 MIRROR_RESYNC 6 mirrors 000709 1789073153.838785 mapwrite 0x010a8d thru 0x019ac5 (0x9039 bytes) 000712 1789073154.117807 mapread 0x00f136 thru 0x018153 (0x901e bytes) 000713 1789073154.121832 write 0x0090ef thru 0x013650 (0xa562 bytes) 000714 1789073154.145184 mapread 0x00999e thru 0x0177fb (0xde5e bytes) 000715 1789073154.159297 trunc from 0x019ac6 to 0x01f0a4 (0x55df bytes) 000717 1789073154.221569 mapwrite 0x0199e5 thru 0x01a157 (0x773 bytes) 000718 1789073154.327553 write 0x03a3b3 thru 0x03fa11 (0x565f bytes) 000720 1789073154.331583 write 0x009db4 thru 0x00c025 (0x2272 bytes) 000722 1789073154.337539 mapwrite 0x032b3c thru 0x03ffff (0xd4c4 bytes) 000723 1789073154.555518 mapread 0x021685 thru 0x025923 (0x429f bytes) 000725 1789073154.568224 mapwrite 0x009a10 thru 0x00e455 (0x4a46 bytes) 000726 1789073154.626383 read 0x01d4cb thru 0x028f4a (0xba80 bytes) 000727 1789073154.627051 mapread 0x03cf85 thru 0x03ffff (0x307b bytes) 000728 1789073154.627842 mapread 0x02c13b thru 0x031948 (0x580e bytes) 000729 1789073154.635108 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xca50c9da (stale) Mirror 12: 0xca50c9da (stale) Mirror 13: 0xca50c9da (stale) Mirror 14: 0xca50c9da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xca50c9da (stale) Mirror 12: 0xca50c9da (stale) Mirror 13: 0xca50c9da (stale) Mirror 14: 0xca50c9da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000730 1789073155.297234 trunc from 0x040000 to 0x02f1fc (0x10e03 bytes) 000731 1789073155.325593 read 0x021ec0 thru 0x022399 (0x4da bytes) 000733 1789073155.360013 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 10: 0xc53b78c2 (stale) Mirror 12: 0xc53b78c2 (stale) Mirror 13: 0xc53b78c2 (stale) Mirror 14: 0xc53b78c2 (stale) CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 1: 0x42355648 Mirror 15: 0x42355648 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f1fd: skipped 000734 1789073157.265777 mapread 0x0155ee thru 0x01c56d (0x6f80 bytes) 000735 1789073157.308765 read 0x023975 thru 0x027d3a (0x43c6 bytes) 000736 1789073157.343731 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 10: 0xc53b78c2 (stale) Mirror 12: 0xc53b78c2 (stale) Mirror 13: 0xc53b78c2 (stale) Mirror 14: 0xc53b78c2 (stale) CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 1: 0x42355648 Mirror 15: 0x42355648 Mirror 16: 0x42355648 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f1fd: skipped 000737 1789073158.865523 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 10: 0xc53b78c2 (stale) Mirror 12: 0xc53b78c2 (stale) Mirror 13: 0xc53b78c2 (stale) Mirror 14: 0xc53b78c2 (stale) CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 1: 0x42355648 Mirror 15: 0x42355648 Mirror 16: 0x42355648 Mirror 17: 0x42355648 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f1fd: skipped 000738 1789073160.374330 write 0x006ad1 thru 0x00b8f6 (0x4e26 bytes) 000739 1789073160.474180 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 10: 0xc53b78c2 (stale) Mirror 12: 0xc53b78c2 (stale) Mirror 13: 0xc53b78c2 (stale) Mirror 14: 0xc53b78c2 (stale) Mirror 15: 0x42355648 (stale) Mirror 16: 0x42355648 (stale) Mirror 17: 0x42355648 (stale) CRC-32 checksum value for chunk [0, 0x2f1fd): Mirror 1: 0x276ed131 Mirror 18: 0x276ed131 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f1fd: skipped 000740 1789073162.190562 MIRROR_RESYNC 9 mirrors 000742 1789073164.746415 MIRROR_EXTEND to 10 mirrors 000743 1789073165.825576 write 0x01212a thru 0x0174c0 (0x5397 bytes) 000744 1789073165.985338 mapwrite 0x00c7e7 thru 0x015c1c (0x9436 bytes) 000746 1789073166.128119 read 0x0161fa thru 0x0189d1 (0x27d8 bytes) 000748 1789073166.156766 mapwrite 0x00f4e1 thru 0x012fbe (0x3ade bytes) 000749 1789073166.314870 read 0x01ee2f thru 0x02be46 (0xd018 bytes) 000750 1789073166.350543 trunc from 0x02f1fd to 0x003eb6 (0x2b346 bytes) 000751 1789073166.396314 read 0x001d88 thru 0x003eb6 (0x212f bytes) 000752 1789073166.402805 write 0x03f18a thru 0x03ffff (0xe76 bytes) 000753 1789073166.405386 mapread 0x01496c thru 0x023532 (0xebc7 bytes) 000756 1789073166.450090 trunc from 0x040000 to 0x00d148 (0x32eb7 bytes) 000760 1789073166.492608 trunc from 0x00d149 to 0x001195 (0xbfb3 bytes) 000762 1789073166.553438 read 0x0010ff thru 0x001195 (0x97 bytes) 000765 1789073166.569315 read 0x00051c thru 0x001195 (0xc7a bytes) 000766 1789073166.572486 trunc from 0x001196 to 0x036710 (0x3557b bytes) 000770 1789073166.623001 read 0x01fe8d thru 0x02d79f (0xd913 bytes) 000772 1789073166.669835 write 0x02284c thru 0x024e02 (0x25b7 bytes) 000773 1789073166.672884 read 0x0107bd thru 0x01a5c1 (0x9e05 bytes) 000777 1789073166.684446 trunc from 0x036711 to 0x0156b5 (0x2105b bytes) 000778 1789073166.708100 trunc from 0x0156b6 to 0x019f73 (0x48be bytes) 000780 1789073166.738535 write 0x0249e5 thru 0x029d5d (0x5379 bytes) 000781 1789073166.741355 trunc from 0x029d5e to 0x02e608 (0x48ab bytes) 000785 1789073166.773319 trunc from 0x02e609 to 0x010c6a (0x1d99e bytes) 000788 1789073166.811638 mapread 0x0001d7 thru 0x004eba (0x4ce4 bytes) 000790 1789073166.833577 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10c6b): Mirror 10: 0x650a5dbe (stale) Mirror 12: 0x650a5dbe (stale) Mirror 13: 0x650a5dbe (stale) Mirror 15: 0x650a5dbe (stale) Mirror 16: 0x650a5dbe (stale) Mirror 17: 0x650a5dbe (stale) Mirror 18: 0x650a5dbe (stale) Mirror 19: 0x650a5dbe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10c6b): Mirror 10: 0x650a5dbe (stale) Mirror 12: 0x650a5dbe (stale) Mirror 13: 0x650a5dbe (stale) Mirror 15: 0x650a5dbe (stale) Mirror 16: 0x650a5dbe (stale) Mirror 17: 0x650a5dbe (stale) Mirror 18: 0x650a5dbe (stale) Mirror 19: 0x650a5dbe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10c6b: skipped 000792 1789073167.602778 trunc from 0x010c6b to 0x039b2f (0x28ec5 bytes) 000795 1789073167.636030 MIRROR_RESYNC 9 mirrors 000799 1789073171.611294 write 0x01c57a thru 0x026c9b (0xa722 bytes) 000800 1789073171.780805 mapread 0x02e3ff thru 0x036dd5 (0x89d7 bytes) 000802 1789073171.799069 read 0x038a4c thru 0x039b2f (0x10e4 bytes) 000804 1789073171.805626 mapwrite 0x03f636 thru 0x03ffff (0x9ca bytes) 000805 1789073171.935175 mapread 0x037d72 thru 0x039cd4 (0x1f63 bytes) 000807 1789073171.938943 trunc from 0x040000 to 0x02bb1b (0x144e4 bytes) 000808 1789073172.002135 MIRROR_RESYNC 9 mirrors 000812 1789073175.753553 trunc from 0x02bb1c to 0x02893e (0x31dd bytes) 000813 1789073175.860479 mapread 0x01a78a thru 0x026a1d (0xc294 bytes) 000816 1789073175.924859 read 0x028750 thru 0x02893e (0x1ef bytes) 000817 1789073175.925423 mapread 0x00e715 thru 0x0107cd (0x20b9 bytes) 000819 1789073175.954789 write 0x013e3d thru 0x015fb5 (0x2179 bytes) 000820 1789073175.957061 read 0x0078e8 thru 0x00f2e2 (0x79fb bytes) 000821 1789073175.957649 mapread 0x000e19 thru 0x008f13 (0x80fb bytes) 000822 1789073175.971302 trunc from 0x02893f to 0x00ba4e (0x1cef0 bytes) 000823 1789073176.001780 write 0x013b8c thru 0x01849f (0x4914 bytes) 000824 1789073176.008350 read 0x01746d thru 0x01849f (0x1033 bytes) 000827 1789073176.011489 write 0x03bbc8 thru 0x03ef4d (0x3386 bytes) 000828 1789073176.014787 write 0x00c633 thru 0x014a78 (0x8446 bytes) 000831 1789073176.039488 mapwrite 0x02f648 thru 0x03c3bf (0xcd78 bytes) 000835 1789073176.150487 mapread 0x02f5fd thru 0x034a71 (0x5475 bytes) 000842 1789073176.161335 mapread 0x014c20 thru 0x01eb9b (0x9f7c bytes) 000843 1789073176.162435 trunc from 0x03ef4e to 0x02aa50 (0x144fd bytes) 000845 1789073176.202594 write 0x01ae28 thru 0x0221ff (0x73d8 bytes) 000847 1789073176.209855 write 0x027d54 thru 0x02e245 (0x64f2 bytes) 000848 1789073176.215924 mapwrite 0x01c06a thru 0x020cd1 (0x4c68 bytes) 000849 1789073176.355275 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e246): Mirror 10: 0xb6bd7a07 (stale) Mirror 12: 0xb6bd7a07 (stale) Mirror 13: 0xb6bd7a07 (stale) Mirror 16: 0xb6bd7a07 (stale) Mirror 17: 0xb6bd7a07 (stale) Mirror 18: 0xb6bd7a07 (stale) Mirror 19: 0xb6bd7a07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e246): Mirror 10: 0xb6bd7a07 (stale) Mirror 12: 0xb6bd7a07 (stale) Mirror 13: 0xb6bd7a07 (stale) Mirror 16: 0xb6bd7a07 (stale) Mirror 17: 0xb6bd7a07 (stale) Mirror 18: 0xb6bd7a07 (stale) Mirror 19: 0xb6bd7a07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e246: skipped 000850 1789073177.013496 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e246): Mirror 12: 0xb6bd7a07 (stale) Mirror 13: 0xb6bd7a07 (stale) Mirror 16: 0xb6bd7a07 (stale) Mirror 17: 0xb6bd7a07 (stale) Mirror 18: 0xb6bd7a07 (stale) Mirror 19: 0xb6bd7a07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e246): Mirror 12: 0xb6bd7a07 (stale) Mirror 13: 0xb6bd7a07 (stale) Mirror 16: 0xb6bd7a07 (stale) Mirror 17: 0xb6bd7a07 (stale) Mirror 18: 0xb6bd7a07 (stale) Mirror 19: 0xb6bd7a07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e246: skipped 000851 1789073177.821417 read 0x01d3df thru 0x02b801 (0xe423 bytes) 000852 1789073177.832150 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e246): Mirror 13: 0xb6bd7a07 (stale) Mirror 16: 0xb6bd7a07 (stale) Mirror 17: 0xb6bd7a07 (stale) Mirror 18: 0xb6bd7a07 (stale) Mirror 19: 0xb6bd7a07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e246): Mirror 13: 0xb6bd7a07 (stale) Mirror 16: 0xb6bd7a07 (stale) Mirror 17: 0xb6bd7a07 (stale) Mirror 18: 0xb6bd7a07 (stale) Mirror 19: 0xb6bd7a07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e246: skipped 000853 1789073178.338360 mapread 0x004cb4 thru 0x005454 (0x7a1 bytes) 000854 1789073178.363628 mapwrite 0x030c79 thru 0x0376ce (0x6a56 bytes) 000856 1789073178.638610 mapread 0x009611 thru 0x00eb66 (0x5556 bytes) 000859 1789073178.704467 write 0x0300cc thru 0x037fe7 (0x7f1c bytes) 000862 1789073178.717175 trunc from 0x037fe8 to 0x0039d9 (0x3460e bytes) 000864 1789073178.754616 mapwrite 0x003885 thru 0x0068a4 (0x3020 bytes) 000865 1789073178.902383 write 0x00a1ed thru 0x00c2ad (0x20c1 bytes) 000866 1789073178.910797 read 0x007d2e thru 0x00c2ad (0x4580 bytes) 000869 1789073178.944554 read 0x00680f thru 0x00c2ad (0x5a9f bytes) 000870 1789073178.949623 mapread 0x00b450 thru 0x00c2ad (0xe5e bytes) 000872 1789073178.968285 mapwrite 0x0245df thru 0x02612c (0x1b4e bytes) 000873 1789073179.167274 mapread 0x00fd06 thru 0x019ddc (0xa0d7 bytes) 000874 1789073179.174314 read 0x00be4d thru 0x0192b7 (0xd46b bytes) 000877 1789073179.186048 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2612d): Mirror 13: 0x41c3b9eb (stale) Mirror 16: 0x41c3b9eb (stale) Mirror 18: 0x41c3b9eb (stale) Mirror 19: 0x41c3b9eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2612d): Mirror 13: 0x41c3b9eb (stale) Mirror 16: 0x41c3b9eb (stale) Mirror 18: 0x41c3b9eb (stale) Mirror 19: 0x41c3b9eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2612d: skipped 000879 1789073180.007459 mapread 0x0061f7 thru 0x013ba9 (0xd9b3 bytes) 000880 1789073180.048874 mapwrite 0x012470 thru 0x01b926 (0x94b7 bytes) 000881 1789073180.178497 mapread 0x001418 thru 0x010c9c (0xf885 bytes) 000883 1789073180.183381 mapwrite 0x01e107 thru 0x02590e (0x7808 bytes) 000885 1789073180.270261 mapwrite 0x035c52 thru 0x03ffff (0xa3ae bytes) 000886 1789073180.429173 trunc from 0x040000 to 0x02e2d5 (0x11d2a bytes) 000887 1789073180.466703 read 0x014e3d thru 0x01f56d (0xa731 bytes) 000888 1789073180.468761 write 0x01b851 thru 0x01d430 (0x1be0 bytes) 000890 1789073180.472796 trunc from 0x02e2d6 to 0x01ec1f (0xf6b6 bytes) 000891 1789073180.516635 read 0x012b88 thru 0x01b321 (0x879a bytes) 000893 1789073180.517941 mapread 0x009f96 thru 0x0154d8 (0xb543 bytes) 000895 1789073180.531534 mapwrite 0x031099 thru 0x03f18a (0xe0f2 bytes) 000898 1789073180.665834 trunc from 0x03f18b to 0x0389d7 (0x67b3 bytes) 000899 1789073180.682402 read 0x0209e9 thru 0x0226e2 (0x1cfa bytes) 000900 1789073180.683476 trunc from 0x0389d8 to 0x023621 (0x153b6 bytes) 000901 1789073180.724460 read 0x022d13 thru 0x023621 (0x90f bytes) 000903 1789073180.727258 read 0x00d946 thru 0x01146a (0x3b25 bytes) 000904 1789073180.728258 trunc from 0x023622 to 0x032ec8 (0xf8a7 bytes) 000906 1789073180.751632 mapread 0x01be5f thru 0x024641 (0x87e3 bytes) 000907 1789073180.762555 mapwrite 0x01f592 thru 0x020533 (0xfa2 bytes) 000908 1789073180.897358 read 0x01b3bb thru 0x01caee (0x1734 bytes) 000909 1789073180.899257 mapread 0x012d1c thru 0x015472 (0x2757 bytes) 000910 1789073180.900820 write 0x00768e thru 0x016fee (0xf961 bytes) 000911 1789073180.910639 read 0x00631a thru 0x00fea5 (0x9b8c bytes) 000912 1789073180.922317 read 0x009ba9 thru 0x00a97d (0xdd5 bytes) 000914 1789073180.924436 mapread 0x021645 thru 0x02f82f (0xe1eb bytes) 000916 1789073180.935508 MIRROR_RESYNC 5 mirrors 000920 1789073183.230294 read 0x004a64 thru 0x012bed (0xe18a bytes) 000923 1789073183.251267 read 0x018dcd thru 0x024ab3 (0xbce7 bytes) 000925 1789073183.300217 mapread 0x00e2ff thru 0x016774 (0x8476 bytes) 000928 1789073183.321822 MIRROR_EXTEND to 6 mirrors 000930 1789073184.863450 MIRROR_RESYNC 6 mirrors 000931 1789073185.456127 trunc from 0x032ec9 to 0x01ca7d (0x1644b bytes) 000934 1789073185.522511 write 0x03a92c thru 0x03dd9e (0x3473 bytes) 000936 1789073185.525393 mapwrite 0x0062e1 thru 0x011ff3 (0xbd13 bytes) 000938 1789073185.602077 mapwrite 0x006ad9 thru 0x007fa3 (0x14cb bytes) 000939 1789073185.666328 write 0x01cdd3 thru 0x024f4e (0x817c bytes) 000942 1789073185.683772 mapwrite 0x019823 thru 0x028423 (0xec01 bytes) 000943 1789073185.830988 read 0x0127b5 thru 0x0198be (0x710a bytes) 000945 1789073185.838531 MIRROR_RESYNC 6 mirrors 000947 1789073187.921943 read 0x039d3e thru 0x03dd9e (0x4061 bytes) 000949 1789073187.930457 write 0x00a711 thru 0x01083b (0x612b bytes) 000950 1789073188.009214 mapwrite 0x01baba thru 0x01f4e9 (0x3a30 bytes) 000954 1789073188.079705 write 0x031e27 thru 0x039f11 (0x80eb bytes) 000955 1789073188.098352 trunc from 0x03dd9f to 0x03be72 (0x1f2c bytes) 000956 1789073188.124754 mapread 0x032607 thru 0x03be72 (0x986c bytes) 000958 1789073188.140887 mapread 0x02f9d0 thru 0x03be72 (0xc4a3 bytes) 000959 1789073188.156779 mapwrite 0x00b60e thru 0x00ef9c (0x398f bytes) 000964 1789073188.249554 write 0x031aa1 thru 0x0387a1 (0x6d01 bytes) 000966 1789073188.255409 read 0x01ed9d thru 0x01edb5 (0x19 bytes) 000967 1789073188.256683 mapwrite 0x01558f thru 0x016737 (0x11a9 bytes) 000968 1789073188.361718 read 0x020e14 thru 0x028363 (0x7550 bytes) 000969 1789073188.385940 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3be73): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3be73): Mirror 13: 0xb0774b8f (stale) Mirror 16: 0xb0774b8f (stale) Mirror 18: 0xb0774b8f (stale) Mirror 19: 0xb0774b8f (stale) Mirror 20: 0xb0774b8f (stale) CRC-32 checksum value for chunk [0, 0x3be73): Mirror 1: 0x84da59e8 Mirror 21: 0x84da59e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3be73: skipped 000970 1789073189.811707 trunc from 0x03be73 to 0x038de7 (0x308b bytes) 000971 1789073190.024809 write 0x011e1a thru 0x012443 (0x62a bytes) 000972 1789073190.044139 trunc from 0x038de8 to 0x02cef7 (0xbef0 bytes) 000973 1789073190.071007 trunc from 0x02cef8 to 0x03f639 (0x12742 bytes) 000976 1789073190.093238 mapwrite 0x026c9b thru 0x028382 (0x16e8 bytes) 000977 1789073190.272127 MIRROR_RESYNC 7 mirrors 000979 1789073193.328501 mapwrite 0x014632 thru 0x01c58a (0x7f59 bytes) 000982 1789073193.673468 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f63a): Mirror 13: 0xdf38c7ce (stale) Mirror 18: 0xdf38c7ce (stale) Mirror 19: 0xdf38c7ce (stale) Mirror 20: 0xdf38c7ce (stale) Mirror 21: 0xdf38c7ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f63a): Mirror 13: 0xdf38c7ce (stale) Mirror 18: 0xdf38c7ce (stale) Mirror 19: 0xdf38c7ce (stale) Mirror 20: 0xdf38c7ce (stale) Mirror 21: 0xdf38c7ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f63a: skipped 000983 1789073194.352788 mapwrite 0x00e7ea thru 0x013873 (0x508a bytes) 000984 1789073194.520359 mapwrite 0x0332d8 thru 0x0367c1 (0x34ea bytes) 000985 1789073194.658633 mapwrite 0x03043e thru 0x0378e8 (0x74ab bytes) 000986 1789073194.809618 mapwrite 0x02bd6c thru 0x037eb6 (0xc14b bytes) 000988 1789073194.994310 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f63a): Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f63a): Mirror 13: 0xdf38c7ce (stale) Mirror 18: 0xdf38c7ce (stale) Mirror 19: 0xdf38c7ce (stale) Mirror 20: 0xdf38c7ce (stale) Mirror 21: 0xdf38c7ce (stale) CRC-32 checksum value for chunk [0, 0x3f63a): Mirror 1: 0x314b342f Mirror 22: 0x314b342f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f63a: skipped 000990 1789073197.402838 write 0x029973 thru 0x02e075 (0x4703 bytes) 000991 1789073197.514024 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3f63a): Mirror 13: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f63a): Mirror 13: 0xdf38c7ce (stale) Mirror 18: 0xdf38c7ce (stale) Mirror 19: 0xdf38c7ce (stale) Mirror 20: 0xdf38c7ce (stale) Mirror 21: 0xdf38c7ce (stale) Mirror 22: 0x314b342f (stale) CRC-32 checksum value for chunk [0, 0x3f63a): Mirror 1: 0x5632a00b Mirror 23: 0x5632a00b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f63a: skipped 000994 1789073198.687384 read 0x02f5bd thru 0x0328c5 (0x3309 bytes) 000998 1789073198.692845 mapwrite 0x026719 thru 0x02a955 (0x423d bytes) 000999 1789073198.828240 mapwrite 0x017f18 thru 0x018dce (0xeb7 bytes) All operations completed A-OK!