== sanity-flr test 70a: flr mode fsx test ================ 10:56:14 (1786632974) Seed set to 2976 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x16946 000004 1786632976.496744 trunc from 00000000 to 0x016945 (0x16946 bytes) 000006 1786632976.514089 write 0x03ed3d thru 0x03ffff (0x12c3 bytes) 000007 1786632976.515134 write 0x00c4c3 thru 0x0150b6 (0x8bf4 bytes) 000009 1786632976.536647 write 0x0121ac thru 0x01f77b (0xd5d0 bytes) 000010 1786632976.547287 write 0x03de6a thru 0x03ffff (0x2196 bytes) 000011 1786632976.555192 trunc from 0x040000 to 0x006817 (0x397e8 bytes) 000012 1786632976.573477 write 0x0141f8 thru 0x01d377 (0x9180 bytes) 000013 1786632976.575129 mapread 0x0179f9 thru 0x01a660 (0x2c68 bytes) truncating to largest ever: 0x18112 000014 1786632976.577700 trunc from 0x01d378 to 0x018111 (0x5266 bytes) 000015 1786632976.594034 mapwrite 0x0121f0 thru 0x016997 (0x47a8 bytes) truncating to largest ever: 0x22ec0 000020 1786632976.651865 trunc from 0x018112 to 0x022ebf (0xadae bytes) truncating to largest ever: 0x382e8 000021 1786632976.674137 trunc from 0x022ec0 to 0x0382e7 (0x15428 bytes) 000024 1786632976.701860 read 0x004855 thru 0x00b326 (0x6ad2 bytes) 000025 1786632976.716092 MIRROR_EXTEND to 2 mirrors 000026 1786632977.486408 read 0x010aab thru 0x017378 (0x68ce bytes) 000031 1786632977.496250 trunc from 0x0382e8 to 0x00963d (0x2ecaa bytes) 000032 1786632977.585069 read 0x004245 thru 0x00963d (0x53f9 bytes) 000033 1786632977.598672 write 0x034de3 thru 0x03ffff (0xb21d bytes) 000034 1786632977.606307 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000037 1786632977.831121 mapread 0x015310 thru 0x021183 (0xbe74 bytes) 000038 1786632977.895316 trunc from 0x040000 to 0x00d75c (0x328a3 bytes) 000039 1786632977.921024 read 0x00b2c1 thru 0x00d75c (0x249c bytes) 000040 1786632977.928062 mapread 0x004957 thru 0x004973 (0x1d bytes) truncating to largest ever: 0x3cd47 000041 1786632977.939690 trunc from 0x00d75d to 0x03cd46 (0x2f5ea bytes) 000042 1786632977.968475 write 0x0027df thru 0x003ebf (0x16e1 bytes) 000043 1786632977.970192 mapwrite 0x0116db thru 0x01a302 (0x8c28 bytes) 000046 1786632978.074902 trunc from 0x03cd47 to 0x0263c2 (0x16984 bytes) 000047 1786632978.093719 mapread 0x00e20e thru 0x013c6b (0x5a5e bytes) 000050 1786632978.097850 read 0x0067ea thru 0x00d532 (0x6d49 bytes) 000051 1786632978.098676 mapread 0x024cdf thru 0x0263c2 (0x16e4 bytes) 000054 1786632978.109870 trunc from 0x0263c3 to 0x025ac2 (0x900 bytes) 000055 1786632978.135799 MIRROR_EXTEND to 2 mirrors 000056 1786632978.916695 mapread 0x0015c1 thru 0x007cb4 (0x66f4 bytes) 000057 1786632978.936473 mapwrite 0x02bc66 thru 0x02c911 (0xcac bytes) 000062 1786632979.121763 write 0x002934 thru 0x009beb (0x72b8 bytes) 000063 1786632979.135974 mapread 0x0049ac thru 0x01177e (0xcdd3 bytes) 000064 1786632979.156688 mapwrite 0x00c589 thru 0x010f46 (0x49be bytes) 000065 1786632979.234327 mapread 0x0169c7 thru 0x025110 (0xe74a bytes) 000066 1786632979.257508 read 0x019077 thru 0x02763e (0xe5c8 bytes) 000067 1786632979.259882 mapwrite 0x03f41f thru 0x03ffff (0xbe1 bytes) 000068 1786632979.350327 trunc from 0x040000 to 0x02bfe6 (0x14019 bytes) 000069 1786632979.374494 write 0x004b37 thru 0x00800f (0x34d9 bytes) 000071 1786632979.386154 MIRROR_RESYNC 2 mirrors 000072 1786632980.290842 write 0x0337b6 thru 0x03ffff (0xc84a bytes) 000074 1786632980.361853 read 0x027c7f thru 0x02f0b1 (0x7433 bytes) 000077 1786632980.371490 trunc from 0x040000 to 0x00553f (0x3aac0 bytes) 000078 1786632980.407575 trunc from 0x005540 to 0x004ade (0xa61 bytes) 000079 1786632980.443676 mapwrite 0x02986b thru 0x0306d0 (0x6e66 bytes) 000080 1786632980.557600 read 0x00d4d3 thru 0x01770f (0xa23d bytes) 000082 1786632980.575065 mapwrite 0x02642c thru 0x0267c3 (0x398 bytes) 000083 1786632980.639684 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x306d1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306d1): Mirror 2: 0x42ae8918 (stale) CRC-32 checksum value for chunk [0, 0x306d1): Mirror 1: 0xf4941835 Mirror 3: 0xf4941835 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306d1: skipped 000084 1786632981.637154 write 0x007daa thru 0x0097ab (0x1a02 bytes) 000086 1786632981.741538 mapread 0x00b3cd thru 0x01241f (0x7053 bytes) 000087 1786632981.784323 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x306d1): Mirror 3: 0xf4941835 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306d1): Mirror 3: 0xf4941835 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306d1: skipped 000088 1786632982.093758 MIRROR_RESYNC 2 mirrors 000089 1786632982.882378 read 0x02a106 thru 0x0306d0 (0x65cb bytes) 000090 1786632982.892869 read 0x011b58 thru 0x019745 (0x7bee bytes) 000091 1786632982.906580 write 0x005ff1 thru 0x006848 (0x858 bytes) 000092 1786632982.983363 mapwrite 0x011891 thru 0x01e12a (0xc89a bytes) 000094 1786632983.094359 read 0x0040f1 thru 0x00e3aa (0xa2ba bytes) 000098 1786632983.109802 write 0x00b402 thru 0x00ed08 (0x3907 bytes) 000099 1786632983.111397 mapread 0x01f3ee thru 0x02764f (0x8262 bytes) 000100 1786632983.113044 read 0x00f6ba thru 0x01e088 (0xe9cf bytes) 000101 1786632983.114522 mapwrite 0x003038 thru 0x008256 (0x521f bytes) 000106 1786632983.174654 write 0x00cd08 thru 0x0150b9 (0x83b2 bytes) 000107 1786632983.178854 write 0x029436 thru 0x03751c (0xe0e7 bytes) 000108 1786632983.190972 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000110 1786632983.384324 read 0x0339c0 thru 0x03751c (0x3b5d bytes) 000112 1786632983.399337 write 0x01da72 thru 0x026a22 (0x8fb1 bytes) 000113 1786632983.410767 trunc from 0x03751d to 0x00efb2 (0x2856a bytes) 000114 1786632983.434373 mapwrite 0x01a742 thru 0x01d773 (0x3032 bytes) 000116 1786632983.535035 mapwrite 0x036c7b thru 0x03ac53 (0x3fd9 bytes) 000122 1786632983.676429 write 0x01d219 thru 0x01f075 (0x1e5d bytes) 000124 1786632983.684377 mapread 0x01883d thru 0x0235b4 (0xad78 bytes) 000126 1786632983.699077 trunc from 0x03ac54 to 0x026380 (0x148d3 bytes) 000128 1786632983.733409 mapwrite 0x037334 thru 0x03ffff (0x8ccc bytes) 000129 1786632983.815293 read 0x03a0c8 thru 0x03ffff (0x5f38 bytes) 000131 1786632983.819626 mapwrite 0x0265b4 thru 0x03461c (0xe069 bytes) 000134 1786632983.891971 mapwrite 0x027c71 thru 0x034699 (0xca29 bytes) 000138 1786632983.957641 write 0x02c0a8 thru 0x032bb5 (0x6b0e bytes) 000140 1786632983.959659 trunc from 0x040000 to 0x03a433 (0x5bcc bytes) 000143 1786632983.979114 write 0x020d69 thru 0x02e265 (0xd4fd bytes) 000144 1786632983.981228 write 0x02d182 thru 0x03c21c (0xf09b bytes) 000146 1786632983.983646 write 0x02e35c thru 0x033f37 (0x5bdc bytes) 000147 1786632983.985105 write 0x01fd62 thru 0x02c303 (0xc5a2 bytes) 000148 1786632983.986473 write 0x0134fa thru 0x01e145 (0xac4c bytes) 000149 1786632983.987737 trunc from 0x03c21d to 0x039a1b (0x2801 bytes) 000151 1786632984.006292 mapwrite 0x017111 thru 0x01f616 (0x8506 bytes) 000157 1786632984.097632 mapread 0x030da6 thru 0x0354fd (0x4758 bytes) 000158 1786632984.099443 mapread 0x024bf4 thru 0x0256d4 (0xae1 bytes) 000160 1786632984.112200 write 0x00305b thru 0x01046f (0xd415 bytes) 000161 1786632984.113737 mapread 0x02c761 thru 0x02dc43 (0x14e3 bytes) 000162 1786632984.114772 mapwrite 0x00cf2d thru 0x017ba3 (0xac77 bytes) 000168 1786632984.193347 mapwrite 0x0119ee thru 0x01645e (0x4a71 bytes) 000172 1786632984.252858 read 0x019cf3 thru 0x01caa9 (0x2db7 bytes) 000173 1786632984.253782 read 0x035154 thru 0x039a1b (0x48c8 bytes) 000174 1786632984.254968 trunc from 0x039a1c to 0x012f0b (0x26b10 bytes) 000175 1786632984.276850 mapwrite 0x0271bc thru 0x0304bb (0x9300 bytes) 000176 1786632984.355622 read 0x00ce20 thru 0x010088 (0x3269 bytes) 000178 1786632984.357342 mapwrite 0x018913 thru 0x021172 (0x8860 bytes) 000179 1786632984.411465 mapread 0x002318 thru 0x00ae6a (0x8b53 bytes) 000180 1786632984.413344 trunc from 0x0304bc to 0x036b5c (0x66a1 bytes) 000181 1786632984.430434 mapread 0x00a651 thru 0x01543a (0xadea bytes) 000182 1786632984.431857 trunc from 0x036b5d to 0x030b84 (0x5fd8 bytes) 000183 1786632984.445383 mapread 0x0128e8 thru 0x0227e4 (0xfefd bytes) 000184 1786632984.448029 mapread 0x02f01a thru 0x030b84 (0x1b6b bytes) 000186 1786632984.449722 trunc from 0x030b85 to 0x03209b (0x1517 bytes) 000188 1786632984.463370 mapread 0x00e38f thru 0x01d111 (0xed83 bytes) 000191 1786632984.474327 trunc from 0x03209c to 0x01a44b (0x17c50 bytes) 000193 1786632984.490940 trunc from 0x01a44c to 0x00b587 (0xeec4 bytes) 000194 1786632984.506285 mapwrite 0x02cfe5 thru 0x030776 (0x3792 bytes) 000196 1786632984.597180 mapread 0x022226 thru 0x025e46 (0x3c21 bytes) 000200 1786632984.600594 mapwrite 0x0321a6 thru 0x03662b (0x4486 bytes) 000206 1786632984.674689 mapwrite 0x0116f9 thru 0x011d36 (0x63e bytes) 000207 1786632984.749213 read 0x005bb7 thru 0x007f4d (0x2397 bytes) 000209 1786632984.753655 mapread 0x02ae9b thru 0x02da22 (0x2b88 bytes) 000213 1786632984.760815 read 0x025c41 thru 0x033a67 (0xde27 bytes) 000214 1786632984.761819 write 0x02826c thru 0x032df0 (0xab85 bytes) 000215 1786632984.763791 read 0x0336c0 thru 0x03662b (0x2f6c bytes) 000216 1786632984.765699 read 0x031118 thru 0x03662b (0x5514 bytes) 000217 1786632984.766725 mapread 0x01012f thru 0x0151d7 (0x50a9 bytes) 000218 1786632984.768698 read 0x026007 thru 0x02ede0 (0x8dda bytes) 000219 1786632984.771807 mapread 0x00cdc2 thru 0x00d038 (0x277 bytes) 000222 1786632984.778683 mapwrite 0x03be90 thru 0x03ffff (0x4170 bytes) 000223 1786632984.873461 read 0x028b98 thru 0x030c7b (0x80e4 bytes) 000225 1786632984.876362 trunc from 0x040000 to 0x0062bc (0x39d43 bytes) 000227 1786632984.906154 mapread 0x004211 thru 0x0062bc (0x20ac bytes) 000228 1786632984.910361 mapread 0x000b67 thru 0x0062bc (0x5756 bytes) 000229 1786632984.912413 write 0x037d58 thru 0x03ffff (0x82a8 bytes) 000231 1786632984.916474 mapwrite 0x00f88b thru 0x01302e (0x37a4 bytes) 000232 1786632984.993852 write 0x03ec1e thru 0x03ffff (0x13e2 bytes) 000234 1786632984.997375 read 0x0168c1 thru 0x0207ba (0x9efa bytes) 000238 1786632985.006366 mapread 0x00af4b thru 0x00d7d6 (0x288c bytes) 000239 1786632985.008117 mapread 0x0029ec thru 0x004f66 (0x257b bytes) 000240 1786632985.010353 write 0x031f7d thru 0x03d077 (0xb0fb bytes) 000241 1786632985.013166 write 0x02f3f8 thru 0x037a1e (0x8627 bytes) 000242 1786632985.017774 write 0x01f2e2 thru 0x02dac5 (0xe7e4 bytes) 000244 1786632985.037245 MIRROR_EXTEND to 2 mirrors 000246 1786632986.034006 trunc from 0x040000 to 0x01f37f (0x20c80 bytes) 000247 1786632986.233797 read 0x00395c thru 0x00ba0f (0x80b4 bytes) 000249 1786632986.257122 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000251 1786632986.433286 read 0x00ab71 thru 0x013bfa (0x908a bytes) 000256 1786632986.471496 mapread 0x006432 thru 0x010208 (0x9dd7 bytes) 000260 1786632986.521050 write 0x033338 thru 0x03ffff (0xccc8 bytes) 000264 1786632986.529775 read 0x03f2b3 thru 0x03ffff (0xd4d bytes) 000265 1786632986.531708 read 0x015086 thru 0x021525 (0xc4a0 bytes) 000271 1786632986.559004 write 0x022549 thru 0x0233a5 (0xe5d bytes) 000272 1786632986.561416 write 0x03af33 thru 0x03dae5 (0x2bb3 bytes) 000274 1786632986.563720 mapwrite 0x0024d2 thru 0x0095e2 (0x7111 bytes) 000276 1786632986.683140 MIRROR_EXTEND to 2 mirrors 000278 1786632987.847950 mapread 0x00946b thru 0x012c5b (0x97f1 bytes) 000280 1786632987.865580 write 0x03c261 thru 0x03ffff (0x3d9f bytes) 000281 1786632987.975476 mapwrite 0x022f3c thru 0x027293 (0x4358 bytes) 000282 1786632988.077739 write 0x03a72d thru 0x03dcea (0x35be bytes) 000283 1786632988.088392 mapwrite 0x00192f thru 0x00ef23 (0xd5f5 bytes) 000284 1786632988.220783 write 0x02f67f thru 0x039ce2 (0xa664 bytes) 000288 1786632988.254606 mapread 0x037b06 thru 0x03a691 (0x2b8c bytes) 000289 1786632988.258338 mapread 0x033011 thru 0x038b79 (0x5b69 bytes) 000290 1786632988.259832 mapread 0x025c9e thru 0x0354d0 (0xf833 bytes) 000291 1786632988.278651 mapwrite 0x01167e thru 0x0178e4 (0x6267 bytes) 000292 1786632988.462376 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000293 1786632988.731019 trunc from 0x040000 to 0x00135b (0x3eca4 bytes) 000295 1786632988.760081 write 0x037a29 thru 0x037bb6 (0x18e bytes) 000299 1786632988.779184 trunc from 0x037bb7 to 0x002112 (0x35aa4 bytes) 000302 1786632988.811790 trunc from 0x002113 to 0x01c417 (0x1a305 bytes) 000304 1786632988.831388 trunc from 0x01c418 to 0x01e200 (0x1de9 bytes) 000305 1786632988.877767 mapread 0x01162c thru 0x013bd5 (0x25aa bytes) 000308 1786632988.913534 mapwrite 0x0276c9 thru 0x02ea09 (0x7341 bytes) 000309 1786632989.009136 trunc from 0x02ea0a to 0x03a1d3 (0xb7ca bytes) 000310 1786632989.057057 trunc from 0x03a1d4 to 0x0365d2 (0x3c01 bytes) 000311 1786632989.104123 mapread 0x01c495 thru 0x0245cf (0x813b bytes) 000312 1786632989.116754 mapread 0x01cb80 thru 0x020345 (0x37c6 bytes) 000313 1786632989.121057 mapwrite 0x02a4f8 thru 0x02b006 (0xb0f bytes) 000314 1786632989.190535 read 0x010f1b thru 0x0132cf (0x23b5 bytes) 000315 1786632989.191248 mapwrite 0x03cd4a thru 0x03fb89 (0x2e40 bytes) 000316 1786632989.265568 trunc from 0x03fb8a to 0x03390b (0xc27e bytes) 000317 1786632989.282197 write 0x015530 thru 0x020583 (0xb054 bytes) 000318 1786632989.284181 mapread 0x032c7d thru 0x03390b (0xc8f bytes) 000319 1786632989.292337 mapread 0x030495 thru 0x03390b (0x3477 bytes) 000322 1786632989.294787 mapread 0x022db0 thru 0x02520f (0x2460 bytes) 000323 1786632989.296990 mapread 0x02e3c1 thru 0x03390b (0x554b bytes) 000324 1786632989.298491 mapread 0x00c55a thru 0x0186ed (0xc194 bytes) 000325 1786632989.300621 write 0x00484d thru 0x00b570 (0x6d24 bytes) 000326 1786632989.310849 trunc from 0x03390c to 0x01cf65 (0x169a6 bytes) 000327 1786632989.328568 mapwrite 0x035930 thru 0x03c1e7 (0x68b8 bytes) 000328 1786632989.423211 trunc from 0x03c1e8 to 0x00e415 (0x2ddd2 bytes) 000329 1786632989.446293 trunc from 0x00e416 to 0x03ba91 (0x2d67c bytes) 000330 1786632989.461901 mapread 0x000a43 thru 0x00cbed (0xc1ab bytes) 000331 1786632989.470370 read 0x0031b0 thru 0x00eade (0xb92f bytes) 000334 1786632989.472642 mapwrite 0x030e1a thru 0x03ffff (0xf1e6 bytes) 000335 1786632989.552384 mapread 0x00c897 thru 0x01a0f3 (0xd85d bytes) 000337 1786632989.554278 mapwrite 0x031113 thru 0x03ffff (0xeeed bytes) 000342 1786632989.640362 read 0x02968c thru 0x02f79c (0x6111 bytes) 000343 1786632989.641055 mapwrite 0x03d8f1 thru 0x03ffff (0x270f bytes) 000344 1786632989.691378 MIRROR_EXTEND to 2 mirrors 000346 1786632990.603363 trunc from 0x040000 to 0x0224ce (0x1db31 bytes) 000347 1786632990.699997 read 0x007e67 thru 0x008788 (0x922 bytes) 000348 1786632990.712891 write 0x02a85c thru 0x03a12e (0xf8d3 bytes) 000350 1786632990.717323 trunc from 0x03a12f to 0x03174e (0x89e0 bytes) 000351 1786632990.747175 read 0x00acca thru 0x010944 (0x5c7b bytes) 000352 1786632990.796945 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3174f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3174f): Mirror 2: 0xe902af6f (stale) CRC-32 checksum value for chunk [0, 0x3174f): Mirror 1: 0xe2846e0d Mirror 3: 0xe2846e0d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3174f: skipped 000355 1786632992.034529 mapread 0x02310c thru 0x030243 (0xd138 bytes) 000356 1786632992.073299 read 0x006491 thru 0x009d46 (0x38b6 bytes) 000357 1786632992.083383 mapwrite 0x007ddd thru 0x00e3b4 (0x65d8 bytes) 000358 1786632992.330817 trunc from 0x03174f to 0x024d1f (0xca2f bytes) 000359 1786632992.419351 MIRROR_RESYNC 3 mirrors 000364 1786632993.685593 write 0x02fa65 thru 0x035dec (0x6388 bytes) 000365 1786632993.773473 mapread 0x023ff8 thru 0x031a66 (0xda6f bytes) 000366 1786632993.817450 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35ded): Mirror 2: 0x2840fd93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ded): Mirror 2: 0x2840fd93 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ded: skipped 000367 1786632994.147077 mapread 0x0040a4 thru 0x00e285 (0xa1e2 bytes) 000368 1786632994.168755 read 0x0045a8 thru 0x008d01 (0x475a bytes) 000369 1786632994.169420 mapread 0x024696 thru 0x02c239 (0x7ba4 bytes) 000370 1786632994.185608 read 0x01ef24 thru 0x02da19 (0xeaf6 bytes) 000372 1786632994.216811 trunc from 0x035ded to 0x030bb5 (0x5237 bytes) 000373 1786632994.234318 write 0x02d34e thru 0x032c7b (0x592e bytes) 000374 1786632994.236838 mapwrite 0x02ee95 thru 0x037a4e (0x8bba bytes) 000375 1786632994.336297 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37a4f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a4f): Mirror 2: 0x5732e9a8 (stale) CRC-32 checksum value for chunk [0, 0x37a4f): Mirror 1: 0xc0993cc Mirror 3: 0xc0993cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a4f: skipped 000377 1786632995.362128 trunc from 0x037a4f to 0x03a5e5 (0x2b97 bytes) 000378 1786632995.468545 write 0x00cf97 thru 0x0160f6 (0x9160 bytes) 000379 1786632995.478241 mapwrite 0x03d63a thru 0x03ffff (0x29c6 bytes) 000380 1786632995.552318 read 0x032542 thru 0x03c36a (0x9e29 bytes) 000384 1786632995.582534 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8ca7ed9a (stale) Mirror 3: 0x2b5a5dd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe8fc3366 Mirror 4: 0xe8fc3366 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000385 1786632996.783948 mapwrite 0x009423 thru 0x017c53 (0xe831 bytes) 000388 1786632997.022790 MIRROR_RESYNC 4 mirrors 000389 1786632998.868505 mapwrite 0x01f595 thru 0x024819 (0x5285 bytes) 000390 1786632999.114710 write 0x001215 thru 0x00b42c (0xa218 bytes) 000392 1786632999.174387 mapread 0x003585 thru 0x009976 (0x63f2 bytes) 000393 1786632999.180642 write 0x01dff9 thru 0x02cf2e (0xef36 bytes) 000394 1786632999.206061 write 0x0293f0 thru 0x02db72 (0x4783 bytes) 000395 1786632999.220509 trunc from 0x040000 to 0x0296c6 (0x16939 bytes) 000396 1786632999.262343 trunc from 0x0296c7 to 0x00f3d6 (0x1a2f0 bytes) 000397 1786632999.306528 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf3d7): Mirror 2: 0x6648590c (stale) Mirror 3: 0x6648590c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf3d7): Mirror 2: 0x6648590c (stale) Mirror 3: 0x6648590c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf3d7: skipped 000398 1786632999.609217 mapread 0x00cc25 thru 0x00f242 (0x261e bytes) 000401 1786632999.625250 read 0x0046c7 thru 0x00e234 (0x9b6e bytes) 000402 1786632999.629903 trunc from 0x00f3d7 to 0x00eb25 (0x8b1 bytes) 000403 1786632999.672072 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xeb26): Mirror 3: 0xe5e3cb32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xeb26): Mirror 3: 0xe5e3cb32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xeb26: skipped 000404 1786632999.975211 mapwrite 0x01423d thru 0x01735b (0x311f bytes) 000405 1786633000.055073 trunc from 0x01735c to 0x002b81 (0x147da bytes) 000406 1786633000.076879 mapwrite 0x001082 thru 0x00a745 (0x96c4 bytes) 000407 1786633000.156628 mapwrite 0x0168b2 thru 0x01af19 (0x4668 bytes) 000409 1786633000.241402 read 0x015cfa thru 0x018056 (0x235d bytes) 000411 1786633000.242680 mapwrite 0x02886a thru 0x02bb8c (0x3323 bytes) 000412 1786633000.368572 MIRROR_RESYNC 2 mirrors 000413 1786633001.764083 write 0x02d2c5 thru 0x03bc5f (0xe99b bytes) 000414 1786633001.850697 mapwrite 0x0314f9 thru 0x03e22b (0xcd33 bytes) 000415 1786633001.954840 mapwrite 0x00a52e thru 0x01314a (0x8c1d bytes) 000416 1786633002.089185 trunc from 0x03e22c to 0x031e1d (0xc40e bytes) 000418 1786633002.122557 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000419 1786633002.362087 write 0x0292fa thru 0x0340f9 (0xae00 bytes) 000420 1786633002.381404 write 0x036082 thru 0x039b6b (0x3aea bytes) 000427 1786633002.401309 read 0x0105d7 thru 0x01ac7e (0xa6a8 bytes) 000428 1786633002.429131 mapread 0x033b74 thru 0x039b6b (0x5ff8 bytes) 000430 1786633002.445135 write 0x0049cd thru 0x00b880 (0x6eb4 bytes) 000431 1786633002.468659 mapwrite 0x0388de thru 0x03ffff (0x7722 bytes) 000433 1786633002.639706 trunc from 0x040000 to 0x01b09e (0x24f61 bytes) 000435 1786633002.669549 write 0x00ff72 thru 0x01ef17 (0xefa6 bytes) 000436 1786633002.682449 mapread 0x0040b3 thru 0x007c0d (0x3b5b bytes) 000439 1786633002.686522 mapwrite 0x007ec8 thru 0x0084c3 (0x5fc bytes) 000441 1786633002.828184 mapwrite 0x00c0ac thru 0x015cd3 (0x9c28 bytes) 000444 1786633002.941765 trunc from 0x01ef18 to 0x003ea7 (0x1b070 bytes) 000445 1786633002.999653 read 0x0030b3 thru 0x003ea7 (0xdf5 bytes) 000446 1786633003.027454 MIRROR_EXTEND to 2 mirrors 000447 1786633004.209886 mapwrite 0x01e990 thru 0x0210c0 (0x2731 bytes) 000449 1786633004.476080 mapwrite 0x011b31 thru 0x016d91 (0x5261 bytes) 000452 1786633004.575121 write 0x016736 thru 0x01f8dc (0x91a7 bytes) 000454 1786633004.578450 trunc from 0x0210c1 to 0x0069f2 (0x1a6ce bytes) 000457 1786633004.615423 write 0x00a60e thru 0x00d589 (0x2f7c bytes) 000458 1786633004.617684 mapread 0x00cb07 thru 0x00d589 (0xa83 bytes) 000460 1786633004.621261 read 0x0047b1 thru 0x00d589 (0x8dd9 bytes) 000461 1786633004.631844 trunc from 0x00d58a to 0x02b589 (0x1e000 bytes) 000462 1786633004.674616 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000465 1786633004.843381 read 0x016d71 thru 0x01c843 (0x5ad3 bytes) 000467 1786633004.857373 read 0x00ca4f thru 0x00e823 (0x1dd5 bytes) 000469 1786633004.881238 trunc from 0x02b58a to 0x03712b (0xbba2 bytes) 000471 1786633004.913399 write 0x0012c5 thru 0x004d26 (0x3a62 bytes) 000472 1786633004.916678 mapread 0x014848 thru 0x024623 (0xfddc bytes) 000473 1786633004.919150 read 0x032b12 thru 0x03712b (0x461a bytes) 000474 1786633004.942641 trunc from 0x03712c to 0x0108e9 (0x26842 bytes) 000478 1786633004.969360 mapread 0x00468c thru 0x006325 (0x1c9a bytes) 000479 1786633004.974528 mapwrite 0x017e1b thru 0x02512d (0xd313 bytes) 000481 1786633005.179162 mapwrite 0x00f92c thru 0x01c96c (0xd041 bytes) 000482 1786633005.370433 trunc from 0x02512e to 0x02c3e8 (0x72bb bytes) 000484 1786633005.389165 trunc from 0x02c3e9 to 0x014177 (0x18271 bytes) 000485 1786633005.417090 mapwrite 0x0212a7 thru 0x027cd7 (0x6a31 bytes) 000487 1786633005.595853 read 0x00c26d thru 0x019e2b (0xdbbf bytes) 000488 1786633005.611815 write 0x01a2f9 thru 0x01f074 (0x4d7c bytes) 000489 1786633005.613059 trunc from 0x027cd8 to 0x03191d (0x9c46 bytes) 000490 1786633005.641660 mapwrite 0x031a7e thru 0x03de42 (0xc3c5 bytes) truncating to largest ever: 0x3e8df 000491 1786633005.795162 trunc from 0x03de43 to 0x03e8de (0xa9c bytes) 000493 1786633005.820333 trunc from 0x03e8df to 0x004fa6 (0x39938 bytes) 000496 1786633005.850244 mapread 0x00411d thru 0x004fa6 (0xe8a bytes) 000497 1786633005.851688 mapwrite 0x00b85f thru 0x014853 (0x8ff5 bytes) 000498 1786633005.972471 mapread 0x007272 thru 0x007839 (0x5c8 bytes) 000499 1786633005.978395 mapwrite 0x00b00d thru 0x01021f (0x5213 bytes) 000501 1786633006.024451 mapread 0x010b05 thru 0x014853 (0x3d4f bytes) 000503 1786633006.027842 mapwrite 0x0062f1 thru 0x00a2b8 (0x3fc8 bytes) 000504 1786633006.086439 write 0x0371e7 thru 0x03887c (0x1696 bytes) 000509 1786633006.091472 trunc from 0x03887d to 0x01a454 (0x1e428 bytes) 000511 1786633006.109689 mapread 0x012d9f thru 0x014439 (0x169b bytes) 000512 1786633006.110836 mapwrite 0x0186d1 thru 0x0233cf (0xacff bytes) 000515 1786633006.274300 write 0x02ce64 thru 0x03aae6 (0xdc83 bytes) 000519 1786633006.280062 mapwrite 0x012da1 thru 0x018b71 (0x5dd1 bytes) 000520 1786633006.377483 write 0x01c3a5 thru 0x0256ec (0x9348 bytes) 000522 1786633006.387906 mapread 0x034441 thru 0x039479 (0x5039 bytes) 000524 1786633006.393089 trunc from 0x03aae7 to 0x01ee8b (0x1bc5b bytes) 000529 1786633006.414714 mapwrite 0x001557 thru 0x00b91e (0xa3c8 bytes) 000533 1786633006.521250 trunc from 0x01ee8c to 0x035c2b (0x16da0 bytes) 000535 1786633006.543540 mapwrite 0x00bc0a thru 0x014085 (0x847c bytes) 000536 1786633006.592086 mapwrite 0x037d11 thru 0x03ffff (0x82ef bytes) 000539 1786633006.818023 trunc from 0x040000 to 0x00ac0b (0x353f4 bytes) 000543 1786633006.840568 mapwrite 0x010b58 thru 0x01d1c1 (0xc66a bytes) 000544 1786633007.054891 trunc from 0x01d1c2 to 0x011f78 (0xb249 bytes) 000545 1786633007.072418 mapread 0x0056f0 thru 0x00667e (0xf8f bytes) 000546 1786633007.074227 write 0x011c49 thru 0x01b2d0 (0x9688 bytes) 000549 1786633007.078884 trunc from 0x01b2d1 to 0x038d00 (0x1da30 bytes) 000550 1786633007.095497 mapwrite 0x023bc4 thru 0x032763 (0xeba0 bytes) 000552 1786633007.311860 write 0x03fd99 thru 0x03ffff (0x267 bytes) 000553 1786633007.313446 mapwrite 0x0004d3 thru 0x00a06a (0x9b98 bytes) 000555 1786633007.382064 MIRROR_EXTEND to 2 mirrors 000556 1786633008.659475 trunc from 0x040000 to 0x004274 (0x3bd8b bytes) 000557 1786633008.844261 mapwrite 0x016a4c thru 0x0179a2 (0xf57 bytes) 000559 1786633008.934530 mapread 0x00f7c2 thru 0x014ce2 (0x5521 bytes) 000564 1786633008.954787 write 0x023bac thru 0x026b6d (0x2fc2 bytes) 000567 1786633008.957255 mapread 0x00e459 thru 0x019f01 (0xbaa9 bytes) 000569 1786633008.967325 mapwrite 0x03d9cb thru 0x03ffff (0x2635 bytes) 000570 1786633009.150291 write 0x033fa3 thru 0x035e08 (0x1e66 bytes) 000571 1786633009.174874 read 0x033032 thru 0x039af6 (0x6ac5 bytes) 000572 1786633009.183479 mapwrite 0x02e774 thru 0x03a13e (0xb9cb bytes) 000573 1786633009.274062 mapwrite 0x0234a0 thru 0x02f95a (0xc4bb bytes) 000574 1786633009.351229 mapwrite 0x008134 thru 0x009589 (0x1456 bytes) 000575 1786633009.398567 mapwrite 0x0082cf thru 0x00f029 (0x6d5b bytes) 000576 1786633009.470717 write 0x014d9e thru 0x01ea36 (0x9c99 bytes) 000580 1786633009.476309 mapwrite 0x00d4da thru 0x00f6cf (0x21f6 bytes) 000582 1786633009.587297 trunc from 0x040000 to 0x006904 (0x396fb bytes) 000586 1786633009.612699 trunc from 0x006905 to 0x01d1b5 (0x168b1 bytes) 000587 1786633009.633370 read 0x002d0c thru 0x00ba64 (0x8d59 bytes) 000589 1786633009.668106 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000590 1786633009.776518 read 0x0044da thru 0x0139fe (0xf525 bytes) 000591 1786633009.787694 MIRROR_EXTEND to 2 mirrors 000593 1786633010.615282 read 0x012afb thru 0x01d1b5 (0xa6bb bytes) 000595 1786633010.629298 read 0x00b7a4 thru 0x00f233 (0x3a90 bytes) 000598 1786633010.639200 mapread 0x00f3c1 thru 0x015eaa (0x6aea bytes) 000601 1786633010.643148 write 0x01f14e thru 0x02a9fc (0xb8af bytes) 000602 1786633010.724019 trunc from 0x02a9fd to 0x0124eb (0x18511 bytes) 000603 1786633010.756423 MIRROR_RESYNC 2 mirrors 000604 1786633011.493464 read 0x000c2e thru 0x0030b9 (0x248c bytes) 000605 1786633011.499891 write 0x004dd2 thru 0x009638 (0x4867 bytes) 000606 1786633011.593408 read 0x00332c thru 0x007866 (0x453b bytes) 000607 1786633011.601101 mapread 0x005eab thru 0x0124eb (0xc641 bytes) 000608 1786633011.602514 mapread 0x0001f8 thru 0x0044d3 (0x42dc bytes) 000610 1786633011.611239 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x124ec): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x124ec): Mirror 2: 0x8f73cba2 (stale) CRC-32 checksum value for chunk [0, 0x124ec): Mirror 1: 0x7480663e Mirror 3: 0x7480663e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x124ec: skipped 000612 1786633012.862042 MIRROR_RESYNC 3 mirrors 000615 1786633013.844011 mapwrite 0x0096b8 thru 0x00bcac (0x25f5 bytes) 000617 1786633014.090895 MIRROR_RESYNC 3 mirrors 000621 1786633014.999644 write 0x015a8b thru 0x01a642 (0x4bb8 bytes) 000622 1786633015.054703 trunc from 0x01a643 to 0x012bce (0x7a74 bytes) 000623 1786633015.087090 MIRROR_RESYNC 3 mirrors 000624 1786633016.368953 trunc from 0x012bcf to 0x001452 (0x1177c bytes) 000627 1786633016.511887 mapread 0x000de3 thru 0x001452 (0x670 bytes) 000628 1786633016.534476 read 0x0013ab thru 0x001452 (0xa8 bytes) 000629 1786633016.535389 mapwrite 0x011ed0 thru 0x01ed86 (0xceb7 bytes) 000630 1786633016.639710 read 0x01a90a thru 0x01ed86 (0x447d bytes) 000632 1786633016.646437 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ed87): Mirror 3: 0x460af5a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ed87): Mirror 3: 0x460af5a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ed87: skipped 000634 1786633017.082910 mapread 0x009250 thru 0x009b0e (0x8bf bytes) 000637 1786633017.093647 mapread 0x0042c1 thru 0x008cf4 (0x4a34 bytes) 000638 1786633017.120483 write 0x02c925 thru 0x02f327 (0x2a03 bytes) 000640 1786633017.127374 mapread 0x026ac3 thru 0x02c134 (0x5672 bytes) 000642 1786633017.147776 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f328): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f328): Mirror 3: 0xb6fdbac9 (stale) CRC-32 checksum value for chunk [0, 0x2f328): Mirror 1: 0xc3e2458 Mirror 4: 0xc3e2458 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f328: skipped 000643 1786633018.506132 trunc from 0x02f328 to 0x03b962 (0xc63b bytes) 000644 1786633018.669761 mapread 0x01c02c thru 0x026d16 (0xaceb bytes) 000646 1786633018.709407 MIRROR_RESYNC 3 mirrors 000648 1786633020.503375 trunc from 0x03b963 to 0x01383f (0x28123 bytes) 000649 1786633020.626608 trunc from 0x013840 to 0x03ace3 (0x274a4 bytes) 000650 1786633020.692407 write 0x038f82 thru 0x03ffff (0x707e bytes) 000651 1786633020.701080 mapread 0x00a9fb thru 0x011a97 (0x709d bytes) 000654 1786633020.764092 mapwrite 0x02895a thru 0x02c8cf (0x3f76 bytes) 000658 1786633020.941531 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9696ca0 (stale) Mirror 4: 0x9696ca0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdafb7f02 Mirror 5: 0xdafb7f02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000661 1786633022.795677 read 0x0233a6 thru 0x03201a (0xec75 bytes) 000663 1786633022.807752 mapwrite 0x0055ec thru 0x006230 (0xc45 bytes) 000664 1786633023.068968 mapwrite 0x029e19 thru 0x02e01a (0x4202 bytes) 000665 1786633023.187872 write 0x024143 thru 0x02927f (0x513d bytes) 000666 1786633023.189543 mapread 0x00c150 thru 0x012e8f (0x6d40 bytes) 000667 1786633023.210104 mapwrite 0x03a013 thru 0x03ffff (0x5fed bytes) 000669 1786633023.301443 read 0x006c50 thru 0x0143be (0xd76f bytes) 000672 1786633023.303297 trunc from 0x040000 to 0x016f02 (0x290fd bytes) 000673 1786633023.355801 mapwrite 0x01a863 thru 0x01e439 (0x3bd7 bytes) 000677 1786633023.443725 write 0x02a443 thru 0x035b44 (0xb702 bytes) 000678 1786633023.446200 mapwrite 0x03fc2e thru 0x03ffff (0x3d2 bytes) 000679 1786633023.531062 mapread 0x011a7f thru 0x018e9b (0x741d bytes) 000680 1786633023.533850 mapread 0x03ed32 thru 0x03ffff (0x12ce bytes) 000681 1786633023.536421 write 0x020b5e thru 0x025c1a (0x50bd bytes) 000685 1786633023.552578 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9696ca0 (stale) Mirror 5: 0xdafb7f02 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9696ca0 (stale) Mirror 5: 0xdafb7f02 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000686 1786633024.032420 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xdafb7f02 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xdafb7f02 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000687 1786633024.413382 mapread 0x01b67c thru 0x0292ad (0xdc32 bytes) 000689 1786633024.459881 mapread 0x02ca4d thru 0x03a8c5 (0xde79 bytes) 000690 1786633024.488801 MIRROR_RESYNC 2 mirrors 000691 1786633025.988124 trunc from 0x040000 to 0x024ecf (0x1b130 bytes) 000692 1786633026.106633 MIRROR_RESYNC 2 mirrors 000693 1786633027.350520 write 0x0317c9 thru 0x03aa6b (0x92a3 bytes) 000694 1786633027.431432 MIRROR_RESYNC 2 mirrors 000695 1786633028.976525 MIRROR_EXTEND to 3 mirrors 000696 1786633030.604258 trunc from 0x03aa6c to 0x020174 (0x1a8f7 bytes) 000697 1786633030.718278 read 0x009c8e thru 0x00deaa (0x421d bytes) 000698 1786633030.735234 read 0x004da0 thru 0x007981 (0x2be2 bytes) 000699 1786633030.764493 read 0x0054c1 thru 0x01160c (0xc14c bytes) 000701 1786633030.779058 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20175): Mirror 6: 0xb90cd4e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20175): Mirror 6: 0xb90cd4e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20175: skipped 000702 1786633031.109899 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000703 1786633031.243782 read 0x01880b thru 0x01cf47 (0x473d bytes) 000704 1786633031.257303 read 0x012a3a thru 0x017c38 (0x51ff bytes) 000706 1786633031.272323 mapread 0x011052 thru 0x01a26e (0x921d bytes) 000707 1786633031.274834 read 0x00fcad thru 0x012029 (0x237d bytes) 000711 1786633031.277252 mapread 0x00e76b thru 0x01a86e (0xc104 bytes) 000712 1786633031.283791 write 0x010f25 thru 0x01637f (0x545b bytes) 000714 1786633031.289268 trunc from 0x020175 to 0x017a36 (0x873e bytes) 000717 1786633031.324892 write 0x033945 thru 0x03df31 (0xa5ed bytes) 000718 1786633031.326454 mapwrite 0x039305 thru 0x03ffff (0x6cfb bytes) 000719 1786633031.425371 trunc from 0x040000 to 0x00fcf0 (0x3030f bytes) 000722 1786633031.446614 mapwrite 0x00e6c6 thru 0x016a54 (0x838f bytes) 000723 1786633031.557858 read 0x00612f thru 0x013f1a (0xddec bytes) 000724 1786633031.559229 mapread 0x010502 thru 0x01240d (0x1f0c bytes) 000725 1786633031.560868 read 0x00ab46 thru 0x015d6d (0xb228 bytes) 000727 1786633031.564332 trunc from 0x016a55 to 0x00daf7 (0x8f5d bytes) 000731 1786633031.590232 read 0x004a2a thru 0x00daf7 (0x90ce bytes) 000735 1786633031.594441 read 0x004cac thru 0x00daf7 (0x8e4c bytes) 000736 1786633031.595465 write 0x015402 thru 0x01ec4b (0x984a bytes) 000740 1786633031.601250 mapread 0x01df04 thru 0x01ec4b (0xd48 bytes) 000741 1786633031.602800 mapread 0x001443 thru 0x002594 (0x1152 bytes) 000745 1786633031.608494 write 0x028189 thru 0x02e3ff (0x6277 bytes) 000749 1786633031.614200 mapread 0x005868 thru 0x006043 (0x7dc bytes) 000750 1786633031.615824 mapread 0x023eb2 thru 0x02d185 (0x92d4 bytes) 000751 1786633031.624834 write 0x028611 thru 0x02ab89 (0x2579 bytes) 000753 1786633031.627749 trunc from 0x02e400 to 0x0003fe (0x2e001 bytes) 000756 1786633031.651810 mapread 0x0000a5 thru 0x0003fe (0x35a bytes) 000758 1786633031.657660 read 0x000388 thru 0x0003fe (0x77 bytes) 000760 1786633031.663960 trunc from 0x0003ff to 0x02eefd (0x2eaff bytes) 000762 1786633031.704853 mapread 0x01da70 thru 0x021aa4 (0x4035 bytes) 000765 1786633031.732795 mapwrite 0x0269b0 thru 0x03406e (0xd6bf bytes) 000766 1786633031.840420 mapread 0x011f70 thru 0x021d1e (0xfdaf bytes) 000770 1786633031.845803 read 0x009074 thru 0x009f53 (0xee0 bytes) 000774 1786633031.850058 read 0x02b260 thru 0x02b405 (0x1a6 bytes) 000776 1786633031.852695 write 0x03974b thru 0x03c946 (0x31fc bytes) 000783 1786633031.874430 mapwrite 0x00d2fb thru 0x00e62e (0x1334 bytes) 000784 1786633031.936518 trunc from 0x03c947 to 0x037162 (0x57e4 bytes) 000785 1786633031.949672 trunc from 0x037163 to 0x02a70a (0xca58 bytes) 000786 1786633031.966258 mapwrite 0x036ea7 thru 0x03d23c (0x6396 bytes) 000787 1786633032.031294 write 0x01fedb thru 0x02ae27 (0xaf4d bytes) 000789 1786633032.034698 mapread 0x0004f5 thru 0x0076e4 (0x71f0 bytes) 000790 1786633032.041743 MIRROR_EXTEND to 2 mirrors 000792 1786633033.079047 mapwrite 0x0164a4 thru 0x023052 (0xcbaf bytes) 000798 1786633033.299855 trunc from 0x03d23d to 0x013468 (0x29dd4 bytes) 000799 1786633033.368546 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x13469): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13469): Mirror 2: 0xb38e9870 (stale) CRC-32 checksum value for chunk [0, 0x13469): Mirror 1: 0xb38e9870 Mirror 3: 0xb38e9870 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13469: skipped 000801 1786633034.573052 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13469): Mirror 2: 0xb38e9870 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13469): Mirror 2: 0xb38e9870 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13469: skipped 000802 1786633035.144005 mapread 0x010eb6 thru 0x013468 (0x25b3 bytes) 000803 1786633035.171630 trunc from 0x013469 to 0x039791 (0x26329 bytes) 000805 1786633035.197548 mapwrite 0x02d9a8 thru 0x031a3e (0x4097 bytes) 000811 1786633035.321455 write 0x03b5b2 thru 0x03b5f2 (0x41 bytes) 000812 1786633035.322668 mapwrite 0x03f364 thru 0x03ffff (0xc9c bytes) 000813 1786633035.393815 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000814 1786633035.558713 MIRROR_EXTEND to 2 mirrors 000817 1786633036.704300 trunc from 0x040000 to 0x033ba0 (0xc45f bytes) 000819 1786633036.883973 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33ba1): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33ba1): Mirror 2: 0x58229be4 (stale) CRC-32 checksum value for chunk [0, 0x33ba1): Mirror 1: 0x58229be4 Mirror 3: 0x58229be4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33ba1: skipped 000820 1786633038.437223 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000823 1786633038.799904 mapread 0x02beec thru 0x033ba0 (0x7cb5 bytes) 000824 1786633038.832219 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000827 1786633039.035723 mapread 0x02f2eb thru 0x033a57 (0x476d bytes) 000828 1786633039.066092 mapwrite 0x03c045 thru 0x03ffff (0x3fbb bytes) 000829 1786633039.207299 trunc from 0x040000 to 0x0036be (0x3c941 bytes) 000830 1786633039.240734 write 0x02343a thru 0x02c012 (0x8bd9 bytes) 000831 1786633039.247268 write 0x00078f thru 0x0029c1 (0x2233 bytes) 000833 1786633039.269161 write 0x0309c1 thru 0x034d5f (0x439f bytes) 000834 1786633039.273731 trunc from 0x034d60 to 0x01abe6 (0x1a179 bytes) 000837 1786633039.300905 write 0x025912 thru 0x02c566 (0x6c55 bytes) 000839 1786633039.306621 read 0x001909 thru 0x003c59 (0x2351 bytes) 000840 1786633039.318777 MIRROR_EXTEND to 2 mirrors 000842 1786633040.084124 read 0x0195e9 thru 0x01fc45 (0x665d bytes) 000845 1786633040.092518 write 0x03fd35 thru 0x03ffff (0x2cb bytes) 000848 1786633040.157209 read 0x007555 thru 0x0146b8 (0xd164 bytes) 000849 1786633040.170381 MIRROR_RESYNC 2 mirrors 000850 1786633041.234898 MIRROR_RESYNC 2 mirrors 000851 1786633041.653562 write 0x02b743 thru 0x031247 (0x5b05 bytes) 000853 1786633041.769286 mapwrite 0x0398d7 thru 0x03f9d9 (0x6103 bytes) 000856 1786633041.915254 read 0x0195d5 thru 0x01acba (0x16e6 bytes) 000857 1786633041.921326 mapwrite 0x03050b thru 0x03bf5f (0xba55 bytes) 000858 1786633041.979936 read 0x022db0 thru 0x02f7f3 (0xca44 bytes) 000860 1786633041.992753 write 0x015198 thru 0x015594 (0x3fd bytes) 000862 1786633041.995080 mapwrite 0x03c5cf thru 0x03ffff (0x3a31 bytes) 000863 1786633042.058049 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x15bf4a83 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x24f6099d Mirror 3: 0x24f6099d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000864 1786633043.248171 write 0x00b001 thru 0x017508 (0xc508 bytes) 000865 1786633043.333620 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x24f6099d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x24f6099d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000866 1786633043.654270 write 0x039700 thru 0x03e431 (0x4d32 bytes) 000868 1786633043.676962 write 0x0180ea thru 0x019abf (0x19d6 bytes) 000869 1786633043.698404 write 0x01f378 thru 0x01f6d3 (0x35c bytes) 000871 1786633043.711185 read 0x01fd59 thru 0x023ba1 (0x3e49 bytes) 000872 1786633043.726728 trunc from 0x040000 to 0x0221c8 (0x1de37 bytes) 000873 1786633043.757736 read 0x00e5be thru 0x011016 (0x2a59 bytes) 000875 1786633043.778333 mapread 0x01fe52 thru 0x0201f0 (0x39f bytes) 000876 1786633043.783336 mapread 0x003633 thru 0x0103f4 (0xcdc2 bytes) 000878 1786633043.785278 write 0x0250be thru 0x026b9d (0x1ae0 bytes) 000880 1786633043.790810 mapread 0x0258e3 thru 0x026657 (0xd75 bytes) 000881 1786633043.798673 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000883 1786633043.963116 mapread 0x004101 thru 0x007a56 (0x3956 bytes) 000886 1786633043.987593 trunc from 0x026b9e to 0x034ec0 (0xe323 bytes) 000887 1786633044.017278 mapread 0x017fb1 thru 0x025be0 (0xdc30 bytes) 000888 1786633044.040604 trunc from 0x034ec1 to 0x001528 (0x33998 bytes) 000889 1786633044.058712 write 0x037054 thru 0x03ffff (0x8fac bytes) 000890 1786633044.062155 trunc from 0x040000 to 0x035a24 (0xa5db bytes) 000893 1786633044.089648 read 0x019540 thru 0x01b702 (0x21c3 bytes) 000895 1786633044.108175 read 0x01f9e7 thru 0x020eb0 (0x14ca bytes) 000896 1786633044.122146 MIRROR_EXTEND to 2 mirrors 000897 1786633044.937983 read 0x0143db thru 0x014dec (0xa12 bytes) 000898 1786633044.949959 mapread 0x002f28 thru 0x011c9c (0xed75 bytes) 000899 1786633044.986078 trunc from 0x035a25 to 0x0093e5 (0x2c63f bytes) 000900 1786633045.117704 trunc from 0x0093e6 to 0x02f2ae (0x25ec9 bytes) 000901 1786633045.145027 trunc from 0x02f2af to 0x023286 (0xc028 bytes) 000902 1786633045.166542 MIRROR_RESYNC 2 mirrors 000907 1786633045.926397 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1c2:0x0]: Invalid argument (22) 000908 1786633046.076956 mapread 0x015cbc thru 0x02212e (0xc473 bytes) 000909 1786633046.107769 mapread 0x01741f thru 0x023286 (0xbe68 bytes) 000914 1786633046.113557 mapwrite 0x013a3d thru 0x0209e3 (0xcfa7 bytes) 000915 1786633046.237640 read 0x0079e0 thru 0x01360a (0xbc2b bytes) 000916 1786633046.246741 mapwrite 0x02f21d thru 0x034aa0 (0x5884 bytes) 000919 1786633046.365004 trunc from 0x034aa1 to 0x035194 (0x6f4 bytes) 000921 1786633046.384169 trunc from 0x035195 to 0x03bce7 (0x6b53 bytes) 000922 1786633046.401681 mapread 0x02e7a7 thru 0x038dcc (0xa626 bytes) 000924 1786633046.412792 read 0x008851 thru 0x015324 (0xcad4 bytes) 000926 1786633046.415238 mapwrite 0x014dae thru 0x015202 (0x455 bytes) 000928 1786633046.450046 read 0x006bcb thru 0x00bb16 (0x4f4c bytes) 000929 1786633046.459741 mapread 0x00e019 thru 0x01b3b9 (0xd3a1 bytes) 000931 1786633046.461662 mapread 0x01b7ed thru 0x01d7c4 (0x1fd8 bytes) 000932 1786633046.463651 mapwrite 0x03771f thru 0x03ffff (0x88e1 bytes) 000933 1786633046.526106 read 0x0095f2 thru 0x015474 (0xbe83 bytes) 000936 1786633046.528452 mapwrite 0x03481a thru 0x03d005 (0x87ec bytes) 000937 1786633046.580956 mapwrite 0x01689c thru 0x0251a0 (0xe905 bytes) 000938 1786633046.626475 trunc from 0x040000 to 0x01480e (0x2b7f1 bytes) 000939 1786633046.642348 write 0x027624 thru 0x02f78f (0x816c bytes) 000941 1786633046.644229 mapread 0x01671f thru 0x01aaa7 (0x4389 bytes) 000946 1786633046.657361 mapwrite 0x03c154 thru 0x03c79a (0x647 bytes) 000952 1786633046.799045 mapread 0x02865f thru 0x032b2d (0xa4cf bytes) 000955 1786633046.802646 mapread 0x03c6a3 thru 0x03c79a (0xf8 bytes) 000956 1786633046.809416 mapwrite 0x03477d thru 0x03c155 (0x79d9 bytes) 000960 1786633046.884547 write 0x02018d thru 0x021105 (0xf79 bytes) 000964 1786633046.894698 MIRROR_EXTEND to 2 mirrors 000965 1786633048.380372 mapread 0x033bdc thru 0x03c79a (0x8bbf bytes) 000968 1786633048.400671 MIRROR_RESYNC 2 mirrors 000973 1786633048.715387 mapwrite 0x0114d2 thru 0x019d30 (0x885f bytes) 000975 1786633048.857662 trunc from 0x03c79b to 0x03515f (0x763b bytes) 000976 1786633048.877383 write 0x012875 thru 0x014b30 (0x22bc bytes) 000977 1786633048.879548 write 0x0293a5 thru 0x0387f8 (0xf454 bytes) 000978 1786633048.891122 MIRROR_RESYNC 2 mirrors 000982 1786633050.136385 MIRROR_EXTEND to 3 mirrors 000983 1786633051.162554 mapread 0x025a10 thru 0x032cc3 (0xd2b4 bytes) 000987 1786633051.187279 mapread 0x027a9d thru 0x031800 (0x9d64 bytes) 000988 1786633051.191204 write 0x037fa8 thru 0x03ffff (0x8058 bytes) 000989 1786633051.260849 mapwrite 0x038ffb thru 0x03ffff (0x7005 bytes) 000991 1786633051.302686 read 0x01148b thru 0x016b11 (0x5687 bytes) 000992 1786633051.310689 read 0x0135fa thru 0x0203a7 (0xcdae bytes) 000993 1786633051.319776 trunc from 0x040000 to 0x038ad6 (0x7529 bytes) 000994 1786633051.344176 mapread 0x016cb7 thru 0x025cd9 (0xf023 bytes) 000999 1786633051.349036 trunc from 0x038ad7 to 0x029938 (0xf19e bytes) All operations completed A-OK!