== sanity-flr test 70a: flr mode fsx test ================ 22:06:41 (1787191601) Seed set to 1603 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1787191603.434715 write 0x023dcf thru 0x0303d8 (0xc60a bytes) 000002 1787191603.447095 read 0x01fa26 thru 0x02977d (0x9d58 bytes) 000003 1787191603.457428 mapread 0x004021 thru 0x00c307 (0x82e7 bytes) 000004 1787191603.477249 write 0x037e74 thru 0x03ffff (0x818c bytes) 000005 1787191603.492480 write 0x00c6a0 thru 0x017e8a (0xb7eb bytes) 000006 1787191603.500717 read 0x029376 thru 0x032014 (0x8c9f bytes) 000008 1787191603.509563 read 0x02046a thru 0x02e270 (0xde07 bytes) 000009 1787191603.510922 mapwrite 0x010142 thru 0x019ec0 (0x9d7f bytes) 000011 1787191603.561363 read 0x01f23c thru 0x02e311 (0xf0d6 bytes) 000013 1787191603.563008 write 0x0005d9 thru 0x00d31c (0xcd44 bytes) truncating to largest ever: 0x14cc 000014 1787191603.565118 trunc from 0x040000 to 0x0014cb (0x3eb34 bytes) 000016 1787191603.581840 mapwrite 0x0008ea thru 0x000d69 (0x480 bytes) 000017 1787191603.627718 mapread 0x00082d thru 0x0014cb (0xc9f bytes) truncating to largest ever: 0x132d4 000020 1787191603.630233 trunc from 0x0014cc to 0x0132d3 (0x11e08 bytes) 000021 1787191603.657285 MIRROR_EXTEND to 2 mirrors 000022 1787191604.584328 mapread 0x00d6d5 thru 0x0132d3 (0x5bff bytes) 000023 1787191604.601688 mapread 0x0092ee thru 0x00fb3f (0x6852 bytes) 000027 1787191604.603755 mapread 0x00fcb1 thru 0x0132d3 (0x3623 bytes) truncating to largest ever: 0x3471b 000031 1787191604.606487 trunc from 0x0132d4 to 0x03471a (0x21447 bytes) 000032 1787191604.750095 mapwrite 0x033900 thru 0x037301 (0x3a02 bytes) 000033 1787191604.839063 read 0x00cd1a thru 0x014caa (0x7f91 bytes) 000034 1787191604.849225 write 0x00396e thru 0x00a884 (0x6f17 bytes) 000035 1787191604.858321 write 0x00fe37 thru 0x0135fc (0x37c6 bytes) 000036 1787191604.863638 MIRROR_RESYNC 2 mirrors 000037 1787191605.759698 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000039 1787191605.963597 mapwrite 0x0208b0 thru 0x0241e6 (0x3937 bytes) 000041 1787191606.144835 mapread 0x0259f7 thru 0x028e1c (0x3426 bytes) 000043 1787191606.148763 read 0x0049ba thru 0x00f3b4 (0xa9fb bytes) 000044 1787191606.160004 read 0x0047f4 thru 0x00e71d (0x9f2a bytes) 000045 1787191606.160645 read 0x031f45 thru 0x035631 (0x36ed bytes) 000047 1787191606.182207 mapread 0x035736 thru 0x037301 (0x1bcc bytes) 000048 1787191606.184702 write 0x014d71 thru 0x0165d9 (0x1869 bytes) 000054 1787191606.199033 mapread 0x014a82 thru 0x020b91 (0xc110 bytes) 000055 1787191606.214037 MIRROR_EXTEND to 2 mirrors 000056 1787191607.075285 mapwrite 0x0296f6 thru 0x02c66f (0x2f7a bytes) 000057 1787191607.311679 mapread 0x005c1e thru 0x0153b5 (0xf798 bytes) truncating to largest ever: 0x3e6ed 000058 1787191607.331187 trunc from 0x037302 to 0x03e6ec (0x73eb bytes) 000059 1787191607.398628 mapread 0x018f6a thru 0x028714 (0xf7ab bytes) 000062 1787191607.432131 mapread 0x029c3e thru 0x036fb3 (0xd376 bytes) 000063 1787191607.449478 mapwrite 0x02e563 thru 0x034833 (0x62d1 bytes) 000064 1787191607.571054 mapwrite 0x018f15 thru 0x026191 (0xd27d bytes) 000065 1787191607.615559 mapread 0x02fa00 thru 0x0362a9 (0x68aa bytes) 000066 1787191607.625345 MIRROR_RESYNC 2 mirrors 000068 1787191608.665503 mapwrite 0x03a67f thru 0x03ffff (0x5981 bytes) 000072 1787191608.818780 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2bee210b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x596f3a9e Mirror 3: 0x596f3a9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000074 1787191609.674883 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2bee210b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2bee210b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000075 1787191609.944324 mapwrite 0x02872c thru 0x029ea1 (0x1776 bytes) 000076 1787191610.066874 mapread 0x02a648 thru 0x034727 (0xa0e0 bytes) 000077 1787191610.083761 read 0x02efb9 thru 0x03d582 (0xe5ca bytes) 000079 1787191610.092932 trunc from 0x040000 to 0x034f55 (0xb0aa bytes) 000084 1787191610.121924 MIRROR_RESYNC 2 mirrors 000085 1787191610.993563 mapwrite 0x02134f thru 0x02f356 (0xe008 bytes) 000086 1787191611.378363 mapread 0x02118b thru 0x022ac6 (0x193c bytes) 000087 1787191611.382471 write 0x0121c2 thru 0x01e0de (0xbf1d bytes) 000089 1787191611.405535 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000090 1787191611.644604 MIRROR_EXTEND to 2 mirrors 000091 1787191612.852179 trunc from 0x034f56 to 0x01fc2a (0x1532b bytes) 000092 1787191612.996432 trunc from 0x01fc2b to 0x018b25 (0x7105 bytes) 000093 1787191613.020495 mapread 0x00cb6e thru 0x018b25 (0xbfb8 bytes) 000094 1787191613.072160 trunc from 0x018b26 to 0x02b47c (0x12957 bytes) 000096 1787191613.118729 MIRROR_RESYNC 2 mirrors 000100 1787191614.500099 mapwrite 0x01904b thru 0x01b97e (0x2934 bytes) 000101 1787191614.695676 mapread 0x022427 thru 0x02b47c (0x9056 bytes) 000102 1787191614.758270 mapwrite 0x021af8 thru 0x02ee41 (0xd34a bytes) 000112 1787191614.933542 mapwrite 0x016456 thru 0x01d874 (0x741f bytes) 000115 1787191614.980222 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000116 1787191615.120484 read 0x007a57 thru 0x007bf9 (0x1a3 bytes) 000119 1787191615.128683 trunc from 0x02ee42 to 0x027268 (0x7bd9 bytes) 000120 1787191615.141342 write 0x010e32 thru 0x01e3c4 (0xd593 bytes) 000124 1787191615.155402 mapread 0x002564 thru 0x00975e (0x71fb bytes) 000126 1787191615.170109 trunc from 0x027269 to 0x013199 (0x140cf bytes) 000127 1787191615.185484 write 0x02788e thru 0x037598 (0xfd0b bytes) 000129 1787191615.189057 mapread 0x0243e6 thru 0x02e6e7 (0xa302 bytes) 000131 1787191615.195672 write 0x025938 thru 0x027191 (0x185a bytes) 000132 1787191615.196570 read 0x034538 thru 0x037598 (0x3061 bytes) 000133 1787191615.197076 read 0x00d940 thru 0x017153 (0x9814 bytes) 000134 1787191615.204039 read 0x00bb29 thru 0x018495 (0xc96d bytes) 000137 1787191615.206111 mapread 0x00d05f thru 0x00f17d (0x211f bytes) 000139 1787191615.207867 read 0x00cdec thru 0x00d5c1 (0x7d6 bytes) 000143 1787191615.210422 mapwrite 0x039e69 thru 0x03b70e (0x18a6 bytes) 000145 1787191615.291929 read 0x01b878 thru 0x026fad (0xb736 bytes) 000148 1787191615.293523 write 0x023051 thru 0x025286 (0x2236 bytes) 000150 1787191615.296457 write 0x0161ac thru 0x0184dc (0x2331 bytes) 000151 1787191615.299717 mapread 0x017ab4 thru 0x01bd23 (0x4270 bytes) 000152 1787191615.302399 write 0x02e41f thru 0x031966 (0x3548 bytes) 000153 1787191615.303464 mapread 0x02c6a3 thru 0x02f2fe (0x2c5c bytes) 000157 1787191615.309770 mapread 0x017316 thru 0x01aac8 (0x37b3 bytes) 000158 1787191615.313262 mapwrite 0x03e564 thru 0x03ffff (0x1a9c bytes) 000159 1787191615.447301 trunc from 0x040000 to 0x023e59 (0x1c1a6 bytes) 000160 1787191615.470040 mapwrite 0x01927d thru 0x02523d (0xbfc1 bytes) 000162 1787191615.647613 trunc from 0x02523e to 0x0308b9 (0xb67c bytes) 000164 1787191615.688220 MIRROR_EXTEND to 2 mirrors 000166 1787191616.692744 trunc from 0x0308ba to 0x030de0 (0x527 bytes) 000167 1787191616.800608 trunc from 0x030de1 to 0x030ce5 (0xfb bytes) 000168 1787191616.858521 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x30ce6): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30ce6): Mirror 2: 0xfe3b77c1 (stale) CRC-32 checksum value for chunk [0, 0x30ce6): Mirror 1: 0xfe3b77c1 Mirror 3: 0xfe3b77c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30ce6: skipped 000170 1787191618.033382 mapread 0x019237 thru 0x01e6b5 (0x547f bytes) 000172 1787191618.064338 mapread 0x006387 thru 0x00d990 (0x760a bytes) 000174 1787191618.083050 trunc from 0x030ce6 to 0x00e2bf (0x22a26 bytes) 000177 1787191618.186384 trunc from 0x00e2c0 to 0x0012d9 (0xcfe6 bytes) 000179 1787191618.216599 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12da): Mirror 2: 0x85969b2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12da): Mirror 2: 0x85969b2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12da: skipped 000180 1787191618.554192 mapread 0x001079 thru 0x0012d9 (0x261 bytes) 000188 1787191618.565694 read 0x000304 thru 0x0012d9 (0xfd6 bytes) 000189 1787191618.571494 mapwrite 0x03021e thru 0x032a8b (0x286e bytes) 000191 1787191618.649763 trunc from 0x032a8c to 0x0078e7 (0x2b1a4 bytes) 000192 1787191618.671446 MIRROR_RESYNC 2 mirrors 000195 1787191619.388852 trunc from 0x0078e8 to 0x00bb65 (0x427e bytes) 000199 1787191619.520039 read 0x008b95 thru 0x00bb65 (0x2fd1 bytes) 000202 1787191619.533629 read 0x00400c thru 0x00bb65 (0x7b5a bytes) 000203 1787191619.554067 read 0x0076a8 thru 0x00a94f (0x32a8 bytes) 000204 1787191619.568343 write 0x02cce0 thru 0x0383b0 (0xb6d1 bytes) 000205 1787191619.573608 mapread 0x000d98 thru 0x004821 (0x3a8a bytes) 000209 1787191619.578051 mapread 0x02c72f thru 0x032773 (0x6045 bytes) 000210 1787191619.586770 mapwrite 0x01f7a3 thru 0x02d9d9 (0xe237 bytes) 000211 1787191619.768272 write 0x023f0f thru 0x02be37 (0x7f29 bytes) 000212 1787191619.769617 mapwrite 0x0357e2 thru 0x03e459 (0x8c78 bytes) 000213 1787191619.849971 read 0x00829d thru 0x00e64c (0x63b0 bytes) 000214 1787191619.850789 write 0x007a01 thru 0x013ccc (0xc2cc bytes) 000215 1787191619.853071 trunc from 0x03e45a to 0x016eb4 (0x275a5 bytes) 000217 1787191619.870735 MIRROR_RESYNC 2 mirrors 000218 1787191621.137867 write 0x00aae9 thru 0x01a65b (0xfb73 bytes) 000220 1787191621.251694 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000221 1787191621.511998 read 0x019f5b thru 0x01a65b (0x701 bytes) 000222 1787191621.521564 mapread 0x00aa24 thru 0x00d707 (0x2ce4 bytes) 000225 1787191621.567793 trunc from 0x01a65c to 0x019709 (0xf52 bytes) 000226 1787191621.586455 trunc from 0x01970a to 0x00aa21 (0xece8 bytes) 000230 1787191621.626697 mapread 0x002c96 thru 0x0046cf (0x1a3a bytes) 000231 1787191621.647693 MIRROR_EXTEND to 2 mirrors 000232 1787191622.716024 MIRROR_RESYNC 2 mirrors 000234 1787191623.218964 mapwrite 0x02c0ff thru 0x03682b (0xa72d bytes) 000235 1787191623.610545 mapread 0x0048a4 thru 0x00a793 (0x5ef0 bytes) 000238 1787191623.641966 mapwrite 0x02cf6d thru 0x03b219 (0xe2ad bytes) 000240 1787191623.762961 read 0x00caec thru 0x015551 (0x8a66 bytes) 000241 1787191623.776570 read 0x03731e thru 0x039d28 (0x2a0b bytes) 000242 1787191623.785710 MIRROR_RESYNC 2 mirrors 000243 1787191625.008394 trunc from 0x03b21a to 0x021513 (0x19d06 bytes) 000244 1787191625.148914 mapread 0x019667 thru 0x021513 (0x7ead bytes) 000245 1787191625.197127 read 0x0025f1 thru 0x006b80 (0x4590 bytes) 000246 1787191625.213193 trunc from 0x021514 to 0x02b7fa (0xa2e7 bytes) 000247 1787191625.247669 mapwrite 0x03a127 thru 0x03e70e (0x45e8 bytes) 000249 1787191625.354788 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000250 1787191625.506560 write 0x017687 thru 0x0272f4 (0xfc6e bytes) 000252 1787191625.522528 mapread 0x00692e thru 0x0075fe (0xcd1 bytes) 000256 1787191625.536029 read 0x0188f2 thru 0x01c397 (0x3aa6 bytes) 000257 1787191625.536933 read 0x01a8f5 thru 0x02661b (0xbd27 bytes) 000258 1787191625.537985 write 0x00d6be thru 0x011783 (0x40c6 bytes) 000259 1787191625.549684 mapread 0x003959 thru 0x008828 (0x4ed0 bytes) 000263 1787191625.554531 trunc from 0x03e70f to 0x0385bb (0x6153 bytes) 000265 1787191625.575313 trunc from 0x0385bc to 0x0256c5 (0x12ef6 bytes) 000266 1787191625.605373 mapwrite 0x00b64f thru 0x00bc58 (0x60a bytes) 000267 1787191625.658182 read 0x006e3d thru 0x010b27 (0x9ceb bytes) 000273 1787191625.664624 trunc from 0x0256c6 to 0x032b67 (0xd4a2 bytes) 000274 1787191625.705318 write 0x00edf0 thru 0x01b105 (0xc316 bytes) 000279 1787191625.727840 MIRROR_EXTEND to 2 mirrors 000281 1787191626.722126 mapwrite 0x006727 thru 0x006e47 (0x721 bytes) 000283 1787191626.895536 mapwrite 0x035d07 thru 0x03ffff (0xa2f9 bytes) 000284 1787191627.004367 mapwrite 0x013cd2 thru 0x01781f (0x3b4e bytes) 000287 1787191627.065671 mapwrite 0x003cf8 thru 0x0084ec (0x47f5 bytes) 000288 1787191627.151265 mapread 0x0239a4 thru 0x02ee0b (0xb468 bytes) 000293 1787191627.190339 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000294 1787191627.361472 mapread 0x036b93 thru 0x03dbad (0x701b bytes) 000296 1787191627.395283 write 0x01ba31 thru 0x01c9d9 (0xfa9 bytes) 000297 1787191627.410895 mapwrite 0x00781d thru 0x00e378 (0x6b5c bytes) 000299 1787191627.480785 read 0x013053 thru 0x0135f6 (0x5a4 bytes) 000305 1787191627.494040 mapread 0x01c5cf thru 0x026264 (0x9c96 bytes) 000306 1787191627.533849 write 0x00ec3b thru 0x01ddf7 (0xf1bd bytes) 000307 1787191627.535337 trunc from 0x040000 to 0x006b1e (0x394e1 bytes) 000309 1787191627.568558 trunc from 0x006b1f to 0x03701f (0x30501 bytes) 000311 1787191627.610498 write 0x010899 thru 0x01207e (0x17e6 bytes) 000315 1787191627.636286 trunc from 0x037020 to 0x03d709 (0x66ea bytes) 000317 1787191627.665907 mapwrite 0x00bdaa thru 0x013af7 (0x7d4e bytes) 000320 1787191627.746184 mapwrite 0x000394 thru 0x002891 (0x24fe bytes) 000323 1787191627.879210 trunc from 0x03d70a to 0x016c48 (0x26ac1 bytes) 000325 1787191627.934256 trunc from 0x016c49 to 0x00b619 (0xb62f bytes) 000326 1787191627.989297 trunc from 0x00b61a to 0x029ab3 (0x1e49a bytes) 000329 1787191628.037566 write 0x0053d0 thru 0x00d764 (0x8395 bytes) 000331 1787191628.055910 trunc from 0x029ab4 to 0x009f71 (0x1fb42 bytes) 000334 1787191628.084290 trunc from 0x009f72 to 0x00d008 (0x3097 bytes) 000335 1787191628.124452 trunc from 0x00d009 to 0x002235 (0xadd3 bytes) 000336 1787191628.158371 read 0x0003cc thru 0x002235 (0x1e6a bytes) 000337 1787191628.159480 mapwrite 0x0160f2 thru 0x02507a (0xef89 bytes) 000338 1787191628.287752 mapwrite 0x008e15 thru 0x011c0e (0x8dfa bytes) 000339 1787191628.366066 trunc from 0x02507b to 0x0050d5 (0x1ffa5 bytes) 000341 1787191628.394805 read 0x003294 thru 0x003f18 (0xc85 bytes) 000342 1787191628.395410 write 0x03d038 thru 0x03ffff (0x2fc8 bytes) 000346 1787191628.413220 read 0x03ace7 thru 0x03ffff (0x5319 bytes) 000348 1787191628.431646 mapwrite 0x004045 thru 0x0093ed (0x53a9 bytes) 000351 1787191628.512423 mapwrite 0x03706d thru 0x03ffff (0x8f93 bytes) 000354 1787191628.576345 mapwrite 0x003c0f thru 0x00dee3 (0xa2d5 bytes) 000361 1787191628.687189 trunc from 0x040000 to 0x00d284 (0x32d7b bytes) 000363 1787191628.714249 trunc from 0x00d285 to 0x012577 (0x52f3 bytes) 000364 1787191628.732367 mapread 0x00cfd8 thru 0x012577 (0x55a0 bytes) 000366 1787191628.759972 MIRROR_EXTEND to 2 mirrors 000367 1787191630.005014 write 0x001c18 thru 0x003b04 (0x1eed bytes) 000371 1787191630.106020 trunc from 0x012578 to 0x0388d2 (0x2635b bytes) 000372 1787191630.154281 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x388d3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x388d3): Mirror 2: 0xb7b554b2 (stale) CRC-32 checksum value for chunk [0, 0x388d3): Mirror 1: 0x88788be2 Mirror 3: 0x88788be2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x388d3: skipped 000375 1787191631.696943 write 0x0368c9 thru 0x037f2d (0x1665 bytes) 000376 1787191631.808258 mapread 0x01ff51 thru 0x02fe4c (0xfefc bytes) 000377 1787191631.839332 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x388d3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x388d3): Mirror 2: 0xb7b554b2 (stale) Mirror 3: 0x88788be2 (stale) CRC-32 checksum value for chunk [0, 0x388d3): Mirror 1: 0x7482b6c1 Mirror 4: 0x7482b6c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x388d3: skipped 000379 1787191633.321734 read 0x0197a4 thru 0x0250a1 (0xb8fe bytes) 000380 1787191633.332662 mapread 0x017d85 thru 0x0194b0 (0x172c bytes) 000382 1787191633.354337 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x388d3): Mirror 3: 0x88788be2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x388d3): Mirror 3: 0x88788be2 (stale) CRC-32 checksum value for chunk [0, 0x388d3): Mirror 1: 0x7482b6c1 Mirror 4: 0x7482b6c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x388d3: skipped 000387 1787191634.007067 write 0x036644 thru 0x03ec13 (0x85d0 bytes) 000389 1787191634.100267 trunc from 0x03ec14 to 0x03562c (0x95e7 bytes) 000392 1787191634.126561 trunc from 0x03562d to 0x013c0c (0x21a20 bytes) 000393 1787191634.148391 mapwrite 0x01f4b4 thru 0x02d4dd (0xe02a bytes) 000394 1787191634.274287 trunc from 0x02d4de to 0x01ed81 (0xe75c bytes) 000396 1787191634.297228 write 0x03c76e thru 0x03ffff (0x3892 bytes) 000397 1787191634.298532 trunc from 0x040000 to 0x03cacd (0x3532 bytes) 000398 1787191634.332262 read 0x00f581 thru 0x01a9d8 (0xb458 bytes) 000400 1787191634.358815 mapread 0x00c91f thru 0x0153b2 (0x8a94 bytes) 000401 1787191634.388331 mapwrite 0x020080 thru 0x02a790 (0xa711 bytes) 000403 1787191634.533491 trunc from 0x03cace to 0x017d9a (0x24d33 bytes) 000404 1787191634.571832 read 0x00adf7 thru 0x014bc9 (0x9dd3 bytes) 000405 1787191634.573207 read 0x011030 thru 0x0158f9 (0x48ca bytes) 000407 1787191634.575523 mapread 0x005905 thru 0x007e81 (0x257d bytes) 000410 1787191634.578069 trunc from 0x017d9b to 0x01b1dc (0x3442 bytes) 000412 1787191634.605575 mapread 0x013fc1 thru 0x017a29 (0x3a69 bytes) 000416 1787191634.611561 mapwrite 0x032b73 thru 0x038706 (0x5b94 bytes) 000417 1787191634.738445 write 0x0042b3 thru 0x0099b0 (0x56fe bytes) 000420 1787191634.740353 mapread 0x006639 thru 0x01228e (0xbc56 bytes) 000425 1787191634.752535 write 0x01c4d2 thru 0x0237d9 (0x7308 bytes) 000426 1787191634.759610 MIRROR_RESYNC 3 mirrors 000428 1787191635.615345 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000430 1787191635.873992 mapwrite 0x015351 thru 0x023ca4 (0xe954 bytes) 000433 1787191636.004483 trunc from 0x038707 to 0x00b6f0 (0x2d016 bytes) 000435 1787191636.023815 write 0x0391a4 thru 0x03ffff (0x6e5c bytes) 000436 1787191636.030012 MIRROR_RESYNC 2 mirrors 000437 1787191636.915516 write 0x02efc4 thru 0x03843e (0x947b bytes) 000438 1787191637.017986 mapread 0x00665c thru 0x012768 (0xc10d bytes) 000440 1787191637.059339 mapread 0x0265a3 thru 0x02aa8e (0x44ec bytes) 000443 1787191637.083501 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) 000444 1787191637.253635 mapwrite 0x027511 thru 0x034974 (0xd464 bytes) 000446 1787191637.352019 MIRROR_EXTEND to 2 mirrors 000448 1787191638.378021 read 0x016a89 thru 0x01cdbb (0x6333 bytes) 000449 1787191638.387693 mapread 0x018aa7 thru 0x021064 (0x85be bytes) 000450 1787191638.422459 mapread 0x0112ea thru 0x01cad1 (0xb7e8 bytes) 000452 1787191638.434948 mapwrite 0x03d90f thru 0x03ffff (0x26f1 bytes) 000453 1787191638.608558 mapread 0x00044d thru 0x003825 (0x33d9 bytes) 000454 1787191638.630239 read 0x02ef7f thru 0x030244 (0x12c6 bytes) 000456 1787191638.661084 mapwrite 0x00fa68 thru 0x010cca (0x1263 bytes) 000459 1787191638.723444 MIRROR_RESYNC 2 mirrors 000460 1787191639.656075 mapread 0x02b55f thru 0x037935 (0xc3d7 bytes) 000462 1787191639.702857 trunc from 0x040000 to 0x0143f9 (0x2bc06 bytes) 000464 1787191639.778191 MIRROR_RESYNC 2 mirrors 000465 1787191640.678463 read 0x013956 thru 0x0143f9 (0xaa4 bytes) 000470 1787191640.685380 read 0x0074dc thru 0x0143f9 (0xcf1e bytes) 000471 1787191640.695049 mapread 0x00f1ac thru 0x01350d (0x4362 bytes) 000473 1787191640.696479 read 0x003d9c thru 0x004214 (0x479 bytes) 000474 1787191640.697185 write 0x02099e thru 0x021dd4 (0x1437 bytes) 000475 1787191640.756265 write 0x039199 thru 0x03ffff (0x6e67 bytes) 000476 1787191640.765204 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7e261128 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa2fc2b3c Mirror 3: 0xa2fc2b3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000477 1787191641.646562 mapwrite 0x034ffe thru 0x038af6 (0x3af9 bytes) 000479 1787191641.878845 write 0x01fe4d thru 0x027e00 (0x7fb4 bytes) 000481 1787191641.903391 mapread 0x03459d thru 0x03ffff (0xba63 bytes) 000482 1787191641.909898 read 0x03ec42 thru 0x03ffff (0x13be bytes) 000483 1787191641.910950 trunc from 0x040000 to 0x02a5c0 (0x15a3f bytes) 000487 1787191641.951151 mapread 0x01ee22 thru 0x022b71 (0x3d50 bytes) 000489 1787191641.971089 write 0x014d1f thru 0x01a627 (0x5909 bytes) 000491 1787191641.994466 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a5c1): Mirror 2: 0x43259982 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a5c1): Mirror 2: 0x43259982 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a5c1: skipped 000493 1787191642.459797 mapread 0x023efe thru 0x02a5c0 (0x66c3 bytes) 000494 1787191642.493463 write 0x02c664 thru 0x02f76e (0x310b bytes) 000496 1787191642.499809 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f76f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f76f): Mirror 2: 0x193a637f (stale) CRC-32 checksum value for chunk [0, 0x2f76f): Mirror 1: 0xfb4304fc Mirror 3: 0xfb4304fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f76f: skipped 000497 1787191643.199932 mapread 0x00d15f thru 0x013473 (0x6315 bytes) 000499 1787191643.238166 mapread 0x0138a5 thru 0x01ba43 (0x819f bytes) 000502 1787191643.251620 mapwrite 0x006d52 thru 0x009678 (0x2927 bytes) 000507 1787191643.416990 trunc from 0x02f76f to 0x03c5fd (0xce8f bytes) 000509 1787191643.457522 mapwrite 0x026d7c thru 0x031b33 (0xadb8 bytes) 000510 1787191643.556940 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c5fe): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c5fe): Mirror 2: 0x1ac1662c (stale) Mirror 3: 0x68efdde3 (stale) CRC-32 checksum value for chunk [0, 0x3c5fe): Mirror 1: 0x482341d1 Mirror 4: 0x482341d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c5fe: skipped 000511 1787191644.262541 trunc from 0x03c5fe to 0x01c903 (0x1fcfa bytes) 000512 1787191644.386319 write 0x03945d thru 0x03ffff (0x6ba3 bytes) 000513 1787191644.389237 write 0x03a4cc thru 0x03ffff (0x5b34 bytes) 000515 1787191644.395521 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7e261128 (stale) Mirror 3: 0x61e0210b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7e261128 (stale) Mirror 3: 0x61e0210b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000519 1787191644.693268 trunc from 0x040000 to 0x013c82 (0x2c37d bytes) 000524 1787191644.713790 mapwrite 0x0025a5 thru 0x00c72e (0xa18a bytes) 000525 1787191644.777708 read 0x00c5ff thru 0x013c82 (0x7684 bytes) 000526 1787191644.785074 trunc from 0x013c83 to 0x017a34 (0x3db2 bytes) 000528 1787191644.805051 write 0x02f5a7 thru 0x03a292 (0xacec bytes) 000531 1787191644.811106 mapwrite 0x0065ed thru 0x01580f (0xf223 bytes) 000532 1787191644.864270 trunc from 0x03a293 to 0x02176a (0x18b28 bytes) 000533 1787191644.878445 trunc from 0x02176b to 0x019c1f (0x7b4b bytes) 000534 1787191644.897017 mapwrite 0x01fe90 thru 0x025a74 (0x5be5 bytes) 000537 1787191644.958916 trunc from 0x025a75 to 0x0111bd (0x148b7 bytes) 000538 1787191644.976087 mapwrite 0x013099 thru 0x01c36f (0x92d7 bytes) 000541 1787191645.098023 trunc from 0x01c370 to 0x00f847 (0xcb28 bytes) 000543 1787191645.125868 mapread 0x00e4ed thru 0x00f847 (0x135b bytes) 000545 1787191645.136516 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xf848): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf848): Mirror 2: 0x18b479b2 (stale) Mirror 3: 0x18b479b2 (stale) CRC-32 checksum value for chunk [0, 0xf848): Mirror 1: 0x56cb2da6 Mirror 4: 0x56cb2da6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf848: skipped 000546 1787191646.114176 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf848): Mirror 3: 0x18b479b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf848): Mirror 3: 0x18b479b2 (stale) CRC-32 checksum value for chunk [0, 0xf848): Mirror 1: 0x56cb2da6 Mirror 4: 0x56cb2da6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf848: skipped 000547 1787191646.653823 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf848): Mirror 3: 0x18b479b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf848): Mirror 3: 0x18b479b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf848: skipped 000550 1787191646.971090 mapwrite 0x01b1d1 thru 0x02ae85 (0xfcb5 bytes) 000551 1787191647.081015 mapwrite 0x023a7f thru 0x02ad4a (0x72cc bytes) 000552 1787191647.119531 read 0x020b4c thru 0x02ae85 (0xa33a bytes) 000553 1787191647.120384 mapread 0x00b055 thru 0x014076 (0x9022 bytes) 000556 1787191647.135041 mapread 0x0041d5 thru 0x00dcdf (0x9b0b bytes) 000557 1787191647.140906 MIRROR_RESYNC 2 mirrors 000558 1787191647.744194 write 0x00a6b1 thru 0x00f624 (0x4f74 bytes) 000560 1787191647.838284 write 0x034089 thru 0x03517d (0x10f5 bytes) 000561 1787191647.840637 trunc from 0x03517e to 0x015294 (0x1fee9 bytes) 000562 1787191647.884391 read 0x0016ce thru 0x007175 (0x5aa8 bytes) 000563 1787191647.893423 mapread 0x011a50 thru 0x015294 (0x3845 bytes) 000572 1787191647.918291 write 0x00bb25 thru 0x0130f5 (0x75d1 bytes) 000573 1787191647.921873 read 0x00ce97 thru 0x0144de (0x7648 bytes) 000574 1787191647.923967 mapwrite 0x0187be thru 0x019680 (0xec3 bytes) 000575 1787191648.043945 mapwrite 0x02f74c thru 0x039c02 (0xa4b7 bytes) 000576 1787191648.132799 read 0x035831 thru 0x039c02 (0x43d2 bytes) 000577 1787191648.134282 trunc from 0x039c03 to 0x03cb02 (0x2f00 bytes) 000578 1787191648.161048 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3cb03): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb03): Mirror 3: 0xc0c6b8f1 (stale) CRC-32 checksum value for chunk [0, 0x3cb03): Mirror 1: 0x442f8a73 Mirror 4: 0x442f8a73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb03: skipped 000579 1787191649.073960 read 0x017989 thru 0x01bcc6 (0x433e bytes) 000580 1787191649.087045 MIRROR_RESYNC 3 mirrors 000581 1787191650.011244 trunc from 0x03cb03 to 0x005698 (0x3746a bytes) 000582 1787191650.120979 read 0x0024ec thru 0x004fd1 (0x2ae6 bytes) 000583 1787191650.136962 MIRROR_RESYNC 3 mirrors 000584 1787191650.790621 MIRROR_EXTEND to 4 mirrors 000585 1787191651.392778 trunc from 0x005699 to 0x013738 (0xe0a0 bytes) 000586 1787191651.466728 mapread 0x0114a4 thru 0x013738 (0x2295 bytes) 000587 1787191651.482744 read 0x00eebd thru 0x00fdf2 (0xf36 bytes) 000588 1787191651.487940 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13739): Mirror 4: 0xa7941069 (stale) Mirror 5: 0xa7941069 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13739): Mirror 4: 0xa7941069 (stale) Mirror 5: 0xa7941069 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13739: skipped 000589 1787191651.744016 trunc from 0x013739 to 0x032dcf (0x1f697 bytes) 000590 1787191651.760809 write 0x03d735 thru 0x03ea22 (0x12ee bytes) 000592 1787191651.766313 MIRROR_RESYNC 3 mirrors 000593 1787191652.715178 write 0x01d40b thru 0x025405 (0x7ffb bytes) 000596 1787191652.798476 read 0x01a029 thru 0x0238b4 (0x988c bytes) 000597 1787191652.807830 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ea23): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea23): Mirror 4: 0xe46ec774 (stale) Mirror 5: 0xe46ec774 (stale) CRC-32 checksum value for chunk [0, 0x3ea23): Mirror 1: 0x57a1e2b Mirror 6: 0x57a1e2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea23: skipped 000599 1787191653.683796 mapwrite 0x03d79a thru 0x03ffff (0x2866 bytes) 000600 1787191653.814833 write 0x020a01 thru 0x027c09 (0x7209 bytes) 000601 1787191653.826108 mapwrite 0x01f9ca thru 0x028303 (0x893a bytes) 000603 1787191653.881088 read 0x039fd1 thru 0x03ffff (0x602f bytes) 000604 1787191653.885712 MIRROR_RESYNC 4 mirrors 000605 1787191654.936950 trunc from 0x040000 to 0x016520 (0x29adf bytes) 000609 1787191655.023267 mapread 0x00b907 thru 0x00bff6 (0x6f0 bytes) 000611 1787191655.029567 trunc from 0x016521 to 0x006efb (0xf625 bytes) 000615 1787191655.066935 mapread 0x00299f thru 0x006efb (0x455d bytes) 000617 1787191655.082203 mapwrite 0x0041f3 thru 0x00c66d (0x847b bytes) 000618 1787191655.150101 write 0x026676 thru 0x035296 (0xec21 bytes) 000619 1787191655.153572 mapread 0x00367c thru 0x00c234 (0x8bb9 bytes) 000620 1787191655.159734 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35297): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35297): Mirror 4: 0x3f9ee901 (stale) Mirror 5: 0x3f9ee901 (stale) Mirror 6: 0x3f9ee901 (stale) CRC-32 checksum value for chunk [0, 0x35297): Mirror 1: 0xc0dd1c0e Mirror 7: 0xc0dd1c0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35297: skipped 000622 1787191656.061001 write 0x0306fa thru 0x036e1f (0x6726 bytes) 000625 1787191656.188435 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x36e20): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e20): Mirror 4: 0x848b375 (stale) Mirror 5: 0x848b375 (stale) Mirror 6: 0x848b375 (stale) Mirror 7: 0xb6816ff (stale) CRC-32 checksum value for chunk [0, 0x36e20): Mirror 1: 0x52caef3b Mirror 8: 0x52caef3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e20: skipped truncating to largest ever: 0x3fb92 000626 1787191657.330259 trunc from 0x036e20 to 0x03fb91 (0x8d72 bytes) 000627 1787191657.452108 read 0x038cd3 thru 0x03fb91 (0x6ebf bytes) 000628 1787191657.481258 mapwrite 0x016f5b thru 0x01cb75 (0x5c1b bytes) 000629 1787191657.573100 read 0x02e512 thru 0x034bcb (0x66ba bytes) 000630 1787191657.597320 trunc from 0x03fb92 to 0x03ac48 (0x4f49 bytes) 000632 1787191657.618831 trunc from 0x03ac49 to 0x037e53 (0x2df5 bytes) 000634 1787191657.634164 mapread 0x00ba18 thru 0x00d133 (0x171c bytes) 000636 1787191657.636702 read 0x008d1c thru 0x009b23 (0xe08 bytes) 000638 1787191657.642183 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37e54): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e54): Mirror 4: 0x50c6a0fd (stale) Mirror 5: 0x50c6a0fd (stale) Mirror 6: 0x50c6a0fd (stale) Mirror 7: 0x60f48add (stale) Mirror 8: 0xcb28933d (stale) CRC-32 checksum value for chunk [0, 0x37e54): Mirror 1: 0x62e6bcf9 Mirror 9: 0x62e6bcf9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e54: skipped 000639 1787191658.624424 write 0x019075 thru 0x01c9bd (0x3949 bytes) 000641 1787191658.766284 write 0x017200 thru 0x01d589 (0x638a bytes) 000642 1787191658.796989 mapread 0x004198 thru 0x00f0a4 (0xaf0d bytes) 000643 1787191658.815744 write 0x00b028 thru 0x012647 (0x7620 bytes) 000644 1787191658.822551 mapread 0x007473 thru 0x010d41 (0x98cf bytes) 000645 1787191658.824362 mapwrite 0x016bf0 thru 0x021bef (0xb000 bytes) 000647 1787191658.897905 write 0x01ab80 thru 0x01afd3 (0x454 bytes) 000648 1787191658.904036 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37e54): Mirror 4: 0x50c6a0fd (stale) Mirror 5: 0x50c6a0fd (stale) Mirror 6: 0x50c6a0fd (stale) Mirror 7: 0x60f48add (stale) Mirror 9: 0x62e6bcf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e54): Mirror 4: 0x50c6a0fd (stale) Mirror 5: 0x50c6a0fd (stale) Mirror 6: 0x50c6a0fd (stale) Mirror 7: 0x60f48add (stale) Mirror 9: 0x62e6bcf9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e54: skipped 000649 1787191659.361664 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37e54): Mirror 4: 0x50c6a0fd (stale) Mirror 5: 0x50c6a0fd (stale) Mirror 7: 0x60f48add (stale) Mirror 9: 0x62e6bcf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e54): Mirror 4: 0x50c6a0fd (stale) Mirror 5: 0x50c6a0fd (stale) Mirror 7: 0x60f48add (stale) Mirror 9: 0x62e6bcf9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e54: skipped 000650 1787191659.938843 mapwrite 0x024563 thru 0x02e38b (0x9e29 bytes) 000651 1787191660.007199 read 0x01f43c thru 0x0200bf (0xc84 bytes) 000653 1787191660.011684 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37e54): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e54): Mirror 4: 0x50c6a0fd (stale) Mirror 5: 0x50c6a0fd (stale) Mirror 7: 0x60f48add (stale) Mirror 9: 0x62e6bcf9 (stale) CRC-32 checksum value for chunk [0, 0x37e54): Mirror 1: 0xafe452f Mirror 10: 0xafe452f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e54: skipped 000654 1787191661.082944 mapread 0x00e8a8 thru 0x01ca49 (0xe1a2 bytes) 000655 1787191661.120320 trunc from 0x037e54 to 0x002815 (0x3563e bytes) 000659 1787191661.247527 trunc from 0x002816 to 0x0189b3 (0x1619e bytes) 000661 1787191661.309454 mapread 0x001521 thru 0x00adca (0x98aa bytes) 000662 1787191661.325635 mapread 0x00a31f thru 0x011bd6 (0x78b8 bytes) 000664 1787191661.341090 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x189b4): Mirror 5: 0x960fdbbb (stale) Mirror 7: 0x9ba9cfe8 (stale) Mirror 9: 0xc00267b6 (stale) Mirror 10: 0x1e00efab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x189b4): Mirror 5: 0x960fdbbb (stale) Mirror 7: 0x9ba9cfe8 (stale) Mirror 9: 0xc00267b6 (stale) Mirror 10: 0x1e00efab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x189b4: skipped 000665 1787191661.791283 write 0x00fec5 thru 0x01f67d (0xf7b9 bytes) 000666 1787191661.827013 MIRROR_RESYNC 5 mirrors 000667 1787191663.192842 MIRROR_EXTEND to 6 mirrors 000668 1787191663.843782 mapread 0x0130ad thru 0x01840e (0x5362 bytes) 000669 1787191663.867292 write 0x03e3e7 thru 0x03ffff (0x1c19 bytes) 000670 1787191663.956793 write 0x039dd4 thru 0x03d99c (0x3bc9 bytes) 000671 1787191663.970751 mapread 0x030413 thru 0x03908f (0x8c7d bytes) 000674 1787191663.979972 mapwrite 0x03dd51 thru 0x03ffff (0x22af bytes) 000678 1787191664.029196 trunc from 0x040000 to 0x00a2d4 (0x35d2b bytes) 000680 1787191664.050507 trunc from 0x00a2d5 to 0x02ce28 (0x22b54 bytes) 000683 1787191664.067315 read 0x0026f8 thru 0x009be3 (0x74ec bytes) 000684 1787191664.075393 trunc from 0x02ce29 to 0x02e188 (0x1360 bytes) 000685 1787191664.088813 write 0x001018 thru 0x00cb53 (0xbb3c bytes) 000687 1787191664.103509 MIRROR_RESYNC 6 mirrors 000688 1787191665.103202 MIRROR_RESYNC 6 mirrors 000690 1787191665.465709 write 0x01a407 thru 0x01cda1 (0x299b bytes) 000693 1787191665.552328 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e189): Mirror 7: 0x32f1c477 (stale) Mirror 9: 0x32f1c477 (stale) Mirror 10: 0x32f1c477 (stale) Mirror 11: 0x32f1c477 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e189): Mirror 7: 0x32f1c477 (stale) Mirror 9: 0x32f1c477 (stale) Mirror 10: 0x32f1c477 (stale) Mirror 11: 0x32f1c477 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e189: skipped 000696 1787191665.944397 mapwrite 0x009f9d thru 0x018fad (0xf011 bytes) 000697 1787191666.050954 read 0x00329c thru 0x009281 (0x5fe6 bytes) 000699 1787191666.066822 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e189): Mirror 7: 0x32f1c477 (stale) Mirror 9: 0x32f1c477 (stale) Mirror 11: 0x32f1c477 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e189): Mirror 7: 0x32f1c477 (stale) Mirror 9: 0x32f1c477 (stale) Mirror 11: 0x32f1c477 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e189: skipped 000703 1787191666.373117 read 0x0030fa thru 0x009aca (0x69d1 bytes) 000704 1787191666.380832 trunc from 0x02e189 to 0x034c5e (0x6ad6 bytes) 000706 1787191666.415662 mapread 0x0027ec thru 0x00f791 (0xcfa6 bytes) 000708 1787191666.440215 MIRROR_RESYNC 4 mirrors 000709 1787191667.593384 read 0x00b71f thru 0x016297 (0xab79 bytes) 000710 1787191667.618439 trunc from 0x034c5f to 0x008052 (0x2cc0c bytes) 000712 1787191667.838502 mapread 0x00742e thru 0x008052 (0xc25 bytes) 000713 1787191667.857795 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x8053): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8053): Mirror 7: 0xc1b664ff (stale) Mirror 9: 0xc1b664ff (stale) Mirror 11: 0xc1b664ff (stale) CRC-32 checksum value for chunk [0, 0x8053): Mirror 1: 0xc1b664ff Mirror 12: 0xc1b664ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8053: skipped 000715 1787191668.958717 read 0x0022e7 thru 0x004728 (0x2442 bytes) 000720 1787191669.013891 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x8053): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8053): Mirror 7: 0xc1b664ff (stale) Mirror 9: 0xc1b664ff (stale) Mirror 11: 0xc1b664ff (stale) CRC-32 checksum value for chunk [0, 0x8053): Mirror 1: 0xc1b664ff Mirror 12: 0xc1b664ff Mirror 13: 0xc1b664ff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8053: skipped 000722 1787191669.964166 write 0x02a747 thru 0x032a71 (0x832b bytes) 000725 1787191670.047754 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x32a72): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a72): Mirror 7: 0xd0730cf3 (stale) Mirror 9: 0xd0730cf3 (stale) Mirror 11: 0xd0730cf3 (stale) Mirror 12: 0x99274cc3 (stale) Mirror 13: 0x99274cc3 (stale) CRC-32 checksum value for chunk [0, 0x32a72): Mirror 1: 0xf9a471f Mirror 14: 0xf9a471f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a72: skipped 000726 1787191671.725392 mapwrite 0x0394a2 thru 0x03ffff (0x6b5e bytes) 000727 1787191672.070614 trunc from 0x040000 to 0x008ba7 (0x37458 bytes) 000729 1787191672.093760 write 0x03e16b thru 0x03ffff (0x1e95 bytes) 000730 1787191672.095407 mapread 0x014509 thru 0x01c0b3 (0x7bab bytes) 000731 1787191672.103732 mapread 0x012d66 thru 0x01642e (0x36c9 bytes) 000733 1787191672.110120 MIRROR_RESYNC 7 mirrors 000736 1787191674.067079 mapwrite 0x02cd2e thru 0x02d8b9 (0xb8c bytes) 000737 1787191674.255048 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xf9fee582 (stale) Mirror 9: 0xf9fee582 (stale) Mirror 11: 0xf9fee582 (stale) Mirror 12: 0xf9fee582 (stale) Mirror 13: 0xf9fee582 (stale) Mirror 14: 0xf9fee582 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6dd9ca61 Mirror 15: 0x6dd9ca61 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000738 1787191675.331347 mapwrite 0x02615c thru 0x029403 (0x32a8 bytes) 000739 1787191675.495429 mapwrite 0x025422 thru 0x0334f0 (0xe0cf bytes) 000745 1787191675.564051 write 0x00912a thru 0x018ddf (0xfcb6 bytes) 000747 1787191675.574047 write 0x036576 thru 0x03ffff (0x9a8a bytes) 000749 1787191675.576765 mapwrite 0x015c48 thru 0x0170b2 (0x146b bytes) 000751 1787191675.652004 read 0x008b68 thru 0x0131e4 (0xa67d bytes) 000753 1787191675.658217 mapread 0x02c96d thru 0x033d6c (0x7400 bytes) 000754 1787191675.659850 read 0x02b598 thru 0x038ab9 (0xd522 bytes) 000756 1787191675.661093 write 0x011610 thru 0x011e4f (0x840 bytes) 000757 1787191675.662889 read 0x013ded thru 0x01f777 (0xb98b bytes) 000758 1787191675.673923 trunc from 0x040000 to 0x03a0d4 (0x5f2b bytes) 000761 1787191675.704270 mapwrite 0x010b90 thru 0x01dca1 (0xd112 bytes) 000765 1787191675.796097 mapread 0x01e4ff thru 0x021aa2 (0x35a4 bytes) 000769 1787191675.799308 write 0x033958 thru 0x03daf4 (0xa19d bytes) 000770 1787191675.801308 read 0x003a22 thru 0x0107b6 (0xcd95 bytes) 000771 1787191675.806449 MIRROR_RESYNC 8 mirrors 000773 1787191677.776768 read 0x02462a thru 0x02474c (0x123 bytes) 000775 1787191677.788044 read 0x00a4e4 thru 0x00b536 (0x1053 bytes) 000777 1787191677.810021 mapwrite 0x01661d thru 0x01e634 (0x8018 bytes) 000783 1787191678.196678 read 0x0376e8 thru 0x03a25a (0x2b73 bytes) 000785 1787191678.245955 mapwrite 0x032a0b thru 0x03bccb (0x92c1 bytes) 000787 1787191678.330039 mapwrite 0x002280 thru 0x00b8d6 (0x9657 bytes) 000789 1787191678.406310 read 0x02b15d thru 0x0363e7 (0xb28b bytes) 000790 1787191678.407307 trunc from 0x03daf5 to 0x003af0 (0x3a004 bytes) 000791 1787191678.444620 mapread 0x002e5c thru 0x003af0 (0xc95 bytes) 000793 1787191678.454009 mapwrite 0x03a79c thru 0x03ffff (0x5864 bytes) 000794 1787191678.581656 write 0x0319bb thru 0x03e179 (0xc7bf bytes) 000795 1787191678.584300 mapread 0x03c7fa thru 0x03ffff (0x3806 bytes) 000796 1787191678.585755 read 0x033ec0 thru 0x03ffff (0xc140 bytes) 000797 1787191678.586432 read 0x03c616 thru 0x03ffff (0x39ea bytes) 000800 1787191678.592337 MIRROR_RESYNC 8 mirrors 000802 1787191680.445305 write 0x035a57 thru 0x03ffff (0xa5a9 bytes) 000803 1787191680.587430 mapread 0x0268a9 thru 0x032114 (0xb86c bytes) 000804 1787191680.624839 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x1fe09241 (stale) Mirror 11: 0x1fe09241 (stale) Mirror 12: 0x1fe09241 (stale) Mirror 13: 0x1fe09241 (stale) Mirror 14: 0x1fe09241 (stale) Mirror 15: 0x1fe09241 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x1fe09241 (stale) Mirror 11: 0x1fe09241 (stale) Mirror 12: 0x1fe09241 (stale) Mirror 13: 0x1fe09241 (stale) Mirror 14: 0x1fe09241 (stale) Mirror 15: 0x1fe09241 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000805 1787191681.140881 mapwrite 0x030b01 thru 0x0312bb (0x7bb bytes) 000807 1787191681.193894 MIRROR_RESYNC 7 mirrors 000809 1787191683.564038 mapwrite 0x03be39 thru 0x03ffff (0x41c7 bytes) 000810 1787191683.787977 trunc from 0x040000 to 0x0372b1 (0x8d4e bytes) 000811 1787191683.825013 mapwrite 0x00dbfc thru 0x0187e5 (0xabea bytes) 000812 1787191683.973816 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x372b2): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x372b2): Mirror 7: 0xa308726e (stale) Mirror 11: 0xa308726e (stale) Mirror 12: 0xa308726e (stale) Mirror 13: 0xa308726e (stale) Mirror 14: 0xa308726e (stale) Mirror 15: 0xa308726e (stale) CRC-32 checksum value for chunk [0, 0x372b2): Mirror 1: 0xa3137bde Mirror 16: 0xa3137bde lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x372b2: skipped 000815 1787191685.315163 write 0x0180fa thru 0x01d460 (0x5367 bytes) 000816 1787191685.441298 trunc from 0x0372b2 to 0x00de64 (0x2944d bytes) 000819 1787191685.476220 write 0x002258 thru 0x00f619 (0xd3c2 bytes) 000822 1787191685.485512 mapwrite 0x03dbea thru 0x03ffff (0x2416 bytes) 000823 1787191685.640670 mapwrite 0x00c3f1 thru 0x011470 (0x5080 bytes) 000824 1787191685.791892 read 0x021c00 thru 0x022ee7 (0x12e8 bytes) 000825 1787191685.816274 MIRROR_RESYNC 8 mirrors 000826 1787191688.334017 trunc from 0x040000 to 0x00bb95 (0x3446a bytes) 000829 1787191688.445331 mapwrite 0x01f44f thru 0x02137d (0x1f2f bytes) 000830 1787191688.609952 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2137e): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2137e): Mirror 7: 0xa4b793d2 (stale) Mirror 11: 0xa4b793d2 (stale) Mirror 12: 0xa4b793d2 (stale) Mirror 13: 0xa4b793d2 (stale) Mirror 14: 0xa4b793d2 (stale) Mirror 15: 0xa4b793d2 (stale) Mirror 16: 0xa4b793d2 (stale) CRC-32 checksum value for chunk [0, 0x2137e): Mirror 1: 0xe220f0e1 Mirror 17: 0xe220f0e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2137e: skipped 000831 1787191689.972296 mapread 0x00289f thru 0x00d6ea (0xae4c bytes) 000832 1787191690.052757 mapwrite 0x00497e thru 0x0053c5 (0xa48 bytes) 000836 1787191690.269064 write 0x00fb31 thru 0x01994d (0x9e1d bytes) 000837 1787191690.275654 mapread 0x0192e5 thru 0x02137d (0x8099 bytes) 000838 1787191690.284729 trunc from 0x02137e to 0x028088 (0x6d0b bytes) 000839 1787191690.307978 mapread 0x01ace1 thru 0x028088 (0xd3a8 bytes) 000840 1787191690.351055 trunc from 0x028089 to 0x03e7e9 (0x16761 bytes) 000841 1787191690.371722 mapwrite 0x02c776 thru 0x0313f4 (0x4c7f bytes) 000842 1787191690.418670 mapread 0x01096d thru 0x017808 (0x6e9c bytes) 000852 1787191690.425942 mapwrite 0x01c34c thru 0x02a060 (0xdd15 bytes) 000856 1787191690.481675 write 0x02a4e0 thru 0x02d955 (0x3476 bytes) 000857 1787191690.482882 mapwrite 0x0373e0 thru 0x03ffff (0x8c20 bytes) 000859 1787191690.590792 read 0x01159d thru 0x018cac (0x7710 bytes) 000860 1787191690.592385 write 0x039171 thru 0x03ffff (0x6e8f bytes) 000862 1787191690.594222 write 0x007c26 thru 0x017bde (0xffb9 bytes) 000863 1787191690.596244 write 0x03a2df thru 0x03b215 (0xf37 bytes) 000864 1787191690.597348 read 0x024e01 thru 0x02c356 (0x7556 bytes) 000865 1787191690.600442 read 0x02513e thru 0x028e02 (0x3cc5 bytes) 000867 1787191690.603958 read 0x03818d thru 0x03ffff (0x7e73 bytes) 000868 1787191690.604715 write 0x01edb6 thru 0x028f11 (0xa15c bytes) 000871 1787191690.609874 mapwrite 0x005c5c thru 0x009584 (0x3929 bytes) 000872 1787191690.744398 read 0x0314d4 thru 0x03417b (0x2ca8 bytes) 000873 1787191690.745003 trunc from 0x040000 to 0x0172be (0x28d41 bytes) 000874 1787191690.787383 mapwrite 0x011340 thru 0x01c833 (0xb4f4 bytes) 000875 1787191690.921713 write 0x00c741 thru 0x01a082 (0xd942 bytes) 000878 1787191690.932952 read 0x014fd5 thru 0x01a5cb (0x55f7 bytes) 000879 1787191690.936490 mapread 0x017542 thru 0x019ec4 (0x2983 bytes) 000880 1787191690.953801 MIRROR_RESYNC 9 mirrors 000881 1787191693.173450 trunc from 0x01c834 to 0x003afc (0x18d37 bytes) 000882 1787191693.255692 read 0x003295 thru 0x003afc (0x868 bytes) 000883 1787191693.265083 mapwrite 0x02d386 thru 0x030093 (0x2d0e bytes) 000884 1787191693.448897 mapwrite 0x0369a6 thru 0x037272 (0x8cd bytes) 000885 1787191693.541559 write 0x0260d7 thru 0x03069c (0xa5c6 bytes) 000886 1787191693.547570 read 0x0366e3 thru 0x037272 (0xb90 bytes) 000887 1787191693.552485 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37273): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37273): Mirror 7: 0xde84537a (stale) Mirror 11: 0xde84537a (stale) Mirror 12: 0xde84537a (stale) Mirror 13: 0xde84537a (stale) Mirror 14: 0xde84537a (stale) Mirror 15: 0xde84537a (stale) Mirror 16: 0xde84537a (stale) Mirror 17: 0xde84537a (stale) CRC-32 checksum value for chunk [0, 0x37273): Mirror 1: 0xc44da610 Mirror 18: 0xc44da610 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37273: skipped 000888 1787191694.834785 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x37273): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37273): Mirror 7: 0xde84537a (stale) Mirror 11: 0xde84537a (stale) Mirror 12: 0xde84537a (stale) Mirror 13: 0xde84537a (stale) Mirror 14: 0xde84537a (stale) Mirror 15: 0xde84537a (stale) Mirror 16: 0xde84537a (stale) Mirror 17: 0xde84537a (stale) CRC-32 checksum value for chunk [0, 0x37273): Mirror 1: 0xc44da610 Mirror 18: 0xc44da610 Mirror 19: 0xc44da610 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37273: skipped 000889 1787191695.908286 write 0x03f44d thru 0x03ffff (0xbb3 bytes) 000890 1787191696.024056 mapwrite 0x0187ca thru 0x021767 (0x8f9e bytes) 000893 1787191696.104936 trunc from 0x040000 to 0x01dc4c (0x223b3 bytes) 000894 1787191696.132745 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1dc4d): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dc4d): Mirror 7: 0xeb773184 (stale) Mirror 11: 0xeb773184 (stale) Mirror 12: 0xeb773184 (stale) Mirror 13: 0xeb773184 (stale) Mirror 14: 0xeb773184 (stale) Mirror 15: 0xeb773184 (stale) Mirror 16: 0xeb773184 (stale) Mirror 17: 0xeb773184 (stale) Mirror 18: 0x98e3ae19 (stale) Mirror 19: 0x98e3ae19 (stale) CRC-32 checksum value for chunk [0, 0x1dc4d): Mirror 1: 0x5ea5a65b Mirror 20: 0x5ea5a65b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dc4d: skipped 000895 1787191697.141826 mapwrite 0x02ac68 thru 0x030411 (0x57aa bytes) 000896 1787191697.312774 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x30412): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30412): Mirror 7: 0x13f21a10 (stale) Mirror 11: 0x13f21a10 (stale) Mirror 12: 0x13f21a10 (stale) Mirror 13: 0x13f21a10 (stale) Mirror 14: 0x13f21a10 (stale) Mirror 15: 0x13f21a10 (stale) Mirror 16: 0x13f21a10 (stale) Mirror 17: 0x13f21a10 (stale) Mirror 18: 0x16df3c13 (stale) Mirror 19: 0x16df3c13 (stale) Mirror 20: 0xb58f50ab (stale) CRC-32 checksum value for chunk [0, 0x30412): Mirror 1: 0xe88c25a9 Mirror 21: 0xe88c25a9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30412: skipped 000899 1787191698.351802 read 0x01520c thru 0x017c31 (0x2a26 bytes) 000900 1787191698.364293 read 0x012632 thru 0x01d193 (0xab62 bytes) truncating to largest ever: 0x3fe18 000901 1787191698.380983 trunc from 0x030412 to 0x03fe17 (0xfa06 bytes) 000902 1787191698.551289 write 0x020245 thru 0x02148e (0x124a bytes) 000903 1787191698.575096 mapread 0x023b21 thru 0x02e50f (0xa9ef bytes) 000904 1787191698.682742 MIRROR_RESYNC 13 mirrors 000905 1787191700.690038 write 0x032b38 thru 0x033029 (0x4f2 bytes) 000907 1787191700.801441 write 0x010cc5 thru 0x014967 (0x3ca3 bytes) 000909 1787191700.826982 mapread 0x019773 thru 0x026c02 (0xd490 bytes) 000910 1787191700.863818 mapwrite 0x021750 thru 0x02e11e (0xc9cf bytes) 000911 1787191700.957345 write 0x01bf3c thru 0x01f3d9 (0x349e bytes) 000913 1787191700.975887 MIRROR_RESYNC 13 mirrors 000914 1787191703.065271 mapread 0x03d479 thru 0x03fe17 (0x299f bytes) 000916 1787191703.102451 trunc from 0x03fe18 to 0x037826 (0x85f1 bytes) 000917 1787191703.268249 read 0x00ce18 thru 0x0167e8 (0x99d1 bytes) 000919 1787191703.285157 read 0x0081e4 thru 0x00b399 (0x31b6 bytes) 000921 1787191703.304220 write 0x021bce thru 0x030713 (0xeb46 bytes) 000922 1787191703.306542 mapread 0x013559 thru 0x015f87 (0x2a2f bytes) 000923 1787191703.307877 write 0x029a64 thru 0x031d4b (0x82e8 bytes) 000924 1787191703.313394 write 0x03129a thru 0x0355ee (0x4355 bytes) 000925 1787191703.315320 read 0x0347f2 thru 0x037826 (0x3035 bytes) 000926 1787191703.315850 mapread 0x000962 thru 0x00b26f (0xa90e bytes) 000928 1787191703.319052 trunc from 0x037827 to 0x00f1ff (0x28627 bytes) 000929 1787191703.368603 trunc from 0x00f200 to 0x03bba6 (0x2c9a7 bytes) 000933 1787191703.395392 read 0x00ed89 thru 0x01db8d (0xee05 bytes) 000934 1787191703.405060 mapwrite 0x03c1c2 thru 0x03ffff (0x3e3e bytes) 000935 1787191703.517615 read 0x0178e9 thru 0x022b66 (0xb27e bytes) 000936 1787191703.525917 MIRROR_RESYNC 13 mirrors 000938 1787191707.310110 write 0x039a97 thru 0x03ffff (0x6569 bytes) 000939 1787191707.402300 MIRROR_RESYNC 13 mirrors 000940 1787191710.684736 write 0x011cd0 thru 0x01910e (0x743f bytes) 000941 1787191710.845611 mapread 0x00fb95 thru 0x012edd (0x3349 bytes) 000942 1787191710.858884 mapwrite 0x001440 thru 0x00c175 (0xad36 bytes) 000944 1787191710.935947 mapread 0x036ae8 thru 0x03dd6b (0x7284 bytes) 000945 1787191710.947788 write 0x00e36a thru 0x01a553 (0xc1ea bytes) 000946 1787191710.954757 mapread 0x00320f thru 0x011424 (0xe216 bytes) 000948 1787191710.957375 mapread 0x03df2a thru 0x03ffff (0x20d6 bytes) 000949 1787191710.962085 read 0x02bff6 thru 0x032e34 (0x6e3f bytes) 000950 1787191710.985527 mapwrite 0x0317af thru 0x03c6b6 (0xaf08 bytes) 000954 1787191711.074012 read 0x02bf3f thru 0x02d2ae (0x1370 bytes) 000955 1787191711.075363 read 0x029851 thru 0x029bce (0x37e bytes) 000956 1787191711.086424 mapwrite 0x01fd88 thru 0x02cc87 (0xcf00 bytes) 000958 1787191711.191761 write 0x03d957 thru 0x03d9f4 (0x9e bytes) 000959 1787191711.199698 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1b0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7d5da6fc (stale) Mirror 11: 0x7d5da6fc (stale) Mirror 12: 0x7d5da6fc (stale) Mirror 13: 0x7d5da6fc (stale) Mirror 14: 0x7d5da6fc (stale) Mirror 15: 0x7d5da6fc (stale) Mirror 16: 0x7d5da6fc (stale) Mirror 17: 0x7d5da6fc (stale) Mirror 18: 0x7d5da6fc (stale) Mirror 20: 0x7d5da6fc (stale) Mirror 21: 0x7d5da6fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7d5da6fc (stale) Mirror 11: 0x7d5da6fc (stale) Mirror 12: 0x7d5da6fc (stale) Mirror 13: 0x7d5da6fc (stale) Mirror 14: 0x7d5da6fc (stale) Mirror 15: 0x7d5da6fc (stale) Mirror 16: 0x7d5da6fc (stale) Mirror 17: 0x7d5da6fc (stale) Mirror 18: 0x7d5da6fc (stale) Mirror 20: 0x7d5da6fc (stale) Mirror 21: 0x7d5da6fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000961 1787191712.065683 mapread 0x010be2 thru 0x01ee67 (0xe286 bytes) 000964 1787191712.108459 write 0x012807 thru 0x01a37e (0x7b78 bytes) 000965 1787191712.109567 trunc from 0x040000 to 0x011f72 (0x2e08d bytes) 000968 1787191712.131800 write 0x03f195 thru 0x03ffff (0xe6b bytes) 000969 1787191712.132767 mapwrite 0x0287f8 thru 0x032050 (0x9859 bytes) 000970 1787191712.294635 mapread 0x006d6f thru 0x015b55 (0xede7 bytes) 000971 1787191712.358343 MIRROR_RESYNC 12 mirrors 000973 1787191714.202635 write 0x004b24 thru 0x00687e (0x1d5b bytes) 000976 1787191714.322283 read 0x000813 thru 0x003bfa (0x33e8 bytes) 000977 1787191714.331969 mapwrite 0x02235b thru 0x02ce25 (0xaacb bytes) 000978 1787191714.415915 mapwrite 0x03969f thru 0x03a93b (0x129d bytes) 000979 1787191714.479822 mapread 0x03ba2e thru 0x03ffff (0x45d2 bytes) 000980 1787191714.482987 read 0x03fff8 thru 0x03ffff (0x8 bytes) 000981 1787191714.484597 mapread 0x03d606 thru 0x03ffff (0x29fa bytes) 000982 1787191714.487094 mapread 0x033513 thru 0x03ffff (0xcaed bytes) 000983 1787191714.488785 mapwrite 0x03dd50 thru 0x03ffff (0x22b0 bytes) 000988 1787191714.548856 mapwrite 0x007196 thru 0x00e452 (0x72bd bytes) 000990 1787191714.607454 trunc from 0x040000 to 0x015c85 (0x2a37a bytes) 000992 1787191714.652129 mapwrite 0x01750c thru 0x01a662 (0x3157 bytes) 000993 1787191714.728916 mapwrite 0x03f5ba thru 0x03ffff (0xa46 bytes) 000994 1787191714.799231 write 0x020d87 thru 0x02e774 (0xd9ee bytes) 000997 1787191714.824344 mapwrite 0x011e7c thru 0x01c958 (0xaadd bytes) 000998 1787191714.925586 mapwrite 0x00da55 thru 0x01cfac (0xf558 bytes) 000999 1787191714.984342 read 0x0338cb thru 0x03cb83 (0x92b9 bytes) 001000 1787191714.995921 mapwrite 0x00fb9f thru 0x01c930 (0xcd92 bytes) All operations completed A-OK!