== sanity-flr test 70a: flr mode fsx test ================ 04:16:17 (1787386577) Seed set to 6579 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x291a6 000004 1787386580.201543 trunc from 00000000 to 0x0291a5 (0x291a6 bytes) 000005 1787386580.245214 mapread 0x00c007 thru 0x013e23 (0x7e1d bytes) 000008 1787386580.271507 read 0x00dae9 thru 0x015ac4 (0x7fdc bytes) 000009 1787386580.272426 mapread 0x01021b thru 0x010799 (0x57f bytes) 000012 1787386580.276009 trunc from 0x0291a6 to 0x004031 (0x25174 bytes) 000013 1787386580.299641 write 0x02977f thru 0x02cc81 (0x3503 bytes) 000015 1787386580.301942 mapwrite 0x00dd77 thru 0x01cee2 (0xf16c bytes) 000019 1787386580.486327 trunc from 0x02cc82 to 0x006d12 (0x25f6f bytes) 000020 1787386580.560332 mapread 0x001cff thru 0x003df9 (0x20fb bytes) 000022 1787386580.581251 trunc from 0x006d13 to 0x005120 (0x1bf2 bytes) 000025 1787386580.608044 MIRROR_EXTEND to 2 mirrors 000027 1787386581.269560 trunc from 0x005121 to 0x014d13 (0xfbf3 bytes) 000028 1787386581.365730 trunc from 0x014d14 to 0x000244 (0x14acf bytes) 000029 1787386581.394727 mapwrite 0x01c2e8 thru 0x021c08 (0x5921 bytes) 000030 1787386581.536999 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) 000032 1787386581.860633 mapread 0x0186f7 thru 0x021c08 (0x9512 bytes) 000033 1787386581.880248 read 0x00a0c7 thru 0x016065 (0xbf9f bytes) 000034 1787386581.892831 write 0x001e7f thru 0x005054 (0x31d6 bytes) 000036 1787386581.910398 read 0x00367e thru 0x009141 (0x5ac4 bytes) 000037 1787386581.928581 mapread 0x005c75 thru 0x00f630 (0x99bc bytes) 000038 1787386581.930447 mapread 0x0041d1 thru 0x00d7ad (0x95dd bytes) 000039 1787386581.936166 mapwrite 0x014a8b thru 0x01c203 (0x7779 bytes) truncating to largest ever: 0x39491 000040 1787386582.012850 trunc from 0x021c09 to 0x039490 (0x17888 bytes) 000041 1787386582.043885 mapwrite 0x016a09 thru 0x01c9a5 (0x5f9d bytes) truncating to largest ever: 0x3ab0f 000042 1787386582.120250 trunc from 0x039491 to 0x03ab0e (0x167e bytes) 000043 1787386582.146142 mapwrite 0x01be36 thru 0x025815 (0x99e0 bytes) 000045 1787386582.206828 write 0x03babf thru 0x03ffff (0x4541 bytes) 000046 1787386582.211648 mapread 0x03a289 thru 0x03ffff (0x5d77 bytes) 000048 1787386582.214686 mapread 0x00ca5f thru 0x00e7ab (0x1d4d bytes) 000050 1787386582.217039 mapread 0x004b1f thru 0x014afb (0xffdd bytes) 000051 1787386582.222777 read 0x0194fc thru 0x01ed3c (0x5841 bytes) 000052 1787386582.223899 trunc from 0x040000 to 0x034997 (0xb668 bytes) 000055 1787386582.242764 read 0x02ddba thru 0x034997 (0x6bde bytes) 000057 1787386582.245338 read 0x032867 thru 0x034997 (0x2131 bytes) 000059 1787386582.246825 read 0x00a1c9 thru 0x019622 (0xf45a bytes) 000060 1787386582.247883 read 0x021506 thru 0x028ba1 (0x769c bytes) 000061 1787386582.248884 write 0x0193d6 thru 0x02666b (0xd296 bytes) 000064 1787386582.253138 mapwrite 0x00c404 thru 0x01362f (0x722c bytes) 000066 1787386582.344852 trunc from 0x034998 to 0x01866a (0x1c32d bytes) 000067 1787386582.400859 mapread 0x00c41f thru 0x01866a (0xc24c bytes) 000070 1787386582.405933 read 0x011e8a thru 0x01866a (0x67e1 bytes) 000072 1787386582.410095 trunc from 0x01866b to 0x02cab5 (0x1444b bytes) 000075 1787386582.447619 mapwrite 0x03e3c9 thru 0x03ffff (0x1c37 bytes) 000077 1787386582.589703 trunc from 0x040000 to 0x0355f5 (0xaa0a bytes) 000078 1787386582.615700 trunc from 0x0355f6 to 0x011dff (0x237f6 bytes) 000080 1787386582.635931 read 0x007b01 thru 0x011dff (0xa2ff bytes) 000083 1787386582.644534 mapwrite 0x0012ef thru 0x00feb1 (0xebc3 bytes) 000084 1787386582.690025 mapread 0x003fda thru 0x008cad (0x4cd4 bytes) 000085 1787386582.691105 trunc from 0x011e00 to 0x0174bd (0x56be bytes) 000086 1787386582.707561 mapwrite 0x029efd thru 0x03629d (0xc3a1 bytes) 000088 1787386582.781579 trunc from 0x03629e to 0x01c8d1 (0x199cc bytes) 000089 1787386582.798712 trunc from 0x01c8d2 to 0x0150c9 (0x7808 bytes) 000094 1787386582.817911 read 0x008099 thru 0x00ff9b (0x7f03 bytes) 000095 1787386582.818802 mapwrite 0x01ca8e thru 0x01ee35 (0x23a8 bytes) 000100 1787386582.890104 MIRROR_EXTEND to 2 mirrors 000101 1787386583.417685 read 0x00bbc5 thru 0x0146fd (0x8b39 bytes) 000103 1787386583.424754 mapwrite 0x019dc6 thru 0x0233ae (0x95e9 bytes) 000104 1787386583.569832 mapread 0x0100a3 thru 0x018ad1 (0x8a2f bytes) 000105 1787386583.580145 mapwrite 0x02d788 thru 0x03be53 (0xe6cc bytes) 000106 1787386583.635407 read 0x013b9a thru 0x01ccd6 (0x913d bytes) truncating to largest ever: 0x3da06 000108 1787386583.636422 trunc from 0x03be54 to 0x03da05 (0x1bb2 bytes) 000110 1787386583.645062 write 0x031d13 thru 0x031e24 (0x112 bytes) 000111 1787386583.645947 mapwrite 0x011507 thru 0x017270 (0x5d6a bytes) 000112 1787386583.671457 mapread 0x00e7f4 thru 0x01aa57 (0xc264 bytes) 000113 1787386583.672748 mapread 0x0038b5 thru 0x005abc (0x2208 bytes) 000116 1787386583.679635 trunc from 0x03da06 to 0x01007f (0x2d986 bytes) 000117 1787386583.688726 mapwrite 0x0038f5 thru 0x011f3f (0xe64b bytes) 000119 1787386583.732940 mapwrite 0x03ab81 thru 0x03ffff (0x547f bytes) 000120 1787386583.808276 trunc from 0x040000 to 0x01813f (0x27ec0 bytes) 000121 1787386583.825816 read 0x0107d2 thru 0x014dc3 (0x45f2 bytes) 000124 1787386583.843771 trunc from 0x018140 to 0x03b97e (0x2383f bytes) 000127 1787386583.860659 mapwrite 0x00f74c thru 0x013ae0 (0x4395 bytes) 000129 1787386583.910298 mapread 0x027c27 thru 0x02b3b1 (0x378b bytes) 000130 1787386583.935093 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) 000131 1787386584.144523 write 0x013b21 thru 0x01e0c3 (0xa5a3 bytes) 000132 1787386584.160380 mapread 0x019183 thru 0x01a895 (0x1713 bytes) 000133 1787386584.161546 read 0x02bf43 thru 0x02d4bb (0x1579 bytes) 000135 1787386584.181045 write 0x0031ac thru 0x0065ac (0x3401 bytes) 000136 1787386584.224616 MIRROR_EXTEND to 2 mirrors 000139 1787386585.031539 trunc from 0x03b97f to 0x00328e (0x386f0 bytes) 000141 1787386585.147521 trunc from 0x00328f to 0x031152 (0x2dec4 bytes) 000145 1787386585.165883 write 0x01789f thru 0x024fe3 (0xd745 bytes) 000146 1787386585.189120 mapwrite 0x02fcc2 thru 0x03a65c (0xa99b bytes) 000147 1787386585.323112 mapwrite 0x01d4f3 thru 0x02c11d (0xec2b bytes) 000148 1787386585.407503 mapwrite 0x017cef thru 0x01e19f (0x64b1 bytes) 000149 1787386585.431959 trunc from 0x03a65d to 0x002f8d (0x376cf bytes) 000150 1787386585.447110 mapwrite 0x01468c thru 0x01724f (0x2bc4 bytes) 000151 1787386585.503250 mapwrite 0x022019 thru 0x02ce69 (0xae51 bytes) 000155 1787386585.594918 write 0x01c82d thru 0x02b4cd (0xeca1 bytes) 000156 1787386585.600411 read 0x0007e7 thru 0x00da01 (0xd21b bytes) 000157 1787386585.611079 mapread 0x0267e4 thru 0x028e68 (0x2685 bytes) 000158 1787386585.614923 mapread 0x025b70 thru 0x02760a (0x1a9b bytes) 000160 1787386585.618518 mapwrite 0x01ebbb thru 0x02a9c1 (0xbe07 bytes) 000163 1787386585.663437 mapread 0x0175c3 thru 0x01d273 (0x5cb1 bytes) 000164 1787386585.670886 read 0x02312d thru 0x02ce69 (0x9d3d bytes) 000166 1787386585.674432 read 0x00662d thru 0x00ed96 (0x876a bytes) 000170 1787386585.676968 trunc from 0x02ce6a to 0x00ba9f (0x213ca bytes) 000171 1787386585.698468 trunc from 0x00baa0 to 0x03b525 (0x2fa86 bytes) 000172 1787386585.719587 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b526): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b526): Mirror 2: 0x260da891 (stale) CRC-32 checksum value for chunk [0, 0x3b526): Mirror 1: 0xfa780a2 Mirror 3: 0xfa780a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b526: skipped 000174 1787386586.281039 write 0x02fff3 thru 0x03216d (0x217b bytes) 000175 1787386586.383961 trunc from 0x03b526 to 0x02e6ba (0xce6b bytes) 000178 1787386586.428381 read 0x0202f3 thru 0x02e6ba (0xe3c8 bytes) 000179 1787386586.437400 trunc from 0x02e6bb to 0x0238ea (0xadd0 bytes) 000180 1787386586.458003 write 0x0091c8 thru 0x015177 (0xbfb0 bytes) 000183 1787386586.488034 mapread 0x01efe7 thru 0x0231ec (0x4206 bytes) 000184 1787386586.506826 read 0x00a4e6 thru 0x01a1c5 (0xfce0 bytes) 000185 1787386586.520793 trunc from 0x0238eb to 0x01ea8e (0x4e5c bytes) 000192 1787386586.551846 mapread 0x00a06f thru 0x00b449 (0x13db bytes) 000193 1787386586.553822 trunc from 0x01ea8f to 0x03249d (0x13a0f bytes) 000194 1787386586.574819 write 0x017287 thru 0x019582 (0x22fc bytes) 000195 1787386586.594040 mapwrite 0x03c95b thru 0x03ffff (0x36a5 bytes) 000197 1787386586.717388 mapwrite 0x02e121 thru 0x030514 (0x23f4 bytes) 000198 1787386586.768285 read 0x023647 thru 0x02a991 (0x734b bytes) 000200 1787386586.787330 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9fac00bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9fac00bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000202 1787386587.087089 trunc from 0x040000 to 0x01b402 (0x24bfd bytes) 000203 1787386587.111452 mapwrite 0x0221fd thru 0x022b8e (0x992 bytes) 000206 1787386587.242757 read 0x00a9a4 thru 0x012183 (0x77e0 bytes) 000208 1787386587.264985 mapread 0x0040da thru 0x00b495 (0x73bc bytes) 000210 1787386587.330107 read 0x01109b thru 0x01f2fc (0xe262 bytes) 000211 1787386587.356080 read 0x01de94 thru 0x022b8e (0x4cfb bytes) 000213 1787386587.385802 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) 000216 1787386587.680163 mapread 0x01dc0f thru 0x021206 (0x35f8 bytes) 000217 1787386587.704391 read 0x0226df thru 0x022b8e (0x4b0 bytes) 000219 1787386587.706019 write 0x007e16 thru 0x014724 (0xc90f bytes) 000223 1787386587.724676 mapwrite 0x0342e9 thru 0x03b850 (0x7568 bytes) 000224 1787386587.803351 write 0x0157f5 thru 0x023955 (0xe161 bytes) 000225 1787386587.813723 read 0x03b2e6 thru 0x03b850 (0x56b bytes) 000227 1787386587.816093 write 0x03fee3 thru 0x03ffff (0x11d bytes) 000228 1787386587.817952 mapwrite 0x0265f9 thru 0x028c4a (0x2652 bytes) 000232 1787386587.856105 mapread 0x02c125 thru 0x030615 (0x44f1 bytes) 000235 1787386587.859809 write 0x02460b thru 0x02c257 (0x7c4d bytes) 000236 1787386587.861167 write 0x03094b thru 0x0325e5 (0x1c9b bytes) 000238 1787386587.863904 trunc from 0x040000 to 0x03261f (0xd9e0 bytes) 000239 1787386587.884086 mapread 0x0065c7 thru 0x0165a6 (0xffe0 bytes) 000241 1787386587.885923 read 0x00e379 thru 0x00ea1d (0x6a5 bytes) 000242 1787386587.887573 read 0x029a2e thru 0x02aa1a (0xfed bytes) 000244 1787386587.889825 mapread 0x017841 thru 0x0271f0 (0xf9b0 bytes) 000246 1787386587.892823 trunc from 0x032620 to 0x02d07f (0x55a0 bytes) 000247 1787386587.919457 MIRROR_EXTEND to 2 mirrors 000248 1787386588.691077 mapwrite 0x009e0b thru 0x011ac0 (0x7cb6 bytes) 000250 1787386588.851485 write 0x036859 thru 0x03ffff (0x97a7 bytes) 000252 1787386588.855726 write 0x00440a thru 0x00cdc2 (0x89b9 bytes) 000255 1787386588.859473 write 0x0341a9 thru 0x037801 (0x3659 bytes) 000256 1787386588.865236 write 0x00ec48 thru 0x0172f2 (0x86ab bytes) 000257 1787386588.871508 mapwrite 0x01d79d thru 0x02b7c9 (0xe02d bytes) 000261 1787386588.964722 read 0x014ecc thru 0x01c239 (0x736e bytes) 000262 1787386588.965780 mapwrite 0x005599 thru 0x0060d9 (0xb41 bytes) 000264 1787386589.010674 mapread 0x01347e thru 0x016fb0 (0x3b33 bytes) 000265 1787386589.013669 mapread 0x001fa4 thru 0x00c1ac (0xa209 bytes) 000266 1787386589.027747 MIRROR_RESYNC 2 mirrors 000269 1787386589.753740 MIRROR_EXTEND to 3 mirrors 000272 1787386590.747372 MIRROR_EXTEND to 4 mirrors 000273 1787386591.384439 mapwrite 0x013902 thru 0x01ed99 (0xb498 bytes) 000274 1787386591.581921 mapread 0x00e2c3 thru 0x0188f9 (0xa637 bytes) 000277 1787386591.592291 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbdfa6a4 (stale) Mirror 3: 0xbdfa6a4 (stale) Mirror 4: 0xbdfa6a4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x304bd0df Mirror 5: 0x304bd0df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000278 1787386592.595281 mapwrite 0x0319d6 thru 0x038ec3 (0x74ee bytes) 000281 1787386592.786254 mapwrite 0x001ed1 thru 0x00fb04 (0xdc34 bytes) 000283 1787386592.838354 mapread 0x02b2fc thru 0x035cb8 (0xa9bd bytes) 000284 1787386592.839863 mapread 0x01595e thru 0x0251d0 (0xf873 bytes) 000286 1787386592.857391 mapread 0x02eb04 thru 0x03a421 (0xb91e bytes) 000288 1787386592.858731 mapread 0x029aff thru 0x02a944 (0xe46 bytes) 000289 1787386592.863693 read 0x0249e6 thru 0x030e35 (0xc450 bytes) 000294 1787386592.870917 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbdfa6a4 (stale) Mirror 3: 0xbdfa6a4 (stale) Mirror 4: 0xbdfa6a4 (stale) Mirror 5: 0x304bd0df (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xae114ce3 Mirror 6: 0xae114ce3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000295 1787386593.947627 write 0x032d7c thru 0x03b886 (0x8b0b bytes) 000297 1787386594.088338 read 0x021d2f thru 0x023c61 (0x1f33 bytes) 000299 1787386594.117665 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xbdfa6a4 (stale) Mirror 3: 0xbdfa6a4 (stale) Mirror 4: 0xbdfa6a4 (stale) Mirror 5: 0x304bd0df (stale) Mirror 6: 0xae114ce3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa25e24bd Mirror 7: 0xa25e24bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000300 1787386595.093699 mapread 0x01ab5f thru 0x0235af (0x8a51 bytes) 000301 1787386595.126912 write 0x01805f thru 0x0215c5 (0x9567 bytes) 000302 1787386595.275731 mapwrite 0x03c253 thru 0x03ffff (0x3dad bytes) 000303 1787386595.399489 mapread 0x03e54d thru 0x03ffff (0x1ab3 bytes) 000304 1787386595.400996 mapread 0x0371c8 thru 0x03ffff (0x8e38 bytes) 000306 1787386595.404597 read 0x009d93 thru 0x00eace (0x4d3c bytes) 000308 1787386595.417729 mapwrite 0x033343 thru 0x03efa4 (0xbc62 bytes) 000316 1787386595.524765 MIRROR_RESYNC 7 mirrors 000319 1787386597.419365 trunc from 0x040000 to 0x024378 (0x1bc87 bytes) 000321 1787386597.524608 mapwrite 0x00428c thru 0x00aba1 (0x6916 bytes) 000322 1787386597.601462 trunc from 0x024379 to 0x02265c (0x1d1c bytes) 000323 1787386597.637759 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2265d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2265d): Mirror 2: 0x1879d34a (stale) Mirror 3: 0x1879d34a (stale) Mirror 4: 0x1879d34a (stale) Mirror 5: 0x1879d34a (stale) Mirror 6: 0x1879d34a (stale) Mirror 7: 0x1879d34a (stale) CRC-32 checksum value for chunk [0, 0x2265d): Mirror 1: 0x2ace9380 Mirror 8: 0x2ace9380 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2265d: skipped 000325 1787386598.559172 trunc from 0x02265d to 0x008e08 (0x19854 bytes) 000326 1787386598.707541 mapread 0x006348 thru 0x008e08 (0x2ac1 bytes) 000328 1787386598.727452 trunc from 0x008e09 to 0x013abd (0xacb5 bytes) 000329 1787386598.754921 MIRROR_RESYNC 8 mirrors 000330 1787386599.882373 MIRROR_RESYNC 8 mirrors 000332 1787386600.405621 write 0x011bc3 thru 0x01bbad (0x9feb bytes) 000334 1787386600.499513 read 0x00a60d thru 0x01a43f (0xfe33 bytes) 000335 1787386600.515421 MIRROR_RESYNC 8 mirrors 000339 1787386601.772761 write 0x00dea3 thru 0x00e793 (0x8f1 bytes) 000341 1787386601.861780 mapwrite 0x003d45 thru 0x005ec0 (0x217c bytes) 000342 1787386601.939317 read 0x01158c thru 0x01b137 (0x9bac bytes) 000343 1787386601.955951 read 0x00ef0f thru 0x01bbad (0xcc9f bytes) 000344 1787386601.956874 read 0x00be7c thru 0x0143c2 (0x8547 bytes) 000346 1787386601.959154 mapread 0x009901 thru 0x018e72 (0xf572 bytes) 000347 1787386601.967946 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1bbae): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bbae): Mirror 2: 0x257016a9 (stale) Mirror 3: 0x257016a9 (stale) Mirror 4: 0x257016a9 (stale) Mirror 5: 0x257016a9 (stale) Mirror 6: 0x257016a9 (stale) Mirror 7: 0x257016a9 (stale) Mirror 8: 0x257016a9 (stale) CRC-32 checksum value for chunk [0, 0x1bbae): Mirror 1: 0x3be51a0a Mirror 9: 0x3be51a0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bbae: skipped 000348 1787386602.760844 read 0x00454e thru 0x01450b (0xffbe bytes) 000351 1787386602.798535 write 0x015f3a thru 0x01a873 (0x493a bytes) 000354 1787386602.895850 write 0x034b64 thru 0x037155 (0x25f2 bytes) 000362 1787386602.905987 trunc from 0x037156 to 0x0164ec (0x20c69 bytes) 000363 1787386602.926107 trunc from 0x0164ed to 0x009f9a (0xc552 bytes) 000364 1787386602.944545 write 0x020147 thru 0x027f3b (0x7df5 bytes) 000365 1787386602.948542 mapread 0x0001ef thru 0x00d6da (0xd4ec bytes) 000366 1787386602.978628 read 0x00d7d1 thru 0x01c6e3 (0xef13 bytes) 000368 1787386602.988926 mapread 0x00b7b8 thru 0x00eb30 (0x3379 bytes) 000370 1787386602.992296 mapwrite 0x031f64 thru 0x03ffff (0xe09c bytes) 000372 1787386603.085378 trunc from 0x040000 to 0x037e7d (0x8182 bytes) 000373 1787386603.112110 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37e7e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e7e): Mirror 2: 0xef43f925 (stale) Mirror 3: 0xef43f925 (stale) Mirror 4: 0xef43f925 (stale) Mirror 5: 0xef43f925 (stale) Mirror 6: 0xef43f925 (stale) Mirror 7: 0xef43f925 (stale) Mirror 8: 0xef43f925 (stale) Mirror 9: 0xfad7a624 (stale) CRC-32 checksum value for chunk [0, 0x37e7e): Mirror 1: 0xfcbb5408 Mirror 10: 0xfcbb5408 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e7e: skipped 000374 1787386603.953633 mapread 0x022c64 thru 0x02fde6 (0xd183 bytes) 000375 1787386603.997668 trunc from 0x037e7e to 0x002f65 (0x34f18 bytes) 000377 1787386604.106348 read 0x0006d1 thru 0x002f65 (0x2895 bytes) 000378 1787386604.117320 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2f66): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f66): Mirror 2: 0x1f26100d (stale) Mirror 3: 0x1f26100d (stale) Mirror 4: 0x1f26100d (stale) Mirror 5: 0x1f26100d (stale) Mirror 6: 0x1f26100d (stale) Mirror 7: 0x1f26100d (stale) Mirror 8: 0x1f26100d (stale) Mirror 9: 0x1f26100d (stale) Mirror 10: 0x1f26100d (stale) CRC-32 checksum value for chunk [0, 0x2f66): Mirror 1: 0x1f26100d Mirror 11: 0x1f26100d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f66: skipped 000380 1787386605.000119 read 0x0001ed thru 0x002f65 (0x2d79 bytes) 000381 1787386605.021807 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2f66): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f66): Mirror 2: 0x1f26100d (stale) Mirror 3: 0x1f26100d (stale) Mirror 4: 0x1f26100d (stale) Mirror 5: 0x1f26100d (stale) Mirror 6: 0x1f26100d (stale) Mirror 7: 0x1f26100d (stale) Mirror 8: 0x1f26100d (stale) Mirror 9: 0x1f26100d (stale) Mirror 10: 0x1f26100d (stale) CRC-32 checksum value for chunk [0, 0x2f66): Mirror 1: 0x1f26100d Mirror 11: 0x1f26100d Mirror 12: 0x1f26100d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f66: skipped 000382 1787386605.781988 mapread 0x002367 thru 0x002f65 (0xbff bytes) 000385 1787386605.793517 MIRROR_RESYNC 12 mirrors 000387 1787386607.050844 mapwrite 0x03489b thru 0x03ffff (0xb765 bytes) 000388 1787386607.201164 mapread 0x021c3f thru 0x031227 (0xf5e9 bytes) 000389 1787386607.227326 write 0x03e1ed thru 0x03ffff (0x1e13 bytes) 000390 1787386607.229360 mapwrite 0x01a19c thru 0x024dd4 (0xac39 bytes) 000392 1787386607.274994 trunc from 0x040000 to 0x0014fe (0x3eb01 bytes) 000393 1787386607.296388 mapread 0x000905 thru 0x0014fe (0xbfa bytes) 000394 1787386607.309484 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14ff): Mirror 2: 0x407d28c7 (stale) Mirror 3: 0x407d28c7 (stale) Mirror 4: 0x407d28c7 (stale) Mirror 5: 0x407d28c7 (stale) Mirror 6: 0x407d28c7 (stale) Mirror 7: 0x407d28c7 (stale) Mirror 8: 0x407d28c7 (stale) Mirror 9: 0x407d28c7 (stale) Mirror 10: 0x407d28c7 (stale) Mirror 12: 0x407d28c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14ff): Mirror 2: 0x407d28c7 (stale) Mirror 3: 0x407d28c7 (stale) Mirror 4: 0x407d28c7 (stale) Mirror 5: 0x407d28c7 (stale) Mirror 6: 0x407d28c7 (stale) Mirror 7: 0x407d28c7 (stale) Mirror 8: 0x407d28c7 (stale) Mirror 9: 0x407d28c7 (stale) Mirror 10: 0x407d28c7 (stale) Mirror 12: 0x407d28c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14ff: skipped 000395 1787386607.651743 mapwrite 0x005770 thru 0x0135ad (0xde3e bytes) 000396 1787386607.762914 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x135ae): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x135ae): Mirror 2: 0xf1e6fc4c (stale) Mirror 3: 0xf1e6fc4c (stale) Mirror 4: 0xf1e6fc4c (stale) Mirror 5: 0xf1e6fc4c (stale) Mirror 6: 0xf1e6fc4c (stale) Mirror 7: 0xf1e6fc4c (stale) Mirror 8: 0xf1e6fc4c (stale) Mirror 9: 0xf1e6fc4c (stale) Mirror 10: 0xf1e6fc4c (stale) Mirror 12: 0xf1e6fc4c (stale) CRC-32 checksum value for chunk [0, 0x135ae): Mirror 1: 0x832f6709 Mirror 13: 0x832f6709 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x135ae: skipped 000398 1787386608.869269 mapread 0x001766 thru 0x002608 (0xea3 bytes) 000399 1787386608.928501 write 0x00700d thru 0x00ad50 (0x3d44 bytes) 000402 1787386609.164238 read 0x005be2 thru 0x011122 (0xb541 bytes) 000403 1787386609.185046 read 0x0029d6 thru 0x00f7fb (0xce26 bytes) 000404 1787386609.197243 read 0x0014dd thru 0x008b83 (0x76a7 bytes) 000405 1787386609.199623 mapread 0x00e879 thru 0x0135ad (0x4d35 bytes) 000407 1787386609.207230 write 0x011a6d thru 0x01601b (0x45af bytes) 000409 1787386609.210368 mapread 0x00ec48 thru 0x01601b (0x73d4 bytes) 000410 1787386609.212428 trunc from 0x01601c to 0x032cb2 (0x1cc97 bytes) 000412 1787386609.274433 trunc from 0x032cb3 to 0x01fe11 (0x12ea1 bytes) 000413 1787386609.323345 read 0x004995 thru 0x005b95 (0x1201 bytes) 000415 1787386609.335338 mapwrite 0x03c577 thru 0x03ffff (0x3a89 bytes) 000416 1787386609.457478 mapwrite 0x03a839 thru 0x03ffff (0x57c7 bytes) 000418 1787386609.521731 MIRROR_RESYNC 12 mirrors 000420 1787386611.466549 mapread 0x01d05e thru 0x02c11c (0xf0bf bytes) 000421 1787386611.500295 mapread 0x014968 thru 0x024061 (0xf6fa bytes) 000427 1787386611.512432 mapread 0x03ed71 thru 0x03ffff (0x128f bytes) 000429 1787386611.522592 mapread 0x014ff6 thru 0x02046e (0xb479 bytes) 000430 1787386611.523543 read 0x02eb2e thru 0x031114 (0x25e7 bytes) 000432 1787386611.532402 write 0x0189e9 thru 0x02319a (0xa7b2 bytes) 000435 1787386611.657499 mapread 0x00c0de thru 0x0187e7 (0xc70a bytes) 000438 1787386611.685065 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8c40e44e (stale) Mirror 3: 0x8c40e44e (stale) Mirror 4: 0x8c40e44e (stale) Mirror 5: 0x8c40e44e (stale) Mirror 7: 0x8c40e44e (stale) Mirror 8: 0x8c40e44e (stale) Mirror 9: 0x8c40e44e (stale) Mirror 10: 0x8c40e44e (stale) Mirror 12: 0x8c40e44e (stale) Mirror 13: 0x8c40e44e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8c40e44e (stale) Mirror 3: 0x8c40e44e (stale) Mirror 4: 0x8c40e44e (stale) Mirror 5: 0x8c40e44e (stale) Mirror 7: 0x8c40e44e (stale) Mirror 8: 0x8c40e44e (stale) Mirror 9: 0x8c40e44e (stale) Mirror 10: 0x8c40e44e (stale) Mirror 12: 0x8c40e44e (stale) Mirror 13: 0x8c40e44e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000439 1787386612.529159 mapread 0x025d87 thru 0x03548e (0xf708 bytes) 000444 1787386612.586694 write 0x0139f5 thru 0x0204aa (0xcab6 bytes) 000446 1787386612.598141 write 0x001874 thru 0x0092db (0x7a68 bytes) 000449 1787386612.612391 read 0x0317ee thru 0x036fe2 (0x57f5 bytes) 000450 1787386612.613363 mapwrite 0x034961 thru 0x035e69 (0x1509 bytes) 000452 1787386612.672017 trunc from 0x040000 to 0x03c061 (0x3f9e bytes) 000453 1787386612.685159 mapread 0x02656f thru 0x02724c (0xcde bytes) 000454 1787386612.686544 read 0x02d0cb thru 0x0355b4 (0x84ea bytes) 000456 1787386612.695422 read 0x034192 thru 0x03aa42 (0x68b1 bytes) 000458 1787386612.703943 read 0x012ecc thru 0x01e7cb (0xb900 bytes) 000459 1787386612.704658 mapread 0x032655 thru 0x03c061 (0x9a0d bytes) 000461 1787386612.707799 write 0x012bb6 thru 0x01e0c1 (0xb50c bytes) 000464 1787386612.711422 mapread 0x002cd8 thru 0x0055b1 (0x28da bytes) 000467 1787386612.714306 mapread 0x034247 thru 0x03849b (0x4255 bytes) 000468 1787386612.715988 mapwrite 0x0132a1 thru 0x0204fe (0xd25e bytes) 000469 1787386612.762544 write 0x01da52 thru 0x0230ac (0x565b bytes) 000470 1787386612.768487 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c062): Mirror 2: 0x5e4e8314 (stale) Mirror 3: 0x5e4e8314 (stale) Mirror 4: 0x5e4e8314 (stale) Mirror 5: 0x5e4e8314 (stale) Mirror 7: 0x5e4e8314 (stale) Mirror 8: 0x5e4e8314 (stale) Mirror 9: 0x5e4e8314 (stale) Mirror 12: 0x5e4e8314 (stale) Mirror 13: 0x5e4e8314 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c062): Mirror 2: 0x5e4e8314 (stale) Mirror 3: 0x5e4e8314 (stale) Mirror 4: 0x5e4e8314 (stale) Mirror 5: 0x5e4e8314 (stale) Mirror 7: 0x5e4e8314 (stale) Mirror 8: 0x5e4e8314 (stale) Mirror 9: 0x5e4e8314 (stale) Mirror 12: 0x5e4e8314 (stale) Mirror 13: 0x5e4e8314 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c062: skipped 000472 1787386613.347837 mapwrite 0x003edf thru 0x012c9f (0xedc1 bytes) 000474 1787386613.423429 mapwrite 0x00912e thru 0x00e307 (0x51da bytes) 000476 1787386613.459833 mapread 0x001b7e thru 0x00ad78 (0x91fb bytes) 000480 1787386613.464224 write 0x037960 thru 0x03ffff (0x86a0 bytes) 000481 1787386613.475172 write 0x01527a thru 0x0199a0 (0x4727 bytes) 000482 1787386613.476496 mapwrite 0x02470e thru 0x02b7a3 (0x7096 bytes) 000484 1787386613.529247 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8c40e44e (stale) Mirror 3: 0x8c40e44e (stale) Mirror 4: 0x8c40e44e (stale) Mirror 5: 0x8c40e44e (stale) Mirror 7: 0x8c40e44e (stale) Mirror 8: 0x8c40e44e (stale) Mirror 9: 0x8c40e44e (stale) Mirror 12: 0x8c40e44e (stale) Mirror 13: 0x8c40e44e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x73afb844 Mirror 14: 0x73afb844 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000485 1787386614.378430 trunc from 0x040000 to 0x024b58 (0x1b4a7 bytes) 000486 1787386614.499603 mapwrite 0x01ee38 thru 0x028516 (0x96df bytes) 000487 1787386614.611478 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28517): Mirror 2: 0xc8f4a3ec (stale) Mirror 4: 0xc8f4a3ec (stale) Mirror 5: 0xc8f4a3ec (stale) Mirror 7: 0xc8f4a3ec (stale) Mirror 8: 0xc8f4a3ec (stale) Mirror 9: 0xc8f4a3ec (stale) Mirror 12: 0xc8f4a3ec (stale) Mirror 13: 0xc8f4a3ec (stale) Mirror 14: 0x6e2edf70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28517): Mirror 2: 0xc8f4a3ec (stale) Mirror 4: 0xc8f4a3ec (stale) Mirror 5: 0xc8f4a3ec (stale) Mirror 7: 0xc8f4a3ec (stale) Mirror 8: 0xc8f4a3ec (stale) Mirror 9: 0xc8f4a3ec (stale) Mirror 12: 0xc8f4a3ec (stale) Mirror 13: 0xc8f4a3ec (stale) Mirror 14: 0x6e2edf70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28517: skipped 000488 1787386615.113432 write 0x0141f1 thru 0x01f02f (0xae3f bytes) 000489 1787386615.126932 read 0x013abb thru 0x0211e2 (0xd728 bytes) 000490 1787386615.134451 write 0x00773b thru 0x00833b (0xc01 bytes) 000493 1787386615.149431 mapread 0x01cced thru 0x027652 (0xa966 bytes) 000495 1787386615.174432 write 0x03287d thru 0x03ffff (0xd783 bytes) 000496 1787386615.177788 write 0x0095d7 thru 0x00f8b7 (0x62e1 bytes) 000500 1787386615.194780 mapwrite 0x039c8f thru 0x03a639 (0x9ab bytes) 000501 1787386615.254665 mapwrite 0x032916 thru 0x0361de (0x38c9 bytes) 000503 1787386615.375686 mapread 0x02ba28 thru 0x02e651 (0x2c2a bytes) 000504 1787386615.391476 trunc from 0x040000 to 0x00090c (0x3f6f3 bytes) 000505 1787386615.411319 write 0x0059bd thru 0x00cbc8 (0x720c bytes) 000506 1787386615.414608 write 0x008962 thru 0x00a3b9 (0x1a58 bytes) 000507 1787386615.416535 trunc from 0x00cbc9 to 0x00d5f7 (0xa2f bytes) 000509 1787386615.446387 MIRROR_RESYNC 10 mirrors 000510 1787386616.624510 write 0x014f50 thru 0x0159ab (0xa5c bytes) 000511 1787386616.681226 write 0x030b40 thru 0x03722b (0x66ec bytes) 000513 1787386616.686587 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3722c): Mirror 2: 0xe5113f36 (stale) Mirror 4: 0xe5113f36 (stale) Mirror 5: 0xe5113f36 (stale) Mirror 7: 0xe5113f36 (stale) Mirror 8: 0xe5113f36 (stale) Mirror 9: 0xe5113f36 (stale) Mirror 13: 0xe5113f36 (stale) Mirror 14: 0xe5113f36 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3722c): Mirror 2: 0xe5113f36 (stale) Mirror 4: 0xe5113f36 (stale) Mirror 5: 0xe5113f36 (stale) Mirror 7: 0xe5113f36 (stale) Mirror 8: 0xe5113f36 (stale) Mirror 9: 0xe5113f36 (stale) Mirror 13: 0xe5113f36 (stale) Mirror 14: 0xe5113f36 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3722c: skipped 000515 1787386617.143743 mapread 0x0047b2 thru 0x00525d (0xaac bytes) 000516 1787386617.154288 trunc from 0x03722c to 0x008cb9 (0x2e572 bytes) 000517 1787386617.174112 mapwrite 0x004a24 thru 0x00f3a9 (0xa986 bytes) 000518 1787386617.244362 mapread 0x0046a4 thru 0x00f3a9 (0xad06 bytes) 000522 1787386617.250888 read 0x008adf thru 0x00f3a9 (0x68cb bytes) 000523 1787386617.251667 write 0x01b7d9 thru 0x02af0b (0xf733 bytes) 000527 1787386617.257448 trunc from 0x02af0c to 0x007e7f (0x2308c bytes) 000528 1787386617.305321 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x7e80): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7e80): Mirror 2: 0x76657ea8 (stale) Mirror 4: 0x76657ea8 (stale) Mirror 5: 0x76657ea8 (stale) Mirror 7: 0x76657ea8 (stale) Mirror 8: 0x76657ea8 (stale) Mirror 9: 0x76657ea8 (stale) Mirror 13: 0x76657ea8 (stale) Mirror 14: 0x76657ea8 (stale) CRC-32 checksum value for chunk [0, 0x7e80): Mirror 1: 0x6443aec6 Mirror 15: 0x6443aec6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7e80: skipped 000529 1787386617.991735 write 0x0209e4 thru 0x022a24 (0x2041 bytes) 000530 1787386618.081591 trunc from 0x022a25 to 0x02babc (0x9098 bytes) 000531 1787386618.103024 trunc from 0x02babd to 0x011dec (0x19cd0 bytes) 000532 1787386618.120474 mapread 0x0097f1 thru 0x011dec (0x85fc bytes) 000533 1787386618.141068 trunc from 0x011ded to 0x004c1e (0xd1ce bytes) 000534 1787386618.159350 MIRROR_RESYNC 10 mirrors 000536 1787386619.436143 write 0x02f189 thru 0x03ac88 (0xbb00 bytes) 000539 1787386619.494682 read 0x016ca6 thru 0x01d524 (0x687f bytes) 000540 1787386619.505408 mapread 0x015fad thru 0x0207de (0xa832 bytes) 000543 1787386619.522038 MIRROR_RESYNC 10 mirrors 000548 1787386620.831634 write 0x0271f7 thru 0x02a165 (0x2f6f bytes) 000549 1787386620.896029 trunc from 0x03ac89 to 0x0333f0 (0x7898 bytes) 000550 1787386620.915421 read 0x003a83 thru 0x00a78a (0x6d08 bytes) 000551 1787386620.925501 read 0x025988 thru 0x033178 (0xd7f1 bytes) 000552 1787386620.935014 write 0x027692 thru 0x035b48 (0xe4b7 bytes) 000554 1787386620.942534 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x35b49): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b49): Mirror 2: 0xbf0ba4bd (stale) Mirror 4: 0xbf0ba4bd (stale) Mirror 5: 0xbf0ba4bd (stale) Mirror 7: 0xbf0ba4bd (stale) Mirror 8: 0xbf0ba4bd (stale) Mirror 9: 0xbf0ba4bd (stale) Mirror 13: 0xbf0ba4bd (stale) Mirror 14: 0xbf0ba4bd (stale) Mirror 15: 0xbf0ba4bd (stale) CRC-32 checksum value for chunk [0, 0x35b49): Mirror 1: 0xd230bbae Mirror 16: 0xd230bbae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b49: skipped 000555 1787386621.773079 write 0x003b40 thru 0x00cdd7 (0x9298 bytes) 000556 1787386621.841785 read 0x01c46a thru 0x01cca1 (0x838 bytes) 000557 1787386621.853943 write 0x033772 thru 0x039f0e (0x679d bytes) 000559 1787386621.863708 mapread 0x007917 thru 0x00e0a5 (0x678f bytes) 000562 1787386621.876466 mapwrite 0x00498c thru 0x009d4e (0x53c3 bytes) 000563 1787386621.957375 trunc from 0x039f0f to 0x03310d (0x6e01 bytes) 000565 1787386621.993110 write 0x003fc1 thru 0x00c9e5 (0x8a25 bytes) 000567 1787386621.997349 write 0x013646 thru 0x01bb57 (0x8512 bytes) 000568 1787386622.015544 write 0x008510 thru 0x010fab (0x8a9c bytes) 000569 1787386622.021009 trunc from 0x03310e to 0x019e89 (0x19284 bytes) 000573 1787386622.047461 read 0x018fd5 thru 0x019e89 (0xeb5 bytes) 000574 1787386622.048256 read 0x00b9b1 thru 0x011393 (0x59e3 bytes) 000575 1787386622.055064 mapread 0x005e11 thru 0x007bef (0x1ddf bytes) 000576 1787386622.056638 write 0x025be7 thru 0x029554 (0x396e bytes) 000578 1787386622.059116 read 0x019113 thru 0x01c004 (0x2ef2 bytes) 000580 1787386622.067095 mapread 0x012909 thru 0x0185c9 (0x5cc1 bytes) 000584 1787386622.072002 mapread 0x01aff1 thru 0x029554 (0xe564 bytes) 000586 1787386622.075043 read 0x021d52 thru 0x02494e (0x2bfd bytes) 000587 1787386622.080292 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29555): Mirror 2: 0xbe352647 (stale) Mirror 4: 0xbe352647 (stale) Mirror 5: 0xbe352647 (stale) Mirror 7: 0xbe352647 (stale) Mirror 8: 0xbe352647 (stale) Mirror 13: 0xbe352647 (stale) Mirror 14: 0xbe352647 (stale) Mirror 15: 0xbe352647 (stale) Mirror 16: 0x54dffbbd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29555): Mirror 2: 0xbe352647 (stale) Mirror 4: 0xbe352647 (stale) Mirror 5: 0xbe352647 (stale) Mirror 7: 0xbe352647 (stale) Mirror 8: 0xbe352647 (stale) Mirror 13: 0xbe352647 (stale) Mirror 14: 0xbe352647 (stale) Mirror 15: 0xbe352647 (stale) Mirror 16: 0x54dffbbd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29555: skipped 000589 1787386622.713747 mapread 0x001d85 thru 0x007fb5 (0x6231 bytes) 000590 1787386622.735077 trunc from 0x029555 to 0x01c924 (0xcc30 bytes) 000591 1787386622.749644 read 0x003654 thru 0x003dba (0x767 bytes) 000592 1787386622.750853 mapwrite 0x02059b thru 0x02a01b (0x9a81 bytes) 000593 1787386622.829039 trunc from 0x02a01c to 0x03ae10 (0x10df5 bytes) 000595 1787386622.848305 trunc from 0x03ae11 to 0x01ce77 (0x1df99 bytes) 000596 1787386622.872060 write 0x017362 thru 0x01d43d (0x60dc bytes) 000599 1787386622.882051 write 0x007483 thru 0x00dc02 (0x6780 bytes) 000601 1787386622.885142 read 0x013d7b thru 0x01a9d6 (0x6c5c bytes) 000603 1787386622.896005 read 0x00b33c thru 0x00e23d (0x2f02 bytes) 000604 1787386622.900098 MIRROR_RESYNC 10 mirrors 000605 1787386624.206925 trunc from 0x01d43e to 0x00174a (0x1bcf3 bytes) 000606 1787386624.283368 read 0x0002f6 thru 0x00174a (0x1455 bytes) 000608 1787386624.291138 trunc from 0x00174b to 0x017a86 (0x1633c bytes) 000609 1787386624.318302 write 0x033be8 thru 0x03f2ef (0xb708 bytes) 000610 1787386624.333859 trunc from 0x03f2f0 to 0x034a93 (0xa85c bytes) 000611 1787386624.387796 mapwrite 0x03a1bb thru 0x03b242 (0x1088 bytes) 000613 1787386624.493803 write 0x00506d thru 0x00d303 (0x8297 bytes) 000615 1787386624.506755 mapread 0x01271a thru 0x021e44 (0xf72b bytes) 000618 1787386624.532842 mapwrite 0x0146e4 thru 0x01eefb (0xa818 bytes) 000620 1787386624.639404 mapread 0x0222ab thru 0x02dd0b (0xba61 bytes) 000621 1787386624.665361 mapread 0x0060ff thru 0x00d2b4 (0x71b6 bytes) 000622 1787386624.666704 mapwrite 0x0238a6 thru 0x02728c (0x39e7 bytes) 000624 1787386624.734886 mapwrite 0x02febf thru 0x03d471 (0xd5b3 bytes) 000625 1787386624.872273 mapwrite 0x00ab66 thru 0x00c1d0 (0x166b bytes) 000628 1787386624.929302 write 0x02039b thru 0x02c020 (0xbc86 bytes) 000629 1787386624.930763 mapwrite 0x006b2d thru 0x00f914 (0x8de8 bytes) 000631 1787386625.010053 mapwrite 0x0372b5 thru 0x03ffff (0x8d4b bytes) 000632 1787386625.084918 mapwrite 0x03fb24 thru 0x03ffff (0x4dc bytes) 000634 1787386625.124816 mapread 0x0022cc thru 0x009db2 (0x7ae7 bytes) 000635 1787386625.131448 write 0x000935 thru 0x004d19 (0x43e5 bytes) 000637 1787386625.136963 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x485621ab (stale) Mirror 4: 0x485621ab (stale) Mirror 5: 0x485621ab (stale) Mirror 7: 0x485621ab (stale) Mirror 8: 0x485621ab (stale) Mirror 13: 0x485621ab (stale) Mirror 14: 0x485621ab (stale) Mirror 15: 0x485621ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x485621ab (stale) Mirror 4: 0x485621ab (stale) Mirror 5: 0x485621ab (stale) Mirror 7: 0x485621ab (stale) Mirror 8: 0x485621ab (stale) Mirror 13: 0x485621ab (stale) Mirror 14: 0x485621ab (stale) Mirror 15: 0x485621ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000638 1787386625.672457 read 0x009059 thru 0x014298 (0xb240 bytes) 000641 1787386625.684872 mapwrite 0x004139 thru 0x00c36e (0x8236 bytes) 000642 1787386625.806109 MIRROR_RESYNC 9 mirrors 000643 1787386627.233522 read 0x037121 thru 0x037acb (0x9ab bytes) truncating to largest ever: 0x3e797 000646 1787386627.239365 trunc from 0x040000 to 0x03e796 (0x1869 bytes) 000647 1787386627.318933 read 0x00be54 thru 0x01031e (0x44cb bytes) 000651 1787386627.332581 trunc from 0x03e797 to 0x03bffb (0x279b bytes) 000652 1787386627.358790 read 0x032f80 thru 0x0357eb (0x286c bytes) 000654 1787386627.365081 MIRROR_RESYNC 9 mirrors 000655 1787386628.653957 mapread 0x001b77 thru 0x0095ec (0x7a76 bytes) 000656 1787386628.684126 read 0x0099d8 thru 0x010bc6 (0x71ef bytes) 000657 1787386628.689512 MIRROR_RESYNC 9 mirrors 000659 1787386629.237859 mapwrite 0x006c19 thru 0x0133ea (0xc7d2 bytes) 000660 1787386629.444202 mapwrite 0x006be4 thru 0x011740 (0xab5d bytes) 000662 1787386629.497225 write 0x01506b thru 0x01c599 (0x752f bytes) 000663 1787386629.509372 mapwrite 0x03626a thru 0x03ad0e (0x4aa5 bytes) 000664 1787386629.562623 mapread 0x033efb thru 0x0349e4 (0xaea bytes) 000666 1787386629.564812 mapwrite 0x005421 thru 0x012d71 (0xd951 bytes) 000667 1787386629.617329 write 0x013b45 thru 0x01ddb3 (0xa26f bytes) 000670 1787386629.626148 mapread 0x036cd7 thru 0x03b38f (0x46b9 bytes) 000672 1787386629.628967 mapread 0x006cfa thru 0x012e89 (0xc190 bytes) 000674 1787386629.631917 trunc from 0x03bffc to 0x028124 (0x13ed7 bytes) 000675 1787386629.664724 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28125): Mirror 2: 0x6e8a1729 (stale) Mirror 4: 0x6e8a1729 (stale) Mirror 5: 0x6e8a1729 (stale) Mirror 7: 0x6e8a1729 (stale) Mirror 8: 0x6e8a1729 (stale) Mirror 13: 0x6e8a1729 (stale) Mirror 14: 0x6e8a1729 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28125): Mirror 2: 0x6e8a1729 (stale) Mirror 4: 0x6e8a1729 (stale) Mirror 5: 0x6e8a1729 (stale) Mirror 7: 0x6e8a1729 (stale) Mirror 8: 0x6e8a1729 (stale) Mirror 13: 0x6e8a1729 (stale) Mirror 14: 0x6e8a1729 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28125: skipped 000676 1787386630.334694 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x28125): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28125): Mirror 2: 0x6e8a1729 (stale) Mirror 4: 0x6e8a1729 (stale) Mirror 5: 0x6e8a1729 (stale) Mirror 7: 0x6e8a1729 (stale) Mirror 8: 0x6e8a1729 (stale) Mirror 13: 0x6e8a1729 (stale) Mirror 14: 0x6e8a1729 (stale) CRC-32 checksum value for chunk [0, 0x28125): Mirror 1: 0xa0eef7fe Mirror 15: 0xa0eef7fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28125: skipped 000677 1787386631.660663 mapwrite 0x02ec72 thru 0x03b05d (0xc3ec bytes) 000681 1787386631.835301 write 0x006dca thru 0x01453d (0xd774 bytes) 000682 1787386631.848171 trunc from 0x03b05e to 0x034b08 (0x6555 bytes) 000683 1787386631.870476 mapread 0x02522a thru 0x02c06c (0x6e43 bytes) 000684 1787386631.884231 MIRROR_RESYNC 9 mirrors 000687 1787386633.451802 mapread 0x016bd6 thru 0x01d8ea (0x6d15 bytes) 000688 1787386633.483707 write 0x022207 thru 0x02ceee (0xace8 bytes) 000689 1787386633.579812 trunc from 0x034b09 to 0x01e3a6 (0x16762 bytes) 000691 1787386633.599586 mapwrite 0x02e85e thru 0x030b87 (0x232a bytes) 000694 1787386633.669923 trunc from 0x030b88 to 0x01948c (0x176fb bytes) 000695 1787386633.694154 mapread 0x01126b thru 0x01948c (0x8222 bytes) 000696 1787386633.704053 trunc from 0x01948d to 0x0343e3 (0x1af57 bytes) 000699 1787386633.718028 trunc from 0x0343e4 to 0x00a939 (0x29aaa bytes) 000700 1787386633.736691 mapwrite 0x001691 thru 0x00e209 (0xcb79 bytes) 000703 1787386633.823114 write 0x036d5e thru 0x03ffff (0x92a2 bytes) 000704 1787386633.827730 mapread 0x009c0c thru 0x014abe (0xaeb3 bytes) 000705 1787386633.850140 read 0x0014f3 thru 0x01104b (0xfb59 bytes) 000708 1787386633.861775 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xcda08528 (stale) Mirror 4: 0xcda08528 (stale) Mirror 5: 0xcda08528 (stale) Mirror 7: 0xcda08528 (stale) Mirror 8: 0xcda08528 (stale) Mirror 13: 0xcda08528 (stale) Mirror 14: 0xcda08528 (stale) Mirror 15: 0xcda08528 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc4d4a351 Mirror 16: 0xc4d4a351 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000709 1787386634.963941 write 0x009b3c thru 0x018785 (0xec4a bytes) 000717 1787386635.056947 mapread 0x02509b thru 0x03474e (0xf6b4 bytes) 000719 1787386635.124076 mapread 0x02d9e8 thru 0x03a010 (0xc629 bytes) 000723 1787386635.157136 trunc from 0x040000 to 0x0147bb (0x2b844 bytes) 000725 1787386635.189438 MIRROR_RESYNC 10 mirrors 000726 1787386636.269321 mapread 0x008b46 thru 0x00c2a6 (0x3761 bytes) 000728 1787386636.285621 mapread 0x00b174 thru 0x0147bb (0x9648 bytes) 000729 1787386636.290469 write 0x03035c thru 0x03848d (0x8132 bytes) 000732 1787386636.336136 trunc from 0x03848e to 0x016a0f (0x21a7e bytes) 000733 1787386636.348534 mapread 0x0086d8 thru 0x01461e (0xbf47 bytes) 000734 1787386636.362000 trunc from 0x016a10 to 0x038e5e (0x2244f bytes) 000735 1787386636.373839 mapwrite 0x022e5c thru 0x02f028 (0xc1cd bytes) 000736 1787386636.434608 mapread 0x00e6c8 thru 0x01ba42 (0xd37b bytes) 000737 1787386636.439086 mapread 0x000e25 thru 0x00cdfe (0xbfda bytes) 000738 1787386636.442533 write 0x01440e thru 0x018293 (0x3e86 bytes) 000739 1787386636.443523 read 0x025849 thru 0x02e6cd (0x8e85 bytes) 000741 1787386636.444644 trunc from 0x038e5f to 0x020090 (0x18dce bytes) 000744 1787386636.456569 read 0x00fc6e thru 0x017507 (0x789a bytes) 000745 1787386636.457102 mapwrite 0x023f28 thru 0x02cd36 (0x8e0f bytes) 000746 1787386636.510800 mapwrite 0x035e49 thru 0x03fa2b (0x9be3 bytes) 000747 1787386636.552887 trunc from 0x03fa2c to 0x0358e7 (0xa144 bytes) 000748 1787386636.571742 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x358e8): Mirror 2: 0x375977a9 (stale) Mirror 4: 0x375977a9 (stale) Mirror 5: 0x375977a9 (stale) Mirror 7: 0x375977a9 (stale) Mirror 8: 0x375977a9 (stale) Mirror 13: 0x375977a9 (stale) Mirror 14: 0x375977a9 (stale) Mirror 15: 0x375977a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x358e8): Mirror 2: 0x375977a9 (stale) Mirror 4: 0x375977a9 (stale) Mirror 5: 0x375977a9 (stale) Mirror 7: 0x375977a9 (stale) Mirror 8: 0x375977a9 (stale) Mirror 13: 0x375977a9 (stale) Mirror 14: 0x375977a9 (stale) Mirror 15: 0x375977a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x358e8: skipped 000749 1787386636.881653 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x358e8): Mirror 2: 0x375977a9 (stale) Mirror 4: 0x375977a9 (stale) Mirror 5: 0x375977a9 (stale) Mirror 7: 0x375977a9 (stale) Mirror 13: 0x375977a9 (stale) Mirror 14: 0x375977a9 (stale) Mirror 15: 0x375977a9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x358e8): Mirror 2: 0x375977a9 (stale) Mirror 4: 0x375977a9 (stale) Mirror 5: 0x375977a9 (stale) Mirror 7: 0x375977a9 (stale) Mirror 13: 0x375977a9 (stale) Mirror 14: 0x375977a9 (stale) Mirror 15: 0x375977a9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x358e8: skipped 000750 1787386637.255148 mapread 0x005504 thru 0x0139c0 (0xe4bd bytes) 000751 1787386637.274566 mapread 0x013822 thru 0x020dca (0xd5a9 bytes) 000753 1787386637.281418 mapread 0x026b29 thru 0x034cc2 (0xe19a bytes) 000755 1787386637.295269 trunc from 0x0358e8 to 0x021d89 (0x13b5e bytes) 000757 1787386637.324010 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21d8a): Mirror 2: 0x68237cd6 (stale) Mirror 5: 0x68237cd6 (stale) Mirror 7: 0x68237cd6 (stale) Mirror 13: 0x68237cd6 (stale) Mirror 14: 0x68237cd6 (stale) Mirror 15: 0x68237cd6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21d8a): Mirror 2: 0x68237cd6 (stale) Mirror 5: 0x68237cd6 (stale) Mirror 7: 0x68237cd6 (stale) Mirror 13: 0x68237cd6 (stale) Mirror 14: 0x68237cd6 (stale) Mirror 15: 0x68237cd6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21d8a: skipped 000758 1787386637.706946 read 0x01e484 thru 0x021d89 (0x3906 bytes) 000759 1787386637.712942 trunc from 0x021d8a to 0x01ded4 (0x3eb5 bytes) 000763 1787386637.739839 read 0x002df3 thru 0x00d4fb (0xa709 bytes) 000764 1787386637.757067 write 0x0276d5 thru 0x0295e1 (0x1f0d bytes) 000765 1787386637.759774 trunc from 0x0295e2 to 0x02f899 (0x62b8 bytes) 000766 1787386637.776767 write 0x02587f thru 0x02e3d2 (0x8b54 bytes) 000770 1787386637.795101 read 0x02ba10 thru 0x02eab5 (0x30a6 bytes) 000772 1787386637.798123 read 0x01d91e thru 0x02713f (0x9822 bytes) 000773 1787386637.804095 MIRROR_RESYNC 7 mirrors 000774 1787386639.056509 mapwrite 0x02f7b8 thru 0x0376f1 (0x7f3a bytes) 000775 1787386639.235074 mapwrite 0x039e33 thru 0x03ffff (0x61cd bytes) 000778 1787386639.321087 mapwrite 0x03fd9d thru 0x03ffff (0x263 bytes) 000780 1787386639.349299 write 0x03bb39 thru 0x03ffff (0x44c7 bytes) 000781 1787386639.350474 mapwrite 0x01913a thru 0x01a6e4 (0x15ab bytes) 000782 1787386639.406057 trunc from 0x040000 to 0x00792d (0x386d2 bytes) 000783 1787386639.424103 mapread 0x00228c thru 0x003c36 (0x19ab bytes) 000786 1787386639.439000 write 0x02a43a thru 0x03329a (0x8e61 bytes) 000787 1787386639.445496 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3329b): Mirror 2: 0x584d1a8e (stale) Mirror 5: 0x584d1a8e (stale) Mirror 7: 0x584d1a8e (stale) Mirror 13: 0x584d1a8e (stale) Mirror 14: 0x584d1a8e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3329b): Mirror 2: 0x584d1a8e (stale) Mirror 5: 0x584d1a8e (stale) Mirror 7: 0x584d1a8e (stale) Mirror 13: 0x584d1a8e (stale) Mirror 14: 0x584d1a8e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3329b: skipped 000789 1787386639.748425 mapwrite 0x03e688 thru 0x03ffff (0x1978 bytes) 000791 1787386639.790138 read 0x01ae2a thru 0x02135c (0x6533 bytes) 000793 1787386639.798046 mapread 0x03566b thru 0x03fa3f (0xa3d5 bytes) 000794 1787386639.804100 trunc from 0x040000 to 0x00891a (0x376e5 bytes) 000795 1787386639.812379 mapread 0x0036c8 thru 0x00891a (0x5253 bytes) 000798 1787386639.819278 trunc from 0x00891b to 0x01d5da (0x14cc0 bytes) 000799 1787386639.827831 write 0x0121b1 thru 0x01ca1a (0xa86a bytes) 000800 1787386639.832802 write 0x02de5c thru 0x0320b6 (0x425b bytes) 000801 1787386639.834451 write 0x0031d1 thru 0x00534d (0x217d bytes) 000803 1787386639.835568 mapread 0x02811e thru 0x02f396 (0x7279 bytes) 000804 1787386639.842497 MIRROR_RESYNC 6 mirrors 000805 1787386640.606744 mapwrite 0x01134e thru 0x019032 (0x7ce5 bytes) 000808 1787386640.716308 read 0x02223c thru 0x025e0f (0x3bd4 bytes) 000809 1787386640.721046 trunc from 0x0320b7 to 0x014438 (0x1dc7e bytes) 000810 1787386640.733892 write 0x01f142 thru 0x029960 (0xa81f bytes) 000811 1787386640.735085 mapread 0x01129d thru 0x01af31 (0x9c95 bytes) 000812 1787386640.745151 MIRROR_RESYNC 6 mirrors 000813 1787386641.616734 write 0x01f663 thru 0x027dac (0x874a bytes) 000814 1787386641.694311 mapread 0x002895 thru 0x002b0c (0x278 bytes) 000815 1787386641.703731 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29961): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29961): Mirror 2: 0x42da8334 (stale) Mirror 5: 0x42da8334 (stale) Mirror 7: 0x42da8334 (stale) Mirror 13: 0x42da8334 (stale) Mirror 14: 0x42da8334 (stale) CRC-32 checksum value for chunk [0, 0x29961): Mirror 1: 0x453aa5ee Mirror 15: 0x453aa5ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29961: skipped 000819 1787386642.755355 mapwrite 0x03a636 thru 0x03ffff (0x59ca bytes) 000823 1787386642.901469 trunc from 0x040000 to 0x023d52 (0x1c2ad bytes) truncating to largest ever: 0x3eda6 000827 1787386642.938307 trunc from 0x023d53 to 0x03eda5 (0x1b053 bytes) 000828 1787386642.960905 MIRROR_RESYNC 7 mirrors 000829 1787386644.204758 mapread 0x00d46f thru 0x00ff8a (0x2b1c bytes) 000831 1787386644.224064 write 0x00359a thru 0x00e9c0 (0xb427 bytes) 000834 1787386644.308833 write 0x02993f thru 0x0360ec (0xc7ae bytes) 000836 1787386644.319828 trunc from 0x03eda6 to 0x0348fe (0xa4a7 bytes) 000838 1787386644.346886 read 0x0242b4 thru 0x0335bd (0xf30a bytes) 000839 1787386644.356913 trunc from 0x0348ff to 0x019c54 (0x1acaa bytes) 000844 1787386644.377010 write 0x0188ee thru 0x02805e (0xf771 bytes) 000845 1787386644.387432 read 0x00860a thru 0x01458b (0xbf82 bytes) 000846 1787386644.399419 mapread 0x00e414 thru 0x010285 (0x1e72 bytes) 000847 1787386644.400537 mapwrite 0x01f69c thru 0x029424 (0x9d89 bytes) 000849 1787386644.495501 mapwrite 0x01c86b thru 0x022c03 (0x6399 bytes) 000851 1787386644.579059 mapwrite 0x00fc8e thru 0x010de1 (0x1154 bytes) 000852 1787386644.611753 read 0x015661 thru 0x0179ff (0x239f bytes) 000854 1787386644.613803 write 0x03e94f thru 0x03ffff (0x16b1 bytes) 000855 1787386644.615244 mapwrite 0x025171 thru 0x032746 (0xd5d6 bytes) 000856 1787386644.690833 mapread 0x03f56c thru 0x03ffff (0xa94 bytes) 000857 1787386644.693029 write 0x02f484 thru 0x03ba64 (0xc5e1 bytes) 000858 1787386644.695120 trunc from 0x040000 to 0x026fb9 (0x19046 bytes) 000859 1787386644.716491 trunc from 0x026fba to 0x01bec2 (0xb0f7 bytes) 000860 1787386644.735301 mapread 0x0100c1 thru 0x0138c8 (0x3808 bytes) 000861 1787386644.744466 MIRROR_RESYNC 7 mirrors 000862 1787386646.144727 mapwrite 0x00863e thru 0x00955b (0xf1e bytes) 000863 1787386646.447665 read 0x00aae2 thru 0x00dfe7 (0x3506 bytes) 000867 1787386646.461517 write 0x02c4ee thru 0x0311ed (0x4d00 bytes) 000871 1787386646.468685 write 0x01b41e thru 0x0289a2 (0xd585 bytes) 000872 1787386646.504377 write 0x036490 thru 0x03f433 (0x8fa4 bytes) 000873 1787386646.507608 write 0x02ce50 thru 0x035208 (0x83b9 bytes) 000874 1787386646.536397 mapwrite 0x0373f8 thru 0x03ffff (0x8c08 bytes) 000875 1787386646.625654 trunc from 0x040000 to 0x02f3d0 (0x10c2f bytes) 000876 1787386646.653712 trunc from 0x02f3d1 to 0x0359d1 (0x6601 bytes) 000878 1787386646.702284 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x359d2): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x359d2): Mirror 2: 0xf2630abd (stale) Mirror 5: 0xf2630abd (stale) Mirror 7: 0xf2630abd (stale) Mirror 13: 0xf2630abd (stale) Mirror 14: 0xf2630abd (stale) Mirror 15: 0xf2630abd (stale) CRC-32 checksum value for chunk [0, 0x359d2): Mirror 1: 0xbe48bf54 Mirror 16: 0xbe48bf54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x359d2: skipped 000879 1787386648.011910 read 0x02317f thru 0x032cc2 (0xfb44 bytes) 000880 1787386648.061038 write 0x00931b thru 0x00d017 (0x3cfd bytes) 000884 1787386648.210993 read 0x00a5f9 thru 0x00e6df (0x40e7 bytes) 000887 1787386648.228654 mapwrite 0x0169c5 thru 0x024311 (0xd94d bytes) 000889 1787386648.319247 read 0x0269ff thru 0x02a50e (0x3b10 bytes) 000890 1787386648.319912 write 0x030da7 thru 0x037d65 (0x6fbf bytes) 000891 1787386648.321066 write 0x030de1 thru 0x03cd8f (0xbfaf bytes) 000892 1787386648.331162 mapwrite 0x022987 thru 0x02ffdc (0xd656 bytes) 000893 1787386648.410280 trunc from 0x03cd90 to 0x00d355 (0x2fa3a bytes) 000894 1787386648.435934 mapread 0x00251f thru 0x00d355 (0xae37 bytes) 000899 1787386648.451644 read 0x00a913 thru 0x00d355 (0x2a43 bytes) 000900 1787386648.456402 mapwrite 0x03d8a3 thru 0x03ffff (0x275d bytes) 000901 1787386648.567027 write 0x00d022 thru 0x00ffe6 (0x2fc5 bytes) 000907 1787386648.576672 read 0x033a9a thru 0x03e13d (0xa6a4 bytes) 000908 1787386648.580512 write 0x015c2d thru 0x0172fa (0x16ce bytes) 000909 1787386648.592931 MIRROR_RESYNC 8 mirrors 000911 1787386650.099067 mapwrite 0x026d88 thru 0x02c083 (0x52fc bytes) 000912 1787386650.243159 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x12dd924e (stale) Mirror 5: 0x12dd924e (stale) Mirror 7: 0x12dd924e (stale) Mirror 13: 0x12dd924e (stale) Mirror 14: 0x12dd924e (stale) Mirror 15: 0x12dd924e (stale) Mirror 16: 0x12dd924e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7ae8fded Mirror 17: 0x7ae8fded lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000916 1787386651.275000 mapread 0x02d143 thru 0x033f18 (0x6dd6 bytes) 000918 1787386651.364027 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x12dd924e (stale) Mirror 5: 0x12dd924e (stale) Mirror 7: 0x12dd924e (stale) Mirror 13: 0x12dd924e (stale) Mirror 14: 0x12dd924e (stale) Mirror 15: 0x12dd924e (stale) Mirror 16: 0x12dd924e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7ae8fded Mirror 17: 0x7ae8fded Mirror 18: 0x7ae8fded lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000920 1787386652.458878 mapwrite 0x03df72 thru 0x03ffff (0x208e bytes) 000921 1787386652.670264 mapwrite 0x011500 thru 0x014853 (0x3354 bytes) 000922 1787386652.727725 mapread 0x005ec9 thru 0x008b17 (0x2c4f bytes) 000926 1787386652.743639 mapread 0x0006be thru 0x00f3c7 (0xed0a bytes) 000927 1787386652.753608 mapread 0x03c1d6 thru 0x03ffff (0x3e2a bytes) 000928 1787386652.754772 trunc from 0x040000 to 0x0283df (0x17c20 bytes) 000929 1787386652.786953 mapread 0x00645d thru 0x010b40 (0xa6e4 bytes) 000931 1787386652.789758 trunc from 0x0283e0 to 0x01cf1f (0xb4c0 bytes) 000932 1787386652.809559 trunc from 0x01cf20 to 0x03b97b (0x1ea5c bytes) 000933 1787386652.857615 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b97c): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b97c): Mirror 2: 0xeb2bdcb1 (stale) Mirror 5: 0xeb2bdcb1 (stale) Mirror 7: 0xeb2bdcb1 (stale) Mirror 13: 0xeb2bdcb1 (stale) Mirror 14: 0xeb2bdcb1 (stale) Mirror 15: 0xeb2bdcb1 (stale) Mirror 16: 0xeb2bdcb1 (stale) Mirror 17: 0xeae4ded4 (stale) Mirror 18: 0xeae4ded4 (stale) CRC-32 checksum value for chunk [0, 0x3b97c): Mirror 1: 0x9d32c773 Mirror 19: 0x9d32c773 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b97c: skipped 000936 1787386654.254890 trunc from 0x03b97c to 0x02176e (0x1a20d bytes) 000937 1787386654.349752 trunc from 0x02176f to 0x02f931 (0xe1c3 bytes) 000938 1787386654.378505 MIRROR_RESYNC 11 mirrors 000939 1787386656.362330 mapread 0x02a16e thru 0x02f931 (0x57c4 bytes) 000940 1787386656.398681 mapread 0x028dcd thru 0x029998 (0xbcc bytes) 000941 1787386656.399628 trunc from 0x02f932 to 0x001cad (0x2dc84 bytes) truncating to largest ever: 0x3fdb1 000942 1787386656.509451 trunc from 0x001cae to 0x03fdb0 (0x3e103 bytes) 000943 1787386656.540119 read 0x0270b2 thru 0x02ef98 (0x7ee7 bytes) 000944 1787386656.560792 mapread 0x0015aa thru 0x00b7bf (0xa216 bytes) 000946 1787386656.586723 trunc from 0x03fdb1 to 0x00325f (0x3cb51 bytes) 000947 1787386656.610899 write 0x03e222 thru 0x03ffff (0x1dde bytes) 000948 1787386656.618616 mapwrite 0x0256ec thru 0x02eff5 (0x990a bytes) 000951 1787386656.759708 mapread 0x003434 thru 0x004101 (0xcce bytes) 000952 1787386656.799896 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb77c4b7c (stale) Mirror 5: 0xb77c4b7c (stale) Mirror 7: 0xb77c4b7c (stale) Mirror 13: 0xb77c4b7c (stale) Mirror 14: 0xb77c4b7c (stale) Mirror 15: 0xb77c4b7c (stale) Mirror 16: 0xb77c4b7c (stale) Mirror 17: 0xb77c4b7c (stale) Mirror 18: 0xb77c4b7c (stale) Mirror 19: 0xb77c4b7c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x679246b8 Mirror 20: 0x679246b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000953 1787386658.121340 mapwrite 0x0249f9 thru 0x03474c (0xfd54 bytes) 000956 1787386658.556259 MIRROR_RESYNC 12 mirrors 000957 1787386660.830647 trunc from 0x040000 to 0x015c0d (0x2a3f2 bytes) 000958 1787386660.933746 read 0x002b67 thru 0x00bec1 (0x935b bytes) 000962 1787386660.966517 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15c0e): Mirror 2: 0x914625e1 (stale) Mirror 5: 0x914625e1 (stale) Mirror 7: 0x914625e1 (stale) Mirror 14: 0x914625e1 (stale) Mirror 15: 0x914625e1 (stale) Mirror 16: 0x914625e1 (stale) Mirror 17: 0x914625e1 (stale) Mirror 18: 0x914625e1 (stale) Mirror 19: 0x914625e1 (stale) Mirror 20: 0x914625e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15c0e): Mirror 2: 0x914625e1 (stale) Mirror 5: 0x914625e1 (stale) Mirror 7: 0x914625e1 (stale) Mirror 14: 0x914625e1 (stale) Mirror 15: 0x914625e1 (stale) Mirror 16: 0x914625e1 (stale) Mirror 17: 0x914625e1 (stale) Mirror 18: 0x914625e1 (stale) Mirror 19: 0x914625e1 (stale) Mirror 20: 0x914625e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15c0e: skipped 000963 1787386661.464350 MIRROR_RESYNC 11 mirrors 000965 1787386663.077806 write 0x01d8da thru 0x02c52a (0xec51 bytes) 000966 1787386663.202109 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2c52b): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c52b): Mirror 2: 0xb4a8269e (stale) Mirror 5: 0xb4a8269e (stale) Mirror 7: 0xb4a8269e (stale) Mirror 14: 0xb4a8269e (stale) Mirror 15: 0xb4a8269e (stale) Mirror 16: 0xb4a8269e (stale) Mirror 17: 0xb4a8269e (stale) Mirror 18: 0xb4a8269e (stale) Mirror 19: 0xb4a8269e (stale) Mirror 20: 0xb4a8269e (stale) CRC-32 checksum value for chunk [0, 0x2c52b): Mirror 1: 0x69c00403 Mirror 21: 0x69c00403 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c52b: skipped 000967 1787386664.519947 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2c52b): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c52b): Mirror 2: 0xb4a8269e (stale) Mirror 5: 0xb4a8269e (stale) Mirror 7: 0xb4a8269e (stale) Mirror 14: 0xb4a8269e (stale) Mirror 15: 0xb4a8269e (stale) Mirror 16: 0xb4a8269e (stale) Mirror 17: 0xb4a8269e (stale) Mirror 18: 0xb4a8269e (stale) Mirror 19: 0xb4a8269e (stale) Mirror 20: 0xb4a8269e (stale) CRC-32 checksum value for chunk [0, 0x2c52b): Mirror 1: 0x69c00403 Mirror 21: 0x69c00403 Mirror 22: 0x69c00403 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c52b: skipped 000969 1787386665.541535 write 0x00b6ef thru 0x018e3e (0xd750 bytes) 000970 1787386665.647689 read 0x01f670 thru 0x024e86 (0x5817 bytes) 000974 1787386665.662333 read 0x006666 thru 0x013a20 (0xd3bb bytes) 000975 1787386665.703822 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a0:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c52b): Mirror 2: 0xb4a8269e (stale) Mirror 5: 0xb4a8269e (stale) Mirror 14: 0xb4a8269e (stale) Mirror 15: 0xb4a8269e (stale) Mirror 16: 0xb4a8269e (stale) Mirror 17: 0xb4a8269e (stale) Mirror 18: 0xb4a8269e (stale) Mirror 19: 0xb4a8269e (stale) Mirror 20: 0xb4a8269e (stale) Mirror 21: 0x69c00403 (stale) Mirror 22: 0x69c00403 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c52b): Mirror 2: 0xb4a8269e (stale) Mirror 5: 0xb4a8269e (stale) Mirror 14: 0xb4a8269e (stale) Mirror 15: 0xb4a8269e (stale) Mirror 16: 0xb4a8269e (stale) Mirror 17: 0xb4a8269e (stale) Mirror 18: 0xb4a8269e (stale) Mirror 19: 0xb4a8269e (stale) Mirror 20: 0xb4a8269e (stale) Mirror 21: 0x69c00403 (stale) Mirror 22: 0x69c00403 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c52b: skipped 000976 1787386666.349084 trunc from 0x02c52b to 0x020cce (0xb85c bytes) 000977 1787386666.376292 read 0x014104 thru 0x01c968 (0x8865 bytes) 000978 1787386666.382614 mapwrite 0x03f49b thru 0x03ffff (0xb65 bytes) 000979 1787386666.484125 write 0x013319 thru 0x014b9d (0x1885 bytes) 000980 1787386666.496110 mapread 0x01f8eb thru 0x0283e4 (0x8afa bytes) 000982 1787386666.516912 write 0x00b9c1 thru 0x00c5fd (0xc3d bytes) 000983 1787386666.542383 mapwrite 0x0133f8 thru 0x019761 (0x636a bytes) 000984 1787386666.586515 write 0x005050 thru 0x0139f0 (0xe9a1 bytes) 000985 1787386666.594021 mapwrite 0x025424 thru 0x03535e (0xff3b bytes) 000987 1787386666.676730 trunc from 0x040000 to 0x007714 (0x388eb bytes) 000988 1787386666.699118 trunc from 0x007715 to 0x034a99 (0x2d385 bytes) 000989 1787386666.754540 read 0x02373c thru 0x02b15b (0x7a20 bytes) 000990 1787386666.772002 read 0x02a6d4 thru 0x02ad93 (0x6c0 bytes) 000991 1787386666.772751 trunc from 0x034a9a to 0x03b51f (0x6a86 bytes) 000994 1787386666.793264 mapwrite 0x0068be thru 0x00e5c8 (0x7d0b bytes) 000995 1787386666.863215 read 0x004565 thru 0x00ca08 (0x84a4 bytes) 000996 1787386666.863946 write 0x0157ad thru 0x0255ff (0xfe53 bytes) 000998 1787386666.867403 write 0x0083ca thru 0x00dd36 (0x596d bytes) 000999 1787386666.869092 trunc from 0x03b520 to 0x03ba1b (0x4fc bytes) All operations completed A-OK!